2024-08-18T20:49:48.894 INFO:root:teuthology version: 1.2.0 2024-08-18T20:49:48.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-18T20:49:49.004 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222 branch: main description: rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-zstd} rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/pool-create-delete} email: ceph-qa@ceph.com first_in_suite: false job_id: '7859222' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client: debug monc: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr1: false ms bind msgr2: true ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: mon ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async mgr: debug mgr: 20 debug monc: 10 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos service trim min: 5 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true bluestore write v2: false bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client ping interval: 4 mon client ping timeout: 12 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(POOL_APP_NOT_ENABLED\) - slow request - overall HEALTH_ sha1: 797669399b32d2915e64eb6d4b1257ae3c50f80b ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 797669399b32d2915e64eb6d4b1257ae3c50f80b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 964adda23da9f7b057cb34fdc0b82aeb7ed65324 owner: scheduled_teuthology@teuthology priority: 101 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mon.d - mon.e - osd.0 - osd.1 - osd.2 - - mon.f - mon.g - mon.h - mon.i - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 1858 sha1: 797669399b32d2915e64eb6d4b1257ae3c50f80b sleep_before_teardown: 0 subset: 29813/100000 suite: rados suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 964adda23da9f7b057cb34fdc0b82aeb7ed65324 targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJMrGfaNFm9vYdCciM1jvqRgVt3TObiZhws4l1mUuYAnCgYdYURrKMPOifWnpntdwmCVl+aNrAQqEQLYJMMsYLk= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBODmfEX4U/3FYbB3IhFDeK9I3OJK35kgGgJvgQwhWMpfP4Jap76H9G2NWwm3lmEjf1/N7CZ6k88LozYA7vQRCDc= tasks: - install: null - ceph: null - mon_thrash: freeze_mon_duration: 20 freeze_mon_probability: 10 revive_delay: 20 thrash_delay: 1 thrash_many: true - exec: client.0: - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-18_20:00:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-18T20:49:49.004 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa; will attempt to use it 2024-08-18T20:49:49.005 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks 2024-08-18T20:49:49.005 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-18T20:49:49.007 INFO:teuthology.task.internal:Checking packages... 2024-08-18T20:49:49.033 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '797669399b32d2915e64eb6d4b1257ae3c50f80b' 2024-08-18T20:49:49.033 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-18T20:49:49.033 INFO:teuthology.packaging:ref: None 2024-08-18T20:49:49.034 INFO:teuthology.packaging:tag: None 2024-08-18T20:49:49.034 INFO:teuthology.packaging:branch: main 2024-08-18T20:49:49.034 INFO:teuthology.packaging:sha1: 797669399b32d2915e64eb6d4b1257ae3c50f80b 2024-08-18T20:49:49.034 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-08-18T20:49:49.266 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-5847-g79766939-1jammy 2024-08-18T20:49:49.267 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-18T20:49:49.273 INFO:teuthology.task.internal:no buildpackages task found 2024-08-18T20:49:49.273 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-18T20:49:49.355 INFO:teuthology.task.internal:Saving configuration 2024-08-18T20:49:49.372 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-18T20:49:49.414 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-18T20:49:49.438 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-18 20:43:40.736389', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHlRVNQ7H2vdFWW7pT+it3nuH1bWtsZIdWVd/7+h3In+'} 2024-08-18T20:49:49.459 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-18 20:43:40.735025', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF5Hg5Qi/ZFrAkdl1i5c/eEl73kG/l0Hr9ehFSGeWpEh'} 2024-08-18T20:49:49.459 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-18T20:49:49.470 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'] 2024-08-18T20:49:49.470 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2024-08-18T20:49:49.470 INFO:teuthology.run_tasks:Running task console_log... 2024-08-18T20:49:49.544 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f867fe40430>, signals=[15]) 2024-08-18T20:49:49.544 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-18T20:49:49.552 INFO:teuthology.task.internal:Opening connections... 2024-08-18T20:49:49.552 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T20:49:49.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T20:49:49.634 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-08-18T20:49:49.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T20:49:49.714 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-18T20:49:49.719 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-08-18T20:49:49.724 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-08-18T20:49:49.724 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-08-18T20:49:49.770 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-08-18T20:49:49.771 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Ubuntu" 2024-08-18T20:49:49.771 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="22.04" 2024-08-18T20:49:49.771 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-08-18T20:49:49.771 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_CODENAME=jammy 2024-08-18T20:49:49.771 INFO:teuthology.orchestra.run.smithi005.stdout:ID=ubuntu 2024-08-18T20:49:49.771 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE=debian 2024-08-18T20:49:49.771 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-18T20:49:49.771 INFO:teuthology.orchestra.run.smithi005.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-18T20:49:49.771 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-18T20:49:49.771 INFO:teuthology.orchestra.run.smithi005.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-18T20:49:49.771 INFO:teuthology.orchestra.run.smithi005.stdout:UBUNTU_CODENAME=jammy 2024-08-18T20:49:49.772 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-08-18T20:49:49.794 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-08-18T20:49:49.800 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-08-18T20:49:49.800 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-08-18T20:49:49.850 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-08-18T20:49:49.850 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu" 2024-08-18T20:49:49.850 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="22.04" 2024-08-18T20:49:49.851 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-08-18T20:49:49.851 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=jammy 2024-08-18T20:49:49.851 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu 2024-08-18T20:49:49.851 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian 2024-08-18T20:49:49.851 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-18T20:49:49.851 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-18T20:49:49.851 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-18T20:49:49.851 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-18T20:49:49.851 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=jammy 2024-08-18T20:49:49.851 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-08-18T20:49:49.877 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-18T20:49:49.886 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-18T20:49:49.913 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-18T20:49:49.913 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-08-18T20:49:49.916 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-08-18T20:49:49.920 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-18T20:49:49.937 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-18T20:49:49.937 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-08-18T20:49:49.964 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-08-18T20:49:49.980 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-18T20:49:50.032 INFO:teuthology.run_tasks:Running task kernel... 2024-08-18T20:49:50.046 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-18T20:49:50.046 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.f': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-18T20:49:50.046 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-18T20:49:50.047 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-18T20:49:50.051 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T20:49:50.051 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-08-18T20:49:50.052 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T20:49:50.052 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-08-18T20:49:50.098 INFO:teuthology.orchestra.run.smithi157.stdout:5.15.0-56-generic 2024-08-18T20:49:50.098 INFO:teuthology.task.kernel:Running kernel on smithi157: 5.15.0-56-generic 2024-08-18T20:49:50.099 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get clean 2024-08-18T20:49:50.100 INFO:teuthology.orchestra.run.smithi005.stdout:5.15.0-56-generic 2024-08-18T20:49:50.100 INFO:teuthology.task.kernel:Running kernel on smithi005: 5.15.0-56-generic 2024-08-18T20:49:50.100 DEBUG:teuthology.orchestra.run.smithi005:> sudo apt-get clean 2024-08-18T20:49:50.217 DEBUG:teuthology.orchestra.run.smithi005:> sudo apt-get update 2024-08-18T20:49:50.236 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-08-18T20:49:50.366 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-18T20:49:50.374 INFO:teuthology.orchestra.run.smithi005.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-08-18T20:49:50.375 INFO:teuthology.orchestra.run.smithi005.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-08-18T20:49:50.439 INFO:teuthology.orchestra.run.smithi005.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-08-18T20:49:50.525 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-18T20:49:50.526 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-08-18T20:49:50.564 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-08-18T20:49:50.622 INFO:teuthology.orchestra.run.smithi005.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [524 kB] 2024-08-18T20:49:50.691 INFO:teuthology.orchestra.run.smithi005.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,729 kB] 2024-08-18T20:49:50.705 INFO:teuthology.orchestra.run.smithi005.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [684 kB] 2024-08-18T20:49:50.730 INFO:teuthology.orchestra.run.smithi005.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [287 kB] 2024-08-18T20:49:50.733 INFO:teuthology.orchestra.run.smithi005.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.2 kB] 2024-08-18T20:49:50.733 INFO:teuthology.orchestra.run.smithi005.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,247 kB] 2024-08-18T20:49:50.749 INFO:teuthology.orchestra.run.smithi005.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.3 kB] 2024-08-18T20:49:50.750 INFO:teuthology.orchestra.run.smithi005.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [388 kB] 2024-08-18T20:49:50.772 INFO:teuthology.orchestra.run.smithi005.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [572 B] 2024-08-18T20:49:50.772 INFO:teuthology.orchestra.run.smithi005.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,948 kB] 2024-08-18T20:49:50.772 INFO:teuthology.orchestra.run.smithi005.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [621 kB] 2024-08-18T20:49:50.777 INFO:teuthology.orchestra.run.smithi005.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [890 kB] 2024-08-18T20:49:50.782 INFO:teuthology.orchestra.run.smithi005.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [175 kB] 2024-08-18T20:49:50.784 INFO:teuthology.orchestra.run.smithi005.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.0 kB] 2024-08-18T20:49:50.784 INFO:teuthology.orchestra.run.smithi005.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-08-18T20:49:50.784 INFO:teuthology.orchestra.run.smithi005.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-08-18T20:49:50.784 INFO:teuthology.orchestra.run.smithi005.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-08-18T20:49:50.785 INFO:teuthology.orchestra.run.smithi005.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-08-18T20:49:50.803 INFO:teuthology.orchestra.run.smithi005.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [345 kB] 2024-08-18T20:49:50.806 INFO:teuthology.orchestra.run.smithi005.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-08-18T20:49:50.806 INFO:teuthology.orchestra.run.smithi005.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,322 kB] 2024-08-18T20:49:50.823 INFO:teuthology.orchestra.run.smithi005.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.9 kB] 2024-08-18T20:49:50.823 INFO:teuthology.orchestra.run.smithi005.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [401 kB] 2024-08-18T20:49:50.826 INFO:teuthology.orchestra.run.smithi005.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2024-08-18T20:49:50.827 INFO:teuthology.orchestra.run.smithi005.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [725 kB] 2024-08-18T20:49:50.832 INFO:teuthology.orchestra.run.smithi005.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,111 kB] 2024-08-18T20:49:50.840 INFO:teuthology.orchestra.run.smithi005.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [259 kB] 2024-08-18T20:49:50.842 INFO:teuthology.orchestra.run.smithi005.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [25.9 kB] 2024-08-18T20:49:50.842 INFO:teuthology.orchestra.run.smithi005.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-08-18T20:49:50.842 INFO:teuthology.orchestra.run.smithi005.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-08-18T20:49:50.858 INFO:teuthology.orchestra.run.smithi005.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-08-18T20:49:50.858 INFO:teuthology.orchestra.run.smithi005.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-08-18T20:49:50.858 INFO:teuthology.orchestra.run.smithi005.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-08-18T20:49:50.858 INFO:teuthology.orchestra.run.smithi005.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-08-18T20:49:50.859 INFO:teuthology.orchestra.run.smithi005.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-08-18T20:49:50.874 INFO:teuthology.orchestra.run.smithi005.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-08-18T20:49:50.874 INFO:teuthology.orchestra.run.smithi005.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-08-18T20:49:50.875 INFO:teuthology.orchestra.run.smithi005.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-08-18T20:49:50.875 INFO:teuthology.orchestra.run.smithi005.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-08-18T20:49:50.875 INFO:teuthology.orchestra.run.smithi005.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-08-18T20:49:50.919 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-08-18T20:49:50.943 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,729 kB] 2024-08-18T20:49:51.059 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [684 kB] 2024-08-18T20:49:51.264 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,948 kB] 2024-08-18T20:49:51.359 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [524 kB] 2024-08-18T20:49:51.376 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [287 kB] 2024-08-18T20:49:51.385 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.2 kB] 2024-08-18T20:49:51.385 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,247 kB] 2024-08-18T20:49:51.409 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [345 kB] 2024-08-18T20:49:51.423 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-08-18T20:49:51.424 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.9 kB] 2024-08-18T20:49:51.425 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,322 kB] 2024-08-18T20:49:51.480 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.3 kB] 2024-08-18T20:49:51.481 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [388 kB] 2024-08-18T20:49:51.502 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [401 kB] 2024-08-18T20:49:51.502 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [572 B] 2024-08-18T20:49:51.502 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [890 kB] 2024-08-18T20:49:51.509 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2024-08-18T20:49:51.509 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,111 kB] 2024-08-18T20:49:51.539 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [621 kB] 2024-08-18T20:49:51.540 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [725 kB] 2024-08-18T20:49:51.550 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [175 kB] 2024-08-18T20:49:51.554 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.0 kB] 2024-08-18T20:49:51.554 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-08-18T20:49:51.554 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-08-18T20:49:51.560 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [259 kB] 2024-08-18T20:49:51.565 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [25.9 kB] 2024-08-18T20:49:51.574 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-08-18T20:49:51.575 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-08-18T20:49:51.575 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-08-18T20:49:51.622 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-08-18T20:49:51.623 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-08-18T20:49:51.648 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-08-18T20:49:51.648 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-08-18T20:49:51.650 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-08-18T20:49:51.651 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-08-18T20:49:51.651 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-08-18T20:49:51.655 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-08-18T20:49:51.656 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-08-18T20:49:51.737 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-08-18T20:49:51.737 INFO:teuthology.orchestra.run.smithi157.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-08-18T20:49:57.198 INFO:teuthology.orchestra.run.smithi005.stdout:Fetched 15.5 MB in 2s (7,165 kB/s) 2024-08-18T20:49:57.539 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 15.5 MB in 3s (5,800 kB/s) 2024-08-18T20:49:58.577 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2024-08-18T20:49:58.594 DEBUG:teuthology.orchestra.run.smithi005:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-18T20:49:58.657 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2024-08-18T20:49:58.866 INFO:teuthology.orchestra.run.smithi005.stdout:Building dependency tree... 2024-08-18T20:49:58.866 INFO:teuthology.orchestra.run.smithi005.stdout:Reading state information... 2024-08-18T20:49:59.022 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-08-18T20:49:59.041 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-18T20:49:59.064 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages were automatically installed and are no longer required: 2024-08-18T20:49:59.064 INFO:teuthology.orchestra.run.smithi005.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-18T20:49:59.064 INFO:teuthology.orchestra.run.smithi005.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-18T20:49:59.065 INFO:teuthology.orchestra.run.smithi005.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-18T20:49:59.065 INFO:teuthology.orchestra.run.smithi005.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-08-18T20:49:59.065 INFO:teuthology.orchestra.run.smithi005.stdout: python2.7-minimal 2024-08-18T20:49:59.065 INFO:teuthology.orchestra.run.smithi005.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-18T20:49:59.067 INFO:teuthology.orchestra.run.smithi005.stdout:The following additional packages will be installed: 2024-08-18T20:49:59.067 INFO:teuthology.orchestra.run.smithi005.stdout: linux-generic linux-headers-5.15.0-118 linux-headers-5.15.0-118-generic 2024-08-18T20:49:59.067 INFO:teuthology.orchestra.run.smithi005.stdout: linux-headers-generic linux-image-5.15.0-118-generic 2024-08-18T20:49:59.067 INFO:teuthology.orchestra.run.smithi005.stdout: linux-modules-5.15.0-118-generic linux-modules-extra-5.15.0-118-generic 2024-08-18T20:49:59.069 INFO:teuthology.orchestra.run.smithi005.stdout:Suggested packages: 2024-08-18T20:49:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-08-18T20:49:59.069 INFO:teuthology.orchestra.run.smithi005.stdout:Recommended packages: 2024-08-18T20:49:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: thermald 2024-08-18T20:49:59.096 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-08-18T20:49:59.118 INFO:teuthology.orchestra.run.smithi005.stdout:The following NEW packages will be installed: 2024-08-18T20:49:59.118 INFO:teuthology.orchestra.run.smithi005.stdout: linux-headers-5.15.0-118 linux-headers-5.15.0-118-generic 2024-08-18T20:49:59.118 INFO:teuthology.orchestra.run.smithi005.stdout: linux-image-5.15.0-118-generic linux-modules-5.15.0-118-generic 2024-08-18T20:49:59.118 INFO:teuthology.orchestra.run.smithi005.stdout: linux-modules-extra-5.15.0-118-generic 2024-08-18T20:49:59.119 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages will be upgraded: 2024-08-18T20:49:59.120 INFO:teuthology.orchestra.run.smithi005.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-18T20:49:59.284 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-08-18T20:49:59.285 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-08-18T20:49:59.299 INFO:teuthology.orchestra.run.smithi005.stdout:3 upgraded, 5 newly installed, 0 to remove and 333 not upgraded. 2024-08-18T20:49:59.299 INFO:teuthology.orchestra.run.smithi005.stdout:Need to get 113 MB of archives. 2024-08-18T20:49:59.299 INFO:teuthology.orchestra.run.smithi005.stdout:After this operation, 583 MB of additional disk space will be used. 2024-08-18T20:49:59.299 INFO:teuthology.orchestra.run.smithi005.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-118-generic amd64 5.15.0-118.128 [22.6 MB] 2024-08-18T20:49:59.450 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-08-18T20:49:59.450 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-18T20:49:59.451 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-18T20:49:59.451 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-18T20:49:59.451 INFO:teuthology.orchestra.run.smithi157.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-08-18T20:49:59.451 INFO:teuthology.orchestra.run.smithi157.stdout: python2.7-minimal 2024-08-18T20:49:59.451 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-18T20:49:59.451 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-08-18T20:49:59.451 INFO:teuthology.orchestra.run.smithi157.stdout: linux-generic linux-headers-5.15.0-118 linux-headers-5.15.0-118-generic 2024-08-18T20:49:59.451 INFO:teuthology.orchestra.run.smithi157.stdout: linux-headers-generic linux-image-5.15.0-118-generic 2024-08-18T20:49:59.451 INFO:teuthology.orchestra.run.smithi157.stdout: linux-modules-5.15.0-118-generic linux-modules-extra-5.15.0-118-generic 2024-08-18T20:49:59.452 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-08-18T20:49:59.452 INFO:teuthology.orchestra.run.smithi157.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-08-18T20:49:59.452 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2024-08-18T20:49:59.452 INFO:teuthology.orchestra.run.smithi157.stdout: thermald 2024-08-18T20:49:59.495 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-08-18T20:49:59.495 INFO:teuthology.orchestra.run.smithi157.stdout: linux-headers-5.15.0-118 linux-headers-5.15.0-118-generic 2024-08-18T20:49:59.495 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.15.0-118-generic linux-modules-5.15.0-118-generic 2024-08-18T20:49:59.496 INFO:teuthology.orchestra.run.smithi157.stdout: linux-modules-extra-5.15.0-118-generic 2024-08-18T20:49:59.497 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages will be upgraded: 2024-08-18T20:49:59.498 INFO:teuthology.orchestra.run.smithi157.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-18T20:49:59.548 INFO:teuthology.orchestra.run.smithi157.stdout:3 upgraded, 5 newly installed, 0 to remove and 333 not upgraded. 2024-08-18T20:49:59.548 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 113 MB of archives. 2024-08-18T20:49:59.548 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 583 MB of additional disk space will be used. 2024-08-18T20:49:59.548 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-118-generic amd64 5.15.0-118.128 [22.6 MB] 2024-08-18T20:49:59.981 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-118-generic amd64 5.15.0-118.128 [11.5 MB] 2024-08-18T20:50:00.064 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-118-generic amd64 5.15.0-118.128 [64.0 MB] 2024-08-18T20:50:00.721 INFO:teuthology.orchestra.run.smithi005.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-118-generic amd64 5.15.0-118.128 [11.5 MB] 2024-08-18T20:50:00.819 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.118.118 [1,694 B] 2024-08-18T20:50:00.820 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.118.118 [2,466 B] 2024-08-18T20:50:00.820 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-118 all 5.15.0-118.128 [12.4 MB] 2024-08-18T20:50:00.936 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-118-generic amd64 5.15.0-118.128 [2,876 kB] 2024-08-18T20:50:01.039 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.118.118 [2,322 B] 2024-08-18T20:50:01.078 INFO:teuthology.orchestra.run.smithi005.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-118-generic amd64 5.15.0-118.128 [64.0 MB] 2024-08-18T20:50:01.429 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 113 MB in 2s (73.9 MB/s) 2024-08-18T20:50:01.631 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-modules-5.15.0-118-generic. 2024-08-18T20:50:03.312 INFO:teuthology.orchestra.run.smithi005.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.118.118 [1,694 B] 2024-08-18T20:50:03.312 INFO:teuthology.orchestra.run.smithi005.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.118.118 [2,466 B] 2024-08-18T20:50:03.313 INFO:teuthology.orchestra.run.smithi005.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-118 all 5.15.0-118.128 [12.4 MB] 2024-08-18T20:50:03.663 INFO:teuthology.orchestra.run.smithi005.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-118-generic amd64 5.15.0-118.128 [2,876 kB] 2024-08-18T20:50:03.711 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-08-18T20:50:03.716 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../0-linux-modules-5.15.0-118-generic_5.15.0-118.128_amd64.deb ... 2024-08-18T20:50:03.745 INFO:teuthology.orchestra.run.smithi005.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.118.118 [2,322 B] 2024-08-18T20:50:03.844 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-modules-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:04.183 INFO:teuthology.orchestra.run.smithi005.stdout:Fetched 113 MB in 5s (24.6 MB/s) 2024-08-18T20:50:04.338 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package linux-modules-5.15.0-118-generic. 2024-08-18T20:50:06.309 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-08-18T20:50:06.314 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../0-linux-modules-5.15.0-118-generic_5.15.0-118.128_amd64.deb ... 2024-08-18T20:50:06.418 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-modules-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:06.588 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-image-5.15.0-118-generic. 2024-08-18T20:50:06.609 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../1-linux-image-5.15.0-118-generic_5.15.0-118.128_amd64.deb ... 2024-08-18T20:50:06.694 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:07.226 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-118-generic. 2024-08-18T20:50:07.245 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-118-generic_5.15.0-118.128_amd64.deb ... 2024-08-18T20:50:07.282 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-modules-extra-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:08.662 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package linux-image-5.15.0-118-generic. 2024-08-18T20:50:08.682 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../1-linux-image-5.15.0-118-generic_5.15.0-118.128_amd64.deb ... 2024-08-18T20:50:08.763 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-image-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:09.248 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-118-generic. 2024-08-18T20:50:09.268 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-118-generic_5.15.0-118.128_amd64.deb ... 2024-08-18T20:50:09.306 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-modules-extra-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:13.911 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../3-linux-generic_5.15.0.118.118_amd64.deb ... 2024-08-18T20:50:14.052 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-generic (5.15.0.118.118) over (5.15.0.56.54) ... 2024-08-18T20:50:14.401 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.118.118_amd64.deb ... 2024-08-18T20:50:14.497 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-generic (5.15.0.118.118) over (5.15.0.56.54) ... 2024-08-18T20:50:14.808 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-headers-5.15.0-118. 2024-08-18T20:50:14.831 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../5-linux-headers-5.15.0-118_5.15.0-118.128_all.deb ... 2024-08-18T20:50:14.891 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-5.15.0-118 (5.15.0-118.128) ... 2024-08-18T20:50:16.351 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../3-linux-generic_5.15.0.118.118_amd64.deb ... 2024-08-18T20:50:16.475 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-generic (5.15.0.118.118) over (5.15.0.56.54) ... 2024-08-18T20:50:16.800 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.118.118_amd64.deb ... 2024-08-18T20:50:16.929 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-image-generic (5.15.0.118.118) over (5.15.0.56.54) ... 2024-08-18T20:50:17.224 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package linux-headers-5.15.0-118. 2024-08-18T20:50:17.247 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../5-linux-headers-5.15.0-118_5.15.0-118.128_all.deb ... 2024-08-18T20:50:17.290 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-headers-5.15.0-118 (5.15.0-118.128) ... 2024-08-18T20:50:20.746 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-headers-5.15.0-118-generic. 2024-08-18T20:50:20.783 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../6-linux-headers-5.15.0-118-generic_5.15.0-118.128_amd64.deb ... 2024-08-18T20:50:20.812 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:23.462 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package linux-headers-5.15.0-118-generic. 2024-08-18T20:50:23.499 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../6-linux-headers-5.15.0-118-generic_5.15.0-118.128_amd64.deb ... 2024-08-18T20:50:23.536 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-headers-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:24.062 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.118.118_amd64.deb ... 2024-08-18T20:50:24.189 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-generic (5.15.0.118.118) over (5.15.0.56.54) ... 2024-08-18T20:50:24.555 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-5.15.0-118 (5.15.0-118.128) ... 2024-08-18T20:50:24.677 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:24.803 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-generic (5.15.0.118.118) ... 2024-08-18T20:50:24.940 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:26.362 INFO:teuthology.orchestra.run.smithi157.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-08-18T20:50:26.362 INFO:teuthology.orchestra.run.smithi157.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-08-18T20:50:26.362 INFO:teuthology.orchestra.run.smithi157.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-118-generic 2024-08-18T20:50:26.363 INFO:teuthology.orchestra.run.smithi157.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-118-generic 2024-08-18T20:50:26.784 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-modules-extra-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:27.285 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.118.118_amd64.deb ... 2024-08-18T20:50:27.407 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-headers-generic (5.15.0.118.118) over (5.15.0.56.54) ... 2024-08-18T20:50:27.774 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-headers-5.15.0-118 (5.15.0-118.128) ... 2024-08-18T20:50:27.886 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-headers-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:27.987 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-headers-generic (5.15.0.118.118) ... 2024-08-18T20:50:28.108 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-image-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:28.209 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-modules-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:29.438 INFO:teuthology.orchestra.run.smithi005.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-08-18T20:50:29.438 INFO:teuthology.orchestra.run.smithi005.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-08-18T20:50:29.438 INFO:teuthology.orchestra.run.smithi005.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-118-generic 2024-08-18T20:50:29.438 INFO:teuthology.orchestra.run.smithi005.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-118-generic 2024-08-18T20:50:29.585 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-modules-extra-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:29.636 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-generic (5.15.0.118.118) ... 2024-08-18T20:50:29.762 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-generic (5.15.0.118.118) ... 2024-08-18T20:50:29.889 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for linux-image-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:29.962 INFO:teuthology.orchestra.run.smithi157.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-18T20:50:29.962 INFO:teuthology.orchestra.run.smithi157.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-118-generic 2024-08-18T20:50:31.061 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-modules-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:32.813 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-image-generic (5.15.0.118.118) ... 2024-08-18T20:50:32.947 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-generic (5.15.0.118.118) ... 2024-08-18T20:50:33.074 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for linux-image-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-18T20:50:33.147 INFO:teuthology.orchestra.run.smithi005.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-18T20:50:33.148 INFO:teuthology.orchestra.run.smithi005.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-118-generic 2024-08-18T20:50:44.096 INFO:teuthology.orchestra.run.smithi157.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-18T20:50:44.096 INFO:teuthology.orchestra.run.smithi157.stdout:Sourcing file `/etc/default/grub' 2024-08-18T20:50:44.114 INFO:teuthology.orchestra.run.smithi157.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-18T20:50:44.139 INFO:teuthology.orchestra.run.smithi157.stdout:Generating grub configuration file ... 2024-08-18T20:50:44.467 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.15.0-118-generic 2024-08-18T20:50:44.481 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.15.0-118-generic 2024-08-18T20:50:44.844 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-18T20:50:44.849 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-18T20:50:44.925 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-18T20:50:44.930 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-18T20:50:45.076 INFO:teuthology.orchestra.run.smithi157.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-18T20:50:45.077 INFO:teuthology.orchestra.run.smithi157.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-08-18T20:50:45.077 INFO:teuthology.orchestra.run.smithi157.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-18T20:50:45.116 INFO:teuthology.orchestra.run.smithi157.stdout:done 2024-08-18T20:50:45.587 DEBUG:teuthology.orchestra.run.smithi157:> dpkg -s linux-image-generic 2024-08-18T20:50:45.604 INFO:teuthology.orchestra.run.smithi157.stdout:Package: linux-image-generic 2024-08-18T20:50:45.605 INFO:teuthology.orchestra.run.smithi157.stdout:Status: install ok installed 2024-08-18T20:50:45.605 INFO:teuthology.orchestra.run.smithi157.stdout:Priority: optional 2024-08-18T20:50:45.605 INFO:teuthology.orchestra.run.smithi157.stdout:Section: kernel 2024-08-18T20:50:45.605 INFO:teuthology.orchestra.run.smithi157.stdout:Installed-Size: 21 2024-08-18T20:50:45.605 INFO:teuthology.orchestra.run.smithi157.stdout:Maintainer: Ubuntu Kernel Team 2024-08-18T20:50:45.605 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: amd64 2024-08-18T20:50:45.605 INFO:teuthology.orchestra.run.smithi157.stdout:Source: linux-meta 2024-08-18T20:50:45.605 INFO:teuthology.orchestra.run.smithi157.stdout:Version: 5.15.0.118.118 2024-08-18T20:50:45.605 INFO:teuthology.orchestra.run.smithi157.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-118), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-18T20:50:45.605 INFO:teuthology.orchestra.run.smithi157.stdout:Depends: linux-image-5.15.0-118-generic, linux-modules-extra-5.15.0-118-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-18T20:50:45.605 INFO:teuthology.orchestra.run.smithi157.stdout:Recommends: thermald 2024-08-18T20:50:45.605 INFO:teuthology.orchestra.run.smithi157.stdout:Description: Generic Linux kernel image 2024-08-18T20:50:45.606 INFO:teuthology.orchestra.run.smithi157.stdout: This package will always depend on the latest generic kernel image 2024-08-18T20:50:45.606 INFO:teuthology.orchestra.run.smithi157.stdout: available. 2024-08-18T20:50:45.606 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-118-generic 2024-08-18T20:50:45.606 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-18T20:50:45.606 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-18T20:50:45.606 INFO:teuthology.task.kernel:Installing distro kernel on mon.f... 2024-08-18T20:50:45.606 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi157.front.sepia.ceph.com, path=None, version=distro) 2024-08-18T20:50:45.607 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get clean 2024-08-18T20:50:45.800 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-08-18T20:50:45.935 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-18T20:50:46.064 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-18T20:50:46.137 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-18T20:50:46.219 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-18T20:50:47.420 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-08-18T20:50:47.439 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-18T20:50:47.491 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-08-18T20:50:47.675 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-08-18T20:50:47.676 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-08-18T20:50:47.838 INFO:teuthology.orchestra.run.smithi157.stdout:linux-image-generic is already the newest version (5.15.0.118.118). 2024-08-18T20:50:47.838 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-08-18T20:50:47.838 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-18T20:50:47.839 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-18T20:50:47.839 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-18T20:50:47.839 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-18T20:50:47.839 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-18T20:50:47.839 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-18T20:50:47.871 INFO:teuthology.orchestra.run.smithi005.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-18T20:50:47.872 INFO:teuthology.orchestra.run.smithi005.stdout:Sourcing file `/etc/default/grub' 2024-08-18T20:50:47.879 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 0 newly installed, 0 to remove and 333 not upgraded. 2024-08-18T20:50:47.879 DEBUG:teuthology.orchestra.run.smithi157:> dpkg -s linux-image-generic 2024-08-18T20:50:47.882 INFO:teuthology.orchestra.run.smithi005.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-18T20:50:47.898 INFO:teuthology.orchestra.run.smithi005.stdout:Generating grub configuration file ... 2024-08-18T20:50:47.936 INFO:teuthology.orchestra.run.smithi157.stdout:Package: linux-image-generic 2024-08-18T20:50:47.936 INFO:teuthology.orchestra.run.smithi157.stdout:Status: install ok installed 2024-08-18T20:50:47.936 INFO:teuthology.orchestra.run.smithi157.stdout:Priority: optional 2024-08-18T20:50:47.936 INFO:teuthology.orchestra.run.smithi157.stdout:Section: kernel 2024-08-18T20:50:47.936 INFO:teuthology.orchestra.run.smithi157.stdout:Installed-Size: 21 2024-08-18T20:50:47.936 INFO:teuthology.orchestra.run.smithi157.stdout:Maintainer: Ubuntu Kernel Team 2024-08-18T20:50:47.936 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: amd64 2024-08-18T20:50:47.936 INFO:teuthology.orchestra.run.smithi157.stdout:Source: linux-meta 2024-08-18T20:50:47.936 INFO:teuthology.orchestra.run.smithi157.stdout:Version: 5.15.0.118.118 2024-08-18T20:50:47.936 INFO:teuthology.orchestra.run.smithi157.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-118), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-18T20:50:47.937 INFO:teuthology.orchestra.run.smithi157.stdout:Depends: linux-image-5.15.0-118-generic, linux-modules-extra-5.15.0-118-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-18T20:50:47.937 INFO:teuthology.orchestra.run.smithi157.stdout:Recommends: thermald 2024-08-18T20:50:47.937 INFO:teuthology.orchestra.run.smithi157.stdout:Description: Generic Linux kernel image 2024-08-18T20:50:47.937 INFO:teuthology.orchestra.run.smithi157.stdout: This package will always depend on the latest generic kernel image 2024-08-18T20:50:47.937 INFO:teuthology.orchestra.run.smithi157.stdout: available. 2024-08-18T20:50:47.937 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-08-18T20:50:47.981 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.CXAIls8EPs 2024-08-18T20:50:47.981 DEBUG:teuthology.orchestra.run.smithi157:> sudo cp /boot/grub/grub.cfg /tmp/tmp.CXAIls8EPs 2024-08-18T20:50:48.052 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.CXAIls8EPs 2024-08-18T20:50:48.132 INFO:teuthology.orchestra.run.smithi005.stdout:Found linux image: /boot/vmlinuz-5.15.0-118-generic 2024-08-18T20:50:48.148 INFO:teuthology.orchestra.run.smithi005.stdout:Found initrd image: /boot/initrd.img-5.15.0-118-generic 2024-08-18T20:50:48.177 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.CXAIls8EPs is 10KB 2024-08-18T20:50:48.190 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.CXAIls8EPs 2024-08-18T20:50:48.196 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-18T20:50:48.250 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T20:50:48.250 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-18T20:50:48.250 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-18T20:50:48.323 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-118-generic 2024-08-18T20:50:48.323 DEBUG:teuthology.orchestra.run.smithi157:> sudo update-grub 2024-08-18T20:50:48.458 INFO:teuthology.orchestra.run.smithi005.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-18T20:50:48.464 INFO:teuthology.orchestra.run.smithi005.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-18T20:50:48.534 INFO:teuthology.orchestra.run.smithi005.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-18T20:50:48.540 INFO:teuthology.orchestra.run.smithi005.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-18T20:50:48.684 INFO:teuthology.orchestra.run.smithi005.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-18T20:50:48.684 INFO:teuthology.orchestra.run.smithi005.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-08-18T20:50:48.684 INFO:teuthology.orchestra.run.smithi005.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-18T20:50:48.722 INFO:teuthology.orchestra.run.smithi005.stdout:done 2024-08-18T20:50:49.227 DEBUG:teuthology.orchestra.run.smithi005:> dpkg -s linux-image-generic 2024-08-18T20:50:49.247 INFO:teuthology.orchestra.run.smithi005.stdout:Package: linux-image-generic 2024-08-18T20:50:49.247 INFO:teuthology.orchestra.run.smithi005.stdout:Status: install ok installed 2024-08-18T20:50:49.247 INFO:teuthology.orchestra.run.smithi005.stdout:Priority: optional 2024-08-18T20:50:49.247 INFO:teuthology.orchestra.run.smithi005.stdout:Section: kernel 2024-08-18T20:50:49.247 INFO:teuthology.orchestra.run.smithi005.stdout:Installed-Size: 21 2024-08-18T20:50:49.247 INFO:teuthology.orchestra.run.smithi005.stdout:Maintainer: Ubuntu Kernel Team 2024-08-18T20:50:49.247 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: amd64 2024-08-18T20:50:49.248 INFO:teuthology.orchestra.run.smithi005.stdout:Source: linux-meta 2024-08-18T20:50:49.248 INFO:teuthology.orchestra.run.smithi005.stdout:Version: 5.15.0.118.118 2024-08-18T20:50:49.248 INFO:teuthology.orchestra.run.smithi005.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-118), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-18T20:50:49.248 INFO:teuthology.orchestra.run.smithi005.stdout:Depends: linux-image-5.15.0-118-generic, linux-modules-extra-5.15.0-118-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-18T20:50:49.248 INFO:teuthology.orchestra.run.smithi005.stdout:Recommends: thermald 2024-08-18T20:50:49.248 INFO:teuthology.orchestra.run.smithi005.stdout:Description: Generic Linux kernel image 2024-08-18T20:50:49.248 INFO:teuthology.orchestra.run.smithi005.stdout: This package will always depend on the latest generic kernel image 2024-08-18T20:50:49.248 INFO:teuthology.orchestra.run.smithi005.stdout: available. 2024-08-18T20:50:49.248 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-118-generic 2024-08-18T20:50:49.249 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-18T20:50:49.249 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-18T20:50:49.249 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-08-18T20:50:49.249 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi005.front.sepia.ceph.com, path=None, version=distro) 2024-08-18T20:50:49.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo apt-get clean 2024-08-18T20:50:49.423 DEBUG:teuthology.orchestra.run.smithi005:> sudo apt-get update 2024-08-18T20:50:49.673 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub' 2024-08-18T20:50:49.674 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-18T20:50:49.674 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-18T20:50:49.676 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-18T20:50:49.680 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2024-08-18T20:50:49.746 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-18T20:50:49.828 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-18T20:50:49.879 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.15.0-118-generic 2024-08-18T20:50:49.886 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.15.0-118-generic 2024-08-18T20:50:50.131 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-18T20:50:50.137 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-18T20:50:50.179 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-18T20:50:50.184 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-18T20:50:50.299 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-18T20:50:50.299 INFO:teuthology.orchestra.run.smithi157.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-18T20:50:50.300 INFO:teuthology.orchestra.run.smithi157.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-18T20:50:50.319 INFO:teuthology.orchestra.run.smithi157.stderr:done 2024-08-18T20:50:50.331 DEBUG:teuthology.orchestra.run.smithi157:> sudo shutdown -r now 2024-08-18T20:50:51.114 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2024-08-18T20:50:51.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-18T20:50:51.188 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2024-08-18T20:50:51.377 INFO:teuthology.orchestra.run.smithi005.stdout:Building dependency tree... 2024-08-18T20:50:51.377 INFO:teuthology.orchestra.run.smithi005.stdout:Reading state information... 2024-08-18T20:50:51.551 INFO:teuthology.orchestra.run.smithi005.stdout:linux-image-generic is already the newest version (5.15.0.118.118). 2024-08-18T20:50:51.551 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages were automatically installed and are no longer required: 2024-08-18T20:50:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-18T20:50:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-18T20:50:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-18T20:50:51.552 INFO:teuthology.orchestra.run.smithi005.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-18T20:50:51.552 INFO:teuthology.orchestra.run.smithi005.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-18T20:50:51.552 INFO:teuthology.orchestra.run.smithi005.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-18T20:50:51.592 INFO:teuthology.orchestra.run.smithi005.stdout:0 upgraded, 0 newly installed, 0 to remove and 333 not upgraded. 2024-08-18T20:50:51.594 DEBUG:teuthology.orchestra.run.smithi005:> dpkg -s linux-image-generic 2024-08-18T20:50:51.653 INFO:teuthology.orchestra.run.smithi005.stdout:Package: linux-image-generic 2024-08-18T20:50:51.653 INFO:teuthology.orchestra.run.smithi005.stdout:Status: install ok installed 2024-08-18T20:50:51.653 INFO:teuthology.orchestra.run.smithi005.stdout:Priority: optional 2024-08-18T20:50:51.653 INFO:teuthology.orchestra.run.smithi005.stdout:Section: kernel 2024-08-18T20:50:51.654 INFO:teuthology.orchestra.run.smithi005.stdout:Installed-Size: 21 2024-08-18T20:50:51.654 INFO:teuthology.orchestra.run.smithi005.stdout:Maintainer: Ubuntu Kernel Team 2024-08-18T20:50:51.654 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: amd64 2024-08-18T20:50:51.654 INFO:teuthology.orchestra.run.smithi005.stdout:Source: linux-meta 2024-08-18T20:50:51.654 INFO:teuthology.orchestra.run.smithi005.stdout:Version: 5.15.0.118.118 2024-08-18T20:50:51.654 INFO:teuthology.orchestra.run.smithi005.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-118), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-18T20:50:51.654 INFO:teuthology.orchestra.run.smithi005.stdout:Depends: linux-image-5.15.0-118-generic, linux-modules-extra-5.15.0-118-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-18T20:50:51.654 INFO:teuthology.orchestra.run.smithi005.stdout:Recommends: thermald 2024-08-18T20:50:51.654 INFO:teuthology.orchestra.run.smithi005.stdout:Description: Generic Linux kernel image 2024-08-18T20:50:51.654 INFO:teuthology.orchestra.run.smithi005.stdout: This package will always depend on the latest generic kernel image 2024-08-18T20:50:51.654 INFO:teuthology.orchestra.run.smithi005.stdout: available. 2024-08-18T20:50:51.655 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-08-18T20:50:51.698 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.dogjP6E6Fp 2024-08-18T20:50:51.698 DEBUG:teuthology.orchestra.run.smithi005:> sudo cp /boot/grub/grub.cfg /tmp/tmp.dogjP6E6Fp 2024-08-18T20:50:51.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.dogjP6E6Fp 2024-08-18T20:50:51.890 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.dogjP6E6Fp is 10KB 2024-08-18T20:50:51.903 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.dogjP6E6Fp 2024-08-18T20:50:51.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-18T20:50:51.966 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T20:50:51.967 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-18T20:50:51.967 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-18T20:50:52.033 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-118-generic 2024-08-18T20:50:52.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo update-grub 2024-08-18T20:50:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:Sourcing file `/etc/default/grub' 2024-08-18T20:50:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-18T20:50:53.323 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2024-08-18T20:50:53.503 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.15.0-118-generic 2024-08-18T20:50:53.510 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.15.0-118-generic 2024-08-18T20:50:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-18T20:50:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-18T20:50:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-18T20:50:53.793 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-18T20:50:53.918 INFO:teuthology.orchestra.run.smithi005.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-18T20:50:53.918 INFO:teuthology.orchestra.run.smithi005.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-18T20:50:53.918 INFO:teuthology.orchestra.run.smithi005.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-18T20:50:53.928 INFO:teuthology.orchestra.run.smithi005.stderr:done 2024-08-18T20:50:53.930 DEBUG:teuthology.orchestra.run.smithi005:> sudo shutdown -r now 2024-08-18T20:51:20.359 INFO:teuthology.task.kernel:Checking client mon.f for new kernel version... 2024-08-18T20:51:20.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-08-18T20:51:20.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T20:51:23.933 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-08-18T20:51:23.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-18T20:51:23.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T20:51:38.847 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-08-18T20:51:42.434 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-08-18T20:51:47.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-08-18T20:51:47.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T20:51:50.914 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-08-18T20:51:51.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-18T20:51:51.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T20:52:02.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-08-18T20:52:02.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T20:52:05.986 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-08-18T20:52:21.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-08-18T20:52:21.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T20:52:39.519 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-08-18T20:52:51.447 DEBUG:teuthology.orchestra.remote:timed out 2024-08-18T20:52:57.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-08-18T20:52:57.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T20:52:58.158 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-08-18T20:52:58.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-08-18T20:52:58.765 INFO:teuthology.task.kernel:Checking kernel version of mon.f, want "5.15.0-118-generic"... 2024-08-18T20:52:58.765 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-08-18T20:52:58.810 INFO:teuthology.orchestra.run.smithi157.stdout:5.15.0-118-generic 2024-08-18T20:52:58.810 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-118-generic vs 5.15.0-118-generic 2024-08-18T20:52:58.810 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-18T20:52:58.811 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-18T20:52:59.811 INFO:teuthology.task.kernel:Enabling kdb on mon.f... 2024-08-18T20:52:59.812 DEBUG:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-18T20:52:59.893 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2024-08-18T20:52:59.920 DEBUG:teuthology.parallel:result is None 2024-08-18T20:53:03.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-18T20:53:03.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T20:53:03.752 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-08-18T20:53:04.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-18T20:53:04.434 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-118-generic"... 2024-08-18T20:53:04.434 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-08-18T20:53:04.479 INFO:teuthology.orchestra.run.smithi005.stdout:5.15.0-118-generic 2024-08-18T20:53:04.479 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-118-generic vs 5.15.0-118-generic 2024-08-18T20:53:04.479 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-18T20:53:04.479 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-18T20:53:05.480 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-18T20:53:05.480 DEBUG:teuthology.orchestra.run.smithi005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-18T20:53:05.578 INFO:teuthology.orchestra.run.smithi005.stdout:ttyS1 2024-08-18T20:53:05.600 DEBUG:teuthology.parallel:result is None 2024-08-18T20:53:05.601 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-18T20:53:05.608 INFO:teuthology.task.internal:Creating test directory... 2024-08-18T20:53:05.609 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-18T20:53:05.611 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-18T20:53:05.617 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-18T20:53:05.861 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-18T20:53:05.896 INFO:teuthology.task.internal:Creating archive directory... 2024-08-18T20:53:05.897 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-18T20:53:05.899 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-18T20:53:05.992 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-18T20:53:06.000 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-18T20:53:06.000 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-18T20:53:06.003 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-18T20:53:06.019 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T20:53:06.020 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T20:53:06.027 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T20:53:06.028 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T20:53:06.030 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-18T20:53:06.037 INFO:teuthology.task.internal:Configuring sudo... 2024-08-18T20:53:06.037 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-18T20:53:06.072 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-18T20:53:06.105 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-18T20:53:06.115 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-18T20:53:06.116 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-18T20:53:06.128 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-18T20:53:06.158 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T20:53:06.179 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T20:53:06.227 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T20:53:06.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-18T20:53:06.301 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T20:53:06.307 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T20:53:06.355 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T20:53:06.355 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-18T20:53:06.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-08-18T20:53:06.429 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-08-18T20:53:06.505 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-18T20:53:06.513 INFO:teuthology.task.internal:Starting timer... 2024-08-18T20:53:06.513 INFO:teuthology.run_tasks:Running task pcp... 2024-08-18T20:53:06.543 INFO:teuthology.run_tasks:Running task selinux... 2024-08-18T20:53:06.597 DEBUG:teuthology.task.selinux:Excluding smithi005: OS 'ubuntu' does not support SELinux 2024-08-18T20:53:06.597 DEBUG:teuthology.task.selinux:Excluding smithi157: OS 'ubuntu' does not support SELinux 2024-08-18T20:53:06.597 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-18T20:53:06.597 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-08-18T20:53:06.597 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-18T20:53:06.598 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-18T20:53:06.633 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-18T20:53:06.636 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-18T20:53:06.750 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-18T20:53:06.761 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-18T20:53:06.763 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi157.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-18T21:00:41.787 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com')] 2024-08-18T21:00:41.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-18T21:00:41.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T21:00:41.873 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-08-18T21:00:41.956 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-18T21:00:41.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-08-18T21:00:41.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T21:00:42.038 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-08-18T21:00:42.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-08-18T21:00:42.114 INFO:teuthology.run_tasks:Running task clock... 2024-08-18T21:00:42.125 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-18T21:00:42.125 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-18T21:00:42.126 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T21:00:42.129 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-18T21:00:42.129 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T21:00:42.156 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-08-18T21:00:42.156 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: Command line: ntpd -gq 2024-08-18T21:00:42.156 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: ---------------------------------------------------- 2024-08-18T21:00:42.156 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: ntp-4 is maintained by Network Time Foundation, 2024-08-18T21:00:42.156 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-08-18T21:00:42.156 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: corporation. Support and training for ntp-4 are 2024-08-18T21:00:42.156 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: available at https://www.nwtime.org/support 2024-08-18T21:00:42.156 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: ---------------------------------------------------- 2024-08-18T21:00:42.157 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: proto: precision = 0.068 usec (-24) 2024-08-18T21:00:42.157 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: basedate set to 2022-02-04 2024-08-18T21:00:42.157 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: gps base set to 2022-02-06 (week 2196) 2024-08-18T21:00:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-18T21:00:42.158 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-18T21:00:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-18T21:00:42.159 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: restrict ::: KOD does nothing without LIMITED. 2024-08-18T21:00:42.159 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: Listen and drop on 0 v6wildcard [::]:123 2024-08-18T21:00:42.159 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-18T21:00:42.159 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: Listen normally on 2 lo 127.0.0.1:123 2024-08-18T21:00:42.161 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: Listen normally on 3 ens1f0 172.21.15.5:123 2024-08-18T21:00:42.161 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: Listen normally on 4 lo [::1]:123 2024-08-18T21:00:42.161 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1442%4]:123 2024-08-18T21:00:42.161 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:42 ntpd[18284]: Listening on routing socket on fd #22 for interface updates 2024-08-18T21:00:42.183 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-08-18T21:00:42.183 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: Command line: ntpd -gq 2024-08-18T21:00:42.183 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: ---------------------------------------------------- 2024-08-18T21:00:42.183 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: ntp-4 is maintained by Network Time Foundation, 2024-08-18T21:00:42.183 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-08-18T21:00:42.183 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: corporation. Support and training for ntp-4 are 2024-08-18T21:00:42.183 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: available at https://www.nwtime.org/support 2024-08-18T21:00:42.183 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: ---------------------------------------------------- 2024-08-18T21:00:42.184 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: proto: precision = 0.044 usec (-24) 2024-08-18T21:00:42.184 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: basedate set to 2022-02-04 2024-08-18T21:00:42.184 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: gps base set to 2022-02-06 (week 2196) 2024-08-18T21:00:42.184 INFO:teuthology.orchestra.run.smithi157.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-18T21:00:42.185 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-18T21:00:42.185 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: restrict ::: KOD does nothing without LIMITED. 2024-08-18T21:00:42.185 INFO:teuthology.orchestra.run.smithi157.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-18T21:00:42.186 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: Listen and drop on 0 v6wildcard [::]:123 2024-08-18T21:00:42.186 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-18T21:00:42.186 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: Listen normally on 2 lo 127.0.0.1:123 2024-08-18T21:00:42.186 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: Listen normally on 3 enp3s0f1 172.21.15.157:123 2024-08-18T21:00:42.186 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: Listen normally on 4 lo [::1]:123 2024-08-18T21:00:42.186 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ea1%5]:123 2024-08-18T21:00:42.186 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:42 ntpd[18366]: Listening on routing socket on fd #22 for interface updates 2024-08-18T21:00:43.156 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:43 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:43.156 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:43 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:43.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:43 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:43.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:43 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:43.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:43 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:43.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:43 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:43.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:43 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:43.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:43 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:44.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:44 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:44.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:44 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:44.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:44 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:44.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:44 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:44.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:44 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:44.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:44 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:44.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:44 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:44.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:44 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:44.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:44 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:44.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:44 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:44.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:44 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:44.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:44 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:45.156 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:45 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:45.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:45 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:45.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:45 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:45.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:45 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:45.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:45 ntpd[18284]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:45.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:45 ntpd[18284]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:45.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:45 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:45.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:45 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:45.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:45 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:45.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:45 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:45.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:45 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:45.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:45 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:46.156 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:46 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:46.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:46 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:46.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:46 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:46.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:46 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:46.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:46 ntpd[18284]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:46.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:46 ntpd[18284]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:46.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:46 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:46.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:46 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:46.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:46 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:46.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:46 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:46.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:46 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:46.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:46 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:46.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:46 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:46.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:46 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:46.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:46 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:46.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:46 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:46.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:46 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:46.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:46 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:46.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:46 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:46.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:46 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:47.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:47 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:47.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:47 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:47.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:47 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:47.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:47 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:47.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:47 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:47.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:47 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:47.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:47 ntpd[18284]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:47.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:47 ntpd[18284]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:47.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:47 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:47.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:47 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:47.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:47 ntpd[18284]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:47.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:47 ntpd[18284]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:47.183 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:47 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:47.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:47 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:47.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:47 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:47.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:47 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:47.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:47 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:47.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:47 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:48 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:48 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:48 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:48 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:48 ntpd[18284]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:48 ntpd[18284]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:48.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:48 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:48.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:48 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:48.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:48 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:48.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:48 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:48.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:48 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:48.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:48 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:48.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:48 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:48.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:48 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:48.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:48 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:48.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:48 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:48.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:48 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:48.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:48 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:49 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:49 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:49 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:49 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:49 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:49 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:49 ntpd[18284]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:49 ntpd[18284]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:49 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:49 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:49 ntpd[18284]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:49 ntpd[18284]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:49.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:49 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:49.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:49 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:49.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:49 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:49.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:49 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:49.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:49 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:49.184 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:49 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:49.185 INFO:teuthology.orchestra.run.smithi157.stdout:18 Aug 21:00:49 ntpd[18366]: ntpd: time slew -0.001098 s 2024-08-18T21:00:49.185 INFO:teuthology.orchestra.run.smithi157.stdout:ntpd: time slew -0.001098s 2024-08-18T21:00:49.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:49 ntpd[18366]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-18T21:00:49.185 INFO:teuthology.orchestra.run.smithi157.stderr:18 Aug 21:00:49 ntpd[18366]: can't open /var/log/ntpstats/loopstats.20240818: Permission denied 2024-08-18T21:00:49.238 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-08-18T21:00:49.238 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-08-18T21:00:49.238 INFO:teuthology.orchestra.run.smithi157.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-18T21:00:49.239 INFO:teuthology.orchestra.run.smithi157.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-18T21:00:49.239 INFO:teuthology.orchestra.run.smithi157.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-18T21:00:49.239 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-18T21:00:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:50 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:50 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:50 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:50 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:50 ntpd[18284]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:50 ntpd[18284]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:51 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:51 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:51 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:51 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:51 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:51 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:51 ntpd[18284]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:51 ntpd[18284]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:51 ntpd[18284]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T21:00:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:51 ntpd[18284]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T21:00:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:51 ntpd[18284]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T21:00:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:51 ntpd[18284]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T21:00:51.158 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 21:00:51 ntpd[18284]: ntpd: time slew -0.001375 s 2024-08-18T21:00:51.158 INFO:teuthology.orchestra.run.smithi005.stdout:ntpd: time slew -0.001375s 2024-08-18T21:00:51.159 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:51 ntpd[18284]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-18T21:00:51.159 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 21:00:51 ntpd[18284]: can't open /var/log/ntpstats/loopstats.20240818: Permission denied 2024-08-18T21:00:51.211 INFO:teuthology.orchestra.run.smithi005.stdout: remote refid st t when poll reach delay offset jitter 2024-08-18T21:00:51.211 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================== 2024-08-18T21:00:51.211 INFO:teuthology.orchestra.run.smithi005.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-18T21:00:51.211 INFO:teuthology.orchestra.run.smithi005.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-18T21:00:51.211 INFO:teuthology.orchestra.run.smithi005.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-18T21:00:51.211 INFO:teuthology.orchestra.run.smithi005.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-18T21:00:51.211 INFO:teuthology.run_tasks:Running task install... 2024-08-18T21:00:51.220 DEBUG:teuthology.task.install:project ceph 2024-08-18T21:00:51.220 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '797669399b32d2915e64eb6d4b1257ae3c50f80b'}} 2024-08-18T21:00:51.220 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '797669399b32d2915e64eb6d4b1257ae3c50f80b'} 2024-08-18T21:00:51.220 INFO:teuthology.task.install:Using flavor: default 2024-08-18T21:00:51.226 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-18T21:00:51.226 INFO:teuthology.task.install:extra packages: [] 2024-08-18T21:00:51.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo apt-key list | grep Ceph 2024-08-18T21:00:51.228 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-key list | grep Ceph 2024-08-18T21:00:51.293 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-08-18T21:00:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-08-18T21:00:51.324 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-18T21:00:51.324 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph.com (release key) 2024-08-18T21:00:51.325 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-08-18T21:00:51.326 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=797669399b32d2915e64eb6d4b1257ae3c50f80b 2024-08-18T21:00:51.342 INFO:teuthology.orchestra.run.smithi005.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-18T21:00:51.342 INFO:teuthology.orchestra.run.smithi005.stdout:uid [ unknown] Ceph.com (release key) 2024-08-18T21:00:51.343 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-08-18T21:00:51.343 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=797669399b32d2915e64eb6d4b1257ae3c50f80b 2024-08-18T21:00:51.470 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default/ 2024-08-18T21:00:51.470 INFO:teuthology.task.install.deb:Package version is 19.0.0-5847-g79766939-1jammy 2024-08-18T21:00:51.486 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default/ 2024-08-18T21:00:51.487 INFO:teuthology.task.install.deb:Package version is 19.0.0-5847-g79766939-1jammy 2024-08-18T21:00:51.578 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T21:00:51.578 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-18T21:00:51.592 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:00:51.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-18T21:00:51.594 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-08-18T21:00:51.607 DEBUG:teuthology.orchestra.run.smithi005:> sudo apt-get update 2024-08-18T21:00:51.773 INFO:teuthology.orchestra.run.smithi005.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-08-18T21:00:51.825 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy InRelease 2024-08-18T21:00:51.832 INFO:teuthology.orchestra.run.smithi005.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy InRelease 2024-08-18T21:00:51.847 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-08-18T21:00:51.853 INFO:teuthology.orchestra.run.smithi005.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-08-18T21:00:51.870 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-08-18T21:00:51.875 INFO:teuthology.orchestra.run.smithi005.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-08-18T21:00:51.891 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-18T21:00:51.893 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-08-18T21:00:51.898 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-18T21:00:51.902 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-18T21:00:51.907 INFO:teuthology.orchestra.run.smithi005.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-08-18T21:00:51.922 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-08-18T21:00:51.934 INFO:teuthology.orchestra.run.smithi005.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-08-18T21:00:51.963 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-08-18T21:00:51.979 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-18T21:00:52.061 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-18T21:00:52.223 INFO:teuthology.orchestra.run.smithi005.stdout:Fetched 158 kB in 0s (368 kB/s) 2024-08-18T21:00:52.324 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-18T21:00:52.467 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 157 kB in 1s (225 kB/s) 2024-08-18T21:00:53.276 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2024-08-18T21:00:53.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-5847-g79766939-1jammy cephadm=19.0.0-5847-g79766939-1jammy ceph-mds=19.0.0-5847-g79766939-1jammy ceph-mgr=19.0.0-5847-g79766939-1jammy ceph-common=19.0.0-5847-g79766939-1jammy ceph-fuse=19.0.0-5847-g79766939-1jammy ceph-test=19.0.0-5847-g79766939-1jammy ceph-volume=19.0.0-5847-g79766939-1jammy radosgw=19.0.0-5847-g79766939-1jammy python3-rados=19.0.0-5847-g79766939-1jammy python3-rgw=19.0.0-5847-g79766939-1jammy python3-cephfs=19.0.0-5847-g79766939-1jammy python3-rbd=19.0.0-5847-g79766939-1jammy libcephfs2=19.0.0-5847-g79766939-1jammy libcephfs-dev=19.0.0-5847-g79766939-1jammy librados2=19.0.0-5847-g79766939-1jammy librbd1=19.0.0-5847-g79766939-1jammy rbd-fuse=19.0.0-5847-g79766939-1jammy 2024-08-18T21:00:53.359 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2024-08-18T21:00:53.473 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-08-18T21:00:53.490 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-5847-g79766939-1jammy cephadm=19.0.0-5847-g79766939-1jammy ceph-mds=19.0.0-5847-g79766939-1jammy ceph-mgr=19.0.0-5847-g79766939-1jammy ceph-common=19.0.0-5847-g79766939-1jammy ceph-fuse=19.0.0-5847-g79766939-1jammy ceph-test=19.0.0-5847-g79766939-1jammy ceph-volume=19.0.0-5847-g79766939-1jammy radosgw=19.0.0-5847-g79766939-1jammy python3-rados=19.0.0-5847-g79766939-1jammy python3-rgw=19.0.0-5847-g79766939-1jammy python3-cephfs=19.0.0-5847-g79766939-1jammy python3-rbd=19.0.0-5847-g79766939-1jammy libcephfs2=19.0.0-5847-g79766939-1jammy libcephfs-dev=19.0.0-5847-g79766939-1jammy librados2=19.0.0-5847-g79766939-1jammy librbd1=19.0.0-5847-g79766939-1jammy rbd-fuse=19.0.0-5847-g79766939-1jammy 2024-08-18T21:00:53.555 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-08-18T21:00:53.570 INFO:teuthology.orchestra.run.smithi005.stdout:Building dependency tree... 2024-08-18T21:00:53.571 INFO:teuthology.orchestra.run.smithi005.stdout:Reading state information... 2024-08-18T21:00:53.772 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-08-18T21:00:53.772 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-08-18T21:00:53.785 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages were automatically installed and are no longer required: 2024-08-18T21:00:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-18T21:00:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-18T21:00:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-18T21:00:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-18T21:00:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-18T21:00:53.787 INFO:teuthology.orchestra.run.smithi005.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-18T21:00:53.787 INFO:teuthology.orchestra.run.smithi005.stdout:The following additional packages will be installed: 2024-08-18T21:00:53.787 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-18T21:00:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-08-18T21:00:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-18T21:00:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-08-18T21:00:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-08-18T21:00:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-08-18T21:00:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-08-18T21:00:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-08-18T21:00:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-08-18T21:00:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-18T21:00:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-18T21:00:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-18T21:00:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-18T21:00:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-18T21:00:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-18T21:00:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-18T21:00:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-08-18T21:00:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-08-18T21:00:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-08-18T21:00:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-08-18T21:00:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-08-18T21:00:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-08-18T21:00:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-08-18T21:00:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet zip 2024-08-18T21:00:53.791 INFO:teuthology.orchestra.run.smithi005.stdout:Suggested packages: 2024-08-18T21:00:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-08-18T21:00:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-08-18T21:00:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-08-18T21:00:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-08-18T21:00:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-08-18T21:00:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-18T21:00:53.792 INFO:teuthology.orchestra.run.smithi005.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-08-18T21:00:53.792 INFO:teuthology.orchestra.run.smithi005.stdout:Recommended packages: 2024-08-18T21:00:53.792 INFO:teuthology.orchestra.run.smithi005.stdout: btrfs-tools 2024-08-18T21:00:53.900 INFO:teuthology.orchestra.run.smithi005.stdout:The following NEW packages will be installed: 2024-08-18T21:00:53.900 INFO:teuthology.orchestra.run.smithi005.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-18T21:00:53.900 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-18T21:00:53.900 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-08-18T21:00:53.900 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-08-18T21:00:53.900 INFO:teuthology.orchestra.run.smithi005.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-08-18T21:00:53.900 INFO:teuthology.orchestra.run.smithi005.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-08-18T21:00:53.900 INFO:teuthology.orchestra.run.smithi005.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-08-18T21:00:53.900 INFO:teuthology.orchestra.run.smithi005.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-08-18T21:00:53.900 INFO:teuthology.orchestra.run.smithi005.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-08-18T21:00:53.900 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-08-18T21:00:53.901 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-08-18T21:00:53.901 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-18T21:00:53.901 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-18T21:00:53.901 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-18T21:00:53.901 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-18T21:00:53.901 INFO:teuthology.orchestra.run.smithi005.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-18T21:00:53.901 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-18T21:00:53.901 INFO:teuthology.orchestra.run.smithi005.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-18T21:00:53.901 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-08-18T21:00:53.901 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-08-18T21:00:53.901 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-08-18T21:00:53.901 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-08-18T21:00:53.901 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-08-18T21:00:53.901 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-08-18T21:00:53.902 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-08-18T21:00:53.902 INFO:teuthology.orchestra.run.smithi005.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-08-18T21:00:53.958 INFO:teuthology.orchestra.run.smithi005.stdout:0 upgraded, 118 newly installed, 0 to remove and 320 not upgraded. 2024-08-18T21:00:53.959 INFO:teuthology.orchestra.run.smithi005.stdout:Need to get 251 MB of archives. 2024-08-18T21:00:53.959 INFO:teuthology.orchestra.run.smithi005.stdout:After this operation, 932 MB of additional disk space will be used. 2024-08-18T21:00:53.959 INFO:teuthology.orchestra.run.smithi005.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-08-18T21:00:53.988 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-08-18T21:00:53.988 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-18T21:00:53.988 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-18T21:00:53.989 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-18T21:00:53.989 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-18T21:00:53.989 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-18T21:00:53.989 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-18T21:00:53.990 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-08-18T21:00:53.990 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-18T21:00:53.991 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-08-18T21:00:53.992 INFO:teuthology.orchestra.run.smithi157.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-18T21:00:53.992 INFO:teuthology.orchestra.run.smithi157.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-08-18T21:00:53.992 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-08-18T21:00:53.992 INFO:teuthology.orchestra.run.smithi157.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-08-18T21:00:53.992 INFO:teuthology.orchestra.run.smithi157.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-08-18T21:00:53.992 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-08-18T21:00:53.992 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-08-18T21:00:53.992 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-18T21:00:53.992 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-18T21:00:53.992 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-18T21:00:53.992 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-18T21:00:53.992 INFO:teuthology.orchestra.run.smithi157.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-18T21:00:53.992 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-18T21:00:53.993 INFO:teuthology.orchestra.run.smithi157.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-18T21:00:53.993 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-08-18T21:00:53.993 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-08-18T21:00:53.993 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-08-18T21:00:53.993 INFO:teuthology.orchestra.run.smithi157.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-08-18T21:00:53.993 INFO:teuthology.orchestra.run.smithi157.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-08-18T21:00:53.993 INFO:teuthology.orchestra.run.smithi157.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-08-18T21:00:53.993 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-08-18T21:00:53.993 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet zip 2024-08-18T21:00:53.993 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-08-18T21:00:53.994 INFO:teuthology.orchestra.run.smithi157.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-08-18T21:00:53.994 INFO:teuthology.orchestra.run.smithi157.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-08-18T21:00:53.994 INFO:teuthology.orchestra.run.smithi157.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-08-18T21:00:53.994 INFO:teuthology.orchestra.run.smithi157.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-08-18T21:00:53.994 INFO:teuthology.orchestra.run.smithi157.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-08-18T21:00:53.994 INFO:teuthology.orchestra.run.smithi157.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-18T21:00:53.994 INFO:teuthology.orchestra.run.smithi157.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-08-18T21:00:53.994 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2024-08-18T21:00:53.994 INFO:teuthology.orchestra.run.smithi157.stdout: btrfs-tools 2024-08-18T21:00:54.046 INFO:teuthology.orchestra.run.smithi005.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-08-18T21:00:54.048 INFO:teuthology.orchestra.run.smithi005.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-08-18T21:00:54.055 INFO:teuthology.orchestra.run.smithi005.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-5847-g79766939-1jammy [3,632 kB] 2024-08-18T21:00:54.065 INFO:teuthology.orchestra.run.smithi005.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-08-18T21:00:54.095 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-08-18T21:00:54.095 INFO:teuthology.orchestra.run.smithi157.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-18T21:00:54.095 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-18T21:00:54.095 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-08-18T21:00:54.097 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-08-18T21:00:54.097 INFO:teuthology.orchestra.run.smithi157.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-08-18T21:00:54.097 INFO:teuthology.orchestra.run.smithi157.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-08-18T21:00:54.097 INFO:teuthology.orchestra.run.smithi157.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-08-18T21:00:54.097 INFO:teuthology.orchestra.run.smithi157.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-08-18T21:00:54.097 INFO:teuthology.orchestra.run.smithi157.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-08-18T21:00:54.097 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-08-18T21:00:54.097 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-08-18T21:00:54.097 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-18T21:00:54.097 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-18T21:00:54.097 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-18T21:00:54.097 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-18T21:00:54.097 INFO:teuthology.orchestra.run.smithi157.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-18T21:00:54.098 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-18T21:00:54.098 INFO:teuthology.orchestra.run.smithi157.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-18T21:00:54.098 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-08-18T21:00:54.098 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-08-18T21:00:54.098 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-08-18T21:00:54.098 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-08-18T21:00:54.098 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-08-18T21:00:54.098 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-08-18T21:00:54.098 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-08-18T21:00:54.098 INFO:teuthology.orchestra.run.smithi157.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-08-18T21:00:54.124 INFO:teuthology.orchestra.run.smithi005.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-08-18T21:00:54.129 INFO:teuthology.orchestra.run.smithi005.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-08-18T21:00:54.141 INFO:teuthology.orchestra.run.smithi005.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-08-18T21:00:54.145 INFO:teuthology.orchestra.run.smithi005.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-08-18T21:00:54.146 INFO:teuthology.orchestra.run.smithi005.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-08-18T21:00:54.147 INFO:teuthology.orchestra.run.smithi005.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-08-18T21:00:54.156 INFO:teuthology.orchestra.run.smithi005.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-08-18T21:00:54.158 INFO:teuthology.orchestra.run.smithi005.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-08-18T21:00:54.158 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 118 newly installed, 0 to remove and 320 not upgraded. 2024-08-18T21:00:54.159 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 251 MB of archives. 2024-08-18T21:00:54.159 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 932 MB of additional disk space will be used. 2024-08-18T21:00:54.159 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-08-18T21:00:54.160 INFO:teuthology.orchestra.run.smithi005.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-08-18T21:00:54.162 INFO:teuthology.orchestra.run.smithi005.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-08-18T21:00:54.162 INFO:teuthology.orchestra.run.smithi005.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-08-18T21:00:54.164 INFO:teuthology.orchestra.run.smithi005.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-08-18T21:00:54.179 INFO:teuthology.orchestra.run.smithi005.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-08-18T21:00:54.181 INFO:teuthology.orchestra.run.smithi005.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-08-18T21:00:54.181 INFO:teuthology.orchestra.run.smithi005.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-08-18T21:00:54.182 INFO:teuthology.orchestra.run.smithi005.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-08-18T21:00:54.183 INFO:teuthology.orchestra.run.smithi005.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-08-18T21:00:54.183 INFO:teuthology.orchestra.run.smithi005.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-08-18T21:00:54.196 INFO:teuthology.orchestra.run.smithi005.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-08-18T21:00:54.196 INFO:teuthology.orchestra.run.smithi005.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-08-18T21:00:54.197 INFO:teuthology.orchestra.run.smithi005.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-08-18T21:00:54.197 INFO:teuthology.orchestra.run.smithi005.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-08-18T21:00:54.213 INFO:teuthology.orchestra.run.smithi005.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-08-18T21:00:54.215 INFO:teuthology.orchestra.run.smithi005.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-08-18T21:00:54.216 INFO:teuthology.orchestra.run.smithi005.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-08-18T21:00:54.216 INFO:teuthology.orchestra.run.smithi005.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-08-18T21:00:54.217 INFO:teuthology.orchestra.run.smithi005.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-08-18T21:00:54.218 INFO:teuthology.orchestra.run.smithi005.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-18T21:00:54.230 INFO:teuthology.orchestra.run.smithi005.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-08-18T21:00:54.230 INFO:teuthology.orchestra.run.smithi005.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-08-18T21:00:54.231 INFO:teuthology.orchestra.run.smithi005.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-08-18T21:00:54.232 INFO:teuthology.orchestra.run.smithi005.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-08-18T21:00:54.247 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-08-18T21:00:54.247 INFO:teuthology.orchestra.run.smithi005.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-08-18T21:00:54.249 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-08-18T21:00:54.249 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-5847-g79766939-1jammy [3,632 kB] 2024-08-18T21:00:54.252 INFO:teuthology.orchestra.run.smithi005.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-08-18T21:00:54.253 INFO:teuthology.orchestra.run.smithi005.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-08-18T21:00:54.253 INFO:teuthology.orchestra.run.smithi005.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-08-18T21:00:54.254 INFO:teuthology.orchestra.run.smithi005.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-08-18T21:00:54.255 INFO:teuthology.orchestra.run.smithi005.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-08-18T21:00:54.264 INFO:teuthology.orchestra.run.smithi005.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-08-18T21:00:54.265 INFO:teuthology.orchestra.run.smithi005.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-08-18T21:00:54.266 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-08-18T21:00:54.266 INFO:teuthology.orchestra.run.smithi005.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-08-18T21:00:54.267 INFO:teuthology.orchestra.run.smithi005.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-08-18T21:00:54.281 INFO:teuthology.orchestra.run.smithi005.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-08-18T21:00:54.282 INFO:teuthology.orchestra.run.smithi005.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-08-18T21:00:54.282 INFO:teuthology.orchestra.run.smithi005.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-5847-g79766939-1jammy [3,313 kB] 2024-08-18T21:00:54.282 INFO:teuthology.orchestra.run.smithi005.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-08-18T21:00:54.285 INFO:teuthology.orchestra.run.smithi005.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-08-18T21:00:54.325 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-08-18T21:00:54.330 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-08-18T21:00:54.338 INFO:teuthology.orchestra.run.smithi005.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-08-18T21:00:54.339 INFO:teuthology.orchestra.run.smithi005.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-08-18T21:00:54.340 INFO:teuthology.orchestra.run.smithi005.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-18T21:00:54.340 INFO:teuthology.orchestra.run.smithi005.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-08-18T21:00:54.341 INFO:teuthology.orchestra.run.smithi005.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-08-18T21:00:54.342 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-08-18T21:00:54.346 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-08-18T21:00:54.347 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-08-18T21:00:54.348 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-08-18T21:00:54.356 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-08-18T21:00:54.358 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-08-18T21:00:54.359 INFO:teuthology.orchestra.run.smithi005.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-08-18T21:00:54.360 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-08-18T21:00:54.361 INFO:teuthology.orchestra.run.smithi005.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-08-18T21:00:54.361 INFO:teuthology.orchestra.run.smithi005.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-08-18T21:00:54.362 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-08-18T21:00:54.363 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-08-18T21:00:54.366 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-08-18T21:00:54.376 INFO:teuthology.orchestra.run.smithi005.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-08-18T21:00:54.376 INFO:teuthology.orchestra.run.smithi005.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-08-18T21:00:54.376 INFO:teuthology.orchestra.run.smithi005.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-08-18T21:00:54.377 INFO:teuthology.orchestra.run.smithi005.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-08-18T21:00:54.377 INFO:teuthology.orchestra.run.smithi005.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-08-18T21:00:54.377 INFO:teuthology.orchestra.run.smithi005.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-08-18T21:00:54.380 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-08-18T21:00:54.381 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-08-18T21:00:54.382 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-08-18T21:00:54.382 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-08-18T21:00:54.384 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-08-18T21:00:54.384 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-08-18T21:00:54.384 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-08-18T21:00:54.385 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-08-18T21:00:54.391 INFO:teuthology.orchestra.run.smithi005.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-08-18T21:00:54.391 INFO:teuthology.orchestra.run.smithi005.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-08-18T21:00:54.394 INFO:teuthology.orchestra.run.smithi005.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-08-18T21:00:54.398 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-08-18T21:00:54.398 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-08-18T21:00:54.408 INFO:teuthology.orchestra.run.smithi005.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-08-18T21:00:54.409 INFO:teuthology.orchestra.run.smithi005.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-08-18T21:00:54.410 INFO:teuthology.orchestra.run.smithi005.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-08-18T21:00:54.413 INFO:teuthology.orchestra.run.smithi005.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-08-18T21:00:54.415 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-08-18T21:00:54.415 INFO:teuthology.orchestra.run.smithi005.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-08-18T21:00:54.415 INFO:teuthology.orchestra.run.smithi005.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-08-18T21:00:54.416 INFO:teuthology.orchestra.run.smithi005.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-08-18T21:00:54.419 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-08-18T21:00:54.420 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-08-18T21:00:54.420 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-08-18T21:00:54.421 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-08-18T21:00:54.423 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-18T21:00:54.423 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-08-18T21:00:54.424 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-08-18T21:00:54.424 INFO:teuthology.orchestra.run.smithi005.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-08-18T21:00:54.425 INFO:teuthology.orchestra.run.smithi005.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-08-18T21:00:54.428 INFO:teuthology.orchestra.run.smithi005.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-08-18T21:00:54.432 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-08-18T21:00:54.433 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-08-18T21:00:54.442 INFO:teuthology.orchestra.run.smithi005.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-18T21:00:54.442 INFO:teuthology.orchestra.run.smithi005.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-08-18T21:00:54.443 INFO:teuthology.orchestra.run.smithi005.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-08-18T21:00:54.444 INFO:teuthology.orchestra.run.smithi005.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-08-18T21:00:54.445 INFO:teuthology.orchestra.run.smithi005.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-08-18T21:00:54.449 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-08-18T21:00:54.455 INFO:teuthology.orchestra.run.smithi005.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-08-18T21:00:54.455 INFO:teuthology.orchestra.run.smithi005.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-08-18T21:00:54.457 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-08-18T21:00:54.458 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-08-18T21:00:54.458 INFO:teuthology.orchestra.run.smithi005.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-08-18T21:00:54.459 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-08-18T21:00:54.460 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-08-18T21:00:54.460 INFO:teuthology.orchestra.run.smithi005.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-08-18T21:00:54.461 INFO:teuthology.orchestra.run.smithi005.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-08-18T21:00:54.461 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-08-18T21:00:54.465 INFO:teuthology.orchestra.run.smithi157.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-08-18T21:00:54.466 INFO:teuthology.orchestra.run.smithi157.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-08-18T21:00:54.468 INFO:teuthology.orchestra.run.smithi157.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-08-18T21:00:54.469 INFO:teuthology.orchestra.run.smithi157.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-08-18T21:00:54.483 INFO:teuthology.orchestra.run.smithi157.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-08-18T21:00:54.484 INFO:teuthology.orchestra.run.smithi157.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-08-18T21:00:54.485 INFO:teuthology.orchestra.run.smithi157.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-08-18T21:00:54.489 INFO:teuthology.orchestra.run.smithi157.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-08-18T21:00:54.499 INFO:teuthology.orchestra.run.smithi005.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-5847-g79766939-1jammy [721 kB] 2024-08-18T21:00:54.555 INFO:teuthology.orchestra.run.smithi157.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-08-18T21:00:54.555 INFO:teuthology.orchestra.run.smithi157.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-08-18T21:00:54.556 INFO:teuthology.orchestra.run.smithi157.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-18T21:00:54.557 INFO:teuthology.orchestra.run.smithi157.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-08-18T21:00:54.558 INFO:teuthology.orchestra.run.smithi157.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-08-18T21:00:54.575 INFO:teuthology.orchestra.run.smithi157.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-08-18T21:00:54.576 INFO:teuthology.orchestra.run.smithi005.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-5847-g79766939-1jammy [356 kB] 2024-08-18T21:00:54.577 INFO:teuthology.orchestra.run.smithi157.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-08-18T21:00:54.577 INFO:teuthology.orchestra.run.smithi157.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-08-18T21:00:54.583 INFO:teuthology.orchestra.run.smithi005.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-5847-g79766939-1jammy [32.8 kB] 2024-08-18T21:00:54.588 INFO:teuthology.orchestra.run.smithi005.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-5847-g79766939-1jammy [180 kB] 2024-08-18T21:00:54.592 INFO:teuthology.orchestra.run.smithi157.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-08-18T21:00:54.592 INFO:teuthology.orchestra.run.smithi157.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-08-18T21:00:54.593 INFO:teuthology.orchestra.run.smithi157.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-08-18T21:00:54.593 INFO:teuthology.orchestra.run.smithi157.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-08-18T21:00:54.594 INFO:teuthology.orchestra.run.smithi157.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-08-18T21:00:54.594 INFO:teuthology.orchestra.run.smithi157.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-08-18T21:00:54.609 INFO:teuthology.orchestra.run.smithi157.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-08-18T21:00:54.610 INFO:teuthology.orchestra.run.smithi157.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-08-18T21:00:54.614 INFO:teuthology.orchestra.run.smithi157.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-08-18T21:00:54.617 INFO:teuthology.orchestra.run.smithi005.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-5847-g79766939-1jammy [68.9 kB] 2024-08-18T21:00:54.626 INFO:teuthology.orchestra.run.smithi157.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-08-18T21:00:54.627 INFO:teuthology.orchestra.run.smithi157.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-08-18T21:00:54.628 INFO:teuthology.orchestra.run.smithi157.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-08-18T21:00:54.631 INFO:teuthology.orchestra.run.smithi157.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-08-18T21:00:54.633 INFO:teuthology.orchestra.run.smithi157.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-08-18T21:00:54.634 INFO:teuthology.orchestra.run.smithi157.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-08-18T21:00:54.634 INFO:teuthology.orchestra.run.smithi157.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-08-18T21:00:54.635 INFO:teuthology.orchestra.run.smithi005.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-5847-g79766939-1jammy [338 kB] 2024-08-18T21:00:54.644 INFO:teuthology.orchestra.run.smithi157.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-08-18T21:00:54.644 INFO:teuthology.orchestra.run.smithi157.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-08-18T21:00:54.647 INFO:teuthology.orchestra.run.smithi157.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-08-18T21:00:54.661 INFO:teuthology.orchestra.run.smithi157.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-18T21:00:54.661 INFO:teuthology.orchestra.run.smithi157.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-08-18T21:00:54.661 INFO:teuthology.orchestra.run.smithi157.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-08-18T21:00:54.663 INFO:teuthology.orchestra.run.smithi157.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-08-18T21:00:54.663 INFO:teuthology.orchestra.run.smithi157.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-08-18T21:00:54.670 INFO:teuthology.orchestra.run.smithi157.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-08-18T21:00:54.670 INFO:teuthology.orchestra.run.smithi157.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-08-18T21:00:54.678 INFO:teuthology.orchestra.run.smithi157.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-08-18T21:00:54.678 INFO:teuthology.orchestra.run.smithi005.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-5847-g79766939-1jammy [8,017 kB] 2024-08-18T21:00:54.681 INFO:teuthology.orchestra.run.smithi157.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-08-18T21:00:54.682 INFO:teuthology.orchestra.run.smithi157.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-08-18T21:00:54.831 INFO:teuthology.orchestra.run.smithi005.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-5847-g79766939-1jammy [112 kB] 2024-08-18T21:00:54.833 INFO:teuthology.orchestra.run.smithi005.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-5847-g79766939-1jammy [472 kB] 2024-08-18T21:00:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-5847-g79766939-1jammy [28.3 MB] 2024-08-18T21:00:55.829 INFO:teuthology.orchestra.run.smithi005.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-5847-g79766939-1jammy [5,198 kB] 2024-08-18T21:00:55.912 INFO:teuthology.orchestra.run.smithi005.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-5847-g79766939-1jammy [247 kB] 2024-08-18T21:00:55.929 INFO:teuthology.orchestra.run.smithi005.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-5847-g79766939-1jammy [124 kB] 2024-08-18T21:00:55.951 INFO:teuthology.orchestra.run.smithi005.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-5847-g79766939-1jammy [1,560 kB] 2024-08-18T21:00:56.000 INFO:teuthology.orchestra.run.smithi005.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-5847-g79766939-1jammy [6,293 kB] 2024-08-18T21:00:56.211 INFO:teuthology.orchestra.run.smithi005.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-5847-g79766939-1jammy [23.1 MB] 2024-08-18T21:00:57.022 INFO:teuthology.orchestra.run.smithi005.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-5847-g79766939-1jammy [14.1 kB] 2024-08-18T21:00:57.023 INFO:teuthology.orchestra.run.smithi005.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-5847-g79766939-1jammy [880 kB] 2024-08-18T21:00:57.041 INFO:teuthology.orchestra.run.smithi005.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-5847-g79766939-1jammy [2,437 kB] 2024-08-18T21:00:57.085 INFO:teuthology.orchestra.run.smithi005.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-5847-g79766939-1jammy [801 kB] 2024-08-18T21:00:57.112 INFO:teuthology.orchestra.run.smithi005.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-5847-g79766939-1jammy [156 kB] 2024-08-18T21:00:57.136 INFO:teuthology.orchestra.run.smithi005.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-5847-g79766939-1jammy [61.3 MB] 2024-08-18T21:00:59.793 INFO:teuthology.orchestra.run.smithi157.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-5847-g79766939-1jammy [3,313 kB] 2024-08-18T21:00:59.863 INFO:teuthology.orchestra.run.smithi157.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-5847-g79766939-1jammy [721 kB] 2024-08-18T21:00:59.875 INFO:teuthology.orchestra.run.smithi157.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-5847-g79766939-1jammy [356 kB] 2024-08-18T21:00:59.879 INFO:teuthology.orchestra.run.smithi005.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-5847-g79766939-1jammy [8,625 kB] 2024-08-18T21:00:59.881 INFO:teuthology.orchestra.run.smithi157.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-5847-g79766939-1jammy [32.8 kB] 2024-08-18T21:00:59.882 INFO:teuthology.orchestra.run.smithi157.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-5847-g79766939-1jammy [180 kB] 2024-08-18T21:00:59.884 INFO:teuthology.orchestra.run.smithi157.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-5847-g79766939-1jammy [68.9 kB] 2024-08-18T21:00:59.886 INFO:teuthology.orchestra.run.smithi157.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-5847-g79766939-1jammy [338 kB] 2024-08-18T21:00:59.890 INFO:teuthology.orchestra.run.smithi157.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-5847-g79766939-1jammy [8,017 kB] 2024-08-18T21:01:00.049 INFO:teuthology.orchestra.run.smithi005.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-5847-g79766939-1jammy [14.2 kB] 2024-08-18T21:01:00.049 INFO:teuthology.orchestra.run.smithi005.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-5847-g79766939-1jammy [55.8 MB] 2024-08-18T21:01:00.154 INFO:teuthology.orchestra.run.smithi157.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-5847-g79766939-1jammy [112 kB] 2024-08-18T21:01:00.156 INFO:teuthology.orchestra.run.smithi157.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-5847-g79766939-1jammy [472 kB] 2024-08-18T21:01:00.181 INFO:teuthology.orchestra.run.smithi157.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-5847-g79766939-1jammy [28.3 MB] 2024-08-18T21:01:01.936 INFO:teuthology.orchestra.run.smithi005.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-5847-g79766939-1jammy [130 kB] 2024-08-18T21:01:01.939 INFO:teuthology.orchestra.run.smithi005.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-5847-g79766939-1jammy [38.9 kB] 2024-08-18T21:01:02.002 INFO:teuthology.orchestra.run.smithi005.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-5847-g79766939-1jammy [16.0 MB] 2024-08-18T21:01:02.354 INFO:teuthology.orchestra.run.smithi005.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-5847-g79766939-1jammy [91.4 kB] 2024-08-18T21:01:02.938 INFO:teuthology.orchestra.run.smithi157.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-5847-g79766939-1jammy [5,198 kB] 2024-08-18T21:01:02.947 INFO:teuthology.orchestra.run.smithi005.stdout:Fetched 251 MB in 8s (29.7 MB/s) 2024-08-18T21:01:03.008 INFO:teuthology.orchestra.run.smithi157.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-5847-g79766939-1jammy [247 kB] 2024-08-18T21:01:03.012 INFO:teuthology.orchestra.run.smithi157.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-5847-g79766939-1jammy [124 kB] 2024-08-18T21:01:03.012 INFO:teuthology.orchestra.run.smithi157.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-5847-g79766939-1jammy [1,560 kB] 2024-08-18T21:01:03.026 INFO:teuthology.orchestra.run.smithi157.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-5847-g79766939-1jammy [6,293 kB] 2024-08-18T21:01:03.117 INFO:teuthology.orchestra.run.smithi157.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-5847-g79766939-1jammy [23.1 MB] 2024-08-18T21:01:03.118 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-08-18T21:01:03.222 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-08-18T21:01:03.228 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-08-18T21:01:03.318 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-18T21:01:03.574 INFO:teuthology.orchestra.run.smithi157.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-5847-g79766939-1jammy [14.1 kB] 2024-08-18T21:01:03.574 INFO:teuthology.orchestra.run.smithi157.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-5847-g79766939-1jammy [880 kB] 2024-08-18T21:01:03.584 INFO:teuthology.orchestra.run.smithi157.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-5847-g79766939-1jammy [2,437 kB] 2024-08-18T21:01:03.610 INFO:teuthology.orchestra.run.smithi157.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-5847-g79766939-1jammy [801 kB] 2024-08-18T21:01:03.619 INFO:teuthology.orchestra.run.smithi157.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-5847-g79766939-1jammy [156 kB] 2024-08-18T21:01:03.621 INFO:teuthology.orchestra.run.smithi157.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-5847-g79766939-1jammy [61.3 MB] 2024-08-18T21:01:03.654 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-18T21:01:03.681 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-08-18T21:01:03.720 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-18T21:01:04.132 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-18T21:01:04.159 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-08-18T21:01:04.207 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-18T21:01:04.677 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-18T21:01:04.704 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-18T21:01:04.753 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T21:01:04.862 INFO:teuthology.orchestra.run.smithi157.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-5847-g79766939-1jammy [8,625 kB] 2024-08-18T21:01:04.968 INFO:teuthology.orchestra.run.smithi157.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-5847-g79766939-1jammy [14.2 kB] 2024-08-18T21:01:04.968 INFO:teuthology.orchestra.run.smithi157.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-5847-g79766939-1jammy [55.8 MB] 2024-08-18T21:01:05.164 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-18T21:01:05.190 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-18T21:01:05.238 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T21:01:06.009 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-18T21:01:06.036 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-18T21:01:06.083 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T21:01:06.138 INFO:teuthology.orchestra.run.smithi157.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-5847-g79766939-1jammy [130 kB] 2024-08-18T21:01:06.140 INFO:teuthology.orchestra.run.smithi157.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-5847-g79766939-1jammy [38.9 kB] 2024-08-18T21:01:06.141 INFO:teuthology.orchestra.run.smithi157.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-5847-g79766939-1jammy [16.0 MB] 2024-08-18T21:01:06.428 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-08-18T21:01:06.446 INFO:teuthology.orchestra.run.smithi157.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-5847-g79766939-1jammy [91.4 kB] 2024-08-18T21:01:06.455 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-08-18T21:01:06.494 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-18T21:01:06.822 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package librados2. 2024-08-18T21:01:06.849 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../007-librados2_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:06.889 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking librados2 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:07.012 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 251 MB in 12s (20.3 MB/s) 2024-08-18T21:01:07.180 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-08-18T21:01:07.280 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-08-18T21:01:07.286 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-08-18T21:01:07.370 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-18T21:01:07.409 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package librbd1. 2024-08-18T21:01:07.436 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../008-librbd1_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:07.483 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking librbd1 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:07.691 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-18T21:01:07.717 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-08-18T21:01:07.757 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-18T21:01:07.911 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libcephfs2. 2024-08-18T21:01:07.938 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:07.978 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libcephfs2 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:08.264 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-rados. 2024-08-18T21:01:08.291 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../010-python3-rados_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:08.330 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-rados (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:08.535 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-18T21:01:08.561 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-08-18T21:01:08.602 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-18T21:01:08.658 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-18T21:01:08.685 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-5847-g79766939-1jammy_all.deb ... 2024-08-18T21:01:08.724 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-ceph-argparse (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:08.952 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cephfs. 2024-08-18T21:01:08.968 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:09.002 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cephfs (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:09.005 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-18T21:01:09.031 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-18T21:01:09.072 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T21:01:09.330 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-18T21:01:09.356 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-5847-g79766939-1jammy_all.deb ... 2024-08-18T21:01:09.396 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-ceph-common (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:09.467 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-18T21:01:09.493 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-18T21:01:09.534 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T21:01:09.733 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-18T21:01:09.760 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-08-18T21:01:09.799 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-18T21:01:09.870 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-18T21:01:09.896 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-18T21:01:09.937 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T21:01:10.119 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-prettytable. 2024-08-18T21:01:10.146 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-08-18T21:01:10.185 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-08-18T21:01:10.256 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-08-18T21:01:10.283 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-08-18T21:01:10.315 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-18T21:01:10.438 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-rbd. 2024-08-18T21:01:10.453 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:10.488 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-rbd (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:10.618 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librados2. 2024-08-18T21:01:10.644 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../007-librados2_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:10.684 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librados2 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:11.145 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librbd1. 2024-08-18T21:01:11.171 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../008-librbd1_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:11.199 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-18T21:01:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librbd1 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:11.226 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-08-18T21:01:11.266 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-18T21:01:11.552 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-08-18T21:01:11.579 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-08-18T21:01:11.618 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-08-18T21:01:11.623 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs2. 2024-08-18T21:01:11.649 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:11.690 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs2 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:11.938 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-08-18T21:01:11.954 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-08-18T21:01:11.984 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rados. 2024-08-18T21:01:11.996 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-18T21:01:11.999 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../010-python3-rados_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:12.042 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rados (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:12.299 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package lua5.1. 2024-08-18T21:01:12.311 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-18T21:01:12.315 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-08-18T21:01:12.338 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-5847-g79766939-1jammy_all.deb ... 2024-08-18T21:01:12.349 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-08-18T21:01:12.378 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-argparse (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:12.644 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package lua-any. 2024-08-18T21:01:12.655 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cephfs. 2024-08-18T21:01:12.660 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-08-18T21:01:12.671 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:12.702 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking lua-any (27ubuntu1) ... 2024-08-18T21:01:12.739 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cephfs (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:12.946 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package zip. 2024-08-18T21:01:12.973 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-08-18T21:01:13.013 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking zip (3.0-12build2) ... 2024-08-18T21:01:13.050 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-18T21:01:13.076 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-5847-g79766939-1jammy_all.deb ... 2024-08-18T21:01:13.116 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-common (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:13.375 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package unzip. 2024-08-18T21:01:13.401 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-08-18T21:01:13.441 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-08-18T21:01:13.445 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-18T21:01:13.475 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-08-18T21:01:13.586 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-18T21:01:13.787 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package luarocks. 2024-08-18T21:01:13.813 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-08-18T21:01:13.853 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-08-18T21:01:13.855 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-prettytable. 2024-08-18T21:01:13.871 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-08-18T21:01:13.914 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-08-18T21:01:14.150 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rbd. 2024-08-18T21:01:14.165 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:14.208 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rbd (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:14.252 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package librgw2. 2024-08-18T21:01:14.280 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../025-librgw2_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:14.319 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking librgw2 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:14.545 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-18T21:01:14.571 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-08-18T21:01:14.611 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-18T21:01:14.905 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-08-18T21:01:14.932 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-08-18T21:01:14.946 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-rgw. 2024-08-18T21:01:14.962 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:14.972 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-08-18T21:01:15.004 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-rgw (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:15.242 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-08-18T21:01:15.257 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-08-18T21:01:15.292 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-18T21:01:15.316 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package liboath0:amd64. 2024-08-18T21:01:15.343 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-08-18T21:01:15.374 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-08-18T21:01:15.612 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua5.1. 2024-08-18T21:01:15.638 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-08-18T21:01:15.669 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libradosstriper1. 2024-08-18T21:01:15.678 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-08-18T21:01:15.696 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:15.735 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libradosstriper1 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:15.989 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-any. 2024-08-18T21:01:16.004 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-08-18T21:01:16.073 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-any (27ubuntu1) ... 2024-08-18T21:01:16.292 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package zip. 2024-08-18T21:01:16.305 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-common. 2024-08-18T21:01:16.307 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-08-18T21:01:16.332 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../029-ceph-common_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:16.342 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking zip (3.0-12build2) ... 2024-08-18T21:01:16.371 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-common (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:16.645 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package unzip. 2024-08-18T21:01:16.671 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-08-18T21:01:16.712 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-08-18T21:01:17.068 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package luarocks. 2024-08-18T21:01:17.094 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-08-18T21:01:17.134 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-08-18T21:01:17.467 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librgw2. 2024-08-18T21:01:17.493 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../025-librgw2_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:17.542 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librgw2 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:17.919 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-base. 2024-08-18T21:01:17.946 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../030-ceph-base_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:17.986 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-base (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:18.144 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rgw. 2024-08-18T21:01:18.159 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:18.202 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rgw (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:18.506 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-08-18T21:01:18.533 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-08-18T21:01:18.538 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liboath0:amd64. 2024-08-18T21:01:18.565 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-08-18T21:01:18.572 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-08-18T21:01:18.605 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-08-18T21:01:18.877 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cheroot. 2024-08-18T21:01:18.883 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libradosstriper1. 2024-08-18T21:01:18.902 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-08-18T21:01:18.909 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:18.942 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-18T21:01:18.949 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libradosstriper1 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:19.270 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-08-18T21:01:19.297 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-08-18T21:01:19.336 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-08-18T21:01:19.378 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-common. 2024-08-18T21:01:19.404 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../029-ceph-common_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:19.444 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-common (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:19.622 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jaraco.text. 2024-08-18T21:01:19.650 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-08-18T21:01:19.689 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-08-18T21:01:19.942 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-08-18T21:01:19.969 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-08-18T21:01:20.000 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-08-18T21:01:20.286 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-tempora. 2024-08-18T21:01:20.314 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-08-18T21:01:20.352 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-08-18T21:01:20.706 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-portend. 2024-08-18T21:01:20.733 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-08-18T21:01:20.797 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-08-18T21:01:20.892 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-base. 2024-08-18T21:01:20.918 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../030-ceph-base_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:20.976 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-base (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:21.167 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-08-18T21:01:21.194 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-08-18T21:01:21.225 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-08-18T21:01:21.528 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-18T21:01:21.538 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-08-18T21:01:21.555 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-08-18T21:01:21.564 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-08-18T21:01:21.594 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-08-18T21:01:21.604 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-08-18T21:01:21.907 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cheroot. 2024-08-18T21:01:21.933 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-08-18T21:01:21.948 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-natsort. 2024-08-18T21:01:21.973 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-18T21:01:21.975 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-08-18T21:01:22.014 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-08-18T21:01:22.293 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-08-18T21:01:22.320 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-08-18T21:01:22.351 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-logutils. 2024-08-18T21:01:22.360 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-08-18T21:01:22.378 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-08-18T21:01:22.417 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-08-18T21:01:22.663 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.text. 2024-08-18T21:01:22.678 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-18T21:01:22.689 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-08-18T21:01:22.706 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-08-18T21:01:22.729 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-08-18T21:01:22.737 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-08-18T21:01:23.015 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-mako. 2024-08-18T21:01:23.032 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-08-18T21:01:23.042 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-08-18T21:01:23.058 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-08-18T21:01:23.081 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-18T21:01:23.098 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-08-18T21:01:23.410 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempora. 2024-08-18T21:01:23.437 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-08-18T21:01:23.443 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-18T21:01:23.470 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-18T21:01:23.493 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-08-18T21:01:23.509 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-18T21:01:23.787 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-18T21:01:23.803 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-08-18T21:01:23.837 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-08-18T21:01:24.030 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-portend. 2024-08-18T21:01:24.056 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-08-18T21:01:24.072 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-webob. 2024-08-18T21:01:24.096 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-08-18T21:01:24.096 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-08-18T21:01:24.131 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-08-18T21:01:24.399 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-08-18T21:01:24.426 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-08-18T21:01:24.465 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-08-18T21:01:24.494 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-waitress. 2024-08-18T21:01:24.521 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-08-18T21:01:24.564 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-18T21:01:24.752 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-18T21:01:24.779 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-08-18T21:01:24.818 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-08-18T21:01:24.897 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-tempita. 2024-08-18T21:01:24.924 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-08-18T21:01:24.964 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-08-18T21:01:25.250 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-paste. 2024-08-18T21:01:25.277 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-08-18T21:01:25.316 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-08-18T21:01:25.620 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-18T21:01:25.647 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-08-18T21:01:25.686 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-08-18T21:01:25.881 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-natsort. 2024-08-18T21:01:25.908 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-08-18T21:01:25.947 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-08-18T21:01:25.989 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-18T21:01:26.016 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-08-18T21:01:26.055 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-08-18T21:01:26.267 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-logutils. 2024-08-18T21:01:26.294 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-08-18T21:01:26.334 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-08-18T21:01:26.550 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-webtest. 2024-08-18T21:01:26.577 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-08-18T21:01:26.578 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-18T21:01:26.605 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-08-18T21:01:26.616 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-08-18T21:01:26.636 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-08-18T21:01:26.886 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pecan. 2024-08-18T21:01:26.902 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-08-18T21:01:26.922 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-mako. 2024-08-18T21:01:26.936 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-08-18T21:01:26.949 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-08-18T21:01:26.989 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-18T21:01:27.334 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-18T21:01:27.361 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-18T21:01:27.401 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-18T21:01:27.704 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-18T21:01:27.730 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-08-18T21:01:27.770 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-08-18T21:01:28.073 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webob. 2024-08-18T21:01:28.100 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-08-18T21:01:28.116 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-certifi. 2024-08-18T21:01:28.139 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-08-18T21:01:28.143 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-08-18T21:01:28.182 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-08-18T21:01:28.467 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-waitress. 2024-08-18T21:01:28.494 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-08-18T21:01:28.537 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-18T21:01:28.544 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-idna. 2024-08-18T21:01:28.571 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-08-18T21:01:28.610 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-08-18T21:01:28.795 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempita. 2024-08-18T21:01:28.822 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-08-18T21:01:28.862 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-08-18T21:01:28.930 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-urllib3. 2024-08-18T21:01:28.957 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-08-18T21:01:28.996 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-18T21:01:29.165 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-paste. 2024-08-18T21:01:29.191 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-08-18T21:01:29.231 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-08-18T21:01:29.325 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-requests. 2024-08-18T21:01:29.352 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-08-18T21:01:29.394 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-18T21:01:29.526 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-18T21:01:29.550 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-08-18T21:01:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-08-18T21:01:29.669 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-18T21:01:29.685 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-08-18T21:01:29.719 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-18T21:01:29.896 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-18T21:01:29.923 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-08-18T21:01:29.962 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-08-18T21:01:30.022 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-18T21:01:30.038 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-5847-g79766939-1jammy_all.deb ... 2024-08-18T21:01:30.080 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-modules-core (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:30.265 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webtest. 2024-08-18T21:01:30.292 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-08-18T21:01:30.332 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-08-18T21:01:30.493 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-18T21:01:30.521 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:30.560 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:30.651 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pecan. 2024-08-18T21:01:30.678 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-08-18T21:01:30.718 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-08-18T21:01:30.921 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-18T21:01:30.948 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-08-18T21:01:30.987 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-08-18T21:01:31.031 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-certifi. 2024-08-18T21:01:31.058 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-08-18T21:01:31.089 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-08-18T21:01:31.265 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-openssl. 2024-08-18T21:01:31.292 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-08-18T21:01:31.332 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-08-18T21:01:31.392 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-idna. 2024-08-18T21:01:31.419 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-08-18T21:01:31.458 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-08-18T21:01:31.660 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr. 2024-08-18T21:01:31.687 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:31.726 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:31.778 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-urllib3. 2024-08-18T21:01:31.805 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-08-18T21:01:31.845 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-18T21:01:32.121 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mon. 2024-08-18T21:01:32.148 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:32.181 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests. 2024-08-18T21:01:32.187 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mon (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:32.208 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-08-18T21:01:32.247 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-18T21:01:32.559 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-18T21:01:32.586 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-08-18T21:01:32.625 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-18T21:01:32.816 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-osd. 2024-08-18T21:01:32.843 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:32.882 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-osd (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:32.904 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-18T21:01:32.931 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-5847-g79766939-1jammy_all.deb ... 2024-08-18T21:01:32.970 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-modules-core (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:33.350 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-18T21:01:33.377 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:33.417 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:33.719 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-18T21:01:33.747 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-08-18T21:01:33.786 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-08-18T21:01:33.952 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph. 2024-08-18T21:01:33.969 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../066-ceph_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:34.002 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:34.064 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-openssl. 2024-08-18T21:01:34.090 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-08-18T21:01:34.122 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-08-18T21:01:34.289 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-fuse. 2024-08-18T21:01:34.316 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:34.355 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-fuse (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:34.458 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr. 2024-08-18T21:01:34.485 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:34.525 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:34.742 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mds. 2024-08-18T21:01:34.769 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:34.808 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mds (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:34.928 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mon. 2024-08-18T21:01:34.955 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:34.994 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mon (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:35.211 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package cephadm. 2024-08-18T21:01:35.239 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../069-cephadm_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:35.277 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking cephadm (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:35.547 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-asyncssh. 2024-08-18T21:01:35.574 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-08-18T21:01:35.590 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-osd. 2024-08-18T21:01:35.605 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-08-18T21:01:35.616 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:35.648 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-osd (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:35.933 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python-babel-localedata. 2024-08-18T21:01:35.949 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-08-18T21:01:35.991 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-18T21:01:36.668 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph. 2024-08-18T21:01:36.694 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../066-ceph_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:36.734 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:37.054 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-fuse. 2024-08-18T21:01:37.080 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:37.120 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-fuse (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:37.187 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-babel. 2024-08-18T21:01:37.215 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-08-18T21:01:37.254 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-08-18T21:01:37.490 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mds. 2024-08-18T21:01:37.517 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:37.556 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mds (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:37.582 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jinja2. 2024-08-18T21:01:37.609 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-08-18T21:01:37.648 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-18T21:01:37.926 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephadm. 2024-08-18T21:01:37.953 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../069-cephadm_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:37.984 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephadm (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:38.018 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-18T21:01:38.045 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-5847-g79766939-1jammy_all.deb ... 2024-08-18T21:01:38.093 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-cephadm (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:38.296 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-asyncssh. 2024-08-18T21:01:38.322 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-08-18T21:01:38.362 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-08-18T21:01:38.446 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-18T21:01:38.473 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-08-18T21:01:38.512 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-18T21:01:38.648 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-babel-localedata. 2024-08-18T21:01:38.675 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-08-18T21:01:38.706 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-18T21:01:38.790 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-routes. 2024-08-18T21:01:38.806 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-08-18T21:01:38.840 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-08-18T21:01:39.194 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-18T21:01:39.221 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-5847-g79766939-1jammy_all.deb ... 2024-08-18T21:01:39.260 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-dashboard (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:39.878 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-babel. 2024-08-18T21:01:39.894 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-08-18T21:01:39.928 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-08-18T21:01:40.198 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jinja2. 2024-08-18T21:01:40.224 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-08-18T21:01:40.255 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-18T21:01:40.584 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-18T21:01:40.611 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-5847-g79766939-1jammy_all.deb ... 2024-08-18T21:01:40.650 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-cephadm (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:40.995 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-18T21:01:41.022 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-08-18T21:01:41.062 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-18T21:01:41.431 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-routes. 2024-08-18T21:01:41.459 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-08-18T21:01:41.498 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-08-18T21:01:41.834 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-18T21:01:41.862 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-5847-g79766939-1jammy_all.deb ... 2024-08-18T21:01:41.909 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-dashboard (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:42.056 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-08-18T21:01:42.074 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-08-18T21:01:42.106 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-18T21:01:42.601 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-joblib. 2024-08-18T21:01:42.629 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-08-18T21:01:42.667 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-08-18T21:01:43.038 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-08-18T21:01:43.066 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-08-18T21:01:43.104 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-08-18T21:01:43.357 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-sklearn. 2024-08-18T21:01:43.385 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-08-18T21:01:43.415 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-18T21:01:44.140 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-18T21:01:44.169 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-5847-g79766939-1jammy_all.deb ... 2024-08-18T21:01:44.300 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:44.714 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-08-18T21:01:44.731 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-08-18T21:01:44.772 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-18T21:01:45.267 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-joblib. 2024-08-18T21:01:45.295 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-08-18T21:01:45.342 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-08-18T21:01:45.346 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cachetools. 2024-08-18T21:01:45.374 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-08-18T21:01:45.421 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-08-18T21:01:45.687 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-08-18T21:01:45.715 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-08-18T21:01:45.754 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-08-18T21:01:45.790 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-18T21:01:45.819 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-08-18T21:01:45.865 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-08-18T21:01:46.056 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn. 2024-08-18T21:01:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-08-18T21:01:46.123 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-18T21:01:46.235 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-18T21:01:46.263 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-08-18T21:01:46.310 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-08-18T21:01:46.813 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-rsa. 2024-08-18T21:01:46.823 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-18T21:01:46.841 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-08-18T21:01:46.851 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-5847-g79766939-1jammy_all.deb ... 2024-08-18T21:01:46.879 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-rsa (4.8-1) ... 2024-08-18T21:01:46.975 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:47.408 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-google-auth. 2024-08-18T21:01:47.436 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-08-18T21:01:47.474 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-08-18T21:01:47.820 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-18T21:01:47.848 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-08-18T21:01:47.886 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-18T21:01:47.896 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cachetools. 2024-08-18T21:01:47.923 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-08-18T21:01:47.954 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-08-18T21:01:48.257 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-18T21:01:48.264 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-websocket. 2024-08-18T21:01:48.284 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-08-18T21:01:48.292 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-08-18T21:01:48.323 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-08-18T21:01:48.339 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-08-18T21:01:48.660 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-18T21:01:48.687 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-08-18T21:01:48.717 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-18T21:01:48.726 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-08-18T21:01:48.745 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-08-18T21:01:48.792 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-18T21:01:49.071 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rsa. 2024-08-18T21:01:49.098 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-08-18T21:01:49.137 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rsa (4.8-1) ... 2024-08-18T21:01:49.431 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-18T21:01:49.449 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-google-auth. 2024-08-18T21:01:49.460 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-5847-g79766939-1jammy_all.deb ... 2024-08-18T21:01:49.477 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-08-18T21:01:49.497 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:49.516 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-08-18T21:01:49.817 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-18T21:01:49.845 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-08-18T21:01:49.883 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-18T21:01:50.053 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-18T21:01:50.081 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-08-18T21:01:50.119 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-18T21:01:50.220 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-18T21:01:50.248 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-08-18T21:01:50.286 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-18T21:01:50.430 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-websocket. 2024-08-18T21:01:50.458 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-08-18T21:01:50.497 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-08-18T21:01:50.505 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package jq. 2024-08-18T21:01:50.522 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-08-18T21:01:50.555 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-08-18T21:01:50.808 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package socat. 2024-08-18T21:01:50.817 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-18T21:01:50.836 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-08-18T21:01:50.845 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-08-18T21:01:50.874 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-08-18T21:01:50.900 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-18T21:01:51.203 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package xmlstarlet. 2024-08-18T21:01:51.231 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-08-18T21:01:51.269 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-08-18T21:01:51.581 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-18T21:01:51.609 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-5847-g79766939-1jammy_all.deb ... 2024-08-18T21:01:51.647 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:51.657 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-test. 2024-08-18T21:01:51.673 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../097-ceph-test_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:51.715 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-test (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:51.958 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-18T21:01:51.986 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-08-18T21:01:52.016 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-18T21:01:52.328 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-18T21:01:52.356 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-08-18T21:01:52.419 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-18T21:01:52.664 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package jq. 2024-08-18T21:01:52.692 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-08-18T21:01:52.730 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-08-18T21:01:52.983 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package socat. 2024-08-18T21:01:52.999 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-08-18T21:01:53.041 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-08-18T21:01:53.353 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package xmlstarlet. 2024-08-18T21:01:53.369 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-08-18T21:01:53.411 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-08-18T21:01:53.757 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-test. 2024-08-18T21:01:53.773 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../097-ceph-test_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:53.815 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-test (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:54.370 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-volume. 2024-08-18T21:01:54.398 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-5847-g79766939-1jammy_all.deb ... 2024-08-18T21:01:54.427 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-volume (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:54.731 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-18T21:01:54.760 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:54.798 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libcephfs-dev (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:55.101 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package lua-socket:amd64. 2024-08-18T21:01:55.129 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-08-18T21:01:55.167 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-18T21:01:55.514 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package lua-sec:amd64. 2024-08-18T21:01:55.542 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-08-18T21:01:55.580 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-08-18T21:01:55.892 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package nvme-cli. 2024-08-18T21:01:55.920 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-08-18T21:01:55.950 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-08-18T21:01:56.305 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package pkg-config. 2024-08-18T21:01:56.334 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-08-18T21:01:56.344 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-volume. 2024-08-18T21:01:56.372 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-08-18T21:01:56.372 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-5847-g79766939-1jammy_all.deb ... 2024-08-18T21:01:56.411 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-volume (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:56.625 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-08-18T21:01:56.642 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-08-18T21:01:56.683 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-08-18T21:01:56.706 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-18T21:01:56.734 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:01:56.773 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs-dev (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:01:57.059 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-socket:amd64. 2024-08-18T21:01:57.077 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-08-18T21:01:57.108 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-18T21:01:57.136 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-iniconfig. 2024-08-18T21:01:57.165 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-08-18T21:01:57.203 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-08-18T21:01:57.440 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-sec:amd64. 2024-08-18T21:01:57.468 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-08-18T21:01:57.505 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pastescript. 2024-08-18T21:01:57.506 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-08-18T21:01:57.534 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-18T21:01:57.572 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-18T21:01:57.836 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package nvme-cli. 2024-08-18T21:01:57.863 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-08-18T21:01:57.902 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-08-18T21:01:57.925 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pluggy. 2024-08-18T21:01:57.954 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-08-18T21:01:57.991 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-08-18T21:01:58.278 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-psutil. 2024-08-18T21:01:58.291 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package pkg-config. 2024-08-18T21:01:58.307 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-08-18T21:01:58.319 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-08-18T21:01:58.336 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-08-18T21:01:58.349 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-08-18T21:01:58.585 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-08-18T21:01:58.601 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-08-18T21:01:58.643 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-08-18T21:01:58.664 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-py. 2024-08-18T21:01:58.692 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-08-18T21:01:58.730 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-py (1.10.0-1) ... 2024-08-18T21:01:59.000 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pygments. 2024-08-18T21:01:59.017 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-08-18T21:01:59.046 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-iniconfig. 2024-08-18T21:01:59.050 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-08-18T21:01:59.075 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-08-18T21:01:59.113 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-08-18T21:01:59.349 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastescript. 2024-08-18T21:01:59.377 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-18T21:01:59.415 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-18T21:01:59.530 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-18T21:01:59.558 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-08-18T21:01:59.596 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-08-18T21:01:59.735 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pluggy. 2024-08-18T21:01:59.763 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-08-18T21:01:59.827 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-08-18T21:01:59.907 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-toml. 2024-08-18T21:01:59.936 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-08-18T21:01:59.973 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-08-18T21:02:00.147 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-psutil. 2024-08-18T21:02:00.175 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-08-18T21:02:00.213 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-08-18T21:02:00.234 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pytest. 2024-08-18T21:02:00.263 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-08-18T21:02:00.292 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-08-18T21:02:00.533 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-py. 2024-08-18T21:02:00.561 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-08-18T21:02:00.599 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-py (1.10.0-1) ... 2024-08-18T21:02:00.613 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-simplejson. 2024-08-18T21:02:00.642 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-08-18T21:02:00.679 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-08-18T21:02:00.919 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pygments. 2024-08-18T21:02:00.947 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-08-18T21:02:00.957 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-18T21:02:00.983 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-08-18T21:02:00.985 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-08-18T21:02:01.023 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-08-18T21:02:01.415 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-18T21:02:01.432 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-08-18T21:02:01.473 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-08-18T21:02:01.769 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package radosgw. 2024-08-18T21:02:01.776 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-toml. 2024-08-18T21:02:01.798 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../116-radosgw_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:02:01.804 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-08-18T21:02:01.835 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking radosgw (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:01.842 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-08-18T21:02:02.145 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pytest. 2024-08-18T21:02:02.174 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-08-18T21:02:02.220 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-08-18T21:02:02.557 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplejson. 2024-08-18T21:02:02.585 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-08-18T21:02:02.623 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-08-18T21:02:02.755 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package rbd-fuse. 2024-08-18T21:02:02.772 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:02:02.813 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking rbd-fuse (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:02.892 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-18T21:02:02.909 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-08-18T21:02:02.951 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-08-18T21:02:03.160 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-08-18T21:02:03.460 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-18T21:02:03.578 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-08-18T21:02:03.713 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package radosgw. 2024-08-18T21:02:03.742 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../116-radosgw_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:02:03.780 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking radosgw (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:03.851 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-08-18T21:02:04.179 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-08-18T21:02:04.633 INFO:teuthology.orchestra.run.smithi005.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-08-18T21:02:04.674 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package rbd-fuse. 2024-08-18T21:02:04.703 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-5847-g79766939-1jammy_amd64.deb ... 2024-08-18T21:02:04.704 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up cephadm (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:04.741 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking rbd-fuse (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:05.019 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-08-18T21:02:05.213 INFO:teuthology.orchestra.run.smithi005.stdout:Adding system user cephadm....done 2024-08-18T21:02:05.254 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-18T21:02:05.327 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-18T21:02:05.355 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-08-18T21:02:05.604 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-08-18T21:02:05.859 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-08-18T21:02:05.871 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-08-18T21:02:05.997 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-08-18T21:02:06.195 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-08-18T21:02:06.257 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-18T21:02:06.533 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-08-18T21:02:06.642 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-py (1.10.0-1) ... 2024-08-18T21:02:06.647 INFO:teuthology.orchestra.run.smithi157.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-08-18T21:02:06.715 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephadm (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:06.929 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-08-18T21:02:07.182 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user cephadm....done 2024-08-18T21:02:07.307 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-08-18T21:02:07.363 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-18T21:02:07.566 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-08-18T21:02:07.631 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-08-18T21:02:07.834 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-08-18T21:02:07.882 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-08-18T21:02:08.008 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-08-18T21:02:08.268 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-18T21:02:08.360 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-08-18T21:02:08.511 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-08-18T21:02:08.611 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-08-18T21:02:08.629 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-py (1.10.0-1) ... 2024-08-18T21:02:08.930 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-08-18T21:02:08.939 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-08-18T21:02:09.290 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-08-18T21:02:09.322 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-ceph-argparse (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:09.558 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-08-18T21:02:09.598 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-18T21:02:09.749 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-18T21:02:09.834 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-08-18T21:02:09.858 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-08-18T21:02:09.959 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-08-18T21:02:10.102 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-08-18T21:02:10.202 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-08-18T21:02:10.345 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-08-18T21:02:10.570 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-08-18T21:02:10.596 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-08-18T21:02:10.600 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-08-18T21:02:10.664 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-18T21:02:10.807 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-08-18T21:02:11.031 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-argparse (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:11.174 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-18T21:02:11.290 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-18T21:02:11.300 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-08-18T21:02:11.416 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-18T21:02:11.542 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-08-18T21:02:11.559 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-08-18T21:02:11.668 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-08-18T21:02:11.810 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-08-18T21:02:11.927 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-08-18T21:02:12.120 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up zip (3.0-12build2) ... 2024-08-18T21:02:12.271 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-08-18T21:02:12.349 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-08-18T21:02:12.518 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-08-18T21:02:12.581 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-18T21:02:12.698 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-08-18T21:02:12.957 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-08-18T21:02:13.041 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-18T21:02:13.167 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-08-18T21:02:13.216 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-08-18T21:02:13.325 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-08-18T21:02:13.426 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-18T21:02:13.435 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-08-18T21:02:13.686 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-08-18T21:02:13.711 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-08-18T21:02:13.996 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up zip (3.0-12build2) ... 2024-08-18T21:02:14.103 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-08-18T21:02:14.122 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-08-18T21:02:14.355 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-08-18T21:02:14.771 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-18T21:02:14.807 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-08-18T21:02:15.050 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-08-18T21:02:15.091 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-18T21:02:15.176 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-08-18T21:02:15.293 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-18T21:02:15.426 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-08-18T21:02:15.587 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-08-18T21:02:15.652 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-08-18T21:02:15.778 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-ceph-common (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:15.979 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-08-18T21:02:16.079 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-08-18T21:02:16.230 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-08-18T21:02:16.408 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-18T21:02:16.598 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-18T21:02:16.891 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-18T21:02:17.243 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-08-18T21:02:17.485 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-08-18T21:02:17.611 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-common (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:17.619 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-08-18T21:02:17.862 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T21:02:17.913 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-08-18T21:02:17.997 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-toml (0.10.2-1) ... 2024-08-18T21:02:18.265 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-18T21:02:18.272 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-18T21:02:18.416 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-08-18T21:02:18.542 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-18T21:02:18.818 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-08-18T21:02:19.086 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-08-18T21:02:19.345 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T21:02:19.436 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-08-18T21:02:19.479 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-08-18T21:02:19.688 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T21:02:19.781 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-08-18T21:02:19.822 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-toml (0.10.2-1) ... 2024-08-18T21:02:20.040 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-08-18T21:02:20.090 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-18T21:02:20.207 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-08-18T21:02:20.291 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-08-18T21:02:20.333 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-18T21:02:20.526 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-18T21:02:20.635 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-08-18T21:02:20.768 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-08-18T21:02:20.885 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-08-18T21:02:21.044 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-18T21:02:21.170 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-08-18T21:02:21.262 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T21:02:21.388 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-08-18T21:02:21.463 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-18T21:02:21.590 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-18T21:02:21.689 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-08-18T21:02:21.891 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-08-18T21:02:21.941 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-08-18T21:02:22.208 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-08-18T21:02:22.223 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-08-18T21:02:22.459 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-18T21:02:22.460 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-18T21:02:22.577 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-08-18T21:02:22.703 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-08-18T21:02:22.710 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-08-18T21:02:22.792 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-08-18T21:02:22.961 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-18T21:02:23.030 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-18T21:02:23.087 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-08-18T21:02:23.156 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-08-18T21:02:23.363 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-18T21:02:23.489 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-18T21:02:23.549 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-08-18T21:02:23.782 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-08-18T21:02:23.791 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up lua-any (27ubuntu1) ... 2024-08-18T21:02:23.893 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-portend (3.0.0-1) ... 2024-08-18T21:02:24.075 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-08-18T21:02:24.127 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T21:02:24.245 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-18T21:02:24.318 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-18T21:02:24.427 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-08-18T21:02:24.545 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-08-18T21:02:24.579 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-08-18T21:02:24.634 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-08-18T21:02:24.897 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-18T21:02:24.897 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-18T21:02:25.031 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-08-18T21:02:25.173 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-08-18T21:02:25.291 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-rsa (4.8-1) ... 2024-08-18T21:02:25.391 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-08-18T21:02:25.542 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-08-18T21:02:25.642 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-any (27ubuntu1) ... 2024-08-18T21:02:25.768 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-portend (3.0.0-1) ... 2024-08-18T21:02:25.810 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-18T21:02:26.019 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T21:02:26.145 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-18T21:02:26.171 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-08-18T21:02:26.454 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-08-18T21:02:26.581 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-18T21:02:26.739 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-18T21:02:26.883 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-08-18T21:02:27.006 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-08-18T21:02:27.133 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rsa (4.8-1) ... 2024-08-18T21:02:27.210 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-18T21:02:27.336 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up librados2 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:27.409 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-08-18T21:02:27.462 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libsqlite3-mod-ceph (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:27.588 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-08-18T21:02:27.677 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-18T21:02:27.916 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libcephfs2 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:28.017 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libradosstriper1 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:28.021 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-08-18T21:02:28.127 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-08-18T21:02:28.398 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-18T21:02:28.412 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up librbd1 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:28.538 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-modules-core (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:28.664 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-fuse (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:28.691 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-08-18T21:02:28.893 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-18T21:02:28.893 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-18T21:02:29.052 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-18T21:02:29.187 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librados2 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:29.313 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libsqlite3-mod-ceph (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:29.415 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libcephfs-dev (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:29.430 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-08-18T21:02:29.524 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-rados (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:29.625 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up librgw2 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:29.726 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-18T21:02:29.750 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs2 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:29.859 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libradosstriper1 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:29.969 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-08-18T21:02:30.246 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librbd1 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:30.371 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-modules-core (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:30.489 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-fuse (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:30.694 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-18T21:02:30.694 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-18T21:02:31.014 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-rbd (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:31.140 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up rbd-fuse (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:31.199 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs-dev (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:31.266 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-rgw (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:31.325 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rados (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:31.366 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cephfs (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:31.450 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librgw2 (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:31.467 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-common (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:31.568 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-18T21:02:31.994 INFO:teuthology.orchestra.run.smithi005.stdout:Adding group ceph....done 2024-08-18T21:02:32.354 INFO:teuthology.orchestra.run.smithi005.stdout:Adding system user ceph....done 2024-08-18T21:02:32.481 INFO:teuthology.orchestra.run.smithi005.stdout:Setting system user ceph properties....done 2024-08-18T21:02:32.498 INFO:teuthology.orchestra.run.smithi005.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-18T21:02:32.645 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-18T21:02:32.705 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rbd (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:32.831 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up rbd-fuse (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:32.957 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rgw (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:33.002 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-18T21:02:33.083 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cephfs (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:33.201 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-common (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:33.477 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-test (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:33.603 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up radosgw (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:33.736 INFO:teuthology.orchestra.run.smithi157.stdout:Adding group ceph....done 2024-08-18T21:02:34.062 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user ceph....done 2024-08-18T21:02:34.119 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-18T21:02:34.119 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-18T21:02:34.172 INFO:teuthology.orchestra.run.smithi157.stdout:Setting system user ceph properties....done 2024-08-18T21:02:34.188 INFO:teuthology.orchestra.run.smithi157.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-18T21:02:34.323 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-18T21:02:34.589 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-base (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:34.648 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-18T21:02:34.950 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-18T21:02:35.152 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-test (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:35.270 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up radosgw (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:35.382 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mds (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:35.619 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-18T21:02:35.619 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-18T21:02:35.776 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-18T21:02:35.776 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-18T21:02:36.109 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:36.301 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-18T21:02:36.301 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-18T21:02:36.604 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-base (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:36.752 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-osd (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:36.935 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-18T21:02:37.039 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-18T21:02:37.039 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-18T21:02:37.377 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mds (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:37.537 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-k8sevents (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:37.604 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-18T21:02:37.604 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-18T21:02:37.688 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:37.839 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mon (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:38.067 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-18T21:02:38.067 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-18T21:02:38.104 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:38.314 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-18T21:02:38.315 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-18T21:02:38.540 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-cephadm (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:38.691 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:38.792 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-dashboard (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:38.814 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-osd (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:39.094 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-18T21:02:39.188 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-18T21:02:39.412 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-volume (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:39.598 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-k8sevents (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:39.725 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:39.781 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-18T21:02:39.867 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mon (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:39.898 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-18T21:02:40.050 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-18T21:02:40.076 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-18T21:02:40.076 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-18T21:02:40.552 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-cephadm (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:40.720 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:40.837 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-dashboard (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:40.980 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-volume (19.0.0-5847-g79766939-1jammy) ... 2024-08-18T21:02:41.160 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-18T21:02:41.324 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-18T21:02:41.626 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-18T21:02:41.771 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-18T21:02:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-18T21:02:41.830 DEBUG:teuthology.parallel:result is None 2024-08-18T21:02:43.182 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-18T21:02:43.832 INFO:teuthology.orchestra.run.smithi157.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-18T21:02:43.837 DEBUG:teuthology.parallel:result is None 2024-08-18T21:02:43.838 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=797669399b32d2915e64eb6d4b1257ae3c50f80b 2024-08-18T21:02:43.992 DEBUG:teuthology.orchestra.run.smithi005:> dpkg-query -W -f '${Version}' ceph 2024-08-18T21:02:44.012 INFO:teuthology.orchestra.run.smithi005.stdout:19.0.0-5847-g79766939-1jammy 2024-08-18T21:02:44.013 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5847-g79766939-1jammy 2024-08-18T21:02:44.013 INFO:teuthology.task.install:The correct ceph version 19.0.0-5847-g79766939-1jammy is installed. 2024-08-18T21:02:44.018 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=797669399b32d2915e64eb6d4b1257ae3c50f80b 2024-08-18T21:02:44.159 DEBUG:teuthology.orchestra.run.smithi157:> dpkg-query -W -f '${Version}' ceph 2024-08-18T21:02:44.178 INFO:teuthology.orchestra.run.smithi157.stdout:19.0.0-5847-g79766939-1jammy 2024-08-18T21:02:44.178 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5847-g79766939-1jammy 2024-08-18T21:02:44.178 INFO:teuthology.task.install:The correct ceph version 19.0.0-5847-g79766939-1jammy is installed. 2024-08-18T21:02:44.180 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-18T21:02:44.180 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:02:44.180 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-18T21:02:44.195 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T21:02:44.195 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-18T21:02:44.236 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-18T21:02:44.236 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:02:44.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2024-08-18T21:02:44.252 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-18T21:02:44.307 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T21:02:44.307 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2024-08-18T21:02:44.321 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-18T21:02:44.376 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-18T21:02:44.376 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:02:44.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-18T21:02:44.390 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-18T21:02:44.443 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T21:02:44.443 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-18T21:02:44.457 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-18T21:02:44.517 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-18T21:02:44.517 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:02:44.517 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2024-08-18T21:02:44.531 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-18T21:02:44.587 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T21:02:44.588 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2024-08-18T21:02:44.600 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-18T21:02:44.656 INFO:teuthology.run_tasks:Running task ceph... 2024-08-18T21:02:44.734 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-18T21:02:44.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2024-08-18T21:02:44.737 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /var/log/ceph 2024-08-18T21:02:44.749 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-18T21:02:44.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-18T21:02:44.792 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-18T21:02:44.804 INFO:tasks.ceph:Creating extra log directories... 2024-08-18T21:02:44.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-18T21:02:44.849 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-18T21:02:44.871 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-18T21:02:44.871 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client ping interval': 4, 'mon client ping timeout': 12, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'slow request', 'overall HEALTH_'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-18T21:02:44.871 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222', 'branch': 'main', 'description': 'rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-zstd} rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/pool-create-delete}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7859222', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client ping interval': 4, 'mon client ping timeout': 12, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'slow request', 'overall HEALTH_'], 'sha1': '797669399b32d2915e64eb6d4b1257ae3c50f80b'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '797669399b32d2915e64eb6d4b1257ae3c50f80b'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '964adda23da9f7b057cb34fdc0b82aeb7ed65324'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 101, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'], ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 1858, 'sha1': '797669399b32d2915e64eb6d4b1257ae3c50f80b', 'sleep_before_teardown': 0, 'subset': '29813/100000', 'suite': 'rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '964adda23da9f7b057cb34fdc0b82aeb7ed65324', 'targets': {'smithi005.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJMrGfaNFm9vYdCciM1jvqRgVt3TObiZhws4l1mUuYAnCgYdYURrKMPOifWnpntdwmCVl+aNrAQqEQLYJMMsYLk=', 'smithi157.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBODmfEX4U/3FYbB3IhFDeK9I3OJK35kgGgJvgQwhWMpfP4Jap76H9G2NWwm3lmEjf1/N7CZ6k88LozYA7vQRCDc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'freeze_mon_duration': 20, 'freeze_mon_probability': 10, 'revive_delay': 20, 'thrash_delay': 1, 'thrash_many': True}}, {'exec': {'client.0': ['ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-18_20:00:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-18T21:02:44.872 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-18T21:02:44.904 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-18T21:02:44.910 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2024-08-18T21:02:44.952 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/run/ceph 2024-08-18T21:02:44.969 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:02:44.969 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-08-18T21:02:45.011 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-18T21:02:45.012 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-08-18T21:02:45.059 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-18T21:02:45.060 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T21:02:45.060 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 871 Links: 1 2024-08-18T21:02:45.060 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T21:02:45.060 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-18 20:57:07.364877493 +0000 2024-08-18T21:02:45.060 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-18 20:57:07.360877528 +0000 2024-08-18T21:02:45.060 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-18 20:57:07.360877528 +0000 2024-08-18T21:02:45.060 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-08-18T21:02:45.060 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-18T21:02:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T21:02:45.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T21:02:45.115 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000325224 s, 1.6 MB/s 2024-08-18T21:02:45.116 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-18T21:02:45.165 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-08-18T21:02:45.211 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-18T21:02:45.212 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T21:02:45.212 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 880 Links: 1 2024-08-18T21:02:45.212 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T21:02:45.212 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-18 20:57:08.124870700 +0000 2024-08-18T21:02:45.212 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-18 20:57:07.864873024 +0000 2024-08-18T21:02:45.212 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-18 20:57:07.864873024 +0000 2024-08-18T21:02:45.212 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-08-18T21:02:45.212 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-18T21:02:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T21:02:45.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T21:02:45.267 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000305219 s, 1.7 MB/s 2024-08-18T21:02:45.268 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-18T21:02:45.317 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-08-18T21:02:45.363 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-18T21:02:45.363 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T21:02:45.364 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-08-18T21:02:45.364 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T21:02:45.364 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-18 20:57:08.620866267 +0000 2024-08-18T21:02:45.364 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-18 20:57:08.348868698 +0000 2024-08-18T21:02:45.364 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-18 20:57:08.348868698 +0000 2024-08-18T21:02:45.364 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-08-18T21:02:45.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-18T21:02:45.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T21:02:45.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T21:02:45.418 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000303592 s, 1.7 MB/s 2024-08-18T21:02:45.419 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-18T21:02:45.469 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-08-18T21:02:45.515 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-18T21:02:45.515 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T21:02:45.516 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-08-18T21:02:45.516 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T21:02:45.516 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-18 20:57:08.852864194 +0000 2024-08-18T21:02:45.516 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-18 20:57:08.848864228 +0000 2024-08-18T21:02:45.516 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-18 20:57:08.848864228 +0000 2024-08-18T21:02:45.516 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-08-18T21:02:45.516 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-18T21:02:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T21:02:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T21:02:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000291818 s, 1.8 MB/s 2024-08-18T21:02:45.571 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-18T21:02:45.621 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-08-18T21:02:45.621 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T21:02:45.621 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-08-18T21:02:45.627 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-18T21:02:45.627 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-08-18T21:02:45.673 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-18T21:02:45.673 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T21:02:45.674 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 872 Links: 1 2024-08-18T21:02:45.674 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T21:02:45.674 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-08-18 20:57:02.055477856 +0000 2024-08-18T21:02:45.674 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-08-18 20:57:01.791480215 +0000 2024-08-18T21:02:45.674 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-08-18 20:57:01.791480215 +0000 2024-08-18T21:02:45.674 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-08-18T21:02:45.674 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-18T21:02:45.728 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-08-18T21:02:45.728 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-08-18T21:02:45.728 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000324876 s, 1.6 MB/s 2024-08-18T21:02:45.729 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-18T21:02:45.783 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-08-18T21:02:45.829 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-18T21:02:45.829 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T21:02:45.829 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-08-18T21:02:45.829 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T21:02:45.830 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-08-18 20:57:02.279475857 +0000 2024-08-18T21:02:45.830 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-08-18 20:57:02.275475891 +0000 2024-08-18T21:02:45.830 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-08-18 20:57:02.275475891 +0000 2024-08-18T21:02:45.830 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-08-18T21:02:45.830 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-18T21:02:45.883 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-08-18T21:02:45.883 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-08-18T21:02:45.884 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000243198 s, 2.1 MB/s 2024-08-18T21:02:45.884 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-18T21:02:45.934 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-08-18T21:02:45.981 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-18T21:02:45.981 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T21:02:45.981 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-08-18T21:02:45.981 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T21:02:45.981 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-08-18 20:57:02.979469603 +0000 2024-08-18T21:02:45.981 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-08-18 20:57:02.739471748 +0000 2024-08-18T21:02:45.981 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-08-18 20:57:02.739471748 +0000 2024-08-18T21:02:45.981 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-08-18T21:02:45.982 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-18T21:02:46.035 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-08-18T21:02:46.035 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-08-18T21:02:46.035 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000267564 s, 1.9 MB/s 2024-08-18T21:02:46.036 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-18T21:02:46.086 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-08-18T21:02:46.133 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-18T21:02:46.133 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T21:02:46.133 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 928 Links: 1 2024-08-18T21:02:46.133 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T21:02:46.133 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-08-18 20:57:03.439465495 +0000 2024-08-18T21:02:46.133 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-08-18 20:57:03.215467495 +0000 2024-08-18T21:02:46.134 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-08-18 20:57:03.215467495 +0000 2024-08-18T21:02:46.134 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-08-18T21:02:46.134 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-18T21:02:46.191 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-08-18T21:02:46.191 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-08-18T21:02:46.191 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.00023516 s, 2.2 MB/s 2024-08-18T21:02:46.193 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-18T21:02:46.242 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-08-18T21:02:46.243 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-08-18T21:02:46.243 INFO:tasks.ceph:Generating config... 2024-08-18T21:02:46.244 INFO:tasks.ceph:[client] debug monc = 20 2024-08-18T21:02:46.244 INFO:tasks.ceph:[client] debug ms = 1 2024-08-18T21:02:46.244 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-08-18T21:02:46.244 INFO:tasks.ceph:[global] mon election default strategy = 1 2024-08-18T21:02:46.244 INFO:tasks.ceph:[global] ms bind msgr1 = False 2024-08-18T21:02:46.244 INFO:tasks.ceph:[global] ms bind msgr2 = True 2024-08-18T21:02:46.244 INFO:tasks.ceph:[global] ms inject delay max = 1 2024-08-18T21:02:46.244 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2024-08-18T21:02:46.245 INFO:tasks.ceph:[global] ms inject delay type = mon 2024-08-18T21:02:46.245 INFO:tasks.ceph:[global] ms inject internal delays = 0.002 2024-08-18T21:02:46.245 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2024-08-18T21:02:46.245 INFO:tasks.ceph:[global] ms type = async 2024-08-18T21:02:46.245 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-18T21:02:46.245 INFO:tasks.ceph:[mgr] debug monc = 10 2024-08-18T21:02:46.245 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-18T21:02:46.245 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-18T21:02:46.245 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-18T21:02:46.245 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-18T21:02:46.245 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2024-08-18T21:02:46.245 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-08-18T21:02:46.245 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-08-18T21:02:46.245 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-08-18T21:02:46.246 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2024-08-18T21:02:46.246 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2024-08-18T21:02:46.246 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-08-18T21:02:46.246 INFO:tasks.ceph:[mon] paxos service trim min = 5 2024-08-18T21:02:46.246 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-18T21:02:46.246 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2024-08-18T21:02:46.246 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-08-18T21:02:46.246 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-18T21:02:46.246 INFO:tasks.ceph:[osd] bluestore write v2 = False 2024-08-18T21:02:46.246 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-08-18T21:02:46.246 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-08-18T21:02:46.246 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-08-18T21:02:46.246 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-18T21:02:46.247 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-18T21:02:46.247 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-08-18T21:02:46.247 INFO:tasks.ceph:[osd] mon client ping interval = 4 2024-08-18T21:02:46.247 INFO:tasks.ceph:[osd] mon client ping timeout = 12 2024-08-18T21:02:46.247 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-18T21:02:46.247 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-18T21:02:46.247 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-18T21:02:46.247 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-08-18T21:02:46.247 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-08-18T21:02:46.247 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-18T21:02:46.247 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-08-18T21:02:46.247 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-08-18T21:02:46.247 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-18T21:02:46.247 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-08-18T21:02:46.248 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-08-18T21:02:46.248 INFO:tasks.ceph:Setting up mon.a... 2024-08-18T21:02:46.248 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-18T21:02:46.283 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2024-08-18T21:02:46.294 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-18T21:02:46.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-18T21:02:46.426 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.b', '[v2:172.21.15.5:3301,v1:172.21.15.5:6790]'), ('mon.c', '[v2:172.21.15.5:3302,v1:172.21.15.5:6791]'), ('mon.d', '[v2:172.21.15.5:3303,v1:172.21.15.5:6792]'), ('mon.e', '[v2:172.21.15.5:3304,v1:172.21.15.5:6793]'), ('mon.f', '172.21.15.157'), ('mon.g', '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]'), ('mon.h', '[v2:172.21.15.157:3302,v1:172.21.15.157:6791]'), ('mon.i', '[v2:172.21.15.157:3303,v1:172.21.15.157:6792]')] 2024-08-18T21:02:46.427 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5,[v2:172.21.15.5:3301,v1:172.21.15.5:6790],[v2:172.21.15.5:3302,v1:172.21.15.5:6791],[v2:172.21.15.5:3303,v1:172.21.15.5:6792],[v2:172.21.15.5:3304,v1:172.21.15.5:6793],172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790],[v2:172.21.15.157:3302,v1:172.21.15.157:6791],[v2:172.21.15.157:3303,v1:172.21.15.157:6792]', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client ping interval': 4, 'mon client ping timeout': 12, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug monc': 10}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mon.d': {}, 'mon.e': {}, 'mon.f': {}, 'mon.g': {}, 'mon.h': {}, 'mon.i': {}} 2024-08-18T21:02:46.428 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:02:46.428 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-18T21:02:46.475 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --addv b '[v2:172.21.15.5:3301,v1:172.21.15.5:6790]' --addv c '[v2:172.21.15.5:3302,v1:172.21.15.5:6791]' --addv d '[v2:172.21.15.5:3303,v1:172.21.15.5:6792]' --addv e '[v2:172.21.15.5:3304,v1:172.21.15.5:6793]' --add f 172.21.15.157 --addv g '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]' --addv h '[v2:172.21.15.157:3302,v1:172.21.15.157:6791]' --addv i '[v2:172.21.15.157:3303,v1:172.21.15.157:6792]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-18T21:02:46.584 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-18T21:02:46.584 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:02:46.584 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = quincy 2024-08-18T21:02:46.584 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2024-08-18T21:02:46.584 INFO:teuthology.orchestra.run.smithi005.stdout:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:02:46.585 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:02:46.585 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:02:46.585 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 17 (quincy) 2024-08-18T21:02:46.585 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2024-08-18T21:02:46.585 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:02:46.585 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:02:46.585 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:02:46.585 INFO:teuthology.orchestra.run.smithi005.stdout:3: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:02:46.585 INFO:teuthology.orchestra.run.smithi005.stdout:4: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:02:46.585 INFO:teuthology.orchestra.run.smithi005.stdout:5: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:02:46.585 INFO:teuthology.orchestra.run.smithi005.stdout:6: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:02:46.585 INFO:teuthology.orchestra.run.smithi005.stdout:7: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:02:46.585 INFO:teuthology.orchestra.run.smithi005.stdout:8: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:02:46.586 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (9 monitors) 2024-08-18T21:02:46.587 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-18T21:02:46.591 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8465e564-1097-423a-818a-e3a141bbf945... 2024-08-18T21:02:46.592 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-18T21:02:46.636 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-18T21:02:46.662 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-08-18T21:02:46.663 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-08-18T21:02:46.663 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-18T21:02:46.663 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-08-18T21:02:46.663 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.663 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-08-18T21:02:46.663 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.663 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-08-18T21:02:46.663 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.663 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-08-18T21:02:46.663 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-08-18T21:02:46.663 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.663 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-08-18T21:02:46.663 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-08-18T21:02:46.664 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.664 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-18T21:02:46.664 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-08-18T21:02:46.664 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.664 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-08-18T21:02:46.664 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-18T21:02:46.664 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.664 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-08-18T21:02:46.664 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.664 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-08-18T21:02:46.664 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-08-18T21:02:46.664 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-08-18T21:02:46.664 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-08-18T21:02:46.664 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-08-18T21:02:46.665 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-08-18T21:02:46.665 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-08-18T21:02:46.665 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-18T21:02:46.665 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-18T21:02:46.665 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-08-18T21:02:46.665 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.665 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-18T21:02:46.665 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.665 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-08-18T21:02:46.665 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.665 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-08-18T21:02:46.665 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.665 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-08-18T21:02:46.666 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-08-18T21:02:46.666 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-08-18T21:02:46.666 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,[v2:172.21.15.5:3301,v1:172.21.15.5:6790],[v2:172.21.15.5:3302,v1:172.21.15.5:6791],[v2:172.21.15.5:3303,v1:172.21.15.5:6792],[v2:172.21.15.5:3304,v1:172.21.15.5:6793],172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790],[v2:172.21.15.157:3302,v1:172.21.15.157:6791],[v2:172.21.15.157:3303,v1:172.21.15.157:6792]" 2024-08-18T21:02:46.666 INFO:teuthology.orchestra.run.smithi005.stdout: mon client directed command retry = 5 2024-08-18T21:02:46.666 INFO:teuthology.orchestra.run.smithi005.stdout: mon election default strategy = 1 2024-08-18T21:02:46.666 INFO:teuthology.orchestra.run.smithi005.stdout: ms bind msgr1 = False 2024-08-18T21:02:46.666 INFO:teuthology.orchestra.run.smithi005.stdout: ms bind msgr2 = True 2024-08-18T21:02:46.666 INFO:teuthology.orchestra.run.smithi005.stdout: ms inject delay max = 1 2024-08-18T21:02:46.666 INFO:teuthology.orchestra.run.smithi005.stdout: ms inject delay probability = 0.005 2024-08-18T21:02:46.666 INFO:teuthology.orchestra.run.smithi005.stdout: ms inject delay type = mon 2024-08-18T21:02:46.666 INFO:teuthology.orchestra.run.smithi005.stdout: ms inject internal delays = 0.002 2024-08-18T21:02:46.666 INFO:teuthology.orchestra.run.smithi005.stdout: ms inject socket failures = 2500 2024-08-18T21:02:46.666 INFO:teuthology.orchestra.run.smithi005.stdout: ms type = async 2024-08-18T21:02:46.667 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:02:46.667 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.667 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-08-18T21:02:46.667 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-08-18T21:02:46.667 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.667 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-08-18T21:02:46.667 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-08-18T21:02:46.667 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-08-18T21:02:46.667 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.667 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-08-18T21:02:46.667 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-08-18T21:02:46.667 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.667 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-08-18T21:02:46.668 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-08-18T21:02:46.668 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-08-18T21:02:46.668 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug trim objects = true 2024-08-18T21:02:46.668 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.668 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-08-18T21:02:46.668 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-08-18T21:02:46.668 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.668 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-08-18T21:02:46.668 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.668 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-08-18T21:02:46.668 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.668 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-08-18T21:02:46.668 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.668 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-08-18T21:02:46.668 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-08-18T21:02:46.669 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.669 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-08-18T21:02:46.669 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-08-18T21:02:46.669 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-08-18T21:02:46.669 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore compression algorithm = zstd 2024-08-18T21:02:46.669 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore compression mode = aggressive 2024-08-18T21:02:46.670 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-08-18T21:02:46.670 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore write v2 = False 2024-08-18T21:02:46.670 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore zero block detection = True 2024-08-18T21:02:46.670 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 20 2024-08-18T21:02:46.670 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 20 2024-08-18T21:02:46.670 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T21:02:46.670 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-08-18T21:02:46.670 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 10 2024-08-18T21:02:46.670 INFO:teuthology.orchestra.run.smithi005.stdout: mon client ping interval = 4 2024-08-18T21:02:46.670 INFO:teuthology.orchestra.run.smithi005.stdout: mon client ping timeout = 12 2024-08-18T21:02:46.670 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-08-18T21:02:46.670 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-08-18T21:02:46.670 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-08-18T21:02:46.671 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify cached snaps = True 2024-08-18T21:02:46.671 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify missing on start = True 2024-08-18T21:02:46.671 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-08-18T21:02:46.671 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock override recovery settings = True 2024-08-18T21:02:46.671 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-08-18T21:02:46.671 INFO:teuthology.orchestra.run.smithi005.stdout: osd op queue = debug_random 2024-08-18T21:02:46.671 INFO:teuthology.orchestra.run.smithi005.stdout: osd op queue cut off = debug_random 2024-08-18T21:02:46.671 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.671 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-08-18T21:02:46.671 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T21:02:46.671 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-08-18T21:02:46.671 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-08-18T21:02:46.671 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-08-18T21:02:46.671 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-08-18T21:02:46.672 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-08-18T21:02:46.672 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-08-18T21:02:46.672 INFO:teuthology.orchestra.run.smithi005.stdout: debug monc = 10 2024-08-18T21:02:46.672 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.672 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-08-18T21:02:46.672 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T21:02:46.672 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-08-18T21:02:46.672 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-08-18T21:02:46.672 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-08-18T21:02:46.672 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-08-18T21:02:46.672 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-08-18T21:02:46.672 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-08-18T21:02:46.672 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-08-18T21:02:46.673 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-08-18T21:02:46.673 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-08-18T21:02:46.673 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.673 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-18T21:02:46.674 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-08-18T21:02:46.674 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-08-18T21:02:46.674 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.674 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-08-18T21:02:46.674 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-18T21:02:46.674 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-18T21:02:46.674 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.674 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-08-18T21:02:46.674 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-08-18T21:02:46.674 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.674 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-08-18T21:02:46.674 INFO:teuthology.orchestra.run.smithi005.stdout: mon min osdmap epochs = 25 2024-08-18T21:02:46.675 INFO:teuthology.orchestra.run.smithi005.stdout: mon osdmap full prune interval = 2 2024-08-18T21:02:46.675 INFO:teuthology.orchestra.run.smithi005.stdout: mon osdmap full prune min = 15 2024-08-18T21:02:46.675 INFO:teuthology.orchestra.run.smithi005.stdout: mon osdmap full prune txsize = 2 2024-08-18T21:02:46.675 INFO:teuthology.orchestra.run.smithi005.stdout: mon scrub inject crc mismatch = 0.01 2024-08-18T21:02:46.675 INFO:teuthology.orchestra.run.smithi005.stdout: mon scrub inject missing keys = 0.05 2024-08-18T21:02:46.675 INFO:teuthology.orchestra.run.smithi005.stdout: mon scrub interval = 300 2024-08-18T21:02:46.675 INFO:teuthology.orchestra.run.smithi005.stdout: paxos service trim min = 5 2024-08-18T21:02:46.675 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:02:46.675 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-08-18T21:02:46.675 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-08-18T21:02:46.675 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-08-18T21:02:46.675 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-08-18T21:02:46.675 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-18T21:02:46.675 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-18T21:02:46.676 INFO:teuthology.orchestra.run.smithi005.stdout: debug monc = 20 2024-08-18T21:02:46.676 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T21:02:46.676 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-08-18T21:02:46.676 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-08-18T21:02:46.676 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-08-18T21:02:46.676 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.d] 2024-08-18T21:02:46.676 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.e] 2024-08-18T21:02:46.676 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.f] 2024-08-18T21:02:46.676 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.g] 2024-08-18T21:02:46.676 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.h] 2024-08-18T21:02:46.676 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.i] 2024-08-18T21:02:46.677 INFO:teuthology.orchestra.run.smithi157.stdout:[global] 2024-08-18T21:02:46.677 INFO:teuthology.orchestra.run.smithi157.stdout: chdir = "" 2024-08-18T21:02:46.677 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-18T21:02:46.677 INFO:teuthology.orchestra.run.smithi157.stdout: auth supported = cephx 2024-08-18T21:02:46.677 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.677 INFO:teuthology.orchestra.run.smithi157.stdout: filestore xattr use omap = true 2024-08-18T21:02:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: mon clock drift allowed = 1.000 2024-08-18T21:02:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: osd crush chooseleaf type = 0 2024-08-18T21:02:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: auth debug = true 2024-08-18T21:02:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on old message = true 2024-08-18T21:02:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on bug = true 2024-08-18T21:02:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-18T21:02:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: mon pg warn max object skew = 0 2024-08-18T21:02:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: # disable pg_autoscaler by default for new pools 2024-08-18T21:02:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-18T21:02:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default size = 2 2024-08-18T21:02:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow primary affinity = true 2024-08-18T21:02:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow pg remap = true 2024-08-18T21:02:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on legacy crush tunables = false 2024-08-18T21:02:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on crush straw calc version zero = false 2024-08-18T21:02:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on no sortbitwise = false 2024-08-18T21:02:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on osd down out interval zero = false 2024-08-18T21:02:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on too few osds = false 2024-08-18T21:02:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-18T21:02:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-18T21:02:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: mon_allow_pool_size_one = true 2024-08-18T21:02:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-18T21:02:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: osd default data pool replay window = 5 2024-08-18T21:02:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: mon allow pool delete = true 2024-08-18T21:02:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: mon cluster log file level = debug 2024-08-18T21:02:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: debug asserts on shutdown = true 2024-08-18T21:02:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: mon health detail to clog = false 2024-08-18T21:02:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: mon host = "172.21.15.5,[v2:172.21.15.5:3301,v1:172.21.15.5:6790],[v2:172.21.15.5:3302,v1:172.21.15.5:6791],[v2:172.21.15.5:3303,v1:172.21.15.5:6792],[v2:172.21.15.5:3304,v1:172.21.15.5:6793],172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790],[v2:172.21.15.157:3302,v1:172.21.15.157:6791],[v2:172.21.15.157:3303,v1:172.21.15.157:6792]" 2024-08-18T21:02:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: mon client directed command retry = 5 2024-08-18T21:02:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: mon election default strategy = 1 2024-08-18T21:02:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: ms bind msgr1 = False 2024-08-18T21:02:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: ms bind msgr2 = True 2024-08-18T21:02:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject delay max = 1 2024-08-18T21:02:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject delay probability = 0.005 2024-08-18T21:02:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject delay type = mon 2024-08-18T21:02:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject internal delays = 0.002 2024-08-18T21:02:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject socket failures = 2500 2024-08-18T21:02:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: ms type = async 2024-08-18T21:02:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: fsid = 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:02:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.681 INFO:teuthology.orchestra.run.smithi157.stdout:[osd] 2024-08-18T21:02:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: osd journal size = 100 2024-08-18T21:02:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub load threshold = 5.0 2024-08-18T21:02:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub max interval = 600 2024-08-18T21:02:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: osd mclock profile = high_recovery_ops 2024-08-18T21:02:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: osd recover clone overlap = true 2024-08-18T21:02:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: osd recovery max chunk = 1048576 2024-08-18T21:02:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug shutdown = true 2024-08-18T21:02:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug op order = true 2024-08-18T21:02:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug verify stray on activate = true 2024-08-18T21:02:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug trim objects = true 2024-08-18T21:02:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: osd open classes on start = true 2024-08-18T21:02:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug pg log writeout = true 2024-08-18T21:02:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: osd deep scrub update digest min age = 30 2024-08-18T21:02:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: osd map max advance = 10 2024-08-18T21:02:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: journal zero on create = true 2024-08-18T21:02:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: filestore ondisk finisher threads = 3 2024-08-18T21:02:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: filestore apply finisher threads = 3 2024-08-18T21:02:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: bdev debug aio = true 2024-08-18T21:02:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug misdirected ops = true 2024-08-18T21:02:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore block size = 96636764160 2024-08-18T21:02:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore compression algorithm = zstd 2024-08-18T21:02:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore compression mode = aggressive 2024-08-18T21:02:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore fsck on mount = True 2024-08-18T21:02:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore write v2 = False 2024-08-18T21:02:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore zero block detection = True 2024-08-18T21:02:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluefs = 20 2024-08-18T21:02:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluestore = 20 2024-08-18T21:02:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-08-18T21:02:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: debug osd = 20 2024-08-18T21:02:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: debug rocksdb = 10 2024-08-18T21:02:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: mon client ping interval = 4 2024-08-18T21:02:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: mon client ping timeout = 12 2024-08-18T21:02:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd backfillfull_ratio = 0.85 2024-08-18T21:02:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd full ratio = 0.9 2024-08-18T21:02:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd nearfull ratio = 0.8 2024-08-18T21:02:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug verify cached snaps = True 2024-08-18T21:02:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug verify missing on start = True 2024-08-18T21:02:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: osd failsafe full ratio = 0.95 2024-08-18T21:02:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: osd mclock override recovery settings = True 2024-08-18T21:02:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: osd objectstore = bluestore 2024-08-18T21:02:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: osd op queue = debug_random 2024-08-18T21:02:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: osd op queue cut off = debug_random 2024-08-18T21:02:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.685 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr] 2024-08-18T21:02:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-08-18T21:02:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: debug mgr = 20 2024-08-18T21:02:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-08-18T21:02:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-08-18T21:02:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-08-18T21:02:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-08-18T21:02:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: mgr/telemetry/nag = false 2024-08-18T21:02:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: debug monc = 10 2024-08-18T21:02:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.686 INFO:teuthology.orchestra.run.smithi157.stdout:[mon] 2024-08-18T21:02:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-08-18T21:02:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-08-18T21:02:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: debug paxos = 20 2024-08-18T21:02:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-08-18T21:02:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: mon data avail warn = 5 2024-08-18T21:02:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: mon mgr mkfs grace = 240 2024-08-18T21:02:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-08-18T21:02:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd reporter subtree level = osd 2024-08-18T21:02:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd prime pg temp = true 2024-08-18T21:02:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-08-18T21:02:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-18T21:02:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: auth mon ticket ttl = 660 # 11m 2024-08-18T21:02:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: auth service ticket ttl = 240 # 4m 2024-08-18T21:02:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: # don't complain about insecure global_id in the test suite 2024-08-18T21:02:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-18T21:02:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-18T21:02:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: # 1m isn't quite enough 2024-08-18T21:02:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: mon_down_mkfs_grace = 2m 2024-08-18T21:02:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_filestore_osds = false 2024-08-18T21:02:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: mon min osdmap epochs = 25 2024-08-18T21:02:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: mon osdmap full prune interval = 2 2024-08-18T21:02:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: mon osdmap full prune min = 15 2024-08-18T21:02:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: mon osdmap full prune txsize = 2 2024-08-18T21:02:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: mon scrub inject crc mismatch = 0.01 2024-08-18T21:02:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: mon scrub inject missing keys = 0.05 2024-08-18T21:02:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: mon scrub interval = 300 2024-08-18T21:02:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: paxos service trim min = 5 2024-08-18T21:02:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-18T21:02:46.688 INFO:teuthology.orchestra.run.smithi157.stdout:[client] 2024-08-18T21:02:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: rgw cache enabled = true 2024-08-18T21:02:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable ops log = true 2024-08-18T21:02:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable usage log = true 2024-08-18T21:02:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-18T21:02:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-18T21:02:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: debug monc = 20 2024-08-18T21:02:46.689 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-08-18T21:02:46.689 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.a] 2024-08-18T21:02:46.689 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.b] 2024-08-18T21:02:46.689 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.c] 2024-08-18T21:02:46.689 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.d] 2024-08-18T21:02:46.689 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.e] 2024-08-18T21:02:46.689 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.f] 2024-08-18T21:02:46.689 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.g] 2024-08-18T21:02:46.689 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.h] 2024-08-18T21:02:46.689 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.i] 2024-08-18T21:02:46.690 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-18T21:02:46.691 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-18T21:02:46.776 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-18T21:02:46.776 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:02:46.776 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-18T21:02:46.782 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:02:46.782 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-18T21:02:46.827 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T21:02:46.828 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:02:46.828 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-18T21:02:46.828 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-18T21:02:46.897 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:02:46.897 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-18T21:02:46.944 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi157.front.sepia.ceph.com 2024-08-18T21:02:46.944 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T21:02:46.944 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-18T21:02:46.944 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-18T21:02:46.969 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T21:02:46.969 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-18T21:02:47.017 INFO:tasks.ceph:Setting up mon nodes... 2024-08-18T21:02:47.017 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-18T21:02:47.018 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-18T21:02:47.101 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-18T21:02:47.112 INFO:tasks.ceph:Setting up mds nodes... 2024-08-18T21:02:47.113 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-18T21:02:47.113 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-18T21:02:47.190 INFO:teuthology.orchestra.run.smithi157.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-18T21:02:47.203 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-18T21:02:47.203 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-08-18T21:02:47.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-18T21:02:47.217 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-08-18T21:02:47.217 INFO:tasks.ceph:role: osd.0 2024-08-18T21:02:47.217 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T21:02:47.217 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-18T21:02:47.271 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T21:02:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T21:02:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T21:02:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-18T21:02:47.272 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T21:02:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-08-18T21:02:47.272 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T21:02:47.272 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-18T21:02:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T21:02:47.272 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T21:02:47.295 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-08-18T21:02:47.297 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-08-18T21:02:47.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-18T21:02:47.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-18T21:02:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: /sbin/restorecon: command not found 2024-08-18T21:02:47.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T21:02:47.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-18T21:02:47.459 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-08-18T21:02:47.459 INFO:tasks.ceph:role: osd.1 2024-08-18T21:02:47.459 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T21:02:47.459 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-18T21:02:47.515 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T21:02:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T21:02:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T21:02:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-18T21:02:47.516 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T21:02:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-08-18T21:02:47.516 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T21:02:47.516 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-18T21:02:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T21:02:47.516 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T21:02:47.540 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-08-18T21:02:47.542 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-08-18T21:02:47.542 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-18T21:02:47.598 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-18T21:02:47.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T21:02:47.648 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: /sbin/restorecon: command not found 2024-08-18T21:02:47.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-18T21:02:47.701 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-08-18T21:02:47.701 INFO:tasks.ceph:role: osd.2 2024-08-18T21:02:47.701 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T21:02:47.702 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-18T21:02:47.755 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T21:02:47.755 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T21:02:47.755 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T21:02:47.756 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-18T21:02:47.756 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T21:02:47.756 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-08-18T21:02:47.756 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T21:02:47.756 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-18T21:02:47.756 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T21:02:47.756 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T21:02:47.779 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-08-18T21:02:47.781 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-08-18T21:02:47.781 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-18T21:02:47.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-18T21:02:47.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T21:02:47.895 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: /sbin/restorecon: command not found 2024-08-18T21:02:47.895 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T21:02:48.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:02:48.010+0000 7f825df727c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-18T21:02:48.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:02:48.010+0000 7f825df727c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-18T21:02:48.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:02:48.010+0000 7f825df727c0 -1 bdev(0x5563e69bd800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-08-18T21:02:48.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:02:48.010+0000 7f825df727c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-18T21:02:51.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-18T21:02:51.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T21:02:51.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:02:51.246+0000 7f88428b07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-18T21:02:51.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:02:51.250+0000 7f88428b07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-18T21:02:51.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:02:51.250+0000 7f88428b07c0 -1 bdev(0x55599701b800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-08-18T21:02:51.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:02:51.250+0000 7f88428b07c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-18T21:02:54.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-18T21:02:54.453 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T21:02:54.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:02:54.534+0000 7faff22047c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-18T21:02:54.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:02:54.534+0000 7faff22047c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-18T21:02:54.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:02:54.534+0000 7faff22047c0 -1 bdev(0x563389e8d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-08-18T21:02:54.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:02:54.534+0000 7faff22047c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-18T21:02:57.690 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-18T21:02:57.745 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-18T21:02:57.759 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-08-18T21:02:57.759 INFO:tasks.ceph:role: osd.3 2024-08-18T21:02:57.759 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com 2024-08-18T21:02:57.759 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-18T21:02:57.813 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T21:02:57.813 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T21:02:57.813 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T21:02:57.813 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-18T21:02:57.813 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T21:02:57.814 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-08-18T21:02:57.814 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T21:02:57.814 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-18T21:02:57.814 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T21:02:57.814 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T21:02:57.837 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-08-18T21:02:57.838 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-08-18T21:02:57.838 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-08-18T21:02:57.901 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-18T21:02:57.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T21:02:57.954 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-08-18T21:02:57.954 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-18T21:02:58.007 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-08-18T21:02:58.007 INFO:tasks.ceph:role: osd.4 2024-08-18T21:02:58.007 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com 2024-08-18T21:02:58.007 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-18T21:02:58.060 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T21:02:58.060 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T21:02:58.060 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T21:02:58.060 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-18T21:02:58.060 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T21:02:58.060 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-08-18T21:02:58.060 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T21:02:58.060 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-18T21:02:58.060 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T21:02:58.060 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T21:02:58.085 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-08-18T21:02:58.087 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-08-18T21:02:58.087 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-08-18T21:02:58.143 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-18T21:02:58.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T21:02:58.194 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-08-18T21:02:58.194 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-18T21:02:58.248 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-08-18T21:02:58.248 INFO:tasks.ceph:role: osd.5 2024-08-18T21:02:58.248 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com 2024-08-18T21:02:58.248 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-18T21:02:58.303 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T21:02:58.304 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T21:02:58.304 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T21:02:58.304 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-18T21:02:58.304 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T21:02:58.304 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-08-18T21:02:58.304 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T21:02:58.304 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-18T21:02:58.304 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T21:02:58.304 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T21:02:58.327 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-08-18T21:02:58.329 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-08-18T21:02:58.330 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2024-08-18T21:02:58.387 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-18T21:02:58.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T21:02:58.437 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-08-18T21:02:58.438 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T21:02:58.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:02:58.560+0000 7f484cc857c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-18T21:02:58.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:02:58.560+0000 7f484cc857c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-18T21:02:58.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:02:58.560+0000 7f484cc857c0 -1 bdev(0x55675d7d9800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-08-18T21:02:58.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:02:58.560+0000 7f484cc857c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-18T21:03:01.701 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-18T21:03:01.715 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T21:03:01.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:01.792+0000 7f71e11857c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-18T21:03:01.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:01.792+0000 7f71e11857c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-18T21:03:01.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:01.792+0000 7f71e11857c0 -1 bdev(0x55cf23f5b800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-08-18T21:03:01.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:01.792+0000 7f71e11857c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-18T21:03:04.917 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-18T21:03:04.974 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T21:03:05.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:05.052+0000 7f5759e457c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-18T21:03:05.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:05.052+0000 7f5759e457c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-18T21:03:05.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:05.052+0000 7f5759e457c0 -1 bdev(0x5627955c1800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-08-18T21:03:05.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:05.052+0000 7f5759e457c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-18T21:03:08.185 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-18T21:03:08.241 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-18T21:03:08.242 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:03:08.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-18T21:03:08.256 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:03:08.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-18T21:03:08.316 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:03:08.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-18T21:03:08.371 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T21:03:08.371 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-18T21:03:08.385 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T21:03:08.385 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-18T21:03:08.440 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T21:03:08.441 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-18T21:03:08.497 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T21:03:08.497 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-18T21:03:08.552 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T21:03:08.552 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-18T21:03:08.601 INFO:tasks.ceph:Adding keys to all mons... 2024-08-18T21:03:08.601 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-18T21:03:08.604 DEBUG:teuthology.orchestra.run.smithi157:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-18T21:03:08.647 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2024-08-18T21:03:08.647 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB4YcJmrrviABAAB2hMuY0TsKn0SdUVIhWrPQ== 2024-08-18T21:03:08.647 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2024-08-18T21:03:08.647 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB7YcJmCJIHDxAA/x9oTWVAoYFbZySn5cy2AQ== 2024-08-18T21:03:08.647 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2024-08-18T21:03:08.647 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB+YcJmqnAFIBAAzNTiB1NySjTh57xtmCy7nA== 2024-08-18T21:03:08.647 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2024-08-18T21:03:08.647 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB3YcJm8sQeBhAAtKTdLMIrZdrrzpAOuY2zPA== 2024-08-18T21:03:08.647 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2024-08-18T21:03:08.647 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCCYcJm1Cl7IRAAVaq52SWGJWhCHCFbI9xmtw== 2024-08-18T21:03:08.648 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.4] 2024-08-18T21:03:08.648 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCFYcJm3ORjLxAAnQruRcj8qcHd78Mjaot7Ow== 2024-08-18T21:03:08.648 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.5] 2024-08-18T21:03:08.648 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCJYcJmkTVXAxAAOe5R6NKFVEosPDEOiunCMg== 2024-08-18T21:03:08.648 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-18T21:03:08.648 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB3YcJmZBduCxAAA6olCQuM7D0iSJph1nfecQ== 2024-08-18T21:03:08.655 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.0] 2024-08-18T21:03:08.655 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB4YcJmrrviABAAB2hMuY0TsKn0SdUVIhWrPQ== 2024-08-18T21:03:08.655 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.1] 2024-08-18T21:03:08.655 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB7YcJmCJIHDxAA/x9oTWVAoYFbZySn5cy2AQ== 2024-08-18T21:03:08.655 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.2] 2024-08-18T21:03:08.656 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB+YcJmqnAFIBAAzNTiB1NySjTh57xtmCy7nA== 2024-08-18T21:03:08.656 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.x] 2024-08-18T21:03:08.656 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB3YcJm8sQeBhAAtKTdLMIrZdrrzpAOuY2zPA== 2024-08-18T21:03:08.656 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.3] 2024-08-18T21:03:08.656 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCCYcJm1Cl7IRAAVaq52SWGJWhCHCFbI9xmtw== 2024-08-18T21:03:08.656 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.4] 2024-08-18T21:03:08.656 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCFYcJm3ORjLxAAnQruRcj8qcHd78Mjaot7Ow== 2024-08-18T21:03:08.656 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.5] 2024-08-18T21:03:08.656 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCJYcJmkTVXAxAAOe5R6NKFVEosPDEOiunCMg== 2024-08-18T21:03:08.656 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2024-08-18T21:03:08.656 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB3YcJmZBduCxAAA6olCQuM7D0iSJph1nfecQ== 2024-08-18T21:03:08.657 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T21:03:08.693 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T21:03:08.745 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T21:03:08.747 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T21:03:08.790 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T21:03:08.832 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T21:03:08.874 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-18T21:03:08.920 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-18T21:03:08.965 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T21:03:08.968 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T21:03:09.007 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T21:03:09.052 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T21:03:09.093 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T21:03:09.136 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T21:03:09.180 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T21:03:09.216 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T21:03:09.272 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-18T21:03:09.272 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-18T21:03:09.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-18T21:03:09.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-18T21:03:09.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-18T21:03:09.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-18T21:03:09.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-18T21:03:09.584 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-18T21:03:09.635 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-18T21:03:09.722 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-18T21:03:09.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-d 2024-08-18T21:03:09.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i d --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-18T21:03:09.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-d 2024-08-18T21:03:09.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-e 2024-08-18T21:03:10.004 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i e --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-18T21:03:10.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-e 2024-08-18T21:03:10.108 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-f 2024-08-18T21:03:10.122 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i f --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-18T21:03:10.216 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-f 2024-08-18T21:03:10.227 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-g 2024-08-18T21:03:10.278 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i g --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-18T21:03:10.369 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-g 2024-08-18T21:03:10.381 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-h 2024-08-18T21:03:10.435 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i h --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-18T21:03:10.529 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-h 2024-08-18T21:03:10.540 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-i 2024-08-18T21:03:10.594 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i i --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-18T21:03:10.684 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-i 2024-08-18T21:03:10.739 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-18T21:03:10.741 DEBUG:teuthology.orchestra.run.smithi157:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-18T21:03:10.784 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-18T21:03:10.785 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-18T21:03:10.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-18T21:03:10.792 INFO:tasks.ceph.mon.a:Started 2024-08-18T21:03:10.792 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-18T21:03:10.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-18T21:03:10.795 INFO:tasks.ceph.mon.b:Started 2024-08-18T21:03:10.795 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-18T21:03:10.795 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-18T21:03:10.797 INFO:tasks.ceph.mon.c:Started 2024-08-18T21:03:10.797 INFO:tasks.ceph.mon.d:Restarting daemon 2024-08-18T21:03:10.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-08-18T21:03:10.801 INFO:tasks.ceph.mon.d:Started 2024-08-18T21:03:10.801 INFO:tasks.ceph.mon.e:Restarting daemon 2024-08-18T21:03:10.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-08-18T21:03:10.803 INFO:tasks.ceph.mon.e:Started 2024-08-18T21:03:10.803 INFO:tasks.ceph.mon.f:Restarting daemon 2024-08-18T21:03:10.803 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-08-18T21:03:10.830 INFO:tasks.ceph.mon.f:Started 2024-08-18T21:03:10.830 INFO:tasks.ceph.mon.g:Restarting daemon 2024-08-18T21:03:10.830 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-08-18T21:03:10.832 INFO:tasks.ceph.mon.g:Started 2024-08-18T21:03:10.832 INFO:tasks.ceph.mon.h:Restarting daemon 2024-08-18T21:03:10.833 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2024-08-18T21:03:10.835 INFO:tasks.ceph.mon.h:Started 2024-08-18T21:03:10.835 INFO:tasks.ceph.mon.i:Restarting daemon 2024-08-18T21:03:10.835 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2024-08-18T21:03:10.838 INFO:tasks.ceph.mon.i:Started 2024-08-18T21:03:10.838 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-18T21:03:10.838 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-18T21:03:10.838 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-18T21:03:10.840 INFO:tasks.ceph.mgr.x:Started 2024-08-18T21:03:10.840 DEBUG:tasks.ceph:set 0 configs 2024-08-18T21:03:10.841 INFO:tasks.ceph:Setting crush tunables to default 2024-08-18T21:03:10.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2024-08-18T21:03:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.974+0000 7fbb75557640 10 monclient: get_monmap_and_config 2024-08-18T21:03:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.974+0000 7fbb75557640 10 monclient: build_initial_monmap 2024-08-18T21:03:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.974+0000 7fbb75557640 10 monclient: monmap: 2024-08-18T21:03:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:10.979456+0000 2024-08-18T21:03:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:10.979456+0000 2024-08-18T21:03:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:10.980 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.974+0000 7fbb75557640 1 Processor -- start 2024-08-18T21:03:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.974+0000 7fbb75557640 1 -- start start 2024-08-18T21:03:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.974+0000 7fbb75557640 10 monclient: init 2024-08-18T21:03:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb75557640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb75557640 10 monclient: _add_conns ranks=[5,0,7,1,6,9,2,4,10,3,8] 2024-08-18T21:03:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb75557640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 0x7fbb700a4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb75557640 10 monclient(hunting): picked mon.noname-h con 0x7fbb700a4260 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb75557640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbb70072b10 addr v1:172.21.15.5:6789/0 2024-08-18T21:03:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb75557640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 0x7fbb70071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb75557640 10 monclient(hunting): picked mon.noname-i con 0x7fbb70136850 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb75557640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb70073b20 con 0x7fbb70072b10 2024-08-18T21:03:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb75557640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb75557640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fbb70073e00 con 0x7fbb700a4260 2024-08-18T21:03:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb75557640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb75557640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fbb7009dad0 con 0x7fbb70136850 2024-08-18T21:03:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb75557640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb75557640 10 monclient(hunting): authenticate will time out at 957.992255s 2024-08-18T21:03:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6e7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbb70072b10 0x7fbb70070f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41728/0 (socket says 172.21.15.5:41728) 2024-08-18T21:03:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 learned_addr learned my addr 172.21.15.5:0/3529597620 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:03:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 0x7fbb700a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 0x7fbb70071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6effd640 10 monclient(hunting): get_auth_request con 0x7fbb700a4260 auth_method 0 2024-08-18T21:03:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request con 0x7fbb70136850 auth_method 0 2024-08-18T21:03:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 msgr2=0x7fbb700a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:03:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 msgr2=0x7fbb700a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 0x7fbb700a4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 0x7fbb700a4640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:03:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 msgr2=0x7fbb70071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:03:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 msgr2=0x7fbb70071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 0x7fbb70071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 0x7fbb70071670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:03:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:10.978+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> v1:172.21.15.5:6789/0 conn(0x7fbb70072b10 legacy=0x7fbb70070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 0x7fbb70071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 0x7fbb700a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6effd640 10 monclient(hunting): get_auth_request con 0x7fbb700a4260 auth_method 0 2024-08-18T21:03:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6effd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request con 0x7fbb70136850 auth_method 0 2024-08-18T21:03:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 msgr2=0x7fbb700a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:03:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 msgr2=0x7fbb700a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 0x7fbb700a4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 0x7fbb700a4640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:03:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 msgr2=0x7fbb70071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:03:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 msgr2=0x7fbb70071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 0x7fbb70071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.182+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 0x7fbb70071670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:03:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 0x7fbb700a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 0x7fbb70071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6effd640 10 monclient(hunting): get_auth_request con 0x7fbb700a4260 auth_method 0 2024-08-18T21:03:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6effd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request con 0x7fbb70136850 auth_method 0 2024-08-18T21:03:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 msgr2=0x7fbb700a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:03:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 msgr2=0x7fbb700a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 0x7fbb700a4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 0x7fbb700a4640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:03:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 msgr2=0x7fbb70071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:03:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 msgr2=0x7fbb70071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 0x7fbb70071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:11.586+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 0x7fbb70071670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:03:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 0x7fbb70071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 0x7fbb700a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request con 0x7fbb70136850 auth_method 0 2024-08-18T21:03:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6effd640 10 monclient(hunting): get_auth_request con 0x7fbb700a4260 auth_method 0 2024-08-18T21:03:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6effd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 msgr2=0x7fbb70071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:03:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 msgr2=0x7fbb70071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 0x7fbb70071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 msgr2=0x7fbb700a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:03:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 msgr2=0x7fbb700a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:12.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 0x7fbb700a4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:12.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 0x7fbb700a4640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:03:12.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:12.390+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 0x7fbb70071670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:03:13.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 10 monclient(hunting): tick 2024-08-18T21:03:13.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:03:13.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 1 monclient(hunting): continuing hunt 2024-08-18T21:03:13.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:03:13.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 msgr2=0x7fbb70071670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:03:13.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbb70136850 0x7fbb70071670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:13.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 msgr2=0x7fbb700a4640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:03:13.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb700a4260 0x7fbb700a4640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:13.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 1 -- 172.21.15.5:0/3529597620 >> v1:172.21.15.5:6789/0 conn(0x7fbb70072b10 legacy=0x7fbb70070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:13.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 10 monclient: _add_conns ranks=[3,6,8,4,1,9,10,2] 2024-08-18T21:03:13.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5c005ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:13.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 10 monclient(hunting): picked mon.noname-g con 0x7fbb5c0038b0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:13.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 0x7fbb5c008720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:13.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 10 monclient(hunting): picked mon.noname-d con 0x7fbb5c006290 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:13.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 0x7fbb5c00b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:13.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 10 monclient(hunting): picked mon.noname-e con 0x7fbb5c008e10 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:13.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:13.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 1 -- 172.21.15.5:0/3529597620 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbb70073e00 con 0x7fbb5c0038b0 2024-08-18T21:03:13.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:13.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 1 -- 172.21.15.5:0/3529597620 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fbb7009dad0 con 0x7fbb5c006290 2024-08-18T21:03:13.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:13.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 1 -- 172.21.15.5:0/3529597620 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fbb5c00baf0 con 0x7fbb5c008e10 2024-08-18T21:03:13.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6cff9640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:13.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5c005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 0x7fbb5c00b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 0x7fbb5c008720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6effd640 10 monclient(hunting): get_auth_request con 0x7fbb5c0038b0 auth_method 0 2024-08-18T21:03:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request con 0x7fbb5c008e10 auth_method 0 2024-08-18T21:03:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request con 0x7fbb5c006290 auth_method 0 2024-08-18T21:03:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 msgr2=0x7fbb5c005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:03:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 msgr2=0x7fbb5c005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5c005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5c005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:03:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 msgr2=0x7fbb5c00b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:03:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 msgr2=0x7fbb5c00b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 0x7fbb5c00b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 msgr2=0x7fbb5c008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:03:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 msgr2=0x7fbb5c008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 0x7fbb5c00b2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:03:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 0x7fbb5c008720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:13.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:13.978+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 0x7fbb5c008720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:03:14.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 0x7fbb5c00b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:14.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request con 0x7fbb5c008e10 auth_method 0 2024-08-18T21:03:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 0x7fbb5c008720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request con 0x7fbb5c006290 auth_method 0 2024-08-18T21:03:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 msgr2=0x7fbb5c00b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:03:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 msgr2=0x7fbb5c00b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 0x7fbb5c00b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 msgr2=0x7fbb5c008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:03:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 0x7fbb5c00b2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:03:14.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 msgr2=0x7fbb5c008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:14.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 0x7fbb5c008720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:14.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 0x7fbb5c008720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:03:14.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5c005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:14.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6effd640 10 monclient(hunting): get_auth_request con 0x7fbb5c0038b0 auth_method 0 2024-08-18T21:03:14.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:14.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:14.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6effd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:14.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 msgr2=0x7fbb5c005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:03:14.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 msgr2=0x7fbb5c005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:14.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5c005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:14.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.182+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5c005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:03:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 0x7fbb5c00b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5c005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 0x7fbb5c008720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6effd640 10 monclient(hunting): get_auth_request con 0x7fbb5c0038b0 auth_method 0 2024-08-18T21:03:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6effd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request con 0x7fbb5c008e10 auth_method 0 2024-08-18T21:03:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request con 0x7fbb5c006290 auth_method 0 2024-08-18T21:03:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 msgr2=0x7fbb5c005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:03:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 msgr2=0x7fbb5c005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 msgr2=0x7fbb5c00b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:03:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5c005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 msgr2=0x7fbb5c00b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 0x7fbb5c00b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5c005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:03:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 msgr2=0x7fbb5c008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:03:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 0x7fbb5c00b2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:03:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 msgr2=0x7fbb5c008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 0x7fbb5c008720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:14.586+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 0x7fbb5c008720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:03:15.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 0x7fbb5c00b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:15.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 0x7fbb5c008720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:15.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request con 0x7fbb5c008e10 auth_method 0 2024-08-18T21:03:15.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:15.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:15.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:15.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request con 0x7fbb5c006290 auth_method 0 2024-08-18T21:03:15.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:15.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:15.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:15.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5c005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:15.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6effd640 10 monclient(hunting): get_auth_request con 0x7fbb5c0038b0 auth_method 0 2024-08-18T21:03:15.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:15.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:15.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6effd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:15.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 msgr2=0x7fbb5c00b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:03:15.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 msgr2=0x7fbb5c008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:03:15.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 msgr2=0x7fbb5c00b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:15.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 msgr2=0x7fbb5c008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:15.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 0x7fbb5c00b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:15.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 msgr2=0x7fbb5c005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:03:15.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 0x7fbb5c008720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:15.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 msgr2=0x7fbb5c005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:15.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5c005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:15.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5c005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:03:15.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 0x7fbb5c00b2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:03:15.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:15.390+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 0x7fbb5c008720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:03:16.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 10 monclient(hunting): tick 2024-08-18T21:03:16.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:03:16.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 1 monclient(hunting): continuing hunt 2024-08-18T21:03:16.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:03:16.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 msgr2=0x7fbb5c00b2a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:03:16.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb5c008e10 0x7fbb5c00b2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:16.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 msgr2=0x7fbb5c008720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:03:16.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb5c006290 0x7fbb5c008720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:16.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 msgr2=0x7fbb5c005ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:03:16.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5c005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:16.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 reap_dead start 2024-08-18T21:03:16.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 10 monclient: _add_conns ranks=[2,4,1,9,10] 2024-08-18T21:03:16.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 0x7fbb5c009290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:16.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 10 monclient(hunting): picked mon.noname-b con 0x7fbb5c006710 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:16.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 0x7fbb5c009bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:16.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 10 monclient(hunting): picked mon.noname-c con 0x7fbb5c0097d0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:16.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fbb5c00a110 addr v1:172.21.15.157:6789/0 2024-08-18T21:03:16.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 1 -- 172.21.15.5:0/3529597620 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb70068a50 con 0x7fbb5c00a110 2024-08-18T21:03:16.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:16.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 1 -- 172.21.15.5:0/3529597620 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fbb70073e00 con 0x7fbb5c006710 2024-08-18T21:03:16.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:16.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 1 -- 172.21.15.5:0/3529597620 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fbb7009dad0 con 0x7fbb5c0097d0 2024-08-18T21:03:16.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6cff9640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 0x7fbb5c009bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 0x7fbb5c009290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6effd640 10 monclient(hunting): get_auth_request con 0x7fbb5c006710 auth_method 0 2024-08-18T21:03:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request con 0x7fbb5c0097d0 auth_method 0 2024-08-18T21:03:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 msgr2=0x7fbb5c009bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:03:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 msgr2=0x7fbb5c009bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 msgr2=0x7fbb5c009290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:03:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 0x7fbb5c009bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 msgr2=0x7fbb5c009290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 0x7fbb5c009290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 0x7fbb5c009bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:03:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.978+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 0x7fbb5c009290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:03:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:16.982+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 >> v1:172.21.15.157:6789/0 conn(0x7fbb5c00a110 legacy=0x7fbb5c00a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:17.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 0x7fbb5c009bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:17.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 0x7fbb5c009290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:17.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6effd640 10 monclient(hunting): get_auth_request con 0x7fbb5c006710 auth_method 0 2024-08-18T21:03:17.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:17.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:17.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6effd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:17.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request con 0x7fbb5c0097d0 auth_method 0 2024-08-18T21:03:17.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 msgr2=0x7fbb5c009290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:03:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 msgr2=0x7fbb5c009290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 msgr2=0x7fbb5c009bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:03:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 0x7fbb5c009290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 msgr2=0x7fbb5c009bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 0x7fbb5c009bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 0x7fbb5c009290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:03:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.182+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 0x7fbb5c009bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:03:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 0x7fbb5c009290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 0x7fbb5c009bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6effd640 10 monclient(hunting): get_auth_request con 0x7fbb5c006710 auth_method 0 2024-08-18T21:03:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6effd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request con 0x7fbb5c0097d0 auth_method 0 2024-08-18T21:03:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 msgr2=0x7fbb5c009290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:03:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6effd640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 msgr2=0x7fbb5c009290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 0x7fbb5c009290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:17.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 msgr2=0x7fbb5c009bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:03:17.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 msgr2=0x7fbb5c009bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:03:17.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 0x7fbb5c009bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:17.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 0x7fbb5c009290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:03:17.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.586+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 0x7fbb5c009bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:03:17.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 -- 172.21.15.5:0/3529597620 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 187475659 0 0) 0x7fbb70068a50 con 0x7fbb5c00a110 2024-08-18T21:03:17.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient(hunting): _negotiate 2024-08-18T21:03:17.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient(hunting): my global_id is 4105 2024-08-18T21:03:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 -- 172.21.15.5:0/3529597620 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb58003530 con 0x7fbb5c00a110 2024-08-18T21:03:17.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 -- 172.21.15.5:0/3529597620 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3061311661 0 0) 0x7fbb58003530 con 0x7fbb5c00a110 2024-08-18T21:03:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 msgr2=0x7fbb5c009bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:03:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb5c0097d0 0x7fbb5c009bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 msgr2=0x7fbb5c009290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:03:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbb5c006710 0x7fbb5c009290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient: _finish_hunting 0 2024-08-18T21:03:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 monclient: found mon.noname-f-legacy 2024-08-18T21:03:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient: _send_mon_message to mon.noname-f-legacy at v1:172.21.15.157:6789/0 2024-08-18T21:03:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 -- 172.21.15.5:0/3529597620 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c00af50 con 0x7fbb5c00a110 2024-08-18T21:03:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient: _finish_auth 0 2024-08-18T21:03:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient: _check_auth_tickets 2024-08-18T21:03:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 -- 172.21.15.5:0/3529597620 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 4141550541 0 0) 0x7fbb68009d10 con 0x7fbb5c00a110 2024-08-18T21:03:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient: got monmap 1 from mon.noname-f-legacy (according to old e1) 2024-08-18T21:03:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient: dump: 2024-08-18T21:03:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:17.962 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 monclient: mon.f has (v2) addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] but i'm connected to v1:172.21.15.157:6789/0, reconnecting 2024-08-18T21:03:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 -- 172.21.15.5:0/3529597620 >> v1:172.21.15.157:6789/0 conn(0x7fbb5c00a110 legacy=0x7fbb5c00a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient: _add_conns ranks=[6,5,3,7,4,2,1,0,8] 2024-08-18T21:03:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb58004210 0x7fbb58004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient(hunting): picked mon.d con 0x7fbb58004210 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb58004e20 0x7fbb580052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient(hunting): picked mon.h con 0x7fbb58004e20 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5800bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient(hunting): picked mon.g con 0x7fbb5c0038b0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 -- 172.21.15.5:0/3529597620 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbb70073e00 con 0x7fbb5c0038b0 2024-08-18T21:03:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 -- 172.21.15.5:0/3529597620 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fbb7009dad0 con 0x7fbb58004e20 2024-08-18T21:03:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 1 -- 172.21.15.5:0/3529597620 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fbb5800c3b0 con 0x7fbb58004210 2024-08-18T21:03:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6dffb640 10 monclient(hunting): _finish_auth 0 2024-08-18T21:03:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb58004210 0x7fbb58004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6effd640 10 monclient(hunting): get_auth_request con 0x7fbb58004210 auth_method 0 2024-08-18T21:03:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6effd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb58004e20 0x7fbb580052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request con 0x7fbb58004e20 auth_method 0 2024-08-18T21:03:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5800bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6effd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:03:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request con 0x7fbb5c0038b0 auth_method 0 2024-08-18T21:03:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:03:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.954+0000 7fbb6f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:03:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.958+0000 7fbb6e7fc640 10 monclient(hunting): handle_auth_done global_id 4105 payload 293 2024-08-18T21:03:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.958+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb58004210 msgr2=0x7fbb58004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.958+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb58004210 0x7fbb58004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.958+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 msgr2=0x7fbb5800bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.958+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5c0038b0 0x7fbb5800bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.958+0000 7fbb6e7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:03:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.958+0000 7fbb6e7fc640 1 monclient: found mon.h 2024-08-18T21:03:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.958+0000 7fbb6e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.958+0000 7fbb6e7fc640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:03:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.958+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb58003530 con 0x7fbb58004e20 2024-08-18T21:03:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.958+0000 7fbb6e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:17.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.958+0000 7fbb6e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:17.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.958+0000 7fbb6e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:17.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.958+0000 7fbb6f7fe640 1 -- 172.21.15.5:0/3529597620 reap_dead start 2024-08-18T21:03:17.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.958+0000 7fbb75557640 5 monclient: authenticate success, global_id 4105 2024-08-18T21:03:17.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.958+0000 7fbb75557640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:17.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb58004e20 msgr2=0x7fbb580052a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb58004e20 0x7fbb580052a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbb70072590 tx=0x7fbb6401dcf0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=b3a93eeb0a213668 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb6dffb640 1 -- 172.21.15.5:0/3529597620 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbb640ac070 con 0x7fbb58004e20 2024-08-18T21:03:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb6dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:03:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb6dffb640 10 monclient: dump: 2024-08-18T21:03:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:17.970 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:17.970 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:17.970 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:17.970 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:17.970 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:17.970 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:17.970 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:17.970 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:17.970 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:17.970 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:17.970 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb75557640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb6dffb640 1 -- 172.21.15.5:0/3529597620 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb640a6b90 con 0x7fbb58004e20 2024-08-18T21:03:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb6dffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb75557640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb75557640 4 set_mon_vals no callback set 2024-08-18T21:03:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb6dffb640 1 -- 172.21.15.5:0/3529597620 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbb64005bd0 con 0x7fbb58004e20 2024-08-18T21:03:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb6dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:03:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb6dffb640 10 monclient: dump: 2024-08-18T21:03:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:17.972 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb75557640 10 monclient: shutdown 2024-08-18T21:03:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb75557640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb75557640 1 -- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb58004e20 msgr2=0x7fbb580052a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb75557640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb58004e20 0x7fbb580052a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbb70072590 tx=0x7fbb6401dcf0 comp rx=0 tx=0).stop 2024-08-18T21:03:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb75557640 1 -- 172.21.15.5:0/3529597620 shutdown_connections 2024-08-18T21:03:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb75557640 1 --2- 172.21.15.5:0/3529597620 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb58004e20 0x7fbb580052a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb75557640 1 -- 172.21.15.5:0/3529597620 >> 172.21.15.5:0/3529597620 conn(0x7fbb700a8a90 msgr2=0x7fbb700a8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb75557640 1 -- 172.21.15.5:0/3529597620 shutdown_connections 2024-08-18T21:03:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.962+0000 7fbb75557640 1 -- 172.21.15.5:0/3529597620 wait complete. 2024-08-18T21:03:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 10 monclient: build_initial_monmap 2024-08-18T21:03:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 10 monclient: monmap: 2024-08-18T21:03:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:17.974 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 1 Processor -- start 2024-08-18T21:03:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 1 -- start start 2024-08-18T21:03:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 10 monclient: init 2024-08-18T21:03:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 10 monclient: _add_conns ranks=[4,8,0,6,1,3,2,5,7] 2024-08-18T21:03:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb58004e20 0x7fbb70132ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 10 monclient(hunting): picked mon.noname-c con 0x7fbb58004e20 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb701331e0 0x7fbb7011ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 10 monclient(hunting): picked mon.noname-e con 0x7fbb701331e0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb7011f220 0x7fbb7011f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 10 monclient(hunting): picked mon.noname-a con 0x7fbb7011f220 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbb70138270 con 0x7fbb7011f220 2024-08-18T21:03:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fbb701380f0 con 0x7fbb58004e20 2024-08-18T21:03:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fbb701383f0 con 0x7fbb701331e0 2024-08-18T21:03:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb75557640 10 monclient(hunting): authenticate will time out at 964.983685s 2024-08-18T21:03:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb6e7fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb701331e0 0x7fbb7011ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb6e7fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb701331e0 0x7fbb7011ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:48838/0 (socket says 172.21.15.5:48838) 2024-08-18T21:03:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3405191231 learned_addr learned my addr 172.21.15.5:0/3405191231 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request con 0x7fbb701331e0 auth_method 0 2024-08-18T21:03:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb6e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb6e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb6effd640 1 --2- 172.21.15.5:0/3405191231 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb58004e20 0x7fbb70132ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.966+0000 7fbb6f7fe640 1 --2- 172.21.15.5:0/3405191231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb7011f220 0x7fbb7011f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request con 0x7fbb7011f220 auth_method 0 2024-08-18T21:03:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6effd640 10 monclient(hunting): get_auth_request con 0x7fbb58004e20 auth_method 0 2024-08-18T21:03:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:17.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:17.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:17.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:17.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:17.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:17.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:17.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:17.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:17.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6e7fc640 10 monclient(hunting): handle_auth_done global_id 4112 payload 824 2024-08-18T21:03:17.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3405191231 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb58004e20 msgr2=0x7fbb70132ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:17.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3405191231 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb58004e20 0x7fbb70132ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:17.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3405191231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb7011f220 msgr2=0x7fbb7011f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3405191231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb7011f220 0x7fbb7011f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6e7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:03:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6e7fc640 1 monclient: found mon.noname-e 2024-08-18T21:03:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6e7fc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3405191231 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb70122680 con 0x7fbb701331e0 2024-08-18T21:03:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6e7fc640 1 -- 172.21.15.5:0/3405191231 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb701331e0 msgr2=0x7fbb7011ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6e7fc640 1 --2- 172.21.15.5:0/3405191231 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb701331e0 0x7fbb7011ece0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbb6401c450 tx=0x7fbb58005840 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb577fe640 1 -- 172.21.15.5:0/3405191231 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbb640be020 con 0x7fbb701331e0 2024-08-18T21:03:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb577fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb577fe640 10 monclient: dump: 2024-08-18T21:03:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:17.984 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:17.984 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:17.984 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:17.984 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:17.984 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:17.984 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:17.984 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:17.984 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:17.984 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:17.984 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:17.984 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:17.984 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:17.984 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:17.985 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:17.985 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:17.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb577fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:17.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb577fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:17.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:17.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb577fe640 1 -- 172.21.15.5:0/3405191231 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb64004c60 con 0x7fbb701331e0 2024-08-18T21:03:17.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb75557640 5 monclient: authenticate success, global_id 4112 2024-08-18T21:03:17.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb75557640 10 monclient: _renew_subs 2024-08-18T21:03:17.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb75557640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:17.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb75557640 1 -- 172.21.15.5:0/3405191231 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb70134390 con 0x7fbb701331e0 2024-08-18T21:03:17.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb577fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:17.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb577fe640 1 -- 172.21.15.5:0/3405191231 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbb640ac040 con 0x7fbb701331e0 2024-08-18T21:03:17.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:17.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb577fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:17.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb577fe640 10 monclient: dump: 2024-08-18T21:03:17.986 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:17.986 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:17.986 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:17.986 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:17.986 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:17.986 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:17.986 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:17.986 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:17.986 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:17.986 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:17.987 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb75557640 10 monclient: _renew_subs 2024-08-18T21:03:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb75557640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb75557640 1 -- 172.21.15.5:0/3405191231 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb70120320 con 0x7fbb701331e0 2024-08-18T21:03:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb6d7fa640 4 set_mon_vals no callback set 2024-08-18T21:03:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb577fe640 1 -- 172.21.15.5:0/3405191231 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbb640c1020 con 0x7fbb701331e0 2024-08-18T21:03:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.970+0000 7fbb577fe640 1 -- 172.21.15.5:0/3405191231 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbb64010040 con 0x7fbb701331e0 2024-08-18T21:03:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.974+0000 7fbb75557640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:17.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.974+0000 7fbb75557640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:17.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.974+0000 7fbb75557640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:17.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.974+0000 7fbb75557640 1 -- 172.21.15.5:0/3405191231 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb70068960 con 0x7fbb701331e0 2024-08-18T21:03:17.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.974+0000 7fbb577fe640 1 -- 172.21.15.5:0/3405191231 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fbb640c8030 con 0x7fbb701331e0 2024-08-18T21:03:17.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.974+0000 7fbb577fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:17.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:17.974+0000 7fbb577fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:18.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.042+0000 7fbb75557640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2024-08-18T21:03:18.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.042+0000 7fbb75557640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-08-18T21:03:18.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.042+0000 7fbb75557640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:18.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.042+0000 7fbb75557640 1 -- 172.21.15.5:0/3405191231 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fbb70133710 con 0x7fbb701331e0 2024-08-18T21:03:18.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.878+0000 7fbb577fe640 1 -- 172.21.15.5:0/3405191231 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fbb70073b20 con 0x7fbb701331e0 2024-08-18T21:03:18.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.878+0000 7fbb577fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-08-18T21:03:18.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.878+0000 7fbb577fe640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2024-08-18T21:03:18.881 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-08-18T21:03:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.882+0000 7fbb75557640 10 monclient: shutdown 2024-08-18T21:03:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.882+0000 7fbb75557640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.882+0000 7fbb75557640 1 -- 172.21.15.5:0/3405191231 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb701331e0 msgr2=0x7fbb7011ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.882+0000 7fbb75557640 1 --2- 172.21.15.5:0/3405191231 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb701331e0 0x7fbb7011ece0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbb6401c450 tx=0x7fbb58005840 comp rx=0 tx=0).stop 2024-08-18T21:03:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.882+0000 7fbb75557640 1 -- 172.21.15.5:0/3405191231 shutdown_connections 2024-08-18T21:03:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.882+0000 7fbb75557640 1 --2- 172.21.15.5:0/3405191231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb7011f220 0x7fbb7011f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.882+0000 7fbb75557640 1 --2- 172.21.15.5:0/3405191231 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbb701331e0 0x7fbb7011ece0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.882+0000 7fbb75557640 1 --2- 172.21.15.5:0/3405191231 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb58004e20 0x7fbb70132ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.882+0000 7fbb75557640 1 -- 172.21.15.5:0/3405191231 >> 172.21.15.5:0/3405191231 conn(0x7fbb700a8a90 msgr2=0x7fbb701bd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.882+0000 7fbb75557640 1 -- 172.21.15.5:0/3405191231 shutdown_connections 2024-08-18T21:03:18.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:18.882+0000 7fbb75557640 1 -- 172.21.15.5:0/3405191231 wait complete. 2024-08-18T21:03:18.910 INFO:tasks.ceph:check_enable_crimson: False 2024-08-18T21:03:18.910 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-18T21:03:18.910 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:03:18.911 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-18T21:03:18.924 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:03:18.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-18T21:03:18.978 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T21:03:18.979 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-18T21:03:19.036 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T21:03:19.036 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-18T21:03:19.049 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T21:03:19.049 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-18T21:03:19.104 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-18T21:03:19.104 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-18T21:03:19.159 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 8f6d162e-ed99-408f-87c5-4880e57b4f0a 0 2024-08-18T21:03:19.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 10 monclient: get_monmap_and_config 2024-08-18T21:03:19.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 10 monclient: build_initial_monmap 2024-08-18T21:03:19.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 10 monclient: monmap: 2024-08-18T21:03:19.322 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 0 2024-08-18T21:03:19.322 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:19.322 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:03:19.323151+0000 2024-08-18T21:03:19.322 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:03:19.323151+0000 2024-08-18T21:03:19.322 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:19.323 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:19.323 INFO:teuthology.orchestra.run.smithi157.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:19.323 INFO:teuthology.orchestra.run.smithi157.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:19.323 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:19.323 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:19.323 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:19.323 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:19.323 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:19.323 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:19.323 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:19.323 INFO:teuthology.orchestra.run.smithi157.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:19.323 INFO:teuthology.orchestra.run.smithi157.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:19.323 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:19.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 1 Processor -- start 2024-08-18T21:03:19.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 1 -- start start 2024-08-18T21:03:19.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 10 monclient: init 2024-08-18T21:03:19.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:19.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 10 monclient: _add_conns ranks=[4,9,3,1,7,2,8,6,10,5,0] 2024-08-18T21:03:19.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07180a5ac0 0x7f07180a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:19.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 10 monclient(hunting): picked mon.noname-c con 0x7f07180a5ac0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:19.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07180a63e0 0x7f07181378e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:19.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 10 monclient(hunting): picked mon.noname-a con 0x7f07180a63e0 addr v2:172.21.15.5:3300/0 2024-08-18T21:03:19.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0718137e20 0x7f07181382d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:19.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 10 monclient(hunting): picked mon.noname-g con 0x7f0718137e20 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:19.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:19.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f07180a2050 con 0x7f07180a63e0 2024-08-18T21:03:19.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:19.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f07180a3990 con 0x7f0718137e20 2024-08-18T21:03:19.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:19.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f07180a30f0 con 0x7f07180a5ac0 2024-08-18T21:03:19.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:19.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f071d7f7640 10 monclient(hunting): authenticate will time out at 948.027044s 2024-08-18T21:03:19.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0718137e20 0x7f07181382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:19.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0718137e20 0x7f07181382d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:39682/0 (socket says 172.21.15.157:39682) 2024-08-18T21:03:19.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 1 -- 172.21.15.157:0/2137620451 learned_addr learned my addr 172.21.15.157:0/2137620451 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-18T21:03:19.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 10 monclient(hunting): get_auth_request con 0x7f0718137e20 auth_method 0 2024-08-18T21:03:19.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:19.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:19.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:19.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:19.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:19.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:19.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07167fc640 1 --2- 172.21.15.157:0/2137620451 >> v2:172.21.15.5:3300/0 conn(0x7f07180a63e0 0x7f07181378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:19.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f0716ffd640 1 --2- 172.21.15.157:0/2137620451 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07180a5ac0 0x7f07180a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:19.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07167fc640 10 monclient(hunting): get_auth_request con 0x7f07180a63e0 auth_method 0 2024-08-18T21:03:19.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07167fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:19.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07167fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:19.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07167fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:19.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f0716ffd640 10 monclient(hunting): get_auth_request con 0x7f07180a5ac0 auth_method 0 2024-08-18T21:03:19.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f0716ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:19.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f0716ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:19.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f0716ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:19.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 10 monclient(hunting): handle_auth_done global_id 4107 payload 274 2024-08-18T21:03:19.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 1 -- 172.21.15.157:0/2137620451 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07180a5ac0 msgr2=0x7f07180a5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:19.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 1 --2- 172.21.15.157:0/2137620451 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07180a5ac0 0x7f07180a5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:19.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 1 -- 172.21.15.157:0/2137620451 >> v2:172.21.15.5:3300/0 conn(0x7f07180a63e0 msgr2=0x7f07181378e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:19.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 1 --2- 172.21.15.157:0/2137620451 >> v2:172.21.15.5:3300/0 conn(0x7f07180a63e0 0x7f07181378e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:19.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:19.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 1 monclient: found mon.noname-g 2024-08-18T21:03:19.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:19.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:03:19.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.320+0000 7f07177fe640 1 -- 172.21.15.157:0/2137620451 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07180a7660 con 0x7f0718137e20 2024-08-18T21:03:19.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.324+0000 7f07177fe640 1 -- 172.21.15.157:0/2137620451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0718137e20 msgr2=0x7f07181382d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:19.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.324+0000 7f07177fe640 1 --2- 172.21.15.157:0/2137620451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0718137e20 0x7f07181382d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0708009e50 tx=0x7f070801c8f0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=2bd25e555115b577 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:19.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.324+0000 7f0715ffb640 1 -- 172.21.15.157:0/2137620451 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07080090d0 con 0x7f0718137e20 2024-08-18T21:03:19.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.324+0000 7f0715ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:19.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.324+0000 7f0715ffb640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:03:19.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.324+0000 7f0715ffb640 10 monclient: dump: 2024-08-18T21:03:19.333 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:19.334 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:19.334 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:19.334 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:19.334 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:19.334 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:19.334 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:19.334 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:19.334 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:19.334 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:19.334 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:19.334 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:19.335 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:19.335 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:19.335 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:19.335 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:19.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.324+0000 7f0715ffb640 10 monclient: _finish_auth 0 2024-08-18T21:03:19.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.324+0000 7f0715ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:03:19.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.324+0000 7f0715ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:19.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.324+0000 7f0715ffb640 1 -- 172.21.15.157:0/2137620451 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07080a59b0 con 0x7f0718137e20 2024-08-18T21:03:19.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 5 monclient: authenticate success, global_id 4107 2024-08-18T21:03:19.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:19.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f0715ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:19.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:19.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 4 set_mon_vals no callback set 2024-08-18T21:03:19.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f0715ffb640 1 -- 172.21.15.157:0/2137620451 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07080ad3f0 con 0x7f0718137e20 2024-08-18T21:03:19.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f0715ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:19.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f0715ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:03:19.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f0715ffb640 10 monclient: dump: 2024-08-18T21:03:19.336 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:19.336 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:19.336 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:19.336 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:19.336 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:19.336 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:19.336 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:19.337 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 10 monclient: shutdown 2024-08-18T21:03:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 -- 172.21.15.157:0/2137620451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0718137e20 msgr2=0x7f07181382d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 --2- 172.21.15.157:0/2137620451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0718137e20 0x7f07181382d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0708009e50 tx=0x7f070801c8f0 comp rx=0 tx=0).stop 2024-08-18T21:03:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 -- 172.21.15.157:0/2137620451 shutdown_connections 2024-08-18T21:03:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 --2- 172.21.15.157:0/2137620451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0718137e20 0x7f07181382d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 --2- 172.21.15.157:0/2137620451 >> v2:172.21.15.5:3300/0 conn(0x7f07180a63e0 0x7f07181378e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 --2- 172.21.15.157:0/2137620451 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07180a5ac0 0x7f07180a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 -- 172.21.15.157:0/2137620451 >> 172.21.15.157:0/2137620451 conn(0x7f07180aa770 msgr2=0x7f07180a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 -- 172.21.15.157:0/2137620451 shutdown_connections 2024-08-18T21:03:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 -- 172.21.15.157:0/2137620451 wait complete. 2024-08-18T21:03:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 10 monclient: build_initial_monmap 2024-08-18T21:03:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 10 monclient: monmap: 2024-08-18T21:03:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 0 2024-08-18T21:03:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 0.000000 2024-08-18T21:03:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:created 0.000000 2024-08-18T21:03:19.338 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:19.339 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 Processor -- start 2024-08-18T21:03:19.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 -- start start 2024-08-18T21:03:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 10 monclient: init 2024-08-18T21:03:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 10 monclient: _add_conns ranks=[4,2,5,8,6,1,7,0,3] 2024-08-18T21:03:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07180a5ac0 0x7f0718136800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 10 monclient(hunting): picked mon.noname-c con 0x7f07180a5ac0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f07180a63e0 0x7f0718136d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 10 monclient(hunting): picked mon.noname-b con 0x7f07180a63e0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0718137e20 0x7f071813bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 10 monclient(hunting): picked mon.noname-h con 0x7f0718137e20 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f07180a1dc0 con 0x7f07180a63e0 2024-08-18T21:03:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f07180a1c40 con 0x7f07180a5ac0 2024-08-18T21:03:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f07181417d0 con 0x7f0718137e20 2024-08-18T21:03:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f071d7f7640 10 monclient(hunting): authenticate will time out at 948.034389s 2024-08-18T21:03:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0718137e20 0x7f071813bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0718137e20 0x7f071813bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.157:58062/0 (socket says 172.21.15.157:58062) 2024-08-18T21:03:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 1 -- 172.21.15.157:0/2785047275 learned_addr learned my addr 172.21.15.157:0/2785047275 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-18T21:03:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 10 monclient(hunting): get_auth_request con 0x7f0718137e20 auth_method 0 2024-08-18T21:03:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f0716ffd640 1 --2- 172.21.15.157:0/2785047275 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07180a5ac0 0x7f0718136800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07167fc640 1 --2- 172.21.15.157:0/2785047275 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f07180a63e0 0x7f0718136d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f0716ffd640 10 monclient(hunting): get_auth_request con 0x7f07180a5ac0 auth_method 0 2024-08-18T21:03:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f0716ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f0716ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f0716ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07167fc640 10 monclient(hunting): get_auth_request con 0x7f07180a63e0 auth_method 0 2024-08-18T21:03:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07167fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07167fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07167fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 10 monclient(hunting): handle_auth_done global_id 4118 payload 824 2024-08-18T21:03:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 1 -- 172.21.15.157:0/2785047275 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07180a5ac0 msgr2=0x7f0718136800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:19.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 1 --2- 172.21.15.157:0/2785047275 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07180a5ac0 0x7f0718136800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:19.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 1 -- 172.21.15.157:0/2785047275 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f07180a63e0 msgr2=0x7f0718136d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:19.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 1 --2- 172.21.15.157:0/2785047275 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f07180a63e0 0x7f0718136d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:19.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:19.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 1 monclient: found mon.noname-h 2024-08-18T21:03:19.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:19.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:03:19.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.328+0000 7f07177fe640 1 -- 172.21.15.157:0/2785047275 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071806f8e0 con 0x7f0718137e20 2024-08-18T21:03:19.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f07177fe640 1 -- 172.21.15.157:0/2785047275 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0718137e20 msgr2=0x7f071813bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:19.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f07177fe640 1 --2- 172.21.15.157:0/2785047275 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0718137e20 0x7f071813bcd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0708009040 tx=0x7f0708019690 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:19.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f06ff7fe640 1 -- 172.21.15.157:0/2785047275 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07080bd020 con 0x7f0718137e20 2024-08-18T21:03:19.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f06ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:19.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f06ff7fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:03:19.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f06ff7fe640 10 monclient: dump: 2024-08-18T21:03:19.345 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:19.345 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:19.347 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f06ff7fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f06ff7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f06ff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f071d7f7640 5 monclient: authenticate success, global_id 4118 2024-08-18T21:03:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f06ff7fe640 1 -- 172.21.15.157:0/2785047275 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0708003e10 con 0x7f0718137e20 2024-08-18T21:03:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f06ff7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f06ff7fe640 1 -- 172.21.15.157:0/2785047275 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07080044b0 con 0x7f0718137e20 2024-08-18T21:03:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f06ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f06ff7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:03:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f07157fa640 4 set_mon_vals no callback set 2024-08-18T21:03:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f06ff7fe640 10 monclient: dump: 2024-08-18T21:03:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:19.349 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:19.349 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:19.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f071d7f7640 10 monclient: _renew_subs 2024-08-18T21:03:19.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f071d7f7640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:03:19.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f071d7f7640 1 -- 172.21.15.157:0/2785047275 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f071813dd80 con 0x7f0718137e20 2024-08-18T21:03:19.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f071d7f7640 10 monclient: _renew_subs 2024-08-18T21:03:19.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f071d7f7640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:03:19.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f071d7f7640 1 -- 172.21.15.157:0/2785047275 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f071806e0e0 con 0x7f0718137e20 2024-08-18T21:03:19.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f06ff7fe640 1 -- 172.21.15.157:0/2785047275 <== mon.5 v2:172.21.15.157:3302/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f07080c0020 con 0x7f0718137e20 2024-08-18T21:03:19.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f06ff7fe640 1 -- 172.21.15.157:0/2785047275 <== mon.5 v2:172.21.15.157:3302/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f07080b9470 con 0x7f0718137e20 2024-08-18T21:03:19.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f071d7f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:19.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f071d7f7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:19.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f071d7f7640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:03:19.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.332+0000 7f071d7f7640 1 -- 172.21.15.157:0/2785047275 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07180a5ea0 con 0x7f0718137e20 2024-08-18T21:03:19.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.336+0000 7f06ff7fe640 1 -- 172.21.15.157:0/2785047275 <== mon.5 v2:172.21.15.157:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f07080c7030 con 0x7f0718137e20 2024-08-18T21:03:19.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.336+0000 7f06ff7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:19.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.336+0000 7f06ff7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:19.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.408+0000 7f071d7f7640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8f6d162e-ed99-408f-87c5-4880e57b4f0a", "id": 0}] 2024-08-18T21:03:19.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.408+0000 7f071d7f7640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8f6d162e-ed99-408f-87c5-4880e57b4f0a", "id": 0}] 2024-08-18T21:03:19.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.408+0000 7f071d7f7640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:03:19.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:19.408+0000 7f071d7f7640 1 -- 172.21.15.157:0/2785047275 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_command({"prefix": "osd new", "uuid": "8f6d162e-ed99-408f-87c5-4880e57b4f0a", "id": 0} v 0) -- 0x7f071813d770 con 0x7f0718137e20 2024-08-18T21:03:20.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.028+0000 7f06ff7fe640 1 -- 172.21.15.157:0/2785047275 <== mon.5 v2:172.21.15.157:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f6d162e-ed99-408f-87c5-4880e57b4f0a", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f0708016600 con 0x7f0718137e20 2024-08-18T21:03:20.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.028+0000 7f06ff7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8f6d162e-ed99-408f-87c5-4880e57b4f0a", "id": 0}] 2024-08-18T21:03:20.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.028+0000 7f06ff7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:20.033 INFO:teuthology.orchestra.run.smithi157.stdout:0 2024-08-18T21:03:20.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.032+0000 7f071d7f7640 10 monclient: shutdown 2024-08-18T21:03:20.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.032+0000 7f071d7f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:20.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.032+0000 7f071d7f7640 1 -- 172.21.15.157:0/2785047275 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0718137e20 msgr2=0x7f071813bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.032+0000 7f071d7f7640 1 --2- 172.21.15.157:0/2785047275 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0718137e20 0x7f071813bcd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0708009040 tx=0x7f0708019690 comp rx=0 tx=0).stop 2024-08-18T21:03:20.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.032+0000 7f071d7f7640 1 -- 172.21.15.157:0/2785047275 shutdown_connections 2024-08-18T21:03:20.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.032+0000 7f071d7f7640 1 --2- 172.21.15.157:0/2785047275 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f07180a63e0 0x7f0718136d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.032+0000 7f071d7f7640 1 --2- 172.21.15.157:0/2785047275 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0718137e20 0x7f071813bcd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.032+0000 7f071d7f7640 1 --2- 172.21.15.157:0/2785047275 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07180a5ac0 0x7f0718136800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.032+0000 7f071d7f7640 1 -- 172.21.15.157:0/2785047275 >> 172.21.15.157:0/2785047275 conn(0x7f07180aa770 msgr2=0x7f071809dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:20.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.032+0000 7f071d7f7640 1 -- 172.21.15.157:0/2785047275 shutdown_connections 2024-08-18T21:03:20.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.032+0000 7f071d7f7640 1 -- 172.21.15.157:0/2785047275 wait complete. 2024-08-18T21:03:20.050 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 99984157-5771-44d0-b5fa-c3e5b2537e67 1 2024-08-18T21:03:20.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 10 monclient: get_monmap_and_config 2024-08-18T21:03:20.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 10 monclient: build_initial_monmap 2024-08-18T21:03:20.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 10 monclient: monmap: 2024-08-18T21:03:20.171 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 0 2024-08-18T21:03:20.171 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.171 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:03:20.171781+0000 2024-08-18T21:03:20.171 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:03:20.171781+0000 2024-08-18T21:03:20.171 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:20.171 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.171 INFO:teuthology.orchestra.run.smithi157.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:20.171 INFO:teuthology.orchestra.run.smithi157.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:20.171 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:20.172 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:20.172 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:20.172 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:20.172 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:20.172 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:20.172 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:20.172 INFO:teuthology.orchestra.run.smithi157.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:20.172 INFO:teuthology.orchestra.run.smithi157.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:20.172 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 1 Processor -- start 2024-08-18T21:03:20.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 1 -- start start 2024-08-18T21:03:20.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 10 monclient: init 2024-08-18T21:03:20.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:20.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 10 monclient: _add_conns ranks=[7,2,5,3,1,6,8,4,9,10,0] 2024-08-18T21:03:20.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f30cc0a4210 0x7f30cc0a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 10 monclient(hunting): picked mon.noname-i con 0x7f30cc0a4210 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f30cc0a4b30 0x7f30cc135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 10 monclient(hunting): picked mon.noname-b con 0x7f30cc0a4b30 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f30cc136500 0x7f30cc136940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 10 monclient(hunting): picked mon.noname-h con 0x7f30cc136500 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f30cc0701f0 con 0x7f30cc0a4b30 2024-08-18T21:03:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f30cc071570 con 0x7f30cc136500 2024-08-18T21:03:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f30cc071b30 con 0x7f30cc0a4210 2024-08-18T21:03:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30d14cf640 10 monclient(hunting): authenticate will time out at 948.875751s 2024-08-18T21:03:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30caffd640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f30cc0a4210 0x7f30cc0a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30cb7fe640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f30cc136500 0x7f30cc136940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30cb7fe640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f30cc136500 0x7f30cc136940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.157:58072/0 (socket says 172.21.15.157:58072) 2024-08-18T21:03:20.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30cb7fe640 1 -- 172.21.15.157:0/1702056207 learned_addr learned my addr 172.21.15.157:0/1702056207 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-18T21:03:20.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30cb7fe640 10 monclient(hunting): get_auth_request con 0x7f30cc136500 auth_method 0 2024-08-18T21:03:20.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30cb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30caffd640 10 monclient(hunting): get_auth_request con 0x7f30cc0a4210 auth_method 0 2024-08-18T21:03:20.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30caffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.168+0000 7f30caffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:20.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:20.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:20.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:20.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:20.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:20.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30ca7fc640 1 --2- 172.21.15.157:0/1702056207 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f30cc0a4b30 0x7f30cc135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30ca7fc640 10 monclient(hunting): get_auth_request con 0x7f30cc0a4b30 auth_method 0 2024-08-18T21:03:20.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30ca7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30ca7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30ca7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30cb7fe640 10 monclient(hunting): handle_auth_done global_id 4127 payload 274 2024-08-18T21:03:20.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30cb7fe640 1 -- 172.21.15.157:0/1702056207 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f30cc0a4210 msgr2=0x7f30cc0a45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:20.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30cb7fe640 1 --2- 172.21.15.157:0/1702056207 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f30cc0a4210 0x7f30cc0a45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30cb7fe640 1 -- 172.21.15.157:0/1702056207 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f30cc0a4b30 msgr2=0x7f30cc135fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:20.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30cb7fe640 1 --2- 172.21.15.157:0/1702056207 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f30cc0a4b30 0x7f30cc135fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30cb7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:20.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30cb7fe640 1 monclient: found mon.noname-h 2024-08-18T21:03:20.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:20.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30cb7fe640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:03:20.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30cb7fe640 1 -- 172.21.15.157:0/1702056207 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30cc06f830 con 0x7f30cc136500 2024-08-18T21:03:20.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30ca7fc640 1 --2- 172.21.15.157:0/1702056207 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f30cc0a4b30 0x7f30cc135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:03:20.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.172+0000 7f30caffd640 1 --2- 172.21.15.157:0/1702056207 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f30cc0a4210 0x7f30cc0a45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:20.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30cb7fe640 1 -- 172.21.15.157:0/1702056207 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f30cc136500 msgr2=0x7f30cc136940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:20.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30cb7fe640 1 --2- 172.21.15.157:0/1702056207 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f30cc136500 0x7f30cc136940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009900 tx=0x7f30bc01c420 comp rx=0 tx=0).ready entity=mon.5 client_cookie=6dbf66a0aadc154 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:20.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30c9ffb640 1 -- 172.21.15.157:0/1702056207 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f30bc0b0070 con 0x7f30cc136500 2024-08-18T21:03:20.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:20.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30c9ffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:03:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30c9ffb640 10 monclient: dump: 2024-08-18T21:03:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:20.185 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30c9ffb640 10 monclient: _finish_auth 0 2024-08-18T21:03:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30c9ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:03:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30c9ffb640 1 -- 172.21.15.157:0/1702056207 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30bc0aa810 con 0x7f30cc136500 2024-08-18T21:03:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30c9ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30c9ffb640 1 -- 172.21.15.157:0/1702056207 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f30bc0aae30 con 0x7f30cc136500 2024-08-18T21:03:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:20.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30c9ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:03:20.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30c9ffb640 10 monclient: dump: 2024-08-18T21:03:20.186 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:20.186 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.186 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.186 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.186 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:20.186 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.186 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:20.186 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:20.186 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:20.186 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:20.186 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:20.187 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:20.187 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:20.187 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:20.187 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:20.187 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30d14cf640 5 monclient: authenticate success, global_id 4127 2024-08-18T21:03:20.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30d14cf640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:20.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30d14cf640 4 set_mon_vals no callback set 2024-08-18T21:03:20.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30d14cf640 10 monclient: shutdown 2024-08-18T21:03:20.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30d14cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:20.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30d14cf640 1 -- 172.21.15.157:0/1702056207 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f30cc136500 msgr2=0x7f30cc136940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30d14cf640 1 --2- 172.21.15.157:0/1702056207 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f30cc136500 0x7f30cc136940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009900 tx=0x7f30bc01c420 comp rx=0 tx=0).stop 2024-08-18T21:03:20.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30d14cf640 1 -- 172.21.15.157:0/1702056207 shutdown_connections 2024-08-18T21:03:20.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30d14cf640 1 --2- 172.21.15.157:0/1702056207 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f30cc136500 0x7f30cc136940 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30d14cf640 1 --2- 172.21.15.157:0/1702056207 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f30cc0a4b30 0x7f30cc135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30d14cf640 1 --2- 172.21.15.157:0/1702056207 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f30cc0a4210 0x7f30cc0a45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30d14cf640 1 -- 172.21.15.157:0/1702056207 >> 172.21.15.157:0/1702056207 conn(0x7f30cc0a8e00 msgr2=0x7f30cc0a5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:20.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30d14cf640 1 -- 172.21.15.157:0/1702056207 shutdown_connections 2024-08-18T21:03:20.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30d14cf640 1 -- 172.21.15.157:0/1702056207 wait complete. 2024-08-18T21:03:20.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30d14cf640 10 monclient: build_initial_monmap 2024-08-18T21:03:20.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.176+0000 7f30d14cf640 10 monclient: monmap: 2024-08-18T21:03:20.188 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 0 2024-08-18T21:03:20.188 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:20.188 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 0.000000 2024-08-18T21:03:20.189 INFO:teuthology.orchestra.run.smithi157.stderr:created 0.000000 2024-08-18T21:03:20.189 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:20.189 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.189 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:20.189 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:20.189 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:20.189 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:20.189 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:20.189 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:20.189 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:20.189 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:20.189 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:20.189 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 1 Processor -- start 2024-08-18T21:03:20.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 1 -- start start 2024-08-18T21:03:20.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 10 monclient: init 2024-08-18T21:03:20.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:20.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 10 monclient: _add_conns ranks=[5,1,3,8,7,2,6,0,4] 2024-08-18T21:03:20.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f30cc0a4210 0x7f30cc12d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 10 monclient(hunting): picked mon.noname-h con 0x7f30cc0a4210 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:20.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30cc0a4b30 0x7f30cc12d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 10 monclient(hunting): picked mon.noname-f con 0x7f30cc0a4b30 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:20.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30cc136500 0x7f30cc09ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 10 monclient(hunting): picked mon.noname-g con 0x7f30cc136500 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:20.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc070430 con 0x7f30cc0a4b30 2024-08-18T21:03:20.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f30cc0723a0 con 0x7f30cc136500 2024-08-18T21:03:20.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f30cc131330 con 0x7f30cc0a4210 2024-08-18T21:03:20.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:20.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 10 monclient(hunting): authenticate will time out at 948.884937s 2024-08-18T21:03:20.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30caffd640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f30cc0a4210 0x7f30cc12d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30ca7fc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30cc0a4b30 0x7f30cc12d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30caffd640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f30cc0a4210 0x7f30cc12d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.157:58078/0 (socket says 172.21.15.157:58078) 2024-08-18T21:03:20.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30cc136500 0x7f30cc09ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30caffd640 1 -- 172.21.15.157:0/2947706118 learned_addr learned my addr 172.21.15.157:0/2947706118 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-18T21:03:20.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30ca7fc640 10 monclient(hunting): get_auth_request con 0x7f30cc0a4b30 auth_method 0 2024-08-18T21:03:20.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30ca7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30ca7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30ca7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30caffd640 10 monclient(hunting): get_auth_request con 0x7f30cc0a4210 auth_method 0 2024-08-18T21:03:20.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30caffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30caffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 10 monclient(hunting): get_auth_request con 0x7f30cc136500 auth_method 0 2024-08-18T21:03:20.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30ca7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:20.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30ca7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:20.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30ca7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:20.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:20.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:20.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:20.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 10 monclient(hunting): handle_auth_done global_id 4116 payload 824 2024-08-18T21:03:20.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 1 -- 172.21.15.157:0/2947706118 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f30cc0a4210 msgr2=0x7f30cc12d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 1 --2- 172.21.15.157:0/2947706118 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f30cc0a4210 0x7f30cc12d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 1 -- 172.21.15.157:0/2947706118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30cc0a4b30 msgr2=0x7f30cc12d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 1 --2- 172.21.15.157:0/2947706118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30cc0a4b30 0x7f30cc12d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:20.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 1 monclient: found mon.noname-g 2024-08-18T21:03:20.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:20.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:03:20.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 1 -- 172.21.15.157:0/2947706118 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30cc0a25c0 con 0x7f30cc136500 2024-08-18T21:03:20.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30ca7fc640 1 --2- 172.21.15.157:0/2947706118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30cc0a4b30 0x7f30cc12d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:20.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 1 -- 172.21.15.157:0/2947706118 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30cc136500 msgr2=0x7f30cc09ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:20.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30cb7fe640 1 --2- 172.21.15.157:0/2947706118 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30cc136500 0x7f30cc09ece0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0ad000 tx=0x7f30bc0191c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:20.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30b37fe640 1 -- 172.21.15.157:0/2947706118 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f30bc0b0040 con 0x7f30cc136500 2024-08-18T21:03:20.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:20.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30b37fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:03:20.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30b37fe640 10 monclient: dump: 2024-08-18T21:03:20.195 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:20.195 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.195 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.195 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.196 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:20.196 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.196 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:20.196 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:20.196 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:20.196 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:20.196 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:20.196 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:20.196 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:20.196 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:20.196 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:20.196 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30b37fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:20.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30b37fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:20.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:20.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30b37fe640 1 -- 172.21.15.157:0/2947706118 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30bc0ba070 con 0x7f30cc136500 2024-08-18T21:03:20.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30b37fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:20.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30b37fe640 1 -- 172.21.15.157:0/2947706118 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f30bc0044b0 con 0x7f30cc136500 2024-08-18T21:03:20.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 5 monclient: authenticate success, global_id 4116 2024-08-18T21:03:20.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 10 monclient: _renew_subs 2024-08-18T21:03:20.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30d14cf640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.157:3301/0 2024-08-18T21:03:20.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.184+0000 7f30d14cf640 1 -- 172.21.15.157:0/2947706118 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30cc0a0540 con 0x7f30cc136500 2024-08-18T21:03:20.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.180+0000 7f30c97fa640 4 set_mon_vals no callback set 2024-08-18T21:03:20.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.184+0000 7f30b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:20.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.184+0000 7f30b37fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:03:20.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.184+0000 7f30b37fe640 10 monclient: dump: 2024-08-18T21:03:20.198 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:20.198 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.198 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.198 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.198 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:20.198 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.198 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:20.198 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:20.198 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:20.198 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:20.198 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:20.198 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:20.198 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:20.199 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:20.199 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:20.199 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.184+0000 7f30d14cf640 10 monclient: _renew_subs 2024-08-18T21:03:20.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.184+0000 7f30d14cf640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.157:3301/0 2024-08-18T21:03:20.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.184+0000 7f30d14cf640 1 -- 172.21.15.157:0/2947706118 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f30cc0a10a0 con 0x7f30cc136500 2024-08-18T21:03:20.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.184+0000 7f30b37fe640 1 -- 172.21.15.157:0/2947706118 <== mon.3 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f30bc003620 con 0x7f30cc136500 2024-08-18T21:03:20.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.184+0000 7f30b37fe640 1 -- 172.21.15.157:0/2947706118 <== mon.3 v2:172.21.15.157:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f30bc0b57c0 con 0x7f30cc136500 2024-08-18T21:03:20.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.184+0000 7f30d14cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:20.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.184+0000 7f30d14cf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:20.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.184+0000 7f30d14cf640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.157:3301/0 2024-08-18T21:03:20.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.184+0000 7f30d14cf640 1 -- 172.21.15.157:0/2947706118 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30cc073d70 con 0x7f30cc136500 2024-08-18T21:03:20.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.184+0000 7f30b37fe640 1 -- 172.21.15.157:0/2947706118 <== mon.3 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f30cc073d70 con 0x7f30cc136500 2024-08-18T21:03:20.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.184+0000 7f30b37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:20.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.184+0000 7f30b37fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:20.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.256+0000 7f30d14cf640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "99984157-5771-44d0-b5fa-c3e5b2537e67", "id": 1}] 2024-08-18T21:03:20.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.256+0000 7f30d14cf640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "99984157-5771-44d0-b5fa-c3e5b2537e67", "id": 1}] 2024-08-18T21:03:20.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.256+0000 7f30d14cf640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.157:3301/0 2024-08-18T21:03:20.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.256+0000 7f30d14cf640 1 -- 172.21.15.157:0/2947706118 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "99984157-5771-44d0-b5fa-c3e5b2537e67", "id": 1} v 0) -- 0x7f30cc0a4f10 con 0x7f30cc136500 2024-08-18T21:03:20.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.264+0000 7f30b37fe640 1 -- 172.21.15.157:0/2947706118 <== mon.3 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "99984157-5771-44d0-b5fa-c3e5b2537e67", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f30bc0c3020 con 0x7f30cc136500 2024-08-18T21:03:20.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.264+0000 7f30b37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "99984157-5771-44d0-b5fa-c3e5b2537e67", "id": 1}] 2024-08-18T21:03:20.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.264+0000 7f30b37fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:20.265 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-08-18T21:03:20.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.264+0000 7f30d14cf640 10 monclient: shutdown 2024-08-18T21:03:20.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.264+0000 7f30d14cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:20.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.264+0000 7f30d14cf640 1 -- 172.21.15.157:0/2947706118 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30cc136500 msgr2=0x7f30cc09ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.264+0000 7f30d14cf640 1 --2- 172.21.15.157:0/2947706118 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30cc136500 0x7f30cc09ece0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0ad000 tx=0x7f30bc0191c0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.264+0000 7f30d14cf640 1 -- 172.21.15.157:0/2947706118 shutdown_connections 2024-08-18T21:03:20.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.264+0000 7f30d14cf640 1 --2- 172.21.15.157:0/2947706118 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30cc136500 0x7f30cc09ece0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.264+0000 7f30d14cf640 1 --2- 172.21.15.157:0/2947706118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30cc0a4b30 0x7f30cc12d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.264+0000 7f30d14cf640 1 --2- 172.21.15.157:0/2947706118 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f30cc0a4210 0x7f30cc12d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.264+0000 7f30d14cf640 1 -- 172.21.15.157:0/2947706118 >> 172.21.15.157:0/2947706118 conn(0x7f30cc0a8e00 msgr2=0x7f30cc0a6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:20.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.264+0000 7f30d14cf640 1 -- 172.21.15.157:0/2947706118 shutdown_connections 2024-08-18T21:03:20.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.264+0000 7f30d14cf640 1 -- 172.21.15.157:0/2947706118 wait complete. 2024-08-18T21:03:20.282 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 00fd1d05-f5a1-4d89-8e2c-47a61392f500 2 2024-08-18T21:03:20.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 10 monclient: get_monmap_and_config 2024-08-18T21:03:20.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 10 monclient: build_initial_monmap 2024-08-18T21:03:20.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 10 monclient: monmap: 2024-08-18T21:03:20.394 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 0 2024-08-18T21:03:20.394 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.394 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:03:20.395368+0000 2024-08-18T21:03:20.394 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:03:20.395368+0000 2024-08-18T21:03:20.395 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:20.395 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.395 INFO:teuthology.orchestra.run.smithi157.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:20.395 INFO:teuthology.orchestra.run.smithi157.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:20.395 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:20.395 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:20.395 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:20.395 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:20.395 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:20.396 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:20.396 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:20.396 INFO:teuthology.orchestra.run.smithi157.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:20.396 INFO:teuthology.orchestra.run.smithi157.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:20.396 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 1 Processor -- start 2024-08-18T21:03:20.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 1 -- start start 2024-08-18T21:03:20.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 10 monclient: init 2024-08-18T21:03:20.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:20.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 10 monclient: _add_conns ranks=[4,6,7,2,0,5,3,8,10,9,1] 2024-08-18T21:03:20.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f43680a4960 0x7f43680a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 10 monclient(hunting): picked mon.noname-c con 0x7f43680a4960 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:20.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f43680a5280 0x7f4368138730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 10 monclient(hunting): picked mon.noname-d con 0x7f43680a5280 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:20.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4368138c70 0x7f43681390f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 10 monclient(hunting): picked mon.noname-i con 0x7f4368138c70 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:20.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f436806ccb0 con 0x7f43680a4960 2024-08-18T21:03:20.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f436806ce80 con 0x7f43680a5280 2024-08-18T21:03:20.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f436809da30 con 0x7f4368138c70 2024-08-18T21:03:20.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:20.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436ed15640 10 monclient(hunting): authenticate will time out at 949.099226s 2024-08-18T21:03:20.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4368138c70 0x7f43681390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4368138c70 0x7f43681390f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.157:51080/0 (socket says 172.21.15.157:51080) 2024-08-18T21:03:20.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 1 -- 172.21.15.157:0/3921110778 learned_addr learned my addr 172.21.15.157:0/3921110778 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-18T21:03:20.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 10 monclient(hunting): get_auth_request con 0x7f4368138c70 auth_method 0 2024-08-18T21:03:20.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:20.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:20.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:20.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f4367fff640 1 --2- 172.21.15.157:0/3921110778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f43680a5280 0x7f4368138730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436cab1640 1 --2- 172.21.15.157:0/3921110778 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f43680a4960 0x7f43680a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f4367fff640 10 monclient(hunting): get_auth_request con 0x7f43680a5280 auth_method 0 2024-08-18T21:03:20.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f4367fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f4367fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f4367fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436cab1640 10 monclient(hunting): get_auth_request con 0x7f43680a4960 auth_method 0 2024-08-18T21:03:20.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436cab1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436cab1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436cab1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 10 monclient(hunting): handle_auth_done global_id 4120 payload 274 2024-08-18T21:03:20.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 1 -- 172.21.15.157:0/3921110778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f43680a5280 msgr2=0x7f4368138730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:20.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 1 --2- 172.21.15.157:0/3921110778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f43680a5280 0x7f4368138730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 1 -- 172.21.15.157:0/3921110778 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f43680a4960 msgr2=0x7f43680a4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:20.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 1 --2- 172.21.15.157:0/3921110778 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f43680a4960 0x7f43680a4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 10 monclient: _finish_hunting 0 2024-08-18T21:03:20.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 1 monclient: found mon.noname-i 2024-08-18T21:03:20.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:20.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:03:20.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.392+0000 7f436d2b2640 1 -- 172.21.15.157:0/3921110778 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f436806d090 con 0x7f4368138c70 2024-08-18T21:03:20.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.396+0000 7f436d2b2640 1 -- 172.21.15.157:0/3921110778 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4368138c70 msgr2=0x7f43681390f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:20.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.396+0000 7f436d2b2640 1 --2- 172.21.15.157:0/3921110778 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4368138c70 0x7f43681390f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f43580098d0 tx=0x7f435801c440 comp rx=0 tx=0).ready entity=mon.7 client_cookie=7a1b66705158f384 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:20.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f43677fe640 1 -- 172.21.15.157:0/3921110778 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f43580b0070 con 0x7f4368138c70 2024-08-18T21:03:20.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f43677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:20.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f43677fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:03:20.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f43677fe640 10 monclient: dump: 2024-08-18T21:03:20.409 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:20.409 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.409 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.409 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.409 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:20.409 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.409 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:20.409 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:20.409 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:20.410 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:20.410 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:20.410 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:20.410 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:20.410 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:20.410 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:20.410 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f43677fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:20.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f43677fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:20.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f43677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:20.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f43677fe640 1 -- 172.21.15.157:0/3921110778 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43580aa810 con 0x7f4368138c70 2024-08-18T21:03:20.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 5 monclient: authenticate success, global_id 4120 2024-08-18T21:03:20.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:20.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f43677fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:20.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:20.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 4 set_mon_vals no callback set 2024-08-18T21:03:20.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f43677fe640 1 -- 172.21.15.157:0/3921110778 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f43580a9300 con 0x7f4368138c70 2024-08-18T21:03:20.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f43677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:20.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f43677fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:03:20.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f43677fe640 10 monclient: dump: 2024-08-18T21:03:20.411 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:20.411 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.411 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.412 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.412 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:20.412 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.412 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:20.412 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:20.412 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:20.412 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:20.412 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:20.412 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:20.412 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:20.412 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:20.413 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:20.413 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 10 monclient: shutdown 2024-08-18T21:03:20.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:20.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 -- 172.21.15.157:0/3921110778 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4368138c70 msgr2=0x7f43681390f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 --2- 172.21.15.157:0/3921110778 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4368138c70 0x7f43681390f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f43580098d0 tx=0x7f435801c440 comp rx=0 tx=0).stop 2024-08-18T21:03:20.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 -- 172.21.15.157:0/3921110778 shutdown_connections 2024-08-18T21:03:20.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 --2- 172.21.15.157:0/3921110778 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4368138c70 0x7f43681390f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 --2- 172.21.15.157:0/3921110778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f43680a5280 0x7f4368138730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 --2- 172.21.15.157:0/3921110778 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f43680a4960 0x7f43680a4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 -- 172.21.15.157:0/3921110778 >> 172.21.15.157:0/3921110778 conn(0x7f43680a6440 msgr2=0x7f4368068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:20.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 -- 172.21.15.157:0/3921110778 shutdown_connections 2024-08-18T21:03:20.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 -- 172.21.15.157:0/3921110778 wait complete. 2024-08-18T21:03:20.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 10 monclient: build_initial_monmap 2024-08-18T21:03:20.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 10 monclient: monmap: 2024-08-18T21:03:20.414 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 0 2024-08-18T21:03:20.414 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:20.414 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 0.000000 2024-08-18T21:03:20.414 INFO:teuthology.orchestra.run.smithi157.stderr:created 0.000000 2024-08-18T21:03:20.414 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:20.414 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.414 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:20.414 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:20.414 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:20.414 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:20.414 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:20.415 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:20.415 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:20.415 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:20.415 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:20.415 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 Processor -- start 2024-08-18T21:03:20.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 -- start start 2024-08-18T21:03:20.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 10 monclient: init 2024-08-18T21:03:20.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:20.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 10 monclient: _add_conns ranks=[0,1,3,5,6,8,2,4,7] 2024-08-18T21:03:20.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43680a4960 0x7f4368137230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 10 monclient(hunting): picked mon.noname-a con 0x7f43680a4960 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:20.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43680a5280 0x7f4368137770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 10 monclient(hunting): picked mon.noname-f con 0x7f43680a5280 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:20.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4368138c70 0x7f436811f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 10 monclient(hunting): picked mon.noname-g con 0x7f4368138c70 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:20.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f436809f290 con 0x7f43680a4960 2024-08-18T21:03:20.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f436809f110 con 0x7f43680a5280 2024-08-18T21:03:20.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4368143580 con 0x7f4368138c70 2024-08-18T21:03:20.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:20.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436ed15640 10 monclient(hunting): authenticate will time out at 949.106516s 2024-08-18T21:03:20.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43680a5280 0x7f4368137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436d2b2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4368138c70 0x7f436811f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436d2b2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4368138c70 0x7f436811f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:39708/0 (socket says 172.21.15.157:39708) 2024-08-18T21:03:20.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436d2b2640 1 -- 172.21.15.157:0/942804538 learned_addr learned my addr 172.21.15.157:0/942804538 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-18T21:03:20.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436d2b2640 10 monclient(hunting): get_auth_request con 0x7f4368138c70 auth_method 0 2024-08-18T21:03:20.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436d2b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436d2b2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436d2b2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 10 monclient(hunting): get_auth_request con 0x7f43680a5280 auth_method 0 2024-08-18T21:03:20.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436d2b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:20.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436d2b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:20.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436d2b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:20.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:20.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:20.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:20.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436cab1640 1 --2- 172.21.15.157:0/942804538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43680a4960 0x7f4368137230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436cab1640 10 monclient(hunting): get_auth_request con 0x7f43680a4960 auth_method 0 2024-08-18T21:03:20.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436cab1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436cab1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436cab1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 10 monclient(hunting): handle_auth_done global_id 4123 payload 824 2024-08-18T21:03:20.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 1 -- 172.21.15.157:0/942804538 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4368138c70 msgr2=0x7f436811f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 1 --2- 172.21.15.157:0/942804538 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4368138c70 0x7f436811f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 1 -- 172.21.15.157:0/942804538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43680a4960 msgr2=0x7f4368137230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 1 --2- 172.21.15.157:0/942804538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43680a4960 0x7f4368137230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 10 monclient: _finish_hunting 0 2024-08-18T21:03:20.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 1 monclient: found mon.noname-f 2024-08-18T21:03:20.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:20.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:03:20.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f4367fff640 1 -- 172.21.15.157:0/942804538 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4368068800 con 0x7f43680a5280 2024-08-18T21:03:20.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.400+0000 7f436d2b2640 1 --2- 172.21.15.157:0/942804538 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4368138c70 0x7f436811f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:20.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f4367fff640 1 -- 172.21.15.157:0/942804538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43680a5280 msgr2=0x7f4368137770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:20.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f4367fff640 1 --2- 172.21.15.157:0/942804538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43680a5280 0x7f4368137770 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f435c00d5a0 tx=0x7f435c00da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:20.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f43657fa640 1 -- 172.21.15.157:0/942804538 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f435c019070 con 0x7f43680a5280 2024-08-18T21:03:20.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f43657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:20.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f43657fa640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:03:20.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f43657fa640 10 monclient: dump: 2024-08-18T21:03:20.421 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:20.421 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.421 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.421 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.421 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:20.421 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.421 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:20.421 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:20.421 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:20.421 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:20.421 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:20.421 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:20.422 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:20.422 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:20.422 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:20.422 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f43657fa640 10 monclient: _finish_auth 0 2024-08-18T21:03:20.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f43657fa640 10 monclient: _check_auth_tickets 2024-08-18T21:03:20.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f43657fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:20.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f43657fa640 1 -- 172.21.15.157:0/942804538 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f435c004450 con 0x7f43680a5280 2024-08-18T21:03:20.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f43657fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:20.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f43657fa640 1 -- 172.21.15.157:0/942804538 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f435c012420 con 0x7f43680a5280 2024-08-18T21:03:20.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f436ed15640 5 monclient: authenticate success, global_id 4123 2024-08-18T21:03:20.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f436ed15640 10 monclient: _renew_subs 2024-08-18T21:03:20.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f436ed15640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:03:20.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f436ed15640 1 -- 172.21.15.157:0/942804538 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43680a8b00 con 0x7f43680a5280 2024-08-18T21:03:20.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f43657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:20.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f43657fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:03:20.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f4366ffd640 4 set_mon_vals no callback set 2024-08-18T21:03:20.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f43657fa640 10 monclient: dump: 2024-08-18T21:03:20.423 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:20.423 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.423 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.423 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.423 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:20.423 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.423 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:20.424 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:20.424 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:20.424 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:20.424 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:20.424 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:20.424 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:20.424 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:20.424 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:20.424 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f436ed15640 10 monclient: _renew_subs 2024-08-18T21:03:20.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f436ed15640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:03:20.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f436ed15640 1 -- 172.21.15.157:0/942804538 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4368122c60 con 0x7f43680a5280 2024-08-18T21:03:20.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f43657fa640 1 -- 172.21.15.157:0/942804538 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f435c012680 con 0x7f43680a5280 2024-08-18T21:03:20.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f43657fa640 1 -- 172.21.15.157:0/942804538 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f435c00f040 con 0x7f43680a5280 2024-08-18T21:03:20.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f436ed15640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:20.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f436ed15640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:20.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f436ed15640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:03:20.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.404+0000 7f436ed15640 1 -- 172.21.15.157:0/942804538 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f436813fd40 con 0x7f43680a5280 2024-08-18T21:03:20.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.416+0000 7f43657fa640 1 -- 172.21.15.157:0/942804538 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f435c022070 con 0x7f43680a5280 2024-08-18T21:03:20.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.420+0000 7f43657fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:20.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.420+0000 7f43657fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:20.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.500+0000 7f436ed15640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "00fd1d05-f5a1-4d89-8e2c-47a61392f500", "id": 2}] 2024-08-18T21:03:20.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.500+0000 7f436ed15640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "00fd1d05-f5a1-4d89-8e2c-47a61392f500", "id": 2}] 2024-08-18T21:03:20.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.500+0000 7f436ed15640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:03:20.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.500+0000 7f436ed15640 1 -- 172.21.15.157:0/942804538 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00fd1d05-f5a1-4d89-8e2c-47a61392f500", "id": 2} v 0) -- 0x7f4368138730 con 0x7f43680a5280 2024-08-18T21:03:20.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.504+0000 7f43657fa640 1 -- 172.21.15.157:0/942804538 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00fd1d05-f5a1-4d89-8e2c-47a61392f500", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f435c012ba0 con 0x7f43680a5280 2024-08-18T21:03:20.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.504+0000 7f43657fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "00fd1d05-f5a1-4d89-8e2c-47a61392f500", "id": 2}] 2024-08-18T21:03:20.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.504+0000 7f43657fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:20.507 INFO:teuthology.orchestra.run.smithi157.stdout:2 2024-08-18T21:03:20.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.504+0000 7f436ed15640 10 monclient: shutdown 2024-08-18T21:03:20.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.504+0000 7f436ed15640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:20.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.504+0000 7f436ed15640 1 -- 172.21.15.157:0/942804538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43680a5280 msgr2=0x7f4368137770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.504+0000 7f436ed15640 1 --2- 172.21.15.157:0/942804538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43680a5280 0x7f4368137770 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f435c00d5a0 tx=0x7f435c00da60 comp rx=0 tx=0).stop 2024-08-18T21:03:20.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.504+0000 7f436ed15640 1 -- 172.21.15.157:0/942804538 shutdown_connections 2024-08-18T21:03:20.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.504+0000 7f436ed15640 1 --2- 172.21.15.157:0/942804538 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4368138c70 0x7f436811f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.504+0000 7f436ed15640 1 --2- 172.21.15.157:0/942804538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43680a5280 0x7f4368137770 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f435c00d5a0 tx=0x7f435c00da60 comp rx=0 tx=0).stop 2024-08-18T21:03:20.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.504+0000 7f436ed15640 1 --2- 172.21.15.157:0/942804538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43680a4960 0x7f4368137230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.504+0000 7f436ed15640 1 -- 172.21.15.157:0/942804538 >> 172.21.15.157:0/942804538 conn(0x7f43680a6440 msgr2=0x7f436813ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:20.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.504+0000 7f436ed15640 1 -- 172.21.15.157:0/942804538 shutdown_connections 2024-08-18T21:03:20.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.504+0000 7f436ed15640 1 -- 172.21.15.157:0/942804538 wait complete. 2024-08-18T21:03:20.524 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 8bb1ba33-9e75-43ee-bbfc-7ab22350e4a5 3 2024-08-18T21:03:20.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 10 monclient: get_monmap_and_config 2024-08-18T21:03:20.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 10 monclient: build_initial_monmap 2024-08-18T21:03:20.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 10 monclient: monmap: 2024-08-18T21:03:20.642 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 0 2024-08-18T21:03:20.642 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.642 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:03:20.643210+0000 2024-08-18T21:03:20.643 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:03:20.643210+0000 2024-08-18T21:03:20.643 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:20.643 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.643 INFO:teuthology.orchestra.run.smithi157.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:20.643 INFO:teuthology.orchestra.run.smithi157.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:20.643 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:20.643 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:20.643 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:20.643 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:20.643 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:20.644 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:20.644 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:20.644 INFO:teuthology.orchestra.run.smithi157.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:20.644 INFO:teuthology.orchestra.run.smithi157.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:20.644 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 1 Processor -- start 2024-08-18T21:03:20.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 1 -- start start 2024-08-18T21:03:20.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 10 monclient: init 2024-08-18T21:03:20.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:20.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 10 monclient: _add_conns ranks=[2,5,1,3,7,6,4,10,0,9,8] 2024-08-18T21:03:20.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5af009da30 0x7f5af009de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 10 monclient(hunting): picked mon.noname-b con 0x7f5af009da30 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:20.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5af00a03e0 0x7f5af009e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 10 monclient(hunting): picked mon.noname-h con 0x7f5af00a03e0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:20.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f5af00a3110 addr v1:172.21.15.157:6789/0 2024-08-18T21:03:20.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af009f7c0 con 0x7f5af00a3110 2024-08-18T21:03:20.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f5af009e890 con 0x7f5af009da30 2024-08-18T21:03:20.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f5af009f4e0 con 0x7f5af00a03e0 2024-08-18T21:03:20.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:20.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5af5cfb640 10 monclient(hunting): authenticate will time out at 949.347128s 2024-08-18T21:03:20.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5af00a03e0 0x7f5af009e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeffff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5af00a3110 0x7f5af01366a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:34786/0 (socket says 172.21.15.157:34786) 2024-08-18T21:03:20.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeffff640 1 -- 172.21.15.157:0/250868135 learned_addr learned my addr 172.21.15.157:0/250868135 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-08-18T21:03:20.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 10 monclient(hunting): get_auth_request con 0x7f5af00a03e0 auth_method 0 2024-08-18T21:03:20.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:20.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:20.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:20.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aef7fe640 1 --2- 172.21.15.157:0/250868135 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5af009da30 0x7f5af009de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aef7fe640 10 monclient(hunting): get_auth_request con 0x7f5af009da30 auth_method 0 2024-08-18T21:03:20.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 10 monclient(hunting): handle_auth_done global_id 4145 payload 274 2024-08-18T21:03:20.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 1 -- 172.21.15.157:0/250868135 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5af009da30 msgr2=0x7f5af009de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:20.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 1 --2- 172.21.15.157:0/250868135 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5af009da30 0x7f5af009de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 1 -- 172.21.15.157:0/250868135 >> v1:172.21.15.157:6789/0 conn(0x7f5af00a3110 legacy=0x7f5af01366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:20.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 10 monclient: _finish_hunting 0 2024-08-18T21:03:20.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 1 monclient: found mon.noname-h 2024-08-18T21:03:20.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:20.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:03:20.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.640+0000 7f5aeeffd640 1 -- 172.21.15.157:0/250868135 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af009faa0 con 0x7f5af00a03e0 2024-08-18T21:03:20.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.644+0000 7f5aeeffd640 1 -- 172.21.15.157:0/250868135 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5af00a03e0 msgr2=0x7f5af009e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:20.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.644+0000 7f5aeeffd640 1 --2- 172.21.15.157:0/250868135 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5af00a03e0 0x7f5af009e350 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80097f0 tx=0x7f5ad801cbf0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=2829937d627e8746 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:20.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.644+0000 7f5aee7fc640 1 -- 172.21.15.157:0/250868135 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5ad80b0070 con 0x7f5af00a03e0 2024-08-18T21:03:20.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.644+0000 7f5aee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:20.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.644+0000 7f5aee7fc640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:03:20.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.644+0000 7f5aee7fc640 10 monclient: dump: 2024-08-18T21:03:20.656 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:20.656 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.656 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.656 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.656 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:20.657 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.657 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:20.657 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:20.657 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:20.657 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:20.657 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:20.657 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:20.657 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:20.657 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:20.657 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:20.657 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.644+0000 7f5aee7fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:20.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.644+0000 7f5aee7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:20.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.644+0000 7f5aee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:20.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.644+0000 7f5aee7fc640 1 -- 172.21.15.157:0/250868135 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad80aa810 con 0x7f5af00a03e0 2024-08-18T21:03:20.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aee7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:20.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aee7fc640 1 -- 172.21.15.157:0/250868135 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5ad80aae30 con 0x7f5af00a03e0 2024-08-18T21:03:20.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 5 monclient: authenticate success, global_id 4145 2024-08-18T21:03:20.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:20.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 4 set_mon_vals no callback set 2024-08-18T21:03:20.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:20.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aee7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:03:20.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aee7fc640 10 monclient: dump: 2024-08-18T21:03:20.658 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:20.658 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.658 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.659 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.659 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:20.659 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.659 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:20.659 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:20.659 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:20.659 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:20.659 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:20.659 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:20.659 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:20.659 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:20.659 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:20.660 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 10 monclient: shutdown 2024-08-18T21:03:20.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:20.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 1 -- 172.21.15.157:0/250868135 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5af00a03e0 msgr2=0x7f5af009e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 1 --2- 172.21.15.157:0/250868135 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5af00a03e0 0x7f5af009e350 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80097f0 tx=0x7f5ad801cbf0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 1 -- 172.21.15.157:0/250868135 shutdown_connections 2024-08-18T21:03:20.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 1 --2- 172.21.15.157:0/250868135 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5af00a03e0 0x7f5af009e350 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 1 --2- 172.21.15.157:0/250868135 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5af009da30 0x7f5af009de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 1 -- 172.21.15.157:0/250868135 >> 172.21.15.157:0/250868135 conn(0x7f5af00688d0 msgr2=0x7f5af0068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:20.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 1 -- 172.21.15.157:0/250868135 shutdown_connections 2024-08-18T21:03:20.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 1 -- 172.21.15.157:0/250868135 wait complete. 2024-08-18T21:03:20.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 10 monclient: build_initial_monmap 2024-08-18T21:03:20.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 10 monclient: monmap: 2024-08-18T21:03:20.661 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 0 2024-08-18T21:03:20.661 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:20.661 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 0.000000 2024-08-18T21:03:20.661 INFO:teuthology.orchestra.run.smithi157.stderr:created 0.000000 2024-08-18T21:03:20.661 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:20.661 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.661 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:20.661 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:20.661 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:20.661 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:20.661 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:20.661 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:20.662 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:20.662 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:20.662 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:20.662 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 1 Processor -- start 2024-08-18T21:03:20.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 1 -- start start 2024-08-18T21:03:20.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 10 monclient: init 2024-08-18T21:03:20.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:20.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 10 monclient: _add_conns ranks=[0,5,3,1,7,8,6,4,2] 2024-08-18T21:03:20.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5af009da30 0x7f5af006c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 10 monclient(hunting): picked mon.noname-a con 0x7f5af009da30 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:20.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5af00a3110 0x7f5af0138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 10 monclient(hunting): picked mon.noname-h con 0x7f5af00a3110 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:20.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5af0138e40 0x7f5af01392c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 10 monclient(hunting): picked mon.noname-g con 0x7f5af0138e40 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:20.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0140ca0 con 0x7f5af009da30 2024-08-18T21:03:20.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5af0140b20 con 0x7f5af0138e40 2024-08-18T21:03:20.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f5af0140e20 con 0x7f5af00a3110 2024-08-18T21:03:20.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:20.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5af5cfb640 10 monclient(hunting): authenticate will time out at 949.354426s 2024-08-18T21:03:20.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5af00a3110 0x7f5af0138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5af00a3110 0x7f5af0138900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.157:58104/0 (socket says 172.21.15.157:58104) 2024-08-18T21:03:20.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 1 -- 172.21.15.157:0/375152923 learned_addr learned my addr 172.21.15.157:0/375152923 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-18T21:03:20.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 10 monclient(hunting): get_auth_request con 0x7f5af00a3110 auth_method 0 2024-08-18T21:03:20.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeffff640 1 --2- 172.21.15.157:0/375152923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5af0138e40 0x7f5af01392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeffff640 10 monclient(hunting): get_auth_request con 0x7f5af0138e40 auth_method 0 2024-08-18T21:03:20.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:20.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:20.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:20.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:20.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:20.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:20.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aef7fe640 1 --2- 172.21.15.157:0/375152923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5af009da30 0x7f5af006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aef7fe640 10 monclient(hunting): get_auth_request con 0x7f5af009da30 auth_method 0 2024-08-18T21:03:20.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 10 monclient(hunting): handle_auth_done global_id 4154 payload 824 2024-08-18T21:03:20.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 1 -- 172.21.15.157:0/375152923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5af0138e40 msgr2=0x7f5af01392c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 1 --2- 172.21.15.157:0/375152923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5af0138e40 0x7f5af01392c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 1 -- 172.21.15.157:0/375152923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5af009da30 msgr2=0x7f5af006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 1 --2- 172.21.15.157:0/375152923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5af009da30 0x7f5af006c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 10 monclient: _finish_hunting 0 2024-08-18T21:03:20.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 1 monclient: found mon.noname-h 2024-08-18T21:03:20.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:20.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:03:20.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeeffd640 1 -- 172.21.15.157:0/375152923 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af013e5d0 con 0x7f5af00a3110 2024-08-18T21:03:20.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.648+0000 7f5aeffff640 1 --2- 172.21.15.157:0/375152923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5af0138e40 0x7f5af01392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:20.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5aeeffd640 1 -- 172.21.15.157:0/375152923 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5af00a3110 msgr2=0x7f5af0138900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:20.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5aeeffd640 1 --2- 172.21.15.157:0/375152923 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5af00a3110 0x7f5af0138900 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80097f0 tx=0x7f5ad8018f30 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:20.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5ae7fff640 1 -- 172.21.15.157:0/375152923 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5ad80b0040 con 0x7f5af00a3110 2024-08-18T21:03:20.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5ae7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:20.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5ae7fff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:03:20.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5ae7fff640 10 monclient: dump: 2024-08-18T21:03:20.666 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:20.666 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.666 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.666 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.667 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:20.667 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.667 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:20.667 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:20.667 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:20.667 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:20.667 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:20.667 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:20.667 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:20.667 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:20.667 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:20.667 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5ae7fff640 10 monclient: _finish_auth 0 2024-08-18T21:03:20.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5ae7fff640 10 monclient: _check_auth_tickets 2024-08-18T21:03:20.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5ae7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:20.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5af5cfb640 5 monclient: authenticate success, global_id 4154 2024-08-18T21:03:20.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5ae7fff640 1 -- 172.21.15.157:0/375152923 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad80b9070 con 0x7f5af00a3110 2024-08-18T21:03:20.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5ae7fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:20.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5ae7fff640 1 -- 172.21.15.157:0/375152923 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5ad80044b0 con 0x7f5af00a3110 2024-08-18T21:03:20.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5af5cfb640 10 monclient: _renew_subs 2024-08-18T21:03:20.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5af5cfb640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:03:20.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5af5cfb640 1 -- 172.21.15.157:0/375152923 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af013b620 con 0x7f5af00a3110 2024-08-18T21:03:20.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5aedffb640 4 set_mon_vals no callback set 2024-08-18T21:03:20.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5ae7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:20.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5ae7fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:03:20.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5ae7fff640 10 monclient: dump: 2024-08-18T21:03:20.668 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:20.669 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.669 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.669 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.669 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:20.669 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.669 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:20.669 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:20.669 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:20.669 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:20.669 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:20.669 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:20.669 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:20.669 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:20.669 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:20.670 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5af5cfb640 10 monclient: _renew_subs 2024-08-18T21:03:20.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5af5cfb640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:03:20.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5af5cfb640 1 -- 172.21.15.157:0/375152923 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af00a1d00 con 0x7f5af00a3110 2024-08-18T21:03:20.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5ae7fff640 1 -- 172.21.15.157:0/375152923 <== mon.5 v2:172.21.15.157:3302/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5ad80b3070 con 0x7f5af00a3110 2024-08-18T21:03:20.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5ae7fff640 1 -- 172.21.15.157:0/375152923 <== mon.5 v2:172.21.15.157:3302/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f5ad80be460 con 0x7f5af00a3110 2024-08-18T21:03:20.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5af5cfb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:20.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5af5cfb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:20.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5af5cfb640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:03:20.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.652+0000 7f5af5cfb640 1 -- 172.21.15.157:0/375152923 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af01366a0 con 0x7f5af00a3110 2024-08-18T21:03:20.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.656+0000 7f5ae7fff640 1 -- 172.21.15.157:0/375152923 <== mon.5 v2:172.21.15.157:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5af009f7c0 con 0x7f5af00a3110 2024-08-18T21:03:20.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.656+0000 7f5ae7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:20.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.656+0000 7f5ae7fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:20.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.724+0000 7f5af5cfb640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8bb1ba33-9e75-43ee-bbfc-7ab22350e4a5", "id": 3}] 2024-08-18T21:03:20.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.724+0000 7f5af5cfb640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8bb1ba33-9e75-43ee-bbfc-7ab22350e4a5", "id": 3}] 2024-08-18T21:03:20.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.724+0000 7f5af5cfb640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:03:20.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.724+0000 7f5af5cfb640 1 -- 172.21.15.157:0/375152923 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_command({"prefix": "osd new", "uuid": "8bb1ba33-9e75-43ee-bbfc-7ab22350e4a5", "id": 3} v 0) -- 0x7f5af006d2c0 con 0x7f5af00a3110 2024-08-18T21:03:20.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.732+0000 7f5ae7fff640 1 -- 172.21.15.157:0/375152923 <== mon.5 v2:172.21.15.157:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8bb1ba33-9e75-43ee-bbfc-7ab22350e4a5", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f5ad80aa7e0 con 0x7f5af00a3110 2024-08-18T21:03:20.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.732+0000 7f5ae7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8bb1ba33-9e75-43ee-bbfc-7ab22350e4a5", "id": 3}] 2024-08-18T21:03:20.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.732+0000 7f5ae7fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:20.734 INFO:teuthology.orchestra.run.smithi157.stdout:3 2024-08-18T21:03:20.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.732+0000 7f5af5cfb640 10 monclient: shutdown 2024-08-18T21:03:20.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.732+0000 7f5af5cfb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:20.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.732+0000 7f5af5cfb640 1 -- 172.21.15.157:0/375152923 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5af00a3110 msgr2=0x7f5af0138900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.732+0000 7f5af5cfb640 1 --2- 172.21.15.157:0/375152923 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5af00a3110 0x7f5af0138900 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80097f0 tx=0x7f5ad8018f30 comp rx=0 tx=0).stop 2024-08-18T21:03:20.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.732+0000 7f5af5cfb640 1 -- 172.21.15.157:0/375152923 shutdown_connections 2024-08-18T21:03:20.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.732+0000 7f5af5cfb640 1 --2- 172.21.15.157:0/375152923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5af0138e40 0x7f5af01392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.732+0000 7f5af5cfb640 1 --2- 172.21.15.157:0/375152923 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5af00a3110 0x7f5af0138900 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.732+0000 7f5af5cfb640 1 --2- 172.21.15.157:0/375152923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5af009da30 0x7f5af006c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.732+0000 7f5af5cfb640 1 -- 172.21.15.157:0/375152923 >> 172.21.15.157:0/375152923 conn(0x7f5af00688d0 msgr2=0x7f5af0135890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:20.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.732+0000 7f5af5cfb640 1 -- 172.21.15.157:0/375152923 shutdown_connections 2024-08-18T21:03:20.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.732+0000 7f5af5cfb640 1 -- 172.21.15.157:0/375152923 wait complete. 2024-08-18T21:03:20.749 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new f7043f2f-d6d1-4c40-bf70-80a10071a795 4 2024-08-18T21:03:20.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 10 monclient: get_monmap_and_config 2024-08-18T21:03:20.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 10 monclient: build_initial_monmap 2024-08-18T21:03:20.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 10 monclient: monmap: 2024-08-18T21:03:20.867 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 0 2024-08-18T21:03:20.867 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.868 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:03:20.867511+0000 2024-08-18T21:03:20.868 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:03:20.867511+0000 2024-08-18T21:03:20.868 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:20.868 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.868 INFO:teuthology.orchestra.run.smithi157.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:20.868 INFO:teuthology.orchestra.run.smithi157.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:20.868 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:20.868 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:20.868 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:20.868 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:20.868 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:20.868 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:20.868 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:20.868 INFO:teuthology.orchestra.run.smithi157.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:20.869 INFO:teuthology.orchestra.run.smithi157.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:20.869 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 1 Processor -- start 2024-08-18T21:03:20.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 1 -- start start 2024-08-18T21:03:20.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 10 monclient: init 2024-08-18T21:03:20.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:20.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 10 monclient: _add_conns ranks=[4,8,7,3,9,1,5,0,10,6,2] 2024-08-18T21:03:20.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff2f80a4000 0x7ff2f80a2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 10 monclient(hunting): picked mon.noname-c con 0x7ff2f80a4000 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:20.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff2f80a43e0 0x7ff2f80a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 10 monclient(hunting): picked mon.noname-e con 0x7ff2f80a43e0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:20.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff2f809b080 0x7ff2f809b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 10 monclient(hunting): picked mon.noname-i con 0x7ff2f809b080 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:20.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff2f809fbd0 con 0x7ff2f80a4000 2024-08-18T21:03:20.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7ff2f80a5f60 con 0x7ff2f809b080 2024-08-18T21:03:20.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff2f80a05e0 con 0x7ff2f80a43e0 2024-08-18T21:03:20.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:20.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff30021a640 10 monclient(hunting): authenticate will time out at 949.571436s 2024-08-18T21:03:20.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff2f809b080 0x7ff2f809b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff2f809b080 0x7ff2f809b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.157:51090/0 (socket says 172.21.15.157:51090) 2024-08-18T21:03:20.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 1 -- 172.21.15.157:0/3402541360 learned_addr learned my addr 172.21.15.157:0/3402541360 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-18T21:03:20.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 10 monclient(hunting): get_auth_request con 0x7ff2f809b080 auth_method 0 2024-08-18T21:03:20.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:20.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:20.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:20.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fdfb6640 1 --2- 172.21.15.157:0/3402541360 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff2f80a4000 0x7ff2f80a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fdfb6640 10 monclient(hunting): get_auth_request con 0x7ff2f80a4000 auth_method 0 2024-08-18T21:03:20.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fdfb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fdfb6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fd7b5640 1 --2- 172.21.15.157:0/3402541360 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff2f80a43e0 0x7ff2f80a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fdfb6640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 10 monclient(hunting): handle_auth_done global_id 4129 payload 274 2024-08-18T21:03:20.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 1 -- 172.21.15.157:0/3402541360 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff2f80a43e0 msgr2=0x7ff2f80a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:20.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 1 --2- 172.21.15.157:0/3402541360 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff2f80a43e0 0x7ff2f80a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 1 -- 172.21.15.157:0/3402541360 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff2f80a4000 msgr2=0x7ff2f80a2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:20.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 1 --2- 172.21.15.157:0/3402541360 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff2f80a4000 0x7ff2f80a2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 10 monclient: _finish_hunting 0 2024-08-18T21:03:20.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 1 monclient: found mon.noname-i 2024-08-18T21:03:20.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:20.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:03:20.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fe7b7640 1 -- 172.21.15.157:0/3402541360 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f809fda0 con 0x7ff2f809b080 2024-08-18T21:03:20.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fd7b5640 10 monclient: get_auth_request con 0x7ff2f80a43e0 auth_method 0 2024-08-18T21:03:20.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.864+0000 7ff2fd7b5640 1 --2- 172.21.15.157:0/3402541360 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff2f80a43e0 0x7ff2f80a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:20.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fe7b7640 1 -- 172.21.15.157:0/3402541360 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff2f809b080 msgr2=0x7ff2f809b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:20.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fe7b7640 1 --2- 172.21.15.157:0/3402541360 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff2f809b080 0x7ff2f809b4c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4009e80 tx=0x7ff2f401d370 comp rx=0 tx=0).ready entity=mon.7 client_cookie=a4beb3af351533c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:20.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fcfb4640 1 -- 172.21.15.157:0/3402541360 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff2f40090d0 con 0x7ff2f809b080 2024-08-18T21:03:20.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fcfb4640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:20.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fcfb4640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:03:20.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fcfb4640 10 monclient: dump: 2024-08-18T21:03:20.882 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:20.882 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.882 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.882 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.882 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:20.882 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.883 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:20.883 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:20.883 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:20.883 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:20.883 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:20.883 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:20.883 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:20.883 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:20.883 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:20.883 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fcfb4640 10 monclient: _finish_auth 0 2024-08-18T21:03:20.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fcfb4640 10 monclient: _check_auth_tickets 2024-08-18T21:03:20.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fcfb4640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:20.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fcfb4640 1 -- 172.21.15.157:0/3402541360 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f40a59f0 con 0x7ff2f809b080 2024-08-18T21:03:20.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 5 monclient: authenticate success, global_id 4129 2024-08-18T21:03:20.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:20.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fcfb4640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:20.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fcfb4640 1 -- 172.21.15.157:0/3402541360 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff2f40a5ba0 con 0x7ff2f809b080 2024-08-18T21:03:20.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fcfb4640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:20.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fcfb4640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:03:20.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fcfb4640 10 monclient: dump: 2024-08-18T21:03:20.884 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:20.884 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.884 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.884 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.885 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:20.885 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.885 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:20.885 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:20.885 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:20.885 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:20.885 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:20.885 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:20.885 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:20.885 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:20.885 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:20.885 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:20.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 4 set_mon_vals no callback set 2024-08-18T21:03:20.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 10 monclient: shutdown 2024-08-18T21:03:20.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:20.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 -- 172.21.15.157:0/3402541360 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff2f809b080 msgr2=0x7ff2f809b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 --2- 172.21.15.157:0/3402541360 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff2f809b080 0x7ff2f809b4c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4009e80 tx=0x7ff2f401d370 comp rx=0 tx=0).stop 2024-08-18T21:03:20.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 -- 172.21.15.157:0/3402541360 shutdown_connections 2024-08-18T21:03:20.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 --2- 172.21.15.157:0/3402541360 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff2f809b080 0x7ff2f809b4c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 --2- 172.21.15.157:0/3402541360 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff2f80a43e0 0x7ff2f80a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 --2- 172.21.15.157:0/3402541360 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff2f80a4000 0x7ff2f80a2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 -- 172.21.15.157:0/3402541360 >> 172.21.15.157:0/3402541360 conn(0x7ff2f80a50f0 msgr2=0x7ff2f80a54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:20.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 -- 172.21.15.157:0/3402541360 shutdown_connections 2024-08-18T21:03:20.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 -- 172.21.15.157:0/3402541360 wait complete. 2024-08-18T21:03:20.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 10 monclient: build_initial_monmap 2024-08-18T21:03:20.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 10 monclient: monmap: 2024-08-18T21:03:20.887 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 0 2024-08-18T21:03:20.887 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:20.887 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 0.000000 2024-08-18T21:03:20.887 INFO:teuthology.orchestra.run.smithi157.stderr:created 0.000000 2024-08-18T21:03:20.887 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:20.888 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.888 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:20.888 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:20.888 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:20.888 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:20.888 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:20.888 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:20.888 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:20.888 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:20.888 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:20.889 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 Processor -- start 2024-08-18T21:03:20.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 -- start start 2024-08-18T21:03:20.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 10 monclient: init 2024-08-18T21:03:20.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:20.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 10 monclient: _add_conns ranks=[4,0,8,2,3,1,5,6,7] 2024-08-18T21:03:20.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff2f809b080 0x7ff2f809a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 10 monclient(hunting): picked mon.noname-c con 0x7ff2f809b080 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:20.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f80a4000 0x7ff2f809a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 10 monclient(hunting): picked mon.noname-a con 0x7ff2f80a4000 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:20.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff2f80a43e0 0x7ff2f809aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:20.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 10 monclient(hunting): picked mon.noname-e con 0x7ff2f80a43e0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:20.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f80a2820 con 0x7ff2f80a4000 2024-08-18T21:03:20.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff2f80a26a0 con 0x7ff2f809b080 2024-08-18T21:03:20.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:20.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff2f813f150 con 0x7ff2f80a43e0 2024-08-18T21:03:20.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:20.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff30021a640 10 monclient(hunting): authenticate will time out at 949.578681s 2024-08-18T21:03:20.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f80a4000 0x7ff2f809a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fdfb6640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff2f809b080 0x7ff2f809a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fe7b7640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff2f80a43e0 0x7ff2f809aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:20.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fdfb6640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff2f809b080 0x7ff2f809a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.157:41800/0 (socket says 172.21.15.157:41800) 2024-08-18T21:03:20.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f80a4000 0x7ff2f809a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.157:56406/0 (socket says 172.21.15.157:56406) 2024-08-18T21:03:20.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fdfb6640 1 -- 172.21.15.157:0/2776842395 learned_addr learned my addr 172.21.15.157:0/2776842395 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-18T21:03:20.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fdfb6640 10 monclient(hunting): get_auth_request con 0x7ff2f809b080 auth_method 0 2024-08-18T21:03:20.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fdfb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fdfb6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fdfb6640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 10 monclient(hunting): get_auth_request con 0x7ff2f80a4000 auth_method 0 2024-08-18T21:03:20.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fe7b7640 10 monclient(hunting): get_auth_request con 0x7ff2f80a43e0 auth_method 0 2024-08-18T21:03:20.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fe7b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:20.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fe7b7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:20.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fe7b7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:20.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:20.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:20.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:20.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fdfb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:20.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fdfb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:20.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fdfb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:20.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fe7b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:20.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fe7b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:20.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fe7b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:20.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 10 monclient(hunting): handle_auth_done global_id 4140 payload 824 2024-08-18T21:03:20.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 1 -- 172.21.15.157:0/2776842395 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff2f80a43e0 msgr2=0x7ff2f809aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 1 --2- 172.21.15.157:0/2776842395 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff2f80a43e0 0x7ff2f809aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 1 -- 172.21.15.157:0/2776842395 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff2f809b080 msgr2=0x7ff2f809a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 1 --2- 172.21.15.157:0/2776842395 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff2f809b080 0x7ff2f809a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 10 monclient: _finish_hunting 0 2024-08-18T21:03:20.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 1 monclient: found mon.noname-a 2024-08-18T21:03:20.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:20.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:20.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.872+0000 7ff2fd7b5640 1 -- 172.21.15.157:0/2776842395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f813aaa0 con 0x7ff2f80a4000 2024-08-18T21:03:20.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2fd7b5640 1 -- 172.21.15.157:0/2776842395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f80a4000 msgr2=0x7ff2f809a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:20.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2fd7b5640 1 --2- 172.21.15.157:0/2776842395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f80a4000 0x7ff2f809a5b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800c780 tx=0x7ff2e800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:20.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2ee7fc640 1 -- 172.21.15.157:0/2776842395 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff2e8005bb0 con 0x7ff2f80a4000 2024-08-18T21:03:20.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:20.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2ee7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:20.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2ee7fc640 10 monclient: dump: 2024-08-18T21:03:20.894 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:20.894 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.894 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.894 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.895 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:20.895 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.895 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:20.895 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:20.895 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:20.895 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:20.895 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:20.895 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:20.895 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:20.895 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:20.895 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:20.895 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2ee7fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:20.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2ee7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:20.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:20.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff30021a640 5 monclient: authenticate success, global_id 4140 2024-08-18T21:03:20.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff30021a640 10 monclient: _renew_subs 2024-08-18T21:03:20.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff30021a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:20.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff30021a640 1 -- 172.21.15.157:0/2776842395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f813ad80 con 0x7ff2f80a4000 2024-08-18T21:03:20.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2ee7fc640 1 -- 172.21.15.157:0/2776842395 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e8017070 con 0x7ff2f80a4000 2024-08-18T21:03:20.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2ee7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:20.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff30021a640 10 monclient: _renew_subs 2024-08-18T21:03:20.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff30021a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:20.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2effff640 4 set_mon_vals no callback set 2024-08-18T21:03:20.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff30021a640 1 -- 172.21.15.157:0/2776842395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f809e700 con 0x7ff2f80a4000 2024-08-18T21:03:20.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2ee7fc640 1 -- 172.21.15.157:0/2776842395 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff2e8005d50 con 0x7ff2f80a4000 2024-08-18T21:03:20.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:20.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2ee7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:20.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2ee7fc640 10 monclient: dump: 2024-08-18T21:03:20.897 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:20.897 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:20.897 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.897 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:20.897 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:20.898 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:20.898 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:20.898 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:20.898 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:20.898 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:20.898 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:20.898 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:20.898 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:20.898 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:20.898 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:20.898 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:20.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2ee7fc640 1 -- 172.21.15.157:0/2776842395 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff2e800a640 con 0x7ff2f80a4000 2024-08-18T21:03:20.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff2ee7fc640 1 -- 172.21.15.157:0/2776842395 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ff2e8006030 con 0x7ff2f80a4000 2024-08-18T21:03:20.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff30021a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:20.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff30021a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:20.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff30021a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:20.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.876+0000 7ff30021a640 1 -- 172.21.15.157:0/2776842395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f80a2160 con 0x7ff2f80a4000 2024-08-18T21:03:20.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.884+0000 7ff2ee7fc640 1 -- 172.21.15.157:0/2776842395 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff2e8006580 con 0x7ff2f80a4000 2024-08-18T21:03:20.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.884+0000 7ff2ee7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:20.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.884+0000 7ff2ee7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:20.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.956+0000 7ff30021a640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "f7043f2f-d6d1-4c40-bf70-80a10071a795", "id": 4}] 2024-08-18T21:03:20.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.956+0000 7ff30021a640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "f7043f2f-d6d1-4c40-bf70-80a10071a795", "id": 4}] 2024-08-18T21:03:20.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.956+0000 7ff30021a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:20.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.956+0000 7ff30021a640 1 -- 172.21.15.157:0/2776842395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f7043f2f-d6d1-4c40-bf70-80a10071a795", "id": 4} v 0) -- 0x7ff2f81393e0 con 0x7ff2f80a4000 2024-08-18T21:03:20.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.960+0000 7ff2ee7fc640 1 -- 172.21.15.157:0/2776842395 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f7043f2f-d6d1-4c40-bf70-80a10071a795", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7ff2e8006760 con 0x7ff2f80a4000 2024-08-18T21:03:20.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.960+0000 7ff2ee7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "f7043f2f-d6d1-4c40-bf70-80a10071a795", "id": 4}] 2024-08-18T21:03:20.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.960+0000 7ff2ee7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:20.962 INFO:teuthology.orchestra.run.smithi157.stdout:4 2024-08-18T21:03:20.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.960+0000 7ff30021a640 10 monclient: shutdown 2024-08-18T21:03:20.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.960+0000 7ff30021a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:20.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.960+0000 7ff30021a640 1 -- 172.21.15.157:0/2776842395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f80a4000 msgr2=0x7ff2f809a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:20.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.960+0000 7ff30021a640 1 --2- 172.21.15.157:0/2776842395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f80a4000 0x7ff2f809a5b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800c780 tx=0x7ff2e800cc40 comp rx=0 tx=0).stop 2024-08-18T21:03:20.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.960+0000 7ff30021a640 1 -- 172.21.15.157:0/2776842395 shutdown_connections 2024-08-18T21:03:20.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.960+0000 7ff30021a640 1 --2- 172.21.15.157:0/2776842395 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff2f80a43e0 0x7ff2f809aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.960+0000 7ff30021a640 1 --2- 172.21.15.157:0/2776842395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f80a4000 0x7ff2f809a5b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.960+0000 7ff30021a640 1 --2- 172.21.15.157:0/2776842395 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff2f809b080 0x7ff2f809a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:20.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.960+0000 7ff30021a640 1 -- 172.21.15.157:0/2776842395 >> 172.21.15.157:0/2776842395 conn(0x7ff2f80a50f0 msgr2=0x7ff2f80a64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:20.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.960+0000 7ff30021a640 1 -- 172.21.15.157:0/2776842395 shutdown_connections 2024-08-18T21:03:20.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:20.960+0000 7ff30021a640 1 -- 172.21.15.157:0/2776842395 wait complete. 2024-08-18T21:03:20.979 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 6d9d2c91-ec42-46cf-9b18-8c488f1f489c 5 2024-08-18T21:03:21.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.092+0000 7fa675356640 10 monclient: get_monmap_and_config 2024-08-18T21:03:21.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.092+0000 7fa675356640 10 monclient: build_initial_monmap 2024-08-18T21:03:21.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.092+0000 7fa675356640 10 monclient: monmap: 2024-08-18T21:03:21.096 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 0 2024-08-18T21:03:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:03:21.097462+0000 2024-08-18T21:03:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:03:21.097462+0000 2024-08-18T21:03:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:21.098 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:21.098 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:21.098 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:21.098 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:21.098 INFO:teuthology.orchestra.run.smithi157.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:21.098 INFO:teuthology.orchestra.run.smithi157.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:21.098 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:21.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 1 Processor -- start 2024-08-18T21:03:21.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 1 -- start start 2024-08-18T21:03:21.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 10 monclient: init 2024-08-18T21:03:21.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 10 monclient: _add_conns ranks=[2,10,1,4,9,7,8,0,6,3,5] 2024-08-18T21:03:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa6700a5ac0 0x7fa6700a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 10 monclient(hunting): picked mon.noname-b con 0x7fa6700a5ac0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa6700a0cd0 0x7fa6700a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 10 monclient(hunting): picked mon.noname-f con 0x7fa6700a0cd0 addr v2:172.21.15.157:3300/0 2024-08-18T21:03:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fa670139c60 addr v1:172.21.15.157:6789/0 2024-08-18T21:03:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6700a1790 con 0x7fa670139c60 2024-08-18T21:03:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fa67006e500 con 0x7fa6700a0cd0 2024-08-18T21:03:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fa6700a6920 con 0x7fa6700a5ac0 2024-08-18T21:03:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:21.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa675356640 10 monclient(hunting): authenticate will time out at 949.801316s 2024-08-18T21:03:21.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa6700a0cd0 0x7fa6700a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:21.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa66f7fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fa670139c60 0x7fa67013a0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:34800/0 (socket says 172.21.15.157:34800) 2024-08-18T21:03:21.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa66f7fe640 1 -- 172.21.15.157:0/2609246884 learned_addr learned my addr 172.21.15.157:0/2609246884 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-08-18T21:03:21.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 10 monclient(hunting): get_auth_request con 0x7fa6700a0cd0 auth_method 0 2024-08-18T21:03:21.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:21.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:21.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:21.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:21.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:21.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:21.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 10 monclient(hunting): handle_auth_done global_id 4132 payload 274 2024-08-18T21:03:21.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa66effd640 1 --2- 172.21.15.157:0/2609246884 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa6700a5ac0 0x7fa6700a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:21.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 1 -- 172.21.15.157:0/2609246884 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa6700a5ac0 msgr2=0x7fa6700a5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:21.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 1 --2- 172.21.15.157:0/2609246884 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa6700a5ac0 0x7fa6700a5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 1 -- 172.21.15.157:0/2609246884 >> v1:172.21.15.157:6789/0 conn(0x7fa670139c60 legacy=0x7fa67013a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:21.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 10 monclient: _finish_hunting 0 2024-08-18T21:03:21.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 1 monclient: found mon.noname-f 2024-08-18T21:03:21.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:21.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:03:21.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.096+0000 7fa667fff640 1 -- 172.21.15.157:0/2609246884 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67006de40 con 0x7fa6700a0cd0 2024-08-18T21:03:21.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa667fff640 1 -- 172.21.15.157:0/2609246884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6700a0cd0 msgr2=0x7fa6700a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:21.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa667fff640 1 --2- 172.21.15.157:0/2609246884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6700a0cd0 0x7fa6700a63e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa6580097c0 tx=0x7fa65801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5305585f3bc5c5dd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:21.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa66e7fc640 1 -- 172.21.15.157:0/2609246884 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa6580b0070 con 0x7fa6700a0cd0 2024-08-18T21:03:21.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa66e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:21.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa66e7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:03:21.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa66e7fc640 10 monclient: dump: 2024-08-18T21:03:21.109 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:21.109 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:21.109 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:21.109 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:21.109 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:21.109 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:21.109 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:21.109 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:21.109 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:21.110 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:21.110 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:21.110 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:21.110 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:21.110 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:21.110 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:21.110 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:21.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa66e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:21.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa66e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:21.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa66e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:21.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa66e7fc640 1 -- 172.21.15.157:0/2609246884 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6580aa810 con 0x7fa6700a0cd0 2024-08-18T21:03:21.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 5 monclient: authenticate success, global_id 4132 2024-08-18T21:03:21.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:21.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa66e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:21.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:21.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa66e7fc640 1 -- 172.21.15.157:0/2609246884 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa6580a93e0 con 0x7fa6700a0cd0 2024-08-18T21:03:21.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa66e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:21.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 4 set_mon_vals no callback set 2024-08-18T21:03:21.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa66e7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:03:21.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa66e7fc640 10 monclient: dump: 2024-08-18T21:03:21.111 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:21.111 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:21.111 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:21.111 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:21.111 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:21.112 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:21.112 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:21.112 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:21.112 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:21.112 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:21.112 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:21.112 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:21.112 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:21.112 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:21.112 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:21.112 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:21.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 10 monclient: shutdown 2024-08-18T21:03:21.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:21.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 1 -- 172.21.15.157:0/2609246884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6700a0cd0 msgr2=0x7fa6700a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 1 --2- 172.21.15.157:0/2609246884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6700a0cd0 0x7fa6700a63e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa6580097c0 tx=0x7fa65801c360 comp rx=0 tx=0).stop 2024-08-18T21:03:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 1 -- 172.21.15.157:0/2609246884 shutdown_connections 2024-08-18T21:03:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 1 --2- 172.21.15.157:0/2609246884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6700a0cd0 0x7fa6700a63e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 1 --2- 172.21.15.157:0/2609246884 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa6700a5ac0 0x7fa6700a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 1 -- 172.21.15.157:0/2609246884 >> 172.21.15.157:0/2609246884 conn(0x7fa6700aa770 msgr2=0x7fa6700a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 1 -- 172.21.15.157:0/2609246884 shutdown_connections 2024-08-18T21:03:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 1 -- 172.21.15.157:0/2609246884 wait complete. 2024-08-18T21:03:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 10 monclient: build_initial_monmap 2024-08-18T21:03:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 10 monclient: monmap: 2024-08-18T21:03:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 0 2024-08-18T21:03:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 0.000000 2024-08-18T21:03:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:created 0.000000 2024-08-18T21:03:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:21.114 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:21.114 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:21.114 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:21.114 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:21.114 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:21.114 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:21.114 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:21.114 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:21.114 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:21.114 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:21.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 1 Processor -- start 2024-08-18T21:03:21.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 1 -- start start 2024-08-18T21:03:21.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.100+0000 7fa675356640 10 monclient: init 2024-08-18T21:03:21.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:21.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 monclient: _add_conns ranks=[8,1,0,3,6,2,7,5,4] 2024-08-18T21:03:21.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa6700a0cd0 0x7fa670138c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:21.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 monclient(hunting): picked mon.noname-e con 0x7fa6700a0cd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:21.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6700a5ac0 0x7fa670139190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:21.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 monclient(hunting): picked mon.noname-f con 0x7fa6700a5ac0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:21.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa670139c60 0x7fa6701396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:21.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 monclient(hunting): picked mon.noname-a con 0x7fa670139c60 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:21.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:21.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa670144860 con 0x7fa670139c60 2024-08-18T21:03:21.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:21.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa6701446e0 con 0x7fa6700a5ac0 2024-08-18T21:03:21.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:21.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fa6701449e0 con 0x7fa6700a0cd0 2024-08-18T21:03:21.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:21.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 monclient(hunting): authenticate will time out at 949.808147s 2024-08-18T21:03:21.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6700a5ac0 0x7fa670139190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:21.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6700a5ac0 0x7fa670139190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45656/0 (socket says 172.21.15.157:45656) 2024-08-18T21:03:21.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 1 -- 172.21.15.157:0/2441960908 learned_addr learned my addr 172.21.15.157:0/2441960908 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-18T21:03:21.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 10 monclient(hunting): get_auth_request con 0x7fa6700a5ac0 auth_method 0 2024-08-18T21:03:21.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:21.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:21.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:21.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:21.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:21.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:21.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 10 monclient(hunting): handle_auth_done global_id 4141 payload 824 2024-08-18T21:03:21.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa66effd640 1 --2- 172.21.15.157:0/2441960908 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa6700a0cd0 0x7fa670138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:21.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 1 -- 172.21.15.157:0/2441960908 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa6700a0cd0 msgr2=0x7fa670138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:21.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa66f7fe640 1 --2- 172.21.15.157:0/2441960908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa670139c60 0x7fa6701396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:21.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 1 --2- 172.21.15.157:0/2441960908 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa6700a0cd0 0x7fa670138c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 1 -- 172.21.15.157:0/2441960908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa670139c60 msgr2=0x7fa6701396d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:21.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 1 --2- 172.21.15.157:0/2441960908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa670139c60 0x7fa6701396d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 10 monclient: _finish_hunting 0 2024-08-18T21:03:21.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 1 monclient: found mon.noname-f 2024-08-18T21:03:21.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:21.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:03:21.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 1 -- 172.21.15.157:0/2441960908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67013f860 con 0x7fa6700a5ac0 2024-08-18T21:03:21.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 1 -- 172.21.15.157:0/2441960908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6700a5ac0 msgr2=0x7fa670139190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:21.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa667fff640 1 --2- 172.21.15.157:0/2441960908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6700a5ac0 0x7fa670139190 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa6580ae040 tx=0x7fa658019100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:21.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa6677fe640 1 -- 172.21.15.157:0/2441960908 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa6580b0040 con 0x7fa6700a5ac0 2024-08-18T21:03:21.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa6677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:21.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa6677fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:03:21.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa6677fe640 10 monclient: dump: 2024-08-18T21:03:21.118 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:21.118 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:21.118 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:21.118 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:21.118 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:21.118 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:21.119 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:21.119 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:21.119 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:21.119 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:21.119 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:21.119 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:21.119 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:21.119 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:21.119 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:21.119 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:21.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa6677fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:21.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa6677fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:21.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa6677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:21.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa6677fe640 1 -- 172.21.15.157:0/2441960908 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa658004250 con 0x7fa6700a5ac0 2024-08-18T21:03:21.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 5 monclient: authenticate success, global_id 4141 2024-08-18T21:03:21.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 monclient: _renew_subs 2024-08-18T21:03:21.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:03:21.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 1 -- 172.21.15.157:0/2441960908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6700a9d10 con 0x7fa6700a5ac0 2024-08-18T21:03:21.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa6677fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:21.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa6677fe640 1 -- 172.21.15.157:0/2441960908 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa658004400 con 0x7fa6700a5ac0 2024-08-18T21:03:21.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa6677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:21.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa6677fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:03:21.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa66d7fa640 4 set_mon_vals no callback set 2024-08-18T21:03:21.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa6677fe640 10 monclient: dump: 2024-08-18T21:03:21.120 INFO:teuthology.orchestra.run.smithi157.stderr:epoch 1 2024-08-18T21:03:21.120 INFO:teuthology.orchestra.run.smithi157.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:21.121 INFO:teuthology.orchestra.run.smithi157.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:21.121 INFO:teuthology.orchestra.run.smithi157.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:21.121 INFO:teuthology.orchestra.run.smithi157.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:21.121 INFO:teuthology.orchestra.run.smithi157.stderr:election_strategy: 1 2024-08-18T21:03:21.121 INFO:teuthology.orchestra.run.smithi157.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:21.121 INFO:teuthology.orchestra.run.smithi157.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:21.121 INFO:teuthology.orchestra.run.smithi157.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:21.121 INFO:teuthology.orchestra.run.smithi157.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:21.121 INFO:teuthology.orchestra.run.smithi157.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:21.121 INFO:teuthology.orchestra.run.smithi157.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:21.121 INFO:teuthology.orchestra.run.smithi157.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:21.121 INFO:teuthology.orchestra.run.smithi157.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:21.121 INFO:teuthology.orchestra.run.smithi157.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:21.122 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:03:21.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 monclient: _renew_subs 2024-08-18T21:03:21.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:03:21.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 1 -- 172.21.15.157:0/2441960908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa67013efc0 con 0x7fa6700a5ac0 2024-08-18T21:03:21.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa6677fe640 1 -- 172.21.15.157:0/2441960908 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa658003620 con 0x7fa6700a5ac0 2024-08-18T21:03:21.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa6677fe640 1 -- 172.21.15.157:0/2441960908 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fa6580bd980 con 0x7fa6700a5ac0 2024-08-18T21:03:21.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:21.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:21.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:03:21.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.104+0000 7fa675356640 1 -- 172.21.15.157:0/2441960908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa67013a0f0 con 0x7fa6700a5ac0 2024-08-18T21:03:21.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.108+0000 7fa6677fe640 1 -- 172.21.15.157:0/2441960908 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa658016070 con 0x7fa6700a5ac0 2024-08-18T21:03:21.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.108+0000 7fa6677fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:21.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.108+0000 7fa6677fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:21.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.224+0000 7fa675356640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "6d9d2c91-ec42-46cf-9b18-8c488f1f489c", "id": 5}] 2024-08-18T21:03:21.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.224+0000 7fa675356640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "6d9d2c91-ec42-46cf-9b18-8c488f1f489c", "id": 5}] 2024-08-18T21:03:21.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.224+0000 7fa675356640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:03:21.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.224+0000 7fa675356640 1 -- 172.21.15.157:0/2441960908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6d9d2c91-ec42-46cf-9b18-8c488f1f489c", "id": 5} v 0) -- 0x7fa67006d010 con 0x7fa6700a5ac0 2024-08-18T21:03:21.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.456+0000 7fa6677fe640 1 -- 172.21.15.157:0/2441960908 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6d9d2c91-ec42-46cf-9b18-8c488f1f489c", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fa658003af0 con 0x7fa6700a5ac0 2024-08-18T21:03:21.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.460+0000 7fa6677fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "6d9d2c91-ec42-46cf-9b18-8c488f1f489c", "id": 5}] 2024-08-18T21:03:21.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.460+0000 7fa6677fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:21.461 INFO:teuthology.orchestra.run.smithi157.stdout:5 2024-08-18T21:03:21.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.460+0000 7fa675356640 10 monclient: shutdown 2024-08-18T21:03:21.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.460+0000 7fa675356640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:21.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.460+0000 7fa675356640 1 -- 172.21.15.157:0/2441960908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6700a5ac0 msgr2=0x7fa670139190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:21.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.460+0000 7fa675356640 1 --2- 172.21.15.157:0/2441960908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6700a5ac0 0x7fa670139190 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa6580ae040 tx=0x7fa658019100 comp rx=0 tx=0).stop 2024-08-18T21:03:21.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.460+0000 7fa675356640 1 -- 172.21.15.157:0/2441960908 shutdown_connections 2024-08-18T21:03:21.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.460+0000 7fa675356640 1 --2- 172.21.15.157:0/2441960908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa670139c60 0x7fa6701396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.460+0000 7fa675356640 1 --2- 172.21.15.157:0/2441960908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6700a5ac0 0x7fa670139190 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.460+0000 7fa675356640 1 --2- 172.21.15.157:0/2441960908 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa6700a0cd0 0x7fa670138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.460+0000 7fa675356640 1 -- 172.21.15.157:0/2441960908 >> 172.21.15.157:0/2441960908 conn(0x7fa6700aa770 msgr2=0x7fa6700a8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:21.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.460+0000 7fa675356640 1 -- 172.21.15.157:0/2441960908 shutdown_connections 2024-08-18T21:03:21.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-18T21:03:21.460+0000 7fa675356640 1 -- 172.21.15.157:0/2441960908 wait complete. 2024-08-18T21:03:21.468 INFO:tasks.ceph.mgr.x.smithi157.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-08-18T21:03:21.468 INFO:tasks.ceph.mgr.x.smithi157.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-08-18T21:03:21.468 INFO:tasks.ceph.mgr.x.smithi157.stderr: from numpy import show_config as show_numpy_config 2024-08-18T21:03:21.481 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-18T21:03:21.481 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-18T21:03:21.484 INFO:tasks.ceph.osd.0:Started 2024-08-18T21:03:21.484 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-18T21:03:21.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-18T21:03:21.486 INFO:tasks.ceph.osd.1:Started 2024-08-18T21:03:21.487 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-18T21:03:21.487 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-18T21:03:21.489 INFO:tasks.ceph.osd.2:Started 2024-08-18T21:03:21.489 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-18T21:03:21.489 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-18T21:03:21.491 INFO:tasks.ceph.osd.3:Started 2024-08-18T21:03:21.492 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-18T21:03:21.492 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-18T21:03:21.493 INFO:tasks.ceph.osd.4:Started 2024-08-18T21:03:21.494 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-18T21:03:21.494 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-18T21:03:21.495 INFO:tasks.ceph.osd.5:Started 2024-08-18T21:03:21.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T21:03:21.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 10 monclient: get_monmap_and_config 2024-08-18T21:03:21.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 10 monclient: build_initial_monmap 2024-08-18T21:03:21.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 10 monclient: monmap: 2024-08-18T21:03:21.616 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:21.616 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:21.618044+0000 2024-08-18T21:03:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:21.618044+0000 2024-08-18T21:03:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:21.618 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:21.618 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 1 Processor -- start 2024-08-18T21:03:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 1 -- start start 2024-08-18T21:03:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 10 monclient: init 2024-08-18T21:03:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 10 monclient: _add_conns ranks=[2,6,9,1,4,0,7,3,8,5,10] 2024-08-18T21:03:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4f64073570 0x7f4f64073950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 10 monclient(hunting): picked mon.noname-b con 0x7f4f64073570 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4f64139b90 0x7f4f640a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 10 monclient(hunting): picked mon.noname-d con 0x7f4f64139b90 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f64073e90 0x7f4f640a2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 10 monclient(hunting): picked mon.noname-a con 0x7f4f64073e90 addr v2:172.21.15.5:3300/0 2024-08-18T21:03:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4f6406fd70 con 0x7f4f64073e90 2024-08-18T21:03:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f4f640a4aa0 con 0x7f4f64073570 2024-08-18T21:03:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f4f640a4d80 con 0x7f4f64139b90 2024-08-18T21:03:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.614+0000 7f4f6b281640 10 monclient(hunting): authenticate will time out at 968.631866s 2024-08-18T21:03:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6981e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f64073e90 0x7f4f640a2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4f64073570 0x7f4f64073950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6881c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4f64139b90 0x7f4f640a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6881c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4f64139b90 0x7f4f640a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:36378/0 (socket says 172.21.15.5:36378) 2024-08-18T21:03:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6981e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f64073e90 0x7f4f640a2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43194/0 (socket says 172.21.15.5:43194) 2024-08-18T21:03:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 10 monclient(hunting): get_auth_request con 0x7f4f64073570 auth_method 0 2024-08-18T21:03:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6881c640 1 -- 172.21.15.5:0/2315327316 learned_addr learned my addr 172.21.15.5:0/2315327316 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6881c640 10 monclient(hunting): get_auth_request con 0x7f4f64139b90 auth_method 0 2024-08-18T21:03:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6881c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6881c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6881c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6981e640 10 monclient(hunting): get_auth_request con 0x7f4f64073e90 auth_method 0 2024-08-18T21:03:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6981e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6981e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6981e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6881c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6881c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6881c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6981e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6981e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6981e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 10 monclient(hunting): handle_auth_done global_id 4142 payload 274 2024-08-18T21:03:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 1 -- 172.21.15.5:0/2315327316 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4f64139b90 msgr2=0x7f4f640a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 1 --2- 172.21.15.5:0/2315327316 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4f64139b90 0x7f4f640a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 1 -- 172.21.15.5:0/2315327316 >> v2:172.21.15.5:3300/0 conn(0x7f4f64073e90 msgr2=0x7f4f640a2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 1 --2- 172.21.15.5:0/2315327316 >> v2:172.21.15.5:3300/0 conn(0x7f4f64073e90 0x7f4f640a2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 10 monclient: _finish_hunting 0 2024-08-18T21:03:21.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 1 monclient: found mon.noname-b 2024-08-18T21:03:21.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:21.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:21.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6901d640 1 -- 172.21.15.5:0/2315327316 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f64070020 con 0x7f4f64073570 2024-08-18T21:03:21.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6881c640 1 --2- 172.21.15.5:0/2315327316 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4f64139b90 0x7f4f640a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:21.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.618+0000 7f4f6981e640 1 --2- 172.21.15.5:0/2315327316 >> v2:172.21.15.5:3300/0 conn(0x7f4f64073e90 0x7f4f640a2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:21.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6901d640 1 -- 172.21.15.5:0/2315327316 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4f64073570 msgr2=0x7f4f64073950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:21.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6901d640 1 --2- 172.21.15.5:0/2315327316 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4f64073570 0x7f4f64073950 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4f600097c0 tx=0x7f4f6001c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7de8a85df36a8e91 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:21.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f5bfff640 1 -- 172.21.15.5:0/2315327316 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f600b0070 con 0x7f4f64073570 2024-08-18T21:03:21.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f5bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f5bfff640 10 monclient: dump: 2024-08-18T21:03:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:21.629 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f5bfff640 10 monclient: _finish_auth 0 2024-08-18T21:03:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f5bfff640 10 monclient: _check_auth_tickets 2024-08-18T21:03:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f5bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f5bfff640 1 -- 172.21.15.5:0/2315327316 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f600aa810 con 0x7f4f64073570 2024-08-18T21:03:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 5 monclient: authenticate success, global_id 4142 2024-08-18T21:03:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f5bfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f5bfff640 1 -- 172.21.15.5:0/2315327316 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f600aae30 con 0x7f4f64073570 2024-08-18T21:03:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f5bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f5bfff640 10 monclient: dump: 2024-08-18T21:03:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:21.631 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 4 set_mon_vals no callback set 2024-08-18T21:03:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 10 monclient: shutdown 2024-08-18T21:03:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 -- 172.21.15.5:0/2315327316 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4f64073570 msgr2=0x7f4f64073950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 --2- 172.21.15.5:0/2315327316 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4f64073570 0x7f4f64073950 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4f600097c0 tx=0x7f4f6001c360 comp rx=0 tx=0).stop 2024-08-18T21:03:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 -- 172.21.15.5:0/2315327316 shutdown_connections 2024-08-18T21:03:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 --2- 172.21.15.5:0/2315327316 >> v2:172.21.15.5:3300/0 conn(0x7f4f64073e90 0x7f4f640a2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 --2- 172.21.15.5:0/2315327316 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4f64139b90 0x7f4f640a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 --2- 172.21.15.5:0/2315327316 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4f64073570 0x7f4f64073950 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 -- 172.21.15.5:0/2315327316 >> 172.21.15.5:0/2315327316 conn(0x7f4f640a8a90 msgr2=0x7f4f640a8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 -- 172.21.15.5:0/2315327316 shutdown_connections 2024-08-18T21:03:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 -- 172.21.15.5:0/2315327316 wait complete. 2024-08-18T21:03:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 10 monclient: build_initial_monmap 2024-08-18T21:03:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 10 monclient: monmap: 2024-08-18T21:03:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:21.633 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 Processor -- start 2024-08-18T21:03:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 -- start start 2024-08-18T21:03:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 10 monclient: init 2024-08-18T21:03:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 10 monclient: _add_conns ranks=[0,2,3,5,6,8,7,4,1] 2024-08-18T21:03:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f64073570 0x7f4f641375a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 10 monclient(hunting): picked mon.noname-a con 0x7f4f64073570 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4f64073e90 0x7f4f6413fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 10 monclient(hunting): picked mon.noname-b con 0x7f4f64073e90 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f64139b90 0x7f4f64140080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 10 monclient(hunting): picked mon.noname-g con 0x7f4f64139b90 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4f64143450 con 0x7f4f64073570 2024-08-18T21:03:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f4f640a3fe0 con 0x7f4f64073e90 2024-08-18T21:03:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4f641435d0 con 0x7f4f64139b90 2024-08-18T21:03:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6b281640 10 monclient(hunting): authenticate will time out at 968.639134s 2024-08-18T21:03:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6901d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f64073570 0x7f4f641375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4f64073e90 0x7f4f6413fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6901d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f64073570 0x7f4f641375a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43198/0 (socket says 172.21.15.5:43198) 2024-08-18T21:03:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4f64073e90 0x7f4f6413fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59014/0 (socket says 172.21.15.5:59014) 2024-08-18T21:03:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6901d640 1 -- 172.21.15.5:0/2275279498 learned_addr learned my addr 172.21.15.5:0/2275279498 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6901d640 10 monclient(hunting): get_auth_request con 0x7f4f64073570 auth_method 0 2024-08-18T21:03:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6901d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6901d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6901d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 10 monclient(hunting): get_auth_request con 0x7f4f64073e90 auth_method 0 2024-08-18T21:03:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6901d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6901d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6901d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6981e640 1 --2- 172.21.15.5:0/2275279498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f64139b90 0x7f4f64140080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6981e640 10 monclient(hunting): get_auth_request con 0x7f4f64139b90 auth_method 0 2024-08-18T21:03:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6981e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6981e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6981e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 10 monclient(hunting): handle_auth_done global_id 4151 payload 824 2024-08-18T21:03:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 1 -- 172.21.15.5:0/2275279498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f64139b90 msgr2=0x7f4f64140080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 1 --2- 172.21.15.5:0/2275279498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f64139b90 0x7f4f64140080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 1 -- 172.21.15.5:0/2275279498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f64073570 msgr2=0x7f4f641375a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:21.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 1 --2- 172.21.15.5:0/2275279498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f64073570 0x7f4f641375a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 10 monclient: _finish_hunting 0 2024-08-18T21:03:21.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 1 monclient: found mon.noname-b 2024-08-18T21:03:21.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:21.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:21.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6881c640 1 -- 172.21.15.5:0/2275279498 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f64137f50 con 0x7f4f64073e90 2024-08-18T21:03:21.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.622+0000 7f4f6901d640 1 --2- 172.21.15.5:0/2275279498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f64073570 0x7f4f641375a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:21.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f6881c640 1 -- 172.21.15.5:0/2275279498 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4f64073e90 msgr2=0x7f4f6413fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f6881c640 1 --2- 172.21.15.5:0/2275279498 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4f64073e90 0x7f4f6413fb40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4f64068d00 tx=0x7f4f5400ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f59ffb640 1 -- 172.21.15.5:0/2275279498 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f54017020 con 0x7f4f64073e90 2024-08-18T21:03:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f59ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f59ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f59ffb640 10 monclient: dump: 2024-08-18T21:03:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:21.640 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f59ffb640 10 monclient: _finish_auth 0 2024-08-18T21:03:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f59ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:03:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f59ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f59ffb640 1 -- 172.21.15.5:0/2275279498 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f54004450 con 0x7f4f64073e90 2024-08-18T21:03:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f6b281640 5 monclient: authenticate success, global_id 4151 2024-08-18T21:03:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f6b281640 10 monclient: _renew_subs 2024-08-18T21:03:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f6b281640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f6b281640 1 -- 172.21.15.5:0/2275279498 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f64138920 con 0x7f4f64073e90 2024-08-18T21:03:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f59ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f59ffb640 1 -- 172.21.15.5:0/2275279498 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f54003620 con 0x7f4f64073e90 2024-08-18T21:03:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f59ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f59ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f59ffb640 10 monclient: dump: 2024-08-18T21:03:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:21.642 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f5b7fe640 4 set_mon_vals no callback set 2024-08-18T21:03:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f6b281640 10 monclient: _renew_subs 2024-08-18T21:03:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f6b281640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f6b281640 1 -- 172.21.15.5:0/2275279498 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f6413d700 con 0x7f4f64073e90 2024-08-18T21:03:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f59ffb640 1 -- 172.21.15.5:0/2275279498 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4f5401a020 con 0x7f4f64073e90 2024-08-18T21:03:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f59ffb640 1 -- 172.21.15.5:0/2275279498 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f4f5400f040 con 0x7f4f64073e90 2024-08-18T21:03:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f6b281640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f6b281640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f6b281640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.626+0000 7f4f6b281640 1 -- 172.21.15.5:0/2275279498 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f64073950 con 0x7f4f64073e90 2024-08-18T21:03:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.630+0000 7f4f59ffb640 1 -- 172.21.15.5:0/2275279498 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4f54021030 con 0x7f4f64073e90 2024-08-18T21:03:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.630+0000 7f4f59ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.630+0000 7f4f59ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:21.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.690+0000 7f4f6b281640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:21.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.690+0000 7f4f6b281640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:21.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.690+0000 7f4f6b281640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:21.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.690+0000 7f4f6b281640 1 -- 172.21.15.5:0/2275279498 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f6413a5a0 con 0x7f4f64073e90 2024-08-18T21:03:21.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.690+0000 7f4f59ffb640 1 -- 172.21.15.5:0/2275279498 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (secure 0 0 0) 0x7f4f540093f0 con 0x7f4f64073e90 2024-08-18T21:03:21.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.690+0000 7f4f59ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:21.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.690+0000 7f4f59ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:21.694 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:03:21.694 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","created":"2024-08-18T21:03:17.118714+0000","modified":"2024-08-18T21:03:21.231242+0000","last_up_change":"0.000000","last_in_change":"2024-08-18T21:03:21.231242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8f6d162e-ed99-408f-87c5-4880e57b4f0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"99984157-5771-44d0-b5fa-c3e5b2537e67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00fd1d05-f5a1-4d89-8e2c-47a61392f500","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8bb1ba33-9e75-43ee-bbfc-7ab22350e4a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f7043f2f-d6d1-4c40-bf70-80a10071a795","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6d9d2c91-ec42-46cf-9b18-8c488f1f489c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T21:03:21.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.694+0000 7f4f6b281640 10 monclient: shutdown 2024-08-18T21:03:21.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.694+0000 7f4f6b281640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:21.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.694+0000 7f4f6b281640 1 -- 172.21.15.5:0/2275279498 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4f64073e90 msgr2=0x7f4f6413fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:21.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.694+0000 7f4f6b281640 1 --2- 172.21.15.5:0/2275279498 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4f64073e90 0x7f4f6413fb40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4f64068d00 tx=0x7f4f5400ed40 comp rx=0 tx=0).stop 2024-08-18T21:03:21.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.694+0000 7f4f6b281640 1 -- 172.21.15.5:0/2275279498 shutdown_connections 2024-08-18T21:03:21.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.694+0000 7f4f6b281640 1 --2- 172.21.15.5:0/2275279498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f64139b90 0x7f4f64140080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.694+0000 7f4f6b281640 1 --2- 172.21.15.5:0/2275279498 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4f64073e90 0x7f4f6413fb40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.694+0000 7f4f6b281640 1 --2- 172.21.15.5:0/2275279498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f64073570 0x7f4f641375a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:21.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.694+0000 7f4f6b281640 1 -- 172.21.15.5:0/2275279498 >> 172.21.15.5:0/2275279498 conn(0x7f4f640a8a90 msgr2=0x7f4f64130e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:21.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.694+0000 7f4f6b281640 1 -- 172.21.15.5:0/2275279498 shutdown_connections 2024-08-18T21:03:21.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:21.694+0000 7f4f6b281640 1 -- 172.21.15.5:0/2275279498 wait complete. 2024-08-18T21:03:21.711 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-18T21:03:21.711 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-18T21:03:22.316 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-18T21:03:22.441 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.438+0000 7f38297ae640 10 monclient: get_monmap_and_config 2024-08-18T21:03:22.441 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.438+0000 7f38297ae640 10 monclient: build_initial_monmap 2024-08-18T21:03:22.442 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.438+0000 7f38297ae640 10 monclient: monmap: 2024-08-18T21:03:22.442 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2024-08-18T21:03:22.442 INFO:teuthology.misc.health.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:22.442 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2024-08-18T21:03:22.443087+0000 2024-08-18T21:03:22.442 INFO:teuthology.misc.health.smithi005.stderr:created 2024-08-18T21:03:22.443087+0000 2024-08-18T21:03:22.442 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:22.442 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:22.442 INFO:teuthology.misc.health.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:22.442 INFO:teuthology.misc.health.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:22.442 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:22.442 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:22.442 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:22.443 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:22.443 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:22.443 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:22.443 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:22.443 INFO:teuthology.misc.health.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:22.443 INFO:teuthology.misc.health.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:22.443 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:22.445 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.438+0000 7f38297ae640 1 Processor -- start 2024-08-18T21:03:22.445 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.438+0000 7f38297ae640 1 -- start start 2024-08-18T21:03:22.445 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.438+0000 7f38297ae640 10 monclient: init 2024-08-18T21:03:22.445 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38297ae640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:22.445 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38297ae640 10 monclient: _add_conns ranks=[9,6,0,5,1,3,7,2,4,10,8] 2024-08-18T21:03:22.445 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38297ae640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3824139c90 0x7f382409eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:22.446 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38297ae640 10 monclient(hunting): picked mon.noname-a con 0x7f3824139c90 addr v2:172.21.15.5:3300/0 2024-08-18T21:03:22.446 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38297ae640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f382413a070 0x7f38240a6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:22.446 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38297ae640 10 monclient(hunting): picked mon.noname-d con 0x7f382413a070 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:22.446 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38297ae640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f382413a4b0 addr v1:172.21.15.5:6789/0 2024-08-18T21:03:22.446 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38297ae640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f382409d9e0 con 0x7f382413a4b0 2024-08-18T21:03:22.446 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38297ae640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:22.446 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38297ae640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f382409de90 con 0x7f3824139c90 2024-08-18T21:03:22.446 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38297ae640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:22.446 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38297ae640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f382406f9c0 con 0x7f382413a070 2024-08-18T21:03:22.446 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38297ae640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:22.446 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38297ae640 10 monclient(hunting): authenticate will time out at 969.456505s 2024-08-18T21:03:22.446 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3824139c90 0x7f382409eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:22.447 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38237fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f382413a4b0 0x7f38240a7050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59930/0 (socket says 172.21.15.5:59930) 2024-08-18T21:03:22.447 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38237fe640 1 -- 172.21.15.5:0/2227731057 learned_addr learned my addr 172.21.15.5:0/2227731057 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:03:22.447 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38227fc640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f382413a070 0x7f38240a6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:22.447 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 1 --2- 172.21.15.5:0/2227731057 >> v2:172.21.15.5:3300/0 conn(0x7f3824139c90 0x7f382409eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43204/0 (socket says 172.21.15.5:43204) 2024-08-18T21:03:22.447 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 10 monclient(hunting): get_auth_request con 0x7f3824139c90 auth_method 0 2024-08-18T21:03:22.447 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:22.447 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:22.447 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:22.447 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38227fc640 10 monclient(hunting): get_auth_request con 0x7f382413a070 auth_method 0 2024-08-18T21:03:22.447 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38227fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:22.447 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38227fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:22.447 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38227fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:22.447 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:22.448 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:22.448 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:22.448 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38227fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:22.448 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38227fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:22.448 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38227fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:22.448 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 10 monclient(hunting): handle_auth_done global_id 4176 payload 274 2024-08-18T21:03:22.448 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 1 -- 172.21.15.5:0/2227731057 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f382413a070 msgr2=0x7f38240a6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:22.448 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 1 --2- 172.21.15.5:0/2227731057 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f382413a070 0x7f38240a6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:22.448 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 1 -- 172.21.15.5:0/2227731057 >> v1:172.21.15.5:6789/0 conn(0x7f382413a4b0 legacy=0x7f38240a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:22.448 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:03:22.448 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 1 monclient: found mon.noname-a 2024-08-18T21:03:22.448 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:22.448 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:22.448 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f3822ffd640 1 -- 172.21.15.5:0/2227731057 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382409e730 con 0x7f3824139c90 2024-08-18T21:03:22.449 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.442+0000 7f38227fc640 1 --2- 172.21.15.5:0/2227731057 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f382413a070 0x7f38240a6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:22.450 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f3822ffd640 1 -- 172.21.15.5:0/2227731057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3824139c90 msgr2=0x7f382409eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:22.450 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f3822ffd640 1 --2- 172.21.15.5:0/2227731057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3824139c90 0x7f382409eb50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f382406dd20 tx=0x7f381401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca5d54f2418bd1d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:22.450 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f3821ffb640 1 -- 172.21.15.5:0/2227731057 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38140b0070 con 0x7f3824139c90 2024-08-18T21:03:22.450 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f3821ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:22.451 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f3821ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:22.451 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f3821ffb640 10 monclient: dump: 2024-08-18T21:03:22.451 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2024-08-18T21:03:22.451 INFO:teuthology.misc.health.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:22.451 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:22.451 INFO:teuthology.misc.health.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:22.451 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:22.451 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:22.451 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:22.451 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:22.451 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:22.451 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:22.451 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:22.451 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:22.452 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:22.452 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:22.452 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:22.452 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:22.452 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f3821ffb640 10 monclient: _finish_auth 0 2024-08-18T21:03:22.452 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f3821ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:03:22.452 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f3821ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:22.452 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f3821ffb640 1 -- 172.21.15.5:0/2227731057 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38140aa810 con 0x7f3824139c90 2024-08-18T21:03:22.452 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f3821ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:22.452 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f3821ffb640 1 -- 172.21.15.5:0/2227731057 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38140aae30 con 0x7f3824139c90 2024-08-18T21:03:22.452 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 5 monclient: authenticate success, global_id 4176 2024-08-18T21:03:22.452 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:22.452 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 4 set_mon_vals no callback set 2024-08-18T21:03:22.453 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f3821ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:22.453 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f3821ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:22.453 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f3821ffb640 10 monclient: dump: 2024-08-18T21:03:22.453 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2024-08-18T21:03:22.453 INFO:teuthology.misc.health.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:22.453 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:22.453 INFO:teuthology.misc.health.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:22.453 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:22.453 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:22.453 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:22.453 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:22.453 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:22.453 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:22.454 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:22.454 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:22.454 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:22.454 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:22.454 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:22.454 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:22.454 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 10 monclient: shutdown 2024-08-18T21:03:22.454 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:22.454 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 1 -- 172.21.15.5:0/2227731057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3824139c90 msgr2=0x7f382409eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:22.454 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 1 --2- 172.21.15.5:0/2227731057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3824139c90 0x7f382409eb50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f382406dd20 tx=0x7f381401c360 comp rx=0 tx=0).stop 2024-08-18T21:03:22.454 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 1 -- 172.21.15.5:0/2227731057 shutdown_connections 2024-08-18T21:03:22.454 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 1 --2- 172.21.15.5:0/2227731057 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f382413a070 0x7f38240a6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:22.454 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 1 --2- 172.21.15.5:0/2227731057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3824139c90 0x7f382409eb50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:22.455 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 1 -- 172.21.15.5:0/2227731057 >> 172.21.15.5:0/2227731057 conn(0x7f38240a8c10 msgr2=0x7f38240a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:22.455 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 1 -- 172.21.15.5:0/2227731057 shutdown_connections 2024-08-18T21:03:22.455 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 1 -- 172.21.15.5:0/2227731057 wait complete. 2024-08-18T21:03:22.455 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 10 monclient: build_initial_monmap 2024-08-18T21:03:22.455 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 10 monclient: monmap: 2024-08-18T21:03:22.455 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2024-08-18T21:03:22.455 INFO:teuthology.misc.health.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:22.455 INFO:teuthology.misc.health.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:22.455 INFO:teuthology.misc.health.smithi005.stderr:created 0.000000 2024-08-18T21:03:22.455 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:22.455 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:22.455 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:22.455 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:22.455 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:22.456 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:22.456 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:22.456 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:22.456 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:22.456 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:22.456 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:22.456 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:22.456 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 1 Processor -- start 2024-08-18T21:03:22.456 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 1 -- start start 2024-08-18T21:03:22.456 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.446+0000 7f38297ae640 10 monclient: init 2024-08-18T21:03:22.459 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:22.459 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 10 monclient: _add_conns ranks=[0,5,2,8,4,3,7,6,1] 2024-08-18T21:03:22.459 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3824139c90 0x7f3824140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:22.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 10 monclient(hunting): picked mon.noname-a con 0x7f3824139c90 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:22.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f382413a070 0x7f3824141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:22.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 10 monclient(hunting): picked mon.noname-h con 0x7f382413a070 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:22.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f382413a4b0 0x7f382413a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:22.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 10 monclient(hunting): picked mon.noname-b con 0x7f382413a4b0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:22.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:22.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3824144350 con 0x7f3824139c90 2024-08-18T21:03:22.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:22.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f38240a7970 con 0x7f382413a4b0 2024-08-18T21:03:22.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:22.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f38241444d0 con 0x7f382413a070 2024-08-18T21:03:22.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:22.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 10 monclient(hunting): authenticate will time out at 969.464441s 2024-08-18T21:03:22.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3824139c90 0x7f3824140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:22.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3824139c90 0x7f3824140ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43216/0 (socket says 172.21.15.5:43216) 2024-08-18T21:03:22.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 1 -- 172.21.15.5:0/3815452218 learned_addr learned my addr 172.21.15.5:0/3815452218 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:22.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 10 monclient(hunting): get_auth_request con 0x7f3824139c90 auth_method 0 2024-08-18T21:03:22.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:22.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:22.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:22.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38237fe640 1 --2- 172.21.15.5:0/3815452218 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f382413a4b0 0x7f382413a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:22.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38237fe640 10 monclient(hunting): get_auth_request con 0x7f382413a4b0 auth_method 0 2024-08-18T21:03:22.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:22.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38237fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:22.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38237fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:22.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:22.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:22.462 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:22.462 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:22.462 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:22.462 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:22.462 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 10 monclient(hunting): handle_auth_done global_id 4185 payload 824 2024-08-18T21:03:22.462 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 1 -- 172.21.15.5:0/3815452218 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f382413a070 msgr2=0x7f3824141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:22.462 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 1 --2- 172.21.15.5:0/3815452218 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f382413a070 0x7f3824141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:22.462 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 1 -- 172.21.15.5:0/3815452218 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f382413a4b0 msgr2=0x7f382413a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:22.462 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 1 --2- 172.21.15.5:0/3815452218 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f382413a4b0 0x7f382413a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:22.462 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:03:22.462 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 1 monclient: found mon.noname-a 2024-08-18T21:03:22.462 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:22.462 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:22.463 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 1 -- 172.21.15.5:0/3815452218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38240aaf20 con 0x7f3824139c90 2024-08-18T21:03:22.463 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 1 -- 172.21.15.5:0/3815452218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3824139c90 msgr2=0x7f3824140ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:22.463 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3822ffd640 1 --2- 172.21.15.5:0/3815452218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3824139c90 0x7f3824140ae0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f381401c190 tx=0x7f3814019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:22.463 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f380b7fe640 1 -- 172.21.15.5:0/3815452218 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38140b0040 con 0x7f3824139c90 2024-08-18T21:03:22.463 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f380b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:22.463 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f380b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:22.463 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f380b7fe640 10 monclient: dump: 2024-08-18T21:03:22.463 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2024-08-18T21:03:22.463 INFO:teuthology.misc.health.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:22.463 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:22.463 INFO:teuthology.misc.health.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:22.463 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:22.463 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:22.464 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:22.464 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:22.464 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:22.464 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:22.464 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:22.464 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:22.464 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:22.464 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:22.464 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:22.464 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:22.464 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f380b7fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:22.464 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f380b7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:22.464 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f380b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:22.465 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f380b7fe640 1 -- 172.21.15.5:0/3815452218 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38140044b0 con 0x7f3824139c90 2024-08-18T21:03:22.465 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f380b7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:22.465 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f380b7fe640 1 -- 172.21.15.5:0/3815452218 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3814003a90 con 0x7f3824139c90 2024-08-18T21:03:22.465 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f380b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:22.465 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f380b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:22.465 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f380b7fe640 10 monclient: dump: 2024-08-18T21:03:22.465 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2024-08-18T21:03:22.465 INFO:teuthology.misc.health.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:22.465 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:22.465 INFO:teuthology.misc.health.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:22.465 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:22.465 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:22.465 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:22.465 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:22.466 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:22.466 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:22.466 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:22.466 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:22.466 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:22.466 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:22.466 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:22.466 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:22.466 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f3820ff9640 4 set_mon_vals no callback set 2024-08-18T21:03:22.466 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 5 monclient: authenticate success, global_id 4185 2024-08-18T21:03:22.466 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 10 monclient: _renew_subs 2024-08-18T21:03:22.466 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:22.467 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 1 -- 172.21.15.5:0/3815452218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3824141560 con 0x7f3824139c90 2024-08-18T21:03:22.467 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 10 monclient: _renew_subs 2024-08-18T21:03:22.467 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:22.467 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f38297ae640 1 -- 172.21.15.5:0/3815452218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382413cfd0 con 0x7f3824139c90 2024-08-18T21:03:22.467 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f380b7fe640 1 -- 172.21.15.5:0/3815452218 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f38140bb030 con 0x7f3824139c90 2024-08-18T21:03:22.467 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.450+0000 7f380b7fe640 1 -- 172.21.15.5:0/3815452218 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f38140b9020 con 0x7f3824139c90 2024-08-18T21:03:22.467 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.454+0000 7f38297ae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:22.467 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.454+0000 7f38297ae640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:22.467 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.454+0000 7f38297ae640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:22.467 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.454+0000 7f38297ae640 1 -- 172.21.15.5:0/3815452218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38240ab5c0 con 0x7f3824139c90 2024-08-18T21:03:22.467 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.454+0000 7f380b7fe640 1 -- 172.21.15.5:0/3815452218 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f38240ab5c0 con 0x7f3824139c90 2024-08-18T21:03:22.467 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.454+0000 7f380b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:22.467 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.454+0000 7f380b7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:22.519 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f38297ae640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:22.519 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f38297ae640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:22.519 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f38297ae640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:22.519 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f38297ae640 1 -- 172.21.15.5:0/3815452218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f382409eb50 con 0x7f3824139c90 2024-08-18T21:03:22.520 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f380b7fe640 1 -- 172.21.15.5:0/3815452218 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (secure 0 0 0) 0x7f38140c2060 con 0x7f3824139c90 2024-08-18T21:03:22.520 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f380b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:22.520 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f380b7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:22.520 INFO:teuthology.misc.health.smithi005.stdout: 2024-08-18T21:03:22.520 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":8,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","created":"2024-08-18T21:03:17.118714+0000","modified":"2024-08-18T21:03:21.231242+0000","last_up_change":"0.000000","last_in_change":"2024-08-18T21:03:21.231242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8f6d162e-ed99-408f-87c5-4880e57b4f0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"99984157-5771-44d0-b5fa-c3e5b2537e67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00fd1d05-f5a1-4d89-8e2c-47a61392f500","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8bb1ba33-9e75-43ee-bbfc-7ab22350e4a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f7043f2f-d6d1-4c40-bf70-80a10071a795","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6d9d2c91-ec42-46cf-9b18-8c488f1f489c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T21:03:22.521 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f38297ae640 10 monclient: shutdown 2024-08-18T21:03:22.521 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f38297ae640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:22.521 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f38297ae640 1 -- 172.21.15.5:0/3815452218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3824139c90 msgr2=0x7f3824140ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:22.521 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f38297ae640 1 --2- 172.21.15.5:0/3815452218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3824139c90 0x7f3824140ae0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f381401c190 tx=0x7f3814019100 comp rx=0 tx=0).stop 2024-08-18T21:03:22.521 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f38297ae640 1 -- 172.21.15.5:0/3815452218 shutdown_connections 2024-08-18T21:03:22.522 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f38297ae640 1 --2- 172.21.15.5:0/3815452218 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f382413a4b0 0x7f382413a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:22.522 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f38297ae640 1 --2- 172.21.15.5:0/3815452218 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f382413a070 0x7f3824141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:22.522 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f38297ae640 1 --2- 172.21.15.5:0/3815452218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3824139c90 0x7f3824140ae0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:22.522 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f38297ae640 1 -- 172.21.15.5:0/3815452218 >> 172.21.15.5:0/3815452218 conn(0x7f38240a8c10 msgr2=0x7f38240a1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:22.522 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f38297ae640 1 -- 172.21.15.5:0/3815452218 shutdown_connections 2024-08-18T21:03:22.522 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:22.518+0000 7f38297ae640 1 -- 172.21.15.5:0/3815452218 wait complete. 2024-08-18T21:03:22.536 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-08-18T21:03:22.621 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-08-18T21:03:22.620+0000 7fd87b8447c0 -1 Falling back to public interface 2024-08-18T21:03:22.639 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-08-18T21:03:22.638+0000 7fab0a54f7c0 -1 Falling back to public interface 2024-08-18T21:03:22.643 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-18T21:03:22.642+0000 7f9d324fa7c0 -1 Falling back to public interface 2024-08-18T21:03:22.841 INFO:tasks.ceph.osd.3.smithi157.stderr:2024-08-18T21:03:22.840+0000 7f64efc0e7c0 -1 Falling back to public interface 2024-08-18T21:03:23.090 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-08-18T21:03:23.088+0000 7f77f1a4c7c0 -1 Falling back to public interface 2024-08-18T21:03:23.137 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-08-18T21:03:23.134+0000 7f5da75af7c0 -1 Falling back to public interface 2024-08-18T21:03:24.766 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-18T21:03:24.764+0000 7fa113080640 -1 mgr.server handle_report got status from non-daemon mon.f 2024-08-18T21:03:24.767 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-18T21:03:24.764+0000 7fa113080640 -1 mgr.server handle_report got status from non-daemon mon.e 2024-08-18T21:03:24.772 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-18T21:03:24.768+0000 7fa113080640 -1 mgr.server handle_report got status from non-daemon mon.d 2024-08-18T21:03:24.772 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-18T21:03:24.768+0000 7fa113080640 -1 mgr.server handle_report got status from non-daemon mon.h 2024-08-18T21:03:24.772 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-18T21:03:24.768+0000 7fa113080640 -1 mgr.server handle_report got status from non-daemon mon.g 2024-08-18T21:03:24.773 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-18T21:03:24.772+0000 7fa113080640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-18T21:03:24.773 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-18T21:03:24.772+0000 7fa113080640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-18T21:03:26.646 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-08-18T21:03:26.644+0000 7fd87b8447c0 -1 osd.5 0 log_to_monitors true 2024-08-18T21:03:26.710 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-08-18T21:03:26.706+0000 7fab0a54f7c0 -1 osd.2 0 log_to_monitors true 2024-08-18T21:03:26.716 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-18T21:03:26.714+0000 7f9d324fa7c0 -1 osd.1 0 log_to_monitors true 2024-08-18T21:03:26.841 INFO:tasks.ceph.osd.3.smithi157.stderr:2024-08-18T21:03:26.840+0000 7f64efc0e7c0 -1 osd.3 0 log_to_monitors true 2024-08-18T21:03:27.188 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-08-18T21:03:27.188+0000 7f77f1a4c7c0 -1 osd.4 0 log_to_monitors true 2024-08-18T21:03:27.318 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-08-18T21:03:27.314+0000 7f5da75af7c0 -1 osd.0 0 log_to_monitors true 2024-08-18T21:03:28.563 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-08-18T21:03:28.560+0000 7fd8777ed640 -1 osd.5 0 waiting for initial osdmap 2024-08-18T21:03:28.564 INFO:tasks.ceph.osd.3.smithi157.stderr:2024-08-18T21:03:28.560+0000 7f64ebbb7640 -1 osd.3 0 waiting for initial osdmap 2024-08-18T21:03:28.564 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-08-18T21:03:28.560+0000 7f77ed9f5640 -1 osd.4 0 waiting for initial osdmap 2024-08-18T21:03:28.566 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-18T21:03:28.562+0000 7f9d2e4a3640 -1 osd.1 0 waiting for initial osdmap 2024-08-18T21:03:28.567 INFO:tasks.ceph.osd.3.smithi157.stderr:2024-08-18T21:03:28.564+0000 7f64e79f1640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T21:03:28.569 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-08-18T21:03:28.568+0000 7fd873627640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T21:03:28.570 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-08-18T21:03:28.568+0000 7f77e982f640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T21:03:28.573 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-18T21:03:28.570+0000 7f9d2a2dd640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T21:03:29.141 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-18T21:03:29.280 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 10 monclient: get_monmap_and_config 2024-08-18T21:03:29.281 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 10 monclient: build_initial_monmap 2024-08-18T21:03:29.281 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 10 monclient: monmap: 2024-08-18T21:03:29.281 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2024-08-18T21:03:29.281 INFO:teuthology.misc.health.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:29.281 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2024-08-18T21:03:29.282510+0000 2024-08-18T21:03:29.281 INFO:teuthology.misc.health.smithi005.stderr:created 2024-08-18T21:03:29.282510+0000 2024-08-18T21:03:29.281 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:29.281 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:29.281 INFO:teuthology.misc.health.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:29.281 INFO:teuthology.misc.health.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:29.281 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:29.281 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:29.282 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:29.282 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:29.282 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:29.282 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:29.282 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:29.282 INFO:teuthology.misc.health.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:29.282 INFO:teuthology.misc.health.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:29.282 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:29.284 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 1 Processor -- start 2024-08-18T21:03:29.284 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 1 -- start start 2024-08-18T21:03:29.284 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 10 monclient: init 2024-08-18T21:03:29.284 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:29.284 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 10 monclient: _add_conns ranks=[4,0,10,7,5,2,1,3,8,6,9] 2024-08-18T21:03:29.284 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fee0c138aa0 0x7fee0c138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:29.284 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 10 monclient(hunting): picked mon.noname-c con 0x7fee0c138aa0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:29.284 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fee0c06d2a0 addr v1:172.21.15.5:6789/0 2024-08-18T21:03:29.285 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fee0c1393c0 0x7fee0c0a5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:29.285 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 10 monclient(hunting): picked mon.noname-f con 0x7fee0c1393c0 addr v2:172.21.15.157:3300/0 2024-08-18T21:03:29.285 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee0c09e050 con 0x7fee0c06d2a0 2024-08-18T21:03:29.285 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:29.285 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fee0c09f260 con 0x7fee0c1393c0 2024-08-18T21:03:29.285 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:29.285 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fee0c09e2c0 con 0x7fee0c138aa0 2024-08-18T21:03:29.285 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:29.285 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee13a00640 10 monclient(hunting): authenticate will time out at 976.295436s 2024-08-18T21:03:29.285 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee10f9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fee0c06d2a0 0x7fee0c0a4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34912/0 (socket says 172.21.15.5:34912) 2024-08-18T21:03:29.285 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee10f9b640 1 -- 172.21.15.5:0/3394617408 learned_addr learned my addr 172.21.15.5:0/3394617408 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:03:29.285 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 1 --2- 172.21.15.5:0/3394617408 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fee0c138aa0 0x7fee0c138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:29.286 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 10 monclient(hunting): get_auth_request con 0x7fee0c138aa0 auth_method 0 2024-08-18T21:03:29.286 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:29.286 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:29.286 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:29.286 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:29.286 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:29.286 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:29.286 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee11f9d640 1 --2- 172.21.15.5:0/3394617408 >> v2:172.21.15.157:3300/0 conn(0x7fee0c1393c0 0x7fee0c0a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:29.286 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee11f9d640 10 monclient(hunting): get_auth_request con 0x7fee0c1393c0 auth_method 0 2024-08-18T21:03:29.287 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee11f9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:29.287 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee11f9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:29.287 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee11f9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:29.287 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 10 monclient(hunting): handle_auth_done global_id 4225 payload 274 2024-08-18T21:03:29.287 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 1 -- 172.21.15.5:0/3394617408 >> v2:172.21.15.157:3300/0 conn(0x7fee0c1393c0 msgr2=0x7fee0c0a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:29.287 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 1 --2- 172.21.15.5:0/3394617408 >> v2:172.21.15.157:3300/0 conn(0x7fee0c1393c0 0x7fee0c0a5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:29.287 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 1 -- 172.21.15.5:0/3394617408 >> v1:172.21.15.5:6789/0 conn(0x7fee0c06d2a0 legacy=0x7fee0c0a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:29.287 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 10 monclient: _finish_hunting 0 2024-08-18T21:03:29.287 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 1 monclient: found mon.noname-c 2024-08-18T21:03:29.287 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:29.287 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:29.287 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.278+0000 7fee1179c640 1 -- 172.21.15.5:0/3394617408 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c09e5a0 con 0x7fee0c138aa0 2024-08-18T21:03:29.289 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee1179c640 1 -- 172.21.15.5:0/3394617408 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fee0c138aa0 msgr2=0x7fee0c138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:29.289 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee1179c640 1 --2- 172.21.15.5:0/3394617408 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fee0c138aa0 0x7fee0c138e80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fee080097f0 tx=0x7fee0801c360 comp rx=0 tx=0).ready entity=mon.4 client_cookie=b833e1f2cba17361 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:29.289 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee03fff640 1 -- 172.21.15.5:0/3394617408 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fee080b0070 con 0x7fee0c138aa0 2024-08-18T21:03:29.289 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee03fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:29.289 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee03fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:29.289 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee03fff640 10 monclient: dump: 2024-08-18T21:03:29.289 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2024-08-18T21:03:29.289 INFO:teuthology.misc.health.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:29.290 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:29.290 INFO:teuthology.misc.health.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:29.290 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:29.290 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:29.290 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:29.290 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:29.290 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:29.290 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:29.290 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:29.290 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:29.291 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:29.291 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:29.291 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:29.291 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:29.291 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee03fff640 10 monclient: _finish_auth 0 2024-08-18T21:03:29.291 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee03fff640 10 monclient: _check_auth_tickets 2024-08-18T21:03:29.291 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee03fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:29.291 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 5 monclient: authenticate success, global_id 4225 2024-08-18T21:03:29.291 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee03fff640 1 -- 172.21.15.5:0/3394617408 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee080aa810 con 0x7fee0c138aa0 2024-08-18T21:03:29.291 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:29.291 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee03fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:29.291 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:29.292 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 4 set_mon_vals no callback set 2024-08-18T21:03:29.292 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee03fff640 1 -- 172.21.15.5:0/3394617408 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fee080a9300 con 0x7fee0c138aa0 2024-08-18T21:03:29.292 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee03fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:29.292 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee03fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:29.292 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee03fff640 10 monclient: dump: 2024-08-18T21:03:29.292 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2024-08-18T21:03:29.292 INFO:teuthology.misc.health.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:29.292 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:29.292 INFO:teuthology.misc.health.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:29.292 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:29.292 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:29.292 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:29.292 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:29.293 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:29.293 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:29.293 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:29.293 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:29.293 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:29.293 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:29.293 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:29.293 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:29.293 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 10 monclient: shutdown 2024-08-18T21:03:29.293 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:29.294 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 1 -- 172.21.15.5:0/3394617408 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fee0c138aa0 msgr2=0x7fee0c138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:29.294 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 1 --2- 172.21.15.5:0/3394617408 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fee0c138aa0 0x7fee0c138e80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fee080097f0 tx=0x7fee0801c360 comp rx=0 tx=0).stop 2024-08-18T21:03:29.294 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 1 -- 172.21.15.5:0/3394617408 shutdown_connections 2024-08-18T21:03:29.294 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 1 --2- 172.21.15.5:0/3394617408 >> v2:172.21.15.157:3300/0 conn(0x7fee0c1393c0 0x7fee0c0a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:29.294 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 1 --2- 172.21.15.5:0/3394617408 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fee0c138aa0 0x7fee0c138e80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:29.294 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 1 -- 172.21.15.5:0/3394617408 >> 172.21.15.5:0/3394617408 conn(0x7fee0c0a6590 msgr2=0x7fee0c068690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:29.294 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 1 -- 172.21.15.5:0/3394617408 shutdown_connections 2024-08-18T21:03:29.294 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 1 -- 172.21.15.5:0/3394617408 wait complete. 2024-08-18T21:03:29.298 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 10 monclient: build_initial_monmap 2024-08-18T21:03:29.298 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 10 monclient: monmap: 2024-08-18T21:03:29.298 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2024-08-18T21:03:29.298 INFO:teuthology.misc.health.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:29.298 INFO:teuthology.misc.health.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:29.298 INFO:teuthology.misc.health.smithi005.stderr:created 0.000000 2024-08-18T21:03:29.299 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:29.299 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:29.299 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:29.299 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:29.299 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:29.299 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:29.299 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:29.299 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:29.299 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:29.299 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:29.299 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:29.299 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:29.299 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 1 Processor -- start 2024-08-18T21:03:29.299 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 1 -- start start 2024-08-18T21:03:29.300 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 10 monclient: init 2024-08-18T21:03:29.300 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:29.300 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.286+0000 7fee13a00640 10 monclient: _add_conns ranks=[6,3,0,7,8,2,5,4,1] 2024-08-18T21:03:29.300 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee13a00640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fee0c06d2a0 0x7fee0c137c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:29.300 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee13a00640 10 monclient(hunting): picked mon.noname-d con 0x7fee0c06d2a0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:29.300 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee13a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee0c138aa0 0x7fee0c13ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:29.300 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee13a00640 10 monclient(hunting): picked mon.noname-g con 0x7fee0c138aa0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:29.300 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee13a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee0c1393c0 0x7fee0c13b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:29.300 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee13a00640 10 monclient(hunting): picked mon.noname-a con 0x7fee0c1393c0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:29.300 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee13a00640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:29.300 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee13a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c1443a0 con 0x7fee0c1393c0 2024-08-18T21:03:29.300 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee13a00640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:29.300 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee13a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fee0c0a57e0 con 0x7fee0c138aa0 2024-08-18T21:03:29.301 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee13a00640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:29.301 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee13a00640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fee0c144520 con 0x7fee0c06d2a0 2024-08-18T21:03:29.301 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee13a00640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:29.301 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee13a00640 10 monclient(hunting): authenticate will time out at 976.304143s 2024-08-18T21:03:29.301 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee11f9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee0c1393c0 0x7fee0c13b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:29.301 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee11f9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee0c1393c0 0x7fee0c13b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44384/0 (socket says 172.21.15.5:44384) 2024-08-18T21:03:29.301 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fee0c06d2a0 0x7fee0c137c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:29.301 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee11f9d640 1 -- 172.21.15.5:0/2648802324 learned_addr learned my addr 172.21.15.5:0/2648802324 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:29.301 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee11f9d640 10 monclient(hunting): get_auth_request con 0x7fee0c1393c0 auth_method 0 2024-08-18T21:03:29.301 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee11f9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:29.301 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee11f9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:29.301 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee11f9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:29.301 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 10 monclient(hunting): get_auth_request con 0x7fee0c06d2a0 auth_method 0 2024-08-18T21:03:29.301 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:29.302 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:29.302 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:29.302 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:29.302 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:29.302 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:29.302 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee11f9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:29.302 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee11f9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:29.302 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee11f9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:29.302 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee10f9b640 1 --2- 172.21.15.5:0/2648802324 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee0c138aa0 0x7fee0c13ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:29.302 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee10f9b640 10 monclient(hunting): get_auth_request con 0x7fee0c138aa0 auth_method 0 2024-08-18T21:03:29.302 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee10f9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:29.302 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee10f9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:29.302 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee10f9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:29.302 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 10 monclient(hunting): handle_auth_done global_id 4200 payload 824 2024-08-18T21:03:29.303 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 1 -- 172.21.15.5:0/2648802324 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee0c138aa0 msgr2=0x7fee0c13ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:29.303 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 1 --2- 172.21.15.5:0/2648802324 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee0c138aa0 0x7fee0c13ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:29.303 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 1 -- 172.21.15.5:0/2648802324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee0c1393c0 msgr2=0x7fee0c13b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:29.303 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 1 --2- 172.21.15.5:0/2648802324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee0c1393c0 0x7fee0c13b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:29.303 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 10 monclient: _finish_hunting 0 2024-08-18T21:03:29.303 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 1 monclient: found mon.noname-d 2024-08-18T21:03:29.303 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:29.303 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:29.303 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 1 -- 172.21.15.5:0/2648802324 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c0a4800 con 0x7fee0c06d2a0 2024-08-18T21:03:29.303 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee11f9d640 1 --2- 172.21.15.5:0/2648802324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee0c1393c0 0x7fee0c13b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:29.303 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 1 -- 172.21.15.5:0/2648802324 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fee0c06d2a0 msgr2=0x7fee0c137c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:29.303 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee1179c640 1 --2- 172.21.15.5:0/2648802324 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fee0c06d2a0 0x7fee0c137c80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fee080ab000 tx=0x7fee08019100 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:29.303 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee01ffb640 1 -- 172.21.15.5:0/2648802324 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fee080b0040 con 0x7fee0c06d2a0 2024-08-18T21:03:29.303 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:29.303 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee01ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:29.304 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee01ffb640 10 monclient: dump: 2024-08-18T21:03:29.304 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2024-08-18T21:03:29.304 INFO:teuthology.misc.health.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:29.304 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:29.304 INFO:teuthology.misc.health.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:29.304 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:29.304 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:29.304 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:29.304 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:29.304 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:29.304 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:29.304 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:29.304 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:29.305 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:29.305 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:29.305 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:29.305 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:29.305 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee01ffb640 10 monclient: _finish_auth 0 2024-08-18T21:03:29.305 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee01ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:03:29.305 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee01ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:29.305 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee13a00640 5 monclient: authenticate success, global_id 4200 2024-08-18T21:03:29.305 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee01ffb640 1 -- 172.21.15.5:0/2648802324 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee080044b0 con 0x7fee0c06d2a0 2024-08-18T21:03:29.305 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee01ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:29.305 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee01ffb640 1 -- 172.21.15.5:0/2648802324 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fee08003a90 con 0x7fee0c06d2a0 2024-08-18T21:03:29.305 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:29.305 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee01ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:29.305 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee037fe640 4 set_mon_vals no callback set 2024-08-18T21:03:29.306 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.290+0000 7fee01ffb640 10 monclient: dump: 2024-08-18T21:03:29.306 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2024-08-18T21:03:29.306 INFO:teuthology.misc.health.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:29.306 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:29.306 INFO:teuthology.misc.health.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:29.306 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:29.306 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:29.306 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:29.306 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:29.306 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:29.306 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:29.306 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:29.306 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:29.306 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:29.307 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:29.307 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:29.307 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:29.307 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.294+0000 7fee13a00640 10 monclient: _renew_subs 2024-08-18T21:03:29.307 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.294+0000 7fee13a00640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:29.307 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.294+0000 7fee13a00640 1 -- 172.21.15.5:0/2648802324 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee0c133960 con 0x7fee0c06d2a0 2024-08-18T21:03:29.307 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.294+0000 7fee13a00640 10 monclient: _renew_subs 2024-08-18T21:03:29.307 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.294+0000 7fee13a00640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:29.307 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.294+0000 7fee13a00640 1 -- 172.21.15.5:0/2648802324 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fee0c13d310 con 0x7fee0c06d2a0 2024-08-18T21:03:29.307 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.294+0000 7fee13a00640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:29.307 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.294+0000 7fee13a00640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:29.307 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.294+0000 7fee13a00640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:29.307 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.294+0000 7fee13a00640 1 -- 172.21.15.5:0/2648802324 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee0c138e80 con 0x7fee0c06d2a0 2024-08-18T21:03:29.307 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.294+0000 7fee01ffb640 1 -- 172.21.15.5:0/2648802324 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 4) ==== 47702+0+0 (secure 0 0 0) 0x7fee080bb020 con 0x7fee0c06d2a0 2024-08-18T21:03:29.307 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.294+0000 7fee01ffb640 1 --2- 172.21.15.5:0/2648802324 >> v2:172.21.15.157:6812/631023601 conn(0x7fedf003bd30 0x7fedf003e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:29.308 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.294+0000 7fee01ffb640 1 -- 172.21.15.5:0/2648802324 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(10..10 src has 1..10) ==== 1911+0+0 (secure 0 0 0) 0x7fee080b9020 con 0x7fee0c06d2a0 2024-08-18T21:03:29.308 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.294+0000 7fee10f9b640 1 --2- 172.21.15.5:0/2648802324 >> v2:172.21.15.157:6812/631023601 conn(0x7fedf003bd30 0x7fedf003e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:29.308 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.294+0000 7fee10f9b640 10 monclient: get_auth_request con 0x7fedf003bd30 auth_method 0 2024-08-18T21:03:29.308 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.298+0000 7fee10f9b640 1 --2- 172.21.15.5:0/2648802324 >> v2:172.21.15.157:6812/631023601 conn(0x7fedf003bd30 0x7fedf003e1f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fee0c13bec0 tx=0x7fedfc009040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:29.308 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.302+0000 7fee01ffb640 1 -- 172.21.15.5:0/2648802324 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fee08016070 con 0x7fee0c06d2a0 2024-08-18T21:03:29.308 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.302+0000 7fee01ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:29.308 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.302+0000 7fee01ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:29.347 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-08-18T21:03:29.346+0000 7fab06d0a640 -1 osd.2 0 waiting for initial osdmap 2024-08-18T21:03:29.350 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-08-18T21:03:29.346+0000 7faafe32a640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T21:03:29.473 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.470+0000 7fee13a00640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:29.473 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.470+0000 7fee13a00640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:29.473 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.470+0000 7fee13a00640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:29.473 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.470+0000 7fee13a00640 1 -- 172.21.15.5:0/2648802324 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee0c064590 con 0x7fee0c06d2a0 2024-08-18T21:03:29.474 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.470+0000 7fee01ffb640 1 -- 172.21.15.5:0/2648802324 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+5606 (secure 0 0 0) 0x7fee080aa7e0 con 0x7fee0c06d2a0 2024-08-18T21:03:29.474 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.470+0000 7fee01ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:29.474 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.470+0000 7fee01ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:29.474 INFO:teuthology.misc.health.smithi005.stdout: 2024-08-18T21:03:29.474 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","created":"2024-08-18T21:03:17.118714+0000","modified":"2024-08-18T21:03:28.211093+0000","last_up_change":"0.000000","last_in_change":"2024-08-18T21:03:21.231242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8f6d162e-ed99-408f-87c5-4880e57b4f0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"99984157-5771-44d0-b5fa-c3e5b2537e67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00fd1d05-f5a1-4d89-8e2c-47a61392f500","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8bb1ba33-9e75-43ee-bbfc-7ab22350e4a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f7043f2f-d6d1-4c40-bf70-80a10071a795","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6d9d2c91-ec42-46cf-9b18-8c488f1f489c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T21:03:29.476 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.474+0000 7fee13a00640 1 -- 172.21.15.5:0/2648802324 >> v2:172.21.15.157:6812/631023601 conn(0x7fedf003bd30 msgr2=0x7fedf003e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:29.476 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.474+0000 7fee13a00640 1 --2- 172.21.15.5:0/2648802324 >> v2:172.21.15.157:6812/631023601 conn(0x7fedf003bd30 0x7fedf003e1f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fee0c13bec0 tx=0x7fedfc009040 comp rx=0 tx=0).stop 2024-08-18T21:03:29.476 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.474+0000 7fee13a00640 10 monclient: shutdown 2024-08-18T21:03:29.476 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.474+0000 7fee13a00640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:29.476 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.474+0000 7fee13a00640 1 -- 172.21.15.5:0/2648802324 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fee0c06d2a0 msgr2=0x7fee0c137c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:29.476 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.474+0000 7fee13a00640 1 --2- 172.21.15.5:0/2648802324 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fee0c06d2a0 0x7fee0c137c80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fee080ab000 tx=0x7fee08019100 comp rx=0 tx=0).stop 2024-08-18T21:03:29.476 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.474+0000 7fee13a00640 1 -- 172.21.15.5:0/2648802324 shutdown_connections 2024-08-18T21:03:29.476 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.474+0000 7fee13a00640 1 --2- 172.21.15.5:0/2648802324 >> v2:172.21.15.157:6812/631023601 conn(0x7fedf003bd30 0x7fedf003e1f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:29.477 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.474+0000 7fee13a00640 1 --2- 172.21.15.5:0/2648802324 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee0c138aa0 0x7fee0c13ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:29.477 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.474+0000 7fee13a00640 1 --2- 172.21.15.5:0/2648802324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee0c1393c0 0x7fee0c13b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:29.477 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.474+0000 7fee13a00640 1 --2- 172.21.15.5:0/2648802324 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fee0c06d2a0 0x7fee0c137c80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:29.477 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.474+0000 7fee13a00640 1 -- 172.21.15.5:0/2648802324 >> 172.21.15.5:0/2648802324 conn(0x7fee0c0a6590 msgr2=0x7fee0c0a6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:29.477 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.474+0000 7fee13a00640 1 -- 172.21.15.5:0/2648802324 shutdown_connections 2024-08-18T21:03:29.477 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:29.474+0000 7fee13a00640 1 -- 172.21.15.5:0/2648802324 wait complete. 2024-08-18T21:03:29.490 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-08-18T21:03:29.567 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-08-18T21:03:29.566+0000 7f5da3558640 -1 osd.0 0 waiting for initial osdmap 2024-08-18T21:03:29.576 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-08-18T21:03:29.574+0000 7f5d9f392640 -1 osd.0 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T21:03:36.095 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-18T21:03:36.222 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.217+0000 7fb33a002640 10 monclient: get_monmap_and_config 2024-08-18T21:03:36.222 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.217+0000 7fb33a002640 10 monclient: build_initial_monmap 2024-08-18T21:03:36.222 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.217+0000 7fb33a002640 10 monclient: monmap: 2024-08-18T21:03:36.222 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2024-08-18T21:03:36.222 INFO:teuthology.misc.health.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:36.222 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2024-08-18T21:03:36.223691+0000 2024-08-18T21:03:36.222 INFO:teuthology.misc.health.smithi005.stderr:created 2024-08-18T21:03:36.223691+0000 2024-08-18T21:03:36.222 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:36.222 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:36.223 INFO:teuthology.misc.health.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:36.223 INFO:teuthology.misc.health.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:36.223 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:36.223 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:36.223 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:36.223 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:36.223 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:36.223 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:36.223 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:36.223 INFO:teuthology.misc.health.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:36.223 INFO:teuthology.misc.health.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:36.223 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:36.225 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 1 Processor -- start 2024-08-18T21:03:36.225 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 1 -- start start 2024-08-18T21:03:36.225 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 10 monclient: init 2024-08-18T21:03:36.226 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:36.226 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 10 monclient: _add_conns ranks=[3,0,6,2,8,7,9,4,10,1,5] 2024-08-18T21:03:36.226 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb334139c90 0x7fb33409eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:36.226 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 10 monclient(hunting): picked mon.noname-g con 0x7fb334139c90 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:36.226 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb33413a070 addr v1:172.21.15.5:6789/0 2024-08-18T21:03:36.226 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb33413a4b0 0x7fb3340a7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:36.226 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 10 monclient(hunting): picked mon.noname-d con 0x7fb33413a4b0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:36.226 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb33409d9e0 con 0x7fb33413a070 2024-08-18T21:03:36.226 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:36.226 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb33409de90 con 0x7fb334139c90 2024-08-18T21:03:36.226 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:36.226 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fb33406f9c0 con 0x7fb33413a4b0 2024-08-18T21:03:36.226 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:36.227 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb33a002640 10 monclient(hunting): authenticate will time out at 983.237103s 2024-08-18T21:03:36.227 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb33413a4b0 0x7fb3340a7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:36.227 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb332ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb33413a070 0x7fb3340a6b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51270/0 (socket says 172.21.15.5:51270) 2024-08-18T21:03:36.227 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb332ffd640 1 -- 172.21.15.5:0/3341386071 learned_addr learned my addr 172.21.15.5:0/3341386071 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:03:36.227 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 10 monclient(hunting): get_auth_request con 0x7fb33413a4b0 auth_method 0 2024-08-18T21:03:36.227 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:36.227 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:36.227 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:36.227 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb3337fe640 1 --2- 172.21.15.5:0/3341386071 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb334139c90 0x7fb33409eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:36.227 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:36.227 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:36.227 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:36.227 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb3337fe640 10 monclient(hunting): get_auth_request con 0x7fb334139c90 auth_method 0 2024-08-18T21:03:36.228 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb3337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:36.228 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb3337fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:36.228 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb3337fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:36.228 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb3337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:36.228 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb3337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:36.228 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb3337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:36.228 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 10 monclient(hunting): handle_auth_done global_id 4218 payload 274 2024-08-18T21:03:36.228 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 1 -- 172.21.15.5:0/3341386071 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb334139c90 msgr2=0x7fb33409eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:36.228 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 1 --2- 172.21.15.5:0/3341386071 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb334139c90 0x7fb33409eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.228 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 1 -- 172.21.15.5:0/3341386071 >> v1:172.21.15.5:6789/0 conn(0x7fb33413a070 legacy=0x7fb3340a6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:36.228 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 10 monclient: _finish_hunting 0 2024-08-18T21:03:36.228 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 1 monclient: found mon.noname-d 2024-08-18T21:03:36.228 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:36.228 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:36.229 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.221+0000 7fb333fff640 1 -- 172.21.15.5:0/3341386071 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33409e730 con 0x7fb33413a4b0 2024-08-18T21:03:36.230 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb333fff640 1 -- 172.21.15.5:0/3341386071 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb33413a4b0 msgr2=0x7fb3340a7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:36.230 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb333fff640 1 --2- 172.21.15.5:0/3341386071 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb33413a4b0 0x7fb3340a7220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0097f0 tx=0x7fb32c01c3a0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=e6a2d1e1fc7b100a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:36.230 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb3327fc640 1 -- 172.21.15.5:0/3341386071 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb32c0b0070 con 0x7fb33413a4b0 2024-08-18T21:03:36.230 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb3327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:36.230 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb3327fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:36.231 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb3327fc640 10 monclient: dump: 2024-08-18T21:03:36.231 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2024-08-18T21:03:36.231 INFO:teuthology.misc.health.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:36.231 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:36.231 INFO:teuthology.misc.health.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:36.231 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:36.231 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:36.231 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:36.231 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:36.231 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:36.231 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:36.231 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:36.231 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:36.232 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:36.232 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:36.232 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:36.232 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:36.232 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb3327fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:36.232 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb3327fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:36.232 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb3327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:36.232 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb3327fc640 1 -- 172.21.15.5:0/3341386071 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32c0aa810 con 0x7fb33413a4b0 2024-08-18T21:03:36.232 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb33a002640 5 monclient: authenticate success, global_id 4218 2024-08-18T21:03:36.232 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb33a002640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:36.232 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb3327fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:36.232 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb3327fc640 1 -- 172.21.15.5:0/3341386071 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb32c0a9300 con 0x7fb33413a4b0 2024-08-18T21:03:36.232 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb33a002640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:36.232 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb33a002640 4 set_mon_vals no callback set 2024-08-18T21:03:36.233 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb3327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:36.233 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb3327fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:36.233 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb3327fc640 10 monclient: dump: 2024-08-18T21:03:36.233 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2024-08-18T21:03:36.233 INFO:teuthology.misc.health.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:36.233 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:36.233 INFO:teuthology.misc.health.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:36.233 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:36.233 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:36.233 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:36.233 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:36.233 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:36.233 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:36.234 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:36.234 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:36.234 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:36.234 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:36.234 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:36.234 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:36.234 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb33a002640 10 monclient: shutdown 2024-08-18T21:03:36.234 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb33a002640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:36.234 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb33a002640 1 -- 172.21.15.5:0/3341386071 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb33413a4b0 msgr2=0x7fb3340a7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:36.234 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb33a002640 1 --2- 172.21.15.5:0/3341386071 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb33413a4b0 0x7fb3340a7220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0097f0 tx=0x7fb32c01c3a0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.234 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb33a002640 1 -- 172.21.15.5:0/3341386071 shutdown_connections 2024-08-18T21:03:36.234 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb33a002640 1 --2- 172.21.15.5:0/3341386071 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb33413a4b0 0x7fb3340a7220 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.234 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb33a002640 1 --2- 172.21.15.5:0/3341386071 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb334139c90 0x7fb33409eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.234 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb33a002640 1 -- 172.21.15.5:0/3341386071 >> 172.21.15.5:0/3341386071 conn(0x7fb3340a8c10 msgr2=0x7fb3340a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:36.235 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb33a002640 1 -- 172.21.15.5:0/3341386071 shutdown_connections 2024-08-18T21:03:36.235 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb33a002640 1 -- 172.21.15.5:0/3341386071 wait complete. 2024-08-18T21:03:36.235 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb33a002640 10 monclient: build_initial_monmap 2024-08-18T21:03:36.235 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.225+0000 7fb33a002640 10 monclient: monmap: 2024-08-18T21:03:36.235 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2024-08-18T21:03:36.235 INFO:teuthology.misc.health.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:36.235 INFO:teuthology.misc.health.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:36.235 INFO:teuthology.misc.health.smithi005.stderr:created 0.000000 2024-08-18T21:03:36.235 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:36.235 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:36.235 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:36.235 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:36.235 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:36.236 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:36.236 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:36.236 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:36.236 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:36.236 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:36.236 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:36.236 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:36.240 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 1 Processor -- start 2024-08-18T21:03:36.240 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 1 -- start start 2024-08-18T21:03:36.240 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 10 monclient: init 2024-08-18T21:03:36.240 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:36.240 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 10 monclient: _add_conns ranks=[7,2,0,8,5,4,3,6,1] 2024-08-18T21:03:36.240 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb334139c90 0x7fb33413a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:36.240 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 10 monclient(hunting): picked mon.noname-i con 0x7fb334139c90 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:36.241 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb33413a070 0x7fb33413add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:36.241 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 10 monclient(hunting): picked mon.noname-b con 0x7fb33413a070 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:36.241 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb33413a4b0 0x7fb33413b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:36.241 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 10 monclient(hunting): picked mon.noname-a con 0x7fb33413a4b0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:36.241 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:36.241 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb334144350 con 0x7fb33413a4b0 2024-08-18T21:03:36.241 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:36.241 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fb3340a7970 con 0x7fb33413a070 2024-08-18T21:03:36.241 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:36.241 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fb3341444d0 con 0x7fb334139c90 2024-08-18T21:03:36.241 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:36.241 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb33a002640 10 monclient(hunting): authenticate will time out at 983.244925s 2024-08-18T21:03:36.241 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb33413a070 0x7fb33413add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:36.242 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb333fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb33413a4b0 0x7fb33413b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:36.242 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb33413a070 0x7fb33413add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33160/0 (socket says 172.21.15.5:33160) 2024-08-18T21:03:36.242 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 1 -- 172.21.15.5:0/3053445449 learned_addr learned my addr 172.21.15.5:0/3053445449 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:36.242 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 10 monclient(hunting): get_auth_request con 0x7fb33413a070 auth_method 0 2024-08-18T21:03:36.242 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:36.242 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:36.242 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:36.242 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb333fff640 10 monclient(hunting): get_auth_request con 0x7fb33413a4b0 auth_method 0 2024-08-18T21:03:36.242 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb333fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:36.242 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb333fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:36.242 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb333fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:36.242 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:36.242 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:36.243 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:36.243 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb333fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:36.243 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb333fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:36.243 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb333fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:36.243 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb3337fe640 1 --2- 172.21.15.5:0/3053445449 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb334139c90 0x7fb33413a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:36.243 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb3337fe640 10 monclient(hunting): get_auth_request con 0x7fb334139c90 auth_method 0 2024-08-18T21:03:36.243 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb3337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:36.243 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb3337fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:36.243 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb3337fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:36.243 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 10 monclient(hunting): handle_auth_done global_id 4250 payload 824 2024-08-18T21:03:36.243 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 1 -- 172.21.15.5:0/3053445449 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb334139c90 msgr2=0x7fb33413a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:36.243 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 1 --2- 172.21.15.5:0/3053445449 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb334139c90 0x7fb33413a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.243 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 1 -- 172.21.15.5:0/3053445449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb33413a4b0 msgr2=0x7fb33413b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:36.243 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 1 --2- 172.21.15.5:0/3053445449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb33413a4b0 0x7fb33413b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.244 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:03:36.244 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 1 monclient: found mon.noname-b 2024-08-18T21:03:36.244 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:36.244 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:36.244 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 1 -- 172.21.15.5:0/3053445449 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3341413a0 con 0x7fb33413a070 2024-08-18T21:03:36.244 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb333fff640 1 --2- 172.21.15.5:0/3053445449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb33413a4b0 0x7fb33413b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:36.244 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 1 -- 172.21.15.5:0/3053445449 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb33413a070 msgr2=0x7fb33413add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:36.244 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb332ffd640 1 --2- 172.21.15.5:0/3053445449 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb33413a070 0x7fb33413add0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb32800cb70 tx=0x7fb32800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:36.244 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb31bfff640 1 -- 172.21.15.5:0/3053445449 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb32800ad50 con 0x7fb33413a070 2024-08-18T21:03:36.244 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb31bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:36.244 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb31bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:36.244 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb31bfff640 10 monclient: dump: 2024-08-18T21:03:36.244 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2024-08-18T21:03:36.245 INFO:teuthology.misc.health.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:36.245 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:36.245 INFO:teuthology.misc.health.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:36.245 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:36.245 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:36.245 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:36.245 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:36.245 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:36.245 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:36.245 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:36.245 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:36.245 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:36.245 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:36.245 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:36.246 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:36.246 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb31bfff640 10 monclient: _finish_auth 0 2024-08-18T21:03:36.246 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.229+0000 7fb31bfff640 10 monclient: _check_auth_tickets 2024-08-18T21:03:36.246 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb31bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:36.246 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb31bfff640 1 -- 172.21.15.5:0/3053445449 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb328012870 con 0x7fb33413a070 2024-08-18T21:03:36.246 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb31bfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:36.246 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb31bfff640 1 -- 172.21.15.5:0/3053445449 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb328007070 con 0x7fb33413a070 2024-08-18T21:03:36.246 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb31bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:36.246 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb31bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:36.246 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb31bfff640 10 monclient: dump: 2024-08-18T21:03:36.246 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2024-08-18T21:03:36.246 INFO:teuthology.misc.health.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:36.246 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:36.247 INFO:teuthology.misc.health.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:36.247 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:36.247 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:36.247 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:36.247 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:36.247 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:36.247 INFO:teuthology.misc.health.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:36.247 INFO:teuthology.misc.health.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:36.247 INFO:teuthology.misc.health.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:36.247 INFO:teuthology.misc.health.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:36.247 INFO:teuthology.misc.health.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:36.247 INFO:teuthology.misc.health.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:36.247 INFO:teuthology.misc.health.smithi005.stderr: 2024-08-18T21:03:36.248 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb33a002640 5 monclient: authenticate success, global_id 4250 2024-08-18T21:03:36.248 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb3317fa640 4 set_mon_vals no callback set 2024-08-18T21:03:36.248 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb33a002640 10 monclient: _renew_subs 2024-08-18T21:03:36.248 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb33a002640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:36.248 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb33a002640 1 -- 172.21.15.5:0/3053445449 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33413d470 con 0x7fb33413a070 2024-08-18T21:03:36.248 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb33a002640 10 monclient: _renew_subs 2024-08-18T21:03:36.248 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb33a002640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:36.248 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb33a002640 1 -- 172.21.15.5:0/3053445449 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3340aaf90 con 0x7fb33413a070 2024-08-18T21:03:36.248 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb33a002640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:36.248 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb33a002640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:36.248 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb33a002640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:36.248 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb33a002640 1 -- 172.21.15.5:0/3053445449 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb33409eb50 con 0x7fb33413a070 2024-08-18T21:03:36.248 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb31bfff640 1 -- 172.21.15.5:0/3053445449 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fb328012400 con 0x7fb33413a070 2024-08-18T21:03:36.248 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb31bfff640 1 --2- 172.21.15.5:0/3053445449 >> v2:172.21.15.157:6812/631023601 conn(0x7fb32003bdf0 0x7fb32003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:36.249 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb31bfff640 1 -- 172.21.15.5:0/3053445449 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(15..15 src has 1..15) ==== 3153+0+0 (secure 0 0 0) 0x7fb32804ea60 con 0x7fb33413a070 2024-08-18T21:03:36.249 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb3337fe640 1 --2- 172.21.15.5:0/3053445449 >> v2:172.21.15.157:6812/631023601 conn(0x7fb32003bdf0 0x7fb32003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:36.249 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.233+0000 7fb3337fe640 10 monclient: get_auth_request con 0x7fb32003bdf0 auth_method 0 2024-08-18T21:03:36.249 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.237+0000 7fb3337fe640 1 --2- 172.21.15.5:0/3053445449 >> v2:172.21.15.157:6812/631023601 conn(0x7fb32003bdf0 0x7fb32003e2b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb324009af0 tx=0x7fb324008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:36.249 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.237+0000 7fb31bfff640 1 -- 172.21.15.5:0/3053445449 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fb328012cb0 con 0x7fb33413a070 2024-08-18T21:03:36.249 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.237+0000 7fb31bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:36.249 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.237+0000 7fb31bfff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:36.411 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.409+0000 7fb33a002640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:36.411 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.409+0000 7fb33a002640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:36.411 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.409+0000 7fb33a002640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:36.411 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.409+0000 7fb33a002640 1 -- 172.21.15.5:0/3053445449 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb334064590 con 0x7fb33413a070 2024-08-18T21:03:36.412 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.409+0000 7fb31bfff640 1 -- 172.21.15.5:0/3053445449 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+9017 (secure 0 0 0) 0x7fb328007250 con 0x7fb33413a070 2024-08-18T21:03:36.412 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.409+0000 7fb31bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:36.412 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.409+0000 7fb31bfff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:36.413 INFO:teuthology.misc.health.smithi005.stdout: 2024-08-18T21:03:36.413 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":15,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","created":"2024-08-18T21:03:17.118714+0000","modified":"2024-08-18T21:03:34.058185+0000","last_up_change":"2024-08-18T21:03:30.570125+0000","last_in_change":"2024-08-18T21:03:21.231242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T21:03:31.386335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f6d162e-ed99-408f-87c5-4880e57b4f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":150392090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":150392090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":150392090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":150392090}]},"public_addr":"172.21.15.5:6808/150392090","cluster_addr":"172.21.15.5:6809/150392090","heartbeat_back_addr":"172.21.15.5:6811/150392090","heartbeat_front_addr":"172.21.15.5:6810/150392090","state":["exists","up"]},{"osd":1,"uuid":"99984157-5771-44d0-b5fa-c3e5b2537e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1057536297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6805","nonce":1057536297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":1057536297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1057536297}]},"public_addr":"172.21.15.5:6804/1057536297","cluster_addr":"172.21.15.5:6805/1057536297","heartbeat_back_addr":"172.21.15.5:6807/1057536297","heartbeat_front_addr":"172.21.15.5:6806/1057536297","state":["exists","up"]},{"osd":2,"uuid":"00fd1d05-f5a1-4d89-8e2c-47a61392f500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3354229361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":3354229361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":3354229361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3354229361}]},"public_addr":"172.21.15.5:6800/3354229361","cluster_addr":"172.21.15.5:6801/3354229361","heartbeat_back_addr":"172.21.15.5:6803/3354229361","heartbeat_front_addr":"172.21.15.5:6802/3354229361","state":["exists","up"]},{"osd":3,"uuid":"8bb1ba33-9e75-43ee-bbfc-7ab22350e4a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1750098759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6805","nonce":1750098759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":1750098759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1750098759}]},"public_addr":"172.21.15.157:6804/1750098759","cluster_addr":"172.21.15.157:6805/1750098759","heartbeat_back_addr":"172.21.15.157:6807/1750098759","heartbeat_front_addr":"172.21.15.157:6806/1750098759","state":["exists","up"]},{"osd":4,"uuid":"f7043f2f-d6d1-4c40-bf70-80a10071a795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":269684279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":269684279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":269684279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":269684279}]},"public_addr":"172.21.15.157:6808/269684279","cluster_addr":"172.21.15.157:6809/269684279","heartbeat_back_addr":"172.21.15.157:6811/269684279","heartbeat_front_addr":"172.21.15.157:6810/269684279","state":["exists","up"]},{"osd":5,"uuid":"6d9d2c91-ec42-46cf-9b18-8c488f1f489c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2335500119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6801","nonce":2335500119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":2335500119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2335500119}]},"public_addr":"172.21.15.157:6800/2335500119","cluster_addr":"172.21.15.157:6801/2335500119","heartbeat_back_addr":"172.21.15.157:6803/2335500119","heartbeat_front_addr":"172.21.15.157:6802/2335500119","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:28.290592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.700001+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.705490+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.882949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:28.204174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.630992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T21:03:36.415 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.413+0000 7fb33a002640 1 -- 172.21.15.5:0/3053445449 >> v2:172.21.15.157:6812/631023601 conn(0x7fb32003bdf0 msgr2=0x7fb32003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:36.415 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.413+0000 7fb33a002640 1 --2- 172.21.15.5:0/3053445449 >> v2:172.21.15.157:6812/631023601 conn(0x7fb32003bdf0 0x7fb32003e2b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb324009af0 tx=0x7fb324008040 comp rx=0 tx=0).stop 2024-08-18T21:03:36.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.413+0000 7fb33a002640 10 monclient: shutdown 2024-08-18T21:03:36.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.413+0000 7fb33a002640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:36.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.413+0000 7fb33a002640 1 -- 172.21.15.5:0/3053445449 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb33413a070 msgr2=0x7fb33413add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:36.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.413+0000 7fb33a002640 1 --2- 172.21.15.5:0/3053445449 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb33413a070 0x7fb33413add0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb32800cb70 tx=0x7fb32800a430 comp rx=0 tx=0).stop 2024-08-18T21:03:36.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.413+0000 7fb33a002640 1 -- 172.21.15.5:0/3053445449 shutdown_connections 2024-08-18T21:03:36.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.413+0000 7fb33a002640 1 --2- 172.21.15.5:0/3053445449 >> v2:172.21.15.157:6812/631023601 conn(0x7fb32003bdf0 0x7fb32003e2b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.413+0000 7fb33a002640 1 --2- 172.21.15.5:0/3053445449 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb33413a070 0x7fb33413add0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.413+0000 7fb33a002640 1 --2- 172.21.15.5:0/3053445449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb33413a4b0 0x7fb33413b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.413+0000 7fb33a002640 1 --2- 172.21.15.5:0/3053445449 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb334139c90 0x7fb33413a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.413+0000 7fb33a002640 1 -- 172.21.15.5:0/3053445449 >> 172.21.15.5:0/3053445449 conn(0x7fb3340a8c10 msgr2=0x7fb3340a1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:36.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.413+0000 7fb33a002640 1 -- 172.21.15.5:0/3053445449 shutdown_connections 2024-08-18T21:03:36.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T21:03:36.413+0000 7fb33a002640 1 -- 172.21.15.5:0/3053445449 wait complete. 2024-08-18T21:03:36.431 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-08-18T21:03:36.431 INFO:tasks.ceph:Creating RBD pool 2024-08-18T21:03:36.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd pool create rbd 8 2024-08-18T21:03:36.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.545+0000 7fe1b7905640 10 monclient: get_monmap_and_config 2024-08-18T21:03:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.545+0000 7fe1b7905640 10 monclient: build_initial_monmap 2024-08-18T21:03:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 10 monclient: monmap: 2024-08-18T21:03:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:36.552481+0000 2024-08-18T21:03:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:36.552481+0000 2024-08-18T21:03:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:36.552 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:36.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 1 Processor -- start 2024-08-18T21:03:36.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 1 -- start start 2024-08-18T21:03:36.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 10 monclient: init 2024-08-18T21:03:36.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:36.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 10 monclient: _add_conns ranks=[9,7,5,4,0,10,6,3,8,1,2] 2024-08-18T21:03:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe1b00a5ac0 0x7fe1b00a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 10 monclient(hunting): picked mon.noname-a con 0x7fe1b00a5ac0 addr v2:172.21.15.5:3300/0 2024-08-18T21:03:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe1b00a0cd0 0x7fe1b00a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 10 monclient(hunting): picked mon.noname-i con 0x7fe1b00a0cd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe1b0139c60 0x7fe1b013a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 10 monclient(hunting): picked mon.noname-h con 0x7fe1b0139c60 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe1b006e500 con 0x7fe1b00a5ac0 2024-08-18T21:03:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe1b00a6920 con 0x7fe1b0139c60 2024-08-18T21:03:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fe1b00a1790 con 0x7fe1b00a0cd0 2024-08-18T21:03:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b7905640 10 monclient(hunting): authenticate will time out at 983.565803s 2024-08-18T21:03:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe1b00a5ac0 0x7fe1b00a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe1b00a5ac0 0x7fe1b00a5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55264/0 (socket says 172.21.15.5:55264) 2024-08-18T21:03:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 1 -- 172.21.15.5:0/1642217319 learned_addr learned my addr 172.21.15.5:0/1642217319 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 10 monclient(hunting): get_auth_request con 0x7fe1b00a5ac0 auth_method 0 2024-08-18T21:03:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b5ea2640 1 --2- 172.21.15.5:0/1642217319 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe1b0139c60 0x7fe1b013a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b4ea0640 1 --2- 172.21.15.5:0/1642217319 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe1b00a0cd0 0x7fe1b00a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b5ea2640 10 monclient(hunting): get_auth_request con 0x7fe1b0139c60 auth_method 0 2024-08-18T21:03:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b5ea2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b5ea2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b5ea2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b4ea0640 10 monclient(hunting): get_auth_request con 0x7fe1b00a0cd0 auth_method 0 2024-08-18T21:03:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b4ea0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b4ea0640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b4ea0640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b5ea2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b5ea2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b5ea2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 10 monclient(hunting): handle_auth_done global_id 4248 payload 274 2024-08-18T21:03:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 1 -- 172.21.15.5:0/1642217319 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe1b00a0cd0 msgr2=0x7fe1b00a63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 1 --2- 172.21.15.5:0/1642217319 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe1b00a0cd0 0x7fe1b00a63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 1 -- 172.21.15.5:0/1642217319 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe1b0139c60 msgr2=0x7fe1b013a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 1 --2- 172.21.15.5:0/1642217319 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe1b0139c60 0x7fe1b013a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 10 monclient: _finish_hunting 0 2024-08-18T21:03:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 1 monclient: found mon.noname-a 2024-08-18T21:03:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b56a1640 1 -- 172.21.15.5:0/1642217319 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b006de40 con 0x7fe1b00a5ac0 2024-08-18T21:03:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.549+0000 7fe1b4ea0640 1 --2- 172.21.15.5:0/1642217319 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe1b00a0cd0 0x7fe1b00a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:03:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b56a1640 1 -- 172.21.15.5:0/1642217319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1b00a5ac0 msgr2=0x7fe1b00a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b56a1640 1 --2- 172.21.15.5:0/1642217319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1b00a5ac0 0x7fe1b00a5ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009870 tx=0x7fe1ac01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4dfdfd598445f0f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1a7fff640 1 -- 172.21.15.5:0/1642217319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe1ac0b0070 con 0x7fe1b00a5ac0 2024-08-18T21:03:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1a7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1a7fff640 10 monclient: dump: 2024-08-18T21:03:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:36.564 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1a7fff640 10 monclient: _finish_auth 0 2024-08-18T21:03:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1a7fff640 10 monclient: _check_auth_tickets 2024-08-18T21:03:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b7905640 5 monclient: authenticate success, global_id 4248 2024-08-18T21:03:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b7905640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1a7fff640 1 -- 172.21.15.5:0/1642217319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1ac0aa810 con 0x7fe1b00a5ac0 2024-08-18T21:03:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1a7fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1a7fff640 1 -- 172.21.15.5:0/1642217319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe1ac0a9300 con 0x7fe1b00a5ac0 2024-08-18T21:03:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b7905640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b7905640 4 set_mon_vals no callback set 2024-08-18T21:03:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1a7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1a7fff640 10 monclient: dump: 2024-08-18T21:03:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:36.567 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b7905640 10 monclient: shutdown 2024-08-18T21:03:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b7905640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b7905640 1 -- 172.21.15.5:0/1642217319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1b00a5ac0 msgr2=0x7fe1b00a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b7905640 1 --2- 172.21.15.5:0/1642217319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1b00a5ac0 0x7fe1b00a5ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009870 tx=0x7fe1ac01c3f0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b7905640 1 -- 172.21.15.5:0/1642217319 shutdown_connections 2024-08-18T21:03:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b7905640 1 --2- 172.21.15.5:0/1642217319 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe1b0139c60 0x7fe1b013a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b7905640 1 --2- 172.21.15.5:0/1642217319 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe1b00a0cd0 0x7fe1b00a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b7905640 1 --2- 172.21.15.5:0/1642217319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1b00a5ac0 0x7fe1b00a5ea0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b7905640 1 -- 172.21.15.5:0/1642217319 >> 172.21.15.5:0/1642217319 conn(0x7fe1b00aa770 msgr2=0x7fe1b00a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b7905640 1 -- 172.21.15.5:0/1642217319 shutdown_connections 2024-08-18T21:03:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.553+0000 7fe1b7905640 1 -- 172.21.15.5:0/1642217319 wait complete. 2024-08-18T21:03:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 10 monclient: build_initial_monmap 2024-08-18T21:03:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 10 monclient: monmap: 2024-08-18T21:03:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:36.569 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 1 Processor -- start 2024-08-18T21:03:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 1 -- start start 2024-08-18T21:03:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 10 monclient: init 2024-08-18T21:03:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 10 monclient: _add_conns ranks=[7,4,5,2,6,0,1,8,3] 2024-08-18T21:03:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe1b00a0cd0 0x7fe1b0138640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 10 monclient(hunting): picked mon.noname-i con 0x7fe1b00a0cd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1b00a5ac0 0x7fe1b0138b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 10 monclient(hunting): picked mon.noname-c con 0x7fe1b00a5ac0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe1b0139c60 0x7fe1b013bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 10 monclient(hunting): picked mon.noname-h con 0x7fe1b0139c60 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fe1b00a7870 con 0x7fe1b00a5ac0 2024-08-18T21:03:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe1b00a76f0 con 0x7fe1b0139c60 2024-08-18T21:03:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fe1b006e160 con 0x7fe1b00a0cd0 2024-08-18T21:03:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b7905640 10 monclient(hunting): authenticate will time out at 983.573771s 2024-08-18T21:03:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1b00a5ac0 0x7fe1b0138b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1b00a5ac0 0x7fe1b0138b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:51334/0 (socket says 172.21.15.5:51334) 2024-08-18T21:03:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 1 -- 172.21.15.5:0/1844224931 learned_addr learned my addr 172.21.15.5:0/1844224931 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 10 monclient(hunting): get_auth_request con 0x7fe1b00a5ac0 auth_method 0 2024-08-18T21:03:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b56a1640 1 --2- 172.21.15.5:0/1844224931 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe1b00a0cd0 0x7fe1b0138640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b5ea2640 1 --2- 172.21.15.5:0/1844224931 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe1b0139c60 0x7fe1b013bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b5ea2640 10 monclient(hunting): get_auth_request con 0x7fe1b0139c60 auth_method 0 2024-08-18T21:03:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b5ea2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b5ea2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b5ea2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b56a1640 10 monclient(hunting): get_auth_request con 0x7fe1b00a0cd0 auth_method 0 2024-08-18T21:03:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b56a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b56a1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b56a1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b56a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b56a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b56a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b5ea2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b5ea2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b5ea2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 10 monclient(hunting): handle_auth_done global_id 4243 payload 824 2024-08-18T21:03:36.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 1 -- 172.21.15.5:0/1844224931 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe1b00a0cd0 msgr2=0x7fe1b0138640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:36.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 1 --2- 172.21.15.5:0/1844224931 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe1b00a0cd0 0x7fe1b0138640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 1 -- 172.21.15.5:0/1844224931 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe1b0139c60 msgr2=0x7fe1b013bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:36.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 1 --2- 172.21.15.5:0/1844224931 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe1b0139c60 0x7fe1b013bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:36.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 10 monclient: _finish_hunting 0 2024-08-18T21:03:36.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 1 monclient: found mon.noname-c 2024-08-18T21:03:36.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:36.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:36.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.557+0000 7fe1b4ea0640 1 -- 172.21.15.5:0/1844224931 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b013f660 con 0x7fe1b00a5ac0 2024-08-18T21:03:36.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1b4ea0640 1 -- 172.21.15.5:0/1844224931 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1b00a5ac0 msgr2=0x7fe1b0138b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:36.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1b4ea0640 1 --2- 172.21.15.5:0/1844224931 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1b00a5ac0 0x7fe1b0138b80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000e810 tx=0x7fe1a000ecd0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:36.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1a5ffb640 1 -- 172.21.15.5:0/1844224931 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe1a0017070 con 0x7fe1b00a5ac0 2024-08-18T21:03:36.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:36.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1a5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:36.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1a5ffb640 10 monclient: dump: 2024-08-18T21:03:36.576 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:36.576 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:36.576 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:36.576 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:36.576 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:36.577 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:36.577 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:36.577 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:36.577 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:36.577 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:36.577 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:36.577 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:36.577 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:36.577 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:36.578 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1a5ffb640 10 monclient: _finish_auth 0 2024-08-18T21:03:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1a5ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:03:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1a5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1a5ffb640 1 -- 172.21.15.5:0/1844224931 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a000cd50 con 0x7fe1b00a5ac0 2024-08-18T21:03:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1b7905640 5 monclient: authenticate success, global_id 4243 2024-08-18T21:03:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1b7905640 10 monclient: _renew_subs 2024-08-18T21:03:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1b7905640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1b7905640 1 -- 172.21.15.5:0/1844224931 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b013fff0 con 0x7fe1b00a5ac0 2024-08-18T21:03:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1a5ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1a5ffb640 1 -- 172.21.15.5:0/1844224931 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe1a000f040 con 0x7fe1b00a5ac0 2024-08-18T21:03:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1a5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1a5ffb640 10 monclient: dump: 2024-08-18T21:03:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:36.580 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1b7905640 10 monclient: _renew_subs 2024-08-18T21:03:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1b7905640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1b7905640 1 -- 172.21.15.5:0/1844224931 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b013f0a0 con 0x7fe1b00a5ac0 2024-08-18T21:03:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1a77fe640 4 set_mon_vals no callback set 2024-08-18T21:03:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1b4ea0640 1 --2- 172.21.15.5:0/1844224931 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1b00a5ac0 0x7fe1b0138b80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000e810 tx=0x7fe1a000ecd0 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7fe1a001a070 mgrmap(e 5) 2024-08-18T21:03:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1b7905640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1a5ffb640 1 -- 172.21.15.5:0/1844224931 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe1a001a070 con 0x7fe1b00a5ac0 2024-08-18T21:03:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1b7905640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1b7905640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1b7905640 1 -- 172.21.15.5:0/1844224931 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1b013a0d0 con 0x7fe1b00a5ac0 2024-08-18T21:03:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1a5ffb640 1 --2- 172.21.15.5:0/1844224931 >> v2:172.21.15.157:6812/631023601 conn(0x7fe19403bdc0 0x7fe19403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1b56a1640 1 --2- 172.21.15.5:0/1844224931 >> v2:172.21.15.157:6812/631023601 conn(0x7fe19403bdc0 0x7fe19403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.561+0000 7fe1b56a1640 10 monclient: get_auth_request con 0x7fe19403bdc0 auth_method 0 2024-08-18T21:03:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.565+0000 7fe1b56a1640 1 --2- 172.21.15.5:0/1844224931 >> v2:172.21.15.157:6812/631023601 conn(0x7fe19403bdc0 0x7fe19403e280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0ad000 tx=0x7fe1ac0a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:36.569+0000 7fe1a5ffb640 1 -- 172.21.15.5:0/1844224931 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(15..15 src has 1..15) ==== 3153+0+0 (secure 0 0 0) 0x7fe1a004e000 con 0x7fe1b00a5ac0 2024-08-18T21:03:37.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:37.389+0000 7fe1a5ffb640 1 -- 172.21.15.5:0/1844224931 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fe1a000cb70 con 0x7fe1b00a5ac0 2024-08-18T21:03:37.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:37.389+0000 7fe1a5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:37.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:37.389+0000 7fe1a5ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:37.565+0000 7fe1b7905640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-08-18T21:03:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:37.565+0000 7fe1b7905640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-08-18T21:03:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:37.565+0000 7fe1b7905640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:37.565+0000 7fe1b7905640 1 -- 172.21.15.5:0/1844224931 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fe1b013f8a0 con 0x7fe1b00a5ac0 2024-08-18T21:03:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.177+0000 7fe1a5ffb640 1 -- 172.21.15.5:0/1844224931 <== mon.4 v2:172.21.15.5:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) ==== 109+0+0 (secure 0 0 0) 0x7fe1a000c8e0 con 0x7fe1b00a5ac0 2024-08-18T21:03:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.177+0000 7fe1a5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-08-18T21:03:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.177+0000 7fe1a5ffb640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2024-08-18T21:03:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'rbd' created 2024-08-18T21:03:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.181+0000 7fe1b7905640 1 -- 172.21.15.5:0/1844224931 >> v2:172.21.15.157:6812/631023601 conn(0x7fe19403bdc0 msgr2=0x7fe19403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.181+0000 7fe1b7905640 1 --2- 172.21.15.5:0/1844224931 >> v2:172.21.15.157:6812/631023601 conn(0x7fe19403bdc0 0x7fe19403e280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0ad000 tx=0x7fe1ac0a6000 comp rx=0 tx=0).stop 2024-08-18T21:03:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.181+0000 7fe1b7905640 10 monclient: shutdown 2024-08-18T21:03:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.181+0000 7fe1b7905640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.181+0000 7fe1b7905640 1 -- 172.21.15.5:0/1844224931 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1b00a5ac0 msgr2=0x7fe1b0138b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.181+0000 7fe1b7905640 1 --2- 172.21.15.5:0/1844224931 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1b00a5ac0 0x7fe1b0138b80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000e810 tx=0x7fe1a000ecd0 comp rx=0 tx=0).stop 2024-08-18T21:03:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.181+0000 7fe1b7905640 1 -- 172.21.15.5:0/1844224931 shutdown_connections 2024-08-18T21:03:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.181+0000 7fe1b7905640 1 --2- 172.21.15.5:0/1844224931 >> v2:172.21.15.157:6812/631023601 conn(0x7fe19403bdc0 0x7fe19403e280 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.181+0000 7fe1b7905640 1 --2- 172.21.15.5:0/1844224931 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe1b0139c60 0x7fe1b013bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.181+0000 7fe1b7905640 1 --2- 172.21.15.5:0/1844224931 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1b00a5ac0 0x7fe1b0138b80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.181+0000 7fe1b7905640 1 --2- 172.21.15.5:0/1844224931 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe1b00a0cd0 0x7fe1b0138640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.181+0000 7fe1b7905640 1 -- 172.21.15.5:0/1844224931 >> 172.21.15.5:0/1844224931 conn(0x7fe1b00aa770 msgr2=0x7fe1b00a8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.181+0000 7fe1b7905640 1 -- 172.21.15.5:0/1844224931 shutdown_connections 2024-08-18T21:03:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.181+0000 7fe1b7905640 1 -- 172.21.15.5:0/1844224931 wait complete. 2024-08-18T21:03:38.206 DEBUG:teuthology.orchestra.run.smithi005:> rbd --cluster ceph pool init rbd 2024-08-18T21:03:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.257+0000 7fac52f77100 10 monclient: get_monmap_and_config 2024-08-18T21:03:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.257+0000 7fac52f77100 10 monclient: build_initial_monmap 2024-08-18T21:03:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.257+0000 7fac52f77100 10 monclient: monmap: 2024-08-18T21:03:38.262 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:38.262 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:38.262 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:38.263395+0000 2024-08-18T21:03:38.262 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:38.263395+0000 2024-08-18T21:03:38.262 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:38.262 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:38.262 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:38.262 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:38.262 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:38.262 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:38.262 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:38.262 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:38.262 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:38.263 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 1 Processor -- start 2024-08-18T21:03:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 1 -- start start 2024-08-18T21:03:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 10 monclient: init 2024-08-18T21:03:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 10 monclient: _reopen_session rank -1 2024-08-18T21:03:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 10 monclient: _add_conns ranks=[5,10,8,7,3,1,0,2,6,9,4] 2024-08-18T21:03:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x55dd6e05d0d0 0x55dd6e075a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 10 monclient(hunting): picked mon.noname-h con 0x55dd6e05d0d0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 1 --2- >> v2:172.21.15.157:3300/0 conn(0x55dd6e05d4b0 0x55dd6e05d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 10 monclient(hunting): picked mon.noname-f con 0x55dd6e05d4b0 addr v2:172.21.15.157:3300/0 2024-08-18T21:03:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x55dd6e10fef0 0x55dd6e1102f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 10 monclient(hunting): picked mon.noname-e con 0x55dd6e10fef0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x55dd6df45e10 con 0x55dd6e05d4b0 2024-08-18T21:03:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x55dd6df56910 con 0x55dd6e05d0d0 2024-08-18T21:03:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x55dd6df49e50 con 0x55dd6e10fef0 2024-08-18T21:03:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 10 monclient(hunting): _renew_subs 2024-08-18T21:03:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52f77100 10 monclient(hunting): authenticate will time out at 985.276917s 2024-08-18T21:03:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x55dd6e10fef0 0x55dd6e1102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x55dd6e10fef0 0x55dd6e1102f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:44368/0 (socket says 172.21.15.5:44368) 2024-08-18T21:03:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 1 -- 172.21.15.5:0/1250675601 learned_addr learned my addr 172.21.15.5:0/1250675601 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 10 monclient(hunting): get_auth_request con 0x55dd6e10fef0 auth_method 0 2024-08-18T21:03:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac51a81640 1 --2- 172.21.15.5:0/1250675601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x55dd6e05d0d0 0x55dd6e075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac51280640 1 --2- 172.21.15.5:0/1250675601 >> v2:172.21.15.157:3300/0 conn(0x55dd6e05d4b0 0x55dd6e05d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac51a81640 10 monclient(hunting): get_auth_request con 0x55dd6e05d0d0 auth_method 0 2024-08-18T21:03:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac51a81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac51a81640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac51a81640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac51280640 10 monclient(hunting): get_auth_request con 0x55dd6e05d4b0 auth_method 0 2024-08-18T21:03:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac51280640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac51280640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac51280640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac51a81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac51a81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac51a81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 10 monclient(hunting): handle_auth_done global_id 4184 payload 274 2024-08-18T21:03:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 1 -- 172.21.15.5:0/1250675601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x55dd6e05d0d0 msgr2=0x55dd6e075a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 1 --2- 172.21.15.5:0/1250675601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x55dd6e05d0d0 0x55dd6e075a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 1 -- 172.21.15.5:0/1250675601 >> v2:172.21.15.157:3300/0 conn(0x55dd6e05d4b0 msgr2=0x55dd6e05d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 1 --2- 172.21.15.5:0/1250675601 >> v2:172.21.15.157:3300/0 conn(0x55dd6e05d4b0 0x55dd6e05d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 10 monclient: _finish_hunting 0 2024-08-18T21:03:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 1 monclient: found mon.noname-e 2024-08-18T21:03:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac52ce3640 1 -- 172.21.15.5:0/1250675601 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd6deeb160 con 0x55dd6e10fef0 2024-08-18T21:03:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.261+0000 7fac51280640 1 --2- 172.21.15.5:0/1250675601 >> v2:172.21.15.157:3300/0 conn(0x55dd6e05d4b0 0x55dd6e05d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:03:38.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52ce3640 1 -- 172.21.15.5:0/1250675601 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x55dd6e10fef0 msgr2=0x55dd6e1102f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:38.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52ce3640 1 --2- 172.21.15.5:0/1250675601 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x55dd6e10fef0 0x55dd6e1102f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fac4400a5c0 tx=0x7fac4401b330 comp rx=0 tx=0).ready entity=mon.8 client_cookie=1e77408ed482373d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:38.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac50a7f640 1 -- 172.21.15.5:0/1250675601 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac440af070 con 0x55dd6e10fef0 2024-08-18T21:03:38.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac50a7f640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:38.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac50a7f640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:38.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac50a7f640 10 monclient: dump: 2024-08-18T21:03:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:38.275 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac50a7f640 10 monclient: _finish_auth 0 2024-08-18T21:03:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac50a7f640 10 monclient: _check_auth_tickets 2024-08-18T21:03:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac50a7f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac50a7f640 1 -- 172.21.15.5:0/1250675601 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac440a3e50 con 0x55dd6e10fef0 2024-08-18T21:03:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac50a7f640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac50a7f640 1 -- 172.21.15.5:0/1250675601 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac440a9c80 con 0x55dd6e10fef0 2024-08-18T21:03:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52f77100 5 monclient: authenticate success, global_id 4184 2024-08-18T21:03:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52f77100 10 monclient: get_monmap_and_config success 2024-08-18T21:03:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52f77100 4 set_mon_vals no callback set 2024-08-18T21:03:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac50a7f640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac50a7f640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac50a7f640 10 monclient: dump: 2024-08-18T21:03:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:38.277 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52f77100 10 monclient: shutdown 2024-08-18T21:03:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52f77100 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52f77100 1 -- 172.21.15.5:0/1250675601 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x55dd6e10fef0 msgr2=0x55dd6e1102f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52f77100 1 --2- 172.21.15.5:0/1250675601 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x55dd6e10fef0 0x55dd6e1102f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fac4400a5c0 tx=0x7fac4401b330 comp rx=0 tx=0).stop 2024-08-18T21:03:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52f77100 1 -- 172.21.15.5:0/1250675601 shutdown_connections 2024-08-18T21:03:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52f77100 1 --2- 172.21.15.5:0/1250675601 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x55dd6e10fef0 0x55dd6e1102f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52f77100 1 --2- 172.21.15.5:0/1250675601 >> v2:172.21.15.157:3300/0 conn(0x55dd6e05d4b0 0x55dd6e05d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52f77100 1 --2- 172.21.15.5:0/1250675601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x55dd6e05d0d0 0x55dd6e075a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52f77100 1 -- 172.21.15.5:0/1250675601 >> 172.21.15.5:0/1250675601 conn(0x55dd6e05f2e0 msgr2=0x55dd6e05f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52f77100 1 -- 172.21.15.5:0/1250675601 shutdown_connections 2024-08-18T21:03:38.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52f77100 1 -- 172.21.15.5:0/1250675601 wait complete. 2024-08-18T21:03:38.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52f77100 10 monclient: build_initial_monmap 2024-08-18T21:03:38.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.265+0000 7fac52f77100 10 monclient: monmap: 2024-08-18T21:03:38.278 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:38.278 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:38.278 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:38.278 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:38.278 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:38.279 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 1 Processor -- start 2024-08-18T21:03:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 1 -- start start 2024-08-18T21:03:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 10 monclient: init 2024-08-18T21:03:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 10 monclient: _reopen_session rank -1 2024-08-18T21:03:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 10 monclient: _add_conns ranks=[2,3,4,8,1,0,6,5,7] 2024-08-18T21:03:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x55dd6e05d0d0 0x55dd6e1167b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 10 monclient(hunting): picked mon.noname-b con 0x55dd6e05d0d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55dd6e05d4b0 0x55dd6e10f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 10 monclient(hunting): picked mon.noname-g con 0x55dd6e05d4b0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x55dd6e10fef0 0x55dd6e0f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 10 monclient(hunting): picked mon.noname-c con 0x55dd6e10fef0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x55dd6e110c40 con 0x55dd6e05d0d0 2024-08-18T21:03:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55dd6deec860 con 0x55dd6e05d4b0 2024-08-18T21:03:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x55dd6e05ddd0 con 0x55dd6e10fef0 2024-08-18T21:03:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 10 monclient(hunting): _renew_subs 2024-08-18T21:03:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52f77100 10 monclient(hunting): authenticate will time out at 985.284762s 2024-08-18T21:03:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51a81640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x55dd6e05d0d0 0x55dd6e1167b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x55dd6e10fef0 0x55dd6e0f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51a81640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x55dd6e05d0d0 0x55dd6e1167b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33174/0 (socket says 172.21.15.5:33174) 2024-08-18T21:03:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x55dd6e10fef0 0x55dd6e0f6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:51338/0 (socket says 172.21.15.5:51338) 2024-08-18T21:03:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51a81640 1 -- 172.21.15.5:0/1882478398 learned_addr learned my addr 172.21.15.5:0/1882478398 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51a81640 10 monclient(hunting): get_auth_request con 0x55dd6e05d0d0 auth_method 0 2024-08-18T21:03:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51a81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51a81640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51a81640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 10 monclient(hunting): get_auth_request con 0x55dd6e10fef0 auth_method 0 2024-08-18T21:03:38.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:38.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:38.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:38.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:38.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:38.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51280640 1 --2- 172.21.15.5:0/1882478398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55dd6e05d4b0 0x55dd6e10f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:38.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:38.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51a81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:38.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51a81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:38.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51a81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:38.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51280640 10 monclient(hunting): get_auth_request con 0x55dd6e05d4b0 auth_method 0 2024-08-18T21:03:38.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51280640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:38.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51280640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:38.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51280640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:38.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51280640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:38.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51280640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:38.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51280640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:38.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 10 monclient(hunting): handle_auth_done global_id 4252 payload 824 2024-08-18T21:03:38.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 1 -- 172.21.15.5:0/1882478398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55dd6e05d4b0 msgr2=0x55dd6e10f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:38.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 1 --2- 172.21.15.5:0/1882478398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55dd6e05d4b0 0x55dd6e10f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:38.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 1 -- 172.21.15.5:0/1882478398 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x55dd6e05d0d0 msgr2=0x55dd6e1167b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:38.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 1 --2- 172.21.15.5:0/1882478398 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x55dd6e05d0d0 0x55dd6e1167b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:38.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 10 monclient: _finish_hunting 0 2024-08-18T21:03:38.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 1 monclient: found mon.noname-c 2024-08-18T21:03:38.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:38.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:38.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 1 -- 172.21.15.5:0/1882478398 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd6dec5c50 con 0x55dd6e10fef0 2024-08-18T21:03:38.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac51a81640 1 --2- 172.21.15.5:0/1882478398 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x55dd6e05d0d0 0x55dd6e1167b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:38.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 1 -- 172.21.15.5:0/1882478398 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x55dd6e10fef0 msgr2=0x55dd6e0f6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:38.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac52ce3640 1 --2- 172.21.15.5:0/1882478398 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x55dd6e10fef0 0x55dd6e0f6d60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fac440aa000 tx=0x7fac440180d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:38.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac49ffb640 1 -- 172.21.15.5:0/1882478398 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac440ba030 con 0x55dd6e10fef0 2024-08-18T21:03:38.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac49ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:38.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.269+0000 7fac49ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:38.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac49ffb640 10 monclient: dump: 2024-08-18T21:03:38.286 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:38.286 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:38.287 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac49ffb640 10 monclient: _finish_auth 0 2024-08-18T21:03:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac49ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:03:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac49ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac49ffb640 1 -- 172.21.15.5:0/1882478398 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac440b58e0 con 0x55dd6e10fef0 2024-08-18T21:03:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac49ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac49ffb640 1 -- 172.21.15.5:0/1882478398 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac440af040 con 0x55dd6e10fef0 2024-08-18T21:03:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac52f77100 5 monclient: authenticate success, global_id 4252 2024-08-18T21:03:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac52f77100 10 monclient: _renew_subs 2024-08-18T21:03:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac52f77100 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac52f77100 1 -- 172.21.15.5:0/1882478398 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd6e07ff20 con 0x55dd6e10fef0 2024-08-18T21:03:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac4bfff640 4 set_mon_vals no callback set 2024-08-18T21:03:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac49ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac49ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac49ffb640 10 monclient: dump: 2024-08-18T21:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:38.290 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac52f77100 10 monclient: _renew_subs 2024-08-18T21:03:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac52f77100 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac52f77100 1 -- 172.21.15.5:0/1882478398 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x55dd6e0f9c40 con 0x55dd6e10fef0 2024-08-18T21:03:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac49ffb640 1 -- 172.21.15.5:0/1882478398 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fac440b5470 con 0x55dd6e10fef0 2024-08-18T21:03:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac49ffb640 1 --2- 172.21.15.5:0/1882478398 >> v2:172.21.15.157:6812/631023601 conn(0x7fac3803a6b0 0x7fac3803cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac49ffb640 1 -- 172.21.15.5:0/1882478398 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(16..16 src has 1..16) ==== 3495+0+0 (secure 0 0 0) 0x7fac440bb070 con 0x55dd6e10fef0 2024-08-18T21:03:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac52f77100 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2024-08-18T21:03:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac52f77100 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2024-08-18T21:03:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac52f77100 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:38.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac52f77100 1 -- 172.21.15.5:0/1882478398 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55dd6e0f9f20 con 0x55dd6e10fef0 2024-08-18T21:03:38.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac51a81640 1 --2- 172.21.15.5:0/1882478398 >> v2:172.21.15.157:6812/631023601 conn(0x7fac3803a6b0 0x7fac3803cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:38.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.273+0000 7fac51a81640 10 monclient: get_auth_request con 0x7fac3803a6b0 auth_method 0 2024-08-18T21:03:38.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:38.277+0000 7fac51a81640 1 --2- 172.21.15.5:0/1882478398 >> v2:172.21.15.157:6812/631023601 conn(0x7fac3803a6b0 0x7fac3803cb70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fac3c002e40 tx=0x7fac3c005d90 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:39.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.185+0000 7fac49ffb640 1 -- 172.21.15.5:0/1882478398 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v17) ==== 141+0+0 (secure 0 0 0) 0x7fac44015040 con 0x55dd6e10fef0 2024-08-18T21:03:39.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.185+0000 7fac49ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2024-08-18T21:03:39.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.185+0000 7fac49ffb640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2024-08-18T21:03:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.185+0000 7fac52f77100 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.185+0000 7fac52f77100 1 -- 172.21.15.5:0/1882478398 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac440a3e50 con 0x55dd6e10fef0 2024-08-18T21:03:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.185+0000 7fac49ffb640 1 -- 172.21.15.5:0/1882478398 <== mon.4 v2:172.21.15.5:3302/0 7 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fac440bf460 con 0x55dd6e10fef0 2024-08-18T21:03:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.185+0000 7fac49ffb640 10 monclient: handle_get_version_reply finishing 1 version 17 2024-08-18T21:03:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.185+0000 7fac4bfff640 10 monclient: _renew_subs 2024-08-18T21:03:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.185+0000 7fac4bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.185+0000 7fac4bfff640 1 -- 172.21.15.5:0/1882478398 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=17}) -- 0x7fac2c002c50 con 0x55dd6e10fef0 2024-08-18T21:03:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.189+0000 7fac49ffb640 1 -- 172.21.15.5:0/1882478398 <== mon.4 v2:172.21.15.5:3302/0 8 ==== osd_map(17..17 src has 1..17) ==== 674+0+0 (secure 0 0 0) 0x7fac440b6d00 con 0x55dd6e10fef0 2024-08-18T21:03:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.189+0000 7fac52f77100 1 --2- 172.21.15.5:0/1882478398 >> v2:172.21.15.5:6804/1057536297 conn(0x55dd6e10fad0 0x55dd6e12b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.189+0000 7fac52f77100 1 -- 172.21.15.5:0/1882478398 --> v2:172.21.15.5:6804/1057536297 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x55dd6e12b9b0 con 0x55dd6e10fad0 2024-08-18T21:03:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.189+0000 7fac51280640 1 --2- 172.21.15.5:0/1882478398 >> v2:172.21.15.5:6804/1057536297 conn(0x55dd6e10fad0 0x55dd6e12b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.189+0000 7fac51280640 10 monclient: get_auth_request con 0x55dd6e10fad0 auth_method 0 2024-08-18T21:03:39.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.193+0000 7fac51280640 1 --2- 172.21.15.5:0/1882478398 >> v2:172.21.15.5:6804/1057536297 conn(0x55dd6e10fad0 0x55dd6e12b470 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:39.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.197+0000 7fac51280640 1 -- 172.21.15.5:0/1882478398 <== osd.1 v2:172.21.15.5:6804/1057536297 1 ==== osd_op_reply(1 rbd_trash [create] v17'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7fac40009960 con 0x55dd6e10fad0 2024-08-18T21:03:39.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.201+0000 7fac52f77100 1 --2- 172.21.15.5:0/1882478398 >> v2:172.21.15.5:6808/150392090 conn(0x55dd6e17e4f0 0x55dd6e180980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:39.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.201+0000 7fac52f77100 1 -- 172.21.15.5:0/1882478398 --> v2:172.21.15.5:6808/150392090 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x55dd6e180f10 con 0x55dd6e17e4f0 2024-08-18T21:03:39.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.201+0000 7fac51a81640 1 --2- 172.21.15.5:0/1882478398 >> v2:172.21.15.5:6808/150392090 conn(0x55dd6e17e4f0 0x55dd6e180980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:39.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.201+0000 7fac51a81640 10 monclient: get_auth_request con 0x55dd6e17e4f0 auth_method 0 2024-08-18T21:03:39.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.205+0000 7fac51a81640 1 --2- 172.21.15.5:0/1882478398 >> v2:172.21.15.5:6808/150392090 conn(0x55dd6e17e4f0 0x55dd6e180980 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:39.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.205+0000 7fac51a81640 1 -- 172.21.15.5:0/1882478398 <== osd.0 v2:172.21.15.5:6808/150392090 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fac3c0134c0 con 0x55dd6e17e4f0 2024-08-18T21:03:39.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.205+0000 7fac52f77100 1 -- 172.21.15.5:0/1882478398 --> v2:172.21.15.5:6808/150392090 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x55dd6e17cf80 con 0x55dd6e17e4f0 2024-08-18T21:03:39.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.205+0000 7fac51a81640 1 -- 172.21.15.5:0/1882478398 <== osd.0 v2:172.21.15.5:6808/150392090 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fac3c0134c0 con 0x55dd6e17e4f0 2024-08-18T21:03:39.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.205+0000 7fac4b7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:39.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:39.205+0000 7fac4b7fe640 1 -- 172.21.15.5:0/1882478398 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fac28001f10 con 0x55dd6e10fef0 2024-08-18T21:03:41.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:41.173+0000 7fac49ffb640 1 -- 172.21.15.5:0/1882478398 <== mon.4 v2:172.21.15.5:3302/0 9 ==== pool_op_reply(tid 4 (0) Success v18) ==== 55+0+0 (secure 0 0 0) 0x7fac440be3c0 con 0x55dd6e10fef0 2024-08-18T21:03:41.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:41.173+0000 7fac49ffb640 10 monclient: _renew_subs 2024-08-18T21:03:41.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:41.173+0000 7fac49ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:41.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:41.173+0000 7fac49ffb640 1 -- 172.21.15.5:0/1882478398 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=18}) -- 0x7fac380404f0 con 0x55dd6e10fef0 2024-08-18T21:03:41.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:41.173+0000 7fac49ffb640 1 -- 172.21.15.5:0/1882478398 <== mon.4 v2:172.21.15.5:3302/0 10 ==== osd_map(18..18 src has 1..18) ==== 626+0+0 (secure 0 0 0) 0x7fac440a93a0 con 0x55dd6e10fef0 2024-08-18T21:03:41.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:41.173+0000 7fac4bfff640 1 -- 172.21.15.5:0/1882478398 --> v2:172.21.15.5:6808/150392090 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7fac2c005920 con 0x55dd6e17e4f0 2024-08-18T21:03:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:41.177+0000 7fac51a81640 1 -- 172.21.15.5:0/1882478398 <== osd.0 v2:172.21.15.5:6808/150392090 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v18'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fac3c0134c0 con 0x55dd6e17e4f0 2024-08-18T21:03:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:41.181+0000 7fac4b7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:41.181+0000 7fac4b7fe640 1 -- 172.21.15.5:0/1882478398 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v18) -- 0x7fac28003360 con 0x55dd6e10fef0 2024-08-18T21:03:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:41.269+0000 7fac48ff9640 10 monclient: tick 2024-08-18T21:03:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:41.269+0000 7fac48ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:03:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:41.269+0000 7fac48ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:41.269+0000 7fac48ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.185+0000 7fac49ffb640 1 -- 172.21.15.5:0/1882478398 <== mon.4 v2:172.21.15.5:3302/0 11 ==== pool_op_reply(tid 6 (0) Success v19) ==== 43+0+0 (secure 0 0 0) 0x7fac440a9720 con 0x55dd6e10fef0 2024-08-18T21:03:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.185+0000 7fac49ffb640 10 monclient: _renew_subs 2024-08-18T21:03:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.185+0000 7fac49ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.185+0000 7fac49ffb640 1 -- 172.21.15.5:0/1882478398 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=19}) -- 0x7fac380405a0 con 0x55dd6e10fef0 2024-08-18T21:03:42.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.185+0000 7fac49ffb640 1 -- 172.21.15.5:0/1882478398 <== mon.4 v2:172.21.15.5:3302/0 12 ==== osd_map(19..19 src has 1..19) ==== 654+0+0 (secure 0 0 0) 0x7fac440bf740 con 0x55dd6e10fef0 2024-08-18T21:03:42.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.185+0000 7fac4bfff640 1 -- 172.21.15.5:0/1882478398 --> v2:172.21.15.5:6808/150392090 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x7fac2c005ce0 con 0x55dd6e17e4f0 2024-08-18T21:03:42.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac51a81640 1 -- 172.21.15.5:0/1882478398 <== osd.0 v2:172.21.15.5:6808/150392090 4 ==== osd_op_reply(7 rbd_info [write 0~19] v19'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac3c0134c0 con 0x55dd6e17e4f0 2024-08-18T21:03:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac52f77100 1 -- 172.21.15.5:0/1882478398 >> v2:172.21.15.5:6808/150392090 conn(0x55dd6e17e4f0 msgr2=0x55dd6e180980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac52f77100 1 --2- 172.21.15.5:0/1882478398 >> v2:172.21.15.5:6808/150392090 conn(0x55dd6e17e4f0 0x55dd6e180980 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac52f77100 1 -- 172.21.15.5:0/1882478398 >> v2:172.21.15.5:6804/1057536297 conn(0x55dd6e10fad0 msgr2=0x55dd6e12b470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac52f77100 1 --2- 172.21.15.5:0/1882478398 >> v2:172.21.15.5:6804/1057536297 conn(0x55dd6e10fad0 0x55dd6e12b470 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac52f77100 1 -- 172.21.15.5:0/1882478398 >> v2:172.21.15.157:6812/631023601 conn(0x7fac3803a6b0 msgr2=0x7fac3803cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac52f77100 1 --2- 172.21.15.5:0/1882478398 >> v2:172.21.15.157:6812/631023601 conn(0x7fac3803a6b0 0x7fac3803cb70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fac3c002e40 tx=0x7fac3c005d90 comp rx=0 tx=0).stop 2024-08-18T21:03:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac52f77100 10 monclient: shutdown 2024-08-18T21:03:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac52f77100 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac52f77100 1 -- 172.21.15.5:0/1882478398 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x55dd6e10fef0 msgr2=0x55dd6e0f6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac52f77100 1 --2- 172.21.15.5:0/1882478398 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x55dd6e10fef0 0x55dd6e0f6d60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fac440aa000 tx=0x7fac440180d0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac52ce3640 1 -- 172.21.15.5:0/1882478398 reap_dead start 2024-08-18T21:03:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac52ce3640 1 -- 172.21.15.5:0/1882478398 reap_dead start 2024-08-18T21:03:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac52f77100 1 -- 172.21.15.5:0/1882478398 shutdown_connections 2024-08-18T21:03:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac52f77100 1 -- 172.21.15.5:0/1882478398 >> 172.21.15.5:0/1882478398 conn(0x55dd6e05f2e0 msgr2=0x55dd6e07e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac52f77100 1 -- 172.21.15.5:0/1882478398 shutdown_connections 2024-08-18T21:03:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.189+0000 7fac52f77100 1 -- 172.21.15.5:0/1882478398 wait complete. 2024-08-18T21:03:42.201 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-18T21:03:42.202 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-08-18T21:03:42.202 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-18T21:03:42.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 10 monclient: get_monmap_and_config 2024-08-18T21:03:42.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 10 monclient: build_initial_monmap 2024-08-18T21:03:42.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 10 monclient: monmap: 2024-08-18T21:03:42.332 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:42.332 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:42.332 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:42.333725+0000 2024-08-18T21:03:42.332 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:42.333725+0000 2024-08-18T21:03:42.332 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:42.332 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:42.333 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:42.333 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:42.333 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:42.333 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:42.333 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:42.333 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:42.333 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:42.333 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:42.333 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:42.333 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:42.333 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:42.333 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:42.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 1 Processor -- start 2024-08-18T21:03:42.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 1 -- start start 2024-08-18T21:03:42.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 10 monclient: init 2024-08-18T21:03:42.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:42.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 10 monclient: _add_conns ranks=[1,10,6,2,7,5,0,9,8,3,4] 2024-08-18T21:03:42.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7710137a70 addr v1:172.21.15.157:6789/0 2024-08-18T21:03:42.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f77100a4c10 0x7f77100a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:42.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 10 monclient(hunting): picked mon.noname-f con 0x7f77100a4c10 addr v2:172.21.15.157:3300/0 2024-08-18T21:03:42.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f771013c8f0 0x7f771013ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:42.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 10 monclient(hunting): picked mon.noname-d con 0x7f771013c8f0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:42.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f771009fe40 con 0x7f7710137a70 2024-08-18T21:03:42.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:42.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f77100a03e0 con 0x7f77100a4c10 2024-08-18T21:03:42.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:42.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f77100a08e0 con 0x7f771013c8f0 2024-08-18T21:03:42.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:42.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f771820d640 10 monclient(hunting): authenticate will time out at 989.346900s 2024-08-18T21:03:42.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f771013c8f0 0x7f771013ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:42.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f771013c8f0 0x7f771013ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:48850/0 (socket says 172.21.15.5:48850) 2024-08-18T21:03:42.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 1 -- 172.21.15.5:0/3463224338 learned_addr learned my addr 172.21.15.5:0/3463224338 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:42.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 10 monclient(hunting): get_auth_request con 0x7f771013c8f0 auth_method 0 2024-08-18T21:03:42.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:42.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:42.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:42.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:42.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:42.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:42.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77157a8640 1 --2- 172.21.15.5:0/3463224338 >> v2:172.21.15.157:3300/0 conn(0x7f77100a4c10 0x7f77100a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:42.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 10 monclient(hunting): handle_auth_done global_id 4227 payload 274 2024-08-18T21:03:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 1 -- 172.21.15.5:0/3463224338 >> v2:172.21.15.157:3300/0 conn(0x7f77100a4c10 msgr2=0x7f77100a1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 1 --2- 172.21.15.5:0/3463224338 >> v2:172.21.15.157:3300/0 conn(0x7f77100a4c10 0x7f77100a1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 1 -- 172.21.15.5:0/3463224338 >> v1:172.21.15.157:6789/0 conn(0x7f7710137a70 legacy=0x7f7710137e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 10 monclient: _finish_hunting 0 2024-08-18T21:03:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 1 monclient: found mon.noname-d 2024-08-18T21:03:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77167aa640 1 -- 172.21.15.5:0/3463224338 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77100a0bc0 con 0x7f771013c8f0 2024-08-18T21:03:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77157a8640 10 monclient: get_auth_request con 0x7f77100a4c10 auth_method 0 2024-08-18T21:03:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.329+0000 7f77157a8640 1 --2- 172.21.15.5:0/3463224338 >> v2:172.21.15.157:3300/0 conn(0x7f77100a4c10 0x7f77100a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77167aa640 1 -- 172.21.15.5:0/3463224338 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f771013c8f0 msgr2=0x7f771013ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77167aa640 1 --2- 172.21.15.5:0/3463224338 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f771013c8f0 0x7f771013ece0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f77100a9fa0 tx=0x7f770c01c3e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=bf78a5831594f41b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f7714fa7640 1 -- 172.21.15.5:0/3463224338 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f770c0b0070 con 0x7f771013c8f0 2024-08-18T21:03:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f7714fa7640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f7714fa7640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f7714fa7640 10 monclient: dump: 2024-08-18T21:03:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:42.344 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f7714fa7640 10 monclient: _finish_auth 0 2024-08-18T21:03:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f7714fa7640 10 monclient: _check_auth_tickets 2024-08-18T21:03:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f7714fa7640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 5 monclient: authenticate success, global_id 4227 2024-08-18T21:03:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f7714fa7640 1 -- 172.21.15.5:0/3463224338 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f770c0aa810 con 0x7f771013c8f0 2024-08-18T21:03:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f7714fa7640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 4 set_mon_vals no callback set 2024-08-18T21:03:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f7714fa7640 1 -- 172.21.15.5:0/3463224338 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f770c0a93e0 con 0x7f771013c8f0 2024-08-18T21:03:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f7714fa7640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f7714fa7640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f7714fa7640 10 monclient: dump: 2024-08-18T21:03:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:42.347 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:42.347 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:42.347 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:42.347 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:42.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 10 monclient: shutdown 2024-08-18T21:03:42.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:42.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 1 -- 172.21.15.5:0/3463224338 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f771013c8f0 msgr2=0x7f771013ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:42.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 1 --2- 172.21.15.5:0/3463224338 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f771013c8f0 0x7f771013ece0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f77100a9fa0 tx=0x7f770c01c3e0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 1 -- 172.21.15.5:0/3463224338 shutdown_connections 2024-08-18T21:03:42.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 1 --2- 172.21.15.5:0/3463224338 >> v2:172.21.15.157:3300/0 conn(0x7f77100a4c10 0x7f77100a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 1 --2- 172.21.15.5:0/3463224338 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f771013c8f0 0x7f771013ece0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 1 -- 172.21.15.5:0/3463224338 >> 172.21.15.5:0/3463224338 conn(0x7f77100688d0 msgr2=0x7f7710068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:42.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 1 -- 172.21.15.5:0/3463224338 shutdown_connections 2024-08-18T21:03:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 1 -- 172.21.15.5:0/3463224338 wait complete. 2024-08-18T21:03:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 10 monclient: build_initial_monmap 2024-08-18T21:03:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 10 monclient: monmap: 2024-08-18T21:03:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:42.349 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 1 Processor -- start 2024-08-18T21:03:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 1 -- start start 2024-08-18T21:03:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 10 monclient: init 2024-08-18T21:03:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 10 monclient: _add_conns ranks=[7,2,4,3,6,1,8,0,5] 2024-08-18T21:03:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f77100a4c10 0x7f771011f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 10 monclient(hunting): picked mon.noname-i con 0x7f77100a4c10 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7710137a70 0x7f7710136620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 10 monclient(hunting): picked mon.noname-b con 0x7f7710137a70 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f771013c8f0 0x7f771013a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 10 monclient(hunting): picked mon.noname-c con 0x7f771013c8f0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f7710141dd0 con 0x7f7710137a70 2024-08-18T21:03:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f7710141c50 con 0x7f771013c8f0 2024-08-18T21:03:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7710141f50 con 0x7f77100a4c10 2024-08-18T21:03:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f771820d640 10 monclient(hunting): authenticate will time out at 989.355565s 2024-08-18T21:03:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77157a8640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7710137a70 0x7f7710136620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77157a8640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7710137a70 0x7f7710136620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33180/0 (socket says 172.21.15.5:33180) 2024-08-18T21:03:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77157a8640 1 -- 172.21.15.5:0/3357827097 learned_addr learned my addr 172.21.15.5:0/3357827097 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77157a8640 10 monclient(hunting): get_auth_request con 0x7f7710137a70 auth_method 0 2024-08-18T21:03:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77167aa640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f771013c8f0 0x7f771013a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77157a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77157a8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77157a8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77167aa640 10 monclient(hunting): get_auth_request con 0x7f771013c8f0 auth_method 0 2024-08-18T21:03:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77167aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77167aa640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77167aa640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77157a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77157a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77157a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77167aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77167aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.337+0000 7f77167aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f7715fa9640 1 --2- 172.21.15.5:0/3357827097 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f77100a4c10 0x7f771011f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77157a8640 10 monclient(hunting): handle_auth_done global_id 4268 payload 824 2024-08-18T21:03:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77157a8640 1 -- 172.21.15.5:0/3357827097 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f77100a4c10 msgr2=0x7f771011f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77157a8640 1 --2- 172.21.15.5:0/3357827097 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f77100a4c10 0x7f771011f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77157a8640 1 -- 172.21.15.5:0/3357827097 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f771013c8f0 msgr2=0x7f771013a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77157a8640 1 --2- 172.21.15.5:0/3357827097 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f771013c8f0 0x7f771013a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77157a8640 10 monclient: _finish_hunting 0 2024-08-18T21:03:42.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77157a8640 1 monclient: found mon.noname-b 2024-08-18T21:03:42.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77157a8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:42.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77157a8640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:42.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77157a8640 1 -- 172.21.15.5:0/3357827097 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77101cfd00 con 0x7f7710137a70 2024-08-18T21:03:42.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f7715fa9640 10 monclient: get_auth_request con 0x7f77100a4c10 auth_method 0 2024-08-18T21:03:42.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f7715fa9640 1 --2- 172.21.15.5:0/3357827097 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f77100a4c10 0x7f771011f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77157a8640 1 -- 172.21.15.5:0/3357827097 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7710137a70 msgr2=0x7f7710136620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77157a8640 1 --2- 172.21.15.5:0/3357827097 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7710137a70 0x7f7710136620 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f770000c7f0 tx=0x7f770000ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77067fc640 1 -- 172.21.15.5:0/3357827097 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7700015070 con 0x7f7710137a70 2024-08-18T21:03:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77067fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77067fc640 10 monclient: dump: 2024-08-18T21:03:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:42.357 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:42.357 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:42.357 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:42.357 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:42.357 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:42.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77067fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:42.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77067fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:42.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:42.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77067fc640 1 -- 172.21.15.5:0/3357827097 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77000113f0 con 0x7f7710137a70 2024-08-18T21:03:42.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77067fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:42.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77067fc640 1 -- 172.21.15.5:0/3357827097 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7700011a10 con 0x7f7710137a70 2024-08-18T21:03:42.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f771820d640 5 monclient: authenticate success, global_id 4268 2024-08-18T21:03:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f771820d640 10 monclient: _renew_subs 2024-08-18T21:03:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f771820d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f771820d640 1 -- 172.21.15.5:0/3357827097 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7710138090 con 0x7f7710137a70 2024-08-18T21:03:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77077fe640 4 set_mon_vals no callback set 2024-08-18T21:03:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77067fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77067fc640 10 monclient: dump: 2024-08-18T21:03:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:42.359 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:42.359 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:42.359 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:42.359 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:42.359 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:42.359 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:42.359 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:42.359 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:42.359 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:42.359 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:42.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f771820d640 10 monclient: _renew_subs 2024-08-18T21:03:42.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f771820d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f771820d640 1 -- 172.21.15.5:0/3357827097 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7710120fb0 con 0x7f7710137a70 2024-08-18T21:03:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f771820d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f771820d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f771820d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f771820d640 1 -- 172.21.15.5:0/3357827097 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77100a1b60 con 0x7f7710137a70 2024-08-18T21:03:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.341+0000 7f77067fc640 1 -- 172.21.15.5:0/3357827097 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f7700018070 con 0x7f7710137a70 2024-08-18T21:03:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.345+0000 7f77067fc640 1 --2- 172.21.15.5:0/3357827097 >> v2:172.21.15.157:6812/631023601 conn(0x7f76f403bdc0 0x7f76f403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.345+0000 7f77067fc640 1 -- 172.21.15.5:0/3357827097 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f770004e550 con 0x7f7710137a70 2024-08-18T21:03:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.345+0000 7f7715fa9640 1 --2- 172.21.15.5:0/3357827097 >> v2:172.21.15.157:6812/631023601 conn(0x7f76f403bdc0 0x7f76f403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.345+0000 7f7715fa9640 10 monclient: get_auth_request con 0x7f76f403bdc0 auth_method 0 2024-08-18T21:03:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.345+0000 7f7715fa9640 1 --2- 172.21.15.5:0/3357827097 >> v2:172.21.15.157:6812/631023601 conn(0x7f76f403bdc0 0x7f76f403e280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7708007fd0 tx=0x7f7708009040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.349+0000 7f77067fc640 1 -- 172.21.15.5:0/3357827097 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f7710138090 con 0x7f7710137a70 2024-08-18T21:03:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.349+0000 7f77067fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:42.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.349+0000 7f77067fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:42.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.521+0000 7f771820d640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2024-08-18T21:03:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.521+0000 7f771820d640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2024-08-18T21:03:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.521+0000 7f771820d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.521+0000 7f771820d640 1 -- 172.21.15.5:0/3357827097 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f77101372c0 con 0x7f7710137a70 2024-08-18T21:03:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.521+0000 7f77067fc640 1 -- 172.21.15.5:0/3357827097 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v2) ==== 86+0+159 (secure 0 0 0) 0x7f77101cfd00 con 0x7f7710137a70 2024-08-18T21:03:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.521+0000 7f77067fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2024-08-18T21:03:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.521+0000 7f77067fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:42.527 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:03:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.525+0000 7f771820d640 1 -- 172.21.15.5:0/3357827097 >> v2:172.21.15.157:6812/631023601 conn(0x7f76f403bdc0 msgr2=0x7f76f403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.525+0000 7f771820d640 1 --2- 172.21.15.5:0/3357827097 >> v2:172.21.15.157:6812/631023601 conn(0x7f76f403bdc0 0x7f76f403e280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7708007fd0 tx=0x7f7708009040 comp rx=0 tx=0).stop 2024-08-18T21:03:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.525+0000 7f771820d640 10 monclient: shutdown 2024-08-18T21:03:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.525+0000 7f771820d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.525+0000 7f771820d640 1 -- 172.21.15.5:0/3357827097 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7710137a70 msgr2=0x7f7710136620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.525+0000 7f771820d640 1 --2- 172.21.15.5:0/3357827097 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7710137a70 0x7f7710136620 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f770000c7f0 tx=0x7f770000ccb0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.525+0000 7f771820d640 1 -- 172.21.15.5:0/3357827097 shutdown_connections 2024-08-18T21:03:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.525+0000 7f771820d640 1 --2- 172.21.15.5:0/3357827097 >> v2:172.21.15.157:6812/631023601 conn(0x7f76f403bdc0 0x7f76f403e280 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.525+0000 7f771820d640 1 --2- 172.21.15.5:0/3357827097 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f771013c8f0 0x7f771013a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.525+0000 7f771820d640 1 --2- 172.21.15.5:0/3357827097 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7710137a70 0x7f7710136620 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.525+0000 7f771820d640 1 --2- 172.21.15.5:0/3357827097 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f77100a4c10 0x7f771011f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.525+0000 7f771820d640 1 -- 172.21.15.5:0/3357827097 >> 172.21.15.5:0/3357827097 conn(0x7f77100688d0 msgr2=0x7f77100a7770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.525+0000 7f771820d640 1 -- 172.21.15.5:0/3357827097 shutdown_connections 2024-08-18T21:03:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.525+0000 7f771820d640 1 -- 172.21.15.5:0/3357827097 wait complete. 2024-08-18T21:03:42.545 INFO:teuthology.orchestra.run.smithi005.stdout:[{"version":2,"timestamp":"2024-08-18T21:03:29.349594+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"6371.514620"}]}] 2024-08-18T21:03:42.545 INFO:tasks.ceph_manager:config epoch is 2 2024-08-18T21:03:42.545 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-18T21:03:42.545 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-18T21:03:42.546 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-18T21:03:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.657+0000 7fb63ed0a640 10 monclient: get_monmap_and_config 2024-08-18T21:03:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.657+0000 7fb63ed0a640 10 monclient: build_initial_monmap 2024-08-18T21:03:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.657+0000 7fb63ed0a640 10 monclient: monmap: 2024-08-18T21:03:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:42.663537+0000 2024-08-18T21:03:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:42.663537+0000 2024-08-18T21:03:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:42.663 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 1 Processor -- start 2024-08-18T21:03:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 1 -- start start 2024-08-18T21:03:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 10 monclient: init 2024-08-18T21:03:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 10 monclient: _add_conns ranks=[2,0,3,10,1,5,4,9,6,7,8] 2024-08-18T21:03:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6380a6bd0 0x7fb6380a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 10 monclient(hunting): picked mon.noname-b con 0x7fb6380a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb63809f080 addr v1:172.21.15.5:6789/0 2024-08-18T21:03:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6380a74f0 0x7fb63813a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 10 monclient(hunting): picked mon.noname-g con 0x7fb6380a74f0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6380a7fb0 con 0x7fb63809f080 2024-08-18T21:03:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fb63809e4c0 con 0x7fb6380a6bd0 2024-08-18T21:03:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb63806f930 con 0x7fb6380a74f0 2024-08-18T21:03:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63ed0a640 10 monclient(hunting): authenticate will time out at 989.676923s 2024-08-18T21:03:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6380a6bd0 0x7fb6380a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6380a6bd0 0x7fb6380a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33188/0 (socket says 172.21.15.5:33188) 2024-08-18T21:03:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 1 -- 172.21.15.5:0/2093081931 learned_addr learned my addr 172.21.15.5:0/2093081931 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 10 monclient(hunting): get_auth_request con 0x7fb6380a6bd0 auth_method 0 2024-08-18T21:03:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb637fff640 1 --1- 172.21.15.5:0/2093081931 >> v1:172.21.15.5:6789/0 conn(0x7fb63809f080 0x7fb638139990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51274/0 (socket says 172.21.15.5:51274) 2024-08-18T21:03:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63d2a7640 1 --2- 172.21.15.5:0/2093081931 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6380a74f0 0x7fb63813a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 10 monclient(hunting): handle_auth_done global_id 4277 payload 274 2024-08-18T21:03:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 1 -- 172.21.15.5:0/2093081931 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6380a74f0 msgr2=0x7fb63813a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 1 --2- 172.21.15.5:0/2093081931 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6380a74f0 0x7fb63813a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 1 -- 172.21.15.5:0/2093081931 >> v1:172.21.15.5:6789/0 conn(0x7fb63809f080 legacy=0x7fb638139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 10 monclient: _finish_hunting 0 2024-08-18T21:03:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 1 monclient: found mon.noname-b 2024-08-18T21:03:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.661+0000 7fb63caa6640 1 -- 172.21.15.5:0/2093081931 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63809de70 con 0x7fb6380a6bd0 2024-08-18T21:03:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63caa6640 1 -- 172.21.15.5:0/2093081931 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6380a6bd0 msgr2=0x7fb6380a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63caa6640 1 --2- 172.21.15.5:0/2093081931 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6380a6bd0 0x7fb6380a6fb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb6280098a0 tx=0x7fb62801cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecb7e86e891d8064 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb6377fe640 1 -- 172.21.15.5:0/2093081931 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb6280b0070 con 0x7fb6380a6bd0 2024-08-18T21:03:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb6377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb6377fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb6377fe640 10 monclient: dump: 2024-08-18T21:03:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:42.673 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb6377fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb6377fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb6377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 5 monclient: authenticate success, global_id 4277 2024-08-18T21:03:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb6377fe640 1 -- 172.21.15.5:0/2093081931 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6280aa810 con 0x7fb6380a6bd0 2024-08-18T21:03:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb6377fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 4 set_mon_vals no callback set 2024-08-18T21:03:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb6377fe640 1 -- 172.21.15.5:0/2093081931 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb6280aae30 con 0x7fb6380a6bd0 2024-08-18T21:03:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb6377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb6377fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb6377fe640 10 monclient: dump: 2024-08-18T21:03:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 10 monclient: shutdown 2024-08-18T21:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 1 -- 172.21.15.5:0/2093081931 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6380a6bd0 msgr2=0x7fb6380a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 1 --2- 172.21.15.5:0/2093081931 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6380a6bd0 0x7fb6380a6fb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb6280098a0 tx=0x7fb62801cea0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 1 -- 172.21.15.5:0/2093081931 shutdown_connections 2024-08-18T21:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 1 --2- 172.21.15.5:0/2093081931 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6380a74f0 0x7fb63813a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 1 --2- 172.21.15.5:0/2093081931 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6380a6bd0 0x7fb6380a6fb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 1 -- 172.21.15.5:0/2093081931 >> 172.21.15.5:0/2093081931 conn(0x7fb638068700 msgr2=0x7fb638068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 1 -- 172.21.15.5:0/2093081931 shutdown_connections 2024-08-18T21:03:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 1 -- 172.21.15.5:0/2093081931 wait complete. 2024-08-18T21:03:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 10 monclient: build_initial_monmap 2024-08-18T21:03:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 10 monclient: monmap: 2024-08-18T21:03:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:42.677 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 1 Processor -- start 2024-08-18T21:03:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 1 -- start start 2024-08-18T21:03:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.665+0000 7fb63ed0a640 10 monclient: init 2024-08-18T21:03:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 10 monclient: _add_conns ranks=[1,3,6,5,2,4,8,0,7] 2024-08-18T21:03:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb63809f080 0x7fb638138f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 10 monclient(hunting): picked mon.noname-f con 0x7fb63809f080 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6380a6bd0 0x7fb638139480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 10 monclient(hunting): picked mon.noname-g con 0x7fb6380a6bd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb6380a74f0 0x7fb63813e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 10 monclient(hunting): picked mon.noname-d con 0x7fb6380a74f0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb63813a5e0 con 0x7fb63809f080 2024-08-18T21:03:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb6380a89f0 con 0x7fb6380a6bd0 2024-08-18T21:03:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fb63813a760 con 0x7fb6380a74f0 2024-08-18T21:03:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 10 monclient(hunting): authenticate will time out at 989.684079s 2024-08-18T21:03:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb6380a74f0 0x7fb63813e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb6380a74f0 0x7fb63813e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:48858/0 (socket says 172.21.15.5:48858) 2024-08-18T21:03:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 1 -- 172.21.15.5:0/2849341300 learned_addr learned my addr 172.21.15.5:0/2849341300 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 10 monclient(hunting): get_auth_request con 0x7fb6380a74f0 auth_method 0 2024-08-18T21:03:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63caa6640 1 --2- 172.21.15.5:0/2849341300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb63809f080 0x7fb638138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb637fff640 1 --2- 172.21.15.5:0/2849341300 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6380a6bd0 0x7fb638139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 10 monclient(hunting): handle_auth_done global_id 4236 payload 824 2024-08-18T21:03:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 1 -- 172.21.15.5:0/2849341300 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6380a6bd0 msgr2=0x7fb638139480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 1 --2- 172.21.15.5:0/2849341300 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6380a6bd0 0x7fb638139480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 1 -- 172.21.15.5:0/2849341300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb63809f080 msgr2=0x7fb638138f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 1 --2- 172.21.15.5:0/2849341300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb63809f080 0x7fb638138f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 10 monclient: _finish_hunting 0 2024-08-18T21:03:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 1 monclient: found mon.noname-d 2024-08-18T21:03:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 1 -- 172.21.15.5:0/2849341300 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb638123820 con 0x7fb6380a74f0 2024-08-18T21:03:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb637fff640 10 monclient: get_auth_request con 0x7fb6380a6bd0 auth_method 0 2024-08-18T21:03:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63caa6640 10 monclient: get_auth_request con 0x7fb63809f080 auth_method 0 2024-08-18T21:03:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb637fff640 1 --2- 172.21.15.5:0/2849341300 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6380a6bd0 0x7fb638139480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63caa6640 1 --2- 172.21.15.5:0/2849341300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb63809f080 0x7fb638138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 1 -- 172.21.15.5:0/2849341300 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb6380a74f0 msgr2=0x7fb63813e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63d2a7640 1 --2- 172.21.15.5:0/2849341300 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb6380a74f0 0x7fb63813e5e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c590 tx=0x7fb63000ca50 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb6357fa640 1 -- 172.21.15.5:0/2849341300 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb630015070 con 0x7fb6380a74f0 2024-08-18T21:03:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb6357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb6357fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb6357fa640 10 monclient: dump: 2024-08-18T21:03:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:42.684 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb6357fa640 10 monclient: _finish_auth 0 2024-08-18T21:03:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb6357fa640 10 monclient: _check_auth_tickets 2024-08-18T21:03:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb6357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb6357fa640 1 -- 172.21.15.5:0/2849341300 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb630011c80 con 0x7fb6380a74f0 2024-08-18T21:03:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb6357fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb6357fa640 1 -- 172.21.15.5:0/2849341300 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb630011e30 con 0x7fb6380a74f0 2024-08-18T21:03:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb6357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb6357fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb6357fa640 10 monclient: dump: 2024-08-18T21:03:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:42.686 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb636ffd640 4 set_mon_vals no callback set 2024-08-18T21:03:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 5 monclient: authenticate success, global_id 4236 2024-08-18T21:03:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 10 monclient: _renew_subs 2024-08-18T21:03:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 1 -- 172.21.15.5:0/2849341300 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb638123b00 con 0x7fb6380a74f0 2024-08-18T21:03:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 10 monclient: _renew_subs 2024-08-18T21:03:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.669+0000 7fb63ed0a640 1 -- 172.21.15.5:0/2849341300 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fb638123540 con 0x7fb6380a74f0 2024-08-18T21:03:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.673+0000 7fb63ed0a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.673+0000 7fb63ed0a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.673+0000 7fb63ed0a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.673+0000 7fb63ed0a640 1 -- 172.21.15.5:0/2849341300 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb638123d40 con 0x7fb6380a74f0 2024-08-18T21:03:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.673+0000 7fb6357fa640 1 -- 172.21.15.5:0/2849341300 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fb630011810 con 0x7fb6380a74f0 2024-08-18T21:03:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.673+0000 7fb6357fa640 1 --2- 172.21.15.5:0/2849341300 >> v2:172.21.15.157:6812/631023601 conn(0x7fb62403bdc0 0x7fb62403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.673+0000 7fb6357fa640 1 -- 172.21.15.5:0/2849341300 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fb63004e2f0 con 0x7fb6380a74f0 2024-08-18T21:03:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.673+0000 7fb63caa6640 1 --2- 172.21.15.5:0/2849341300 >> v2:172.21.15.157:6812/631023601 conn(0x7fb62403bdc0 0x7fb62403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.673+0000 7fb63caa6640 10 monclient: get_auth_request con 0x7fb62403bdc0 auth_method 0 2024-08-18T21:03:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.677+0000 7fb63caa6640 1 --2- 172.21.15.5:0/2849341300 >> v2:172.21.15.157:6812/631023601 conn(0x7fb62403bdc0 0x7fb62403e280 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb6280098a0 tx=0x7fb628004740 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.677+0000 7fb6357fa640 1 -- 172.21.15.5:0/2849341300 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fb63001e030 con 0x7fb6380a74f0 2024-08-18T21:03:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.677+0000 7fb6357fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.677+0000 7fb6357fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:42.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.889+0000 7fb63ed0a640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2024-08-18T21:03:42.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.889+0000 7fb63ed0a640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2024-08-18T21:03:42.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.889+0000 7fb63ed0a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:42.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.889+0000 7fb63ed0a640 1 -- 172.21.15.5:0/2849341300 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb638140930 con 0x7fb6380a74f0 2024-08-18T21:03:42.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb6357fa640 1 -- 172.21.15.5:0/2849341300 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+92095 (secure 0 0 0) 0x7fb63004e020 con 0x7fb6380a74f0 2024-08-18T21:03:42.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb6357fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2024-08-18T21:03:42.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb6357fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:42.897 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:03:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb63ed0a640 1 -- 172.21.15.5:0/2849341300 >> v2:172.21.15.157:6812/631023601 conn(0x7fb62403bdc0 msgr2=0x7fb62403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb63ed0a640 1 --2- 172.21.15.5:0/2849341300 >> v2:172.21.15.157:6812/631023601 conn(0x7fb62403bdc0 0x7fb62403e280 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb6280098a0 tx=0x7fb628004740 comp rx=0 tx=0).stop 2024-08-18T21:03:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb63ed0a640 10 monclient: shutdown 2024-08-18T21:03:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb63ed0a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb63ed0a640 1 -- 172.21.15.5:0/2849341300 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb6380a74f0 msgr2=0x7fb63813e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb63ed0a640 1 --2- 172.21.15.5:0/2849341300 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb6380a74f0 0x7fb63813e5e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c590 tx=0x7fb63000ca50 comp rx=0 tx=0).stop 2024-08-18T21:03:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb63ed0a640 1 -- 172.21.15.5:0/2849341300 shutdown_connections 2024-08-18T21:03:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb63ed0a640 1 --2- 172.21.15.5:0/2849341300 >> v2:172.21.15.157:6812/631023601 conn(0x7fb62403bdc0 0x7fb62403e280 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb63ed0a640 1 --2- 172.21.15.5:0/2849341300 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb6380a74f0 0x7fb63813e5e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb63ed0a640 1 --2- 172.21.15.5:0/2849341300 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6380a6bd0 0x7fb638139480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb63ed0a640 1 --2- 172.21.15.5:0/2849341300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb63809f080 0x7fb638138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb63ed0a640 1 -- 172.21.15.5:0/2849341300 >> 172.21.15.5:0/2849341300 conn(0x7fb638068700 msgr2=0x7fb6380a15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb63ed0a640 1 -- 172.21.15.5:0/2849341300 shutdown_connections 2024-08-18T21:03:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:42.893+0000 7fb63ed0a640 1 -- 172.21.15.5:0/2849341300 wait complete. 2024-08-18T21:03:42.914 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"flags":0,"active_gid":4130,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":631023601}]},"active_addr":"172.21.15.157:6812/631023601","active_change":"2024-08-18T21:03:23.321612+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":114690165}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":821009025}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":2640913746}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":1178776743}]}]} 2024-08-18T21:03:42.916 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-18T21:03:42.916 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-18T21:03:42.916 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T21:03:43.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.021+0000 7f71616d9640 10 monclient: get_monmap_and_config 2024-08-18T21:03:43.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.021+0000 7f71616d9640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.021+0000 7f71616d9640 10 monclient: monmap: 2024-08-18T21:03:43.026 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.026 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.026 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:43.027832+0000 2024-08-18T21:03:43.026 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:43.027832+0000 2024-08-18T21:03:43.026 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.026 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.026 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:43.026 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:43.027 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 1 Processor -- start 2024-08-18T21:03:43.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 1 -- start start 2024-08-18T21:03:43.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 10 monclient: init 2024-08-18T21:03:43.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 10 monclient: _add_conns ranks=[8,3,0,10,5,7,9,1,2,4,6] 2024-08-18T21:03:43.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f715c0a6bd0 0x7f715c0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 10 monclient(hunting): picked mon.noname-e con 0x7f715c0a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:43.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f715c09f080 0x7f715c0a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 10 monclient(hunting): picked mon.noname-g con 0x7f715c09f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:43.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f715c139990 addr v1:172.21.15.5:6789/0 2024-08-18T21:03:43.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715c0a7fb0 con 0x7f715c139990 2024-08-18T21:03:43.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f715c09e4c0 con 0x7f715c09f080 2024-08-18T21:03:43.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f715c06f930 con 0x7f715c0a6bd0 2024-08-18T21:03:43.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f71616d9640 10 monclient(hunting): authenticate will time out at 990.040922s 2024-08-18T21:03:43.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f715c0a6bd0 0x7f715c0a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f715c139990 0x7f715c139e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51282/0 (socket says 172.21.15.5:51282) 2024-08-18T21:03:43.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715b7fe640 1 -- 172.21.15.5:0/1059895397 learned_addr learned my addr 172.21.15.5:0/1059895397 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:03:43.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f715c0a6bd0 0x7f715c0a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:44378/0 (socket says 172.21.15.5:44378) 2024-08-18T21:03:43.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 10 monclient(hunting): get_auth_request con 0x7f715c0a6bd0 auth_method 0 2024-08-18T21:03:43.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715a7fc640 1 --2- 172.21.15.5:0/1059895397 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f715c09f080 0x7f715c0a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 10 monclient(hunting): handle_auth_done global_id 4193 payload 274 2024-08-18T21:03:43.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 1 -- 172.21.15.5:0/1059895397 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f715c09f080 msgr2=0x7f715c0a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 1 --2- 172.21.15.5:0/1059895397 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f715c09f080 0x7f715c0a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 1 -- 172.21.15.5:0/1059895397 >> v1:172.21.15.5:6789/0 conn(0x7f715c139990 legacy=0x7f715c139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 1 monclient: found mon.noname-e 2024-08-18T21:03:43.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:43.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715affd640 1 -- 172.21.15.5:0/1059895397 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715c09de70 con 0x7f715c0a6bd0 2024-08-18T21:03:43.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715a7fc640 10 monclient: get_auth_request con 0x7f715c09f080 auth_method 0 2024-08-18T21:03:43.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.025+0000 7f715a7fc640 1 --2- 172.21.15.5:0/1059895397 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f715c09f080 0x7f715c0a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:43.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f715affd640 1 -- 172.21.15.5:0/1059895397 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f715c0a6bd0 msgr2=0x7f715c0a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f715affd640 1 --2- 172.21.15.5:0/1059895397 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f715c0a6bd0 0x7f715c0a6fb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f714c009820 tx=0x7f714c01c380 comp rx=0 tx=0).ready entity=mon.8 client_cookie=ccde737b0d68b530 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f7159ffb640 1 -- 172.21.15.5:0/1059895397 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f714c0b0070 con 0x7f715c0a6bd0 2024-08-18T21:03:43.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f7159ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f7159ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:43.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f7159ffb640 10 monclient: dump: 2024-08-18T21:03:43.034 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.034 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.036 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f7159ffb640 10 monclient: _finish_auth 0 2024-08-18T21:03:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f7159ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:03:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f7159ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f7159ffb640 1 -- 172.21.15.5:0/1059895397 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c0aa810 con 0x7f715c0a6bd0 2024-08-18T21:03:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f7159ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f7159ffb640 1 -- 172.21.15.5:0/1059895397 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f714c0aae30 con 0x7f715c0a6bd0 2024-08-18T21:03:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f7159ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f7159ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f7159ffb640 10 monclient: dump: 2024-08-18T21:03:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.037 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 5 monclient: authenticate success, global_id 4193 2024-08-18T21:03:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 4 set_mon_vals no callback set 2024-08-18T21:03:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 10 monclient: shutdown 2024-08-18T21:03:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 1 -- 172.21.15.5:0/1059895397 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f715c0a6bd0 msgr2=0x7f715c0a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 1 --2- 172.21.15.5:0/1059895397 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f715c0a6bd0 0x7f715c0a6fb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f714c009820 tx=0x7f714c01c380 comp rx=0 tx=0).stop 2024-08-18T21:03:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 1 -- 172.21.15.5:0/1059895397 shutdown_connections 2024-08-18T21:03:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 1 --2- 172.21.15.5:0/1059895397 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f715c09f080 0x7f715c0a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 1 --2- 172.21.15.5:0/1059895397 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f715c0a6bd0 0x7f715c0a6fb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 1 -- 172.21.15.5:0/1059895397 >> 172.21.15.5:0/1059895397 conn(0x7f715c068700 msgr2=0x7f715c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 1 -- 172.21.15.5:0/1059895397 shutdown_connections 2024-08-18T21:03:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 1 -- 172.21.15.5:0/1059895397 wait complete. 2024-08-18T21:03:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 10 monclient: monmap: 2024-08-18T21:03:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.039 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 1 Processor -- start 2024-08-18T21:03:43.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 1 -- start start 2024-08-18T21:03:43.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.029+0000 7f71616d9640 10 monclient: init 2024-08-18T21:03:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 10 monclient: _add_conns ranks=[2,0,4,3,7,8,6,1,5] 2024-08-18T21:03:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f715c09f080 0x7f715c140060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 10 monclient(hunting): picked mon.noname-b con 0x7f715c09f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f715c0a6bd0 0x7f715c1d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 10 monclient(hunting): picked mon.noname-a con 0x7f715c0a6bd0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f715c139990 0x7f715c13db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 10 monclient(hunting): picked mon.noname-c con 0x7f715c139990 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f715c1447a0 con 0x7f715c0a6bd0 2024-08-18T21:03:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f715c144620 con 0x7f715c09f080 2024-08-18T21:03:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f715c144920 con 0x7f715c139990 2024-08-18T21:03:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 10 monclient(hunting): authenticate will time out at 990.048438s 2024-08-18T21:03:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f715c0a6bd0 0x7f715c1d1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f715c0a6bd0 0x7f715c1d1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55272/0 (socket says 172.21.15.5:55272) 2024-08-18T21:03:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 1 -- 172.21.15.5:0/1740877407 learned_addr learned my addr 172.21.15.5:0/1740877407 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 10 monclient(hunting): get_auth_request con 0x7f715c0a6bd0 auth_method 0 2024-08-18T21:03:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715b7fe640 1 --2- 172.21.15.5:0/1740877407 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f715c139990 0x7f715c13db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715affd640 1 --2- 172.21.15.5:0/1740877407 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f715c09f080 0x7f715c140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715b7fe640 10 monclient(hunting): get_auth_request con 0x7f715c139990 auth_method 0 2024-08-18T21:03:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715affd640 10 monclient(hunting): get_auth_request con 0x7f715c09f080 auth_method 0 2024-08-18T21:03:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 10 monclient(hunting): handle_auth_done global_id 4257 payload 824 2024-08-18T21:03:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 1 -- 172.21.15.5:0/1740877407 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f715c139990 msgr2=0x7f715c13db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 1 --2- 172.21.15.5:0/1740877407 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f715c139990 0x7f715c13db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 1 -- 172.21.15.5:0/1740877407 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f715c09f080 msgr2=0x7f715c140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 1 --2- 172.21.15.5:0/1740877407 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f715c09f080 0x7f715c140060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 1 monclient: found mon.noname-a 2024-08-18T21:03:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 1 -- 172.21.15.5:0/1740877407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715c1231f0 con 0x7f715c0a6bd0 2024-08-18T21:03:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715b7fe640 1 --2- 172.21.15.5:0/1740877407 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f715c139990 0x7f715c13db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715affd640 1 --2- 172.21.15.5:0/1740877407 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f715c09f080 0x7f715c140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 1 -- 172.21.15.5:0/1740877407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f715c0a6bd0 msgr2=0x7f715c1d1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f715a7fc640 1 --2- 172.21.15.5:0/1740877407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f715c0a6bd0 0x7f715c1d1f00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f714400c7c0 tx=0x7f714400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71537fe640 1 -- 172.21.15.5:0/1740877407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71440113f0 con 0x7f715c0a6bd0 2024-08-18T21:03:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71537fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71537fe640 10 monclient: dump: 2024-08-18T21:03:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.049 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71537fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71537fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 5 monclient: authenticate success, global_id 4257 2024-08-18T21:03:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71537fe640 1 -- 172.21.15.5:0/1740877407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71440115d0 con 0x7f715c0a6bd0 2024-08-18T21:03:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 10 monclient: _renew_subs 2024-08-18T21:03:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 1 -- 172.21.15.5:0/1740877407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715c0ab0e0 con 0x7f715c0a6bd0 2024-08-18T21:03:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71537fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71537fe640 1 -- 172.21.15.5:0/1740877407 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7144011bf0 con 0x7f715c0a6bd0 2024-08-18T21:03:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71537fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71597fa640 4 set_mon_vals no callback set 2024-08-18T21:03:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71537fe640 10 monclient: dump: 2024-08-18T21:03:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 10 monclient: _renew_subs 2024-08-18T21:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.033+0000 7f71616d9640 1 -- 172.21.15.5:0/1740877407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f715c122f10 con 0x7f715c0a6bd0 2024-08-18T21:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.037+0000 7f71616d9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.037+0000 7f71616d9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.037+0000 7f71616d9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.037+0000 7f71616d9640 1 -- 172.21.15.5:0/1740877407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f715c139e10 con 0x7f715c0a6bd0 2024-08-18T21:03:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.037+0000 7f71537fe640 1 -- 172.21.15.5:0/1740877407 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f7144011780 con 0x7f715c0a6bd0 2024-08-18T21:03:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.037+0000 7f71537fe640 1 --2- 172.21.15.5:0/1740877407 >> v2:172.21.15.157:6812/631023601 conn(0x7f713c03bcf0 0x7f713c03e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.037+0000 7f71537fe640 1 -- 172.21.15.5:0/1740877407 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f714404e7d0 con 0x7f715c0a6bd0 2024-08-18T21:03:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.037+0000 7f715affd640 1 --2- 172.21.15.5:0/1740877407 >> v2:172.21.15.157:6812/631023601 conn(0x7f713c03bcf0 0x7f713c03e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.037+0000 7f715affd640 10 monclient: get_auth_request con 0x7f713c03bcf0 auth_method 0 2024-08-18T21:03:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.041+0000 7f715affd640 1 --2- 172.21.15.5:0/1740877407 >> v2:172.21.15.157:6812/631023601 conn(0x7f713c03bcf0 0x7f713c03e1b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f714c0ab000 tx=0x7f714c0a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.041+0000 7f71537fe640 1 -- 172.21.15.5:0/1740877407 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f7144015020 con 0x7f715c0a6bd0 2024-08-18T21:03:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.041+0000 7f71537fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.041+0000 7f71537fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.213+0000 7f71616d9640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.213+0000 7f71616d9640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.213+0000 7f71616d9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.213+0000 7f71616d9640 1 -- 172.21.15.5:0/1740877407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f715c0746d0 con 0x7f715c0a6bd0 2024-08-18T21:03:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.213+0000 7f71537fe640 1 -- 172.21.15.5:0/1740877407 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+10923 (secure 0 0 0) 0x7f7144018d60 con 0x7f715c0a6bd0 2024-08-18T21:03:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.213+0000 7f71537fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.213+0000 7f71537fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:43.216 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:03:43.216 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","created":"2024-08-18T21:03:17.118714+0000","modified":"2024-08-18T21:03:42.169675+0000","last_up_change":"2024-08-18T21:03:30.570125+0000","last_in_change":"2024-08-18T21:03:21.231242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T21:03:31.386335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-18T21:03:37.578348+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f6d162e-ed99-408f-87c5-4880e57b4f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":150392090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":150392090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":150392090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":150392090}]},"public_addr":"172.21.15.5:6808/150392090","cluster_addr":"172.21.15.5:6809/150392090","heartbeat_back_addr":"172.21.15.5:6811/150392090","heartbeat_front_addr":"172.21.15.5:6810/150392090","state":["exists","up"]},{"osd":1,"uuid":"99984157-5771-44d0-b5fa-c3e5b2537e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1057536297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6805","nonce":1057536297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":1057536297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1057536297}]},"public_addr":"172.21.15.5:6804/1057536297","cluster_addr":"172.21.15.5:6805/1057536297","heartbeat_back_addr":"172.21.15.5:6807/1057536297","heartbeat_front_addr":"172.21.15.5:6806/1057536297","state":["exists","up"]},{"osd":2,"uuid":"00fd1d05-f5a1-4d89-8e2c-47a61392f500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3354229361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":3354229361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":3354229361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3354229361}]},"public_addr":"172.21.15.5:6800/3354229361","cluster_addr":"172.21.15.5:6801/3354229361","heartbeat_back_addr":"172.21.15.5:6803/3354229361","heartbeat_front_addr":"172.21.15.5:6802/3354229361","state":["exists","up"]},{"osd":3,"uuid":"8bb1ba33-9e75-43ee-bbfc-7ab22350e4a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1750098759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6805","nonce":1750098759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":1750098759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1750098759}]},"public_addr":"172.21.15.157:6804/1750098759","cluster_addr":"172.21.15.157:6805/1750098759","heartbeat_back_addr":"172.21.15.157:6807/1750098759","heartbeat_front_addr":"172.21.15.157:6806/1750098759","state":["exists","up"]},{"osd":4,"uuid":"f7043f2f-d6d1-4c40-bf70-80a10071a795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":269684279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":269684279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":269684279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":269684279}]},"public_addr":"172.21.15.157:6808/269684279","cluster_addr":"172.21.15.157:6809/269684279","heartbeat_back_addr":"172.21.15.157:6811/269684279","heartbeat_front_addr":"172.21.15.157:6810/269684279","state":["exists","up"]},{"osd":5,"uuid":"6d9d2c91-ec42-46cf-9b18-8c488f1f489c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2335500119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6801","nonce":2335500119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":2335500119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2335500119}]},"public_addr":"172.21.15.157:6800/2335500119","cluster_addr":"172.21.15.157:6801/2335500119","heartbeat_back_addr":"172.21.15.157:6803/2335500119","heartbeat_front_addr":"172.21.15.157:6802/2335500119","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:28.290592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.700001+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.705490+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.882949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:28.204174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.630992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T21:03:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.217+0000 7f71616d9640 1 -- 172.21.15.5:0/1740877407 >> v2:172.21.15.157:6812/631023601 conn(0x7f713c03bcf0 msgr2=0x7f713c03e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.217+0000 7f71616d9640 1 --2- 172.21.15.5:0/1740877407 >> v2:172.21.15.157:6812/631023601 conn(0x7f713c03bcf0 0x7f713c03e1b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f714c0ab000 tx=0x7f714c0a6000 comp rx=0 tx=0).stop 2024-08-18T21:03:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.217+0000 7f71616d9640 10 monclient: shutdown 2024-08-18T21:03:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.217+0000 7f71616d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.217+0000 7f71616d9640 1 -- 172.21.15.5:0/1740877407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f715c0a6bd0 msgr2=0x7f715c1d1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.217+0000 7f71616d9640 1 --2- 172.21.15.5:0/1740877407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f715c0a6bd0 0x7f715c1d1f00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f714400c7c0 tx=0x7f714400cc80 comp rx=0 tx=0).stop 2024-08-18T21:03:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.217+0000 7f71616d9640 1 -- 172.21.15.5:0/1740877407 shutdown_connections 2024-08-18T21:03:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.217+0000 7f71616d9640 1 --2- 172.21.15.5:0/1740877407 >> v2:172.21.15.157:6812/631023601 conn(0x7f713c03bcf0 0x7f713c03e1b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.217+0000 7f71616d9640 1 --2- 172.21.15.5:0/1740877407 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f715c139990 0x7f715c13db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.217+0000 7f71616d9640 1 --2- 172.21.15.5:0/1740877407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f715c0a6bd0 0x7f715c1d1f00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.217+0000 7f71616d9640 1 --2- 172.21.15.5:0/1740877407 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f715c09f080 0x7f715c140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.217+0000 7f71616d9640 1 -- 172.21.15.5:0/1740877407 >> 172.21.15.5:0/1740877407 conn(0x7f715c068700 msgr2=0x7f715c0aa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.217+0000 7f71616d9640 1 -- 172.21.15.5:0/1740877407 shutdown_connections 2024-08-18T21:03:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.217+0000 7f71616d9640 1 -- 172.21.15.5:0/1740877407 wait complete. 2024-08-18T21:03:43.234 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-18T21:03:43.234 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T21:03:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.349+0000 7fd3aceb4640 10 monclient: get_monmap_and_config 2024-08-18T21:03:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.349+0000 7fd3aceb4640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.349+0000 7fd3aceb4640 10 monclient: monmap: 2024-08-18T21:03:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:43.355359+0000 2024-08-18T21:03:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:43.355359+0000 2024-08-18T21:03:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:43.355 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.349+0000 7fd3aceb4640 1 Processor -- start 2024-08-18T21:03:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.349+0000 7fd3aceb4640 1 -- start start 2024-08-18T21:03:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.349+0000 7fd3aceb4640 10 monclient: init 2024-08-18T21:03:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3aceb4640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3aceb4640 10 monclient: _add_conns ranks=[5,7,3,6,1,4,10,0,9,8,2] 2024-08-18T21:03:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3aceb4640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd3a8139dc0 0x7fd3a813a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3aceb4640 10 monclient(hunting): picked mon.noname-h con 0x7fd3a8139dc0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3aceb4640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd3a809f110 0x7fd3a806c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3aceb4640 10 monclient(hunting): picked mon.noname-i con 0x7fd3a809f110 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3aceb4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd3a806ce90 0x7fd3a806d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3aceb4640 10 monclient(hunting): picked mon.noname-g con 0x7fd3a806ce90 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3aceb4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3aceb4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a80a4f90 con 0x7fd3a806ce90 2024-08-18T21:03:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3aceb4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3aceb4640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fd3a809daa0 con 0x7fd3a8139dc0 2024-08-18T21:03:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3aceb4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3aceb4640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fd3a809deb0 con 0x7fd3a809f110 2024-08-18T21:03:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3aceb4640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3aceb4640 10 monclient(hunting): authenticate will time out at 990.368580s 2024-08-18T21:03:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a6d9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd3a806ce90 0x7fd3a806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd3a809f110 0x7fd3a806c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a659c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd3a8139dc0 0x7fd3a813a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a6d9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd3a806ce90 0x7fd3a806d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:39140/0 (socket says 172.21.15.5:39140) 2024-08-18T21:03:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a6d9d640 1 -- 172.21.15.5:0/1396648671 learned_addr learned my addr 172.21.15.5:0/1396648671 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a6d9d640 10 monclient(hunting): get_auth_request con 0x7fd3a806ce90 auth_method 0 2024-08-18T21:03:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 10 monclient(hunting): get_auth_request con 0x7fd3a809f110 auth_method 0 2024-08-18T21:03:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a659c640 10 monclient(hunting): get_auth_request con 0x7fd3a8139dc0 auth_method 0 2024-08-18T21:03:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 10 monclient(hunting): handle_auth_done global_id 4228 payload 274 2024-08-18T21:03:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 1 -- 172.21.15.5:0/1396648671 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd3a8139dc0 msgr2=0x7fd3a813a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 1 --2- 172.21.15.5:0/1396648671 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd3a8139dc0 0x7fd3a813a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 1 -- 172.21.15.5:0/1396648671 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd3a806ce90 msgr2=0x7fd3a806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 1 --2- 172.21.15.5:0/1396648671 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd3a806ce90 0x7fd3a806d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 1 monclient: found mon.noname-i 2024-08-18T21:03:43.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:03:43.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.353+0000 7fd3a5d9b640 1 -- 172.21.15.5:0/1396648671 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a809e190 con 0x7fd3a809f110 2024-08-18T21:03:43.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3a5d9b640 1 -- 172.21.15.5:0/1396648671 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd3a809f110 msgr2=0x7fd3a806c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3a5d9b640 1 --2- 172.21.15.5:0/1396648671 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd3a809f110 0x7fd3a806c950 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd39c009850 tx=0x7fd39c01c380 comp rx=0 tx=0).ready entity=mon.7 client_cookie=3d160aaaefd55863 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3a559a640 1 -- 172.21.15.5:0/1396648671 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd39c0b0070 con 0x7fd3a809f110 2024-08-18T21:03:43.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3a559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3a559a640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:03:43.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3a559a640 10 monclient: dump: 2024-08-18T21:03:43.365 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.365 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.365 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.365 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.365 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.366 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.366 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.366 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.366 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.366 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.366 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.366 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.366 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.366 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.366 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.366 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3a559a640 10 monclient: _finish_auth 0 2024-08-18T21:03:43.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3a559a640 10 monclient: _check_auth_tickets 2024-08-18T21:03:43.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3a559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3a559a640 1 -- 172.21.15.5:0/1396648671 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd39c0aa810 con 0x7fd3a809f110 2024-08-18T21:03:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3a559a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3aceb4640 5 monclient: authenticate success, global_id 4228 2024-08-18T21:03:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3aceb4640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3aceb4640 4 set_mon_vals no callback set 2024-08-18T21:03:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3aceb4640 10 monclient: shutdown 2024-08-18T21:03:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3aceb4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3aceb4640 1 -- 172.21.15.5:0/1396648671 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd3a809f110 msgr2=0x7fd3a806c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3aceb4640 1 --2- 172.21.15.5:0/1396648671 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd3a809f110 0x7fd3a806c950 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd39c009850 tx=0x7fd39c01c380 comp rx=0 tx=0).stop 2024-08-18T21:03:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3aceb4640 1 -- 172.21.15.5:0/1396648671 shutdown_connections 2024-08-18T21:03:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3aceb4640 1 --2- 172.21.15.5:0/1396648671 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd3a806ce90 0x7fd3a806d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3aceb4640 1 --2- 172.21.15.5:0/1396648671 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd3a809f110 0x7fd3a806c950 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3aceb4640 1 --2- 172.21.15.5:0/1396648671 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd3a8139dc0 0x7fd3a813a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3aceb4640 1 -- 172.21.15.5:0/1396648671 >> 172.21.15.5:0/1396648671 conn(0x7fd3a80688d0 msgr2=0x7fd3a8068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3aceb4640 1 -- 172.21.15.5:0/1396648671 shutdown_connections 2024-08-18T21:03:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3aceb4640 1 -- 172.21.15.5:0/1396648671 wait complete. 2024-08-18T21:03:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3aceb4640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.357+0000 7fd3aceb4640 10 monclient: monmap: 2024-08-18T21:03:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.369 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 1 Processor -- start 2024-08-18T21:03:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 1 -- start start 2024-08-18T21:03:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 10 monclient: init 2024-08-18T21:03:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 10 monclient: _add_conns ranks=[7,2,5,3,0,8,4,1,6] 2024-08-18T21:03:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd3a806ce90 0x7fd3a81d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 10 monclient(hunting): picked mon.noname-i con 0x7fd3a806ce90 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd3a809f110 0x7fd3a8134810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 10 monclient(hunting): picked mon.noname-b con 0x7fd3a809f110 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd3a8139dc0 0x7fd3a813d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 10 monclient(hunting): picked mon.noname-h con 0x7fd3a8139dc0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a81437f0 con 0x7fd3a809f110 2024-08-18T21:03:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fd3a8143670 con 0x7fd3a8139dc0 2024-08-18T21:03:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fd3a8143970 con 0x7fd3a806ce90 2024-08-18T21:03:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 10 monclient(hunting): authenticate will time out at 990.376991s 2024-08-18T21:03:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd3a809f110 0x7fd3a8134810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd3a809f110 0x7fd3a8134810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33212/0 (socket says 172.21.15.5:33212) 2024-08-18T21:03:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 1 -- 172.21.15.5:0/3292112437 learned_addr learned my addr 172.21.15.5:0/3292112437 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 10 monclient(hunting): get_auth_request con 0x7fd3a809f110 auth_method 0 2024-08-18T21:03:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a659c640 1 --2- 172.21.15.5:0/3292112437 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd3a806ce90 0x7fd3a81d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 10 monclient(hunting): handle_auth_done global_id 4295 payload 824 2024-08-18T21:03:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 1 -- 172.21.15.5:0/3292112437 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd3a806ce90 msgr2=0x7fd3a81d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 1 --2- 172.21.15.5:0/3292112437 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd3a806ce90 0x7fd3a81d1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a6d9d640 1 --2- 172.21.15.5:0/3292112437 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd3a8139dc0 0x7fd3a813d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 1 -- 172.21.15.5:0/3292112437 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd3a8139dc0 msgr2=0x7fd3a813d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 1 --2- 172.21.15.5:0/3292112437 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd3a8139dc0 0x7fd3a813d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 1 monclient: found mon.noname-b 2024-08-18T21:03:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 1 -- 172.21.15.5:0/3292112437 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a80a4150 con 0x7fd3a809f110 2024-08-18T21:03:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a659c640 10 monclient: get_auth_request con 0x7fd3a806ce90 auth_method 0 2024-08-18T21:03:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a6d9d640 10 monclient: get_auth_request con 0x7fd3a8139dc0 auth_method 0 2024-08-18T21:03:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a659c640 1 --2- 172.21.15.5:0/3292112437 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd3a806ce90 0x7fd3a81d1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a6d9d640 1 --2- 172.21.15.5:0/3292112437 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd3a8139dc0 0x7fd3a813d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:43.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 1 -- 172.21.15.5:0/3292112437 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd3a809f110 msgr2=0x7fd3a8134810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3a5d9b640 1 --2- 172.21.15.5:0/3292112437 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd3a809f110 0x7fd3a8134810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd39c01c1b0 tx=0x7fd39c019120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd396ffd640 1 -- 172.21.15.5:0/3292112437 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd39c0b0040 con 0x7fd3a809f110 2024-08-18T21:03:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd396ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd396ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd396ffd640 10 monclient: dump: 2024-08-18T21:03:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.376 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd396ffd640 10 monclient: _finish_auth 0 2024-08-18T21:03:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd396ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:03:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd396ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd396ffd640 1 -- 172.21.15.5:0/3292112437 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd39c004250 con 0x7fd3a809f110 2024-08-18T21:03:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd396ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd396ffd640 1 -- 172.21.15.5:0/3292112437 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd39c004400 con 0x7fd3a809f110 2024-08-18T21:03:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd396ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd396ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd396ffd640 10 monclient: dump: 2024-08-18T21:03:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.378 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd397fff640 4 set_mon_vals no callback set 2024-08-18T21:03:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.361+0000 7fd3aceb4640 5 monclient: authenticate success, global_id 4295 2024-08-18T21:03:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.365+0000 7fd3aceb4640 10 monclient: _renew_subs 2024-08-18T21:03:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.365+0000 7fd3aceb4640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.365+0000 7fd3aceb4640 1 -- 172.21.15.5:0/3292112437 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a811f910 con 0x7fd3a809f110 2024-08-18T21:03:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.365+0000 7fd3aceb4640 10 monclient: _renew_subs 2024-08-18T21:03:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.365+0000 7fd3aceb4640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.365+0000 7fd3aceb4640 1 -- 172.21.15.5:0/3292112437 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a8140140 con 0x7fd3a809f110 2024-08-18T21:03:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.365+0000 7fd3aceb4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.365+0000 7fd3aceb4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.365+0000 7fd3aceb4640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.365+0000 7fd3aceb4640 1 -- 172.21.15.5:0/3292112437 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3a806c950 con 0x7fd3a809f110 2024-08-18T21:03:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.365+0000 7fd396ffd640 1 -- 172.21.15.5:0/3292112437 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fd39c0aa7e0 con 0x7fd3a809f110 2024-08-18T21:03:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.365+0000 7fd396ffd640 1 --2- 172.21.15.5:0/3292112437 >> v2:172.21.15.157:6812/631023601 conn(0x7fd38803bdc0 0x7fd38803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.365+0000 7fd396ffd640 1 -- 172.21.15.5:0/3292112437 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fd39c0e80b0 con 0x7fd3a809f110 2024-08-18T21:03:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.365+0000 7fd3a659c640 1 --2- 172.21.15.5:0/3292112437 >> v2:172.21.15.157:6812/631023601 conn(0x7fd38803bdc0 0x7fd38803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.365+0000 7fd3a659c640 10 monclient: get_auth_request con 0x7fd38803bdc0 auth_method 0 2024-08-18T21:03:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.369+0000 7fd3a659c640 1 --2- 172.21.15.5:0/3292112437 >> v2:172.21.15.157:6812/631023601 conn(0x7fd38803bdc0 0x7fd38803e280 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0007440 tx=0x7fd3a000b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.369+0000 7fd396ffd640 1 -- 172.21.15.5:0/3292112437 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fd39c016090 con 0x7fd3a809f110 2024-08-18T21:03:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.369+0000 7fd396ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.369+0000 7fd396ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:43.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.533+0000 7fd3aceb4640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:43.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.533+0000 7fd3aceb4640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:43.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.533+0000 7fd3aceb4640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:43.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.533+0000 7fd3aceb4640 1 -- 172.21.15.5:0/3292112437 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3a811fdc0 con 0x7fd3a809f110 2024-08-18T21:03:43.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd396ffd640 1 -- 172.21.15.5:0/3292112437 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+10923 (secure 0 0 0) 0x7fd39c0039f0 con 0x7fd3a809f110 2024-08-18T21:03:43.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd396ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:43.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd396ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:43.539 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:03:43.539 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","created":"2024-08-18T21:03:17.118714+0000","modified":"2024-08-18T21:03:42.169675+0000","last_up_change":"2024-08-18T21:03:30.570125+0000","last_in_change":"2024-08-18T21:03:21.231242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T21:03:31.386335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-18T21:03:37.578348+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f6d162e-ed99-408f-87c5-4880e57b4f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":150392090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":150392090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":150392090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":150392090}]},"public_addr":"172.21.15.5:6808/150392090","cluster_addr":"172.21.15.5:6809/150392090","heartbeat_back_addr":"172.21.15.5:6811/150392090","heartbeat_front_addr":"172.21.15.5:6810/150392090","state":["exists","up"]},{"osd":1,"uuid":"99984157-5771-44d0-b5fa-c3e5b2537e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1057536297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6805","nonce":1057536297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":1057536297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1057536297}]},"public_addr":"172.21.15.5:6804/1057536297","cluster_addr":"172.21.15.5:6805/1057536297","heartbeat_back_addr":"172.21.15.5:6807/1057536297","heartbeat_front_addr":"172.21.15.5:6806/1057536297","state":["exists","up"]},{"osd":2,"uuid":"00fd1d05-f5a1-4d89-8e2c-47a61392f500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3354229361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":3354229361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":3354229361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3354229361}]},"public_addr":"172.21.15.5:6800/3354229361","cluster_addr":"172.21.15.5:6801/3354229361","heartbeat_back_addr":"172.21.15.5:6803/3354229361","heartbeat_front_addr":"172.21.15.5:6802/3354229361","state":["exists","up"]},{"osd":3,"uuid":"8bb1ba33-9e75-43ee-bbfc-7ab22350e4a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1750098759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6805","nonce":1750098759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":1750098759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1750098759}]},"public_addr":"172.21.15.157:6804/1750098759","cluster_addr":"172.21.15.157:6805/1750098759","heartbeat_back_addr":"172.21.15.157:6807/1750098759","heartbeat_front_addr":"172.21.15.157:6806/1750098759","state":["exists","up"]},{"osd":4,"uuid":"f7043f2f-d6d1-4c40-bf70-80a10071a795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":269684279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":269684279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":269684279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":269684279}]},"public_addr":"172.21.15.157:6808/269684279","cluster_addr":"172.21.15.157:6809/269684279","heartbeat_back_addr":"172.21.15.157:6811/269684279","heartbeat_front_addr":"172.21.15.157:6810/269684279","state":["exists","up"]},{"osd":5,"uuid":"6d9d2c91-ec42-46cf-9b18-8c488f1f489c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2335500119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6801","nonce":2335500119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":2335500119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2335500119}]},"public_addr":"172.21.15.157:6800/2335500119","cluster_addr":"172.21.15.157:6801/2335500119","heartbeat_back_addr":"172.21.15.157:6803/2335500119","heartbeat_front_addr":"172.21.15.157:6802/2335500119","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:28.290592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.700001+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.705490+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.882949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:28.204174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.630992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T21:03:43.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd3aceb4640 1 -- 172.21.15.5:0/3292112437 >> v2:172.21.15.157:6812/631023601 conn(0x7fd38803bdc0 msgr2=0x7fd38803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd3aceb4640 1 --2- 172.21.15.5:0/3292112437 >> v2:172.21.15.157:6812/631023601 conn(0x7fd38803bdc0 0x7fd38803e280 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0007440 tx=0x7fd3a000b040 comp rx=0 tx=0).stop 2024-08-18T21:03:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd3aceb4640 10 monclient: shutdown 2024-08-18T21:03:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd3aceb4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd3aceb4640 1 -- 172.21.15.5:0/3292112437 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd3a809f110 msgr2=0x7fd3a8134810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd3aceb4640 1 --2- 172.21.15.5:0/3292112437 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd3a809f110 0x7fd3a8134810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd39c01c1b0 tx=0x7fd39c019120 comp rx=0 tx=0).stop 2024-08-18T21:03:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd3aceb4640 1 -- 172.21.15.5:0/3292112437 shutdown_connections 2024-08-18T21:03:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd3aceb4640 1 --2- 172.21.15.5:0/3292112437 >> v2:172.21.15.157:6812/631023601 conn(0x7fd38803bdc0 0x7fd38803e280 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd3aceb4640 1 --2- 172.21.15.5:0/3292112437 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd3a8139dc0 0x7fd3a813d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd3aceb4640 1 --2- 172.21.15.5:0/3292112437 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd3a809f110 0x7fd3a8134810 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd3aceb4640 1 --2- 172.21.15.5:0/3292112437 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd3a806ce90 0x7fd3a81d1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd3aceb4640 1 -- 172.21.15.5:0/3292112437 >> 172.21.15.5:0/3292112437 conn(0x7fd3a80688d0 msgr2=0x7fd3a80a79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd3aceb4640 1 -- 172.21.15.5:0/3292112437 shutdown_connections 2024-08-18T21:03:43.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.537+0000 7fd3aceb4640 1 -- 172.21.15.5:0/3292112437 wait complete. 2024-08-18T21:03:43.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-18T21:03:43.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-18T21:03:43.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-18T21:03:43.558 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-18T21:03:43.558 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-18T21:03:43.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-18T21:03:43.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.669+0000 7fe241b8a640 10 monclient: get_monmap_and_config 2024-08-18T21:03:43.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.669+0000 7fe241b8a640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.669+0000 7fe241b8a640 10 monclient: monmap: 2024-08-18T21:03:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:43.675262+0000 2024-08-18T21:03:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:43.675262+0000 2024-08-18T21:03:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:43.675 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.669+0000 7f793cbcf640 10 monclient: get_monmap_and_config 2024-08-18T21:03:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.669+0000 7f793cbcf640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.669+0000 7f793cbcf640 10 monclient: monmap: 2024-08-18T21:03:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:43.675755+0000 2024-08-18T21:03:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:43.675755+0000 2024-08-18T21:03:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:43.677 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.669+0000 7fe241b8a640 1 Processor -- start 2024-08-18T21:03:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.669+0000 7fe241b8a640 1 -- start start 2024-08-18T21:03:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.669+0000 7fe241b8a640 10 monclient: init 2024-08-18T21:03:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.669+0000 7f793cbcf640 1 Processor -- start 2024-08-18T21:03:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793cbcf640 1 -- start start 2024-08-18T21:03:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793cbcf640 10 monclient: init 2024-08-18T21:03:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe241b8a640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe241b8a640 10 monclient: _add_conns ranks=[1,7,10,4,8,5,3,9,0,2,6] 2024-08-18T21:03:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe241b8a640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fe23c0a6bd0 addr v1:172.21.15.157:6789/0 2024-08-18T21:03:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe241b8a640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe23c09f080 0x7fe23c13ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe241b8a640 10 monclient(hunting): picked mon.noname-i con 0x7fe23c09f080 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe241b8a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe23c0a76c0 0x7fe23c141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe241b8a640 10 monclient(hunting): picked mon.noname-f con 0x7fe23c0a76c0 addr v2:172.21.15.157:3300/0 2024-08-18T21:03:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe241b8a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe23c0a7fb0 con 0x7fe23c0a6bd0 2024-08-18T21:03:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe241b8a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe241b8a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe23c09e4c0 con 0x7fe23c0a76c0 2024-08-18T21:03:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe241b8a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe241b8a640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fe23c06f930 con 0x7fe23c09f080 2024-08-18T21:03:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe241b8a640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe241b8a640 10 monclient(hunting): authenticate will time out at 990.688416s 2024-08-18T21:03:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793cbcf640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793cbcf640 10 monclient: _add_conns ranks=[0,4,7,10,3,9,1,8,2,5,6] 2024-08-18T21:03:43.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793cbcf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f79380a4960 addr v1:172.21.15.5:6789/0 2024-08-18T21:03:43.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793cbcf640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f793809df40 0x7f793813ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793cbcf640 10 monclient(hunting): picked mon.noname-c con 0x7f793809df40 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:43.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f793809df40 0x7f793813ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f79380a4960 0x7f79380a4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51292/0 (socket says 172.21.15.5:51292) 2024-08-18T21:03:43.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793659c640 1 -- 172.21.15.5:0/1893560083 learned_addr learned my addr 172.21.15.5:0/1893560083 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:03:43.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe23c09f080 0x7fe23c13ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe23c09f080 0x7fe23c13ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:49308/0 (socket says 172.21.15.5:49308) 2024-08-18T21:03:43.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 1 -- 172.21.15.5:0/1393940305 learned_addr learned my addr 172.21.15.5:0/1393940305 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 10 monclient(hunting): get_auth_request con 0x7fe23c09f080 auth_method 0 2024-08-18T21:03:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23bfff640 1 --2- 172.21.15.5:0/1393940305 >> v2:172.21.15.157:3300/0 conn(0x7fe23c0a76c0 0x7fe23c141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23bfff640 10 monclient(hunting): get_auth_request con 0x7fe23c0a76c0 auth_method 0 2024-08-18T21:03:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793cbcf640 1 --2- 172.21.15.5:0/1893560083 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79380a5450 0x7f793813df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793cbcf640 10 monclient(hunting): picked mon.noname-i con 0x7f79380a5450 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793cbcf640 1 -- 172.21.15.5:0/1893560083 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793809e3c0 con 0x7f79380a4960 2024-08-18T21:03:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793cbcf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793cbcf640 1 -- 172.21.15.5:0/1893560083 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f793809fd00 con 0x7f793809df40 2024-08-18T21:03:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793cbcf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793cbcf640 1 -- 172.21.15.5:0/1893560083 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7938069510 con 0x7f79380a5450 2024-08-18T21:03:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793cbcf640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f793cbcf640 10 monclient(hunting): authenticate will time out at 990.689290s 2024-08-18T21:03:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 10 monclient(hunting): get_auth_request con 0x7f793809df40 auth_method 0 2024-08-18T21:03:43.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7936d9d640 1 --2- 172.21.15.5:0/1893560083 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79380a5450 0x7f793813df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7936d9d640 10 monclient(hunting): get_auth_request con 0x7f79380a5450 auth_method 0 2024-08-18T21:03:43.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7936d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7936d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7936d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 10 monclient(hunting): handle_auth_done global_id 4237 payload 274 2024-08-18T21:03:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 1 -- 172.21.15.5:0/1393940305 >> v2:172.21.15.157:3300/0 conn(0x7fe23c0a76c0 msgr2=0x7fe23c141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 1 --2- 172.21.15.5:0/1393940305 >> v2:172.21.15.157:3300/0 conn(0x7fe23c0a76c0 0x7fe23c141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 1 -- 172.21.15.5:0/1393940305 >> v1:172.21.15.157:6789/0 conn(0x7fe23c0a6bd0 legacy=0x7fe23c0a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 1 monclient: found mon.noname-i 2024-08-18T21:03:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:03:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7fe23affd640 1 -- 172.21.15.5:0/1393940305 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23c09de70 con 0x7fe23c09f080 2024-08-18T21:03:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 10 monclient(hunting): handle_auth_done global_id 4279 payload 274 2024-08-18T21:03:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 1 -- 172.21.15.5:0/1893560083 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79380a5450 msgr2=0x7f793813df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 1 --2- 172.21.15.5:0/1893560083 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79380a5450 0x7f793813df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 1 -- 172.21.15.5:0/1893560083 >> v1:172.21.15.5:6789/0 conn(0x7f79380a4960 legacy=0x7f79380a4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 1 monclient: found mon.noname-c 2024-08-18T21:03:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.673+0000 7f7935d9b640 1 -- 172.21.15.5:0/1893560083 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79380a3310 con 0x7f793809df40 2024-08-18T21:03:43.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe23affd640 1 -- 172.21.15.5:0/1393940305 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe23c09f080 msgr2=0x7fe23c13ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe23affd640 1 --2- 172.21.15.5:0/1393940305 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe23c09f080 0x7fe23c13ede0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe230009870 tx=0x7fe23001c420 comp rx=0 tx=0).ready entity=mon.7 client_cookie=f566cd2e8ab9e8cc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7935d9b640 1 -- 172.21.15.5:0/1893560083 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f793809df40 msgr2=0x7f793813ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7935d9b640 1 --2- 172.21.15.5:0/1893560083 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f793809df40 0x7f793813ba30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f792c0097f0 tx=0x7f792c0207c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=36af7d061bb4f120 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7935d9b640 1 -- 172.21.15.5:0/1893560083 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f793809df40 msgr2=0x7f793813ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-08-18T21:03:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7935d9b640 1 -- 172.21.15.5:0/1893560083 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f793809df40 msgr2=0x7f793813ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:03:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7935d9b640 1 --2- 172.21.15.5:0/1893560083 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f793809df40 0x7f793813ba30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f792c0097f0 tx=0x7f792c0207c0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7935d9b640 1 --2- 172.21.15.5:0/1893560083 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f793809df40 0x7f793813ba30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f792c0097f0 tx=0x7f792c0207c0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 10 monclient: ms_handle_reset current mon [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 1 -- 172.21.15.5:0/1893560083 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f793809df40 msgr2=0x7f793813ba30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 1 --2- 172.21.15.5:0/1893560083 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f793809df40 0x7f793813ba30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 10 monclient: _add_conns ranks=[10,9,8,1,5,3,2,6] 2024-08-18T21:03:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 1 --2- 172.21.15.5:0/1893560083 >> v2:172.21.15.157:3300/0 conn(0x7f7920003640 0x7f7920005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 10 monclient(hunting): picked mon.noname-f con 0x7f7920003640 addr v2:172.21.15.157:3300/0 2024-08-18T21:03:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 1 --2- 172.21.15.5:0/1893560083 >> v2:172.21.15.5:3300/0 conn(0x7f79200062e0 0x7f79200087a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 10 monclient(hunting): picked mon.noname-a con 0x7f79200062e0 addr v2:172.21.15.5:3300/0 2024-08-18T21:03:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 1 --2- 172.21.15.5:0/1893560083 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7920009070 0x7f792000b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 10 monclient(hunting): picked mon.noname-e con 0x7f7920009070 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 1 -- 172.21.15.5:0/1893560083 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f792000be60 con 0x7f79200062e0 2024-08-18T21:03:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 1 -- 172.21.15.5:0/1893560083 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f792000bfe0 con 0x7f7920003640 2024-08-18T21:03:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 1 -- 172.21.15.5:0/1893560083 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f792000c1e0 con 0x7f7920009070 2024-08-18T21:03:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793559a640 10 monclient(hunting): ms_handle_reset stray mon [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe23a7fc640 1 -- 172.21.15.5:0/1393940305 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe2300b0070 con 0x7fe23c09f080 2024-08-18T21:03:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe23a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe23a7fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:03:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe23a7fc640 10 monclient: dump: 2024-08-18T21:03:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.693 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe23a7fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe23a7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe23a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe241b8a640 5 monclient: authenticate success, global_id 4237 2024-08-18T21:03:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe241b8a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe23a7fc640 1 -- 172.21.15.5:0/1393940305 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2300aa810 con 0x7fe23c09f080 2024-08-18T21:03:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe23a7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe241b8a640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe23a7fc640 1 -- 172.21.15.5:0/1393940305 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe2300a9300 con 0x7fe23c09f080 2024-08-18T21:03:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe23a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe241b8a640 4 set_mon_vals no callback set 2024-08-18T21:03:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe23a7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:03:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe23a7fc640 10 monclient: dump: 2024-08-18T21:03:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.695 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793659c640 1 --2- 172.21.15.5:0/1893560083 >> v2:172.21.15.157:3300/0 conn(0x7f7920003640 0x7f7920005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793659c640 10 monclient(hunting): get_auth_request con 0x7f7920003640 auth_method 0 2024-08-18T21:03:43.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:43.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 1 --2- 172.21.15.5:0/1893560083 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7920009070 0x7f792000b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 10 monclient(hunting): get_auth_request con 0x7f7920009070 auth_method 0 2024-08-18T21:03:43.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:43.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f793659c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:03:43.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:03:43.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7935d9b640 1 --2- 172.21.15.5:0/1893560083 >> v2:172.21.15.5:3300/0 conn(0x7f79200062e0 0x7f79200087a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7935d9b640 10 monclient(hunting): get_auth_request con 0x7f79200062e0 auth_method 0 2024-08-18T21:03:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7935d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7935d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7935d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 10 monclient(hunting): handle_auth_done global_id 4279 payload 293 2024-08-18T21:03:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 1 -- 172.21.15.5:0/1893560083 >> v2:172.21.15.157:3300/0 conn(0x7f7920003640 msgr2=0x7f7920005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 1 --2- 172.21.15.5:0/1893560083 >> v2:172.21.15.157:3300/0 conn(0x7f7920003640 0x7f7920005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 1 -- 172.21.15.5:0/1893560083 >> v2:172.21.15.5:3300/0 conn(0x7f79200062e0 msgr2=0x7f79200087a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 1 --2- 172.21.15.5:0/1893560083 >> v2:172.21.15.5:3300/0 conn(0x7f79200062e0 0x7f79200087a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 1 monclient: found mon.noname-e 2024-08-18T21:03:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 1 -- 172.21.15.5:0/1893560083 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792000c4a0 con 0x7f7920009070 2024-08-18T21:03:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7f7936d9d640 1 -- 172.21.15.5:0/1893560083 reap_dead start 2024-08-18T21:03:43.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe241b8a640 10 monclient: shutdown 2024-08-18T21:03:43.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe241b8a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:43.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe241b8a640 1 -- 172.21.15.5:0/1393940305 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe23c09f080 msgr2=0x7fe23c13ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe241b8a640 1 --2- 172.21.15.5:0/1393940305 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe23c09f080 0x7fe23c13ede0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe230009870 tx=0x7fe23001c420 comp rx=0 tx=0).stop 2024-08-18T21:03:43.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe241b8a640 1 -- 172.21.15.5:0/1393940305 shutdown_connections 2024-08-18T21:03:43.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe241b8a640 1 --2- 172.21.15.5:0/1393940305 >> v2:172.21.15.157:3300/0 conn(0x7fe23c0a76c0 0x7fe23c141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe241b8a640 1 --2- 172.21.15.5:0/1393940305 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe23c09f080 0x7fe23c13ede0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe241b8a640 1 -- 172.21.15.5:0/1393940305 >> 172.21.15.5:0/1393940305 conn(0x7fe23c068700 msgr2=0x7fe23c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:43.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe241b8a640 1 -- 172.21.15.5:0/1393940305 shutdown_connections 2024-08-18T21:03:43.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.677+0000 7fe241b8a640 1 -- 172.21.15.5:0/1393940305 wait complete. 2024-08-18T21:03:43.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 10 monclient: monmap: 2024-08-18T21:03:43.702 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.702 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:43.702 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:43.702 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:43.702 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.702 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.702 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:43.702 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:43.702 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.702 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.702 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.702 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.702 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.703 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.703 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.703 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 1 Processor -- start 2024-08-18T21:03:43.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 1 -- start start 2024-08-18T21:03:43.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 10 monclient: init 2024-08-18T21:03:43.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 10 monclient: _add_conns ranks=[8,2,7,3,0,4,1,5,6] 2024-08-18T21:03:43.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe23c09f080 0x7fe23c1d12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 10 monclient(hunting): picked mon.noname-e con 0x7fe23c09f080 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:43.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe23c0a6bd0 0x7fe23c1d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 10 monclient(hunting): picked mon.noname-b con 0x7fe23c0a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:43.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f7936d9d640 1 -- 172.21.15.5:0/1893560083 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7920009070 msgr2=0x7f792000b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f7936d9d640 1 --2- 172.21.15.5:0/1893560083 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7920009070 0x7f792000b530 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f79200034d0 tx=0x7f792c009190 comp rx=0 tx=0).ready entity=mon.8 client_cookie=e3a9e983c19f862c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe23c09f080 0x7fe23c1d12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23affd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe23c0a6bd0 0x7fe23c1d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe23c09f080 0x7fe23c1d12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:44398/0 (socket says 172.21.15.5:44398) 2024-08-18T21:03:43.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23affd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe23c0a6bd0 0x7fe23c1d17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33216/0 (socket says 172.21.15.5:33216) 2024-08-18T21:03:43.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 1 -- 172.21.15.5:0/28673038 learned_addr learned my addr 172.21.15.5:0/28673038 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:43.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 1 --2- 172.21.15.5:0/28673038 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe23c0a76c0 0x7fe23c1d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 10 monclient(hunting): picked mon.noname-i con 0x7fe23c0a76c0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:43.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 1 -- 172.21.15.5:0/28673038 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fe23c144210 con 0x7fe23c0a6bd0 2024-08-18T21:03:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 1 -- 172.21.15.5:0/28673038 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fe23c144090 con 0x7fe23c0a76c0 2024-08-18T21:03:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 1 -- 172.21.15.5:0/28673038 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fe23c144390 con 0x7fe23c09f080 2024-08-18T21:03:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe241b8a640 10 monclient(hunting): authenticate will time out at 990.697663s 2024-08-18T21:03:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 10 monclient(hunting): get_auth_request con 0x7fe23c09f080 auth_method 0 2024-08-18T21:03:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23affd640 10 monclient(hunting): get_auth_request con 0x7fe23c0a6bd0 auth_method 0 2024-08-18T21:03:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793559a640 1 -- 172.21.15.5:0/1893560083 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7930019070 con 0x7f7920009070 2024-08-18T21:03:43.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793559a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793559a640 10 monclient: dump: 2024-08-18T21:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.709 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793559a640 10 monclient: _finish_auth 0 2024-08-18T21:03:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793559a640 10 monclient: _check_auth_tickets 2024-08-18T21:03:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793559a640 1 -- 172.21.15.5:0/1893560083 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79300137d0 con 0x7f7920009070 2024-08-18T21:03:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793559a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793559a640 1 -- 172.21.15.5:0/1893560083 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7930009be0 con 0x7f7920009070 2024-08-18T21:03:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793559a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793559a640 10 monclient: dump: 2024-08-18T21:03:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.710 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.710 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.710 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.710 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.710 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.710 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.710 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.710 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.710 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.710 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.710 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.710 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.710 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.710 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793cbcf640 5 monclient: authenticate success, global_id 4279 2024-08-18T21:03:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793cbcf640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793cbcf640 4 set_mon_vals no callback set 2024-08-18T21:03:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23bfff640 1 --2- 172.21.15.5:0/28673038 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe23c0a76c0 0x7fe23c1d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23bfff640 10 monclient(hunting): get_auth_request con 0x7fe23c0a76c0 auth_method 0 2024-08-18T21:03:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 10 monclient(hunting): handle_auth_done global_id 4202 payload 824 2024-08-18T21:03:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 1 -- 172.21.15.5:0/28673038 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe23c0a76c0 msgr2=0x7fe23c1d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 1 --2- 172.21.15.5:0/28673038 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe23c0a76c0 0x7fe23c1d1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 1 -- 172.21.15.5:0/28673038 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe23c0a6bd0 msgr2=0x7fe23c1d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 1 --2- 172.21.15.5:0/28673038 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe23c0a6bd0 0x7fe23c1d17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 1 monclient: found mon.noname-e 2024-08-18T21:03:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:43.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7fe23b7fe640 1 -- 172.21.15.5:0/28673038 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23c0aba10 con 0x7fe23c09f080 2024-08-18T21:03:43.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793cbcf640 10 monclient: shutdown 2024-08-18T21:03:43.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793cbcf640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:43.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793cbcf640 1 -- 172.21.15.5:0/1893560083 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7920009070 msgr2=0x7f792000b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793cbcf640 1 --2- 172.21.15.5:0/1893560083 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7920009070 0x7f792000b530 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f79200034d0 tx=0x7f792c009190 comp rx=0 tx=0).stop 2024-08-18T21:03:43.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793cbcf640 1 -- 172.21.15.5:0/1893560083 shutdown_connections 2024-08-18T21:03:43.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793cbcf640 1 --2- 172.21.15.5:0/1893560083 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7920009070 0x7f792000b530 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793cbcf640 1 -- 172.21.15.5:0/1893560083 >> 172.21.15.5:0/1893560083 conn(0x7f79380a6440 msgr2=0x7f7938068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793cbcf640 1 -- 172.21.15.5:0/1893560083 shutdown_connections 2024-08-18T21:03:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793cbcf640 1 -- 172.21.15.5:0/1893560083 wait complete. 2024-08-18T21:03:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793cbcf640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.681+0000 7f793cbcf640 10 monclient: monmap: 2024-08-18T21:03:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.716 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 1 Processor -- start 2024-08-18T21:03:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 1 -- start start 2024-08-18T21:03:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 10 monclient: init 2024-08-18T21:03:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe23b7fe640 1 -- 172.21.15.5:0/28673038 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe23c09f080 msgr2=0x7fe23c1d12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe23b7fe640 1 --2- 172.21.15.5:0/28673038 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe23c09f080 0x7fe23c1d12a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00c480 tx=0x7fe22c00c940 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 1 -- 172.21.15.5:0/28673038 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe22c012cb0 con 0x7fe23c09f080 2024-08-18T21:03:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 10 monclient: dump: 2024-08-18T21:03:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.718 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 10 monclient: _finish_auth 0 2024-08-18T21:03:43.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 10 monclient: _check_auth_tickets 2024-08-18T21:03:43.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:43.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 1 -- 172.21.15.5:0/28673038 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe22c017070 con 0x7fe23c09f080 2024-08-18T21:03:43.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe241b8a640 5 monclient: authenticate success, global_id 4202 2024-08-18T21:03:43.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe241b8a640 10 monclient: _renew_subs 2024-08-18T21:03:43.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe241b8a640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:43.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe241b8a640 1 -- 172.21.15.5:0/28673038 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe23c129e10 con 0x7fe23c09f080 2024-08-18T21:03:43.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe241b8a640 10 monclient: _renew_subs 2024-08-18T21:03:43.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe241b8a640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:43.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe241b8a640 1 -- 172.21.15.5:0/28673038 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fe23c12a8d0 con 0x7fe23c09f080 2024-08-18T21:03:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 1 -- 172.21.15.5:0/28673038 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe22c0117f0 con 0x7fe23c09f080 2024-08-18T21:03:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 10 monclient: dump: 2024-08-18T21:03:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.721 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.721 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.721 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.721 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.721 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.721 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.721 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.721 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.721 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe239ffb640 4 set_mon_vals no callback set 2024-08-18T21:03:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 10 monclient: _add_conns ranks=[5,0,7,3,6,1,8,4,2] 2024-08-18T21:03:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7920009070 0x7f79381232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 10 monclient(hunting): picked mon.noname-h con 0x7f7920009070 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7938123820 0x7f7938123c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe241b8a640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe241b8a640 1 -- 172.21.15.5:0/28673038 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe23c129560 con 0x7fe23c09f080 2024-08-18T21:03:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7938123820 0x7f7938123c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7938123820 0x7f7938123c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55300/0 (socket says 172.21.15.5:55300) 2024-08-18T21:03:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793659c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7920009070 0x7f79381232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 1 -- 172.21.15.5:0/69566348 learned_addr learned my addr 172.21.15.5:0/69566348 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793659c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7920009070 0x7f79381232e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:50426/0 (socket says 172.21.15.5:50426) 2024-08-18T21:03:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 10 monclient(hunting): picked mon.noname-a con 0x7f7938123820 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 1 --2- 172.21.15.5:0/69566348 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79381cd260 0x7f79381cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 10 monclient(hunting): picked mon.noname-i con 0x7f79381cd260 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 1 -- 172.21.15.5:0/69566348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f79380a50d0 con 0x7f7938123820 2024-08-18T21:03:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 1 -- 172.21.15.5:0/69566348 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f79380a4f50 con 0x7f7920009070 2024-08-18T21:03:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 1 -- 172.21.15.5:0/69566348 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f79380a5250 con 0x7f79381cd260 2024-08-18T21:03:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793cbcf640 10 monclient(hunting): authenticate will time out at 990.702060s 2024-08-18T21:03:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 10 monclient(hunting): get_auth_request con 0x7f7938123820 auth_method 0 2024-08-18T21:03:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793659c640 10 monclient(hunting): get_auth_request con 0x7f7920009070 auth_method 0 2024-08-18T21:03:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7936d9d640 1 --2- 172.21.15.5:0/69566348 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79381cd260 0x7f79381cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7936d9d640 10 monclient(hunting): get_auth_request con 0x7f79381cd260 auth_method 0 2024-08-18T21:03:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7936d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7936d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7936d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f793659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7936d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7936d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7936d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 10 monclient(hunting): handle_auth_done global_id 4266 payload 824 2024-08-18T21:03:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 1 -- 172.21.15.5:0/69566348 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79381cd260 msgr2=0x7f79381cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 1 --2- 172.21.15.5:0/69566348 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79381cd260 0x7f79381cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 1 -- 172.21.15.5:0/69566348 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7920009070 msgr2=0x7f79381232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 1 --2- 172.21.15.5:0/69566348 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7920009070 0x7f79381232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 1 monclient: found mon.noname-a 2024-08-18T21:03:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7f7935d9b640 1 -- 172.21.15.5:0/69566348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7938126100 con 0x7f7938123820 2024-08-18T21:03:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 1 -- 172.21.15.5:0/28673038 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe22c011380 con 0x7fe23c09f080 2024-08-18T21:03:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 1 --2- 172.21.15.5:0/28673038 >> v2:172.21.15.157:6812/631023601 conn(0x7fe22803bdc0 0x7fe22803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 1 -- 172.21.15.5:0/28673038 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fe22c04e360 con 0x7fe23c09f080 2024-08-18T21:03:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 1 --2- 172.21.15.5:0/28673038 >> v2:172.21.15.157:6800/2335500119 conn(0x7fe2280418d0 0x7fe228043d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe223fff640 1 -- 172.21.15.5:0/28673038 --> v2:172.21.15.157:6800/2335500119 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2280443a0 con 0x7fe2280418d0 2024-08-18T21:03:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe23affd640 1 --2- 172.21.15.5:0/28673038 >> v2:172.21.15.157:6812/631023601 conn(0x7fe22803bdc0 0x7fe22803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe23bfff640 1 --2- 172.21.15.5:0/28673038 >> v2:172.21.15.157:6800/2335500119 conn(0x7fe2280418d0 0x7fe228043d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe23affd640 10 monclient: get_auth_request con 0x7fe22803bdc0 auth_method 0 2024-08-18T21:03:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe23bfff640 10 monclient: get_auth_request con 0x7fe2280418d0 auth_method 0 2024-08-18T21:03:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe23bfff640 1 -- 172.21.15.5:0/28673038 >> v2:172.21.15.157:6800/2335500119 conn(0x7fe2280418d0 msgr2=0x7fe228043d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-18T21:03:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe23bfff640 1 -- 172.21.15.5:0/28673038 >> v2:172.21.15.157:6800/2335500119 conn(0x7fe2280418d0 msgr2=0x7fe228043d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:03:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe23bfff640 1 --2- 172.21.15.5:0/28673038 >> v2:172.21.15.157:6800/2335500119 conn(0x7fe2280418d0 0x7fe228043d10 crc :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:43.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.685+0000 7fe23bfff640 1 --2- 172.21.15.5:0/28673038 >> v2:172.21.15.157:6800/2335500119 conn(0x7fe2280418d0 0x7fe228043d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:03:43.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7935d9b640 1 -- 172.21.15.5:0/69566348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7938123820 msgr2=0x7f7938123c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7935d9b640 1 --2- 172.21.15.5:0/69566348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7938123820 0x7f7938123c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f792c09c0d0 tx=0x7f792c01d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 1 -- 172.21.15.5:0/69566348 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f792c0aeae0 con 0x7f7938123820 2024-08-18T21:03:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 10 monclient: dump: 2024-08-18T21:03:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.734 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 10 monclient: _finish_auth 0 2024-08-18T21:03:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:03:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 1 -- 172.21.15.5:0/69566348 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792c0b3070 con 0x7f7938123820 2024-08-18T21:03:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f793cbcf640 5 monclient: authenticate success, global_id 4266 2024-08-18T21:03:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f793cbcf640 10 monclient: _renew_subs 2024-08-18T21:03:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 1 -- 172.21.15.5:0/69566348 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f792c0aec80 con 0x7f7938123820 2024-08-18T21:03:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7934d99640 4 set_mon_vals no callback set 2024-08-18T21:03:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f793cbcf640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f793cbcf640 1 -- 172.21.15.5:0/69566348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7938124c10 con 0x7f7938123820 2024-08-18T21:03:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 10 monclient: dump: 2024-08-18T21:03:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.736 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f793cbcf640 10 monclient: _renew_subs 2024-08-18T21:03:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f793cbcf640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f793cbcf640 1 -- 172.21.15.5:0/69566348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7938127470 con 0x7f7938123820 2024-08-18T21:03:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 1 -- 172.21.15.5:0/69566348 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f792c0ae670 con 0x7f7938123820 2024-08-18T21:03:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f793cbcf640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f793cbcf640 1 -- 172.21.15.5:0/69566348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f79380a4420 con 0x7f7938123820 2024-08-18T21:03:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 1 --2- 172.21.15.5:0/69566348 >> v2:172.21.15.157:6812/631023601 conn(0x7f791803bdc0 0x7f791803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 1 -- 172.21.15.5:0/69566348 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f792c0edde0 con 0x7f7938123820 2024-08-18T21:03:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 1 --2- 172.21.15.5:0/69566348 >> v2:172.21.15.157:6804/1750098759 conn(0x7f79180418d0 0x7f7918043d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 1 -- 172.21.15.5:0/69566348 --> v2:172.21.15.157:6804/1750098759 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f79180443a0 con 0x7f79180418d0 2024-08-18T21:03:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7fe23affd640 1 --2- 172.21.15.5:0/28673038 >> v2:172.21.15.157:6812/631023601 conn(0x7fe22803bdc0 0x7fe22803e280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe23c09db50 tx=0x7fe2300a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f793659c640 1 --2- 172.21.15.5:0/69566348 >> v2:172.21.15.157:6812/631023601 conn(0x7f791803bdc0 0x7f791803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f793659c640 10 monclient: get_auth_request con 0x7f791803bdc0 auth_method 0 2024-08-18T21:03:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 1 -- 172.21.15.5:0/69566348 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f792c0b9410 con 0x7f7938123820 2024-08-18T21:03:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7926ffd640 10 monclient: handle_get_version_reply finishing 1 version 19 2024-08-18T21:03:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7936d9d640 1 --2- 172.21.15.5:0/69566348 >> v2:172.21.15.157:6804/1750098759 conn(0x7f79180418d0 0x7f7918043d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.689+0000 7f7936d9d640 10 monclient: get_auth_request con 0x7f79180418d0 auth_method 0 2024-08-18T21:03:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.693+0000 7f793659c640 1 --2- 172.21.15.5:0/69566348 >> v2:172.21.15.157:6812/631023601 conn(0x7f791803bdc0 0x7f791803e280 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7920003530 tx=0x7f7928007dc0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.697+0000 7f7936d9d640 1 --2- 172.21.15.5:0/69566348 >> v2:172.21.15.157:6804/1750098759 conn(0x7f79180418d0 0x7f7918043d10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.697+0000 7f7926ffd640 1 -- 172.21.15.5:0/69566348 <== osd.3 v2:172.21.15.157:6804/1750098759 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f79180443a0 con 0x7f79180418d0 2024-08-18T21:03:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.713+0000 7f793cbcf640 1 -- 172.21.15.5:0/69566348 --> v2:172.21.15.157:6804/1750098759 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f793806d160 con 0x7f79180418d0 2024-08-18T21:03:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.713+0000 7f7926ffd640 1 -- 172.21.15.5:0/69566348 <== osd.3 v2:172.21.15.157:6804/1750098759 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f793806d160 con 0x7f79180418d0 2024-08-18T21:03:43.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.713+0000 7f793cbcf640 1 -- 172.21.15.5:0/69566348 >> v2:172.21.15.157:6804/1750098759 conn(0x7f79180418d0 msgr2=0x7f7918043d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.713+0000 7f793cbcf640 1 --2- 172.21.15.5:0/69566348 >> v2:172.21.15.157:6804/1750098759 conn(0x7f79180418d0 0x7f7918043d10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.713+0000 7f793cbcf640 1 -- 172.21.15.5:0/69566348 >> v2:172.21.15.157:6812/631023601 conn(0x7f791803bdc0 msgr2=0x7f791803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.713+0000 7f793cbcf640 1 --2- 172.21.15.5:0/69566348 >> v2:172.21.15.157:6812/631023601 conn(0x7f791803bdc0 0x7f791803e280 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7920003530 tx=0x7f7928007dc0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.713+0000 7f793cbcf640 10 monclient: shutdown 2024-08-18T21:03:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.713+0000 7f793cbcf640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.713+0000 7f793cbcf640 1 -- 172.21.15.5:0/69566348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7938123820 msgr2=0x7f7938123c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.713+0000 7f793cbcf640 1 --2- 172.21.15.5:0/69566348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7938123820 0x7f7938123c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f792c09c0d0 tx=0x7f792c01d560 comp rx=0 tx=0).stop 2024-08-18T21:03:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.713+0000 7f7936d9d640 1 -- 172.21.15.5:0/69566348 reap_dead start 2024-08-18T21:03:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.713+0000 7f793cbcf640 1 -- 172.21.15.5:0/69566348 shutdown_connections 2024-08-18T21:03:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.713+0000 7f793cbcf640 1 -- 172.21.15.5:0/69566348 >> 172.21.15.5:0/69566348 conn(0x7f79380a6440 msgr2=0x7f79380a2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.713+0000 7f793cbcf640 1 -- 172.21.15.5:0/69566348 shutdown_connections 2024-08-18T21:03:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.713+0000 7f793cbcf640 1 -- 172.21.15.5:0/69566348 wait complete. 2024-08-18T21:03:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.725+0000 7f88318f4640 10 monclient: get_monmap_and_config 2024-08-18T21:03:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.725+0000 7f88318f4640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.725+0000 7f88318f4640 10 monclient: monmap: 2024-08-18T21:03:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:43.731324+0000 2024-08-18T21:03:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:43.731324+0000 2024-08-18T21:03:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:43.744 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.725+0000 7f88318f4640 1 Processor -- start 2024-08-18T21:03:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.725+0000 7f88318f4640 1 -- start start 2024-08-18T21:03:43.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.725+0000 7f88318f4640 10 monclient: init 2024-08-18T21:03:43.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f88318f4640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f88318f4640 10 monclient: _add_conns ranks=[10,0,7,2,5,4,6,3,8,1,9] 2024-08-18T21:03:43.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f88318f4640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f882c0a6bd0 0x7f882c0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f88318f4640 10 monclient(hunting): picked mon.noname-f con 0x7f882c0a6bd0 addr v2:172.21.15.157:3300/0 2024-08-18T21:03:43.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f88318f4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f882c09f080 addr v1:172.21.15.5:6789/0 2024-08-18T21:03:43.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f88318f4640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f882c0a74f0 0x7f882c13a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f88318f4640 10 monclient(hunting): picked mon.noname-i con 0x7f882c0a74f0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:43.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f88318f4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f882c0a7fb0 con 0x7f882c09f080 2024-08-18T21:03:43.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f88318f4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f88318f4640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f882c09e4c0 con 0x7f882c0a6bd0 2024-08-18T21:03:43.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f88318f4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f88318f4640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f882c06f930 con 0x7f882c0a74f0 2024-08-18T21:03:43.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f88318f4640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f88318f4640 10 monclient(hunting): authenticate will time out at 990.744965s 2024-08-18T21:03:43.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 10 monclient: get_monmap_and_config 2024-08-18T21:03:43.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 10 monclient: monmap: 2024-08-18T21:03:43.746 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.746 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.747 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:43.733340+0000 2024-08-18T21:03:43.747 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:43.733340+0000 2024-08-18T21:03:43.747 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.747 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.747 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:43.747 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:43.747 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.747 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.747 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.747 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.747 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.747 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.747 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.747 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:43.748 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882a7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f882c09f080 0x7f882c139990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51304/0 (socket says 172.21.15.5:51304) 2024-08-18T21:03:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882a7fc640 1 -- 172.21.15.5:0/2018192865 learned_addr learned my addr 172.21.15.5:0/2018192865 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:03:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 1 --2- 172.21.15.5:0/2018192865 >> v2:172.21.15.157:3300/0 conn(0x7f882c0a6bd0 0x7f882c0a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 10 monclient(hunting): get_auth_request con 0x7f882c0a6bd0 auth_method 0 2024-08-18T21:03:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882b7fe640 1 --2- 172.21.15.5:0/2018192865 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f882c0a74f0 0x7f882c13a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882b7fe640 10 monclient(hunting): get_auth_request con 0x7f882c0a74f0 auth_method 0 2024-08-18T21:03:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 1 Processor -- start 2024-08-18T21:03:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 1 -- start start 2024-08-18T21:03:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 10 monclient: init 2024-08-18T21:03:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 10 monclient(hunting): handle_auth_done global_id 4240 payload 274 2024-08-18T21:03:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 1 -- 172.21.15.5:0/2018192865 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f882c0a74f0 msgr2=0x7f882c13a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 1 --2- 172.21.15.5:0/2018192865 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f882c0a74f0 0x7f882c13a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 1 -- 172.21.15.5:0/2018192865 >> v1:172.21.15.5:6789/0 conn(0x7f882c09f080 legacy=0x7f882c139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 1 monclient: found mon.noname-f 2024-08-18T21:03:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:03:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882affd640 1 -- 172.21.15.5:0/2018192865 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c09de70 con 0x7f882c0a6bd0 2024-08-18T21:03:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f882b7fe640 1 --2- 172.21.15.5:0/2018192865 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f882c0a74f0 0x7f882c13a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 10 monclient: _add_conns ranks=[9,6,8,2,1,4,7,3,10,5,0] 2024-08-18T21:03:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5bb806c950 0x7f5bb80a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 10 monclient(hunting): picked mon.noname-a con 0x7f5bb806c950 addr v2:172.21.15.5:3300/0 2024-08-18T21:03:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5bb806cd30 0x7f5bb806d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5bb806c950 0x7f5bb80a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5bb806c950 0x7f5bb80a4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55302/0 (socket says 172.21.15.5:55302) 2024-08-18T21:03:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5baffff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5bb806cd30 0x7f5bb806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5baffff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5bb806cd30 0x7f5bb806d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:48874/0 (socket says 172.21.15.5:48874) 2024-08-18T21:03:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 10 monclient(hunting): picked mon.noname-d con 0x7f5bb806cd30 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 1 -- 172.21.15.5:0/734450775 learned_addr learned my addr 172.21.15.5:0/734450775 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 1 --2- 172.21.15.5:0/734450775 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5bb8137800 0x7f5bb8137cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 10 monclient(hunting): picked mon.noname-e con 0x7f5bb8137800 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/734450775 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5bb80a04c0 con 0x7f5bb806c950 2024-08-18T21:03:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/734450775 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f5bb80a0970 con 0x7f5bb806cd30 2024-08-18T21:03:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/734450775 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f5bb80a0c50 con 0x7f5bb8137800 2024-08-18T21:03:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bbd7b2640 10 monclient(hunting): authenticate will time out at 990.746618s 2024-08-18T21:03:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 10 monclient(hunting): get_auth_request con 0x7f5bb806c950 auth_method 0 2024-08-18T21:03:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb77fe640 1 --2- 172.21.15.5:0/734450775 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5bb8137800 0x7f5bb8137cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5baffff640 10 monclient(hunting): get_auth_request con 0x7f5bb806cd30 auth_method 0 2024-08-18T21:03:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5baffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5baffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5baffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb77fe640 10 monclient(hunting): get_auth_request con 0x7f5bb8137800 auth_method 0 2024-08-18T21:03:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5baffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5baffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5baffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 10 monclient(hunting): handle_auth_done global_id 4275 payload 274 2024-08-18T21:03:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 1 -- 172.21.15.5:0/734450775 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5bb8137800 msgr2=0x7f5bb8137cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 1 --2- 172.21.15.5:0/734450775 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5bb8137800 0x7f5bb8137cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 1 -- 172.21.15.5:0/734450775 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5bb806cd30 msgr2=0x7f5bb806d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 1 --2- 172.21.15.5:0/734450775 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5bb806cd30 0x7f5bb806d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 1 monclient: found mon.noname-a 2024-08-18T21:03:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.729+0000 7f5bb6ffd640 1 -- 172.21.15.5:0/734450775 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb80a1bf0 con 0x7f5bb806c950 2024-08-18T21:03:43.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 10 monclient: get_monmap_and_config 2024-08-18T21:03:43.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 10 monclient: monmap: 2024-08-18T21:03:43.758 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.758 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.758 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:43.738827+0000 2024-08-18T21:03:43.758 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:43.738827+0000 2024-08-18T21:03:43.758 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.758 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.758 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:43.759 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.760 INFO:teuthology.orchestra.run.smithi005.stdout:47244640260 2024-08-18T21:03:43.760 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-18T21:03:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f75209a6640 10 monclient: get_monmap_and_config 2024-08-18T21:03:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f75209a6640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f75209a6640 10 monclient: monmap: 2024-08-18T21:03:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:43.738952+0000 2024-08-18T21:03:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:43.738952+0000 2024-08-18T21:03:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:43.762 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 1 Processor -- start 2024-08-18T21:03:43.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 1 -- start start 2024-08-18T21:03:43.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 10 monclient: init 2024-08-18T21:03:43.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f75209a6640 1 Processor -- start 2024-08-18T21:03:43.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bb6ffd640 1 -- 172.21.15.5:0/734450775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb806c950 msgr2=0x7f5bb80a4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bb6ffd640 1 --2- 172.21.15.5:0/734450775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb806c950 0x7f5bb80a4cd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009870 tx=0x7f5ba801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80f660c15ae6d75 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f75209a6640 1 -- start start 2024-08-18T21:03:43.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f882affd640 1 -- 172.21.15.5:0/2018192865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f882c0a6bd0 msgr2=0x7f882c0a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f882affd640 1 --2- 172.21.15.5:0/2018192865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f882c0a6bd0 0x7f882c0a6fb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f881c0097c0 tx=0x7f881c01cdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=927a1743d134e773 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f75209a6640 10 monclient: init 2024-08-18T21:03:43.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bb67fc640 1 -- 172.21.15.5:0/734450775 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5ba80b1070 con 0x7f5bb806c950 2024-08-18T21:03:43.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bb67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bb67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:43.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bb67fc640 10 monclient: dump: 2024-08-18T21:03:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.767 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bb67fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bb67fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bb67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bb67fc640 1 -- 172.21.15.5:0/734450775 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba80ab830 con 0x7f5bb806c950 2024-08-18T21:03:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bb67fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bb67fc640 1 -- 172.21.15.5:0/734450775 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5ba80abe50 con 0x7f5bb806c950 2024-08-18T21:03:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bbd7b2640 5 monclient: authenticate success, global_id 4275 2024-08-18T21:03:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bbd7b2640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bbd7b2640 4 set_mon_vals no callback set 2024-08-18T21:03:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bb67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bb67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:43.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f5bb67fc640 10 monclient: dump: 2024-08-18T21:03:43.768 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.768 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.768 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.768 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.768 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.768 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.768 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.768 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.768 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.768 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.768 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.768 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.768 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.768 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.769 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.769 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f8829ffb640 1 -- 172.21.15.5:0/2018192865 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f881c0b0070 con 0x7f882c0a6bd0 2024-08-18T21:03:43.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f8829ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 10 monclient: _add_conns ranks=[3,5,4,9,7,1,8,0,10,6,2] 2024-08-18T21:03:43.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f8829ffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:03:43.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b70139a20 0x7f2b70139e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 10 monclient(hunting): picked mon.noname-g con 0x7f2b70139a20 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:43.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f8829ffb640 10 monclient: dump: 2024-08-18T21:03:43.771 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.771 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.771 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.771 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.771 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.771 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.771 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.771 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.771 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.771 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.772 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f8829ffb640 10 monclient: _finish_auth 0 2024-08-18T21:03:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f8829ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:03:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f8829ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f8829ffb640 1 -- 172.21.15.5:0/2018192865 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f881c0aa810 con 0x7f882c0a6bd0 2024-08-18T21:03:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f8829ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2b7013a340 0x7f2b700a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 10 monclient(hunting): picked mon.noname-h con 0x7f2b7013a340 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b7006c950 0x7f2b700a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 10 monclient(hunting): picked mon.noname-c con 0x7f2b7006c950 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f8829ffb640 1 -- 172.21.15.5:0/2018192865 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f881c0aae30 con 0x7f882c0a6bd0 2024-08-18T21:03:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f8829ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f8829ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:03:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f8829ffb640 10 monclient: dump: 2024-08-18T21:03:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.775 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f88318f4640 5 monclient: authenticate success, global_id 4240 2024-08-18T21:03:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7009df80 con 0x7f2b70139a20 2024-08-18T21:03:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f2b7009e260 con 0x7f2b7006c950 2024-08-18T21:03:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f2b7006cf50 con 0x7f2b7013a340 2024-08-18T21:03:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f2b76bf7640 10 monclient(hunting): authenticate will time out at 990.751827s 2024-08-18T21:03:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f88318f4640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.733+0000 7f88318f4640 4 set_mon_vals no callback set 2024-08-18T21:03:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f75209a6640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f75209a6640 10 monclient: _add_conns ranks=[5,3,7,8,1,4,10,0,6,2,9] 2024-08-18T21:03:43.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b7006c950 0x7f2b700a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b74993640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b70139a20 0x7f2b70139e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b7006c950 0x7f2b700a4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:51390/0 (socket says 172.21.15.5:51390) 2024-08-18T21:03:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 1 -- 172.21.15.5:0/3840903820 learned_addr learned my addr 172.21.15.5:0/3840903820 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 10 monclient(hunting): get_auth_request con 0x7f2b7006c950 auth_method 0 2024-08-18T21:03:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b74993640 10 monclient(hunting): get_auth_request con 0x7f2b70139a20 auth_method 0 2024-08-18T21:03:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b74993640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b74993640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b74993640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b6ffff640 1 --2- 172.21.15.5:0/3840903820 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2b7013a340 0x7f2b700a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b6ffff640 10 monclient(hunting): get_auth_request con 0x7f2b7013a340 auth_method 0 2024-08-18T21:03:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b6ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b6ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b6ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f75209a6640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7514022c60 0x7f7514009430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b74993640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b74993640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b74993640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b6ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b6ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b6ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f5bbd7b2640 10 monclient: shutdown 2024-08-18T21:03:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f5bbd7b2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/734450775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb806c950 msgr2=0x7f5bb80a4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f5bbd7b2640 1 --2- 172.21.15.5:0/734450775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb806c950 0x7f5bb80a4cd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009870 tx=0x7f5ba801c420 comp rx=0 tx=0).stop 2024-08-18T21:03:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 10 monclient(hunting): handle_auth_done global_id 4288 payload 274 2024-08-18T21:03:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 1 -- 172.21.15.5:0/3840903820 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2b7013a340 msgr2=0x7f2b700a48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 1 --2- 172.21.15.5:0/3840903820 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2b7013a340 0x7f2b700a48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 1 -- 172.21.15.5:0/3840903820 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b70139a20 msgr2=0x7f2b70139e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 1 --2- 172.21.15.5:0/3840903820 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b70139a20 0x7f2b70139e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 1 monclient: found mon.noname-c 2024-08-18T21:03:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f2b75194640 1 -- 172.21.15.5:0/3840903820 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b70069460 con 0x7f2b7006c950 2024-08-18T21:03:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 10 monclient: shutdown 2024-08-18T21:03:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 1 -- 172.21.15.5:0/2018192865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f882c0a6bd0 msgr2=0x7f882c0a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 1 --2- 172.21.15.5:0/2018192865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f882c0a6bd0 0x7f882c0a6fb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f881c0097c0 tx=0x7f881c01cdc0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f75209a6640 10 monclient(hunting): picked mon.noname-h con 0x7f7514022c60 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f75209a6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7514023040 0x7f75140bc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f75209a6640 10 monclient(hunting): picked mon.noname-g con 0x7f7514023040 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f75209a6640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7514023420 0x7f75140bce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/734450775 shutdown_connections 2024-08-18T21:03:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f5bbd7b2640 1 --2- 172.21.15.5:0/734450775 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5bb8137800 0x7f5bb8137cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f5bbd7b2640 1 --2- 172.21.15.5:0/734450775 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5bb806cd30 0x7f5bb806d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f5bbd7b2640 1 --2- 172.21.15.5:0/734450775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb806c950 0x7f5bb80a4cd0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009870 tx=0x7f5ba801c420 comp rx=0 tx=0).stop 2024-08-18T21:03:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/734450775 >> 172.21.15.5:0/734450775 conn(0x7f5bb80688d0 msgr2=0x7f5bb8068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f75209a6640 10 monclient(hunting): picked mon.noname-i con 0x7f7514023420 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f75209a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 1 -- 172.21.15.5:0/2018192865 shutdown_connections 2024-08-18T21:03:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 1 --2- 172.21.15.5:0/2018192865 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f882c0a74f0 0x7f882c13a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 1 --2- 172.21.15.5:0/2018192865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f882c0a6bd0 0x7f882c0a6fb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f75209a6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f751400a470 con 0x7f7514023040 2024-08-18T21:03:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f75209a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 1 -- 172.21.15.5:0/2018192865 >> 172.21.15.5:0/2018192865 conn(0x7f882c068700 msgr2=0x7f882c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f75209a6640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f751400a1f0 con 0x7f7514022c60 2024-08-18T21:03:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f75209a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f75209a6640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7514020e90 con 0x7f7514023420 2024-08-18T21:03:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f75209a6640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f75209a6640 10 monclient(hunting): authenticate will time out at 990.752896s 2024-08-18T21:03:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7514022c60 0x7f7514009430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 1 -- 172.21.15.5:0/2018192865 shutdown_connections 2024-08-18T21:03:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 1 -- 172.21.15.5:0/2018192865 wait complete. 2024-08-18T21:03:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7514022c60 0x7f7514009430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:50438/0 (socket says 172.21.15.5:50438) 2024-08-18T21:03:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 1 -- 172.21.15.5:0/3927910084 learned_addr learned my addr 172.21.15.5:0/3927910084 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 10 monclient(hunting): get_auth_request con 0x7f7514022c60 auth_method 0 2024-08-18T21:03:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751a59c640 1 --2- 172.21.15.5:0/3927910084 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7514023040 0x7f75140bc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751b59e640 1 --2- 172.21.15.5:0/3927910084 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7514023420 0x7f75140bce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751a59c640 10 monclient(hunting): get_auth_request con 0x7f7514023040 auth_method 0 2024-08-18T21:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751b59e640 10 monclient(hunting): get_auth_request con 0x7f7514023420 auth_method 0 2024-08-18T21:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751b59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751b59e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751b59e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751b59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751b59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751b59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 10 monclient: monmap: 2024-08-18T21:03:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.791 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 1 Processor -- start 2024-08-18T21:03:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 1 -- start start 2024-08-18T21:03:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 10 monclient: init 2024-08-18T21:03:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 10 monclient: _add_conns ranks=[7,4,5,6,3,2,0,8,1] 2024-08-18T21:03:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f882c09f080 0x7f882c138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 10 monclient(hunting): picked mon.noname-i con 0x7f882c09f080 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f882c0a6bd0 0x7f882c139400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 10 monclient(hunting): picked mon.noname-c con 0x7f882c0a6bd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f882c0a74f0 0x7f882c13e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 10 monclient(hunting): picked mon.noname-h con 0x7f882c0a74f0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f882c13a5e0 con 0x7f882c0a6bd0 2024-08-18T21:03:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f882c0a89f0 con 0x7f882c0a74f0 2024-08-18T21:03:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f882c13a760 con 0x7f882c09f080 2024-08-18T21:03:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f88318f4640 10 monclient(hunting): authenticate will time out at 990.754725s 2024-08-18T21:03:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/734450775 shutdown_connections 2024-08-18T21:03:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/734450775 wait complete. 2024-08-18T21:03:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882a7fc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f882c0a6bd0 0x7f882c139400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882a7fc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f882c0a6bd0 0x7f882c139400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:51398/0 (socket says 172.21.15.5:51398) 2024-08-18T21:03:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882a7fc640 1 -- 172.21.15.5:0/3267676250 learned_addr learned my addr 172.21.15.5:0/3267676250 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882a7fc640 10 monclient(hunting): get_auth_request con 0x7f882c0a6bd0 auth_method 0 2024-08-18T21:03:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 1 --2- 172.21.15.5:0/3267676250 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f882c09f080 0x7f882c138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 10 monclient(hunting): get_auth_request con 0x7f882c09f080 auth_method 0 2024-08-18T21:03:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882b7fe640 1 --2- 172.21.15.5:0/3267676250 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f882c0a74f0 0x7f882c13e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882b7fe640 10 monclient(hunting): get_auth_request con 0x7f882c0a74f0 auth_method 0 2024-08-18T21:03:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 10 monclient(hunting): handle_auth_done global_id 4291 payload 824 2024-08-18T21:03:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 1 -- 172.21.15.5:0/3267676250 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f882c0a74f0 msgr2=0x7f882c13e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 1 --2- 172.21.15.5:0/3267676250 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f882c0a74f0 0x7f882c13e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 1 -- 172.21.15.5:0/3267676250 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f882c0a6bd0 msgr2=0x7f882c139400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 1 --2- 172.21.15.5:0/3267676250 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f882c0a6bd0 0x7f882c139400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 1 monclient: found mon.noname-i 2024-08-18T21:03:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:03:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f882affd640 1 -- 172.21.15.5:0/3267676250 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c0aba50 con 0x7f882c09f080 2024-08-18T21:03:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f5bbd7b2640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f5bbd7b2640 10 monclient: monmap: 2024-08-18T21:03:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.799 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.799 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.799 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.799 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.799 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f5bbd7b2640 1 Processor -- start 2024-08-18T21:03:43.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 10 monclient(hunting): handle_auth_done global_id 4271 payload 274 2024-08-18T21:03:43.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 1 -- 172.21.15.5:0/3927910084 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7514023420 msgr2=0x7f75140bce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 1 --2- 172.21.15.5:0/3927910084 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7514023420 0x7f75140bce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 1 -- 172.21.15.5:0/3927910084 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7514023040 msgr2=0x7f75140bc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 1 --2- 172.21.15.5:0/3927910084 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7514023040 0x7f75140bc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 1 monclient: found mon.noname-h 2024-08-18T21:03:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:03:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f751ad9d640 1 -- 172.21.15.5:0/3927910084 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7514009970 con 0x7f7514022c60 2024-08-18T21:03:43.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f5bbd7b2640 1 -- start start 2024-08-18T21:03:43.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.737+0000 7f5bbd7b2640 10 monclient: init 2024-08-18T21:03:43.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bbd7b2640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bbd7b2640 10 monclient: _add_conns ranks=[8,0,6,3,5,1,7,2,4] 2024-08-18T21:03:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bbd7b2640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5bb806cd30 0x7f5bb813c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bbd7b2640 10 monclient(hunting): picked mon.noname-e con 0x7f5bb806cd30 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bbd7b2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb8137800 0x7f5bb809da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bbd7b2640 10 monclient(hunting): picked mon.noname-a con 0x7f5bb8137800 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bbd7b2640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5bb809df70 0x7f5bb809e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bbd7b2640 10 monclient(hunting): picked mon.noname-d con 0x7f5bb809df70 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bbd7b2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bbd7b2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb8141480 con 0x7f5bb8137800 2024-08-18T21:03:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bbd7b2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bbd7b2640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f5bb809fe50 con 0x7f5bb809df70 2024-08-18T21:03:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bbd7b2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bbd7b2640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f5bb8141600 con 0x7f5bb806cd30 2024-08-18T21:03:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bbd7b2640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bbd7b2640 10 monclient(hunting): authenticate will time out at 990.756455s 2024-08-18T21:03:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb8137800 0x7f5bb809da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb8137800 0x7f5bb809da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55316/0 (socket says 172.21.15.5:55316) 2024-08-18T21:03:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bb6ffd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5bb806cd30 0x7f5bb813c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 1 -- 172.21.15.5:0/3703682446 learned_addr learned my addr 172.21.15.5:0/3703682446 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 10 monclient(hunting): get_auth_request con 0x7f5bb8137800 auth_method 0 2024-08-18T21:03:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bb6ffd640 10 monclient(hunting): get_auth_request con 0x7f5bb806cd30 auth_method 0 2024-08-18T21:03:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bb6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bb6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bb6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bb77fe640 1 --2- 172.21.15.5:0/3703682446 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5bb809df70 0x7f5bb809e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bb77fe640 10 monclient(hunting): get_auth_request con 0x7f5bb809df70 auth_method 0 2024-08-18T21:03:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bb77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bb77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5bb77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 10 monclient(hunting): handle_auth_done global_id 4284 payload 824 2024-08-18T21:03:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 1 -- 172.21.15.5:0/3703682446 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5bb806cd30 msgr2=0x7f5bb813c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 1 --2- 172.21.15.5:0/3703682446 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5bb806cd30 0x7f5bb813c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 1 -- 172.21.15.5:0/3703682446 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5bb809df70 msgr2=0x7f5bb809e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 1 --2- 172.21.15.5:0/3703682446 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5bb809df70 0x7f5bb809e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 1 monclient: found mon.noname-a 2024-08-18T21:03:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 1 -- 172.21.15.5:0/3703682446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb813dd10 con 0x7f5bb8137800 2024-08-18T21:03:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b75194640 1 -- 172.21.15.5:0/3840903820 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b7006c950 msgr2=0x7f2b700a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b75194640 1 --2- 172.21.15.5:0/3840903820 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b7006c950 0x7f2b700a4e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009e80 tx=0x7f2b6801c910 comp rx=0 tx=0).ready entity=mon.4 client_cookie=6f02d7060adbf3d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b6f7fe640 1 -- 172.21.15.5:0/3840903820 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2b680090d0 con 0x7f2b7006c950 2024-08-18T21:03:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b6f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b6f7fe640 10 monclient: dump: 2024-08-18T21:03:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.807 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b6f7fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b6f7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b6f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b6f7fe640 1 -- 172.21.15.5:0/3840903820 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b680a5a70 con 0x7f2b7006c950 2024-08-18T21:03:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b6f7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b6f7fe640 1 -- 172.21.15.5:0/3840903820 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2b680a5c20 con 0x7f2b7006c950 2024-08-18T21:03:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b76bf7640 5 monclient: authenticate success, global_id 4288 2024-08-18T21:03:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b6f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b6f7fe640 10 monclient: dump: 2024-08-18T21:03:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.809 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b76bf7640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b76bf7640 4 set_mon_vals no callback set 2024-08-18T21:03:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f882affd640 1 -- 172.21.15.5:0/3267676250 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f882c09f080 msgr2=0x7f882c138ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f882affd640 1 --2- 172.21.15.5:0/3267676250 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f882c09f080 0x7f882c138ec0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f881c0ad000 tx=0x7f881c019100 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f751ad9d640 1 -- 172.21.15.5:0/3927910084 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7514022c60 msgr2=0x7f7514009430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f751ad9d640 1 --2- 172.21.15.5:0/3927910084 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7514022c60 0x7f7514009430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f750c0098a0 tx=0x7f750c01c460 comp rx=0 tx=0).ready entity=mon.5 client_cookie=4557eb7c88ec1537 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f8813fff640 1 -- 172.21.15.5:0/3267676250 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f881c0b0040 con 0x7f882c09f080 2024-08-18T21:03:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f8813fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b76bf7640 10 monclient: shutdown 2024-08-18T21:03:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b76bf7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b76bf7640 1 -- 172.21.15.5:0/3840903820 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b7006c950 msgr2=0x7f2b700a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b76bf7640 1 --2- 172.21.15.5:0/3840903820 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b7006c950 0x7f2b700a4e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009e80 tx=0x7f2b6801c910 comp rx=0 tx=0).stop 2024-08-18T21:03:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f8813fff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:03:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f8813fff640 10 monclient: dump: 2024-08-18T21:03:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.812 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b76bf7640 1 -- 172.21.15.5:0/3840903820 shutdown_connections 2024-08-18T21:03:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b76bf7640 1 --2- 172.21.15.5:0/3840903820 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b7006c950 0x7f2b700a4e30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b76bf7640 1 --2- 172.21.15.5:0/3840903820 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2b7013a340 0x7f2b700a48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b76bf7640 1 --2- 172.21.15.5:0/3840903820 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b70139a20 0x7f2b70139e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b76bf7640 1 -- 172.21.15.5:0/3840903820 >> 172.21.15.5:0/3840903820 conn(0x7f2b700a6430 msgr2=0x7f2b70068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f7519d9b640 1 -- 172.21.15.5:0/3927910084 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f750c0b0070 con 0x7f7514022c60 2024-08-18T21:03:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f7519d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f7519d9b640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:03:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f7519d9b640 10 monclient: dump: 2024-08-18T21:03:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.815 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f7519d9b640 10 monclient: _finish_auth 0 2024-08-18T21:03:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f7519d9b640 10 monclient: _check_auth_tickets 2024-08-18T21:03:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f7519d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f75209a6640 5 monclient: authenticate success, global_id 4271 2024-08-18T21:03:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f75209a6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f7519d9b640 1 -- 172.21.15.5:0/3927910084 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750c0aa3a0 con 0x7f7514022c60 2024-08-18T21:03:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f7519d9b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f7519d9b640 1 -- 172.21.15.5:0/3927910084 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f750c0aaa80 con 0x7f7514022c60 2024-08-18T21:03:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f75209a6640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f75209a6640 4 set_mon_vals no callback set 2024-08-18T21:03:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f7519d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f7519d9b640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:03:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f7519d9b640 10 monclient: dump: 2024-08-18T21:03:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.817 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f8813fff640 10 monclient: _finish_auth 0 2024-08-18T21:03:43.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f8813fff640 10 monclient: _check_auth_tickets 2024-08-18T21:03:43.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f8813fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:43.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f88318f4640 5 monclient: authenticate success, global_id 4291 2024-08-18T21:03:43.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b76bf7640 1 -- 172.21.15.5:0/3840903820 shutdown_connections 2024-08-18T21:03:43.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f88318f4640 10 monclient: _renew_subs 2024-08-18T21:03:43.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f88318f4640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:03:43.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b76bf7640 1 -- 172.21.15.5:0/3840903820 wait complete. 2024-08-18T21:03:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f88318f4640 1 -- 172.21.15.5:0/3267676250 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882c0abfa0 con 0x7f882c09f080 2024-08-18T21:03:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f8813fff640 1 -- 172.21.15.5:0/3267676250 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f881c0aadc0 con 0x7f882c09f080 2024-08-18T21:03:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f8813fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f88297fa640 4 set_mon_vals no callback set 2024-08-18T21:03:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f88318f4640 10 monclient: _renew_subs 2024-08-18T21:03:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f88318f4640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:03:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f88318f4640 1 -- 172.21.15.5:0/3267676250 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f882c140060 con 0x7f882c09f080 2024-08-18T21:03:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f8813fff640 1 -- 172.21.15.5:0/3267676250 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f881c0044b0 con 0x7f882c09f080 2024-08-18T21:03:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f8813fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f8813fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:03:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f8813fff640 10 monclient: dump: 2024-08-18T21:03:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.821 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f75209a6640 10 monclient: shutdown 2024-08-18T21:03:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f75209a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f75209a6640 1 -- 172.21.15.5:0/3927910084 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7514022c60 msgr2=0x7f7514009430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f75209a6640 1 --2- 172.21.15.5:0/3927910084 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7514022c60 0x7f7514009430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f750c0098a0 tx=0x7f750c01c460 comp rx=0 tx=0).stop 2024-08-18T21:03:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f75209a6640 1 -- 172.21.15.5:0/3927910084 shutdown_connections 2024-08-18T21:03:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f75209a6640 1 --2- 172.21.15.5:0/3927910084 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7514023420 0x7f75140bce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f75209a6640 1 --2- 172.21.15.5:0/3927910084 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7514023040 0x7f75140bc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f75209a6640 1 --2- 172.21.15.5:0/3927910084 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7514022c60 0x7f7514009430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f75209a6640 1 -- 172.21.15.5:0/3927910084 >> 172.21.15.5:0/3927910084 conn(0x7f7514007bd0 msgr2=0x7f7514007fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f88318f4640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:03:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f88318f4640 1 -- 172.21.15.5:0/3267676250 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f882c0a6fb0 con 0x7f882c09f080 2024-08-18T21:03:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b76bf7640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f75209a6640 1 -- 172.21.15.5:0/3927910084 shutdown_connections 2024-08-18T21:03:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f75209a6640 1 -- 172.21.15.5:0/3927910084 wait complete. 2024-08-18T21:03:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f2b76bf7640 10 monclient: monmap: 2024-08-18T21:03:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.825 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 1 -- 172.21.15.5:0/3703682446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb8137800 msgr2=0x7f5bb809da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.741+0000 7f5baffff640 1 --2- 172.21.15.5:0/3703682446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb8137800 0x7f5bb809da30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000e900 tx=0x7f5ba000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 1 -- 172.21.15.5:0/3703682446 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5ba0017070 con 0x7f5bb8137800 2024-08-18T21:03:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 10 monclient: dump: 2024-08-18T21:03:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.828 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 1 -- 172.21.15.5:0/3703682446 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba000cc10 con 0x7f5bb8137800 2024-08-18T21:03:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5bbd7b2640 5 monclient: authenticate success, global_id 4284 2024-08-18T21:03:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5bbd7b2640 10 monclient: _renew_subs 2024-08-18T21:03:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5bbd7b2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/3703682446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb811ff50 con 0x7f5bb8137800 2024-08-18T21:03:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 1 -- 172.21.15.5:0/3703682446 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5ba000cdc0 con 0x7f5bb8137800 2024-08-18T21:03:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 10 monclient: dump: 2024-08-18T21:03:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.830 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5bbd7b2640 10 monclient: _renew_subs 2024-08-18T21:03:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5bbd7b2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/3703682446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb80a8d70 con 0x7f5bb8137800 2024-08-18T21:03:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 1 Processor -- start 2024-08-18T21:03:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 10 monclient: monmap: 2024-08-18T21:03:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.833 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5bb5ffb640 4 set_mon_vals no callback set 2024-08-18T21:03:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f8813fff640 1 -- 172.21.15.5:0/3267676250 <== mon.7 v2:172.21.15.157:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f881c0bb030 con 0x7f882c09f080 2024-08-18T21:03:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 1 -- start start 2024-08-18T21:03:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 10 monclient: init 2024-08-18T21:03:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5bbd7b2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/3703682446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5bb806d150 con 0x7f5bb8137800 2024-08-18T21:03:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f8813fff640 1 --2- 172.21.15.5:0/3267676250 >> v2:172.21.15.157:6812/631023601 conn(0x7f881803bdb0 0x7f881803e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 1 Processor -- start 2024-08-18T21:03:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f8813fff640 1 -- 172.21.15.5:0/3267676250 <== mon.7 v2:172.21.15.157:3303/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f881c0b9020 con 0x7f882c09f080 2024-08-18T21:03:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f8813fff640 1 --2- 172.21.15.5:0/3267676250 >> v2:172.21.15.5:6808/150392090 conn(0x7f88180418c0 0x7f8818043d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f8813fff640 1 -- 172.21.15.5:0/3267676250 --> v2:172.21.15.5:6808/150392090 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f881c0aa810 con 0x7f88180418c0 2024-08-18T21:03:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f8813fff640 1 -- 172.21.15.5:0/3267676250 <== mon.7 v2:172.21.15.157:3303/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f881c0e8860 con 0x7f882c09f080 2024-08-18T21:03:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f8813fff640 10 monclient: handle_get_version_reply finishing 1 version 19 2024-08-18T21:03:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 1 -- start start 2024-08-18T21:03:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 10 monclient: init 2024-08-18T21:03:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f882b7fe640 1 --2- 172.21.15.5:0/3267676250 >> v2:172.21.15.5:6808/150392090 conn(0x7f88180418c0 0x7f8818043d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f882a7fc640 1 --2- 172.21.15.5:0/3267676250 >> v2:172.21.15.157:6812/631023601 conn(0x7f881803bdb0 0x7f881803e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 10 monclient: _add_conns ranks=[6,5,0,4,3,1,2,8,7] 2024-08-18T21:03:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b7006c950 0x7f2b701344e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f882b7fe640 10 monclient: get_auth_request con 0x7f88180418c0 auth_method 0 2024-08-18T21:03:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f882a7fc640 10 monclient: get_auth_request con 0x7f881803bdb0 auth_method 0 2024-08-18T21:03:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 10 monclient(hunting): picked mon.noname-d con 0x7f2b7006c950 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2b70139a20 0x7f2b7013d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 10 monclient(hunting): picked mon.noname-h con 0x7f2b70139a20 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b7006c950 0x7f2b701344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b7013a340 0x7f2b7013d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b7006c950 0x7f2b701344e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:48886/0 (socket says 172.21.15.5:48886) 2024-08-18T21:03:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 10 monclient(hunting): picked mon.noname-a con 0x7f2b7013a340 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 1 -- 172.21.15.5:0/2880954021 learned_addr learned my addr 172.21.15.5:0/2880954021 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 1 -- 172.21.15.5:0/2880954021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2b701433c0 con 0x7f2b7013a340 2024-08-18T21:03:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 1 -- 172.21.15.5:0/2880954021 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f2b700a5780 con 0x7f2b70139a20 2024-08-18T21:03:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 1 -- 172.21.15.5:0/2880954021 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f2b70143540 con 0x7f2b7006c950 2024-08-18T21:03:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b76bf7640 10 monclient(hunting): authenticate will time out at 990.761773s 2024-08-18T21:03:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 10 monclient(hunting): get_auth_request con 0x7f2b7006c950 auth_method 0 2024-08-18T21:03:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 1 -- 172.21.15.5:0/3703682446 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f5ba001a070 con 0x7f5bb8137800 2024-08-18T21:03:43.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b75194640 1 --2- 172.21.15.5:0/2880954021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b7013a340 0x7f2b7013d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b75194640 10 monclient(hunting): get_auth_request con 0x7f2b7013a340 auth_method 0 2024-08-18T21:03:43.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b75194640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b75194640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b75194640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b6ffff640 1 --2- 172.21.15.5:0/2880954021 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2b70139a20 0x7f2b7013d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b6ffff640 10 monclient(hunting): get_auth_request con 0x7f2b70139a20 auth_method 0 2024-08-18T21:03:43.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b6ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b6ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b6ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b75194640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b75194640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b75194640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b6ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 10 monclient: _add_conns ranks=[8,5,1,3,2,7,0,6,4] 2024-08-18T21:03:43.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b6ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b6ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7514022c60 0x7f75140c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 10 monclient(hunting): handle_auth_done global_id 4263 payload 824 2024-08-18T21:03:43.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 1 -- 172.21.15.5:0/2880954021 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2b70139a20 msgr2=0x7f2b7013d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 1 --2- 172.21.15.5:0/2880954021 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2b70139a20 0x7f2b7013d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 10 monclient(hunting): picked mon.noname-e con 0x7f7514022c60 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 1 -- 172.21.15.5:0/2880954021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b7013a340 msgr2=0x7f2b7013d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 1 --2- 172.21.15.5:0/2880954021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b7013a340 0x7f2b7013d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 1 monclient: found mon.noname-d 2024-08-18T21:03:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b74993640 1 -- 172.21.15.5:0/2880954021 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7011f8d0 con 0x7f2b7006c950 2024-08-18T21:03:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 1 --2- 172.21.15.5:0/3703682446 >> v2:172.21.15.157:6812/631023601 conn(0x7f5b9803bdf0 0x7f5b9803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 1 -- 172.21.15.5:0/3703682446 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f5ba000f040 con 0x7f5bb8137800 2024-08-18T21:03:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 1 --2- 172.21.15.5:0/3703682446 >> v2:172.21.15.5:6800/3354229361 conn(0x7f5b98041900 0x7f5b98043d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 1 -- 172.21.15.5:0/3703682446 --> v2:172.21.15.5:6800/3354229361 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b980443d0 con 0x7f5b98041900 2024-08-18T21:03:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 1 -- 172.21.15.5:0/3703682446 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5ba0055050 con 0x7f5bb8137800 2024-08-18T21:03:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5baf7fe640 10 monclient: handle_get_version_reply finishing 1 version 19 2024-08-18T21:03:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7514022c60 0x7f75140c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7514022c60 0x7f75140c0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:44438/0 (socket says 172.21.15.5:44438) 2024-08-18T21:03:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 1 -- 172.21.15.5:0/2997118238 learned_addr learned my addr 172.21.15.5:0/2997118238 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 1 --2- 172.21.15.5:0/2997118238 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7514023040 0x7f75140c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f2b75194640 1 --2- 172.21.15.5:0/2880954021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b7013a340 0x7f2b7013d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 10 monclient(hunting): picked mon.noname-h con 0x7f7514023040 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 1 --2- 172.21.15.5:0/2997118238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7514023420 0x7f75140bc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 10 monclient(hunting): picked mon.noname-f con 0x7f7514023420 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 1 -- 172.21.15.5:0/2997118238 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f75140c6640 con 0x7f7514023420 2024-08-18T21:03:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 1 -- 172.21.15.5:0/2997118238 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f75140bd750 con 0x7f7514023040 2024-08-18T21:03:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 1 -- 172.21.15.5:0/2997118238 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f75140c67c0 con 0x7f7514022c60 2024-08-18T21:03:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f75209a6640 10 monclient(hunting): authenticate will time out at 990.762627s 2024-08-18T21:03:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 10 monclient(hunting): get_auth_request con 0x7f7514022c60 auth_method 0 2024-08-18T21:03:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5bb77fe640 1 --2- 172.21.15.5:0/3703682446 >> v2:172.21.15.5:6800/3354229361 conn(0x7f5b98041900 0x7f5b98043d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f5bb77fe640 10 monclient: get_auth_request con 0x7f5b98041900 auth_method 0 2024-08-18T21:03:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 10 monclient(hunting): handle_auth_done global_id 4229 payload 824 2024-08-18T21:03:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751a59c640 1 --2- 172.21.15.5:0/2997118238 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7514023040 0x7f75140c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 1 -- 172.21.15.5:0/2997118238 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7514023040 msgr2=0x7f75140c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751b59e640 1 --2- 172.21.15.5:0/2997118238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7514023420 0x7f75140bc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 1 --2- 172.21.15.5:0/2997118238 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7514023040 0x7f75140c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 1 -- 172.21.15.5:0/2997118238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7514023420 msgr2=0x7f75140bc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 1 --2- 172.21.15.5:0/2997118238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7514023420 0x7f75140bc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 10 monclient: _finish_hunting 0 2024-08-18T21:03:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 1 monclient: found mon.noname-e 2024-08-18T21:03:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.745+0000 7f751ad9d640 1 -- 172.21.15.5:0/2997118238 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7514026ab0 con 0x7f7514022c60 2024-08-18T21:03:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f882a7fc640 1 --2- 172.21.15.5:0/3267676250 >> v2:172.21.15.157:6812/631023601 conn(0x7f881803bdb0 0x7f881803e270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8820007d60 tx=0x7f8820007cb0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b74993640 1 -- 172.21.15.5:0/2880954021 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b7006c950 msgr2=0x7f2b701344e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b74993640 1 --2- 172.21.15.5:0/2880954021 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b7006c950 0x7f2b701344e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000e8b0 tx=0x7f2b6000ed70 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f5bb6ffd640 1 --2- 172.21.15.5:0/3703682446 >> v2:172.21.15.157:6812/631023601 conn(0x7f5b9803bdf0 0x7f5b9803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f5bb6ffd640 10 monclient: get_auth_request con 0x7f5b9803bdf0 auth_method 0 2024-08-18T21:03:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/2880954021 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2b60017070 con 0x7f2b7006c950 2024-08-18T21:03:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6d7fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6d7fa640 10 monclient: dump: 2024-08-18T21:03:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.854 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6d7fa640 10 monclient: _finish_auth 0 2024-08-18T21:03:43.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6d7fa640 10 monclient: _check_auth_tickets 2024-08-18T21:03:43.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:43.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b76bf7640 5 monclient: authenticate success, global_id 4263 2024-08-18T21:03:43.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b76bf7640 10 monclient: _renew_subs 2024-08-18T21:03:43.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b76bf7640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:43.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b76bf7640 1 -- 172.21.15.5:0/2880954021 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b70135270 con 0x7f2b7006c950 2024-08-18T21:03:43.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/2880954021 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b60013470 con 0x7f2b7006c950 2024-08-18T21:03:43.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6d7fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:43.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/2880954021 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2b60013a90 con 0x7f2b7006c950 2024-08-18T21:03:43.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6d7fa640 10 monclient: dump: 2024-08-18T21:03:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.856 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6effd640 4 set_mon_vals no callback set 2024-08-18T21:03:43.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f751ad9d640 1 -- 172.21.15.5:0/2997118238 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7514022c60 msgr2=0x7f75140c0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:43.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f751ad9d640 1 --2- 172.21.15.5:0/2997118238 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7514022c60 0x7f75140c0a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f750c0097c0 tx=0x7f750c019200 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75037fe640 1 -- 172.21.15.5:0/2997118238 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f750c0b9070 con 0x7f7514022c60 2024-08-18T21:03:43.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f882b7fe640 1 --2- 172.21.15.5:0/3267676250 >> v2:172.21.15.5:6808/150392090 conn(0x7f88180418c0 0x7f8818043d00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f8813fff640 1 -- 172.21.15.5:0/3267676250 <== osd.0 v2:172.21.15.5:6808/150392090 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f881c0aa810 con 0x7f88180418c0 2024-08-18T21:03:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b76bf7640 10 monclient: _renew_subs 2024-08-18T21:03:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b76bf7640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b76bf7640 1 -- 172.21.15.5:0/2880954021 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b70135670 con 0x7f2b7006c950 2024-08-18T21:03:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/2880954021 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f2b6001a070 con 0x7f2b7006c950 2024-08-18T21:03:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6d7fa640 1 --2- 172.21.15.5:0/2880954021 >> v2:172.21.15.157:6812/631023601 conn(0x7f2b5c03bdc0 0x7f2b5c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/2880954021 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f2b6000f040 con 0x7f2b7006c950 2024-08-18T21:03:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b76bf7640 1 --2- 172.21.15.5:0/2880954021 >> v2:172.21.15.5:6804/1057536297 conn(0x7f2b7011faf0 0x7f2b700a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6ffff640 1 --2- 172.21.15.5:0/2880954021 >> v2:172.21.15.157:6812/631023601 conn(0x7f2b5c03bdc0 0x7f2b5c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b6ffff640 10 monclient: get_auth_request con 0x7f2b5c03bdc0 auth_method 0 2024-08-18T21:03:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b76bf7640 1 -- 172.21.15.5:0/2880954021 --> v2:172.21.15.5:6804/1057536297 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b70139e00 con 0x7f2b7011faf0 2024-08-18T21:03:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b75194640 1 --2- 172.21.15.5:0/2880954021 >> v2:172.21.15.5:6804/1057536297 conn(0x7f2b7011faf0 0x7f2b700a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f2b75194640 10 monclient: get_auth_request con 0x7f2b7011faf0 auth_method 0 2024-08-18T21:03:43.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f5bb77fe640 1 --2- 172.21.15.5:0/3703682446 >> v2:172.21.15.5:6800/3354229361 conn(0x7f5b98041900 0x7f5b98043d40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f5bb6ffd640 1 --2- 172.21.15.5:0/3703682446 >> v2:172.21.15.157:6812/631023601 conn(0x7f5b9803bdf0 0x7f5b9803e2b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80ac000 tx=0x7f5ba80a7000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f5baf7fe640 1 -- 172.21.15.5:0/3703682446 <== osd.2 v2:172.21.15.5:6800/3354229361 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b980443d0 con 0x7f5b98041900 2024-08-18T21:03:43.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75037fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75037fe640 10 monclient: dump: 2024-08-18T21:03:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.861 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75037fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75037fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75209a6640 5 monclient: authenticate success, global_id 4229 2024-08-18T21:03:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75037fe640 1 -- 172.21.15.5:0/2997118238 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750c003be0 con 0x7f7514022c60 2024-08-18T21:03:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75037fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75037fe640 1 -- 172.21.15.5:0/2997118238 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f750c0b0040 con 0x7f7514022c60 2024-08-18T21:03:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75209a6640 10 monclient: _renew_subs 2024-08-18T21:03:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75209a6640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75209a6640 1 -- 172.21.15.5:0/2997118238 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751402bc30 con 0x7f7514022c60 2024-08-18T21:03:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75037fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75037fe640 10 monclient: dump: 2024-08-18T21:03:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:43.863 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75209a6640 10 monclient: _renew_subs 2024-08-18T21:03:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75209a6640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75209a6640 1 -- 172.21.15.5:0/2997118238 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f75140a7ef0 con 0x7f7514022c60 2024-08-18T21:03:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f751959a640 4 set_mon_vals no callback set 2024-08-18T21:03:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75209a6640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.749+0000 7f75209a6640 1 -- 172.21.15.5:0/2997118238 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7514009430 con 0x7f7514022c60 2024-08-18T21:03:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.753+0000 7f75037fe640 1 -- 172.21.15.5:0/2997118238 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f750c0bc060 con 0x7f7514022c60 2024-08-18T21:03:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.753+0000 7f75037fe640 1 --2- 172.21.15.5:0/2997118238 >> v2:172.21.15.157:6812/631023601 conn(0x7f750803be20 0x7f750803e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.753+0000 7f75037fe640 1 -- 172.21.15.5:0/2997118238 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f750c0ed050 con 0x7f7514022c60 2024-08-18T21:03:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.753+0000 7f75037fe640 1 --2- 172.21.15.5:0/2997118238 >> v2:172.21.15.157:6808/269684279 conn(0x7f7508041930 0x7f7508043d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.753+0000 7f75037fe640 1 -- 172.21.15.5:0/2997118238 --> v2:172.21.15.157:6808/269684279 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7508044400 con 0x7f7508041930 2024-08-18T21:03:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.753+0000 7f751a59c640 1 --2- 172.21.15.5:0/2997118238 >> v2:172.21.15.157:6812/631023601 conn(0x7f750803be20 0x7f750803e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.753+0000 7f751b59e640 1 --2- 172.21.15.5:0/2997118238 >> v2:172.21.15.157:6808/269684279 conn(0x7f7508041930 0x7f7508043d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.753+0000 7f751a59c640 10 monclient: get_auth_request con 0x7f750803be20 auth_method 0 2024-08-18T21:03:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.753+0000 7f751b59e640 10 monclient: get_auth_request con 0x7f7508041930 auth_method 0 2024-08-18T21:03:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.753+0000 7f2b6ffff640 1 --2- 172.21.15.5:0/2880954021 >> v2:172.21.15.157:6812/631023601 conn(0x7f2b5c03bdc0 0x7f2b5c03e280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2b700a3300 tx=0x7f2b64009190 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.753+0000 7f2b75194640 1 --2- 172.21.15.5:0/2880954021 >> v2:172.21.15.5:6804/1057536297 conn(0x7f2b7011faf0 0x7f2b700a1cd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.757+0000 7f751a59c640 1 --2- 172.21.15.5:0/2997118238 >> v2:172.21.15.157:6812/631023601 conn(0x7f750803be20 0x7f750803e2e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75140bd310 tx=0x7f7510008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.757+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/2880954021 <== osd.1 v2:172.21.15.5:6804/1057536297 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2b70139e00 con 0x7f2b7011faf0 2024-08-18T21:03:43.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.757+0000 7f751b59e640 1 --2- 172.21.15.5:0/2997118238 >> v2:172.21.15.157:6808/269684279 conn(0x7f7508041930 0x7f7508043d70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.757+0000 7f75037fe640 1 -- 172.21.15.5:0/2997118238 <== osd.4 v2:172.21.15.157:6808/269684279 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7508044400 con 0x7f7508041930 2024-08-18T21:03:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f88318f4640 1 -- 172.21.15.5:0/3267676250 --> v2:172.21.15.5:6808/150392090 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f882c123640 con 0x7f88180418c0 2024-08-18T21:03:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f8813fff640 1 -- 172.21.15.5:0/3267676250 <== osd.0 v2:172.21.15.5:6808/150392090 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8824009d80 con 0x7f88180418c0 2024-08-18T21:03:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f88318f4640 1 -- 172.21.15.5:0/3267676250 >> v2:172.21.15.5:6808/150392090 conn(0x7f88180418c0 msgr2=0x7f8818043d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f88318f4640 1 --2- 172.21.15.5:0/3267676250 >> v2:172.21.15.5:6808/150392090 conn(0x7f88180418c0 0x7f8818043d00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f88318f4640 1 -- 172.21.15.5:0/3267676250 >> v2:172.21.15.157:6812/631023601 conn(0x7f881803bdb0 msgr2=0x7f881803e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f88318f4640 1 --2- 172.21.15.5:0/3267676250 >> v2:172.21.15.157:6812/631023601 conn(0x7f881803bdb0 0x7f881803e270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8820007d60 tx=0x7f8820007cb0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f88318f4640 10 monclient: shutdown 2024-08-18T21:03:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f88318f4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f88318f4640 1 -- 172.21.15.5:0/3267676250 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f882c09f080 msgr2=0x7f882c138ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f88318f4640 1 --2- 172.21.15.5:0/3267676250 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f882c09f080 0x7f882c138ec0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f881c0ad000 tx=0x7f881c019100 comp rx=0 tx=0).stop 2024-08-18T21:03:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f882b7fe640 1 -- 172.21.15.5:0/3267676250 reap_dead start 2024-08-18T21:03:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f88318f4640 1 -- 172.21.15.5:0/3267676250 shutdown_connections 2024-08-18T21:03:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f88318f4640 1 -- 172.21.15.5:0/3267676250 >> 172.21.15.5:0/3267676250 conn(0x7f882c068700 msgr2=0x7f882c0aa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f88318f4640 1 -- 172.21.15.5:0/3267676250 shutdown_connections 2024-08-18T21:03:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f88318f4640 1 -- 172.21.15.5:0/3267676250 wait complete. 2024-08-18T21:03:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/3703682446 --> v2:172.21.15.5:6800/3354229361 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5bb813dad0 con 0x7f5b98041900 2024-08-18T21:03:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f5baf7fe640 1 -- 172.21.15.5:0/3703682446 <== osd.2 v2:172.21.15.5:6800/3354229361 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5bb813dad0 con 0x7f5b98041900 2024-08-18T21:03:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/3703682446 >> v2:172.21.15.5:6800/3354229361 conn(0x7f5b98041900 msgr2=0x7f5b98043d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f5bbd7b2640 1 --2- 172.21.15.5:0/3703682446 >> v2:172.21.15.5:6800/3354229361 conn(0x7f5b98041900 0x7f5b98043d40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/3703682446 >> v2:172.21.15.157:6812/631023601 conn(0x7f5b9803bdf0 msgr2=0x7f5b9803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f5bbd7b2640 1 --2- 172.21.15.5:0/3703682446 >> v2:172.21.15.157:6812/631023601 conn(0x7f5b9803bdf0 0x7f5b9803e2b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80ac000 tx=0x7f5ba80a7000 comp rx=0 tx=0).stop 2024-08-18T21:03:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f5bbd7b2640 10 monclient: shutdown 2024-08-18T21:03:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f5bbd7b2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/3703682446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb8137800 msgr2=0x7f5bb809da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f5bbd7b2640 1 --2- 172.21.15.5:0/3703682446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb8137800 0x7f5bb809da30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000e900 tx=0x7f5ba000edc0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f5bb77fe640 1 -- 172.21.15.5:0/3703682446 reap_dead start 2024-08-18T21:03:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/3703682446 shutdown_connections 2024-08-18T21:03:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/3703682446 >> 172.21.15.5:0/3703682446 conn(0x7f5bb80688d0 msgr2=0x7f5bb813df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/3703682446 shutdown_connections 2024-08-18T21:03:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.765+0000 7f5bbd7b2640 1 -- 172.21.15.5:0/3703682446 wait complete. 2024-08-18T21:03:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.781+0000 7f2b76bf7640 1 -- 172.21.15.5:0/2880954021 --> v2:172.21.15.5:6804/1057536297 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2b700a2210 con 0x7f2b7011faf0 2024-08-18T21:03:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.781+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/2880954021 <== osd.1 v2:172.21.15.5:6804/1057536297 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2b700a2210 con 0x7f2b7011faf0 2024-08-18T21:03:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.781+0000 7f2b76bf7640 1 -- 172.21.15.5:0/2880954021 >> v2:172.21.15.5:6804/1057536297 conn(0x7f2b7011faf0 msgr2=0x7f2b700a1cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.781+0000 7f2b76bf7640 1 --2- 172.21.15.5:0/2880954021 >> v2:172.21.15.5:6804/1057536297 conn(0x7f2b7011faf0 0x7f2b700a1cd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.781+0000 7f2b76bf7640 1 -- 172.21.15.5:0/2880954021 >> v2:172.21.15.157:6812/631023601 conn(0x7f2b5c03bdc0 msgr2=0x7f2b5c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.781+0000 7f2b76bf7640 1 --2- 172.21.15.5:0/2880954021 >> v2:172.21.15.157:6812/631023601 conn(0x7f2b5c03bdc0 0x7f2b5c03e280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2b700a3300 tx=0x7f2b64009190 comp rx=0 tx=0).stop 2024-08-18T21:03:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.781+0000 7f2b76bf7640 10 monclient: shutdown 2024-08-18T21:03:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.781+0000 7f2b76bf7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.781+0000 7f2b76bf7640 1 -- 172.21.15.5:0/2880954021 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b7006c950 msgr2=0x7f2b701344e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.781+0000 7f2b76bf7640 1 --2- 172.21.15.5:0/2880954021 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b7006c950 0x7f2b701344e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000e8b0 tx=0x7f2b6000ed70 comp rx=0 tx=0).stop 2024-08-18T21:03:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.781+0000 7f2b75194640 1 -- 172.21.15.5:0/2880954021 reap_dead start 2024-08-18T21:03:43.873 INFO:teuthology.orchestra.run.smithi005.stdout:51539607557 2024-08-18T21:03:43.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-18T21:03:43.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.781+0000 7f2b76bf7640 1 -- 172.21.15.5:0/2880954021 shutdown_connections 2024-08-18T21:03:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.781+0000 7f2b76bf7640 1 -- 172.21.15.5:0/2880954021 >> 172.21.15.5:0/2880954021 conn(0x7f2b700a6430 msgr2=0x7f2b700a0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.781+0000 7f2b76bf7640 1 -- 172.21.15.5:0/2880954021 shutdown_connections 2024-08-18T21:03:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.781+0000 7f2b76bf7640 1 -- 172.21.15.5:0/2880954021 wait complete. 2024-08-18T21:03:43.874 INFO:teuthology.orchestra.run.smithi005.stdout:47244640261 2024-08-18T21:03:43.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-18T21:03:43.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.785+0000 7f75209a6640 1 -- 172.21.15.5:0/2997118238 --> v2:172.21.15.157:6808/269684279 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7514025910 con 0x7f7508041930 2024-08-18T21:03:43.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.785+0000 7f75037fe640 1 -- 172.21.15.5:0/2997118238 <== osd.4 v2:172.21.15.157:6808/269684279 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7514025910 con 0x7f7508041930 2024-08-18T21:03:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.785+0000 7f75209a6640 1 -- 172.21.15.5:0/2997118238 >> v2:172.21.15.157:6808/269684279 conn(0x7f7508041930 msgr2=0x7f7508043d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.785+0000 7f75209a6640 1 --2- 172.21.15.5:0/2997118238 >> v2:172.21.15.157:6808/269684279 conn(0x7f7508041930 0x7f7508043d70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.785+0000 7f75209a6640 1 -- 172.21.15.5:0/2997118238 >> v2:172.21.15.157:6812/631023601 conn(0x7f750803be20 msgr2=0x7f750803e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.785+0000 7f75209a6640 1 --2- 172.21.15.5:0/2997118238 >> v2:172.21.15.157:6812/631023601 conn(0x7f750803be20 0x7f750803e2e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75140bd310 tx=0x7f7510008040 comp rx=0 tx=0).stop 2024-08-18T21:03:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.785+0000 7f75209a6640 10 monclient: shutdown 2024-08-18T21:03:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.785+0000 7f75209a6640 20 monclient: shutdown canceling and discarding version request 1 2024-08-18T21:03:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.785+0000 7f75209a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.785+0000 7f75209a6640 1 -- 172.21.15.5:0/2997118238 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7514022c60 msgr2=0x7f75140c0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.785+0000 7f75209a6640 1 --2- 172.21.15.5:0/2997118238 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7514022c60 0x7f75140c0a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f750c0097c0 tx=0x7f750c019200 comp rx=0 tx=0).stop 2024-08-18T21:03:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.785+0000 7f751b59e640 1 -- 172.21.15.5:0/2997118238 reap_dead start 2024-08-18T21:03:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.785+0000 7f75209a6640 1 -- 172.21.15.5:0/2997118238 shutdown_connections 2024-08-18T21:03:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.785+0000 7f75209a6640 1 -- 172.21.15.5:0/2997118238 >> 172.21.15.5:0/2997118238 conn(0x7f7514007bd0 msgr2=0x7f7514025200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.785+0000 7f75209a6640 1 -- 172.21.15.5:0/2997118238 shutdown_connections 2024-08-18T21:03:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.785+0000 7f75209a6640 1 -- 172.21.15.5:0/2997118238 wait complete. 2024-08-18T21:03:43.878 INFO:teuthology.orchestra.run.smithi005.stdout:47244640260 2024-08-18T21:03:43.878 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-18T21:03:43.879 INFO:teuthology.orchestra.run.smithi005.stdout:47244640260 2024-08-18T21:03:43.879 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-18T21:03:43.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.889+0000 7fe23bfff640 1 --2- 172.21.15.5:0/28673038 >> v2:172.21.15.157:6800/2335500119 conn(0x7fe2280418d0 0x7fe228043d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.889+0000 7fe23bfff640 10 monclient: get_auth_request con 0x7fe2280418d0 auth_method 0 2024-08-18T21:03:43.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.893+0000 7fe23bfff640 1 --2- 172.21.15.5:0/28673038 >> v2:172.21.15.157:6800/2335500119 conn(0x7fe2280418d0 0x7fe228043d10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:43.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.897+0000 7fe223fff640 1 -- 172.21.15.5:0/28673038 <== osd.5 v2:172.21.15.157:6800/2335500119 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe2280443a0 con 0x7fe2280418d0 2024-08-18T21:03:43.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.917+0000 7fe223fff640 1 -- 172.21.15.5:0/28673038 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe22c055050 con 0x7fe23c09f080 2024-08-18T21:03:43.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.917+0000 7fe223fff640 10 monclient: handle_get_version_reply finishing 1 version 19 2024-08-18T21:03:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.925+0000 7fe241b8a640 1 -- 172.21.15.5:0/28673038 --> v2:172.21.15.157:6800/2335500119 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe23c0ad2c0 con 0x7fe2280418d0 2024-08-18T21:03:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.925+0000 7fe223fff640 1 -- 172.21.15.5:0/28673038 <== osd.5 v2:172.21.15.157:6800/2335500119 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe23c0ad2c0 con 0x7fe2280418d0 2024-08-18T21:03:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.925+0000 7fe241b8a640 1 -- 172.21.15.5:0/28673038 >> v2:172.21.15.157:6800/2335500119 conn(0x7fe2280418d0 msgr2=0x7fe228043d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.925+0000 7fe241b8a640 1 --2- 172.21.15.5:0/28673038 >> v2:172.21.15.157:6800/2335500119 conn(0x7fe2280418d0 0x7fe228043d10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.925+0000 7fe241b8a640 1 -- 172.21.15.5:0/28673038 >> v2:172.21.15.157:6812/631023601 conn(0x7fe22803bdc0 msgr2=0x7fe22803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.925+0000 7fe241b8a640 1 --2- 172.21.15.5:0/28673038 >> v2:172.21.15.157:6812/631023601 conn(0x7fe22803bdc0 0x7fe22803e280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe23c09db50 tx=0x7fe2300a6000 comp rx=0 tx=0).stop 2024-08-18T21:03:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.925+0000 7fe241b8a640 10 monclient: shutdown 2024-08-18T21:03:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.925+0000 7fe241b8a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.925+0000 7fe241b8a640 1 -- 172.21.15.5:0/28673038 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe23c09f080 msgr2=0x7fe23c1d12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.925+0000 7fe241b8a640 1 --2- 172.21.15.5:0/28673038 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe23c09f080 0x7fe23c1d12a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00c480 tx=0x7fe22c00c940 comp rx=0 tx=0).stop 2024-08-18T21:03:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.925+0000 7fe23bfff640 1 -- 172.21.15.5:0/28673038 reap_dead start 2024-08-18T21:03:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.925+0000 7fe241b8a640 1 -- 172.21.15.5:0/28673038 shutdown_connections 2024-08-18T21:03:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.925+0000 7fe241b8a640 1 -- 172.21.15.5:0/28673038 >> 172.21.15.5:0/28673038 conn(0x7fe23c068700 msgr2=0x7fe23c0a4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.925+0000 7fe241b8a640 1 -- 172.21.15.5:0/28673038 shutdown_connections 2024-08-18T21:03:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.925+0000 7fe241b8a640 1 -- 172.21.15.5:0/28673038 wait complete. 2024-08-18T21:03:43.956 INFO:teuthology.orchestra.run.smithi005.stdout:47244640260 2024-08-18T21:03:43.957 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-18T21:03:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.989+0000 7fe74ff4d640 10 monclient: get_monmap_and_config 2024-08-18T21:03:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.989+0000 7fe74ff4d640 10 monclient: build_initial_monmap 2024-08-18T21:03:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.989+0000 7fe74ff4d640 10 monclient: monmap: 2024-08-18T21:03:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:43.995436+0000 2024-08-18T21:03:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:43.995436+0000 2024-08-18T21:03:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:43.995 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.989+0000 7fe74ff4d640 1 Processor -- start 2024-08-18T21:03:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.989+0000 7fe74ff4d640 1 -- start start 2024-08-18T21:03:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.989+0000 7fe74ff4d640 10 monclient: init 2024-08-18T21:03:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74ff4d640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74ff4d640 10 monclient: _add_conns ranks=[8,4,3,6,10,5,2,1,7,9,0] 2024-08-18T21:03:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74ff4d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe7480a4960 0x7fe7480a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74ff4d640 10 monclient(hunting): picked mon.noname-e con 0x7fe7480a4960 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74ff4d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe74809df40 0x7fe7480a5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74ff4d640 10 monclient(hunting): picked mon.noname-c con 0x7fe74809df40 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74ff4d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe748136780 0x7fe748136be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74ff4d640 10 monclient(hunting): picked mon.noname-g con 0x7fe748136780 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74ff4d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74ff4d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe7480a57c0 con 0x7fe748136780 2024-08-18T21:03:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74ff4d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74ff4d640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fe74809fd00 con 0x7fe74809df40 2024-08-18T21:03:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74ff4d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74ff4d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fe74809e3c0 con 0x7fe7480a4960 2024-08-18T21:03:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74ff4d640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74ff4d640 10 monclient(hunting): authenticate will time out at 991.008267s 2024-08-18T21:03:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe74809df40 0x7fe7480a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe74809df40 0x7fe7480a5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:51406/0 (socket says 172.21.15.5:51406) 2024-08-18T21:03:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 1 -- 172.21.15.5:0/2184122925 learned_addr learned my addr 172.21.15.5:0/2184122925 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 10 monclient(hunting): get_auth_request con 0x7fe74809df40 auth_method 0 2024-08-18T21:03:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74dce9640 1 --2- 172.21.15.5:0/2184122925 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe7480a4960 0x7fe7480a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74dce9640 10 monclient(hunting): get_auth_request con 0x7fe7480a4960 auth_method 0 2024-08-18T21:03:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74dce9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74dce9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74dce9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 10 monclient(hunting): handle_auth_done global_id 4306 payload 274 2024-08-18T21:03:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 1 -- 172.21.15.5:0/2184122925 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe7480a4960 msgr2=0x7fe7480a4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74e4ea640 1 --2- 172.21.15.5:0/2184122925 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe748136780 0x7fe748136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 1 --2- 172.21.15.5:0/2184122925 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe7480a4960 0x7fe7480a4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 1 -- 172.21.15.5:0/2184122925 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe748136780 msgr2=0x7fe748136be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 1 --2- 172.21.15.5:0/2184122925 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe748136780 0x7fe748136be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 10 monclient: _finish_hunting 0 2024-08-18T21:03:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 1 monclient: found mon.noname-c 2024-08-18T21:03:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74d4e8640 1 -- 172.21.15.5:0/2184122925 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe748069510 con 0x7fe74809df40 2024-08-18T21:03:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74e4ea640 10 monclient: get_auth_request con 0x7fe748136780 auth_method 0 2024-08-18T21:03:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74e4ea640 1 --2- 172.21.15.5:0/2184122925 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe748136780 0x7fe748136be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.993+0000 7fe74dce9640 1 --2- 172.21.15.5:0/2184122925 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe7480a4960 0x7fe7480a4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:03:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74d4e8640 1 -- 172.21.15.5:0/2184122925 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe74809df40 msgr2=0x7fe7480a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74d4e8640 1 --2- 172.21.15.5:0/2184122925 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe74809df40 0x7fe7480a5280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe7380098a0 tx=0x7fe73801c470 comp rx=0 tx=0).ready entity=mon.4 client_cookie=348b47a2f5ebd750 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74cce7640 1 -- 172.21.15.5:0/2184122925 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe7380b0070 con 0x7fe74809df40 2024-08-18T21:03:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74cce7640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74cce7640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74cce7640 10 monclient: dump: 2024-08-18T21:03:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.005 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74cce7640 10 monclient: _finish_auth 0 2024-08-18T21:03:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74cce7640 10 monclient: _check_auth_tickets 2024-08-18T21:03:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74cce7640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74cce7640 1 -- 172.21.15.5:0/2184122925 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7380aa810 con 0x7fe74809df40 2024-08-18T21:03:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74cce7640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74cce7640 1 -- 172.21.15.5:0/2184122925 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe7380aae30 con 0x7fe74809df40 2024-08-18T21:03:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74cce7640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74cce7640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74cce7640 10 monclient: dump: 2024-08-18T21:03:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74ff4d640 5 monclient: authenticate success, global_id 4306 2024-08-18T21:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74ff4d640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74ff4d640 4 set_mon_vals no callback set 2024-08-18T21:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74ff4d640 10 monclient: shutdown 2024-08-18T21:03:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74ff4d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74ff4d640 1 -- 172.21.15.5:0/2184122925 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe74809df40 msgr2=0x7fe7480a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74ff4d640 1 --2- 172.21.15.5:0/2184122925 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe74809df40 0x7fe7480a5280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe7380098a0 tx=0x7fe73801c470 comp rx=0 tx=0).stop 2024-08-18T21:03:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74ff4d640 1 -- 172.21.15.5:0/2184122925 shutdown_connections 2024-08-18T21:03:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74ff4d640 1 --2- 172.21.15.5:0/2184122925 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe748136780 0x7fe748136be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74ff4d640 1 --2- 172.21.15.5:0/2184122925 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe74809df40 0x7fe7480a5280 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74ff4d640 1 --2- 172.21.15.5:0/2184122925 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe7480a4960 0x7fe7480a4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74ff4d640 1 -- 172.21.15.5:0/2184122925 >> 172.21.15.5:0/2184122925 conn(0x7fe7480a6440 msgr2=0x7fe748068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74ff4d640 1 -- 172.21.15.5:0/2184122925 shutdown_connections 2024-08-18T21:03:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:43.997+0000 7fe74ff4d640 1 -- 172.21.15.5:0/2184122925 wait complete. 2024-08-18T21:03:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 10 monclient: build_initial_monmap 2024-08-18T21:03:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 10 monclient: monmap: 2024-08-18T21:03:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:44.009 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 1 Processor -- start 2024-08-18T21:03:44.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 10 monclient: get_monmap_and_config 2024-08-18T21:03:44.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 10 monclient: build_initial_monmap 2024-08-18T21:03:44.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 10 monclient: monmap: 2024-08-18T21:03:44.010 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:44.005300+0000 2024-08-18T21:03:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:44.005300+0000 2024-08-18T21:03:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:44.012 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:44.012 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:44.012 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:44.012 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 10 monclient: get_monmap_and_config 2024-08-18T21:03:44.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 10 monclient: build_initial_monmap 2024-08-18T21:03:44.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 10 monclient: monmap: 2024-08-18T21:03:44.012 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:44.012 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:44.005594+0000 2024-08-18T21:03:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:44.005594+0000 2024-08-18T21:03:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:44.014 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 1 -- start start 2024-08-18T21:03:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 10 monclient: init 2024-08-18T21:03:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 1 Processor -- start 2024-08-18T21:03:44.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 1 -- start start 2024-08-18T21:03:44.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 10 monclient: init 2024-08-18T21:03:44.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:44.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 10 monclient: _add_conns ranks=[4,6,3,1,0,5,7,8,2] 2024-08-18T21:03:44.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe74809df40 0x7fe7481cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 1 Processor -- start 2024-08-18T21:03:44.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 1 -- start start 2024-08-18T21:03:44.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 10 monclient: init 2024-08-18T21:03:44.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe74809df40 0x7fe7481cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe74809df40 0x7fe7481cd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:36702/0 (socket says 172.21.15.5:36702) 2024-08-18T21:03:44.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:44.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 10 monclient: _add_conns ranks=[2,0,7,1,10,6,4,5,9,8,3] 2024-08-18T21:03:44.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47dc0b9710 0x7f47dc0b9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 10 monclient(hunting): picked mon.noname-b con 0x7f47dc0b9710 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:44.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f47dc007e60 addr v1:172.21.15.5:6789/0 2024-08-18T21:03:44.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47dc008950 0x7f47dc0c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f47dc007e60 0x7f47dc008240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57626/0 (socket says 172.21.15.5:57626) 2024-08-18T21:03:44.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:44.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 10 monclient: _add_conns ranks=[0,10,6,1,9,4,7,3,5,2,8] 2024-08-18T21:03:44.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 10 monclient(hunting): picked mon.noname-c con 0x7fe74809df40 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:44.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe7480a4960 0x7fe748135970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 10 monclient(hunting): picked mon.noname-i con 0x7f47dc008950 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e3fff640 1 -- 172.21.15.5:0/130996850 learned_addr learned my addr 172.21.15.5:0/130996850 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:03:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 1 -- 172.21.15.5:0/130996850 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47dc028220 con 0x7f47dc007e60 2024-08-18T21:03:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 10 monclient(hunting): picked mon.noname-d con 0x7fe7480a4960 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe748136780 0x7fe748139a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 10 monclient(hunting): picked mon.noname-g con 0x7fe748136780 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe74806cad0 con 0x7fe748136780 2024-08-18T21:03:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fe74806c950 con 0x7fe74809df40 2024-08-18T21:03:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fe74806cc50 con 0x7fe7480a4960 2024-08-18T21:03:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 1 -- 172.21.15.5:0/314659730 learned_addr learned my addr 172.21.15.5:0/314659730 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74ff4d640 10 monclient(hunting): authenticate will time out at 991.018908s 2024-08-18T21:03:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 10 monclient(hunting): get_auth_request con 0x7fe74809df40 auth_method 0 2024-08-18T21:03:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74d4e8640 1 --2- 172.21.15.5:0/314659730 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe7480a4960 0x7fe748135970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74d4e8640 10 monclient(hunting): get_auth_request con 0x7fe7480a4960 auth_method 0 2024-08-18T21:03:44.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74d4e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74d4e8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74d4e8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 1 --2- 172.21.15.5:0/130996850 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47dc0b9710 0x7f47dc0b9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 1 -- 172.21.15.5:0/130996850 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f47dc020e40 con 0x7f47dc0b9710 2024-08-18T21:03:44.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 1 -- 172.21.15.5:0/130996850 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f47dc021120 con 0x7f47dc008950 2024-08-18T21:03:44.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:44.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9a36640 10 monclient(hunting): authenticate will time out at 991.019133s 2024-08-18T21:03:44.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74d4e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74d4e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74d4e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74e4ea640 1 --2- 172.21.15.5:0/314659730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe748136780 0x7fe748139a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74e4ea640 10 monclient(hunting): get_auth_request con 0x7fe748136780 auth_method 0 2024-08-18T21:03:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74e4ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74e4ea640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74e4ea640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74e4ea640 1 -- 172.21.15.5:0/314659730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe748136780 msgr2=0x7fe748139a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-18T21:03:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74e4ea640 1 -- 172.21.15.5:0/314659730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe748136780 msgr2=0x7fe748139a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:03:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74e4ea640 1 --2- 172.21.15.5:0/314659730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe748136780 0x7fe748139a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74e4ea640 1 --2- 172.21.15.5:0/314659730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe748136780 0x7fe748139a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:03:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 10 monclient(hunting): get_auth_request con 0x7f47dc0b9710 auth_method 0 2024-08-18T21:03:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9235640 1 --2- 172.21.15.5:0/130996850 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47dc008950 0x7f47dc0c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f648009b8c0 addr v1:172.21.15.5:6789/0 2024-08-18T21:03:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f648009bca0 0x7f6480068e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 10 monclient(hunting): picked mon.noname-f con 0x7f648009bca0 addr v2:172.21.15.157:3300/0 2024-08-18T21:03:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6480069350 0x7f648013e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 10 monclient(hunting): picked mon.noname-d con 0x7f6480069350 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f648575d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6480069350 0x7f648013e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f6484f5c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f648009b8c0 0x7f6480068700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57632/0 (socket says 172.21.15.5:57632) 2024-08-18T21:03:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f6484f5c640 1 -- 172.21.15.5:0/3774428081 learned_addr learned my addr 172.21.15.5:0/3774428081 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:03:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f6477fff640 1 --2- 172.21.15.5:0/3774428081 >> v2:172.21.15.157:3300/0 conn(0x7f648009bca0 0x7f6480068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9235640 10 monclient(hunting): get_auth_request con 0x7f47dc008950 auth_method 0 2024-08-18T21:03:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9235640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9235640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e9235640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 10 monclient(hunting): handle_auth_done global_id 4313 payload 274 2024-08-18T21:03:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 1 -- 172.21.15.5:0/130996850 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47dc008950 msgr2=0x7f47dc0c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 1 --2- 172.21.15.5:0/130996850 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47dc008950 0x7f47dc0c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 1 -- 172.21.15.5:0/130996850 >> v1:172.21.15.5:6789/0 conn(0x7f47dc007e60 legacy=0x7f47dc008240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 10 monclient: _finish_hunting 0 2024-08-18T21:03:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 1 monclient: found mon.noname-b 2024-08-18T21:03:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f47e8a34640 1 -- 172.21.15.5:0/130996850 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47dc021400 con 0x7f47dc0b9710 2024-08-18T21:03:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 1 -- 172.21.15.5:0/3774428081 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64800a9290 con 0x7f648009b8c0 2024-08-18T21:03:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 1 -- 172.21.15.5:0/3774428081 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f64800a1b50 con 0x7f648009bca0 2024-08-18T21:03:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 1 -- 172.21.15.5:0/3774428081 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f64800a1e30 con 0x7f6480069350 2024-08-18T21:03:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f64871c0640 10 monclient(hunting): authenticate will time out at 991.019704s 2024-08-18T21:03:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f648575d640 10 monclient(hunting): get_auth_request con 0x7f6480069350 auth_method 0 2024-08-18T21:03:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f648575d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f648575d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f648575d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f6477fff640 10 monclient(hunting): get_auth_request con 0x7f648009bca0 auth_method 0 2024-08-18T21:03:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f6477fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f6477fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f6477fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f648575d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f648575d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f648575d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 10 monclient(hunting): handle_auth_done global_id 4315 payload 824 2024-08-18T21:03:44.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 1 -- 172.21.15.5:0/314659730 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe7480a4960 msgr2=0x7fe748135970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 1 --2- 172.21.15.5:0/314659730 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe7480a4960 0x7fe748135970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 1 -- 172.21.15.5:0/314659730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe748136780 msgr2=0x7fe748139a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:03:44.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f6477fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f6477fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7f6477fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 1 --2- 172.21.15.5:0/314659730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe748136780 0x7fe748139a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 10 monclient: _finish_hunting 0 2024-08-18T21:03:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 1 monclient: found mon.noname-c 2024-08-18T21:03:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74dce9640 1 -- 172.21.15.5:0/314659730 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe748136de0 con 0x7fe74809df40 2024-08-18T21:03:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.001+0000 7fe74d4e8640 1 --2- 172.21.15.5:0/314659730 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe7480a4960 0x7fe748135970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7f648575d640 10 monclient(hunting): handle_auth_done global_id 4281 payload 274 2024-08-18T21:03:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7f648575d640 1 -- 172.21.15.5:0/3774428081 >> v2:172.21.15.157:3300/0 conn(0x7f648009bca0 msgr2=0x7f6480068e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7f648575d640 1 --2- 172.21.15.5:0/3774428081 >> v2:172.21.15.157:3300/0 conn(0x7f648009bca0 0x7f6480068e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7f648575d640 1 -- 172.21.15.5:0/3774428081 >> v1:172.21.15.5:6789/0 conn(0x7f648009b8c0 legacy=0x7f6480068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7f648575d640 10 monclient: _finish_hunting 0 2024-08-18T21:03:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7f648575d640 1 monclient: found mon.noname-d 2024-08-18T21:03:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7f648575d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7f648575d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7f648575d640 1 -- 172.21.15.5:0/3774428081 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64800a2880 con 0x7f6480069350 2024-08-18T21:03:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe74dce9640 1 -- 172.21.15.5:0/314659730 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe74809df40 msgr2=0x7fe7481cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe74dce9640 1 --2- 172.21.15.5:0/314659730 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe74809df40 0x7fe7481cd1d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe74400e840 tx=0x7fe74400ed00 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe73e7fc640 1 -- 172.21.15.5:0/314659730 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe744017070 con 0x7fe74809df40 2024-08-18T21:03:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe73e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe73e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe73e7fc640 10 monclient: dump: 2024-08-18T21:03:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.034 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe73e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe73e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe73e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe73e7fc640 1 -- 172.21.15.5:0/314659730 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe74400cd50 con 0x7fe74809df40 2024-08-18T21:03:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe73e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe73e7fc640 1 -- 172.21.15.5:0/314659730 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe74400f040 con 0x7fe74809df40 2024-08-18T21:03:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe73e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe73e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe73e7fc640 10 monclient: dump: 2024-08-18T21:03:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.036 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe73ffff640 4 set_mon_vals no callback set 2024-08-18T21:03:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe74ff4d640 5 monclient: authenticate success, global_id 4315 2024-08-18T21:03:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe74ff4d640 10 monclient: _renew_subs 2024-08-18T21:03:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe74ff4d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe74ff4d640 1 -- 172.21.15.5:0/314659730 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe74813b4e0 con 0x7fe74809df40 2024-08-18T21:03:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe74ff4d640 10 monclient: _renew_subs 2024-08-18T21:03:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe74ff4d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.005+0000 7fe74ff4d640 1 -- 172.21.15.5:0/314659730 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fe74811fa60 con 0x7fe74809df40 2024-08-18T21:03:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7fe74ff4d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7fe74ff4d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7fe74ff4d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7fe74ff4d640 1 -- 172.21.15.5:0/314659730 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7480aa040 con 0x7fe74809df40 2024-08-18T21:03:44.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f648575d640 1 -- 172.21.15.5:0/3774428081 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6480069350 msgr2=0x7f648013e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:44.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f648575d640 1 --2- 172.21.15.5:0/3774428081 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6480069350 0x7f648013e8a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f647800f370 tx=0x7f6478020c30 comp rx=0 tx=0).ready entity=mon.6 client_cookie=7b9fcb2b0129827b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7fe73e7fc640 1 -- 172.21.15.5:0/314659730 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe74401a070 con 0x7fe74809df40 2024-08-18T21:03:44.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64777fe640 1 -- 172.21.15.5:0/3774428081 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f647800d540 con 0x7f6480069350 2024-08-18T21:03:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64777fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64777fe640 10 monclient: dump: 2024-08-18T21:03:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.039 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64777fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64777fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64777fe640 1 -- 172.21.15.5:0/3774428081 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64780a9890 con 0x7f6480069350 2024-08-18T21:03:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 5 monclient: authenticate success, global_id 4281 2024-08-18T21:03:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64777fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 4 set_mon_vals no callback set 2024-08-18T21:03:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64777fe640 1 -- 172.21.15.5:0/3774428081 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f647800b740 con 0x7f6480069350 2024-08-18T21:03:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64777fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64777fe640 10 monclient: dump: 2024-08-18T21:03:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.041 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7fe73e7fc640 1 --2- 172.21.15.5:0/314659730 >> v2:172.21.15.157:6812/631023601 conn(0x7fe72c03bdc0 0x7fe72c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7fe74d4e8640 1 --2- 172.21.15.5:0/314659730 >> v2:172.21.15.157:6812/631023601 conn(0x7fe72c03bdc0 0x7fe72c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7fe74d4e8640 10 monclient: get_auth_request con 0x7fe72c03bdc0 auth_method 0 2024-08-18T21:03:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 10 monclient: shutdown 2024-08-18T21:03:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 1 -- 172.21.15.5:0/3774428081 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6480069350 msgr2=0x7f648013e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 1 --2- 172.21.15.5:0/3774428081 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6480069350 0x7f648013e8a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f647800f370 tx=0x7f6478020c30 comp rx=0 tx=0).stop 2024-08-18T21:03:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 1 -- 172.21.15.5:0/3774428081 shutdown_connections 2024-08-18T21:03:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 1 --2- 172.21.15.5:0/3774428081 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6480069350 0x7f648013e8a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 1 --2- 172.21.15.5:0/3774428081 >> v2:172.21.15.157:3300/0 conn(0x7f648009bca0 0x7f6480068e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 1 -- 172.21.15.5:0/3774428081 >> 172.21.15.5:0/3774428081 conn(0x7f64800a8480 msgr2=0x7f64800a8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 1 -- 172.21.15.5:0/3774428081 shutdown_connections 2024-08-18T21:03:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 1 -- 172.21.15.5:0/3774428081 wait complete. 2024-08-18T21:03:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 10 monclient: build_initial_monmap 2024-08-18T21:03:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 10 monclient: monmap: 2024-08-18T21:03:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:44.045 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 1 Processor -- start 2024-08-18T21:03:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 1 -- start start 2024-08-18T21:03:44.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 10 monclient: init 2024-08-18T21:03:44.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:44.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 10 monclient: _add_conns ranks=[3,7,1,4,6,8,0,2,5] 2024-08-18T21:03:44.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6480069350 0x7f6480071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 10 monclient(hunting): picked mon.noname-g con 0x7f6480069350 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:44.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f648009b8c0 0x7f6480071590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 10 monclient(hunting): picked mon.noname-i con 0x7f648009b8c0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:44.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f648009bca0 0x7f6480071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 10 monclient(hunting): picked mon.noname-f con 0x7f648009bca0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:44.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f64800a0520 con 0x7f648009bca0 2024-08-18T21:03:44.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f64800a03a0 con 0x7f6480069350 2024-08-18T21:03:44.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f64800a06a0 con 0x7f648009b8c0 2024-08-18T21:03:44.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:44.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f64871c0640 10 monclient(hunting): authenticate will time out at 991.027915s 2024-08-18T21:03:44.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7fe74d4e8640 1 --2- 172.21.15.5:0/314659730 >> v2:172.21.15.157:6812/631023601 conn(0x7fe72c03bdc0 0x7fe72c03e280 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe7380ab000 tx=0x7fe7380a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f6484f5c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6480069350 0x7f6480071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f648009bca0 0x7f6480071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f648009bca0 0x7f6480071ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:58012/0 (socket says 172.21.15.5:58012) 2024-08-18T21:03:44.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 1 -- 172.21.15.5:0/2054602224 learned_addr learned my addr 172.21.15.5:0/2054602224 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:44.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 10 monclient(hunting): get_auth_request con 0x7f648009bca0 auth_method 0 2024-08-18T21:03:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f6484f5c640 10 monclient(hunting): get_auth_request con 0x7f6480069350 auth_method 0 2024-08-18T21:03:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f6484f5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f6484f5c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f6484f5c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f6484f5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f6484f5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f6484f5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 10 monclient(hunting): handle_auth_done global_id 4258 payload 824 2024-08-18T21:03:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 1 -- 172.21.15.5:0/2054602224 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f648009b8c0 msgr2=0x7f6480071590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-18T21:03:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 1 --2- 172.21.15.5:0/2054602224 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f648009b8c0 0x7f6480071590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 1 -- 172.21.15.5:0/2054602224 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6480069350 msgr2=0x7f6480071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 1 --2- 172.21.15.5:0/2054602224 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6480069350 0x7f6480071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 10 monclient: _finish_hunting 0 2024-08-18T21:03:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 1 monclient: found mon.noname-f 2024-08-18T21:03:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:03:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 1 -- 172.21.15.5:0/2054602224 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6480139790 con 0x7f648009bca0 2024-08-18T21:03:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f6484f5c640 1 --2- 172.21.15.5:0/2054602224 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6480069350 0x7f6480071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 1 -- 172.21.15.5:0/2054602224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f648009bca0 msgr2=0x7f6480071ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f648575d640 1 --2- 172.21.15.5:0/2054602224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f648009bca0 0x7f6480071ad0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f64780214d0 tx=0x7f647801d9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64757fa640 1 -- 172.21.15.5:0/2054602224 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f64780c0020 con 0x7f648009bca0 2024-08-18T21:03:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64757fa640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:03:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64757fa640 10 monclient: dump: 2024-08-18T21:03:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.053 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.053 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.053 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.053 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.053 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64757fa640 10 monclient: _finish_auth 0 2024-08-18T21:03:44.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64757fa640 10 monclient: _check_auth_tickets 2024-08-18T21:03:44.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64757fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:44.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64757fa640 1 -- 172.21.15.5:0/2054602224 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f647800d540 con 0x7f648009bca0 2024-08-18T21:03:44.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64871c0640 5 monclient: authenticate success, global_id 4258 2024-08-18T21:03:44.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64871c0640 10 monclient: _renew_subs 2024-08-18T21:03:44.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64871c0640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:03:44.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64871c0640 1 -- 172.21.15.5:0/2054602224 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64800749f0 con 0x7f648009bca0 2024-08-18T21:03:44.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64757fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:44.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64757fa640 1 -- 172.21.15.5:0/2054602224 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f647800b740 con 0x7f648009bca0 2024-08-18T21:03:44.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64757fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:03:44.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64757fa640 10 monclient: dump: 2024-08-18T21:03:44.054 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.054 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.054 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.054 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.054 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.054 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.055 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.055 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.055 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.055 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.055 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.057 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.057 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.058 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.058 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.058 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.013+0000 7f64871c0640 10 monclient: _renew_subs 2024-08-18T21:03:44.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f64871c0640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:03:44.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f64871c0640 1 -- 172.21.15.5:0/2054602224 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64800734d0 con 0x7f648009bca0 2024-08-18T21:03:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e8a34640 1 -- 172.21.15.5:0/130996850 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47dc0b9710 msgr2=0x7f47dc0b9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e8a34640 1 --2- 172.21.15.5:0/130996850 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47dc0b9710 0x7f47dc0b9af0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f47d80097f0 tx=0x7f47d801c180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49dba987c140aa06 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e37fe640 1 -- 172.21.15.5:0/130996850 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47d80b0070 con 0x7f47dc0b9710 2024-08-18T21:03:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e37fe640 10 monclient: dump: 2024-08-18T21:03:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.060 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.060 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.060 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.060 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.060 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.060 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.060 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.060 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.060 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.060 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e37fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:44.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e37fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:44.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:44.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e9a36640 5 monclient: authenticate success, global_id 4313 2024-08-18T21:03:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e9a36640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e37fe640 1 -- 172.21.15.5:0/130996850 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d80aa810 con 0x7f47dc0b9710 2024-08-18T21:03:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e37fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e9a36640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e9a36640 4 set_mon_vals no callback set 2024-08-18T21:03:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e9a36640 10 monclient: shutdown 2024-08-18T21:03:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e9a36640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e9a36640 1 -- 172.21.15.5:0/130996850 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47dc0b9710 msgr2=0x7f47dc0b9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e9a36640 1 --2- 172.21.15.5:0/130996850 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47dc0b9710 0x7f47dc0b9af0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f47d80097f0 tx=0x7f47d801c180 comp rx=0 tx=0).stop 2024-08-18T21:03:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e37fe640 1 -- 172.21.15.5:0/130996850 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 0 0 0) 0x7f47d80aae30 con 0x7f47dc0b9710 2024-08-18T21:03:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e37fe640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-08-18T21:03:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e9a36640 1 -- 172.21.15.5:0/130996850 shutdown_connections 2024-08-18T21:03:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e9a36640 1 --2- 172.21.15.5:0/130996850 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47dc008950 0x7f47dc0c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e9a36640 1 --2- 172.21.15.5:0/130996850 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47dc0b9710 0x7f47dc0b9af0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.009+0000 7f47e9a36640 1 -- 172.21.15.5:0/130996850 >> 172.21.15.5:0/130996850 conn(0x7f47dc0289b0 msgr2=0x7f47dc028dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:44.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7fe73e7fc640 1 -- 172.21.15.5:0/314659730 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fe74400c8e0 con 0x7fe74809df40 2024-08-18T21:03:44.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f47e9a36640 1 -- 172.21.15.5:0/130996850 shutdown_connections 2024-08-18T21:03:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f6476ffd640 4 set_mon_vals no callback set 2024-08-18T21:03:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f64871c0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f64871c0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f64871c0640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:03:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f64871c0640 1 -- 172.21.15.5:0/2054602224 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6460005090 con 0x7f648009bca0 2024-08-18T21:03:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f64757fa640 1 -- 172.21.15.5:0/2054602224 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f64780c3020 con 0x7f648009bca0 2024-08-18T21:03:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f47e9a36640 1 -- 172.21.15.5:0/130996850 wait complete. 2024-08-18T21:03:44.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f64757fa640 1 --2- 172.21.15.5:0/2054602224 >> v2:172.21.15.157:6812/631023601 conn(0x7f646c03bdf0 0x7f646c03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f64757fa640 1 -- 172.21.15.5:0/2054602224 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f64780ed450 con 0x7f648009bca0 2024-08-18T21:03:44.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f6484f5c640 1 --2- 172.21.15.5:0/2054602224 >> v2:172.21.15.157:6812/631023601 conn(0x7f646c03bdf0 0x7f646c03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f6484f5c640 10 monclient: get_auth_request con 0x7f646c03bdf0 auth_method 0 2024-08-18T21:03:44.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f47e9a36640 10 monclient: build_initial_monmap 2024-08-18T21:03:44.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f47e9a36640 10 monclient: monmap: 2024-08-18T21:03:44.065 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:44.067 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f47e9a36640 1 Processor -- start 2024-08-18T21:03:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f47e9a36640 1 -- start start 2024-08-18T21:03:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.017+0000 7f47e9a36640 10 monclient: init 2024-08-18T21:03:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7fe73e7fc640 1 -- 172.21.15.5:0/314659730 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fe744012e10 con 0x7fe74809df40 2024-08-18T21:03:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7fe73e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7fe73e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9a36640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:44.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f6484f5c640 1 --2- 172.21.15.5:0/2054602224 >> v2:172.21.15.157:6812/631023601 conn(0x7f646c03bdf0 0x7f646c03e2b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f647c007ca0 tx=0x7f647c007bf0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9a36640 10 monclient: _add_conns ranks=[3,4,7,6,8,0,2,1,5] 2024-08-18T21:03:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9a36640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47dc007e60 0x7f47dc0c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9a36640 10 monclient(hunting): picked mon.noname-g con 0x7f47dc007e60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9a36640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47dc008950 0x7f47dc0c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9a36640 10 monclient(hunting): picked mon.noname-c con 0x7f47dc008950 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47dc008950 0x7f47dc0c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47dc008950 0x7f47dc0c14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:36714/0 (socket says 172.21.15.5:36714) 2024-08-18T21:03:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 1 -- 172.21.15.5:0/1014277848 learned_addr learned my addr 172.21.15.5:0/1014277848 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9a36640 1 --2- 172.21.15.5:0/1014277848 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47dc0b9710 0x7f47dc0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e8a34640 1 --2- 172.21.15.5:0/1014277848 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47dc007e60 0x7f47dc0c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9a36640 10 monclient(hunting): picked mon.noname-i con 0x7f47dc0b9710 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9a36640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9a36640 1 -- 172.21.15.5:0/1014277848 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f47dc01ff20 con 0x7f47dc007e60 2024-08-18T21:03:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9a36640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9a36640 1 -- 172.21.15.5:0/1014277848 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f47dc01fda0 con 0x7f47dc008950 2024-08-18T21:03:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9a36640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9a36640 1 -- 172.21.15.5:0/1014277848 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f47dc0ba030 con 0x7f47dc0b9710 2024-08-18T21:03:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9a36640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9a36640 10 monclient(hunting): authenticate will time out at 991.037870s 2024-08-18T21:03:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 10 monclient(hunting): get_auth_request con 0x7f47dc008950 auth_method 0 2024-08-18T21:03:44.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e8a34640 10 monclient(hunting): get_auth_request con 0x7f47dc007e60 auth_method 0 2024-08-18T21:03:44.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e8a34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e8a34640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e8a34640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9235640 1 --2- 172.21.15.5:0/1014277848 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47dc0b9710 0x7f47dc0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9235640 10 monclient(hunting): get_auth_request con 0x7f47dc0b9710 auth_method 0 2024-08-18T21:03:44.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9235640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9235640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9235640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e8a34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e8a34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e8a34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9235640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9235640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e9235640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 10 monclient(hunting): handle_auth_done global_id 4324 payload 824 2024-08-18T21:03:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 1 -- 172.21.15.5:0/1014277848 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47dc0b9710 msgr2=0x7f47dc0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 1 --2- 172.21.15.5:0/1014277848 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47dc0b9710 0x7f47dc0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 1 -- 172.21.15.5:0/1014277848 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47dc007e60 msgr2=0x7f47dc0c0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 1 --2- 172.21.15.5:0/1014277848 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47dc007e60 0x7f47dc0c0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 10 monclient: _finish_hunting 0 2024-08-18T21:03:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 1 monclient: found mon.noname-c 2024-08-18T21:03:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.021+0000 7f47e3fff640 1 -- 172.21.15.5:0/1014277848 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47dc02b410 con 0x7f47dc008950 2024-08-18T21:03:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e3fff640 1 -- 172.21.15.5:0/1014277848 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47dc008950 msgr2=0x7f47dc0c14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e3fff640 1 --2- 172.21.15.5:0/1014277848 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47dc008950 0x7f47dc0c14c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f47d000c480 tx=0x7f47d000c940 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e17fa640 1 -- 172.21.15.5:0/1014277848 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47d0005d00 con 0x7f47dc008950 2024-08-18T21:03:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e17fa640 10 monclient: dump: 2024-08-18T21:03:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.076 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e17fa640 10 monclient: _finish_auth 0 2024-08-18T21:03:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e17fa640 10 monclient: _check_auth_tickets 2024-08-18T21:03:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e9a36640 5 monclient: authenticate success, global_id 4324 2024-08-18T21:03:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e9a36640 10 monclient: _renew_subs 2024-08-18T21:03:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e9a36640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e9a36640 1 -- 172.21.15.5:0/1014277848 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47dc0c4cb0 con 0x7f47dc008950 2024-08-18T21:03:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e9a36640 10 monclient: _renew_subs 2024-08-18T21:03:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e9a36640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e9a36640 1 -- 172.21.15.5:0/1014277848 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f47dc0a26d0 con 0x7f47dc008950 2024-08-18T21:03:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e17fa640 1 -- 172.21.15.5:0/1014277848 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d0007070 con 0x7f47dc008950 2024-08-18T21:03:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e17fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e17fa640 1 -- 172.21.15.5:0/1014277848 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47d00076d0 con 0x7f47dc008950 2024-08-18T21:03:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e17fa640 10 monclient: dump: 2024-08-18T21:03:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e2ffd640 4 set_mon_vals no callback set 2024-08-18T21:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e9a36640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e9a36640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e9a36640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e9a36640 1 -- 172.21.15.5:0/1014277848 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c4005090 con 0x7f47dc008950 2024-08-18T21:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e17fa640 1 -- 172.21.15.5:0/1014277848 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f47d0007260 con 0x7f47dc008950 2024-08-18T21:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e17fa640 1 --2- 172.21.15.5:0/1014277848 >> v2:172.21.15.157:6812/631023601 conn(0x7f47c8044500 0x7f47c80469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e17fa640 1 -- 172.21.15.5:0/1014277848 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f47d004e260 con 0x7f47dc008950 2024-08-18T21:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e8a34640 1 --2- 172.21.15.5:0/1014277848 >> v2:172.21.15.157:6812/631023601 conn(0x7f47c8044500 0x7f47c80469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.025+0000 7f47e8a34640 10 monclient: get_auth_request con 0x7f47c8044500 auth_method 0 2024-08-18T21:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.029+0000 7f47e8a34640 1 --2- 172.21.15.5:0/1014277848 >> v2:172.21.15.157:6812/631023601 conn(0x7f47c8044500 0x7f47c80469c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f47d80ab000 tx=0x7f47d80a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.033+0000 7f64757fa640 1 -- 172.21.15.5:0/2054602224 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f64780ca070 con 0x7f648009bca0 2024-08-18T21:03:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.033+0000 7f64757fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.033+0000 7f64757fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.037+0000 7f47e17fa640 1 -- 172.21.15.5:0/1014277848 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f47d0010d10 con 0x7f47dc008950 2024-08-18T21:03:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.037+0000 7f47e17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.037+0000 7f47e17fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:44.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.049+0000 7f291210f640 10 monclient: get_monmap_and_config 2024-08-18T21:03:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.049+0000 7f291210f640 10 monclient: build_initial_monmap 2024-08-18T21:03:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.049+0000 7f291210f640 10 monclient: monmap: 2024-08-18T21:03:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:44.055347+0000 2024-08-18T21:03:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:44.055347+0000 2024-08-18T21:03:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.049+0000 7f291210f640 1 Processor -- start 2024-08-18T21:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.049+0000 7f291210f640 1 -- start start 2024-08-18T21:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.049+0000 7f291210f640 10 monclient: init 2024-08-18T21:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f291210f640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f291210f640 10 monclient: _add_conns ranks=[2,6,9,0,4,1,5,10,3,8,7] 2024-08-18T21:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f291210f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f290c0a6bd0 0x7f290c0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f291210f640 10 monclient(hunting): picked mon.noname-b con 0x7f290c0a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:44.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f291210f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f290c09f080 0x7f290c0a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f290c09f080 0x7f290c0a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f290c09f080 0x7f290c0a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:57060/0 (socket says 172.21.15.5:57060) 2024-08-18T21:03:44.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290b7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f290c0a6bd0 0x7f290c0a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290b7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f290c0a6bd0 0x7f290c0a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34102/0 (socket says 172.21.15.5:34102) 2024-08-18T21:03:44.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290b7fe640 1 -- 172.21.15.5:0/1173288840 learned_addr learned my addr 172.21.15.5:0/1173288840 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:44.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f291210f640 10 monclient(hunting): picked mon.noname-d con 0x7f290c09f080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:44.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f291210f640 1 --2- 172.21.15.5:0/1173288840 >> v2:172.21.15.5:3300/0 conn(0x7f290c139990 0x7f290c139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f291210f640 10 monclient(hunting): picked mon.noname-a con 0x7f290c139990 addr v2:172.21.15.5:3300/0 2024-08-18T21:03:44.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f291210f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f291210f640 1 -- 172.21.15.5:0/1173288840 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f290c09e4c0 con 0x7f290c139990 2024-08-18T21:03:44.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f291210f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f291210f640 1 -- 172.21.15.5:0/1173288840 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f290c06f930 con 0x7f290c0a6bd0 2024-08-18T21:03:44.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f291210f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f291210f640 1 -- 172.21.15.5:0/1173288840 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f290c0a7a30 con 0x7f290c09f080 2024-08-18T21:03:44.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f291210f640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:44.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f291210f640 10 monclient(hunting): authenticate will time out at 991.068759s 2024-08-18T21:03:44.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290b7fe640 10 monclient(hunting): get_auth_request con 0x7f290c0a6bd0 auth_method 0 2024-08-18T21:03:44.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290bfff640 1 --2- 172.21.15.5:0/1173288840 >> v2:172.21.15.5:3300/0 conn(0x7f290c139990 0x7f290c139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290bfff640 10 monclient(hunting): get_auth_request con 0x7f290c139990 auth_method 0 2024-08-18T21:03:44.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 10 monclient(hunting): get_auth_request con 0x7f290c09f080 auth_method 0 2024-08-18T21:03:44.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 10 monclient(hunting): handle_auth_done global_id 4290 payload 274 2024-08-18T21:03:44.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 1 -- 172.21.15.5:0/1173288840 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f290c0a6bd0 msgr2=0x7f290c0a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:44.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 1 --2- 172.21.15.5:0/1173288840 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f290c0a6bd0 0x7f290c0a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 1 -- 172.21.15.5:0/1173288840 >> v2:172.21.15.5:3300/0 conn(0x7f290c139990 msgr2=0x7f290c139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:44.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 1 --2- 172.21.15.5:0/1173288840 >> v2:172.21.15.5:3300/0 conn(0x7f290c139990 0x7f290c139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 10 monclient: _finish_hunting 0 2024-08-18T21:03:44.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 1 monclient: found mon.noname-d 2024-08-18T21:03:44.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:44.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:44.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290affd640 1 -- 172.21.15.5:0/1173288840 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290c0a7fb0 con 0x7f290c09f080 2024-08-18T21:03:44.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.053+0000 7f290bfff640 1 --2- 172.21.15.5:0/1173288840 >> v2:172.21.15.5:3300/0 conn(0x7f290c139990 0x7f290c139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:44.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f290affd640 1 -- 172.21.15.5:0/1173288840 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f290c09f080 msgr2=0x7f290c0a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:44.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f290affd640 1 --2- 172.21.15.5:0/1173288840 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f290c09f080 0x7f290c0a74f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f29000097f0 tx=0x7f290001c360 comp rx=0 tx=0).ready entity=mon.6 client_cookie=51547a233cecd2c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f290a7fc640 1 -- 172.21.15.5:0/1173288840 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f29000b0070 con 0x7f290c09f080 2024-08-18T21:03:44.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f290a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f290a7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:44.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f290a7fc640 10 monclient: dump: 2024-08-18T21:03:44.092 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.092 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.092 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.092 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.092 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.092 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.092 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.092 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.092 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.092 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.092 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.093 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.093 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.093 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.093 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.093 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f290a7fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:44.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f290a7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:44.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f290a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:44.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f291210f640 5 monclient: authenticate success, global_id 4290 2024-08-18T21:03:44.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f291210f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:44.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f290a7fc640 1 -- 172.21.15.5:0/1173288840 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29000aa810 con 0x7f290c09f080 2024-08-18T21:03:44.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f290a7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:44.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f291210f640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:44.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f291210f640 4 set_mon_vals no callback set 2024-08-18T21:03:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f290a7fc640 1 -- 172.21.15.5:0/1173288840 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f29000a4e60 con 0x7f290c09f080 2024-08-18T21:03:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f290a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f290a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f290a7fc640 10 monclient: dump: 2024-08-18T21:03:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.095 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f291210f640 10 monclient: shutdown 2024-08-18T21:03:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f291210f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f291210f640 1 -- 172.21.15.5:0/1173288840 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f290c09f080 msgr2=0x7f290c0a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f291210f640 1 --2- 172.21.15.5:0/1173288840 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f290c09f080 0x7f290c0a74f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f29000097f0 tx=0x7f290001c360 comp rx=0 tx=0).stop 2024-08-18T21:03:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f291210f640 1 -- 172.21.15.5:0/1173288840 shutdown_connections 2024-08-18T21:03:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f291210f640 1 --2- 172.21.15.5:0/1173288840 >> v2:172.21.15.5:3300/0 conn(0x7f290c139990 0x7f290c139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f291210f640 1 --2- 172.21.15.5:0/1173288840 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f290c09f080 0x7f290c0a74f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f291210f640 1 --2- 172.21.15.5:0/1173288840 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f290c0a6bd0 0x7f290c0a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f291210f640 1 -- 172.21.15.5:0/1173288840 >> 172.21.15.5:0/1173288840 conn(0x7f290c068700 msgr2=0x7f290c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f291210f640 1 -- 172.21.15.5:0/1173288840 shutdown_connections 2024-08-18T21:03:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.057+0000 7f291210f640 1 -- 172.21.15.5:0/1173288840 wait complete. 2024-08-18T21:03:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 10 monclient: build_initial_monmap 2024-08-18T21:03:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 10 monclient: monmap: 2024-08-18T21:03:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:44.097 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 1 Processor -- start 2024-08-18T21:03:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 1 -- start start 2024-08-18T21:03:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 10 monclient: init 2024-08-18T21:03:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 10 monclient: _add_conns ranks=[8,3,5,1,7,2,0,6,4] 2024-08-18T21:03:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f290c09f080 0x7f290c138860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 10 monclient(hunting): picked mon.noname-e con 0x7f290c09f080 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f290c0a6bd0 0x7f290c138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 10 monclient(hunting): picked mon.noname-g con 0x7f290c0a6bd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f290c139990 0x7f290c13da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 10 monclient(hunting): picked mon.noname-h con 0x7f290c139990 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f290c0a89f0 con 0x7f290c0a6bd0 2024-08-18T21:03:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f290c0a7ce0 con 0x7f290c139990 2024-08-18T21:03:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f290c143610 con 0x7f290c09f080 2024-08-18T21:03:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f291210f640 10 monclient(hunting): authenticate will time out at 991.077289s 2024-08-18T21:03:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f290c09f080 0x7f290c138860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f290c09f080 0x7f290c138860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47428/0 (socket says 172.21.15.5:47428) 2024-08-18T21:03:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 1 -- 172.21.15.5:0/4096956754 learned_addr learned my addr 172.21.15.5:0/4096956754 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 10 monclient(hunting): get_auth_request con 0x7f290c09f080 auth_method 0 2024-08-18T21:03:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290affd640 1 --2- 172.21.15.5:0/4096956754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f290c0a6bd0 0x7f290c138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290affd640 10 monclient(hunting): get_auth_request con 0x7f290c0a6bd0 auth_method 0 2024-08-18T21:03:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290bfff640 1 --2- 172.21.15.5:0/4096956754 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f290c139990 0x7f290c13da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 10 monclient(hunting): handle_auth_done global_id 4247 payload 824 2024-08-18T21:03:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 1 -- 172.21.15.5:0/4096956754 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f290c139990 msgr2=0x7f290c13da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 1 --2- 172.21.15.5:0/4096956754 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f290c139990 0x7f290c13da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 1 -- 172.21.15.5:0/4096956754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f290c0a6bd0 msgr2=0x7f290c138da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 1 --2- 172.21.15.5:0/4096956754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f290c0a6bd0 0x7f290c138da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 1 monclient: found mon.noname-e 2024-08-18T21:03:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.061+0000 7f290b7fe640 1 -- 172.21.15.5:0/4096956754 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290c13fbc0 con 0x7f290c09f080 2024-08-18T21:03:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f290b7fe640 1 -- 172.21.15.5:0/4096956754 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f290c09f080 msgr2=0x7f290c138860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f290b7fe640 1 --2- 172.21.15.5:0/4096956754 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f290c09f080 0x7f290c138860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00e890 tx=0x7f28fc00ed50 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f28f3fff640 1 -- 172.21.15.5:0/4096956754 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f28fc017070 con 0x7f290c09f080 2024-08-18T21:03:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f28f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f28f3fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f28f3fff640 10 monclient: dump: 2024-08-18T21:03:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.102 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f28f3fff640 10 monclient: _finish_auth 0 2024-08-18T21:03:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f28f3fff640 10 monclient: _check_auth_tickets 2024-08-18T21:03:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f28f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f28f3fff640 1 -- 172.21.15.5:0/4096956754 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28fc013470 con 0x7f290c09f080 2024-08-18T21:03:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f291210f640 5 monclient: authenticate success, global_id 4247 2024-08-18T21:03:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f291210f640 10 monclient: _renew_subs 2024-08-18T21:03:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f291210f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f291210f640 1 -- 172.21.15.5:0/4096956754 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f290c13fe10 con 0x7f290c09f080 2024-08-18T21:03:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f28f3fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f28f3fff640 1 -- 172.21.15.5:0/4096956754 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f28fc013a90 con 0x7f290c09f080 2024-08-18T21:03:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f28f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 10 monclient: get_monmap_and_config 2024-08-18T21:03:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 10 monclient: build_initial_monmap 2024-08-18T21:03:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 10 monclient: monmap: 2024-08-18T21:03:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:44.069082+0000 2024-08-18T21:03:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:44.069082+0000 2024-08-18T21:03:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:44.105 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f28f3fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f28f3fff640 10 monclient: dump: 2024-08-18T21:03:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.107 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f291210f640 10 monclient: _renew_subs 2024-08-18T21:03:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f291210f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f291210f640 1 -- 172.21.15.5:0/4096956754 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f290c0ab610 con 0x7f290c09f080 2024-08-18T21:03:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f2909ffb640 4 set_mon_vals no callback set 2024-08-18T21:03:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 1 Processor -- start 2024-08-18T21:03:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 1 -- start start 2024-08-18T21:03:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 10 monclient: init 2024-08-18T21:03:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 10 monclient: _add_conns ranks=[0,3,7,2,10,8,6,5,4,1,9] 2024-08-18T21:03:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7faf500a6bd0 addr v1:172.21.15.5:6789/0 2024-08-18T21:03:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf5009f080 0x7faf5013ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 10 monclient(hunting): picked mon.noname-g con 0x7faf5009f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7faf500a76c0 0x7faf50141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 10 monclient(hunting): picked mon.noname-i con 0x7faf500a76c0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf500a7fb0 con 0x7faf500a6bd0 2024-08-18T21:03:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7faf5009e4c0 con 0x7faf5009f080 2024-08-18T21:03:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7faf5006f930 con 0x7faf500a76c0 2024-08-18T21:03:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf58207640 10 monclient(hunting): authenticate will time out at 991.081991s 2024-08-18T21:03:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf5009f080 0x7faf5013ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf5009f080 0x7faf5013ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:58194/0 (socket says 172.21.15.5:58194) 2024-08-18T21:03:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 1 -- 172.21.15.5:0/1548476013 learned_addr learned my addr 172.21.15.5:0/1548476013 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 10 monclient(hunting): get_auth_request con 0x7faf5009f080 auth_method 0 2024-08-18T21:03:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f291210f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f291210f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f291210f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f291210f640 1 -- 172.21.15.5:0/4096956754 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f290c139e10 con 0x7f290c09f080 2024-08-18T21:03:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf567a4640 1 --2- 172.21.15.5:0/1548476013 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7faf500a76c0 0x7faf50141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf567a4640 10 monclient(hunting): get_auth_request con 0x7faf500a76c0 auth_method 0 2024-08-18T21:03:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf567a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf567a4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf567a4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf567a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf567a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf567a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 10 monclient(hunting): handle_auth_done global_id 4305 payload 274 2024-08-18T21:03:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 1 -- 172.21.15.5:0/1548476013 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7faf500a76c0 msgr2=0x7faf50141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 1 --2- 172.21.15.5:0/1548476013 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7faf500a76c0 0x7faf50141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 1 -- 172.21.15.5:0/1548476013 >> v1:172.21.15.5:6789/0 conn(0x7faf500a6bd0 legacy=0x7faf500a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 10 monclient: _finish_hunting 0 2024-08-18T21:03:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 1 monclient: found mon.noname-g 2024-08-18T21:03:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:03:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7faf557a2640 1 -- 172.21.15.5:0/1548476013 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5009de70 con 0x7faf5009f080 2024-08-18T21:03:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f28f3fff640 1 -- 172.21.15.5:0/4096956754 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f28fc01a070 con 0x7f290c09f080 2024-08-18T21:03:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f28f3fff640 1 --2- 172.21.15.5:0/4096956754 >> v2:172.21.15.157:6812/631023601 conn(0x7f28f803bdf0 0x7f28f803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f28f3fff640 1 -- 172.21.15.5:0/4096956754 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f28fc00f040 con 0x7f290c09f080 2024-08-18T21:03:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f290affd640 1 --2- 172.21.15.5:0/4096956754 >> v2:172.21.15.157:6812/631023601 conn(0x7f28f803bdf0 0x7f28f803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.065+0000 7f290affd640 10 monclient: get_auth_request con 0x7f28f803bdf0 auth_method 0 2024-08-18T21:03:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.069+0000 7f290affd640 1 --2- 172.21.15.5:0/4096956754 >> v2:172.21.15.157:6812/631023601 conn(0x7f28f803bdf0 0x7f28f803e2b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f29000ab000 tx=0x7f29000a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf557a2640 1 -- 172.21.15.5:0/1548476013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf5009f080 msgr2=0x7faf5013ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:44.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf557a2640 1 --2- 172.21.15.5:0/1548476013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf5009f080 0x7faf5013ede0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0098a0 tx=0x7faf4c01c4d0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=7c0011dce12b0852 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf54fa1640 1 -- 172.21.15.5:0/1548476013 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faf4c0b0070 con 0x7faf5009f080 2024-08-18T21:03:44.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf54fa1640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf54fa1640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:03:44.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf54fa1640 10 monclient: dump: 2024-08-18T21:03:44.117 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.117 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.117 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.117 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.117 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.117 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.117 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.117 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.117 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.117 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.117 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.117 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.117 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.117 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.118 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.118 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf54fa1640 10 monclient: _finish_auth 0 2024-08-18T21:03:44.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf54fa1640 10 monclient: _check_auth_tickets 2024-08-18T21:03:44.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf54fa1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:44.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf54fa1640 1 -- 172.21.15.5:0/1548476013 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c0aa810 con 0x7faf5009f080 2024-08-18T21:03:44.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf58207640 5 monclient: authenticate success, global_id 4305 2024-08-18T21:03:44.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf58207640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:44.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf54fa1640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:44.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf58207640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:44.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf58207640 4 set_mon_vals no callback set 2024-08-18T21:03:44.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf54fa1640 1 -- 172.21.15.5:0/1548476013 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faf4c0a9300 con 0x7faf5009f080 2024-08-18T21:03:44.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf54fa1640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf54fa1640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:03:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf54fa1640 10 monclient: dump: 2024-08-18T21:03:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.120 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf58207640 10 monclient: shutdown 2024-08-18T21:03:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf58207640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf58207640 1 -- 172.21.15.5:0/1548476013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf5009f080 msgr2=0x7faf5013ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf58207640 1 --2- 172.21.15.5:0/1548476013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf5009f080 0x7faf5013ede0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0098a0 tx=0x7faf4c01c4d0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf58207640 1 -- 172.21.15.5:0/1548476013 shutdown_connections 2024-08-18T21:03:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf58207640 1 --2- 172.21.15.5:0/1548476013 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7faf500a76c0 0x7faf50141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf58207640 1 --2- 172.21.15.5:0/1548476013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf5009f080 0x7faf5013ede0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf58207640 1 -- 172.21.15.5:0/1548476013 >> 172.21.15.5:0/1548476013 conn(0x7faf50068700 msgr2=0x7faf50068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf58207640 1 -- 172.21.15.5:0/1548476013 shutdown_connections 2024-08-18T21:03:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.073+0000 7faf58207640 1 -- 172.21.15.5:0/1548476013 wait complete. 2024-08-18T21:03:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 10 monclient: build_initial_monmap 2024-08-18T21:03:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 10 monclient: monmap: 2024-08-18T21:03:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:44.122 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 1 Processor -- start 2024-08-18T21:03:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 1 -- start start 2024-08-18T21:03:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 10 monclient: init 2024-08-18T21:03:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 10 monclient: _add_conns ranks=[0,4,1,5,8,2,7,6,3] 2024-08-18T21:03:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf5009f080 0x7faf50128e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 10 monclient(hunting): picked mon.noname-a con 0x7faf5009f080 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7faf500a6bd0 0x7faf5013fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 10 monclient(hunting): picked mon.noname-c con 0x7faf500a6bd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf500a76c0 0x7faf501269c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 10 monclient(hunting): picked mon.noname-f con 0x7faf500a76c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faf50144210 con 0x7faf5009f080 2024-08-18T21:03:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7faf50144090 con 0x7faf500a76c0 2024-08-18T21:03:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7faf50144390 con 0x7faf500a6bd0 2024-08-18T21:03:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf58207640 10 monclient(hunting): authenticate will time out at 991.093409s 2024-08-18T21:03:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf55fa3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf5009f080 0x7faf50128e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7faf500a6bd0 0x7faf5013fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7faf500a6bd0 0x7faf5013fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:36730/0 (socket says 172.21.15.5:36730) 2024-08-18T21:03:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 1 -- 172.21.15.5:0/4061484877 learned_addr learned my addr 172.21.15.5:0/4061484877 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 10 monclient(hunting): get_auth_request con 0x7faf500a6bd0 auth_method 0 2024-08-18T21:03:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf55fa3640 10 monclient(hunting): get_auth_request con 0x7faf5009f080 auth_method 0 2024-08-18T21:03:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf55fa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf55fa3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf55fa3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf55fa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf55fa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf55fa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 10 monclient(hunting): handle_auth_done global_id 4333 payload 824 2024-08-18T21:03:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 1 -- 172.21.15.5:0/4061484877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf500a76c0 msgr2=0x7faf501269c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 1 --2- 172.21.15.5:0/4061484877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf500a76c0 0x7faf501269c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 1 -- 172.21.15.5:0/4061484877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf5009f080 msgr2=0x7faf50128e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 1 --2- 172.21.15.5:0/4061484877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf5009f080 0x7faf50128e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 10 monclient: _finish_hunting 0 2024-08-18T21:03:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 1 monclient: found mon.noname-c 2024-08-18T21:03:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf557a2640 1 -- 172.21.15.5:0/4061484877 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5012a0a0 con 0x7faf500a6bd0 2024-08-18T21:03:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7faf55fa3640 1 --2- 172.21.15.5:0/4061484877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf5009f080 0x7faf50128e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7f28f3fff640 1 -- 172.21.15.5:0/4096956754 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f290c13fe10 con 0x7f290c09f080 2024-08-18T21:03:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7f28f3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.077+0000 7f28f3fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf557a2640 1 -- 172.21.15.5:0/4061484877 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7faf500a6bd0 msgr2=0x7faf5013fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf557a2640 1 --2- 172.21.15.5:0/4061484877 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7faf500a6bd0 0x7faf5013fcd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0097c0 tx=0x7faf4c019270 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf467fc640 1 -- 172.21.15.5:0/4061484877 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faf4c0b9070 con 0x7faf500a6bd0 2024-08-18T21:03:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf467fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf467fc640 10 monclient: dump: 2024-08-18T21:03:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.129 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf467fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf467fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf467fc640 1 -- 172.21.15.5:0/4061484877 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c0044b0 con 0x7faf500a6bd0 2024-08-18T21:03:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf467fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf467fc640 1 -- 172.21.15.5:0/4061484877 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faf4c0b0040 con 0x7faf500a6bd0 2024-08-18T21:03:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf467fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf47fff640 4 set_mon_vals no callback set 2024-08-18T21:03:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf467fc640 10 monclient: dump: 2024-08-18T21:03:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.131 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.131 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.131 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.131 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf58207640 5 monclient: authenticate success, global_id 4333 2024-08-18T21:03:44.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf58207640 10 monclient: _renew_subs 2024-08-18T21:03:44.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf58207640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:44.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf58207640 1 -- 172.21.15.5:0/4061484877 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5012a380 con 0x7faf500a6bd0 2024-08-18T21:03:44.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf58207640 10 monclient: _renew_subs 2024-08-18T21:03:44.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf58207640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:44.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf58207640 1 -- 172.21.15.5:0/4061484877 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7faf501297f0 con 0x7faf500a6bd0 2024-08-18T21:03:44.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf58207640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf58207640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf58207640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:44.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf58207640 1 -- 172.21.15.5:0/4061484877 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf500ad2c0 con 0x7faf500a6bd0 2024-08-18T21:03:44.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf467fc640 1 -- 172.21.15.5:0/4061484877 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7faf4c004040 con 0x7faf500a6bd0 2024-08-18T21:03:44.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf467fc640 1 --2- 172.21.15.5:0/4061484877 >> v2:172.21.15.157:6812/631023601 conn(0x7faf3403bdc0 0x7faf3403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.081+0000 7faf467fc640 1 -- 172.21.15.5:0/4061484877 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7faf4c0e7ba0 con 0x7faf500a6bd0 2024-08-18T21:03:44.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.085+0000 7faf55fa3640 1 --2- 172.21.15.5:0/4061484877 >> v2:172.21.15.157:6812/631023601 conn(0x7faf3403bdc0 0x7faf3403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.085+0000 7faf467fc640 1 -- 172.21.15.5:0/4061484877 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7faf4c016150 con 0x7faf500a6bd0 2024-08-18T21:03:44.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.085+0000 7faf467fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.085+0000 7faf467fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:44.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.085+0000 7faf55fa3640 10 monclient: get_auth_request con 0x7faf3403bdc0 auth_method 0 2024-08-18T21:03:44.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.089+0000 7faf55fa3640 1 --2- 172.21.15.5:0/4061484877 >> v2:172.21.15.157:6812/631023601 conn(0x7faf3403bdc0 0x7faf3403e280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faf40007fd0 tx=0x7faf40007e40 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.137+0000 7f735e818640 10 monclient: get_monmap_and_config 2024-08-18T21:03:44.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.137+0000 7f735e818640 10 monclient: build_initial_monmap 2024-08-18T21:03:44.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.137+0000 7f735e818640 10 monclient: monmap: 2024-08-18T21:03:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:44.143461+0000 2024-08-18T21:03:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:44.143461+0000 2024-08-18T21:03:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:44.143 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.137+0000 7f735e818640 1 Processor -- start 2024-08-18T21:03:44.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.137+0000 7f735e818640 1 -- start start 2024-08-18T21:03:44.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.137+0000 7f735e818640 10 monclient: init 2024-08-18T21:03:44.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735e818640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:44.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735e818640 10 monclient: _add_conns ranks=[3,2,9,4,6,8,10,5,7,0,1] 2024-08-18T21:03:44.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735e818640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f73580a6bd0 0x7f73580a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735e818640 10 monclient(hunting): picked mon.noname-g con 0x7f73580a6bd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:44.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735e818640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f735809f080 0x7f73580a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735e818640 10 monclient(hunting): picked mon.noname-b con 0x7f735809f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:44.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735e818640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7358139990 0x7f7358139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735e818640 10 monclient(hunting): picked mon.noname-a con 0x7f7358139990 addr v2:172.21.15.5:3300/0 2024-08-18T21:03:44.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735e818640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735e818640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f735809e4c0 con 0x7f7358139990 2024-08-18T21:03:44.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735e818640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735e818640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f735806f930 con 0x7f735809f080 2024-08-18T21:03:44.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735e818640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735e818640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f73580a7a30 con 0x7f73580a6bd0 2024-08-18T21:03:44.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735e818640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:44.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735e818640 10 monclient(hunting): authenticate will time out at 991.156451s 2024-08-18T21:03:44.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f735809f080 0x7f73580a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f735809f080 0x7f73580a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34104/0 (socket says 172.21.15.5:34104) 2024-08-18T21:03:44.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 1 -- 172.21.15.5:0/2158309073 learned_addr learned my addr 172.21.15.5:0/2158309073 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:44.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 10 monclient(hunting): get_auth_request con 0x7f735809f080 auth_method 0 2024-08-18T21:03:44.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735cdb5640 1 --2- 172.21.15.5:0/2158309073 >> v2:172.21.15.5:3300/0 conn(0x7f7358139990 0x7f7358139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735cdb5640 10 monclient(hunting): get_auth_request con 0x7f7358139990 auth_method 0 2024-08-18T21:03:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735cdb5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735cdb5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735cdb5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735cdb5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735cdb5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f735cdb5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 10 monclient(hunting): handle_auth_done global_id 4331 payload 274 2024-08-18T21:03:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 1 -- 172.21.15.5:0/2158309073 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f73580a6bd0 msgr2=0x7f73580a6fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T21:03:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 1 --2- 172.21.15.5:0/2158309073 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f73580a6bd0 0x7f73580a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 1 -- 172.21.15.5:0/2158309073 >> v2:172.21.15.5:3300/0 conn(0x7f7358139990 msgr2=0x7f7358139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 1 --2- 172.21.15.5:0/2158309073 >> v2:172.21.15.5:3300/0 conn(0x7f7358139990 0x7f7358139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 1 monclient: found mon.noname-b 2024-08-18T21:03:44.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:44.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:44.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.141+0000 7f73577fe640 1 -- 172.21.15.5:0/2158309073 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73580a7fb0 con 0x7f735809f080 2024-08-18T21:03:44.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f73577fe640 1 -- 172.21.15.5:0/2158309073 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f735809f080 msgr2=0x7f73580a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:44.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f73577fe640 1 --2- 172.21.15.5:0/2158309073 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f735809f080 0x7f73580a74f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f734c0098a0 tx=0x7f734c01c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef909cb5c001f4d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f7356ffd640 1 -- 172.21.15.5:0/2158309073 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f734c0b0070 con 0x7f735809f080 2024-08-18T21:03:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f7356ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f7356ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f7356ffd640 10 monclient: dump: 2024-08-18T21:03:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.151 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f7356ffd640 10 monclient: _finish_auth 0 2024-08-18T21:03:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f7356ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:03:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f7356ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f7356ffd640 1 -- 172.21.15.5:0/2158309073 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f734c0aa810 con 0x7f735809f080 2024-08-18T21:03:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f7356ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f7356ffd640 1 -- 172.21.15.5:0/2158309073 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f734c0aae30 con 0x7f735809f080 2024-08-18T21:03:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f7356ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f7356ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f7356ffd640 10 monclient: dump: 2024-08-18T21:03:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.153 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.153 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.153 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.153 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.153 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f735e818640 5 monclient: authenticate success, global_id 4331 2024-08-18T21:03:44.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f735e818640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:44.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.145+0000 7f735e818640 4 set_mon_vals no callback set 2024-08-18T21:03:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 10 monclient: shutdown 2024-08-18T21:03:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 -- 172.21.15.5:0/2158309073 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f735809f080 msgr2=0x7f73580a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 --2- 172.21.15.5:0/2158309073 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f735809f080 0x7f73580a74f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f734c0098a0 tx=0x7f734c01c420 comp rx=0 tx=0).stop 2024-08-18T21:03:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 -- 172.21.15.5:0/2158309073 shutdown_connections 2024-08-18T21:03:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 --2- 172.21.15.5:0/2158309073 >> v2:172.21.15.5:3300/0 conn(0x7f7358139990 0x7f7358139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 --2- 172.21.15.5:0/2158309073 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f735809f080 0x7f73580a74f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 --2- 172.21.15.5:0/2158309073 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f73580a6bd0 0x7f73580a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 -- 172.21.15.5:0/2158309073 >> 172.21.15.5:0/2158309073 conn(0x7f7358068700 msgr2=0x7f7358068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 -- 172.21.15.5:0/2158309073 shutdown_connections 2024-08-18T21:03:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 -- 172.21.15.5:0/2158309073 wait complete. 2024-08-18T21:03:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 10 monclient: build_initial_monmap 2024-08-18T21:03:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 10 monclient: monmap: 2024-08-18T21:03:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:44.157 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:44.157 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.157 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:44.157 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:44.157 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:44.157 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:44.157 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:44.157 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:44.157 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:44.157 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:44.157 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:44.157 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 Processor -- start 2024-08-18T21:03:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 -- start start 2024-08-18T21:03:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 10 monclient: init 2024-08-18T21:03:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 10 monclient: _add_conns ranks=[4,7,0,5,2,8,1,3,6] 2024-08-18T21:03:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f735809f080 0x7f7358072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 10 monclient(hunting): picked mon.noname-c con 0x7f735809f080 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f73580a6bd0 0x7f7358072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 10 monclient(hunting): picked mon.noname-i con 0x7f73580a6bd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7358139990 0x7f7358072ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 10 monclient(hunting): picked mon.noname-a con 0x7f7358139990 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f73580a89f0 con 0x7f7358139990 2024-08-18T21:03:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f73580a7ce0 con 0x7f735809f080 2024-08-18T21:03:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7358143610 con 0x7f73580a6bd0 2024-08-18T21:03:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735e818640 10 monclient(hunting): authenticate will time out at 991.166848s 2024-08-18T21:03:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7358139990 0x7f7358072ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7358139990 0x7f7358072ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46644/0 (socket says 172.21.15.5:46644) 2024-08-18T21:03:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 1 -- 172.21.15.5:0/4127794244 learned_addr learned my addr 172.21.15.5:0/4127794244 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 10 monclient(hunting): get_auth_request con 0x7f7358139990 auth_method 0 2024-08-18T21:03:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f7357fff640 1 --2- 172.21.15.5:0/4127794244 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f735809f080 0x7f7358072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f7357fff640 10 monclient(hunting): get_auth_request con 0x7f735809f080 auth_method 0 2024-08-18T21:03:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f7357fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f7357fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f7357fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f7357fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f7357fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f7357fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 10 monclient(hunting): handle_auth_done global_id 4329 payload 824 2024-08-18T21:03:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 1 -- 172.21.15.5:0/4127794244 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f73580a6bd0 msgr2=0x7f7358072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 1 --2- 172.21.15.5:0/4127794244 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f73580a6bd0 0x7f7358072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 1 -- 172.21.15.5:0/4127794244 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f735809f080 msgr2=0x7f7358072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 1 --2- 172.21.15.5:0/4127794244 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f735809f080 0x7f7358072050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 10 monclient: _finish_hunting 0 2024-08-18T21:03:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 1 monclient: found mon.noname-a 2024-08-18T21:03:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.149+0000 7f735cdb5640 1 -- 172.21.15.5:0/4127794244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73580ab580 con 0x7f7358139990 2024-08-18T21:03:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.153+0000 7f735cdb5640 1 -- 172.21.15.5:0/4127794244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7358139990 msgr2=0x7f7358072ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.153+0000 7f735cdb5640 1 --2- 172.21.15.5:0/4127794244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7358139990 0x7f7358072ad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f735000efc0 tx=0x7f735000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.153+0000 7f7354ff9640 1 -- 172.21.15.5:0/4127794244 DispatchQueue::entry inject delay of 0.002000 2024-08-18T21:03:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7354ff9640 1 -- 172.21.15.5:0/4127794244 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7350018020 con 0x7f7358139990 2024-08-18T21:03:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7354ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7354ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7354ff9640 10 monclient: dump: 2024-08-18T21:03:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.164 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7354ff9640 10 monclient: _finish_auth 0 2024-08-18T21:03:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7354ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:03:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7354ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7354ff9640 1 -- 172.21.15.5:0/4127794244 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73500148f0 con 0x7f7358139990 2024-08-18T21:03:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f735e818640 5 monclient: authenticate success, global_id 4329 2024-08-18T21:03:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f735e818640 10 monclient: _renew_subs 2024-08-18T21:03:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f735e818640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f735e818640 1 -- 172.21.15.5:0/4127794244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73580ab050 con 0x7f7358139990 2024-08-18T21:03:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7354ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7354ff9640 1 -- 172.21.15.5:0/4127794244 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f73500133e0 con 0x7f7358139990 2024-08-18T21:03:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7354ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7354ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7354ff9640 10 monclient: dump: 2024-08-18T21:03:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:44.166 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f735e818640 10 monclient: _renew_subs 2024-08-18T21:03:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f735e818640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f735e818640 1 -- 172.21.15.5:0/4127794244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f735813fdc0 con 0x7f7358139990 2024-08-18T21:03:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f73567fc640 4 set_mon_vals no callback set 2024-08-18T21:03:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7354ff9640 1 -- 172.21.15.5:0/4127794244 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f735001b020 con 0x7f7358139990 2024-08-18T21:03:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f735e818640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7354ff9640 1 --2- 172.21.15.5:0/4127794244 >> v2:172.21.15.157:6812/631023601 conn(0x7f734403bdc0 0x7f734403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7354ff9640 1 -- 172.21.15.5:0/4127794244 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f735004ee60 con 0x7f7358139990 2024-08-18T21:03:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f735e818640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f735e818640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f735e818640 1 -- 172.21.15.5:0/4127794244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7358139e10 con 0x7f7358139990 2024-08-18T21:03:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.157+0000 7f7357fff640 1 --2- 172.21.15.5:0/4127794244 >> v2:172.21.15.157:6812/631023601 conn(0x7f734403bdc0 0x7f734403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.161+0000 7f7357fff640 10 monclient: get_auth_request con 0x7f734403bdc0 auth_method 0 2024-08-18T21:03:44.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.161+0000 7f7354ff9640 1 -- 172.21.15.5:0/4127794244 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f7350022070 con 0x7f7358139990 2024-08-18T21:03:44.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.161+0000 7f7354ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:44.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.161+0000 7f7354ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:44.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.161+0000 7f7357fff640 1 --2- 172.21.15.5:0/4127794244 >> v2:172.21.15.157:6812/631023601 conn(0x7f734403bdc0 0x7f734403e280 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7348009980 tx=0x7f73480090e0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:44.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.265+0000 7f64871c0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-08-18T21:03:44.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.265+0000 7f64871c0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-08-18T21:03:44.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.265+0000 7f64871c0640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:03:44.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.265+0000 7f64871c0640 1 -- 172.21.15.5:0/2054602224 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6460005380 con 0x7f648009bca0 2024-08-18T21:03:44.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.265+0000 7f64757fa640 1 -- 172.21.15.5:0/2054602224 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f647801a940 con 0x7f648009bca0 2024-08-18T21:03:44.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.265+0000 7f64757fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-08-18T21:03:44.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.265+0000 7f64757fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:44.270 INFO:teuthology.orchestra.run.smithi005.stdout:47244640259 2024-08-18T21:03:44.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.269+0000 7f64871c0640 1 -- 172.21.15.5:0/2054602224 >> v2:172.21.15.157:6812/631023601 conn(0x7f646c03bdf0 msgr2=0x7f646c03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.269+0000 7f64871c0640 1 --2- 172.21.15.5:0/2054602224 >> v2:172.21.15.157:6812/631023601 conn(0x7f646c03bdf0 0x7f646c03e2b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f647c007ca0 tx=0x7f647c007bf0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.269+0000 7f64871c0640 10 monclient: shutdown 2024-08-18T21:03:44.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.269+0000 7f64871c0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:44.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.269+0000 7f64871c0640 1 -- 172.21.15.5:0/2054602224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f648009bca0 msgr2=0x7f6480071ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.269+0000 7f64871c0640 1 --2- 172.21.15.5:0/2054602224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f648009bca0 0x7f6480071ad0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f64780214d0 tx=0x7f647801d9d0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.269+0000 7f64871c0640 1 -- 172.21.15.5:0/2054602224 shutdown_connections 2024-08-18T21:03:44.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.269+0000 7f64871c0640 1 --2- 172.21.15.5:0/2054602224 >> v2:172.21.15.157:6812/631023601 conn(0x7f646c03bdf0 0x7f646c03e2b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.269+0000 7f64871c0640 1 --2- 172.21.15.5:0/2054602224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f648009bca0 0x7f6480071ad0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.269+0000 7f64871c0640 1 --2- 172.21.15.5:0/2054602224 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f648009b8c0 0x7f6480071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.269+0000 7f64871c0640 1 --2- 172.21.15.5:0/2054602224 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6480069350 0x7f6480071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.269+0000 7f64871c0640 1 -- 172.21.15.5:0/2054602224 >> 172.21.15.5:0/2054602224 conn(0x7f64800a8480 msgr2=0x7f64800a5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:44.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.269+0000 7f64871c0640 1 -- 172.21.15.5:0/2054602224 shutdown_connections 2024-08-18T21:03:44.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.269+0000 7f64871c0640 1 -- 172.21.15.5:0/2054602224 wait complete. 2024-08-18T21:03:44.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.1 2024-08-18T21:03:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.329+0000 7fe74ff4d640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-08-18T21:03:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.329+0000 7fe74ff4d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-08-18T21:03:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.329+0000 7fe74ff4d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.329+0000 7fe74ff4d640 1 -- 172.21.15.5:0/314659730 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe7480a8d30 con 0x7fe74809df40 2024-08-18T21:03:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.329+0000 7fe73e7fc640 1 -- 172.21.15.5:0/314659730 <== mon.4 v2:172.21.15.5:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe744013410 con 0x7fe74809df40 2024-08-18T21:03:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.329+0000 7fe73e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-08-18T21:03:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.329+0000 7fe73e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:44.333 INFO:teuthology.orchestra.run.smithi005.stdout:47244640259 2024-08-18T21:03:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.333+0000 7fe74ff4d640 1 -- 172.21.15.5:0/314659730 >> v2:172.21.15.157:6812/631023601 conn(0x7fe72c03bdc0 msgr2=0x7fe72c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.333+0000 7fe74ff4d640 1 --2- 172.21.15.5:0/314659730 >> v2:172.21.15.157:6812/631023601 conn(0x7fe72c03bdc0 0x7fe72c03e280 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe7380ab000 tx=0x7fe7380a6000 comp rx=0 tx=0).stop 2024-08-18T21:03:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.333+0000 7fe74ff4d640 10 monclient: shutdown 2024-08-18T21:03:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.333+0000 7fe74ff4d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.333+0000 7fe74ff4d640 1 -- 172.21.15.5:0/314659730 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe74809df40 msgr2=0x7fe7481cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.333+0000 7fe74ff4d640 1 --2- 172.21.15.5:0/314659730 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe74809df40 0x7fe7481cd1d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe74400e840 tx=0x7fe74400ed00 comp rx=0 tx=0).stop 2024-08-18T21:03:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.333+0000 7fe74ff4d640 1 -- 172.21.15.5:0/314659730 shutdown_connections 2024-08-18T21:03:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.333+0000 7fe74ff4d640 1 --2- 172.21.15.5:0/314659730 >> v2:172.21.15.157:6812/631023601 conn(0x7fe72c03bdc0 0x7fe72c03e280 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.333+0000 7fe74ff4d640 1 --2- 172.21.15.5:0/314659730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe748136780 0x7fe748139a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.333+0000 7fe74ff4d640 1 --2- 172.21.15.5:0/314659730 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe7480a4960 0x7fe748135970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.333+0000 7fe74ff4d640 1 --2- 172.21.15.5:0/314659730 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe74809df40 0x7fe7481cd1d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.333+0000 7fe74ff4d640 1 -- 172.21.15.5:0/314659730 >> 172.21.15.5:0/314659730 conn(0x7fe7480a6440 msgr2=0x7fe74813ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.333+0000 7fe74ff4d640 1 -- 172.21.15.5:0/314659730 shutdown_connections 2024-08-18T21:03:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.333+0000 7fe74ff4d640 1 -- 172.21.15.5:0/314659730 wait complete. 2024-08-18T21:03:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.341+0000 7f735e818640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-08-18T21:03:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.341+0000 7f735e818640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-08-18T21:03:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.341+0000 7f735e818640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.341+0000 7f735e818640 1 -- 172.21.15.5:0/4127794244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f735813b560 con 0x7f7358139990 2024-08-18T21:03:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.341+0000 7f7354ff9640 1 -- 172.21.15.5:0/4127794244 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7350010040 con 0x7f7358139990 2024-08-18T21:03:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.341+0000 7f7354ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-08-18T21:03:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.341+0000 7f7354ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:44.345 INFO:teuthology.orchestra.run.smithi005.stdout:47244640259 2024-08-18T21:03:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.341+0000 7f735e818640 1 -- 172.21.15.5:0/4127794244 >> v2:172.21.15.157:6812/631023601 conn(0x7f734403bdc0 msgr2=0x7f734403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.341+0000 7f735e818640 1 --2- 172.21.15.5:0/4127794244 >> v2:172.21.15.157:6812/631023601 conn(0x7f734403bdc0 0x7f734403e280 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7348009980 tx=0x7f73480090e0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.341+0000 7f735e818640 10 monclient: shutdown 2024-08-18T21:03:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.341+0000 7f735e818640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.341+0000 7f735e818640 1 -- 172.21.15.5:0/4127794244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7358139990 msgr2=0x7f7358072ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.341+0000 7f735e818640 1 --2- 172.21.15.5:0/4127794244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7358139990 0x7f7358072ad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f735000efc0 tx=0x7f735000c490 comp rx=0 tx=0).stop 2024-08-18T21:03:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.345+0000 7f735e818640 1 -- 172.21.15.5:0/4127794244 shutdown_connections 2024-08-18T21:03:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.345+0000 7f735e818640 1 --2- 172.21.15.5:0/4127794244 >> v2:172.21.15.157:6812/631023601 conn(0x7f734403bdc0 0x7f734403e280 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.345+0000 7f735e818640 1 --2- 172.21.15.5:0/4127794244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7358139990 0x7f7358072ad0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.345+0000 7f735e818640 1 --2- 172.21.15.5:0/4127794244 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f73580a6bd0 0x7f7358072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.345+0000 7f735e818640 1 --2- 172.21.15.5:0/4127794244 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f735809f080 0x7f7358072050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.345+0000 7f735e818640 1 -- 172.21.15.5:0/4127794244 >> 172.21.15.5:0/4127794244 conn(0x7f7358068700 msgr2=0x7f73580a20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.345+0000 7f735e818640 1 -- 172.21.15.5:0/4127794244 shutdown_connections 2024-08-18T21:03:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.345+0000 7f735e818640 1 -- 172.21.15.5:0/4127794244 wait complete. 2024-08-18T21:03:44.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.3 2024-08-18T21:03:44.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.5 2024-08-18T21:03:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-08-18T21:03:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-08-18T21:03:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 1 -- 172.21.15.5:0/1014277848 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f47c4005380 con 0x7f47dc008950 2024-08-18T21:03:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e17fa640 1 -- 172.21.15.5:0/1014277848 <== mon.4 v2:172.21.15.5:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f47d0012400 con 0x7f47dc008950 2024-08-18T21:03:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-08-18T21:03:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e17fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:44.371 INFO:teuthology.orchestra.run.smithi005.stdout:47244640260 2024-08-18T21:03:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 1 -- 172.21.15.5:0/1014277848 >> v2:172.21.15.157:6812/631023601 conn(0x7f47c8044500 msgr2=0x7f47c80469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 1 --2- 172.21.15.5:0/1014277848 >> v2:172.21.15.157:6812/631023601 conn(0x7f47c8044500 0x7f47c80469c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f47d80ab000 tx=0x7f47d80a6000 comp rx=0 tx=0).stop 2024-08-18T21:03:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 10 monclient: shutdown 2024-08-18T21:03:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 1 -- 172.21.15.5:0/1014277848 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47dc008950 msgr2=0x7f47dc0c14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 1 --2- 172.21.15.5:0/1014277848 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47dc008950 0x7f47dc0c14c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f47d000c480 tx=0x7f47d000c940 comp rx=0 tx=0).stop 2024-08-18T21:03:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 1 -- 172.21.15.5:0/1014277848 shutdown_connections 2024-08-18T21:03:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 1 --2- 172.21.15.5:0/1014277848 >> v2:172.21.15.157:6812/631023601 conn(0x7f47c8044500 0x7f47c80469c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 1 --2- 172.21.15.5:0/1014277848 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47dc0b9710 0x7f47dc0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 1 --2- 172.21.15.5:0/1014277848 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47dc008950 0x7f47dc0c14c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 1 --2- 172.21.15.5:0/1014277848 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47dc007e60 0x7f47dc0c0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 1 -- 172.21.15.5:0/1014277848 >> 172.21.15.5:0/1014277848 conn(0x7f47dc0289b0 msgr2=0x7f47dc02a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 1 -- 172.21.15.5:0/1014277848 shutdown_connections 2024-08-18T21:03:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.369+0000 7f47e9a36640 1 -- 172.21.15.5:0/1014277848 wait complete. 2024-08-18T21:03:44.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.2 2024-08-18T21:03:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.389+0000 7f291210f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-08-18T21:03:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.389+0000 7f291210f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-08-18T21:03:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.389+0000 7f291210f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.389+0000 7f291210f640 1 -- 172.21.15.5:0/4096956754 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f290c0746d0 con 0x7f290c09f080 2024-08-18T21:03:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.389+0000 7f28f3fff640 1 -- 172.21.15.5:0/4096956754 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f28fc013810 con 0x7f290c09f080 2024-08-18T21:03:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.389+0000 7f28f3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-08-18T21:03:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.389+0000 7f28f3fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:44.393 INFO:teuthology.orchestra.run.smithi005.stdout:51539607556 2024-08-18T21:03:44.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-08-18T21:03:44.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-08-18T21:03:44.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:44.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7f291210f640 1 -- 172.21.15.5:0/4096956754 >> v2:172.21.15.157:6812/631023601 conn(0x7f28f803bdf0 msgr2=0x7f28f803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 1 -- 172.21.15.5:0/4061484877 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7faf501c9220 con 0x7faf500a6bd0 2024-08-18T21:03:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7f291210f640 1 --2- 172.21.15.5:0/4096956754 >> v2:172.21.15.157:6812/631023601 conn(0x7f28f803bdf0 0x7f28f803e2b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f29000ab000 tx=0x7f29000a6000 comp rx=0 tx=0).stop 2024-08-18T21:03:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7f291210f640 10 monclient: shutdown 2024-08-18T21:03:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7f291210f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7f291210f640 1 -- 172.21.15.5:0/4096956754 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f290c09f080 msgr2=0x7f290c138860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7f291210f640 1 --2- 172.21.15.5:0/4096956754 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f290c09f080 0x7f290c138860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00e890 tx=0x7f28fc00ed50 comp rx=0 tx=0).stop 2024-08-18T21:03:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7f291210f640 1 -- 172.21.15.5:0/4096956754 shutdown_connections 2024-08-18T21:03:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7f291210f640 1 --2- 172.21.15.5:0/4096956754 >> v2:172.21.15.157:6812/631023601 conn(0x7f28f803bdf0 0x7f28f803e2b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7f291210f640 1 --2- 172.21.15.5:0/4096956754 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f290c139990 0x7f290c13da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7f291210f640 1 --2- 172.21.15.5:0/4096956754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f290c0a6bd0 0x7f290c138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7f291210f640 1 --2- 172.21.15.5:0/4096956754 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f290c09f080 0x7f290c138860 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7f291210f640 1 -- 172.21.15.5:0/4096956754 >> 172.21.15.5:0/4096956754 conn(0x7f290c068700 msgr2=0x7f290c0a9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf467fc640 1 -- 172.21.15.5:0/4061484877 <== mon.4 v2:172.21.15.5:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faf4c003dd0 con 0x7faf500a6bd0 2024-08-18T21:03:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf467fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-08-18T21:03:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf467fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:44.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7f291210f640 1 -- 172.21.15.5:0/4096956754 shutdown_connections 2024-08-18T21:03:44.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7f291210f640 1 -- 172.21.15.5:0/4096956754 wait complete. 2024-08-18T21:03:44.397 INFO:teuthology.orchestra.run.smithi005.stdout:47244640259 2024-08-18T21:03:44.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 1 -- 172.21.15.5:0/4061484877 >> v2:172.21.15.157:6812/631023601 conn(0x7faf3403bdc0 msgr2=0x7faf3403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 1 --2- 172.21.15.5:0/4061484877 >> v2:172.21.15.157:6812/631023601 conn(0x7faf3403bdc0 0x7faf3403e280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faf40007fd0 tx=0x7faf40007e40 comp rx=0 tx=0).stop 2024-08-18T21:03:44.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 10 monclient: shutdown 2024-08-18T21:03:44.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:44.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 1 -- 172.21.15.5:0/4061484877 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7faf500a6bd0 msgr2=0x7faf5013fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:44.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 1 --2- 172.21.15.5:0/4061484877 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7faf500a6bd0 0x7faf5013fcd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0097c0 tx=0x7faf4c019270 comp rx=0 tx=0).stop 2024-08-18T21:03:44.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 1 -- 172.21.15.5:0/4061484877 shutdown_connections 2024-08-18T21:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 1 --2- 172.21.15.5:0/4061484877 >> v2:172.21.15.157:6812/631023601 conn(0x7faf3403bdc0 0x7faf3403e280 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 1 --2- 172.21.15.5:0/4061484877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf500a76c0 0x7faf501269c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 1 --2- 172.21.15.5:0/4061484877 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7faf500a6bd0 0x7faf5013fcd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 1 --2- 172.21.15.5:0/4061484877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf5009f080 0x7faf50128e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 1 -- 172.21.15.5:0/4061484877 >> 172.21.15.5:0/4061484877 conn(0x7faf50068700 msgr2=0x7faf500aa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 1 -- 172.21.15.5:0/4061484877 shutdown_connections 2024-08-18T21:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:44.393+0000 7faf58207640 1 -- 172.21.15.5:0/4061484877 wait complete. 2024-08-18T21:03:44.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607556 for osd.0 2024-08-18T21:03:44.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.4 2024-08-18T21:03:45.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-18T21:03:45.361 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-18T21:03:45.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-18T21:03:45.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-18T21:03:45.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-18T21:03:45.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-18T21:03:45.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 10 monclient: get_monmap_and_config 2024-08-18T21:03:45.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 10 monclient: build_initial_monmap 2024-08-18T21:03:45.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 10 monclient: monmap: 2024-08-18T21:03:45.424 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:45.424 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.424 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:45.425466+0000 2024-08-18T21:03:45.424 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:45.425466+0000 2024-08-18T21:03:45.424 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:45.424 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:45.425 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 1 Processor -- start 2024-08-18T21:03:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 1 -- start start 2024-08-18T21:03:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 10 monclient: init 2024-08-18T21:03:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 10 monclient: _add_conns ranks=[9,0,10,5,6,3,7,1,8,2,4] 2024-08-18T21:03:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ae0134460 0x7f7ae0134840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 10 monclient(hunting): picked mon.noname-a con 0x7f7ae0134460 addr v2:172.21.15.5:3300/0 2024-08-18T21:03:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7ae0133fa0 addr v1:172.21.15.5:6789/0 2024-08-18T21:03:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7ae0070440 0x7f7ae013f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 10 monclient(hunting): picked mon.noname-f con 0x7f7ae0070440 addr v2:172.21.15.157:3300/0 2024-08-18T21:03:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae009e320 con 0x7f7ae0133fa0 2024-08-18T21:03:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7ae009e600 con 0x7f7ae0134460 2024-08-18T21:03:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7ae009e8e0 con 0x7f7ae0070440 2024-08-18T21:03:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7ae5c0c640 10 monclient(hunting): authenticate will time out at 992.438357s 2024-08-18T21:03:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ae0134460 0x7f7ae0134840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ae0134460 0x7f7ae0134840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46664/0 (socket says 172.21.15.5:46664) 2024-08-18T21:03:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adf7fe640 1 -- 172.21.15.5:0/2829935221 learned_addr learned my addr 172.21.15.5:0/2829935221 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adf7fe640 10 monclient(hunting): get_auth_request con 0x7f7ae0134460 auth_method 0 2024-08-18T21:03:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 1 --2- 172.21.15.5:0/2829935221 >> v2:172.21.15.157:3300/0 conn(0x7f7ae0070440 0x7f7ae013f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 10 monclient(hunting): get_auth_request con 0x7f7ae0070440 auth_method 0 2024-08-18T21:03:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 10 monclient(hunting): handle_auth_done global_id 4267 payload 274 2024-08-18T21:03:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 1 -- 172.21.15.5:0/2829935221 >> v2:172.21.15.5:3300/0 conn(0x7f7ae0134460 msgr2=0x7f7ae0134840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 1 --2- 172.21.15.5:0/2829935221 >> v2:172.21.15.5:3300/0 conn(0x7f7ae0134460 0x7f7ae0134840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 1 -- 172.21.15.5:0/2829935221 >> v1:172.21.15.5:6789/0 conn(0x7f7ae0133fa0 legacy=0x7f7ae006fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 10 monclient: _finish_hunting 0 2024-08-18T21:03:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 1 monclient: found mon.noname-f 2024-08-18T21:03:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:03:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.421+0000 7f7adffff640 1 -- 172.21.15.5:0/2829935221 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae009ebc0 con 0x7f7ae0070440 2024-08-18T21:03:45.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7adffff640 1 -- 172.21.15.5:0/2829935221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ae0070440 msgr2=0x7f7ae013f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:45.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7adffff640 1 --2- 172.21.15.5:0/2829935221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ae0070440 0x7f7ae013f820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0070da0 tx=0x7f7ad8020c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=876b770fa2ffaf6e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ade7fc640 1 -- 172.21.15.5:0/2829935221 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7ad80b6070 con 0x7f7ae0070440 2024-08-18T21:03:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ade7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ade7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:03:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ade7fc640 10 monclient: dump: 2024-08-18T21:03:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.433 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ade7fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ade7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ade7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ade7fc640 1 -- 172.21.15.5:0/2829935221 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad80a9e20 con 0x7f7ae0070440 2024-08-18T21:03:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ade7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ade7fc640 1 -- 172.21.15.5:0/2829935221 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7ad80af7b0 con 0x7f7ae0070440 2024-08-18T21:03:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ade7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ade7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:03:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ade7fc640 10 monclient: dump: 2024-08-18T21:03:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.435 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.435 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.435 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ae5c0c640 5 monclient: authenticate success, global_id 4267 2024-08-18T21:03:45.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ae5c0c640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:45.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ae5c0c640 4 set_mon_vals no callback set 2024-08-18T21:03:45.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ae5c0c640 10 monclient: shutdown 2024-08-18T21:03:45.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ae5c0c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:45.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/2829935221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ae0070440 msgr2=0x7f7ae013f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ae5c0c640 1 --2- 172.21.15.5:0/2829935221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ae0070440 0x7f7ae013f820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0070da0 tx=0x7f7ad8020c00 comp rx=0 tx=0).stop 2024-08-18T21:03:45.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/2829935221 shutdown_connections 2024-08-18T21:03:45.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ae5c0c640 1 --2- 172.21.15.5:0/2829935221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ae0070440 0x7f7ae013f820 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ae5c0c640 1 --2- 172.21.15.5:0/2829935221 >> v2:172.21.15.5:3300/0 conn(0x7f7ae0134460 0x7f7ae0134840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/2829935221 >> 172.21.15.5:0/2829935221 conn(0x7f7ae00a8a90 msgr2=0x7f7ae00a8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:45.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/2829935221 shutdown_connections 2024-08-18T21:03:45.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/2829935221 wait complete. 2024-08-18T21:03:45.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ae5c0c640 10 monclient: build_initial_monmap 2024-08-18T21:03:45.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.429+0000 7f7ae5c0c640 10 monclient: monmap: 2024-08-18T21:03:45.439 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:45.439 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:45.439 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:45.439 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:45.439 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:45.439 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.439 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:45.439 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:45.439 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:45.439 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:45.439 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:45.439 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:45.440 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:45.440 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:45.440 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:45.440 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 1 Processor -- start 2024-08-18T21:03:45.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 1 -- start start 2024-08-18T21:03:45.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 10 monclient: init 2024-08-18T21:03:45.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:45.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 10 monclient: _add_conns ranks=[0,6,7,1,8,5,3,4,2] 2024-08-18T21:03:45.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0070440 0x7f7ae0131060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 10 monclient(hunting): picked mon.noname-a con 0x7f7ae0070440 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:45.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ae0133fa0 0x7f7ae01315a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 10 monclient(hunting): picked mon.noname-d con 0x7f7ae0133fa0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:45.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0070440 0x7f7ae0131060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0070440 0x7f7ae0131060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46676/0 (socket says 172.21.15.5:46676) 2024-08-18T21:03:45.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 1 -- 172.21.15.5:0/4077479471 learned_addr learned my addr 172.21.15.5:0/4077479471 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:45.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adeffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ae0133fa0 0x7f7ae01315a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 1 --2- 172.21.15.5:0/4077479471 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7ae0134460 0x7f7ae01380b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 10 monclient(hunting): picked mon.noname-i con 0x7f7ae0134460 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:45.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/4077479471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae0140570 con 0x7f7ae0070440 2024-08-18T21:03:45.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/4077479471 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f7ae009dd40 con 0x7f7ae0133fa0 2024-08-18T21:03:45.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/4077479471 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7ae01406f0 con 0x7f7ae0134460 2024-08-18T21:03:45.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:45.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7ae5c0c640 10 monclient(hunting): authenticate will time out at 992.449416s 2024-08-18T21:03:45.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 10 monclient(hunting): get_auth_request con 0x7f7ae0070440 auth_method 0 2024-08-18T21:03:45.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adeffd640 10 monclient(hunting): get_auth_request con 0x7f7ae0133fa0 auth_method 0 2024-08-18T21:03:45.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adeffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 10 monclient(hunting): handle_auth_done global_id 4347 payload 824 2024-08-18T21:03:45.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 1 -- 172.21.15.5:0/4077479471 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7ae0134460 msgr2=0x7f7ae01380b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 1 --2- 172.21.15.5:0/4077479471 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7ae0134460 0x7f7ae01380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 1 -- 172.21.15.5:0/4077479471 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ae0133fa0 msgr2=0x7f7ae01315a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 1 --2- 172.21.15.5:0/4077479471 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ae0133fa0 0x7f7ae01315a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:45.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 1 monclient: found mon.noname-a 2024-08-18T21:03:45.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:45.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:45.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adf7fe640 1 -- 172.21.15.5:0/4077479471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae00a7bd0 con 0x7f7ae0070440 2024-08-18T21:03:45.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.433+0000 7f7adeffd640 1 --2- 172.21.15.5:0/4077479471 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ae0133fa0 0x7f7ae01315a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7adf7fe640 1 -- 172.21.15.5:0/4077479471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0070440 msgr2=0x7f7ae0131060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7adf7fe640 1 --2- 172.21.15.5:0/4077479471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0070440 0x7f7ae0131060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000e820 tx=0x7f7ad000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ac7fff640 1 -- 172.21.15.5:0/4077479471 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7ad0017070 con 0x7f7ae0070440 2024-08-18T21:03:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ac7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ac7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ac7fff640 10 monclient: dump: 2024-08-18T21:03:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.446 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ac7fff640 10 monclient: _finish_auth 0 2024-08-18T21:03:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ac7fff640 10 monclient: _check_auth_tickets 2024-08-18T21:03:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ac7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ac7fff640 1 -- 172.21.15.5:0/4077479471 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad0013470 con 0x7f7ae0070440 2024-08-18T21:03:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ac7fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ac7fff640 1 -- 172.21.15.5:0/4077479471 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7ad0013a90 con 0x7f7ae0070440 2024-08-18T21:03:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ac7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ac7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ac7fff640 10 monclient: dump: 2024-08-18T21:03:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.448 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.448 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.448 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.448 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.448 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.448 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.448 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.448 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7addffb640 4 set_mon_vals no callback set 2024-08-18T21:03:45.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ae5c0c640 5 monclient: authenticate success, global_id 4347 2024-08-18T21:03:45.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ae5c0c640 10 monclient: _renew_subs 2024-08-18T21:03:45.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ae5c0c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:45.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/4077479471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae013f860 con 0x7f7ae0070440 2024-08-18T21:03:45.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ae5c0c640 10 monclient: _renew_subs 2024-08-18T21:03:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ae5c0c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/4077479471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae013bd60 con 0x7f7ae0070440 2024-08-18T21:03:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ae5c0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ae5c0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ae5c0c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/4077479471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae0134840 con 0x7f7ae0070440 2024-08-18T21:03:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ac7fff640 1 -- 172.21.15.5:0/4077479471 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f7ad001a070 con 0x7f7ae0070440 2024-08-18T21:03:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ac7fff640 1 --2- 172.21.15.5:0/4077479471 >> v2:172.21.15.157:6812/631023601 conn(0x7f7acc03bdf0 0x7f7acc03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.437+0000 7f7ac7fff640 1 -- 172.21.15.5:0/4077479471 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f7ad000f040 con 0x7f7ae0070440 2024-08-18T21:03:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.445+0000 7f7adeffd640 1 --2- 172.21.15.5:0/4077479471 >> v2:172.21.15.157:6812/631023601 conn(0x7f7acc03bdf0 0x7f7acc03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.445+0000 7f7adeffd640 10 monclient: get_auth_request con 0x7f7acc03bdf0 auth_method 0 2024-08-18T21:03:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.445+0000 7f7adeffd640 1 --2- 172.21.15.5:0/4077479471 >> v2:172.21.15.157:6812/631023601 conn(0x7f7acc03bdf0 0x7f7acc03e2b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ae013aae0 tx=0x7f7ad4007e40 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.445+0000 7f7ac7fff640 1 -- 172.21.15.5:0/4077479471 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f7ad0021070 con 0x7f7ae0070440 2024-08-18T21:03:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.445+0000 7f7ac7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.445+0000 7f7ac7fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:45.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.497+0000 7f13b4927640 10 monclient: get_monmap_and_config 2024-08-18T21:03:45.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.497+0000 7f13b4927640 10 monclient: build_initial_monmap 2024-08-18T21:03:45.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.497+0000 7f13b4927640 10 monclient: monmap: 2024-08-18T21:03:45.501 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:45.501 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.501 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:45.502510+0000 2024-08-18T21:03:45.501 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:45.502510+0000 2024-08-18T21:03:45.501 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:45.501 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.501 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:45.501 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:45.501 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:45.501 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:45.501 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:45.501 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:45.501 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:45.502 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:45.502 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:45.502 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:45.502 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:45.502 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.497+0000 7f13b4927640 1 Processor -- start 2024-08-18T21:03:45.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.497+0000 7f13b4927640 1 -- start start 2024-08-18T21:03:45.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.497+0000 7f13b4927640 10 monclient: init 2024-08-18T21:03:45.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.497+0000 7f13b4927640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:45.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.497+0000 7f13b4927640 10 monclient: _add_conns ranks=[7,6,9,5,3,2,10,0,4,1,8] 2024-08-18T21:03:45.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.497+0000 7f13b4927640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13b009da30 0x7f13b009de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.497+0000 7f13b4927640 10 monclient(hunting): picked mon.noname-i con 0x7f13b009da30 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:45.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.497+0000 7f13b4927640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f13b00a03e0 0x7f13b009e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.497+0000 7f13b4927640 10 monclient(hunting): picked mon.noname-d con 0x7f13b00a03e0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:45.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.497+0000 7f13b4927640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13b00a3110 0x7f13b01366a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13b4927640 10 monclient(hunting): picked mon.noname-a con 0x7f13b00a3110 addr v2:172.21.15.5:3300/0 2024-08-18T21:03:45.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f13b00a03e0 0x7f13b009e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f13b00a03e0 0x7f13b009e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:57074/0 (socket says 172.21.15.5:57074) 2024-08-18T21:03:45.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 1 -- 172.21.15.5:0/208413461 learned_addr learned my addr 172.21.15.5:0/208413461 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:45.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13aed9d640 1 --2- 172.21.15.5:0/208413461 >> v2:172.21.15.5:3300/0 conn(0x7f13b00a3110 0x7f13b01366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13b4927640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13b4927640 1 -- 172.21.15.5:0/208413461 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f13b009e890 con 0x7f13b00a3110 2024-08-18T21:03:45.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13b4927640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13ae59c640 1 --2- 172.21.15.5:0/208413461 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13b009da30 0x7f13b009de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13b4927640 1 -- 172.21.15.5:0/208413461 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f13b009f7c0 con 0x7f13b00a03e0 2024-08-18T21:03:45.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13b4927640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13b4927640 1 -- 172.21.15.5:0/208413461 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f13b009f4e0 con 0x7f13b009da30 2024-08-18T21:03:45.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13b4927640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:45.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13b4927640 10 monclient(hunting): authenticate will time out at 992.516910s 2024-08-18T21:03:45.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 10 monclient(hunting): get_auth_request con 0x7f13b00a03e0 auth_method 0 2024-08-18T21:03:45.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13aed9d640 10 monclient(hunting): get_auth_request con 0x7f13b00a3110 auth_method 0 2024-08-18T21:03:45.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13aed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13aed9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13aed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13ae59c640 10 monclient(hunting): get_auth_request con 0x7f13b009da30 auth_method 0 2024-08-18T21:03:45.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13ae59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13ae59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13ae59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13aed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13aed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13aed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 10 monclient(hunting): handle_auth_done global_id 4308 payload 274 2024-08-18T21:03:45.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 1 -- 172.21.15.5:0/208413461 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13b009da30 msgr2=0x7f13b009de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:45.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 1 --2- 172.21.15.5:0/208413461 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13b009da30 0x7f13b009de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 1 -- 172.21.15.5:0/208413461 >> v2:172.21.15.5:3300/0 conn(0x7f13b00a3110 msgr2=0x7f13b01366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:45.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 1 --2- 172.21.15.5:0/208413461 >> v2:172.21.15.5:3300/0 conn(0x7f13b00a3110 0x7f13b01366a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 10 monclient: _finish_hunting 0 2024-08-18T21:03:45.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 1 monclient: found mon.noname-d 2024-08-18T21:03:45.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:45.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:45.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13add9b640 1 -- 172.21.15.5:0/208413461 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b009faa0 con 0x7f13b00a03e0 2024-08-18T21:03:45.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.501+0000 7f13aed9d640 1 --2- 172.21.15.5:0/208413461 >> v2:172.21.15.5:3300/0 conn(0x7f13b00a3110 0x7f13b01366a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:45.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 10 monclient: get_monmap_and_config 2024-08-18T21:03:45.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 10 monclient: build_initial_monmap 2024-08-18T21:03:45.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 10 monclient: monmap: 2024-08-18T21:03:45.510 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:45.510 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.510 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:45.509137+0000 2024-08-18T21:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:45.509137+0000 2024-08-18T21:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:45.512 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 1 Processor -- start 2024-08-18T21:03:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 1 -- start start 2024-08-18T21:03:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 10 monclient: init 2024-08-18T21:03:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 10 monclient: _add_conns ranks=[4,6,0,2,7,1,3,9,5,10,8] 2024-08-18T21:03:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f433c139840 0x7f433c09efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 10 monclient(hunting): picked mon.noname-c con 0x7f433c139840 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f433c0a4cd0 0x7f433c139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 10 monclient(hunting): picked mon.noname-d con 0x7f433c0a4cd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f433c13a160 addr v1:172.21.15.5:6789/0 2024-08-18T21:03:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f433c09e1a0 con 0x7f433c13a160 2024-08-18T21:03:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433ad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f433c13a160 0x7f433c1366a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57658/0 (socket says 172.21.15.5:57658) 2024-08-18T21:03:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433ad9d640 1 -- 172.21.15.5:0/4078359044 learned_addr learned my addr 172.21.15.5:0/4078359044 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:03:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 1 --2- 172.21.15.5:0/4078359044 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f433c139840 0x7f433c09efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 1 -- 172.21.15.5:0/4078359044 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f433c09f6d0 con 0x7f433c139840 2024-08-18T21:03:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 1 -- 172.21.15.5:0/4078359044 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f433c0a50d0 con 0x7f433c0a4cd0 2024-08-18T21:03:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4340827640 10 monclient(hunting): authenticate will time out at 992.522332s 2024-08-18T21:03:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 10 monclient(hunting): get_auth_request con 0x7f433c139840 auth_method 0 2024-08-18T21:03:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4339d9b640 1 --2- 172.21.15.5:0/4078359044 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f433c0a4cd0 0x7f433c139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4339d9b640 10 monclient(hunting): get_auth_request con 0x7f433c0a4cd0 auth_method 0 2024-08-18T21:03:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4339d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4339d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4339d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 10 monclient(hunting): handle_auth_done global_id 4351 payload 274 2024-08-18T21:03:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 1 -- 172.21.15.5:0/4078359044 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f433c0a4cd0 msgr2=0x7f433c139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13add9b640 1 -- 172.21.15.5:0/208413461 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f13b00a03e0 msgr2=0x7f13b009e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13add9b640 1 --2- 172.21.15.5:0/208413461 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f13b00a03e0 0x7f13b009e350 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009870 tx=0x7f13a401cb90 comp rx=0 tx=0).ready entity=mon.6 client_cookie=24e2d52abca955d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 1 --2- 172.21.15.5:0/4078359044 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f433c0a4cd0 0x7f433c139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 1 -- 172.21.15.5:0/4078359044 >> v1:172.21.15.5:6789/0 conn(0x7f433c13a160 legacy=0x7f433c1366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:45.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13ad59a640 1 -- 172.21.15.5:0/208413461 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13a40b0070 con 0x7f13b00a03e0 2024-08-18T21:03:45.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13ad59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13ad59a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13ad59a640 10 monclient: dump: 2024-08-18T21:03:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.517 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 10 monclient: _finish_hunting 0 2024-08-18T21:03:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13ad59a640 10 monclient: _finish_auth 0 2024-08-18T21:03:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13ad59a640 10 monclient: _check_auth_tickets 2024-08-18T21:03:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13ad59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 1 monclient: found mon.noname-c 2024-08-18T21:03:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13ad59a640 1 -- 172.21.15.5:0/208413461 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13a40aa810 con 0x7f13b00a03e0 2024-08-18T21:03:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13b4927640 5 monclient: authenticate success, global_id 4308 2024-08-18T21:03:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13b4927640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13ad59a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13ad59a640 1 -- 172.21.15.5:0/208413461 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13a40aae30 con 0x7f13b00a03e0 2024-08-18T21:03:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13ad59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13ad59a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f433a59c640 1 -- 172.21.15.5:0/4078359044 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f433c069a00 con 0x7f433c139840 2024-08-18T21:03:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13ad59a640 10 monclient: dump: 2024-08-18T21:03:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.521 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13b4927640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f13b4927640 4 set_mon_vals no callback set 2024-08-18T21:03:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.505+0000 7f4339d9b640 1 --2- 172.21.15.5:0/4078359044 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f433c0a4cd0 0x7f433c139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:03:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.509+0000 7f13b4927640 10 monclient: shutdown 2024-08-18T21:03:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.509+0000 7f13b4927640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.509+0000 7f13b4927640 1 -- 172.21.15.5:0/208413461 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f13b00a03e0 msgr2=0x7f13b009e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.509+0000 7f13b4927640 1 --2- 172.21.15.5:0/208413461 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f13b00a03e0 0x7f13b009e350 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009870 tx=0x7f13a401cb90 comp rx=0 tx=0).stop 2024-08-18T21:03:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.509+0000 7f13b4927640 1 -- 172.21.15.5:0/208413461 shutdown_connections 2024-08-18T21:03:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.509+0000 7f13b4927640 1 --2- 172.21.15.5:0/208413461 >> v2:172.21.15.5:3300/0 conn(0x7f13b00a3110 0x7f13b01366a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.509+0000 7f13b4927640 1 --2- 172.21.15.5:0/208413461 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f13b00a03e0 0x7f13b009e350 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.509+0000 7f13b4927640 1 --2- 172.21.15.5:0/208413461 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13b009da30 0x7f13b009de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.509+0000 7f13b4927640 1 -- 172.21.15.5:0/208413461 >> 172.21.15.5:0/208413461 conn(0x7f13b00688d0 msgr2=0x7f13b0068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.509+0000 7f13b4927640 1 -- 172.21.15.5:0/208413461 shutdown_connections 2024-08-18T21:03:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.509+0000 7f13b4927640 1 -- 172.21.15.5:0/208413461 wait complete. 2024-08-18T21:03:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.509+0000 7f13b4927640 10 monclient: build_initial_monmap 2024-08-18T21:03:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.509+0000 7f13b4927640 10 monclient: monmap: 2024-08-18T21:03:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:45.526 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.509+0000 7f13b4927640 1 Processor -- start 2024-08-18T21:03:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.509+0000 7f13b4927640 1 -- start start 2024-08-18T21:03:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.509+0000 7f13b4927640 10 monclient: init 2024-08-18T21:03:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13b4927640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13b4927640 10 monclient: _add_conns ranks=[2,3,7,5,1,4,0,6,8] 2024-08-18T21:03:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13b4927640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f13b009da30 0x7f13b0073520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13b4927640 10 monclient(hunting): picked mon.noname-b con 0x7f13b009da30 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13b4927640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f13b00a3110 0x7f13b01cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13b4927640 10 monclient(hunting): picked mon.noname-g con 0x7f13b00a3110 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13b4927640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13b01cfde0 0x7f13b006c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13b4927640 10 monclient(hunting): picked mon.noname-i con 0x7f13b01cfde0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13b4927640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13b4927640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f13b013fc90 con 0x7f13b009da30 2024-08-18T21:03:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13b4927640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13b4927640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f13b013fb10 con 0x7f13b00a3110 2024-08-18T21:03:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13b4927640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13b4927640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f13b013fe10 con 0x7f13b01cfde0 2024-08-18T21:03:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13b4927640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13b4927640 10 monclient(hunting): authenticate will time out at 992.528190s 2024-08-18T21:03:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f13b009da30 0x7f13b0073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f13b009da30 0x7f13b0073520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34116/0 (socket says 172.21.15.5:34116) 2024-08-18T21:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 1 -- 172.21.15.5:0/1177334487 learned_addr learned my addr 172.21.15.5:0/1177334487 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 10 monclient(hunting): get_auth_request con 0x7f13b009da30 auth_method 0 2024-08-18T21:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13aed9d640 1 --2- 172.21.15.5:0/1177334487 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13b01cfde0 0x7f13b006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13aed9d640 10 monclient(hunting): get_auth_request con 0x7f13b01cfde0 auth_method 0 2024-08-18T21:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13add9b640 1 --2- 172.21.15.5:0/1177334487 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f13b00a3110 0x7f13b01cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13aed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13aed9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13aed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13add9b640 10 monclient(hunting): get_auth_request con 0x7f13b00a3110 auth_method 0 2024-08-18T21:03:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13add9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13add9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13add9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13aed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13aed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13aed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 10 monclient(hunting): handle_auth_done global_id 4340 payload 824 2024-08-18T21:03:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 1 -- 172.21.15.5:0/1177334487 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13b01cfde0 msgr2=0x7f13b006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 1 --2- 172.21.15.5:0/1177334487 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13b01cfde0 0x7f13b006c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 1 -- 172.21.15.5:0/1177334487 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f13b00a3110 msgr2=0x7f13b01cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 1 --2- 172.21.15.5:0/1177334487 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f13b00a3110 0x7f13b01cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 10 monclient: _finish_hunting 0 2024-08-18T21:03:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 1 monclient: found mon.noname-b 2024-08-18T21:03:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 1 -- 172.21.15.5:0/1177334487 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b013ba00 con 0x7f13b009da30 2024-08-18T21:03:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f433a59c640 1 -- 172.21.15.5:0/4078359044 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f433c139840 msgr2=0x7f433c09efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f433a59c640 1 --2- 172.21.15.5:0/4078359044 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f433c139840 0x7f433c09efd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f432c0097f0 tx=0x7f432c01c1c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=a880d9a6a4a1d7a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f433959a640 1 -- 172.21.15.5:0/4078359044 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f432c0b1070 con 0x7f433c139840 2024-08-18T21:03:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f433959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f433959a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f433959a640 10 monclient: dump: 2024-08-18T21:03:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.533 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f433959a640 10 monclient: _finish_auth 0 2024-08-18T21:03:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f433959a640 10 monclient: _check_auth_tickets 2024-08-18T21:03:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f433959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f433959a640 1 -- 172.21.15.5:0/4078359044 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f432c0a4ca0 con 0x7f433c139840 2024-08-18T21:03:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f433959a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f433959a640 1 -- 172.21.15.5:0/4078359044 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f432c0aac20 con 0x7f433c139840 2024-08-18T21:03:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f433959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f433959a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f433959a640 10 monclient: dump: 2024-08-18T21:03:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.535 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 5 monclient: authenticate success, global_id 4351 2024-08-18T21:03:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 4 set_mon_vals no callback set 2024-08-18T21:03:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 10 monclient: shutdown 2024-08-18T21:03:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 1 -- 172.21.15.5:0/4078359044 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f433c139840 msgr2=0x7f433c09efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 1 --2- 172.21.15.5:0/4078359044 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f433c139840 0x7f433c09efd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f432c0097f0 tx=0x7f432c01c1c0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 1 -- 172.21.15.5:0/4078359044 shutdown_connections 2024-08-18T21:03:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 1 --2- 172.21.15.5:0/4078359044 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f433c0a4cd0 0x7f433c139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 1 --2- 172.21.15.5:0/4078359044 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f433c139840 0x7f433c09efd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 1 -- 172.21.15.5:0/4078359044 >> 172.21.15.5:0/4078359044 conn(0x7f433c0688d0 msgr2=0x7f433c068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 1 -- 172.21.15.5:0/4078359044 shutdown_connections 2024-08-18T21:03:45.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 1 -- 172.21.15.5:0/4078359044 wait complete. 2024-08-18T21:03:45.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 1 -- 172.21.15.5:0/1177334487 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f13b009da30 msgr2=0x7f13b0073520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:45.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f13ae59c640 1 --2- 172.21.15.5:0/1177334487 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f13b009da30 0x7f13b0073520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f13a000d800 tx=0x7f13a000dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 10 monclient: build_initial_monmap 2024-08-18T21:03:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 10 monclient: monmap: 2024-08-18T21:03:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:45.540 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 1 Processor -- start 2024-08-18T21:03:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 1 -- start start 2024-08-18T21:03:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.513+0000 7f4340827640 10 monclient: init 2024-08-18T21:03:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4340827640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4340827640 10 monclient: _add_conns ranks=[4,3,0,7,5,8,1,2,6] 2024-08-18T21:03:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4340827640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f433c0a4cd0 0x7f433c1d12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4340827640 10 monclient(hunting): picked mon.noname-c con 0x7f433c0a4cd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4340827640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f433c139840 0x7f433c135ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4340827640 10 monclient(hunting): picked mon.noname-g con 0x7f433c139840 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4340827640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f433c13a160 0x7f433c13e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f433c0a4cd0 0x7f433c1d12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f433c0a4cd0 0x7f433c1d12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:36766/0 (socket says 172.21.15.5:36766) 2024-08-18T21:03:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4340827640 10 monclient(hunting): picked mon.noname-a con 0x7f433c13a160 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433ad9d640 1 --2- 172.21.15.5:0/813815861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f433c13a160 0x7f433c13e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4339d9b640 1 --2- 172.21.15.5:0/813815861 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f433c139840 0x7f433c135ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 1 -- 172.21.15.5:0/813815861 learned_addr learned my addr 172.21.15.5:0/813815861 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4340827640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4340827640 1 -- 172.21.15.5:0/813815861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f433c144130 con 0x7f433c13a160 2024-08-18T21:03:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4340827640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4340827640 1 -- 172.21.15.5:0/813815861 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f433c143fb0 con 0x7f433c139840 2024-08-18T21:03:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4340827640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4340827640 1 -- 172.21.15.5:0/813815861 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f433c1442b0 con 0x7f433c0a4cd0 2024-08-18T21:03:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4340827640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4340827640 10 monclient(hunting): authenticate will time out at 992.533397s 2024-08-18T21:03:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433ad9d640 10 monclient(hunting): get_auth_request con 0x7f433c13a160 auth_method 0 2024-08-18T21:03:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 10 monclient(hunting): get_auth_request con 0x7f433c0a4cd0 auth_method 0 2024-08-18T21:03:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4339d9b640 10 monclient(hunting): get_auth_request con 0x7f433c139840 auth_method 0 2024-08-18T21:03:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4339d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4339d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4339d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4339d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4339d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f4339d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 10 monclient(hunting): handle_auth_done global_id 4360 payload 824 2024-08-18T21:03:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 1 -- 172.21.15.5:0/813815861 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f433c139840 msgr2=0x7f433c135ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 1 --2- 172.21.15.5:0/813815861 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f433c139840 0x7f433c135ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 1 -- 172.21.15.5:0/813815861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f433c13a160 msgr2=0x7f433c13e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 1 --2- 172.21.15.5:0/813815861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f433c13a160 0x7f433c13e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 10 monclient: _finish_hunting 0 2024-08-18T21:03:45.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 1 monclient: found mon.noname-c 2024-08-18T21:03:45.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:45.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:45.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f433a59c640 1 -- 172.21.15.5:0/813815861 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f433c120550 con 0x7f433c0a4cd0 2024-08-18T21:03:45.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f139effd640 1 -- 172.21.15.5:0/1177334487 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13a000bd40 con 0x7f13b009da30 2024-08-18T21:03:45.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f139effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f139effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:45.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f139effd640 10 monclient: dump: 2024-08-18T21:03:45.545 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.545 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.545 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.546 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.546 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.546 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.546 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.546 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.546 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.546 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.546 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.546 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.546 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.546 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.546 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.546 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f139effd640 10 monclient: _finish_auth 0 2024-08-18T21:03:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f139effd640 10 monclient: _check_auth_tickets 2024-08-18T21:03:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f139effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f139effd640 1 -- 172.21.15.5:0/1177334487 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13a0019070 con 0x7f13b009da30 2024-08-18T21:03:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f139effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f139effd640 1 -- 172.21.15.5:0/1177334487 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13a00148a0 con 0x7f13b009da30 2024-08-18T21:03:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f139effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f139effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f13acd99640 4 set_mon_vals no callback set 2024-08-18T21:03:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f139effd640 10 monclient: dump: 2024-08-18T21:03:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.548 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f13b4927640 5 monclient: authenticate success, global_id 4340 2024-08-18T21:03:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f13b4927640 10 monclient: _renew_subs 2024-08-18T21:03:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f13b4927640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f13b4927640 1 -- 172.21.15.5:0/1177334487 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b00a1f40 con 0x7f13b009da30 2024-08-18T21:03:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f13b4927640 10 monclient: _renew_subs 2024-08-18T21:03:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f13b4927640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.517+0000 7f13b4927640 1 -- 172.21.15.5:0/1177334487 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b013a200 con 0x7f13b009da30 2024-08-18T21:03:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f433a59c640 1 -- 172.21.15.5:0/813815861 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f433c0a4cd0 msgr2=0x7f433c1d12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f433a59c640 1 --2- 172.21.15.5:0/813815861 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f433c0a4cd0 0x7f433c1d12a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f432c009710 tx=0x7f432c018f60 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f13b4927640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f13b4927640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f13b4927640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:45.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f13b4927640 1 -- 172.21.15.5:0/1177334487 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13b01366a0 con 0x7f13b009da30 2024-08-18T21:03:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f432affd640 1 -- 172.21.15.5:0/813815861 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f432c0b1040 con 0x7f433c0a4cd0 2024-08-18T21:03:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f432affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f432affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f432affd640 10 monclient: dump: 2024-08-18T21:03:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f432affd640 10 monclient: _finish_auth 0 2024-08-18T21:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f432affd640 10 monclient: _check_auth_tickets 2024-08-18T21:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f432affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f432affd640 1 -- 172.21.15.5:0/813815861 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f432c0ba070 con 0x7f433c0a4cd0 2024-08-18T21:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f4340827640 5 monclient: authenticate success, global_id 4360 2024-08-18T21:03:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f4340827640 10 monclient: _renew_subs 2024-08-18T21:03:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f4340827640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f4340827640 1 -- 172.21.15.5:0/813815861 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f433c120830 con 0x7f433c0a4cd0 2024-08-18T21:03:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f4340827640 10 monclient: _renew_subs 2024-08-18T21:03:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f4340827640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f4340827640 1 -- 172.21.15.5:0/813815861 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f433c0a8260 con 0x7f433c0a4cd0 2024-08-18T21:03:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f432affd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f432affd640 1 -- 172.21.15.5:0/813815861 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f432c0acd20 con 0x7f433c0a4cd0 2024-08-18T21:03:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f432affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f432affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f432affd640 10 monclient: dump: 2024-08-18T21:03:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.554 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f139effd640 1 -- 172.21.15.5:0/1177334487 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f13a0014430 con 0x7f13b009da30 2024-08-18T21:03:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f139effd640 1 --2- 172.21.15.5:0/1177334487 >> v2:172.21.15.157:6812/631023601 conn(0x7f139003bdf0 0x7f139003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f139effd640 1 -- 172.21.15.5:0/1177334487 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f13a000f040 con 0x7f13b009da30 2024-08-18T21:03:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f4340827640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f4340827640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f4340827640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:45.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f4340827640 1 -- 172.21.15.5:0/813815861 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f433c139c20 con 0x7f433c0a4cd0 2024-08-18T21:03:45.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f7dd0de5640 10 monclient: get_monmap_and_config 2024-08-18T21:03:45.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f7dd0de5640 10 monclient: build_initial_monmap 2024-08-18T21:03:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f7dd0de5640 10 monclient: monmap: 2024-08-18T21:03:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:45.527384+0000 2024-08-18T21:03:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:45.527384+0000 2024-08-18T21:03:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:45.559 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f7dd0de5640 1 Processor -- start 2024-08-18T21:03:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f7dd0de5640 1 -- start start 2024-08-18T21:03:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.521+0000 7f7dd0de5640 10 monclient: init 2024-08-18T21:03:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dd0de5640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dd0de5640 10 monclient: _add_conns ranks=[6,1,10,0,9,3,7,5,4,8,2] 2024-08-18T21:03:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dd0de5640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc09da30 0x7f7dcc09de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dd0de5640 10 monclient(hunting): picked mon.noname-d con 0x7f7dcc09da30 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dd0de5640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7dcc0a03e0 addr v1:172.21.15.157:6789/0 2024-08-18T21:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dd0de5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7dcc0a3110 0x7f7dcc09e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dd0de5640 10 monclient(hunting): picked mon.noname-f con 0x7f7dcc0a3110 addr v2:172.21.15.157:3300/0 2024-08-18T21:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dd0de5640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc09f7c0 con 0x7f7dcc0a03e0 2024-08-18T21:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dd0de5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dd0de5640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7dcc09e890 con 0x7f7dcc0a3110 2024-08-18T21:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dd0de5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dd0de5640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f7dcc09f4e0 con 0x7f7dcc09da30 2024-08-18T21:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dd0de5640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dd0de5640 10 monclient(hunting): authenticate will time out at 992.540268s 2024-08-18T21:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc09da30 0x7f7dcc09de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dcad9d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7dcc0a3110 0x7f7dcc09e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dcad9d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7dcc0a3110 0x7f7dcc09e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:58062/0 (socket says 172.21.15.5:58062) 2024-08-18T21:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dcad9d640 1 -- 172.21.15.5:0/2799713031 learned_addr learned my addr 172.21.15.5:0/2799713031 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dcad9d640 10 monclient(hunting): get_auth_request con 0x7f7dcc0a3110 auth_method 0 2024-08-18T21:03:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dcad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dcad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dcad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 10 monclient(hunting): get_auth_request con 0x7f7dcc09da30 auth_method 0 2024-08-18T21:03:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dcad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dcad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dcad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 10 monclient(hunting): handle_auth_done global_id 4326 payload 274 2024-08-18T21:03:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 1 -- 172.21.15.5:0/2799713031 >> v2:172.21.15.157:3300/0 conn(0x7f7dcc0a3110 msgr2=0x7f7dcc09e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 1 --2- 172.21.15.5:0/2799713031 >> v2:172.21.15.157:3300/0 conn(0x7f7dcc0a3110 0x7f7dcc09e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 1 -- 172.21.15.5:0/2799713031 >> v1:172.21.15.157:6789/0 conn(0x7f7dcc0a03e0 legacy=0x7f7dcc1366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 10 monclient: _finish_hunting 0 2024-08-18T21:03:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 1 monclient: found mon.noname-d 2024-08-18T21:03:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f7dca59c640 1 -- 172.21.15.5:0/2799713031 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc09faa0 con 0x7f7dcc09da30 2024-08-18T21:03:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f432affd640 1 -- 172.21.15.5:0/813815861 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f432c003c50 con 0x7f433c0a4cd0 2024-08-18T21:03:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f432affd640 1 --2- 172.21.15.5:0/813815861 >> v2:172.21.15.157:6812/631023601 conn(0x7f431c03bdc0 0x7f431c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f432affd640 1 -- 172.21.15.5:0/813815861 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f432c0e81a0 con 0x7f433c0a4cd0 2024-08-18T21:03:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f4339d9b640 1 --2- 172.21.15.5:0/813815861 >> v2:172.21.15.157:6812/631023601 conn(0x7f431c03bdc0 0x7f431c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f4339d9b640 10 monclient: get_auth_request con 0x7f431c03bdc0 auth_method 0 2024-08-18T21:03:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f432affd640 1 -- 172.21.15.5:0/813815861 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f433c09e1a0 con 0x7f433c0a4cd0 2024-08-18T21:03:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f432affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f432affd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:45.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.525+0000 7f4339d9b640 1 --2- 172.21.15.5:0/813815861 >> v2:172.21.15.157:6812/631023601 conn(0x7f431c03bdc0 0x7f431c03e280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f433c076da0 tx=0x7f4330008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.529+0000 7f432bfff640 4 set_mon_vals no callback set 2024-08-18T21:03:45.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.529+0000 7f13add9b640 1 --2- 172.21.15.5:0/1177334487 >> v2:172.21.15.157:6812/631023601 conn(0x7f139003bdf0 0x7f139003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.529+0000 7f13add9b640 10 monclient: get_auth_request con 0x7f139003bdf0 auth_method 0 2024-08-18T21:03:45.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.529+0000 7f139effd640 1 -- 172.21.15.5:0/1177334487 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f13a0014a40 con 0x7f13b009da30 2024-08-18T21:03:45.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.529+0000 7f139effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.529+0000 7f139effd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:45.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.529+0000 7f13add9b640 1 --2- 172.21.15.5:0/1177334487 >> v2:172.21.15.157:6812/631023601 conn(0x7f139003bdf0 0x7f139003e2b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13a40ab000 tx=0x7f13a4004740 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.529+0000 7f7dca59c640 1 -- 172.21.15.5:0/2799713031 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc09da30 msgr2=0x7f7dcc09de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.529+0000 7f7dca59c640 1 --2- 172.21.15.5:0/2799713031 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc09da30 0x7f7dcc09de10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009a50 tx=0x7f7db401ce10 comp rx=0 tx=0).ready entity=mon.6 client_cookie=c6ab20c2ff3e9db server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dc959a640 1 -- 172.21.15.5:0/2799713031 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7db40b0070 con 0x7f7dcc09da30 2024-08-18T21:03:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dc959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dc959a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dc959a640 10 monclient: dump: 2024-08-18T21:03:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.569 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.569 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.569 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.569 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.569 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.569 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.569 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.569 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.569 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.569 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.569 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.569 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.569 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.569 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.570 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dc959a640 10 monclient: _finish_auth 0 2024-08-18T21:03:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dc959a640 10 monclient: _check_auth_tickets 2024-08-18T21:03:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dc959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dc959a640 1 -- 172.21.15.5:0/2799713031 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db40aa810 con 0x7f7dcc09da30 2024-08-18T21:03:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dc959a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dc959a640 1 -- 172.21.15.5:0/2799713031 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7db40aae30 con 0x7f7dcc09da30 2024-08-18T21:03:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dc959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dc959a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dc959a640 10 monclient: dump: 2024-08-18T21:03:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.571 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dd0de5640 5 monclient: authenticate success, global_id 4326 2024-08-18T21:03:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dd0de5640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dd0de5640 4 set_mon_vals no callback set 2024-08-18T21:03:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dd0de5640 10 monclient: shutdown 2024-08-18T21:03:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dd0de5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dd0de5640 1 -- 172.21.15.5:0/2799713031 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc09da30 msgr2=0x7f7dcc09de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dd0de5640 1 --2- 172.21.15.5:0/2799713031 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc09da30 0x7f7dcc09de10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009a50 tx=0x7f7db401ce10 comp rx=0 tx=0).stop 2024-08-18T21:03:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dd0de5640 1 -- 172.21.15.5:0/2799713031 shutdown_connections 2024-08-18T21:03:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dd0de5640 1 --2- 172.21.15.5:0/2799713031 >> v2:172.21.15.157:3300/0 conn(0x7f7dcc0a3110 0x7f7dcc09e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dd0de5640 1 --2- 172.21.15.5:0/2799713031 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc09da30 0x7f7dcc09de10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.545+0000 7f7dd0de5640 1 -- 172.21.15.5:0/2799713031 >> 172.21.15.5:0/2799713031 conn(0x7f7dcc0688d0 msgr2=0x7f7dcc068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 1 -- 172.21.15.5:0/2799713031 shutdown_connections 2024-08-18T21:03:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 1 -- 172.21.15.5:0/2799713031 wait complete. 2024-08-18T21:03:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 10 monclient: build_initial_monmap 2024-08-18T21:03:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 10 monclient: monmap: 2024-08-18T21:03:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:45.574 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 1 Processor -- start 2024-08-18T21:03:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 1 -- start start 2024-08-18T21:03:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 10 monclient: init 2024-08-18T21:03:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 10 monclient: _add_conns ranks=[2,7,6,4,0,5,8,3,1] 2024-08-18T21:03:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7dcc09da30 0x7f7dcc0731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 10 monclient(hunting): picked mon.noname-b con 0x7f7dcc09da30 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7dcc0a3110 0x7f7dcc131db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 10 monclient(hunting): picked mon.noname-i con 0x7f7dcc0a3110 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc1322f0 0x7f7dcc132710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 10 monclient(hunting): picked mon.noname-d con 0x7f7dcc1322f0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f7dcc06cce0 con 0x7f7dcc09da30 2024-08-18T21:03:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f7dcc06cb60 con 0x7f7dcc1322f0 2024-08-18T21:03:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7dcc06ce60 con 0x7f7dcc0a3110 2024-08-18T21:03:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dd0de5640 10 monclient(hunting): authenticate will time out at 992.575390s 2024-08-18T21:03:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dcad9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc1322f0 0x7f7dcc132710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dcad9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc1322f0 0x7f7dcc132710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:57096/0 (socket says 172.21.15.5:57096) 2024-08-18T21:03:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dcad9d640 1 -- 172.21.15.5:0/711198068 learned_addr learned my addr 172.21.15.5:0/711198068 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dcad9d640 10 monclient(hunting): get_auth_request con 0x7f7dcc1322f0 auth_method 0 2024-08-18T21:03:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dcad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dcad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dcad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dcad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dcad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dc9d9b640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7dcc0a3110 0x7f7dcc131db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dcad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dc9d9b640 10 monclient(hunting): get_auth_request con 0x7f7dcc0a3110 auth_method 0 2024-08-18T21:03:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dc9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dc9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.557+0000 7f7dc9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dcad9d640 10 monclient(hunting): handle_auth_done global_id 4335 payload 824 2024-08-18T21:03:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dcad9d640 1 -- 172.21.15.5:0/711198068 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7dcc0a3110 msgr2=0x7f7dcc131db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dcad9d640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7dcc0a3110 0x7f7dcc131db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dcad9d640 1 -- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7dcc09da30 msgr2=0x7f7dcc0731d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:03:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dcad9d640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7dcc09da30 0x7f7dcc0731d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dcad9d640 10 monclient: _finish_hunting 0 2024-08-18T21:03:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dcad9d640 1 monclient: found mon.noname-d 2024-08-18T21:03:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dcad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dcad9d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dcad9d640 1 -- 172.21.15.5:0/711198068 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc0a20c0 con 0x7f7dcc1322f0 2024-08-18T21:03:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dcad9d640 1 -- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc1322f0 msgr2=0x7f7dcc132710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dcad9d640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc1322f0 0x7f7dcc132710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400ec40 tx=0x7f7dc400c490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc2ffd640 1 -- 172.21.15.5:0/711198068 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7dc400ee50 con 0x7f7dcc1322f0 2024-08-18T21:03:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc2ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc2ffd640 10 monclient: dump: 2024-08-18T21:03:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.579 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc2ffd640 10 monclient: _finish_auth 0 2024-08-18T21:03:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc2ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:03:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc2ffd640 1 -- 172.21.15.5:0/711198068 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc4003e10 con 0x7f7dcc1322f0 2024-08-18T21:03:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dd0de5640 5 monclient: authenticate success, global_id 4335 2024-08-18T21:03:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc2ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc2ffd640 1 -- 172.21.15.5:0/711198068 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7dc400cd30 con 0x7f7dcc1322f0 2024-08-18T21:03:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dd0de5640 10 monclient: _renew_subs 2024-08-18T21:03:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dd0de5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dd0de5640 1 -- 172.21.15.5:0/711198068 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc077170 con 0x7f7dcc1322f0 2024-08-18T21:03:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc2ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc2ffd640 10 monclient: dump: 2024-08-18T21:03:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.581 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dd0de5640 10 monclient: _renew_subs 2024-08-18T21:03:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dd0de5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dd0de5640 1 -- 172.21.15.5:0/711198068 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dcc1342c0 con 0x7f7dcc1322f0 2024-08-18T21:03:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dc3fff640 4 set_mon_vals no callback set 2024-08-18T21:03:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.561+0000 7f7dd0de5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f7dd0de5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f7dd0de5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f7dd0de5640 1 -- 172.21.15.5:0/711198068 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db0005090 con 0x7f7dcc1322f0 2024-08-18T21:03:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f7dc2ffd640 1 -- 172.21.15.5:0/711198068 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f7dc4012050 con 0x7f7dcc1322f0 2024-08-18T21:03:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 10 monclient: get_monmap_and_config 2024-08-18T21:03:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 10 monclient: build_initial_monmap 2024-08-18T21:03:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 10 monclient: monmap: 2024-08-18T21:03:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:45.568985+0000 2024-08-18T21:03:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:45.568985+0000 2024-08-18T21:03:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:45.584 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:45.584 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f7dc2ffd640 1 --2- 172.21.15.5:0/711198068 >> v2:172.21.15.157:6812/631023601 conn(0x7f7dac03bdc0 0x7f7dac03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f7dc2ffd640 1 -- 172.21.15.5:0/711198068 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f7dc404e860 con 0x7f7dcc1322f0 2024-08-18T21:03:45.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 1 Processor -- start 2024-08-18T21:03:45.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 1 -- start start 2024-08-18T21:03:45.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 10 monclient: init 2024-08-18T21:03:45.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f7dca59c640 1 --2- 172.21.15.5:0/711198068 >> v2:172.21.15.157:6812/631023601 conn(0x7f7dac03bdc0 0x7f7dac03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f7dca59c640 10 monclient: get_auth_request con 0x7f7dac03bdc0 auth_method 0 2024-08-18T21:03:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 10 monclient: _add_conns ranks=[9,2,4,8,0,6,7,1,3,10,5] 2024-08-18T21:03:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f462c0a6bd0 0x7f462c0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 10 monclient(hunting): picked mon.noname-a con 0x7f462c0a6bd0 addr v2:172.21.15.5:3300/0 2024-08-18T21:03:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f462c09f080 0x7f462c0a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 10 monclient(hunting): picked mon.noname-b con 0x7f462c09f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f462c139990 0x7f462c139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 10 monclient(hunting): picked mon.noname-c con 0x7f462c139990 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f462c09e4c0 con 0x7f462c0a6bd0 2024-08-18T21:03:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f462c06f930 con 0x7f462c09f080 2024-08-18T21:03:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f462c0a7a30 con 0x7f462c139990 2024-08-18T21:03:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4633c73640 10 monclient(hunting): authenticate will time out at 992.581834s 2024-08-18T21:03:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4631a0f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f462c0a6bd0 0x7f462c0a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f462c09f080 0x7f462c0a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4631a0f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f462c0a6bd0 0x7f462c0a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46714/0 (socket says 172.21.15.5:46714) 2024-08-18T21:03:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4631a0f640 1 -- 172.21.15.5:0/3575949530 learned_addr learned my addr 172.21.15.5:0/3575949530 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 10 monclient(hunting): get_auth_request con 0x7f462c09f080 auth_method 0 2024-08-18T21:03:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4632210640 1 --2- 172.21.15.5:0/3575949530 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f462c139990 0x7f462c139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4632210640 10 monclient(hunting): get_auth_request con 0x7f462c139990 auth_method 0 2024-08-18T21:03:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4632210640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4632210640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4632210640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4632210640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4632210640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4632210640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4631a0f640 10 monclient(hunting): get_auth_request con 0x7f462c0a6bd0 auth_method 0 2024-08-18T21:03:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4631a0f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4631a0f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f4631a0f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 10 monclient(hunting): handle_auth_done global_id 4349 payload 274 2024-08-18T21:03:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 1 -- 172.21.15.5:0/3575949530 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f462c139990 msgr2=0x7f462c139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 1 --2- 172.21.15.5:0/3575949530 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f462c139990 0x7f462c139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 1 -- 172.21.15.5:0/3575949530 >> v2:172.21.15.5:3300/0 conn(0x7f462c0a6bd0 msgr2=0x7f462c0a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 1 --2- 172.21.15.5:0/3575949530 >> v2:172.21.15.5:3300/0 conn(0x7f462c0a6bd0 0x7f462c0a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 10 monclient: _finish_hunting 0 2024-08-18T21:03:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 1 monclient: found mon.noname-b 2024-08-18T21:03:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.565+0000 7f463120e640 1 -- 172.21.15.5:0/3575949530 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462c0a7fb0 con 0x7f462c09f080 2024-08-18T21:03:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.569+0000 7f7dca59c640 1 --2- 172.21.15.5:0/711198068 >> v2:172.21.15.157:6812/631023601 conn(0x7f7dac03bdc0 0x7f7dac03e280 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7db40ab000 tx=0x7f7db4004740 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.569+0000 7f7dc2ffd640 1 -- 172.21.15.5:0/711198068 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f7dc4022020 con 0x7f7dcc1322f0 2024-08-18T21:03:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.569+0000 7f7dc2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.569+0000 7f7dc2ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.569+0000 7f463120e640 1 -- 172.21.15.5:0/3575949530 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f462c09f080 msgr2=0x7f462c0a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.569+0000 7f463120e640 1 --2- 172.21.15.5:0/3575949530 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f462c09f080 0x7f462c0a74f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f461c0097c0 tx=0x7f461c01c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0c531b6617332b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4630a0d640 1 -- 172.21.15.5:0/3575949530 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f461c0b0070 con 0x7f462c09f080 2024-08-18T21:03:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4630a0d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4630a0d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4630a0d640 10 monclient: dump: 2024-08-18T21:03:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.596 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4630a0d640 10 monclient: _finish_auth 0 2024-08-18T21:03:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4630a0d640 10 monclient: _check_auth_tickets 2024-08-18T21:03:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4630a0d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4630a0d640 1 -- 172.21.15.5:0/3575949530 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f461c0aa810 con 0x7f462c09f080 2024-08-18T21:03:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4630a0d640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4630a0d640 1 -- 172.21.15.5:0/3575949530 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f461c0a4e60 con 0x7f462c09f080 2024-08-18T21:03:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4630a0d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4630a0d640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4630a0d640 10 monclient: dump: 2024-08-18T21:03:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.597 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4633c73640 5 monclient: authenticate success, global_id 4349 2024-08-18T21:03:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4633c73640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4633c73640 4 set_mon_vals no callback set 2024-08-18T21:03:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4633c73640 10 monclient: shutdown 2024-08-18T21:03:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4633c73640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4633c73640 1 -- 172.21.15.5:0/3575949530 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f462c09f080 msgr2=0x7f462c0a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.573+0000 7f4633c73640 1 --2- 172.21.15.5:0/3575949530 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f462c09f080 0x7f462c0a74f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f461c0097c0 tx=0x7f461c01c360 comp rx=0 tx=0).stop 2024-08-18T21:03:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 1 -- 172.21.15.5:0/3575949530 shutdown_connections 2024-08-18T21:03:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 1 --2- 172.21.15.5:0/3575949530 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f462c139990 0x7f462c139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 1 --2- 172.21.15.5:0/3575949530 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f462c09f080 0x7f462c0a74f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 1 --2- 172.21.15.5:0/3575949530 >> v2:172.21.15.5:3300/0 conn(0x7f462c0a6bd0 0x7f462c0a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 1 -- 172.21.15.5:0/3575949530 >> 172.21.15.5:0/3575949530 conn(0x7f462c068700 msgr2=0x7f462c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 1 -- 172.21.15.5:0/3575949530 shutdown_connections 2024-08-18T21:03:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 1 -- 172.21.15.5:0/3575949530 wait complete. 2024-08-18T21:03:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 10 monclient: build_initial_monmap 2024-08-18T21:03:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 10 monclient: monmap: 2024-08-18T21:03:45.599 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:45.599 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:45.599 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:45.599 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:45.599 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:45.599 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.599 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:45.599 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:45.599 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:45.599 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:45.599 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:45.599 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:45.599 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:45.599 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:45.600 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:45.600 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 1 Processor -- start 2024-08-18T21:03:45.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 1 -- start start 2024-08-18T21:03:45.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 10 monclient: init 2024-08-18T21:03:45.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:45.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 10 monclient: _add_conns ranks=[1,7,2,0,5,8,3,6,4] 2024-08-18T21:03:45.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f462c09f080 0x7f462c13e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 10 monclient(hunting): picked mon.noname-f con 0x7f462c09f080 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:45.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f462c0a6bd0 0x7f462c072f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 10 monclient(hunting): picked mon.noname-i con 0x7f462c0a6bd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:45.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f462c139990 0x7f462c13bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 10 monclient(hunting): picked mon.noname-b con 0x7f462c139990 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:45.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f462c0a89f0 con 0x7f462c09f080 2024-08-18T21:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f462c0a7ce0 con 0x7f462c139990 2024-08-18T21:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f462c143610 con 0x7f462c0a6bd0 2024-08-18T21:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4633c73640 10 monclient(hunting): authenticate will time out at 992.594639s 2024-08-18T21:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4631a0f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f462c09f080 0x7f462c13e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4632210640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f462c139990 0x7f462c13bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4632210640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f462c139990 0x7f462c13bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34142/0 (socket says 172.21.15.5:34142) 2024-08-18T21:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4632210640 1 -- 172.21.15.5:0/2645563243 learned_addr learned my addr 172.21.15.5:0/2645563243 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4632210640 10 monclient(hunting): get_auth_request con 0x7f462c139990 auth_method 0 2024-08-18T21:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4632210640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4632210640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4632210640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4631a0f640 10 monclient(hunting): get_auth_request con 0x7f462c09f080 auth_method 0 2024-08-18T21:03:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4631a0f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4631a0f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4631a0f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4631a0f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4631a0f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4631a0f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4632210640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4632210640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.577+0000 7f4632210640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.581+0000 7f4631a0f640 10 monclient(hunting): handle_auth_done global_id 4285 payload 824 2024-08-18T21:03:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.581+0000 7f4631a0f640 1 -- 172.21.15.5:0/2645563243 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f462c0a6bd0 msgr2=0x7f462c072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.581+0000 7f4631a0f640 1 --2- 172.21.15.5:0/2645563243 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f462c0a6bd0 0x7f462c072f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.581+0000 7f4631a0f640 1 -- 172.21.15.5:0/2645563243 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f462c139990 msgr2=0x7f462c13bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.581+0000 7f4631a0f640 1 --2- 172.21.15.5:0/2645563243 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f462c139990 0x7f462c13bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.581+0000 7f4631a0f640 10 monclient: _finish_hunting 0 2024-08-18T21:03:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.581+0000 7f4631a0f640 1 monclient: found mon.noname-f 2024-08-18T21:03:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.581+0000 7f4631a0f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.581+0000 7f4631a0f640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:03:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.581+0000 7f4631a0f640 1 -- 172.21.15.5:0/2645563243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462c13d5a0 con 0x7f462c09f080 2024-08-18T21:03:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.581+0000 7f4631a0f640 1 -- 172.21.15.5:0/2645563243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f462c09f080 msgr2=0x7f462c13e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.581+0000 7f4631a0f640 1 --2- 172.21.15.5:0/2645563243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f462c09f080 0x7f462c13e940 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f462800e580 tx=0x7f462800ea40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.581+0000 7f46227fc640 1 -- 172.21.15.5:0/2645563243 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4628017070 con 0x7f462c09f080 2024-08-18T21:03:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.581+0000 7f46227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.581+0000 7f46227fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:03:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.581+0000 7f46227fc640 10 monclient: dump: 2024-08-18T21:03:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.605 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f46227fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f46227fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f46227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f46227fc640 1 -- 172.21.15.5:0/2645563243 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4628013a90 con 0x7f462c09f080 2024-08-18T21:03:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f4633c73640 5 monclient: authenticate success, global_id 4285 2024-08-18T21:03:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f4633c73640 10 monclient: _renew_subs 2024-08-18T21:03:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f4633c73640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:03:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f4633c73640 1 -- 172.21.15.5:0/2645563243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f462c0ab4c0 con 0x7f462c09f080 2024-08-18T21:03:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f46227fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f4623fff640 4 set_mon_vals no callback set 2024-08-18T21:03:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f46227fc640 1 -- 172.21.15.5:0/2645563243 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f462800f040 con 0x7f462c09f080 2024-08-18T21:03:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f4633c73640 10 monclient: _renew_subs 2024-08-18T21:03:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f4633c73640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:03:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f4633c73640 1 -- 172.21.15.5:0/2645563243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f462c13f060 con 0x7f462c09f080 2024-08-18T21:03:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f46227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f46227fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:03:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f46227fc640 10 monclient: dump: 2024-08-18T21:03:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.607 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f4633c73640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f4633c73640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f4633c73640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:03:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f4633c73640 1 -- 172.21.15.5:0/2645563243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f462c139e10 con 0x7f462c09f080 2024-08-18T21:03:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f46227fc640 1 -- 172.21.15.5:0/2645563243 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f462801a070 con 0x7f462c09f080 2024-08-18T21:03:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f46227fc640 1 --2- 172.21.15.5:0/2645563243 >> v2:172.21.15.157:6812/631023601 conn(0x7f461003bd80 0x7f461003e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.585+0000 7f46227fc640 1 -- 172.21.15.5:0/2645563243 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f4628013c40 con 0x7f462c09f080 2024-08-18T21:03:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.589+0000 7f463120e640 1 --2- 172.21.15.5:0/2645563243 >> v2:172.21.15.157:6812/631023601 conn(0x7f461003bd80 0x7f461003e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.589+0000 7f463120e640 10 monclient: get_auth_request con 0x7f461003bd80 auth_method 0 2024-08-18T21:03:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.589+0000 7f463120e640 1 --2- 172.21.15.5:0/2645563243 >> v2:172.21.15.157:6812/631023601 conn(0x7f461003bd80 0x7f461003e240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f461c0ab000 tx=0x7f461c004740 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.593+0000 7f511daa9640 10 monclient: get_monmap_and_config 2024-08-18T21:03:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.593+0000 7f511daa9640 10 monclient: build_initial_monmap 2024-08-18T21:03:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.593+0000 7f511daa9640 10 monclient: monmap: 2024-08-18T21:03:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:45.599255+0000 2024-08-18T21:03:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:45.599255+0000 2024-08-18T21:03:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:45.611 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.593+0000 7f511daa9640 1 Processor -- start 2024-08-18T21:03:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.593+0000 7f511daa9640 1 -- start start 2024-08-18T21:03:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.593+0000 7f511daa9640 10 monclient: init 2024-08-18T21:03:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f511daa9640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f511daa9640 10 monclient: _add_conns ranks=[3,1,7,10,5,4,6,9,2,8,0] 2024-08-18T21:03:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f511daa9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51180a4960 0x7f51180a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f511daa9640 10 monclient(hunting): picked mon.noname-g con 0x7f51180a4960 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f511daa9640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f51180a5280 addr v1:172.21.15.157:6789/0 2024-08-18T21:03:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f511daa9640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5118138e40 0x7f5118141d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f511daa9640 10 monclient(hunting): picked mon.noname-i con 0x7f5118138e40 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f511daa9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511809da30 con 0x7f51180a5280 2024-08-18T21:03:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f511daa9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f511daa9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f511806ccb0 con 0x7f51180a4960 2024-08-18T21:03:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f511daa9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f511daa9640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f511806ce80 con 0x7f5118138e40 2024-08-18T21:03:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f511daa9640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f511daa9640 10 monclient(hunting): authenticate will time out at 992.612767s 2024-08-18T21:03:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f510ffff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f51180a5280 0x7f5118138730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:52656/0 (socket says 172.21.15.5:52656) 2024-08-18T21:03:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f510ffff640 1 -- 172.21.15.5:0/3974713840 learned_addr learned my addr 172.21.15.5:0/3974713840 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:03:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 1 --2- 172.21.15.5:0/3974713840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51180a4960 0x7f51180a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f5117fff640 1 --2- 172.21.15.5:0/3974713840 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5118138e40 0x7f5118141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 10 monclient(hunting): get_auth_request con 0x7f51180a4960 auth_method 0 2024-08-18T21:03:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f5117fff640 10 monclient(hunting): get_auth_request con 0x7f5118138e40 auth_method 0 2024-08-18T21:03:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f5117fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f5117fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f5117fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f5117fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f5117fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f5117fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 10 monclient(hunting): handle_auth_done global_id 4332 payload 274 2024-08-18T21:03:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 1 -- 172.21.15.5:0/3974713840 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5118138e40 msgr2=0x7f5118141d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 1 --2- 172.21.15.5:0/3974713840 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5118138e40 0x7f5118141d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 1 -- 172.21.15.5:0/3974713840 >> v1:172.21.15.157:6789/0 conn(0x7f51180a5280 legacy=0x7f5118138730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 1 monclient: found mon.noname-g 2024-08-18T21:03:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:03:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.597+0000 7f51177fe640 1 -- 172.21.15.5:0/3974713840 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511806d090 con 0x7f51180a4960 2024-08-18T21:03:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.601+0000 7f46227fc640 1 -- 172.21.15.5:0/2645563243 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f462c0ab4c0 con 0x7f462c09f080 2024-08-18T21:03:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.601+0000 7f46227fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.601+0000 7f46227fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.601+0000 7f51177fe640 1 -- 172.21.15.5:0/3974713840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51180a4960 msgr2=0x7f51180a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.601+0000 7f51177fe640 1 --2- 172.21.15.5:0/3974713840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51180a4960 0x7f51180a4d40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f51080097c0 tx=0x7f510801c380 comp rx=0 tx=0).ready entity=mon.3 client_cookie=f94dd1036277075f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.601+0000 7f5116ffd640 1 -- 172.21.15.5:0/3974713840 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f51080b0070 con 0x7f51180a4960 2024-08-18T21:03:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.601+0000 7f5116ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.601+0000 7f5116ffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:03:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.601+0000 7f5116ffd640 10 monclient: dump: 2024-08-18T21:03:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.622 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f5116ffd640 10 monclient: _finish_auth 0 2024-08-18T21:03:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f5116ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:03:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f5116ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 5 monclient: authenticate success, global_id 4332 2024-08-18T21:03:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f5116ffd640 1 -- 172.21.15.5:0/3974713840 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51080aa3a0 con 0x7f51180a4960 2024-08-18T21:03:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f5116ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f5116ffd640 1 -- 172.21.15.5:0/3974713840 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f51080aa9c0 con 0x7f51180a4960 2024-08-18T21:03:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f5116ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f5116ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:03:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f5116ffd640 10 monclient: dump: 2024-08-18T21:03:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.624 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 4 set_mon_vals no callback set 2024-08-18T21:03:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 10 monclient: shutdown 2024-08-18T21:03:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 1 -- 172.21.15.5:0/3974713840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51180a4960 msgr2=0x7f51180a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 1 --2- 172.21.15.5:0/3974713840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51180a4960 0x7f51180a4d40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f51080097c0 tx=0x7f510801c380 comp rx=0 tx=0).stop 2024-08-18T21:03:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 1 -- 172.21.15.5:0/3974713840 shutdown_connections 2024-08-18T21:03:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 1 --2- 172.21.15.5:0/3974713840 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5118138e40 0x7f5118141d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 1 --2- 172.21.15.5:0/3974713840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51180a4960 0x7f51180a4d40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 1 -- 172.21.15.5:0/3974713840 >> 172.21.15.5:0/3974713840 conn(0x7f51180a6440 msgr2=0x7f5118068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 1 -- 172.21.15.5:0/3974713840 shutdown_connections 2024-08-18T21:03:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 1 -- 172.21.15.5:0/3974713840 wait complete. 2024-08-18T21:03:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 10 monclient: build_initial_monmap 2024-08-18T21:03:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 10 monclient: monmap: 2024-08-18T21:03:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:45.626 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 1 Processor -- start 2024-08-18T21:03:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 1 -- start start 2024-08-18T21:03:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.605+0000 7f511daa9640 10 monclient: init 2024-08-18T21:03:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f511daa9640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f511daa9640 10 monclient: _add_conns ranks=[5,4,1,8,6,7,0,3,2] 2024-08-18T21:03:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f511daa9640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f51180a4960 0x7f51181336e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f511daa9640 10 monclient(hunting): picked mon.noname-h con 0x7f51180a4960 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f511daa9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f51180a5280 0x7f5118133c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f510ffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f51180a5280 0x7f5118133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f510ffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f51180a5280 0x7f5118133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:36794/0 (socket says 172.21.15.5:36794) 2024-08-18T21:03:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f510ffff640 1 -- 172.21.15.5:0/3471563220 learned_addr learned my addr 172.21.15.5:0/3471563220 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f511daa9640 10 monclient(hunting): picked mon.noname-c con 0x7f51180a5280 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 1 --2- 172.21.15.5:0/3471563220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f51180a4960 0x7f51181336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f511daa9640 1 --2- 172.21.15.5:0/3471563220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5118138e40 0x7f5118134160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f511daa9640 10 monclient(hunting): picked mon.noname-f con 0x7f5118138e40 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f511daa9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f511daa9640 1 -- 172.21.15.5:0/3471563220 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f511809f290 con 0x7f5118138e40 2024-08-18T21:03:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f511daa9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f511daa9640 1 -- 172.21.15.5:0/3471563220 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f511809f110 con 0x7f51180a5280 2024-08-18T21:03:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f511daa9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f511daa9640 1 -- 172.21.15.5:0/3471563220 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f5118144ad0 con 0x7f51180a4960 2024-08-18T21:03:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f511daa9640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f511daa9640 10 monclient(hunting): authenticate will time out at 992.624969s 2024-08-18T21:03:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f510ffff640 10 monclient(hunting): get_auth_request con 0x7f51180a5280 auth_method 0 2024-08-18T21:03:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f510ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f510ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f510ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 10 monclient(hunting): get_auth_request con 0x7f51180a4960 auth_method 0 2024-08-18T21:03:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f5117fff640 1 --2- 172.21.15.5:0/3471563220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5118138e40 0x7f5118134160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f5117fff640 10 monclient(hunting): get_auth_request con 0x7f5118138e40 auth_method 0 2024-08-18T21:03:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f5117fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f5117fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f5117fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f510ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f510ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f510ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f5117fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f5117fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f5117fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 10 monclient(hunting): handle_auth_done global_id 4298 payload 824 2024-08-18T21:03:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 1 -- 172.21.15.5:0/3471563220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f51180a5280 msgr2=0x7f5118133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 1 --2- 172.21.15.5:0/3471563220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f51180a5280 0x7f5118133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 1 -- 172.21.15.5:0/3471563220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5118138e40 msgr2=0x7f5118134160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 1 --2- 172.21.15.5:0/3471563220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5118138e40 0x7f5118134160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 1 monclient: found mon.noname-h 2024-08-18T21:03:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:03:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.609+0000 7f51177fe640 1 -- 172.21.15.5:0/3471563220 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51181402d0 con 0x7f51180a4960 2024-08-18T21:03:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f51177fe640 1 -- 172.21.15.5:0/3471563220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f51180a4960 msgr2=0x7f51181336e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f51177fe640 1 --2- 172.21.15.5:0/3471563220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f51180a4960 0x7f51181336e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f51080ad000 tx=0x7f5108019120 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f5114ff9640 1 -- 172.21.15.5:0/3471563220 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f51080b0040 con 0x7f51180a4960 2024-08-18T21:03:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f5114ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f5114ff9640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:03:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f5114ff9640 10 monclient: dump: 2024-08-18T21:03:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.632 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f5114ff9640 10 monclient: _finish_auth 0 2024-08-18T21:03:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f5114ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:03:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f5114ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f5114ff9640 1 -- 172.21.15.5:0/3471563220 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5108003de0 con 0x7f51180a4960 2024-08-18T21:03:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f5114ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f5114ff9640 1 -- 172.21.15.5:0/3471563220 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f51080aa9c0 con 0x7f51180a4960 2024-08-18T21:03:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f5114ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f5114ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:03:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f51167fc640 4 set_mon_vals no callback set 2024-08-18T21:03:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f5114ff9640 10 monclient: dump: 2024-08-18T21:03:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.634 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f511daa9640 5 monclient: authenticate success, global_id 4298 2024-08-18T21:03:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f511daa9640 10 monclient: _renew_subs 2024-08-18T21:03:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f511daa9640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:03:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f511daa9640 1 -- 172.21.15.5:0/3471563220 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51181405b0 con 0x7f51180a4960 2024-08-18T21:03:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f511daa9640 10 monclient: _renew_subs 2024-08-18T21:03:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f511daa9640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:03:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f511daa9640 1 -- 172.21.15.5:0/3471563220 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f511813f090 con 0x7f51180a4960 2024-08-18T21:03:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f511daa9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f511daa9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f511daa9640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:03:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f511daa9640 1 -- 172.21.15.5:0/3471563220 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51180a4d40 con 0x7f51180a4960 2024-08-18T21:03:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f5114ff9640 1 -- 172.21.15.5:0/3471563220 <== mon.5 v2:172.21.15.157:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f5108003970 con 0x7f51180a4960 2024-08-18T21:03:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f5114ff9640 1 --2- 172.21.15.5:0/3471563220 >> v2:172.21.15.157:6812/631023601 conn(0x7f50f803bdc0 0x7f50f803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.613+0000 7f5114ff9640 1 -- 172.21.15.5:0/3471563220 <== mon.5 v2:172.21.15.157:3302/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f51080e8ae0 con 0x7f51180a4960 2024-08-18T21:03:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.617+0000 7f510ffff640 1 --2- 172.21.15.5:0/3471563220 >> v2:172.21.15.157:6812/631023601 conn(0x7f50f803bdc0 0x7f50f803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.617+0000 7f510ffff640 10 monclient: get_auth_request con 0x7f50f803bdc0 auth_method 0 2024-08-18T21:03:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.617+0000 7f510ffff640 1 --2- 172.21.15.5:0/3471563220 >> v2:172.21.15.157:6812/631023601 conn(0x7f50f803bdc0 0x7f50f803e280 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5100007d30 tx=0x7f5100007c80 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.629+0000 7f5114ff9640 1 -- 172.21.15.5:0/3471563220 <== mon.5 v2:172.21.15.157:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f5108016090 con 0x7f51180a4960 2024-08-18T21:03:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.629+0000 7f5114ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.629+0000 7f5114ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:45.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.725+0000 7f13b4927640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-08-18T21:03:45.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.725+0000 7f13b4927640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-08-18T21:03:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.725+0000 7f13b4927640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.725+0000 7f13b4927640 1 -- 172.21.15.5:0/1177334487 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f13b00a2eb0 con 0x7f13b009da30 2024-08-18T21:03:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.725+0000 7f139effd640 1 -- 172.21.15.5:0/1177334487 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f13a0013aa0 con 0x7f13b009da30 2024-08-18T21:03:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.725+0000 7f139effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-08-18T21:03:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.725+0000 7f139effd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:45.730 INFO:teuthology.orchestra.run.smithi005.stdout:47244640259 2024-08-18T21:03:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.729+0000 7f13b4927640 1 -- 172.21.15.5:0/1177334487 >> v2:172.21.15.157:6812/631023601 conn(0x7f139003bdf0 msgr2=0x7f139003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.729+0000 7f13b4927640 1 --2- 172.21.15.5:0/1177334487 >> v2:172.21.15.157:6812/631023601 conn(0x7f139003bdf0 0x7f139003e2b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13a40ab000 tx=0x7f13a4004740 comp rx=0 tx=0).stop 2024-08-18T21:03:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.729+0000 7f13b4927640 10 monclient: shutdown 2024-08-18T21:03:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.729+0000 7f13b4927640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.729+0000 7f13b4927640 1 -- 172.21.15.5:0/1177334487 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f13b009da30 msgr2=0x7f13b0073520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.729+0000 7f13b4927640 1 --2- 172.21.15.5:0/1177334487 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f13b009da30 0x7f13b0073520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f13a000d800 tx=0x7f13a000dc00 comp rx=0 tx=0).stop 2024-08-18T21:03:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.729+0000 7f13b4927640 1 -- 172.21.15.5:0/1177334487 shutdown_connections 2024-08-18T21:03:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.729+0000 7f13b4927640 1 --2- 172.21.15.5:0/1177334487 >> v2:172.21.15.157:6812/631023601 conn(0x7f139003bdf0 0x7f139003e2b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.729+0000 7f13b4927640 1 --2- 172.21.15.5:0/1177334487 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13b01cfde0 0x7f13b006c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.729+0000 7f13b4927640 1 --2- 172.21.15.5:0/1177334487 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f13b00a3110 0x7f13b01cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.729+0000 7f13b4927640 1 --2- 172.21.15.5:0/1177334487 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f13b009da30 0x7f13b0073520 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.729+0000 7f13b4927640 1 -- 172.21.15.5:0/1177334487 >> 172.21.15.5:0/1177334487 conn(0x7f13b00688d0 msgr2=0x7f13b00a87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.729+0000 7f13b4927640 1 -- 172.21.15.5:0/1177334487 shutdown_connections 2024-08-18T21:03:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.729+0000 7f13b4927640 1 -- 172.21.15.5:0/1177334487 wait complete. 2024-08-18T21:03:45.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.5 2024-08-18T21:03:45.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dd0de5640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-08-18T21:03:45.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dd0de5640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-08-18T21:03:45.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dd0de5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:45.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dd0de5640 1 -- 172.21.15.5:0/711198068 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7db0005380 con 0x7f7dcc1322f0 2024-08-18T21:03:45.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dcad9d640 1 -- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc1322f0 msgr2=0x7f7dcc132710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-18T21:03:45.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dcad9d640 1 -- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc1322f0 msgr2=0x7f7dcc132710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:03:45.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dcad9d640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc1322f0 0x7f7dcc132710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400ec40 tx=0x7f7dc400c490 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:03:45.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dcad9d640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc1322f0 0x7f7dcc132710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400ec40 tx=0x7f7dc400c490 comp rx=0 tx=0).stop 2024-08-18T21:03:45.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 10 monclient: ms_handle_reset current mon [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:45.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:45.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 1 -- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc1322f0 msgr2=0x7f7dcc132710 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:45.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7dcc1322f0 0x7f7dcc132710 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 10 monclient: _add_conns ranks=[1,4,0,8,6,2,3,7,5] 2024-08-18T21:03:45.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7dac041620 0x7f7dac043a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 10 monclient(hunting): picked mon.f con 0x7f7dac041620 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7dac0442c0 0x7f7dac046750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 10 monclient(hunting): picked mon.c con 0x7f7dac0442c0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dac0472f0 0x7f7dac049780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 10 monclient(hunting): picked mon.a con 0x7f7dac0472f0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 1 -- 172.21.15.5:0/711198068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac04a330 con 0x7f7dac0472f0 2024-08-18T21:03:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 1 -- 172.21.15.5:0/711198068 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac04a4e0 con 0x7f7dac041620 2024-08-18T21:03:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 1 -- 172.21.15.5:0/711198068 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f7dac04a690 con 0x7f7dac0442c0 2024-08-18T21:03:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc2ffd640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dcad9d640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7dac0442c0 0x7f7dac046750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dcad9d640 10 monclient(hunting): get_auth_request con 0x7f7dac0442c0 auth_method 0 2024-08-18T21:03:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dcad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dcad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dcad9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dca59c640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dac0472f0 0x7f7dac049780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dca59c640 10 monclient(hunting): get_auth_request con 0x7f7dac0472f0 auth_method 0 2024-08-18T21:03:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dca59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dca59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dca59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dcad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dcad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dcad9d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:03:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc9d9b640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7dac041620 0x7f7dac043a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc9d9b640 10 monclient(hunting): get_auth_request con 0x7f7dac041620 auth_method 0 2024-08-18T21:03:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dc9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:03:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dca59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dca59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dca59c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:03:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dcad9d640 10 monclient(hunting): handle_auth_done global_id 4335 payload 293 2024-08-18T21:03:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dcad9d640 1 -- 172.21.15.5:0/711198068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7dac041620 msgr2=0x7f7dac043a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.757+0000 7f7dcad9d640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7dac041620 0x7f7dac043a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dcad9d640 1 -- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dac0472f0 msgr2=0x7f7dac049780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dcad9d640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dac0472f0 0x7f7dac049780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dcad9d640 10 monclient: _finish_hunting 0 2024-08-18T21:03:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dcad9d640 1 monclient: found mon.c 2024-08-18T21:03:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dcad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dcad9d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dcad9d640 1 -- 172.21.15.5:0/711198068 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7f7dac04a8f0 con 0x7f7dac0442c0 2024-08-18T21:03:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dcad9d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-08-18T21:03:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dcad9d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dcad9d640 1 -- 172.21.15.5:0/711198068 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7dc4042040 con 0x7f7dac0442c0 2024-08-18T21:03:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dcad9d640 10 monclient: _finish_auth 0 2024-08-18T21:03:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dcad9d640 10 monclient: _check_auth_tickets 2024-08-18T21:03:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dcad9d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dcad9d640 1 -- 172.21.15.5:0/711198068 reap_dead start 2024-08-18T21:03:45.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dcad9d640 1 -- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7dac0442c0 msgr2=0x7f7dac046750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:45.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dcad9d640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7dac0442c0 0x7f7dac046750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7db00057b0 tx=0x7f7dc400b040 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:45.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dc2ffd640 1 -- 172.21.15.5:0/711198068 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7dc401c540 con 0x7f7dac0442c0 2024-08-18T21:03:45.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:45.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dc2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:45.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dc2ffd640 10 monclient: dump: 2024-08-18T21:03:45.769 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:45.769 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:45.769 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.769 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:45.769 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:45.769 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:45.769 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:45.769 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:45.769 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:45.769 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:45.770 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:45.770 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:45.770 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:45.770 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:45.770 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:45.770 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:45.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dc2ffd640 1 -- 172.21.15.5:0/711198068 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc40039a0 con 0x7f7dac0442c0 2024-08-18T21:03:45.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dc2ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:45.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dc3fff640 4 set_mon_vals no callback set 2024-08-18T21:03:45.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dc2ffd640 1 -- 172.21.15.5:0/711198068 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f7dc40073f0 con 0x7f7dac0442c0 2024-08-18T21:03:45.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dc2ffd640 1 -- 172.21.15.5:0/711198068 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7dc4010040 con 0x7f7dac0442c0 2024-08-18T21:03:45.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dc2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-08-18T21:03:45.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.761+0000 7f7dc2ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:45.771 INFO:teuthology.orchestra.run.smithi005.stdout:47244640260 2024-08-18T21:03:45.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.765+0000 7f7dd0de5640 1 -- 172.21.15.5:0/711198068 >> v2:172.21.15.157:6812/631023601 conn(0x7f7dac03bdc0 msgr2=0x7f7dac03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.765+0000 7f7dd0de5640 1 --2- 172.21.15.5:0/711198068 >> v2:172.21.15.157:6812/631023601 conn(0x7f7dac03bdc0 0x7f7dac03e280 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7db40ab000 tx=0x7f7db4004740 comp rx=0 tx=0).stop 2024-08-18T21:03:45.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.765+0000 7f7dd0de5640 10 monclient: shutdown 2024-08-18T21:03:45.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.765+0000 7f7dd0de5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:45.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.765+0000 7f7dd0de5640 1 -- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7dac0442c0 msgr2=0x7f7dac046750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.765+0000 7f7dd0de5640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7dac0442c0 0x7f7dac046750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7db00057b0 tx=0x7f7dc400b040 comp rx=0 tx=0).stop 2024-08-18T21:03:45.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.765+0000 7f7dd0de5640 1 -- 172.21.15.5:0/711198068 shutdown_connections 2024-08-18T21:03:45.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.765+0000 7f7dd0de5640 1 --2- 172.21.15.5:0/711198068 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7dac0442c0 0x7f7dac046750 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.765+0000 7f7dd0de5640 1 --2- 172.21.15.5:0/711198068 >> v2:172.21.15.157:6812/631023601 conn(0x7f7dac03bdc0 0x7f7dac03e280 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.765+0000 7f7dd0de5640 1 -- 172.21.15.5:0/711198068 >> 172.21.15.5:0/711198068 conn(0x7f7dcc0688d0 msgr2=0x7f7dcc140910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:45.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.765+0000 7f7dd0de5640 1 -- 172.21.15.5:0/711198068 shutdown_connections 2024-08-18T21:03:45.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.765+0000 7f7dd0de5640 1 -- 172.21.15.5:0/711198068 wait complete. 2024-08-18T21:03:45.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.773+0000 7f7ae5c0c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-08-18T21:03:45.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.773+0000 7f7ae5c0c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-08-18T21:03:45.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.773+0000 7f7ae5c0c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:45.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.773+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/4077479471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7ae013a560 con 0x7f7ae0070440 2024-08-18T21:03:45.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ac7fff640 1 -- 172.21.15.5:0/4077479471 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7ad000cb50 con 0x7f7ae0070440 2024-08-18T21:03:45.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ac7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-08-18T21:03:45.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ac7fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:45.779 INFO:teuthology.orchestra.run.smithi005.stdout:47244640259 2024-08-18T21:03:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/4077479471 >> v2:172.21.15.157:6812/631023601 conn(0x7f7acc03bdf0 msgr2=0x7f7acc03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ae5c0c640 1 --2- 172.21.15.5:0/4077479471 >> v2:172.21.15.157:6812/631023601 conn(0x7f7acc03bdf0 0x7f7acc03e2b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ae013aae0 tx=0x7f7ad4007e40 comp rx=0 tx=0).stop 2024-08-18T21:03:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ae5c0c640 10 monclient: shutdown 2024-08-18T21:03:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ae5c0c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/4077479471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0070440 msgr2=0x7f7ae0131060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ae5c0c640 1 --2- 172.21.15.5:0/4077479471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0070440 0x7f7ae0131060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000e820 tx=0x7f7ad000ece0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/4077479471 shutdown_connections 2024-08-18T21:03:45.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ae5c0c640 1 --2- 172.21.15.5:0/4077479471 >> v2:172.21.15.157:6812/631023601 conn(0x7f7acc03bdf0 0x7f7acc03e2b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ae5c0c640 1 --2- 172.21.15.5:0/4077479471 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7ae0134460 0x7f7ae01380b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ae5c0c640 1 --2- 172.21.15.5:0/4077479471 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ae0133fa0 0x7f7ae01315a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ae5c0c640 1 --2- 172.21.15.5:0/4077479471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0070440 0x7f7ae0131060 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/4077479471 >> 172.21.15.5:0/4077479471 conn(0x7f7ae00a8a90 msgr2=0x7f7ae01333d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:45.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/4077479471 shutdown_connections 2024-08-18T21:03:45.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.777+0000 7f7ae5c0c640 1 -- 172.21.15.5:0/4077479471 wait complete. 2024-08-18T21:03:45.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.2 2024-08-18T21:03:45.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.1 2024-08-18T21:03:45.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f4340827640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-08-18T21:03:45.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f4340827640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-08-18T21:03:45.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f4340827640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:45.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f4340827640 1 -- 172.21.15.5:0/813815861 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f433c140a40 con 0x7f433c0a4cd0 2024-08-18T21:03:45.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f432affd640 1 -- 172.21.15.5:0/813815861 <== mon.4 v2:172.21.15.5:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f433c09e1a0 con 0x7f433c0a4cd0 2024-08-18T21:03:45.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f432affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-08-18T21:03:45.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f432affd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:45.821 INFO:teuthology.orchestra.run.smithi005.stdout:47244640259 2024-08-18T21:03:45.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f4340827640 1 -- 172.21.15.5:0/813815861 >> v2:172.21.15.157:6812/631023601 conn(0x7f431c03bdc0 msgr2=0x7f431c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f4340827640 1 --2- 172.21.15.5:0/813815861 >> v2:172.21.15.157:6812/631023601 conn(0x7f431c03bdc0 0x7f431c03e280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f433c076da0 tx=0x7f4330008040 comp rx=0 tx=0).stop 2024-08-18T21:03:45.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f4340827640 10 monclient: shutdown 2024-08-18T21:03:45.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f4340827640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:45.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f4340827640 1 -- 172.21.15.5:0/813815861 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f433c0a4cd0 msgr2=0x7f433c1d12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f4340827640 1 --2- 172.21.15.5:0/813815861 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f433c0a4cd0 0x7f433c1d12a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f432c009710 tx=0x7f432c018f60 comp rx=0 tx=0).stop 2024-08-18T21:03:45.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f4340827640 1 -- 172.21.15.5:0/813815861 shutdown_connections 2024-08-18T21:03:45.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f4340827640 1 --2- 172.21.15.5:0/813815861 >> v2:172.21.15.157:6812/631023601 conn(0x7f431c03bdc0 0x7f431c03e280 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f4340827640 1 --2- 172.21.15.5:0/813815861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f433c13a160 0x7f433c13e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f4340827640 1 --2- 172.21.15.5:0/813815861 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f433c139840 0x7f433c135ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f4340827640 1 --2- 172.21.15.5:0/813815861 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f433c0a4cd0 0x7f433c1d12a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.817+0000 7f4340827640 1 -- 172.21.15.5:0/813815861 >> 172.21.15.5:0/813815861 conn(0x7f433c0688d0 msgr2=0x7f433c0a7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:45.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.821+0000 7f4340827640 1 -- 172.21.15.5:0/813815861 shutdown_connections 2024-08-18T21:03:45.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.821+0000 7f4340827640 1 -- 172.21.15.5:0/813815861 wait complete. 2024-08-18T21:03:45.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.3 2024-08-18T21:03:45.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.873+0000 7f511daa9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-08-18T21:03:45.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.873+0000 7f511daa9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-08-18T21:03:45.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.873+0000 7f511daa9640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:03:45.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.873+0000 7f511daa9640 1 -- 172.21.15.5:0/3471563220 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f511806e1f0 con 0x7f51180a4960 2024-08-18T21:03:45.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.873+0000 7f5114ff9640 1 -- 172.21.15.5:0/3471563220 <== mon.5 v2:172.21.15.157:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f51080abd00 con 0x7f51180a4960 2024-08-18T21:03:45.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.873+0000 7f5114ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-08-18T21:03:45.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.873+0000 7f5114ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:45.876 INFO:teuthology.orchestra.run.smithi005.stdout:47244640259 2024-08-18T21:03:45.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.873+0000 7f4633c73640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-08-18T21:03:45.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-08-18T21:03:45.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:03:45.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 1 -- 172.21.15.5:0/2645563243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f462c0746d0 con 0x7f462c09f080 2024-08-18T21:03:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f511daa9640 1 -- 172.21.15.5:0/3471563220 >> v2:172.21.15.157:6812/631023601 conn(0x7f50f803bdc0 msgr2=0x7f50f803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f511daa9640 1 --2- 172.21.15.5:0/3471563220 >> v2:172.21.15.157:6812/631023601 conn(0x7f50f803bdc0 0x7f50f803e280 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5100007d30 tx=0x7f5100007c80 comp rx=0 tx=0).stop 2024-08-18T21:03:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f511daa9640 10 monclient: shutdown 2024-08-18T21:03:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f511daa9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f511daa9640 1 -- 172.21.15.5:0/3471563220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f51180a4960 msgr2=0x7f51181336e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f511daa9640 1 --2- 172.21.15.5:0/3471563220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f51180a4960 0x7f51181336e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f51080ad000 tx=0x7f5108019120 comp rx=0 tx=0).stop 2024-08-18T21:03:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f511daa9640 1 -- 172.21.15.5:0/3471563220 shutdown_connections 2024-08-18T21:03:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f511daa9640 1 --2- 172.21.15.5:0/3471563220 >> v2:172.21.15.157:6812/631023601 conn(0x7f50f803bdc0 0x7f50f803e280 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f511daa9640 1 --2- 172.21.15.5:0/3471563220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5118138e40 0x7f5118134160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f511daa9640 1 --2- 172.21.15.5:0/3471563220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f51180a5280 0x7f5118133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f511daa9640 1 --2- 172.21.15.5:0/3471563220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f51180a4960 0x7f51181336e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f511daa9640 1 -- 172.21.15.5:0/3471563220 >> 172.21.15.5:0/3471563220 conn(0x7f51180a6440 msgr2=0x7f51180a8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f511daa9640 1 -- 172.21.15.5:0/3471563220 shutdown_connections 2024-08-18T21:03:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f511daa9640 1 -- 172.21.15.5:0/3471563220 wait complete. 2024-08-18T21:03:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f46227fc640 1 -- 172.21.15.5:0/2645563243 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4628013620 con 0x7f462c09f080 2024-08-18T21:03:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f46227fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-08-18T21:03:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f46227fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:45.881 INFO:teuthology.orchestra.run.smithi005.stdout:51539607556 2024-08-18T21:03:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 1 -- 172.21.15.5:0/2645563243 >> v2:172.21.15.157:6812/631023601 conn(0x7f461003bd80 msgr2=0x7f461003e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 1 --2- 172.21.15.5:0/2645563243 >> v2:172.21.15.157:6812/631023601 conn(0x7f461003bd80 0x7f461003e240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f461c0ab000 tx=0x7f461c004740 comp rx=0 tx=0).stop 2024-08-18T21:03:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 10 monclient: shutdown 2024-08-18T21:03:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 1 -- 172.21.15.5:0/2645563243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f462c09f080 msgr2=0x7f462c13e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 1 --2- 172.21.15.5:0/2645563243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f462c09f080 0x7f462c13e940 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f462800e580 tx=0x7f462800ea40 comp rx=0 tx=0).stop 2024-08-18T21:03:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 1 -- 172.21.15.5:0/2645563243 shutdown_connections 2024-08-18T21:03:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 1 --2- 172.21.15.5:0/2645563243 >> v2:172.21.15.157:6812/631023601 conn(0x7f461003bd80 0x7f461003e240 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 1 --2- 172.21.15.5:0/2645563243 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f462c139990 0x7f462c13bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 1 --2- 172.21.15.5:0/2645563243 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f462c0a6bd0 0x7f462c072f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 1 --2- 172.21.15.5:0/2645563243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f462c09f080 0x7f462c13e940 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:45.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 1 -- 172.21.15.5:0/2645563243 >> 172.21.15.5:0/2645563243 conn(0x7f462c068700 msgr2=0x7f462c0a3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:45.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 1 -- 172.21.15.5:0/2645563243 shutdown_connections 2024-08-18T21:03:45.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:45.877+0000 7f4633c73640 1 -- 172.21.15.5:0/2645563243 wait complete. 2024-08-18T21:03:45.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.4 2024-08-18T21:03:45.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607556 for osd.0 2024-08-18T21:03:46.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-18T21:03:46.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-18T21:03:46.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-18T21:03:46.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-18T21:03:46.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 10 monclient: get_monmap_and_config 2024-08-18T21:03:46.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 10 monclient: build_initial_monmap 2024-08-18T21:03:46.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 10 monclient: monmap: 2024-08-18T21:03:46.879 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:46.879 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.879 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:46.880778+0000 2024-08-18T21:03:46.879 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:46.880778+0000 2024-08-18T21:03:46.879 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:46.879 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.879 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:46.879 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:46.879 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:46.879 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:46.879 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:46.880 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:46.880 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:46.880 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:46.880 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:46.880 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:46.880 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:46.880 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 1 Processor -- start 2024-08-18T21:03:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 1 -- start start 2024-08-18T21:03:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 10 monclient: init 2024-08-18T21:03:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 10 monclient: _add_conns ranks=[5,2,3,4,10,1,7,0,6,9,8] 2024-08-18T21:03:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2cb006c950 0x7f2cb009ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 10 monclient(hunting): picked mon.noname-h con 0x7f2cb006c950 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2cb006cd30 0x7f2cb006d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 10 monclient(hunting): picked mon.noname-b con 0x7f2cb006cd30 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cb01396d0 0x7f2cb0139ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 10 monclient(hunting): picked mon.noname-g con 0x7f2cb01396d0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb009e1c0 con 0x7f2cb006cd30 2024-08-18T21:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb009f4b0 con 0x7f2cb01396d0 2024-08-18T21:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f2cb009dee0 con 0x7f2cb006c950 2024-08-18T21:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb69d5640 10 monclient(hunting): authenticate will time out at 993.893686s 2024-08-18T21:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2cb006cd30 0x7f2cb006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2cb006cd30 0x7f2cb006d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34150/0 (socket says 172.21.15.5:34150) 2024-08-18T21:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 1 -- 172.21.15.5:0/328656075 learned_addr learned my addr 172.21.15.5:0/328656075 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 10 monclient(hunting): get_auth_request con 0x7f2cb006cd30 auth_method 0 2024-08-18T21:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caffff640 1 --2- 172.21.15.5:0/328656075 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2cb006c950 0x7f2cb009ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb4f72640 1 --2- 172.21.15.5:0/328656075 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cb01396d0 0x7f2cb0139ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caffff640 10 monclient(hunting): get_auth_request con 0x7f2cb006c950 auth_method 0 2024-08-18T21:03:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb4f72640 10 monclient(hunting): get_auth_request con 0x7f2cb01396d0 auth_method 0 2024-08-18T21:03:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb4f72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb4f72640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2cb4f72640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 10 monclient(hunting): handle_auth_done global_id 4367 payload 274 2024-08-18T21:03:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 1 -- 172.21.15.5:0/328656075 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2cb006c950 msgr2=0x7f2cb009ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 1 --2- 172.21.15.5:0/328656075 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2cb006c950 0x7f2cb009ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 1 -- 172.21.15.5:0/328656075 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cb01396d0 msgr2=0x7f2cb0139ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 1 --2- 172.21.15.5:0/328656075 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cb01396d0 0x7f2cb0139ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 1 monclient: found mon.noname-b 2024-08-18T21:03:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.877+0000 7f2caf7fe640 1 -- 172.21.15.5:0/328656075 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb009e4a0 con 0x7f2cb006cd30 2024-08-18T21:03:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2caf7fe640 1 -- 172.21.15.5:0/328656075 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2cb006cd30 msgr2=0x7f2cb006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2caf7fe640 1 --2- 172.21.15.5:0/328656075 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2cb006cd30 0x7f2cb006d110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40098a0 tx=0x7f2ca401c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4f691745bb82486 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2caeffd640 1 -- 172.21.15.5:0/328656075 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2ca40b2070 con 0x7f2cb006cd30 2024-08-18T21:03:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2caeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2caeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2caeffd640 10 monclient: dump: 2024-08-18T21:03:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:46.890 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2caeffd640 10 monclient: _finish_auth 0 2024-08-18T21:03:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2caeffd640 10 monclient: _check_auth_tickets 2024-08-18T21:03:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2caeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2caeffd640 1 -- 172.21.15.5:0/328656075 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca40ab7f0 con 0x7f2cb006cd30 2024-08-18T21:03:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2cb69d5640 5 monclient: authenticate success, global_id 4367 2024-08-18T21:03:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2cb69d5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2caeffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2cb69d5640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2cb69d5640 4 set_mon_vals no callback set 2024-08-18T21:03:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2caeffd640 1 -- 172.21.15.5:0/328656075 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2ca40abe10 con 0x7f2cb006cd30 2024-08-18T21:03:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2caeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2caeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2caeffd640 10 monclient: dump: 2024-08-18T21:03:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:46.892 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2cb69d5640 10 monclient: shutdown 2024-08-18T21:03:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2cb69d5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2cb69d5640 1 -- 172.21.15.5:0/328656075 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2cb006cd30 msgr2=0x7f2cb006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2cb69d5640 1 --2- 172.21.15.5:0/328656075 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2cb006cd30 0x7f2cb006d110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40098a0 tx=0x7f2ca401c440 comp rx=0 tx=0).stop 2024-08-18T21:03:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2cb69d5640 1 -- 172.21.15.5:0/328656075 shutdown_connections 2024-08-18T21:03:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2cb69d5640 1 --2- 172.21.15.5:0/328656075 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cb01396d0 0x7f2cb0139ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2cb69d5640 1 --2- 172.21.15.5:0/328656075 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2cb006cd30 0x7f2cb006d110 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2cb69d5640 1 --2- 172.21.15.5:0/328656075 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2cb006c950 0x7f2cb009ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2cb69d5640 1 -- 172.21.15.5:0/328656075 >> 172.21.15.5:0/328656075 conn(0x7f2cb00688d0 msgr2=0x7f2cb0068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2cb69d5640 1 -- 172.21.15.5:0/328656075 shutdown_connections 2024-08-18T21:03:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.881+0000 7f2cb69d5640 1 -- 172.21.15.5:0/328656075 wait complete. 2024-08-18T21:03:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 10 monclient: build_initial_monmap 2024-08-18T21:03:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 10 monclient: monmap: 2024-08-18T21:03:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:46.894 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 1 Processor -- start 2024-08-18T21:03:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 1 -- start start 2024-08-18T21:03:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 10 monclient: init 2024-08-18T21:03:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 10 monclient: _add_conns ranks=[5,7,8,3,4,0,6,1,2] 2024-08-18T21:03:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2cb006c950 0x7f2cb0122600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 10 monclient(hunting): picked mon.noname-h con 0x7f2cb006c950 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2cb006cd30 0x7f2cb01d1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 10 monclient(hunting): picked mon.noname-i con 0x7f2cb006cd30 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2cb01396d0 0x7f2cb0120070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 10 monclient(hunting): picked mon.noname-e con 0x7f2cb01396d0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f2cb0143580 con 0x7f2cb006c950 2024-08-18T21:03:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f2cb0143400 con 0x7f2cb006cd30 2024-08-18T21:03:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f2cb0143700 con 0x7f2cb01396d0 2024-08-18T21:03:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb69d5640 10 monclient(hunting): authenticate will time out at 993.901233s 2024-08-18T21:03:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2cb01396d0 0x7f2cb0120070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2cb01396d0 0x7f2cb0120070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47438/0 (socket says 172.21.15.5:47438) 2024-08-18T21:03:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 1 -- 172.21.15.5:0/1377142843 learned_addr learned my addr 172.21.15.5:0/1377142843 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 10 monclient(hunting): get_auth_request con 0x7f2cb01396d0 auth_method 0 2024-08-18T21:03:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2caffff640 1 --2- 172.21.15.5:0/1377142843 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2cb006c950 0x7f2cb0122600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2caf7fe640 1 --2- 172.21.15.5:0/1377142843 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2cb006cd30 0x7f2cb01d1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2caffff640 10 monclient(hunting): get_auth_request con 0x7f2cb006c950 auth_method 0 2024-08-18T21:03:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2caffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2caffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2caffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2caf7fe640 10 monclient(hunting): get_auth_request con 0x7f2cb006cd30 auth_method 0 2024-08-18T21:03:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2caf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2caf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2caf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 10 monclient(hunting): handle_auth_done global_id 4256 payload 824 2024-08-18T21:03:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 1 -- 172.21.15.5:0/1377142843 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2cb006cd30 msgr2=0x7f2cb01d1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 1 --2- 172.21.15.5:0/1377142843 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2cb006cd30 0x7f2cb01d1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 1 -- 172.21.15.5:0/1377142843 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2cb006c950 msgr2=0x7f2cb0122600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 1 --2- 172.21.15.5:0/1377142843 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2cb006c950 0x7f2cb0122600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 10 monclient: _finish_hunting 0 2024-08-18T21:03:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 1 monclient: found mon.noname-e 2024-08-18T21:03:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2cb4f72640 1 -- 172.21.15.5:0/1377142843 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb0123b20 con 0x7f2cb01396d0 2024-08-18T21:03:46.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.885+0000 7f2caffff640 1 --2- 172.21.15.5:0/1377142843 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2cb006c950 0x7f2cb0122600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:03:46.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cb4f72640 1 -- 172.21.15.5:0/1377142843 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2cb01396d0 msgr2=0x7f2cb0120070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:46.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cb4f72640 1 --2- 172.21.15.5:0/1377142843 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2cb01396d0 0x7f2cb0120070 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8007e60 tx=0x7f2ca800e4b0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:46.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cacff9640 1 -- 172.21.15.5:0/1377142843 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2ca8014890 con 0x7f2cb01396d0 2024-08-18T21:03:46.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cacff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:46.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cacff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:46.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cacff9640 10 monclient: dump: 2024-08-18T21:03:46.900 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:46.900 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.900 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.900 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.900 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:46.900 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.900 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:46.900 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:46.900 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:46.900 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:46.900 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:46.900 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:46.900 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:46.901 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cacff9640 10 monclient: _finish_auth 0 2024-08-18T21:03:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cacff9640 10 monclient: _check_auth_tickets 2024-08-18T21:03:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cacff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cb69d5640 5 monclient: authenticate success, global_id 4256 2024-08-18T21:03:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cacff9640 1 -- 172.21.15.5:0/1377142843 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca8019070 con 0x7f2cb01396d0 2024-08-18T21:03:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cacff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cacff9640 1 -- 172.21.15.5:0/1377142843 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2ca8013380 con 0x7f2cb01396d0 2024-08-18T21:03:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cb69d5640 10 monclient: _renew_subs 2024-08-18T21:03:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cb69d5640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cb69d5640 1 -- 172.21.15.5:0/1377142843 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb0123e00 con 0x7f2cb01396d0 2024-08-18T21:03:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cacff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:46.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cae7fc640 4 set_mon_vals no callback set 2024-08-18T21:03:46.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cacff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:46.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cacff9640 10 monclient: dump: 2024-08-18T21:03:46.902 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:46.902 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.902 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.902 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.902 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:46.902 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.902 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:46.902 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:46.902 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:46.903 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cb69d5640 10 monclient: _renew_subs 2024-08-18T21:03:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cb69d5640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cb69d5640 1 -- 172.21.15.5:0/1377142843 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb0122f90 con 0x7f2cb01396d0 2024-08-18T21:03:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2c967fc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2c967fc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2c967fc640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2c967fc640 1 -- 172.21.15.5:0/1377142843 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c88005090 con 0x7f2cb01396d0 2024-08-18T21:03:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cacff9640 1 -- 172.21.15.5:0/1377142843 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f2ca8014420 con 0x7f2cb01396d0 2024-08-18T21:03:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cacff9640 1 --2- 172.21.15.5:0/1377142843 >> v2:172.21.15.157:6812/631023601 conn(0x7f2c9c03bdc0 0x7f2c9c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2cacff9640 1 -- 172.21.15.5:0/1377142843 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f2ca804ed90 con 0x7f2cb01396d0 2024-08-18T21:03:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2caffff640 1 --2- 172.21.15.5:0/1377142843 >> v2:172.21.15.157:6812/631023601 conn(0x7f2c9c03bdc0 0x7f2c9c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.889+0000 7f2caffff640 10 monclient: get_auth_request con 0x7f2c9c03bdc0 auth_method 0 2024-08-18T21:03:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.893+0000 7f2caffff640 1 --2- 172.21.15.5:0/1377142843 >> v2:172.21.15.157:6812/631023601 conn(0x7f2c9c03bdc0 0x7f2c9c03e280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0007a70 tx=0x7f2ca0008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:46.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-18T21:03:46.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-18T21:03:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.897+0000 7f2cacff9640 1 -- 172.21.15.5:0/1377142843 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f2ca8013520 con 0x7f2cb01396d0 2024-08-18T21:03:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.897+0000 7f2cacff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.897+0000 7f2cacff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:46.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.925+0000 7ff37d8cb640 10 monclient: get_monmap_and_config 2024-08-18T21:03:46.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.925+0000 7ff37d8cb640 10 monclient: build_initial_monmap 2024-08-18T21:03:46.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.925+0000 7ff37d8cb640 10 monclient: monmap: 2024-08-18T21:03:46.930 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:46.930 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.930 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:46.931957+0000 2024-08-18T21:03:46.930 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:46.931957+0000 2024-08-18T21:03:46.930 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:46.930 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.931 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:46.931 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:46.931 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:46.931 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:46.931 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:46.931 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:46.931 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:46.931 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:46.931 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:46.931 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:46.931 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:46.931 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 1 Processor -- start 2024-08-18T21:03:46.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 1 -- start start 2024-08-18T21:03:46.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 10 monclient: init 2024-08-18T21:03:46.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:46.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 10 monclient: _add_conns ranks=[8,9,2,1,3,0,5,10,6,4,7] 2024-08-18T21:03:46.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff3780a6bd0 0x7ff3780a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 10 monclient(hunting): picked mon.noname-e con 0x7ff3780a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:46.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff37809f080 0x7ff3780a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 10 monclient(hunting): picked mon.noname-a con 0x7ff37809f080 addr v2:172.21.15.5:3300/0 2024-08-18T21:03:46.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff378139990 0x7ff378139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 10 monclient(hunting): picked mon.noname-b con 0x7ff378139990 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:46.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff37809e4c0 con 0x7ff37809f080 2024-08-18T21:03:46.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7ff37806f930 con 0x7ff378139990 2024-08-18T21:03:46.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff3780a7a30 con 0x7ff3780a6bd0 2024-08-18T21:03:46.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:46.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff37d8cb640 10 monclient(hunting): authenticate will time out at 993.945446s 2024-08-18T21:03:46.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3767fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff37809f080 0x7ff3780a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff378139990 0x7ff378139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3767fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff37809f080 0x7ff3780a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46752/0 (socket says 172.21.15.5:46752) 2024-08-18T21:03:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3767fc640 1 -- 172.21.15.5:0/1968225808 learned_addr learned my addr 172.21.15.5:0/1968225808 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3767fc640 10 monclient(hunting): get_auth_request con 0x7ff37809f080 auth_method 0 2024-08-18T21:03:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3767fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3767fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3767fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 10 monclient(hunting): get_auth_request con 0x7ff378139990 auth_method 0 2024-08-18T21:03:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3767fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3767fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3767fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:46.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:46.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:46.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:46.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff376ffd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff3780a6bd0 0x7ff3780a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 10 monclient(hunting): handle_auth_done global_id 4376 payload 274 2024-08-18T21:03:46.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 1 -- 172.21.15.5:0/1968225808 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff3780a6bd0 msgr2=0x7ff3780a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:46.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 1 --2- 172.21.15.5:0/1968225808 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff3780a6bd0 0x7ff3780a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 1 -- 172.21.15.5:0/1968225808 >> v2:172.21.15.5:3300/0 conn(0x7ff37809f080 msgr2=0x7ff3780a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:46.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 1 --2- 172.21.15.5:0/1968225808 >> v2:172.21.15.5:3300/0 conn(0x7ff37809f080 0x7ff3780a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:46.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 1 monclient: found mon.noname-b 2024-08-18T21:03:46.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:46.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:46.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3777fe640 1 -- 172.21.15.5:0/1968225808 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3780a7fb0 con 0x7ff378139990 2024-08-18T21:03:46.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.929+0000 7ff3767fc640 1 --2- 172.21.15.5:0/1968225808 >> v2:172.21.15.5:3300/0 conn(0x7ff37809f080 0x7ff3780a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:46.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.933+0000 7ff376ffd640 10 monclient: get_auth_request con 0x7ff3780a6bd0 auth_method 0 2024-08-18T21:03:46.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.933+0000 7ff376ffd640 1 --2- 172.21.15.5:0/1968225808 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff3780a6bd0 0x7ff3780a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:46.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.933+0000 7ff3777fe640 1 -- 172.21.15.5:0/1968225808 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff378139990 msgr2=0x7ff378139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:46.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.933+0000 7ff3777fe640 1 --2- 172.21.15.5:0/1968225808 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff378139990 0x7ff378139e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff370009d90 tx=0x7ff37001c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0da5ecf7da6ecca server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:46.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.933+0000 7ff375ffb640 1 -- 172.21.15.5:0/1968225808 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff3700b2070 con 0x7ff378139990 2024-08-18T21:03:46.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.933+0000 7ff375ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:46.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff375ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:46.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff375ffb640 10 monclient: dump: 2024-08-18T21:03:46.938 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:46.939 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.939 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.939 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.939 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:46.939 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.939 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:46.939 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:46.939 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:46.939 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:46.939 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:46.939 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:46.939 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:46.939 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:46.939 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:46.940 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff375ffb640 10 monclient: _finish_auth 0 2024-08-18T21:03:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff375ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:03:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff375ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff375ffb640 1 -- 172.21.15.5:0/1968225808 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3700a59d0 con 0x7ff378139990 2024-08-18T21:03:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 5 monclient: authenticate success, global_id 4376 2024-08-18T21:03:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff375ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff375ffb640 1 -- 172.21.15.5:0/1968225808 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff3700a5bc0 con 0x7ff378139990 2024-08-18T21:03:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff375ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 4 set_mon_vals no callback set 2024-08-18T21:03:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff375ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:46.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff375ffb640 10 monclient: dump: 2024-08-18T21:03:46.941 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:46.941 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.941 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.941 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.941 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:46.941 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.941 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:46.941 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:46.941 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:46.941 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:46.941 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:46.941 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:46.941 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:46.942 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:46.942 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:46.942 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 10 monclient: shutdown 2024-08-18T21:03:46.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:46.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 -- 172.21.15.5:0/1968225808 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff378139990 msgr2=0x7ff378139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:46.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 --2- 172.21.15.5:0/1968225808 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff378139990 0x7ff378139e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff370009d90 tx=0x7ff37001c850 comp rx=0 tx=0).stop 2024-08-18T21:03:46.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 -- 172.21.15.5:0/1968225808 shutdown_connections 2024-08-18T21:03:46.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 --2- 172.21.15.5:0/1968225808 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff378139990 0x7ff378139e10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 --2- 172.21.15.5:0/1968225808 >> v2:172.21.15.5:3300/0 conn(0x7ff37809f080 0x7ff3780a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 --2- 172.21.15.5:0/1968225808 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff3780a6bd0 0x7ff3780a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 -- 172.21.15.5:0/1968225808 >> 172.21.15.5:0/1968225808 conn(0x7ff378068700 msgr2=0x7ff378068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:46.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 -- 172.21.15.5:0/1968225808 shutdown_connections 2024-08-18T21:03:46.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 -- 172.21.15.5:0/1968225808 wait complete. 2024-08-18T21:03:46.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 10 monclient: build_initial_monmap 2024-08-18T21:03:46.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 10 monclient: monmap: 2024-08-18T21:03:46.945 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:46.945 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:46.945 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:46.945 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:46.945 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:46.945 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.945 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:46.945 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:46.945 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:46.945 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:46.945 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:46.945 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:46.945 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:46.945 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:46.946 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 Processor -- start 2024-08-18T21:03:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 -- start start 2024-08-18T21:03:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 10 monclient: init 2024-08-18T21:03:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 10 monclient: _add_conns ranks=[1,7,8,3,4,0,2,6,5] 2024-08-18T21:03:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff37809f080 0x7ff378138480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 10 monclient(hunting): picked mon.noname-f con 0x7ff37809f080 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff3780a6bd0 0x7ff3781389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 10 monclient(hunting): picked mon.noname-i con 0x7ff3780a6bd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff378139990 0x7ff37813d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 10 monclient(hunting): picked mon.noname-e con 0x7ff378139990 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:46.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff3780a89f0 con 0x7ff37809f080 2024-08-18T21:03:46.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7ff3780a7ce0 con 0x7ff3780a6bd0 2024-08-18T21:03:46.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff378143610 con 0x7ff378139990 2024-08-18T21:03:46.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:46.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff37d8cb640 10 monclient(hunting): authenticate will time out at 993.955605s 2024-08-18T21:03:46.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff3777fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff378139990 0x7ff37813d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff3777fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff378139990 0x7ff37813d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47458/0 (socket says 172.21.15.5:47458) 2024-08-18T21:03:46.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff3777fe640 1 -- 172.21.15.5:0/585807084 learned_addr learned my addr 172.21.15.5:0/585807084 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:46.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff3777fe640 10 monclient(hunting): get_auth_request con 0x7ff378139990 auth_method 0 2024-08-18T21:03:46.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff3777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff3777fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff3777fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff3777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:46.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff3777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:46.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff3777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:46.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff3777fe640 10 monclient(hunting): handle_auth_done global_id 4265 payload 824 2024-08-18T21:03:46.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff3777fe640 1 -- 172.21.15.5:0/585807084 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff3780a6bd0 msgr2=0x7ff3781389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:46.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.937+0000 7ff3767fc640 1 --2- 172.21.15.5:0/585807084 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff3780a6bd0 0x7ff3781389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff3777fe640 1 --2- 172.21.15.5:0/585807084 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff3780a6bd0 0x7ff3781389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff3777fe640 1 -- 172.21.15.5:0/585807084 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff37809f080 msgr2=0x7ff378138480 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-18T21:03:46.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff3777fe640 1 --2- 172.21.15.5:0/585807084 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff37809f080 0x7ff378138480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff3777fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:46.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff3777fe640 1 monclient: found mon.noname-e 2024-08-18T21:03:46.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff3777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:46.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff3777fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:46.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff3777fe640 1 -- 172.21.15.5:0/585807084 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff378124170 con 0x7ff378139990 2024-08-18T21:03:46.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff3767fc640 10 monclient: get_auth_request con 0x7ff3780a6bd0 auth_method 0 2024-08-18T21:03:46.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff3767fc640 1 --2- 172.21.15.5:0/585807084 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff3780a6bd0 0x7ff3781389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:46.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff3777fe640 1 -- 172.21.15.5:0/585807084 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff378139990 msgr2=0x7ff37813d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:46.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff3777fe640 1 --2- 172.21.15.5:0/585807084 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff378139990 0x7ff37813d9f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff37001c680 tx=0x7ff3700195f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:46.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff35ffff640 1 -- 172.21.15.5:0/585807084 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff3700b2050 con 0x7ff378139990 2024-08-18T21:03:46.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff35ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:46.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff35ffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:46.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff35ffff640 10 monclient: dump: 2024-08-18T21:03:46.950 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:46.950 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.951 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.951 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.951 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:46.951 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.951 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:46.951 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:46.951 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:46.951 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:46.951 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:46.951 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:46.951 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:46.951 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:46.951 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:46.952 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff35ffff640 10 monclient: _finish_auth 0 2024-08-18T21:03:46.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff35ffff640 10 monclient: _check_auth_tickets 2024-08-18T21:03:46.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff35ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:46.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff35ffff640 1 -- 172.21.15.5:0/585807084 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3700be070 con 0x7ff378139990 2024-08-18T21:03:46.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff35ffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:46.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff35ffff640 1 -- 172.21.15.5:0/585807084 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff370003bb0 con 0x7ff378139990 2024-08-18T21:03:46.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff35ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:46.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff35ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:46.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff35ffff640 10 monclient: dump: 2024-08-18T21:03:46.952 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:46.952 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.952 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.952 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff37d8cb640 5 monclient: authenticate success, global_id 4265 2024-08-18T21:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff37d8cb640 10 monclient: _renew_subs 2024-08-18T21:03:46.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff37d8cb640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:46.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff37d8cb640 1 -- 172.21.15.5:0/585807084 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3780ab300 con 0x7ff378139990 2024-08-18T21:03:46.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff37d8cb640 10 monclient: _renew_subs 2024-08-18T21:03:46.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff37d8cb640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:46.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff37d8cb640 1 -- 172.21.15.5:0/585807084 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7ff378139570 con 0x7ff378139990 2024-08-18T21:03:46.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.941+0000 7ff3757fa640 4 set_mon_vals no callback set 2024-08-18T21:03:46.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.945+0000 7ff37d8cb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:46.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.945+0000 7ff37d8cb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:46.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.945+0000 7ff37d8cb640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:46.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.945+0000 7ff37d8cb640 1 -- 172.21.15.5:0/585807084 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff358005090 con 0x7ff378139990 2024-08-18T21:03:46.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.945+0000 7ff35ffff640 1 -- 172.21.15.5:0/585807084 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7ff370004040 con 0x7ff378139990 2024-08-18T21:03:46.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.945+0000 7ff35ffff640 1 --2- 172.21.15.5:0/585807084 >> v2:172.21.15.157:6812/631023601 conn(0x7ff36403bdc0 0x7ff36403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.945+0000 7ff35ffff640 1 -- 172.21.15.5:0/585807084 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7ff3700e9480 con 0x7ff378139990 2024-08-18T21:03:46.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.945+0000 7ff376ffd640 1 --2- 172.21.15.5:0/585807084 >> v2:172.21.15.157:6812/631023601 conn(0x7ff36403bdc0 0x7ff36403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.945+0000 7ff376ffd640 10 monclient: get_auth_request con 0x7ff36403bdc0 auth_method 0 2024-08-18T21:03:46.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.949+0000 7ff376ffd640 1 --2- 172.21.15.5:0/585807084 >> v2:172.21.15.157:6812/631023601 conn(0x7ff36403bdc0 0x7ff36403e280 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff368006b20 tx=0x7ff368008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:46.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.953+0000 7ff35ffff640 1 -- 172.21.15.5:0/585807084 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7ff370016560 con 0x7ff378139990 2024-08-18T21:03:46.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.953+0000 7ff35ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:46.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.953+0000 7ff35ffff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:46.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.961+0000 7fed23380640 10 monclient: get_monmap_and_config 2024-08-18T21:03:46.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.961+0000 7fe1f5ee7640 10 monclient: get_monmap_and_config 2024-08-18T21:03:46.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.961+0000 7fe1f5ee7640 10 monclient: build_initial_monmap 2024-08-18T21:03:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.961+0000 7fe1f5ee7640 10 monclient: monmap: 2024-08-18T21:03:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:46.967491+0000 2024-08-18T21:03:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:46.967491+0000 2024-08-18T21:03:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:46.967 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.961+0000 7fed23380640 10 monclient: build_initial_monmap 2024-08-18T21:03:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.961+0000 7fed23380640 10 monclient: monmap: 2024-08-18T21:03:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:46.967480+0000 2024-08-18T21:03:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:46.967480+0000 2024-08-18T21:03:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:46.969 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.961+0000 7fe1f5ee7640 1 Processor -- start 2024-08-18T21:03:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.961+0000 7fe1f5ee7640 1 -- start start 2024-08-18T21:03:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.961+0000 7fe1f5ee7640 10 monclient: init 2024-08-18T21:03:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1f5ee7640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1f5ee7640 10 monclient: _add_conns ranks=[8,2,1,6,3,7,4,10,9,0,5] 2024-08-18T21:03:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1f5ee7640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe1f009da30 0x7fe1f00a0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1f5ee7640 10 monclient(hunting): picked mon.noname-e con 0x7fe1f009da30 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1f5ee7640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe1f009de10 0x7fe1f009e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1f5ee7640 10 monclient(hunting): picked mon.noname-b con 0x7fe1f009de10 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1f5ee7640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fe1f01367f0 addr v1:172.21.15.157:6789/0 2024-08-18T21:03:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1f5ee7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f009fbc0 con 0x7fe1f01367f0 2024-08-18T21:03:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1f5ee7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1f5ee7640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f00a3220 con 0x7fe1f009de10 2024-08-18T21:03:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1f5ee7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1f5ee7640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fe1f009f600 con 0x7fe1f009da30 2024-08-18T21:03:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1f5ee7640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1f5ee7640 10 monclient(hunting): authenticate will time out at 993.980356s 2024-08-18T21:03:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe1f009da30 0x7fe1f00a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1eeffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe1f009de10 0x7fe1f009e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe1f009da30 0x7fe1f00a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47470/0 (socket says 172.21.15.5:47470) 2024-08-18T21:03:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 1 -- 172.21.15.5:0/2819319748 learned_addr learned my addr 172.21.15.5:0/2819319748 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 10 monclient(hunting): get_auth_request con 0x7fe1f009da30 auth_method 0 2024-08-18T21:03:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1eeffd640 10 monclient(hunting): get_auth_request con 0x7fe1f009de10 auth_method 0 2024-08-18T21:03:46.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1eeffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:46.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:46.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:46.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:46.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 10 monclient(hunting): handle_auth_done global_id 4274 payload 274 2024-08-18T21:03:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 1 -- 172.21.15.5:0/2819319748 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe1f009de10 msgr2=0x7fe1f009e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 1 --2- 172.21.15.5:0/2819319748 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe1f009de10 0x7fe1f009e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 1 -- 172.21.15.5:0/2819319748 >> v1:172.21.15.157:6789/0 conn(0x7fe1f01367f0 legacy=0x7fe1f0136c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 1 monclient: found mon.noname-e 2024-08-18T21:03:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fe1ef7fe640 1 -- 172.21.15.5:0/2819319748 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f009f8e0 con 0x7fe1f009da30 2024-08-18T21:03:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 1 Processor -- start 2024-08-18T21:03:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 1 -- start start 2024-08-18T21:03:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 10 monclient: init 2024-08-18T21:03:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 10 monclient: _add_conns ranks=[3,7,8,0,10,6,2,1,9,5,4] 2024-08-18T21:03:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed1c0a6bd0 0x7fed1c0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 10 monclient(hunting): picked mon.noname-g con 0x7fed1c0a6bd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fed1c09f080 0x7fed1c0a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 10 monclient(hunting): picked mon.noname-i con 0x7fed1c09f080 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fed1c139990 0x7fed1c139df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 10 monclient(hunting): picked mon.noname-e con 0x7fed1c139990 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fed1c09e4c0 con 0x7fed1c0a6bd0 2024-08-18T21:03:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fed1c06f930 con 0x7fed1c09f080 2024-08-18T21:03:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fed1c0a7a30 con 0x7fed1c139990 2024-08-18T21:03:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed23380640 10 monclient(hunting): authenticate will time out at 993.983583s 2024-08-18T21:03:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed2191d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fed1c139990 0x7fed1c139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed2111c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed1c0a6bd0 0x7fed1c0a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed2191d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fed1c139990 0x7fed1c139df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47478/0 (socket says 172.21.15.5:47478) 2024-08-18T21:03:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed2191d640 1 -- 172.21.15.5:0/577005656 learned_addr learned my addr 172.21.15.5:0/577005656 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed2191d640 10 monclient(hunting): get_auth_request con 0x7fed1c139990 auth_method 0 2024-08-18T21:03:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed2191d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed2191d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.965+0000 7fed2191d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2111c640 10 monclient(hunting): get_auth_request con 0x7fed1c0a6bd0 auth_method 0 2024-08-18T21:03:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2111c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2111c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2111c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2191d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2191d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2191d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2111c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2111c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2091b640 1 --2- 172.21.15.5:0/577005656 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fed1c09f080 0x7fed1c0a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2111c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2091b640 10 monclient(hunting): get_auth_request con 0x7fed1c09f080 auth_method 0 2024-08-18T21:03:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2091b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2091b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2091b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2191d640 10 monclient(hunting): handle_auth_done global_id 4283 payload 274 2024-08-18T21:03:46.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ef7fe640 1 -- 172.21.15.5:0/2819319748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe1f009da30 msgr2=0x7fe1f00a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:46.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ef7fe640 1 --2- 172.21.15.5:0/2819319748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe1f009da30 0x7fe1f00a0600 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00098a0 tx=0x7fe1e001e650 comp rx=0 tx=0).ready entity=mon.8 client_cookie=d16f1b3b6510b904 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ee7fc640 1 -- 172.21.15.5:0/2819319748 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe1e00ac870 con 0x7fe1f009da30 2024-08-18T21:03:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ee7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ee7fc640 10 monclient: dump: 2024-08-18T21:03:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:46.983 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ee7fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ee7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 5 monclient: authenticate success, global_id 4274 2024-08-18T21:03:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ee7fc640 1 -- 172.21.15.5:0/2819319748 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e00b1070 con 0x7fe1f009da30 2024-08-18T21:03:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ee7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 4 set_mon_vals no callback set 2024-08-18T21:03:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ee7fc640 1 -- 172.21.15.5:0/2819319748 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe1e00ab360 con 0x7fe1f009da30 2024-08-18T21:03:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ee7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ee7fc640 10 monclient: dump: 2024-08-18T21:03:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 10 monclient: shutdown 2024-08-18T21:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 1 -- 172.21.15.5:0/2819319748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe1f009da30 msgr2=0x7fe1f00a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 1 --2- 172.21.15.5:0/2819319748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe1f009da30 0x7fe1f00a0600 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00098a0 tx=0x7fe1e001e650 comp rx=0 tx=0).stop 2024-08-18T21:03:46.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 1 -- 172.21.15.5:0/2819319748 shutdown_connections 2024-08-18T21:03:46.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 1 --2- 172.21.15.5:0/2819319748 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe1f009de10 0x7fe1f009e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 1 --2- 172.21.15.5:0/2819319748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe1f009da30 0x7fe1f00a0600 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 1 -- 172.21.15.5:0/2819319748 >> 172.21.15.5:0/2819319748 conn(0x7fe1f00688d0 msgr2=0x7fe1f0068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:46.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 1 -- 172.21.15.5:0/2819319748 shutdown_connections 2024-08-18T21:03:46.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 1 -- 172.21.15.5:0/2819319748 wait complete. 2024-08-18T21:03:46.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 10 monclient: build_initial_monmap 2024-08-18T21:03:46.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 10 monclient: monmap: 2024-08-18T21:03:46.986 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:46.986 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:46.986 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:46.986 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:46.987 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 1 Processor -- start 2024-08-18T21:03:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 1 -- start start 2024-08-18T21:03:46.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 10 monclient: init 2024-08-18T21:03:46.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2191d640 1 -- 172.21.15.5:0/577005656 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fed1c09f080 msgr2=0x7fed1c0a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:46.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2191d640 1 --2- 172.21.15.5:0/577005656 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fed1c09f080 0x7fed1c0a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2191d640 1 -- 172.21.15.5:0/577005656 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed1c0a6bd0 msgr2=0x7fed1c0a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:46.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2191d640 1 --2- 172.21.15.5:0/577005656 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed1c0a6bd0 0x7fed1c0a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2191d640 10 monclient: _finish_hunting 0 2024-08-18T21:03:46.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2191d640 1 monclient: found mon.noname-e 2024-08-18T21:03:46.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2191d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:46.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2191d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:46.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2191d640 1 -- 172.21.15.5:0/577005656 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1c0a7fb0 con 0x7fed1c139990 2024-08-18T21:03:46.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fed2091b640 1 --2- 172.21.15.5:0/577005656 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fed1c09f080 0x7fed1c0a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:03:46.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 10 monclient: _add_conns ranks=[6,0,2,7,3,5,8,1,4] 2024-08-18T21:03:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe1f009de10 0x7fe1f0135980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 10 monclient(hunting): picked mon.noname-d con 0x7fe1f009de10 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1f01367f0 0x7fe1f01202f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 10 monclient(hunting): picked mon.noname-a con 0x7fe1f01367f0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe1f0135ec0 0x7fe1f0120830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 10 monclient(hunting): picked mon.noname-b con 0x7fe1f0135ec0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f009e730 con 0x7fe1f01367f0 2024-08-18T21:03:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f006d160 con 0x7fe1f0135ec0 2024-08-18T21:03:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fe1f00a88b0 con 0x7fe1f009de10 2024-08-18T21:03:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1f5ee7640 10 monclient(hunting): authenticate will time out at 993.987679s 2024-08-18T21:03:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1effff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe1f0135ec0 0x7fe1f0120830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1effff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe1f0135ec0 0x7fe1f0120830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34178/0 (socket says 172.21.15.5:34178) 2024-08-18T21:03:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1effff640 1 -- 172.21.15.5:0/529787096 learned_addr learned my addr 172.21.15.5:0/529787096 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1effff640 10 monclient(hunting): get_auth_request con 0x7fe1f0135ec0 auth_method 0 2024-08-18T21:03:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1effff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1effff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ef7fe640 1 --2- 172.21.15.5:0/529787096 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe1f009de10 0x7fe1f0135980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ef7fe640 10 monclient(hunting): get_auth_request con 0x7fe1f009de10 auth_method 0 2024-08-18T21:03:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.969+0000 7fe1ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1eeffd640 1 --2- 172.21.15.5:0/529787096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1f01367f0 0x7fe1f01202f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1eeffd640 10 monclient(hunting): get_auth_request con 0x7fe1f01367f0 auth_method 0 2024-08-18T21:03:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1eeffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1ef7fe640 10 monclient(hunting): handle_auth_done global_id 4344 payload 824 2024-08-18T21:03:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1ef7fe640 1 -- 172.21.15.5:0/529787096 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe1f0135ec0 msgr2=0x7fe1f0120830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1ef7fe640 1 --2- 172.21.15.5:0/529787096 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe1f0135ec0 0x7fe1f0120830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1ef7fe640 1 -- 172.21.15.5:0/529787096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1f01367f0 msgr2=0x7fe1f01202f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1ef7fe640 1 --2- 172.21.15.5:0/529787096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1f01367f0 0x7fe1f01202f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1ef7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1ef7fe640 1 monclient: found mon.noname-d 2024-08-18T21:03:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1ef7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1ef7fe640 1 -- 172.21.15.5:0/529787096 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f0136ce0 con 0x7fe1f009de10 2024-08-18T21:03:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed2191d640 1 -- 172.21.15.5:0/577005656 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fed1c139990 msgr2=0x7fed1c139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed2191d640 1 --2- 172.21.15.5:0/577005656 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fed1c139990 0x7fed1c139df0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fed180098a0 tx=0x7fed1801c440 comp rx=0 tx=0).ready entity=mon.8 client_cookie=590565a77e98d05 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed13fff640 1 -- 172.21.15.5:0/577005656 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fed180b0070 con 0x7fed1c139990 2024-08-18T21:03:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed13fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed13fff640 10 monclient: dump: 2024-08-18T21:03:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:46.996 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed13fff640 10 monclient: _finish_auth 0 2024-08-18T21:03:46.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed13fff640 10 monclient: _check_auth_tickets 2024-08-18T21:03:46.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:46.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed13fff640 1 -- 172.21.15.5:0/577005656 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed180aa810 con 0x7fed1c139990 2024-08-18T21:03:46.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed13fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:46.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed13fff640 1 -- 172.21.15.5:0/577005656 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fed180aae30 con 0x7fed1c139990 2024-08-18T21:03:46.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed23380640 5 monclient: authenticate success, global_id 4283 2024-08-18T21:03:46.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed23380640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:46.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed23380640 4 set_mon_vals no callback set 2024-08-18T21:03:46.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:46.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed13fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:46.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed13fff640 10 monclient: dump: 2024-08-18T21:03:46.996 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:46.998 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:46.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1ef7fe640 1 -- 172.21.15.5:0/529787096 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe1f009de10 msgr2=0x7fe1f0135980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:46.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1ef7fe640 1 --2- 172.21.15.5:0/529787096 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe1f009de10 0x7fe1f0135980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00b0000 tx=0x7fe1e001b3f0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:46.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1d7fff640 1 -- 172.21.15.5:0/529787096 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe1e00b9070 con 0x7fe1f009de10 2024-08-18T21:03:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1d7fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1d7fff640 10 monclient: dump: 2024-08-18T21:03:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.000 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1d7fff640 10 monclient: _finish_auth 0 2024-08-18T21:03:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1d7fff640 10 monclient: _check_auth_tickets 2024-08-18T21:03:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1d7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1d7fff640 1 -- 172.21.15.5:0/529787096 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e00b5420 con 0x7fe1f009de10 2024-08-18T21:03:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1d7fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1d7fff640 1 -- 172.21.15.5:0/529787096 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe1e00b5a40 con 0x7fe1f009de10 2024-08-18T21:03:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1d7fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1d7fff640 10 monclient: dump: 2024-08-18T21:03:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.002 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.002 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1edffb640 4 set_mon_vals no callback set 2024-08-18T21:03:47.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed23380640 10 monclient: shutdown 2024-08-18T21:03:47.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed23380640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed23380640 1 -- 172.21.15.5:0/577005656 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fed1c139990 msgr2=0x7fed1c139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed23380640 1 --2- 172.21.15.5:0/577005656 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fed1c139990 0x7fed1c139df0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fed180098a0 tx=0x7fed1801c440 comp rx=0 tx=0).stop 2024-08-18T21:03:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed23380640 1 -- 172.21.15.5:0/577005656 shutdown_connections 2024-08-18T21:03:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed23380640 1 --2- 172.21.15.5:0/577005656 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fed1c139990 0x7fed1c139df0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed23380640 1 --2- 172.21.15.5:0/577005656 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fed1c09f080 0x7fed1c0a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed23380640 1 --2- 172.21.15.5:0/577005656 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed1c0a6bd0 0x7fed1c0a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed23380640 1 -- 172.21.15.5:0/577005656 >> 172.21.15.5:0/577005656 conn(0x7fed1c068700 msgr2=0x7fed1c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed23380640 1 -- 172.21.15.5:0/577005656 shutdown_connections 2024-08-18T21:03:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fed23380640 1 -- 172.21.15.5:0/577005656 wait complete. 2024-08-18T21:03:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1f5ee7640 5 monclient: authenticate success, global_id 4344 2024-08-18T21:03:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1f5ee7640 10 monclient: _renew_subs 2024-08-18T21:03:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1f5ee7640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1f5ee7640 1 -- 172.21.15.5:0/529787096 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f0121d60 con 0x7fe1f009de10 2024-08-18T21:03:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1f5ee7640 10 monclient: _renew_subs 2024-08-18T21:03:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1f5ee7640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.973+0000 7fe1f5ee7640 1 -- 172.21.15.5:0/529787096 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f01240c0 con 0x7fe1f009de10 2024-08-18T21:03:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 10 monclient: build_initial_monmap 2024-08-18T21:03:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 10 monclient: monmap: 2024-08-18T21:03:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:47.006 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:47.006 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 1 Processor -- start 2024-08-18T21:03:47.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fe1f5ee7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fe1f5ee7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fe1f5ee7640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fe1f5ee7640 1 -- 172.21.15.5:0/529787096 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f009e8b0 con 0x7fe1f009de10 2024-08-18T21:03:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fe1d7fff640 1 -- 172.21.15.5:0/529787096 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe1e00bc070 con 0x7fe1f009de10 2024-08-18T21:03:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fe1d7fff640 1 --2- 172.21.15.5:0/529787096 >> v2:172.21.15.157:6812/631023601 conn(0x7fe1dc03bdc0 0x7fe1dc03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fe1d7fff640 1 -- 172.21.15.5:0/529787096 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fe1e00e8570 con 0x7fe1f009de10 2024-08-18T21:03:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 1 -- start start 2024-08-18T21:03:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 10 monclient: init 2024-08-18T21:03:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 10 monclient: _add_conns ranks=[6,2,7,4,5,0,8,1,3] 2024-08-18T21:03:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fed1c09f080 0x7fed1c072980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 10 monclient(hunting): picked mon.noname-d con 0x7fed1c09f080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fed1c0a6bd0 0x7fed1c072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 10 monclient(hunting): picked mon.noname-b con 0x7fed1c0a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fed1c139990 0x7fed1c073400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 10 monclient(hunting): picked mon.noname-i con 0x7fed1c139990 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fed1c0a89f0 con 0x7fed1c0a6bd0 2024-08-18T21:03:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fed1c0a7ce0 con 0x7fed1c09f080 2024-08-18T21:03:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fed1c143610 con 0x7fed1c139990 2024-08-18T21:03:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed23380640 10 monclient(hunting): authenticate will time out at 993.994319s 2024-08-18T21:03:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fe1eeffd640 1 --2- 172.21.15.5:0/529787096 >> v2:172.21.15.157:6812/631023601 conn(0x7fe1dc03bdc0 0x7fe1dc03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fe1eeffd640 10 monclient: get_auth_request con 0x7fe1dc03bdc0 auth_method 0 2024-08-18T21:03:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2191d640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fed1c139990 0x7fed1c073400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fed1c0a6bd0 0x7fed1c072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fed1c0a6bd0 0x7fed1c072ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34190/0 (socket says 172.21.15.5:34190) 2024-08-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2191d640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fed1c139990 0x7fed1c073400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:55194/0 (socket says 172.21.15.5:55194) 2024-08-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 1 -- 172.21.15.5:0/2788674947 learned_addr learned my addr 172.21.15.5:0/2788674947 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 10 monclient(hunting): get_auth_request con 0x7fed1c0a6bd0 auth_method 0 2024-08-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2191d640 10 monclient(hunting): get_auth_request con 0x7fed1c139990 auth_method 0 2024-08-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2191d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2191d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2191d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2191d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2191d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2191d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 10 monclient(hunting): handle_auth_done global_id 4403 payload 824 2024-08-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 1 -- 172.21.15.5:0/2788674947 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fed1c139990 msgr2=0x7fed1c073400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 1 --2- 172.21.15.5:0/2788674947 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fed1c139990 0x7fed1c073400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 1 -- 172.21.15.5:0/2788674947 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fed1c09f080 msgr2=0x7fed1c072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 1 --2- 172.21.15.5:0/2788674947 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fed1c09f080 0x7fed1c072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 10 monclient: _finish_hunting 0 2024-08-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 1 monclient: found mon.noname-b 2024-08-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.977+0000 7fed2091b640 1 -- 172.21.15.5:0/2788674947 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1c13c460 con 0x7fed1c0a6bd0 2024-08-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fe1eeffd640 1 --2- 172.21.15.5:0/529787096 >> v2:172.21.15.157:6812/631023601 conn(0x7fe1dc03bdc0 0x7fe1dc03e280 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe1f01223d0 tx=0x7fe1e4009190 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed2091b640 1 -- 172.21.15.5:0/2788674947 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fed1c0a6bd0 msgr2=0x7fed1c072ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed2091b640 1 --2- 172.21.15.5:0/2788674947 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fed1c0a6bd0 0x7fed1c072ec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00e810 tx=0x7fed0c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed11ffb640 1 -- 172.21.15.5:0/2788674947 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fed0c017070 con 0x7fed1c0a6bd0 2024-08-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed11ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed11ffb640 10 monclient: dump: 2024-08-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed11ffb640 10 monclient: _finish_auth 0 2024-08-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed11ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed11ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed11ffb640 1 -- 172.21.15.5:0/2788674947 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed0c00cd50 con 0x7fed1c0a6bd0 2024-08-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed11ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed11ffb640 1 -- 172.21.15.5:0/2788674947 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fed0c00f040 con 0x7fed1c0a6bd0 2024-08-18T21:03:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed11ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed11ffb640 10 monclient: dump: 2024-08-18T21:03:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.016 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed23380640 5 monclient: authenticate success, global_id 4403 2024-08-18T21:03:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed23380640 10 monclient: _renew_subs 2024-08-18T21:03:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed137fe640 4 set_mon_vals no callback set 2024-08-18T21:03:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed23380640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed23380640 1 -- 172.21.15.5:0/2788674947 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed1c13af70 con 0x7fed1c0a6bd0 2024-08-18T21:03:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed23380640 10 monclient: _renew_subs 2024-08-18T21:03:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed23380640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed23380640 1 -- 172.21.15.5:0/2788674947 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fed1c13ca30 con 0x7fed1c0a6bd0 2024-08-18T21:03:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed23380640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed23380640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed23380640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fed23380640 1 -- 172.21.15.5:0/2788674947 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed1c139df0 con 0x7fed1c0a6bd0 2024-08-18T21:03:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fe1d7fff640 1 -- 172.21.15.5:0/529787096 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fe1e00c3030 con 0x7fe1f009de10 2024-08-18T21:03:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fe1d7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.981+0000 7fe1d7fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.985+0000 7fed11ffb640 1 -- 172.21.15.5:0/2788674947 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fed0c01a070 con 0x7fed1c0a6bd0 2024-08-18T21:03:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.985+0000 7fed11ffb640 1 --2- 172.21.15.5:0/2788674947 >> v2:172.21.15.157:6812/631023601 conn(0x7fed0003bdc0 0x7fed0003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.985+0000 7fed11ffb640 1 -- 172.21.15.5:0/2788674947 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fed0c04e0f0 con 0x7fed1c0a6bd0 2024-08-18T21:03:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.989+0000 7fed2111c640 1 --2- 172.21.15.5:0/2788674947 >> v2:172.21.15.157:6812/631023601 conn(0x7fed0003bdc0 0x7fed0003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.989+0000 7fed2111c640 10 monclient: get_auth_request con 0x7fed0003bdc0 auth_method 0 2024-08-18T21:03:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.989+0000 7fed11ffb640 1 -- 172.21.15.5:0/2788674947 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fed0c012e10 con 0x7fed1c0a6bd0 2024-08-18T21:03:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.989+0000 7fed11ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.989+0000 7fed11ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:46.989+0000 7fed2111c640 1 --2- 172.21.15.5:0/2788674947 >> v2:172.21.15.157:6812/631023601 conn(0x7fed0003bdc0 0x7fed0003e280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fed1400e110 tx=0x7fed1400d040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 10 monclient: get_monmap_and_config 2024-08-18T21:03:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 10 monclient: build_initial_monmap 2024-08-18T21:03:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 10 monclient: monmap: 2024-08-18T21:03:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:47.049469+0000 2024-08-18T21:03:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:47.049469+0000 2024-08-18T21:03:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:47.049 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 1 Processor -- start 2024-08-18T21:03:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 1 -- start start 2024-08-18T21:03:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 10 monclient: init 2024-08-18T21:03:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 10 monclient: _add_conns ranks=[8,2,10,1,7,3,0,9,5,6,4] 2024-08-18T21:03:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1b480a6bd0 0x7f1b480a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 10 monclient(hunting): picked mon.noname-e con 0x7f1b480a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b4809f080 0x7f1b480a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 10 monclient(hunting): picked mon.noname-b con 0x7f1b4809f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1b48139990 0x7f1b48139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 10 monclient(hunting): picked mon.noname-f con 0x7f1b48139990 addr v2:172.21.15.157:3300/0 2024-08-18T21:03:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1b4809e4c0 con 0x7f1b48139990 2024-08-18T21:03:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4806f930 con 0x7f1b4809f080 2024-08-18T21:03:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f1b480a7a30 con 0x7f1b480a6bd0 2024-08-18T21:03:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b5037d640 10 monclient(hunting): authenticate will time out at 994.062640s 2024-08-18T21:03:47.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1b480a6bd0 0x7f1b480a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4d918640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b4809f080 0x7f1b480a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1b480a6bd0 0x7f1b480a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47482/0 (socket says 172.21.15.5:47482) 2024-08-18T21:03:47.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4d918640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b4809f080 0x7f1b480a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34198/0 (socket says 172.21.15.5:34198) 2024-08-18T21:03:47.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 1 -- 172.21.15.5:0/3526495693 learned_addr learned my addr 172.21.15.5:0/3526495693 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:47.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 10 monclient(hunting): get_auth_request con 0x7f1b480a6bd0 auth_method 0 2024-08-18T21:03:47.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4d918640 10 monclient(hunting): get_auth_request con 0x7f1b4809f080 auth_method 0 2024-08-18T21:03:47.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4d918640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4d918640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4d918640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4d918640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4d918640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4d918640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e91a640 1 --2- 172.21.15.5:0/3526495693 >> v2:172.21.15.157:3300/0 conn(0x7f1b48139990 0x7f1b48139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e91a640 10 monclient(hunting): get_auth_request con 0x7f1b48139990 auth_method 0 2024-08-18T21:03:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e91a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e91a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e91a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 10 monclient(hunting): handle_auth_done global_id 4292 payload 274 2024-08-18T21:03:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 1 -- 172.21.15.5:0/3526495693 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b4809f080 msgr2=0x7f1b480a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 1 --2- 172.21.15.5:0/3526495693 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b4809f080 0x7f1b480a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 1 -- 172.21.15.5:0/3526495693 >> v2:172.21.15.157:3300/0 conn(0x7f1b48139990 msgr2=0x7f1b48139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 1 --2- 172.21.15.5:0/3526495693 >> v2:172.21.15.157:3300/0 conn(0x7f1b48139990 0x7f1b48139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 10 monclient: _finish_hunting 0 2024-08-18T21:03:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 1 monclient: found mon.noname-e 2024-08-18T21:03:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4e119640 1 -- 172.21.15.5:0/3526495693 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b480a7fb0 con 0x7f1b480a6bd0 2024-08-18T21:03:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.045+0000 7f1b4d918640 1 --2- 172.21.15.5:0/3526495693 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b4809f080 0x7f1b480a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b4e119640 1 -- 172.21.15.5:0/3526495693 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1b480a6bd0 msgr2=0x7f1b480a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b4e119640 1 --2- 172.21.15.5:0/3526495693 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1b480a6bd0 0x7f1b480a6fb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1b440098a0 tx=0x7f1b4401c400 comp rx=0 tx=0).ready entity=mon.8 client_cookie=e8745f90be8e51d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b4d117640 1 -- 172.21.15.5:0/3526495693 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1b440b0070 con 0x7f1b480a6bd0 2024-08-18T21:03:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b4d117640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b4d117640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b4d117640 10 monclient: dump: 2024-08-18T21:03:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.059 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b4d117640 10 monclient: _finish_auth 0 2024-08-18T21:03:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b4d117640 10 monclient: _check_auth_tickets 2024-08-18T21:03:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b4d117640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b4d117640 1 -- 172.21.15.5:0/3526495693 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b440aa810 con 0x7f1b480a6bd0 2024-08-18T21:03:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b4d117640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b4d117640 1 -- 172.21.15.5:0/3526495693 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1b440a9300 con 0x7f1b480a6bd0 2024-08-18T21:03:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b4d117640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b4d117640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b4d117640 10 monclient: dump: 2024-08-18T21:03:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.061 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b5037d640 5 monclient: authenticate success, global_id 4292 2024-08-18T21:03:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b5037d640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.049+0000 7f1b5037d640 4 set_mon_vals no callback set 2024-08-18T21:03:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 10 monclient: shutdown 2024-08-18T21:03:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 -- 172.21.15.5:0/3526495693 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1b480a6bd0 msgr2=0x7f1b480a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 --2- 172.21.15.5:0/3526495693 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1b480a6bd0 0x7f1b480a6fb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1b440098a0 tx=0x7f1b4401c400 comp rx=0 tx=0).stop 2024-08-18T21:03:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 -- 172.21.15.5:0/3526495693 shutdown_connections 2024-08-18T21:03:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 --2- 172.21.15.5:0/3526495693 >> v2:172.21.15.157:3300/0 conn(0x7f1b48139990 0x7f1b48139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 --2- 172.21.15.5:0/3526495693 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b4809f080 0x7f1b480a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 --2- 172.21.15.5:0/3526495693 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1b480a6bd0 0x7f1b480a6fb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 -- 172.21.15.5:0/3526495693 >> 172.21.15.5:0/3526495693 conn(0x7f1b48068700 msgr2=0x7f1b48068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 -- 172.21.15.5:0/3526495693 shutdown_connections 2024-08-18T21:03:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 -- 172.21.15.5:0/3526495693 wait complete. 2024-08-18T21:03:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 10 monclient: build_initial_monmap 2024-08-18T21:03:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 10 monclient: monmap: 2024-08-18T21:03:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:47.063 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 Processor -- start 2024-08-18T21:03:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 -- start start 2024-08-18T21:03:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 10 monclient: init 2024-08-18T21:03:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 10 monclient: _add_conns ranks=[2,3,7,8,5,4,0,6,1] 2024-08-18T21:03:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b4809f080 0x7f1b481d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 10 monclient(hunting): picked mon.noname-b con 0x7f1b4809f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b480a6bd0 0x7f1b48138970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 10 monclient(hunting): picked mon.noname-g con 0x7f1b480a6bd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1b48139990 0x7f1b4813db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 10 monclient(hunting): picked mon.noname-i con 0x7f1b48139990 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f1b480a89f0 con 0x7f1b4809f080 2024-08-18T21:03:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1b480a7ce0 con 0x7f1b480a6bd0 2024-08-18T21:03:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f1b48143610 con 0x7f1b48139990 2024-08-18T21:03:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b5037d640 10 monclient(hunting): authenticate will time out at 994.070339s 2024-08-18T21:03:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b4809f080 0x7f1b481d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b4809f080 0x7f1b481d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34200/0 (socket says 172.21.15.5:34200) 2024-08-18T21:03:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 1 -- 172.21.15.5:0/1529687773 learned_addr learned my addr 172.21.15.5:0/1529687773 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 10 monclient(hunting): get_auth_request con 0x7f1b4809f080 auth_method 0 2024-08-18T21:03:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4d918640 1 --2- 172.21.15.5:0/1529687773 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b480a6bd0 0x7f1b48138970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e91a640 1 --2- 172.21.15.5:0/1529687773 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1b48139990 0x7f1b4813db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4d918640 10 monclient(hunting): get_auth_request con 0x7f1b480a6bd0 auth_method 0 2024-08-18T21:03:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4d918640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4d918640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4d918640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 10 monclient(hunting): handle_auth_done global_id 4421 payload 824 2024-08-18T21:03:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 1 -- 172.21.15.5:0/1529687773 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1b48139990 msgr2=0x7f1b4813db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 1 --2- 172.21.15.5:0/1529687773 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1b48139990 0x7f1b4813db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 1 -- 172.21.15.5:0/1529687773 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b480a6bd0 msgr2=0x7f1b48138970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 1 --2- 172.21.15.5:0/1529687773 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b480a6bd0 0x7f1b48138970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 10 monclient: _finish_hunting 0 2024-08-18T21:03:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 1 monclient: found mon.noname-b 2024-08-18T21:03:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.053+0000 7f1b4e119640 1 -- 172.21.15.5:0/1529687773 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b480ab0e0 con 0x7f1b4809f080 2024-08-18T21:03:47.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b4e119640 1 -- 172.21.15.5:0/1529687773 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b4809f080 msgr2=0x7f1b481d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b4e119640 1 --2- 172.21.15.5:0/1529687773 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b4809f080 0x7f1b481d15a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1b440097c0 tx=0x7f1b440191a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3effd640 1 -- 172.21.15.5:0/1529687773 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1b440aae00 con 0x7f1b4809f080 2024-08-18T21:03:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3effd640 10 monclient: dump: 2024-08-18T21:03:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.070 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3effd640 10 monclient: _finish_auth 0 2024-08-18T21:03:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3effd640 10 monclient: _check_auth_tickets 2024-08-18T21:03:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3effd640 1 -- 172.21.15.5:0/1529687773 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b440bb030 con 0x7f1b4809f080 2024-08-18T21:03:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3effd640 1 -- 172.21.15.5:0/1529687773 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1b440b7df0 con 0x7f1b4809f080 2024-08-18T21:03:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3effd640 10 monclient: dump: 2024-08-18T21:03:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.073 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.073 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b4c916640 4 set_mon_vals no callback set 2024-08-18T21:03:47.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b5037d640 5 monclient: authenticate success, global_id 4421 2024-08-18T21:03:47.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b5037d640 10 monclient: _renew_subs 2024-08-18T21:03:47.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b5037d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:47.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b5037d640 1 -- 172.21.15.5:0/1529687773 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b48124310 con 0x7f1b4809f080 2024-08-18T21:03:47.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b5037d640 10 monclient: _renew_subs 2024-08-18T21:03:47.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b5037d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:47.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b5037d640 1 -- 172.21.15.5:0/1529687773 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4813f5a0 con 0x7f1b4809f080 2024-08-18T21:03:47.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3cff9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3cff9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3cff9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:47.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3cff9640 1 -- 172.21.15.5:0/1529687773 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b24005090 con 0x7f1b4809f080 2024-08-18T21:03:47.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.057+0000 7f1b3effd640 1 -- 172.21.15.5:0/1529687773 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f1b44004250 con 0x7f1b4809f080 2024-08-18T21:03:47.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 10 monclient: get_monmap_and_config 2024-08-18T21:03:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 10 monclient: build_initial_monmap 2024-08-18T21:03:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 10 monclient: monmap: 2024-08-18T21:03:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:47.066769+0000 2024-08-18T21:03:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:47.066769+0000 2024-08-18T21:03:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:47.076 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:47.076 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:47.076 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:47.076 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:47.076 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:47.076 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:47.076 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:47.076 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:47.076 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 1 Processor -- start 2024-08-18T21:03:47.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f1b3effd640 1 --2- 172.21.15.5:0/1529687773 >> v2:172.21.15.157:6812/631023601 conn(0x7f1b2c03bdc0 0x7f1b2c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f1b3effd640 1 -- 172.21.15.5:0/1529687773 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f1b440f0590 con 0x7f1b4809f080 2024-08-18T21:03:47.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 1 -- start start 2024-08-18T21:03:47.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 10 monclient: init 2024-08-18T21:03:47.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f1b4d918640 1 --2- 172.21.15.5:0/1529687773 >> v2:172.21.15.157:6812/631023601 conn(0x7f1b2c03bdc0 0x7f1b2c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f1b4d918640 10 monclient: get_auth_request con 0x7f1b2c03bdc0 auth_method 0 2024-08-18T21:03:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 10 monclient: _add_conns ranks=[4,3,7,8,5,0,2,10,1,9,6] 2024-08-18T21:03:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3420074500 0x7f34200a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 10 monclient(hunting): picked mon.noname-c con 0x7f3420074500 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f342006d7d0 0x7f342006dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 10 monclient(hunting): picked mon.noname-g con 0x7f342006d7d0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f342006e0f0 0x7f3420144130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 10 monclient(hunting): picked mon.noname-i con 0x7f342006e0f0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f34200748e0 con 0x7f342006d7d0 2024-08-18T21:03:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f34200a63f0 con 0x7f3420074500 2024-08-18T21:03:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f342006ec30 con 0x7f342006e0f0 2024-08-18T21:03:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3426f0b640 10 monclient(hunting): authenticate will time out at 994.079767s 2024-08-18T21:03:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3424ca7640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3420074500 0x7f34200a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3424ca7640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3420074500 0x7f34200a1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:36822/0 (socket says 172.21.15.5:36822) 2024-08-18T21:03:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3424ca7640 1 -- 172.21.15.5:0/4117313614 learned_addr learned my addr 172.21.15.5:0/4117313614 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3424ca7640 10 monclient(hunting): get_auth_request con 0x7f3420074500 auth_method 0 2024-08-18T21:03:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3424ca7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3424ca7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3424ca7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3424ca7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3424ca7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.061+0000 7f3424ca7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f34254a8640 1 --2- 172.21.15.5:0/4117313614 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f342006e0f0 0x7f3420144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f34254a8640 10 monclient(hunting): get_auth_request con 0x7f342006e0f0 auth_method 0 2024-08-18T21:03:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f34254a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f34254a8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f34254a8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f3424ca7640 10 monclient(hunting): handle_auth_done global_id 4387 payload 274 2024-08-18T21:03:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f3424ca7640 1 -- 172.21.15.5:0/4117313614 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f342006e0f0 msgr2=0x7f3420144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f3424ca7640 1 --2- 172.21.15.5:0/4117313614 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f342006e0f0 0x7f3420144130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f3424ca7640 1 -- 172.21.15.5:0/4117313614 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f342006d7d0 msgr2=0x7f342006dbb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:03:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f3424ca7640 1 --2- 172.21.15.5:0/4117313614 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f342006d7d0 0x7f342006dbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f3424ca7640 10 monclient: _finish_hunting 0 2024-08-18T21:03:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f3424ca7640 1 monclient: found mon.noname-c 2024-08-18T21:03:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f3424ca7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f3424ca7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f3424ca7640 1 -- 172.21.15.5:0/4117313614 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342006f6f0 con 0x7f3420074500 2024-08-18T21:03:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f1b3effd640 1 -- 172.21.15.5:0/1529687773 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f1b480ab0e0 con 0x7f1b4809f080 2024-08-18T21:03:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f1b3effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f1b3effd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.065+0000 7f1b4d918640 1 --2- 172.21.15.5:0/1529687773 >> v2:172.21.15.157:6812/631023601 conn(0x7f1b2c03bdc0 0x7f1b2c03e280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b38009580 tx=0x7f1b38008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3424ca7640 1 -- 172.21.15.5:0/4117313614 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3420074500 msgr2=0x7f34200a1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3424ca7640 1 --2- 172.21.15.5:0/4117313614 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3420074500 0x7f34200a1b00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f34140098a0 tx=0x7f341401c460 comp rx=0 tx=0).ready entity=mon.4 client_cookie=5b3456ba2583e590 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f341f7fe640 1 -- 172.21.15.5:0/4117313614 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f34140b1070 con 0x7f3420074500 2024-08-18T21:03:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f341f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f341f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f341f7fe640 10 monclient: dump: 2024-08-18T21:03:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.091 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.091 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f341f7fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:47.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f341f7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:47.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f341f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:47.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 5 monclient: authenticate success, global_id 4387 2024-08-18T21:03:47.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:47.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f341f7fe640 1 -- 172.21.15.5:0/4117313614 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34140aa7b0 con 0x7f3420074500 2024-08-18T21:03:47.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f341f7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:47.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:47.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 4 set_mon_vals no callback set 2024-08-18T21:03:47.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f341f7fe640 1 -- 172.21.15.5:0/4117313614 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f34140aadd0 con 0x7f3420074500 2024-08-18T21:03:47.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f341f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f341f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f341f7fe640 10 monclient: dump: 2024-08-18T21:03:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 10 monclient: shutdown 2024-08-18T21:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 1 -- 172.21.15.5:0/4117313614 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3420074500 msgr2=0x7f34200a1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 1 --2- 172.21.15.5:0/4117313614 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3420074500 0x7f34200a1b00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f34140098a0 tx=0x7f341401c460 comp rx=0 tx=0).stop 2024-08-18T21:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 1 -- 172.21.15.5:0/4117313614 shutdown_connections 2024-08-18T21:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 1 --2- 172.21.15.5:0/4117313614 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f342006e0f0 0x7f3420144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 1 --2- 172.21.15.5:0/4117313614 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f342006d7d0 0x7f342006dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 1 --2- 172.21.15.5:0/4117313614 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3420074500 0x7f34200a1b00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 1 -- 172.21.15.5:0/4117313614 >> 172.21.15.5:0/4117313614 conn(0x7f342006c950 msgr2=0x7f342006cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 1 -- 172.21.15.5:0/4117313614 shutdown_connections 2024-08-18T21:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 1 -- 172.21.15.5:0/4117313614 wait complete. 2024-08-18T21:03:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 10 monclient: build_initial_monmap 2024-08-18T21:03:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 10 monclient: monmap: 2024-08-18T21:03:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:47.095 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 1 Processor -- start 2024-08-18T21:03:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 1 -- start start 2024-08-18T21:03:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.069+0000 7f3426f0b640 10 monclient: init 2024-08-18T21:03:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3426f0b640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3426f0b640 10 monclient: _add_conns ranks=[8,1,5,6,2,4,7,3,0] 2024-08-18T21:03:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3426f0b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f342006d7d0 0x7f3420071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3426f0b640 10 monclient(hunting): picked mon.noname-e con 0x7f342006d7d0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3426f0b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f342006e0f0 0x7f34200715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3426f0b640 10 monclient(hunting): picked mon.noname-f con 0x7f342006e0f0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3426f0b640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3420071ae0 0x7f34201d5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3426f0b640 10 monclient(hunting): picked mon.noname-h con 0x7f3420071ae0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f342006d7d0 0x7f3420071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3426f0b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3426f0b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3420147010 con 0x7f342006e0f0 2024-08-18T21:03:47.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3426f0b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3426f0b640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f3420146e90 con 0x7f3420071ae0 2024-08-18T21:03:47.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3426f0b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3426f0b640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f3420147190 con 0x7f342006d7d0 2024-08-18T21:03:47.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3426f0b640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:47.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f342006d7d0 0x7f3420071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47488/0 (socket says 172.21.15.5:47488) 2024-08-18T21:03:47.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3426f0b640 10 monclient(hunting): authenticate will time out at 994.088654s 2024-08-18T21:03:47.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 1 -- 172.21.15.5:0/3425729095 learned_addr learned my addr 172.21.15.5:0/3425729095 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:47.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 10 monclient(hunting): get_auth_request con 0x7f342006d7d0 auth_method 0 2024-08-18T21:03:47.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:47.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:47.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:47.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f341ffff640 1 --2- 172.21.15.5:0/3425729095 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f342006e0f0 0x7f34200715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f34254a8640 1 --2- 172.21.15.5:0/3425729095 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3420071ae0 0x7f34201d5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f34254a8640 10 monclient(hunting): get_auth_request con 0x7f3420071ae0 auth_method 0 2024-08-18T21:03:47.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f34254a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f34254a8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f34254a8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f34254a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:47.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f34254a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:47.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f34254a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:47.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 10 monclient(hunting): handle_auth_done global_id 4301 payload 824 2024-08-18T21:03:47.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 1 -- 172.21.15.5:0/3425729095 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3420071ae0 msgr2=0x7f34201d5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 1 --2- 172.21.15.5:0/3425729095 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3420071ae0 0x7f34201d5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 1 -- 172.21.15.5:0/3425729095 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f342006e0f0 msgr2=0x7f34200715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 1 --2- 172.21.15.5:0/3425729095 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f342006e0f0 0x7f34200715a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 10 monclient: _finish_hunting 0 2024-08-18T21:03:47.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 1 monclient: found mon.noname-e 2024-08-18T21:03:47.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:47.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:47.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 1 -- 172.21.15.5:0/3425729095 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3420121080 con 0x7f342006d7d0 2024-08-18T21:03:47.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 1 -- 172.21.15.5:0/3425729095 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f342006d7d0 msgr2=0x7f3420071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:47.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f3424ca7640 1 --2- 172.21.15.5:0/3425729095 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f342006d7d0 0x7f3420071060 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f34140097c0 tx=0x7f3414019200 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:47.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.073+0000 7f341d7fa640 1 -- 172.21.15.5:0/3425729095 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f34140aadd0 con 0x7f342006d7d0 2024-08-18T21:03:47.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341d7fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:47.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341d7fa640 10 monclient: dump: 2024-08-18T21:03:47.099 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.099 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.099 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.099 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.099 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.099 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.099 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.099 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.099 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.099 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.099 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.100 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.100 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.100 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.100 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.100 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341d7fa640 10 monclient: _finish_auth 0 2024-08-18T21:03:47.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341d7fa640 10 monclient: _check_auth_tickets 2024-08-18T21:03:47.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:47.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f3426f0b640 5 monclient: authenticate success, global_id 4301 2024-08-18T21:03:47.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f3426f0b640 10 monclient: _renew_subs 2024-08-18T21:03:47.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f3426f0b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:47.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f3426f0b640 1 -- 172.21.15.5:0/3425729095 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34200a5040 con 0x7f342006d7d0 2024-08-18T21:03:47.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341d7fa640 1 -- 172.21.15.5:0/3425729095 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34140044e0 con 0x7f342006d7d0 2024-08-18T21:03:47.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341d7fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341d7fa640 1 -- 172.21.15.5:0/3425729095 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f34140b1070 con 0x7f342006d7d0 2024-08-18T21:03:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341effd640 4 set_mon_vals no callback set 2024-08-18T21:03:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341d7fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341d7fa640 10 monclient: dump: 2024-08-18T21:03:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f3426f0b640 10 monclient: _renew_subs 2024-08-18T21:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f3426f0b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f3426f0b640 1 -- 172.21.15.5:0/3425729095 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f34200735b0 con 0x7f342006d7d0 2024-08-18T21:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341d7fa640 1 -- 172.21.15.5:0/3425729095 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f3414003620 con 0x7f342006d7d0 2024-08-18T21:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341d7fa640 1 --2- 172.21.15.5:0/3425729095 >> v2:172.21.15.157:6812/631023601 conn(0x7f340403bdc0 0x7f340403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f3426f0b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f3426f0b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f3426f0b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f3426f0b640 1 -- 172.21.15.5:0/3425729095 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34200a1b00 con 0x7f342006d7d0 2024-08-18T21:03:47.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341d7fa640 1 -- 172.21.15.5:0/3425729095 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f34140ed060 con 0x7f342006d7d0 2024-08-18T21:03:47.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341ffff640 1 --2- 172.21.15.5:0/3425729095 >> v2:172.21.15.157:6812/631023601 conn(0x7f340403bdc0 0x7f340403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.077+0000 7f341ffff640 10 monclient: get_auth_request con 0x7f340403bdc0 auth_method 0 2024-08-18T21:03:47.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.081+0000 7f341ffff640 1 --2- 172.21.15.5:0/3425729095 >> v2:172.21.15.157:6812/631023601 conn(0x7f340403bdc0 0x7f340403e280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f340c00a7d0 tx=0x7f340c008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:47.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.081+0000 7f341d7fa640 1 -- 172.21.15.5:0/3425729095 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f3414016170 con 0x7f342006d7d0 2024-08-18T21:03:47.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.081+0000 7f341d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.081+0000 7f341d7fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.241+0000 7f1b3cff9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-08-18T21:03:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.241+0000 7f1b3cff9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-08-18T21:03:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.241+0000 7f1b3cff9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.241+0000 7f1b3cff9640 1 -- 172.21.15.5:0/1529687773 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1b24005380 con 0x7f1b4809f080 2024-08-18T21:03:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.241+0000 7f1b3effd640 1 -- 172.21.15.5:0/1529687773 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1b480ab0e0 con 0x7f1b4809f080 2024-08-18T21:03:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.241+0000 7f1b3effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-08-18T21:03:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.241+0000 7f1b3effd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:47.246 INFO:teuthology.orchestra.run.smithi005.stdout:47244640261 2024-08-18T21:03:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.245+0000 7f1b3cff9640 1 -- 172.21.15.5:0/1529687773 >> v2:172.21.15.157:6812/631023601 conn(0x7f1b2c03bdc0 msgr2=0x7f1b2c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.245+0000 7f1b3cff9640 1 --2- 172.21.15.5:0/1529687773 >> v2:172.21.15.157:6812/631023601 conn(0x7f1b2c03bdc0 0x7f1b2c03e280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b38009580 tx=0x7f1b38008040 comp rx=0 tx=0).stop 2024-08-18T21:03:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.245+0000 7f1b3cff9640 10 monclient: shutdown 2024-08-18T21:03:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.245+0000 7f1b3cff9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.245+0000 7f1b3cff9640 1 -- 172.21.15.5:0/1529687773 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b4809f080 msgr2=0x7f1b481d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.245+0000 7f1b3cff9640 1 --2- 172.21.15.5:0/1529687773 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b4809f080 0x7f1b481d15a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1b440097c0 tx=0x7f1b440191a0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.245+0000 7f1b3cff9640 1 -- 172.21.15.5:0/1529687773 shutdown_connections 2024-08-18T21:03:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.245+0000 7f1b3cff9640 1 --2- 172.21.15.5:0/1529687773 >> v2:172.21.15.157:6812/631023601 conn(0x7f1b2c03bdc0 0x7f1b2c03e280 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.245+0000 7f1b3cff9640 1 --2- 172.21.15.5:0/1529687773 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1b48139990 0x7f1b4813db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.245+0000 7f1b3cff9640 1 --2- 172.21.15.5:0/1529687773 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b480a6bd0 0x7f1b48138970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.245+0000 7f1b3cff9640 1 --2- 172.21.15.5:0/1529687773 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b4809f080 0x7f1b481d15a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.245+0000 7f1b3cff9640 1 -- 172.21.15.5:0/1529687773 >> 172.21.15.5:0/1529687773 conn(0x7f1b48068700 msgr2=0x7f1b480ab9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:47.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.245+0000 7f1b3cff9640 1 -- 172.21.15.5:0/1529687773 shutdown_connections 2024-08-18T21:03:47.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.245+0000 7f1b3cff9640 1 -- 172.21.15.5:0/1529687773 wait complete. 2024-08-18T21:03:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.253+0000 7f2c967fc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-08-18T21:03:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.253+0000 7f2c967fc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-08-18T21:03:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.253+0000 7f2c967fc640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.253+0000 7f2c967fc640 1 -- 172.21.15.5:0/1377142843 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2c88005380 con 0x7f2cb01396d0 2024-08-18T21:03:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.253+0000 7f2cacff9640 1 -- 172.21.15.5:0/1377142843 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2ca8011260 con 0x7f2cb01396d0 2024-08-18T21:03:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.253+0000 7f2cacff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-08-18T21:03:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.253+0000 7f2cacff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:47.255 INFO:teuthology.orchestra.run.smithi005.stdout:47244640261 2024-08-18T21:03:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f2c967fc640 1 -- 172.21.15.5:0/1377142843 >> v2:172.21.15.157:6812/631023601 conn(0x7f2c9c03bdc0 msgr2=0x7f2c9c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f2c967fc640 1 --2- 172.21.15.5:0/1377142843 >> v2:172.21.15.157:6812/631023601 conn(0x7f2c9c03bdc0 0x7f2c9c03e280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0007a70 tx=0x7f2ca0008040 comp rx=0 tx=0).stop 2024-08-18T21:03:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f2c967fc640 10 monclient: shutdown 2024-08-18T21:03:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f2c967fc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f2c967fc640 1 -- 172.21.15.5:0/1377142843 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2cb01396d0 msgr2=0x7f2cb0120070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f2c967fc640 1 --2- 172.21.15.5:0/1377142843 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2cb01396d0 0x7f2cb0120070 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8007e60 tx=0x7f2ca800e4b0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f2c967fc640 1 -- 172.21.15.5:0/1377142843 shutdown_connections 2024-08-18T21:03:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f2c967fc640 1 --2- 172.21.15.5:0/1377142843 >> v2:172.21.15.157:6812/631023601 conn(0x7f2c9c03bdc0 0x7f2c9c03e280 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f2c967fc640 1 --2- 172.21.15.5:0/1377142843 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2cb01396d0 0x7f2cb0120070 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f2c967fc640 1 --2- 172.21.15.5:0/1377142843 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2cb006cd30 0x7f2cb01d1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f2c967fc640 1 --2- 172.21.15.5:0/1377142843 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2cb006c950 0x7f2cb0122600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f2c967fc640 1 -- 172.21.15.5:0/1377142843 >> 172.21.15.5:0/1377142843 conn(0x7f2cb00688d0 msgr2=0x7f2cb00a8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f2c967fc640 1 -- 172.21.15.5:0/1377142843 shutdown_connections 2024-08-18T21:03:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f2c967fc640 1 -- 172.21.15.5:0/1377142843 wait complete. 2024-08-18T21:03:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f3426f0b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-08-18T21:03:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f3426f0b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-08-18T21:03:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f3426f0b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f3426f0b640 1 -- 172.21.15.5:0/3425729095 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f34200728d0 con 0x7f342006d7d0 2024-08-18T21:03:47.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f341d7fa640 1 -- 172.21.15.5:0/3425729095 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f34140b4db0 con 0x7f342006d7d0 2024-08-18T21:03:47.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f341d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-08-18T21:03:47.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.257+0000 7f341d7fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:47.262 INFO:teuthology.orchestra.run.smithi005.stdout:51539607557 2024-08-18T21:03:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.261+0000 7f3426f0b640 1 -- 172.21.15.5:0/3425729095 >> v2:172.21.15.157:6812/631023601 conn(0x7f340403bdc0 msgr2=0x7f340403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.261+0000 7f3426f0b640 1 --2- 172.21.15.5:0/3425729095 >> v2:172.21.15.157:6812/631023601 conn(0x7f340403bdc0 0x7f340403e280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f340c00a7d0 tx=0x7f340c008040 comp rx=0 tx=0).stop 2024-08-18T21:03:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.261+0000 7f3426f0b640 10 monclient: shutdown 2024-08-18T21:03:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.261+0000 7f3426f0b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.261+0000 7f3426f0b640 1 -- 172.21.15.5:0/3425729095 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f342006d7d0 msgr2=0x7f3420071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.261+0000 7f3426f0b640 1 --2- 172.21.15.5:0/3425729095 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f342006d7d0 0x7f3420071060 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f34140097c0 tx=0x7f3414019200 comp rx=0 tx=0).stop 2024-08-18T21:03:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.261+0000 7f3426f0b640 1 -- 172.21.15.5:0/3425729095 shutdown_connections 2024-08-18T21:03:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.261+0000 7f3426f0b640 1 --2- 172.21.15.5:0/3425729095 >> v2:172.21.15.157:6812/631023601 conn(0x7f340403bdc0 0x7f340403e280 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.261+0000 7f3426f0b640 1 --2- 172.21.15.5:0/3425729095 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3420071ae0 0x7f34201d5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.261+0000 7f3426f0b640 1 --2- 172.21.15.5:0/3425729095 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f342006e0f0 0x7f34200715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.261+0000 7f3426f0b640 1 --2- 172.21.15.5:0/3425729095 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f342006d7d0 0x7f3420071060 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.261+0000 7f3426f0b640 1 -- 172.21.15.5:0/3425729095 >> 172.21.15.5:0/3425729095 conn(0x7f342006c950 msgr2=0x7f34200a8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.261+0000 7f3426f0b640 1 -- 172.21.15.5:0/3425729095 shutdown_connections 2024-08-18T21:03:47.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640261 for osd.4 2024-08-18T21:03:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.261+0000 7f3426f0b640 1 -- 172.21.15.5:0/3425729095 wait complete. 2024-08-18T21:03:47.266 DEBUG:teuthology.parallel:result is None 2024-08-18T21:03:47.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607557 for osd.0 2024-08-18T21:03:47.282 DEBUG:teuthology.parallel:result is None 2024-08-18T21:03:47.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640261 for osd.5 2024-08-18T21:03:47.285 DEBUG:teuthology.parallel:result is None 2024-08-18T21:03:47.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.293+0000 7ff37d8cb640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-08-18T21:03:47.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.293+0000 7ff37d8cb640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-08-18T21:03:47.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.293+0000 7ff37d8cb640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:47.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.293+0000 7ff37d8cb640 1 -- 172.21.15.5:0/585807084 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff358005380 con 0x7ff378139990 2024-08-18T21:03:47.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.293+0000 7ff35ffff640 1 -- 172.21.15.5:0/585807084 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff3700add40 con 0x7ff378139990 2024-08-18T21:03:47.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.293+0000 7ff35ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-08-18T21:03:47.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.293+0000 7ff35ffff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:47.297 INFO:teuthology.orchestra.run.smithi005.stdout:47244640262 2024-08-18T21:03:47.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.297+0000 7ff37d8cb640 1 -- 172.21.15.5:0/585807084 >> v2:172.21.15.157:6812/631023601 conn(0x7ff36403bdc0 msgr2=0x7ff36403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.297+0000 7ff37d8cb640 1 --2- 172.21.15.5:0/585807084 >> v2:172.21.15.157:6812/631023601 conn(0x7ff36403bdc0 0x7ff36403e280 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff368006b20 tx=0x7ff368008040 comp rx=0 tx=0).stop 2024-08-18T21:03:47.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.297+0000 7ff37d8cb640 10 monclient: shutdown 2024-08-18T21:03:47.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.297+0000 7ff37d8cb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:47.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.297+0000 7ff37d8cb640 1 -- 172.21.15.5:0/585807084 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff378139990 msgr2=0x7ff37813d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.297+0000 7ff37d8cb640 1 --2- 172.21.15.5:0/585807084 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff378139990 0x7ff37813d9f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff37001c680 tx=0x7ff3700195f0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.297+0000 7ff37d8cb640 1 -- 172.21.15.5:0/585807084 shutdown_connections 2024-08-18T21:03:47.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.297+0000 7ff37d8cb640 1 --2- 172.21.15.5:0/585807084 >> v2:172.21.15.157:6812/631023601 conn(0x7ff36403bdc0 0x7ff36403e280 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.297+0000 7ff37d8cb640 1 --2- 172.21.15.5:0/585807084 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff378139990 0x7ff37813d9f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.297+0000 7ff37d8cb640 1 --2- 172.21.15.5:0/585807084 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff3780a6bd0 0x7ff3781389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.297+0000 7ff37d8cb640 1 --2- 172.21.15.5:0/585807084 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff37809f080 0x7ff378138480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.297+0000 7ff37d8cb640 1 -- 172.21.15.5:0/585807084 >> 172.21.15.5:0/585807084 conn(0x7ff378068700 msgr2=0x7ff3780a9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.297+0000 7ff37d8cb640 1 -- 172.21.15.5:0/585807084 shutdown_connections 2024-08-18T21:03:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.297+0000 7ff37d8cb640 1 -- 172.21.15.5:0/585807084 wait complete. 2024-08-18T21:03:47.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.305+0000 7fe1f5ee7640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-08-18T21:03:47.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.305+0000 7fe1f5ee7640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-08-18T21:03:47.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.305+0000 7fe1f5ee7640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:47.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.305+0000 7fe1f5ee7640 1 -- 172.21.15.5:0/529787096 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe1f006d4f0 con 0x7fe1f009de10 2024-08-18T21:03:47.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1d7fff640 1 -- 172.21.15.5:0/529787096 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe1e0018360 con 0x7fe1f009de10 2024-08-18T21:03:47.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1d7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-08-18T21:03:47.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1d7fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:47.311 INFO:teuthology.orchestra.run.smithi005.stdout:47244640261 2024-08-18T21:03:47.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1f5ee7640 1 -- 172.21.15.5:0/529787096 >> v2:172.21.15.157:6812/631023601 conn(0x7fe1dc03bdc0 msgr2=0x7fe1dc03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1f5ee7640 1 --2- 172.21.15.5:0/529787096 >> v2:172.21.15.157:6812/631023601 conn(0x7fe1dc03bdc0 0x7fe1dc03e280 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe1f01223d0 tx=0x7fe1e4009190 comp rx=0 tx=0).stop 2024-08-18T21:03:47.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1f5ee7640 10 monclient: shutdown 2024-08-18T21:03:47.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1f5ee7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:47.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1f5ee7640 1 -- 172.21.15.5:0/529787096 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe1f009de10 msgr2=0x7fe1f0135980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1f5ee7640 1 --2- 172.21.15.5:0/529787096 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe1f009de10 0x7fe1f0135980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00b0000 tx=0x7fe1e001b3f0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1f5ee7640 1 -- 172.21.15.5:0/529787096 shutdown_connections 2024-08-18T21:03:47.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1f5ee7640 1 --2- 172.21.15.5:0/529787096 >> v2:172.21.15.157:6812/631023601 conn(0x7fe1dc03bdc0 0x7fe1dc03e280 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1f5ee7640 1 --2- 172.21.15.5:0/529787096 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe1f0135ec0 0x7fe1f0120830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1f5ee7640 1 --2- 172.21.15.5:0/529787096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1f01367f0 0x7fe1f01202f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1f5ee7640 1 --2- 172.21.15.5:0/529787096 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe1f009de10 0x7fe1f0135980 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1f5ee7640 1 -- 172.21.15.5:0/529787096 >> 172.21.15.5:0/529787096 conn(0x7fe1f00688d0 msgr2=0x7fe1f00a2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:47.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1f5ee7640 1 -- 172.21.15.5:0/529787096 shutdown_connections 2024-08-18T21:03:47.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fe1f5ee7640 1 -- 172.21.15.5:0/529787096 wait complete. 2024-08-18T21:03:47.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fed23380640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-08-18T21:03:47.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fed23380640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-08-18T21:03:47.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fed23380640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:47.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fed23380640 1 -- 172.21.15.5:0/2788674947 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fed1c0746d0 con 0x7fed1c0a6bd0 2024-08-18T21:03:47.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640262 for osd.2 2024-08-18T21:03:47.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fed11ffb640 1 -- 172.21.15.5:0/2788674947 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fed0c00c8e0 con 0x7fed1c0a6bd0 2024-08-18T21:03:47.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fed11ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-08-18T21:03:47.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.309+0000 7fed11ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:47.316 INFO:teuthology.orchestra.run.smithi005.stdout:47244640261 2024-08-18T21:03:47.316 DEBUG:teuthology.parallel:result is None 2024-08-18T21:03:47.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.313+0000 7fed23380640 1 -- 172.21.15.5:0/2788674947 >> v2:172.21.15.157:6812/631023601 conn(0x7fed0003bdc0 msgr2=0x7fed0003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.313+0000 7fed23380640 1 --2- 172.21.15.5:0/2788674947 >> v2:172.21.15.157:6812/631023601 conn(0x7fed0003bdc0 0x7fed0003e280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fed1400e110 tx=0x7fed1400d040 comp rx=0 tx=0).stop 2024-08-18T21:03:47.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.313+0000 7fed23380640 10 monclient: shutdown 2024-08-18T21:03:47.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.313+0000 7fed23380640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:47.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.313+0000 7fed23380640 1 -- 172.21.15.5:0/2788674947 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fed1c0a6bd0 msgr2=0x7fed1c072ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.313+0000 7fed23380640 1 --2- 172.21.15.5:0/2788674947 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fed1c0a6bd0 0x7fed1c072ec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00e810 tx=0x7fed0c00ecd0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.313+0000 7fed23380640 1 -- 172.21.15.5:0/2788674947 shutdown_connections 2024-08-18T21:03:47.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.313+0000 7fed23380640 1 --2- 172.21.15.5:0/2788674947 >> v2:172.21.15.157:6812/631023601 conn(0x7fed0003bdc0 0x7fed0003e280 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.313+0000 7fed23380640 1 --2- 172.21.15.5:0/2788674947 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fed1c0a6bd0 0x7fed1c072ec0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.313+0000 7fed23380640 1 --2- 172.21.15.5:0/2788674947 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fed1c139990 0x7fed1c073400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.313+0000 7fed23380640 1 --2- 172.21.15.5:0/2788674947 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fed1c09f080 0x7fed1c072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.313+0000 7fed23380640 1 -- 172.21.15.5:0/2788674947 >> 172.21.15.5:0/2788674947 conn(0x7fed1c068700 msgr2=0x7fed1c0aba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:47.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.313+0000 7fed23380640 1 -- 172.21.15.5:0/2788674947 shutdown_connections 2024-08-18T21:03:47.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.313+0000 7fed23380640 1 -- 172.21.15.5:0/2788674947 wait complete. 2024-08-18T21:03:47.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640261 for osd.3 2024-08-18T21:03:47.331 DEBUG:teuthology.parallel:result is None 2024-08-18T21:03:47.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640261 for osd.1 2024-08-18T21:03:47.334 DEBUG:teuthology.parallel:result is None 2024-08-18T21:03:47.334 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T21:03:47.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T21:03:47.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.481+0000 7f78aa331640 10 monclient: get_monmap_and_config 2024-08-18T21:03:47.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.481+0000 7f78aa331640 10 monclient: build_initial_monmap 2024-08-18T21:03:47.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.481+0000 7f78aa331640 10 monclient: monmap: 2024-08-18T21:03:47.485 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:47.485 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.485 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:47.487183+0000 2024-08-18T21:03:47.485 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:47.487183+0000 2024-08-18T21:03:47.485 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:47.486 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.486 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:47.486 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:47.486 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:47.486 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:47.486 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:47.486 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:47.486 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:47.486 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:47.486 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:47.486 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:47.486 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:47.486 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.481+0000 7f78aa331640 1 Processor -- start 2024-08-18T21:03:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.481+0000 7f78aa331640 1 -- start start 2024-08-18T21:03:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.481+0000 7f78aa331640 10 monclient: init 2024-08-18T21:03:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78aa331640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78aa331640 10 monclient: _add_conns ranks=[9,8,10,5,6,0,7,3,2,1,4] 2024-08-18T21:03:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78aa331640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f78a40a1ff0 0x7f78a4137430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78aa331640 10 monclient(hunting): picked mon.noname-a con 0x7f78a40a1ff0 addr v2:172.21.15.5:3300/0 2024-08-18T21:03:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78aa331640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f78a4137970 0x7f78a4137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78aa331640 10 monclient(hunting): picked mon.noname-e con 0x7f78a4137970 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78aa331640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f78a4133eb0 0x7f78a4134360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78aa331640 10 monclient(hunting): picked mon.noname-f con 0x7f78a4133eb0 addr v2:172.21.15.157:3300/0 2024-08-18T21:03:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78aa331640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78aa331640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f78a409dd50 con 0x7f78a40a1ff0 2024-08-18T21:03:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78aa331640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78aa331640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f78a40a23d0 con 0x7f78a4133eb0 2024-08-18T21:03:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78aa331640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78aa331640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f78a409e970 con 0x7f78a4137970 2024-08-18T21:03:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78aa331640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78aa331640 10 monclient(hunting): authenticate will time out at 994.500222s 2024-08-18T21:03:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a37fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f78a4137970 0x7f78a4137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f78a40a1ff0 0x7f78a4137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f78a40a1ff0 0x7f78a4137430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46776/0 (socket says 172.21.15.5:46776) 2024-08-18T21:03:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a37fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f78a4137970 0x7f78a4137dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47500/0 (socket says 172.21.15.5:47500) 2024-08-18T21:03:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 1 -- 172.21.15.5:0/1460513001 learned_addr learned my addr 172.21.15.5:0/1460513001 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 10 monclient(hunting): get_auth_request con 0x7f78a40a1ff0 auth_method 0 2024-08-18T21:03:47.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a37fe640 10 monclient(hunting): get_auth_request con 0x7f78a4137970 auth_method 0 2024-08-18T21:03:47.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:47.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:47.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:47.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:47.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:47.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:47.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a88ce640 1 --2- 172.21.15.5:0/1460513001 >> v2:172.21.15.157:3300/0 conn(0x7f78a4133eb0 0x7f78a4134360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a88ce640 10 monclient(hunting): get_auth_request con 0x7f78a4133eb0 auth_method 0 2024-08-18T21:03:47.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a88ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a88ce640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a88ce640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 10 monclient(hunting): handle_auth_done global_id 4401 payload 274 2024-08-18T21:03:47.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 1 -- 172.21.15.5:0/1460513001 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f78a4137970 msgr2=0x7f78a4137dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:47.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 1 --2- 172.21.15.5:0/1460513001 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f78a4137970 0x7f78a4137dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 1 -- 172.21.15.5:0/1460513001 >> v2:172.21.15.157:3300/0 conn(0x7f78a4133eb0 msgr2=0x7f78a4134360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:47.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 1 --2- 172.21.15.5:0/1460513001 >> v2:172.21.15.157:3300/0 conn(0x7f78a4133eb0 0x7f78a4134360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 10 monclient: _finish_hunting 0 2024-08-18T21:03:47.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 1 monclient: found mon.noname-a 2024-08-18T21:03:47.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:47.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:47.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a3fff640 1 -- 172.21.15.5:0/1460513001 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a409ec50 con 0x7f78a40a1ff0 2024-08-18T21:03:47.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.485+0000 7f78a37fe640 1 --2- 172.21.15.5:0/1460513001 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f78a4137970 0x7f78a4137dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:47.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a3fff640 1 -- 172.21.15.5:0/1460513001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a40a1ff0 msgr2=0x7f78a4137430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:47.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a3fff640 1 --2- 172.21.15.5:0/1460513001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a40a1ff0 0x7f78a4137430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f78a40a90e0 tx=0x7f789c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1935f3a5e578bd0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:47.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a2ffd640 1 -- 172.21.15.5:0/1460513001 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f789c0090d0 con 0x7f78a40a1ff0 2024-08-18T21:03:47.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:47.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a2ffd640 10 monclient: dump: 2024-08-18T21:03:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.499 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a2ffd640 10 monclient: _finish_auth 0 2024-08-18T21:03:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a2ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:03:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a2ffd640 1 -- 172.21.15.5:0/1460513001 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c0a59a0 con 0x7f78a40a1ff0 2024-08-18T21:03:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 5 monclient: authenticate success, global_id 4401 2024-08-18T21:03:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a2ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a2ffd640 1 -- 172.21.15.5:0/1460513001 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f789c0ad3f0 con 0x7f78a40a1ff0 2024-08-18T21:03:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a2ffd640 10 monclient: dump: 2024-08-18T21:03:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.501 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 4 set_mon_vals no callback set 2024-08-18T21:03:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 10 monclient: shutdown 2024-08-18T21:03:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 -- 172.21.15.5:0/1460513001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a40a1ff0 msgr2=0x7f78a4137430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 --2- 172.21.15.5:0/1460513001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a40a1ff0 0x7f78a4137430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f78a40a90e0 tx=0x7f789c01c8b0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 -- 172.21.15.5:0/1460513001 shutdown_connections 2024-08-18T21:03:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 --2- 172.21.15.5:0/1460513001 >> v2:172.21.15.157:3300/0 conn(0x7f78a4133eb0 0x7f78a4134360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 --2- 172.21.15.5:0/1460513001 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f78a4137970 0x7f78a4137dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 --2- 172.21.15.5:0/1460513001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a40a1ff0 0x7f78a4137430 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 -- 172.21.15.5:0/1460513001 >> 172.21.15.5:0/1460513001 conn(0x7f78a40a8020 msgr2=0x7f78a40a8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 -- 172.21.15.5:0/1460513001 shutdown_connections 2024-08-18T21:03:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 -- 172.21.15.5:0/1460513001 wait complete. 2024-08-18T21:03:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 10 monclient: build_initial_monmap 2024-08-18T21:03:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 10 monclient: monmap: 2024-08-18T21:03:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:47.503 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 Processor -- start 2024-08-18T21:03:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 -- start start 2024-08-18T21:03:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 10 monclient: init 2024-08-18T21:03:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 10 monclient: _add_conns ranks=[6,0,3,2,4,5,1,8,7] 2024-08-18T21:03:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f78a40a1ff0 0x7f78a413d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 10 monclient(hunting): picked mon.noname-d con 0x7f78a40a1ff0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a4133eb0 0x7f78a413dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 10 monclient(hunting): picked mon.noname-a con 0x7f78a4133eb0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78a4137970 0x7f78a4072450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 10 monclient(hunting): picked mon.noname-g con 0x7f78a4137970 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f78a41411f0 con 0x7f78a4133eb0 2024-08-18T21:03:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f78a40a1e00 con 0x7f78a4137970 2024-08-18T21:03:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f78a4141370 con 0x7f78a40a1ff0 2024-08-18T21:03:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78aa331640 10 monclient(hunting): authenticate will time out at 994.507173s 2024-08-18T21:03:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a4133eb0 0x7f78a413dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a3fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f78a40a1ff0 0x7f78a413d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a4133eb0 0x7f78a413dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46784/0 (socket says 172.21.15.5:46784) 2024-08-18T21:03:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a3fff640 10 monclient(hunting): get_auth_request con 0x7f78a40a1ff0 auth_method 0 2024-08-18T21:03:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 1 -- 172.21.15.5:0/910154946 learned_addr learned my addr 172.21.15.5:0/910154946 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 10 monclient(hunting): get_auth_request con 0x7f78a4133eb0 auth_method 0 2024-08-18T21:03:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a88ce640 1 --2- 172.21.15.5:0/910154946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78a4137970 0x7f78a4072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 10 monclient(hunting): handle_auth_done global_id 4410 payload 824 2024-08-18T21:03:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 1 -- 172.21.15.5:0/910154946 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f78a40a1ff0 msgr2=0x7f78a413d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 1 --2- 172.21.15.5:0/910154946 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f78a40a1ff0 0x7f78a413d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 1 -- 172.21.15.5:0/910154946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78a4137970 msgr2=0x7f78a4072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 1 --2- 172.21.15.5:0/910154946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78a4137970 0x7f78a4072450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 1 monclient: found mon.noname-a 2024-08-18T21:03:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a37fe640 1 -- 172.21.15.5:0/910154946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a40a3ac0 con 0x7f78a4133eb0 2024-08-18T21:03:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a88ce640 10 monclient: get_auth_request con 0x7f78a4137970 auth_method 0 2024-08-18T21:03:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a3fff640 1 --2- 172.21.15.5:0/910154946 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f78a40a1ff0 0x7f78a413d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.489+0000 7f78a88ce640 1 --2- 172.21.15.5:0/910154946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78a4137970 0x7f78a4072450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a37fe640 1 -- 172.21.15.5:0/910154946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a4133eb0 msgr2=0x7f78a413dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a37fe640 1 --2- 172.21.15.5:0/910154946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a4133eb0 0x7f78a413dd70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f789800e960 tx=0x7f789800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a0ff9640 1 -- 172.21.15.5:0/910154946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7898017070 con 0x7f78a4133eb0 2024-08-18T21:03:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a0ff9640 10 monclient: dump: 2024-08-18T21:03:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.508 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a0ff9640 10 monclient: _finish_auth 0 2024-08-18T21:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a0ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a0ff9640 1 -- 172.21.15.5:0/910154946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789800cc10 con 0x7f78a4133eb0 2024-08-18T21:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a0ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a0ff9640 1 -- 172.21.15.5:0/910154946 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f789800cdc0 con 0x7f78a4133eb0 2024-08-18T21:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78aa331640 5 monclient: authenticate success, global_id 4410 2024-08-18T21:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a0ff9640 10 monclient: dump: 2024-08-18T21:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.510 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78aa331640 10 monclient: _renew_subs 2024-08-18T21:03:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a27fc640 4 set_mon_vals no callback set 2024-08-18T21:03:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78aa331640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:47.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78aa331640 1 -- 172.21.15.5:0/910154946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a413a2e0 con 0x7f78a4133eb0 2024-08-18T21:03:47.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78aa331640 10 monclient: _renew_subs 2024-08-18T21:03:47.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78aa331640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:47.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78aa331640 1 -- 172.21.15.5:0/910154946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a413a000 con 0x7f78a4133eb0 2024-08-18T21:03:47.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78aa331640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78aa331640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78aa331640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:47.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a0ff9640 1 -- 172.21.15.5:0/910154946 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f789801a070 con 0x7f78a4133eb0 2024-08-18T21:03:47.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78aa331640 1 -- 172.21.15.5:0/910154946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a4138fa0 con 0x7f78a4133eb0 2024-08-18T21:03:47.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a0ff9640 1 --2- 172.21.15.5:0/910154946 >> v2:172.21.15.157:6812/631023601 conn(0x7f789003bdc0 0x7f789003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a0ff9640 1 -- 172.21.15.5:0/910154946 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f789800f040 con 0x7f78a4133eb0 2024-08-18T21:03:47.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a3fff640 1 --2- 172.21.15.5:0/910154946 >> v2:172.21.15.157:6812/631023601 conn(0x7f789003bdc0 0x7f789003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.493+0000 7f78a3fff640 10 monclient: get_auth_request con 0x7f789003bdc0 auth_method 0 2024-08-18T21:03:47.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.497+0000 7f78a3fff640 1 --2- 172.21.15.5:0/910154946 >> v2:172.21.15.157:6812/631023601 conn(0x7f789003bdc0 0x7f789003e280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f789c0ab000 tx=0x7f789c0a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:47.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.501+0000 7f78a0ff9640 1 -- 172.21.15.5:0/910154946 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f78a40a3ac0 con 0x7f78a4133eb0 2024-08-18T21:03:47.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.501+0000 7f78a0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.501+0000 7f78a0ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.665+0000 7f78aa331640 1 -- 172.21.15.5:0/910154946 --> v2:172.21.15.157:6812/631023601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78a4134320 con 0x7f789003bdc0 2024-08-18T21:03:47.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.669+0000 7f78a0ff9640 1 -- 172.21.15.5:0/910154946 <== mgr.4130 v2:172.21.15.157:6812/631023601 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34141 (secure 0 0 0) 0x7f78a4134320 con 0x7f789003bdc0 2024-08-18T21:03:47.671 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:03:47.671 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T21:03:47.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.669+0000 7f78aa331640 1 -- 172.21.15.5:0/910154946 >> v2:172.21.15.157:6812/631023601 conn(0x7f789003bdc0 msgr2=0x7f789003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.669+0000 7f78aa331640 1 --2- 172.21.15.5:0/910154946 >> v2:172.21.15.157:6812/631023601 conn(0x7f789003bdc0 0x7f789003e280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f789c0ab000 tx=0x7f789c0a7070 comp rx=0 tx=0).stop 2024-08-18T21:03:47.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.669+0000 7f78aa331640 10 monclient: shutdown 2024-08-18T21:03:47.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.669+0000 7f78aa331640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:47.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.669+0000 7f78aa331640 1 -- 172.21.15.5:0/910154946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a4133eb0 msgr2=0x7f78a413dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.669+0000 7f78aa331640 1 --2- 172.21.15.5:0/910154946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a4133eb0 0x7f78a413dd70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f789800e960 tx=0x7f789800ee20 comp rx=0 tx=0).stop 2024-08-18T21:03:47.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.669+0000 7f78aa331640 1 -- 172.21.15.5:0/910154946 shutdown_connections 2024-08-18T21:03:47.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.669+0000 7f78aa331640 1 --2- 172.21.15.5:0/910154946 >> v2:172.21.15.157:6812/631023601 conn(0x7f789003bdc0 0x7f789003e280 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.669+0000 7f78aa331640 1 --2- 172.21.15.5:0/910154946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78a4137970 0x7f78a4072450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.669+0000 7f78aa331640 1 --2- 172.21.15.5:0/910154946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a4133eb0 0x7f78a413dd70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.669+0000 7f78aa331640 1 --2- 172.21.15.5:0/910154946 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f78a40a1ff0 0x7f78a413d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.669+0000 7f78aa331640 1 -- 172.21.15.5:0/910154946 >> 172.21.15.5:0/910154946 conn(0x7f78a40a8020 msgr2=0x7f78a4131db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:47.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.669+0000 7f78aa331640 1 -- 172.21.15.5:0/910154946 shutdown_connections 2024-08-18T21:03:47.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.669+0000 7f78aa331640 1 -- 172.21.15.5:0/910154946 wait complete. 2024-08-18T21:03:47.688 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-18T21:03:47.339300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":167420,"kb_used_data":1072,"kb_used_omap":9,"kb_used_meta":166198,"kb_avail":566063620,"statfs":{"total":579820584960,"available":579649146880,"internally_reserved":0,"allocated":1097728,"data_stored":1375114,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9572,"internal_metadata":170187420},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002248"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.420333+0000","last_change":"2024-08-18T21:03:42.420853+0000","last_active":"2024-08-18T21:03:42.420333+0000","last_peered":"2024-08-18T21:03:42.420333+0000","last_clean":"2024-08-18T21:03:42.420333+0000","last_became_active":"2024-08-18T21:03:39.195166+0000","last_became_peered":"2024-08-18T21:03:39.195166+0000","last_unstale":"2024-08-18T21:03:42.420333+0000","last_undegraded":"2024-08-18T21:03:42.420333+0000","last_fullsized":"2024-08-18T21:03:42.420333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:11:34.985385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001377777,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.183980+0000","last_change":"2024-08-18T21:03:42.184578+0000","last_active":"2024-08-18T21:03:42.183980+0000","last_peered":"2024-08-18T21:03:42.183980+0000","last_clean":"2024-08-18T21:03:42.183980+0000","last_became_active":"2024-08-18T21:03:39.194596+0000","last_became_peered":"2024-08-18T21:03:39.194596+0000","last_unstale":"2024-08-18T21:03:42.183980+0000","last_undegraded":"2024-08-18T21:03:42.183980+0000","last_fullsized":"2024-08-18T21:03:42.183980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:22.467656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001127341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.419869+0000","last_change":"2024-08-18T21:03:42.420253+0000","last_active":"2024-08-18T21:03:42.419869+0000","last_peered":"2024-08-18T21:03:42.419869+0000","last_clean":"2024-08-18T21:03:42.419869+0000","last_became_active":"2024-08-18T21:03:39.192148+0000","last_became_peered":"2024-08-18T21:03:39.192148+0000","last_unstale":"2024-08-18T21:03:42.419869+0000","last_undegraded":"2024-08-18T21:03:42.419869+0000","last_fullsized":"2024-08-18T21:03:42.419869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:00:27.022175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082257800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.419473+0000","last_change":"2024-08-18T21:03:42.420020+0000","last_active":"2024-08-18T21:03:42.419473+0000","last_peered":"2024-08-18T21:03:42.419473+0000","last_clean":"2024-08-18T21:03:42.419473+0000","last_became_active":"2024-08-18T21:03:39.203685+0000","last_became_peered":"2024-08-18T21:03:39.203685+0000","last_unstale":"2024-08-18T21:03:42.419473+0000","last_undegraded":"2024-08-18T21:03:42.419473+0000","last_fullsized":"2024-08-18T21:03:42.419473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:36.890241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099204900000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.186027+0000","last_change":"2024-08-18T21:03:42.186027+0000","last_active":"2024-08-18T21:03:42.186027+0000","last_peered":"2024-08-18T21:03:42.186027+0000","last_clean":"2024-08-18T21:03:42.186027+0000","last_became_active":"2024-08-18T21:03:39.192275+0000","last_became_peered":"2024-08-18T21:03:39.192275+0000","last_unstale":"2024-08-18T21:03:42.186027+0000","last_undegraded":"2024-08-18T21:03:42.186027+0000","last_fullsized":"2024-08-18T21:03:42.186027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:55:49.809092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001842333,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.184121+0000","last_change":"2024-08-18T21:03:42.184643+0000","last_active":"2024-08-18T21:03:42.184121+0000","last_peered":"2024-08-18T21:03:42.184121+0000","last_clean":"2024-08-18T21:03:42.184121+0000","last_became_active":"2024-08-18T21:03:39.201549+0000","last_became_peered":"2024-08-18T21:03:39.201549+0000","last_unstale":"2024-08-18T21:03:42.184121+0000","last_undegraded":"2024-08-18T21:03:42.184121+0000","last_fullsized":"2024-08-18T21:03:42.184121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:01:33.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010119630000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.184742+0000","last_change":"2024-08-18T21:03:42.185411+0000","last_active":"2024-08-18T21:03:42.184742+0000","last_peered":"2024-08-18T21:03:42.184742+0000","last_clean":"2024-08-18T21:03:42.184742+0000","last_became_active":"2024-08-18T21:03:39.201697+0000","last_became_peered":"2024-08-18T21:03:39.201697+0000","last_unstale":"2024-08-18T21:03:42.184742+0000","last_undegraded":"2024-08-18T21:03:42.184742+0000","last_fullsized":"2024-08-18T21:03:42.184742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:03:54.524520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001317337,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.419952+0000","last_change":"2024-08-18T21:03:42.420443+0000","last_active":"2024-08-18T21:03:42.419952+0000","last_peered":"2024-08-18T21:03:42.419952+0000","last_clean":"2024-08-18T21:03:42.419952+0000","last_became_active":"2024-08-18T21:03:39.196022+0000","last_became_peered":"2024-08-18T21:03:39.196022+0000","last_unstale":"2024-08-18T21:03:42.419952+0000","last_undegraded":"2024-08-18T21:03:42.419952+0000","last_fullsized":"2024-08-18T21:03:42.419952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:31.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010002489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.419176+0000","last_change":"2024-08-18T21:03:33.600622+0000","last_active":"2024-08-18T21:03:42.419176+0000","last_peered":"2024-08-18T21:03:42.419176+0000","last_clean":"2024-08-18T21:03:42.419176+0000","last_became_active":"2024-08-18T21:03:33.598635+0000","last_became_peered":"2024-08-18T21:03:33.598635+0000","last_unstale":"2024-08-18T21:03:42.419176+0000","last_undegraded":"2024-08-18T21:03:42.419176+0000","last_fullsized":"2024-08-18T21:03:42.419176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:31.584484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:31.584484+0000","last_clean_scrub_stamp":"2024-08-18T21:03:31.584484+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:05.519532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":12,"seq":51539607558,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":52889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640261,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":581798,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":52889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":52870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":163840,"data_stored":52870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":581798,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T21:03:47.689 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T21:03:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.793+0000 7fce1ee75640 10 monclient: get_monmap_and_config 2024-08-18T21:03:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.793+0000 7fce1ee75640 10 monclient: build_initial_monmap 2024-08-18T21:03:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.793+0000 7fce1ee75640 10 monclient: monmap: 2024-08-18T21:03:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:47.799946+0000 2024-08-18T21:03:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:47.799946+0000 2024-08-18T21:03:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:47.799 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 1 Processor -- start 2024-08-18T21:03:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 1 -- start start 2024-08-18T21:03:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 10 monclient: init 2024-08-18T21:03:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 10 monclient: _add_conns ranks=[6,10,5,7,2,8,1,4,0,3,9] 2024-08-18T21:03:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fce180a5ac0 0x7fce180a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 10 monclient(hunting): picked mon.noname-d con 0x7fce180a5ac0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fce180a63e0 0x7fce181378e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 10 monclient(hunting): picked mon.noname-f con 0x7fce180a63e0 addr v2:172.21.15.157:3300/0 2024-08-18T21:03:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fce18137e20 0x7fce181382d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 10 monclient(hunting): picked mon.noname-h con 0x7fce18137e20 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fce180a2050 con 0x7fce180a63e0 2024-08-18T21:03:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fce180a3990 con 0x7fce18137e20 2024-08-18T21:03:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fce180a30f0 con 0x7fce180a5ac0 2024-08-18T21:03:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1ee75640 10 monclient(hunting): authenticate will time out at 994.813026s 2024-08-18T21:03:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fce180a5ac0 0x7fce180a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fce180a5ac0 0x7fce180a5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:57122/0 (socket says 172.21.15.5:57122) 2024-08-18T21:03:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 1 -- 172.21.15.5:0/2743764931 learned_addr learned my addr 172.21.15.5:0/2743764931 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 10 monclient(hunting): get_auth_request con 0x7fce180a5ac0 auth_method 0 2024-08-18T21:03:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce17fff640 1 --2- 172.21.15.5:0/2743764931 >> v2:172.21.15.157:3300/0 conn(0x7fce180a63e0 0x7fce181378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce17fff640 10 monclient(hunting): get_auth_request con 0x7fce180a63e0 auth_method 0 2024-08-18T21:03:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce17fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce17fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce17fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 10 monclient(hunting): handle_auth_done global_id 4362 payload 274 2024-08-18T21:03:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1d412640 1 --2- 172.21.15.5:0/2743764931 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fce18137e20 0x7fce181382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 1 -- 172.21.15.5:0/2743764931 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fce18137e20 msgr2=0x7fce181382d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 1 --2- 172.21.15.5:0/2743764931 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fce18137e20 0x7fce181382d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 1 -- 172.21.15.5:0/2743764931 >> v2:172.21.15.157:3300/0 conn(0x7fce180a63e0 msgr2=0x7fce181378e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 1 --2- 172.21.15.5:0/2743764931 >> v2:172.21.15.157:3300/0 conn(0x7fce180a63e0 0x7fce181378e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 10 monclient: _finish_hunting 0 2024-08-18T21:03:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 1 monclient: found mon.noname-d 2024-08-18T21:03:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.797+0000 7fce1cc11640 1 -- 172.21.15.5:0/2743764931 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce180a7660 con 0x7fce180a5ac0 2024-08-18T21:03:47.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1cc11640 1 -- 172.21.15.5:0/2743764931 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fce180a5ac0 msgr2=0x7fce180a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:47.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1cc11640 1 --2- 172.21.15.5:0/2743764931 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fce180a5ac0 0x7fce180a5ea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fce08009870 tx=0x7fce0801c420 comp rx=0 tx=0).ready entity=mon.6 client_cookie=9946d7648eb51951 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:47.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce177fe640 1 -- 172.21.15.5:0/2743764931 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce080b0070 con 0x7fce180a5ac0 2024-08-18T21:03:47.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce177fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:47.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce177fe640 10 monclient: dump: 2024-08-18T21:03:47.806 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.808 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce177fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce177fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1ee75640 5 monclient: authenticate success, global_id 4362 2024-08-18T21:03:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce177fe640 1 -- 172.21.15.5:0/2743764931 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce080aa810 con 0x7fce180a5ac0 2024-08-18T21:03:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1ee75640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce177fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1ee75640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1ee75640 4 set_mon_vals no callback set 2024-08-18T21:03:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce177fe640 1 -- 172.21.15.5:0/2743764931 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce080a9300 con 0x7fce180a5ac0 2024-08-18T21:03:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce177fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce177fe640 10 monclient: dump: 2024-08-18T21:03:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.810 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1ee75640 10 monclient: shutdown 2024-08-18T21:03:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1ee75640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1ee75640 1 -- 172.21.15.5:0/2743764931 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fce180a5ac0 msgr2=0x7fce180a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1ee75640 1 --2- 172.21.15.5:0/2743764931 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fce180a5ac0 0x7fce180a5ea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fce08009870 tx=0x7fce0801c420 comp rx=0 tx=0).stop 2024-08-18T21:03:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1ee75640 1 -- 172.21.15.5:0/2743764931 shutdown_connections 2024-08-18T21:03:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1ee75640 1 --2- 172.21.15.5:0/2743764931 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fce18137e20 0x7fce181382d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1ee75640 1 --2- 172.21.15.5:0/2743764931 >> v2:172.21.15.157:3300/0 conn(0x7fce180a63e0 0x7fce181378e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1ee75640 1 --2- 172.21.15.5:0/2743764931 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fce180a5ac0 0x7fce180a5ea0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1ee75640 1 -- 172.21.15.5:0/2743764931 >> 172.21.15.5:0/2743764931 conn(0x7fce180aa770 msgr2=0x7fce180a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1ee75640 1 -- 172.21.15.5:0/2743764931 shutdown_connections 2024-08-18T21:03:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.801+0000 7fce1ee75640 1 -- 172.21.15.5:0/2743764931 wait complete. 2024-08-18T21:03:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 10 monclient: build_initial_monmap 2024-08-18T21:03:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 10 monclient: monmap: 2024-08-18T21:03:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:47.815 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 1 Processor -- start 2024-08-18T21:03:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 1 -- start start 2024-08-18T21:03:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 10 monclient: init 2024-08-18T21:03:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 10 monclient: _add_conns ranks=[3,6,5,7,4,0,8,2,1] 2024-08-18T21:03:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce180a5ac0 0x7fce181394e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 10 monclient(hunting): picked mon.noname-g con 0x7fce180a5ac0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fce180a63e0 0x7fce18139a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 10 monclient(hunting): picked mon.noname-d con 0x7fce180a63e0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fce18137e20 0x7fce18139f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 10 monclient(hunting): picked mon.noname-h con 0x7fce18137e20 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fce180a1dc0 con 0x7fce180a5ac0 2024-08-18T21:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fce180a1c40 con 0x7fce18137e20 2024-08-18T21:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fce181417d0 con 0x7fce180a63e0 2024-08-18T21:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1ee75640 10 monclient(hunting): authenticate will time out at 994.821368s 2024-08-18T21:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fce180a63e0 0x7fce18139a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fce180a63e0 0x7fce18139a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:57136/0 (socket says 172.21.15.5:57136) 2024-08-18T21:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 1 -- 172.21.15.5:0/915796249 learned_addr learned my addr 172.21.15.5:0/915796249 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 10 monclient(hunting): get_auth_request con 0x7fce180a63e0 auth_method 0 2024-08-18T21:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1d412640 1 --2- 172.21.15.5:0/915796249 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fce18137e20 0x7fce18139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 10 monclient(hunting): handle_auth_done global_id 4371 payload 824 2024-08-18T21:03:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 1 -- 172.21.15.5:0/915796249 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fce18137e20 msgr2=0x7fce18139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 1 --2- 172.21.15.5:0/915796249 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fce18137e20 0x7fce18139f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 1 -- 172.21.15.5:0/915796249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce180a5ac0 msgr2=0x7fce181394e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1cc11640 1 --2- 172.21.15.5:0/915796249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce180a5ac0 0x7fce181394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 1 --2- 172.21.15.5:0/915796249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce180a5ac0 0x7fce181394e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 10 monclient: _finish_hunting 0 2024-08-18T21:03:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 1 monclient: found mon.noname-d 2024-08-18T21:03:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 1 -- 172.21.15.5:0/915796249 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1813df10 con 0x7fce180a63e0 2024-08-18T21:03:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1d412640 10 monclient: get_auth_request con 0x7fce18137e20 auth_method 0 2024-08-18T21:03:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce1d412640 1 --2- 172.21.15.5:0/915796249 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fce18137e20 0x7fce18139f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 1 -- 172.21.15.5:0/915796249 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fce180a63e0 msgr2=0x7fce18139a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.805+0000 7fce17fff640 1 --2- 172.21.15.5:0/915796249 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fce180a63e0 0x7fce18139a20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fce0c007ef0 tx=0x7fce0c00e4b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce157fa640 1 -- 172.21.15.5:0/915796249 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce0c01a070 con 0x7fce180a63e0 2024-08-18T21:03:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce157fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce157fa640 10 monclient: dump: 2024-08-18T21:03:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.819 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce157fa640 10 monclient: _finish_auth 0 2024-08-18T21:03:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce157fa640 10 monclient: _check_auth_tickets 2024-08-18T21:03:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce157fa640 1 -- 172.21.15.5:0/915796249 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0c003bb0 con 0x7fce180a63e0 2024-08-18T21:03:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce1ee75640 5 monclient: authenticate success, global_id 4371 2024-08-18T21:03:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce1ee75640 10 monclient: _renew_subs 2024-08-18T21:03:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce1ee75640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce1ee75640 1 -- 172.21.15.5:0/915796249 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce180a6bb0 con 0x7fce180a63e0 2024-08-18T21:03:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce157fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce157fa640 1 -- 172.21.15.5:0/915796249 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce0c003d60 con 0x7fce180a63e0 2024-08-18T21:03:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce157fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce157fa640 10 monclient: dump: 2024-08-18T21:03:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:47.821 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce16ffd640 4 set_mon_vals no callback set 2024-08-18T21:03:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce1ee75640 10 monclient: _renew_subs 2024-08-18T21:03:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce1ee75640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce1ee75640 1 -- 172.21.15.5:0/915796249 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fce1813d020 con 0x7fce180a63e0 2024-08-18T21:03:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce1ee75640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce1ee75640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce1ee75640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce1ee75640 1 -- 172.21.15.5:0/915796249 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce1813bb00 con 0x7fce180a63e0 2024-08-18T21:03:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce157fa640 1 -- 172.21.15.5:0/915796249 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fce0c004030 con 0x7fce180a63e0 2024-08-18T21:03:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce157fa640 1 --2- 172.21.15.5:0/915796249 >> v2:172.21.15.157:6812/631023601 conn(0x7fce0403bdc0 0x7fce0403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce157fa640 1 -- 172.21.15.5:0/915796249 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fce0c04e850 con 0x7fce180a63e0 2024-08-18T21:03:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce1cc11640 1 --2- 172.21.15.5:0/915796249 >> v2:172.21.15.157:6812/631023601 conn(0x7fce0403bdc0 0x7fce0403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.809+0000 7fce1cc11640 10 monclient: get_auth_request con 0x7fce0403bdc0 auth_method 0 2024-08-18T21:03:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.813+0000 7fce1cc11640 1 --2- 172.21.15.5:0/915796249 >> v2:172.21.15.157:6812/631023601 conn(0x7fce0403bdc0 0x7fce0403e280 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fce180a75d0 tx=0x7fce080a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.813+0000 7fce157fa640 1 -- 172.21.15.5:0/915796249 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fce180a6bb0 con 0x7fce180a63e0 2024-08-18T21:03:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.813+0000 7fce157fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.813+0000 7fce157fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.973+0000 7fce1ee75640 1 -- 172.21.15.5:0/915796249 --> v2:172.21.15.157:6812/631023601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce1813bdd0 con 0x7fce0403bdc0 2024-08-18T21:03:47.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.977+0000 7fce157fa640 1 -- 172.21.15.5:0/915796249 <== mgr.4130 v2:172.21.15.157:6812/631023601 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34141 (secure 0 0 0) 0x7fce080c1570 con 0x7fce0403bdc0 2024-08-18T21:03:47.979 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:03:47.979 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T21:03:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.977+0000 7fce1ee75640 1 -- 172.21.15.5:0/915796249 >> v2:172.21.15.157:6812/631023601 conn(0x7fce0403bdc0 msgr2=0x7fce0403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.977+0000 7fce1ee75640 1 --2- 172.21.15.5:0/915796249 >> v2:172.21.15.157:6812/631023601 conn(0x7fce0403bdc0 0x7fce0403e280 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fce180a75d0 tx=0x7fce080a6000 comp rx=0 tx=0).stop 2024-08-18T21:03:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.977+0000 7fce1ee75640 10 monclient: shutdown 2024-08-18T21:03:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.977+0000 7fce1ee75640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.977+0000 7fce1ee75640 1 -- 172.21.15.5:0/915796249 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fce180a63e0 msgr2=0x7fce18139a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.977+0000 7fce1ee75640 1 --2- 172.21.15.5:0/915796249 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fce180a63e0 0x7fce18139a20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fce0c007ef0 tx=0x7fce0c00e4b0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.977+0000 7fce1ee75640 1 -- 172.21.15.5:0/915796249 shutdown_connections 2024-08-18T21:03:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.977+0000 7fce1ee75640 1 --2- 172.21.15.5:0/915796249 >> v2:172.21.15.157:6812/631023601 conn(0x7fce0403bdc0 0x7fce0403e280 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.977+0000 7fce1ee75640 1 --2- 172.21.15.5:0/915796249 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fce18137e20 0x7fce18139f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.977+0000 7fce1ee75640 1 --2- 172.21.15.5:0/915796249 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fce180a63e0 0x7fce18139a20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.977+0000 7fce1ee75640 1 --2- 172.21.15.5:0/915796249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce180a5ac0 0x7fce181394e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.977+0000 7fce1ee75640 1 -- 172.21.15.5:0/915796249 >> 172.21.15.5:0/915796249 conn(0x7fce180aa770 msgr2=0x7fce1809e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.977+0000 7fce1ee75640 1 -- 172.21.15.5:0/915796249 shutdown_connections 2024-08-18T21:03:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:47.977+0000 7fce1ee75640 1 -- 172.21.15.5:0/915796249 wait complete. 2024-08-18T21:03:47.996 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-18T21:03:47.339300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":167420,"kb_used_data":1072,"kb_used_omap":9,"kb_used_meta":166198,"kb_avail":566063620,"statfs":{"total":579820584960,"available":579649146880,"internally_reserved":0,"allocated":1097728,"data_stored":1375114,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9572,"internal_metadata":170187420},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002248"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.420333+0000","last_change":"2024-08-18T21:03:42.420853+0000","last_active":"2024-08-18T21:03:42.420333+0000","last_peered":"2024-08-18T21:03:42.420333+0000","last_clean":"2024-08-18T21:03:42.420333+0000","last_became_active":"2024-08-18T21:03:39.195166+0000","last_became_peered":"2024-08-18T21:03:39.195166+0000","last_unstale":"2024-08-18T21:03:42.420333+0000","last_undegraded":"2024-08-18T21:03:42.420333+0000","last_fullsized":"2024-08-18T21:03:42.420333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:11:34.985385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001377777,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.183980+0000","last_change":"2024-08-18T21:03:42.184578+0000","last_active":"2024-08-18T21:03:42.183980+0000","last_peered":"2024-08-18T21:03:42.183980+0000","last_clean":"2024-08-18T21:03:42.183980+0000","last_became_active":"2024-08-18T21:03:39.194596+0000","last_became_peered":"2024-08-18T21:03:39.194596+0000","last_unstale":"2024-08-18T21:03:42.183980+0000","last_undegraded":"2024-08-18T21:03:42.183980+0000","last_fullsized":"2024-08-18T21:03:42.183980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:22.467656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001127341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.419869+0000","last_change":"2024-08-18T21:03:42.420253+0000","last_active":"2024-08-18T21:03:42.419869+0000","last_peered":"2024-08-18T21:03:42.419869+0000","last_clean":"2024-08-18T21:03:42.419869+0000","last_became_active":"2024-08-18T21:03:39.192148+0000","last_became_peered":"2024-08-18T21:03:39.192148+0000","last_unstale":"2024-08-18T21:03:42.419869+0000","last_undegraded":"2024-08-18T21:03:42.419869+0000","last_fullsized":"2024-08-18T21:03:42.419869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:00:27.022175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082257800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.419473+0000","last_change":"2024-08-18T21:03:42.420020+0000","last_active":"2024-08-18T21:03:42.419473+0000","last_peered":"2024-08-18T21:03:42.419473+0000","last_clean":"2024-08-18T21:03:42.419473+0000","last_became_active":"2024-08-18T21:03:39.203685+0000","last_became_peered":"2024-08-18T21:03:39.203685+0000","last_unstale":"2024-08-18T21:03:42.419473+0000","last_undegraded":"2024-08-18T21:03:42.419473+0000","last_fullsized":"2024-08-18T21:03:42.419473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:36.890241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099204900000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.186027+0000","last_change":"2024-08-18T21:03:42.186027+0000","last_active":"2024-08-18T21:03:42.186027+0000","last_peered":"2024-08-18T21:03:42.186027+0000","last_clean":"2024-08-18T21:03:42.186027+0000","last_became_active":"2024-08-18T21:03:39.192275+0000","last_became_peered":"2024-08-18T21:03:39.192275+0000","last_unstale":"2024-08-18T21:03:42.186027+0000","last_undegraded":"2024-08-18T21:03:42.186027+0000","last_fullsized":"2024-08-18T21:03:42.186027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:55:49.809092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001842333,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.184121+0000","last_change":"2024-08-18T21:03:42.184643+0000","last_active":"2024-08-18T21:03:42.184121+0000","last_peered":"2024-08-18T21:03:42.184121+0000","last_clean":"2024-08-18T21:03:42.184121+0000","last_became_active":"2024-08-18T21:03:39.201549+0000","last_became_peered":"2024-08-18T21:03:39.201549+0000","last_unstale":"2024-08-18T21:03:42.184121+0000","last_undegraded":"2024-08-18T21:03:42.184121+0000","last_fullsized":"2024-08-18T21:03:42.184121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:01:33.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010119630000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.184742+0000","last_change":"2024-08-18T21:03:42.185411+0000","last_active":"2024-08-18T21:03:42.184742+0000","last_peered":"2024-08-18T21:03:42.184742+0000","last_clean":"2024-08-18T21:03:42.184742+0000","last_became_active":"2024-08-18T21:03:39.201697+0000","last_became_peered":"2024-08-18T21:03:39.201697+0000","last_unstale":"2024-08-18T21:03:42.184742+0000","last_undegraded":"2024-08-18T21:03:42.184742+0000","last_fullsized":"2024-08-18T21:03:42.184742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:03:54.524520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001317337,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.419952+0000","last_change":"2024-08-18T21:03:42.420443+0000","last_active":"2024-08-18T21:03:42.419952+0000","last_peered":"2024-08-18T21:03:42.419952+0000","last_clean":"2024-08-18T21:03:42.419952+0000","last_became_active":"2024-08-18T21:03:39.196022+0000","last_became_peered":"2024-08-18T21:03:39.196022+0000","last_unstale":"2024-08-18T21:03:42.419952+0000","last_undegraded":"2024-08-18T21:03:42.419952+0000","last_fullsized":"2024-08-18T21:03:42.419952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:31.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010002489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.419176+0000","last_change":"2024-08-18T21:03:33.600622+0000","last_active":"2024-08-18T21:03:42.419176+0000","last_peered":"2024-08-18T21:03:42.419176+0000","last_clean":"2024-08-18T21:03:42.419176+0000","last_became_active":"2024-08-18T21:03:33.598635+0000","last_became_peered":"2024-08-18T21:03:33.598635+0000","last_unstale":"2024-08-18T21:03:42.419176+0000","last_undegraded":"2024-08-18T21:03:42.419176+0000","last_fullsized":"2024-08-18T21:03:42.419176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:31.584484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:31.584484+0000","last_clean_scrub_stamp":"2024-08-18T21:03:31.584484+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:05.519532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":12,"seq":51539607558,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":52889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640261,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":581798,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":52889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":52870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":163840,"data_stored":52870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":581798,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T21:03:47.997 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T21:03:47.997 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-18T21:03:47.997 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-18T21:03:47.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-18T21:03:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 10 monclient: get_monmap_and_config 2024-08-18T21:03:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 10 monclient: build_initial_monmap 2024-08-18T21:03:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 10 monclient: monmap: 2024-08-18T21:03:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:48.106062+0000 2024-08-18T21:03:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:48.106062+0000 2024-08-18T21:03:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:48.105 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:48.105 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:48.105 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:48.105 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:48.105 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:48.105 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:48.105 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:48.105 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:48.105 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:48.105 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:48.105 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:48.105 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:48.105 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:48.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 1 Processor -- start 2024-08-18T21:03:48.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 1 -- start start 2024-08-18T21:03:48.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 10 monclient: init 2024-08-18T21:03:48.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:48.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 10 monclient: _add_conns ranks=[5,2,8,0,6,10,1,3,4,9,7] 2024-08-18T21:03:48.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdc6c0a6ce0 0x7fdc6c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:48.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 10 monclient(hunting): picked mon.noname-h con 0x7fdc6c0a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:48.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdc6c0a7600 0x7fdc6c139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:48.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 10 monclient(hunting): picked mon.noname-b con 0x7fdc6c0a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:48.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdc6c139fe0 0x7fdc6c13a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:48.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 10 monclient(hunting): picked mon.noname-e con 0x7fdc6c139fe0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:48.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:48.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fdc6c0a5000 con 0x7fdc6c0a7600 2024-08-18T21:03:48.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:48.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdc6c0a4360 con 0x7fdc6c0a6ce0 2024-08-18T21:03:48.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:48.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fdc6c0a45d0 con 0x7fdc6c139fe0 2024-08-18T21:03:48.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:48.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc724aa640 10 monclient(hunting): authenticate will time out at 995.119165s 2024-08-18T21:03:48.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc6b7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdc6c0a7600 0x7fdc6c139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:48.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdc6c139fe0 0x7fdc6c13a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:48.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc6b7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdc6c0a7600 0x7fdc6c139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34210/0 (socket says 172.21.15.5:34210) 2024-08-18T21:03:48.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc6b7fe640 1 -- 172.21.15.5:0/2206712336 learned_addr learned my addr 172.21.15.5:0/2206712336 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:48.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc6b7fe640 10 monclient(hunting): get_auth_request con 0x7fdc6c0a7600 auth_method 0 2024-08-18T21:03:48.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc6b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:48.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc6b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:48.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc6b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:48.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 10 monclient(hunting): get_auth_request con 0x7fdc6c139fe0 auth_method 0 2024-08-18T21:03:48.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:48.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:48.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:48.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:48.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:48.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:48.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc6b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:48.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc6b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:48.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc6b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:48.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc6bfff640 1 --2- 172.21.15.5:0/2206712336 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdc6c0a6ce0 0x7fdc6c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:48.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc6bfff640 10 monclient(hunting): get_auth_request con 0x7fdc6c0a6ce0 auth_method 0 2024-08-18T21:03:48.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:48.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc6bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:48.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:48.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 10 monclient(hunting): handle_auth_done global_id 4319 payload 274 2024-08-18T21:03:48.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 1 -- 172.21.15.5:0/2206712336 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdc6c0a6ce0 msgr2=0x7fdc6c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:48.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 1 --2- 172.21.15.5:0/2206712336 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdc6c0a6ce0 0x7fdc6c0a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 1 -- 172.21.15.5:0/2206712336 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdc6c0a7600 msgr2=0x7fdc6c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:48.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 1 --2- 172.21.15.5:0/2206712336 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdc6c0a7600 0x7fdc6c139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 10 monclient: _finish_hunting 0 2024-08-18T21:03:48.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 1 monclient: found mon.noname-e 2024-08-18T21:03:48.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:48.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:48.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc70a47640 1 -- 172.21.15.5:0/2206712336 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc6c0a32d0 con 0x7fdc6c139fe0 2024-08-18T21:03:48.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.101+0000 7fdc6b7fe640 1 --2- 172.21.15.5:0/2206712336 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdc6c0a7600 0x7fdc6c139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:48.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 1 -- 172.21.15.5:0/2206712336 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdc6c139fe0 msgr2=0x7fdc6c13a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:48.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 1 --2- 172.21.15.5:0/2206712336 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdc6c139fe0 0x7fdc6c13a440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009df0 tx=0x7fdc6401c850 comp rx=0 tx=0).ready entity=mon.8 client_cookie=5364fe5ac95b7372 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:48.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6affd640 1 -- 172.21.15.5:0/2206712336 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdc640b2070 con 0x7fdc6c139fe0 2024-08-18T21:03:48.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:48.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:48.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6affd640 10 monclient: dump: 2024-08-18T21:03:48.113 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:48.113 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:48.113 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:48.114 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:48.114 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:48.114 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:48.114 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:48.114 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:48.114 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:48.114 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:48.114 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:48.114 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:48.114 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:48.114 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:48.114 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:48.114 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:48.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6affd640 10 monclient: _finish_auth 0 2024-08-18T21:03:48.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6affd640 10 monclient: _check_auth_tickets 2024-08-18T21:03:48.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:48.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6affd640 1 -- 172.21.15.5:0/2206712336 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc640a5990 con 0x7fdc6c139fe0 2024-08-18T21:03:48.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6affd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:48.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6affd640 1 -- 172.21.15.5:0/2206712336 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdc640ab340 con 0x7fdc6c139fe0 2024-08-18T21:03:48.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 5 monclient: authenticate success, global_id 4319 2024-08-18T21:03:48.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:48.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 4 set_mon_vals no callback set 2024-08-18T21:03:48.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:48.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:48.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6affd640 10 monclient: dump: 2024-08-18T21:03:48.115 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:48.116 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:48.116 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:48.116 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:48.116 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:48.116 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:48.116 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:48.116 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:48.116 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:48.116 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:48.116 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:48.116 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:48.116 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:48.116 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:48.117 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:48.117 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:48.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 10 monclient: shutdown 2024-08-18T21:03:48.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:48.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 -- 172.21.15.5:0/2206712336 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdc6c139fe0 msgr2=0x7fdc6c13a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:48.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 --2- 172.21.15.5:0/2206712336 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdc6c139fe0 0x7fdc6c13a440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009df0 tx=0x7fdc6401c850 comp rx=0 tx=0).stop 2024-08-18T21:03:48.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 -- 172.21.15.5:0/2206712336 shutdown_connections 2024-08-18T21:03:48.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 --2- 172.21.15.5:0/2206712336 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdc6c139fe0 0x7fdc6c13a440 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 --2- 172.21.15.5:0/2206712336 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdc6c0a7600 0x7fdc6c139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 --2- 172.21.15.5:0/2206712336 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdc6c0a6ce0 0x7fdc6c0a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 -- 172.21.15.5:0/2206712336 >> 172.21.15.5:0/2206712336 conn(0x7fdc6c0acbc0 msgr2=0x7fdc6c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:48.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 -- 172.21.15.5:0/2206712336 shutdown_connections 2024-08-18T21:03:48.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 -- 172.21.15.5:0/2206712336 wait complete. 2024-08-18T21:03:48.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 10 monclient: build_initial_monmap 2024-08-18T21:03:48.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 10 monclient: monmap: 2024-08-18T21:03:48.118 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:48.118 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:48.118 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:48.118 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:48.118 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:48.118 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:48.118 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:48.118 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:48.118 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:48.118 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:48.118 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:48.118 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:48.118 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:48.119 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:48.119 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:48.119 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:48.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 Processor -- start 2024-08-18T21:03:48.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 -- start start 2024-08-18T21:03:48.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 10 monclient: init 2024-08-18T21:03:48.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:48.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 10 monclient: _add_conns ranks=[5,8,0,7,1,4,2,3,6] 2024-08-18T21:03:48.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdc6c0a6ce0 0x7fdc6c0a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:48.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 10 monclient(hunting): picked mon.noname-h con 0x7fdc6c0a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:48.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdc6c0a7600 0x7fdc6c0a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:48.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 10 monclient(hunting): picked mon.noname-e con 0x7fdc6c0a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:48.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6c139fe0 0x7fdc6c0a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:48.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 10 monclient(hunting): picked mon.noname-a con 0x7fdc6c139fe0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:48.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:48.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6c0a79e0 con 0x7fdc6c139fe0 2024-08-18T21:03:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdc6c0a8220 con 0x7fdc6c0a6ce0 2024-08-18T21:03:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fdc6c13c3a0 con 0x7fdc6c0a7600 2024-08-18T21:03:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc724aa640 10 monclient(hunting): authenticate will time out at 995.127444s 2024-08-18T21:03:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6c139fe0 0x7fdc6c0a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6c139fe0 0x7fdc6c0a1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46792/0 (socket says 172.21.15.5:46792) 2024-08-18T21:03:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 1 -- 172.21.15.5:0/2268945130 learned_addr learned my addr 172.21.15.5:0/2268945130 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 10 monclient(hunting): get_auth_request con 0x7fdc6c139fe0 auth_method 0 2024-08-18T21:03:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6b7fe640 1 --2- 172.21.15.5:0/2268945130 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdc6c0a7600 0x7fdc6c0a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6b7fe640 10 monclient(hunting): get_auth_request con 0x7fdc6c0a7600 auth_method 0 2024-08-18T21:03:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6bfff640 1 --2- 172.21.15.5:0/2268945130 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdc6c0a6ce0 0x7fdc6c0a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6bfff640 10 monclient(hunting): get_auth_request con 0x7fdc6c0a6ce0 auth_method 0 2024-08-18T21:03:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:48.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:48.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 10 monclient(hunting): handle_auth_done global_id 4419 payload 824 2024-08-18T21:03:48.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 1 -- 172.21.15.5:0/2268945130 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdc6c0a7600 msgr2=0x7fdc6c0a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:48.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 1 --2- 172.21.15.5:0/2268945130 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdc6c0a7600 0x7fdc6c0a0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 1 -- 172.21.15.5:0/2268945130 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdc6c0a6ce0 msgr2=0x7fdc6c0a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:48.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 1 --2- 172.21.15.5:0/2268945130 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdc6c0a6ce0 0x7fdc6c0a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 10 monclient: _finish_hunting 0 2024-08-18T21:03:48.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 1 monclient: found mon.noname-a 2024-08-18T21:03:48.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:48.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:48.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.109+0000 7fdc70a47640 1 -- 172.21.15.5:0/2268945130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc6c0aa3e0 con 0x7fdc6c139fe0 2024-08-18T21:03:48.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc70a47640 1 -- 172.21.15.5:0/2268945130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6c139fe0 msgr2=0x7fdc6c0a1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc70a47640 1 --2- 172.21.15.5:0/2268945130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6c139fe0 0x7fdc6c0a1440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdc6401c680 tx=0x7fdc640195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc68ff9640 1 -- 172.21.15.5:0/2268945130 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdc640b2050 con 0x7fdc6c139fe0 2024-08-18T21:03:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc68ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc68ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc68ff9640 10 monclient: dump: 2024-08-18T21:03:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:48.128 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc68ff9640 10 monclient: _finish_auth 0 2024-08-18T21:03:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc68ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:03:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc68ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc68ff9640 1 -- 172.21.15.5:0/2268945130 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc640be070 con 0x7fdc6c139fe0 2024-08-18T21:03:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc68ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc68ff9640 1 -- 172.21.15.5:0/2268945130 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdc64003dc0 con 0x7fdc6c139fe0 2024-08-18T21:03:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc68ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc68ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc68ff9640 10 monclient: dump: 2024-08-18T21:03:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:48.130 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc69ffb640 4 set_mon_vals no callback set 2024-08-18T21:03:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc724aa640 5 monclient: authenticate success, global_id 4419 2024-08-18T21:03:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc724aa640 10 monclient: _renew_subs 2024-08-18T21:03:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc724aa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc724aa640 1 -- 172.21.15.5:0/2268945130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc6c135af0 con 0x7fdc6c139fe0 2024-08-18T21:03:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc724aa640 10 monclient: _renew_subs 2024-08-18T21:03:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc724aa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc724aa640 1 -- 172.21.15.5:0/2268945130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc6c13c0c0 con 0x7fdc6c139fe0 2024-08-18T21:03:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc724aa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc724aa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc724aa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc724aa640 1 -- 172.21.15.5:0/2268945130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc6c139aa0 con 0x7fdc6c139fe0 2024-08-18T21:03:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.113+0000 7fdc68ff9640 1 -- 172.21.15.5:0/2268945130 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fdc64004040 con 0x7fdc6c139fe0 2024-08-18T21:03:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.117+0000 7fdc68ff9640 1 --2- 172.21.15.5:0/2268945130 >> v2:172.21.15.157:6812/631023601 conn(0x7fdc5803bdc0 0x7fdc5803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.117+0000 7fdc68ff9640 1 -- 172.21.15.5:0/2268945130 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fdc640e8f10 con 0x7fdc6c139fe0 2024-08-18T21:03:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.117+0000 7fdc6bfff640 1 --2- 172.21.15.5:0/2268945130 >> v2:172.21.15.157:6812/631023601 conn(0x7fdc5803bdc0 0x7fdc5803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.117+0000 7fdc6bfff640 10 monclient: get_auth_request con 0x7fdc5803bdc0 auth_method 0 2024-08-18T21:03:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.117+0000 7fdc6bfff640 1 --2- 172.21.15.5:0/2268945130 >> v2:172.21.15.157:6812/631023601 conn(0x7fdc5803bdc0 0x7fdc5803e280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00b9d0 tx=0x7fdc5c008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.121+0000 7fdc68ff9640 1 -- 172.21.15.5:0/2268945130 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fdc640c7020 con 0x7fdc6c139fe0 2024-08-18T21:03:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.121+0000 7fdc68ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.121+0000 7fdc68ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.325+0000 7fdc724aa640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2024-08-18T21:03:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.325+0000 7fdc724aa640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2024-08-18T21:03:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.325+0000 7fdc724aa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.325+0000 7fdc724aa640 1 -- 172.21.15.5:0/2268945130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdc6c13bde0 con 0x7fdc6c139fe0 2024-08-18T21:03:48.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.325+0000 7fdc68ff9640 1 -- 172.21.15.5:0/2268945130 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fdc64016560 con 0x7fdc6c139fe0 2024-08-18T21:03:48.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.325+0000 7fdc68ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2024-08-18T21:03:48.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.325+0000 7fdc68ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:48.329 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:03:48.329 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-18T21:03:48.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.329+0000 7fdc724aa640 1 -- 172.21.15.5:0/2268945130 >> v2:172.21.15.157:6812/631023601 conn(0x7fdc5803bdc0 msgr2=0x7fdc5803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:48.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.329+0000 7fdc724aa640 1 --2- 172.21.15.5:0/2268945130 >> v2:172.21.15.157:6812/631023601 conn(0x7fdc5803bdc0 0x7fdc5803e280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00b9d0 tx=0x7fdc5c008040 comp rx=0 tx=0).stop 2024-08-18T21:03:48.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.329+0000 7fdc724aa640 10 monclient: shutdown 2024-08-18T21:03:48.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.329+0000 7fdc724aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:48.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.329+0000 7fdc724aa640 1 -- 172.21.15.5:0/2268945130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6c139fe0 msgr2=0x7fdc6c0a1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:48.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.329+0000 7fdc724aa640 1 --2- 172.21.15.5:0/2268945130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6c139fe0 0x7fdc6c0a1440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdc6401c680 tx=0x7fdc640195f0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.329+0000 7fdc724aa640 1 -- 172.21.15.5:0/2268945130 shutdown_connections 2024-08-18T21:03:48.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.329+0000 7fdc724aa640 1 --2- 172.21.15.5:0/2268945130 >> v2:172.21.15.157:6812/631023601 conn(0x7fdc5803bdc0 0x7fdc5803e280 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.329+0000 7fdc724aa640 1 --2- 172.21.15.5:0/2268945130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6c139fe0 0x7fdc6c0a1440 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.329+0000 7fdc724aa640 1 --2- 172.21.15.5:0/2268945130 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdc6c0a7600 0x7fdc6c0a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.329+0000 7fdc724aa640 1 --2- 172.21.15.5:0/2268945130 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdc6c0a6ce0 0x7fdc6c0a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.329+0000 7fdc724aa640 1 -- 172.21.15.5:0/2268945130 >> 172.21.15.5:0/2268945130 conn(0x7fdc6c0acbc0 msgr2=0x7fdc6c135d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:48.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.329+0000 7fdc724aa640 1 -- 172.21.15.5:0/2268945130 shutdown_connections 2024-08-18T21:03:48.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.329+0000 7fdc724aa640 1 -- 172.21.15.5:0/2268945130 wait complete. 2024-08-18T21:03:48.346 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-18T21:03:48.347 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-08-18T21:03:48.360 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-08-18T21:03:48.360 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T21:03:48.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.477+0000 7fa7443d6640 10 monclient: get_monmap_and_config 2024-08-18T21:03:48.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.477+0000 7fa7443d6640 10 monclient: build_initial_monmap 2024-08-18T21:03:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.477+0000 7fa7443d6640 10 monclient: monmap: 2024-08-18T21:03:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:48.483620+0000 2024-08-18T21:03:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:48.483620+0000 2024-08-18T21:03:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:48.483 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:48.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 1 Processor -- start 2024-08-18T21:03:48.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 1 -- start start 2024-08-18T21:03:48.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 10 monclient: init 2024-08-18T21:03:48.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:48.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 10 monclient: _add_conns ranks=[9,8,3,10,6,2,4,1,0,7,5] 2024-08-18T21:03:48.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa73c0a1820 0x7fa73c0a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:48.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 10 monclient(hunting): picked mon.noname-a con 0x7fa73c0a1820 addr v2:172.21.15.5:3300/0 2024-08-18T21:03:48.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa73c137b80 0x7fa73c068700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:48.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 10 monclient(hunting): picked mon.noname-e con 0x7fa73c137b80 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:48.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa73c068c40 0x7fa73c0690c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:48.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 10 monclient(hunting): picked mon.noname-g con 0x7fa73c068c40 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:48.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:48.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa73c09fab0 con 0x7fa73c0a1820 2024-08-18T21:03:48.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:48.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa73c09fd50 con 0x7fa73c068c40 2024-08-18T21:03:48.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:48.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fa73c0a0310 con 0x7fa73c137b80 2024-08-18T21:03:48.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:48.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa7443d6640 10 monclient(hunting): authenticate will time out at 995.496788s 2024-08-18T21:03:48.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa741971640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa73c137b80 0x7fa73c068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:48.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa73c0a1820 0x7fa73c0a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:48.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa73c0a1820 0x7fa73c0a1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46800/0 (socket says 172.21.15.5:46800) 2024-08-18T21:03:48.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa741971640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa73c137b80 0x7fa73c068700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47522/0 (socket says 172.21.15.5:47522) 2024-08-18T21:03:48.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 1 -- 172.21.15.5:0/1899147628 learned_addr learned my addr 172.21.15.5:0/1899147628 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:48.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 10 monclient(hunting): get_auth_request con 0x7fa73c0a1820 auth_method 0 2024-08-18T21:03:48.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:48.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:48.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:48.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa741971640 10 monclient(hunting): get_auth_request con 0x7fa73c137b80 auth_method 0 2024-08-18T21:03:48.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa741971640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:48.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa741971640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:48.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa741971640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:48.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:48.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:48.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:48.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa741971640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:48.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa741971640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:48.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa741971640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:48.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742973640 1 --2- 172.21.15.5:0/1899147628 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa73c068c40 0x7fa73c0690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:48.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 10 monclient(hunting): handle_auth_done global_id 4428 payload 274 2024-08-18T21:03:48.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 1 -- 172.21.15.5:0/1899147628 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa73c137b80 msgr2=0x7fa73c068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:48.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 1 --2- 172.21.15.5:0/1899147628 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa73c137b80 0x7fa73c068700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 1 -- 172.21.15.5:0/1899147628 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa73c068c40 msgr2=0x7fa73c0690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:48.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 1 --2- 172.21.15.5:0/1899147628 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa73c068c40 0x7fa73c0690c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 10 monclient: _finish_hunting 0 2024-08-18T21:03:48.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 1 monclient: found mon.noname-a 2024-08-18T21:03:48.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:48.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:48.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742172640 1 -- 172.21.15.5:0/1899147628 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73c0a0030 con 0x7fa73c0a1820 2024-08-18T21:03:48.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742973640 10 monclient: get_auth_request con 0x7fa73c068c40 auth_method 0 2024-08-18T21:03:48.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.481+0000 7fa742973640 1 --2- 172.21.15.5:0/1899147628 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa73c068c40 0x7fa73c0690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa742172640 1 -- 172.21.15.5:0/1899147628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa73c0a1820 msgr2=0x7fa73c0a1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa742172640 1 --2- 172.21.15.5:0/1899147628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa73c0a1820 0x7fa73c0a1c00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa738009870 tx=0x7fa73801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775c4f2e3d35719f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa741170640 1 -- 172.21.15.5:0/1899147628 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa7380b0070 con 0x7fa73c0a1820 2024-08-18T21:03:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa741170640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa741170640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa741170640 10 monclient: dump: 2024-08-18T21:03:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:48.493 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa741170640 10 monclient: _finish_auth 0 2024-08-18T21:03:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa741170640 10 monclient: _check_auth_tickets 2024-08-18T21:03:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa741170640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa741170640 1 -- 172.21.15.5:0/1899147628 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7380aa810 con 0x7fa73c0a1820 2024-08-18T21:03:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 5 monclient: authenticate success, global_id 4428 2024-08-18T21:03:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa741170640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 4 set_mon_vals no callback set 2024-08-18T21:03:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa741170640 1 -- 172.21.15.5:0/1899147628 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa7380aae30 con 0x7fa73c0a1820 2024-08-18T21:03:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa741170640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa741170640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa741170640 10 monclient: dump: 2024-08-18T21:03:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:48.495 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 10 monclient: shutdown 2024-08-18T21:03:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 -- 172.21.15.5:0/1899147628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa73c0a1820 msgr2=0x7fa73c0a1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 --2- 172.21.15.5:0/1899147628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa73c0a1820 0x7fa73c0a1c00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa738009870 tx=0x7fa73801c4b0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 -- 172.21.15.5:0/1899147628 shutdown_connections 2024-08-18T21:03:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 --2- 172.21.15.5:0/1899147628 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa73c068c40 0x7fa73c0690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 --2- 172.21.15.5:0/1899147628 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa73c137b80 0x7fa73c068700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 --2- 172.21.15.5:0/1899147628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa73c0a1820 0x7fa73c0a1c00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 -- 172.21.15.5:0/1899147628 >> 172.21.15.5:0/1899147628 conn(0x7fa73c0a8480 msgr2=0x7fa73c0a8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 -- 172.21.15.5:0/1899147628 shutdown_connections 2024-08-18T21:03:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 -- 172.21.15.5:0/1899147628 wait complete. 2024-08-18T21:03:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 10 monclient: build_initial_monmap 2024-08-18T21:03:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 10 monclient: monmap: 2024-08-18T21:03:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:48.497 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 Processor -- start 2024-08-18T21:03:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 -- start start 2024-08-18T21:03:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 10 monclient: init 2024-08-18T21:03:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 10 monclient: _add_conns ranks=[6,2,1,3,8,4,7,5,0] 2024-08-18T21:03:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa73c068c40 0x7fa73c1cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 10 monclient(hunting): picked mon.noname-d con 0x7fa73c068c40 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa73c0a1820 0x7fa73c1d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 10 monclient(hunting): picked mon.noname-b con 0x7fa73c0a1820 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa73c137b80 0x7fa73c138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 10 monclient(hunting): picked mon.noname-f con 0x7fa73c137b80 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c141830 con 0x7fa73c137b80 2024-08-18T21:03:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fa73c09ef60 con 0x7fa73c0a1820 2024-08-18T21:03:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fa73c1419b0 con 0x7fa73c068c40 2024-08-18T21:03:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.485+0000 7fa7443d6640 10 monclient(hunting): authenticate will time out at 995.503912s 2024-08-18T21:03:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa742172640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa73c068c40 0x7fa73c1cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa73c0a1820 0x7fa73c1d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa742172640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa73c068c40 0x7fa73c1cfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:57152/0 (socket says 172.21.15.5:57152) 2024-08-18T21:03:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 10 monclient(hunting): get_auth_request con 0x7fa73c0a1820 auth_method 0 2024-08-18T21:03:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa742172640 1 -- 172.21.15.5:0/1706862719 learned_addr learned my addr 172.21.15.5:0/1706862719 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa742172640 10 monclient(hunting): get_auth_request con 0x7fa73c068c40 auth_method 0 2024-08-18T21:03:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa742172640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa742172640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa742172640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa742172640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa742172640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa742172640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa742973640 1 --2- 172.21.15.5:0/1706862719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa73c137b80 0x7fa73c138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa742973640 10 monclient(hunting): get_auth_request con 0x7fa73c137b80 auth_method 0 2024-08-18T21:03:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa742973640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa742973640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa742973640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 10 monclient(hunting): handle_auth_done global_id 4439 payload 824 2024-08-18T21:03:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 1 -- 172.21.15.5:0/1706862719 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa73c068c40 msgr2=0x7fa73c1cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 1 --2- 172.21.15.5:0/1706862719 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa73c068c40 0x7fa73c1cfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 1 -- 172.21.15.5:0/1706862719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa73c137b80 msgr2=0x7fa73c138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 1 --2- 172.21.15.5:0/1706862719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa73c137b80 0x7fa73c138770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 10 monclient: _finish_hunting 0 2024-08-18T21:03:48.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 1 monclient: found mon.noname-b 2024-08-18T21:03:48.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:48.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:48.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 1 -- 172.21.15.5:0/1706862719 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73c139f50 con 0x7fa73c0a1820 2024-08-18T21:03:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 1 -- 172.21.15.5:0/1706862719 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa73c0a1820 msgr2=0x7fa73c1d00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa741971640 1 --2- 172.21.15.5:0/1706862719 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa73c0a1820 0x7fa73c1d00a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00e870 tx=0x7fa72c00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa732ffd640 1 -- 172.21.15.5:0/1706862719 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa72c017070 con 0x7fa73c0a1820 2024-08-18T21:03:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa732ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa732ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa732ffd640 10 monclient: dump: 2024-08-18T21:03:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:48.504 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa732ffd640 10 monclient: _finish_auth 0 2024-08-18T21:03:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa732ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:03:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa732ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa7443d6640 5 monclient: authenticate success, global_id 4439 2024-08-18T21:03:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa732ffd640 1 -- 172.21.15.5:0/1706862719 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa72c00ee60 con 0x7fa73c0a1820 2024-08-18T21:03:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa732ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa732ffd640 1 -- 172.21.15.5:0/1706862719 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa72c0138e0 con 0x7fa73c0a1820 2024-08-18T21:03:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa732ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa732ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa74096f640 4 set_mon_vals no callback set 2024-08-18T21:03:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa732ffd640 10 monclient: dump: 2024-08-18T21:03:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:48.506 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa7443d6640 10 monclient: _renew_subs 2024-08-18T21:03:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa7443d6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa7443d6640 1 -- 172.21.15.5:0/1706862719 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa73c1d05e0 con 0x7fa73c0a1820 2024-08-18T21:03:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa7443d6640 10 monclient: _renew_subs 2024-08-18T21:03:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa7443d6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.489+0000 7fa7443d6640 1 -- 172.21.15.5:0/1706862719 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa73c13cc00 con 0x7fa73c0a1820 2024-08-18T21:03:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.493+0000 7fa7443d6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.493+0000 7fa7443d6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.493+0000 7fa7443d6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.493+0000 7fa7443d6640 1 -- 172.21.15.5:0/1706862719 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa73c068700 con 0x7fa73c0a1820 2024-08-18T21:03:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.493+0000 7fa732ffd640 1 -- 172.21.15.5:0/1706862719 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fa72c01a070 con 0x7fa73c0a1820 2024-08-18T21:03:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.493+0000 7fa732ffd640 1 --2- 172.21.15.5:0/1706862719 >> v2:172.21.15.157:6812/631023601 conn(0x7fa72003bdc0 0x7fa72003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.493+0000 7fa732ffd640 1 -- 172.21.15.5:0/1706862719 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fa72c00f040 con 0x7fa73c0a1820 2024-08-18T21:03:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.493+0000 7fa742172640 1 --2- 172.21.15.5:0/1706862719 >> v2:172.21.15.157:6812/631023601 conn(0x7fa72003bdc0 0x7fa72003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.493+0000 7fa742172640 10 monclient: get_auth_request con 0x7fa72003bdc0 auth_method 0 2024-08-18T21:03:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.497+0000 7fa742172640 1 --2- 172.21.15.5:0/1706862719 >> v2:172.21.15.157:6812/631023601 conn(0x7fa72003bdc0 0x7fa72003e280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa738009870 tx=0x7fa7380a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.497+0000 7fa732ffd640 1 -- 172.21.15.5:0/1706862719 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fa72c024380 con 0x7fa73c0a1820 2024-08-18T21:03:48.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.497+0000 7fa732ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:48.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.497+0000 7fa732ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:48.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.661+0000 7fa7443d6640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:48.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.661+0000 7fa7443d6640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:48.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.661+0000 7fa7443d6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:48.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:48.661+0000 7fa7443d6640 1 -- 172.21.15.5:0/1706862719 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa73c076d90 con 0x7fa73c0a1820 2024-08-18T21:03:49.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.149+0000 7fa732ffd640 1 -- 172.21.15.5:0/1706862719 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+10923 (secure 0 0 0) 0x7fa72c013470 con 0x7fa73c0a1820 2024-08-18T21:03:49.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.149+0000 7fa732ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:03:49.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.149+0000 7fa732ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:49.154 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:03:49.154 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","created":"2024-08-18T21:03:17.118714+0000","modified":"2024-08-18T21:03:42.169675+0000","last_up_change":"2024-08-18T21:03:30.570125+0000","last_in_change":"2024-08-18T21:03:21.231242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T21:03:31.386335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-18T21:03:37.578348+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f6d162e-ed99-408f-87c5-4880e57b4f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":150392090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":150392090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":150392090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":150392090}]},"public_addr":"172.21.15.5:6808/150392090","cluster_addr":"172.21.15.5:6809/150392090","heartbeat_back_addr":"172.21.15.5:6811/150392090","heartbeat_front_addr":"172.21.15.5:6810/150392090","state":["exists","up"]},{"osd":1,"uuid":"99984157-5771-44d0-b5fa-c3e5b2537e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1057536297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6805","nonce":1057536297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":1057536297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1057536297}]},"public_addr":"172.21.15.5:6804/1057536297","cluster_addr":"172.21.15.5:6805/1057536297","heartbeat_back_addr":"172.21.15.5:6807/1057536297","heartbeat_front_addr":"172.21.15.5:6806/1057536297","state":["exists","up"]},{"osd":2,"uuid":"00fd1d05-f5a1-4d89-8e2c-47a61392f500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3354229361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":3354229361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":3354229361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3354229361}]},"public_addr":"172.21.15.5:6800/3354229361","cluster_addr":"172.21.15.5:6801/3354229361","heartbeat_back_addr":"172.21.15.5:6803/3354229361","heartbeat_front_addr":"172.21.15.5:6802/3354229361","state":["exists","up"]},{"osd":3,"uuid":"8bb1ba33-9e75-43ee-bbfc-7ab22350e4a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1750098759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6805","nonce":1750098759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":1750098759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1750098759}]},"public_addr":"172.21.15.157:6804/1750098759","cluster_addr":"172.21.15.157:6805/1750098759","heartbeat_back_addr":"172.21.15.157:6807/1750098759","heartbeat_front_addr":"172.21.15.157:6806/1750098759","state":["exists","up"]},{"osd":4,"uuid":"f7043f2f-d6d1-4c40-bf70-80a10071a795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":269684279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":269684279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":269684279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":269684279}]},"public_addr":"172.21.15.157:6808/269684279","cluster_addr":"172.21.15.157:6809/269684279","heartbeat_back_addr":"172.21.15.157:6811/269684279","heartbeat_front_addr":"172.21.15.157:6810/269684279","state":["exists","up"]},{"osd":5,"uuid":"6d9d2c91-ec42-46cf-9b18-8c488f1f489c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2335500119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6801","nonce":2335500119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":2335500119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2335500119}]},"public_addr":"172.21.15.157:6800/2335500119","cluster_addr":"172.21.15.157:6801/2335500119","heartbeat_back_addr":"172.21.15.157:6803/2335500119","heartbeat_front_addr":"172.21.15.157:6802/2335500119","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:28.290592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.700001+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.705490+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.882949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:28.204174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.630992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T21:03:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.153+0000 7fa7443d6640 1 -- 172.21.15.5:0/1706862719 >> v2:172.21.15.157:6812/631023601 conn(0x7fa72003bdc0 msgr2=0x7fa72003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.153+0000 7fa7443d6640 1 --2- 172.21.15.5:0/1706862719 >> v2:172.21.15.157:6812/631023601 conn(0x7fa72003bdc0 0x7fa72003e280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa738009870 tx=0x7fa7380a6000 comp rx=0 tx=0).stop 2024-08-18T21:03:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.153+0000 7fa7443d6640 10 monclient: shutdown 2024-08-18T21:03:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.153+0000 7fa7443d6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.153+0000 7fa7443d6640 1 -- 172.21.15.5:0/1706862719 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa73c0a1820 msgr2=0x7fa73c1d00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.153+0000 7fa7443d6640 1 --2- 172.21.15.5:0/1706862719 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa73c0a1820 0x7fa73c1d00a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00e870 tx=0x7fa72c00ed30 comp rx=0 tx=0).stop 2024-08-18T21:03:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.153+0000 7fa7443d6640 1 -- 172.21.15.5:0/1706862719 shutdown_connections 2024-08-18T21:03:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.153+0000 7fa7443d6640 1 --2- 172.21.15.5:0/1706862719 >> v2:172.21.15.157:6812/631023601 conn(0x7fa72003bdc0 0x7fa72003e280 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.153+0000 7fa7443d6640 1 --2- 172.21.15.5:0/1706862719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa73c137b80 0x7fa73c138770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.153+0000 7fa7443d6640 1 --2- 172.21.15.5:0/1706862719 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa73c0a1820 0x7fa73c1d00a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.153+0000 7fa7443d6640 1 --2- 172.21.15.5:0/1706862719 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa73c068c40 0x7fa73c1cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.153+0000 7fa7443d6640 1 -- 172.21.15.5:0/1706862719 >> 172.21.15.5:0/1706862719 conn(0x7fa73c0a8480 msgr2=0x7fa73c098260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.153+0000 7fa7443d6640 1 -- 172.21.15.5:0/1706862719 shutdown_connections 2024-08-18T21:03:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.153+0000 7fa7443d6640 1 -- 172.21.15.5:0/1706862719 wait complete. 2024-08-18T21:03:49.180 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T21:03:31.386335+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-08-18T21:03:37.578348+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-18T21:03:49.180 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T21:03:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.309+0000 7fa35ccca640 10 monclient: get_monmap_and_config 2024-08-18T21:03:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.309+0000 7fa35ccca640 10 monclient: build_initial_monmap 2024-08-18T21:03:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.309+0000 7fa35ccca640 10 monclient: monmap: 2024-08-18T21:03:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:49.315671+0000 2024-08-18T21:03:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:49.315671+0000 2024-08-18T21:03:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:49.315 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 1 Processor -- start 2024-08-18T21:03:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 1 -- start start 2024-08-18T21:03:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 10 monclient: init 2024-08-18T21:03:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 10 monclient: _add_conns ranks=[9,8,3,4,10,6,5,1,7,2,0] 2024-08-18T21:03:49.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3580a6ce0 0x7fa3580a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:49.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 10 monclient(hunting): picked mon.noname-a con 0x7fa3580a6ce0 addr v2:172.21.15.5:3300/0 2024-08-18T21:03:49.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa3580a7600 0x7fa358139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:49.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 10 monclient(hunting): picked mon.noname-e con 0x7fa3580a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:49.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa358139fe0 0x7fa35813a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:49.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 10 monclient(hunting): picked mon.noname-g con 0x7fa358139fe0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:49.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:49.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa3580a5000 con 0x7fa3580a6ce0 2024-08-18T21:03:49.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:49.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa3580a4360 con 0x7fa358139fe0 2024-08-18T21:03:49.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:49.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fa3580a45d0 con 0x7fa3580a7600 2024-08-18T21:03:49.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:49.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35ccca640 10 monclient(hunting): authenticate will time out at 996.329170s 2024-08-18T21:03:49.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa355d9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa3580a7600 0x7fa358139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:49.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3580a6ce0 0x7fa3580a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:49.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa355d9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa3580a7600 0x7fa358139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47526/0 (socket says 172.21.15.5:47526) 2024-08-18T21:03:49.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa355d9b640 1 -- 172.21.15.5:0/731256650 learned_addr learned my addr 172.21.15.5:0/731256650 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:49.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa355d9b640 10 monclient(hunting): get_auth_request con 0x7fa3580a7600 auth_method 0 2024-08-18T21:03:49.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa355d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:49.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa355d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:49.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa355d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:49.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 10 monclient(hunting): get_auth_request con 0x7fa3580a6ce0 auth_method 0 2024-08-18T21:03:49.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:49.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:49.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:49.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa355d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:49.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa356d9d640 1 --2- 172.21.15.5:0/731256650 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa358139fe0 0x7fa35813a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:49.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa355d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:49.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa355d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:49.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa356d9d640 10 monclient(hunting): get_auth_request con 0x7fa358139fe0 auth_method 0 2024-08-18T21:03:49.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa356d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa356d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa356d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 10 monclient(hunting): handle_auth_done global_id 4437 payload 274 2024-08-18T21:03:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 1 -- 172.21.15.5:0/731256650 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa3580a7600 msgr2=0x7fa358139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 1 --2- 172.21.15.5:0/731256650 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa3580a7600 0x7fa358139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 1 -- 172.21.15.5:0/731256650 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa358139fe0 msgr2=0x7fa35813a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 1 --2- 172.21.15.5:0/731256650 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa358139fe0 0x7fa35813a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 10 monclient: _finish_hunting 0 2024-08-18T21:03:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 1 monclient: found mon.noname-a 2024-08-18T21:03:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa35659c640 1 -- 172.21.15.5:0/731256650 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3580a32d0 con 0x7fa3580a6ce0 2024-08-18T21:03:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa355d9b640 1 --2- 172.21.15.5:0/731256650 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa3580a7600 0x7fa358139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.313+0000 7fa356d9d640 1 --2- 172.21.15.5:0/731256650 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa358139fe0 0x7fa35813a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:03:49.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35659c640 1 -- 172.21.15.5:0/731256650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3580a6ce0 msgr2=0x7fa3580a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:49.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35659c640 1 --2- 172.21.15.5:0/731256650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3580a6ce0 0x7fa3580a70c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa350009d90 tx=0x7fa35001c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e842eb1c61ab4c1e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:49.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35559a640 1 -- 172.21.15.5:0/731256650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa3500b2070 con 0x7fa3580a6ce0 2024-08-18T21:03:49.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:49.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35559a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:49.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35559a640 10 monclient: dump: 2024-08-18T21:03:49.328 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:49.328 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:49.328 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:49.330 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35559a640 10 monclient: _finish_auth 0 2024-08-18T21:03:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35559a640 10 monclient: _check_auth_tickets 2024-08-18T21:03:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35559a640 1 -- 172.21.15.5:0/731256650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3500a59d0 con 0x7fa3580a6ce0 2024-08-18T21:03:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35559a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35559a640 1 -- 172.21.15.5:0/731256650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa3500ab340 con 0x7fa3580a6ce0 2024-08-18T21:03:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35ccca640 5 monclient: authenticate success, global_id 4437 2024-08-18T21:03:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35ccca640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35ccca640 4 set_mon_vals no callback set 2024-08-18T21:03:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35559a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35559a640 10 monclient: dump: 2024-08-18T21:03:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:49.333 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:49.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35ccca640 10 monclient: shutdown 2024-08-18T21:03:49.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35ccca640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:49.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35ccca640 1 -- 172.21.15.5:0/731256650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3580a6ce0 msgr2=0x7fa3580a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:49.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35ccca640 1 --2- 172.21.15.5:0/731256650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3580a6ce0 0x7fa3580a70c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa350009d90 tx=0x7fa35001c830 comp rx=0 tx=0).stop 2024-08-18T21:03:49.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35ccca640 1 -- 172.21.15.5:0/731256650 shutdown_connections 2024-08-18T21:03:49.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35ccca640 1 --2- 172.21.15.5:0/731256650 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa358139fe0 0x7fa35813a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35ccca640 1 --2- 172.21.15.5:0/731256650 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa3580a7600 0x7fa358139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35ccca640 1 --2- 172.21.15.5:0/731256650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3580a6ce0 0x7fa3580a70c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35ccca640 1 -- 172.21.15.5:0/731256650 >> 172.21.15.5:0/731256650 conn(0x7fa3580acbc0 msgr2=0x7fa3580a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:49.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35ccca640 1 -- 172.21.15.5:0/731256650 shutdown_connections 2024-08-18T21:03:49.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35ccca640 1 -- 172.21.15.5:0/731256650 wait complete. 2024-08-18T21:03:49.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35ccca640 10 monclient: build_initial_monmap 2024-08-18T21:03:49.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.317+0000 7fa35ccca640 10 monclient: monmap: 2024-08-18T21:03:49.334 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:49.334 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:49.334 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:49.334 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:49.334 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:49.334 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:49.334 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:49.334 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:49.334 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:49.335 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:49.335 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:49.335 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:49.335 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:49.335 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:49.335 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:49.335 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:49.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 1 Processor -- start 2024-08-18T21:03:49.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 1 -- start start 2024-08-18T21:03:49.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 10 monclient: init 2024-08-18T21:03:49.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 10 monclient: _add_conns ranks=[6,5,8,3,4,7,1,2,0] 2024-08-18T21:03:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa3580a6ce0 0x7fa3581363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 10 monclient(hunting): picked mon.noname-d con 0x7fa3580a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa3580a7600 0x7fa358136910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 10 monclient(hunting): picked mon.noname-h con 0x7fa3580a7600 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa358139fe0 0x7fa35813c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 10 monclient(hunting): picked mon.noname-e con 0x7fa358139fe0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fa3580a79e0 con 0x7fa3580a7600 2024-08-18T21:03:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fa3580a8220 con 0x7fa3580a6ce0 2024-08-18T21:03:49.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:49.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fa3581404a0 con 0x7fa358139fe0 2024-08-18T21:03:49.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:49.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 10 monclient(hunting): authenticate will time out at 996.336695s 2024-08-18T21:03:49.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa358139fe0 0x7fa35813c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:49.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35659c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa3580a6ce0 0x7fa3581363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:49.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35659c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa3580a6ce0 0x7fa3581363d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:57158/0 (socket says 172.21.15.5:57158) 2024-08-18T21:03:49.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 10 monclient(hunting): get_auth_request con 0x7fa358139fe0 auth_method 0 2024-08-18T21:03:49.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35659c640 1 -- 172.21.15.5:0/2259230404 learned_addr learned my addr 172.21.15.5:0/2259230404 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:49.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:49.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:49.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:49.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35659c640 10 monclient(hunting): get_auth_request con 0x7fa3580a6ce0 auth_method 0 2024-08-18T21:03:49.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:49.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:49.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:49.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:49.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa355d9b640 1 --2- 172.21.15.5:0/2259230404 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa3580a7600 0x7fa358136910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa355d9b640 10 monclient(hunting): get_auth_request con 0x7fa3580a7600 auth_method 0 2024-08-18T21:03:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa355d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa355d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa355d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 10 monclient(hunting): handle_auth_done global_id 4355 payload 824 2024-08-18T21:03:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 1 -- 172.21.15.5:0/2259230404 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa3580a6ce0 msgr2=0x7fa3581363d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:49.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 1 --2- 172.21.15.5:0/2259230404 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa3580a6ce0 0x7fa3581363d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 1 -- 172.21.15.5:0/2259230404 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa3580a7600 msgr2=0x7fa358136910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:49.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 1 --2- 172.21.15.5:0/2259230404 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa3580a7600 0x7fa358136910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 10 monclient: _finish_hunting 0 2024-08-18T21:03:49.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 1 monclient: found mon.noname-e 2024-08-18T21:03:49.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:49.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:49.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 1 -- 172.21.15.5:0/2259230404 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35813fee0 con 0x7fa358139fe0 2024-08-18T21:03:49.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 1 -- 172.21.15.5:0/2259230404 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa358139fe0 msgr2=0x7fa35813c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:49.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa356d9d640 1 --2- 172.21.15.5:0/2259230404 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa358139fe0 0x7fa35813c740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa34800d520 tx=0x7fa34800d9e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:49.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa34effd640 1 -- 172.21.15.5:0/2259230404 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa348012c70 con 0x7fa358139fe0 2024-08-18T21:03:49.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa34effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa34effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa34effd640 10 monclient: dump: 2024-08-18T21:03:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:49.342 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa34effd640 10 monclient: _finish_auth 0 2024-08-18T21:03:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa34effd640 10 monclient: _check_auth_tickets 2024-08-18T21:03:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa34effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa34effd640 1 -- 172.21.15.5:0/2259230404 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa348019070 con 0x7fa358139fe0 2024-08-18T21:03:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa34effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa34effd640 1 -- 172.21.15.5:0/2259230404 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa348012e30 con 0x7fa358139fe0 2024-08-18T21:03:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa34effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa34effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa34effd640 10 monclient: dump: 2024-08-18T21:03:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:49.344 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa354d99640 4 set_mon_vals no callback set 2024-08-18T21:03:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 5 monclient: authenticate success, global_id 4355 2024-08-18T21:03:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 10 monclient: _renew_subs 2024-08-18T21:03:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 1 -- 172.21.15.5:0/2259230404 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3581401c0 con 0x7fa358139fe0 2024-08-18T21:03:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 10 monclient: _renew_subs 2024-08-18T21:03:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.321+0000 7fa35ccca640 1 -- 172.21.15.5:0/2259230404 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fa35813fc00 con 0x7fa358139fe0 2024-08-18T21:03:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.325+0000 7fa35ccca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.325+0000 7fa35ccca640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.325+0000 7fa35ccca640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.325+0000 7fa34effd640 1 -- 172.21.15.5:0/2259230404 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fa348012800 con 0x7fa358139fe0 2024-08-18T21:03:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.325+0000 7fa35ccca640 1 -- 172.21.15.5:0/2259230404 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3580a70c0 con 0x7fa358139fe0 2024-08-18T21:03:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.325+0000 7fa34effd640 1 --2- 172.21.15.5:0/2259230404 >> v2:172.21.15.157:6812/631023601 conn(0x7fa33803bdc0 0x7fa33803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.325+0000 7fa34effd640 1 -- 172.21.15.5:0/2259230404 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fa34800f040 con 0x7fa358139fe0 2024-08-18T21:03:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.325+0000 7fa35659c640 1 --2- 172.21.15.5:0/2259230404 >> v2:172.21.15.157:6812/631023601 conn(0x7fa33803bdc0 0x7fa33803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.325+0000 7fa35659c640 10 monclient: get_auth_request con 0x7fa33803bdc0 auth_method 0 2024-08-18T21:03:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.329+0000 7fa35659c640 1 --2- 172.21.15.5:0/2259230404 >> v2:172.21.15.157:6812/631023601 conn(0x7fa33803bdc0 0x7fa33803e280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa350000f90 tx=0x7fa3500a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.329+0000 7fa34effd640 1 -- 172.21.15.5:0/2259230404 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fa348023020 con 0x7fa358139fe0 2024-08-18T21:03:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.329+0000 7fa34effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.329+0000 7fa34effd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:49.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.497+0000 7fa35ccca640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-08-18T21:03:49.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.497+0000 7fa35ccca640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-08-18T21:03:49.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.497+0000 7fa35ccca640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:49.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.497+0000 7fa35ccca640 1 -- 172.21.15.5:0/2259230404 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa3580a7b60 con 0x7fa358139fe0 2024-08-18T21:03:49.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa34effd640 1 -- 172.21.15.5:0/2259230404 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7fa34801edb0 con 0x7fa358139fe0 2024-08-18T21:03:49.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa34effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-08-18T21:03:49.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa34effd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:49.503 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-18T21:03:49.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa35ccca640 1 -- 172.21.15.5:0/2259230404 >> v2:172.21.15.157:6812/631023601 conn(0x7fa33803bdc0 msgr2=0x7fa33803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:49.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa35ccca640 1 --2- 172.21.15.5:0/2259230404 >> v2:172.21.15.157:6812/631023601 conn(0x7fa33803bdc0 0x7fa33803e280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa350000f90 tx=0x7fa3500a7070 comp rx=0 tx=0).stop 2024-08-18T21:03:49.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa35ccca640 10 monclient: shutdown 2024-08-18T21:03:49.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa35ccca640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:49.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa35ccca640 1 -- 172.21.15.5:0/2259230404 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa358139fe0 msgr2=0x7fa35813c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:49.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa35ccca640 1 --2- 172.21.15.5:0/2259230404 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa358139fe0 0x7fa35813c740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa34800d520 tx=0x7fa34800d9e0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa35ccca640 1 -- 172.21.15.5:0/2259230404 shutdown_connections 2024-08-18T21:03:49.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa35ccca640 1 --2- 172.21.15.5:0/2259230404 >> v2:172.21.15.157:6812/631023601 conn(0x7fa33803bdc0 0x7fa33803e280 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa35ccca640 1 --2- 172.21.15.5:0/2259230404 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa358139fe0 0x7fa35813c740 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa35ccca640 1 --2- 172.21.15.5:0/2259230404 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa3580a7600 0x7fa358136910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa35ccca640 1 --2- 172.21.15.5:0/2259230404 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa3580a6ce0 0x7fa3581363d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa35ccca640 1 -- 172.21.15.5:0/2259230404 >> 172.21.15.5:0/2259230404 conn(0x7fa3580acbc0 msgr2=0x7fa3580a2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:49.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa35ccca640 1 -- 172.21.15.5:0/2259230404 shutdown_connections 2024-08-18T21:03:49.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.501+0000 7fa35ccca640 1 -- 172.21.15.5:0/2259230404 wait complete. 2024-08-18T21:03:49.522 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-08-18T21:03:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.641+0000 7f2339c86640 10 monclient: get_monmap_and_config 2024-08-18T21:03:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.641+0000 7f2339c86640 10 monclient: build_initial_monmap 2024-08-18T21:03:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.641+0000 7f2339c86640 10 monclient: monmap: 2024-08-18T21:03:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:49.647951+0000 2024-08-18T21:03:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:49.647951+0000 2024-08-18T21:03:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:49.647 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:49.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 1 Processor -- start 2024-08-18T21:03:49.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 1 -- start start 2024-08-18T21:03:49.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 10 monclient: init 2024-08-18T21:03:49.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:49.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 10 monclient: _add_conns ranks=[5,1,7,9,4,0,8,6,10,2,3] 2024-08-18T21:03:49.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f23340a6ce0 0x7f23340a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:49.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 10 monclient(hunting): picked mon.noname-h con 0x7f23340a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:49.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f23340a7600 addr v1:172.21.15.157:6789/0 2024-08-18T21:03:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f233413a1b0 0x7f2334141d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 10 monclient(hunting): picked mon.noname-i con 0x7f233413a1b0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23340a45d0 con 0x7f23340a7600 2024-08-18T21:03:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f23340a5000 con 0x7f23340a6ce0 2024-08-18T21:03:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f23340a32d0 con 0x7f233413a1b0 2024-08-18T21:03:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2339c86640 10 monclient(hunting): authenticate will time out at 996.661124s 2024-08-18T21:03:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f23340a6ce0 0x7f23340a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f232bfff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f23340a7600 0x7f2334139aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:52672/0 (socket says 172.21.15.5:52672) 2024-08-18T21:03:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f232bfff640 1 -- 172.21.15.5:0/2071473536 learned_addr learned my addr 172.21.15.5:0/2071473536 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:03:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 10 monclient(hunting): get_auth_request con 0x7f23340a6ce0 auth_method 0 2024-08-18T21:03:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2333fff640 1 --2- 172.21.15.5:0/2071473536 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f233413a1b0 0x7f2334141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2333fff640 10 monclient(hunting): get_auth_request con 0x7f233413a1b0 auth_method 0 2024-08-18T21:03:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2333fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2333fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2333fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2333fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2333fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f2333fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 10 monclient(hunting): handle_auth_done global_id 4361 payload 274 2024-08-18T21:03:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 1 -- 172.21.15.5:0/2071473536 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f233413a1b0 msgr2=0x7f2334141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 1 --2- 172.21.15.5:0/2071473536 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f233413a1b0 0x7f2334141d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 1 -- 172.21.15.5:0/2071473536 >> v1:172.21.15.157:6789/0 conn(0x7f23340a7600 legacy=0x7f2334139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 1 monclient: found mon.noname-h 2024-08-18T21:03:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:03:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.645+0000 7f23337fe640 1 -- 172.21.15.5:0/2071473536 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23340a8900 con 0x7f23340a6ce0 2024-08-18T21:03:49.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f23337fe640 1 -- 172.21.15.5:0/2071473536 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f23340a6ce0 msgr2=0x7f23340a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:49.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f23337fe640 1 --2- 172.21.15.5:0/2071473536 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f23340a6ce0 0x7f23340a70c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f23240097f0 tx=0x7f232401c3a0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=7b92c2d7d222a170 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2332ffd640 1 -- 172.21.15.5:0/2071473536 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f23240b0070 con 0x7f23340a6ce0 2024-08-18T21:03:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2332ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2332ffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:03:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2332ffd640 10 monclient: dump: 2024-08-18T21:03:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:49.659 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:49.659 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:49.659 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:49.659 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:49.659 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:49.659 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:49.659 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:49.659 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:49.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2332ffd640 10 monclient: _finish_auth 0 2024-08-18T21:03:49.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2332ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:03:49.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2332ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:49.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2339c86640 5 monclient: authenticate success, global_id 4361 2024-08-18T21:03:49.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2339c86640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:49.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2332ffd640 1 -- 172.21.15.5:0/2071473536 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23240aa3a0 con 0x7f23340a6ce0 2024-08-18T21:03:49.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2332ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:49.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2339c86640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:49.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2339c86640 4 set_mon_vals no callback set 2024-08-18T21:03:49.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2332ffd640 1 -- 172.21.15.5:0/2071473536 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f23240a4e60 con 0x7f23340a6ce0 2024-08-18T21:03:49.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2332ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:49.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2332ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:03:49.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2332ffd640 10 monclient: dump: 2024-08-18T21:03:49.660 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:49.660 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:49.660 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.660 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.660 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:49.661 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:49.661 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:49.661 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:49.661 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:49.661 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:49.661 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:49.661 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:49.661 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:49.661 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:49.661 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:49.661 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:49.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2339c86640 10 monclient: shutdown 2024-08-18T21:03:49.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2339c86640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:49.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2339c86640 1 -- 172.21.15.5:0/2071473536 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f23340a6ce0 msgr2=0x7f23340a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:49.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2339c86640 1 --2- 172.21.15.5:0/2071473536 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f23340a6ce0 0x7f23340a70c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f23240097f0 tx=0x7f232401c3a0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2339c86640 1 -- 172.21.15.5:0/2071473536 shutdown_connections 2024-08-18T21:03:49.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2339c86640 1 --2- 172.21.15.5:0/2071473536 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f233413a1b0 0x7f2334141d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2339c86640 1 --2- 172.21.15.5:0/2071473536 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f23340a6ce0 0x7f23340a70c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2339c86640 1 -- 172.21.15.5:0/2071473536 >> 172.21.15.5:0/2071473536 conn(0x7f23340acbc0 msgr2=0x7f23340a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:49.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2339c86640 1 -- 172.21.15.5:0/2071473536 shutdown_connections 2024-08-18T21:03:49.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2339c86640 1 -- 172.21.15.5:0/2071473536 wait complete. 2024-08-18T21:03:49.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2339c86640 10 monclient: build_initial_monmap 2024-08-18T21:03:49.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.649+0000 7f2339c86640 10 monclient: monmap: 2024-08-18T21:03:49.662 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:49.662 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:49.662 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 1 Processor -- start 2024-08-18T21:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 1 -- start start 2024-08-18T21:03:49.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 10 monclient: init 2024-08-18T21:03:49.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:49.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 10 monclient: _add_conns ranks=[5,3,0,4,8,6,7,2,1] 2024-08-18T21:03:49.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f23340a6ce0 0x7f2334132cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:49.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 10 monclient(hunting): picked mon.noname-h con 0x7f23340a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:49.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23340a7600 0x7f2334133200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:49.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 10 monclient(hunting): picked mon.noname-g con 0x7f23340a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:49.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f233413a1b0 0x7f233409f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:49.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 10 monclient(hunting): picked mon.noname-a con 0x7f233413a1b0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:49.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:49.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f23340a79e0 con 0x7f233413a1b0 2024-08-18T21:03:49.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:49.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f23340a8220 con 0x7f23340a7600 2024-08-18T21:03:49.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:49.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f23340a2190 con 0x7f23340a6ce0 2024-08-18T21:03:49.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:49.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2339c86640 10 monclient(hunting): authenticate will time out at 996.668870s 2024-08-18T21:03:49.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f233413a1b0 0x7f233409f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:49.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f233413a1b0 0x7f233409f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46824/0 (socket says 172.21.15.5:46824) 2024-08-18T21:03:49.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 1 -- 172.21.15.5:0/2167434313 learned_addr learned my addr 172.21.15.5:0/2167434313 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:49.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 10 monclient(hunting): get_auth_request con 0x7f233413a1b0 auth_method 0 2024-08-18T21:03:49.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:49.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:49.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:49.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f23337fe640 1 --2- 172.21.15.5:0/2167434313 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f23340a6ce0 0x7f2334132cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:49.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f23337fe640 10 monclient(hunting): get_auth_request con 0x7f23340a6ce0 auth_method 0 2024-08-18T21:03:49.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f23337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:49.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f23337fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:49.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f23337fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:49.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:49.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:49.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:49.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f232bfff640 1 --2- 172.21.15.5:0/2167434313 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23340a7600 0x7f2334133200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:49.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f23337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:49.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f23337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:49.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f23337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:49.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f232bfff640 10 monclient(hunting): get_auth_request con 0x7f23340a7600 auth_method 0 2024-08-18T21:03:49.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f232bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:49.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f232bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:49.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f232bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:49.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 10 monclient(hunting): handle_auth_done global_id 4446 payload 824 2024-08-18T21:03:49.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 1 -- 172.21.15.5:0/2167434313 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f23340a6ce0 msgr2=0x7f2334132cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:49.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 1 --2- 172.21.15.5:0/2167434313 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f23340a6ce0 0x7f2334132cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 1 -- 172.21.15.5:0/2167434313 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23340a7600 msgr2=0x7f2334133200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:49.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 1 --2- 172.21.15.5:0/2167434313 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23340a7600 0x7f2334133200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 10 monclient: _finish_hunting 0 2024-08-18T21:03:49.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 1 monclient: found mon.noname-a 2024-08-18T21:03:49.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:49.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:49.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 1 -- 172.21.15.5:0/2167434313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23340a17d0 con 0x7f233413a1b0 2024-08-18T21:03:49.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f232bfff640 1 --2- 172.21.15.5:0/2167434313 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23340a7600 0x7f2334133200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:03:49.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 1 -- 172.21.15.5:0/2167434313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f233413a1b0 msgr2=0x7f233409f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:49.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.653+0000 7f2333fff640 1 --2- 172.21.15.5:0/2167434313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f233413a1b0 0x7f233409f910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f232c009d30 tx=0x7f232c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:49.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2330ff9640 1 -- 172.21.15.5:0/2167434313 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f232c018020 con 0x7f233413a1b0 2024-08-18T21:03:49.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2330ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:49.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2330ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:49.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2330ff9640 10 monclient: dump: 2024-08-18T21:03:49.669 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:49.669 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:49.670 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.670 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.670 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:49.670 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:49.670 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:49.670 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:49.670 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:49.670 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:49.670 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:49.670 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:49.670 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:49.670 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:49.670 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:49.671 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:49.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2330ff9640 10 monclient: _finish_auth 0 2024-08-18T21:03:49.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2330ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:03:49.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2330ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:49.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2330ff9640 1 -- 172.21.15.5:0/2167434313 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232c0148f0 con 0x7f233413a1b0 2024-08-18T21:03:49.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2339c86640 5 monclient: authenticate success, global_id 4446 2024-08-18T21:03:49.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2339c86640 10 monclient: _renew_subs 2024-08-18T21:03:49.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2339c86640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:49.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2339c86640 1 -- 172.21.15.5:0/2167434313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f233413c440 con 0x7f233413a1b0 2024-08-18T21:03:49.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2330ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:49.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2330ff9640 1 -- 172.21.15.5:0/2167434313 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f232c0133e0 con 0x7f233413a1b0 2024-08-18T21:03:49.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2330ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:49.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2330ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2331ffb640 4 set_mon_vals no callback set 2024-08-18T21:03:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2330ff9640 10 monclient: dump: 2024-08-18T21:03:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:49.673 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2339c86640 10 monclient: _renew_subs 2024-08-18T21:03:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2339c86640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2339c86640 1 -- 172.21.15.5:0/2167434313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23340a2640 con 0x7f233413a1b0 2024-08-18T21:03:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2339c86640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2339c86640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2339c86640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2339c86640 1 -- 172.21.15.5:0/2167434313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23340a70c0 con 0x7f233413a1b0 2024-08-18T21:03:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2330ff9640 1 -- 172.21.15.5:0/2167434313 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f232c01b020 con 0x7f233413a1b0 2024-08-18T21:03:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2330ff9640 1 --2- 172.21.15.5:0/2167434313 >> v2:172.21.15.157:6812/631023601 conn(0x7f231403bdf0 0x7f231403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f2330ff9640 1 -- 172.21.15.5:0/2167434313 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f232c04f220 con 0x7f233413a1b0 2024-08-18T21:03:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f23337fe640 1 --2- 172.21.15.5:0/2167434313 >> v2:172.21.15.157:6812/631023601 conn(0x7f231403bdf0 0x7f231403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.657+0000 7f23337fe640 10 monclient: get_auth_request con 0x7f231403bdf0 auth_method 0 2024-08-18T21:03:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.661+0000 7f23337fe640 1 --2- 172.21.15.5:0/2167434313 >> v2:172.21.15.157:6812/631023601 conn(0x7f231403bdf0 0x7f231403e2b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f23240ad000 tx=0x7f23240a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.661+0000 7f2330ff9640 1 -- 172.21.15.5:0/2167434313 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f232c022030 con 0x7f233413a1b0 2024-08-18T21:03:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.661+0000 7f2330ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.661+0000 7f2330ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.833+0000 7f2339c86640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-08-18T21:03:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.833+0000 7f2339c86640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-08-18T21:03:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.833+0000 7f2339c86640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:03:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.833+0000 7f2339c86640 1 -- 172.21.15.5:0/2167434313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7f23341412c0 con 0x7f233413a1b0 2024-08-18T21:03:49.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.833+0000 7f2330ff9640 1 -- 172.21.15.5:0/2167434313 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) ==== 92+0+10 (secure 0 0 0) 0x7f23340a17d0 con 0x7f233413a1b0 2024-08-18T21:03:49.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.833+0000 7f2330ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-08-18T21:03:49.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.833+0000 7f2330ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:49.838 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2024-08-18T21:03:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.837+0000 7f2339c86640 1 -- 172.21.15.5:0/2167434313 >> v2:172.21.15.157:6812/631023601 conn(0x7f231403bdf0 msgr2=0x7f231403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.837+0000 7f2339c86640 1 --2- 172.21.15.5:0/2167434313 >> v2:172.21.15.157:6812/631023601 conn(0x7f231403bdf0 0x7f231403e2b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f23240ad000 tx=0x7f23240a6000 comp rx=0 tx=0).stop 2024-08-18T21:03:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.837+0000 7f2339c86640 10 monclient: shutdown 2024-08-18T21:03:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.837+0000 7f2339c86640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.837+0000 7f2339c86640 1 -- 172.21.15.5:0/2167434313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f233413a1b0 msgr2=0x7f233409f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.837+0000 7f2339c86640 1 --2- 172.21.15.5:0/2167434313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f233413a1b0 0x7f233409f910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f232c009d30 tx=0x7f232c00c490 comp rx=0 tx=0).stop 2024-08-18T21:03:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.837+0000 7f2339c86640 1 -- 172.21.15.5:0/2167434313 shutdown_connections 2024-08-18T21:03:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.837+0000 7f2339c86640 1 --2- 172.21.15.5:0/2167434313 >> v2:172.21.15.157:6812/631023601 conn(0x7f231403bdf0 0x7f231403e2b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.837+0000 7f2339c86640 1 --2- 172.21.15.5:0/2167434313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f233413a1b0 0x7f233409f910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.837+0000 7f2339c86640 1 --2- 172.21.15.5:0/2167434313 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23340a7600 0x7f2334133200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.837+0000 7f2339c86640 1 --2- 172.21.15.5:0/2167434313 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f23340a6ce0 0x7f2334132cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.837+0000 7f2339c86640 1 -- 172.21.15.5:0/2167434313 >> 172.21.15.5:0/2167434313 conn(0x7f23340acbc0 msgr2=0x7f233409da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:49.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.837+0000 7f2339c86640 1 -- 172.21.15.5:0/2167434313 shutdown_connections 2024-08-18T21:03:49.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.837+0000 7f2339c86640 1 -- 172.21.15.5:0/2167434313 wait complete. 2024-08-18T21:03:49.858 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-08-18T21:03:49.858 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T21:03:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.977+0000 7fecbaeaa640 10 monclient: get_monmap_and_config 2024-08-18T21:03:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.977+0000 7fecbaeaa640 10 monclient: build_initial_monmap 2024-08-18T21:03:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.977+0000 7fecbaeaa640 10 monclient: monmap: 2024-08-18T21:03:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:49.983110+0000 2024-08-18T21:03:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:49.983110+0000 2024-08-18T21:03:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:49.983 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:49.983 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:49.983 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:49.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.977+0000 7fecbaeaa640 1 Processor -- start 2024-08-18T21:03:49.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.977+0000 7fecbaeaa640 1 -- start start 2024-08-18T21:03:49.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.977+0000 7fecbaeaa640 10 monclient: init 2024-08-18T21:03:49.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecbaeaa640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:49.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecbaeaa640 10 monclient: _add_conns ranks=[5,1,3,7,4,0,2,10,8,9,6] 2024-08-18T21:03:49.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecbaeaa640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fecb40a6bd0 0x7fecb40a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecbaeaa640 10 monclient(hunting): picked mon.noname-h con 0x7fecb40a6bd0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecbaeaa640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fecb409f080 addr v1:172.21.15.157:6789/0 2024-08-18T21:03:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecbaeaa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecb40a74f0 0x7fecb413a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecbaeaa640 10 monclient(hunting): picked mon.noname-g con 0x7fecb40a74f0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecbaeaa640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecb40a7fb0 con 0x7fecb409f080 2024-08-18T21:03:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecbaeaa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecbaeaa640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fecb409e4c0 con 0x7fecb40a74f0 2024-08-18T21:03:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecbaeaa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecbaeaa640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fecb406f930 con 0x7fecb40a6bd0 2024-08-18T21:03:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecbaeaa640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecbaeaa640 10 monclient(hunting): authenticate will time out at 996.996510s 2024-08-18T21:03:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb3fff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fecb409f080 0x7fecb4139990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:52686/0 (socket says 172.21.15.5:52686) 2024-08-18T21:03:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb3fff640 1 -- 172.21.15.5:0/4292296818 learned_addr learned my addr 172.21.15.5:0/4292296818 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:03:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 1 --2- 172.21.15.5:0/4292296818 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fecb40a6bd0 0x7fecb40a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb9447640 1 --2- 172.21.15.5:0/4292296818 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecb40a74f0 0x7fecb413a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 10 monclient(hunting): get_auth_request con 0x7fecb40a6bd0 auth_method 0 2024-08-18T21:03:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb9447640 10 monclient(hunting): get_auth_request con 0x7fecb40a74f0 auth_method 0 2024-08-18T21:03:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb9447640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb9447640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb9447640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb9447640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb9447640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb9447640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 10 monclient(hunting): handle_auth_done global_id 4379 payload 274 2024-08-18T21:03:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 1 -- 172.21.15.5:0/4292296818 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecb40a74f0 msgr2=0x7fecb413a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 1 --2- 172.21.15.5:0/4292296818 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecb40a74f0 0x7fecb413a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 1 -- 172.21.15.5:0/4292296818 >> v1:172.21.15.157:6789/0 conn(0x7fecb409f080 legacy=0x7fecb4139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 10 monclient: _finish_hunting 0 2024-08-18T21:03:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 1 monclient: found mon.noname-h 2024-08-18T21:03:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:03:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.981+0000 7fecb8c46640 1 -- 172.21.15.5:0/4292296818 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb409de70 con 0x7fecb40a6bd0 2024-08-18T21:03:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecb8c46640 1 -- 172.21.15.5:0/4292296818 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fecb40a6bd0 msgr2=0x7fecb40a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecb8c46640 1 --2- 172.21.15.5:0/4292296818 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fecb40a6bd0 0x7fecb40a6fb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feca4009df0 tx=0x7feca401d2b0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=568b5e3fd5855ddf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecb37fe640 1 -- 172.21.15.5:0/4292296818 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feca40b2070 con 0x7fecb40a6bd0 2024-08-18T21:03:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecb37fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:03:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecb37fe640 10 monclient: dump: 2024-08-18T21:03:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:49.991 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecb37fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecb37fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecb37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 5 monclient: authenticate success, global_id 4379 2024-08-18T21:03:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecb37fe640 1 -- 172.21.15.5:0/4292296818 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca40a59b0 con 0x7fecb40a6bd0 2024-08-18T21:03:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecb37fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 4 set_mon_vals no callback set 2024-08-18T21:03:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecb37fe640 1 -- 172.21.15.5:0/4292296818 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feca40a5be0 con 0x7fecb40a6bd0 2024-08-18T21:03:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecb37fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:03:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecb37fe640 10 monclient: dump: 2024-08-18T21:03:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:49.994 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 10 monclient: shutdown 2024-08-18T21:03:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 1 -- 172.21.15.5:0/4292296818 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fecb40a6bd0 msgr2=0x7fecb40a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 1 --2- 172.21.15.5:0/4292296818 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fecb40a6bd0 0x7fecb40a6fb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feca4009df0 tx=0x7feca401d2b0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 1 -- 172.21.15.5:0/4292296818 shutdown_connections 2024-08-18T21:03:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 1 --2- 172.21.15.5:0/4292296818 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecb40a74f0 0x7fecb413a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 1 --2- 172.21.15.5:0/4292296818 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fecb40a6bd0 0x7fecb40a6fb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 1 -- 172.21.15.5:0/4292296818 >> 172.21.15.5:0/4292296818 conn(0x7fecb4068700 msgr2=0x7fecb4068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 1 -- 172.21.15.5:0/4292296818 shutdown_connections 2024-08-18T21:03:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 1 -- 172.21.15.5:0/4292296818 wait complete. 2024-08-18T21:03:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 10 monclient: build_initial_monmap 2024-08-18T21:03:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 10 monclient: monmap: 2024-08-18T21:03:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:49.996 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:49.996 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:49.996 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:49.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.985+0000 7fecbaeaa640 1 Processor -- start 2024-08-18T21:03:49.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 1 -- start start 2024-08-18T21:03:49.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 10 monclient: init 2024-08-18T21:03:50.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:50.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 10 monclient: _add_conns ranks=[2,4,7,3,0,5,1,6,8] 2024-08-18T21:03:50.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fecb409f080 0x7fecb4139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:50.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 10 monclient(hunting): picked mon.noname-b con 0x7fecb409f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:50.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fecb40a6bd0 0x7fecb413f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:50.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 10 monclient(hunting): picked mon.noname-c con 0x7fecb40a6bd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:50.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fecb40a74f0 0x7fecb413fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:50.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 10 monclient(hunting): picked mon.noname-i con 0x7fecb40a74f0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:50.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:50.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fecb413a5e0 con 0x7fecb409f080 2024-08-18T21:03:50.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:50.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fecb40a89f0 con 0x7fecb40a6bd0 2024-08-18T21:03:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fecb413a760 con 0x7fecb40a74f0 2024-08-18T21:03:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 10 monclient(hunting): authenticate will time out at 997.004562s 2024-08-18T21:03:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fecb40a6bd0 0x7fecb413f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb8c46640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fecb409f080 0x7fecb4139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb8c46640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fecb409f080 0x7fecb4139410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34242/0 (socket says 172.21.15.5:34242) 2024-08-18T21:03:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fecb40a6bd0 0x7fecb413f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:36832/0 (socket says 172.21.15.5:36832) 2024-08-18T21:03:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb8c46640 1 -- 172.21.15.5:0/321121477 learned_addr learned my addr 172.21.15.5:0/321121477 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb8c46640 10 monclient(hunting): get_auth_request con 0x7fecb409f080 auth_method 0 2024-08-18T21:03:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb8c46640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb8c46640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb8c46640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 10 monclient(hunting): get_auth_request con 0x7fecb40a6bd0 auth_method 0 2024-08-18T21:03:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb9447640 1 --2- 172.21.15.5:0/321121477 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fecb40a74f0 0x7fecb413fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb9447640 10 monclient(hunting): get_auth_request con 0x7fecb40a74f0 auth_method 0 2024-08-18T21:03:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb9447640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb9447640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb9447640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb8c46640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb8c46640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb8c46640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb9447640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb9447640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb9447640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 10 monclient(hunting): handle_auth_done global_id 4396 payload 824 2024-08-18T21:03:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 1 -- 172.21.15.5:0/321121477 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fecb40a74f0 msgr2=0x7fecb413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 1 --2- 172.21.15.5:0/321121477 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fecb40a74f0 0x7fecb413fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 1 -- 172.21.15.5:0/321121477 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fecb409f080 msgr2=0x7fecb4139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 1 --2- 172.21.15.5:0/321121477 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fecb409f080 0x7fecb4139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 10 monclient: _finish_hunting 0 2024-08-18T21:03:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 1 monclient: found mon.noname-c 2024-08-18T21:03:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 1 -- 172.21.15.5:0/321121477 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb4123940 con 0x7fecb40a6bd0 2024-08-18T21:03:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb8c46640 1 --2- 172.21.15.5:0/321121477 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fecb409f080 0x7fecb4139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 1 -- 172.21.15.5:0/321121477 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fecb40a6bd0 msgr2=0x7fecb413f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb3fff640 1 --2- 172.21.15.5:0/321121477 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fecb40a6bd0 0x7fecb413f860 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00c440 tx=0x7fec9c00c900 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb17fa640 1 -- 172.21.15.5:0/321121477 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec9c017070 con 0x7fecb40a6bd0 2024-08-18T21:03:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb17fa640 10 monclient: dump: 2024-08-18T21:03:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:50.005 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb17fa640 10 monclient: _finish_auth 0 2024-08-18T21:03:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb17fa640 10 monclient: _check_auth_tickets 2024-08-18T21:03:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb17fa640 1 -- 172.21.15.5:0/321121477 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec9c005d00 con 0x7fecb40a6bd0 2024-08-18T21:03:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 5 monclient: authenticate success, global_id 4396 2024-08-18T21:03:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 10 monclient: _renew_subs 2024-08-18T21:03:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 1 -- 172.21.15.5:0/321121477 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb4123c20 con 0x7fecb40a6bd0 2024-08-18T21:03:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb17fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb17fa640 1 -- 172.21.15.5:0/321121477 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec9c007540 con 0x7fecb40a6bd0 2024-08-18T21:03:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb27fc640 4 set_mon_vals no callback set 2024-08-18T21:03:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecb17fa640 10 monclient: dump: 2024-08-18T21:03:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 10 monclient: _renew_subs 2024-08-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.989+0000 7fecbaeaa640 1 -- 172.21.15.5:0/321121477 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb4141a00 con 0x7fecb40a6bd0 2024-08-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.993+0000 7fecb3fff640 1 --2- 172.21.15.5:0/321121477 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fecb40a6bd0 0x7fecb413f860 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00c440 tx=0x7fec9c00c900 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7fec9c04d8e0 osd_map(19..19 src has 1..19) 2024-08-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.993+0000 7fecb17fa640 1 -- 172.21.15.5:0/321121477 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fec9c007070 con 0x7fecb40a6bd0 2024-08-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.993+0000 7fecbaeaa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.993+0000 7fecbaeaa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.993+0000 7fecbaeaa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.993+0000 7fecbaeaa640 1 -- 172.21.15.5:0/321121477 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecb4123e60 con 0x7fecb40a6bd0 2024-08-18T21:03:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.993+0000 7fecb17fa640 1 --2- 172.21.15.5:0/321121477 >> v2:172.21.15.157:6812/631023601 conn(0x7fec9403bdc0 0x7fec9403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.993+0000 7fecb8c46640 1 --2- 172.21.15.5:0/321121477 >> v2:172.21.15.157:6812/631023601 conn(0x7fec9403bdc0 0x7fec9403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.993+0000 7fecb8c46640 10 monclient: get_auth_request con 0x7fec9403bdc0 auth_method 0 2024-08-18T21:03:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.997+0000 7fecb8c46640 1 --2- 172.21.15.5:0/321121477 >> v2:172.21.15.157:6812/631023601 conn(0x7fec9403bdc0 0x7fec9403e280 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7feca401d2f0 tx=0x7feca4004ac0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:49.997+0000 7fecb17fa640 1 -- 172.21.15.5:0/321121477 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fec9c04d8e0 con 0x7fecb40a6bd0 2024-08-18T21:03:50.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:50.825+0000 7fecb17fa640 1 -- 172.21.15.5:0/321121477 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fec9c007360 con 0x7fecb40a6bd0 2024-08-18T21:03:50.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:50.825+0000 7fecb17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:50.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:50.825+0000 7fecb17fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.005+0000 7fecbaeaa640 1 -- 172.21.15.5:0/321121477 --> v2:172.21.15.157:6812/631023601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fecb41415c0 con 0x7fec9403bdc0 2024-08-18T21:03:51.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.009+0000 7fecb17fa640 1 -- 172.21.15.5:0/321121477 <== mgr.4130 v2:172.21.15.157:6812/631023601 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34141 (secure 0 0 0) 0x7fecb41415c0 con 0x7fec9403bdc0 2024-08-18T21:03:51.012 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:03:51.013 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T21:03:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.013+0000 7fecbaeaa640 1 -- 172.21.15.5:0/321121477 >> v2:172.21.15.157:6812/631023601 conn(0x7fec9403bdc0 msgr2=0x7fec9403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.013+0000 7fecbaeaa640 1 --2- 172.21.15.5:0/321121477 >> v2:172.21.15.157:6812/631023601 conn(0x7fec9403bdc0 0x7fec9403e280 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7feca401d2f0 tx=0x7feca4004ac0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.013+0000 7fecbaeaa640 10 monclient: shutdown 2024-08-18T21:03:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.013+0000 7fecbaeaa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.013+0000 7fecbaeaa640 1 -- 172.21.15.5:0/321121477 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fecb40a6bd0 msgr2=0x7fecb413f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.013+0000 7fecbaeaa640 1 --2- 172.21.15.5:0/321121477 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fecb40a6bd0 0x7fecb413f860 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00c440 tx=0x7fec9c00c900 comp rx=0 tx=0).stop 2024-08-18T21:03:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.013+0000 7fecbaeaa640 1 -- 172.21.15.5:0/321121477 shutdown_connections 2024-08-18T21:03:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.013+0000 7fecbaeaa640 1 --2- 172.21.15.5:0/321121477 >> v2:172.21.15.157:6812/631023601 conn(0x7fec9403bdc0 0x7fec9403e280 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.013+0000 7fecbaeaa640 1 --2- 172.21.15.5:0/321121477 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fecb40a74f0 0x7fecb413fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.013+0000 7fecbaeaa640 1 --2- 172.21.15.5:0/321121477 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fecb40a6bd0 0x7fecb413f860 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.013+0000 7fecbaeaa640 1 --2- 172.21.15.5:0/321121477 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fecb409f080 0x7fecb4139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.013+0000 7fecbaeaa640 1 -- 172.21.15.5:0/321121477 >> 172.21.15.5:0/321121477 conn(0x7fecb4068700 msgr2=0x7fecb40a1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.013+0000 7fecbaeaa640 1 -- 172.21.15.5:0/321121477 shutdown_connections 2024-08-18T21:03:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.013+0000 7fecbaeaa640 1 -- 172.21.15.5:0/321121477 wait complete. 2024-08-18T21:03:51.034 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-18T21:03:49.339957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":167420,"kb_used_data":1072,"kb_used_omap":9,"kb_used_meta":166198,"kb_avail":566063620,"statfs":{"total":579820584960,"available":579649146880,"internally_reserved":0,"allocated":1097728,"data_stored":1375114,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9572,"internal_metadata":170187420},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.169565"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.420333+0000","last_change":"2024-08-18T21:03:42.420853+0000","last_active":"2024-08-18T21:03:42.420333+0000","last_peered":"2024-08-18T21:03:42.420333+0000","last_clean":"2024-08-18T21:03:42.420333+0000","last_became_active":"2024-08-18T21:03:39.195166+0000","last_became_peered":"2024-08-18T21:03:39.195166+0000","last_unstale":"2024-08-18T21:03:42.420333+0000","last_undegraded":"2024-08-18T21:03:42.420333+0000","last_fullsized":"2024-08-18T21:03:42.420333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:11:34.985385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001377777,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.183980+0000","last_change":"2024-08-18T21:03:42.184578+0000","last_active":"2024-08-18T21:03:42.183980+0000","last_peered":"2024-08-18T21:03:42.183980+0000","last_clean":"2024-08-18T21:03:42.183980+0000","last_became_active":"2024-08-18T21:03:39.194596+0000","last_became_peered":"2024-08-18T21:03:39.194596+0000","last_unstale":"2024-08-18T21:03:42.183980+0000","last_undegraded":"2024-08-18T21:03:42.183980+0000","last_fullsized":"2024-08-18T21:03:42.183980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:22.467656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001127341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.419869+0000","last_change":"2024-08-18T21:03:42.420253+0000","last_active":"2024-08-18T21:03:42.419869+0000","last_peered":"2024-08-18T21:03:42.419869+0000","last_clean":"2024-08-18T21:03:42.419869+0000","last_became_active":"2024-08-18T21:03:39.192148+0000","last_became_peered":"2024-08-18T21:03:39.192148+0000","last_unstale":"2024-08-18T21:03:42.419869+0000","last_undegraded":"2024-08-18T21:03:42.419869+0000","last_fullsized":"2024-08-18T21:03:42.419869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:00:27.022175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082257800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.419473+0000","last_change":"2024-08-18T21:03:42.420020+0000","last_active":"2024-08-18T21:03:42.419473+0000","last_peered":"2024-08-18T21:03:42.419473+0000","last_clean":"2024-08-18T21:03:42.419473+0000","last_became_active":"2024-08-18T21:03:39.203685+0000","last_became_peered":"2024-08-18T21:03:39.203685+0000","last_unstale":"2024-08-18T21:03:42.419473+0000","last_undegraded":"2024-08-18T21:03:42.419473+0000","last_fullsized":"2024-08-18T21:03:42.419473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:36.890241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099204900000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.186027+0000","last_change":"2024-08-18T21:03:42.186027+0000","last_active":"2024-08-18T21:03:42.186027+0000","last_peered":"2024-08-18T21:03:42.186027+0000","last_clean":"2024-08-18T21:03:42.186027+0000","last_became_active":"2024-08-18T21:03:39.192275+0000","last_became_peered":"2024-08-18T21:03:39.192275+0000","last_unstale":"2024-08-18T21:03:42.186027+0000","last_undegraded":"2024-08-18T21:03:42.186027+0000","last_fullsized":"2024-08-18T21:03:42.186027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:55:49.809092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001842333,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.184121+0000","last_change":"2024-08-18T21:03:42.184643+0000","last_active":"2024-08-18T21:03:42.184121+0000","last_peered":"2024-08-18T21:03:42.184121+0000","last_clean":"2024-08-18T21:03:42.184121+0000","last_became_active":"2024-08-18T21:03:39.201549+0000","last_became_peered":"2024-08-18T21:03:39.201549+0000","last_unstale":"2024-08-18T21:03:42.184121+0000","last_undegraded":"2024-08-18T21:03:42.184121+0000","last_fullsized":"2024-08-18T21:03:42.184121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:01:33.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010119630000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.184742+0000","last_change":"2024-08-18T21:03:42.185411+0000","last_active":"2024-08-18T21:03:42.184742+0000","last_peered":"2024-08-18T21:03:42.184742+0000","last_clean":"2024-08-18T21:03:42.184742+0000","last_became_active":"2024-08-18T21:03:39.201697+0000","last_became_peered":"2024-08-18T21:03:39.201697+0000","last_unstale":"2024-08-18T21:03:42.184742+0000","last_undegraded":"2024-08-18T21:03:42.184742+0000","last_fullsized":"2024-08-18T21:03:42.184742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:03:54.524520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001317337,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.419952+0000","last_change":"2024-08-18T21:03:42.420443+0000","last_active":"2024-08-18T21:03:42.419952+0000","last_peered":"2024-08-18T21:03:42.419952+0000","last_clean":"2024-08-18T21:03:42.419952+0000","last_became_active":"2024-08-18T21:03:39.196022+0000","last_became_peered":"2024-08-18T21:03:39.196022+0000","last_unstale":"2024-08-18T21:03:42.419952+0000","last_undegraded":"2024-08-18T21:03:42.419952+0000","last_fullsized":"2024-08-18T21:03:42.419952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:31.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010002489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.419176+0000","last_change":"2024-08-18T21:03:33.600622+0000","last_active":"2024-08-18T21:03:42.419176+0000","last_peered":"2024-08-18T21:03:42.419176+0000","last_clean":"2024-08-18T21:03:42.419176+0000","last_became_active":"2024-08-18T21:03:33.598635+0000","last_became_peered":"2024-08-18T21:03:33.598635+0000","last_unstale":"2024-08-18T21:03:42.419176+0000","last_undegraded":"2024-08-18T21:03:42.419176+0000","last_fullsized":"2024-08-18T21:03:42.419176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:31.584484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:31.584484+0000","last_clean_scrub_stamp":"2024-08-18T21:03:31.584484+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:05.519532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":12,"seq":51539607558,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":52889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640261,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":581798,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":52889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":52870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":163840,"data_stored":52870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":581798,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T21:03:51.035 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T21:03:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.145+0000 7f0eb7b3c640 10 monclient: get_monmap_and_config 2024-08-18T21:03:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.145+0000 7f0eb7b3c640 10 monclient: build_initial_monmap 2024-08-18T21:03:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.145+0000 7f0eb7b3c640 10 monclient: monmap: 2024-08-18T21:03:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:51.152099+0000 2024-08-18T21:03:51.151 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:51.152099+0000 2024-08-18T21:03:51.151 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:51.151 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.151 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:51.151 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:51.151 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:51.151 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:51.151 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:51.151 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:51.151 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:51.151 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:51.152 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:51.152 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:51.152 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:51.152 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 1 Processor -- start 2024-08-18T21:03:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 1 -- start start 2024-08-18T21:03:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 10 monclient: init 2024-08-18T21:03:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 10 monclient: _add_conns ranks=[2,10,6,4,0,1,8,3,9,5,7] 2024-08-18T21:03:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0eb00a6bd0 0x7f0eb00a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 10 monclient(hunting): picked mon.noname-b con 0x7f0eb00a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0eb009f080 0x7f0eb00a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 10 monclient(hunting): picked mon.noname-f con 0x7f0eb009f080 addr v2:172.21.15.157:3300/0 2024-08-18T21:03:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0eb0139990 0x7f0eb0139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 10 monclient(hunting): picked mon.noname-d con 0x7f0eb0139990 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f0eb009e4c0 con 0x7f0eb009f080 2024-08-18T21:03:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb006f930 con 0x7f0eb00a6bd0 2024-08-18T21:03:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f0eb00a7a30 con 0x7f0eb0139990 2024-08-18T21:03:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:51.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb7b3c640 10 monclient(hunting): authenticate will time out at 998.165157s 2024-08-18T21:03:51.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0eb00a6bd0 0x7f0eb00a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb60d9640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0eb0139990 0x7f0eb0139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0eb00a6bd0 0x7f0eb00a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34248/0 (socket says 172.21.15.5:34248) 2024-08-18T21:03:51.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 1 -- 172.21.15.5:0/3086612976 learned_addr learned my addr 172.21.15.5:0/3086612976 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:51.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 10 monclient(hunting): get_auth_request con 0x7f0eb00a6bd0 auth_method 0 2024-08-18T21:03:51.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb60d9640 10 monclient(hunting): get_auth_request con 0x7f0eb0139990 auth_method 0 2024-08-18T21:03:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb60d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb60d9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb60d9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb60d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb60d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb60d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb50d7640 1 --2- 172.21.15.5:0/3086612976 >> v2:172.21.15.157:3300/0 conn(0x7f0eb009f080 0x7f0eb00a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb50d7640 10 monclient(hunting): get_auth_request con 0x7f0eb009f080 auth_method 0 2024-08-18T21:03:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb50d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb50d7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb50d7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 10 monclient(hunting): handle_auth_done global_id 4457 payload 274 2024-08-18T21:03:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 1 -- 172.21.15.5:0/3086612976 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0eb0139990 msgr2=0x7f0eb0139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 1 --2- 172.21.15.5:0/3086612976 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0eb0139990 0x7f0eb0139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 1 -- 172.21.15.5:0/3086612976 >> v2:172.21.15.157:3300/0 conn(0x7f0eb009f080 msgr2=0x7f0eb00a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 1 --2- 172.21.15.5:0/3086612976 >> v2:172.21.15.157:3300/0 conn(0x7f0eb009f080 0x7f0eb00a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 10 monclient: _finish_hunting 0 2024-08-18T21:03:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 1 monclient: found mon.noname-b 2024-08-18T21:03:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:51.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb58d8640 1 -- 172.21.15.5:0/3086612976 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb00a7fb0 con 0x7f0eb00a6bd0 2024-08-18T21:03:51.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.149+0000 7f0eb60d9640 1 --2- 172.21.15.5:0/3086612976 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0eb0139990 0x7f0eb0139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:51.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb58d8640 1 -- 172.21.15.5:0/3086612976 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0eb00a6bd0 msgr2=0x7f0eb00a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:51.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb58d8640 1 --2- 172.21.15.5:0/3086612976 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0eb00a6bd0 0x7f0eb00a6fb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0009870 tx=0x7f0ea001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=defc7033a2668040 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:51.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb48d6640 1 -- 172.21.15.5:0/3086612976 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0ea00b0070 con 0x7f0eb00a6bd0 2024-08-18T21:03:51.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb48d6640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:51.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb48d6640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:51.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb48d6640 10 monclient: dump: 2024-08-18T21:03:51.163 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:51.163 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.163 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.163 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.163 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:51.163 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.163 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:51.163 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:51.163 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:51.163 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:51.163 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:51.163 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:51.163 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:51.164 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:51.164 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:51.164 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb48d6640 10 monclient: _finish_auth 0 2024-08-18T21:03:51.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb48d6640 10 monclient: _check_auth_tickets 2024-08-18T21:03:51.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb48d6640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:51.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb48d6640 1 -- 172.21.15.5:0/3086612976 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea00aa810 con 0x7f0eb00a6bd0 2024-08-18T21:03:51.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 5 monclient: authenticate success, global_id 4457 2024-08-18T21:03:51.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:51.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb48d6640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:51.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:51.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb48d6640 1 -- 172.21.15.5:0/3086612976 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0ea00aae30 con 0x7f0eb00a6bd0 2024-08-18T21:03:51.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb48d6640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:51.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 4 set_mon_vals no callback set 2024-08-18T21:03:51.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb48d6640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:51.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb48d6640 10 monclient: dump: 2024-08-18T21:03:51.165 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:51.165 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.165 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.165 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.165 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:51.165 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.165 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:51.165 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:51.165 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:51.165 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:51.165 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:51.166 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:51.166 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:51.166 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:51.166 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:51.166 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 10 monclient: shutdown 2024-08-18T21:03:51.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:51.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 1 -- 172.21.15.5:0/3086612976 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0eb00a6bd0 msgr2=0x7f0eb00a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 1 --2- 172.21.15.5:0/3086612976 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0eb00a6bd0 0x7f0eb00a6fb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0009870 tx=0x7f0ea001c420 comp rx=0 tx=0).stop 2024-08-18T21:03:51.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 1 -- 172.21.15.5:0/3086612976 shutdown_connections 2024-08-18T21:03:51.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 1 --2- 172.21.15.5:0/3086612976 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0eb0139990 0x7f0eb0139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 1 --2- 172.21.15.5:0/3086612976 >> v2:172.21.15.157:3300/0 conn(0x7f0eb009f080 0x7f0eb00a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 1 --2- 172.21.15.5:0/3086612976 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0eb00a6bd0 0x7f0eb00a6fb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 1 -- 172.21.15.5:0/3086612976 >> 172.21.15.5:0/3086612976 conn(0x7f0eb0068700 msgr2=0x7f0eb0068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:51.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 1 -- 172.21.15.5:0/3086612976 shutdown_connections 2024-08-18T21:03:51.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 1 -- 172.21.15.5:0/3086612976 wait complete. 2024-08-18T21:03:51.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 10 monclient: build_initial_monmap 2024-08-18T21:03:51.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 10 monclient: monmap: 2024-08-18T21:03:51.167 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:51.167 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:51.167 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:51.168 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:51.168 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:51.168 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.168 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:51.168 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:51.168 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:51.168 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:51.168 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:51.168 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:51.168 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:51.168 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:51.168 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:51.168 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 1 Processor -- start 2024-08-18T21:03:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 1 -- start start 2024-08-18T21:03:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.153+0000 7f0eb7b3c640 10 monclient: init 2024-08-18T21:03:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb7b3c640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb7b3c640 10 monclient: _add_conns ranks=[3,7,5,0,4,8,2,1,6] 2024-08-18T21:03:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb7b3c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0eb009f080 0x7f0eb01d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb7b3c640 10 monclient(hunting): picked mon.noname-g con 0x7f0eb009f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb7b3c640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0eb00a6bd0 0x7f0eb01388c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb7b3c640 10 monclient(hunting): picked mon.noname-i con 0x7f0eb00a6bd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb7b3c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0eb0139990 0x7f0eb0138e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb7b3c640 10 monclient(hunting): picked mon.noname-h con 0x7f0eb0139990 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb7b3c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb7b3c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb00a89f0 con 0x7f0eb009f080 2024-08-18T21:03:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb7b3c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb7b3c640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f0eb00a7ce0 con 0x7f0eb0139990 2024-08-18T21:03:51.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb7b3c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb7b3c640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f0eb0143610 con 0x7f0eb00a6bd0 2024-08-18T21:03:51.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb7b3c640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:51.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb7b3c640 10 monclient(hunting): authenticate will time out at 998.172394s 2024-08-18T21:03:51.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb58d8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0eb009f080 0x7f0eb01d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0eb0139990 0x7f0eb0138e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb50d7640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0eb00a6bd0 0x7f0eb01388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb50d7640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0eb00a6bd0 0x7f0eb01388c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:55232/0 (socket says 172.21.15.5:55232) 2024-08-18T21:03:51.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb50d7640 1 -- 172.21.15.5:0/1954622051 learned_addr learned my addr 172.21.15.5:0/1954622051 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:51.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb58d8640 10 monclient(hunting): get_auth_request con 0x7f0eb009f080 auth_method 0 2024-08-18T21:03:51.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb58d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb58d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb58d8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 10 monclient(hunting): get_auth_request con 0x7f0eb0139990 auth_method 0 2024-08-18T21:03:51.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb50d7640 10 monclient(hunting): get_auth_request con 0x7f0eb00a6bd0 auth_method 0 2024-08-18T21:03:51.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb50d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb50d7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb50d7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb58d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:51.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb58d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:51.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb58d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:51.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:51.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:51.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:51.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb50d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:51.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb50d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:51.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb50d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:51.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 10 monclient(hunting): handle_auth_done global_id 4388 payload 824 2024-08-18T21:03:51.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 1 -- 172.21.15.5:0/1954622051 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0eb00a6bd0 msgr2=0x7f0eb01388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 1 --2- 172.21.15.5:0/1954622051 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0eb00a6bd0 0x7f0eb01388c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 1 -- 172.21.15.5:0/1954622051 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0eb009f080 msgr2=0x7f0eb01d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 1 --2- 172.21.15.5:0/1954622051 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0eb009f080 0x7f0eb01d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 10 monclient: _finish_hunting 0 2024-08-18T21:03:51.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 1 monclient: found mon.noname-h 2024-08-18T21:03:51.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:51.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:03:51.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.157+0000 7f0eb60d9640 1 -- 172.21.15.5:0/1954622051 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb00aafe0 con 0x7f0eb0139990 2024-08-18T21:03:51.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.161+0000 7f0eb60d9640 1 -- 172.21.15.5:0/1954622051 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0eb0139990 msgr2=0x7f0eb0138e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:51.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.161+0000 7f0eb60d9640 1 --2- 172.21.15.5:0/1954622051 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0eb0139990 0x7f0eb0138e00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800efc0 tx=0x7f0ea800c490 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:51.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0ea67fc640 1 -- 172.21.15.5:0/1954622051 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0ea8018030 con 0x7f0eb0139990 2024-08-18T21:03:51.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0ea67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:51.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0ea67fc640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:03:51.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0ea67fc640 10 monclient: dump: 2024-08-18T21:03:51.175 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:51.175 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.175 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:51.176 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0ea67fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0ea67fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0ea67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0eb7b3c640 5 monclient: authenticate success, global_id 4388 2024-08-18T21:03:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0ea67fc640 1 -- 172.21.15.5:0/1954622051 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea80148f0 con 0x7f0eb0139990 2024-08-18T21:03:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0ea67fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0ea7fff640 4 set_mon_vals no callback set 2024-08-18T21:03:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0eb7b3c640 10 monclient: _renew_subs 2024-08-18T21:03:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0eb7b3c640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:03:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0eb7b3c640 1 -- 172.21.15.5:0/1954622051 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb013fcd0 con 0x7f0eb0139990 2024-08-18T21:03:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0eb7b3c640 10 monclient: _renew_subs 2024-08-18T21:03:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0eb7b3c640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:03:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0eb7b3c640 1 -- 172.21.15.5:0/1954622051 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb0123ac0 con 0x7f0eb0139990 2024-08-18T21:03:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0eb7b3c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0eb7b3c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0eb7b3c640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:03:51.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.165+0000 7f0eb7b3c640 1 -- 172.21.15.5:0/1954622051 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb0139e10 con 0x7f0eb0139990 2024-08-18T21:03:51.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.169+0000 7f0ea67fc640 1 -- 172.21.15.5:0/1954622051 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0ea80133e0 con 0x7f0eb0139990 2024-08-18T21:03:51.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.169+0000 7f0ea67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:51.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.169+0000 7f0ea67fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:03:51.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.169+0000 7f0ea67fc640 10 monclient: dump: 2024-08-18T21:03:51.178 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:51.178 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.178 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.178 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.178 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:51.178 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.178 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:51.178 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:51.179 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:51.179 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:51.179 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:51.179 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:51.179 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:51.179 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:51.179 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:51.179 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.169+0000 7f0ea67fc640 1 -- 172.21.15.5:0/1954622051 <== mon.5 v2:172.21.15.157:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f0ea801b070 con 0x7f0eb0139990 2024-08-18T21:03:51.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.169+0000 7f0ea67fc640 1 --2- 172.21.15.5:0/1954622051 >> v2:172.21.15.157:6812/631023601 conn(0x7f0e9403bda0 0x7f0e9403e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.169+0000 7f0ea67fc640 1 -- 172.21.15.5:0/1954622051 <== mon.5 v2:172.21.15.157:3302/0 5 ==== osd_map(20..20 src has 1..20) ==== 3534+0+0 (secure 0 0 0) 0x7f0ea8019070 con 0x7f0eb0139990 2024-08-18T21:03:51.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.169+0000 7f0eb58d8640 1 --2- 172.21.15.5:0/1954622051 >> v2:172.21.15.157:6812/631023601 conn(0x7f0e9403bda0 0x7f0e9403e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.169+0000 7f0eb58d8640 10 monclient: get_auth_request con 0x7f0e9403bda0 auth_method 0 2024-08-18T21:03:51.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.173+0000 7f0eb58d8640 1 --2- 172.21.15.5:0/1954622051 >> v2:172.21.15.157:6812/631023601 conn(0x7f0e9403bda0 0x7f0e9403e260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00ab000 tx=0x7f0ea00a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:51.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.177+0000 7f0ea67fc640 1 -- 172.21.15.5:0/1954622051 <== mon.5 v2:172.21.15.157:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f0ea8010040 con 0x7f0eb0139990 2024-08-18T21:03:51.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.177+0000 7f0ea67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:51.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.177+0000 7f0ea67fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.341+0000 7f0eb7b3c640 1 -- 172.21.15.5:0/1954622051 --> v2:172.21.15.157:6812/631023601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0eb00ab4a0 con 0x7f0e9403bda0 2024-08-18T21:03:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.345+0000 7f0ea67fc640 1 -- 172.21.15.5:0/1954622051 <== mgr.4130 v2:172.21.15.157:6812/631023601 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34141 (secure 0 0 0) 0x7f0ea00b1040 con 0x7f0e9403bda0 2024-08-18T21:03:51.348 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:03:51.349 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T21:03:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.345+0000 7f0eb7b3c640 1 -- 172.21.15.5:0/1954622051 >> v2:172.21.15.157:6812/631023601 conn(0x7f0e9403bda0 msgr2=0x7f0e9403e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.345+0000 7f0eb7b3c640 1 --2- 172.21.15.5:0/1954622051 >> v2:172.21.15.157:6812/631023601 conn(0x7f0e9403bda0 0x7f0e9403e260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00ab000 tx=0x7f0ea00a6000 comp rx=0 tx=0).stop 2024-08-18T21:03:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.345+0000 7f0eb7b3c640 10 monclient: shutdown 2024-08-18T21:03:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.345+0000 7f0eb7b3c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.345+0000 7f0eb7b3c640 1 -- 172.21.15.5:0/1954622051 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0eb0139990 msgr2=0x7f0eb0138e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.345+0000 7f0eb7b3c640 1 --2- 172.21.15.5:0/1954622051 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0eb0139990 0x7f0eb0138e00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800efc0 tx=0x7f0ea800c490 comp rx=0 tx=0).stop 2024-08-18T21:03:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.349+0000 7f0eb7b3c640 1 -- 172.21.15.5:0/1954622051 shutdown_connections 2024-08-18T21:03:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.349+0000 7f0eb7b3c640 1 --2- 172.21.15.5:0/1954622051 >> v2:172.21.15.157:6812/631023601 conn(0x7f0e9403bda0 0x7f0e9403e260 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.349+0000 7f0eb7b3c640 1 --2- 172.21.15.5:0/1954622051 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0eb0139990 0x7f0eb0138e00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.349+0000 7f0eb7b3c640 1 --2- 172.21.15.5:0/1954622051 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0eb00a6bd0 0x7f0eb01388c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.349+0000 7f0eb7b3c640 1 --2- 172.21.15.5:0/1954622051 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0eb009f080 0x7f0eb01d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.349+0000 7f0eb7b3c640 1 -- 172.21.15.5:0/1954622051 >> 172.21.15.5:0/1954622051 conn(0x7f0eb0068700 msgr2=0x7f0eb00ab9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.349+0000 7f0eb7b3c640 1 -- 172.21.15.5:0/1954622051 shutdown_connections 2024-08-18T21:03:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.349+0000 7f0eb7b3c640 1 -- 172.21.15.5:0/1954622051 wait complete. 2024-08-18T21:03:51.366 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-08-18T21:03:51.340516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":167420,"kb_used_data":1072,"kb_used_omap":9,"kb_used_meta":166198,"kb_avail":566063620,"statfs":{"total":579820584960,"available":579649146880,"internally_reserved":0,"allocated":1097728,"data_stored":1375114,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9572,"internal_metadata":170187420},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.160548"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.420333+0000","last_change":"2024-08-18T21:03:42.420853+0000","last_active":"2024-08-18T21:03:42.420333+0000","last_peered":"2024-08-18T21:03:42.420333+0000","last_clean":"2024-08-18T21:03:42.420333+0000","last_became_active":"2024-08-18T21:03:39.195166+0000","last_became_peered":"2024-08-18T21:03:39.195166+0000","last_unstale":"2024-08-18T21:03:42.420333+0000","last_undegraded":"2024-08-18T21:03:42.420333+0000","last_fullsized":"2024-08-18T21:03:42.420333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:11:34.985385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001377777,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.183980+0000","last_change":"2024-08-18T21:03:42.184578+0000","last_active":"2024-08-18T21:03:42.183980+0000","last_peered":"2024-08-18T21:03:42.183980+0000","last_clean":"2024-08-18T21:03:42.183980+0000","last_became_active":"2024-08-18T21:03:39.194596+0000","last_became_peered":"2024-08-18T21:03:39.194596+0000","last_unstale":"2024-08-18T21:03:42.183980+0000","last_undegraded":"2024-08-18T21:03:42.183980+0000","last_fullsized":"2024-08-18T21:03:42.183980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:22.467656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001127341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.419869+0000","last_change":"2024-08-18T21:03:42.420253+0000","last_active":"2024-08-18T21:03:42.419869+0000","last_peered":"2024-08-18T21:03:42.419869+0000","last_clean":"2024-08-18T21:03:42.419869+0000","last_became_active":"2024-08-18T21:03:39.192148+0000","last_became_peered":"2024-08-18T21:03:39.192148+0000","last_unstale":"2024-08-18T21:03:42.419869+0000","last_undegraded":"2024-08-18T21:03:42.419869+0000","last_fullsized":"2024-08-18T21:03:42.419869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:00:27.022175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082257800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.419473+0000","last_change":"2024-08-18T21:03:42.420020+0000","last_active":"2024-08-18T21:03:42.419473+0000","last_peered":"2024-08-18T21:03:42.419473+0000","last_clean":"2024-08-18T21:03:42.419473+0000","last_became_active":"2024-08-18T21:03:39.203685+0000","last_became_peered":"2024-08-18T21:03:39.203685+0000","last_unstale":"2024-08-18T21:03:42.419473+0000","last_undegraded":"2024-08-18T21:03:42.419473+0000","last_fullsized":"2024-08-18T21:03:42.419473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:36.890241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099204900000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.186027+0000","last_change":"2024-08-18T21:03:42.186027+0000","last_active":"2024-08-18T21:03:42.186027+0000","last_peered":"2024-08-18T21:03:42.186027+0000","last_clean":"2024-08-18T21:03:42.186027+0000","last_became_active":"2024-08-18T21:03:39.192275+0000","last_became_peered":"2024-08-18T21:03:39.192275+0000","last_unstale":"2024-08-18T21:03:42.186027+0000","last_undegraded":"2024-08-18T21:03:42.186027+0000","last_fullsized":"2024-08-18T21:03:42.186027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:55:49.809092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001842333,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.184121+0000","last_change":"2024-08-18T21:03:42.184643+0000","last_active":"2024-08-18T21:03:42.184121+0000","last_peered":"2024-08-18T21:03:42.184121+0000","last_clean":"2024-08-18T21:03:42.184121+0000","last_became_active":"2024-08-18T21:03:39.201549+0000","last_became_peered":"2024-08-18T21:03:39.201549+0000","last_unstale":"2024-08-18T21:03:42.184121+0000","last_undegraded":"2024-08-18T21:03:42.184121+0000","last_fullsized":"2024-08-18T21:03:42.184121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:01:33.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010119630000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.184742+0000","last_change":"2024-08-18T21:03:42.185411+0000","last_active":"2024-08-18T21:03:42.184742+0000","last_peered":"2024-08-18T21:03:42.184742+0000","last_clean":"2024-08-18T21:03:42.184742+0000","last_became_active":"2024-08-18T21:03:39.201697+0000","last_became_peered":"2024-08-18T21:03:39.201697+0000","last_unstale":"2024-08-18T21:03:42.184742+0000","last_undegraded":"2024-08-18T21:03:42.184742+0000","last_fullsized":"2024-08-18T21:03:42.184742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:03:54.524520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001317337,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.419952+0000","last_change":"2024-08-18T21:03:42.420443+0000","last_active":"2024-08-18T21:03:42.419952+0000","last_peered":"2024-08-18T21:03:42.419952+0000","last_clean":"2024-08-18T21:03:42.419952+0000","last_became_active":"2024-08-18T21:03:39.196022+0000","last_became_peered":"2024-08-18T21:03:39.196022+0000","last_unstale":"2024-08-18T21:03:42.419952+0000","last_undegraded":"2024-08-18T21:03:42.419952+0000","last_fullsized":"2024-08-18T21:03:42.419952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:31.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010002489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-18T21:03:42.419176+0000","last_change":"2024-08-18T21:03:33.600622+0000","last_active":"2024-08-18T21:03:42.419176+0000","last_peered":"2024-08-18T21:03:42.419176+0000","last_clean":"2024-08-18T21:03:42.419176+0000","last_became_active":"2024-08-18T21:03:33.598635+0000","last_became_peered":"2024-08-18T21:03:33.598635+0000","last_unstale":"2024-08-18T21:03:42.419176+0000","last_undegraded":"2024-08-18T21:03:42.419176+0000","last_fullsized":"2024-08-18T21:03:42.419176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:31.584484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:31.584484+0000","last_clean_scrub_stamp":"2024-08-18T21:03:31.584484+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:05.519532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":12,"seq":51539607559,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":52889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":581798,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640262,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":52889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":52870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640263,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":163840,"data_stored":52870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":581798,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T21:03:51.366 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-08-18T21:03:51.367 DEBUG:tasks.mon_thrash:Yielding 2024-08-18T21:03:51.367 INFO:teuthology.run_tasks:Running task exec... 2024-08-18T21:03:51.376 INFO:teuthology.task.exec:Executing custom commands... 2024-08-18T21:03:51.377 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi157.front.sepia.ceph.com 2024-08-18T21:03:51.377 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:03:51.377 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-08-18T21:03:51.377 INFO:tasks.mon_thrash.mon_thrasher:seed: 1724015031, revive delay: 20.0, thrash delay: 1.0 thrash many: True, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 20.0 2024-08-18T21:03:51.377 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:03:51.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:03:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.485+0000 7fb3cd37f640 10 monclient: get_monmap_and_config 2024-08-18T21:03:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.485+0000 7fb3cd37f640 10 monclient: build_initial_monmap 2024-08-18T21:03:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.485+0000 7fb3cd37f640 10 monclient: monmap: 2024-08-18T21:03:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:51.492056+0000 2024-08-18T21:03:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:51.492056+0000 2024-08-18T21:03:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:51.491 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 1 Processor -- start 2024-08-18T21:03:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 1 -- start start 2024-08-18T21:03:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 10 monclient: init 2024-08-18T21:03:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 10 monclient: _add_conns ranks=[5,10,9,4,2,3,6,0,8,7,1] 2024-08-18T21:03:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb3c80a9c20 0x7fb3c806c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 10 monclient(hunting): picked mon.noname-h con 0x7fb3c80a9c20 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb3c806ce90 0x7fb3c806d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 10 monclient(hunting): picked mon.noname-f con 0x7fb3c806ce90 addr v2:172.21.15.157:3300/0 2024-08-18T21:03:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3c813e2d0 0x7fb3c81406c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 10 monclient(hunting): picked mon.noname-a con 0x7fb3c813e2d0 addr v2:172.21.15.5:3300/0 2024-08-18T21:03:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb3c80aa000 con 0x7fb3c813e2d0 2024-08-18T21:03:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb3c806d7b0 con 0x7fb3c806ce90 2024-08-18T21:03:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fb3c8068ca0 con 0x7fb3c80a9c20 2024-08-18T21:03:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3cd37f640 10 monclient(hunting): authenticate will time out at 998.505119s 2024-08-18T21:03:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3c813e2d0 0x7fb3c81406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3c813e2d0 0x7fb3c81406c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46840/0 (socket says 172.21.15.5:46840) 2024-08-18T21:03:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 1 -- 172.21.15.5:0/880459068 learned_addr learned my addr 172.21.15.5:0/880459068 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 10 monclient(hunting): get_auth_request con 0x7fb3c813e2d0 auth_method 0 2024-08-18T21:03:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c67fc640 1 --2- 172.21.15.5:0/880459068 >> v2:172.21.15.157:3300/0 conn(0x7fb3c806ce90 0x7fb3c806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c6ffd640 1 --2- 172.21.15.5:0/880459068 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb3c80a9c20 0x7fb3c806c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c67fc640 10 monclient(hunting): get_auth_request con 0x7fb3c806ce90 auth_method 0 2024-08-18T21:03:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c67fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c67fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c6ffd640 10 monclient(hunting): get_auth_request con 0x7fb3c80a9c20 auth_method 0 2024-08-18T21:03:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 10 monclient(hunting): handle_auth_done global_id 4464 payload 274 2024-08-18T21:03:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 1 -- 172.21.15.5:0/880459068 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb3c80a9c20 msgr2=0x7fb3c806c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:51.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 1 --2- 172.21.15.5:0/880459068 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb3c80a9c20 0x7fb3c806c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 1 -- 172.21.15.5:0/880459068 >> v2:172.21.15.157:3300/0 conn(0x7fb3c806ce90 msgr2=0x7fb3c806d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:51.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 1 --2- 172.21.15.5:0/880459068 >> v2:172.21.15.157:3300/0 conn(0x7fb3c806ce90 0x7fb3c806d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:51.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 1 monclient: found mon.noname-a 2024-08-18T21:03:51.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:51.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:03:51.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.489+0000 7fb3c77fe640 1 -- 172.21.15.5:0/880459068 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c809d240 con 0x7fb3c813e2d0 2024-08-18T21:03:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3c77fe640 1 -- 172.21.15.5:0/880459068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c813e2d0 msgr2=0x7fb3c81406c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3c77fe640 1 --2- 172.21.15.5:0/880459068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c813e2d0 0x7fb3c81406c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb3c809f860 tx=0x7fb3c001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f7edfe0275253a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3c5ffb640 1 -- 172.21.15.5:0/880459068 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb3c00090d0 con 0x7fb3c813e2d0 2024-08-18T21:03:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:51.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3c5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:03:51.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3c5ffb640 10 monclient: dump: 2024-08-18T21:03:51.501 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:51.501 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.501 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.501 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.501 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:51.501 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.501 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:51.501 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:51.501 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:51.501 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:51.501 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:51.501 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:51.502 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:51.502 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:51.502 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:51.502 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3c5ffb640 10 monclient: _finish_auth 0 2024-08-18T21:03:51.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3c5ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:03:51.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3c5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:51.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3c5ffb640 1 -- 172.21.15.5:0/880459068 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c00a5b00 con 0x7fb3c813e2d0 2024-08-18T21:03:51.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3c5ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:51.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3c5ffb640 1 -- 172.21.15.5:0/880459068 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb3c00a5cb0 con 0x7fb3c813e2d0 2024-08-18T21:03:51.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3cd37f640 5 monclient: authenticate success, global_id 4464 2024-08-18T21:03:51.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3cd37f640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:51.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3cd37f640 4 set_mon_vals no callback set 2024-08-18T21:03:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3c5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3c5ffb640 10 monclient: dump: 2024-08-18T21:03:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:51.504 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3cd37f640 10 monclient: shutdown 2024-08-18T21:03:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3cd37f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3cd37f640 1 -- 172.21.15.5:0/880459068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c813e2d0 msgr2=0x7fb3c81406c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3cd37f640 1 --2- 172.21.15.5:0/880459068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c813e2d0 0x7fb3c81406c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb3c809f860 tx=0x7fb3c001c880 comp rx=0 tx=0).stop 2024-08-18T21:03:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3cd37f640 1 -- 172.21.15.5:0/880459068 shutdown_connections 2024-08-18T21:03:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3cd37f640 1 --2- 172.21.15.5:0/880459068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c813e2d0 0x7fb3c81406c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3cd37f640 1 --2- 172.21.15.5:0/880459068 >> v2:172.21.15.157:3300/0 conn(0x7fb3c806ce90 0x7fb3c806d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3cd37f640 1 --2- 172.21.15.5:0/880459068 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb3c80a9c20 0x7fb3c806c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3cd37f640 1 -- 172.21.15.5:0/880459068 >> 172.21.15.5:0/880459068 conn(0x7fb3c80a9130 msgr2=0x7fb3c80a9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3cd37f640 1 -- 172.21.15.5:0/880459068 shutdown_connections 2024-08-18T21:03:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3cd37f640 1 -- 172.21.15.5:0/880459068 wait complete. 2024-08-18T21:03:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3cd37f640 10 monclient: build_initial_monmap 2024-08-18T21:03:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.493+0000 7fb3cd37f640 10 monclient: monmap: 2024-08-18T21:03:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:51.506 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 1 Processor -- start 2024-08-18T21:03:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 1 -- start start 2024-08-18T21:03:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 10 monclient: init 2024-08-18T21:03:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 10 monclient: _add_conns ranks=[1,0,4,5,2,3,8,6,7] 2024-08-18T21:03:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3c806ce90 0x7fb3c8138750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 10 monclient(hunting): picked mon.noname-f con 0x7fb3c806ce90 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c80a9c20 0x7fb3c8138c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 10 monclient(hunting): picked mon.noname-a con 0x7fb3c80a9c20 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb3c813e2d0 0x7fb3c8070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 10 monclient(hunting): picked mon.noname-c con 0x7fb3c813e2d0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c8068ab0 con 0x7fb3c80a9c20 2024-08-18T21:03:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c8068930 con 0x7fb3c806ce90 2024-08-18T21:03:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fb3c809fbb0 con 0x7fb3c813e2d0 2024-08-18T21:03:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 10 monclient(hunting): authenticate will time out at 998.512760s 2024-08-18T21:03:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c80a9c20 0x7fb3c8138c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c80a9c20 0x7fb3c8138c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46854/0 (socket says 172.21.15.5:46854) 2024-08-18T21:03:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb3c813e2d0 0x7fb3c8070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c67fc640 1 -- 172.21.15.5:0/2672474745 learned_addr learned my addr 172.21.15.5:0/2672474745 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c67fc640 10 monclient(hunting): get_auth_request con 0x7fb3c80a9c20 auth_method 0 2024-08-18T21:03:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c67fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c67fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 10 monclient(hunting): get_auth_request con 0x7fb3c813e2d0 auth_method 0 2024-08-18T21:03:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c6ffd640 1 --2- 172.21.15.5:0/2672474745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3c806ce90 0x7fb3c8138750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 10 monclient(hunting): handle_auth_done global_id 4414 payload 824 2024-08-18T21:03:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 1 -- 172.21.15.5:0/2672474745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3c806ce90 msgr2=0x7fb3c8138750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 1 --2- 172.21.15.5:0/2672474745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3c806ce90 0x7fb3c8138750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 1 -- 172.21.15.5:0/2672474745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c80a9c20 msgr2=0x7fb3c8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 1 --2- 172.21.15.5:0/2672474745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c80a9c20 0x7fb3c8138c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 1 monclient: found mon.noname-c 2024-08-18T21:03:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:51.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 1 -- 172.21.15.5:0/2672474745 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c8073b20 con 0x7fb3c813e2d0 2024-08-18T21:03:51.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c6ffd640 10 monclient: get_auth_request con 0x7fb3c806ce90 auth_method 0 2024-08-18T21:03:51.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c6ffd640 1 --2- 172.21.15.5:0/2672474745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3c806ce90 0x7fb3c8138750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 1 -- 172.21.15.5:0/2672474745 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb3c813e2d0 msgr2=0x7fb3c8070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c77fe640 1 --2- 172.21.15.5:0/2672474745 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb3c813e2d0 0x7fb3c8070960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb3c809d920 tx=0x7fb3c0019620 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3af7fe640 1 -- 172.21.15.5:0/2672474745 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb3c00bc030 con 0x7fb3c813e2d0 2024-08-18T21:03:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3af7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3af7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3af7fe640 10 monclient: dump: 2024-08-18T21:03:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:51.514 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3af7fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3af7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3af7fe640 1 -- 172.21.15.5:0/2672474745 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c00044b0 con 0x7fb3c813e2d0 2024-08-18T21:03:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 5 monclient: authenticate success, global_id 4414 2024-08-18T21:03:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 10 monclient: _renew_subs 2024-08-18T21:03:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 1 -- 172.21.15.5:0/2672474745 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c813a420 con 0x7fb3c813e2d0 2024-08-18T21:03:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3af7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3af7fe640 1 -- 172.21.15.5:0/2672474745 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb3c0004660 con 0x7fb3c813e2d0 2024-08-18T21:03:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3af7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3af7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3c4ff9640 4 set_mon_vals no callback set 2024-08-18T21:03:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3af7fe640 10 monclient: dump: 2024-08-18T21:03:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:51.516 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:51.516 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:51.516 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:51.516 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 10 monclient: _renew_subs 2024-08-18T21:03:51.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:51.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.497+0000 7fb3cd37f640 1 -- 172.21.15.5:0/2672474745 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c8073840 con 0x7fb3c813e2d0 2024-08-18T21:03:51.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.501+0000 7fb3cd37f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:51.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.501+0000 7fb3cd37f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:51.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.501+0000 7fb3cd37f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:51.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.501+0000 7fb3cd37f640 1 -- 172.21.15.5:0/2672474745 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c806d270 con 0x7fb3c813e2d0 2024-08-18T21:03:51.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.501+0000 7fb3af7fe640 1 -- 172.21.15.5:0/2672474745 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fb3c00bf070 con 0x7fb3c813e2d0 2024-08-18T21:03:51.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.501+0000 7fb3af7fe640 1 --2- 172.21.15.5:0/2672474745 >> v2:172.21.15.157:6812/631023601 conn(0x7fb3b403bdf0 0x7fb3b403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.501+0000 7fb3af7fe640 1 -- 172.21.15.5:0/2672474745 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(20..20 src has 1..20) ==== 3534+0+0 (secure 0 0 0) 0x7fb3c00bd070 con 0x7fb3c813e2d0 2024-08-18T21:03:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.501+0000 7fb3c6ffd640 1 --2- 172.21.15.5:0/2672474745 >> v2:172.21.15.157:6812/631023601 conn(0x7fb3b403bdf0 0x7fb3b403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.501+0000 7fb3c6ffd640 10 monclient: get_auth_request con 0x7fb3b403bdf0 auth_method 0 2024-08-18T21:03:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.505+0000 7fb3c6ffd640 1 --2- 172.21.15.5:0/2672474745 >> v2:172.21.15.157:6812/631023601 conn(0x7fb3b403bdf0 0x7fb3b403e2b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0097c0 tx=0x7fb3bc008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.505+0000 7fb3af7fe640 1 -- 172.21.15.5:0/2672474745 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fb3c00c6020 con 0x7fb3c813e2d0 2024-08-18T21:03:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.505+0000 7fb3af7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.505+0000 7fb3af7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.737+0000 7fb3cd37f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:03:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.737+0000 7fb3cd37f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:03:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.737+0000 7fb3cd37f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.737+0000 7fb3cd37f640 1 -- 172.21.15.5:0/2672474745 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb3c8071c00 con 0x7fb3c813e2d0 2024-08-18T21:03:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3af7fe640 1 -- 172.21.15.5:0/2672474745 <== mon.4 v2:172.21.15.5:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7fb3c00165c0 con 0x7fb3c813e2d0 2024-08-18T21:03:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3af7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:03:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3af7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:51.743 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":10,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":34,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:03:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3cd37f640 1 -- 172.21.15.5:0/2672474745 >> v2:172.21.15.157:6812/631023601 conn(0x7fb3b403bdf0 msgr2=0x7fb3b403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3cd37f640 1 --2- 172.21.15.5:0/2672474745 >> v2:172.21.15.157:6812/631023601 conn(0x7fb3b403bdf0 0x7fb3b403e2b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0097c0 tx=0x7fb3bc008040 comp rx=0 tx=0).stop 2024-08-18T21:03:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3cd37f640 10 monclient: shutdown 2024-08-18T21:03:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3cd37f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3cd37f640 1 -- 172.21.15.5:0/2672474745 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb3c813e2d0 msgr2=0x7fb3c8070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3cd37f640 1 --2- 172.21.15.5:0/2672474745 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb3c813e2d0 0x7fb3c8070960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb3c809d920 tx=0x7fb3c0019620 comp rx=0 tx=0).stop 2024-08-18T21:03:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3cd37f640 1 -- 172.21.15.5:0/2672474745 shutdown_connections 2024-08-18T21:03:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3cd37f640 1 --2- 172.21.15.5:0/2672474745 >> v2:172.21.15.157:6812/631023601 conn(0x7fb3b403bdf0 0x7fb3b403e2b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3cd37f640 1 --2- 172.21.15.5:0/2672474745 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb3c813e2d0 0x7fb3c8070960 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3cd37f640 1 --2- 172.21.15.5:0/2672474745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c80a9c20 0x7fb3c8138c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3cd37f640 1 --2- 172.21.15.5:0/2672474745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3c806ce90 0x7fb3c8138750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3cd37f640 1 -- 172.21.15.5:0/2672474745 >> 172.21.15.5:0/2672474745 conn(0x7fb3c80a9130 msgr2=0x7fb3c80a2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3cd37f640 1 -- 172.21.15.5:0/2672474745 shutdown_connections 2024-08-18T21:03:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.741+0000 7fb3cd37f640 1 -- 172.21.15.5:0/2672474745 wait complete. 2024-08-18T21:03:51.762 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:03:51.763 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-18T21:03:51.763 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:03:51.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:03:51.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.885+0000 7f4b899ce640 10 monclient: get_monmap_and_config 2024-08-18T21:03:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.885+0000 7f4b899ce640 10 monclient: build_initial_monmap 2024-08-18T21:03:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.885+0000 7f4b899ce640 10 monclient: monmap: 2024-08-18T21:03:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:51.891604+0000 2024-08-18T21:03:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:51.891604+0000 2024-08-18T21:03:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:51.891 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:51.891 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:51.891 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:51.891 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:51.891 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:51.891 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:51.891 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:51.891 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.885+0000 7f4b899ce640 1 Processor -- start 2024-08-18T21:03:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 1 -- start start 2024-08-18T21:03:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 10 monclient: init 2024-08-18T21:03:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 10 monclient: _add_conns ranks=[4,7,2,9,0,6,5,1,3,10,8] 2024-08-18T21:03:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4b84136540 0x7f4b84136920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 10 monclient(hunting): picked mon.noname-c con 0x7f4b84136540 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:51.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4b840a4bb0 0x7f4b840a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 10 monclient(hunting): picked mon.noname-i con 0x7f4b840a4bb0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:51.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4b840a5510 0x7f4b84140990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 10 monclient(hunting): picked mon.noname-b con 0x7f4b840a5510 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:51.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f4b840a6870 con 0x7f4b840a5510 2024-08-18T21:03:51.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f4b840a65a0 con 0x7f4b84136540 2024-08-18T21:03:51.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f4b8406e690 con 0x7f4b840a4bb0 2024-08-18T21:03:51.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:51.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b899ce640 10 monclient(hunting): authenticate will time out at 998.904693s 2024-08-18T21:03:51.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b82ffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4b84136540 0x7f4b84136920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4b840a5510 0x7f4b84140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4b840a5510 0x7f4b84140990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34256/0 (socket says 172.21.15.5:34256) 2024-08-18T21:03:51.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b82ffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4b84136540 0x7f4b84136920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:36842/0 (socket says 172.21.15.5:36842) 2024-08-18T21:03:51.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 1 -- 172.21.15.5:0/269311304 learned_addr learned my addr 172.21.15.5:0/269311304 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:51.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 10 monclient(hunting): get_auth_request con 0x7f4b840a5510 auth_method 0 2024-08-18T21:03:51.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b82ffd640 10 monclient(hunting): get_auth_request con 0x7f4b84136540 auth_method 0 2024-08-18T21:03:51.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b82ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b82ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:51.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:51.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:51.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b82ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:51.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b82ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:51.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b82ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:51.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b827fc640 1 --2- 172.21.15.5:0/269311304 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4b840a4bb0 0x7f4b840a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b827fc640 10 monclient(hunting): get_auth_request con 0x7f4b840a4bb0 auth_method 0 2024-08-18T21:03:51.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b827fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b827fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b827fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 10 monclient(hunting): handle_auth_done global_id 4484 payload 274 2024-08-18T21:03:51.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 1 -- 172.21.15.5:0/269311304 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4b840a4bb0 msgr2=0x7f4b840a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:51.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 1 --2- 172.21.15.5:0/269311304 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4b840a4bb0 0x7f4b840a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 1 -- 172.21.15.5:0/269311304 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4b84136540 msgr2=0x7f4b84136920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:51.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 1 --2- 172.21.15.5:0/269311304 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4b84136540 0x7f4b84136920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:51.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 1 monclient: found mon.noname-b 2024-08-18T21:03:51.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:51.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:51.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b837fe640 1 -- 172.21.15.5:0/269311304 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8406e970 con 0x7f4b840a5510 2024-08-18T21:03:51.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.889+0000 7f4b82ffd640 1 --2- 172.21.15.5:0/269311304 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4b84136540 0x7f4b84136920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:51.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b837fe640 1 -- 172.21.15.5:0/269311304 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4b840a5510 msgr2=0x7f4b84140990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:51.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b837fe640 1 --2- 172.21.15.5:0/269311304 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4b840a5510 0x7f4b84140990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009e80 tx=0x7f4b7c01c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e41cbeb625e9febb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:51.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b81ffb640 1 -- 172.21.15.5:0/269311304 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4b7c0090d0 con 0x7f4b840a5510 2024-08-18T21:03:51.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b81ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:51.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b81ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:51.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b81ffb640 10 monclient: dump: 2024-08-18T21:03:51.902 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:51.902 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:51.903 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b81ffb640 10 monclient: _finish_auth 0 2024-08-18T21:03:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b81ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:03:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b81ffb640 1 -- 172.21.15.5:0/269311304 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7c0a5a70 con 0x7f4b840a5510 2024-08-18T21:03:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b81ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b81ffb640 1 -- 172.21.15.5:0/269311304 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4b7c0a5c20 con 0x7f4b840a5510 2024-08-18T21:03:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 5 monclient: authenticate success, global_id 4484 2024-08-18T21:03:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 4 set_mon_vals no callback set 2024-08-18T21:03:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b81ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b81ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b81ffb640 10 monclient: dump: 2024-08-18T21:03:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:51.906 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 10 monclient: shutdown 2024-08-18T21:03:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 1 -- 172.21.15.5:0/269311304 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4b840a5510 msgr2=0x7f4b84140990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 1 --2- 172.21.15.5:0/269311304 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4b840a5510 0x7f4b84140990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009e80 tx=0x7f4b7c01c910 comp rx=0 tx=0).stop 2024-08-18T21:03:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 1 -- 172.21.15.5:0/269311304 shutdown_connections 2024-08-18T21:03:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 1 --2- 172.21.15.5:0/269311304 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4b840a5510 0x7f4b84140990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 1 --2- 172.21.15.5:0/269311304 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4b840a4bb0 0x7f4b840a4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 1 --2- 172.21.15.5:0/269311304 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4b84136540 0x7f4b84136920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 1 -- 172.21.15.5:0/269311304 >> 172.21.15.5:0/269311304 conn(0x7f4b84069090 msgr2=0x7f4b840aa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 1 -- 172.21.15.5:0/269311304 shutdown_connections 2024-08-18T21:03:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 1 -- 172.21.15.5:0/269311304 wait complete. 2024-08-18T21:03:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 10 monclient: build_initial_monmap 2024-08-18T21:03:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 10 monclient: monmap: 2024-08-18T21:03:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:51.908 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 1 Processor -- start 2024-08-18T21:03:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 1 -- start start 2024-08-18T21:03:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.893+0000 7f4b899ce640 10 monclient: init 2024-08-18T21:03:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 10 monclient: _add_conns ranks=[7,4,5,1,8,3,0,6,2] 2024-08-18T21:03:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4b840a4bb0 0x7f4b841371d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 10 monclient(hunting): picked mon.noname-i con 0x7f4b840a4bb0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4b840a5510 0x7f4b84137710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 10 monclient(hunting): picked mon.noname-c con 0x7f4b840a5510 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4b84136540 0x7f4b84137c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 10 monclient(hunting): picked mon.noname-h con 0x7f4b84136540 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f4b8406da60 con 0x7f4b840a5510 2024-08-18T21:03:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f4b8406f940 con 0x7f4b84136540 2024-08-18T21:03:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f4b84140a90 con 0x7f4b840a4bb0 2024-08-18T21:03:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 10 monclient(hunting): authenticate will time out at 998.912249s 2024-08-18T21:03:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4b840a5510 0x7f4b84137710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4b840a5510 0x7f4b84137710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:36856/0 (socket says 172.21.15.5:36856) 2024-08-18T21:03:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 1 -- 172.21.15.5:0/3805583032 learned_addr learned my addr 172.21.15.5:0/3805583032 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 10 monclient(hunting): get_auth_request con 0x7f4b840a5510 auth_method 0 2024-08-18T21:03:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 10 monclient(hunting): handle_auth_done global_id 4432 payload 824 2024-08-18T21:03:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 1 -- 172.21.15.5:0/3805583032 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4b840a4bb0 msgr2=0x7f4b841371d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 1 --2- 172.21.15.5:0/3805583032 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4b840a4bb0 0x7f4b841371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 1 -- 172.21.15.5:0/3805583032 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4b84136540 msgr2=0x7f4b84137c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 1 --2- 172.21.15.5:0/3805583032 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4b84136540 0x7f4b84137c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 10 monclient: _finish_hunting 0 2024-08-18T21:03:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 1 monclient: found mon.noname-c 2024-08-18T21:03:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 1 -- 172.21.15.5:0/3805583032 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b840a0bc0 con 0x7f4b840a5510 2024-08-18T21:03:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 1 -- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4b840a5510 msgr2=0x7f4b84137710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b827fc640 1 --2- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4b840a5510 0x7f4b84137710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800d7d0 tx=0x7f4b7800dc90 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b6bfff640 1 -- 172.21.15.5:0/3805583032 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4b7800bcc0 con 0x7f4b840a5510 2024-08-18T21:03:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b6bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b6bfff640 10 monclient: dump: 2024-08-18T21:03:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:51.912 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b6bfff640 10 monclient: _finish_auth 0 2024-08-18T21:03:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b6bfff640 10 monclient: _check_auth_tickets 2024-08-18T21:03:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b6bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b6bfff640 1 -- 172.21.15.5:0/3805583032 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b78014430 con 0x7f4b840a5510 2024-08-18T21:03:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b6bfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b6bfff640 1 -- 172.21.15.5:0/3805583032 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4b78014a50 con 0x7f4b840a5510 2024-08-18T21:03:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b6bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b6bfff640 10 monclient: dump: 2024-08-18T21:03:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:51.914 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b817fa640 4 set_mon_vals no callback set 2024-08-18T21:03:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 5 monclient: authenticate success, global_id 4432 2024-08-18T21:03:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 10 monclient: _renew_subs 2024-08-18T21:03:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 1 -- 172.21.15.5:0/3805583032 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8413acf0 con 0x7f4b840a5510 2024-08-18T21:03:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 10 monclient: _renew_subs 2024-08-18T21:03:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.897+0000 7f4b899ce640 1 -- 172.21.15.5:0/3805583032 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b840a03f0 con 0x7f4b840a5510 2024-08-18T21:03:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b899ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b899ce640 1 --2- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b84132d80 0x7f4b84133160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b899ce640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b899ce640 1 -- 172.21.15.5:0/3805583032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8406dbe0 con 0x7f4b84132d80 2024-08-18T21:03:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b82ffd640 1 --2- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b84132d80 0x7f4b84133160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b82ffd640 10 monclient: get_auth_request con 0x7f4b84132d80 auth_method 0 2024-08-18T21:03:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b82ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b82ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b82ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b82ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b82ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b6bfff640 1 -- 172.21.15.5:0/3805583032 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f4b7801b030 con 0x7f4b840a5510 2024-08-18T21:03:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b82ffd640 10 monclient(hunting): handle_auth_done global_id 4482 payload 824 2024-08-18T21:03:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b82ffd640 1 -- 172.21.15.5:0/3805583032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b840a7770 con 0x7f4b84132d80 2024-08-18T21:03:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b6bfff640 1 --2- 172.21.15.5:0/3805583032 >> v2:172.21.15.157:6812/631023601 conn(0x7f4b7003bdc0 0x7f4b7003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b6bfff640 1 -- 172.21.15.5:0/3805583032 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(20..20 src has 1..20) ==== 3534+0+0 (secure 0 0 0) 0x7f4b78019020 con 0x7f4b840a5510 2024-08-18T21:03:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b837fe640 1 --2- 172.21.15.5:0/3805583032 >> v2:172.21.15.157:6812/631023601 conn(0x7f4b7003bdc0 0x7f4b7003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b837fe640 10 monclient: get_auth_request con 0x7f4b7003bdc0 auth_method 0 2024-08-18T21:03:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b82ffd640 1 -- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b84132d80 msgr2=0x7f4b84133160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b82ffd640 1 --2- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b84132d80 0x7f4b84133160 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400e7a0 tx=0x7f4b7400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b6bfff640 1 -- 172.21.15.5:0/3805583032 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4b74017070 con 0x7f4b84132d80 2024-08-18T21:03:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b6bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b6bfff640 10 monclient: dump: 2024-08-18T21:03:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:51.922 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b6bfff640 1 -- 172.21.15.5:0/3805583032 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4b7400ee70 con 0x7f4b84132d80 2024-08-18T21:03:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b6bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b6bfff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b6bfff640 1 -- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b84132d80 msgr2=0x7f4b84133160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b6bfff640 1 --2- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b84132d80 0x7f4b84133160 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400e7a0 tx=0x7f4b7400ec60 comp rx=0 tx=0).stop 2024-08-18T21:03:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b6bfff640 1 -- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b84132d80 msgr2=0x7f4b84133160 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.901+0000 7f4b6bfff640 1 --2- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b84132d80 0x7f4b84133160 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400e7a0 tx=0x7f4b7400ec60 comp rx=0 tx=0).stop 2024-08-18T21:03:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.905+0000 7f4b837fe640 1 --2- 172.21.15.5:0/3805583032 >> v2:172.21.15.157:6812/631023601 conn(0x7f4b7003bdc0 0x7f4b7003e280 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009e50 tx=0x7f4b7c004ac0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.909+0000 7f4b899ce640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:03:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.909+0000 7f4b899ce640 1 --2- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b841336a0 0x7f4b840a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.909+0000 7f4b899ce640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.909+0000 7f4b899ce640 1 -- 172.21.15.5:0/3805583032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4b84051140 con 0x7f4b841336a0 2024-08-18T21:03:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.909+0000 7f4b82ffd640 1 --2- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b841336a0 0x7f4b840a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.909+0000 7f4b82ffd640 10 monclient: get_auth_request con 0x7f4b841336a0 auth_method 0 2024-08-18T21:03:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.909+0000 7f4b82ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.909+0000 7f4b82ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.909+0000 7f4b82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.909+0000 7f4b82ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.909+0000 7f4b82ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.909+0000 7f4b82ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.909+0000 7f4b82ffd640 10 monclient(hunting): handle_auth_done global_id 4491 payload 824 2024-08-18T21:03:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.909+0000 7f4b82ffd640 1 -- 172.21.15.5:0/3805583032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4b840a6a20 con 0x7f4b841336a0 2024-08-18T21:03:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b82ffd640 1 -- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b841336a0 msgr2=0x7f4b840a25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b82ffd640 1 --2- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b841336a0 0x7f4b840a25c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b74019000 tx=0x7f4b740046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b6bfff640 1 -- 172.21.15.5:0/3805583032 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4b74017070 con 0x7f4b841336a0 2024-08-18T21:03:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b6bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:03:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b6bfff640 10 monclient: dump: 2024-08-18T21:03:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:51.925 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b6bfff640 1 -- 172.21.15.5:0/3805583032 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9249 (secure 0 0 0) 0x7f4b74006540 con 0x7f4b841336a0 2024-08-18T21:03:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b6bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:03:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b6bfff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b6bfff640 1 -- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b841336a0 msgr2=0x7f4b840a25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b6bfff640 1 --2- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b841336a0 0x7f4b840a25c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b74019000 tx=0x7f4b740046d0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b6bfff640 1 -- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b841336a0 msgr2=0x7f4b840a25c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b6bfff640 1 --2- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b841336a0 0x7f4b840a25c0 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b74019000 tx=0x7f4b740046d0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.926 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:03:51.926 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:03:51.926 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:03:51.926 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:03:51.926 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 10, 2024-08-18T21:03:51.926 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 41035, 2024-08-18T21:03:51.926 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:03:51.926 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:03:51.926 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:03:51.926 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:03:51.926 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:03:51.927 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:03:51.927 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:03:51.927 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:03:51.927 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:03:51.927 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:03:51.927 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:51.927 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 34, 2024-08-18T21:03:51.927 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:51.927 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:03:51.927 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:03:51.927 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:51.927 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:51.927 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:51.928 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:51.928 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:51.928 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:51.928 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:51.928 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:51.928 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:51.928 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:51.928 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:51.928 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:51.928 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:03:51.928 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:03:51.928 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:51.928 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:51.928 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:51.929 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:51.929 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:51.929 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:51.929 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:51.929 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:51.929 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:51.929 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:51.929 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:51.929 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:51.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.929 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:03:51.929 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:03:51.929 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:03:51.930 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:03:51.930 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:03:51.930 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:03:51.930 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:51.930 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:51.930 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:03:51.930 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:03:51.930 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:03:51.930 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:03:51.930 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:03:51.930 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:03:51.930 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:03:51.931 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:51.931 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:03:51.931 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:51.931 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:51.931 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:51.931 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:51.931 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:51.931 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:51.931 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:51.931 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:51.931 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:51.931 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:51.931 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:51.931 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:51.932 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:03:51.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.932 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:03:51.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.932 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:03:51.932 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:03:51.932 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:51.932 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:51.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.932 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:51.932 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:03:51.932 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.932 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:51.933 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:03:51.933 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:51.933 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:51.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.933 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:03:51.933 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:03:51.933 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:51.933 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:51.933 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:51.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.933 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:03:51.934 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:03:51.934 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:51.934 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:51.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.934 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:51.934 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:03:51.934 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.934 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:51.934 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:03:51.934 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.934 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:51.935 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:51.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.935 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:03:51.935 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:03:51.935 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:51.935 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:51.935 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:51.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.935 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:03:51.935 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:03:51.935 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:51.935 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:51.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.936 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:51.936 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:03:51.936 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.936 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:51.936 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:03:51.936 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.936 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:51.937 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:51.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.937 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:03:51.937 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:03:51.937 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:51.937 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:51.937 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:51.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.937 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:03:51.937 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:03:51.937 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:51.937 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:51.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.938 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:51.938 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:03:51.938 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.938 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:51.938 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:03:51.938 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.938 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:51.938 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:51.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.938 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:03:51.939 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:03:51.939 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:51.939 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:51.939 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:51.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.939 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:03:51.939 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:03:51.939 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:51.939 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:51.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.939 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:51.939 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:03:51.940 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.940 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:51.940 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:03:51.940 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.940 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:51.940 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:51.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.940 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:03:51.940 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:03:51.940 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:51.940 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:51.940 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:51.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.941 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:03:51.941 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:03:51.941 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:51.941 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:51.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.941 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:51.941 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:03:51.941 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.941 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:51.941 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:03:51.942 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.942 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:51.942 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:51.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.942 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:03:51.942 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:03:51.942 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:51.942 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:51.942 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:51.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.942 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:03:51.942 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:03:51.942 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:51.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:51.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:51.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:03:51.943 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:51.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:03:51.943 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.943 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:51.943 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:51.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:03:51.944 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:03:51.944 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:51.944 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:51.944 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:51.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.944 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:03:51.944 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:03:51.944 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:51.944 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:51.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.944 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:51.944 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:03:51.944 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:51.945 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:03:51.945 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.945 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:51.945 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:51.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.945 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:03:51.945 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:03:51.945 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:51.945 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:51.945 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:51.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.946 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:03:51.946 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:03:51.946 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:51.946 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:51.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:51.946 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:03:51.946 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:51.947 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:03:51.947 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:51.947 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:51.947 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:51.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.947 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:03:51.947 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:03:51.947 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:51.947 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:51.947 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:51.947 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:51.947 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:51.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.947 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:03:51.948 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:03:51.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.948 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:51.948 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:51.948 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:03:51.948 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:51.948 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:51.948 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:03:51.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:51.948 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:51.948 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:51.948 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:03:51.948 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:51.948 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:51.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:51.949 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:03:51.949 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:03:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b899ce640 1 -- 172.21.15.5:0/3805583032 >> v2:172.21.15.157:6812/631023601 conn(0x7f4b7003bdc0 msgr2=0x7f4b7003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b899ce640 1 --2- 172.21.15.5:0/3805583032 >> v2:172.21.15.157:6812/631023601 conn(0x7f4b7003bdc0 0x7f4b7003e280 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009e50 tx=0x7f4b7c004ac0 comp rx=0 tx=0).stop 2024-08-18T21:03:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b899ce640 10 monclient: shutdown 2024-08-18T21:03:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b899ce640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b899ce640 1 -- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4b840a5510 msgr2=0x7f4b84137710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b899ce640 1 --2- 172.21.15.5:0/3805583032 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4b840a5510 0x7f4b84137710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800d7d0 tx=0x7f4b7800dc90 comp rx=0 tx=0).stop 2024-08-18T21:03:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b837fe640 1 -- 172.21.15.5:0/3805583032 reap_dead start 2024-08-18T21:03:51.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b837fe640 1 -- 172.21.15.5:0/3805583032 reap_dead start 2024-08-18T21:03:51.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b899ce640 1 -- 172.21.15.5:0/3805583032 shutdown_connections 2024-08-18T21:03:51.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b899ce640 1 -- 172.21.15.5:0/3805583032 >> 172.21.15.5:0/3805583032 conn(0x7f4b84069090 msgr2=0x7f4b840a7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:51.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b899ce640 1 -- 172.21.15.5:0/3805583032 shutdown_connections 2024-08-18T21:03:51.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:51.913+0000 7f4b899ce640 1 -- 172.21.15.5:0/3805583032 wait complete. 2024-08-18T21:03:51.951 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:03:51.951 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:03:51.951 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:03:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 10 monclient: get_monmap_and_config 2024-08-18T21:03:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 10 monclient: build_initial_monmap 2024-08-18T21:03:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 10 monclient: monmap: 2024-08-18T21:03:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:52.070587+0000 2024-08-18T21:03:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:52.070587+0000 2024-08-18T21:03:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:52.070 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 1 Processor -- start 2024-08-18T21:03:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 1 -- start start 2024-08-18T21:03:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 10 monclient: init 2024-08-18T21:03:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 10 monclient: _add_conns ranks=[7,5,8,3,0,6,4,1,10,2,9] 2024-08-18T21:03:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f566c0a1ff0 0x7f566c137430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 10 monclient(hunting): picked mon.noname-i con 0x7f566c0a1ff0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f566c137970 0x7f566c137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 10 monclient(hunting): picked mon.noname-h con 0x7f566c137970 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f566c133eb0 0x7f566c134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 10 monclient(hunting): picked mon.noname-e con 0x7f566c133eb0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f566c09dd50 con 0x7f566c137970 2024-08-18T21:03:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f566c0a23d0 con 0x7f566c0a1ff0 2024-08-18T21:03:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f566c09e970 con 0x7f566c133eb0 2024-08-18T21:03:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f5671efb640 10 monclient(hunting): authenticate will time out at 999.083508s 2024-08-18T21:03:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f566bfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f566c133eb0 0x7f566c134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f566bfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f566c133eb0 0x7f566c134330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47542/0 (socket says 172.21.15.5:47542) 2024-08-18T21:03:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f566bfff640 1 -- 172.21.15.5:0/136206467 learned_addr learned my addr 172.21.15.5:0/136206467 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f566bfff640 10 monclient(hunting): get_auth_request con 0x7f566c133eb0 auth_method 0 2024-08-18T21:03:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f566bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f566bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f566bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f566bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f566bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.065+0000 7f566bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566affd640 1 --2- 172.21.15.5:0/136206467 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f566c137970 0x7f566c137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566b7fe640 1 --2- 172.21.15.5:0/136206467 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f566c0a1ff0 0x7f566c137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566affd640 10 monclient(hunting): get_auth_request con 0x7f566c137970 auth_method 0 2024-08-18T21:03:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566bfff640 10 monclient(hunting): handle_auth_done global_id 4382 payload 274 2024-08-18T21:03:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566bfff640 1 -- 172.21.15.5:0/136206467 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f566c0a1ff0 msgr2=0x7f566c137430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566bfff640 1 --2- 172.21.15.5:0/136206467 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f566c0a1ff0 0x7f566c137430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566bfff640 1 -- 172.21.15.5:0/136206467 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f566c137970 msgr2=0x7f566c137dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566bfff640 1 --2- 172.21.15.5:0/136206467 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f566c137970 0x7f566c137dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:03:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566bfff640 1 monclient: found mon.noname-e 2024-08-18T21:03:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566bfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566bfff640 1 -- 172.21.15.5:0/136206467 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566c09ec50 con 0x7f566c133eb0 2024-08-18T21:03:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566b7fe640 10 monclient: get_auth_request con 0x7f566c0a1ff0 auth_method 0 2024-08-18T21:03:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.069+0000 7f566b7fe640 1 --2- 172.21.15.5:0/136206467 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f566c0a1ff0 0x7f566c137430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 1 -- 172.21.15.5:0/136206467 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f566c133eb0 msgr2=0x7f566c134330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 1 --2- 172.21.15.5:0/136206467 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f566c133eb0 0x7f566c134330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f565c0098a0 tx=0x7f565c01c440 comp rx=0 tx=0).ready entity=mon.8 client_cookie=7205a512d91c2db2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566a7fc640 1 -- 172.21.15.5:0/136206467 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f565c0b0070 con 0x7f566c133eb0 2024-08-18T21:03:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566a7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566a7fc640 10 monclient: dump: 2024-08-18T21:03:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.082 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566a7fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566a7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 5 monclient: authenticate success, global_id 4382 2024-08-18T21:03:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566a7fc640 1 -- 172.21.15.5:0/136206467 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c0aa810 con 0x7f566c133eb0 2024-08-18T21:03:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566a7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 4 set_mon_vals no callback set 2024-08-18T21:03:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566a7fc640 1 -- 172.21.15.5:0/136206467 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f565c0a9300 con 0x7f566c133eb0 2024-08-18T21:03:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566a7fc640 10 monclient: dump: 2024-08-18T21:03:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.084 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 10 monclient: shutdown 2024-08-18T21:03:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 -- 172.21.15.5:0/136206467 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f566c133eb0 msgr2=0x7f566c134330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 --2- 172.21.15.5:0/136206467 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f566c133eb0 0x7f566c134330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f565c0098a0 tx=0x7f565c01c440 comp rx=0 tx=0).stop 2024-08-18T21:03:52.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 -- 172.21.15.5:0/136206467 shutdown_connections 2024-08-18T21:03:52.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 --2- 172.21.15.5:0/136206467 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f566c133eb0 0x7f566c134330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 --2- 172.21.15.5:0/136206467 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f566c137970 0x7f566c137dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 --2- 172.21.15.5:0/136206467 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f566c0a1ff0 0x7f566c137430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 -- 172.21.15.5:0/136206467 >> 172.21.15.5:0/136206467 conn(0x7f566c0a8020 msgr2=0x7f566c0a8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:52.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 -- 172.21.15.5:0/136206467 shutdown_connections 2024-08-18T21:03:52.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 -- 172.21.15.5:0/136206467 wait complete. 2024-08-18T21:03:52.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 10 monclient: build_initial_monmap 2024-08-18T21:03:52.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 10 monclient: monmap: 2024-08-18T21:03:52.085 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:52.085 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:52.085 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:52.085 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:52.085 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:52.086 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 Processor -- start 2024-08-18T21:03:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 -- start start 2024-08-18T21:03:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 10 monclient: init 2024-08-18T21:03:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 10 monclient: _add_conns ranks=[2,5,4,1,0,3,7,6,8] 2024-08-18T21:03:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c0a1ff0 0x7f566c1303e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 10 monclient(hunting): picked mon.noname-b con 0x7f566c0a1ff0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f566c133eb0 0x7f566c130920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 10 monclient(hunting): picked mon.noname-h con 0x7f566c133eb0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f566c137970 0x7f566c13a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 10 monclient(hunting): picked mon.noname-c con 0x7f566c137970 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f566c141370 con 0x7f566c0a1ff0 2024-08-18T21:03:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f566c1411f0 con 0x7f566c137970 2024-08-18T21:03:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f566c1414f0 con 0x7f566c133eb0 2024-08-18T21:03:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f5671efb640 10 monclient(hunting): authenticate will time out at 999.090865s 2024-08-18T21:03:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566b7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c0a1ff0 0x7f566c1303e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f566c137970 0x7f566c13a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566b7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c0a1ff0 0x7f566c1303e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34264/0 (socket says 172.21.15.5:34264) 2024-08-18T21:03:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566b7fe640 1 -- 172.21.15.5:0/3874291683 learned_addr learned my addr 172.21.15.5:0/3874291683 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566b7fe640 10 monclient(hunting): get_auth_request con 0x7f566c0a1ff0 auth_method 0 2024-08-18T21:03:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f566c137970 0x7f566c13a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:36858/0 (socket says 172.21.15.5:36858) 2024-08-18T21:03:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 10 monclient(hunting): get_auth_request con 0x7f566c137970 auth_method 0 2024-08-18T21:03:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566affd640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f566c133eb0 0x7f566c130920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566affd640 10 monclient(hunting): get_auth_request con 0x7f566c133eb0 auth_method 0 2024-08-18T21:03:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 10 monclient(hunting): handle_auth_done global_id 4441 payload 824 2024-08-18T21:03:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 1 -- 172.21.15.5:0/3874291683 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f566c133eb0 msgr2=0x7f566c130920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f566c133eb0 0x7f566c130920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 1 -- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c0a1ff0 msgr2=0x7f566c1303e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c0a1ff0 0x7f566c1303e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:03:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 1 monclient: found mon.noname-c 2024-08-18T21:03:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566bfff640 1 -- 172.21.15.5:0/3874291683 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566c13bcb0 con 0x7f566c137970 2024-08-18T21:03:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.073+0000 7f566b7fe640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c0a1ff0 0x7f566c1303e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f566bfff640 1 -- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f566c137970 msgr2=0x7f566c13a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f566bfff640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f566c137970 0x7f566c13a200 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f565c0ab000 tx=0x7f565c0191e0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5663fff640 1 -- 172.21.15.5:0/3874291683 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f565c0b0040 con 0x7f566c137970 2024-08-18T21:03:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5663fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5663fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5663fff640 10 monclient: dump: 2024-08-18T21:03:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.092 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5663fff640 10 monclient: _finish_auth 0 2024-08-18T21:03:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5663fff640 10 monclient: _check_auth_tickets 2024-08-18T21:03:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5663fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5671efb640 5 monclient: authenticate success, global_id 4441 2024-08-18T21:03:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5663fff640 1 -- 172.21.15.5:0/3874291683 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c0044b0 con 0x7f566c137970 2024-08-18T21:03:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5671efb640 10 monclient: _renew_subs 2024-08-18T21:03:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5671efb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5671efb640 1 -- 172.21.15.5:0/3874291683 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f566c137230 con 0x7f566c137970 2024-08-18T21:03:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5663fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5663fff640 1 -- 172.21.15.5:0/3874291683 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f565c0aabf0 con 0x7f566c137970 2024-08-18T21:03:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5663fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5663fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5669ffb640 4 set_mon_vals no callback set 2024-08-18T21:03:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5663fff640 10 monclient: dump: 2024-08-18T21:03:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.094 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5671efb640 10 monclient: _renew_subs 2024-08-18T21:03:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5671efb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5671efb640 1 -- 172.21.15.5:0/3874291683 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f566c13d770 con 0x7f566c137970 2024-08-18T21:03:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5671efb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5671efb640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c13a740 0x7f566c13ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5671efb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5671efb640 1 -- 172.21.15.5:0/3874291683 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f566c051140 con 0x7f566c13a740 2024-08-18T21:03:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5663fff640 1 -- 172.21.15.5:0/3874291683 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f565c0bb060 con 0x7f566c137970 2024-08-18T21:03:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5663fff640 1 --2- 172.21.15.5:0/3874291683 >> v2:172.21.15.157:6812/631023601 conn(0x7f565003bdc0 0x7f565003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f5663fff640 1 -- 172.21.15.5:0/3874291683 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(20..20 src has 1..20) ==== 3534+0+0 (secure 0 0 0) 0x7f565c0e7470 con 0x7f566c137970 2024-08-18T21:03:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f566b7fe640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c13a740 0x7f566c13ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f566b7fe640 10 monclient: get_auth_request con 0x7f566c13a740 auth_method 0 2024-08-18T21:03:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f566b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f566b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f566b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f566b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f566b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f566b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f566affd640 1 --2- 172.21.15.5:0/3874291683 >> v2:172.21.15.157:6812/631023601 conn(0x7f565003bdc0 0x7f565003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f566b7fe640 10 monclient(hunting): handle_auth_done global_id 4502 payload 824 2024-08-18T21:03:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f566b7fe640 1 -- 172.21.15.5:0/3874291683 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f566c137750 con 0x7f566c13a740 2024-08-18T21:03:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.077+0000 7f566affd640 10 monclient: get_auth_request con 0x7f565003bdc0 auth_method 0 2024-08-18T21:03:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.081+0000 7f566b7fe640 1 -- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c13a740 msgr2=0x7f566c13ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.081+0000 7f566b7fe640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c13a740 0x7f566c13ab20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f566400c9f0 tx=0x7f566400ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.081+0000 7f5663fff640 1 -- 172.21.15.5:0/3874291683 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f566400a8b0 con 0x7f566c13a740 2024-08-18T21:03:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.081+0000 7f5663fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.081+0000 7f5663fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.081+0000 7f5663fff640 10 monclient: dump: 2024-08-18T21:03:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.101 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.081+0000 7f5663fff640 1 -- 172.21.15.5:0/3874291683 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5664017420 con 0x7f566c13a740 2024-08-18T21:03:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.081+0000 7f5663fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.081+0000 7f5663fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.081+0000 7f5663fff640 1 -- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c13a740 msgr2=0x7f566c13ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.081+0000 7f5663fff640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c13a740 0x7f566c13ab20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f566400c9f0 tx=0x7f566400ceb0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.081+0000 7f5663fff640 1 -- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c13a740 msgr2=0x7f566c13ab20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.081+0000 7f5663fff640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c13a740 0x7f566c13ab20 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f566400c9f0 tx=0x7f566400ceb0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.081+0000 7f566affd640 1 --2- 172.21.15.5:0/3874291683 >> v2:172.21.15.157:6812/631023601 conn(0x7f565003bdc0 0x7f565003e280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f566c13c320 tx=0x7f5654008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f5671efb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:03:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f5671efb640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c13b060 0x7f566c09f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f5671efb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f5671efb640 1 -- 172.21.15.5:0/3874291683 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f566c134330 con 0x7f566c13b060 2024-08-18T21:03:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f566b7fe640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c13b060 0x7f566c09f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f566b7fe640 10 monclient: get_auth_request con 0x7f566c13b060 auth_method 0 2024-08-18T21:03:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f566b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f566b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f566b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f566b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f566b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f566b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f566b7fe640 10 monclient(hunting): handle_auth_done global_id 4511 payload 824 2024-08-18T21:03:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f566b7fe640 1 -- 172.21.15.5:0/3874291683 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f566c1316e0 con 0x7f566c13b060 2024-08-18T21:03:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f566b7fe640 1 -- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c13b060 msgr2=0x7f566c09f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f566b7fe640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c13b060 0x7f566c09f520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5664017000 tx=0x7f5664004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f5663fff640 1 -- 172.21.15.5:0/3874291683 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5664017e60 con 0x7f566c13b060 2024-08-18T21:03:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f5663fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f5663fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f5663fff640 10 monclient: dump: 2024-08-18T21:03:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.104 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f5663fff640 1 -- 172.21.15.5:0/3874291683 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f56640179f0 con 0x7f566c13b060 2024-08-18T21:03:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f5663fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:03:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f5663fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f5663fff640 1 -- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c13b060 msgr2=0x7f566c09f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f5663fff640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c13b060 0x7f566c09f520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5664017000 tx=0x7f5664004a50 comp rx=0 tx=0).stop 2024-08-18T21:03:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f5663fff640 1 -- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c13b060 msgr2=0x7f566c09f520 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.089+0000 7f5663fff640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f566c13b060 0x7f566c09f520 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5664017000 tx=0x7f5664004a50 comp rx=0 tx=0).stop 2024-08-18T21:03:52.105 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:03:52.105 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:03:52.105 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:03:52.105 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:03:52.106 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 10, 2024-08-18T21:03:52.106 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 41203, 2024-08-18T21:03:52.106 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:03:52.106 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:03:52.106 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:03:52.106 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:03:52.106 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:03:52.106 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:03:52.106 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:03:52.106 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:03:52.106 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:03:52.106 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:03:52.106 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.107 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 34, 2024-08-18T21:03:52.107 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:52.107 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:03:52.107 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:03:52.107 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:52.107 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:52.107 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:52.107 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:52.107 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:52.107 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:52.107 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:52.107 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:52.107 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:52.108 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:52.108 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:52.108 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.108 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:03:52.108 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:03:52.108 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:52.108 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:52.108 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:52.108 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:52.108 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:52.108 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:52.108 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:52.108 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:52.108 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:52.109 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:52.109 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:52.109 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.109 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:03:52.109 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:03:52.109 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:03:52.109 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:03:52.109 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:03:52.109 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:03:52.109 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:52.109 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:52.109 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:03:52.109 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:03:52.110 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:03:52.110 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:03:52.110 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:03:52.110 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:03:52.110 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:03:52.110 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:52.110 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:03:52.110 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:52.110 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:52.110 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:52.110 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:52.110 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:52.110 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:52.111 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:52.111 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:52.111 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:52.111 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:52.111 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:52.111 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.111 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:03:52.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.111 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:03:52.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.111 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:03:52.111 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:03:52.111 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.111 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.112 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.112 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:03:52.112 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.112 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.112 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:03:52.112 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.112 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.112 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.112 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:03:52.113 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:03:52.113 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.113 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.113 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.113 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:03:52.113 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:03:52.113 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.113 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.113 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.113 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:03:52.113 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.114 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:03:52.114 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.114 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.114 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.114 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:03:52.114 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:03:52.114 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.114 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.114 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.115 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:03:52.115 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:03:52.115 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.115 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.115 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.115 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:03:52.115 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.115 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.116 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:03:52.116 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.116 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.116 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.116 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:03:52.116 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:03:52.116 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.116 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.116 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.116 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:03:52.116 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:03:52.116 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.117 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.117 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:03:52.117 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.117 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:03:52.117 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.117 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.117 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.117 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:03:52.118 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:03:52.118 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.118 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.118 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.118 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:03:52.118 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:03:52.118 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.118 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.118 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.118 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:03:52.118 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.119 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.119 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:03:52.119 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.119 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.119 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.119 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:03:52.119 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:03:52.119 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.119 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.119 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.120 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:03:52.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:03:52.120 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.120 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.120 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.120 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:03:52.120 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.120 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.120 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:03:52.121 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.121 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.121 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.121 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:03:52.121 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:03:52.121 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.121 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.121 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.121 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:03:52.121 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:03:52.121 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.122 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.122 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:03:52.122 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.122 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:03:52.122 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.122 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.122 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:03:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:03:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:03:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:03:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:03:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.124 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.124 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:03:52.124 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.124 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.124 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.124 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:03:52.124 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:03:52.124 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.124 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.124 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.125 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:03:52.125 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:03:52.125 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.125 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.125 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:03:52.125 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.125 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:03:52.125 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.126 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.126 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.126 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:03:52.126 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:03:52.126 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.126 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.126 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.126 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.126 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.126 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:03:52.126 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:03:52.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.127 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:52.127 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:52.127 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:03:52.127 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.127 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:03:52.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.127 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:52.127 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:52.127 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:03:52.127 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.127 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.128 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:03:52.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.128 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:52.128 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:52.128 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:03:52.128 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.128 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.128 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:03:52.128 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:03:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.093+0000 7f5671efb640 1 -- 172.21.15.5:0/3874291683 >> v2:172.21.15.157:6812/631023601 conn(0x7f565003bdc0 msgr2=0x7f565003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.093+0000 7f5671efb640 1 --2- 172.21.15.5:0/3874291683 >> v2:172.21.15.157:6812/631023601 conn(0x7f565003bdc0 0x7f565003e280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f566c13c320 tx=0x7f5654008040 comp rx=0 tx=0).stop 2024-08-18T21:03:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.093+0000 7f5671efb640 10 monclient: shutdown 2024-08-18T21:03:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.093+0000 7f5671efb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.093+0000 7f5671efb640 1 -- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f566c137970 msgr2=0x7f566c13a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.093+0000 7f5671efb640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f566c137970 0x7f566c13a200 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f565c0ab000 tx=0x7f565c0191e0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.093+0000 7f566bfff640 1 -- 172.21.15.5:0/3874291683 reap_dead start 2024-08-18T21:03:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.093+0000 7f5671efb640 1 -- 172.21.15.5:0/3874291683 shutdown_connections 2024-08-18T21:03:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.093+0000 7f5671efb640 1 --2- 172.21.15.5:0/3874291683 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f566c137970 0x7f566c13a200 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.093+0000 7f5671efb640 1 -- 172.21.15.5:0/3874291683 >> 172.21.15.5:0/3874291683 conn(0x7f566c0a8020 msgr2=0x7f566c0a3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.093+0000 7f5671efb640 1 -- 172.21.15.5:0/3874291683 shutdown_connections 2024-08-18T21:03:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.093+0000 7f5671efb640 1 -- 172.21.15.5:0/3874291683 wait complete. 2024-08-18T21:03:52.131 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:03:52.131 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:03:52.131 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:03:52.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.253+0000 7f7a1e2f5640 10 monclient: get_monmap_and_config 2024-08-18T21:03:52.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.253+0000 7f7a1e2f5640 10 monclient: build_initial_monmap 2024-08-18T21:03:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 10 monclient: monmap: 2024-08-18T21:03:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:52.260406+0000 2024-08-18T21:03:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:52.260406+0000 2024-08-18T21:03:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:52.260 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 1 Processor -- start 2024-08-18T21:03:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 1 -- start start 2024-08-18T21:03:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 10 monclient: init 2024-08-18T21:03:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 10 monclient: _add_conns ranks=[7,1,2,6,8,0,4,9,3,10,5] 2024-08-18T21:03:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7a180a6bd0 0x7f7a180a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 10 monclient(hunting): picked mon.noname-i con 0x7f7a180a6bd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7a1809f080 addr v1:172.21.15.157:6789/0 2024-08-18T21:03:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7a180a74f0 0x7f7a1813a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 10 monclient(hunting): picked mon.noname-b con 0x7f7a180a74f0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a180a7fb0 con 0x7f7a1809f080 2024-08-18T21:03:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f7a1809e4c0 con 0x7f7a180a74f0 2024-08-18T21:03:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7a1806f930 con 0x7f7a180a6bd0 2024-08-18T21:03:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1e2f5640 10 monclient(hunting): authenticate will time out at 999.273508s 2024-08-18T21:03:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7a180a74f0 0x7f7a1813a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7a180a74f0 0x7f7a1813a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34294/0 (socket says 172.21.15.5:34294) 2024-08-18T21:03:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 1 -- 172.21.15.5:0/3773989139 learned_addr learned my addr 172.21.15.5:0/3773989139 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 10 monclient(hunting): get_auth_request con 0x7f7a180a74f0 auth_method 0 2024-08-18T21:03:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a17fff640 1 --2- 172.21.15.5:0/3773989139 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7a180a6bd0 0x7f7a180a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 10 monclient(hunting): handle_auth_done global_id 4520 payload 274 2024-08-18T21:03:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 1 -- 172.21.15.5:0/3773989139 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7a180a6bd0 msgr2=0x7f7a180a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 1 --2- 172.21.15.5:0/3773989139 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7a180a6bd0 0x7f7a180a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 1 -- 172.21.15.5:0/3773989139 >> v1:172.21.15.157:6789/0 conn(0x7f7a1809f080 legacy=0x7f7a18139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 10 monclient: _finish_hunting 0 2024-08-18T21:03:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 1 monclient: found mon.noname-b 2024-08-18T21:03:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a1c892640 1 -- 172.21.15.5:0/3773989139 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1809de70 con 0x7f7a180a74f0 2024-08-18T21:03:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a17fff640 10 monclient: get_auth_request con 0x7f7a180a6bd0 auth_method 0 2024-08-18T21:03:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.257+0000 7f7a17fff640 1 --2- 172.21.15.5:0/3773989139 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7a180a6bd0 0x7f7a180a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1c892640 1 -- 172.21.15.5:0/3773989139 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7a180a74f0 msgr2=0x7f7a1813a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1c892640 1 --2- 172.21.15.5:0/3773989139 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7a180a74f0 0x7f7a1813a0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009e80 tx=0x7f7a1001d370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b37ee1805014b5f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a177fe640 1 -- 172.21.15.5:0/3773989139 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7a100091b0 con 0x7f7a180a74f0 2024-08-18T21:03:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a177fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a177fe640 10 monclient: dump: 2024-08-18T21:03:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.270 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a177fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a177fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a177fe640 1 -- 172.21.15.5:0/3773989139 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a100a5a70 con 0x7f7a180a74f0 2024-08-18T21:03:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a177fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a177fe640 1 -- 172.21.15.5:0/3773989139 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7a100a5c20 con 0x7f7a180a74f0 2024-08-18T21:03:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a177fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a177fe640 10 monclient: dump: 2024-08-18T21:03:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.272 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1e2f5640 5 monclient: authenticate success, global_id 4520 2024-08-18T21:03:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1e2f5640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1e2f5640 4 set_mon_vals no callback set 2024-08-18T21:03:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1e2f5640 10 monclient: shutdown 2024-08-18T21:03:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1e2f5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1e2f5640 1 -- 172.21.15.5:0/3773989139 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7a180a74f0 msgr2=0x7f7a1813a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1e2f5640 1 --2- 172.21.15.5:0/3773989139 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7a180a74f0 0x7f7a1813a0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009e80 tx=0x7f7a1001d370 comp rx=0 tx=0).stop 2024-08-18T21:03:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1e2f5640 1 -- 172.21.15.5:0/3773989139 shutdown_connections 2024-08-18T21:03:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1e2f5640 1 --2- 172.21.15.5:0/3773989139 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7a180a74f0 0x7f7a1813a0a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1e2f5640 1 --2- 172.21.15.5:0/3773989139 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7a180a6bd0 0x7f7a180a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1e2f5640 1 -- 172.21.15.5:0/3773989139 >> 172.21.15.5:0/3773989139 conn(0x7f7a18068700 msgr2=0x7f7a18068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1e2f5640 1 -- 172.21.15.5:0/3773989139 shutdown_connections 2024-08-18T21:03:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1e2f5640 1 -- 172.21.15.5:0/3773989139 wait complete. 2024-08-18T21:03:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1e2f5640 10 monclient: build_initial_monmap 2024-08-18T21:03:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.261+0000 7f7a1e2f5640 10 monclient: monmap: 2024-08-18T21:03:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:52.274 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 1 Processor -- start 2024-08-18T21:03:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 1 -- start start 2024-08-18T21:03:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 10 monclient: init 2024-08-18T21:03:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 10 monclient: _add_conns ranks=[4,7,3,5,8,2,0,1,6] 2024-08-18T21:03:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1809f080 0x7f7a18138be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 10 monclient(hunting): picked mon.noname-c con 0x7f7a1809f080 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7a180a6bd0 0x7f7a18139120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 10 monclient(hunting): picked mon.noname-i con 0x7f7a180a6bd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a180a74f0 0x7f7a1813e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 10 monclient(hunting): picked mon.noname-g con 0x7f7a180a74f0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7a1813a5e0 con 0x7f7a180a74f0 2024-08-18T21:03:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f7a180a89f0 con 0x7f7a1809f080 2024-08-18T21:03:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7a1813a760 con 0x7f7a180a6bd0 2024-08-18T21:03:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1e2f5640 10 monclient(hunting): authenticate will time out at 999.280765s 2024-08-18T21:03:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1809f080 0x7f7a18138be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1809f080 0x7f7a18138be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:36864/0 (socket says 172.21.15.5:36864) 2024-08-18T21:03:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 1 -- 172.21.15.5:0/2817991945 learned_addr learned my addr 172.21.15.5:0/2817991945 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 10 monclient(hunting): get_auth_request con 0x7f7a1809f080 auth_method 0 2024-08-18T21:03:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1c892640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a180a74f0 0x7f7a1813e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 10 monclient(hunting): handle_auth_done global_id 4450 payload 824 2024-08-18T21:03:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a0f7fe640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7a180a6bd0 0x7f7a18139120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 1 -- 172.21.15.5:0/2817991945 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7a180a6bd0 msgr2=0x7f7a18139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7a180a6bd0 0x7f7a18139120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 1 -- 172.21.15.5:0/2817991945 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a180a74f0 msgr2=0x7f7a1813e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a180a74f0 0x7f7a1813e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 10 monclient: _finish_hunting 0 2024-08-18T21:03:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 1 monclient: found mon.noname-c 2024-08-18T21:03:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 1 -- 172.21.15.5:0/2817991945 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a18123740 con 0x7f7a1809f080 2024-08-18T21:03:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1c892640 10 monclient: get_auth_request con 0x7f7a180a74f0 auth_method 0 2024-08-18T21:03:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a1c892640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a180a74f0 0x7f7a1813e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 1 -- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1809f080 msgr2=0x7f7a18138be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a17fff640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1809f080 0x7f7a18138be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800c7c0 tx=0x7f7a0800cc80 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.265+0000 7f7a157fa640 1 -- 172.21.15.5:0/2817991945 DispatchQueue::entry inject delay of 0.002000 2024-08-18T21:03:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a157fa640 1 -- 172.21.15.5:0/2817991945 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7a08015070 con 0x7f7a1809f080 2024-08-18T21:03:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a157fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a157fa640 10 monclient: dump: 2024-08-18T21:03:52.281 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.281 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.281 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.281 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.281 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.281 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.281 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.281 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.281 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.281 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.281 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.281 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.281 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.281 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.282 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.282 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a157fa640 10 monclient: _finish_auth 0 2024-08-18T21:03:52.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a157fa640 10 monclient: _check_auth_tickets 2024-08-18T21:03:52.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:52.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a157fa640 1 -- 172.21.15.5:0/2817991945 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a080113f0 con 0x7f7a1809f080 2024-08-18T21:03:52.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a157fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:52.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a1e2f5640 5 monclient: authenticate success, global_id 4450 2024-08-18T21:03:52.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a157fa640 1 -- 172.21.15.5:0/2817991945 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7a08011a10 con 0x7f7a1809f080 2024-08-18T21:03:52.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a157fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:52.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a157fa640 10 monclient: dump: 2024-08-18T21:03:52.282 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.283 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.283 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.283 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.283 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.283 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.283 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.283 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.283 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.283 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.283 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.283 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.283 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.283 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.284 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a1e2f5640 10 monclient: _renew_subs 2024-08-18T21:03:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a1e2f5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a1e2f5640 1 -- 172.21.15.5:0/2817991945 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a18140820 con 0x7f7a1809f080 2024-08-18T21:03:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a167fc640 4 set_mon_vals no callback set 2024-08-18T21:03:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a1e2f5640 10 monclient: _renew_subs 2024-08-18T21:03:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a1e2f5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a1e2f5640 1 -- 172.21.15.5:0/2817991945 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a180a6290 con 0x7f7a1809f080 2024-08-18T21:03:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a1e2f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a1e2f5640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1813e990 0x7f7a1813ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a1e2f5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a1e2f5640 1 -- 172.21.15.5:0/2817991945 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f7a18051140 con 0x7f7a1813e990 2024-08-18T21:03:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a0f7fe640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1813e990 0x7f7a1813ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a0f7fe640 10 monclient: get_auth_request con 0x7f7a1813e990 auth_method 0 2024-08-18T21:03:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a0f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a0f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a157fa640 1 -- 172.21.15.5:0/2817991945 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f7a08018070 con 0x7f7a1809f080 2024-08-18T21:03:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a0f7fe640 10 monclient(hunting): handle_auth_done global_id 4459 payload 824 2024-08-18T21:03:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a0f7fe640 1 -- 172.21.15.5:0/2817991945 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a180abab0 con 0x7f7a1813e990 2024-08-18T21:03:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a157fa640 1 --2- 172.21.15.5:0/2817991945 >> v2:172.21.15.157:6812/631023601 conn(0x7f79f803bcf0 0x7f79f803e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a157fa640 1 -- 172.21.15.5:0/2817991945 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(21..21 src has 1..21) ==== 3898+0+0 (secure 0 0 0) 0x7f7a0804e5b0 con 0x7f7a1809f080 2024-08-18T21:03:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a1c892640 1 --2- 172.21.15.5:0/2817991945 >> v2:172.21.15.157:6812/631023601 conn(0x7f79f803bcf0 0x7f79f803e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.269+0000 7f7a1c892640 10 monclient: get_auth_request con 0x7f79f803bcf0 auth_method 0 2024-08-18T21:03:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.273+0000 7f7a0f7fe640 1 -- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1813e990 msgr2=0x7f7a1813ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.273+0000 7f7a0f7fe640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1813e990 0x7f7a1813ed70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7a1813fbb0 tx=0x7f7a0000d810 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.273+0000 7f7a157fa640 1 -- 172.21.15.5:0/2817991945 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7a00016020 con 0x7f7a1813e990 2024-08-18T21:03:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.273+0000 7f7a157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.273+0000 7f7a157fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.273+0000 7f7a157fa640 10 monclient: dump: 2024-08-18T21:03:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.287 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.273+0000 7f7a157fa640 1 -- 172.21.15.5:0/2817991945 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7a00012810 con 0x7f7a1813e990 2024-08-18T21:03:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.273+0000 7f7a157fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.273+0000 7f7a157fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:52.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.273+0000 7f7a157fa640 1 -- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1813e990 msgr2=0x7f7a1813ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.273+0000 7f7a157fa640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1813e990 0x7f7a1813ed70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7a1813fbb0 tx=0x7f7a0000d810 comp rx=0 tx=0).stop 2024-08-18T21:03:52.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.273+0000 7f7a157fa640 1 -- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1813e990 msgr2=0x7f7a1813ed70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:52.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.273+0000 7f7a157fa640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1813e990 0x7f7a1813ed70 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7a1813fbb0 tx=0x7f7a0000d810 comp rx=0 tx=0).stop 2024-08-18T21:03:52.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.273+0000 7f7a1c892640 1 --2- 172.21.15.5:0/2817991945 >> v2:172.21.15.157:6812/631023601 conn(0x7f79f803bcf0 0x7f79f803e1b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009e80 tx=0x7f7a10004ac0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a1e2f5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:03:52.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a1e2f5640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1813f2b0 0x7f7a180a4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a1e2f5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a1e2f5640 1 -- 172.21.15.5:0/2817991945 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f7a180a6fb0 con 0x7f7a1813f2b0 2024-08-18T21:03:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a0f7fe640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1813f2b0 0x7f7a180a4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a0f7fe640 10 monclient: get_auth_request con 0x7f7a1813f2b0 auth_method 0 2024-08-18T21:03:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a0f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a0f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a0f7fe640 10 monclient(hunting): handle_auth_done global_id 4468 payload 824 2024-08-18T21:03:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a0f7fe640 1 -- 172.21.15.5:0/2817991945 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7a180746d0 con 0x7f7a1813f2b0 2024-08-18T21:03:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a0f7fe640 1 -- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1813f2b0 msgr2=0x7f7a180a4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a0f7fe640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1813f2b0 0x7f7a180a4500 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7a1813fbb0 tx=0x7f7a00003770 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a157fa640 1 -- 172.21.15.5:0/2817991945 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7a00016040 con 0x7f7a1813f2b0 2024-08-18T21:03:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a157fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a157fa640 10 monclient: dump: 2024-08-18T21:03:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.292 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.292 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.292 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.292 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.292 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.292 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.292 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.292 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a157fa640 1 -- 172.21.15.5:0/2817991945 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f7a0001b630 con 0x7f7a1813f2b0 2024-08-18T21:03:52.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a157fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:03:52.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a157fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:52.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a157fa640 1 -- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1813f2b0 msgr2=0x7f7a180a4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a157fa640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1813f2b0 0x7f7a180a4500 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7a1813fbb0 tx=0x7f7a00003770 comp rx=0 tx=0).stop 2024-08-18T21:03:52.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a157fa640 1 -- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1813f2b0 msgr2=0x7f7a180a4500 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:52.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a157fa640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1813f2b0 0x7f7a180a4500 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7a1813fbb0 tx=0x7f7a00003770 comp rx=0 tx=0).stop 2024-08-18T21:03:52.293 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:03:52.293 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:03:52.293 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:03:52.293 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:03:52.293 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 10, 2024-08-18T21:03:52.293 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 41399, 2024-08-18T21:03:52.293 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:03:52.293 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:03:52.294 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:03:52.294 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:03:52.294 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:03:52.294 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:03:52.294 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:03:52.294 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:03:52.294 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:03:52.294 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:03:52.294 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.294 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 35, 2024-08-18T21:03:52.294 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:52.294 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:03:52.295 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:03:52.295 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:52.295 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:52.295 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:52.295 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:52.295 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:52.295 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:52.295 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:52.295 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:52.295 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:52.295 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:52.295 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:52.295 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.295 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:03:52.296 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:03:52.296 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:52.296 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:52.296 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:52.296 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:52.296 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:52.296 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:52.296 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:52.296 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:52.296 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:52.296 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:52.296 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:52.296 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.297 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:03:52.297 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:03:52.297 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:03:52.297 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:03:52.297 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:03:52.297 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:03:52.297 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:52.297 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:52.297 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:03:52.297 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:03:52.297 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:03:52.297 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:03:52.297 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:03:52.298 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:03:52.298 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:03:52.298 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:52.298 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:03:52.298 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:52.298 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:52.298 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:52.298 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:52.298 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:52.298 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:52.298 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:52.298 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:52.299 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:52.299 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:52.299 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:52.299 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.299 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:03:52.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.299 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:03:52.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:03:52.299 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:03:52.299 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.299 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.300 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.300 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:03:52.300 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.300 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.300 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:03:52.300 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.300 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.300 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.300 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:03:52.301 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:03:52.301 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.301 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.301 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.301 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:03:52.301 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:03:52.301 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.301 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.301 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.301 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:03:52.302 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.302 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.302 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:03:52.302 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.302 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.302 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.302 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:03:52.302 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:03:52.302 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.302 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.303 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.303 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:03:52.303 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:03:52.303 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.303 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.303 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.303 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:03:52.303 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:03:52.304 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.304 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.304 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:03:52.304 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:03:52.304 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.304 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.304 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.305 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:03:52.305 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:03:52.305 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:03:52.305 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:03:52.305 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.306 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.306 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:03:52.306 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:03:52.306 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.306 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.306 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.306 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:03:52.306 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:03:52.306 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:03:52.307 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:03:52.307 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.307 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.307 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:03:52.308 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:03:52.308 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.308 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.308 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.308 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:03:52.308 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:03:52.308 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.308 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:03:52.309 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:03:52.309 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.309 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.309 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:03:52.309 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:03:52.309 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.309 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.309 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.310 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:03:52.310 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:03:52.310 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:03:52.310 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:03:52.311 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.311 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.311 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:03:52.311 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:03:52.311 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.311 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.311 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.311 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:03:52.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:03:52.311 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.312 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:03:52.312 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.312 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:03:52.312 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.312 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.312 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:03:52.312 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:03:52.312 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.313 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.313 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.313 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:03:52.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:03:52.313 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:03:52.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.314 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:03:52.314 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.314 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.314 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:03:52.314 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:03:52.314 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.314 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.314 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.314 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.314 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.315 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:03:52.315 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:03:52.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.315 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:52.315 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:52.315 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:03:52.315 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.315 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.315 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:03:52.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.315 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:52.315 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:52.315 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:03:52.315 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.316 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.316 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:03:52.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.316 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:52.316 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:52.316 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:03:52.316 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.316 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.316 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:03:52.316 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:03:52.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a1e2f5640 1 -- 172.21.15.5:0/2817991945 >> v2:172.21.15.157:6812/631023601 conn(0x7f79f803bcf0 msgr2=0x7f79f803e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a1e2f5640 1 --2- 172.21.15.5:0/2817991945 >> v2:172.21.15.157:6812/631023601 conn(0x7f79f803bcf0 0x7f79f803e1b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009e80 tx=0x7f7a10004ac0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a1e2f5640 10 monclient: shutdown 2024-08-18T21:03:52.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a1e2f5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:52.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a1e2f5640 1 -- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1809f080 msgr2=0x7f7a18138be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a1e2f5640 1 --2- 172.21.15.5:0/2817991945 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a1809f080 0x7f7a18138be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800c7c0 tx=0x7f7a0800cc80 comp rx=0 tx=0).stop 2024-08-18T21:03:52.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a1c892640 1 -- 172.21.15.5:0/2817991945 reap_dead start 2024-08-18T21:03:52.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a1c892640 1 -- 172.21.15.5:0/2817991945 reap_dead start 2024-08-18T21:03:52.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a1e2f5640 1 -- 172.21.15.5:0/2817991945 shutdown_connections 2024-08-18T21:03:52.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.281+0000 7f7a1e2f5640 1 -- 172.21.15.5:0/2817991945 >> 172.21.15.5:0/2817991945 conn(0x7f7a18068700 msgr2=0x7f7a18141560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:52.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.285+0000 7f7a1e2f5640 1 -- 172.21.15.5:0/2817991945 shutdown_connections 2024-08-18T21:03:52.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.285+0000 7f7a1e2f5640 1 -- 172.21.15.5:0/2817991945 wait complete. 2024-08-18T21:03:52.319 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:03:52.319 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:03:52.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:03:52.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 10 monclient: get_monmap_and_config 2024-08-18T21:03:52.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 10 monclient: build_initial_monmap 2024-08-18T21:03:52.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 10 monclient: monmap: 2024-08-18T21:03:52.432 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:52.432 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.432 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:52.434229+0000 2024-08-18T21:03:52.432 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:52.434229+0000 2024-08-18T21:03:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:52.433 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 1 Processor -- start 2024-08-18T21:03:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 1 -- start start 2024-08-18T21:03:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 10 monclient: init 2024-08-18T21:03:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 10 monclient: _add_conns ranks=[5,4,6,8,9,3,0,10,2,7,1] 2024-08-18T21:03:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f69100a6ce0 0x7f69100a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 10 monclient(hunting): picked mon.noname-h con 0x7f69100a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69100a7600 0x7f6910139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 10 monclient(hunting): picked mon.noname-c con 0x7f69100a7600 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6910139fe0 0x7f691013a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 10 monclient(hunting): picked mon.noname-d con 0x7f6910139fe0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f69100a5000 con 0x7f69100a7600 2024-08-18T21:03:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f69100a4360 con 0x7f69100a6ce0 2024-08-18T21:03:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f69100a45d0 con 0x7f6910139fe0 2024-08-18T21:03:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f6915652640 10 monclient(hunting): authenticate will time out at 999.447043s 2024-08-18T21:03:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690e7fc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69100a7600 0x7f6910139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690e7fc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69100a7600 0x7f6910139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:36900/0 (socket says 172.21.15.5:36900) 2024-08-18T21:03:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690e7fc640 1 -- 172.21.15.5:0/3228391927 learned_addr learned my addr 172.21.15.5:0/3228391927 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690e7fc640 10 monclient(hunting): get_auth_request con 0x7f69100a7600 auth_method 0 2024-08-18T21:03:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 1 --2- 172.21.15.5:0/3228391927 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6910139fe0 0x7f691013a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 10 monclient(hunting): get_auth_request con 0x7f6910139fe0 auth_method 0 2024-08-18T21:03:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690effd640 1 --2- 172.21.15.5:0/3228391927 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f69100a6ce0 0x7f69100a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690effd640 10 monclient(hunting): get_auth_request con 0x7f69100a6ce0 auth_method 0 2024-08-18T21:03:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 10 monclient(hunting): handle_auth_done global_id 4416 payload 274 2024-08-18T21:03:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 1 -- 172.21.15.5:0/3228391927 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f69100a6ce0 msgr2=0x7f69100a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 1 --2- 172.21.15.5:0/3228391927 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f69100a6ce0 0x7f69100a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 1 -- 172.21.15.5:0/3228391927 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69100a7600 msgr2=0x7f6910139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 1 --2- 172.21.15.5:0/3228391927 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69100a7600 0x7f6910139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:03:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 1 monclient: found mon.noname-d 2024-08-18T21:03:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690f7fe640 1 -- 172.21.15.5:0/3228391927 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69100a32d0 con 0x7f6910139fe0 2024-08-18T21:03:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.429+0000 7f690e7fc640 1 --2- 172.21.15.5:0/3228391927 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69100a7600 0x7f6910139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690f7fe640 1 -- 172.21.15.5:0/3228391927 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6910139fe0 msgr2=0x7f691013a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690f7fe640 1 --2- 172.21.15.5:0/3228391927 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6910139fe0 0x7f691013a440 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6908009df0 tx=0x7f690801c850 comp rx=0 tx=0).ready entity=mon.6 client_cookie=69a04f6210f7cceb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690dffb640 1 -- 172.21.15.5:0/3228391927 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f69080b2070 con 0x7f6910139fe0 2024-08-18T21:03:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690dffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690dffb640 10 monclient: dump: 2024-08-18T21:03:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.445 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690dffb640 10 monclient: _finish_auth 0 2024-08-18T21:03:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690dffb640 10 monclient: _check_auth_tickets 2024-08-18T21:03:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690dffb640 1 -- 172.21.15.5:0/3228391927 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69080a5990 con 0x7f6910139fe0 2024-08-18T21:03:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 5 monclient: authenticate success, global_id 4416 2024-08-18T21:03:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690dffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690dffb640 1 -- 172.21.15.5:0/3228391927 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f69080ab340 con 0x7f6910139fe0 2024-08-18T21:03:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 4 set_mon_vals no callback set 2024-08-18T21:03:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690dffb640 10 monclient: dump: 2024-08-18T21:03:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.448 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 10 monclient: shutdown 2024-08-18T21:03:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 -- 172.21.15.5:0/3228391927 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6910139fe0 msgr2=0x7f691013a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 --2- 172.21.15.5:0/3228391927 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6910139fe0 0x7f691013a440 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6908009df0 tx=0x7f690801c850 comp rx=0 tx=0).stop 2024-08-18T21:03:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 -- 172.21.15.5:0/3228391927 shutdown_connections 2024-08-18T21:03:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 --2- 172.21.15.5:0/3228391927 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6910139fe0 0x7f691013a440 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 --2- 172.21.15.5:0/3228391927 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69100a7600 0x7f6910139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 --2- 172.21.15.5:0/3228391927 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f69100a6ce0 0x7f69100a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 -- 172.21.15.5:0/3228391927 >> 172.21.15.5:0/3228391927 conn(0x7f69100acbc0 msgr2=0x7f69100a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 -- 172.21.15.5:0/3228391927 shutdown_connections 2024-08-18T21:03:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 -- 172.21.15.5:0/3228391927 wait complete. 2024-08-18T21:03:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 10 monclient: build_initial_monmap 2024-08-18T21:03:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 10 monclient: monmap: 2024-08-18T21:03:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:52.450 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:52.450 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 Processor -- start 2024-08-18T21:03:52.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 -- start start 2024-08-18T21:03:52.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 10 monclient: init 2024-08-18T21:03:52.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:52.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 10 monclient: _add_conns ranks=[8,5,7,0,3,6,4,1,2] 2024-08-18T21:03:52.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69100a6ce0 0x7f69101d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 10 monclient(hunting): picked mon.noname-e con 0x7f69100a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:52.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f69100a7600 0x7f691013fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 10 monclient(hunting): picked mon.noname-h con 0x7f69100a7600 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:52.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6910139fe0 0x7f69101402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 10 monclient(hunting): picked mon.noname-i con 0x7f6910139fe0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:52.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f69100a79e0 con 0x7f69100a7600 2024-08-18T21:03:52.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f69100a8220 con 0x7f6910139fe0 2024-08-18T21:03:52.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f69100aa250 con 0x7f69100a6ce0 2024-08-18T21:03:52.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:52.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f6915652640 10 monclient(hunting): authenticate will time out at 999.454977s 2024-08-18T21:03:52.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69100a6ce0 0x7f69101d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69100a6ce0 0x7f69101d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47554/0 (socket says 172.21.15.5:47554) 2024-08-18T21:03:52.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 1 -- 172.21.15.5:0/4092810113 learned_addr learned my addr 172.21.15.5:0/4092810113 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:52.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 10 monclient(hunting): get_auth_request con 0x7f69100a6ce0 auth_method 0 2024-08-18T21:03:52.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 10 monclient(hunting): handle_auth_done global_id 4391 payload 824 2024-08-18T21:03:52.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 1 -- 172.21.15.5:0/4092810113 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6910139fe0 msgr2=0x7f69101402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 1 --2- 172.21.15.5:0/4092810113 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6910139fe0 0x7f69101402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 1 -- 172.21.15.5:0/4092810113 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f69100a7600 msgr2=0x7f691013fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 1 --2- 172.21.15.5:0/4092810113 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f69100a7600 0x7f691013fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 10 monclient: _finish_hunting 0 2024-08-18T21:03:52.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 1 monclient: found mon.noname-e 2024-08-18T21:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.437+0000 7f690effd640 1 -- 172.21.15.5:0/4092810113 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69100a7150 con 0x7f69100a6ce0 2024-08-18T21:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f690effd640 1 -- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69100a6ce0 msgr2=0x7f69101d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f690effd640 1 --2- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69100a6ce0 0x7f69101d15e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f690000d780 tx=0x7f690000dc40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f68f77fe640 1 -- 172.21.15.5:0/4092810113 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f690000bd40 con 0x7f69100a6ce0 2024-08-18T21:03:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f68f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f68f77fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f68f77fe640 10 monclient: dump: 2024-08-18T21:03:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.458 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f68f77fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f68f77fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f68f77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f68f77fe640 1 -- 172.21.15.5:0/4092810113 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6900019070 con 0x7f69100a6ce0 2024-08-18T21:03:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f68f77fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f68f77fe640 1 -- 172.21.15.5:0/4092810113 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f69000148a0 con 0x7f69100a6ce0 2024-08-18T21:03:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f68f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f68f77fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f68f77fe640 10 monclient: dump: 2024-08-18T21:03:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.460 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f6915652640 5 monclient: authenticate success, global_id 4391 2024-08-18T21:03:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f6915652640 10 monclient: _renew_subs 2024-08-18T21:03:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f6915652640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f690cff9640 4 set_mon_vals no callback set 2024-08-18T21:03:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f6915652640 1 -- 172.21.15.5:0/4092810113 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6910140800 con 0x7f69100a6ce0 2024-08-18T21:03:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f6915652640 10 monclient: _renew_subs 2024-08-18T21:03:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f6915652640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f6915652640 1 -- 172.21.15.5:0/4092810113 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f691013e290 con 0x7f69100a6ce0 2024-08-18T21:03:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f6915652640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f6915652640 1 --2- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f691013acd0 0x7f691013b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f6915652640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f6915652640 1 -- 172.21.15.5:0/4092810113 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f69100a7b60 con 0x7f691013acd0 2024-08-18T21:03:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f690e7fc640 1 --2- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f691013acd0 0x7f691013b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f690e7fc640 10 monclient: get_auth_request con 0x7f691013acd0 auth_method 0 2024-08-18T21:03:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f690e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f690e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f690e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f690e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f690e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f690e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f68f77fe640 1 -- 172.21.15.5:0/4092810113 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f6900014430 con 0x7f69100a6ce0 2024-08-18T21:03:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f690e7fc640 10 monclient(hunting): handle_auth_done global_id 4425 payload 824 2024-08-18T21:03:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f690e7fc640 1 -- 172.21.15.5:0/4092810113 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6910139aa0 con 0x7f691013acd0 2024-08-18T21:03:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f68f77fe640 1 --2- 172.21.15.5:0/4092810113 >> v2:172.21.15.157:6812/631023601 conn(0x7f68fc03bdc0 0x7f68fc03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.441+0000 7f68f77fe640 1 -- 172.21.15.5:0/4092810113 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(21..21 src has 1..21) ==== 3898+0+0 (secure 0 0 0) 0x7f690000f040 con 0x7f69100a6ce0 2024-08-18T21:03:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.445+0000 7f690f7fe640 1 --2- 172.21.15.5:0/4092810113 >> v2:172.21.15.157:6812/631023601 conn(0x7f68fc03bdc0 0x7f68fc03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.445+0000 7f690f7fe640 10 monclient: get_auth_request con 0x7f68fc03bdc0 auth_method 0 2024-08-18T21:03:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.445+0000 7f690e7fc640 1 -- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f691013acd0 msgr2=0x7f691013b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.445+0000 7f690e7fc640 1 --2- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f691013acd0 0x7f691013b0d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f691013d540 tx=0x7f690400eb40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.445+0000 7f68f77fe640 1 -- 172.21.15.5:0/4092810113 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6904017070 con 0x7f691013acd0 2024-08-18T21:03:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.445+0000 7f68f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.445+0000 7f68f77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.445+0000 7f68f77fe640 10 monclient: dump: 2024-08-18T21:03:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.464 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.445+0000 7f68f77fe640 1 -- 172.21.15.5:0/4092810113 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f690400ee70 con 0x7f691013acd0 2024-08-18T21:03:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.445+0000 7f68f77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.445+0000 7f68f77fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.445+0000 7f68f77fe640 1 -- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f691013acd0 msgr2=0x7f691013b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.445+0000 7f68f77fe640 1 --2- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f691013acd0 0x7f691013b0d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f691013d540 tx=0x7f690400eb40 comp rx=0 tx=0).stop 2024-08-18T21:03:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.445+0000 7f68f77fe640 1 -- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f691013acd0 msgr2=0x7f691013b0d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.445+0000 7f68f77fe640 1 --2- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f691013acd0 0x7f691013b0d0 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f691013d540 tx=0x7f690400eb40 comp rx=0 tx=0).stop 2024-08-18T21:03:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.445+0000 7f690f7fe640 1 --2- 172.21.15.5:0/4092810113 >> v2:172.21.15.157:6812/631023601 conn(0x7f68fc03bdc0 0x7f68fc03e280 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6908009dc0 tx=0x7f6908004ac0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f6915652640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:03:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f6915652640 1 --2- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f691013b610 0x7f691009da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f6915652640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f6915652640 1 -- 172.21.15.5:0/4092810113 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f6910051140 con 0x7f691013b610 2024-08-18T21:03:52.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f690e7fc640 1 --2- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f691013b610 0x7f691009da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f690e7fc640 10 monclient: get_auth_request con 0x7f691013b610 auth_method 0 2024-08-18T21:03:52.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f690e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f690e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f690e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f690e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f690e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f690e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f690e7fc640 10 monclient(hunting): handle_auth_done global_id 4434 payload 824 2024-08-18T21:03:52.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f690e7fc640 1 -- 172.21.15.5:0/4092810113 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f691013e700 con 0x7f691013b610 2024-08-18T21:03:52.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f690e7fc640 1 -- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f691013b610 msgr2=0x7f691009da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f690e7fc640 1 --2- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f691013b610 0x7f691009da30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f691013d540 tx=0x7f69040046d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f68f77fe640 1 -- 172.21.15.5:0/4092810113 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6904017070 con 0x7f691013b610 2024-08-18T21:03:52.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f68f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f68f77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f68f77fe640 10 monclient: dump: 2024-08-18T21:03:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.468 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f68f77fe640 1 -- 172.21.15.5:0/4092810113 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f6904006600 con 0x7f691013b610 2024-08-18T21:03:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f68f77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:03:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f68f77fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f68f77fe640 1 -- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f691013b610 msgr2=0x7f691009da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f68f77fe640 1 --2- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f691013b610 0x7f691009da30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f691013d540 tx=0x7f69040046d0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f68f77fe640 1 -- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f691013b610 msgr2=0x7f691009da30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.453+0000 7f68f77fe640 1 --2- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f691013b610 0x7f691009da30 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f691013d540 tx=0x7f69040046d0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.469 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:03:52.469 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:03:52.469 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:03:52.469 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:03:52.469 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 10, 2024-08-18T21:03:52.469 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 41563, 2024-08-18T21:03:52.469 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:03:52.469 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:03:52.469 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:03:52.469 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:03:52.469 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:03:52.469 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:03:52.470 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:03:52.470 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:03:52.470 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:03:52.470 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:03:52.470 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.470 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 35, 2024-08-18T21:03:52.470 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:52.470 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:03:52.470 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:03:52.470 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:52.470 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:52.470 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:52.470 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:52.471 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:52.471 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:52.471 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:52.471 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:52.471 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:52.471 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:52.471 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:52.471 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.471 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:03:52.471 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:03:52.471 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:52.471 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:52.471 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:52.472 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:52.472 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:52.472 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:52.472 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:52.472 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:52.472 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:52.472 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:52.472 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:52.472 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.472 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:03:52.472 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:03:52.472 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:03:52.472 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:03:52.473 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:03:52.473 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:03:52.473 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:52.473 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:52.473 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:03:52.473 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:03:52.473 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:03:52.473 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:03:52.473 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:03:52.473 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:03:52.473 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:03:52.473 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:52.473 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:03:52.473 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:52.474 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:52.474 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:52.474 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:52.474 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:52.474 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:52.474 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:52.474 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:52.474 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:52.474 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:52.474 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:52.474 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.474 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:03:52.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.475 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:03:52.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.475 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:03:52.475 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:03:52.475 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.475 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.475 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.475 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:03:52.475 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.475 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.475 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:03:52.476 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.476 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.476 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:03:52.476 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:03:52.476 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.476 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.476 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.476 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:03:52.476 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:03:52.476 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.477 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.477 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.477 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:03:52.477 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.477 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.477 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:03:52.477 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.477 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.477 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.478 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:03:52.478 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:03:52.478 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.478 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.478 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.478 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:03:52.478 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:03:52.478 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.478 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:03:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:03:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:03:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:03:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:03:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:03:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:03:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:03:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:03:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:03:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:03:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:03:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:03:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:03:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:03:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:03:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:03:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:03:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:03:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:03:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:03:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:03:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:03:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:03:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:03:52.491 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:03:52.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.457+0000 7f6915652640 1 -- 172.21.15.5:0/4092810113 >> v2:172.21.15.157:6812/631023601 conn(0x7f68fc03bdc0 msgr2=0x7f68fc03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.457+0000 7f6915652640 1 --2- 172.21.15.5:0/4092810113 >> v2:172.21.15.157:6812/631023601 conn(0x7f68fc03bdc0 0x7f68fc03e280 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6908009dc0 tx=0x7f6908004ac0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.457+0000 7f6915652640 10 monclient: shutdown 2024-08-18T21:03:52.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.457+0000 7f6915652640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:52.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.457+0000 7f6915652640 1 -- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69100a6ce0 msgr2=0x7f69101d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.457+0000 7f6915652640 1 --2- 172.21.15.5:0/4092810113 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69100a6ce0 0x7f69101d15e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f690000d780 tx=0x7f690000dc40 comp rx=0 tx=0).stop 2024-08-18T21:03:52.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.457+0000 7f690f7fe640 1 -- 172.21.15.5:0/4092810113 reap_dead start 2024-08-18T21:03:52.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.457+0000 7f690f7fe640 1 -- 172.21.15.5:0/4092810113 reap_dead start 2024-08-18T21:03:52.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.457+0000 7f6915652640 1 -- 172.21.15.5:0/4092810113 shutdown_connections 2024-08-18T21:03:52.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.457+0000 7f6915652640 1 -- 172.21.15.5:0/4092810113 >> 172.21.15.5:0/4092810113 conn(0x7f69100acbc0 msgr2=0x7f69101388e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:52.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.457+0000 7f6915652640 1 -- 172.21.15.5:0/4092810113 shutdown_connections 2024-08-18T21:03:52.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.457+0000 7f6915652640 1 -- 172.21.15.5:0/4092810113 wait complete. 2024-08-18T21:03:52.494 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:03:52.494 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:03:52.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:03:52.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 10 monclient: get_monmap_and_config 2024-08-18T21:03:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 10 monclient: build_initial_monmap 2024-08-18T21:03:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 10 monclient: monmap: 2024-08-18T21:03:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:52.616612+0000 2024-08-18T21:03:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:52.616612+0000 2024-08-18T21:03:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:52.616 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 1 Processor -- start 2024-08-18T21:03:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 1 -- start start 2024-08-18T21:03:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 10 monclient: init 2024-08-18T21:03:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 10 monclient: _add_conns ranks=[6,2,1,3,5,0,9,7,8,10,4] 2024-08-18T21:03:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f71b80a6bd0 0x7f71b80a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 10 monclient(hunting): picked mon.noname-d con 0x7f71b80a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71b809f080 0x7f71b80a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 10 monclient(hunting): picked mon.noname-b con 0x7f71b809f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f71b8139990 addr v1:172.21.15.157:6789/0 2024-08-18T21:03:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71b80a7fb0 con 0x7f71b8139990 2024-08-18T21:03:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f71b809e4c0 con 0x7f71b809f080 2024-08-18T21:03:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f71b806f930 con 0x7f71b80a6bd0 2024-08-18T21:03:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71c03ef640 10 monclient(hunting): authenticate will time out at 999.629753s 2024-08-18T21:03:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f71b80a6bd0 0x7f71b80a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71bd98a640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71b809f080 0x7f71b80a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f71b80a6bd0 0x7f71b80a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:57196/0 (socket says 172.21.15.5:57196) 2024-08-18T21:03:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71bd98a640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71b809f080 0x7f71b80a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34304/0 (socket says 172.21.15.5:34304) 2024-08-18T21:03:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 1 -- 172.21.15.5:0/435047088 learned_addr learned my addr 172.21.15.5:0/435047088 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 10 monclient(hunting): get_auth_request con 0x7f71b80a6bd0 auth_method 0 2024-08-18T21:03:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71bd98a640 10 monclient(hunting): get_auth_request con 0x7f71b809f080 auth_method 0 2024-08-18T21:03:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71bd98a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71bd98a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71bd98a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71bd98a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71bd98a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71bd98a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 10 monclient(hunting): handle_auth_done global_id 4443 payload 274 2024-08-18T21:03:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 1 -- 172.21.15.5:0/435047088 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71b809f080 msgr2=0x7f71b80a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 1 --2- 172.21.15.5:0/435047088 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71b809f080 0x7f71b80a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 1 -- 172.21.15.5:0/435047088 >> v1:172.21.15.157:6789/0 conn(0x7f71b8139990 legacy=0x7f71b8139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 10 monclient: _finish_hunting 0 2024-08-18T21:03:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 1 monclient: found mon.noname-d 2024-08-18T21:03:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71be18b640 1 -- 172.21.15.5:0/435047088 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b809de70 con 0x7f71b80a6bd0 2024-08-18T21:03:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.613+0000 7f71bd98a640 1 --2- 172.21.15.5:0/435047088 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71b809f080 0x7f71b80a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:52.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71be18b640 1 -- 172.21.15.5:0/435047088 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f71b80a6bd0 msgr2=0x7f71b80a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71be18b640 1 --2- 172.21.15.5:0/435047088 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f71b80a6bd0 0x7f71b80a6fb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f71b40098d0 tx=0x7f71b401c440 comp rx=0 tx=0).ready entity=mon.6 client_cookie=a5ed510ae71483ec server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71bd189640 1 -- 172.21.15.5:0/435047088 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71b40b0070 con 0x7f71b80a6bd0 2024-08-18T21:03:52.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71bd189640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71bd189640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:52.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71bd189640 10 monclient: dump: 2024-08-18T21:03:52.626 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.626 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.626 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.626 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.626 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.627 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71bd189640 10 monclient: _finish_auth 0 2024-08-18T21:03:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71bd189640 10 monclient: _check_auth_tickets 2024-08-18T21:03:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71bd189640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71bd189640 1 -- 172.21.15.5:0/435047088 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b40aa810 con 0x7f71b80a6bd0 2024-08-18T21:03:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71bd189640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71bd189640 1 -- 172.21.15.5:0/435047088 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71b40a9300 con 0x7f71b80a6bd0 2024-08-18T21:03:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71c03ef640 5 monclient: authenticate success, global_id 4443 2024-08-18T21:03:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71c03ef640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71c03ef640 4 set_mon_vals no callback set 2024-08-18T21:03:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71bd189640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71bd189640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71bd189640 10 monclient: dump: 2024-08-18T21:03:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.629 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71c03ef640 10 monclient: shutdown 2024-08-18T21:03:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71c03ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71c03ef640 1 -- 172.21.15.5:0/435047088 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f71b80a6bd0 msgr2=0x7f71b80a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71c03ef640 1 --2- 172.21.15.5:0/435047088 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f71b80a6bd0 0x7f71b80a6fb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f71b40098d0 tx=0x7f71b401c440 comp rx=0 tx=0).stop 2024-08-18T21:03:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71c03ef640 1 -- 172.21.15.5:0/435047088 shutdown_connections 2024-08-18T21:03:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71c03ef640 1 --2- 172.21.15.5:0/435047088 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71b809f080 0x7f71b80a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71c03ef640 1 --2- 172.21.15.5:0/435047088 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f71b80a6bd0 0x7f71b80a6fb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71c03ef640 1 -- 172.21.15.5:0/435047088 >> 172.21.15.5:0/435047088 conn(0x7f71b8068700 msgr2=0x7f71b8068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71c03ef640 1 -- 172.21.15.5:0/435047088 shutdown_connections 2024-08-18T21:03:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.617+0000 7f71c03ef640 1 -- 172.21.15.5:0/435047088 wait complete. 2024-08-18T21:03:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 10 monclient: build_initial_monmap 2024-08-18T21:03:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 10 monclient: monmap: 2024-08-18T21:03:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:52.632 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 1 Processor -- start 2024-08-18T21:03:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 1 -- start start 2024-08-18T21:03:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 10 monclient: init 2024-08-18T21:03:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 10 monclient: _add_conns ranks=[2,7,0,1,6,3,5,8,4] 2024-08-18T21:03:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71b809f080 0x7f71b813fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 10 monclient(hunting): picked mon.noname-b con 0x7f71b809f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f71b80a6bd0 0x7f71b81d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 10 monclient(hunting): picked mon.noname-i con 0x7f71b80a6bd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:03:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b8139990 0x7f71b813d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 10 monclient(hunting): picked mon.noname-a con 0x7f71b8139990 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f71b81447a0 con 0x7f71b8139990 2024-08-18T21:03:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f71b8144620 con 0x7f71b809f080 2024-08-18T21:03:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f71b8144920 con 0x7f71b80a6bd0 2024-08-18T21:03:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71c03ef640 10 monclient(hunting): authenticate will time out at 999.637109s 2024-08-18T21:03:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71b809f080 0x7f71b813fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71b809f080 0x7f71b813fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34318/0 (socket says 172.21.15.5:34318) 2024-08-18T21:03:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 1 -- 172.21.15.5:0/639527245 learned_addr learned my addr 172.21.15.5:0/639527245 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 10 monclient(hunting): get_auth_request con 0x7f71b809f080 auth_method 0 2024-08-18T21:03:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be98c640 1 --2- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b8139990 0x7f71b813d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be98c640 10 monclient(hunting): get_auth_request con 0x7f71b8139990 auth_method 0 2024-08-18T21:03:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be98c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be98c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be98c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be98c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be98c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be98c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71bd98a640 1 --2- 172.21.15.5:0/639527245 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f71b80a6bd0 0x7f71b81d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71bd98a640 10 monclient(hunting): get_auth_request con 0x7f71b80a6bd0 auth_method 0 2024-08-18T21:03:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71bd98a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71bd98a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71bd98a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 10 monclient(hunting): handle_auth_done global_id 4538 payload 824 2024-08-18T21:03:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 1 -- 172.21.15.5:0/639527245 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f71b80a6bd0 msgr2=0x7f71b81d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 1 --2- 172.21.15.5:0/639527245 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f71b80a6bd0 0x7f71b81d1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 1 -- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b8139990 msgr2=0x7f71b813d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 1 --2- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b8139990 0x7f71b813d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 10 monclient: _finish_hunting 0 2024-08-18T21:03:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 1 monclient: found mon.noname-b 2024-08-18T21:03:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 1 -- 172.21.15.5:0/639527245 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b80a65a0 con 0x7f71b809f080 2024-08-18T21:03:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 1 -- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71b809f080 msgr2=0x7f71b813fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.621+0000 7f71be18b640 1 --2- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71b809f080 0x7f71b813fe10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f71b40ae040 tx=0x7f71b40191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 1 -- 172.21.15.5:0/639527245 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71b40b9070 con 0x7f71b809f080 2024-08-18T21:03:52.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 10 monclient: dump: 2024-08-18T21:03:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.641 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 10 monclient: _finish_auth 0 2024-08-18T21:03:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 10 monclient: _check_auth_tickets 2024-08-18T21:03:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 1 -- 172.21.15.5:0/639527245 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b4004040 con 0x7f71b809f080 2024-08-18T21:03:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 1 -- 172.21.15.5:0/639527245 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71b40b0040 con 0x7f71b809f080 2024-08-18T21:03:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 10 monclient: dump: 2024-08-18T21:03:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.643 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71c03ef640 5 monclient: authenticate success, global_id 4538 2024-08-18T21:03:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71bc988640 4 set_mon_vals no callback set 2024-08-18T21:03:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71c03ef640 10 monclient: _renew_subs 2024-08-18T21:03:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71c03ef640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71c03ef640 1 -- 172.21.15.5:0/639527245 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b8123010 con 0x7f71b809f080 2024-08-18T21:03:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71c03ef640 10 monclient: _renew_subs 2024-08-18T21:03:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71c03ef640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:03:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71c03ef640 1 -- 172.21.15.5:0/639527245 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b8122d30 con 0x7f71b809f080 2024-08-18T21:03:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71c03ef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71c03ef640 1 --2- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71b81d2330 0x7f71b813dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71c03ef640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71c03ef640 1 -- 172.21.15.5:0/639527245 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f71b81397b0 con 0x7f71b81d2330 2024-08-18T21:03:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71bd98a640 1 --2- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71b81d2330 0x7f71b813dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71bd98a640 10 monclient: get_auth_request con 0x7f71b81d2330 auth_method 0 2024-08-18T21:03:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71bd98a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71bd98a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71bd98a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71bd98a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71bd98a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71bd98a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 1 -- 172.21.15.5:0/639527245 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f71b40aab80 con 0x7f71b809f080 2024-08-18T21:03:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71bd98a640 10 monclient(hunting): handle_auth_done global_id 4400 payload 824 2024-08-18T21:03:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71bd98a640 1 -- 172.21.15.5:0/639527245 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71b8139e10 con 0x7f71b81d2330 2024-08-18T21:03:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 1 --2- 172.21.15.5:0/639527245 >> v2:172.21.15.157:6812/631023601 conn(0x7f719c03bdc0 0x7f719c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 1 -- 172.21.15.5:0/639527245 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 3898+0+0 (secure 0 0 0) 0x7f71b40e7520 con 0x7f71b809f080 2024-08-18T21:03:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71be98c640 1 --2- 172.21.15.5:0/639527245 >> v2:172.21.15.157:6812/631023601 conn(0x7f719c03bdc0 0x7f719c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71be98c640 10 monclient: get_auth_request con 0x7f719c03bdc0 auth_method 0 2024-08-18T21:03:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71bd98a640 1 -- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71b81d2330 msgr2=0x7f71b813dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71bd98a640 1 --2- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71b81d2330 0x7f71b813dd50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71b813f920 tx=0x7f71a8011a60 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 1 -- 172.21.15.5:0/639527245 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71a800fe20 con 0x7f71b81d2330 2024-08-18T21:03:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.625+0000 7f71aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.629+0000 7f71aeffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.629+0000 7f71aeffd640 10 monclient: dump: 2024-08-18T21:03:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.646 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.629+0000 7f71aeffd640 1 -- 172.21.15.5:0/639527245 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f71a800f9b0 con 0x7f71b81d2330 2024-08-18T21:03:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.629+0000 7f71aeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.629+0000 7f71aeffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.629+0000 7f71aeffd640 1 -- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71b81d2330 msgr2=0x7f71b813dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.629+0000 7f71aeffd640 1 --2- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71b81d2330 0x7f71b813dd50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71b813f920 tx=0x7f71a8011a60 comp rx=0 tx=0).stop 2024-08-18T21:03:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.629+0000 7f71aeffd640 1 -- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71b81d2330 msgr2=0x7f71b813dd50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.629+0000 7f71aeffd640 1 --2- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71b81d2330 0x7f71b813dd50 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71b813f920 tx=0x7f71a8011a60 comp rx=0 tx=0).stop 2024-08-18T21:03:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.629+0000 7f71be98c640 1 --2- 172.21.15.5:0/639527245 >> v2:172.21.15.157:6812/631023601 conn(0x7f719c03bdc0 0x7f719c03e280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009f60 tx=0x7f71b000d040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.633+0000 7f71c03ef640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:03:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.633+0000 7f71c03ef640 1 --2- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71b813e290 0x7f71b80a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.633+0000 7f71c03ef640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.633+0000 7f71c03ef640 1 -- 172.21.15.5:0/639527245 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f71b8051140 con 0x7f71b813e290 2024-08-18T21:03:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.633+0000 7f71bd98a640 1 --2- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71b813e290 0x7f71b80a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.633+0000 7f71bd98a640 10 monclient: get_auth_request con 0x7f71b813e290 auth_method 0 2024-08-18T21:03:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.633+0000 7f71bd98a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.633+0000 7f71bd98a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.633+0000 7f71bd98a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.633+0000 7f71bd98a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.633+0000 7f71bd98a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.633+0000 7f71bd98a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.633+0000 7f71bd98a640 10 monclient(hunting): handle_auth_done global_id 4409 payload 824 2024-08-18T21:03:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.633+0000 7f71bd98a640 1 -- 172.21.15.5:0/639527245 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f71b813e6a0 con 0x7f71b813e290 2024-08-18T21:03:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71bd98a640 1 -- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71b813e290 msgr2=0x7f71b80a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71bd98a640 1 --2- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71b813e290 0x7f71b80a4000 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71b813f920 tx=0x7f71a8004740 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71aeffd640 1 -- 172.21.15.5:0/639527245 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71a80066c0 con 0x7f71b813e290 2024-08-18T21:03:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71aeffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71aeffd640 10 monclient: dump: 2024-08-18T21:03:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.650 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71aeffd640 1 -- 172.21.15.5:0/639527245 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f71a8006250 con 0x7f71b813e290 2024-08-18T21:03:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71aeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:03:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71aeffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71aeffd640 1 -- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71b813e290 msgr2=0x7f71b80a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71aeffd640 1 --2- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71b813e290 0x7f71b80a4000 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71b813f920 tx=0x7f71a8004740 comp rx=0 tx=0).stop 2024-08-18T21:03:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71aeffd640 1 -- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71b813e290 msgr2=0x7f71b80a4000 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71aeffd640 1 --2- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71b813e290 0x7f71b80a4000 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71b813f920 tx=0x7f71a8004740 comp rx=0 tx=0).stop 2024-08-18T21:03:52.651 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:03:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:03:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:03:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:03:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 10, 2024-08-18T21:03:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 41751, 2024-08-18T21:03:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:03:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:03:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:03:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:03:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:03:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:03:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:03:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:03:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:03:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:03:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 35, 2024-08-18T21:03:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:03:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:03:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:03:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:03:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:03:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:03:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:03:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:03:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:03:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:03:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:03:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:03:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:03:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:03:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:03:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:03:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:03:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:03:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:03:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:03:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:03:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:03:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:03:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:03:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:03:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:03:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:03:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:03:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:03:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:03:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:03:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:03:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:03:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:03:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:03:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:03:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:03:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:03:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:03:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:03:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:03:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:03:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:03:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:03:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:03:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:03:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:03:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:03:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:03:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:03:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:03:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:03:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:03:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:03:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:03:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:03:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:03:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:03:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:03:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:03:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:03:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:03:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:03:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:03:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:03:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:03:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:03:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:03:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:03:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:03:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:03:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:03:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:03:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:03:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:03:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:03:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:03:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:03:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:03:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:03:52.674 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:03:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71c03ef640 1 -- 172.21.15.5:0/639527245 >> v2:172.21.15.157:6812/631023601 conn(0x7f719c03bdc0 msgr2=0x7f719c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71c03ef640 1 --2- 172.21.15.5:0/639527245 >> v2:172.21.15.157:6812/631023601 conn(0x7f719c03bdc0 0x7f719c03e280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009f60 tx=0x7f71b000d040 comp rx=0 tx=0).stop 2024-08-18T21:03:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71c03ef640 10 monclient: shutdown 2024-08-18T21:03:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71c03ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71c03ef640 1 -- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71b809f080 msgr2=0x7f71b813fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71c03ef640 1 --2- 172.21.15.5:0/639527245 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71b809f080 0x7f71b813fe10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f71b40ae040 tx=0x7f71b40191e0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71be98c640 1 -- 172.21.15.5:0/639527245 reap_dead start 2024-08-18T21:03:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71be98c640 1 -- 172.21.15.5:0/639527245 reap_dead start 2024-08-18T21:03:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71c03ef640 1 -- 172.21.15.5:0/639527245 shutdown_connections 2024-08-18T21:03:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71c03ef640 1 -- 172.21.15.5:0/639527245 >> 172.21.15.5:0/639527245 conn(0x7f71b8068700 msgr2=0x7f71b8141640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71c03ef640 1 -- 172.21.15.5:0/639527245 shutdown_connections 2024-08-18T21:03:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.637+0000 7f71c03ef640 1 -- 172.21.15.5:0/639527245 wait complete. 2024-08-18T21:03:52.677 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:03:52.677 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:03:52.677 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:03:52.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 10 monclient: get_monmap_and_config 2024-08-18T21:03:52.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 10 monclient: build_initial_monmap 2024-08-18T21:03:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 10 monclient: monmap: 2024-08-18T21:03:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:52.793451+0000 2024-08-18T21:03:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:52.793451+0000 2024-08-18T21:03:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:52.793 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:52.793 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:52.793 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:52.793 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:52.793 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:52.793 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 1 Processor -- start 2024-08-18T21:03:52.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 1 -- start start 2024-08-18T21:03:52.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 10 monclient: init 2024-08-18T21:03:52.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:52.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 10 monclient: _add_conns ranks=[4,10,6,3,7,2,8,0,5,9,1] 2024-08-18T21:03:52.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f48d80a6ce0 0x7f48d80a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 10 monclient(hunting): picked mon.noname-c con 0x7f48d80a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:52.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f48d80a7600 0x7f48d8139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 10 monclient(hunting): picked mon.noname-f con 0x7f48d80a7600 addr v2:172.21.15.157:3300/0 2024-08-18T21:03:52.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f48d8139fe0 0x7f48d813a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 10 monclient(hunting): picked mon.noname-d con 0x7f48d8139fe0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:52.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f48d80a5000 con 0x7f48d80a7600 2024-08-18T21:03:52.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f48d80a4360 con 0x7f48d80a6ce0 2024-08-18T21:03:52.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f48d80a45d0 con 0x7f48d8139fe0 2024-08-18T21:03:52.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:52.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dff04640 10 monclient(hunting): authenticate will time out at 999.806576s 2024-08-18T21:03:52.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48ddca0640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f48d80a6ce0 0x7f48d80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f48d8139fe0 0x7f48d813a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48ddca0640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f48d80a6ce0 0x7f48d80a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:36906/0 (socket says 172.21.15.5:36906) 2024-08-18T21:03:52.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48ddca0640 1 -- 172.21.15.5:0/2611606604 learned_addr learned my addr 172.21.15.5:0/2611606604 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:52.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 10 monclient(hunting): get_auth_request con 0x7f48d8139fe0 auth_method 0 2024-08-18T21:03:52.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48ddca0640 10 monclient(hunting): get_auth_request con 0x7f48d80a6ce0 auth_method 0 2024-08-18T21:03:52.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48ddca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48ddca0640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48ddca0640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48ddca0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48ddca0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dd49f640 1 --2- 172.21.15.5:0/2611606604 >> v2:172.21.15.157:3300/0 conn(0x7f48d80a7600 0x7f48d8139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48ddca0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dd49f640 10 monclient(hunting): get_auth_request con 0x7f48d80a7600 auth_method 0 2024-08-18T21:03:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dd49f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dd49f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dd49f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dd49f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dd49f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48dd49f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 10 monclient(hunting): handle_auth_done global_id 4452 payload 274 2024-08-18T21:03:52.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 1 -- 172.21.15.5:0/2611606604 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f48d80a6ce0 msgr2=0x7f48d80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:52.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 1 --2- 172.21.15.5:0/2611606604 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f48d80a6ce0 0x7f48d80a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 1 -- 172.21.15.5:0/2611606604 >> v2:172.21.15.157:3300/0 conn(0x7f48d80a7600 msgr2=0x7f48d8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:52.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 1 --2- 172.21.15.5:0/2611606604 >> v2:172.21.15.157:3300/0 conn(0x7f48d80a7600 0x7f48d8139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 10 monclient: _finish_hunting 0 2024-08-18T21:03:52.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 1 monclient: found mon.noname-d 2024-08-18T21:03:52.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:52.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:52.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48de4a1640 1 -- 172.21.15.5:0/2611606604 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d80a32d0 con 0x7f48d8139fe0 2024-08-18T21:03:52.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.789+0000 7f48ddca0640 1 --2- 172.21.15.5:0/2611606604 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f48d80a6ce0 0x7f48d80a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:52.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48de4a1640 1 -- 172.21.15.5:0/2611606604 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f48d8139fe0 msgr2=0x7f48d813a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48de4a1640 1 --2- 172.21.15.5:0/2611606604 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f48d8139fe0 0x7f48d813a440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009dc0 tx=0x7f48d001c810 comp rx=0 tx=0).ready entity=mon.6 client_cookie=fb0d2ed0d0c84f11 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48dcc9e640 1 -- 172.21.15.5:0/2611606604 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f48d00b2070 con 0x7f48d8139fe0 2024-08-18T21:03:52.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48dcc9e640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48dcc9e640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:52.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48dcc9e640 10 monclient: dump: 2024-08-18T21:03:52.805 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.805 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.805 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.805 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.805 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.805 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.805 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.805 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.805 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.806 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.806 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.806 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.806 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.806 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.806 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.806 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48dcc9e640 10 monclient: _finish_auth 0 2024-08-18T21:03:52.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48dcc9e640 10 monclient: _check_auth_tickets 2024-08-18T21:03:52.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48dcc9e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:52.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48dcc9e640 1 -- 172.21.15.5:0/2611606604 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d00a59b0 con 0x7f48d8139fe0 2024-08-18T21:03:52.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48dcc9e640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:52.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48dcc9e640 1 -- 172.21.15.5:0/2611606604 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f48d00ab340 con 0x7f48d8139fe0 2024-08-18T21:03:52.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48dff04640 5 monclient: authenticate success, global_id 4452 2024-08-18T21:03:52.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48dff04640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:52.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48dff04640 4 set_mon_vals no callback set 2024-08-18T21:03:52.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48dcc9e640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48dcc9e640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:52.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.793+0000 7f48dcc9e640 10 monclient: dump: 2024-08-18T21:03:52.807 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.807 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.807 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.807 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.807 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.807 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.807 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.808 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.808 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.808 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.808 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.808 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.808 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.808 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.808 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.808 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 10 monclient: shutdown 2024-08-18T21:03:52.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:52.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 -- 172.21.15.5:0/2611606604 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f48d8139fe0 msgr2=0x7f48d813a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 --2- 172.21.15.5:0/2611606604 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f48d8139fe0 0x7f48d813a440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009dc0 tx=0x7f48d001c810 comp rx=0 tx=0).stop 2024-08-18T21:03:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 -- 172.21.15.5:0/2611606604 shutdown_connections 2024-08-18T21:03:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 --2- 172.21.15.5:0/2611606604 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f48d8139fe0 0x7f48d813a440 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 --2- 172.21.15.5:0/2611606604 >> v2:172.21.15.157:3300/0 conn(0x7f48d80a7600 0x7f48d8139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 --2- 172.21.15.5:0/2611606604 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f48d80a6ce0 0x7f48d80a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 -- 172.21.15.5:0/2611606604 >> 172.21.15.5:0/2611606604 conn(0x7f48d80acbc0 msgr2=0x7f48d80a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 -- 172.21.15.5:0/2611606604 shutdown_connections 2024-08-18T21:03:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 -- 172.21.15.5:0/2611606604 wait complete. 2024-08-18T21:03:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 10 monclient: build_initial_monmap 2024-08-18T21:03:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 10 monclient: monmap: 2024-08-18T21:03:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:52.810 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 Processor -- start 2024-08-18T21:03:52.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 -- start start 2024-08-18T21:03:52.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 10 monclient: init 2024-08-18T21:03:52.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:52.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 10 monclient: _add_conns ranks=[6,3,1,4,2,0,8,5,7] 2024-08-18T21:03:52.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f48d80a6ce0 0x7f48d8134e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 10 monclient(hunting): picked mon.noname-d con 0x7f48d80a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:52.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48d80a7600 0x7f48d8135380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 10 monclient(hunting): picked mon.noname-g con 0x7f48d80a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:52.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d8139fe0 0x7f48d813aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 10 monclient(hunting): picked mon.noname-f con 0x7f48d8139fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:52.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f48d80a79e0 con 0x7f48d8139fe0 2024-08-18T21:03:52.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f48d80a8220 con 0x7f48d80a7600 2024-08-18T21:03:52.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f48d80abe00 con 0x7f48d80a6ce0 2024-08-18T21:03:52.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:52.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48dff04640 10 monclient(hunting): authenticate will time out at 999.814113s 2024-08-18T21:03:52.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f48d80a6ce0 0x7f48d8134e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f48d80a6ce0 0x7f48d8134e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:57218/0 (socket says 172.21.15.5:57218) 2024-08-18T21:03:52.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 1 -- 172.21.15.5:0/274913825 learned_addr learned my addr 172.21.15.5:0/274913825 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:52.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 10 monclient(hunting): get_auth_request con 0x7f48d80a6ce0 auth_method 0 2024-08-18T21:03:52.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 10 monclient(hunting): handle_auth_done global_id 4461 payload 824 2024-08-18T21:03:52.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 1 -- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48d80a7600 msgr2=0x7f48d8135380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 1 --2- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48d80a7600 0x7f48d8135380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 1 -- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d8139fe0 msgr2=0x7f48d813aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 1 --2- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d8139fe0 0x7f48d813aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 10 monclient: _finish_hunting 0 2024-08-18T21:03:52.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 1 monclient: found mon.noname-d 2024-08-18T21:03:52.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:52.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:03:52.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.797+0000 7f48ddca0640 1 -- 172.21.15.5:0/274913825 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d813db90 con 0x7f48d80a6ce0 2024-08-18T21:03:52.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ddca0640 1 -- 172.21.15.5:0/274913825 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f48d80a6ce0 msgr2=0x7f48d8134e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ddca0640 1 --2- 172.21.15.5:0/274913825 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f48d80a6ce0 0x7f48d8134e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009fd0 tx=0x7f48c800ee10 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ce7fc640 1 -- 172.21.15.5:0/274913825 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f48c8004030 con 0x7f48d80a6ce0 2024-08-18T21:03:52.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ce7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:03:52.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ce7fc640 10 monclient: dump: 2024-08-18T21:03:52.814 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.814 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.814 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.814 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.814 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.814 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.814 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.814 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.815 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.815 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.815 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.815 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.815 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.815 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.815 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.815 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ce7fc640 10 monclient: _finish_auth 0 2024-08-18T21:03:52.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ce7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:03:52.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:52.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ce7fc640 1 -- 172.21.15.5:0/274913825 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c80041d0 con 0x7f48d80a6ce0 2024-08-18T21:03:52.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ce7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:52.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ce7fc640 1 -- 172.21.15.5:0/274913825 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f48c8004380 con 0x7f48d80a6ce0 2024-08-18T21:03:52.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ce7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:03:52.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ce7fc640 10 monclient: dump: 2024-08-18T21:03:52.816 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.816 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.816 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.816 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.816 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.816 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.816 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.816 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.816 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.816 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.817 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.817 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.817 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.817 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.817 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.817 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48cffff640 4 set_mon_vals no callback set 2024-08-18T21:03:52.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dff04640 5 monclient: authenticate success, global_id 4461 2024-08-18T21:03:52.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dff04640 10 monclient: _renew_subs 2024-08-18T21:03:52.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dff04640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:52.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dff04640 1 -- 172.21.15.5:0/274913825 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d813de70 con 0x7f48d80a6ce0 2024-08-18T21:03:52.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dff04640 10 monclient: _renew_subs 2024-08-18T21:03:52.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dff04640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:03:52.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dff04640 1 -- 172.21.15.5:0/274913825 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d813ee10 con 0x7f48d80a6ce0 2024-08-18T21:03:52.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dff04640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:52.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dff04640 1 --2- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d813b740 0x7f48d802d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dff04640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dff04640 1 -- 172.21.15.5:0/274913825 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f48d80a7b60 con 0x7f48d813b740 2024-08-18T21:03:52.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ce7fc640 1 -- 172.21.15.5:0/274913825 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f48c800cb90 con 0x7f48d80a6ce0 2024-08-18T21:03:52.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dd49f640 1 --2- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d813b740 0x7f48d802d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ce7fc640 1 --2- 172.21.15.5:0/274913825 >> v2:172.21.15.157:6812/631023601 conn(0x7f48bc03bdc0 0x7f48bc03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48ce7fc640 1 -- 172.21.15.5:0/274913825 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(21..21 src has 1..21) ==== 3898+0+0 (secure 0 0 0) 0x7f48c800f040 con 0x7f48d80a6ce0 2024-08-18T21:03:52.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dd49f640 10 monclient: get_auth_request con 0x7f48d813b740 auth_method 0 2024-08-18T21:03:52.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dd49f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dd49f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dd49f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dd49f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dd49f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dd49f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48de4a1640 1 --2- 172.21.15.5:0/274913825 >> v2:172.21.15.157:6812/631023601 conn(0x7f48bc03bdc0 0x7f48bc03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48de4a1640 10 monclient: get_auth_request con 0x7f48bc03bdc0 auth_method 0 2024-08-18T21:03:52.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dd49f640 10 monclient(hunting): handle_auth_done global_id 4384 payload 824 2024-08-18T21:03:52.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.801+0000 7f48dd49f640 1 -- 172.21.15.5:0/274913825 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48d8139aa0 con 0x7f48d813b740 2024-08-18T21:03:52.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.805+0000 7f48de4a1640 1 --2- 172.21.15.5:0/274913825 >> v2:172.21.15.157:6812/631023601 conn(0x7f48bc03bdc0 0x7f48bc03e280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f48d80a9780 tx=0x7f48d0004ac0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.805+0000 7f48dd49f640 1 -- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d813b740 msgr2=0x7f48d802d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.805+0000 7f48dd49f640 1 --2- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d813b740 0x7f48d802d1d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f48d813c740 tx=0x7f48d400ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.805+0000 7f48ce7fc640 1 -- 172.21.15.5:0/274913825 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f48d4017070 con 0x7f48d813b740 2024-08-18T21:03:52.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.805+0000 7f48ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.805+0000 7f48ce7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:03:52.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.805+0000 7f48ce7fc640 10 monclient: dump: 2024-08-18T21:03:52.821 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.821 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.822 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.822 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.822 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.822 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.822 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.822 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.822 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.822 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.822 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.822 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.822 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.822 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.822 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.823 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.805+0000 7f48ce7fc640 1 -- 172.21.15.5:0/274913825 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f48d400ee50 con 0x7f48d813b740 2024-08-18T21:03:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.805+0000 7f48ce7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.805+0000 7f48ce7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.805+0000 7f48ce7fc640 1 -- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d813b740 msgr2=0x7f48d802d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.805+0000 7f48ce7fc640 1 --2- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d813b740 0x7f48d802d1d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f48d813c740 tx=0x7f48d400ec00 comp rx=0 tx=0).stop 2024-08-18T21:03:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.805+0000 7f48ce7fc640 1 -- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d813b740 msgr2=0x7f48d802d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.805+0000 7f48ce7fc640 1 --2- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d813b740 0x7f48d802d1d0 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f48d813c740 tx=0x7f48d400ec00 comp rx=0 tx=0).stop 2024-08-18T21:03:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.813+0000 7f48dff04640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:03:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.813+0000 7f48dff04640 1 --2- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d813bb20 0x7f48d802d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.813+0000 7f48dff04640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.813+0000 7f48dff04640 1 -- 172.21.15.5:0/274913825 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f48d8051140 con 0x7f48d813bb20 2024-08-18T21:03:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.813+0000 7f48dd49f640 1 --2- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d813bb20 0x7f48d802d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.813+0000 7f48dd49f640 10 monclient: get_auth_request con 0x7f48d813bb20 auth_method 0 2024-08-18T21:03:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.813+0000 7f48dd49f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.813+0000 7f48dd49f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.813+0000 7f48dd49f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.813+0000 7f48dd49f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.813+0000 7f48dd49f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.813+0000 7f48dd49f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.813+0000 7f48dd49f640 10 monclient(hunting): handle_auth_done global_id 4393 payload 824 2024-08-18T21:03:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.813+0000 7f48dd49f640 1 -- 172.21.15.5:0/274913825 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f48d809f140 con 0x7f48d813bb20 2024-08-18T21:03:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48dd49f640 1 -- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d813bb20 msgr2=0x7f48d802d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48dd49f640 1 --2- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d813bb20 0x7f48d802d710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f48d8069150 tx=0x7f48d40046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48ce7fc640 1 -- 172.21.15.5:0/274913825 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f48d4017070 con 0x7f48d813bb20 2024-08-18T21:03:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48ce7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:03:52.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48ce7fc640 10 monclient: dump: 2024-08-18T21:03:52.825 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.825 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.825 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.825 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.825 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.825 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.825 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.825 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.825 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.825 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.825 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.825 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.826 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.826 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.826 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.826 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48ce7fc640 1 -- 172.21.15.5:0/274913825 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f48d40062c0 con 0x7f48d813bb20 2024-08-18T21:03:52.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48ce7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:03:52.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48ce7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:52.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48ce7fc640 1 -- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d813bb20 msgr2=0x7f48d802d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48ce7fc640 1 --2- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d813bb20 0x7f48d802d710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f48d8069150 tx=0x7f48d40046d0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48ce7fc640 1 -- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d813bb20 msgr2=0x7f48d802d710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:52.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48ce7fc640 1 --2- 172.21.15.5:0/274913825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48d813bb20 0x7f48d802d710 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f48d8069150 tx=0x7f48d40046d0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.827 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:03:52.827 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:03:52.827 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:03:52.827 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:03:52.827 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 10, 2024-08-18T21:03:52.827 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 41895, 2024-08-18T21:03:52.827 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:03:52.827 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:03:52.827 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:03:52.827 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:03:52.827 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:03:52.827 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:03:52.827 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:03:52.828 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:03:52.828 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:03:52.828 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:03:52.828 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.828 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 35, 2024-08-18T21:03:52.828 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:52.828 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:03:52.828 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:03:52.828 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:52.828 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:52.828 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:52.828 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:52.828 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:52.829 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:52.829 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:52.829 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:52.829 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:52.829 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:52.829 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:52.829 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.829 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:03:52.829 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:03:52.829 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:52.829 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:52.829 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:52.829 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:52.830 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:52.830 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:52.830 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:52.830 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:52.830 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:52.830 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:52.830 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:52.830 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.830 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:03:52.830 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:03:52.830 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:03:52.830 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:03:52.831 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:03:52.831 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:03:52.831 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:52.831 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:52.831 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:03:52.831 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:03:52.831 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:03:52.831 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:03:52.831 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:03:52.831 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:03:52.831 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:03:52.831 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:52.831 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:03:52.831 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:52.832 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:52.833 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:52.833 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:52.833 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:52.834 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:52.834 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:52.834 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:52.834 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:52.834 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:52.834 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:52.834 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.834 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:03:52.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.834 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:03:52.834 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.834 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:03:52.834 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:03:52.835 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.835 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.835 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.835 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.835 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:03:52.835 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.835 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.835 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.835 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:03:52.835 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.835 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.835 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.836 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:03:52.836 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:03:52.836 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.836 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.836 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.836 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:03:52.836 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:03:52.836 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.836 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.837 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.837 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:03:52.837 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.837 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.837 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:03:52.837 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.837 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.837 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.837 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:03:52.837 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:03:52.837 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.837 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.838 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.838 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.838 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:03:52.838 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:03:52.838 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.838 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.838 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.838 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.838 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:03:52.838 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.838 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.839 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.839 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:03:52.839 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.839 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.839 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.839 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:03:52.839 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:03:52.839 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.839 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.839 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.839 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.839 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:03:52.840 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:03:52.840 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.840 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.840 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.840 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.840 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:03:52.840 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.840 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.840 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.840 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:03:52.840 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.840 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.840 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.841 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:03:52.841 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:03:52.841 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.841 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.841 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.841 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.841 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:03:52.841 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:03:52.841 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.841 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.841 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.841 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.842 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:03:52.842 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.842 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.842 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.842 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:03:52.842 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.842 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.842 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.842 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:03:52.842 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:03:52.842 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.842 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.843 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.843 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.843 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:03:52.843 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:03:52.843 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.843 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.843 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.843 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.843 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:03:52.843 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.843 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.843 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.844 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:03:52.844 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.844 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.844 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.844 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:03:52.844 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:03:52.844 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.844 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.844 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.844 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.844 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:03:52.844 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:03:52.845 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.845 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.845 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.845 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:03:52.845 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.845 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.845 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:03:52.845 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.845 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.846 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.846 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:03:52.846 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:03:52.846 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.846 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.846 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.846 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.846 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:03:52.846 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:03:52.846 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.846 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.847 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.847 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:03:52.847 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.847 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.847 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:03:52.847 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.847 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.847 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.847 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:03:52.847 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:03:52.848 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.848 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.848 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.848 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.848 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:03:52.848 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:03:52.848 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:52.848 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:52.848 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.848 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:52.848 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:03:52.848 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.849 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.849 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:52.849 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:03:52.849 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:52.849 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.849 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.849 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:03:52.849 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:03:52.849 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:52.849 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:52.849 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:52.849 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.850 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.850 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:03:52.850 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:03:52.850 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.850 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:52.850 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:52.850 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:03:52.850 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.850 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:52.851 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:03:52.851 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:52.851 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:52.851 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:52.851 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:03:52.851 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:52.851 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:52.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:52.851 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:03:52.852 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:03:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48dff04640 1 -- 172.21.15.5:0/274913825 >> v2:172.21.15.157:6812/631023601 conn(0x7f48bc03bdc0 msgr2=0x7f48bc03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48dff04640 1 --2- 172.21.15.5:0/274913825 >> v2:172.21.15.157:6812/631023601 conn(0x7f48bc03bdc0 0x7f48bc03e280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f48d80a9780 tx=0x7f48d0004ac0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48dff04640 10 monclient: shutdown 2024-08-18T21:03:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48dff04640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48dff04640 1 -- 172.21.15.5:0/274913825 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f48d80a6ce0 msgr2=0x7f48d8134e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48dff04640 1 --2- 172.21.15.5:0/274913825 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f48d80a6ce0 0x7f48d8134e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009fd0 tx=0x7f48c800ee10 comp rx=0 tx=0).stop 2024-08-18T21:03:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48de4a1640 1 -- 172.21.15.5:0/274913825 reap_dead start 2024-08-18T21:03:52.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48de4a1640 1 -- 172.21.15.5:0/274913825 reap_dead start 2024-08-18T21:03:52.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48dff04640 1 -- 172.21.15.5:0/274913825 shutdown_connections 2024-08-18T21:03:52.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48dff04640 1 -- 172.21.15.5:0/274913825 >> 172.21.15.5:0/274913825 conn(0x7f48d80acbc0 msgr2=0x7f48d8138490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:52.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48dff04640 1 -- 172.21.15.5:0/274913825 shutdown_connections 2024-08-18T21:03:52.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.817+0000 7f48dff04640 1 -- 172.21.15.5:0/274913825 wait complete. 2024-08-18T21:03:52.854 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:03:52.854 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:03:52.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:03:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 10 monclient: get_monmap_and_config 2024-08-18T21:03:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 10 monclient: build_initial_monmap 2024-08-18T21:03:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 10 monclient: monmap: 2024-08-18T21:03:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:52.977220+0000 2024-08-18T21:03:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:52.977220+0000 2024-08-18T21:03:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:52.976 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 1 Processor -- start 2024-08-18T21:03:52.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 1 -- start start 2024-08-18T21:03:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 10 monclient: init 2024-08-18T21:03:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 10 monclient: _add_conns ranks=[5,2,4,7,10,6,3,8,0,9,1] 2024-08-18T21:03:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f35780a6ce0 0x7f35780a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 10 monclient(hunting): picked mon.noname-h con 0x7f35780a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f35780a7600 0x7f3578139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 10 monclient(hunting): picked mon.noname-b con 0x7f35780a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3578139fe0 0x7f357813a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 10 monclient(hunting): picked mon.noname-c con 0x7f3578139fe0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f35780a5000 con 0x7f35780a7600 2024-08-18T21:03:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f35780a4360 con 0x7f3578139fe0 2024-08-18T21:03:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f35780a45d0 con 0x7f35780a6ce0 2024-08-18T21:03:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357f299640 10 monclient(hunting): authenticate will time out at 999.990423s 2024-08-18T21:03:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f35780a7600 0x7f3578139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357d836640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3578139fe0 0x7f357813a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f35780a7600 0x7f3578139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34326/0 (socket says 172.21.15.5:34326) 2024-08-18T21:03:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 1 -- 172.21.15.5:0/2089121371 learned_addr learned my addr 172.21.15.5:0/2089121371 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 10 monclient(hunting): get_auth_request con 0x7f35780a7600 auth_method 0 2024-08-18T21:03:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357d836640 10 monclient(hunting): get_auth_request con 0x7f3578139fe0 auth_method 0 2024-08-18T21:03:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357d836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357d836640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357d836640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357d836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357d836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357d836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 10 monclient(hunting): handle_auth_done global_id 4547 payload 274 2024-08-18T21:03:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 1 -- 172.21.15.5:0/2089121371 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f35780a6ce0 msgr2=0x7f35780a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 1 --2- 172.21.15.5:0/2089121371 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f35780a6ce0 0x7f35780a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 1 -- 172.21.15.5:0/2089121371 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3578139fe0 msgr2=0x7f357813a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 1 --2- 172.21.15.5:0/2089121371 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3578139fe0 0x7f357813a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 10 monclient: _finish_hunting 0 2024-08-18T21:03:52.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 1 monclient: found mon.noname-b 2024-08-18T21:03:52.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:52.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:52.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357c834640 1 -- 172.21.15.5:0/2089121371 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35780a32d0 con 0x7f35780a7600 2024-08-18T21:03:52.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.973+0000 7f357d836640 1 --2- 172.21.15.5:0/2089121371 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3578139fe0 0x7f357813a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:52.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f357c834640 1 -- 172.21.15.5:0/2089121371 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f35780a7600 msgr2=0x7f3578139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f357c834640 1 --2- 172.21.15.5:0/2089121371 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f35780a7600 0x7f3578139aa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3574009eb0 tx=0x7f357401c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c46a8d574d3c586 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f356ffff640 1 -- 172.21.15.5:0/2089121371 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f35740090d0 con 0x7f35780a7600 2024-08-18T21:03:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f356ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f356ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f356ffff640 10 monclient: dump: 2024-08-18T21:03:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.985 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.985 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.985 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.985 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.985 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.985 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.985 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f356ffff640 10 monclient: _finish_auth 0 2024-08-18T21:03:52.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f356ffff640 10 monclient: _check_auth_tickets 2024-08-18T21:03:52.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f356ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:52.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f356ffff640 1 -- 172.21.15.5:0/2089121371 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35740a5a30 con 0x7f35780a7600 2024-08-18T21:03:52.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f356ffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:52.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f356ffff640 1 -- 172.21.15.5:0/2089121371 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f35740a5be0 con 0x7f35780a7600 2024-08-18T21:03:52.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f357f299640 5 monclient: authenticate success, global_id 4547 2024-08-18T21:03:52.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f357f299640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:52.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f357f299640 4 set_mon_vals no callback set 2024-08-18T21:03:52.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f356ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f356ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:52.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.977+0000 7f356ffff640 10 monclient: dump: 2024-08-18T21:03:52.986 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.986 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.986 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.986 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.986 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.986 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.986 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.987 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.987 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.987 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.987 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.987 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.987 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.987 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.987 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.987 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 10 monclient: shutdown 2024-08-18T21:03:52.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:52.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 -- 172.21.15.5:0/2089121371 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f35780a7600 msgr2=0x7f3578139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 --2- 172.21.15.5:0/2089121371 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f35780a7600 0x7f3578139aa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3574009eb0 tx=0x7f357401c8f0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 -- 172.21.15.5:0/2089121371 shutdown_connections 2024-08-18T21:03:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 --2- 172.21.15.5:0/2089121371 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f35780a7600 0x7f3578139aa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 --2- 172.21.15.5:0/2089121371 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3578139fe0 0x7f357813a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 --2- 172.21.15.5:0/2089121371 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f35780a6ce0 0x7f35780a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 -- 172.21.15.5:0/2089121371 >> 172.21.15.5:0/2089121371 conn(0x7f35780acbc0 msgr2=0x7f35780a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 -- 172.21.15.5:0/2089121371 shutdown_connections 2024-08-18T21:03:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 -- 172.21.15.5:0/2089121371 wait complete. 2024-08-18T21:03:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 10 monclient: build_initial_monmap 2024-08-18T21:03:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 10 monclient: monmap: 2024-08-18T21:03:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:52.989 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 Processor -- start 2024-08-18T21:03:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 -- start start 2024-08-18T21:03:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 10 monclient: init 2024-08-18T21:03:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 10 monclient: _add_conns ranks=[8,3,0,5,2,6,1,7,4] 2024-08-18T21:03:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f35780a6ce0 0x7f3578134cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 10 monclient(hunting): picked mon.noname-e con 0x7f35780a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f35780a7600 0x7f35781351f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 10 monclient(hunting): picked mon.noname-g con 0x7f35780a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3578139fe0 0x7f357813aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 10 monclient(hunting): picked mon.noname-a con 0x7f3578139fe0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:03:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f35780a79e0 con 0x7f3578139fe0 2024-08-18T21:03:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f35780a8220 con 0x7f35780a7600 2024-08-18T21:03:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f357813f0e0 con 0x7f35780a6ce0 2024-08-18T21:03:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357f299640 10 monclient(hunting): authenticate will time out at 999.998904s 2024-08-18T21:03:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f35780a6ce0 0x7f3578134cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f35780a6ce0 0x7f3578134cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47594/0 (socket says 172.21.15.5:47594) 2024-08-18T21:03:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 1 -- 172.21.15.5:0/4268450458 learned_addr learned my addr 172.21.15.5:0/4268450458 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 10 monclient(hunting): get_auth_request con 0x7f35780a6ce0 auth_method 0 2024-08-18T21:03:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d836640 1 --2- 172.21.15.5:0/4268450458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3578139fe0 0x7f357813aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d836640 10 monclient(hunting): get_auth_request con 0x7f3578139fe0 auth_method 0 2024-08-18T21:03:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d836640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d836640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357c834640 1 --2- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f35780a7600 0x7f35781351f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 10 monclient(hunting): handle_auth_done global_id 4418 payload 824 2024-08-18T21:03:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 1 -- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f35780a7600 msgr2=0x7f35781351f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 1 --2- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f35780a7600 0x7f35781351f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 1 -- 172.21.15.5:0/4268450458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3578139fe0 msgr2=0x7f357813aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 1 --2- 172.21.15.5:0/4268450458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3578139fe0 0x7f357813aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 10 monclient: _finish_hunting 0 2024-08-18T21:03:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 1 monclient: found mon.noname-e 2024-08-18T21:03:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.981+0000 7f357d035640 1 -- 172.21.15.5:0/4268450458 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3578135b10 con 0x7f35780a6ce0 2024-08-18T21:03:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357d035640 1 -- 172.21.15.5:0/4268450458 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f35780a6ce0 msgr2=0x7f3578134cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357d035640 1 --2- 172.21.15.5:0/4268450458 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f35780a6ce0 0x7f3578134cb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f357000b580 tx=0x7f357000ba40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356dffb640 1 -- 172.21.15.5:0/4268450458 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3570014070 con 0x7f35780a6ce0 2024-08-18T21:03:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356dffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356dffb640 10 monclient: dump: 2024-08-18T21:03:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:52.999 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356dffb640 10 monclient: _finish_auth 0 2024-08-18T21:03:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356dffb640 10 monclient: _check_auth_tickets 2024-08-18T21:03:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357f299640 5 monclient: authenticate success, global_id 4418 2024-08-18T21:03:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356dffb640 1 -- 172.21.15.5:0/4268450458 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3570010cf0 con 0x7f35780a6ce0 2024-08-18T21:03:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357f299640 10 monclient: _renew_subs 2024-08-18T21:03:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357f299640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357f299640 1 -- 172.21.15.5:0/4268450458 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35780aa440 con 0x7f35780a6ce0 2024-08-18T21:03:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356dffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356dffb640 1 -- 172.21.15.5:0/4268450458 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f357000f830 con 0x7f35780a6ce0 2024-08-18T21:03:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356f7fe640 4 set_mon_vals no callback set 2024-08-18T21:03:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356dffb640 10 monclient: dump: 2024-08-18T21:03:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:53.002 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357f299640 10 monclient: _renew_subs 2024-08-18T21:03:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357f299640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:03:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357f299640 1 -- 172.21.15.5:0/4268450458 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f357813e700 con 0x7f35780a6ce0 2024-08-18T21:03:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357f299640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357f299640 1 --2- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357813cf00 0x7f357813aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357f299640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357f299640 1 -- 172.21.15.5:0/4268450458 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f35780a7b60 con 0x7f357813cf00 2024-08-18T21:03:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356dffb640 1 -- 172.21.15.5:0/4268450458 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f3570017070 con 0x7f35780a6ce0 2024-08-18T21:03:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357c834640 1 --2- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357813cf00 0x7f357813aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357c834640 10 monclient: get_auth_request con 0x7f357813cf00 auth_method 0 2024-08-18T21:03:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357c834640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:53.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357c834640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:53.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357c834640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:53.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356dffb640 1 --2- 172.21.15.5:0/4268450458 >> v2:172.21.15.157:6812/631023601 conn(0x7f356403bdc0 0x7f356403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f356dffb640 1 -- 172.21.15.5:0/4268450458 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(21..21 src has 1..21) ==== 3898+0+0 (secure 0 0 0) 0x7f357004e530 con 0x7f35780a6ce0 2024-08-18T21:03:53.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357c834640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:53.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357c834640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:53.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357c834640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:53.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357d836640 1 --2- 172.21.15.5:0/4268450458 >> v2:172.21.15.157:6812/631023601 conn(0x7f356403bdc0 0x7f356403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357d836640 10 monclient: get_auth_request con 0x7f356403bdc0 auth_method 0 2024-08-18T21:03:53.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357c834640 10 monclient(hunting): handle_auth_done global_id 4422 payload 824 2024-08-18T21:03:53.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.985+0000 7f357c834640 1 -- 172.21.15.5:0/4268450458 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3578139aa0 con 0x7f357813cf00 2024-08-18T21:03:53.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.989+0000 7f357c834640 1 -- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357813cf00 msgr2=0x7f357813aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:53.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.989+0000 7f357c834640 1 --2- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357813cf00 0x7f357813aff0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3574009e80 tx=0x7f3574019690 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:53.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.989+0000 7f357d836640 1 --2- 172.21.15.5:0/4268450458 >> v2:172.21.15.157:6812/631023601 conn(0x7f356403bdc0 0x7f356403e280 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f35780a81b0 tx=0x7f3568009190 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:53.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.989+0000 7f356dffb640 1 -- 172.21.15.5:0/4268450458 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f35740bb070 con 0x7f357813cf00 2024-08-18T21:03:53.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.989+0000 7f356dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:53.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.989+0000 7f356dffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:03:53.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.989+0000 7f356dffb640 10 monclient: dump: 2024-08-18T21:03:53.004 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:53.004 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.004 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.004 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.004 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:53.004 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.004 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:53.004 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:53.005 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.989+0000 7f356dffb640 1 -- 172.21.15.5:0/4268450458 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3574004460 con 0x7f357813cf00 2024-08-18T21:03:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.989+0000 7f356dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.989+0000 7f356dffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.989+0000 7f356dffb640 1 -- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357813cf00 msgr2=0x7f357813aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.989+0000 7f356dffb640 1 --2- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357813cf00 0x7f357813aff0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3574009e80 tx=0x7f3574019690 comp rx=0 tx=0).stop 2024-08-18T21:03:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.989+0000 7f356dffb640 1 -- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357813cf00 msgr2=0x7f357813aff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:53.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.989+0000 7f356dffb640 1 --2- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357813cf00 0x7f357813aff0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3574009e80 tx=0x7f3574019690 comp rx=0 tx=0).stop 2024-08-18T21:03:53.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.997+0000 7f357f299640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:03:53.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.997+0000 7f357f299640 1 --2- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357813b530 0x7f357813b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.997+0000 7f357f299640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:53.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.997+0000 7f357f299640 1 -- 172.21.15.5:0/4268450458 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3578051140 con 0x7f357813b530 2024-08-18T21:03:53.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.997+0000 7f357c834640 1 --2- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357813b530 0x7f357813b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.997+0000 7f357c834640 10 monclient: get_auth_request con 0x7f357813b530 auth_method 0 2024-08-18T21:03:53.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.997+0000 7f357c834640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:53.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.997+0000 7f357c834640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:53.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.997+0000 7f357c834640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:53.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.997+0000 7f357c834640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:53.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.997+0000 7f357c834640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:53.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.997+0000 7f357c834640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:53.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.997+0000 7f357c834640 10 monclient(hunting): handle_auth_done global_id 4431 payload 824 2024-08-18T21:03:53.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:52.997+0000 7f357c834640 1 -- 172.21.15.5:0/4268450458 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f357813be80 con 0x7f357813b530 2024-08-18T21:03:53.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f357c834640 1 -- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357813b530 msgr2=0x7f357813b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:53.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f357c834640 1 --2- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357813b530 0x7f357813b940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f35740af040 tx=0x7f35740a7000 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:53.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f356dffb640 1 -- 172.21.15.5:0/4268450458 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f35740c0ad0 con 0x7f357813b530 2024-08-18T21:03:53.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f356dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:53.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f356dffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:03:53.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f356dffb640 10 monclient: dump: 2024-08-18T21:03:53.009 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:53.009 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.009 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.009 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.009 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:53.009 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.009 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:53.009 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:53.009 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:53.009 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:53.009 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:53.009 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:53.009 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:53.010 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:53.010 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:53.010 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f356dffb640 1 -- 172.21.15.5:0/4268450458 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f35740b7420 con 0x7f357813b530 2024-08-18T21:03:53.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f356dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:03:53.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f356dffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:53.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f356dffb640 1 -- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357813b530 msgr2=0x7f357813b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f356dffb640 1 --2- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357813b530 0x7f357813b940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f35740af040 tx=0x7f35740a7000 comp rx=0 tx=0).stop 2024-08-18T21:03:53.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f356dffb640 1 -- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357813b530 msgr2=0x7f357813b940 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:53.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f356dffb640 1 --2- 172.21.15.5:0/4268450458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357813b530 0x7f357813b940 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f35740af040 tx=0x7f35740a7000 comp rx=0 tx=0).stop 2024-08-18T21:03:53.010 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:03:53.011 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:03:53.011 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:03:53.011 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:03:53.011 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 10, 2024-08-18T21:03:53.011 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 42099, 2024-08-18T21:03:53.011 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:03:53.011 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:03:53.011 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:03:53.011 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:03:53.011 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:03:53.011 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:03:53.011 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:03:53.012 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:03:53.012 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:03:53.012 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:03:53.012 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:53.012 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 35, 2024-08-18T21:03:53.012 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:53.012 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:03:53.012 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:03:53.012 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:53.012 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:53.012 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:53.012 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:53.012 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:53.014 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:53.014 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:53.014 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:53.014 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:53.014 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:53.014 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:53.014 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.014 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:03:53.014 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:03:53.014 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:03:53.014 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:03:53.015 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:03:53.015 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:03:53.015 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:53.015 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:53.015 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:03:53.015 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:03:53.015 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:03:53.015 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:03:53.015 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:03:53.015 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:03:53.015 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:03:53.015 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:53.015 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:03:53.015 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:53.015 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:03:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:03:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.017 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:03:53.017 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:03:53.017 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.017 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.017 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.017 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:03:53.017 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.017 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.017 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:03:53.017 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.017 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.018 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.018 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:03:53.018 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:03:53.018 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.018 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.018 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.018 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:03:53.018 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:03:53.018 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.018 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.019 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.019 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.019 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:03:53.019 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.019 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.019 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.019 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:03:53.019 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.019 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.019 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.019 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:03:53.019 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:03:53.020 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.020 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.020 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.020 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:03:53.020 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:03:53.020 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.020 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.020 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:03:53.020 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.021 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.021 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:03:53.021 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.021 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.021 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.021 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:03:53.021 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:03:53.021 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.021 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.021 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.022 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:03:53.022 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:03:53.022 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.022 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.022 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.022 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:03:53.022 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.022 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.023 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:03:53.023 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.023 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.023 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.023 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:03:53.023 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:03:53.023 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.023 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.023 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.023 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:03:53.023 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:03:53.024 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.024 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.024 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.024 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:03:53.024 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.024 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.024 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:03:53.024 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.024 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.024 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:03:53.025 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:03:53.025 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.025 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.025 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.025 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:03:53.025 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:03:53.025 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:03:53.025 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.026 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.026 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:03:53.026 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.026 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.026 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.026 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:03:53.026 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:03:53.026 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.026 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.026 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.027 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:03:53.027 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:03:53.027 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:03:53.027 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:03:53.028 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.028 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.028 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.028 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:03:53.028 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:03:53.028 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.028 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.028 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.029 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:03:53.029 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:03:53.029 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.029 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.029 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.029 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:03:53.029 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.029 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.029 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:03:53.029 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.029 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.030 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.030 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:03:53.030 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:03:53.030 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.030 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.030 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.030 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:03:53.030 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:03:53.030 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.030 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.031 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:03:53.031 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.031 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:03:53.031 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.031 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.031 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:03:53.031 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:03:53.032 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.032 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.032 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.032 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.032 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.032 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:03:53.032 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:03:53.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.032 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:53.032 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:53.032 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:03:53.032 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.032 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:53.033 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:03:53.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.033 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:53.033 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:53.033 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:03:53.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.033 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:53.033 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:03:53.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.033 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:53.033 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:53.033 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:03:53.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.033 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.034 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:03:53.034 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:03:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f357f299640 1 -- 172.21.15.5:0/4268450458 >> v2:172.21.15.157:6812/631023601 conn(0x7f356403bdc0 msgr2=0x7f356403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f357f299640 1 --2- 172.21.15.5:0/4268450458 >> v2:172.21.15.157:6812/631023601 conn(0x7f356403bdc0 0x7f356403e280 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f35780a81b0 tx=0x7f3568009190 comp rx=0 tx=0).stop 2024-08-18T21:03:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f357f299640 10 monclient: shutdown 2024-08-18T21:03:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f357f299640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f357f299640 1 -- 172.21.15.5:0/4268450458 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f35780a6ce0 msgr2=0x7f3578134cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f357f299640 1 --2- 172.21.15.5:0/4268450458 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f35780a6ce0 0x7f3578134cb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f357000b580 tx=0x7f357000ba40 comp rx=0 tx=0).stop 2024-08-18T21:03:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f357d836640 1 -- 172.21.15.5:0/4268450458 reap_dead start 2024-08-18T21:03:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f357d836640 1 -- 172.21.15.5:0/4268450458 reap_dead start 2024-08-18T21:03:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f357f299640 1 -- 172.21.15.5:0/4268450458 shutdown_connections 2024-08-18T21:03:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f357f299640 1 -- 172.21.15.5:0/4268450458 >> 172.21.15.5:0/4268450458 conn(0x7f35780acbc0 msgr2=0x7f3578135d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f357f299640 1 -- 172.21.15.5:0/4268450458 shutdown_connections 2024-08-18T21:03:53.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.001+0000 7f357f299640 1 -- 172.21.15.5:0/4268450458 wait complete. 2024-08-18T21:03:53.039 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:03:53.039 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:03:53.039 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:03:53.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 10 monclient: get_monmap_and_config 2024-08-18T21:03:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 10 monclient: build_initial_monmap 2024-08-18T21:03:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 10 monclient: monmap: 2024-08-18T21:03:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:53.165826+0000 2024-08-18T21:03:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:53.165826+0000 2024-08-18T21:03:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:53.165 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 1 Processor -- start 2024-08-18T21:03:53.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 1 -- start start 2024-08-18T21:03:53.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 10 monclient: init 2024-08-18T21:03:53.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:53.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 10 monclient: _add_conns ranks=[2,5,1,6,9,8,7,0,10,4,3] 2024-08-18T21:03:53.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f57180a6bd0 0x7f57180a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 10 monclient(hunting): picked mon.noname-b con 0x7f57180a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:03:53.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f571809f080 0x7f57180a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 10 monclient(hunting): picked mon.noname-h con 0x7f571809f080 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:03:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f5718139990 addr v1:172.21.15.157:6789/0 2024-08-18T21:03:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57180a7fb0 con 0x7f5718139990 2024-08-18T21:03:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f571809e4c0 con 0x7f57180a6bd0 2024-08-18T21:03:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f571806f930 con 0x7f571809f080 2024-08-18T21:03:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f5720296640 10 monclient(hunting): authenticate will time out at 1000.178959s 2024-08-18T21:03:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f57180a6bd0 0x7f57180a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f57180a6bd0 0x7f57180a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34336/0 (socket says 172.21.15.5:34336) 2024-08-18T21:03:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 1 -- 172.21.15.5:0/2542988863 learned_addr learned my addr 172.21.15.5:0/2542988863 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 10 monclient(hunting): get_auth_request con 0x7f57180a6bd0 auth_method 0 2024-08-18T21:03:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571d831640 1 --2- 172.21.15.5:0/2542988863 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f571809f080 0x7f57180a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571d831640 10 monclient(hunting): get_auth_request con 0x7f571809f080 auth_method 0 2024-08-18T21:03:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571d831640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571d831640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571d831640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571d831640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571d831640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571d831640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 10 monclient(hunting): handle_auth_done global_id 4556 payload 274 2024-08-18T21:03:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 1 -- 172.21.15.5:0/2542988863 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f571809f080 msgr2=0x7f57180a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 1 --2- 172.21.15.5:0/2542988863 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f571809f080 0x7f57180a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 1 -- 172.21.15.5:0/2542988863 >> v1:172.21.15.157:6789/0 conn(0x7f5718139990 legacy=0x7f5718139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 10 monclient: _finish_hunting 0 2024-08-18T21:03:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 1 monclient: found mon.noname-b 2024-08-18T21:03:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:03:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.161+0000 7f571e032640 1 -- 172.21.15.5:0/2542988863 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571809de70 con 0x7f57180a6bd0 2024-08-18T21:03:53.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f571e032640 1 -- 172.21.15.5:0/2542988863 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f57180a6bd0 msgr2=0x7f57180a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:53.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f571e032640 1 --2- 172.21.15.5:0/2542988863 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f57180a6bd0 0x7f57180a6fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f57140098a0 tx=0x7f571401c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=489527ebce8c5d9f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:53.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f571d030640 1 -- 172.21.15.5:0/2542988863 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f57140b0070 con 0x7f57180a6bd0 2024-08-18T21:03:53.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f571d030640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:53.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f571d030640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:03:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f571d030640 10 monclient: dump: 2024-08-18T21:03:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:53.173 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:53.173 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:53.173 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:53.173 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f571d030640 10 monclient: _finish_auth 0 2024-08-18T21:03:53.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f571d030640 10 monclient: _check_auth_tickets 2024-08-18T21:03:53.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f571d030640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:53.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f571d030640 1 -- 172.21.15.5:0/2542988863 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57140aa810 con 0x7f57180a6bd0 2024-08-18T21:03:53.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f571d030640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:53.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f571d030640 1 -- 172.21.15.5:0/2542988863 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f57140aae30 con 0x7f57180a6bd0 2024-08-18T21:03:53.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 5 monclient: authenticate success, global_id 4556 2024-08-18T21:03:53.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:53.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 4 set_mon_vals no callback set 2024-08-18T21:03:53.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f571d030640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f571d030640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:03:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f571d030640 10 monclient: dump: 2024-08-18T21:03:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:53.175 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 10 monclient: shutdown 2024-08-18T21:03:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 1 -- 172.21.15.5:0/2542988863 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f57180a6bd0 msgr2=0x7f57180a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 1 --2- 172.21.15.5:0/2542988863 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f57180a6bd0 0x7f57180a6fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f57140098a0 tx=0x7f571401c440 comp rx=0 tx=0).stop 2024-08-18T21:03:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 1 -- 172.21.15.5:0/2542988863 shutdown_connections 2024-08-18T21:03:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 1 --2- 172.21.15.5:0/2542988863 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f571809f080 0x7f57180a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 1 --2- 172.21.15.5:0/2542988863 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f57180a6bd0 0x7f57180a6fb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 1 -- 172.21.15.5:0/2542988863 >> 172.21.15.5:0/2542988863 conn(0x7f5718068700 msgr2=0x7f5718068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 1 -- 172.21.15.5:0/2542988863 shutdown_connections 2024-08-18T21:03:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 1 -- 172.21.15.5:0/2542988863 wait complete. 2024-08-18T21:03:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 10 monclient: build_initial_monmap 2024-08-18T21:03:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 10 monclient: monmap: 2024-08-18T21:03:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:53.182 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:53.182 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:53.182 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 1 Processor -- start 2024-08-18T21:03:53.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 1 -- start start 2024-08-18T21:03:53.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 10 monclient: init 2024-08-18T21:03:53.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:53.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 10 monclient: _add_conns ranks=[1,6,4,2,5,7,0,8,3] 2024-08-18T21:03:53.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f571809f080 0x7f571813ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 10 monclient(hunting): picked mon.noname-f con 0x7f571809f080 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:53.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.169+0000 7f5720296640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f57180a6bd0 0x7f5718138840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 10 monclient(hunting): picked mon.noname-d con 0x7f57180a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:53.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5718139990 0x7f571813da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 10 monclient(hunting): picked mon.noname-c con 0x7f5718139990 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f57181447a0 con 0x7f571809f080 2024-08-18T21:03:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f5718144620 con 0x7f5718139990 2024-08-18T21:03:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f5718144920 con 0x7f57180a6bd0 2024-08-18T21:03:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 10 monclient(hunting): authenticate will time out at 1000.188047s 2024-08-18T21:03:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571d831640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f57180a6bd0 0x7f5718138840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5718139990 0x7f571813da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571d831640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f57180a6bd0 0x7f5718138840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:57228/0 (socket says 172.21.15.5:57228) 2024-08-18T21:03:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571d831640 1 -- 172.21.15.5:0/1881751780 learned_addr learned my addr 172.21.15.5:0/1881751780 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571d831640 10 monclient(hunting): get_auth_request con 0x7f57180a6bd0 auth_method 0 2024-08-18T21:03:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571d831640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571d831640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571d831640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 10 monclient(hunting): get_auth_request con 0x7f5718139990 auth_method 0 2024-08-18T21:03:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571d831640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571d831640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571d831640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e032640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f571809f080 0x7f571813ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e032640 10 monclient(hunting): get_auth_request con 0x7f571809f080 auth_method 0 2024-08-18T21:03:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e032640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e032640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e032640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 10 monclient(hunting): handle_auth_done global_id 4504 payload 824 2024-08-18T21:03:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 1 -- 172.21.15.5:0/1881751780 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f57180a6bd0 msgr2=0x7f5718138840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f57180a6bd0 0x7f5718138840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 1 -- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f571809f080 msgr2=0x7f571813ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f571809f080 0x7f571813ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 10 monclient: _finish_hunting 0 2024-08-18T21:03:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 1 monclient: found mon.noname-c 2024-08-18T21:03:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 1 -- 172.21.15.5:0/1881751780 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5718122ef0 con 0x7f5718139990 2024-08-18T21:03:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571d831640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f57180a6bd0 0x7f5718138840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:03:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e032640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f571809f080 0x7f571813ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:03:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 1 -- 172.21.15.5:0/1881751780 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5718139990 msgr2=0x7f571813da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571e833640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5718139990 0x7f571813da50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f571000be30 tx=0x7f571000bf20 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f570effd640 1 -- 172.21.15.5:0/1881751780 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5710019070 con 0x7f5718139990 2024-08-18T21:03:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f570effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f570effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f570effd640 10 monclient: dump: 2024-08-18T21:03:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:53.187 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f570effd640 10 monclient: _finish_auth 0 2024-08-18T21:03:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f570effd640 10 monclient: _check_auth_tickets 2024-08-18T21:03:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f570effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f570effd640 1 -- 172.21.15.5:0/1881751780 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57100127b0 con 0x7f5718139990 2024-08-18T21:03:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 5 monclient: authenticate success, global_id 4504 2024-08-18T21:03:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 10 monclient: _renew_subs 2024-08-18T21:03:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 1 -- 172.21.15.5:0/1881751780 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57181231d0 con 0x7f5718139990 2024-08-18T21:03:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f570effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f570effd640 1 -- 172.21.15.5:0/1881751780 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5710012dd0 con 0x7f5718139990 2024-08-18T21:03:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f570effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f570effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f571c82f640 4 set_mon_vals no callback set 2024-08-18T21:03:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f570effd640 10 monclient: dump: 2024-08-18T21:03:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.188 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:53.189 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 10 monclient: _renew_subs 2024-08-18T21:03:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:53.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.173+0000 7f5720296640 1 -- 172.21.15.5:0/1881751780 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f571813f470 con 0x7f5718139990 2024-08-18T21:03:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f5720296640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f5720296640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5718122930 0x7f571813df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f5720296640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f5720296640 1 -- 172.21.15.5:0/1881751780 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f5718051140 con 0x7f5718122930 2024-08-18T21:03:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f570effd640 1 -- 172.21.15.5:0/1881751780 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f5710006d10 con 0x7f5718139990 2024-08-18T21:03:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f571e032640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5718122930 0x7f571813df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f571e032640 10 monclient: get_auth_request con 0x7f5718122930 auth_method 0 2024-08-18T21:03:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f571e032640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f571e032640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f571e032640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f570effd640 1 --2- 172.21.15.5:0/1881751780 >> v2:172.21.15.157:6812/631023601 conn(0x7f56fc03bdf0 0x7f56fc03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f571e032640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f571e032640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:53.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f571e032640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:53.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f570effd640 1 -- 172.21.15.5:0/1881751780 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(21..21 src has 1..21) ==== 3898+0+0 (secure 0 0 0) 0x7f571004e150 con 0x7f5718139990 2024-08-18T21:03:53.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f571d831640 1 --2- 172.21.15.5:0/1881751780 >> v2:172.21.15.157:6812/631023601 conn(0x7f56fc03bdf0 0x7f56fc03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f571e032640 10 monclient(hunting): handle_auth_done global_id 4442 payload 824 2024-08-18T21:03:53.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f571e032640 1 -- 172.21.15.5:0/1881751780 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5718139e10 con 0x7f5718122930 2024-08-18T21:03:53.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f571d831640 10 monclient: get_auth_request con 0x7f56fc03bdf0 auth_method 0 2024-08-18T21:03:53.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f571e032640 1 -- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5718122930 msgr2=0x7f571813df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:53.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f571e032640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5718122930 0x7f571813df90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f57140ab000 tx=0x7f57140191e0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:53.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f570effd640 1 -- 172.21.15.5:0/1881751780 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f57140b0070 con 0x7f5718122930 2024-08-18T21:03:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f570effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f570effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:03:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f570effd640 10 monclient: dump: 2024-08-18T21:03:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:53.195 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.177+0000 7f571d831640 1 --2- 172.21.15.5:0/1881751780 >> v2:172.21.15.157:6812/631023601 conn(0x7f56fc03bdf0 0x7f56fc03e2b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f571813fae0 tx=0x7f5708009190 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.181+0000 7f570effd640 1 -- 172.21.15.5:0/1881751780 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f57140b1040 con 0x7f5718122930 2024-08-18T21:03:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.181+0000 7f570effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.181+0000 7f570effd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.181+0000 7f570effd640 1 -- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5718122930 msgr2=0x7f571813df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.181+0000 7f570effd640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5718122930 0x7f571813df90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f57140ab000 tx=0x7f57140191e0 comp rx=0 tx=0).stop 2024-08-18T21:03:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.181+0000 7f570effd640 1 -- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5718122930 msgr2=0x7f571813df90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.181+0000 7f570effd640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5718122930 0x7f571813df90 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f57140ab000 tx=0x7f57140191e0 comp rx=0 tx=0).stop 2024-08-18T21:03:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.185+0000 7f5720296640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:03:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.185+0000 7f5720296640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f571813e4d0 0x7f57180a3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.185+0000 7f5720296640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.185+0000 7f5720296640 1 -- 172.21.15.5:0/1881751780 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f571813e8e0 con 0x7f571813e4d0 2024-08-18T21:03:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.185+0000 7f571e032640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f571813e4d0 0x7f57180a3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.185+0000 7f571e032640 10 monclient: get_auth_request con 0x7f571813e4d0 auth_method 0 2024-08-18T21:03:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.185+0000 7f571e032640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.185+0000 7f571e032640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.185+0000 7f571e032640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.185+0000 7f571e032640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.185+0000 7f571e032640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.185+0000 7f571e032640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.185+0000 7f571e032640 10 monclient(hunting): handle_auth_done global_id 4451 payload 824 2024-08-18T21:03:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.185+0000 7f571e032640 1 -- 172.21.15.5:0/1881751780 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f57181d25c0 con 0x7f571813e4d0 2024-08-18T21:03:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f571e032640 1 -- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f571813e4d0 msgr2=0x7f57180a3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f571e032640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f571813e4d0 0x7f57180a3fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f571401cce0 tx=0x7f57140a8000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f570effd640 1 -- 172.21.15.5:0/1881751780 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5714003e80 con 0x7f571813e4d0 2024-08-18T21:03:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f570effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f570effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:03:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f570effd640 10 monclient: dump: 2024-08-18T21:03:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:53.198 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f570effd640 1 -- 172.21.15.5:0/1881751780 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f5714003e80 con 0x7f571813e4d0 2024-08-18T21:03:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f570effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:03:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f570effd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f570effd640 1 -- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f571813e4d0 msgr2=0x7f57180a3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f570effd640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f571813e4d0 0x7f57180a3fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f571401cce0 tx=0x7f57140a8000 comp rx=0 tx=0).stop 2024-08-18T21:03:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f570effd640 1 -- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f571813e4d0 msgr2=0x7f57180a3fd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f570effd640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f571813e4d0 0x7f57180a3fd0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f571401cce0 tx=0x7f57140a8000 comp rx=0 tx=0).stop 2024-08-18T21:03:53.199 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:03:53.199 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:03:53.199 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:03:53.199 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:03:53.199 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 10, 2024-08-18T21:03:53.200 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 42271, 2024-08-18T21:03:53.200 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:03:53.200 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:03:53.200 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:03:53.200 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:03:53.200 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:03:53.200 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:03:53.200 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:03:53.200 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:03:53.200 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:03:53.200 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:03:53.200 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:53.200 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 36, 2024-08-18T21:03:53.200 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:53.201 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:03:53.201 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:03:53.201 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:53.201 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:53.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:53.201 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:53.201 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:53.201 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:53.201 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:53.201 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:53.201 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:53.201 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:53.201 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:53.201 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:53.201 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:03:53.202 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:03:53.202 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:53.202 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:53.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:53.202 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:53.202 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:53.202 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:53.202 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:53.202 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:53.202 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:53.202 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:53.202 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:53.202 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.203 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:03:53.203 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:03:53.203 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:03:53.203 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:03:53.203 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:03:53.203 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:03:53.203 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:53.203 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:53.203 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:03:53.203 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:03:53.203 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:03:53.203 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:03:53.203 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:03:53.203 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:03:53.204 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:03:53.204 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:53.204 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:03:53.204 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:53.204 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:53.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:53.204 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:53.204 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:53.204 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:53.204 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:53.204 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:53.204 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:53.204 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:53.204 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:53.204 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:53.205 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:03:53.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.205 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:03:53.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.205 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:03:53.205 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:03:53.205 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:03:53.205 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.206 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:03:53.206 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.206 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.206 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.206 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:03:53.206 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:03:53.206 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.206 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.206 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.206 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:03:53.207 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:03:53.207 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:03:53.207 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:03:53.207 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.207 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.207 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.208 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:03:53.208 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:03:53.208 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.208 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.208 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.208 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:03:53.208 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:03:53.208 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.208 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.208 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.209 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:03:53.209 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.209 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.209 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:03:53.209 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.209 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.209 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.209 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:03:53.209 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:03:53.209 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.209 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.209 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.210 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:03:53.210 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:03:53.210 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.210 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.210 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.210 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:03:53.210 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.210 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.210 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:03:53.210 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.211 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.211 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.211 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:03:53.211 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:03:53.211 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.211 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.211 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.211 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.211 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:03:53.211 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:03:53.211 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.211 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.211 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.212 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:03:53.212 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.212 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.212 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:03:53.212 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.212 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.212 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.212 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:03:53.212 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:03:53.213 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.213 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.213 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.213 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:03:53.213 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:03:53.213 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.213 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.213 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.213 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:03:53.213 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.214 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.214 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:03:53.214 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.214 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.214 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.214 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:03:53.214 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:03:53.214 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.214 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.214 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.214 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:03:53.214 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:03:53.215 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.215 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.215 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.215 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:03:53.215 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.215 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.215 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:03:53.215 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.215 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.215 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.215 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:03:53.216 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:03:53.216 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.216 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.216 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.216 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.216 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:03:53.216 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:03:53.216 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.216 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.216 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.216 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.216 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:03:53.216 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.216 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.217 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.217 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:03:53.217 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.217 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.217 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.217 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:03:53.217 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:03:53.217 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.217 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.217 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.217 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.217 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:03:53.217 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:03:53.218 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.218 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.218 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.218 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:03:53.218 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.218 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.218 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:03:53.218 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.218 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.218 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.219 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:03:53.219 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:03:53.219 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.219 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.219 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.219 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.219 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.219 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:03:53.219 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:03:53.219 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.219 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:53.219 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:53.219 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:03:53.219 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.220 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:53.220 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:03:53.220 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.220 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:53.220 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:53.220 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:03:53.220 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.220 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:53.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:03:53.220 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.220 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:53.220 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:53.220 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:03:53.220 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.220 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.221 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:03:53.221 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:03:53.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f5720296640 1 -- 172.21.15.5:0/1881751780 >> v2:172.21.15.157:6812/631023601 conn(0x7f56fc03bdf0 msgr2=0x7f56fc03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f5720296640 1 --2- 172.21.15.5:0/1881751780 >> v2:172.21.15.157:6812/631023601 conn(0x7f56fc03bdf0 0x7f56fc03e2b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f571813fae0 tx=0x7f5708009190 comp rx=0 tx=0).stop 2024-08-18T21:03:53.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f5720296640 10 monclient: shutdown 2024-08-18T21:03:53.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f5720296640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:53.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f5720296640 1 -- 172.21.15.5:0/1881751780 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5718139990 msgr2=0x7f571813da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f5720296640 1 --2- 172.21.15.5:0/1881751780 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5718139990 0x7f571813da50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f571000be30 tx=0x7f571000bf20 comp rx=0 tx=0).stop 2024-08-18T21:03:53.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f571e833640 1 -- 172.21.15.5:0/1881751780 reap_dead start 2024-08-18T21:03:53.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f571e833640 1 -- 172.21.15.5:0/1881751780 reap_dead start 2024-08-18T21:03:53.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f5720296640 1 -- 172.21.15.5:0/1881751780 shutdown_connections 2024-08-18T21:03:53.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f5720296640 1 -- 172.21.15.5:0/1881751780 >> 172.21.15.5:0/1881751780 conn(0x7f5718068700 msgr2=0x7f5718141690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:53.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.189+0000 7f5720296640 1 -- 172.21.15.5:0/1881751780 shutdown_connections 2024-08-18T21:03:53.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.193+0000 7f5720296640 1 -- 172.21.15.5:0/1881751780 wait complete. 2024-08-18T21:03:53.223 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:03:53.224 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:03:53.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:03:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.341+0000 7ff87510d640 10 monclient: get_monmap_and_config 2024-08-18T21:03:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.341+0000 7ff87510d640 10 monclient: build_initial_monmap 2024-08-18T21:03:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.341+0000 7ff87510d640 10 monclient: monmap: 2024-08-18T21:03:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:03:53.347667+0000 2024-08-18T21:03:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:03:53.347667+0000 2024-08-18T21:03:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:03:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:03:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:03:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:03:53.347 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 1 Processor -- start 2024-08-18T21:03:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 1 -- start start 2024-08-18T21:03:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 10 monclient: init 2024-08-18T21:03:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 10 monclient: _add_conns ranks=[8,3,0,10,2,5,6,7,1,4,9] 2024-08-18T21:03:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff8700a6bd0 0x7ff8700a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 10 monclient(hunting): picked mon.noname-e con 0x7ff8700a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:03:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff87009f080 0x7ff8700a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 10 monclient(hunting): picked mon.noname-g con 0x7ff87009f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:03:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff870139990 addr v1:172.21.15.5:6789/0 2024-08-18T21:03:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8700a7fb0 con 0x7ff870139990 2024-08-18T21:03:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff87009e4c0 con 0x7ff87009f080 2024-08-18T21:03:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff87006f930 con 0x7ff8700a6bd0 2024-08-18T21:03:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff87510d640 10 monclient(hunting): authenticate will time out at 1000.360919s 2024-08-18T21:03:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86f59e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff870139990 0x7ff870139e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57666/0 (socket says 172.21.15.5:57666) 2024-08-18T21:03:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86f59e640 1 -- 172.21.15.5:0/2612167616 learned_addr learned my addr 172.21.15.5:0/2612167616 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:03:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 1 --2- 172.21.15.5:0/2612167616 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff8700a6bd0 0x7ff8700a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 10 monclient(hunting): get_auth_request con 0x7ff8700a6bd0 auth_method 0 2024-08-18T21:03:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 10 monclient(hunting): handle_auth_done global_id 4427 payload 274 2024-08-18T21:03:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 1 -- 172.21.15.5:0/2612167616 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff87009f080 msgr2=0x7ff8700a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86e59c640 1 --2- 172.21.15.5:0/2612167616 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff87009f080 0x7ff8700a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 1 --2- 172.21.15.5:0/2612167616 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff87009f080 0x7ff8700a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 1 -- 172.21.15.5:0/2612167616 >> v1:172.21.15.5:6789/0 conn(0x7ff870139990 legacy=0x7ff870139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:03:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 10 monclient: _finish_hunting 0 2024-08-18T21:03:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 1 monclient: found mon.noname-e 2024-08-18T21:03:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:03:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86ed9d640 1 -- 172.21.15.5:0/2612167616 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87009de70 con 0x7ff8700a6bd0 2024-08-18T21:03:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86e59c640 10 monclient: get_auth_request con 0x7ff87009f080 auth_method 0 2024-08-18T21:03:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.345+0000 7ff86e59c640 1 --2- 172.21.15.5:0/2612167616 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff87009f080 0x7ff8700a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:03:53.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff86ed9d640 1 -- 172.21.15.5:0/2612167616 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff8700a6bd0 msgr2=0x7ff8700a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:53.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff86ed9d640 1 --2- 172.21.15.5:0/2612167616 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff8700a6bd0 0x7ff8700a6fb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff860009820 tx=0x7ff86001c380 comp rx=0 tx=0).ready entity=mon.8 client_cookie=1f4d606a24b4c00c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:53.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff86dd9b640 1 -- 172.21.15.5:0/2612167616 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff8600b0070 con 0x7ff8700a6bd0 2024-08-18T21:03:53.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff86dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:53.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff86dd9b640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:03:53.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff86dd9b640 10 monclient: dump: 2024-08-18T21:03:53.356 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:53.356 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.356 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.356 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.356 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:53.356 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.356 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:53.357 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff86dd9b640 10 monclient: _finish_auth 0 2024-08-18T21:03:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff86dd9b640 10 monclient: _check_auth_tickets 2024-08-18T21:03:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff86dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 5 monclient: authenticate success, global_id 4427 2024-08-18T21:03:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff86dd9b640 1 -- 172.21.15.5:0/2612167616 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8600aa810 con 0x7ff8700a6bd0 2024-08-18T21:03:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:03:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff86dd9b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 10 monclient: get_monmap_and_config success 2024-08-18T21:03:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 4 set_mon_vals no callback set 2024-08-18T21:03:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff86dd9b640 1 -- 172.21.15.5:0/2612167616 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff8600aae30 con 0x7ff8700a6bd0 2024-08-18T21:03:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff86dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff86dd9b640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:03:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff86dd9b640 10 monclient: dump: 2024-08-18T21:03:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:53.359 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 10 monclient: shutdown 2024-08-18T21:03:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 1 -- 172.21.15.5:0/2612167616 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff8700a6bd0 msgr2=0x7ff8700a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 1 --2- 172.21.15.5:0/2612167616 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff8700a6bd0 0x7ff8700a6fb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff860009820 tx=0x7ff86001c380 comp rx=0 tx=0).stop 2024-08-18T21:03:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 1 -- 172.21.15.5:0/2612167616 shutdown_connections 2024-08-18T21:03:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 1 --2- 172.21.15.5:0/2612167616 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff87009f080 0x7ff8700a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 1 --2- 172.21.15.5:0/2612167616 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff8700a6bd0 0x7ff8700a6fb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 1 -- 172.21.15.5:0/2612167616 >> 172.21.15.5:0/2612167616 conn(0x7ff870068700 msgr2=0x7ff870068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 1 -- 172.21.15.5:0/2612167616 shutdown_connections 2024-08-18T21:03:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 1 -- 172.21.15.5:0/2612167616 wait complete. 2024-08-18T21:03:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 10 monclient: build_initial_monmap 2024-08-18T21:03:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 10 monclient: monmap: 2024-08-18T21:03:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:03:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:03:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:03:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:03:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:03:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:03:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:03:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:03:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:03:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:03:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:03:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:03:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:03:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:03:53.361 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 1 Processor -- start 2024-08-18T21:03:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 1 -- start start 2024-08-18T21:03:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 10 monclient: init 2024-08-18T21:03:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 10 monclient: _reopen_session rank -1 2024-08-18T21:03:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 10 monclient: _add_conns ranks=[4,1,6,7,3,8,2,5,0] 2024-08-18T21:03:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff87009f080 0x7ff8701d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 10 monclient(hunting): picked mon.noname-c con 0x7ff87009f080 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:03:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff870139990 0x7ff87013fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 10 monclient(hunting): picked mon.noname-f con 0x7ff870139990 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:03:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff870140380 0x7ff87013ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 10 monclient(hunting): picked mon.noname-d con 0x7ff870140380 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:03:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff8701447a0 con 0x7ff870139990 2024-08-18T21:03:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff870144620 con 0x7ff87009f080 2024-08-18T21:03:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7ff870144920 con 0x7ff870140380 2024-08-18T21:03:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 10 monclient(hunting): _renew_subs 2024-08-18T21:03:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.349+0000 7ff87510d640 10 monclient(hunting): authenticate will time out at 1000.367974s 2024-08-18T21:03:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff87009f080 0x7ff8701d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff87009f080 0x7ff8701d18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:36934/0 (socket says 172.21.15.5:36934) 2024-08-18T21:03:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 1 -- 172.21.15.5:0/1773552153 learned_addr learned my addr 172.21.15.5:0/1773552153 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:03:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 10 monclient(hunting): get_auth_request con 0x7ff87009f080 auth_method 0 2024-08-18T21:03:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86f59e640 1 --2- 172.21.15.5:0/1773552153 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff870140380 0x7ff87013ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86f59e640 10 monclient(hunting): get_auth_request con 0x7ff870140380 auth_method 0 2024-08-18T21:03:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86f59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86f59e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86f59e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86f59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86f59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86f59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 10 monclient(hunting): handle_auth_done global_id 4513 payload 824 2024-08-18T21:03:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 1 -- 172.21.15.5:0/1773552153 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff870140380 msgr2=0x7ff87013ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 1 --2- 172.21.15.5:0/1773552153 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff870140380 0x7ff87013ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 1 -- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff870139990 msgr2=0x7ff87013fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 1 --2- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff870139990 0x7ff87013fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 10 monclient: _finish_hunting 0 2024-08-18T21:03:53.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 1 monclient: found mon.noname-c 2024-08-18T21:03:53.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:03:53.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:03:53.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 1 -- 172.21.15.5:0/1773552153 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff870140e00 con 0x7ff87009f080 2024-08-18T21:03:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 1 -- 172.21.15.5:0/1773552153 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff87009f080 msgr2=0x7ff8701d18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86ed9d640 1 --2- 172.21.15.5:0/1773552153 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff87009f080 0x7ff8701d18a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff86001c1b0 tx=0x7ff860019120 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff8577fe640 1 -- 172.21.15.5:0/1773552153 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff8600b0040 con 0x7ff87009f080 2024-08-18T21:03:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff8577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff8577fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:03:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff8577fe640 10 monclient: dump: 2024-08-18T21:03:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:53.369 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff8577fe640 10 monclient: _finish_auth 0 2024-08-18T21:03:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff8577fe640 10 monclient: _check_auth_tickets 2024-08-18T21:03:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff8577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:03:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff8577fe640 1 -- 172.21.15.5:0/1773552153 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8600b9070 con 0x7ff87009f080 2024-08-18T21:03:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff87510d640 5 monclient: authenticate success, global_id 4513 2024-08-18T21:03:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff87510d640 10 monclient: _renew_subs 2024-08-18T21:03:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff87510d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff87510d640 1 -- 172.21.15.5:0/1773552153 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff87013c5b0 con 0x7ff87009f080 2024-08-18T21:03:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff8577fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:03:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff8577fe640 1 -- 172.21.15.5:0/1773552153 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff8600044b0 con 0x7ff87009f080 2024-08-18T21:03:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff8577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff8577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:03:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff8577fe640 10 monclient: dump: 2024-08-18T21:03:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:53.371 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff86cd99640 4 set_mon_vals no callback set 2024-08-18T21:03:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff87510d640 10 monclient: _renew_subs 2024-08-18T21:03:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff87510d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:03:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff87510d640 1 -- 172.21.15.5:0/1773552153 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7ff87013e070 con 0x7ff87009f080 2024-08-18T21:03:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff87510d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff87510d640 1 --2- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff87013b0b0 0x7ff87013b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff87510d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff87510d640 1 -- 172.21.15.5:0/1773552153 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7ff870051140 con 0x7ff87013b0b0 2024-08-18T21:03:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.353+0000 7ff8577fe640 1 -- 172.21.15.5:0/1773552153 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7ff8600b3070 con 0x7ff87009f080 2024-08-18T21:03:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff8577fe640 1 --2- 172.21.15.5:0/1773552153 >> v2:172.21.15.157:6812/631023601 conn(0x7ff85c03bdc0 0x7ff85c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff8577fe640 1 -- 172.21.15.5:0/1773552153 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (secure 0 0 0) 0x7ff8600e8050 con 0x7ff87009f080 2024-08-18T21:03:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff86e59c640 1 --2- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff87013b0b0 0x7ff87013b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff86e59c640 10 monclient: get_auth_request con 0x7ff87013b0b0 auth_method 0 2024-08-18T21:03:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff86e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff86e59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff86e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff86f59e640 1 --2- 172.21.15.5:0/1773552153 >> v2:172.21.15.157:6812/631023601 conn(0x7ff85c03bdc0 0x7ff85c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff86e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff86e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff86e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff86f59e640 10 monclient: get_auth_request con 0x7ff85c03bdc0 auth_method 0 2024-08-18T21:03:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff86e59c640 10 monclient(hunting): handle_auth_done global_id 4444 payload 824 2024-08-18T21:03:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff86e59c640 1 -- 172.21.15.5:0/1773552153 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8700ab0e0 con 0x7ff87013b0b0 2024-08-18T21:03:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff86e59c640 1 -- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff87013b0b0 msgr2=0x7ff87013b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff86e59c640 1 --2- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff87013b0b0 0x7ff87013b490 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff87013cc20 tx=0x7ff86400cb80 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff86f59e640 1 --2- 172.21.15.5:0/1773552153 >> v2:172.21.15.157:6812/631023601 conn(0x7ff85c03bdc0 0x7ff85c03e280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff86800c490 tx=0x7ff868009b10 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.357+0000 7ff8577fe640 1 -- 172.21.15.5:0/1773552153 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff864015070 con 0x7ff87013b0b0 2024-08-18T21:03:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.361+0000 7ff8577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.361+0000 7ff8577fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.361+0000 7ff8577fe640 10 monclient: dump: 2024-08-18T21:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:53.375 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.361+0000 7ff8577fe640 1 -- 172.21.15.5:0/1773552153 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff8640078a0 con 0x7ff87013b0b0 2024-08-18T21:03:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.361+0000 7ff8577fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:03:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.361+0000 7ff8577fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:03:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.361+0000 7ff8577fe640 1 -- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff87013b0b0 msgr2=0x7ff87013b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.361+0000 7ff8577fe640 1 --2- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff87013b0b0 0x7ff87013b490 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff87013cc20 tx=0x7ff86400cb80 comp rx=0 tx=0).stop 2024-08-18T21:03:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.361+0000 7ff8577fe640 1 -- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff87013b0b0 msgr2=0x7ff87013b490 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.361+0000 7ff8577fe640 1 --2- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff87013b0b0 0x7ff87013b490 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff87013cc20 tx=0x7ff86400cb80 comp rx=0 tx=0).stop 2024-08-18T21:03:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.365+0000 7ff87510d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:03:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.365+0000 7ff87510d640 1 --2- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff8700a4250 0x7ff8700a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:03:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.365+0000 7ff87510d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:03:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.365+0000 7ff87510d640 1 -- 172.21.15.5:0/1773552153 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7ff87013b9d0 con 0x7ff8700a4250 2024-08-18T21:03:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.365+0000 7ff86e59c640 1 --2- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff8700a4250 0x7ff8700a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:03:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.365+0000 7ff86e59c640 10 monclient: get_auth_request con 0x7ff8700a4250 auth_method 0 2024-08-18T21:03:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.365+0000 7ff86e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:03:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.365+0000 7ff86e59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:03:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.365+0000 7ff86e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:03:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.365+0000 7ff86e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:03:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.365+0000 7ff86e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.365+0000 7ff86e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.369+0000 7ff86e59c640 10 monclient(hunting): handle_auth_done global_id 4453 payload 824 2024-08-18T21:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.369+0000 7ff86e59c640 1 -- 172.21.15.5:0/1773552153 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff870139e10 con 0x7ff8700a4250 2024-08-18T21:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.369+0000 7ff86e59c640 1 -- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff8700a4250 msgr2=0x7ff8700a4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.369+0000 7ff86e59c640 1 --2- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff8700a4250 0x7ff8700a4660 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff87013cc20 tx=0x7ff8640046d0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.369+0000 7ff8577fe640 1 -- 172.21.15.5:0/1773552153 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff864028020 con 0x7ff8700a4250 2024-08-18T21:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.369+0000 7ff8577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.369+0000 7ff8577fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.369+0000 7ff8577fe640 10 monclient: dump: 2024-08-18T21:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.369+0000 7ff8577fe640 1 -- 172.21.15.5:0/1773552153 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7ff8640113f0 con 0x7ff8700a4250 2024-08-18T21:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.369+0000 7ff8577fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:03:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.369+0000 7ff8577fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:03:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.369+0000 7ff8577fe640 1 -- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff8700a4250 msgr2=0x7ff8700a4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.369+0000 7ff8577fe640 1 --2- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff8700a4250 0x7ff8700a4660 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff87013cc20 tx=0x7ff8640046d0 comp rx=0 tx=0).stop 2024-08-18T21:03:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.373+0000 7ff8577fe640 1 -- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff8700a4250 msgr2=0x7ff8700a4660 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:03:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.373+0000 7ff8577fe640 1 --2- 172.21.15.5:0/1773552153 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff8700a4250 0x7ff8700a4660 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:03:53.380 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:03:53.380 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:03:53.380 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:03:53.380 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:03:53.380 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 10, 2024-08-18T21:03:53.381 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 42467, 2024-08-18T21:03:53.381 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:03:53.381 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:03:53.381 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:03:53.381 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:03:53.381 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:03:53.381 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:03:53.381 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:03:53.381 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:03:53.381 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:03:53.381 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:03:53.381 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:53.381 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 36, 2024-08-18T21:03:53.381 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:53.382 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:03:53.382 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:03:53.382 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:53.382 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:53.382 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:53.382 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:53.382 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:53.382 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:53.382 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:53.382 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:53.382 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:53.382 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:53.382 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:53.382 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:53.383 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:03:53.383 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:03:53.383 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:53.383 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:53.383 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:53.383 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:53.383 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:53.383 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:53.383 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:53.383 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:53.383 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:53.383 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:53.383 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:53.383 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.384 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:03:53.384 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:03:53.384 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:03:53.384 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:03:53.384 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:03:53.384 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:03:53.384 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:53.384 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:03:53.384 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:03:53.384 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:03:53.384 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:03:53.384 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:03:53.384 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:03:53.385 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:03:53.385 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:03:53.385 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:03:53.385 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:03:53.385 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:03:53.385 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:03:53.385 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:03:53.385 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:03:53.385 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:03:53.385 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:03:53.385 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:03:53.385 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:03:53.385 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:03:53.385 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:03:53.386 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:03:53.386 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:53.386 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:03:53.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.386 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:03:53.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.386 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:03:53.386 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:03:53.386 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.386 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.386 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.386 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:03:53.386 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.387 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.387 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:03:53.387 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.387 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.387 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:03:53.387 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:03:53.387 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.387 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.387 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.388 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:03:53.388 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:03:53.388 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:03:53.388 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:03:53.388 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.388 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.389 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:03:53.389 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:03:53.389 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.389 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.389 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.389 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:03:53.389 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:03:53.389 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.390 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.390 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:03:53.390 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.390 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.390 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:03:53.390 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.390 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.390 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.390 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:03:53.390 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:03:53.390 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.391 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.391 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.391 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:03:53.391 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:03:53.391 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:03:53.391 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.392 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:03:53.392 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.392 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.392 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.392 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:03:53.392 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:03:53.392 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.392 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.392 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.392 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:03:53.393 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:03:53.393 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:03:53.393 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:03:53.393 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.393 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.393 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.394 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:03:53.394 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:03:53.394 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.394 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.394 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.394 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:03:53.394 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:03:53.394 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.394 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.395 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.395 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:03:53.395 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.395 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.395 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:03:53.395 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.395 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.395 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.395 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:03:53.395 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:03:53.396 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.396 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.396 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.396 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:03:53.396 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:03:53.396 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.396 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.396 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.396 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:03:53.396 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.397 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.397 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.397 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:03:53.397 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.397 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.397 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.397 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:03:53.397 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:03:53.397 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.397 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.397 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.398 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:03:53.398 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:03:53.398 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.398 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.398 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:03:53.398 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.398 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:03:53.398 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.398 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.399 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.399 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:03:53.399 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:03:53.399 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.399 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.399 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.399 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:03:53.399 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:03:53.399 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:03:53.399 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:03:53.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.400 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:03:53.400 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:03:53.400 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.400 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.400 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:03:53.400 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:03:53.400 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:03:53.400 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.400 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.400 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:03:53.400 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:03:53.400 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:03:53.400 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:03:53.401 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:03:53.401 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.401 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.401 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:03:53.401 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:03:53.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.401 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:53.401 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:53.401 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:03:53.401 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.401 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:53.401 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:03:53.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.402 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:53.402 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:53.402 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:03:53.402 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.402 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:03:53.402 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:03:53.402 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:03:53.402 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:03:53.402 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:03:53.402 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:03:53.402 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:03:53.402 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:03:53.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:03:53.402 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:03:53.403 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.373+0000 7ff87510d640 1 -- 172.21.15.5:0/1773552153 >> v2:172.21.15.157:6812/631023601 conn(0x7ff85c03bdc0 msgr2=0x7ff85c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.373+0000 7ff87510d640 1 --2- 172.21.15.5:0/1773552153 >> v2:172.21.15.157:6812/631023601 conn(0x7ff85c03bdc0 0x7ff85c03e280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff86800c490 tx=0x7ff868009b10 comp rx=0 tx=0).stop 2024-08-18T21:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.373+0000 7ff87510d640 10 monclient: shutdown 2024-08-18T21:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.373+0000 7ff87510d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.373+0000 7ff87510d640 1 -- 172.21.15.5:0/1773552153 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff87009f080 msgr2=0x7ff8701d18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.373+0000 7ff87510d640 1 --2- 172.21.15.5:0/1773552153 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff87009f080 0x7ff8701d18a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff86001c1b0 tx=0x7ff860019120 comp rx=0 tx=0).stop 2024-08-18T21:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.373+0000 7ff86f59e640 1 -- 172.21.15.5:0/1773552153 reap_dead start 2024-08-18T21:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.373+0000 7ff86f59e640 1 -- 172.21.15.5:0/1773552153 reap_dead start 2024-08-18T21:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.373+0000 7ff87510d640 1 -- 172.21.15.5:0/1773552153 shutdown_connections 2024-08-18T21:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.373+0000 7ff87510d640 1 -- 172.21.15.5:0/1773552153 >> 172.21.15.5:0/1773552153 conn(0x7ff870068700 msgr2=0x7ff8700aba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.373+0000 7ff87510d640 1 -- 172.21.15.5:0/1773552153 shutdown_connections 2024-08-18T21:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:03:53.373+0000 7ff87510d640 1 -- 172.21.15.5:0/1773552153 wait complete. 2024-08-18T21:03:53.405 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:03:53.405 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['e', 'h'] 2024-08-18T21:03:53.405 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a', 'd', 'g'] 2024-08-18T21:03:53.405 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-08-18T21:03:53.405 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-08-18T21:03:53.405 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-08-18T21:03:53.405 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:03:53.416 INFO:tasks.ceph.mon.e:Stopped 2024-08-18T21:03:53.416 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.h 2024-08-18T21:03:53.416 INFO:tasks.mon_thrash.mon_thrasher:killing mon.h 2024-08-18T21:03:53.417 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2024-08-18T21:03:53.417 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:03:53.435 INFO:tasks.ceph.mon.h:Stopped 2024-08-18T21:03:53.435 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-18T21:03:53.436 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-18T21:03:53.436 INFO:tasks.mon_thrash:Sending STOP to mon d 2024-08-18T21:03:53.436 INFO:tasks.ceph.mon.d:Sent signal 19 2024-08-18T21:03:53.436 INFO:tasks.mon_thrash:Sending STOP to mon g 2024-08-18T21:03:53.436 INFO:tasks.ceph.mon.g:Sent signal 19 2024-08-18T21:03:53.436 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs to unfreeze mons 2024-08-18T21:03:53.630 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28002]: starting. 2024-08-18T21:03:53.630 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28002]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28001 2024-08-18T21:03:53.630 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28002]: created object 0... 2024-08-18T21:03:53.630 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28002]: created object 25... 2024-08-18T21:03:53.630 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28002]: created object 49... 2024-08-18T21:03:53.630 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28002]: finishing. 2024-08-18T21:03:53.631 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28002]: shutting down. 2024-08-18T21:04:13.437 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-18T21:04:13.439 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-18T21:04:13.439 INFO:tasks.mon_thrash:Sending CONT to mon d 2024-08-18T21:04:13.439 INFO:tasks.ceph.mon.d:Sent signal 18 2024-08-18T21:04:13.439 INFO:tasks.mon_thrash:Sending CONT to mon g 2024-08-18T21:04:13.439 INFO:tasks.ceph.mon.g:Sent signal 18 2024-08-18T21:04:13.439 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 7 2024-08-18T21:04:13.440 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:04:13.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 10 monclient: get_monmap_and_config 2024-08-18T21:04:13.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 10 monclient: build_initial_monmap 2024-08-18T21:04:13.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 10 monclient: monmap: 2024-08-18T21:04:13.576 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:04:13.576 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:13.576 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:04:13.577675+0000 2024-08-18T21:04:13.576 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:04:13.577675+0000 2024-08-18T21:04:13.576 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:04:13.576 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:13.576 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:04:13.576 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:04:13.576 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:04:13.576 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:04:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:04:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:04:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:04:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:04:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:04:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:04:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:04:13.577 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:13.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 1 Processor -- start 2024-08-18T21:04:13.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 1 -- start start 2024-08-18T21:04:13.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 10 monclient: init 2024-08-18T21:04:13.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:13.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 10 monclient: _add_conns ranks=[3,10,6,1,4,5,7,0,2,9,8] 2024-08-18T21:04:13.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 0x7f86e00a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:13.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 10 monclient(hunting): picked mon.noname-g con 0x7f86e00a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:04:13.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 0x7f86e0139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:13.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 10 monclient(hunting): picked mon.noname-f con 0x7f86e00a7600 addr v2:172.21.15.157:3300/0 2024-08-18T21:04:13.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 0x7f86e013a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:13.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 10 monclient(hunting): picked mon.noname-d con 0x7f86e0139fe0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:04:13.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:13.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f86e00a5000 con 0x7f86e00a7600 2024-08-18T21:04:13.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f86e00a4360 con 0x7f86e00a6ce0 2024-08-18T21:04:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f86e00a45d0 con 0x7f86e0139fe0 2024-08-18T21:04:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e7063640 10 monclient(hunting): authenticate will time out at 1020.590935s 2024-08-18T21:04:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e5600640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 0x7f86e013a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e5600640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 0x7f86e013a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:51366/0 (socket says 172.21.15.5:51366) 2024-08-18T21:04:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e5600640 1 -- 172.21.15.5:0/3255752332 learned_addr learned my addr 172.21.15.5:0/3255752332 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:04:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e5600640 10 monclient(hunting): get_auth_request con 0x7f86e0139fe0 auth_method 0 2024-08-18T21:04:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e5600640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e5600640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e5600640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e5600640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 msgr2=0x7f86e013a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:04:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e5600640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 msgr2=0x7f86e013a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e5600640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 0x7f86e013a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 0x7f86e0139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86dffff640 10 monclient(hunting): get_auth_request con 0x7f86e00a7600 auth_method 0 2024-08-18T21:04:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e5600640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 0x7f86e013a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:04:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86dffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86dffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 0x7f86e00a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86dffff640 1 -- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 msgr2=0x7f86e0139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:04:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86dffff640 1 -- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 msgr2=0x7f86e0139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 0x7f86e0139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e4dff640 10 monclient(hunting): get_auth_request con 0x7f86e00a6ce0 auth_method 0 2024-08-18T21:04:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e4dff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e4dff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e4dff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 0x7f86e0139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:04:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 msgr2=0x7f86e00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:04:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 msgr2=0x7f86e00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 0x7f86e00a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.573+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 0x7f86e00a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:04:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e5600640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 0x7f86e013a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e5600640 10 monclient(hunting): get_auth_request con 0x7f86e0139fe0 auth_method 0 2024-08-18T21:04:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e5600640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e5600640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e5600640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e5600640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 msgr2=0x7f86e013a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:04:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e5600640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 msgr2=0x7f86e013a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e5600640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 0x7f86e013a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 0x7f86e0139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e5600640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 0x7f86e013a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:04:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 0x7f86e00a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86dffff640 10 monclient(hunting): get_auth_request con 0x7f86e00a7600 auth_method 0 2024-08-18T21:04:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86dffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86dffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e4dff640 10 monclient(hunting): get_auth_request con 0x7f86e00a6ce0 auth_method 0 2024-08-18T21:04:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e4dff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e4dff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e4dff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 msgr2=0x7f86e00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:04:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 msgr2=0x7f86e00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86dffff640 1 -- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 msgr2=0x7f86e0139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:04:13.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86dffff640 1 -- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 msgr2=0x7f86e0139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:13.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 0x7f86e00a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:13.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 0x7f86e0139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:13.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 0x7f86e00a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:04:13.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:13.777+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 0x7f86e0139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:04:14.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e5600640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 0x7f86e013a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:14.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e5600640 10 monclient(hunting): get_auth_request con 0x7f86e0139fe0 auth_method 0 2024-08-18T21:04:14.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e5600640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:14.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e5600640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:14.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e5600640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:14.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e5600640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 msgr2=0x7f86e013a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:04:14.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e5600640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 msgr2=0x7f86e013a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:14.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e5600640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 0x7f86e013a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:14.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e5600640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 0x7f86e013a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:04:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 0x7f86e00a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 0x7f86e0139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86dffff640 10 monclient(hunting): get_auth_request con 0x7f86e00a7600 auth_method 0 2024-08-18T21:04:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86dffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86dffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e4dff640 10 monclient(hunting): get_auth_request con 0x7f86e00a6ce0 auth_method 0 2024-08-18T21:04:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e4dff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e4dff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e4dff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86dffff640 1 -- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 msgr2=0x7f86e0139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:04:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86dffff640 1 -- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 msgr2=0x7f86e0139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 0x7f86e0139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 msgr2=0x7f86e00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:04:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 msgr2=0x7f86e00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:14.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 0x7f86e00a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:14.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 0x7f86e0139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:04:14.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.181+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 0x7f86e00a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:04:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e5600640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 0x7f86e013a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e5600640 10 monclient(hunting): get_auth_request con 0x7f86e0139fe0 auth_method 0 2024-08-18T21:04:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e5600640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e5600640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e5600640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e5600640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 msgr2=0x7f86e013a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:04:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e5600640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 msgr2=0x7f86e013a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e5600640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 0x7f86e013a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e5600640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 0x7f86e013a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:04:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 0x7f86e0139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 0x7f86e00a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86dffff640 10 monclient(hunting): get_auth_request con 0x7f86e00a7600 auth_method 0 2024-08-18T21:04:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86dffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86dffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e4dff640 10 monclient(hunting): get_auth_request con 0x7f86e00a6ce0 auth_method 0 2024-08-18T21:04:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e4dff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e4dff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e4dff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86dffff640 1 -- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 msgr2=0x7f86e0139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:04:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86dffff640 1 -- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 msgr2=0x7f86e0139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 0x7f86e0139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 0x7f86e0139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:04:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 msgr2=0x7f86e00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:04:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 msgr2=0x7f86e00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 0x7f86e00a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:14.985+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 0x7f86e00a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:04:16.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 10 monclient(hunting): tick 2024-08-18T21:04:16.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:04:16.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 1 monclient(hunting): continuing hunt 2024-08-18T21:04:16.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:04:16.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 msgr2=0x7f86e013a440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:04:16.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86e0139fe0 0x7f86e013a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:16.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 msgr2=0x7f86e00a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:04:16.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86e00a6ce0 0x7f86e00a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:16.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 1 -- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 msgr2=0x7f86e0139aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:04:16.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 1 --2- 172.21.15.5:0/3255752332 >> v2:172.21.15.157:3300/0 conn(0x7f86e00a7600 0x7f86e0139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:16.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 10 monclient: _add_conns ranks=[4,2,0,5,8,1,9,7] 2024-08-18T21:04:16.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 0x7f86cc005c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:16.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 10 monclient(hunting): picked mon.noname-c con 0x7f86cc003810 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:04:16.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 0x7f86cc0086d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:16.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 10 monclient(hunting): picked mon.noname-b con 0x7f86cc006240 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:04:16.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f86cc008da0 addr v1:172.21.15.5:6789/0 2024-08-18T21:04:16.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 1 -- 172.21.15.5:0/3255752332 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86e00a32d0 con 0x7f86cc008da0 2024-08-18T21:04:16.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:16.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 1 -- 172.21.15.5:0/3255752332 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f86e00a4360 con 0x7f86cc006240 2024-08-18T21:04:16.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:16.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 1 -- 172.21.15.5:0/3255752332 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f86e00a45d0 con 0x7f86cc003810 2024-08-18T21:04:16.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86de7fc640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:16.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 0x7f86cc0086d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:16.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 0x7f86cc005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86dffff640 10 monclient(hunting): get_auth_request con 0x7f86cc006240 auth_method 0 2024-08-18T21:04:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86dffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86dffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86e4dff640 10 monclient(hunting): get_auth_request con 0x7f86cc003810 auth_method 0 2024-08-18T21:04:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86e4dff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86e4dff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86e4dff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86dffff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 msgr2=0x7f86cc0086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:04:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86dffff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 msgr2=0x7f86cc0086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 0x7f86cc0086d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 msgr2=0x7f86cc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:04:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 msgr2=0x7f86cc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 0x7f86cc005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:16.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 0x7f86cc005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:04:16.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 0x7f86cc0086d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:04:16.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.577+0000 7f86e5600640 1 -- 172.21.15.5:0/3255752332 >> v1:172.21.15.5:6789/0 conn(0x7f86cc008da0 legacy=0x7f86cc00b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 0x7f86cc0086d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 0x7f86cc005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86dffff640 10 monclient(hunting): get_auth_request con 0x7f86cc006240 auth_method 0 2024-08-18T21:04:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86dffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86dffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86e4dff640 10 monclient(hunting): get_auth_request con 0x7f86cc003810 auth_method 0 2024-08-18T21:04:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86e4dff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86e4dff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86e4dff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86dffff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 msgr2=0x7f86cc0086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:04:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86dffff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 msgr2=0x7f86cc0086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 0x7f86cc0086d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 msgr2=0x7f86cc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:04:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 msgr2=0x7f86cc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 0x7f86cc005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 0x7f86cc0086d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:04:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:16.781+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 0x7f86cc005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:04:17.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 0x7f86cc0086d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:17.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 0x7f86cc005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:17.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86dffff640 10 monclient(hunting): get_auth_request con 0x7f86cc006240 auth_method 0 2024-08-18T21:04:17.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:17.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86dffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:17.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86dffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:17.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86e4dff640 10 monclient(hunting): get_auth_request con 0x7f86cc003810 auth_method 0 2024-08-18T21:04:17.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86e4dff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:17.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86e4dff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:17.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86e4dff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:17.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86dffff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 msgr2=0x7f86cc0086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:04:17.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86dffff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 msgr2=0x7f86cc0086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:17.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 0x7f86cc0086d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:17.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 msgr2=0x7f86cc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:04:17.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 msgr2=0x7f86cc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:17.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 0x7f86cc005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:17.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 0x7f86cc0086d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:04:17.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.185+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 0x7f86cc005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:04:17.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 0x7f86cc0086d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:17.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 0x7f86cc005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86dffff640 10 monclient(hunting): get_auth_request con 0x7f86cc006240 auth_method 0 2024-08-18T21:04:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86dffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86dffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86e4dff640 10 monclient(hunting): get_auth_request con 0x7f86cc003810 auth_method 0 2024-08-18T21:04:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86e4dff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86e4dff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86e4dff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 msgr2=0x7f86cc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:04:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86dffff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 msgr2=0x7f86cc0086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:04:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 msgr2=0x7f86cc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86dffff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 msgr2=0x7f86cc0086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:04:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 0x7f86cc005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:17.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 0x7f86cc0086d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:17.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 0x7f86cc005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:04:17.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:17.989+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 0x7f86cc0086d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:04:18.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.517+0000 7f86df7fe640 1 -- 172.21.15.5:0/3255752332 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067714538 0 0) 0x7f86e00a32d0 con 0x7f86cc008da0 2024-08-18T21:04:18.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.517+0000 7f86df7fe640 10 monclient(hunting): _negotiate 2024-08-18T21:04:18.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.517+0000 7f86df7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:18.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.517+0000 7f86df7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:18.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.517+0000 7f86df7fe640 10 monclient(hunting): my global_id is 4518 2024-08-18T21:04:18.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.517+0000 7f86df7fe640 1 -- 172.21.15.5:0/3255752332 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86c0003530 con 0x7f86cc008da0 2024-08-18T21:04:18.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 1 -- 172.21.15.5:0/3255752332 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3202008651 0 0) 0x7f86c0003530 con 0x7f86cc008da0 2024-08-18T21:04:18.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 msgr2=0x7f86cc005c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:04:18.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86cc003810 0x7f86cc005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 msgr2=0x7f86cc0086d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:04:18.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86cc006240 0x7f86cc0086d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:04:18.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 1 monclient: found mon.noname-a-legacy 2024-08-18T21:04:18.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:18.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.5:6789/0 2024-08-18T21:04:18.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 1 -- 172.21.15.5:0/3255752332 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86cc00dc80 con 0x7f86cc008da0 2024-08-18T21:04:18.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient: _finish_auth 0 2024-08-18T21:04:18.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:04:18.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:18.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e7063640 5 monclient: authenticate success, global_id 4518 2024-08-18T21:04:18.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e7063640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:04:18.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e5600640 1 -- 172.21.15.5:0/3255752332 reap_dead start 2024-08-18T21:04:18.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 1 -- 172.21.15.5:0/3255752332 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 4141550541 0 0) 0x7f86d0009d30 con 0x7f86cc008da0 2024-08-18T21:04:18.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:18.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-08-18T21:04:18.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient: dump: 2024-08-18T21:04:18.530 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:18.530 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:18.530 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.530 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.530 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:18.530 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:18.530 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:18.531 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:18.531 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:18.531 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:18.531 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:18.531 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:18.531 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:18.531 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:18.531 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:18.531 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:18.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] but i'm connected to v1:172.21.15.5:6789/0, reconnecting 2024-08-18T21:04:18.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:18.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 1 -- 172.21.15.5:0/3255752332 >> v1:172.21.15.5:6789/0 conn(0x7f86cc008da0 legacy=0x7f86cc00b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:18.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient: _add_conns ranks=[1,6,4,3,5,8,7,2,0] 2024-08-18T21:04:18.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c0004210 0x7f86c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:18.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient(hunting): picked mon.f con 0x7f86c0004210 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:04:18.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86c0004e20 0x7f86c00052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:18.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient(hunting): picked mon.d con 0x7f86c0004e20 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:04:18.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86c0009c00 0x7f86c000c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:18.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient(hunting): picked mon.c con 0x7f86c0009c00 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:04:18.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:18.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 1 -- 172.21.15.5:0/3255752332 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f86e00a4360 con 0x7f86c0004210 2024-08-18T21:04:18.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:18.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 1 -- 172.21.15.5:0/3255752332 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f86e00a45d0 con 0x7f86c0009c00 2024-08-18T21:04:18.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:18.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 1 -- 172.21.15.5:0/3255752332 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f86c000c9a0 con 0x7f86c0004e20 2024-08-18T21:04:18.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:18.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86df7fe640 10 monclient(hunting): _finish_auth 0 2024-08-18T21:04:18.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e7063640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2024-08-18T21:04:18.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e5600640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86c0009c00 0x7f86c000c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:18.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e5600640 10 monclient(hunting): get_auth_request con 0x7f86c0009c00 auth_method 0 2024-08-18T21:04:18.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e5600640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:18.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e5600640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:18.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e5600640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:18.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c0004210 0x7f86c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:18.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 10 monclient(hunting): get_auth_request con 0x7f86c0004210 auth_method 0 2024-08-18T21:04:18.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:18.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:18.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:18.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e5600640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:18.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e5600640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:18.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e5600640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:04:18.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:18.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:18.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:04:18.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86dffff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86c0004e20 0x7f86c00052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:18.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86dffff640 10 monclient(hunting): get_auth_request con 0x7f86c0004e20 auth_method 0 2024-08-18T21:04:18.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:18.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86dffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:18.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86dffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:18.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86dffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:18.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86dffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:18.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86dffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:04:18.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 10 monclient(hunting): handle_auth_done global_id 4518 payload 293 2024-08-18T21:04:18.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86c0004e20 msgr2=0x7f86c00052a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:04:18.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86c0004e20 0x7f86c00052a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86c0009c00 msgr2=0x7f86c000c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:04:18.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86c0009c00 0x7f86c000c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 10 monclient: _finish_hunting 0 2024-08-18T21:04:18.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 1 monclient: found mon.f 2024-08-18T21:04:18.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:18.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:04:18.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c0003530 con 0x7f86c0004210 2024-08-18T21:04:18.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 10 monclient: _finish_auth 0 2024-08-18T21:04:18.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 10 monclient: _check_auth_tickets 2024-08-18T21:04:18.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.525+0000 7f86e4dff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:18.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86e4dff640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c0004210 msgr2=0x7f86c0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:18.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86e4dff640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c0004210 0x7f86c0004810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86d8019b00 tx=0x7f86d801dd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74f34dff4f400a90 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86df7fe640 1 -- 172.21.15.5:0/3255752332 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86d800f040 con 0x7f86c0004210 2024-08-18T21:04:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86df7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:04:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86df7fe640 10 monclient: dump: 2024-08-18T21:04:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:18.542 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86df7fe640 1 -- 172.21.15.5:0/3255752332 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d80a6850 con 0x7f86c0004210 2024-08-18T21:04:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86e7063640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:04:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86df7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86e7063640 10 monclient: get_monmap_and_config success 2024-08-18T21:04:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86e7063640 4 set_mon_vals no callback set 2024-08-18T21:04:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86df7fe640 1 -- 172.21.15.5:0/3255752332 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86d8018440 con 0x7f86c0004210 2024-08-18T21:04:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86df7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:04:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86df7fe640 10 monclient: dump: 2024-08-18T21:04:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:18.544 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:18.544 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:18.544 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:18.544 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:18.544 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:18.544 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:18.544 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:18.544 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:18.544 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:18.544 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86e7063640 10 monclient: shutdown 2024-08-18T21:04:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86e7063640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:04:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86e7063640 1 -- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c0004210 msgr2=0x7f86c0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86e7063640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c0004210 0x7f86c0004810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86d8019b00 tx=0x7f86d801dd50 comp rx=0 tx=0).stop 2024-08-18T21:04:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86e7063640 1 -- 172.21.15.5:0/3255752332 shutdown_connections 2024-08-18T21:04:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86e7063640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f86c0004e20 0x7f86c00052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86e7063640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c0004210 0x7f86c0004810 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86e7063640 1 --2- 172.21.15.5:0/3255752332 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86c0009c00 0x7f86c000c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86e7063640 1 -- 172.21.15.5:0/3255752332 >> 172.21.15.5:0/3255752332 conn(0x7f86e00acbc0 msgr2=0x7f86e00a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:04:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86e7063640 1 -- 172.21.15.5:0/3255752332 shutdown_connections 2024-08-18T21:04:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.537+0000 7f86e7063640 1 -- 172.21.15.5:0/3255752332 wait complete. 2024-08-18T21:04:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 10 monclient: build_initial_monmap 2024-08-18T21:04:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 10 monclient: monmap: 2024-08-18T21:04:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:04:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:04:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:04:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:04:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:04:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:04:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:04:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:04:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:04:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:04:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:04:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:04:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:04:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:04:18.553 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 1 Processor -- start 2024-08-18T21:04:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 1 -- start start 2024-08-18T21:04:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 10 monclient: init 2024-08-18T21:04:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 10 monclient: _add_conns ranks=[2,3,4,8,7,0,6,5,1] 2024-08-18T21:04:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86c0004210 0x7f86e00a0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 10 monclient(hunting): picked mon.noname-b con 0x7f86c0004210 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:04:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86c0004e20 0x7f86e0137c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 10 monclient(hunting): picked mon.noname-g con 0x7f86c0004e20 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:04:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86c0009c00 0x7f86e0138180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:18.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 10 monclient(hunting): picked mon.noname-c con 0x7f86c0009c00 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:04:18.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:18.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f86e00a79e0 con 0x7f86c0004210 2024-08-18T21:04:18.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:18.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f86e00a8220 con 0x7f86c0004e20 2024-08-18T21:04:18.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:18.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f86e00a8e50 con 0x7f86c0009c00 2024-08-18T21:04:18.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:18.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e7063640 10 monclient(hunting): authenticate will time out at 1025.558855s 2024-08-18T21:04:18.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86c0004210 0x7f86e00a0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:18.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86c0004210 0x7f86e00a0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:44430/0 (socket says 172.21.15.5:44430) 2024-08-18T21:04:18.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e5600640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86c0009c00 0x7f86e0138180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:18.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 1 -- 172.21.15.5:0/637545263 learned_addr learned my addr 172.21.15.5:0/637545263 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:04:18.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 10 monclient(hunting): get_auth_request con 0x7f86c0004210 auth_method 0 2024-08-18T21:04:18.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:18.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:18.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:18.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e5600640 10 monclient(hunting): get_auth_request con 0x7f86c0009c00 auth_method 0 2024-08-18T21:04:18.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e5600640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:18.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e5600640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:18.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e5600640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:18.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:18.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:18.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86dffff640 1 --2- 172.21.15.5:0/637545263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86c0004e20 0x7f86e0137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e5600640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e5600640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e5600640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86dffff640 10 monclient(hunting): get_auth_request con 0x7f86c0004e20 auth_method 0 2024-08-18T21:04:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86dffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86dffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 10 monclient(hunting): handle_auth_done global_id 4565 payload 824 2024-08-18T21:04:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 1 -- 172.21.15.5:0/637545263 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86c0009c00 msgr2=0x7f86e0138180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 1 --2- 172.21.15.5:0/637545263 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86c0009c00 0x7f86e0138180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 1 -- 172.21.15.5:0/637545263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86c0004e20 msgr2=0x7f86e0137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 1 --2- 172.21.15.5:0/637545263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86c0004e20 0x7f86e0137c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 10 monclient: _finish_hunting 0 2024-08-18T21:04:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 1 monclient: found mon.noname-b 2024-08-18T21:04:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:04:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86e4dff640 1 -- 172.21.15.5:0/637545263 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e00a19a0 con 0x7f86c0004210 2024-08-18T21:04:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.541+0000 7f86dffff640 1 --2- 172.21.15.5:0/637545263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86c0004e20 0x7f86e0137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:04:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86e4dff640 1 -- 172.21.15.5:0/637545263 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86c0004210 msgr2=0x7f86e00a0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86e4dff640 1 --2- 172.21.15.5:0/637545263 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86c0004210 0x7f86e00a0f70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f86d801db80 tx=0x7f86c0005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86dd7fa640 1 -- 172.21.15.5:0/637545263 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86d80044a0 con 0x7f86c0004210 2024-08-18T21:04:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86dd7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:04:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86dd7fa640 10 monclient: dump: 2024-08-18T21:04:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:18.559 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86dd7fa640 10 monclient: _finish_auth 0 2024-08-18T21:04:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86dd7fa640 10 monclient: _check_auth_tickets 2024-08-18T21:04:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86dd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86e7063640 5 monclient: authenticate success, global_id 4565 2024-08-18T21:04:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86e7063640 10 monclient: _renew_subs 2024-08-18T21:04:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86dd7fa640 1 -- 172.21.15.5:0/637545263 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d80a6c10 con 0x7f86c0004210 2024-08-18T21:04:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86e7063640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:04:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86e7063640 1 -- 172.21.15.5:0/637545263 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e0124dc0 con 0x7f86c0004210 2024-08-18T21:04:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86dd7fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86dd7fa640 1 -- 172.21.15.5:0/637545263 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86d80a6dc0 con 0x7f86c0004210 2024-08-18T21:04:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86dd7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:04:18.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86deffd640 4 set_mon_vals no callback set 2024-08-18T21:04:18.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86dd7fa640 10 monclient: dump: 2024-08-18T21:04:18.561 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:18.561 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:18.561 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.561 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.561 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:18.562 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86e7063640 10 monclient: _renew_subs 2024-08-18T21:04:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86e7063640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:04:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86e7063640 1 -- 172.21.15.5:0/637545263 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e01d1b90 con 0x7f86c0004210 2024-08-18T21:04:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86dd7fa640 1 -- 172.21.15.5:0/637545263 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f86d8004030 con 0x7f86c0004210 2024-08-18T21:04:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86e7063640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86e7063640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86e7063640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:04:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.545+0000 7f86e7063640 1 -- 172.21.15.5:0/637545263 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e00a9310 con 0x7f86c0004210 2024-08-18T21:04:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.549+0000 7f86dd7fa640 1 --2- 172.21.15.5:0/637545263 >> v2:172.21.15.157:6812/631023601 conn(0x7f86cc03cbb0 0x7f86cc03f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.549+0000 7f86dd7fa640 1 -- 172.21.15.5:0/637545263 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 3898+0+0 (secure 0 0 0) 0x7f86d80b3040 con 0x7f86c0004210 2024-08-18T21:04:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.549+0000 7f86dffff640 1 --2- 172.21.15.5:0/637545263 >> v2:172.21.15.157:6812/631023601 conn(0x7f86cc03cbb0 0x7f86cc03f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.549+0000 7f86dffff640 10 monclient: get_auth_request con 0x7f86cc03cbb0 auth_method 0 2024-08-18T21:04:18.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.549+0000 7f86dffff640 1 --2- 172.21.15.5:0/637545263 >> v2:172.21.15.157:6812/631023601 conn(0x7f86cc03cbb0 0x7f86cc03f070 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f86e00a2010 tx=0x7f86c801b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:18.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.553+0000 7f86dd7fa640 1 -- 172.21.15.5:0/637545263 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f86e00a9310 con 0x7f86c0004210 2024-08-18T21:04:18.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.553+0000 7f86dd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:18.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.553+0000 7f86dd7fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:04:18.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.797+0000 7f86e7063640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:04:18.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.797+0000 7f86e7063640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:04:18.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.797+0000 7f86e7063640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:04:18.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.797+0000 7f86e7063640 1 -- 172.21.15.5:0/637545263 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f86e013a3c0 con 0x7f86c0004210 2024-08-18T21:04:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86dd7fa640 1 -- 172.21.15.5:0/637545263 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3160 (secure 0 0 0) 0x7f86e0124dc0 con 0x7f86c0004210 2024-08-18T21:04:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86dd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:04:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86dd7fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:04:18.803 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":18,"quorum":[0,1,2,3,4,6,7],"quorum_names":["a","f","b","g","c","d","i"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:04:18.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86e7063640 1 -- 172.21.15.5:0/637545263 >> v2:172.21.15.157:6812/631023601 conn(0x7f86cc03cbb0 msgr2=0x7f86cc03f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:18.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86e7063640 1 --2- 172.21.15.5:0/637545263 >> v2:172.21.15.157:6812/631023601 conn(0x7f86cc03cbb0 0x7f86cc03f070 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f86e00a2010 tx=0x7f86c801b040 comp rx=0 tx=0).stop 2024-08-18T21:04:18.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86e7063640 10 monclient: shutdown 2024-08-18T21:04:18.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86e7063640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:04:18.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86e7063640 1 -- 172.21.15.5:0/637545263 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86c0004210 msgr2=0x7f86e00a0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:18.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86e7063640 1 --2- 172.21.15.5:0/637545263 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86c0004210 0x7f86e00a0f70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f86d801db80 tx=0x7f86c0005840 comp rx=0 tx=0).stop 2024-08-18T21:04:18.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86e7063640 1 -- 172.21.15.5:0/637545263 shutdown_connections 2024-08-18T21:04:18.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86e7063640 1 --2- 172.21.15.5:0/637545263 >> v2:172.21.15.157:6812/631023601 conn(0x7f86cc03cbb0 0x7f86cc03f070 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86e7063640 1 --2- 172.21.15.5:0/637545263 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f86c0009c00 0x7f86e0138180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86e7063640 1 --2- 172.21.15.5:0/637545263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86c0004e20 0x7f86e0137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86e7063640 1 --2- 172.21.15.5:0/637545263 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f86c0004210 0x7f86e00a0f70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86e7063640 1 -- 172.21.15.5:0/637545263 >> 172.21.15.5:0/637545263 conn(0x7f86e00acbc0 msgr2=0x7f86e00aa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:04:18.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86e7063640 1 -- 172.21.15.5:0/637545263 shutdown_connections 2024-08-18T21:04:18.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.801+0000 7f86e7063640 1 -- 172.21.15.5:0/637545263 wait complete. 2024-08-18T21:04:18.823 INFO:tasks.mon_thrash.ceph_manager:quorum is size 7 2024-08-18T21:04:18.823 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon a 2024-08-18T21:04:18.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:04:18.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 10 monclient: get_monmap_and_config 2024-08-18T21:04:18.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 10 monclient: build_initial_monmap 2024-08-18T21:04:18.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 10 monclient: monmap: 2024-08-18T21:04:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:04:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:04:18.949461+0000 2024-08-18T21:04:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:04:18.949461+0000 2024-08-18T21:04:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:04:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:04:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:04:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:04:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:04:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:04:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:04:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:04:18.949 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:04:18.949 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:04:18.949 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:04:18.949 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:04:18.949 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:18.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 1 Processor -- start 2024-08-18T21:04:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 1 -- start start 2024-08-18T21:04:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 10 monclient: init 2024-08-18T21:04:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 10 monclient: _add_conns ranks=[5,3,0,9,10,7,2,6,1,4,8] 2024-08-18T21:04:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3f1c0a6ce0 0x7f3f1c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 10 monclient(hunting): picked mon.noname-h con 0x7f3f1c0a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:04:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f1c0a7600 0x7f3f1c139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 10 monclient(hunting): picked mon.noname-g con 0x7f3f1c0a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:04:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3f1c139fe0 addr v1:172.21.15.5:6789/0 2024-08-18T21:04:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f1c0a45d0 con 0x7f3f1c139fe0 2024-08-18T21:04:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1c0a5000 con 0x7f3f1c0a7600 2024-08-18T21:04:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f3f1c0a32d0 con 0x7f3f1c0a6ce0 2024-08-18T21:04:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f21ff3640 10 monclient(hunting): authenticate will time out at 1025.962915s 2024-08-18T21:04:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1b7fe640 1 -- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3f1c0a6ce0 msgr2=0x7f3f1c0a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3302/0 2024-08-18T21:04:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3f1c139fe0 0x7f3f1c140cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49662/0 (socket says 172.21.15.5:49662) 2024-08-18T21:04:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1bfff640 1 -- 172.21.15.5:0/3041114238 learned_addr learned my addr 172.21.15.5:0/3041114238 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:04:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1b7fe640 1 --2- 172.21.15.5:0/3041114238 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3f1c0a6ce0 0x7f3f1c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:04:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 1 --2- 172.21.15.5:0/3041114238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f1c0a7600 0x7f3f1c139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 10 monclient(hunting): get_auth_request con 0x7f3f1c0a7600 auth_method 0 2024-08-18T21:04:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 10 monclient(hunting): handle_auth_done global_id 4449 payload 274 2024-08-18T21:04:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 1 -- 172.21.15.5:0/3041114238 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3f1c0a6ce0 msgr2=0x7f3f1c0a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:04:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 1 --2- 172.21.15.5:0/3041114238 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3f1c0a6ce0 0x7f3f1c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 1 -- 172.21.15.5:0/3041114238 >> v1:172.21.15.5:6789/0 conn(0x7f3f1c139fe0 legacy=0x7f3f1c140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:04:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 10 monclient: _finish_hunting 0 2024-08-18T21:04:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 1 monclient: found mon.noname-g 2024-08-18T21:04:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:04:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.945+0000 7f3f1affd640 1 -- 172.21.15.5:0/3041114238 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1c0a8900 con 0x7f3f1c0a7600 2024-08-18T21:04:18.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 1 -- 172.21.15.5:0/3041114238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f1c0a7600 msgr2=0x7f3f1c139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:18.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 1 --2- 172.21.15.5:0/3041114238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f1c0a7600 0x7f3f1c139aa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3f040097f0 tx=0x7f3f0401c3c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=931d3e3b7d4ed225 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1a7fc640 1 -- 172.21.15.5:0/3041114238 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f040b0070 con 0x7f3f1c0a7600 2024-08-18T21:04:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1a7fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:04:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1a7fc640 10 monclient: dump: 2024-08-18T21:04:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:18.958 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1a7fc640 10 monclient: _finish_auth 0 2024-08-18T21:04:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1a7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:04:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1a7fc640 1 -- 172.21.15.5:0/3041114238 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f040aa810 con 0x7f3f1c0a7600 2024-08-18T21:04:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 5 monclient: authenticate success, global_id 4449 2024-08-18T21:04:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:04:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1a7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 10 monclient: get_monmap_and_config success 2024-08-18T21:04:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 4 set_mon_vals no callback set 2024-08-18T21:04:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1a7fc640 1 -- 172.21.15.5:0/3041114238 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f040a93e0 con 0x7f3f1c0a7600 2024-08-18T21:04:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1a7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:04:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1a7fc640 10 monclient: dump: 2024-08-18T21:04:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:18.960 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 10 monclient: shutdown 2024-08-18T21:04:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:04:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 1 -- 172.21.15.5:0/3041114238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f1c0a7600 msgr2=0x7f3f1c139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 1 --2- 172.21.15.5:0/3041114238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f1c0a7600 0x7f3f1c139aa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3f040097f0 tx=0x7f3f0401c3c0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 1 -- 172.21.15.5:0/3041114238 shutdown_connections 2024-08-18T21:04:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 1 --2- 172.21.15.5:0/3041114238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f1c0a7600 0x7f3f1c139aa0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 1 --2- 172.21.15.5:0/3041114238 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3f1c0a6ce0 0x7f3f1c0a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 1 -- 172.21.15.5:0/3041114238 >> 172.21.15.5:0/3041114238 conn(0x7f3f1c0acbc0 msgr2=0x7f3f1c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:04:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 1 -- 172.21.15.5:0/3041114238 shutdown_connections 2024-08-18T21:04:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 1 -- 172.21.15.5:0/3041114238 wait complete. 2024-08-18T21:04:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 10 monclient: build_initial_monmap 2024-08-18T21:04:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 10 monclient: monmap: 2024-08-18T21:04:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:04:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:04:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:04:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:04:18.962 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:04:18.962 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:18.962 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:04:18.962 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:04:18.962 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:04:18.962 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:04:18.962 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:04:18.963 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:04:18.963 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:04:18.963 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:04:18.963 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:04:18.963 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:18.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 1 Processor -- start 2024-08-18T21:04:18.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 1 -- start start 2024-08-18T21:04:18.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 10 monclient: init 2024-08-18T21:04:18.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:18.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 10 monclient: _add_conns ranks=[0,2,4,3,1,7,5,8,6] 2024-08-18T21:04:18.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c0a6ce0 0x7f3f1c1360e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 10 monclient(hunting): picked mon.noname-a con 0x7f3f1c0a6ce0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:04:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3f1c0a7600 0x7f3f1c13b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 10 monclient(hunting): picked mon.noname-b con 0x7f3f1c0a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:04:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3f1c139fe0 0x7f3f1c13bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 10 monclient(hunting): picked mon.noname-c con 0x7f3f1c139fe0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:04:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c0a79e0 con 0x7f3f1c0a6ce0 2024-08-18T21:04:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1c0a9810 con 0x7f3f1c0a7600 2024-08-18T21:04:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f3f1c13d320 con 0x7f3f1c139fe0 2024-08-18T21:04:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f21ff3640 10 monclient(hunting): authenticate will time out at 1025.970958s 2024-08-18T21:04:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3f1c0a7600 0x7f3f1c13b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1bfff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3f1c139fe0 0x7f3f1c13bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c0a6ce0 0x7f3f1c1360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3f1c0a7600 0x7f3f1c13b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:44438/0 (socket says 172.21.15.5:44438) 2024-08-18T21:04:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 1 -- 172.21.15.5:0/941468781 learned_addr learned my addr 172.21.15.5:0/941468781 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:04:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 10 monclient(hunting): get_auth_request con 0x7f3f1c0a7600 auth_method 0 2024-08-18T21:04:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1bfff640 10 monclient(hunting): get_auth_request con 0x7f3f1c139fe0 auth_method 0 2024-08-18T21:04:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1b7fe640 10 monclient(hunting): get_auth_request con 0x7f3f1c0a6ce0 auth_method 0 2024-08-18T21:04:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 10 monclient(hunting): handle_auth_done global_id 4574 payload 824 2024-08-18T21:04:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 1 -- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3f1c139fe0 msgr2=0x7f3f1c13bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 1 --2- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3f1c139fe0 0x7f3f1c13bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 1 -- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c0a6ce0 msgr2=0x7f3f1c1360e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 1 --2- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c0a6ce0 0x7f3f1c1360e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 10 monclient: _finish_hunting 0 2024-08-18T21:04:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 1 monclient: found mon.noname-b 2024-08-18T21:04:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:04:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1affd640 1 -- 172.21.15.5:0/941468781 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1c0aa870 con 0x7f3f1c0a7600 2024-08-18T21:04:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.953+0000 7f3f1bfff640 1 --2- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3f1c139fe0 0x7f3f1c13bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:04:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f1affd640 1 -- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3f1c0a7600 msgr2=0x7f3f1c13b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f1affd640 1 --2- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3f1c0a7600 0x7f3f1c13b9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f040ae040 tx=0x7f3f04019160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f13fff640 1 -- 172.21.15.5:0/941468781 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f040b9070 con 0x7f3f1c0a7600 2024-08-18T21:04:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f13fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:04:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f13fff640 10 monclient: dump: 2024-08-18T21:04:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:18.974 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f13fff640 10 monclient: _finish_auth 0 2024-08-18T21:04:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f13fff640 10 monclient: _check_auth_tickets 2024-08-18T21:04:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f13fff640 1 -- 172.21.15.5:0/941468781 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f04004240 con 0x7f3f1c0a7600 2024-08-18T21:04:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f21ff3640 5 monclient: authenticate success, global_id 4574 2024-08-18T21:04:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f21ff3640 10 monclient: _renew_subs 2024-08-18T21:04:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f21ff3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:04:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f21ff3640 1 -- 172.21.15.5:0/941468781 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1c142160 con 0x7f3f1c0a7600 2024-08-18T21:04:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f13fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f13fff640 1 -- 172.21.15.5:0/941468781 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f040b0040 con 0x7f3f1c0a7600 2024-08-18T21:04:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f13fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:04:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f19ffb640 4 set_mon_vals no callback set 2024-08-18T21:04:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f13fff640 10 monclient: dump: 2024-08-18T21:04:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:18.976 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f21ff3640 10 monclient: _renew_subs 2024-08-18T21:04:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f21ff3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:04:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f21ff3640 1 -- 172.21.15.5:0/941468781 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f1c13ede0 con 0x7f3f1c0a7600 2024-08-18T21:04:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f21ff3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f21ff3640 1 --2- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c136620 0x7f3f1c13c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f21ff3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f21ff3640 1 -- 172.21.15.5:0/941468781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c0a7b60 con 0x7f3f1c136620 2024-08-18T21:04:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f1b7fe640 1 --2- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c136620 0x7f3f1c13c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f1b7fe640 10 monclient: get_auth_request con 0x7f3f1c136620 auth_method 0 2024-08-18T21:04:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f1b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f1b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f1b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f1b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f1b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f1affd640 1 --2- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3f1c0a7600 0x7f3f1c13b9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f040ae040 tx=0x7f3f04019160 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7f3f040e7a90 osd_map(23..23 src has 1..23) 2024-08-18T21:04:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f13fff640 1 -- 172.21.15.5:0/941468781 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f3f04003620 con 0x7f3f1c0a7600 2024-08-18T21:04:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f1b7fe640 10 monclient(hunting): handle_auth_done global_id 4536 payload 824 2024-08-18T21:04:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f1b7fe640 1 -- 172.21.15.5:0/941468781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f1c0aaaa0 con 0x7f3f1c136620 2024-08-18T21:04:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.957+0000 7f3f13fff640 1 --2- 172.21.15.5:0/941468781 >> v2:172.21.15.157:6812/631023601 conn(0x7f3efc03bdc0 0x7f3efc03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.961+0000 7f3f1bfff640 1 --2- 172.21.15.5:0/941468781 >> v2:172.21.15.157:6812/631023601 conn(0x7f3efc03bdc0 0x7f3efc03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.961+0000 7f3f1bfff640 10 monclient: get_auth_request con 0x7f3efc03bdc0 auth_method 0 2024-08-18T21:04:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.961+0000 7f3f1b7fe640 1 -- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c136620 msgr2=0x7f3f1c13c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.961+0000 7f3f1b7fe640 1 --2- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c136620 0x7f3f1c13c440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c003fd0 tx=0x7f3f0c009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.961+0000 7f3f13fff640 1 -- 172.21.15.5:0/941468781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f0c00ede0 con 0x7f3f1c136620 2024-08-18T21:04:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.961+0000 7f3f13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.961+0000 7f3f13fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:04:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.961+0000 7f3f13fff640 10 monclient: dump: 2024-08-18T21:04:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:18.979 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:18.979 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.979 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.979 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:18.979 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:18.979 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:18.979 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:18.979 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:18.979 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:18.979 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:18.979 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:18.979 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:18.979 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:18.980 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:18.980 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:18.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.961+0000 7f3f13fff640 1 -- 172.21.15.5:0/941468781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3f0c00e970 con 0x7f3f1c136620 2024-08-18T21:04:18.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.961+0000 7f3f13fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:18.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.961+0000 7f3f13fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:04:18.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.961+0000 7f3f13fff640 1 -- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c136620 msgr2=0x7f3f1c13c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:18.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.961+0000 7f3f13fff640 1 --2- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c136620 0x7f3f1c13c440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c003fd0 tx=0x7f3f0c009a40 comp rx=0 tx=0).stop 2024-08-18T21:04:18.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.961+0000 7f3f13fff640 1 -- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c136620 msgr2=0x7f3f1c13c440 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:04:18.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.961+0000 7f3f13fff640 1 --2- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c136620 0x7f3f1c13c440 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.961+0000 7f3f1bfff640 1 --2- 172.21.15.5:0/941468781 >> v2:172.21.15.157:6812/631023601 conn(0x7f3efc03bdc0 0x7f3efc03e280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3f14009400 tx=0x7f3f14009350 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:18.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f21ff3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:04:18.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f21ff3640 1 --2- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c13c980 0x7f3f1c09ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:18.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f21ff3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:18.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f21ff3640 1 -- 172.21.15.5:0/941468781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c051140 con 0x7f3f1c13c980 2024-08-18T21:04:18.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f1b7fe640 1 --2- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c13c980 0x7f3f1c09ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:18.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f1b7fe640 10 monclient: get_auth_request con 0x7f3f1c13c980 auth_method 0 2024-08-18T21:04:18.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:18.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f1b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:18.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f1b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:18.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f1b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f1b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f1b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f1b7fe640 10 monclient(hunting): handle_auth_done global_id 4545 payload 824 2024-08-18T21:04:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f1b7fe640 1 -- 172.21.15.5:0/941468781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3f1c0a8220 con 0x7f3f1c13c980 2024-08-18T21:04:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f1b7fe640 1 -- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c13c980 msgr2=0x7f3f1c09ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f1b7fe640 1 --2- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c13c980 0x7f3f1c09ebd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c003fd0 tx=0x7f3f0c0059e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f13fff640 1 -- 172.21.15.5:0/941468781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f0c005c60 con 0x7f3f1c13c980 2024-08-18T21:04:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f13fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:04:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f13fff640 10 monclient: dump: 2024-08-18T21:04:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.984 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:18.984 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:18.984 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:18.984 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:18.984 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:18.984 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:18.984 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:18.984 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:18.984 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:18.984 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:18.984 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:18.984 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:18.984 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:18.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f13fff640 1 -- 172.21.15.5:0/941468781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9560 (secure 0 0 0) 0x7f3f0c005c60 con 0x7f3f1c13c980 2024-08-18T21:04:18.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f13fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:04:18.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f13fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:04:18.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f13fff640 1 -- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c13c980 msgr2=0x7f3f1c09ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:18.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f13fff640 1 --2- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c13c980 0x7f3f1c09ebd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c003fd0 tx=0x7f3f0c0059e0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f13fff640 1 -- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c13c980 msgr2=0x7f3f1c09ebd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:04:18.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.969+0000 7f3f13fff640 1 --2- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c13c980 0x7f3f1c09ebd0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c003fd0 tx=0x7f3f0c0059e0 comp rx=0 tx=0).stop 2024-08-18T21:04:18.985 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:04:18.985 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:04:18.985 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:04:18.985 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:04:18.986 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 18, 2024-08-18T21:04:18.986 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 68091, 2024-08-18T21:04:18.986 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:04:18.986 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:04:18.986 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:04:18.986 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:04:18.986 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:04:18.986 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:04:18.986 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:04:18.986 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:04:18.986 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:18.986 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:04:18.986 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:04:18.987 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:04:18.987 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:04:18.987 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:18.987 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:18.987 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:18.987 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:18.987 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:18.987 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:18.987 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:18.987 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:18.987 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:18.987 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:18.987 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:18.988 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:18.988 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:04:18.988 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:04:18.988 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:18.988 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:18.988 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:18.988 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:18.988 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:18.988 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:18.988 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:18.988 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:18.988 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:18.988 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:18.988 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:18.989 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:18.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:18.989 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:04:18.989 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:04:18.989 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:04:18.989 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:04:18.989 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:04:18.989 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:04:18.989 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:04:18.989 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:04:18.989 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:04:18.989 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:04:18.989 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:04:18.989 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:04:18.990 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:04:18.990 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:04:18.990 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:04:18.990 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:04:18.990 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:04:18.990 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:18.990 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:18.990 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:18.990 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:18.990 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:18.990 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:18.990 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:18.990 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:18.991 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:18.991 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:18.991 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:18.991 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:18.991 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:04:18.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:18.991 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:04:18.991 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:18.991 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:04:18.991 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:04:18.991 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:18.991 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:18.991 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:18.991 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:18.992 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:04:18.992 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:18.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:18.992 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:18.992 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:18.992 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:04:18.992 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:18.992 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:18.992 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:18.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:18.993 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:04:18.993 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:04:18.993 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:18.993 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:18.993 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:18.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:18.993 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:18.993 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:04:18.993 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:04:18.993 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:18.993 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:18.993 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:18.993 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:18.994 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:04:18.994 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:18.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:18.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:18.994 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:18.994 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:04:18.994 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:18.994 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:18.994 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:18.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:18.994 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:04:18.994 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:04:18.995 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:18.995 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:18.995 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:18.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:18.995 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:18.995 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:04:18.995 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:04:18.995 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:18.995 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:18.995 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:18.995 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:18.995 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:04:18.995 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:18.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:18.996 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:18.996 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:18.996 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:04:18.996 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:18.996 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:18.996 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:18.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:18.996 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:04:18.996 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:04:18.996 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:18.996 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:18.996 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:18.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:18.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:18.997 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:04:18.997 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:04:18.997 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:18.997 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:18.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:18.997 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:18.997 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:04:18.997 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:18.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:18.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:18.997 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:18.997 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:04:18.998 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:18.998 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:18.998 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:18.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:18.998 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:04:18.998 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:04:18.998 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:18.998 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:18.998 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:18.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:18.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:18.999 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:04:18.999 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:04:18.999 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:18.999 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:18.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:18.999 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:18.999 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:04:18.999 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:18.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:18.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:18.999 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:18.999 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:04:18.999 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.000 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.000 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.000 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:04:19.000 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:04:19.000 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.000 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.000 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.000 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:04:19.000 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:04:19.000 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.000 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:04:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:04:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:04:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:04:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:04:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:04:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:04:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.003 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.003 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:04:19.003 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.003 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.003 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.003 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:04:19.003 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:04:19.003 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.003 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.003 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.004 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:04:19.004 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:04:19.004 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:04:19.004 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:04:19.004 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.004 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.005 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.005 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:04:19.005 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:04:19.005 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.005 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.005 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.005 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:04:19.005 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:04:19.005 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.005 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.006 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.006 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:04:19.006 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.006 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.006 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:04:19.006 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.006 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.006 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.006 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:04:19.006 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:04:19.007 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.007 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.007 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.007 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.007 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.007 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:04:19.007 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:04:19.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.007 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.007 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.007 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:04:19.007 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.007 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.008 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:04:19.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.008 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.008 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.008 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:04:19.008 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.008 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.008 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:04:19.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.008 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.008 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.008 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:04:19.008 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.008 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.009 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:04:19.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.009 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.009 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.009 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:04:19.009 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.009 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.009 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:04:19.009 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:04:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.973+0000 7f3f21ff3640 1 -- 172.21.15.5:0/941468781 >> v2:172.21.15.157:6812/631023601 conn(0x7f3efc03bdc0 msgr2=0x7f3efc03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.973+0000 7f3f21ff3640 1 --2- 172.21.15.5:0/941468781 >> v2:172.21.15.157:6812/631023601 conn(0x7f3efc03bdc0 0x7f3efc03e280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3f14009400 tx=0x7f3f14009350 comp rx=0 tx=0).stop 2024-08-18T21:04:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.973+0000 7f3f21ff3640 10 monclient: shutdown 2024-08-18T21:04:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.973+0000 7f3f21ff3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:04:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.973+0000 7f3f21ff3640 1 -- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3f1c0a7600 msgr2=0x7f3f1c13b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.973+0000 7f3f21ff3640 1 --2- 172.21.15.5:0/941468781 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3f1c0a7600 0x7f3f1c13b9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f040ae040 tx=0x7f3f04019160 comp rx=0 tx=0).stop 2024-08-18T21:04:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.973+0000 7f3f1bfff640 1 -- 172.21.15.5:0/941468781 reap_dead start 2024-08-18T21:04:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.973+0000 7f3f13fff640 1 -- 172.21.15.5:0/941468781 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 3898+0+0 (unknown 0 0 0) 0x7f3f040e7a90 con 0x7f3f1c0a7600 2024-08-18T21:04:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.973+0000 7f3f1bfff640 1 -- 172.21.15.5:0/941468781 reap_dead start 2024-08-18T21:04:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.973+0000 7f3f21ff3640 1 -- 172.21.15.5:0/941468781 shutdown_connections 2024-08-18T21:04:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.973+0000 7f3f21ff3640 1 -- 172.21.15.5:0/941468781 >> 172.21.15.5:0/941468781 conn(0x7f3f1c0acbc0 msgr2=0x7f3f1c09dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:04:19.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.973+0000 7f3f21ff3640 1 -- 172.21.15.5:0/941468781 shutdown_connections 2024-08-18T21:04:19.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:18.973+0000 7f3f21ff3640 1 -- 172.21.15.5:0/941468781 wait complete. 2024-08-18T21:04:19.012 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:04:19.012 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon b 2024-08-18T21:04:19.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:04:19.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 10 monclient: get_monmap_and_config 2024-08-18T21:04:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 10 monclient: build_initial_monmap 2024-08-18T21:04:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 10 monclient: monmap: 2024-08-18T21:04:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:04:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:04:19.137754+0000 2024-08-18T21:04:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:04:19.137754+0000 2024-08-18T21:04:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:04:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:04:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:04:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:04:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:04:19.137 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:04:19.137 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:04:19.137 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:04:19.137 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:04:19.137 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:04:19.137 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:04:19.137 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:04:19.137 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 1 Processor -- start 2024-08-18T21:04:19.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 1 -- start start 2024-08-18T21:04:19.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 10 monclient: init 2024-08-18T21:04:19.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:19.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 10 monclient: _add_conns ranks=[2,3,1,9,6,0,4,10,5,7,8] 2024-08-18T21:04:19.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d80a6bd0 0x7f20d80a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 10 monclient(hunting): picked mon.noname-b con 0x7f20d80a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:04:19.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20d809f080 0x7f20d80a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 10 monclient(hunting): picked mon.noname-g con 0x7f20d809f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:04:19.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f20d8139990 addr v1:172.21.15.157:6789/0 2024-08-18T21:04:19.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d80a7fb0 con 0x7f20d8139990 2024-08-18T21:04:19.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f20d809e4c0 con 0x7f20d80a6bd0 2024-08-18T21:04:19.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f20d806f930 con 0x7f20d809f080 2024-08-18T21:04:19.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:19.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20de84b640 10 monclient(hunting): authenticate will time out at 1026.151383s 2024-08-18T21:04:19.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d80a6bd0 0x7f20d80a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d80a6bd0 0x7f20d80a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:44454/0 (socket says 172.21.15.5:44454) 2024-08-18T21:04:19.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 1 -- 172.21.15.5:0/3236216465 learned_addr learned my addr 172.21.15.5:0/3236216465 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:04:19.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 10 monclient(hunting): get_auth_request con 0x7f20d80a6bd0 auth_method 0 2024-08-18T21:04:19.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d77fe640 1 --2- 172.21.15.5:0/3236216465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20d809f080 0x7f20d80a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 10 monclient(hunting): handle_auth_done global_id 4583 payload 274 2024-08-18T21:04:19.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 1 -- 172.21.15.5:0/3236216465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20d809f080 msgr2=0x7f20d80a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:04:19.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 1 --2- 172.21.15.5:0/3236216465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20d809f080 0x7f20d80a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 1 -- 172.21.15.5:0/3236216465 >> v1:172.21.15.157:6789/0 conn(0x7f20d8139990 legacy=0x7f20d8139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:04:19.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:04:19.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 1 monclient: found mon.noname-b 2024-08-18T21:04:19.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:19.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:04:19.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d7fff640 1 -- 172.21.15.5:0/3236216465 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d809de70 con 0x7f20d80a6bd0 2024-08-18T21:04:19.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d77fe640 10 monclient: get_auth_request con 0x7f20d809f080 auth_method 0 2024-08-18T21:04:19.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.133+0000 7f20d77fe640 1 --2- 172.21.15.5:0/3236216465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20d809f080 0x7f20d80a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:04:19.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 1 -- 172.21.15.5:0/3236216465 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d80a6bd0 msgr2=0x7f20d80a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 1 --2- 172.21.15.5:0/3236216465 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d80a6bd0 0x7f20d80a6fb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f20d00098a0 tx=0x7f20d001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c22dcbb0907b8a30 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d6ffd640 1 -- 172.21.15.5:0/3236216465 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f20d00b0070 con 0x7f20d80a6bd0 2024-08-18T21:04:19.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:04:19.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d6ffd640 10 monclient: dump: 2024-08-18T21:04:19.144 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.144 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.144 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.145 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.145 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.145 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.145 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.145 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.145 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.145 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.145 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.145 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.145 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.145 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.145 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.145 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:04:19.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:04:19.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:19.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 5 monclient: authenticate success, global_id 4583 2024-08-18T21:04:19.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d6ffd640 1 -- 172.21.15.5:0/3236216465 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d00aa810 con 0x7f20d80a6bd0 2024-08-18T21:04:19.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:04:19.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:19.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 10 monclient: get_monmap_and_config success 2024-08-18T21:04:19.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 4 set_mon_vals no callback set 2024-08-18T21:04:19.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d6ffd640 1 -- 172.21.15.5:0/3236216465 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f20d00aae30 con 0x7f20d80a6bd0 2024-08-18T21:04:19.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:04:19.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d6ffd640 10 monclient: dump: 2024-08-18T21:04:19.146 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.147 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.147 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.147 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.147 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.147 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.147 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.147 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.147 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.147 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.147 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.147 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.147 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.147 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.148 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.148 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 10 monclient: shutdown 2024-08-18T21:04:19.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:04:19.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 1 -- 172.21.15.5:0/3236216465 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d80a6bd0 msgr2=0x7f20d80a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 1 --2- 172.21.15.5:0/3236216465 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d80a6bd0 0x7f20d80a6fb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f20d00098a0 tx=0x7f20d001c440 comp rx=0 tx=0).stop 2024-08-18T21:04:19.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 1 -- 172.21.15.5:0/3236216465 shutdown_connections 2024-08-18T21:04:19.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 1 --2- 172.21.15.5:0/3236216465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20d809f080 0x7f20d80a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 1 --2- 172.21.15.5:0/3236216465 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d80a6bd0 0x7f20d80a6fb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 1 -- 172.21.15.5:0/3236216465 >> 172.21.15.5:0/3236216465 conn(0x7f20d8068700 msgr2=0x7f20d8068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:04:19.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 1 -- 172.21.15.5:0/3236216465 shutdown_connections 2024-08-18T21:04:19.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 1 -- 172.21.15.5:0/3236216465 wait complete. 2024-08-18T21:04:19.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 10 monclient: build_initial_monmap 2024-08-18T21:04:19.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 10 monclient: monmap: 2024-08-18T21:04:19.149 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:04:19.149 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:04:19.149 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:04:19.149 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:04:19.149 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:04:19.149 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.149 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:04:19.149 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:04:19.149 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:04:19.149 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:04:19.149 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:04:19.149 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:04:19.149 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:04:19.150 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:04:19.150 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:04:19.150 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 1 Processor -- start 2024-08-18T21:04:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 1 -- start start 2024-08-18T21:04:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 10 monclient: init 2024-08-18T21:04:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 10 monclient: _add_conns ranks=[0,8,7,4,3,1,5,2,6] 2024-08-18T21:04:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d809f080 0x7f20d8140010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 10 monclient(hunting): picked mon.noname-a con 0x7f20d809f080 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:04:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20d80a6bd0 0x7f20d81d1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 10 monclient(hunting): picked mon.noname-e con 0x7f20d80a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:04:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f20d8139990 0x7f20d813dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 10 monclient(hunting): picked mon.noname-i con 0x7f20d8139990 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:04:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f20d81447a0 con 0x7f20d809f080 2024-08-18T21:04:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f20d8144620 con 0x7f20d8139990 2024-08-18T21:04:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f20d8144920 con 0x7f20d80a6bd0 2024-08-18T21:04:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20de84b640 10 monclient(hunting): authenticate will time out at 1026.158857s 2024-08-18T21:04:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d77fe640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20d80a6bd0 msgr2=0x7f20d81d1e90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:04:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d77fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20d80a6bd0 0x7f20d81d1e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:04:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d809f080 0x7f20d8140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d809f080 0x7f20d8140010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50404/0 (socket says 172.21.15.5:50404) 2024-08-18T21:04:19.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 1 -- 172.21.15.5:0/2421340022 learned_addr learned my addr 172.21.15.5:0/2421340022 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:04:19.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 10 monclient(hunting): get_auth_request con 0x7f20d809f080 auth_method 0 2024-08-18T21:04:19.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20dcde8640 1 --2- 172.21.15.5:0/2421340022 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f20d8139990 0x7f20d813dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20dcde8640 10 monclient(hunting): get_auth_request con 0x7f20d8139990 auth_method 0 2024-08-18T21:04:19.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20dcde8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20dcde8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20dcde8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20dcde8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20dcde8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20dcde8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 10 monclient(hunting): handle_auth_done global_id 4554 payload 824 2024-08-18T21:04:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 1 -- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20d80a6bd0 msgr2=0x7f20d81d1e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:04:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 1 --2- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20d80a6bd0 0x7f20d81d1e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 1 -- 172.21.15.5:0/2421340022 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f20d8139990 msgr2=0x7f20d813dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 1 --2- 172.21.15.5:0/2421340022 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f20d8139990 0x7f20d813dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:04:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 1 monclient: found mon.noname-a 2024-08-18T21:04:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:04:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.141+0000 7f20d7fff640 1 -- 172.21.15.5:0/2421340022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d81409a0 con 0x7f20d809f080 2024-08-18T21:04:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d7fff640 1 -- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d809f080 msgr2=0x7f20d8140010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d7fff640 1 --2- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d809f080 0x7f20d8140010 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f20d00ae040 tx=0x7f20d00191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d4ff9640 1 -- 172.21.15.5:0/2421340022 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f20d00b9070 con 0x7f20d809f080 2024-08-18T21:04:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:04:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d4ff9640 10 monclient: dump: 2024-08-18T21:04:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.160 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d4ff9640 10 monclient: _finish_auth 0 2024-08-18T21:04:19.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d4ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:04:19.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:19.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d4ff9640 1 -- 172.21.15.5:0/2421340022 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d00044b0 con 0x7f20d809f080 2024-08-18T21:04:19.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20de84b640 5 monclient: authenticate success, global_id 4554 2024-08-18T21:04:19.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20de84b640 10 monclient: _renew_subs 2024-08-18T21:04:19.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20de84b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:04:19.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20de84b640 1 -- 172.21.15.5:0/2421340022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d8122970 con 0x7f20d809f080 2024-08-18T21:04:19.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d4ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:19.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d4ff9640 1 -- 172.21.15.5:0/2421340022 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f20d00b0040 con 0x7f20d809f080 2024-08-18T21:04:19.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:04:19.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d4ff9640 10 monclient: dump: 2024-08-18T21:04:19.162 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.162 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.162 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.162 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.162 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.162 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.162 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.162 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.162 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.162 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.162 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.163 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.163 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.163 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.163 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.163 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20de84b640 10 monclient: _renew_subs 2024-08-18T21:04:19.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20de84b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:04:19.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20de84b640 1 -- 172.21.15.5:0/2421340022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d8123210 con 0x7f20d809f080 2024-08-18T21:04:19.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d67fc640 4 set_mon_vals no callback set 2024-08-18T21:04:19.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20de84b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:19.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20de84b640 1 --2- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d81d23d0 0x7f20d813e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20de84b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20de84b640 1 -- 172.21.15.5:0/2421340022 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f20d8051140 con 0x7f20d81d23d0 2024-08-18T21:04:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d77fe640 1 --2- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d81d23d0 0x7f20d813e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d77fe640 10 monclient: get_auth_request con 0x7f20d81d23d0 auth_method 0 2024-08-18T21:04:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d4ff9640 1 -- 172.21.15.5:0/2421340022 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f20d00aacb0 con 0x7f20d809f080 2024-08-18T21:04:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d77fe640 10 monclient(hunting): handle_auth_done global_id 4592 payload 824 2024-08-18T21:04:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d77fe640 1 -- 172.21.15.5:0/2421340022 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20d8139e10 con 0x7f20d81d23d0 2024-08-18T21:04:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d4ff9640 1 --2- 172.21.15.5:0/2421340022 >> v2:172.21.15.157:6812/631023601 conn(0x7f20b803bdb0 0x7f20b803e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20d4ff9640 1 -- 172.21.15.5:0/2421340022 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3898+0+0 (secure 0 0 0) 0x7f20d00e77f0 con 0x7f20d809f080 2024-08-18T21:04:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20dcde8640 1 --2- 172.21.15.5:0/2421340022 >> v2:172.21.15.157:6812/631023601 conn(0x7f20b803bdb0 0x7f20b803e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.145+0000 7f20dcde8640 10 monclient: get_auth_request con 0x7f20b803bdb0 auth_method 0 2024-08-18T21:04:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.149+0000 7f20d77fe640 1 -- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d81d23d0 msgr2=0x7f20d813e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.149+0000 7f20d77fe640 1 --2- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d81d23d0 0x7f20d813e150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f20d813f2f0 tx=0x7f20c000b720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.149+0000 7f20d4ff9640 1 -- 172.21.15.5:0/2421340022 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f20c001b070 con 0x7f20d81d23d0 2024-08-18T21:04:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.149+0000 7f20d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.149+0000 7f20d4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:04:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.149+0000 7f20d4ff9640 10 monclient: dump: 2024-08-18T21:04:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.165 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.166 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.166 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.166 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.166 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.166 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.166 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.166 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.166 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.166 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.166 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.149+0000 7f20d4ff9640 1 -- 172.21.15.5:0/2421340022 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f20c000e860 con 0x7f20d81d23d0 2024-08-18T21:04:19.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.149+0000 7f20d4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:19.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.149+0000 7f20d4ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:04:19.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.149+0000 7f20d4ff9640 1 -- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d81d23d0 msgr2=0x7f20d813e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.149+0000 7f20d4ff9640 1 --2- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d81d23d0 0x7f20d813e150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f20d813f2f0 tx=0x7f20c000b720 comp rx=0 tx=0).stop 2024-08-18T21:04:19.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.149+0000 7f20d4ff9640 1 -- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d81d23d0 msgr2=0x7f20d813e150 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:04:19.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.149+0000 7f20d4ff9640 1 --2- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d81d23d0 0x7f20d813e150 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.149+0000 7f20dcde8640 1 --2- 172.21.15.5:0/2421340022 >> v2:172.21.15.157:6812/631023601 conn(0x7f20b803bdb0 0x7f20b803e270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f20c8006fd0 tx=0x7f20c8006f60 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20de84b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:04:19.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20de84b640 1 --2- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d813e690 0x7f20d80a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20de84b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20de84b640 1 -- 172.21.15.5:0/2421340022 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f20d813eaa0 con 0x7f20d813e690 2024-08-18T21:04:19.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d77fe640 1 --2- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d813e690 0x7f20d80a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d77fe640 10 monclient: get_auth_request con 0x7f20d813e690 auth_method 0 2024-08-18T21:04:19.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d77fe640 10 monclient(hunting): handle_auth_done global_id 4601 payload 824 2024-08-18T21:04:19.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d77fe640 1 -- 172.21.15.5:0/2421340022 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f20d8140dd0 con 0x7f20d813e690 2024-08-18T21:04:19.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d77fe640 1 -- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d813e690 msgr2=0x7f20d80a3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d77fe640 1 --2- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d813e690 0x7f20d80a3eb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f20c0018000 tx=0x7f20c0004ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d4ff9640 1 -- 172.21.15.5:0/2421340022 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f20c001b070 con 0x7f20d813e690 2024-08-18T21:04:19.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:04:19.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d4ff9640 10 monclient: dump: 2024-08-18T21:04:19.170 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.170 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.171 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.171 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.171 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.171 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.171 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.171 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.171 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.171 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.171 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.171 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.171 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.171 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.171 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.172 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d4ff9640 1 -- 172.21.15.5:0/2421340022 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9391 (secure 0 0 0) 0x7f20c001c040 con 0x7f20d813e690 2024-08-18T21:04:19.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:04:19.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d4ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:04:19.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d4ff9640 1 -- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d813e690 msgr2=0x7f20d80a3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d4ff9640 1 --2- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d813e690 0x7f20d80a3eb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f20c0018000 tx=0x7f20c0004ac0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d4ff9640 1 -- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d813e690 msgr2=0x7f20d80a3eb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:04:19.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20d4ff9640 1 --2- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f20d813e690 0x7f20d80a3eb0 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f20c0018000 tx=0x7f20c0004ac0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.172 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:04:19.172 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:04:19.173 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:04:19.173 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:04:19.173 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 18, 2024-08-18T21:04:19.173 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 68271, 2024-08-18T21:04:19.173 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:04:19.173 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:04:19.173 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:04:19.173 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:04:19.173 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:04:19.173 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:04:19.173 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:04:19.173 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:04:19.174 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.174 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:04:19.174 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:04:19.174 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:04:19.174 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:04:19.174 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:19.174 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:19.174 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:19.174 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:19.174 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:19.174 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:19.174 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:19.174 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:19.175 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:19.175 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:19.175 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:19.175 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.175 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:04:19.175 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:04:19.175 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:19.175 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:19.175 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:19.175 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:19.175 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:19.175 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:19.175 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:19.176 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:19.176 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:19.176 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:19.176 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:19.176 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.176 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:04:19.176 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:04:19.176 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:04:19.176 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:04:19.176 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:04:19.176 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:04:19.176 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:04:19.176 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:04:19.177 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:04:19.177 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:04:19.177 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:04:19.177 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:04:19.177 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:04:19.177 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:04:19.177 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:04:19.177 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:04:19.177 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:04:19.177 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:19.177 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:19.177 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:19.177 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:19.177 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:19.177 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:19.178 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:19.178 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:19.178 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:19.178 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:19.178 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:19.178 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.178 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:04:19.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.178 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:04:19.178 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.178 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:04:19.178 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:04:19.179 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.179 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.179 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.179 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:04:19.179 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.179 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.179 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:04:19.179 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.179 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.179 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.180 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:04:19.180 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:04:19.180 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.180 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.180 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.180 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:04:19.180 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:04:19.180 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.181 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.181 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.181 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:04:19.181 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.181 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.181 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:04:19.181 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.181 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.181 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:04:19.182 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:04:19.182 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.182 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.182 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.182 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:04:19.182 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:04:19.182 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.183 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.183 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:04:19.183 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.183 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.183 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:04:19.183 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.183 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.183 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.183 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:04:19.184 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:04:19.184 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.184 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.184 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.184 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:04:19.184 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:04:19.184 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.184 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.184 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:04:19.185 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.185 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:04:19.185 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.185 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.185 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:04:19.185 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:04:19.185 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.185 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.186 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.186 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:04:19.186 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:04:19.186 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.186 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.186 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:04:19.186 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.187 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.187 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:04:19.187 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.187 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.187 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.187 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:04:19.187 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:04:19.187 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.187 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.187 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.188 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:04:19.188 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:04:19.188 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.188 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.188 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:04:19.188 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.188 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:04:19.188 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.189 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.189 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.189 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:04:19.189 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:04:19.189 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.189 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.189 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.189 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:04:19.189 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:04:19.189 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:04:19.190 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:04:19.190 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.190 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.190 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:04:19.191 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:04:19.191 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.191 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.191 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.191 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:04:19.191 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:04:19.191 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:04:19.192 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:04:19.192 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.192 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.192 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:04:19.192 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:04:19.192 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.193 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.193 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.193 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:04:19.193 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:04:19.193 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:04:19.193 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:04:19.194 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.194 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.194 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:04:19.194 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:04:19.194 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.194 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.195 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.195 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.195 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.195 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:04:19.195 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:04:19.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.195 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.195 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.195 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:04:19.195 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.195 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.195 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:04:19.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.196 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.196 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.196 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:04:19.196 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.196 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.196 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:04:19.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.196 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.196 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.196 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:04:19.196 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.196 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.196 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:04:19.197 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:04:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20de84b640 1 -- 172.21.15.5:0/2421340022 >> v2:172.21.15.157:6812/631023601 conn(0x7f20b803bdb0 msgr2=0x7f20b803e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20de84b640 1 --2- 172.21.15.5:0/2421340022 >> v2:172.21.15.157:6812/631023601 conn(0x7f20b803bdb0 0x7f20b803e270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f20c8006fd0 tx=0x7f20c8006f60 comp rx=0 tx=0).stop 2024-08-18T21:04:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20de84b640 10 monclient: shutdown 2024-08-18T21:04:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20de84b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:04:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20de84b640 1 -- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d809f080 msgr2=0x7f20d8140010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20de84b640 1 --2- 172.21.15.5:0/2421340022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d809f080 0x7f20d8140010 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f20d00ae040 tx=0x7f20d00191e0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20dcde8640 1 -- 172.21.15.5:0/2421340022 reap_dead start 2024-08-18T21:04:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20dcde8640 1 -- 172.21.15.5:0/2421340022 reap_dead start 2024-08-18T21:04:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20de84b640 1 -- 172.21.15.5:0/2421340022 shutdown_connections 2024-08-18T21:04:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20de84b640 1 -- 172.21.15.5:0/2421340022 >> 172.21.15.5:0/2421340022 conn(0x7f20d8068700 msgr2=0x7f20d8141540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:04:19.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20de84b640 1 -- 172.21.15.5:0/2421340022 shutdown_connections 2024-08-18T21:04:19.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.157+0000 7f20de84b640 1 -- 172.21.15.5:0/2421340022 wait complete. 2024-08-18T21:04:19.199 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:04:19.199 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon c 2024-08-18T21:04:19.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:04:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 10 monclient: get_monmap_and_config 2024-08-18T21:04:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 10 monclient: build_initial_monmap 2024-08-18T21:04:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 10 monclient: monmap: 2024-08-18T21:04:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:04:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:04:19.317754+0000 2024-08-18T21:04:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:04:19.317754+0000 2024-08-18T21:04:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:04:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:04:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:04:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:04:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:04:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:04:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:04:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:04:19.317 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:04:19.317 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:04:19.317 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:04:19.317 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:04:19.317 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 1 Processor -- start 2024-08-18T21:04:19.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 1 -- start start 2024-08-18T21:04:19.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 10 monclient: init 2024-08-18T21:04:19.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:19.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 10 monclient: _add_conns ranks=[8,7,3,9,4,6,5,1,0,10,2] 2024-08-18T21:04:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2dd00a6bd0 0x7f2dd00a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 10 monclient(hunting): picked mon.noname-e con 0x7f2dd00a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:04:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2dd009f080 0x7f2dd00a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 10 monclient(hunting): picked mon.noname-i con 0x7f2dd009f080 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:04:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2dd0139990 0x7f2dd0139df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 10 monclient(hunting): picked mon.noname-g con 0x7f2dd0139990 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:04:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd009e4c0 con 0x7f2dd0139990 2024-08-18T21:04:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f2dd006f930 con 0x7f2dd009f080 2024-08-18T21:04:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f2dd00a7a30 con 0x7f2dd00a6bd0 2024-08-18T21:04:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd84f6640 10 monclient(hunting): authenticate will time out at 1026.330924s 2024-08-18T21:04:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6292640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2dd00a6bd0 msgr2=0x7f2dd00a6fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:04:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6292640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2dd00a6bd0 0x7f2dd00a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:04:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2dd0139990 0x7f2dd0139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2dd0139990 0x7f2dd0139df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:49718/0 (socket says 172.21.15.5:49718) 2024-08-18T21:04:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 1 -- 172.21.15.5:0/3246203128 learned_addr learned my addr 172.21.15.5:0/3246203128 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:04:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 10 monclient(hunting): get_auth_request con 0x7f2dd0139990 auth_method 0 2024-08-18T21:04:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd5a91640 1 --2- 172.21.15.5:0/3246203128 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2dd009f080 0x7f2dd00a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd5a91640 10 monclient(hunting): get_auth_request con 0x7f2dd009f080 auth_method 0 2024-08-18T21:04:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd5a91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd5a91640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd5a91640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd5a91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd5a91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd5a91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 10 monclient(hunting): handle_auth_done global_id 4458 payload 274 2024-08-18T21:04:19.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 1 -- 172.21.15.5:0/3246203128 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2dd00a6bd0 msgr2=0x7f2dd00a6fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:04:19.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 1 --2- 172.21.15.5:0/3246203128 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2dd00a6bd0 0x7f2dd00a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 1 -- 172.21.15.5:0/3246203128 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2dd009f080 msgr2=0x7f2dd00a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:04:19.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 1 --2- 172.21.15.5:0/3246203128 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2dd009f080 0x7f2dd00a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 10 monclient: _finish_hunting 0 2024-08-18T21:04:19.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 1 monclient: found mon.noname-g 2024-08-18T21:04:19.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:19.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:04:19.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.313+0000 7f2dd6a93640 1 -- 172.21.15.5:0/3246203128 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd00a7fb0 con 0x7f2dd0139990 2024-08-18T21:04:19.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd6a93640 1 -- 172.21.15.5:0/3246203128 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2dd0139990 msgr2=0x7f2dd0139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd6a93640 1 --2- 172.21.15.5:0/3246203128 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2dd0139990 0x7f2dd0139df0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80098a0 tx=0x7f2dc801c460 comp rx=0 tx=0).ready entity=mon.3 client_cookie=38c7f07e39dcfd9c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd5290640 1 -- 172.21.15.5:0/3246203128 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2dc80b0070 con 0x7f2dd0139990 2024-08-18T21:04:19.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd5290640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd5290640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:04:19.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd5290640 10 monclient: dump: 2024-08-18T21:04:19.326 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.326 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.326 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.326 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.326 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.326 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.326 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.326 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.326 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.326 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.327 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.327 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.327 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.327 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.327 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.327 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd5290640 10 monclient: _finish_auth 0 2024-08-18T21:04:19.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd5290640 10 monclient: _check_auth_tickets 2024-08-18T21:04:19.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd5290640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:19.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd5290640 1 -- 172.21.15.5:0/3246203128 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc80aa810 con 0x7f2dd0139990 2024-08-18T21:04:19.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd5290640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:19.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd5290640 1 -- 172.21.15.5:0/3246203128 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2dc80aae30 con 0x7f2dd0139990 2024-08-18T21:04:19.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd5290640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd5290640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:04:19.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd5290640 10 monclient: dump: 2024-08-18T21:04:19.328 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.328 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.328 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.328 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.328 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.328 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.328 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.328 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.328 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.328 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.329 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.329 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.329 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.329 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.329 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.329 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 5 monclient: authenticate success, global_id 4458 2024-08-18T21:04:19.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 10 monclient: get_monmap_and_config success 2024-08-18T21:04:19.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 4 set_mon_vals no callback set 2024-08-18T21:04:19.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 10 monclient: shutdown 2024-08-18T21:04:19.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:04:19.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 1 -- 172.21.15.5:0/3246203128 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2dd0139990 msgr2=0x7f2dd0139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 1 --2- 172.21.15.5:0/3246203128 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2dd0139990 0x7f2dd0139df0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80098a0 tx=0x7f2dc801c460 comp rx=0 tx=0).stop 2024-08-18T21:04:19.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 1 -- 172.21.15.5:0/3246203128 shutdown_connections 2024-08-18T21:04:19.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 1 --2- 172.21.15.5:0/3246203128 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2dd0139990 0x7f2dd0139df0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 1 --2- 172.21.15.5:0/3246203128 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2dd009f080 0x7f2dd00a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 1 --2- 172.21.15.5:0/3246203128 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2dd00a6bd0 0x7f2dd00a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 1 -- 172.21.15.5:0/3246203128 >> 172.21.15.5:0/3246203128 conn(0x7f2dd0068700 msgr2=0x7f2dd0068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:04:19.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 1 -- 172.21.15.5:0/3246203128 shutdown_connections 2024-08-18T21:04:19.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 1 -- 172.21.15.5:0/3246203128 wait complete. 2024-08-18T21:04:19.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 10 monclient: build_initial_monmap 2024-08-18T21:04:19.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 10 monclient: monmap: 2024-08-18T21:04:19.330 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:04:19.330 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:04:19.330 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:04:19.330 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:04:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:04:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:04:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:04:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:04:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:04:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:04:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:04:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:04:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:04:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:04:19.331 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 1 Processor -- start 2024-08-18T21:04:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 1 -- start start 2024-08-18T21:04:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.321+0000 7f2dd84f6640 10 monclient: init 2024-08-18T21:04:19.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:19.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 10 monclient: _add_conns ranks=[1,5,6,3,8,0,7,4,2] 2024-08-18T21:04:19.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2dd009f080 0x7f2dd0138260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 10 monclient(hunting): picked mon.noname-f con 0x7f2dd009f080 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:04:19.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2dd00a6bd0 0x7f2dd01387a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 10 monclient(hunting): picked mon.noname-h con 0x7f2dd00a6bd0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:04:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2dd0139990 0x7f2dd013d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 10 monclient(hunting): picked mon.noname-d con 0x7f2dd0139990 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:04:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd00a89f0 con 0x7f2dd009f080 2024-08-18T21:04:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f2dd00a7ce0 con 0x7f2dd00a6bd0 2024-08-18T21:04:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f2dd0143610 con 0x7f2dd0139990 2024-08-18T21:04:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 10 monclient(hunting): authenticate will time out at 1026.340211s 2024-08-18T21:04:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd5a91640 1 -- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2dd00a6bd0 msgr2=0x7f2dd01387a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3302/0 2024-08-18T21:04:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd5a91640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2dd00a6bd0 0x7f2dd01387a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:04:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2dd0139990 0x7f2dd013d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2dd0139990 0x7f2dd013d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:59146/0 (socket says 172.21.15.5:59146) 2024-08-18T21:04:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 1 -- 172.21.15.5:0/1552335914 learned_addr learned my addr 172.21.15.5:0/1552335914 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:04:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 10 monclient(hunting): get_auth_request con 0x7f2dd0139990 auth_method 0 2024-08-18T21:04:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6292640 1 --2- 172.21.15.5:0/1552335914 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2dd009f080 0x7f2dd0138260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6292640 10 monclient(hunting): get_auth_request con 0x7f2dd009f080 auth_method 0 2024-08-18T21:04:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6292640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6292640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6292640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6292640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6292640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6292640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 10 monclient(hunting): handle_auth_done global_id 4488 payload 824 2024-08-18T21:04:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 1 -- 172.21.15.5:0/1552335914 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2dd00a6bd0 msgr2=0x7f2dd01387a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:04:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 1 --2- 172.21.15.5:0/1552335914 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2dd00a6bd0 0x7f2dd01387a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 1 -- 172.21.15.5:0/1552335914 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2dd009f080 msgr2=0x7f2dd0138260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 1 --2- 172.21.15.5:0/1552335914 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2dd009f080 0x7f2dd0138260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 10 monclient: _finish_hunting 0 2024-08-18T21:04:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 1 monclient: found mon.noname-d 2024-08-18T21:04:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:04:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 1 -- 172.21.15.5:0/1552335914 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd00ab370 con 0x7f2dd0139990 2024-08-18T21:04:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 1 -- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2dd0139990 msgr2=0x7f2dd013d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd6a93640 1 --2- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2dd0139990 0x7f2dd013d940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80098a0 tx=0x7f2dc8019200 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dceffd640 1 -- 172.21.15.5:0/1552335914 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2dc80b9020 con 0x7f2dd0139990 2024-08-18T21:04:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dceffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:04:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dceffd640 10 monclient: dump: 2024-08-18T21:04:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.341 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dceffd640 10 monclient: _finish_auth 0 2024-08-18T21:04:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dceffd640 10 monclient: _check_auth_tickets 2024-08-18T21:04:19.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:19.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dceffd640 1 -- 172.21.15.5:0/1552335914 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc80044b0 con 0x7f2dd0139990 2024-08-18T21:04:19.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 5 monclient: authenticate success, global_id 4488 2024-08-18T21:04:19.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 10 monclient: _renew_subs 2024-08-18T21:04:19.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:04:19.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 1 -- 172.21.15.5:0/1552335914 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd0124100 con 0x7f2dd0139990 2024-08-18T21:04:19.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dceffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:19.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dceffd640 1 -- 172.21.15.5:0/1552335914 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2dc80b0040 con 0x7f2dd0139990 2024-08-18T21:04:19.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dceffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:04:19.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dceffd640 10 monclient: dump: 2024-08-18T21:04:19.342 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.342 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.343 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.343 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.343 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.343 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.343 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.343 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.343 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.343 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.343 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.343 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.343 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.343 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.343 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.344 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 10 monclient: _renew_subs 2024-08-18T21:04:19.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:04:19.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dd84f6640 1 -- 172.21.15.5:0/1552335914 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd0123290 con 0x7f2dd0139990 2024-08-18T21:04:19.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.325+0000 7f2dcffff640 4 set_mon_vals no callback set 2024-08-18T21:04:19.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd84f6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:19.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd84f6640 1 --2- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2dd00a4220 0x7f2dd00a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd84f6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd84f6640 1 -- 172.21.15.5:0/1552335914 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f2dd01238e0 con 0x7f2dd00a4220 2024-08-18T21:04:19.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dceffd640 1 -- 172.21.15.5:0/1552335914 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f2dc80bc020 con 0x7f2dd0139990 2024-08-18T21:04:19.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd6292640 1 --2- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2dd00a4220 0x7f2dd00a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd6292640 10 monclient: get_auth_request con 0x7f2dd00a4220 auth_method 0 2024-08-18T21:04:19.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd6292640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd6292640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd6292640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd6292640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd6292640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd6292640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dceffd640 1 --2- 172.21.15.5:0/1552335914 >> v2:172.21.15.157:6812/631023601 conn(0x7f2dbc03bdc0 0x7f2dbc03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dceffd640 1 -- 172.21.15.5:0/1552335914 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(23..23 src has 1..23) ==== 3898+0+0 (secure 0 0 0) 0x7f2dc80e8290 con 0x7f2dd0139990 2024-08-18T21:04:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd6292640 10 monclient(hunting): handle_auth_done global_id 4540 payload 824 2024-08-18T21:04:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd6292640 1 -- 172.21.15.5:0/1552335914 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2dd0139df0 con 0x7f2dd00a4220 2024-08-18T21:04:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd5a91640 1 --2- 172.21.15.5:0/1552335914 >> v2:172.21.15.157:6812/631023601 conn(0x7f2dbc03bdc0 0x7f2dbc03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd5a91640 10 monclient: get_auth_request con 0x7f2dbc03bdc0 auth_method 0 2024-08-18T21:04:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd6292640 1 -- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2dd00a4220 msgr2=0x7f2dd00a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dd6292640 1 --2- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2dd00a4220 0x7f2dd00a4600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009ed0 tx=0x7f2dc0007660 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dceffd640 1 -- 172.21.15.5:0/1552335914 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2dc001a070 con 0x7f2dd00a4220 2024-08-18T21:04:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:04:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dceffd640 10 monclient: dump: 2024-08-18T21:04:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.347 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dceffd640 1 -- 172.21.15.5:0/1552335914 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2dc00054f0 con 0x7f2dd00a4220 2024-08-18T21:04:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dceffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dceffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:04:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dceffd640 1 -- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2dd00a4220 msgr2=0x7f2dd00a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dceffd640 1 --2- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2dd00a4220 0x7f2dd00a4600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009ed0 tx=0x7f2dc0007660 comp rx=0 tx=0).stop 2024-08-18T21:04:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dceffd640 1 -- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2dd00a4220 msgr2=0x7f2dd00a4600 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:04:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.329+0000 7f2dceffd640 1 --2- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2dd00a4220 0x7f2dd00a4600 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009ed0 tx=0x7f2dc0007660 comp rx=0 tx=0).stop 2024-08-18T21:04:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.333+0000 7f2dd5a91640 1 --2- 172.21.15.5:0/1552335914 >> v2:172.21.15.157:6812/631023601 conn(0x7f2dbc03bdc0 0x7f2dbc03e280 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2dd013f0a0 tx=0x7f2dc4009190 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.337+0000 7f2dd84f6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:04:19.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.337+0000 7f2dd84f6640 1 --2- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2dd00a4b40 0x7f2dd013de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.337+0000 7f2dd84f6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.337+0000 7f2dd84f6640 1 -- 172.21.15.5:0/1552335914 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f2dd0051140 con 0x7f2dd00a4b40 2024-08-18T21:04:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.337+0000 7f2dd6292640 1 --2- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2dd00a4b40 0x7f2dd013de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.337+0000 7f2dd6292640 10 monclient: get_auth_request con 0x7f2dd00a4b40 auth_method 0 2024-08-18T21:04:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.337+0000 7f2dd6292640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.337+0000 7f2dd6292640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.337+0000 7f2dd6292640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.337+0000 7f2dd6292640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.337+0000 7f2dd6292640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.337+0000 7f2dd6292640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.337+0000 7f2dd6292640 10 monclient(hunting): handle_auth_done global_id 4549 payload 824 2024-08-18T21:04:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.337+0000 7f2dd6292640 1 -- 172.21.15.5:0/1552335914 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2dd0122820 con 0x7f2dd00a4b40 2024-08-18T21:04:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dd6292640 1 -- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2dd00a4b40 msgr2=0x7f2dd013de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dd6292640 1 --2- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2dd00a4b40 0x7f2dd013de80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0000f90 tx=0x7f2dc0005d60 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dceffd640 1 -- 172.21.15.5:0/1552335914 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2dc001a070 con 0x7f2dd00a4b40 2024-08-18T21:04:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:04:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dceffd640 10 monclient: dump: 2024-08-18T21:04:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.352 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dceffd640 1 -- 172.21.15.5:0/1552335914 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9391 (secure 0 0 0) 0x7f2dc001c830 con 0x7f2dd00a4b40 2024-08-18T21:04:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dceffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:04:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dceffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:04:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dceffd640 1 -- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2dd00a4b40 msgr2=0x7f2dd013de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dceffd640 1 --2- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2dd00a4b40 0x7f2dd013de80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0000f90 tx=0x7f2dc0005d60 comp rx=0 tx=0).stop 2024-08-18T21:04:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dceffd640 1 -- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2dd00a4b40 msgr2=0x7f2dd013de80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:04:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dceffd640 1 --2- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2dd00a4b40 0x7f2dd013de80 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0000f90 tx=0x7f2dc0005d60 comp rx=0 tx=0).stop 2024-08-18T21:04:19.353 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:04:19.353 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:04:19.353 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:04:19.353 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:04:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 18, 2024-08-18T21:04:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 68459, 2024-08-18T21:04:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:04:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:04:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:04:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:04:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:04:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:04:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:04:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:04:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:04:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:04:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:04:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:04:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:04:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:04:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:04:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:04:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:04:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:04:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:04:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:04:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:04:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:04:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:04:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:04:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:04:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:04:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:04:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:04:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:04:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:04:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:04:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:04:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:04:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:04:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:04:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:04:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:04:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:04:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:04:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:04:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:04:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:04:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:04:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:04:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:04:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:04:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:04:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:04:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:04:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:04:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:04:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:04:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:04:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:04:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:04:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:04:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:04:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:04:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:04:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:04:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:04:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:04:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:04:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:04:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:04:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:04:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:04:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:04:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:04:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:04:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:04:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:04:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:04:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:04:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:04:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:04:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:04:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:04:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:04:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:04:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:04:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:04:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:04:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:04:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:04:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:04:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:04:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:04:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:04:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:04:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:04:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:04:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:04:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:04:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:04:19.377 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:04:19.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dd84f6640 1 -- 172.21.15.5:0/1552335914 >> v2:172.21.15.157:6812/631023601 conn(0x7f2dbc03bdc0 msgr2=0x7f2dbc03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dd84f6640 1 --2- 172.21.15.5:0/1552335914 >> v2:172.21.15.157:6812/631023601 conn(0x7f2dbc03bdc0 0x7f2dbc03e280 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2dd013f0a0 tx=0x7f2dc4009190 comp rx=0 tx=0).stop 2024-08-18T21:04:19.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dd84f6640 10 monclient: shutdown 2024-08-18T21:04:19.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dd84f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:04:19.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dd84f6640 1 -- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2dd0139990 msgr2=0x7f2dd013d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dd84f6640 1 --2- 172.21.15.5:0/1552335914 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2dd0139990 0x7f2dd013d940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80098a0 tx=0x7f2dc8019200 comp rx=0 tx=0).stop 2024-08-18T21:04:19.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dd6a93640 1 -- 172.21.15.5:0/1552335914 reap_dead start 2024-08-18T21:04:19.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dd6a93640 1 -- 172.21.15.5:0/1552335914 reap_dead start 2024-08-18T21:04:19.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dd84f6640 1 -- 172.21.15.5:0/1552335914 shutdown_connections 2024-08-18T21:04:19.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dd84f6640 1 -- 172.21.15.5:0/1552335914 >> 172.21.15.5:0/1552335914 conn(0x7f2dd0068700 msgr2=0x7f2dd00aa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:04:19.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dd84f6640 1 -- 172.21.15.5:0/1552335914 shutdown_connections 2024-08-18T21:04:19.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.341+0000 7f2dd84f6640 1 -- 172.21.15.5:0/1552335914 wait complete. 2024-08-18T21:04:19.379 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:04:19.379 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon d 2024-08-18T21:04:19.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:04:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.497+0000 7ff053c39640 10 monclient: get_monmap_and_config 2024-08-18T21:04:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.497+0000 7ff053c39640 10 monclient: build_initial_monmap 2024-08-18T21:04:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.497+0000 7ff053c39640 10 monclient: monmap: 2024-08-18T21:04:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:04:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:04:19.503541+0000 2024-08-18T21:04:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:04:19.503541+0000 2024-08-18T21:04:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:04:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:04:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:04:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:04:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:04:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:04:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:04:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:04:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:04:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:04:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:04:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:04:19.503 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 1 Processor -- start 2024-08-18T21:04:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 1 -- start start 2024-08-18T21:04:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 10 monclient: init 2024-08-18T21:04:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 10 monclient: _add_conns ranks=[2,5,3,1,9,8,7,4,6,10,0] 2024-08-18T21:04:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff04c09b5d0 0x7ff04c09dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 10 monclient(hunting): picked mon.noname-b con 0x7ff04c09b5d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:04:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff04c09b9b0 0x7ff04c0a4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 10 monclient(hunting): picked mon.noname-h con 0x7ff04c09b9b0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:04:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff04c09bdb0 0x7ff04c0a4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 10 monclient(hunting): picked mon.noname-g con 0x7ff04c09bdb0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:04:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7ff04c09c800 con 0x7ff04c09b5d0 2024-08-18T21:04:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff04c09cae0 con 0x7ff04c09bdb0 2024-08-18T21:04:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7ff04c09cdc0 con 0x7ff04c09b9b0 2024-08-18T21:04:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff053c39640 10 monclient(hunting): authenticate will time out at 1026.517578s 2024-08-18T21:04:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff04c09b5d0 0x7ff04c09dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff04c09b5d0 0x7ff04c09dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:44490/0 (socket says 172.21.15.5:44490) 2024-08-18T21:04:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 1 -- 172.21.15.5:0/2036159013 learned_addr learned my addr 172.21.15.5:0/2036159013 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:04:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 10 monclient(hunting): get_auth_request con 0x7ff04c09b5d0 auth_method 0 2024-08-18T21:04:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0511d4640 1 -- 172.21.15.5:0/2036159013 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff04c09b9b0 msgr2=0x7ff04c0a4000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3302/0 2024-08-18T21:04:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0511d4640 1 --2- 172.21.15.5:0/2036159013 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff04c09b9b0 0x7ff04c0a4000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:04:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0521d6640 1 --2- 172.21.15.5:0/2036159013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff04c09bdb0 0x7ff04c0a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 10 monclient(hunting): handle_auth_done global_id 4610 payload 274 2024-08-18T21:04:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 1 -- 172.21.15.5:0/2036159013 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff04c09b9b0 msgr2=0x7ff04c0a4000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:04:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 1 --2- 172.21.15.5:0/2036159013 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff04c09b9b0 0x7ff04c0a4000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 1 -- 172.21.15.5:0/2036159013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff04c09bdb0 msgr2=0x7ff04c0a4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:04:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 1 --2- 172.21.15.5:0/2036159013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff04c09bdb0 0x7ff04c0a4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 10 monclient: _finish_hunting 0 2024-08-18T21:04:19.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 1 monclient: found mon.noname-b 2024-08-18T21:04:19.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:19.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:04:19.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0519d5640 1 -- 172.21.15.5:0/2036159013 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04c09d0a0 con 0x7ff04c09b5d0 2024-08-18T21:04:19.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0521d6640 10 monclient: get_auth_request con 0x7ff04c09bdb0 auth_method 0 2024-08-18T21:04:19.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.501+0000 7ff0521d6640 1 --2- 172.21.15.5:0/2036159013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff04c09bdb0 0x7ff04c0a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:04:19.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff0519d5640 1 -- 172.21.15.5:0/2036159013 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff04c09b5d0 msgr2=0x7ff04c09dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff0519d5640 1 --2- 172.21.15.5:0/2036159013 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff04c09b5d0 0x7ff04c09dad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff044009e80 tx=0x7ff04401c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71de992152b6253b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff0509d3640 1 -- 172.21.15.5:0/2036159013 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff0440091b0 con 0x7ff04c09b5d0 2024-08-18T21:04:19.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff0509d3640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff0509d3640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:04:19.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff0509d3640 10 monclient: dump: 2024-08-18T21:04:19.513 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.513 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.513 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.513 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.513 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.514 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.514 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.514 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.514 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.514 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.514 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.514 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.514 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.514 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.514 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.514 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff0509d3640 10 monclient: _finish_auth 0 2024-08-18T21:04:19.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff0509d3640 10 monclient: _check_auth_tickets 2024-08-18T21:04:19.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff0509d3640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:19.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff0509d3640 1 -- 172.21.15.5:0/2036159013 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0440a5a90 con 0x7ff04c09b5d0 2024-08-18T21:04:19.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff0509d3640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:19.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff0509d3640 1 -- 172.21.15.5:0/2036159013 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff0440a5c80 con 0x7ff04c09b5d0 2024-08-18T21:04:19.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff0509d3640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff0509d3640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:04:19.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff0509d3640 10 monclient: dump: 2024-08-18T21:04:19.515 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.515 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.515 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.515 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.515 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.515 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.516 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.516 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.516 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.516 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.516 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.516 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.516 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.516 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.516 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.516 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff053c39640 5 monclient: authenticate success, global_id 4610 2024-08-18T21:04:19.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff053c39640 10 monclient: get_monmap_and_config success 2024-08-18T21:04:19.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff053c39640 4 set_mon_vals no callback set 2024-08-18T21:04:19.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff053c39640 10 monclient: shutdown 2024-08-18T21:04:19.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff053c39640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:04:19.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff053c39640 1 -- 172.21.15.5:0/2036159013 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff04c09b5d0 msgr2=0x7ff04c09dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.509+0000 7ff053c39640 1 --2- 172.21.15.5:0/2036159013 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff04c09b5d0 0x7ff04c09dad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff044009e80 tx=0x7ff04401c930 comp rx=0 tx=0).stop 2024-08-18T21:04:19.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.513+0000 7ff053c39640 1 -- 172.21.15.5:0/2036159013 shutdown_connections 2024-08-18T21:04:19.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.513+0000 7ff053c39640 1 --2- 172.21.15.5:0/2036159013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff04c09bdb0 0x7ff04c0a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.513+0000 7ff053c39640 1 --2- 172.21.15.5:0/2036159013 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff04c09b9b0 0x7ff04c0a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.513+0000 7ff053c39640 1 --2- 172.21.15.5:0/2036159013 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff04c09b5d0 0x7ff04c09dad0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff044009e80 tx=0x7ff04401c930 comp rx=0 tx=0).stop 2024-08-18T21:04:19.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.513+0000 7ff053c39640 1 -- 172.21.15.5:0/2036159013 >> 172.21.15.5:0/2036159013 conn(0x7ff04c0a50f0 msgr2=0x7ff04c0a54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:04:19.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.513+0000 7ff053c39640 1 -- 172.21.15.5:0/2036159013 shutdown_connections 2024-08-18T21:04:19.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.513+0000 7ff053c39640 1 -- 172.21.15.5:0/2036159013 wait complete. 2024-08-18T21:04:19.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.513+0000 7ff053c39640 10 monclient: build_initial_monmap 2024-08-18T21:04:19.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.513+0000 7ff053c39640 10 monclient: monmap: 2024-08-18T21:04:19.518 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:04:19.518 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:04:19.518 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:04:19.518 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:04:19.518 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:04:19.518 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.519 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:04:19.519 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:04:19.519 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:04:19.519 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:04:19.519 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:04:19.519 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:04:19.519 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:04:19.519 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:04:19.519 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:04:19.519 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.513+0000 7ff053c39640 1 Processor -- start 2024-08-18T21:04:19.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.513+0000 7ff053c39640 1 -- start start 2024-08-18T21:04:19.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.513+0000 7ff053c39640 10 monclient: init 2024-08-18T21:04:19.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff053c39640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:19.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff053c39640 10 monclient: _add_conns ranks=[0,1,5,7,3,8,2,6,4] 2024-08-18T21:04:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff053c39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff04c09b9b0 0x7ff04c13fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff053c39640 10 monclient(hunting): picked mon.noname-a con 0x7ff04c09b9b0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:04:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff053c39640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff04c09bdb0 0x7ff04c08f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff053c39640 10 monclient(hunting): picked mon.noname-f con 0x7ff04c09bdb0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:04:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff053c39640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff04c08fa10 0x7ff04c1d1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff053c39640 10 monclient(hunting): picked mon.noname-h con 0x7ff04c08fa10 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:04:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff053c39640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff053c39640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c143650 con 0x7ff04c09b9b0 2024-08-18T21:04:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff053c39640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff053c39640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c1434d0 con 0x7ff04c09bdb0 2024-08-18T21:04:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff053c39640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff053c39640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7ff04c1437d0 con 0x7ff04c08fa10 2024-08-18T21:04:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff053c39640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff053c39640 10 monclient(hunting): authenticate will time out at 1026.532469s 2024-08-18T21:04:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0521d6640 1 -- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff04c08fa10 msgr2=0x7ff04c1d1760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3302/0 2024-08-18T21:04:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0521d6640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff04c08fa10 0x7ff04c1d1760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:04:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff04c09b9b0 0x7ff04c13fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff04c09b9b0 0x7ff04c13fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50412/0 (socket says 172.21.15.5:50412) 2024-08-18T21:04:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 1 -- 172.21.15.5:0/3177655917 learned_addr learned my addr 172.21.15.5:0/3177655917 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:04:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 10 monclient(hunting): get_auth_request con 0x7ff04c09b9b0 auth_method 0 2024-08-18T21:04:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0511d4640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff04c09bdb0 0x7ff04c08f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0511d4640 10 monclient(hunting): get_auth_request con 0x7ff04c09bdb0 auth_method 0 2024-08-18T21:04:19.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0511d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0511d4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0511d4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0511d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0511d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0511d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 10 monclient(hunting): handle_auth_done global_id 4563 payload 824 2024-08-18T21:04:19.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 1 -- 172.21.15.5:0/3177655917 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff04c08fa10 msgr2=0x7ff04c1d1760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:04:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff04c08fa10 0x7ff04c1d1760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 1 -- 172.21.15.5:0/3177655917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff04c09bdb0 msgr2=0x7ff04c08f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff04c09bdb0 0x7ff04c08f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 10 monclient: _finish_hunting 0 2024-08-18T21:04:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 1 monclient: found mon.noname-a 2024-08-18T21:04:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:04:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 1 -- 172.21.15.5:0/3177655917 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04c09ec50 con 0x7ff04c09b9b0 2024-08-18T21:04:19.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 1 -- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff04c09b9b0 msgr2=0x7ff04c13fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.517+0000 7ff0519d5640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff04c09b9b0 0x7ff04c13fcb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff04401d1d0 tx=0x7ff0440196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff0440bc030 con 0x7ff04c09b9b0 2024-08-18T21:04:19.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:04:19.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient: dump: 2024-08-18T21:04:19.530 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.530 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.532 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient: _finish_auth 0 2024-08-18T21:04:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient: _check_auth_tickets 2024-08-18T21:04:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff044003bb0 con 0x7ff04c09b9b0 2024-08-18T21:04:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff053c39640 5 monclient: authenticate success, global_id 4563 2024-08-18T21:04:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff044003d60 con 0x7ff04c09b9b0 2024-08-18T21:04:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:04:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient: dump: 2024-08-18T21:04:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.533 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.533 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.533 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.533 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.533 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.533 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.533 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.533 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.533 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.533 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.533 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.533 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.533 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff053c39640 10 monclient: _renew_subs 2024-08-18T21:04:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff053c39640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:04:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff053c39640 1 -- 172.21.15.5:0/3177655917 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04c13ca80 con 0x7ff04c09b9b0 2024-08-18T21:04:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0437fe640 4 set_mon_vals no callback set 2024-08-18T21:04:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff053c39640 10 monclient: _renew_subs 2024-08-18T21:04:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff053c39640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:04:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff053c39640 1 -- 172.21.15.5:0/3177655917 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff04c091e50 con 0x7ff04c09b9b0 2024-08-18T21:04:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 1 -- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff04c09b9b0 msgr2=0x7ff04c13fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-18T21:04:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 1 -- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff04c09b9b0 msgr2=0x7ff04c13fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:04:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff04c09b9b0 0x7ff04c13fcb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff04401d1d0 tx=0x7ff0440196d0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:04:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff04c09b9b0 0x7ff04c13fcb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff04401d1d0 tx=0x7ff0440196d0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient: ms_handle_reset current mon [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:04:19.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:19.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff04c09b9b0 msgr2=0x7ff04c13fcb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:04:19.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff04c09b9b0 0x7ff04c13fcb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff02ffff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:19.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient: _add_conns ranks=[1,6,0,3,8,4,2,7,5] 2024-08-18T21:04:19.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff04c09bdb0 0x7ff030006d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient(hunting): picked mon.f con 0x7ff04c09bdb0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:04:19.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff0300074c0 0x7ff0300098b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient(hunting): picked mon.d con 0x7ff0300074c0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:04:19.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03000a260 0x7ff03000c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient(hunting): picked mon.a con 0x7ff03000a260 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:04:19.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff03000d220 con 0x7ff03000a260 2024-08-18T21:04:19.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff03000d3d0 con 0x7ff04c09bdb0 2024-08-18T21:04:19.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7ff03000d580 con 0x7ff0300074c0 2024-08-18T21:04:19.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0427fc640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:19.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff02ffff640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff04c13fcb0 0x7ff04c08f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0511d4640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff0300074c0 0x7ff0300098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff02ffff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff02ffff640 1 -- 172.21.15.5:0/3177655917 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7ff04c051140 con 0x7ff04c13fcb0 2024-08-18T21:04:19.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0511d4640 10 monclient(hunting): get_auth_request con 0x7ff0300074c0 auth_method 0 2024-08-18T21:04:19.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0511d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0511d4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0511d4640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:19.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff04c13fcb0 0x7ff04c08f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 10 monclient(hunting): get_auth_request con 0x7ff04c13fcb0 auth_method 0 2024-08-18T21:04:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03000a260 0x7ff03000c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0511d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0511d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0511d4640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:04:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 10 monclient(hunting): get_auth_request con 0x7ff03000a260 auth_method 0 2024-08-18T21:04:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff04c09bdb0 0x7ff030006d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:04:19.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 10 monclient(hunting): get_auth_request con 0x7ff04c09bdb0 auth_method 0 2024-08-18T21:04:19.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:04:19.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 10 monclient(hunting): handle_auth_done global_id 4563 payload 293 2024-08-18T21:04:19.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 1 -- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff0300074c0 msgr2=0x7ff0300098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff0300074c0 0x7ff0300098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 1 -- 172.21.15.5:0/3177655917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff04c09bdb0 msgr2=0x7ff030006d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff04c09bdb0 0x7ff030006d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 10 monclient: _finish_hunting 0 2024-08-18T21:04:19.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 1 monclient: found mon.a 2024-08-18T21:04:19.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:19.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:04:19.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 1 -- 172.21.15.5:0/3177655917 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7ff03000d900 con 0x7ff03000a260 2024-08-18T21:04:19.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 10 monclient: _finish_auth 0 2024-08-18T21:04:19.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 10 monclient: _check_auth_tickets 2024-08-18T21:04:19.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0521d6640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:19.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 10 monclient(hunting): handle_auth_done global_id 4497 payload 824 2024-08-18T21:04:19.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.521+0000 7ff0519d5640 1 -- 172.21.15.5:0/3177655917 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff04c09eff0 con 0x7ff04c13fcb0 2024-08-18T21:04:19.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0521d6640 1 -- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03000a260 msgr2=0x7ff03000c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0521d6640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03000a260 0x7ff03000c6f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff04c06f8b0 tx=0x7ff0440a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0519d5640 1 -- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff04c13fcb0 msgr2=0x7ff04c08f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0519d5640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff04c13fcb0 0x7ff04c08f4d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff0440072a0 tx=0x7ff0440d5f30 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff048015020 con 0x7ff03000a260 2024-08-18T21:04:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:04:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 10 monclient: dump: 2024-08-18T21:04:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.541 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff04800a270 con 0x7ff03000a260 2024-08-18T21:04:19.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:19.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff0440b8470 con 0x7ff04c13fcb0 2024-08-18T21:04:19.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:04:19.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 10 monclient: dump: 2024-08-18T21:04:19.542 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.542 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.542 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.542 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.542 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.542 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.543 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.543 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.543 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.543 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.543 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.543 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.543 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.543 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.543 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.543 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff043fff640 4 set_mon_vals no callback set 2024-08-18T21:04:19.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff044004490 con 0x7ff04c13fcb0 2024-08-18T21:04:19.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:04:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff04c13fcb0 msgr2=0x7ff04c08f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff04c13fcb0 0x7ff04c08f4d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff0440072a0 tx=0x7ff0440d5f30 comp rx=0 tx=0).stop 2024-08-18T21:04:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff04c13fcb0 msgr2=0x7ff04c08f4d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:04:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff04c13fcb0 0x7ff04c08f4d0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff0440072a0 tx=0x7ff0440d5f30 comp rx=0 tx=0).stop 2024-08-18T21:04:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7ff048018020 con 0x7ff03000a260 2024-08-18T21:04:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 1 --2- 172.21.15.5:0/3177655917 >> v2:172.21.15.157:6812/631023601 conn(0x7ff04c09b9b0 0x7ff030047100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 <== mon.0 v2:172.21.15.5:3300/0 4 ==== osd_map(24..24 src has 1..24) ==== 3506+0+0 (secure 0 0 0) 0x7ff04804bca0 con 0x7ff03000a260 2024-08-18T21:04:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0519d5640 1 --2- 172.21.15.5:0/3177655917 >> v2:172.21.15.157:6812/631023601 conn(0x7ff04c09b9b0 0x7ff030047100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.525+0000 7ff0519d5640 10 monclient: get_auth_request con 0x7ff04c09b9b0 auth_method 0 2024-08-18T21:04:19.545 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28003]: starting. 2024-08-18T21:04:19.545 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28003]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28001 2024-08-18T21:04:19.545 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28003]: shutting down. 2024-08-18T21:04:19.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.529+0000 7ff0519d5640 1 --2- 172.21.15.5:0/3177655917 >> v2:172.21.15.157:6812/631023601 conn(0x7ff04c09b9b0 0x7ff030047100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff044019710 tx=0x7ff0440b9000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff02ffff640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:04:19.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff02ffff640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff04c0a64d0 0x7ff04c0a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff02ffff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff02ffff640 1 -- 172.21.15.5:0/3177655917 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7ff04c09dad0 con 0x7ff04c0a64d0 2024-08-18T21:04:19.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0511d4640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff04c0a64d0 0x7ff04c0a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0511d4640 10 monclient: get_auth_request con 0x7ff04c0a64d0 auth_method 0 2024-08-18T21:04:19.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0511d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0511d4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0511d4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0511d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0511d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0511d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0511d4640 10 monclient(hunting): handle_auth_done global_id 4506 payload 824 2024-08-18T21:04:19.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0511d4640 1 -- 172.21.15.5:0/3177655917 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff04c06d960 con 0x7ff04c0a64d0 2024-08-18T21:04:19.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0511d4640 1 -- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff04c0a64d0 msgr2=0x7ff04c0a68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0511d4640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff04c0a64d0 0x7ff04c0a68e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff030004100 tx=0x7ff03c009ae0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff03c014440 con 0x7ff04c0a64d0 2024-08-18T21:04:19.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0427fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:04:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0427fc640 10 monclient: dump: 2024-08-18T21:04:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.550 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9391 (secure 0 0 0) 0x7ff03c011ab0 con 0x7ff04c0a64d0 2024-08-18T21:04:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0427fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:04:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0427fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:04:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff04c0a64d0 msgr2=0x7ff04c0a68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0427fc640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff04c0a64d0 0x7ff04c0a68e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff030004100 tx=0x7ff03c009ae0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0427fc640 1 -- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff04c0a64d0 msgr2=0x7ff04c0a68e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:04:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0427fc640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff04c0a64d0 0x7ff04c0a68e0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff030004100 tx=0x7ff03c009ae0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff0521d6640 1 -- 172.21.15.5:0/3177655917 reap_dead start 2024-08-18T21:04:19.551 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:04:19.551 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:04:19.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:04:19.551 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:04:19.551 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 18, 2024-08-18T21:04:19.551 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 68643, 2024-08-18T21:04:19.551 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:04:19.551 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:04:19.551 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:04:19.551 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:04:19.551 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:04:19.552 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:04:19.552 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:04:19.552 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:04:19.552 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.552 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:04:19.552 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:04:19.552 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:04:19.552 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:04:19.552 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:19.552 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:19.552 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:19.552 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:19.552 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:19.553 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:19.553 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:19.553 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:19.553 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:19.553 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:19.553 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:19.553 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.553 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:04:19.553 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:04:19.553 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:19.553 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:19.553 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:19.553 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:19.554 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:19.554 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:19.554 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:19.554 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:19.554 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:19.554 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:19.554 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:19.554 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.554 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:04:19.554 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:04:19.554 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:04:19.554 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:04:19.555 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:04:19.555 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:04:19.555 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:04:19.555 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:04:19.555 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:04:19.555 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:04:19.555 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:04:19.555 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:04:19.555 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:04:19.555 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:04:19.555 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:04:19.555 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:04:19.555 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:04:19.556 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:19.556 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:19.556 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:19.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:19.556 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:19.556 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:19.556 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:19.556 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:19.556 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:19.556 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:19.556 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:19.556 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.556 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:04:19.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.557 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:04:19.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:04:19.557 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:04:19.557 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.557 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.557 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.557 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:04:19.557 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.557 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.558 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:04:19.558 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.558 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.558 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.558 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:04:19.558 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:04:19.558 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.558 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.558 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.558 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.558 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:04:19.559 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:04:19.559 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.559 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.559 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.559 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:04:19.559 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.559 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.559 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:04:19.559 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.559 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.560 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.560 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:04:19.560 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:04:19.560 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.560 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.560 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.560 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:04:19.560 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:04:19.560 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.560 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.561 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.561 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:04:19.561 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.561 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.561 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:04:19.561 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.561 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.561 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.561 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:04:19.562 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:04:19.562 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.562 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.562 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:04:19.562 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:04:19.562 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.562 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.562 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.563 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:04:19.563 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.563 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.563 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.563 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:04:19.563 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.563 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.563 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.563 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:04:19.563 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:04:19.563 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.564 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.564 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:04:19.564 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:04:19.564 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.564 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.564 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.564 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:04:19.564 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.565 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.565 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:04:19.565 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.565 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.565 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.565 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:04:19.565 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:04:19.565 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.565 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.565 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.565 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.566 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:04:19.566 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:04:19.566 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.566 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.566 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.566 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:04:19.566 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.566 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.566 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:04:19.566 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.567 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.567 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.567 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:04:19.567 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:04:19.567 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.567 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.567 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.567 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:04:19.567 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:04:19.567 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.568 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.568 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.568 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:04:19.568 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.568 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.568 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:04:19.568 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.568 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.568 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.568 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:04:19.569 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:04:19.569 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.569 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.569 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.569 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:04:19.569 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:04:19.569 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.569 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.569 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:04:19.569 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.570 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.570 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:04:19.570 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.570 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.570 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.570 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:04:19.570 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:04:19.570 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.570 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.570 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.571 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:04:19.571 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:04:19.571 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.571 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:04:19.571 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.571 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:04:19.572 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.572 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.572 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.572 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:04:19.572 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:04:19.572 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.572 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.572 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.572 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.572 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.573 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:04:19.573 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:04:19.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.573 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.573 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.573 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:04:19.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.573 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.573 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:04:19.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.573 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.573 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.573 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:04:19.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.573 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.574 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:04:19.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.574 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.574 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.574 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:04:19.574 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.574 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.574 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:04:19.574 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:04:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff02ffff640 1 -- 172.21.15.5:0/3177655917 >> v2:172.21.15.157:6812/631023601 conn(0x7ff04c09b9b0 msgr2=0x7ff030047100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff02ffff640 1 --2- 172.21.15.5:0/3177655917 >> v2:172.21.15.157:6812/631023601 conn(0x7ff04c09b9b0 0x7ff030047100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff044019710 tx=0x7ff0440b9000 comp rx=0 tx=0).stop 2024-08-18T21:04:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff02ffff640 10 monclient: shutdown 2024-08-18T21:04:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff02ffff640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:04:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff02ffff640 1 -- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03000a260 msgr2=0x7ff03000c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff02ffff640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03000a260 0x7ff03000c6f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff04c06f8b0 tx=0x7ff0440a7070 comp rx=0 tx=0).stop 2024-08-18T21:04:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff02ffff640 1 -- 172.21.15.5:0/3177655917 shutdown_connections 2024-08-18T21:04:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff02ffff640 1 --2- 172.21.15.5:0/3177655917 >> v2:172.21.15.157:6812/631023601 conn(0x7ff04c09b9b0 0x7ff030047100 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff02ffff640 1 --2- 172.21.15.5:0/3177655917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03000a260 0x7ff03000c6f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff02ffff640 1 -- 172.21.15.5:0/3177655917 >> 172.21.15.5:0/3177655917 conn(0x7ff04c0a50f0 msgr2=0x7ff04c0a1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:04:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff02ffff640 1 -- 172.21.15.5:0/3177655917 shutdown_connections 2024-08-18T21:04:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.533+0000 7ff02ffff640 1 -- 172.21.15.5:0/3177655917 wait complete. 2024-08-18T21:04:19.577 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:04:19.577 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon f 2024-08-18T21:04:19.577 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:04:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.689+0000 7f07f96d6640 10 monclient: get_monmap_and_config 2024-08-18T21:04:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.689+0000 7f07f96d6640 10 monclient: build_initial_monmap 2024-08-18T21:04:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.689+0000 7f07f96d6640 10 monclient: monmap: 2024-08-18T21:04:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:04:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:04:19.696098+0000 2024-08-18T21:04:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:04:19.696098+0000 2024-08-18T21:04:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:04:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:04:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:04:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:04:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:04:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:04:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:04:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:04:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:04:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:04:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:04:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:04:19.695 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 1 Processor -- start 2024-08-18T21:04:19.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 1 -- start start 2024-08-18T21:04:19.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 10 monclient: init 2024-08-18T21:04:19.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:19.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 10 monclient: _add_conns ranks=[8,5,9,1,0,3,6,7,10,4,2] 2024-08-18T21:04:19.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f07f40a6ce0 0x7f07f40a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 10 monclient(hunting): picked mon.noname-e con 0x7f07f40a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:04:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f07f40a7600 0x7f07f4139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 10 monclient(hunting): picked mon.noname-h con 0x7f07f40a7600 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:04:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07f4139fe0 0x7f07f413a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 10 monclient(hunting): picked mon.noname-a con 0x7f07f4139fe0 addr v2:172.21.15.5:3300/0 2024-08-18T21:04:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f07f40a5000 con 0x7f07f4139fe0 2024-08-18T21:04:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f07f40a4360 con 0x7f07f40a7600 2024-08-18T21:04:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f07f40a45d0 con 0x7f07f40a6ce0 2024-08-18T21:04:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f96d6640 10 monclient(hunting): authenticate will time out at 1026.709237s 2024-08-18T21:04:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f2ffd640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f07f40a6ce0 msgr2=0x7f07f40a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:04:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f2ffd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f07f40a6ce0 0x7f07f40a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:04:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f27fc640 1 -- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f07f40a7600 msgr2=0x7f07f4139aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3302/0 2024-08-18T21:04:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07f4139fe0 0x7f07f413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f27fc640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f07f40a7600 0x7f07f4139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:04:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07f4139fe0 0x7f07f413a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50428/0 (socket says 172.21.15.5:50428) 2024-08-18T21:04:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 1 -- 172.21.15.5:0/2593554778 learned_addr learned my addr 172.21.15.5:0/2593554778 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:04:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 10 monclient(hunting): get_auth_request con 0x7f07f4139fe0 auth_method 0 2024-08-18T21:04:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 10 monclient(hunting): handle_auth_done global_id 4590 payload 274 2024-08-18T21:04:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 1 -- 172.21.15.5:0/2593554778 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f07f40a6ce0 msgr2=0x7f07f40a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:04:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 1 --2- 172.21.15.5:0/2593554778 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f07f40a6ce0 0x7f07f40a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 1 -- 172.21.15.5:0/2593554778 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f07f40a7600 msgr2=0x7f07f4139aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:04:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 1 --2- 172.21.15.5:0/2593554778 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f07f40a7600 0x7f07f4139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 10 monclient: _finish_hunting 0 2024-08-18T21:04:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 1 monclient: found mon.noname-a 2024-08-18T21:04:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:04:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.693+0000 7f07f37fe640 1 -- 172.21.15.5:0/2593554778 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f40a32d0 con 0x7f07f4139fe0 2024-08-18T21:04:19.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f37fe640 1 -- 172.21.15.5:0/2593554778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f4139fe0 msgr2=0x7f07f413a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f37fe640 1 --2- 172.21.15.5:0/2593554778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f4139fe0 0x7f07f413a440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009e50 tx=0x7f07ec01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d41730af2ee6a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f1ffb640 1 -- 172.21.15.5:0/2593554778 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07ec0091b0 con 0x7f07f4139fe0 2024-08-18T21:04:19.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:04:19.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f1ffb640 10 monclient: dump: 2024-08-18T21:04:19.704 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.704 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.704 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.704 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.705 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.705 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.705 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.705 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.705 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.705 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.705 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.705 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.705 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.705 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.705 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.705 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f1ffb640 10 monclient: _finish_auth 0 2024-08-18T21:04:19.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f1ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:04:19.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:19.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 5 monclient: authenticate success, global_id 4590 2024-08-18T21:04:19.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:04:19.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f1ffb640 1 -- 172.21.15.5:0/2593554778 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ec0a5ad0 con 0x7f07f4139fe0 2024-08-18T21:04:19.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f1ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:19.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 10 monclient: get_monmap_and_config success 2024-08-18T21:04:19.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 4 set_mon_vals no callback set 2024-08-18T21:04:19.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f1ffb640 1 -- 172.21.15.5:0/2593554778 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07ec0a5c80 con 0x7f07f4139fe0 2024-08-18T21:04:19.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:04:19.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f1ffb640 10 monclient: dump: 2024-08-18T21:04:19.707 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.707 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.707 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.707 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.707 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.707 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.707 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.707 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.707 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.707 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.707 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.707 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.707 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.708 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.708 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.708 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 10 monclient: shutdown 2024-08-18T21:04:19.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:04:19.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 1 -- 172.21.15.5:0/2593554778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f4139fe0 msgr2=0x7f07f413a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 1 --2- 172.21.15.5:0/2593554778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f4139fe0 0x7f07f413a440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009e50 tx=0x7f07ec01c930 comp rx=0 tx=0).stop 2024-08-18T21:04:19.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 1 -- 172.21.15.5:0/2593554778 shutdown_connections 2024-08-18T21:04:19.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 1 --2- 172.21.15.5:0/2593554778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f4139fe0 0x7f07f413a440 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 1 --2- 172.21.15.5:0/2593554778 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f07f40a7600 0x7f07f4139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 1 --2- 172.21.15.5:0/2593554778 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f07f40a6ce0 0x7f07f40a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 1 -- 172.21.15.5:0/2593554778 >> 172.21.15.5:0/2593554778 conn(0x7f07f40acbc0 msgr2=0x7f07f40a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:04:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 1 -- 172.21.15.5:0/2593554778 shutdown_connections 2024-08-18T21:04:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 1 -- 172.21.15.5:0/2593554778 wait complete. 2024-08-18T21:04:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 10 monclient: build_initial_monmap 2024-08-18T21:04:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.697+0000 7f07f96d6640 10 monclient: monmap: 2024-08-18T21:04:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:04:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:04:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:04:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:04:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:04:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:04:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:04:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:04:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:04:19.710 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:04:19.710 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:04:19.710 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:04:19.710 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:04:19.710 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:04:19.710 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 1 Processor -- start 2024-08-18T21:04:19.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 1 -- start start 2024-08-18T21:04:19.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 10 monclient: init 2024-08-18T21:04:19.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:19.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 10 monclient: _add_conns ranks=[2,7,0,1,5,3,8,4,6] 2024-08-18T21:04:19.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f07f40a6ce0 0x7f07f4134db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 10 monclient(hunting): picked mon.noname-b con 0x7f07f40a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:04:19.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07f40a7600 0x7f07f41352f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 10 monclient(hunting): picked mon.noname-i con 0x7f07f40a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:04:19.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f4139fe0 0x7f07f413aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 10 monclient(hunting): picked mon.noname-a con 0x7f07f4139fe0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:04:19.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f07f40a79e0 con 0x7f07f4139fe0 2024-08-18T21:04:19.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f07f40a8220 con 0x7f07f40a6ce0 2024-08-18T21:04:19.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f07f41409b0 con 0x7f07f40a7600 2024-08-18T21:04:19.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:19.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 10 monclient(hunting): authenticate will time out at 1026.716573s 2024-08-18T21:04:19.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f07f40a6ce0 0x7f07f4134db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f4139fe0 0x7f07f413aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f07f40a6ce0 0x7f07f4134db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:44504/0 (socket says 172.21.15.5:44504) 2024-08-18T21:04:19.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 1 -- 172.21.15.5:0/1323527023 learned_addr learned my addr 172.21.15.5:0/1323527023 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:04:19.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 10 monclient(hunting): get_auth_request con 0x7f07f40a6ce0 auth_method 0 2024-08-18T21:04:19.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f37fe640 10 monclient(hunting): get_auth_request con 0x7f07f4139fe0 auth_method 0 2024-08-18T21:04:19.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 10 monclient(hunting): handle_auth_done global_id 4637 payload 824 2024-08-18T21:04:19.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f27fc640 1 --2- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07f40a7600 0x7f07f41352f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 1 -- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07f40a7600 msgr2=0x7f07f41352f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 1 --2- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07f40a7600 0x7f07f41352f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 1 -- 172.21.15.5:0/1323527023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f4139fe0 msgr2=0x7f07f413aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 1 --2- 172.21.15.5:0/1323527023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f4139fe0 0x7f07f413aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:04:19.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 1 monclient: found mon.noname-b 2024-08-18T21:04:19.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:19.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:04:19.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 1 -- 172.21.15.5:0/1323527023 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f40a70c0 con 0x7f07f40a6ce0 2024-08-18T21:04:19.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f37fe640 1 --2- 172.21.15.5:0/1323527023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f4139fe0 0x7f07f413aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:04:19.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 1 -- 172.21.15.5:0/1323527023 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f07f40a6ce0 msgr2=0x7f07f4134db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f2ffd640 1 --2- 172.21.15.5:0/1323527023 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f07f40a6ce0 0x7f07f4134db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f07e400b580 tx=0x7f07e400ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07db7fe640 1 -- 172.21.15.5:0/1323527023 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07e4016070 con 0x7f07f40a6ce0 2024-08-18T21:04:19.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07db7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:04:19.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07db7fe640 10 monclient: dump: 2024-08-18T21:04:19.717 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.717 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.717 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.717 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.717 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.717 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.718 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.718 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.718 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.718 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.718 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.718 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.718 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.718 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.718 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.718 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07db7fe640 10 monclient: _finish_auth 0 2024-08-18T21:04:19.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07db7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:04:19.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07db7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:19.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 5 monclient: authenticate success, global_id 4637 2024-08-18T21:04:19.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07db7fe640 1 -- 172.21.15.5:0/1323527023 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07e4003de0 con 0x7f07f40a6ce0 2024-08-18T21:04:19.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 10 monclient: _renew_subs 2024-08-18T21:04:19.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:04:19.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 1 -- 172.21.15.5:0/1323527023 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f413c160 con 0x7f07f40a6ce0 2024-08-18T21:04:19.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07db7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:19.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07db7fe640 1 -- 172.21.15.5:0/1323527023 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07e400f3e0 con 0x7f07f40a6ce0 2024-08-18T21:04:19.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07db7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:04:19.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07db7fe640 10 monclient: dump: 2024-08-18T21:04:19.719 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.719 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.720 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.720 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.720 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.720 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.720 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.720 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.720 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.720 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.720 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.720 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.720 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.720 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.720 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.721 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f17fa640 4 set_mon_vals no callback set 2024-08-18T21:04:19.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 10 monclient: _renew_subs 2024-08-18T21:04:19.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:04:19.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.701+0000 7f07f96d6640 1 -- 172.21.15.5:0/1323527023 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f413ccc0 con 0x7f07f40a6ce0 2024-08-18T21:04:19.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07f96d6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:19.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07f96d6640 1 --2- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07f413af80 0x7f07f413b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07f96d6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07f96d6640 1 -- 172.21.15.5:0/1323527023 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f07f40a7b60 con 0x7f07f413af80 2024-08-18T21:04:19.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07db7fe640 1 -- 172.21.15.5:0/1323527023 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f07e40050d0 con 0x7f07f40a6ce0 2024-08-18T21:04:19.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07db7fe640 1 --2- 172.21.15.5:0/1323527023 >> v2:172.21.15.157:6812/631023601 conn(0x7f07e003bdc0 0x7f07e003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07f27fc640 1 --2- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07f413af80 0x7f07f413b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07db7fe640 1 -- 172.21.15.5:0/1323527023 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 3506+0+0 (secure 0 0 0) 0x7f07e404d700 con 0x7f07f40a6ce0 2024-08-18T21:04:19.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07f27fc640 10 monclient: get_auth_request con 0x7f07f413af80 auth_method 0 2024-08-18T21:04:19.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07f27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07f27fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07f27fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07f27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07f27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07f27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07f37fe640 1 --2- 172.21.15.5:0/1323527023 >> v2:172.21.15.157:6812/631023601 conn(0x7f07e003bdc0 0x7f07e003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07f37fe640 10 monclient: get_auth_request con 0x7f07e003bdc0 auth_method 0 2024-08-18T21:04:19.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07f27fc640 10 monclient(hunting): handle_auth_done global_id 4456 payload 824 2024-08-18T21:04:19.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.705+0000 7f07f27fc640 1 -- 172.21.15.5:0/1323527023 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07f4139aa0 con 0x7f07f413af80 2024-08-18T21:04:19.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.709+0000 7f07f27fc640 1 -- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07f413af80 msgr2=0x7f07f413b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.709+0000 7f07f27fc640 1 --2- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07f413af80 0x7f07f413b360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f07f413c7d0 tx=0x7f07e800c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.709+0000 7f07f37fe640 1 --2- 172.21.15.5:0/1323527023 >> v2:172.21.15.157:6812/631023601 conn(0x7f07e003bdc0 0x7f07e003e280 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009e50 tx=0x7f07ec0a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.709+0000 7f07db7fe640 1 -- 172.21.15.5:0/1323527023 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07e8003de0 con 0x7f07f413af80 2024-08-18T21:04:19.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.709+0000 7f07db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.709+0000 7f07db7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:04:19.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.709+0000 7f07db7fe640 10 monclient: dump: 2024-08-18T21:04:19.723 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.723 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.723 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.723 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.723 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.723 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.723 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.723 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.723 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.724 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.709+0000 7f07db7fe640 1 -- 172.21.15.5:0/1323527023 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f07e8016070 con 0x7f07f413af80 2024-08-18T21:04:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.709+0000 7f07db7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.709+0000 7f07db7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:04:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.709+0000 7f07db7fe640 1 -- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07f413af80 msgr2=0x7f07f413b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.709+0000 7f07db7fe640 1 --2- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07f413af80 0x7f07f413b360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f07f413c7d0 tx=0x7f07e800c950 comp rx=0 tx=0).stop 2024-08-18T21:04:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.709+0000 7f07db7fe640 1 -- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07f413af80 msgr2=0x7f07f413b360 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:04:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.709+0000 7f07db7fe640 1 --2- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07f413af80 0x7f07f413b360 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f07f413c7d0 tx=0x7f07e800c950 comp rx=0 tx=0).stop 2024-08-18T21:04:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.713+0000 7f07f96d6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:04:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.713+0000 7f07f96d6640 1 --2- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07f413b8a0 0x7f07f409da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.713+0000 7f07f96d6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.713+0000 7f07f96d6640 1 -- 172.21.15.5:0/1323527023 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f07f4051140 con 0x7f07f413b8a0 2024-08-18T21:04:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.713+0000 7f07f27fc640 1 --2- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07f413b8a0 0x7f07f409da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.713+0000 7f07f27fc640 10 monclient: get_auth_request con 0x7f07f413b8a0 auth_method 0 2024-08-18T21:04:19.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.713+0000 7f07f27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.713+0000 7f07f27fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.713+0000 7f07f27fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.713+0000 7f07f27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.713+0000 7f07f27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.713+0000 7f07f27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.717+0000 7f07f27fc640 10 monclient(hunting): handle_auth_done global_id 4465 payload 824 2024-08-18T21:04:19.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.717+0000 7f07f27fc640 1 -- 172.21.15.5:0/1323527023 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f07f4069580 con 0x7f07f413b8a0 2024-08-18T21:04:19.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.717+0000 7f07f27fc640 1 -- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07f413b8a0 msgr2=0x7f07f409da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.717+0000 7f07f27fc640 1 --2- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07f413b8a0 0x7f07f409da30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07e8015000 tx=0x7f07e80059e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.717+0000 7f07db7fe640 1 -- 172.21.15.5:0/1323527023 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07e8011410 con 0x7f07f413b8a0 2024-08-18T21:04:19.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.717+0000 7f07db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.717+0000 7f07db7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:04:19.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.717+0000 7f07db7fe640 10 monclient: dump: 2024-08-18T21:04:19.728 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.728 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.728 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.728 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.728 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.728 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.728 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.728 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.728 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.729 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07db7fe640 1 -- 172.21.15.5:0/1323527023 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9224 (secure 0 0 0) 0x7f07e8005570 con 0x7f07f413b8a0 2024-08-18T21:04:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07db7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:04:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07db7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:04:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07db7fe640 1 -- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07f413b8a0 msgr2=0x7f07f409da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07db7fe640 1 --2- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07f413b8a0 0x7f07f409da30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07e8015000 tx=0x7f07e80059e0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07db7fe640 1 -- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07f413b8a0 msgr2=0x7f07f409da30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:04:19.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07db7fe640 1 --2- 172.21.15.5:0/1323527023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07f413b8a0 0x7f07f409da30 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07e8015000 tx=0x7f07e80059e0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.730 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:04:19.730 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:04:19.730 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:04:19.730 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:04:19.730 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 18, 2024-08-18T21:04:19.730 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 68799, 2024-08-18T21:04:19.730 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:04:19.730 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:04:19.731 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:04:19.731 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:04:19.731 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:04:19.731 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:04:19.731 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:04:19.731 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:04:19.731 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.731 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:04:19.731 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:04:19.731 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:04:19.731 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:04:19.731 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:19.731 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:19.732 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:19.732 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:19.732 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:19.732 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:19.732 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:19.732 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:19.732 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:19.732 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:19.732 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:19.732 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.732 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:04:19.732 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:04:19.732 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:19.732 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:19.733 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:19.733 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:19.733 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:19.733 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:19.733 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:19.733 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:19.733 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:19.733 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:19.733 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:19.733 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.733 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:04:19.733 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:04:19.733 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:04:19.734 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:04:19.734 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:04:19.734 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:04:19.734 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:04:19.734 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:04:19.734 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:04:19.734 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:04:19.734 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:04:19.734 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:04:19.734 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:04:19.734 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:04:19.734 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:04:19.734 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:04:19.735 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:04:19.735 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:19.735 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:19.735 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:19.735 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:19.735 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:19.735 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:19.735 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:19.735 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:19.735 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:19.735 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:19.735 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:19.735 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.735 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:04:19.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.736 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:04:19.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.736 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:04:19.736 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:04:19.736 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:04:19.736 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:04:19.753 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:04:19.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07f96d6640 1 -- 172.21.15.5:0/1323527023 >> v2:172.21.15.157:6812/631023601 conn(0x7f07e003bdc0 msgr2=0x7f07e003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07f96d6640 1 --2- 172.21.15.5:0/1323527023 >> v2:172.21.15.157:6812/631023601 conn(0x7f07e003bdc0 0x7f07e003e280 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009e50 tx=0x7f07ec0a7070 comp rx=0 tx=0).stop 2024-08-18T21:04:19.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07f96d6640 10 monclient: shutdown 2024-08-18T21:04:19.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07f96d6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:04:19.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07f96d6640 1 -- 172.21.15.5:0/1323527023 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f07f40a6ce0 msgr2=0x7f07f4134db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07f96d6640 1 --2- 172.21.15.5:0/1323527023 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f07f40a6ce0 0x7f07f4134db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f07e400b580 tx=0x7f07e400ba40 comp rx=0 tx=0).stop 2024-08-18T21:04:19.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07f37fe640 1 -- 172.21.15.5:0/1323527023 reap_dead start 2024-08-18T21:04:19.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07f37fe640 1 -- 172.21.15.5:0/1323527023 reap_dead start 2024-08-18T21:04:19.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07f96d6640 1 -- 172.21.15.5:0/1323527023 shutdown_connections 2024-08-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07f96d6640 1 -- 172.21.15.5:0/1323527023 >> 172.21.15.5:0/1323527023 conn(0x7f07f40acbc0 msgr2=0x7f07f4135c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07f96d6640 1 -- 172.21.15.5:0/1323527023 shutdown_connections 2024-08-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.721+0000 7f07f96d6640 1 -- 172.21.15.5:0/1323527023 wait complete. 2024-08-18T21:04:19.755 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:04:19.755 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon g 2024-08-18T21:04:19.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 10 monclient: get_monmap_and_config 2024-08-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 10 monclient: build_initial_monmap 2024-08-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 10 monclient: monmap: 2024-08-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:04:19.873459+0000 2024-08-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:04:19.873459+0000 2024-08-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:04:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:04:19.873 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 1 Processor -- start 2024-08-18T21:04:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 1 -- start start 2024-08-18T21:04:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 10 monclient: init 2024-08-18T21:04:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 10 monclient: _add_conns ranks=[2,8,9,1,4,10,7,6,0,5,3] 2024-08-18T21:04:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32c80a6bd0 0x7f32c80a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 10 monclient(hunting): picked mon.noname-b con 0x7f32c80a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:04:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f32c809f080 0x7f32c80a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 10 monclient(hunting): picked mon.noname-e con 0x7f32c809f080 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:04:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f32c8139990 0x7f32c8139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 10 monclient(hunting): picked mon.noname-a con 0x7f32c8139990 addr v2:172.21.15.5:3300/0 2024-08-18T21:04:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f32c809e4c0 con 0x7f32c8139990 2024-08-18T21:04:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f32c806f930 con 0x7f32c80a6bd0 2024-08-18T21:04:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f32c80a7a30 con 0x7f32c809f080 2024-08-18T21:04:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32cdbd8640 10 monclient(hunting): authenticate will time out at 1026.886612s 2024-08-18T21:04:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c6ffd640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f32c809f080 msgr2=0x7f32c80a74f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:04:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c6ffd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f32c809f080 0x7f32c80a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:04:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c77fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32c80a6bd0 0x7f32c80a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f32c8139990 0x7f32c8139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c77fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32c80a6bd0 0x7f32c80a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:44516/0 (socket says 172.21.15.5:44516) 2024-08-18T21:04:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c77fe640 1 -- 172.21.15.5:0/2990191423 learned_addr learned my addr 172.21.15.5:0/2990191423 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:04:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c77fe640 10 monclient(hunting): get_auth_request con 0x7f32c80a6bd0 auth_method 0 2024-08-18T21:04:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 10 monclient(hunting): get_auth_request con 0x7f32c8139990 auth_method 0 2024-08-18T21:04:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 10 monclient(hunting): handle_auth_done global_id 4608 payload 274 2024-08-18T21:04:19.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 1 -- 172.21.15.5:0/2990191423 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f32c809f080 msgr2=0x7f32c80a74f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:04:19.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 1 --2- 172.21.15.5:0/2990191423 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f32c809f080 0x7f32c80a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 1 -- 172.21.15.5:0/2990191423 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32c80a6bd0 msgr2=0x7f32c80a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:04:19.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 1 --2- 172.21.15.5:0/2990191423 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32c80a6bd0 0x7f32c80a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:04:19.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 1 monclient: found mon.noname-a 2024-08-18T21:04:19.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:19.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:04:19.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c7fff640 1 -- 172.21.15.5:0/2990191423 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c80a7fb0 con 0x7f32c8139990 2024-08-18T21:04:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.869+0000 7f32c77fe640 1 --2- 172.21.15.5:0/2990191423 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32c80a6bd0 0x7f32c80a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:04:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32c7fff640 1 -- 172.21.15.5:0/2990191423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c8139990 msgr2=0x7f32c8139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32c7fff640 1 --2- 172.21.15.5:0/2990191423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c8139990 0x7f32c8139e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f32c00097c0 tx=0x7f32c001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70721a94e4ce48d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32c67fc640 1 -- 172.21.15.5:0/2990191423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f32c00b0070 con 0x7f32c8139990 2024-08-18T21:04:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32c67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:04:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32c67fc640 10 monclient: dump: 2024-08-18T21:04:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.884 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32c67fc640 10 monclient: _finish_auth 0 2024-08-18T21:04:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32c67fc640 10 monclient: _check_auth_tickets 2024-08-18T21:04:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32c67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32cdbd8640 5 monclient: authenticate success, global_id 4608 2024-08-18T21:04:19.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32c67fc640 1 -- 172.21.15.5:0/2990191423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c00aa810 con 0x7f32c8139990 2024-08-18T21:04:19.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32cdbd8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:04:19.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32c67fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:19.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32cdbd8640 10 monclient: get_monmap_and_config success 2024-08-18T21:04:19.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32cdbd8640 4 set_mon_vals no callback set 2024-08-18T21:04:19.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32c67fc640 1 -- 172.21.15.5:0/2990191423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f32c00aae30 con 0x7f32c8139990 2024-08-18T21:04:19.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32c67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:04:19.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.873+0000 7f32c67fc640 10 monclient: dump: 2024-08-18T21:04:19.885 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.885 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.885 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.885 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.885 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.886 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.886 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.886 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.886 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.886 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.886 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.886 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.886 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.886 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.886 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.886 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 10 monclient: shutdown 2024-08-18T21:04:19.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:04:19.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 -- 172.21.15.5:0/2990191423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c8139990 msgr2=0x7f32c8139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 --2- 172.21.15.5:0/2990191423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c8139990 0x7f32c8139e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f32c00097c0 tx=0x7f32c001c380 comp rx=0 tx=0).stop 2024-08-18T21:04:19.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 -- 172.21.15.5:0/2990191423 shutdown_connections 2024-08-18T21:04:19.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 --2- 172.21.15.5:0/2990191423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c8139990 0x7f32c8139e10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 --2- 172.21.15.5:0/2990191423 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f32c809f080 0x7f32c80a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 --2- 172.21.15.5:0/2990191423 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32c80a6bd0 0x7f32c80a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 -- 172.21.15.5:0/2990191423 >> 172.21.15.5:0/2990191423 conn(0x7f32c8068700 msgr2=0x7f32c8068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:04:19.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 -- 172.21.15.5:0/2990191423 shutdown_connections 2024-08-18T21:04:19.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 -- 172.21.15.5:0/2990191423 wait complete. 2024-08-18T21:04:19.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 10 monclient: build_initial_monmap 2024-08-18T21:04:19.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 10 monclient: monmap: 2024-08-18T21:04:19.887 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:04:19.887 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:04:19.888 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:04:19.888 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:04:19.888 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:04:19.888 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.888 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:04:19.888 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:04:19.888 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:04:19.888 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:04:19.888 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:04:19.888 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:04:19.888 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:04:19.888 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:04:19.888 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:04:19.888 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 Processor -- start 2024-08-18T21:04:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 -- start start 2024-08-18T21:04:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 10 monclient: init 2024-08-18T21:04:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 10 monclient: _add_conns ranks=[7,0,5,2,4,1,6,8,3] 2024-08-18T21:04:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f32c809f080 0x7f32c81383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 10 monclient(hunting): picked mon.noname-i con 0x7f32c809f080 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:04:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80a6bd0 0x7f32c81388e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 10 monclient(hunting): picked mon.noname-a con 0x7f32c80a6bd0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:04:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f32c8139990 0x7f32c813da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 10 monclient(hunting): picked mon.noname-h con 0x7f32c8139990 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:04:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f32c80a89f0 con 0x7f32c80a6bd0 2024-08-18T21:04:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f32c80a7ce0 con 0x7f32c8139990 2024-08-18T21:04:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f32c8143610 con 0x7f32c809f080 2024-08-18T21:04:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32cdbd8640 10 monclient(hunting): authenticate will time out at 1026.894545s 2024-08-18T21:04:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80a6bd0 0x7f32c81388e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c7fff640 1 -- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f32c8139990 msgr2=0x7f32c813da90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3302/0 2024-08-18T21:04:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80a6bd0 0x7f32c81388e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50458/0 (socket says 172.21.15.5:50458) 2024-08-18T21:04:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 1 -- 172.21.15.5:0/4090598824 learned_addr learned my addr 172.21.15.5:0/4090598824 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:04:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 10 monclient(hunting): get_auth_request con 0x7f32c80a6bd0 auth_method 0 2024-08-18T21:04:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c7fff640 1 --2- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f32c8139990 0x7f32c813da90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:04:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 10 monclient(hunting): handle_auth_done global_id 4617 payload 824 2024-08-18T21:04:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 1 -- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f32c809f080 msgr2=0x7f32c81383a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 1 --2- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f32c809f080 0x7f32c81383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 1 -- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f32c8139990 msgr2=0x7f32c813da90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:04:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 1 --2- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f32c8139990 0x7f32c813da90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:04:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 1 monclient: found mon.noname-a 2024-08-18T21:04:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:04:19.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.877+0000 7f32c6ffd640 1 -- 172.21.15.5:0/4090598824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c81242f0 con 0x7f32c80a6bd0 2024-08-18T21:04:19.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32c6ffd640 1 -- 172.21.15.5:0/4090598824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80a6bd0 msgr2=0x7f32c81388e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32c6ffd640 1 --2- 172.21.15.5:0/4090598824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80a6bd0 0x7f32c81388e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f32b000b580 tx=0x7f32b000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32bffff640 1 -- 172.21.15.5:0/4090598824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f32b0016070 con 0x7f32c80a6bd0 2024-08-18T21:04:19.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32bffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32bffff640 10 monclient: dump: 2024-08-18T21:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32bffff640 10 monclient: _finish_auth 0 2024-08-18T21:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32bffff640 10 monclient: _check_auth_tickets 2024-08-18T21:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32bffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32bffff640 1 -- 172.21.15.5:0/4090598824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b0003de0 con 0x7f32c80a6bd0 2024-08-18T21:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32bffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32bffff640 1 -- 172.21.15.5:0/4090598824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f32b000f3e0 con 0x7f32c80a6bd0 2024-08-18T21:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32cdbd8640 5 monclient: authenticate success, global_id 4617 2024-08-18T21:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32cdbd8640 10 monclient: _renew_subs 2024-08-18T21:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32cdbd8640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32cdbd8640 1 -- 172.21.15.5:0/4090598824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c8123a50 con 0x7f32c80a6bd0 2024-08-18T21:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32c5ffb640 4 set_mon_vals no callback set 2024-08-18T21:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32bffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32bffff640 10 monclient: dump: 2024-08-18T21:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32cdbd8640 10 monclient: _renew_subs 2024-08-18T21:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32cdbd8640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32cdbd8640 1 -- 172.21.15.5:0/4090598824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c8138e20 con 0x7f32c80a6bd0 2024-08-18T21:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32cdbd8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32cdbd8640 1 --2- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32c813dfd0 0x7f32c813e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32cdbd8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32cdbd8640 1 -- 172.21.15.5:0/4090598824 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f32c8123f00 con 0x7f32c813dfd0 2024-08-18T21:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32bffff640 1 -- 172.21.15.5:0/4090598824 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f32b00050d0 con 0x7f32c80a6bd0 2024-08-18T21:04:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32bffff640 1 --2- 172.21.15.5:0/4090598824 >> v2:172.21.15.157:6812/631023601 conn(0x7f32a803bdc0 0x7f32a803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32c77fe640 1 --2- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32c813dfd0 0x7f32c813e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32bffff640 1 -- 172.21.15.5:0/4090598824 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3506+0+0 (secure 0 0 0) 0x7f32b004d7d0 con 0x7f32c80a6bd0 2024-08-18T21:04:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32c77fe640 10 monclient: get_auth_request con 0x7f32c813dfd0 auth_method 0 2024-08-18T21:04:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32c7fff640 1 --2- 172.21.15.5:0/4090598824 >> v2:172.21.15.157:6812/631023601 conn(0x7f32a803bdc0 0x7f32a803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32c7fff640 10 monclient: get_auth_request con 0x7f32a803bdc0 auth_method 0 2024-08-18T21:04:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32c77fe640 10 monclient(hunting): handle_auth_done global_id 4476 payload 824 2024-08-18T21:04:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.881+0000 7f32c77fe640 1 -- 172.21.15.5:0/4090598824 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32c8139e10 con 0x7f32c813dfd0 2024-08-18T21:04:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.885+0000 7f32c77fe640 1 -- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32c813dfd0 msgr2=0x7f32c813e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.885+0000 7f32c77fe640 1 --2- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32c813dfd0 0x7f32c813e3b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32b800eef0 tx=0x7f32b800b480 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.885+0000 7f32c7fff640 1 --2- 172.21.15.5:0/4090598824 >> v2:172.21.15.157:6812/631023601 conn(0x7f32a803bdc0 0x7f32a803e280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32c00097c0 tx=0x7f32c00a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.885+0000 7f32bffff640 1 -- 172.21.15.5:0/4090598824 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f32b8009e20 con 0x7f32c813dfd0 2024-08-18T21:04:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.885+0000 7f32bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.885+0000 7f32bffff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:04:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.885+0000 7f32bffff640 10 monclient: dump: 2024-08-18T21:04:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.901 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.885+0000 7f32bffff640 1 -- 172.21.15.5:0/4090598824 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f32b8019070 con 0x7f32c813dfd0 2024-08-18T21:04:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.885+0000 7f32bffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.885+0000 7f32bffff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:04:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.885+0000 7f32bffff640 1 -- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32c813dfd0 msgr2=0x7f32c813e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.885+0000 7f32bffff640 1 --2- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32c813dfd0 0x7f32c813e3b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32b800eef0 tx=0x7f32b800b480 comp rx=0 tx=0).stop 2024-08-18T21:04:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.885+0000 7f32bffff640 1 -- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32c813dfd0 msgr2=0x7f32c813e3b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:04:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.885+0000 7f32bffff640 1 --2- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32c813dfd0 0x7f32c813e3b0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32b800eef0 tx=0x7f32b800b480 comp rx=0 tx=0).stop 2024-08-18T21:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.893+0000 7f32cdbd8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.893+0000 7f32cdbd8640 1 --2- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32c813e8f0 0x7f32c80a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.893+0000 7f32cdbd8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.893+0000 7f32cdbd8640 1 -- 172.21.15.5:0/4090598824 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f32c8051140 con 0x7f32c813e8f0 2024-08-18T21:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.893+0000 7f32c77fe640 1 --2- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32c813e8f0 0x7f32c80a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.893+0000 7f32c77fe640 10 monclient: get_auth_request con 0x7f32c813e8f0 auth_method 0 2024-08-18T21:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.893+0000 7f32c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.893+0000 7f32c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.893+0000 7f32c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.893+0000 7f32c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.893+0000 7f32c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.893+0000 7f32c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.893+0000 7f32c77fe640 10 monclient(hunting): handle_auth_done global_id 4485 payload 824 2024-08-18T21:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.893+0000 7f32c77fe640 1 -- 172.21.15.5:0/4090598824 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f32c80746d0 con 0x7f32c813e8f0 2024-08-18T21:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32c77fe640 1 -- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32c813e8f0 msgr2=0x7f32c80a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32c77fe640 1 --2- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32c813e8f0 0x7f32c80a42c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f32b800eef0 tx=0x7f32b8004a50 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32bffff640 1 -- 172.21.15.5:0/4090598824 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f32b801ebe0 con 0x7f32c813e8f0 2024-08-18T21:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32bffff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32bffff640 10 monclient: dump: 2024-08-18T21:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:19.906 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32bffff640 1 -- 172.21.15.5:0/4090598824 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9224 (secure 0 0 0) 0x7f32b8022070 con 0x7f32c813e8f0 2024-08-18T21:04:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32bffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:04:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32bffff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:04:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32bffff640 1 -- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32c813e8f0 msgr2=0x7f32c80a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32bffff640 1 --2- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32c813e8f0 0x7f32c80a42c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f32b800eef0 tx=0x7f32b8004a50 comp rx=0 tx=0).stop 2024-08-18T21:04:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32bffff640 1 -- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32c813e8f0 msgr2=0x7f32c80a42c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:04:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32bffff640 1 --2- 172.21.15.5:0/4090598824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32c813e8f0 0x7f32c80a42c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:19.907 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:04:19.907 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:04:19.907 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:04:19.907 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:04:19.907 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 18, 2024-08-18T21:04:19.907 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 68991, 2024-08-18T21:04:19.907 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:04:19.908 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:04:19.908 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:04:19.908 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:04:19.908 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:04:19.908 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:04:19.908 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:04:19.908 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:04:19.908 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.908 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:04:19.908 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:04:19.908 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:04:19.908 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:04:19.908 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:19.909 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:19.909 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:19.909 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:19.909 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:19.909 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:19.909 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:19.909 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:19.909 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:19.909 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:19.909 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:19.909 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.909 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:04:19.909 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:04:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:04:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:04:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:04:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:04:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:04:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:04:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:04:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:04:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:04:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:04:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:04:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:04:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:04:19.912 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:04:19.912 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:04:19.912 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:04:19.912 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:04:19.912 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:19.912 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:19.912 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:19.912 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:19.912 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:19.912 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:19.912 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:19.912 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:19.912 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:19.913 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:19.913 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:19.913 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.913 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:04:19.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.913 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:04:19.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.913 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:04:19.913 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:04:19.913 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.913 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.913 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.913 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:04:19.914 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.914 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.914 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:04:19.914 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.914 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.914 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.914 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:04:19.914 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:04:19.914 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.915 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.915 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.915 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:04:19.915 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:04:19.915 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.915 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.915 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.915 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:04:19.916 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.916 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.916 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:04:19.916 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.916 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.916 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.916 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:04:19.916 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:04:19.916 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.917 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.917 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.917 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:04:19.917 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:04:19.917 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.917 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.917 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.917 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:04:19.917 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.918 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.918 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:04:19.918 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.918 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.918 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.918 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:04:19.918 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:04:19.918 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.918 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.918 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.919 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:04:19.919 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:04:19.919 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.919 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.919 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.919 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:04:19.919 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.920 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.920 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:04:19.920 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.920 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.920 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.920 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:04:19.920 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:04:19.920 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.920 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.920 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.921 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:04:19.921 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:04:19.921 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.921 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.921 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.921 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:04:19.922 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.922 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:04:19.922 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.922 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.922 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.922 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:04:19.922 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:04:19.922 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.923 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.923 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.923 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:04:19.923 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:04:19.923 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.923 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.923 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.923 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:04:19.923 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.924 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.924 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:04:19.924 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.924 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.924 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.924 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:04:19.924 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:04:19.924 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.924 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.924 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.925 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:04:19.925 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:04:19.925 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.925 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.925 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.925 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:04:19.925 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.925 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.925 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:04:19.926 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.926 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.926 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.926 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:04:19.926 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:04:19.926 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.926 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.926 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.926 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.926 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:04:19.926 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:04:19.927 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.927 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.927 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.927 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:04:19.927 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.927 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.927 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:04:19.927 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.927 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.927 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.928 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:04:19.928 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:04:19.928 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.928 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.928 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.928 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:04:19.928 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:04:19.928 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:19.928 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:19.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:19.929 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:04:19.929 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.929 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:19.929 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:04:19.929 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:19.929 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.929 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.929 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:04:19.929 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:04:19.929 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:19.930 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:19.930 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:19.930 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.930 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.930 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:04:19.930 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:04:19.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.930 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.930 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.930 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:04:19.930 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.930 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:19.931 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:04:19.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:19.931 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:19.931 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:19.931 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:04:19.931 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:19.931 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:19.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:19.931 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:04:19.931 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:04:19.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32cdbd8640 1 -- 172.21.15.5:0/4090598824 >> v2:172.21.15.157:6812/631023601 conn(0x7f32a803bdc0 msgr2=0x7f32a803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32cdbd8640 1 --2- 172.21.15.5:0/4090598824 >> v2:172.21.15.157:6812/631023601 conn(0x7f32a803bdc0 0x7f32a803e280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32c00097c0 tx=0x7f32c00a6000 comp rx=0 tx=0).stop 2024-08-18T21:04:19.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32cdbd8640 10 monclient: shutdown 2024-08-18T21:04:19.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32cdbd8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:04:19.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32cdbd8640 1 -- 172.21.15.5:0/4090598824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80a6bd0 msgr2=0x7f32c81388e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:19.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32cdbd8640 1 --2- 172.21.15.5:0/4090598824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80a6bd0 0x7f32c81388e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f32b000b580 tx=0x7f32b000ba40 comp rx=0 tx=0).stop 2024-08-18T21:04:19.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32c7fff640 1 -- 172.21.15.5:0/4090598824 reap_dead start 2024-08-18T21:04:19.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32c7fff640 1 -- 172.21.15.5:0/4090598824 reap_dead start 2024-08-18T21:04:19.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32cdbd8640 1 -- 172.21.15.5:0/4090598824 shutdown_connections 2024-08-18T21:04:19.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32cdbd8640 1 -- 172.21.15.5:0/4090598824 >> 172.21.15.5:0/4090598824 conn(0x7f32c8068700 msgr2=0x7f32c80aa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:04:19.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32cdbd8640 1 -- 172.21.15.5:0/4090598824 shutdown_connections 2024-08-18T21:04:19.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:19.897+0000 7f32cdbd8640 1 -- 172.21.15.5:0/4090598824 wait complete. 2024-08-18T21:04:19.933 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:04:19.934 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon i 2024-08-18T21:04:19.934 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:04:20.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.053+0000 7fb2799de640 10 monclient: get_monmap_and_config 2024-08-18T21:04:20.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.053+0000 7fb2799de640 10 monclient: build_initial_monmap 2024-08-18T21:04:20.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.053+0000 7fb2799de640 10 monclient: monmap: 2024-08-18T21:04:20.057 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:04:20.057 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:20.058 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:04:20.059225+0000 2024-08-18T21:04:20.058 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:04:20.059225+0000 2024-08-18T21:04:20.058 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:04:20.058 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:20.058 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:04:20.058 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:04:20.058 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:04:20.058 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:04:20.058 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:04:20.058 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:04:20.058 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:04:20.059 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:04:20.059 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:04:20.059 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:04:20.059 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:04:20.059 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 1 Processor -- start 2024-08-18T21:04:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 1 -- start start 2024-08-18T21:04:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 10 monclient: init 2024-08-18T21:04:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 10 monclient: _add_conns ranks=[9,5,1,2,6,10,0,7,3,8,4] 2024-08-18T21:04:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2740a6bd0 0x7fb2740a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 10 monclient(hunting): picked mon.noname-a con 0x7fb2740a6bd0 addr v2:172.21.15.5:3300/0 2024-08-18T21:04:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb27409f080 0x7fb2740a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 10 monclient(hunting): picked mon.noname-h con 0x7fb27409f080 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:04:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fb274139990 addr v1:172.21.15.157:6789/0 2024-08-18T21:04:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2740a7fb0 con 0x7fb274139990 2024-08-18T21:04:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb27409e4c0 con 0x7fb2740a6bd0 2024-08-18T21:04:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fb27406f930 con 0x7fb27409f080 2024-08-18T21:04:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2799de640 10 monclient(hunting): authenticate will time out at 1027.072962s 2024-08-18T21:04:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2727fc640 1 -- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb27409f080 msgr2=0x7fb2740a74f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3302/0 2024-08-18T21:04:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2740a6bd0 0x7fb2740a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb2727fc640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb27409f080 0x7fb2740a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:04:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2740a6bd0 0x7fb2740a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50460/0 (socket says 172.21.15.5:50460) 2024-08-18T21:04:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 1 -- 172.21.15.5:0/3051656579 learned_addr learned my addr 172.21.15.5:0/3051656579 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:04:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 10 monclient(hunting): get_auth_request con 0x7fb2740a6bd0 auth_method 0 2024-08-18T21:04:20.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:20.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:20.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:20.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:20.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:20.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:20.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 10 monclient(hunting): handle_auth_done global_id 4626 payload 274 2024-08-18T21:04:20.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 1 -- 172.21.15.5:0/3051656579 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb27409f080 msgr2=0x7fb2740a74f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:04:20.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 1 --2- 172.21.15.5:0/3051656579 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb27409f080 0x7fb2740a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:20.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 1 -- 172.21.15.5:0/3051656579 >> v1:172.21.15.157:6789/0 conn(0x7fb274139990 legacy=0x7fb274139e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:04:20.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:04:20.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 1 monclient: found mon.noname-a 2024-08-18T21:04:20.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:20.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:04:20.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.057+0000 7fb272ffd640 1 -- 172.21.15.5:0/3051656579 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27409de70 con 0x7fb2740a6bd0 2024-08-18T21:04:20.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb272ffd640 1 -- 172.21.15.5:0/3051656579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2740a6bd0 msgr2=0x7fb2740a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:20.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb272ffd640 1 --2- 172.21.15.5:0/3051656579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2740a6bd0 0x7fb2740a6fb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb264009870 tx=0x7fb26401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc07278a23506da9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:20.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb271ffb640 1 -- 172.21.15.5:0/3051656579 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb2640b0070 con 0x7fb2740a6bd0 2024-08-18T21:04:20.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb271ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:20.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb271ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:04:20.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb271ffb640 10 monclient: dump: 2024-08-18T21:04:20.066 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:20.066 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:20.068 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb271ffb640 10 monclient: _finish_auth 0 2024-08-18T21:04:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb271ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:04:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb271ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb271ffb640 1 -- 172.21.15.5:0/3051656579 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2640a4e50 con 0x7fb2740a6bd0 2024-08-18T21:04:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb271ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb271ffb640 1 -- 172.21.15.5:0/3051656579 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb2640aac80 con 0x7fb2740a6bd0 2024-08-18T21:04:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb271ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb271ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:04:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb271ffb640 10 monclient: dump: 2024-08-18T21:04:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:20.069 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb2799de640 5 monclient: authenticate success, global_id 4626 2024-08-18T21:04:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb2799de640 10 monclient: get_monmap_and_config success 2024-08-18T21:04:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb2799de640 4 set_mon_vals no callback set 2024-08-18T21:04:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb2799de640 10 monclient: shutdown 2024-08-18T21:04:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb2799de640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:04:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb2799de640 1 -- 172.21.15.5:0/3051656579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2740a6bd0 msgr2=0x7fb2740a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb2799de640 1 --2- 172.21.15.5:0/3051656579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2740a6bd0 0x7fb2740a6fb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb264009870 tx=0x7fb26401c440 comp rx=0 tx=0).stop 2024-08-18T21:04:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb2799de640 1 -- 172.21.15.5:0/3051656579 shutdown_connections 2024-08-18T21:04:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb2799de640 1 --2- 172.21.15.5:0/3051656579 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb27409f080 0x7fb2740a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb2799de640 1 --2- 172.21.15.5:0/3051656579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2740a6bd0 0x7fb2740a6fb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb2799de640 1 -- 172.21.15.5:0/3051656579 >> 172.21.15.5:0/3051656579 conn(0x7fb274068700 msgr2=0x7fb274068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:04:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb2799de640 1 -- 172.21.15.5:0/3051656579 shutdown_connections 2024-08-18T21:04:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.061+0000 7fb2799de640 1 -- 172.21.15.5:0/3051656579 wait complete. 2024-08-18T21:04:20.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 10 monclient: build_initial_monmap 2024-08-18T21:04:20.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 10 monclient: monmap: 2024-08-18T21:04:20.076 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:04:20.076 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:04:20.076 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:04:20.076 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:04:20.076 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:04:20.076 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:20.076 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:04:20.076 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:04:20.076 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:04:20.077 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:04:20.077 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:04:20.077 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:04:20.077 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:04:20.077 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:04:20.077 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:04:20.077 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:20.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 1 Processor -- start 2024-08-18T21:04:20.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 1 -- start start 2024-08-18T21:04:20.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 10 monclient: init 2024-08-18T21:04:20.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 10 monclient: _reopen_session rank -1 2024-08-18T21:04:20.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 10 monclient: _add_conns ranks=[0,4,3,7,8,2,6,5,1] 2024-08-18T21:04:20.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb27409f080 0x7fb274138660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:20.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 10 monclient(hunting): picked mon.noname-a con 0x7fb27409f080 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:04:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb2740a6bd0 0x7fb27413d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 10 monclient(hunting): picked mon.noname-c con 0x7fb2740a6bd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:04:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb274139990 0x7fb27413df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 10 monclient(hunting): picked mon.noname-g con 0x7fb274139990 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:04:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb2741447a0 con 0x7fb27409f080 2024-08-18T21:04:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb274144620 con 0x7fb274139990 2024-08-18T21:04:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fb274144920 con 0x7fb2740a6bd0 2024-08-18T21:04:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 10 monclient(hunting): _renew_subs 2024-08-18T21:04:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2799de640 10 monclient(hunting): authenticate will time out at 1027.081357s 2024-08-18T21:04:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb27409f080 0x7fb274138660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2727fc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb2740a6bd0 0x7fb27413d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb27409f080 0x7fb274138660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50470/0 (socket says 172.21.15.5:50470) 2024-08-18T21:04:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 1 -- 172.21.15.5:0/627557710 learned_addr learned my addr 172.21.15.5:0/627557710 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:04:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 10 monclient(hunting): get_auth_request con 0x7fb27409f080 auth_method 0 2024-08-18T21:04:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2727fc640 10 monclient(hunting): get_auth_request con 0x7fb2740a6bd0 auth_method 0 2024-08-18T21:04:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2727fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2727fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2727fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2727fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2727fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2737fe640 1 --2- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb274139990 0x7fb27413df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2737fe640 10 monclient(hunting): get_auth_request con 0x7fb274139990 auth_method 0 2024-08-18T21:04:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2737fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb2737fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 10 monclient(hunting): handle_auth_done global_id 4635 payload 824 2024-08-18T21:04:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 1 -- 172.21.15.5:0/627557710 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb2740a6bd0 msgr2=0x7fb27413d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 1 --2- 172.21.15.5:0/627557710 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb2740a6bd0 0x7fb27413d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 1 -- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb274139990 msgr2=0x7fb27413df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 1 --2- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb274139990 0x7fb27413df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:04:20.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:04:20.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 1 monclient: found mon.noname-a 2024-08-18T21:04:20.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:04:20.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:04:20.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.065+0000 7fb272ffd640 1 -- 172.21.15.5:0/627557710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2740a3060 con 0x7fb27409f080 2024-08-18T21:04:20.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb272ffd640 1 -- 172.21.15.5:0/627557710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb27409f080 msgr2=0x7fb274138660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:20.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb272ffd640 1 --2- 172.21.15.5:0/627557710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb27409f080 0x7fb274138660 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb26401c270 tx=0x7fb2640191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:20.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb25bfff640 1 -- 172.21.15.5:0/627557710 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb2640ba070 con 0x7fb27409f080 2024-08-18T21:04:20.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb25bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:20.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb25bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:04:20.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb25bfff640 10 monclient: dump: 2024-08-18T21:04:20.081 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:20.081 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:20.082 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:20.082 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:20.082 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:20.082 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:20.082 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:20.082 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:20.082 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:20.082 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:20.082 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:20.082 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:20.082 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:20.082 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:20.082 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:20.082 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:20.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb25bfff640 10 monclient: _finish_auth 0 2024-08-18T21:04:20.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb25bfff640 10 monclient: _check_auth_tickets 2024-08-18T21:04:20.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb25bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:04:20.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb25bfff640 1 -- 172.21.15.5:0/627557710 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2640b1040 con 0x7fb27409f080 2024-08-18T21:04:20.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb25bfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:04:20.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb25bfff640 1 -- 172.21.15.5:0/627557710 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb2640b0070 con 0x7fb27409f080 2024-08-18T21:04:20.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb25bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:20.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb25bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:04:20.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb25bfff640 10 monclient: dump: 2024-08-18T21:04:20.083 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:20.083 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:20.083 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:20.083 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:20.083 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:20.084 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2799de640 5 monclient: authenticate success, global_id 4635 2024-08-18T21:04:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2799de640 10 monclient: _renew_subs 2024-08-18T21:04:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2799de640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:04:20.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2717fa640 4 set_mon_vals no callback set 2024-08-18T21:04:20.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2799de640 1 -- 172.21.15.5:0/627557710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb274122e80 con 0x7fb27409f080 2024-08-18T21:04:20.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2799de640 10 monclient: _renew_subs 2024-08-18T21:04:20.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2799de640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:04:20.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2799de640 1 -- 172.21.15.5:0/627557710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb27413ff30 con 0x7fb27409f080 2024-08-18T21:04:20.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2799de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:20.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2799de640 1 --2- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb274138ba0 0x7fb27413e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:20.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2799de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:20.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2799de640 1 -- 172.21.15.5:0/627557710 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fb27406ec60 con 0x7fb274138ba0 2024-08-18T21:04:20.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb25bfff640 1 -- 172.21.15.5:0/627557710 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fb264003b80 con 0x7fb27409f080 2024-08-18T21:04:20.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb25bfff640 1 --2- 172.21.15.5:0/627557710 >> v2:172.21.15.157:6812/631023601 conn(0x7fb26003bdc0 0x7fb26003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:20.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb25bfff640 1 -- 172.21.15.5:0/627557710 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3506+0+0 (secure 0 0 0) 0x7fb2640e7b50 con 0x7fb27409f080 2024-08-18T21:04:20.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2727fc640 1 --2- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb274138ba0 0x7fb27413e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2727fc640 10 monclient: get_auth_request con 0x7fb274138ba0 auth_method 0 2024-08-18T21:04:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2727fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2727fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2737fe640 1 --2- 172.21.15.5:0/627557710 >> v2:172.21.15.157:6812/631023601 conn(0x7fb26003bdc0 0x7fb26003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2727fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2727fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2727fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2737fe640 10 monclient: get_auth_request con 0x7fb26003bdc0 auth_method 0 2024-08-18T21:04:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2727fc640 10 monclient(hunting): handle_auth_done global_id 4480 payload 824 2024-08-18T21:04:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.069+0000 7fb2727fc640 1 -- 172.21.15.5:0/627557710 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb27413f430 con 0x7fb274138ba0 2024-08-18T21:04:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.073+0000 7fb2737fe640 1 --2- 172.21.15.5:0/627557710 >> v2:172.21.15.157:6812/631023601 conn(0x7fb26003bdc0 0x7fb26003e280 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009ea0 tx=0x7fb26c009410 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.073+0000 7fb2727fc640 1 -- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb274138ba0 msgr2=0x7fb27413e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.073+0000 7fb2727fc640 1 --2- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb274138ba0 0x7fb27413e450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb268003940 tx=0x7fb268009a40 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.073+0000 7fb25bfff640 1 -- 172.21.15.5:0/627557710 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb268016070 con 0x7fb274138ba0 2024-08-18T21:04:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.073+0000 7fb25bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.073+0000 7fb25bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:04:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.073+0000 7fb25bfff640 10 monclient: dump: 2024-08-18T21:04:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:20.088 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.073+0000 7fb25bfff640 1 -- 172.21.15.5:0/627557710 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb2680128f0 con 0x7fb274138ba0 2024-08-18T21:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.073+0000 7fb25bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.073+0000 7fb25bfff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.073+0000 7fb25bfff640 1 -- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb274138ba0 msgr2=0x7fb27413e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.073+0000 7fb25bfff640 1 --2- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb274138ba0 0x7fb27413e450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb268003940 tx=0x7fb268009a40 comp rx=0 tx=0).stop 2024-08-18T21:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.073+0000 7fb25bfff640 1 -- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb274138ba0 msgr2=0x7fb27413e450 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.073+0000 7fb25bfff640 1 --2- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb274138ba0 0x7fb27413e450 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb268003940 tx=0x7fb268009a40 comp rx=0 tx=0).stop 2024-08-18T21:04:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.081+0000 7fb2799de640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:04:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.081+0000 7fb2799de640 1 --2- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb27413e990 0x7fb2740a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:04:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.081+0000 7fb2799de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:04:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.081+0000 7fb2799de640 1 -- 172.21.15.5:0/627557710 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fb274051140 con 0x7fb27413e990 2024-08-18T21:04:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.081+0000 7fb2727fc640 1 --2- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb27413e990 0x7fb2740a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:04:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.081+0000 7fb2727fc640 10 monclient: get_auth_request con 0x7fb27413e990 auth_method 0 2024-08-18T21:04:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.081+0000 7fb2727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:04:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.081+0000 7fb2727fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:04:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.081+0000 7fb2727fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:04:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.081+0000 7fb2727fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:04:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.081+0000 7fb2727fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:04:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.081+0000 7fb2727fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:04:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.081+0000 7fb2727fc640 10 monclient(hunting): handle_auth_done global_id 4489 payload 824 2024-08-18T21:04:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.081+0000 7fb2727fc640 1 -- 172.21.15.5:0/627557710 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb274139e40 con 0x7fb27413e990 2024-08-18T21:04:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb2727fc640 1 -- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb27413e990 msgr2=0x7fb2740a0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:04:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb2727fc640 1 --2- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb27413e990 0x7fb2740a0c50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb2680093d0 tx=0x7fb2680059e0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:04:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb25bfff640 1 -- 172.21.15.5:0/627557710 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb268016040 con 0x7fb27413e990 2024-08-18T21:04:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb25bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:04:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb25bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:04:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb25bfff640 10 monclient: dump: 2024-08-18T21:04:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:04:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:04:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:04:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:04:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:04:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:04:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:04:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:04:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:04:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:04:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:04:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:04:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:04:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:04:20.093 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:04:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb25bfff640 1 -- 172.21.15.5:0/627557710 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9391 (secure 0 0 0) 0x7fb268005c60 con 0x7fb27413e990 2024-08-18T21:04:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb25bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:04:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb25bfff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:04:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb25bfff640 1 -- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb27413e990 msgr2=0x7fb2740a0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:20.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb25bfff640 1 --2- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb27413e990 0x7fb2740a0c50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb2680093d0 tx=0x7fb2680059e0 comp rx=0 tx=0).stop 2024-08-18T21:04:20.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb25bfff640 1 -- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb27413e990 msgr2=0x7fb2740a0c50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:04:20.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb25bfff640 1 --2- 172.21.15.5:0/627557710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb27413e990 0x7fb2740a0c50 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb2680093d0 tx=0x7fb2680059e0 comp rx=0 tx=0).stop 2024-08-18T21:04:20.094 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:04:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:04:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:04:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:04:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 18, 2024-08-18T21:04:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 69179, 2024-08-18T21:04:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:04:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:04:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:04:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:04:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:04:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:04:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:04:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:04:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:04:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:04:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:04:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:04:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:04:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:04:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:04:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:04:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:04:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:04:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:04:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:04:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:04:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:04:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:04:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:04:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:04:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:04:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:04:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:04:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:04:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:04:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:04:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:04:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:04:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:04:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:04:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:04:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:04:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:04:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:04:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:04:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:04:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:04:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:04:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:04:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:04:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:04:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:04:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:04:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:04:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:04:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:04:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:04:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:04:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:04:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:04:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:04:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:04:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:04:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:04:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:04:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:04:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:04:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:04:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:04:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:04:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:04:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:20.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.107 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:04:20.107 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:04:20.107 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:20.107 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:20.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.107 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:20.107 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:04:20.107 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.107 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:04:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:04:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:04:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:04:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:04:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:04:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:04:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:04:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:04:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:04:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:04:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:04:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:04:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:04:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:04:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:04:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:04:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:04:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:04:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:04:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:04:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:04:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:04:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:04:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:04:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:04:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:04:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:04:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:04:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:04:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:04:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:04:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:04:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:04:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:04:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:04:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:04:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:04:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:04:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:04:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:04:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:04:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:04:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:04:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:04:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:04:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:04:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:04:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:04:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:04:20.117 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:04:20.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb2799de640 1 -- 172.21.15.5:0/627557710 >> v2:172.21.15.157:6812/631023601 conn(0x7fb26003bdc0 msgr2=0x7fb26003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb2799de640 1 --2- 172.21.15.5:0/627557710 >> v2:172.21.15.157:6812/631023601 conn(0x7fb26003bdc0 0x7fb26003e280 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009ea0 tx=0x7fb26c009410 comp rx=0 tx=0).stop 2024-08-18T21:04:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb2799de640 10 monclient: shutdown 2024-08-18T21:04:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb2799de640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:04:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb2799de640 1 -- 172.21.15.5:0/627557710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb27409f080 msgr2=0x7fb274138660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:04:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb2799de640 1 --2- 172.21.15.5:0/627557710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb27409f080 0x7fb274138660 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb26401c270 tx=0x7fb2640191e0 comp rx=0 tx=0).stop 2024-08-18T21:04:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb2737fe640 1 -- 172.21.15.5:0/627557710 reap_dead start 2024-08-18T21:04:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb2737fe640 1 -- 172.21.15.5:0/627557710 reap_dead start 2024-08-18T21:04:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb2799de640 1 -- 172.21.15.5:0/627557710 shutdown_connections 2024-08-18T21:04:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb2799de640 1 -- 172.21.15.5:0/627557710 >> 172.21.15.5:0/627557710 conn(0x7fb274068700 msgr2=0x7fb2740aa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:04:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb2799de640 1 -- 172.21.15.5:0/627557710 shutdown_connections 2024-08-18T21:04:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:04:20.085+0000 7fb2799de640 1 -- 172.21.15.5:0/627557710 wait complete. 2024-08-18T21:04:20.120 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:04:20.120 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-18T21:04:21.772 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:04:21.772 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28036]: starting. 2024-08-18T21:04:21.772 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28036]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28001 2024-08-18T21:04:21.773 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28036]: created object 0... 2024-08-18T21:04:21.773 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28036]: created object 25... 2024-08-18T21:04:21.773 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28036]: created object 49... 2024-08-18T21:04:21.773 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28036]: finishing. 2024-08-18T21:04:21.773 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28036]: shutting down. 2024-08-18T21:04:21.832 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:04:21.832 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28038]: starting. 2024-08-18T21:04:21.832 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28038]: listing objects. 2024-08-18T21:04:21.832 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28038]: listed object 0... 2024-08-18T21:04:21.832 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28038]: listed object 25... 2024-08-18T21:04:21.832 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28038]: saw 50 objects 2024-08-18T21:04:21.832 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28038]: shutting down. 2024-08-18T21:04:22.550 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:04:22.550 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28037]: starting. 2024-08-18T21:04:22.550 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28037]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28001 2024-08-18T21:04:22.550 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28037]: shutting down. 2024-08-18T21:04:22.552 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:04:22.553 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:04:22.553 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:04:22.555 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:04:25.011 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28089]: starting. 2024-08-18T21:04:25.012 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28089]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28088 2024-08-18T21:04:25.012 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28089]: created object 0... 2024-08-18T21:04:25.012 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28089]: created object 25... 2024-08-18T21:04:25.012 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28089]: created object 49... 2024-08-18T21:04:25.012 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28089]: finishing. 2024-08-18T21:04:25.012 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28089]: shutting down. 2024-08-18T21:04:25.801 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28090]: starting. 2024-08-18T21:04:25.802 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28090]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28088 2024-08-18T21:04:25.802 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28090]: shutting down. 2024-08-18T21:04:28.060 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:04:28.060 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28123]: starting. 2024-08-18T21:04:28.060 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28123]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28088 2024-08-18T21:04:28.060 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28123]: created object 0... 2024-08-18T21:04:28.061 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28123]: created object 25... 2024-08-18T21:04:28.061 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28123]: created object 49... 2024-08-18T21:04:28.061 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28123]: finishing. 2024-08-18T21:04:28.061 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28123]: shutting down. 2024-08-18T21:04:28.121 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:04:28.121 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28125]: starting. 2024-08-18T21:04:28.121 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28125]: listing objects. 2024-08-18T21:04:28.121 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28125]: listed object 0... 2024-08-18T21:04:28.122 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28125]: listed object 25... 2024-08-18T21:04:28.122 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28125]: saw 50 objects 2024-08-18T21:04:28.122 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28125]: shutting down. 2024-08-18T21:04:28.859 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:04:28.859 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28124]: starting. 2024-08-18T21:04:28.859 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28124]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28088 2024-08-18T21:04:28.859 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28124]: shutting down. 2024-08-18T21:04:28.863 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:04:28.863 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:04:28.863 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:04:28.866 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:04:31.570 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28176]: starting. 2024-08-18T21:04:31.570 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28176]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28175 2024-08-18T21:04:31.570 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28176]: created object 0... 2024-08-18T21:04:31.570 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28176]: created object 25... 2024-08-18T21:04:31.571 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28176]: created object 49... 2024-08-18T21:04:31.571 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28176]: finishing. 2024-08-18T21:04:31.571 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28176]: shutting down. 2024-08-18T21:04:32.478 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28177]: starting. 2024-08-18T21:04:32.478 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28177]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28175 2024-08-18T21:04:32.478 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28177]: shutting down. 2024-08-18T21:04:34.699 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:04:34.700 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28210]: starting. 2024-08-18T21:04:34.700 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28210]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28175 2024-08-18T21:04:34.700 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28210]: created object 0... 2024-08-18T21:04:34.700 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28210]: created object 25... 2024-08-18T21:04:34.700 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28210]: created object 49... 2024-08-18T21:04:34.700 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28210]: finishing. 2024-08-18T21:04:34.700 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28210]: shutting down. 2024-08-18T21:04:34.758 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:04:34.758 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28212]: starting. 2024-08-18T21:04:34.758 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28212]: listing objects. 2024-08-18T21:04:34.758 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28212]: listed object 0... 2024-08-18T21:04:34.758 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28212]: listed object 25... 2024-08-18T21:04:34.758 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28212]: saw 50 objects 2024-08-18T21:04:34.758 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28212]: shutting down. 2024-08-18T21:04:35.508 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:04:35.508 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28211]: starting. 2024-08-18T21:04:35.508 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28211]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28175 2024-08-18T21:04:35.508 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28211]: shutting down. 2024-08-18T21:04:35.511 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:04:35.512 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:04:35.512 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:04:35.515 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:04:37.740 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28263]: starting. 2024-08-18T21:04:37.741 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28263]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28262 2024-08-18T21:04:37.741 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28263]: created object 0... 2024-08-18T21:04:37.741 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28263]: created object 25... 2024-08-18T21:04:37.741 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28263]: created object 49... 2024-08-18T21:04:37.741 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28263]: finishing. 2024-08-18T21:04:37.741 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28263]: shutting down. 2024-08-18T21:04:38.542 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28264]: starting. 2024-08-18T21:04:38.542 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28264]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28262 2024-08-18T21:04:38.542 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28264]: shutting down. 2024-08-18T21:04:40.120 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-08-18T21:04:40.121 INFO:tasks.ceph.mon.e:Restarting daemon 2024-08-18T21:04:40.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-08-18T21:04:40.124 INFO:tasks.ceph.mon.e:Started 2024-08-18T21:04:40.124 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.h 2024-08-18T21:04:40.124 INFO:tasks.ceph.mon.h:Restarting daemon 2024-08-18T21:04:40.124 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2024-08-18T21:04:40.127 INFO:tasks.ceph.mon.h:Started 2024-08-18T21:04:40.127 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-18T21:04:40.127 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-18T21:04:40.127 INFO:tasks.mon_thrash:Sending STOP to mon d 2024-08-18T21:04:40.127 INFO:tasks.ceph.mon.d:Sent signal 19 2024-08-18T21:04:40.127 INFO:tasks.mon_thrash:Sending STOP to mon g 2024-08-18T21:04:40.128 INFO:tasks.ceph.mon.g:Sent signal 19 2024-08-18T21:04:40.128 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs to unfreeze mons 2024-08-18T21:04:51.765 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:04:51.765 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28297]: starting. 2024-08-18T21:04:51.765 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28297]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28262 2024-08-18T21:04:51.765 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28297]: created object 0... 2024-08-18T21:04:51.765 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28297]: created object 25... 2024-08-18T21:04:51.765 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28297]: created object 49... 2024-08-18T21:04:51.765 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28297]: finishing. 2024-08-18T21:04:51.766 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28297]: shutting down. 2024-08-18T21:05:00.129 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-18T21:05:00.129 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-18T21:05:00.129 INFO:tasks.mon_thrash:Sending CONT to mon d 2024-08-18T21:05:00.129 INFO:tasks.ceph.mon.d:Sent signal 18 2024-08-18T21:05:00.130 INFO:tasks.mon_thrash:Sending CONT to mon g 2024-08-18T21:05:00.130 INFO:tasks.ceph.mon.g:Sent signal 18 2024-08-18T21:05:00.130 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:05:00.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:05:00.240 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:00.240 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28299]: starting. 2024-08-18T21:05:00.240 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28299]: listing objects. 2024-08-18T21:05:00.240 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28299]: listed object 0... 2024-08-18T21:05:00.241 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28299]: listed object 25... 2024-08-18T21:05:00.241 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28299]: saw 50 objects 2024-08-18T21:05:00.241 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28299]: shutting down. 2024-08-18T21:05:00.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 10 monclient: get_monmap_and_config 2024-08-18T21:05:00.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 10 monclient: build_initial_monmap 2024-08-18T21:05:00.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 10 monclient: monmap: 2024-08-18T21:05:00.279 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:00.279 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.279 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:00.281485+0000 2024-08-18T21:05:00.280 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:00.281485+0000 2024-08-18T21:05:00.280 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:00.280 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.280 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:00.280 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:00.280 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:00.280 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:00.280 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:00.280 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:00.280 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:00.280 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:00.280 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:00.280 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:00.280 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:00.281 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 1 Processor -- start 2024-08-18T21:05:00.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 1 -- start start 2024-08-18T21:05:00.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 10 monclient: init 2024-08-18T21:05:00.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:00.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 10 monclient: _add_conns ranks=[2,3,9,0,8,4,10,7,1,6,5] 2024-08-18T21:05:00.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f58e0139dc0 0x7f58e013a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 10 monclient(hunting): picked mon.noname-b con 0x7f58e0139dc0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:00.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58e009f110 0x7f58e006c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 10 monclient(hunting): picked mon.noname-g con 0x7f58e009f110 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:00.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58e006ce90 0x7f58e006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 10 monclient(hunting): picked mon.noname-a con 0x7f58e006ce90 addr v2:172.21.15.5:3300/0 2024-08-18T21:05:00.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f58e00a4f90 con 0x7f58e006ce90 2024-08-18T21:05:00.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f58e009daa0 con 0x7f58e0139dc0 2024-08-18T21:05:00.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f58e009deb0 con 0x7f58e009f110 2024-08-18T21:05:00.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:00.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e84fe640 10 monclient(hunting): authenticate will time out at 1067.294674s 2024-08-18T21:05:00.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58e006ce90 0x7f58e006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e629a640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f58e0139dc0 0x7f58e013a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e629a640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f58e0139dc0 0x7f58e013a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34254/0 (socket says 172.21.15.5:34254) 2024-08-18T21:05:00.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e629a640 1 -- 172.21.15.5:0/346009295 learned_addr learned my addr 172.21.15.5:0/346009295 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:00.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58e006ce90 0x7f58e006d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36952/0 (socket says 172.21.15.5:36952) 2024-08-18T21:05:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e629a640 10 monclient(hunting): get_auth_request con 0x7f58e0139dc0 auth_method 0 2024-08-18T21:05:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e629a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e629a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e629a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 10 monclient(hunting): get_auth_request con 0x7f58e006ce90 auth_method 0 2024-08-18T21:05:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e5a99640 1 --2- 172.21.15.5:0/346009295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58e009f110 0x7f58e006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:00.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:00.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e629a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:00.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e629a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:00.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e629a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:00.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e5a99640 10 monclient(hunting): get_auth_request con 0x7f58e009f110 auth_method 0 2024-08-18T21:05:00.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e5a99640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e5a99640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e5a99640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 10 monclient(hunting): handle_auth_done global_id 4734 payload 274 2024-08-18T21:05:00.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 1 -- 172.21.15.5:0/346009295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58e009f110 msgr2=0x7f58e006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:00.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 1 --2- 172.21.15.5:0/346009295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58e009f110 0x7f58e006c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 1 -- 172.21.15.5:0/346009295 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f58e0139dc0 msgr2=0x7f58e013a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:00.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 1 --2- 172.21.15.5:0/346009295 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f58e0139dc0 0x7f58e013a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 10 monclient: _finish_hunting 0 2024-08-18T21:05:00.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 1 monclient: found mon.noname-a 2024-08-18T21:05:00.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:00.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:05:00.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e6a9b640 1 -- 172.21.15.5:0/346009295 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e009e190 con 0x7f58e006ce90 2024-08-18T21:05:00.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e5a99640 1 --2- 172.21.15.5:0/346009295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58e009f110 0x7f58e006c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:05:00.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.276+0000 7f58e629a640 1 --2- 172.21.15.5:0/346009295 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f58e0139dc0 0x7f58e013a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:00.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e6a9b640 1 -- 172.21.15.5:0/346009295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58e006ce90 msgr2=0x7f58e006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:00.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e6a9b640 1 --2- 172.21.15.5:0/346009295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58e006ce90 0x7f58e006d310 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009dc0 tx=0x7f58dc01c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc706f0ba1565e04 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:00.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e5298640 1 -- 172.21.15.5:0/346009295 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f58dc0a6950 con 0x7f58e006ce90 2024-08-18T21:05:00.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e5298640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:00.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e5298640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:05:00.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e5298640 10 monclient: dump: 2024-08-18T21:05:00.294 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:00.294 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.294 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.294 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.295 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:00.295 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.295 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:00.295 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:00.295 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:00.295 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:00.295 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:00.295 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:00.295 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:00.295 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:00.295 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:00.295 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e5298640 10 monclient: _finish_auth 0 2024-08-18T21:05:00.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e5298640 10 monclient: _check_auth_tickets 2024-08-18T21:05:00.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e5298640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:00.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e84fe640 5 monclient: authenticate success, global_id 4734 2024-08-18T21:05:00.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e84fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:05:00.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e5298640 1 -- 172.21.15.5:0/346009295 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58dc0a6b10 con 0x7f58e006ce90 2024-08-18T21:05:00.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e5298640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:00.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e5298640 1 -- 172.21.15.5:0/346009295 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f58dc0a6cc0 con 0x7f58e006ce90 2024-08-18T21:05:00.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e84fe640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:00.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e84fe640 4 set_mon_vals no callback set 2024-08-18T21:05:00.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.280+0000 7f58e5298640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:00.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e5298640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:05:00.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e5298640 10 monclient: dump: 2024-08-18T21:05:00.296 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:00.297 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.297 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.297 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.297 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:00.298 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.298 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:00.298 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:00.298 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:00.298 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:00.298 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:00.298 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:00.298 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:00.298 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:00.298 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:00.298 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 10 monclient: shutdown 2024-08-18T21:05:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 -- 172.21.15.5:0/346009295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58e006ce90 msgr2=0x7f58e006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 --2- 172.21.15.5:0/346009295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58e006ce90 0x7f58e006d310 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009dc0 tx=0x7f58dc01c810 comp rx=0 tx=0).stop 2024-08-18T21:05:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 -- 172.21.15.5:0/346009295 shutdown_connections 2024-08-18T21:05:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 --2- 172.21.15.5:0/346009295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58e006ce90 0x7f58e006d310 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 --2- 172.21.15.5:0/346009295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58e009f110 0x7f58e006c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 --2- 172.21.15.5:0/346009295 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f58e0139dc0 0x7f58e013a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 -- 172.21.15.5:0/346009295 >> 172.21.15.5:0/346009295 conn(0x7f58e00688d0 msgr2=0x7f58e0068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 -- 172.21.15.5:0/346009295 shutdown_connections 2024-08-18T21:05:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 -- 172.21.15.5:0/346009295 wait complete. 2024-08-18T21:05:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 10 monclient: build_initial_monmap 2024-08-18T21:05:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 10 monclient: monmap: 2024-08-18T21:05:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:00.301 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:00.301 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:00.301 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 Processor -- start 2024-08-18T21:05:00.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 -- start start 2024-08-18T21:05:00.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 10 monclient: init 2024-08-18T21:05:00.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:00.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 10 monclient: _add_conns ranks=[6,3,4,7,8,1,5,2,0] 2024-08-18T21:05:00.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f58e006ce90 0x7f58e011f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 10 monclient(hunting): picked mon.noname-d con 0x7f58e006ce90 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:00.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58e009f110 0x7f58e011fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 10 monclient(hunting): picked mon.noname-g con 0x7f58e009f110 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:00.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f58e0139dc0 0x7f58e011ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 10 monclient(hunting): picked mon.noname-c con 0x7f58e0139dc0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f58e01437f0 con 0x7f58e009f110 2024-08-18T21:05:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f58e0143670 con 0x7f58e0139dc0 2024-08-18T21:05:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f58e0143970 con 0x7f58e006ce90 2024-08-18T21:05:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e84fe640 10 monclient(hunting): authenticate will time out at 1067.302377s 2024-08-18T21:05:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f58e006ce90 0x7f58e011f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f58e006ce90 0x7f58e011f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:60368/0 (socket says 172.21.15.5:60368) 2024-08-18T21:05:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e6a9b640 1 -- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f58e0139dc0 msgr2=0x7f58e011ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-18T21:05:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 1 -- 172.21.15.5:0/161804255 learned_addr learned my addr 172.21.15.5:0/161804255 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:00.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e6a9b640 1 -- 172.21.15.5:0/161804255 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f58e0139dc0 msgr2=0x7f58e011ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:05:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 10 monclient(hunting): get_auth_request con 0x7f58e006ce90 auth_method 0 2024-08-18T21:05:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e6a9b640 1 --2- 172.21.15.5:0/161804255 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f58e0139dc0 0x7f58e011ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2024-08-18T21:05:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e6a9b640 1 --2- 172.21.15.5:0/161804255 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f58e0139dc0 0x7f58e011ffb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e5a99640 1 --2- 172.21.15.5:0/161804255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58e009f110 0x7f58e011fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e5a99640 10 monclient(hunting): get_auth_request con 0x7f58e009f110 auth_method 0 2024-08-18T21:05:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e5a99640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e5a99640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e5a99640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 10 monclient(hunting): handle_auth_done global_id 4623 payload 824 2024-08-18T21:05:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 1 -- 172.21.15.5:0/161804255 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f58e0139dc0 msgr2=0x7f58e011ffb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:05:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 1 --2- 172.21.15.5:0/161804255 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f58e0139dc0 0x7f58e011ffb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 1 -- 172.21.15.5:0/161804255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58e009f110 msgr2=0x7f58e011fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 1 --2- 172.21.15.5:0/161804255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58e009f110 0x7f58e011fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 10 monclient: _finish_hunting 0 2024-08-18T21:05:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 1 monclient: found mon.noname-d 2024-08-18T21:05:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:05:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.284+0000 7f58e629a640 1 -- 172.21.15.5:0/161804255 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e0122250 con 0x7f58e006ce90 2024-08-18T21:05:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58e629a640 1 -- 172.21.15.5:0/161804255 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f58e006ce90 msgr2=0x7f58e011f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58e629a640 1 --2- 172.21.15.5:0/161804255 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f58e006ce90 0x7f58e011f530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f58d800e930 tx=0x7f58d800edf0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:00.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58d6ffd640 1 -- 172.21.15.5:0/161804255 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f58d8017070 con 0x7f58e006ce90 2024-08-18T21:05:00.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:00.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58d6ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:05:00.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58d6ffd640 10 monclient: dump: 2024-08-18T21:05:00.305 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:00.305 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.305 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.305 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.305 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:00.305 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.305 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:00.305 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:00.305 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:00.306 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58d6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:05:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58d6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:05:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58d6ffd640 1 -- 172.21.15.5:0/161804255 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d8013470 con 0x7f58e006ce90 2024-08-18T21:05:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58e84fe640 5 monclient: authenticate success, global_id 4623 2024-08-18T21:05:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58e84fe640 10 monclient: _renew_subs 2024-08-18T21:05:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58e84fe640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58e84fe640 1 -- 172.21.15.5:0/161804255 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e0137650 con 0x7f58e006ce90 2024-08-18T21:05:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58d6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58d6ffd640 1 -- 172.21.15.5:0/161804255 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f58d8013a90 con 0x7f58e006ce90 2024-08-18T21:05:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58d6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:05:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58e4a97640 4 set_mon_vals no callback set 2024-08-18T21:05:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58d6ffd640 10 monclient: dump: 2024-08-18T21:05:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:00.308 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58e84fe640 10 monclient: _renew_subs 2024-08-18T21:05:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58e84fe640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58e84fe640 1 -- 172.21.15.5:0/161804255 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e01401e0 con 0x7f58e006ce90 2024-08-18T21:05:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58e84fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58e84fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58e84fe640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58e84fe640 1 -- 172.21.15.5:0/161804255 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e006c950 con 0x7f58e006ce90 2024-08-18T21:05:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58d6ffd640 1 -- 172.21.15.5:0/161804255 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f58d801a070 con 0x7f58e006ce90 2024-08-18T21:05:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58d6ffd640 1 --2- 172.21.15.5:0/161804255 >> v2:172.21.15.157:6812/631023601 conn(0x7f58c403bdc0 0x7f58c403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58d6ffd640 1 -- 172.21.15.5:0/161804255 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(46..46 src has 11..46) ==== 3898+0+0 (secure 0 0 0) 0x7f58d800f040 con 0x7f58e006ce90 2024-08-18T21:05:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58e5a99640 1 --2- 172.21.15.5:0/161804255 >> v2:172.21.15.157:6812/631023601 conn(0x7f58c403bdc0 0x7f58c403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.288+0000 7f58e5a99640 10 monclient: get_auth_request con 0x7f58c403bdc0 auth_method 0 2024-08-18T21:05:00.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.292+0000 7f58e5a99640 1 --2- 172.21.15.5:0/161804255 >> v2:172.21.15.157:6812/631023601 conn(0x7f58c403bdc0 0x7f58c403e280 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f58e013f820 tx=0x7f58d0008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:00.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.292+0000 7f58d6ffd640 1 -- 172.21.15.5:0/161804255 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f58d8021070 con 0x7f58e006ce90 2024-08-18T21:05:00.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.292+0000 7f58d6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:00.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.292+0000 7f58d6ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.528+0000 7f58e84fe640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:05:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.528+0000 7f58e84fe640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:05:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.528+0000 7f58e84fe640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:00.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.528+0000 7f58e84fe640 1 -- 172.21.15.5:0/161804255 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f58e0074670 con 0x7f58e006ce90 2024-08-18T21:05:00.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.528+0000 7f58d6ffd640 1 -- 172.21.15.5:0/161804255 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3172 (secure 0 0 0) 0x7f58d8013620 con 0x7f58e006ce90 2024-08-18T21:05:00.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.528+0000 7f58d6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:05:00.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.528+0000 7f58d6ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:00.532 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":30,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.532+0000 7f58e84fe640 1 -- 172.21.15.5:0/161804255 >> v2:172.21.15.157:6812/631023601 conn(0x7f58c403bdc0 msgr2=0x7f58c403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.532+0000 7f58e84fe640 1 --2- 172.21.15.5:0/161804255 >> v2:172.21.15.157:6812/631023601 conn(0x7f58c403bdc0 0x7f58c403e280 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f58e013f820 tx=0x7f58d0008040 comp rx=0 tx=0).stop 2024-08-18T21:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.532+0000 7f58e84fe640 10 monclient: shutdown 2024-08-18T21:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.532+0000 7f58e84fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.532+0000 7f58e84fe640 1 -- 172.21.15.5:0/161804255 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f58e006ce90 msgr2=0x7f58e011f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.532+0000 7f58e84fe640 1 --2- 172.21.15.5:0/161804255 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f58e006ce90 0x7f58e011f530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f58d800e930 tx=0x7f58d800edf0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.532+0000 7f58e84fe640 1 -- 172.21.15.5:0/161804255 shutdown_connections 2024-08-18T21:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.532+0000 7f58e84fe640 1 --2- 172.21.15.5:0/161804255 >> v2:172.21.15.157:6812/631023601 conn(0x7f58c403bdc0 0x7f58c403e280 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.532+0000 7f58e84fe640 1 --2- 172.21.15.5:0/161804255 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f58e0139dc0 0x7f58e011ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.532+0000 7f58e84fe640 1 --2- 172.21.15.5:0/161804255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58e009f110 0x7f58e011fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.532+0000 7f58e84fe640 1 --2- 172.21.15.5:0/161804255 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f58e006ce90 0x7f58e011f530 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.532+0000 7f58e84fe640 1 -- 172.21.15.5:0/161804255 >> 172.21.15.5:0/161804255 conn(0x7f58e00688d0 msgr2=0x7f58e00a22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.532+0000 7f58e84fe640 1 -- 172.21.15.5:0/161804255 shutdown_connections 2024-08-18T21:05:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.532+0000 7f58e84fe640 1 -- 172.21.15.5:0/161804255 wait complete. 2024-08-18T21:05:00.552 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:05:00.552 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:05:00.552 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:05:00.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 10 monclient: get_monmap_and_config 2024-08-18T21:05:00.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 10 monclient: build_initial_monmap 2024-08-18T21:05:00.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 10 monclient: monmap: 2024-08-18T21:05:00.679 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:00.679 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:00.681536+0000 2024-08-18T21:05:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:00.681536+0000 2024-08-18T21:05:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:00.681 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 1 Processor -- start 2024-08-18T21:05:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 1 -- start start 2024-08-18T21:05:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 10 monclient: init 2024-08-18T21:05:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 10 monclient: _add_conns ranks=[5,3,1,4,8,7,9,6,2,0,10] 2024-08-18T21:05:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f25380a4960 0x7f25380a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 10 monclient(hunting): picked mon.noname-h con 0x7f25380a4960 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253806ce10 0x7f25380a5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 10 monclient(hunting): picked mon.noname-g con 0x7f253806ce10 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f2538138730 addr v1:172.21.15.157:6789/0 2024-08-18T21:05:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253809e7f0 con 0x7f2538138730 2024-08-18T21:05:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f253809da30 con 0x7f253806ce10 2024-08-18T21:05:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f253809e1c0 con 0x7f25380a4960 2024-08-18T21:05:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f253e00b640 10 monclient(hunting): authenticate will time out at 1067.695445s 2024-08-18T21:05:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f252effd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253806ce10 0x7f25380a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f252effd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253806ce10 0x7f25380a5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:46900/0 (socket says 172.21.15.5:46900) 2024-08-18T21:05:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f252effd640 1 -- 172.21.15.5:0/3165863566 learned_addr learned my addr 172.21.15.5:0/3165863566 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f252effd640 10 monclient(hunting): get_auth_request con 0x7f253806ce10 auth_method 0 2024-08-18T21:05:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f252effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f252effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f252effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.676+0000 7f25377fe640 1 --2- 172.21.15.5:0/3165863566 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f25380a4960 0x7f25380a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f25377fe640 10 monclient(hunting): get_auth_request con 0x7f25380a4960 auth_method 0 2024-08-18T21:05:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f25377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f25377fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f25377fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f252effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f252effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f252effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f25377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f25377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f25377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f252effd640 10 monclient(hunting): handle_auth_done global_id 4602 payload 274 2024-08-18T21:05:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f252effd640 1 -- 172.21.15.5:0/3165863566 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f25380a4960 msgr2=0x7f25380a4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f252effd640 1 --2- 172.21.15.5:0/3165863566 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f25380a4960 0x7f25380a4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f252effd640 1 -- 172.21.15.5:0/3165863566 >> v1:172.21.15.157:6789/0 conn(0x7f2538138730 legacy=0x7f2538138b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f252effd640 10 monclient: _finish_hunting 0 2024-08-18T21:05:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f252effd640 1 monclient: found mon.noname-g 2024-08-18T21:05:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f252effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f252effd640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:05:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.680+0000 7f252effd640 1 -- 172.21.15.5:0/3165863566 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253809dee0 con 0x7f253806ce10 2024-08-18T21:05:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f252effd640 1 -- 172.21.15.5:0/3165863566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253806ce10 msgr2=0x7f25380a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f252effd640 1 --2- 172.21.15.5:0/3165863566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253806ce10 0x7f25380a5280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f25200098a0 tx=0x7f252001cea0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=9eaabed23d034ea5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f2536ffd640 1 -- 172.21.15.5:0/3165863566 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f25200b0070 con 0x7f253806ce10 2024-08-18T21:05:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f2536ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f2536ffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:05:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f2536ffd640 10 monclient: dump: 2024-08-18T21:05:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:00.689 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f2536ffd640 10 monclient: _finish_auth 0 2024-08-18T21:05:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f2536ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:05:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f2536ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f2536ffd640 1 -- 172.21.15.5:0/3165863566 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25200aa810 con 0x7f253806ce10 2024-08-18T21:05:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f2536ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f2536ffd640 1 -- 172.21.15.5:0/3165863566 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f25200a9300 con 0x7f253806ce10 2024-08-18T21:05:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 5 monclient: authenticate success, global_id 4602 2024-08-18T21:05:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 4 set_mon_vals no callback set 2024-08-18T21:05:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f2536ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f2536ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:05:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f2536ffd640 10 monclient: dump: 2024-08-18T21:05:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:00.691 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 10 monclient: shutdown 2024-08-18T21:05:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 1 -- 172.21.15.5:0/3165863566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253806ce10 msgr2=0x7f25380a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 1 --2- 172.21.15.5:0/3165863566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253806ce10 0x7f25380a5280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f25200098a0 tx=0x7f252001cea0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 1 -- 172.21.15.5:0/3165863566 shutdown_connections 2024-08-18T21:05:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 1 --2- 172.21.15.5:0/3165863566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253806ce10 0x7f25380a5280 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 1 --2- 172.21.15.5:0/3165863566 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f25380a4960 0x7f25380a4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 1 -- 172.21.15.5:0/3165863566 >> 172.21.15.5:0/3165863566 conn(0x7f25380a6440 msgr2=0x7f2538068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 1 -- 172.21.15.5:0/3165863566 shutdown_connections 2024-08-18T21:05:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 1 -- 172.21.15.5:0/3165863566 wait complete. 2024-08-18T21:05:00.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 10 monclient: build_initial_monmap 2024-08-18T21:05:00.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 10 monclient: monmap: 2024-08-18T21:05:00.697 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:00.697 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:00.697 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:00.698 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 1 Processor -- start 2024-08-18T21:05:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 1 -- start start 2024-08-18T21:05:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 10 monclient: init 2024-08-18T21:05:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 10 monclient: _add_conns ranks=[6,4,0,3,5,1,8,7,2] 2024-08-18T21:05:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.684+0000 7f253e00b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f253806ce10 0x7f2538137340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 10 monclient(hunting): picked mon.noname-d con 0x7f253806ce10 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f25380a4960 0x7f2538137880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 10 monclient(hunting): picked mon.noname-c con 0x7f25380a4960 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2538138730 0x7f253811f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 10 monclient(hunting): picked mon.noname-a con 0x7f2538138730 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:05:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2538144520 con 0x7f2538138730 2024-08-18T21:05:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f253809f3c0 con 0x7f25380a4960 2024-08-18T21:05:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f25381446a0 con 0x7f253806ce10 2024-08-18T21:05:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 10 monclient(hunting): authenticate will time out at 1067.704079s 2024-08-18T21:05:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f253806ce10 0x7f2538137340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f252effd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f25380a4960 0x7f2538137880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f253806ce10 0x7f2538137340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:60378/0 (socket says 172.21.15.5:60378) 2024-08-18T21:05:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 1 -- 172.21.15.5:0/3272141419 learned_addr learned my addr 172.21.15.5:0/3272141419 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 10 monclient(hunting): get_auth_request con 0x7f253806ce10 auth_method 0 2024-08-18T21:05:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f252effd640 10 monclient(hunting): get_auth_request con 0x7f25380a4960 auth_method 0 2024-08-18T21:05:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f252effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f252effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f252effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2537fff640 1 --2- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2538138730 0x7f253811f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2537fff640 10 monclient(hunting): get_auth_request con 0x7f2538138730 auth_method 0 2024-08-18T21:05:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2537fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2537fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2537fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f252effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f252effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f252effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2537fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2537fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2537fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 10 monclient(hunting): handle_auth_done global_id 4632 payload 824 2024-08-18T21:05:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 1 -- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f25380a4960 msgr2=0x7f2538137880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 1 --2- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f25380a4960 0x7f2538137880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 1 -- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2538138730 msgr2=0x7f253811f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 1 --2- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2538138730 0x7f253811f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 10 monclient: _finish_hunting 0 2024-08-18T21:05:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 1 monclient: found mon.noname-d 2024-08-18T21:05:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:05:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 1 -- 172.21.15.5:0/3272141419 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25380a6de0 con 0x7f253806ce10 2024-08-18T21:05:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f252effd640 1 --2- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f25380a4960 0x7f2538137880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 1 -- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f253806ce10 msgr2=0x7f2538137340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25377fe640 1 --2- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f253806ce10 0x7f2538137340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f252800e930 tx=0x7f252800edf0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2534ff9640 1 -- 172.21.15.5:0/3272141419 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2528017070 con 0x7f253806ce10 2024-08-18T21:05:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2534ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2534ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:05:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2534ff9640 10 monclient: dump: 2024-08-18T21:05:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:00.704 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2534ff9640 10 monclient: _finish_auth 0 2024-08-18T21:05:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2534ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:05:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2534ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 5 monclient: authenticate success, global_id 4632 2024-08-18T21:05:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 10 monclient: _renew_subs 2024-08-18T21:05:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2534ff9640 1 -- 172.21.15.5:0/3272141419 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252800cc10 con 0x7f253806ce10 2024-08-18T21:05:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 1 -- 172.21.15.5:0/3272141419 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2538121b50 con 0x7f253806ce10 2024-08-18T21:05:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2534ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2534ff9640 1 -- 172.21.15.5:0/3272141419 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f252800cdc0 con 0x7f253806ce10 2024-08-18T21:05:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2534ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2534ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:05:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f2534ff9640 10 monclient: dump: 2024-08-18T21:05:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:00.706 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f25367fc640 4 set_mon_vals no callback set 2024-08-18T21:05:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 10 monclient: _renew_subs 2024-08-18T21:05:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.688+0000 7f253e00b640 1 -- 172.21.15.5:0/3272141419 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f2538120910 con 0x7f253806ce10 2024-08-18T21:05:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f253e00b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f253e00b640 1 --2- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253811fae0 0x7f253811fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f253e00b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f253e00b640 1 -- 172.21.15.5:0/3272141419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2538122270 con 0x7f253811fae0 2024-08-18T21:05:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f252effd640 1 --2- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253811fae0 0x7f253811fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f252effd640 10 monclient: get_auth_request con 0x7f253811fae0 auth_method 0 2024-08-18T21:05:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f252effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f252effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f252effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2534ff9640 1 -- 172.21.15.5:0/3272141419 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f252801a070 con 0x7f253806ce10 2024-08-18T21:05:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f252effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:00.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f252effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:00.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f252effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:00.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f252effd640 10 monclient(hunting): handle_auth_done global_id 4752 payload 824 2024-08-18T21:05:00.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2534ff9640 1 --2- 172.21.15.5:0/3272141419 >> v2:172.21.15.157:6812/631023601 conn(0x7f251803bdc0 0x7f251803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f252effd640 1 -- 172.21.15.5:0/3272141419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2538120be0 con 0x7f253811fae0 2024-08-18T21:05:00.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2534ff9640 1 -- 172.21.15.5:0/3272141419 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(46..46 src has 11..46) ==== 3898+0+0 (secure 0 0 0) 0x7f252800f040 con 0x7f253806ce10 2024-08-18T21:05:00.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2537fff640 1 --2- 172.21.15.5:0/3272141419 >> v2:172.21.15.157:6812/631023601 conn(0x7f251803bdc0 0x7f251803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2537fff640 10 monclient: get_auth_request con 0x7f251803bdc0 auth_method 0 2024-08-18T21:05:00.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f252effd640 1 -- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253811fae0 msgr2=0x7f253811fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:00.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f252effd640 1 --2- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253811fae0 0x7f253811fec0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f25200ad000 tx=0x7f25200191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:00.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2534ff9640 1 -- 172.21.15.5:0/3272141419 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f25200ba020 con 0x7f253811fae0 2024-08-18T21:05:00.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2534ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:00.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2534ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:05:00.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2534ff9640 10 monclient: dump: 2024-08-18T21:05:00.709 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:00.709 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.709 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.709 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.709 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:00.709 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.709 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:00.709 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:00.709 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:00.709 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:00.709 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:00.709 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:00.709 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:00.709 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:00.710 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:00.710 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2534ff9640 1 -- 172.21.15.5:0/3272141419 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f25200aaa20 con 0x7f253811fae0 2024-08-18T21:05:00.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2534ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:00.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2534ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:00.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2534ff9640 1 -- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253811fae0 msgr2=0x7f253811fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2534ff9640 1 --2- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253811fae0 0x7f253811fec0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f25200ad000 tx=0x7f25200191e0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2534ff9640 1 -- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253811fae0 msgr2=0x7f253811fec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:00.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2534ff9640 1 --2- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253811fae0 0x7f253811fec0 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f25200ad000 tx=0x7f25200191e0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.692+0000 7f2537fff640 1 --2- 172.21.15.5:0/3272141419 >> v2:172.21.15.157:6812/631023601 conn(0x7f251803bdc0 0x7f251803e280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2530009f60 tx=0x7f253000d040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:00.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.700+0000 7f253e00b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:00.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.700+0000 7f253e00b640 1 --2- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253813bac0 0x7f253813bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.700+0000 7f253e00b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.700+0000 7f253e00b640 1 -- 172.21.15.5:0/3272141419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2538051140 con 0x7f253813bac0 2024-08-18T21:05:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.700+0000 7f252effd640 1 --2- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253813bac0 0x7f253813bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.700+0000 7f252effd640 10 monclient: get_auth_request con 0x7f253813bac0 auth_method 0 2024-08-18T21:05:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.700+0000 7f252effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.700+0000 7f252effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.700+0000 7f252effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.700+0000 7f252effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.700+0000 7f252effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.700+0000 7f252effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.700+0000 7f252effd640 10 monclient(hunting): handle_auth_done global_id 4761 payload 824 2024-08-18T21:05:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.700+0000 7f252effd640 1 -- 172.21.15.5:0/3272141419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2538120400 con 0x7f253813bac0 2024-08-18T21:05:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f252effd640 1 -- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253813bac0 msgr2=0x7f253813bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f252effd640 1 --2- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253813bac0 0x7f253813bed0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f252001cee0 tx=0x7f25200a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f2534ff9640 1 -- 172.21.15.5:0/3272141419 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f25200ba040 con 0x7f253813bac0 2024-08-18T21:05:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f2534ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f2534ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:05:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f2534ff9640 10 monclient: dump: 2024-08-18T21:05:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:00.715 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f2534ff9640 1 -- 172.21.15.5:0/3272141419 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9416 (secure 0 0 0) 0x7f2520003830 con 0x7f253813bac0 2024-08-18T21:05:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f2534ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f2534ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f2534ff9640 1 -- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253813bac0 msgr2=0x7f253813bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f2534ff9640 1 --2- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253813bac0 0x7f253813bed0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f252001cee0 tx=0x7f25200a6000 comp rx=0 tx=0).stop 2024-08-18T21:05:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f2534ff9640 1 -- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253813bac0 msgr2=0x7f253813bed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f2534ff9640 1 --2- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253813bac0 0x7f253813bed0 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f252001cee0 tx=0x7f25200a6000 comp rx=0 tx=0).stop 2024-08-18T21:05:00.716 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:00.716 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:00.716 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:00.716 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:05:00.716 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:00.716 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 109826, 2024-08-18T21:05:00.716 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:00.716 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:00.716 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:00.717 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:00.717 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:00.717 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:00.717 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:00.717 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:00.717 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:00.717 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:00.717 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:00.717 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:05:00.717 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:00.717 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:00.717 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:00.717 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:00.718 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:00.718 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:00.718 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:00.718 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:00.718 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:00.718 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:00.718 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:00.718 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:00.718 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:00.718 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:00.718 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:00.718 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:00.718 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:00.719 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:00.719 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:00.719 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:00.719 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:00.719 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:00.719 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:00.719 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:00.719 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:00.719 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:00.719 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:00.719 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:00.719 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.719 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:00.720 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:00.720 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:00.720 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:00.720 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:00.720 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:00.720 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:00.720 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:00.720 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:00.720 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:00.720 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:00.720 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:00.720 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:00.720 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:00.721 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:00.721 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:00.721 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:00.721 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:00.721 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:00.721 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:00.721 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:00.721 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:00.721 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:00.721 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:00.721 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:00.721 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:00.721 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:00.721 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:00.722 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:00.722 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:00.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.722 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:00.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.722 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:00.722 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:00.722 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.722 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.722 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.722 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:00.722 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.723 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.723 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:00.723 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.723 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.723 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.723 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:00.723 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:00.723 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.723 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.723 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.724 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:00.724 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:00.724 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:00.724 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:00.724 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.724 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.725 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:00.725 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:00.725 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.725 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.725 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.725 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:00.725 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:00.725 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.726 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:00.726 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.726 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:00.726 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.726 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.726 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:00.726 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.728 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.728 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:00.728 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.728 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.728 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.728 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:00.728 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:00.728 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.728 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.728 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.729 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:00.729 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:00.729 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:00.729 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:00.729 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.729 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.730 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.730 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:00.730 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:00.730 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.730 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.730 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.730 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:00.730 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:00.730 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.730 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:00.731 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:00.731 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.731 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.731 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:00.731 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:00.731 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.732 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.732 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.732 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.732 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:00.732 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:00.732 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.732 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.732 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.732 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.732 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:00.732 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.733 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:00.733 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.733 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.733 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.733 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:00.733 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:00.733 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.733 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.733 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.734 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:00.734 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:00.734 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.734 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.734 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.734 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:00.734 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.734 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.734 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:00.734 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.734 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.735 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.735 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:00.735 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:00.735 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.735 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.735 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.735 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:00.735 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:00.735 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.735 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:00.736 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:00.736 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.736 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.736 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:00.736 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:05:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:05:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:00.739 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:00.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f253e00b640 1 -- 172.21.15.5:0/3272141419 >> v2:172.21.15.157:6812/631023601 conn(0x7f251803bdc0 msgr2=0x7f251803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f253e00b640 1 --2- 172.21.15.5:0/3272141419 >> v2:172.21.15.157:6812/631023601 conn(0x7f251803bdc0 0x7f251803e280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2530009f60 tx=0x7f253000d040 comp rx=0 tx=0).stop 2024-08-18T21:05:00.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f253e00b640 10 monclient: shutdown 2024-08-18T21:05:00.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f253e00b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:00.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f253e00b640 1 -- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f253806ce10 msgr2=0x7f2538137340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f253e00b640 1 --2- 172.21.15.5:0/3272141419 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f253806ce10 0x7f2538137340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f252800e930 tx=0x7f252800edf0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f2537fff640 1 -- 172.21.15.5:0/3272141419 reap_dead start 2024-08-18T21:05:00.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f2537fff640 1 -- 172.21.15.5:0/3272141419 reap_dead start 2024-08-18T21:05:00.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f253e00b640 1 -- 172.21.15.5:0/3272141419 shutdown_connections 2024-08-18T21:05:00.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f253e00b640 1 -- 172.21.15.5:0/3272141419 >> 172.21.15.5:0/3272141419 conn(0x7f25380a6440 msgr2=0x7f2538139740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:00.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f253e00b640 1 -- 172.21.15.5:0/3272141419 shutdown_connections 2024-08-18T21:05:00.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.704+0000 7f253e00b640 1 -- 172.21.15.5:0/3272141419 wait complete. 2024-08-18T21:05:00.741 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:00.741 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:05:00.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:05:00.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 10 monclient: get_monmap_and_config 2024-08-18T21:05:00.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 10 monclient: build_initial_monmap 2024-08-18T21:05:00.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 10 monclient: monmap: 2024-08-18T21:05:00.859 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:00.859 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.859 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:00.861425+0000 2024-08-18T21:05:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:00.861425+0000 2024-08-18T21:05:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:00.861 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 1 Processor -- start 2024-08-18T21:05:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 1 -- start start 2024-08-18T21:05:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 10 monclient: init 2024-08-18T21:05:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 10 monclient: _add_conns ranks=[4,1,0,3,2,9,7,8,6,5,10] 2024-08-18T21:05:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61e40a6ce0 0x7f61e40a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 10 monclient(hunting): picked mon.noname-c con 0x7f61e40a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f61e40a7600 addr v1:172.21.15.157:6789/0 2024-08-18T21:05:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f61e413a1b0 addr v1:172.21.15.5:6789/0 2024-08-18T21:05:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61e40a45d0 con 0x7f61e413a1b0 2024-08-18T21:05:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61e40a32d0 con 0x7f61e40a7600 2024-08-18T21:05:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f61e40a5000 con 0x7f61e40a6ce0 2024-08-18T21:05:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61eb617640 10 monclient(hunting): authenticate will time out at 1067.874615s 2024-08-18T21:05:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e93b3640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61e40a6ce0 0x7f61e40a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e9bb4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f61e413a1b0 0x7f61e4141d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56782/0 (socket says 172.21.15.5:56782) 2024-08-18T21:05:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e9bb4640 1 -- 172.21.15.5:0/3107743523 learned_addr learned my addr 172.21.15.5:0/3107743523 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:05:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e93b3640 10 monclient(hunting): get_auth_request con 0x7f61e40a6ce0 auth_method 0 2024-08-18T21:05:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e93b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e93b3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e93b3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e93b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e93b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e93b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e93b3640 10 monclient(hunting): handle_auth_done global_id 4657 payload 274 2024-08-18T21:05:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e93b3640 1 -- 172.21.15.5:0/3107743523 >> v1:172.21.15.157:6789/0 conn(0x7f61e40a7600 legacy=0x7f61e4139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e93b3640 1 -- 172.21.15.5:0/3107743523 >> v1:172.21.15.5:6789/0 conn(0x7f61e413a1b0 legacy=0x7f61e4141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e93b3640 10 monclient: _finish_hunting 0 2024-08-18T21:05:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e93b3640 1 monclient: found mon.noname-c 2024-08-18T21:05:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e93b3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e93b3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:05:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.856+0000 7f61e93b3640 1 -- 172.21.15.5:0/3107743523 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e40a8900 con 0x7f61e40a6ce0 2024-08-18T21:05:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61e93b3640 1 -- 172.21.15.5:0/3107743523 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61e40a6ce0 msgr2=0x7f61e40a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61e93b3640 1 --2- 172.21.15.5:0/3107743523 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61e40a6ce0 0x7f61e40a70c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f61d40097f0 tx=0x7f61d401c3a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=de2d2d39d7373527 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61dbfff640 1 -- 172.21.15.5:0/3107743523 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f61d40b0070 con 0x7f61e40a6ce0 2024-08-18T21:05:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61dbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61dbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:05:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61dbfff640 10 monclient: dump: 2024-08-18T21:05:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:00.867 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61dbfff640 10 monclient: _finish_auth 0 2024-08-18T21:05:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61dbfff640 10 monclient: _check_auth_tickets 2024-08-18T21:05:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61dbfff640 1 -- 172.21.15.5:0/3107743523 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d40aa810 con 0x7f61e40a6ce0 2024-08-18T21:05:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61dbfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61dbfff640 1 -- 172.21.15.5:0/3107743523 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f61d40a93e0 con 0x7f61e40a6ce0 2024-08-18T21:05:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61dbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61dbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61dbfff640 10 monclient: dump: 2024-08-18T21:05:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:00.869 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61eb617640 5 monclient: authenticate success, global_id 4657 2024-08-18T21:05:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61eb617640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.860+0000 7f61eb617640 4 set_mon_vals no callback set 2024-08-18T21:05:00.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 10 monclient: shutdown 2024-08-18T21:05:00.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:00.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 1 -- 172.21.15.5:0/3107743523 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61e40a6ce0 msgr2=0x7f61e40a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 1 --2- 172.21.15.5:0/3107743523 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61e40a6ce0 0x7f61e40a70c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f61d40097f0 tx=0x7f61d401c3a0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 1 -- 172.21.15.5:0/3107743523 shutdown_connections 2024-08-18T21:05:00.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 1 --2- 172.21.15.5:0/3107743523 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61e40a6ce0 0x7f61e40a70c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 1 -- 172.21.15.5:0/3107743523 >> 172.21.15.5:0/3107743523 conn(0x7f61e40acbc0 msgr2=0x7f61e40a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:00.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 1 -- 172.21.15.5:0/3107743523 shutdown_connections 2024-08-18T21:05:00.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 1 -- 172.21.15.5:0/3107743523 wait complete. 2024-08-18T21:05:00.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 10 monclient: build_initial_monmap 2024-08-18T21:05:00.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 10 monclient: monmap: 2024-08-18T21:05:00.875 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:00.875 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:00.875 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:00.875 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:00.875 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:00.875 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.875 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:00.875 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:00.875 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:00.875 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:00.875 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:00.875 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:00.876 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 1 Processor -- start 2024-08-18T21:05:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 1 -- start start 2024-08-18T21:05:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 10 monclient: init 2024-08-18T21:05:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 10 monclient: _add_conns ranks=[4,8,6,3,5,0,1,2,7] 2024-08-18T21:05:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61e40a6ce0 0x7f61e4131c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 10 monclient(hunting): picked mon.noname-c con 0x7f61e40a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f61e40a7600 0x7f61e41321c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 10 monclient(hunting): picked mon.noname-e con 0x7f61e40a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:05:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61e413a1b0 0x7f61e4136c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 10 monclient(hunting): picked mon.noname-d con 0x7f61e413a1b0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:00.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f61e40a79e0 con 0x7f61e40a6ce0 2024-08-18T21:05:00.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f61e40a8220 con 0x7f61e413a1b0 2024-08-18T21:05:00.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f61e4142f00 con 0x7f61e40a7600 2024-08-18T21:05:00.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:00.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61eb617640 10 monclient(hunting): authenticate will time out at 1067.882549s 2024-08-18T21:05:00.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e93b3640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61e40a6ce0 0x7f61e4131c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61e413a1b0 0x7f61e4136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e93b3640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61e40a6ce0 0x7f61e4131c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:40136/0 (socket says 172.21.15.5:40136) 2024-08-18T21:05:00.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61e413a1b0 0x7f61e4136c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:60392/0 (socket says 172.21.15.5:60392) 2024-08-18T21:05:00.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e93b3640 1 -- 172.21.15.5:0/3043989670 learned_addr learned my addr 172.21.15.5:0/3043989670 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e93b3640 10 monclient(hunting): get_auth_request con 0x7f61e40a6ce0 auth_method 0 2024-08-18T21:05:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e93b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e93b3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e93b3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 10 monclient(hunting): get_auth_request con 0x7f61e413a1b0 auth_method 0 2024-08-18T21:05:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e8bb2640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f61e40a7600 0x7f61e41321c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e8bb2640 10 monclient(hunting): get_auth_request con 0x7f61e40a7600 auth_method 0 2024-08-18T21:05:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e8bb2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e8bb2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e8bb2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:00.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:00.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:00.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e93b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:00.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e93b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:00.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e93b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:00.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e8bb2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:00.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e8bb2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:00.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e8bb2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:00.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 10 monclient(hunting): handle_auth_done global_id 4641 payload 824 2024-08-18T21:05:00.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 1 -- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f61e40a7600 msgr2=0x7f61e41321c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f61e40a7600 0x7f61e41321c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 1 -- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61e40a6ce0 msgr2=0x7f61e4131c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61e40a6ce0 0x7f61e4131c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 10 monclient: _finish_hunting 0 2024-08-18T21:05:00.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 1 monclient: found mon.noname-d 2024-08-18T21:05:00.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:00.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:05:00.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e9bb4640 1 -- 172.21.15.5:0/3043989670 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e41427a0 con 0x7f61e413a1b0 2024-08-18T21:05:00.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e8bb2640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f61e40a7600 0x7f61e41321c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:00.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.864+0000 7f61e93b3640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61e40a6ce0 0x7f61e4131c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:00.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61e9bb4640 1 -- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61e413a1b0 msgr2=0x7f61e4136c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:00.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61e9bb4640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61e413a1b0 0x7f61e4136c70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00bde0 tx=0x7f61dc009ed0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:00.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61d9ffb640 1 -- 172.21.15.5:0/3043989670 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f61dc011b90 con 0x7f61e413a1b0 2024-08-18T21:05:00.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:00.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61d9ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:05:00.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61d9ffb640 10 monclient: dump: 2024-08-18T21:05:00.880 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:00.880 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61d9ffb640 10 monclient: _finish_auth 0 2024-08-18T21:05:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61d9ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:05:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61d9ffb640 1 -- 172.21.15.5:0/3043989670 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61dc011d70 con 0x7f61e413a1b0 2024-08-18T21:05:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61d9ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61d9ffb640 1 -- 172.21.15.5:0/3043989670 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f61dc013870 con 0x7f61e413a1b0 2024-08-18T21:05:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61d9ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:05:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61d9ffb640 10 monclient: dump: 2024-08-18T21:05:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:00.883 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61db7fe640 4 set_mon_vals no callback set 2024-08-18T21:05:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61eb617640 5 monclient: authenticate success, global_id 4641 2024-08-18T21:05:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61eb617640 10 monclient: _renew_subs 2024-08-18T21:05:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61eb617640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61eb617640 1 -- 172.21.15.5:0/3043989670 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e4138640 con 0x7f61e413a1b0 2024-08-18T21:05:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61eb617640 10 monclient: _renew_subs 2024-08-18T21:05:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61eb617640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61eb617640 1 -- 172.21.15.5:0/3043989670 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e413aca0 con 0x7f61e413a1b0 2024-08-18T21:05:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61eb617640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61eb617640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61e41371b0 0x7f61e4137590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61eb617640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61eb617640 1 -- 172.21.15.5:0/3043989670 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f61e40a7b60 con 0x7f61e41371b0 2024-08-18T21:05:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61e93b3640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61e41371b0 0x7f61e4137590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61e93b3640 10 monclient: get_auth_request con 0x7f61e41371b0 auth_method 0 2024-08-18T21:05:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61e93b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61e93b3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61e93b3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61e93b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:00.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61e93b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:00.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61e93b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:00.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61d9ffb640 1 -- 172.21.15.5:0/3043989670 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f61dc013400 con 0x7f61e413a1b0 2024-08-18T21:05:00.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61e93b3640 10 monclient(hunting): handle_auth_done global_id 4709 payload 824 2024-08-18T21:05:00.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61e93b3640 1 -- 172.21.15.5:0/3043989670 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f61e40a70c0 con 0x7f61e41371b0 2024-08-18T21:05:00.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61d9ffb640 1 --2- 172.21.15.5:0/3043989670 >> v2:172.21.15.157:6812/631023601 conn(0x7f61c803bdc0 0x7f61c803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61d9ffb640 1 -- 172.21.15.5:0/3043989670 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(46..46 src has 11..46) ==== 3898+0+0 (secure 0 0 0) 0x7f61dc04f0e0 con 0x7f61e413a1b0 2024-08-18T21:05:00.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61e8bb2640 1 --2- 172.21.15.5:0/3043989670 >> v2:172.21.15.157:6812/631023601 conn(0x7f61c803bdc0 0x7f61c803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.868+0000 7f61e8bb2640 10 monclient: get_auth_request con 0x7f61c803bdc0 auth_method 0 2024-08-18T21:05:00.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.872+0000 7f61e93b3640 1 -- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61e41371b0 msgr2=0x7f61e4137590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:00.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.872+0000 7f61e93b3640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61e41371b0 0x7f61e4137590 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f61d401c1d0 tx=0x7f61d4019140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:00.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.872+0000 7f61d9ffb640 1 -- 172.21.15.5:0/3043989670 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f61d40b0040 con 0x7f61e41371b0 2024-08-18T21:05:00.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.872+0000 7f61d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:00.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.872+0000 7f61d9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:00.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.872+0000 7f61d9ffb640 10 monclient: dump: 2024-08-18T21:05:00.888 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:00.888 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.888 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.888 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.888 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:00.888 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.888 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:00.889 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.872+0000 7f61d9ffb640 1 -- 172.21.15.5:0/3043989670 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f61d40aac50 con 0x7f61e41371b0 2024-08-18T21:05:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.872+0000 7f61d9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.872+0000 7f61d9ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.872+0000 7f61d9ffb640 1 -- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61e41371b0 msgr2=0x7f61e4137590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.872+0000 7f61d9ffb640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61e41371b0 0x7f61e4137590 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f61d401c1d0 tx=0x7f61d4019140 comp rx=0 tx=0).stop 2024-08-18T21:05:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.872+0000 7f61d9ffb640 1 -- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61e41371b0 msgr2=0x7f61e4137590 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.872+0000 7f61d9ffb640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61e41371b0 0x7f61e4137590 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f61d401c1d0 tx=0x7f61d4019140 comp rx=0 tx=0).stop 2024-08-18T21:05:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.872+0000 7f61e8bb2640 1 --2- 172.21.15.5:0/3043989670 >> v2:172.21.15.157:6812/631023601 conn(0x7f61c803bdc0 0x7f61c803e280 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f61e4138cb0 tx=0x7f61e0009040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61eb617640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61eb617640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61e4137ad0 0x7f61e409e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61eb617640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61eb617640 1 -- 172.21.15.5:0/3043989670 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f61e4051140 con 0x7f61e4137ad0 2024-08-18T21:05:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61e93b3640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61e4137ad0 0x7f61e409e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61e93b3640 10 monclient: get_auth_request con 0x7f61e4137ad0 auth_method 0 2024-08-18T21:05:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61e93b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61e93b3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61e93b3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61e93b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61e93b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61e93b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61e93b3640 10 monclient(hunting): handle_auth_done global_id 4718 payload 824 2024-08-18T21:05:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61e93b3640 1 -- 172.21.15.5:0/3043989670 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f61e4139dd0 con 0x7f61e4137ad0 2024-08-18T21:05:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61e93b3640 1 -- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61e4137ad0 msgr2=0x7f61e409e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61e93b3640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61e4137ad0 0x7f61e409e790 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61e40abff0 tx=0x7f61d40a8000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61d9ffb640 1 -- 172.21.15.5:0/3043989670 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f61d40b0040 con 0x7f61e4137ad0 2024-08-18T21:05:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61d9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61d9ffb640 10 monclient: dump: 2024-08-18T21:05:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:00.892 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61d9ffb640 1 -- 172.21.15.5:0/3043989670 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f61d40aae00 con 0x7f61e4137ad0 2024-08-18T21:05:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61d9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61d9ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:00.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61d9ffb640 1 -- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61e4137ad0 msgr2=0x7f61e409e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61d9ffb640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61e4137ad0 0x7f61e409e790 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61e40abff0 tx=0x7f61d40a8000 comp rx=0 tx=0).stop 2024-08-18T21:05:00.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61d9ffb640 1 -- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61e4137ad0 msgr2=0x7f61e409e790 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:00.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61d9ffb640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61e4137ad0 0x7f61e409e790 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61e40abff0 tx=0x7f61d40a8000 comp rx=0 tx=0).stop 2024-08-18T21:05:00.893 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:00.893 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:00.893 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:00.893 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:00.893 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:00.893 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 109994, 2024-08-18T21:05:00.894 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:00.894 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:00.894 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:00.894 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:00.894 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:00.894 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:00.894 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:00.894 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:00.894 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:00.894 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:00.894 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:00.894 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:05:00.894 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:00.894 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:00.895 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:00.895 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:00.895 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:00.895 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:00.895 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:00.895 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:00.895 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:00.895 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:00.895 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:00.895 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:00.895 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:00.895 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:00.895 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:00.895 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:00.896 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:00.896 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:00.896 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:00.896 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:00.896 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:00.896 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:00.896 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:00.896 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:00.896 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:00.896 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:00.896 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:00.896 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:00.896 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.897 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:00.897 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:00.897 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:00.897 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:00.897 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:00.897 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:00.897 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:00.897 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:00.897 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:00.897 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:00.897 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:00.897 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:00.897 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:00.897 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:00.898 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:00.898 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:00.898 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:00.898 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:00.898 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:00.898 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:00.898 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:00.898 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:00.898 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:00.898 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:00.898 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:00.898 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:00.898 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:00.898 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:00.899 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:00.899 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:00.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.899 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:00.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.899 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:00.899 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:00.899 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.899 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.899 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.899 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:00.899 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.900 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.900 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:00.900 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.900 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.900 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.900 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:00.900 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:00.900 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.900 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.900 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.901 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:00.901 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:00.901 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.901 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.901 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.901 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:00.901 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.901 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.901 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:00.901 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.901 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.902 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.902 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:00.902 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:00.902 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.902 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.902 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.902 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:00.902 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:00.902 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.902 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.909 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.909 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:00.909 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:00.909 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.909 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.909 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.909 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:00.909 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.910 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.910 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:00.910 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.910 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.910 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.910 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:00.910 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:00.910 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.910 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.910 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.910 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:00.911 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:00.911 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.911 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.911 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.911 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:00.911 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.911 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.911 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:00.911 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.911 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.911 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.912 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:00.912 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:00.912 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.912 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.912 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.912 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:00.912 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:00.912 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:00.913 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:00.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.913 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:00.913 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:00.913 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.913 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:00.913 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:00.913 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:00.913 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.913 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.913 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:00.914 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:00.914 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:00.914 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:00.914 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:00.914 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.914 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.914 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:00.914 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:00.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.914 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:00.914 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:00.914 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:00.915 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.915 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:00.915 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:05:00.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.915 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:00.915 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:00.915 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:05:00.915 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.915 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:00.915 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:00.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:00.915 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:00.915 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:00.915 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:05:00.915 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:00.916 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:00.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:00.916 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:00.916 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61eb617640 1 -- 172.21.15.5:0/3043989670 >> v2:172.21.15.157:6812/631023601 conn(0x7f61c803bdc0 msgr2=0x7f61c803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61eb617640 1 --2- 172.21.15.5:0/3043989670 >> v2:172.21.15.157:6812/631023601 conn(0x7f61c803bdc0 0x7f61c803e280 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f61e4138cb0 tx=0x7f61e0009040 comp rx=0 tx=0).stop 2024-08-18T21:05:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61eb617640 10 monclient: shutdown 2024-08-18T21:05:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61eb617640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:00.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61eb617640 1 -- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61e413a1b0 msgr2=0x7f61e4136c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:00.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61eb617640 1 --2- 172.21.15.5:0/3043989670 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61e413a1b0 0x7f61e4136c70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00bde0 tx=0x7f61dc009ed0 comp rx=0 tx=0).stop 2024-08-18T21:05:00.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61e9bb4640 1 -- 172.21.15.5:0/3043989670 reap_dead start 2024-08-18T21:05:00.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61e9bb4640 1 -- 172.21.15.5:0/3043989670 reap_dead start 2024-08-18T21:05:00.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61eb617640 1 -- 172.21.15.5:0/3043989670 shutdown_connections 2024-08-18T21:05:00.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61eb617640 1 -- 172.21.15.5:0/3043989670 >> 172.21.15.5:0/3043989670 conn(0x7f61e40acbc0 msgr2=0x7f61e409da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:00.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61eb617640 1 -- 172.21.15.5:0/3043989670 shutdown_connections 2024-08-18T21:05:00.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:00.880+0000 7f61eb617640 1 -- 172.21.15.5:0/3043989670 wait complete. 2024-08-18T21:05:00.918 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:00.919 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:05:00.919 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:05:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 10 monclient: get_monmap_and_config 2024-08-18T21:05:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 10 monclient: build_initial_monmap 2024-08-18T21:05:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 10 monclient: monmap: 2024-08-18T21:05:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:01.042381+0000 2024-08-18T21:05:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:01.042381+0000 2024-08-18T21:05:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:01.042 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:01.042 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:01.042 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 1 Processor -- start 2024-08-18T21:05:01.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 1 -- start start 2024-08-18T21:05:01.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 10 monclient: init 2024-08-18T21:05:01.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:01.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 10 monclient: _add_conns ranks=[1,2,3,0,8,4,7,10,6,9,5] 2024-08-18T21:05:01.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f55e40a6bd0 addr v1:172.21.15.157:6789/0 2024-08-18T21:05:01.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f55e409f080 0x7f55e413ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 10 monclient(hunting): picked mon.noname-b con 0x7f55e409f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:01.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55e40a76c0 0x7f55e4141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 10 monclient(hunting): picked mon.noname-g con 0x7f55e40a76c0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:01.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55e40a7fb0 con 0x7f55e40a6bd0 2024-08-18T21:05:01.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f55e409e4c0 con 0x7f55e409f080 2024-08-18T21:05:01.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f55e406f930 con 0x7f55e40a76c0 2024-08-18T21:05:01.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:01.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55eb2b0640 10 monclient(hunting): authenticate will time out at 1068.055762s 2024-08-18T21:05:01.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55e884b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f55e409f080 0x7f55e413ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55e884b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f55e409f080 0x7f55e413ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34290/0 (socket says 172.21.15.5:34290) 2024-08-18T21:05:01.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55e884b640 1 -- 172.21.15.5:0/1634612417 learned_addr learned my addr 172.21.15.5:0/1634612417 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:01.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55e884b640 10 monclient(hunting): get_auth_request con 0x7f55e409f080 auth_method 0 2024-08-18T21:05:01.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55e884b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55e884b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.036+0000 7f55e884b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e884b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e884b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e884b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e984d640 1 --2- 172.21.15.5:0/1634612417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55e40a76c0 0x7f55e4141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e984d640 10 monclient(hunting): get_auth_request con 0x7f55e40a76c0 auth_method 0 2024-08-18T21:05:01.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e984d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e984d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e984d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e884b640 10 monclient(hunting): handle_auth_done global_id 4727 payload 274 2024-08-18T21:05:01.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e884b640 1 -- 172.21.15.5:0/1634612417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55e40a76c0 msgr2=0x7f55e4141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:01.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e884b640 1 --2- 172.21.15.5:0/1634612417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55e40a76c0 0x7f55e4141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e884b640 1 -- 172.21.15.5:0/1634612417 >> v1:172.21.15.157:6789/0 conn(0x7f55e40a6bd0 legacy=0x7f55e40a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:01.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e884b640 10 monclient: _finish_hunting 0 2024-08-18T21:05:01.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e884b640 1 monclient: found mon.noname-b 2024-08-18T21:05:01.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e884b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:01.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e884b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:01.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.040+0000 7f55e884b640 1 -- 172.21.15.5:0/1634612417 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e409de70 con 0x7f55e409f080 2024-08-18T21:05:01.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 1 -- 172.21.15.5:0/1634612417 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f55e409f080 msgr2=0x7f55e413ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 1 --2- 172.21.15.5:0/1634612417 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f55e409f080 0x7f55e413ede0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f55d40098a0 tx=0x7f55d401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9cc5266433d10e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55dbfff640 1 -- 172.21.15.5:0/1634612417 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f55d40b0070 con 0x7f55e409f080 2024-08-18T21:05:01.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55dbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55dbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55dbfff640 10 monclient: dump: 2024-08-18T21:05:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.052 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55dbfff640 10 monclient: _finish_auth 0 2024-08-18T21:05:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55dbfff640 10 monclient: _check_auth_tickets 2024-08-18T21:05:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55dbfff640 1 -- 172.21.15.5:0/1634612417 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d40aa810 con 0x7f55e409f080 2024-08-18T21:05:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 5 monclient: authenticate success, global_id 4727 2024-08-18T21:05:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55dbfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55dbfff640 1 -- 172.21.15.5:0/1634612417 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f55d40a9300 con 0x7f55e409f080 2024-08-18T21:05:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 4 set_mon_vals no callback set 2024-08-18T21:05:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55dbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55dbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55dbfff640 10 monclient: dump: 2024-08-18T21:05:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.054 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 10 monclient: shutdown 2024-08-18T21:05:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 1 -- 172.21.15.5:0/1634612417 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f55e409f080 msgr2=0x7f55e413ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 1 --2- 172.21.15.5:0/1634612417 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f55e409f080 0x7f55e413ede0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f55d40098a0 tx=0x7f55d401c4d0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 1 -- 172.21.15.5:0/1634612417 shutdown_connections 2024-08-18T21:05:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 1 --2- 172.21.15.5:0/1634612417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55e40a76c0 0x7f55e4141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 1 --2- 172.21.15.5:0/1634612417 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f55e409f080 0x7f55e413ede0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 1 -- 172.21.15.5:0/1634612417 >> 172.21.15.5:0/1634612417 conn(0x7f55e4068700 msgr2=0x7f55e4068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 1 -- 172.21.15.5:0/1634612417 shutdown_connections 2024-08-18T21:05:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 1 -- 172.21.15.5:0/1634612417 wait complete. 2024-08-18T21:05:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 10 monclient: build_initial_monmap 2024-08-18T21:05:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 10 monclient: monmap: 2024-08-18T21:05:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:01.056 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 1 Processor -- start 2024-08-18T21:05:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 1 -- start start 2024-08-18T21:05:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 10 monclient: init 2024-08-18T21:05:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 10 monclient: _add_conns ranks=[7,8,5,2,4,6,0,1,3] 2024-08-18T21:05:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f55e409f080 0x7f55e4128d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 10 monclient(hunting): picked mon.noname-i con 0x7f55e409f080 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f55e40a6bd0 0x7f55e413fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 10 monclient(hunting): picked mon.noname-e con 0x7f55e40a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:05:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f55e40a76c0 0x7f55e4126770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 10 monclient(hunting): picked mon.noname-h con 0x7f55e40a76c0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f55e4144210 con 0x7f55e40a76c0 2024-08-18T21:05:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f55e4144090 con 0x7f55e409f080 2024-08-18T21:05:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f55e4144390 con 0x7f55e40a6bd0 2024-08-18T21:05:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55eb2b0640 10 monclient(hunting): authenticate will time out at 1068.062982s 2024-08-18T21:05:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f55e40a6bd0 0x7f55e413fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f55e40a6bd0 0x7f55e413fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:49580/0 (socket says 172.21.15.5:49580) 2024-08-18T21:05:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 1 -- 172.21.15.5:0/1502440702 learned_addr learned my addr 172.21.15.5:0/1502440702 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 10 monclient(hunting): get_auth_request con 0x7f55e40a6bd0 auth_method 0 2024-08-18T21:05:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e984d640 1 --2- 172.21.15.5:0/1502440702 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f55e40a76c0 0x7f55e4126770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e904c640 1 --2- 172.21.15.5:0/1502440702 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f55e409f080 0x7f55e4128d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e904c640 10 monclient(hunting): get_auth_request con 0x7f55e409f080 auth_method 0 2024-08-18T21:05:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e904c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e904c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e904c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e984d640 10 monclient(hunting): get_auth_request con 0x7f55e40a76c0 auth_method 0 2024-08-18T21:05:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e984d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e984d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e984d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 10 monclient(hunting): handle_auth_done global_id 34118 payload 824 2024-08-18T21:05:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 1 -- 172.21.15.5:0/1502440702 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f55e409f080 msgr2=0x7f55e4128d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 1 --2- 172.21.15.5:0/1502440702 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f55e409f080 0x7f55e4128d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 1 -- 172.21.15.5:0/1502440702 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f55e40a76c0 msgr2=0x7f55e4126770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 1 --2- 172.21.15.5:0/1502440702 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f55e40a76c0 0x7f55e4126770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 10 monclient: _finish_hunting 0 2024-08-18T21:05:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 1 monclient: found mon.noname-e 2024-08-18T21:05:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:05:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.044+0000 7f55e884b640 1 -- 172.21.15.5:0/1502440702 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e40aba70 con 0x7f55e40a6bd0 2024-08-18T21:05:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55e884b640 1 -- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f55e40a6bd0 msgr2=0x7f55e413fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55e884b640 1 --2- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f55e40a6bd0 0x7f55e413fc00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f55d40ae040 tx=0x7f55d4019270 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55d9ffb640 1 -- 172.21.15.5:0/1502440702 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f55d40b0040 con 0x7f55e40a6bd0 2024-08-18T21:05:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55d9ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:05:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55d9ffb640 10 monclient: dump: 2024-08-18T21:05:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.064 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55d9ffb640 10 monclient: _finish_auth 0 2024-08-18T21:05:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55d9ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:05:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55d9ffb640 1 -- 172.21.15.5:0/1502440702 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d40044a0 con 0x7f55e40a6bd0 2024-08-18T21:05:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55d9ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55d9ffb640 1 -- 172.21.15.5:0/1502440702 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f55d4003a90 con 0x7f55e40a6bd0 2024-08-18T21:05:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55eb2b0640 5 monclient: authenticate success, global_id 34118 2024-08-18T21:05:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55eb2b0640 10 monclient: _renew_subs 2024-08-18T21:05:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55db7fe640 4 set_mon_vals no callback set 2024-08-18T21:05:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55eb2b0640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:05:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55eb2b0640 1 -- 172.21.15.5:0/1502440702 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e4129fd0 con 0x7f55e40a6bd0 2024-08-18T21:05:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55d9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:05:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55d9ffb640 10 monclient: dump: 2024-08-18T21:05:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.066 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55eb2b0640 10 monclient: _renew_subs 2024-08-18T21:05:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55eb2b0640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:05:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55eb2b0640 1 -- 172.21.15.5:0/1502440702 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e41c9220 con 0x7f55e40a6bd0 2024-08-18T21:05:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55eb2b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55eb2b0640 1 --2- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f55e4126cb0 0x7f55e4127090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55eb2b0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55eb2b0640 1 -- 172.21.15.5:0/1502440702 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f55e40a6050 con 0x7f55e4126cb0 2024-08-18T21:05:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55e904c640 1 --2- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f55e4126cb0 0x7f55e4127090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55e904c640 10 monclient: get_auth_request con 0x7f55e4126cb0 auth_method 0 2024-08-18T21:05:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55e904c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55e904c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55e904c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55d9ffb640 1 -- 172.21.15.5:0/1502440702 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f55d40bb060 con 0x7f55e40a6bd0 2024-08-18T21:05:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55e904c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55e904c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55e904c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55d9ffb640 1 --2- 172.21.15.5:0/1502440702 >> v2:172.21.15.157:6812/631023601 conn(0x7f55c803bdc0 0x7f55c803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55e904c640 10 monclient(hunting): handle_auth_done global_id 4675 payload 824 2024-08-18T21:05:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55d9ffb640 1 -- 172.21.15.5:0/1502440702 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(46..46 src has 11..46) ==== 3898+0+0 (secure 0 0 0) 0x7f55d40e77d0 con 0x7f55e40a6bd0 2024-08-18T21:05:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.048+0000 7f55e904c640 1 -- 172.21.15.5:0/1502440702 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f55e4129720 con 0x7f55e4126cb0 2024-08-18T21:05:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.052+0000 7f55e984d640 1 --2- 172.21.15.5:0/1502440702 >> v2:172.21.15.157:6812/631023601 conn(0x7f55c803bdc0 0x7f55c803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.052+0000 7f55e984d640 10 monclient: get_auth_request con 0x7f55c803bdc0 auth_method 0 2024-08-18T21:05:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.052+0000 7f55e904c640 1 -- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f55e4126cb0 msgr2=0x7f55e4127090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.052+0000 7f55e904c640 1 --2- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f55e4126cb0 0x7f55e4127090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f55e000e7c0 tx=0x7f55e000ec80 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.052+0000 7f55d9ffb640 1 -- 172.21.15.5:0/1502440702 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f55e0015430 con 0x7f55e4126cb0 2024-08-18T21:05:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.052+0000 7f55d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.052+0000 7f55d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.052+0000 7f55d9ffb640 10 monclient: dump: 2024-08-18T21:05:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.069 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.052+0000 7f55d9ffb640 1 -- 172.21.15.5:0/1502440702 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f55e000cb50 con 0x7f55e4126cb0 2024-08-18T21:05:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.052+0000 7f55d9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.052+0000 7f55d9ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.052+0000 7f55d9ffb640 1 -- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f55e4126cb0 msgr2=0x7f55e4127090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.052+0000 7f55d9ffb640 1 --2- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f55e4126cb0 0x7f55e4127090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f55e000e7c0 tx=0x7f55e000ec80 comp rx=0 tx=0).stop 2024-08-18T21:05:01.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.052+0000 7f55d9ffb640 1 -- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f55e4126cb0 msgr2=0x7f55e4127090 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:01.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.052+0000 7f55d9ffb640 1 --2- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f55e4126cb0 0x7f55e4127090 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f55e000e7c0 tx=0x7f55e000ec80 comp rx=0 tx=0).stop 2024-08-18T21:05:01.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.052+0000 7f55e984d640 1 --2- 172.21.15.5:0/1502440702 >> v2:172.21.15.157:6812/631023601 conn(0x7f55c803bdc0 0x7f55c803e280 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00d8d0 tx=0x7f55dc008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55eb2b0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:01.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55eb2b0640 1 --2- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f55e4122820 0x7f55e4122c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55eb2b0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55eb2b0640 1 -- 172.21.15.5:0/1502440702 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f55e4051140 con 0x7f55e4122820 2024-08-18T21:05:01.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55e904c640 1 --2- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f55e4122820 0x7f55e4122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55e904c640 10 monclient: get_auth_request con 0x7f55e4122820 auth_method 0 2024-08-18T21:05:01.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55e904c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55e904c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55e904c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55e904c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55e904c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55e904c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55e904c640 10 monclient(hunting): handle_auth_done global_id 4684 payload 824 2024-08-18T21:05:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55e904c640 1 -- 172.21.15.5:0/1502440702 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f55e41275d0 con 0x7f55e4122820 2024-08-18T21:05:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55e904c640 1 -- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f55e4122820 msgr2=0x7f55e4122c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55e904c640 1 --2- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f55e4122820 0x7f55e4122c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f55e000e7c0 tx=0x7f55e0003af0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55d9ffb640 1 -- 172.21.15.5:0/1502440702 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f55e001ec70 con 0x7f55e4122820 2024-08-18T21:05:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55d9ffb640 10 monclient: dump: 2024-08-18T21:05:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.074 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55d9ffb640 1 -- 172.21.15.5:0/1502440702 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f55e0007340 con 0x7f55e4122820 2024-08-18T21:05:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55d9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55d9ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55d9ffb640 1 -- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f55e4122820 msgr2=0x7f55e4122c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55d9ffb640 1 --2- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f55e4122820 0x7f55e4122c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f55e000e7c0 tx=0x7f55e0003af0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55d9ffb640 1 -- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f55e4122820 msgr2=0x7f55e4122c30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.060+0000 7f55d9ffb640 1 --2- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f55e4122820 0x7f55e4122c30 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f55e000e7c0 tx=0x7f55e0003af0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.074 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:01.075 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:01.075 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:01.075 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:01.075 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:01.075 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 110178, 2024-08-18T21:05:01.075 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:01.075 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:01.075 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:01.075 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:01.075 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:01.075 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:01.075 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:01.075 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:01.076 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:01.076 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:01.076 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.076 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:05:01.076 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:01.076 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:01.076 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:01.076 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.076 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.076 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.076 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.076 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.076 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.076 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.077 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.077 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.077 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.077 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.077 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.077 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:01.077 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:01.077 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.077 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.077 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.077 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.077 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.077 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.077 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.078 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.078 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.078 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.078 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.078 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.078 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:01.078 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:01.078 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:01.078 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:01.078 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:01.078 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:01.078 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:01.078 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:05:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:05:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:01.097 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:01.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.064+0000 7f55eb2b0640 1 -- 172.21.15.5:0/1502440702 >> v2:172.21.15.157:6812/631023601 conn(0x7f55c803bdc0 msgr2=0x7f55c803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.064+0000 7f55eb2b0640 1 --2- 172.21.15.5:0/1502440702 >> v2:172.21.15.157:6812/631023601 conn(0x7f55c803bdc0 0x7f55c803e280 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00d8d0 tx=0x7f55dc008040 comp rx=0 tx=0).stop 2024-08-18T21:05:01.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.064+0000 7f55eb2b0640 10 monclient: shutdown 2024-08-18T21:05:01.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.064+0000 7f55eb2b0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:01.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.064+0000 7f55eb2b0640 1 -- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f55e40a6bd0 msgr2=0x7f55e413fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.064+0000 7f55eb2b0640 1 --2- 172.21.15.5:0/1502440702 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f55e40a6bd0 0x7f55e413fc00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f55d40ae040 tx=0x7f55d4019270 comp rx=0 tx=0).stop 2024-08-18T21:05:01.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.064+0000 7f55e984d640 1 -- 172.21.15.5:0/1502440702 reap_dead start 2024-08-18T21:05:01.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.064+0000 7f55e984d640 1 -- 172.21.15.5:0/1502440702 reap_dead start 2024-08-18T21:05:01.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.064+0000 7f55eb2b0640 1 -- 172.21.15.5:0/1502440702 shutdown_connections 2024-08-18T21:05:01.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.064+0000 7f55eb2b0640 1 -- 172.21.15.5:0/1502440702 >> 172.21.15.5:0/1502440702 conn(0x7f55e4068700 msgr2=0x7f55e40aa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:01.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.064+0000 7f55eb2b0640 1 -- 172.21.15.5:0/1502440702 shutdown_connections 2024-08-18T21:05:01.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.064+0000 7f55eb2b0640 1 -- 172.21.15.5:0/1502440702 wait complete. 2024-08-18T21:05:01.099 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:01.099 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:05:01.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:05:01.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 10 monclient: get_monmap_and_config 2024-08-18T21:05:01.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 10 monclient: build_initial_monmap 2024-08-18T21:05:01.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 10 monclient: monmap: 2024-08-18T21:05:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:01.217488+0000 2024-08-18T21:05:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:01.217488+0000 2024-08-18T21:05:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:01.217 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:01.217 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:01.217 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:01.217 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:01.217 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 1 Processor -- start 2024-08-18T21:05:01.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 1 -- start start 2024-08-18T21:05:01.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 10 monclient: init 2024-08-18T21:05:01.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:01.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 10 monclient: _add_conns ranks=[4,5,7,0,3,2,9,10,8,6,1] 2024-08-18T21:05:01.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f27780a6bd0 0x7f27780a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 10 monclient(hunting): picked mon.noname-c con 0x7f27780a6bd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:01.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f277809f080 0x7f27780a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 10 monclient(hunting): picked mon.noname-h con 0x7f277809f080 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:01.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2778139990 0x7f2778139df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 10 monclient(hunting): picked mon.noname-i con 0x7f2778139990 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:01.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f277809e4c0 con 0x7f27780a6bd0 2024-08-18T21:05:01.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f277806f930 con 0x7f277809f080 2024-08-18T21:05:01.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f27780a7a30 con 0x7f2778139990 2024-08-18T21:05:01.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:01.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277f285640 10 monclient(hunting): authenticate will time out at 1068.231372s 2024-08-18T21:05:01.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f27780a6bd0 0x7f27780a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f27780a6bd0 0x7f27780a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:40168/0 (socket says 172.21.15.5:40168) 2024-08-18T21:05:01.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 1 -- 172.21.15.5:0/4140312940 learned_addr learned my addr 172.21.15.5:0/4140312940 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:01.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 10 monclient(hunting): get_auth_request con 0x7f27780a6bd0 auth_method 0 2024-08-18T21:05:01.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277c820640 1 --2- 172.21.15.5:0/4140312940 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f277809f080 0x7f27780a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 10 monclient(hunting): handle_auth_done global_id 4693 payload 274 2024-08-18T21:05:01.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 1 -- 172.21.15.5:0/4140312940 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2778139990 msgr2=0x7f2778139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:01.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d822640 1 --2- 172.21.15.5:0/4140312940 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2778139990 0x7f2778139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 1 --2- 172.21.15.5:0/4140312940 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2778139990 0x7f2778139df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 1 -- 172.21.15.5:0/4140312940 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f277809f080 msgr2=0x7f27780a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:01.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 1 --2- 172.21.15.5:0/4140312940 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f277809f080 0x7f27780a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 10 monclient: _finish_hunting 0 2024-08-18T21:05:01.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 1 monclient: found mon.noname-c 2024-08-18T21:05:01.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:01.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:05:01.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d021640 1 -- 172.21.15.5:0/4140312940 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27780a7fb0 con 0x7f27780a6bd0 2024-08-18T21:05:01.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277c820640 10 monclient: get_auth_request con 0x7f277809f080 auth_method 0 2024-08-18T21:05:01.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277c820640 1 --2- 172.21.15.5:0/4140312940 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f277809f080 0x7f27780a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:05:01.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d822640 10 monclient: get_auth_request con 0x7f2778139990 auth_method 0 2024-08-18T21:05:01.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.212+0000 7f277d822640 1 --2- 172.21.15.5:0/4140312940 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2778139990 0x7f2778139df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:05:01.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d021640 1 -- 172.21.15.5:0/4140312940 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f27780a6bd0 msgr2=0x7f27780a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d021640 1 --2- 172.21.15.5:0/4140312940 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f27780a6bd0 0x7f27780a6fb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f27740098a0 tx=0x7f277401c440 comp rx=0 tx=0).ready entity=mon.4 client_cookie=ff7ddc28420e356a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f276ffff640 1 -- 172.21.15.5:0/4140312940 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f27740b0070 con 0x7f27780a6bd0 2024-08-18T21:05:01.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f276ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f276ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:05:01.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f276ffff640 10 monclient: dump: 2024-08-18T21:05:01.224 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.224 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.224 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.224 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.224 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.224 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.225 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f276ffff640 10 monclient: _finish_auth 0 2024-08-18T21:05:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f276ffff640 10 monclient: _check_auth_tickets 2024-08-18T21:05:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f276ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f276ffff640 1 -- 172.21.15.5:0/4140312940 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27740aa810 con 0x7f27780a6bd0 2024-08-18T21:05:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f276ffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f276ffff640 1 -- 172.21.15.5:0/4140312940 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f27740aae30 con 0x7f27780a6bd0 2024-08-18T21:05:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 5 monclient: authenticate success, global_id 4693 2024-08-18T21:05:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 4 set_mon_vals no callback set 2024-08-18T21:05:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f276ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f276ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f276ffff640 10 monclient: dump: 2024-08-18T21:05:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.227 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.227 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.227 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.227 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.227 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.227 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.227 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.227 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.227 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.227 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 10 monclient: shutdown 2024-08-18T21:05:01.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:01.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 -- 172.21.15.5:0/4140312940 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f27780a6bd0 msgr2=0x7f27780a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 --2- 172.21.15.5:0/4140312940 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f27780a6bd0 0x7f27780a6fb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f27740098a0 tx=0x7f277401c440 comp rx=0 tx=0).stop 2024-08-18T21:05:01.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 -- 172.21.15.5:0/4140312940 shutdown_connections 2024-08-18T21:05:01.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 --2- 172.21.15.5:0/4140312940 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2778139990 0x7f2778139df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 --2- 172.21.15.5:0/4140312940 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f277809f080 0x7f27780a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 --2- 172.21.15.5:0/4140312940 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f27780a6bd0 0x7f27780a6fb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 -- 172.21.15.5:0/4140312940 >> 172.21.15.5:0/4140312940 conn(0x7f2778068700 msgr2=0x7f2778068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:01.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 -- 172.21.15.5:0/4140312940 shutdown_connections 2024-08-18T21:05:01.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 -- 172.21.15.5:0/4140312940 wait complete. 2024-08-18T21:05:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 10 monclient: build_initial_monmap 2024-08-18T21:05:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 10 monclient: monmap: 2024-08-18T21:05:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:01.234 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 Processor -- start 2024-08-18T21:05:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 -- start start 2024-08-18T21:05:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 10 monclient: init 2024-08-18T21:05:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 10 monclient: _add_conns ranks=[0,3,4,7,6,2,1,8,5] 2024-08-18T21:05:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277809f080 0x7f2778136460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 10 monclient(hunting): picked mon.noname-a con 0x7f277809f080 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:05:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27780a6bd0 0x7f27781369a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 10 monclient(hunting): picked mon.noname-g con 0x7f27780a6bd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2778139990 0x7f277813bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 10 monclient(hunting): picked mon.noname-c con 0x7f2778139990 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f27780a89f0 con 0x7f277809f080 2024-08-18T21:05:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f27780a7ce0 con 0x7f27780a6bd0 2024-08-18T21:05:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f2778143610 con 0x7f2778139990 2024-08-18T21:05:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:01.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277f285640 10 monclient(hunting): authenticate will time out at 1068.239119s 2024-08-18T21:05:01.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2778139990 0x7f277813bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d021640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277809f080 0x7f2778136460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2778139990 0x7f277813bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:40170/0 (socket says 172.21.15.5:40170) 2024-08-18T21:05:01.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 1 -- 172.21.15.5:0/2135766948 learned_addr learned my addr 172.21.15.5:0/2135766948 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:01.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 10 monclient(hunting): get_auth_request con 0x7f2778139990 auth_method 0 2024-08-18T21:05:01.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d021640 10 monclient(hunting): get_auth_request con 0x7f277809f080 auth_method 0 2024-08-18T21:05:01.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d021640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d021640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d021640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d021640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d021640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d021640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277c820640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27780a6bd0 0x7f27781369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277c820640 10 monclient(hunting): get_auth_request con 0x7f27780a6bd0 auth_method 0 2024-08-18T21:05:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277c820640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277c820640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277c820640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 10 monclient(hunting): handle_auth_done global_id 4702 payload 824 2024-08-18T21:05:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 1 -- 172.21.15.5:0/2135766948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27780a6bd0 msgr2=0x7f27781369a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27780a6bd0 0x7f27781369a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 1 -- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277809f080 msgr2=0x7f2778136460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277809f080 0x7f2778136460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 10 monclient: _finish_hunting 0 2024-08-18T21:05:01.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 1 monclient: found mon.noname-c 2024-08-18T21:05:01.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:01.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:05:01.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d822640 1 -- 172.21.15.5:0/2135766948 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277813f7f0 con 0x7f2778139990 2024-08-18T21:05:01.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.220+0000 7f277d021640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277809f080 0x7f2778136460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:01.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277d822640 1 -- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2778139990 msgr2=0x7f277813bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277d822640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2778139990 0x7f277813bb70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f277000cd80 tx=0x7f277000a650 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f276dffb640 1 -- 172.21.15.5:0/2135766948 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f277000fb00 con 0x7f2778139990 2024-08-18T21:05:01.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f276dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f276dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:05:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f276dffb640 10 monclient: dump: 2024-08-18T21:05:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.240 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f276dffb640 10 monclient: _finish_auth 0 2024-08-18T21:05:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f276dffb640 10 monclient: _check_auth_tickets 2024-08-18T21:05:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f276dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f276dffb640 1 -- 172.21.15.5:0/2135766948 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277000fd00 con 0x7f2778139990 2024-08-18T21:05:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277f285640 5 monclient: authenticate success, global_id 4702 2024-08-18T21:05:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277f285640 10 monclient: _renew_subs 2024-08-18T21:05:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277f285640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:05:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277f285640 1 -- 172.21.15.5:0/2135766948 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27780ab580 con 0x7f2778139990 2024-08-18T21:05:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f276dffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f276dffb640 1 -- 172.21.15.5:0/2135766948 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f277000e850 con 0x7f2778139990 2024-08-18T21:05:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f276dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f276dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f276dffb640 10 monclient: dump: 2024-08-18T21:05:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.242 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f276f7fe640 4 set_mon_vals no callback set 2024-08-18T21:05:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277f285640 10 monclient: _renew_subs 2024-08-18T21:05:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277f285640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:05:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277f285640 1 -- 172.21.15.5:0/2135766948 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f277813dd30 con 0x7f2778139990 2024-08-18T21:05:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277f285640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277f285640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f277813f3d0 0x7f277813c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277f285640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277f285640 1 -- 172.21.15.5:0/2135766948 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f2778051140 con 0x7f277813f3d0 2024-08-18T21:05:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277d021640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f277813f3d0 0x7f277813c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277d021640 10 monclient: get_auth_request con 0x7f277813f3d0 auth_method 0 2024-08-18T21:05:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277d021640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277d021640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277d021640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277d021640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277d021640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277d021640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277d822640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2778139990 0x7f277813bb70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f277000cd80 tx=0x7f277000a650 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7f277004ec60 osd_map(46..46 src has 11..46) 2024-08-18T21:05:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f276dffb640 1 -- 172.21.15.5:0/2135766948 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f277000e3e0 con 0x7f2778139990 2024-08-18T21:05:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277d021640 10 monclient(hunting): handle_auth_done global_id 4650 payload 824 2024-08-18T21:05:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f277d021640 1 -- 172.21.15.5:0/2135766948 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2778139df0 con 0x7f277813f3d0 2024-08-18T21:05:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.224+0000 7f276dffb640 1 --2- 172.21.15.5:0/2135766948 >> v2:172.21.15.157:6812/631023601 conn(0x7f275c03bdf0 0x7f275c03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.228+0000 7f277c820640 1 --2- 172.21.15.5:0/2135766948 >> v2:172.21.15.157:6812/631023601 conn(0x7f275c03bdf0 0x7f275c03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.228+0000 7f277c820640 10 monclient: get_auth_request con 0x7f275c03bdf0 auth_method 0 2024-08-18T21:05:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.228+0000 7f277d021640 1 -- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f277813f3d0 msgr2=0x7f277813c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.228+0000 7f277d021640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f277813f3d0 0x7f277813c0b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2774009870 tx=0x7f27740191e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.228+0000 7f276dffb640 1 -- 172.21.15.5:0/2135766948 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f27740ba070 con 0x7f277813f3d0 2024-08-18T21:05:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.228+0000 7f276dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.228+0000 7f276dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:05:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.228+0000 7f276dffb640 10 monclient: dump: 2024-08-18T21:05:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.245 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.228+0000 7f276dffb640 1 -- 172.21.15.5:0/2135766948 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f27740b1040 con 0x7f277813f3d0 2024-08-18T21:05:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.228+0000 7f276dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.228+0000 7f276dffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.228+0000 7f276dffb640 1 -- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f277813f3d0 msgr2=0x7f277813c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.228+0000 7f276dffb640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f277813f3d0 0x7f277813c0b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2774009870 tx=0x7f27740191e0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.228+0000 7f276dffb640 1 -- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f277813f3d0 msgr2=0x7f277813c0b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.228+0000 7f276dffb640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f277813f3d0 0x7f277813c0b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.228+0000 7f277c820640 1 --2- 172.21.15.5:0/2135766948 >> v2:172.21.15.157:6812/631023601 conn(0x7f275c03bdf0 0x7f275c03e2b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f277813d1e0 tx=0x7f2768008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f277f285640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f277f285640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2778136ee0 0x7f277813c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f277f285640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f277f285640 1 -- 172.21.15.5:0/2135766948 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f277813dff0 con 0x7f2778136ee0 2024-08-18T21:05:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f277d021640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2778136ee0 0x7f277813c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f277d021640 10 monclient: get_auth_request con 0x7f2778136ee0 auth_method 0 2024-08-18T21:05:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f277d021640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f277d021640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f277d021640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f277d021640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f277d021640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f277d021640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f277d021640 10 monclient(hunting): handle_auth_done global_id 4659 payload 824 2024-08-18T21:05:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f277d021640 1 -- 172.21.15.5:0/2135766948 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f27780746d0 con 0x7f2778136ee0 2024-08-18T21:05:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f277d021640 1 -- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2778136ee0 msgr2=0x7f277813c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f277d021640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2778136ee0 0x7f277813c5f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f27740098a0 tx=0x7f27740a8000 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f276dffb640 1 -- 172.21.15.5:0/2135766948 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f27740ba070 con 0x7f2778136ee0 2024-08-18T21:05:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f276dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f276dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:05:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.236+0000 7f276dffb640 10 monclient: dump: 2024-08-18T21:05:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.250 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f276dffb640 1 -- 172.21.15.5:0/2135766948 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f2774003a40 con 0x7f2778136ee0 2024-08-18T21:05:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f276dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f276dffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f276dffb640 1 -- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2778136ee0 msgr2=0x7f277813c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f276dffb640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2778136ee0 0x7f277813c5f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f27740098a0 tx=0x7f27740a8000 comp rx=0 tx=0).stop 2024-08-18T21:05:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f276dffb640 1 -- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2778136ee0 msgr2=0x7f277813c5f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f276dffb640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2778136ee0 0x7f277813c5f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.250 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:01.250 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:01.251 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:01.251 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:01.251 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:01.251 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 110346, 2024-08-18T21:05:01.251 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:01.251 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:01.251 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:01.251 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:01.251 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:01.251 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:01.251 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:01.251 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:01.251 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:01.252 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:01.252 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.252 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:05:01.252 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:01.252 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:01.252 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:01.252 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.252 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.252 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.252 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.252 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.252 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.252 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.253 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.253 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.253 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.253 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.253 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:01.253 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:01.253 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.253 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.253 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.253 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.253 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.253 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.253 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.253 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.254 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.254 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.254 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.254 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.254 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:01.254 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:01.254 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:01.254 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:01.254 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:01.254 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:01.254 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:01.254 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:01.255 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:01.255 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:01.255 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:01.255 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:01.255 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:01.255 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:01.255 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:01.255 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:01.255 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:01.255 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.255 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.255 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.255 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.256 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.256 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.256 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.256 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.256 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.256 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.256 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.256 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:01.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.256 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:01.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.256 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:01.256 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:01.256 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.257 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.257 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:01.257 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.257 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:01.257 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.257 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.257 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.257 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:01.258 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:01.258 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.258 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.258 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.258 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:01.258 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:01.258 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.258 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.258 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:01.259 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.259 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.259 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:01.259 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.259 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.259 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.259 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:01.259 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:01.259 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.259 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.259 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.260 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:01.260 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:01.260 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.260 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.260 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:01.260 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.260 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:01.261 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.261 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.261 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:01.261 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:01.261 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.261 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.261 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.261 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:01.261 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:01.262 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.262 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.262 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:01.262 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.262 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:01.262 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.262 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.262 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:01.264 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.264 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.264 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:01.264 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.264 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.264 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.264 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:01.264 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:01.264 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.264 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.264 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:01.273 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:01.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f277f285640 1 -- 172.21.15.5:0/2135766948 >> v2:172.21.15.157:6812/631023601 conn(0x7f275c03bdf0 msgr2=0x7f275c03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f277f285640 1 --2- 172.21.15.5:0/2135766948 >> v2:172.21.15.157:6812/631023601 conn(0x7f275c03bdf0 0x7f275c03e2b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f277813d1e0 tx=0x7f2768008040 comp rx=0 tx=0).stop 2024-08-18T21:05:01.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f277f285640 10 monclient: shutdown 2024-08-18T21:05:01.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f277f285640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:01.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f277f285640 1 -- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2778139990 msgr2=0x7f277813bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f277d822640 1 -- 172.21.15.5:0/2135766948 reap_dead start 2024-08-18T21:05:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f277f285640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2778139990 0x7f277813bb70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f277000cd80 tx=0x7f277000a650 comp rx=0 tx=0).stop 2024-08-18T21:05:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f276dffb640 1 -- 172.21.15.5:0/2135766948 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(46..46 src has 11..46) ==== 3898+0+0 (unknown 0 0 0) 0x7f277004ec60 con 0x7f2778139990 2024-08-18T21:05:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f277f285640 1 -- 172.21.15.5:0/2135766948 shutdown_connections 2024-08-18T21:05:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f277f285640 1 --2- 172.21.15.5:0/2135766948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2778139990 0x7f277813bb70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f277f285640 1 -- 172.21.15.5:0/2135766948 >> 172.21.15.5:0/2135766948 conn(0x7f2778068700 msgr2=0x7f27780aa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f277f285640 1 -- 172.21.15.5:0/2135766948 shutdown_connections 2024-08-18T21:05:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.240+0000 7f277f285640 1 -- 172.21.15.5:0/2135766948 wait complete. 2024-08-18T21:05:01.275 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:01.275 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:05:01.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:05:01.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 10 monclient: get_monmap_and_config 2024-08-18T21:05:01.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 10 monclient: build_initial_monmap 2024-08-18T21:05:01.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 10 monclient: monmap: 2024-08-18T21:05:01.395 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:01.395 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.395 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:01.396551+0000 2024-08-18T21:05:01.395 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:01.396551+0000 2024-08-18T21:05:01.395 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:01.395 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.395 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:01.395 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:01.395 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:01.395 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:01.395 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:01.395 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:01.395 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:01.395 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:01.396 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:01.396 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:01.396 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:01.396 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 1 Processor -- start 2024-08-18T21:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 1 -- start start 2024-08-18T21:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 10 monclient: init 2024-08-18T21:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 10 monclient: _add_conns ranks=[4,0,2,3,1,6,5,9,7,8,10] 2024-08-18T21:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f649c0a4bb0 0x7f649c0a4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 10 monclient(hunting): picked mon.noname-c con 0x7f649c0a4bb0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f649c0a6840 addr v1:172.21.15.5:6789/0 2024-08-18T21:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f649c0a54d0 0x7f649c1414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 10 monclient(hunting): picked mon.noname-b con 0x7f649c0a54d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f649c06efa0 con 0x7f649c0a6840 2024-08-18T21:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f649c0a6470 con 0x7f649c0a54d0 2024-08-18T21:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f649c06e700 con 0x7f649c0a4bb0 2024-08-18T21:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f64a18b4640 10 monclient(hunting): authenticate will time out at 1068.409688s 2024-08-18T21:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649a7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f649c0a6840 0x7f649c13dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56794/0 (socket says 172.21.15.5:56794) 2024-08-18T21:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649a7fc640 1 -- 172.21.15.5:0/1400493803 learned_addr learned my addr 172.21.15.5:0/1400493803 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 1 --2- 172.21.15.5:0/1400493803 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f649c0a4bb0 0x7f649c0a4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649b7fe640 1 --2- 172.21.15.5:0/1400493803 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f649c0a54d0 0x7f649c1414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 10 monclient(hunting): get_auth_request con 0x7f649c0a4bb0 auth_method 0 2024-08-18T21:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649b7fe640 10 monclient(hunting): get_auth_request con 0x7f649c0a54d0 auth_method 0 2024-08-18T21:05:01.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 10 monclient(hunting): handle_auth_done global_id 4711 payload 274 2024-08-18T21:05:01.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 1 -- 172.21.15.5:0/1400493803 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f649c0a54d0 msgr2=0x7f649c1414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:01.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 1 --2- 172.21.15.5:0/1400493803 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f649c0a54d0 0x7f649c1414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 1 -- 172.21.15.5:0/1400493803 >> v1:172.21.15.5:6789/0 conn(0x7f649c0a6840 legacy=0x7f649c13dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:01.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 10 monclient: _finish_hunting 0 2024-08-18T21:05:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 1 monclient: found mon.noname-c 2024-08-18T21:05:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:05:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649affd640 1 -- 172.21.15.5:0/1400493803 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649c0a5950 con 0x7f649c0a4bb0 2024-08-18T21:05:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.392+0000 7f649b7fe640 1 --2- 172.21.15.5:0/1400493803 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f649c0a54d0 0x7f649c1414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:01.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f649affd640 1 -- 172.21.15.5:0/1400493803 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f649c0a4bb0 msgr2=0x7f649c0a4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f649affd640 1 --2- 172.21.15.5:0/1400493803 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f649c0a4bb0 0x7f649c0a4f90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6494009dc0 tx=0x7f649401c850 comp rx=0 tx=0).ready entity=mon.4 client_cookie=5b8c8d0662cc7be2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f6499ffb640 1 -- 172.21.15.5:0/1400493803 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f64940b2070 con 0x7f649c0a4bb0 2024-08-18T21:05:01.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f6499ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f6499ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:05:01.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f6499ffb640 10 monclient: dump: 2024-08-18T21:05:01.405 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.405 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.405 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.405 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.405 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.405 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.405 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.405 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.405 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.405 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.406 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f6499ffb640 10 monclient: _finish_auth 0 2024-08-18T21:05:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f6499ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:05:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f6499ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f64a18b4640 5 monclient: authenticate success, global_id 4711 2024-08-18T21:05:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f64a18b4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:05:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f6499ffb640 1 -- 172.21.15.5:0/1400493803 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64940a59b0 con 0x7f649c0a4bb0 2024-08-18T21:05:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f6499ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f64a18b4640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f64a18b4640 4 set_mon_vals no callback set 2024-08-18T21:05:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f6499ffb640 1 -- 172.21.15.5:0/1400493803 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f64940a5ba0 con 0x7f649c0a4bb0 2024-08-18T21:05:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f6499ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f6499ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f6499ffb640 10 monclient: dump: 2024-08-18T21:05:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.408 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.408 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.408 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.408 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.408 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.408 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.408 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.408 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f64a18b4640 10 monclient: shutdown 2024-08-18T21:05:01.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f64a18b4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:01.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f64a18b4640 1 -- 172.21.15.5:0/1400493803 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f649c0a4bb0 msgr2=0x7f649c0a4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f64a18b4640 1 --2- 172.21.15.5:0/1400493803 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f649c0a4bb0 0x7f649c0a4f90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6494009dc0 tx=0x7f649401c850 comp rx=0 tx=0).stop 2024-08-18T21:05:01.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f64a18b4640 1 -- 172.21.15.5:0/1400493803 shutdown_connections 2024-08-18T21:05:01.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f64a18b4640 1 --2- 172.21.15.5:0/1400493803 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f649c0a54d0 0x7f649c1414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f64a18b4640 1 --2- 172.21.15.5:0/1400493803 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f649c0a4bb0 0x7f649c0a4f90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f64a18b4640 1 -- 172.21.15.5:0/1400493803 >> 172.21.15.5:0/1400493803 conn(0x7f649c0aa1b0 msgr2=0x7f649c0aa590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f64a18b4640 1 -- 172.21.15.5:0/1400493803 shutdown_connections 2024-08-18T21:05:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.396+0000 7f64a18b4640 1 -- 172.21.15.5:0/1400493803 wait complete. 2024-08-18T21:05:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 10 monclient: build_initial_monmap 2024-08-18T21:05:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 10 monclient: monmap: 2024-08-18T21:05:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:01.410 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:01.410 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:01.410 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:01.410 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:01.410 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:01.410 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:01.410 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 1 Processor -- start 2024-08-18T21:05:01.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 1 -- start start 2024-08-18T21:05:01.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 10 monclient: init 2024-08-18T21:05:01.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:01.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 10 monclient: _add_conns ranks=[2,0,6,4,1,7,5,3,8] 2024-08-18T21:05:01.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f649c0a4bb0 0x7f649c129a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 10 monclient(hunting): picked mon.noname-b con 0x7f649c0a4bb0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:01.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f649c0a54d0 0x7f649c1408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 10 monclient(hunting): picked mon.noname-a con 0x7f649c0a54d0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:05:01.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f649c0a6840 0x7f649c1274f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 10 monclient(hunting): picked mon.noname-d con 0x7f649c0a6840 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:01.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f649c144390 con 0x7f649c0a54d0 2024-08-18T21:05:01.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f649c144210 con 0x7f649c0a4bb0 2024-08-18T21:05:01.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f649c144510 con 0x7f649c0a6840 2024-08-18T21:05:01.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:01.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f64a18b4640 10 monclient(hunting): authenticate will time out at 1068.417153s 2024-08-18T21:05:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f649c0a4bb0 0x7f649c129a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f649c0a4bb0 0x7f649c129a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34304/0 (socket says 172.21.15.5:34304) 2024-08-18T21:05:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 1 -- 172.21.15.5:0/3681496642 learned_addr learned my addr 172.21.15.5:0/3681496642 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 10 monclient(hunting): get_auth_request con 0x7f649c0a4bb0 auth_method 0 2024-08-18T21:05:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649a7fc640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f649c0a54d0 0x7f649c1408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649b7fe640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f649c0a6840 0x7f649c1274f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649a7fc640 10 monclient(hunting): get_auth_request con 0x7f649c0a54d0 auth_method 0 2024-08-18T21:05:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649b7fe640 10 monclient(hunting): get_auth_request con 0x7f649c0a6840 auth_method 0 2024-08-18T21:05:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 10 monclient(hunting): handle_auth_done global_id 4745 payload 824 2024-08-18T21:05:01.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 1 -- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f649c0a6840 msgr2=0x7f649c1274f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f649c0a6840 0x7f649c1274f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 1 -- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f649c0a54d0 msgr2=0x7f649c1408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f649c0a54d0 0x7f649c1408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 10 monclient: _finish_hunting 0 2024-08-18T21:05:01.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 1 monclient: found mon.noname-b 2024-08-18T21:05:01.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:01.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:01.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 1 -- 172.21.15.5:0/3681496642 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649c0a7a20 con 0x7f649c0a4bb0 2024-08-18T21:05:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 1 -- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f649c0a4bb0 msgr2=0x7f649c129a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.400+0000 7f649affd640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f649c0a4bb0 0x7f649c129a60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f649401c680 tx=0x7f64940195f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6483fff640 1 -- 172.21.15.5:0/3681496642 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f64940b2050 con 0x7f649c0a4bb0 2024-08-18T21:05:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6483fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6483fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6483fff640 10 monclient: dump: 2024-08-18T21:05:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.419 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6483fff640 10 monclient: _finish_auth 0 2024-08-18T21:05:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6483fff640 10 monclient: _check_auth_tickets 2024-08-18T21:05:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6483fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6483fff640 1 -- 172.21.15.5:0/3681496642 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64940b3040 con 0x7f649c0a4bb0 2024-08-18T21:05:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f64a18b4640 5 monclient: authenticate success, global_id 4745 2024-08-18T21:05:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f64a18b4640 10 monclient: _renew_subs 2024-08-18T21:05:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f64a18b4640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f64a18b4640 1 -- 172.21.15.5:0/3681496642 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649c12a3f0 con 0x7f649c0a4bb0 2024-08-18T21:05:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6483fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6483fff640 1 -- 172.21.15.5:0/3681496642 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6494003bb0 con 0x7f649c0a4bb0 2024-08-18T21:05:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6483fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6483fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6483fff640 10 monclient: dump: 2024-08-18T21:05:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.421 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f64a18b4640 10 monclient: _renew_subs 2024-08-18T21:05:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f64a18b4640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f64a18b4640 1 -- 172.21.15.5:0/3681496642 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f649c12af80 con 0x7f649c0a4bb0 2024-08-18T21:05:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6498ff9640 4 set_mon_vals no callback set 2024-08-18T21:05:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f64a18b4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f64a18b4640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c127a30 0x7f649c127e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f64a18b4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f64a18b4640 1 -- 172.21.15.5:0/3681496642 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f649c051140 con 0x7f649c127a30 2024-08-18T21:05:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f649a7fc640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c127a30 0x7f649c127e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f649a7fc640 10 monclient: get_auth_request con 0x7f649c127a30 auth_method 0 2024-08-18T21:05:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f649a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f649a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f649a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6483fff640 1 -- 172.21.15.5:0/3681496642 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f64940c0030 con 0x7f649c0a4bb0 2024-08-18T21:05:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f649a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f649a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f649a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f649a7fc640 10 monclient(hunting): handle_auth_done global_id 34127 payload 824 2024-08-18T21:05:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6483fff640 1 --2- 172.21.15.5:0/3681496642 >> v2:172.21.15.157:6812/631023601 conn(0x7f648803bdb0 0x7f648803e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f649a7fc640 1 -- 172.21.15.5:0/3681496642 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f649c06ecc0 con 0x7f649c127a30 2024-08-18T21:05:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f6483fff640 1 -- 172.21.15.5:0/3681496642 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(46..46 src has 11..46) ==== 3898+0+0 (secure 0 0 0) 0x7f64940be020 con 0x7f649c0a4bb0 2024-08-18T21:05:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f649b7fe640 1 --2- 172.21.15.5:0/3681496642 >> v2:172.21.15.157:6812/631023601 conn(0x7f648803bdb0 0x7f648803e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f649b7fe640 10 monclient: get_auth_request con 0x7f648803bdb0 auth_method 0 2024-08-18T21:05:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f649a7fc640 1 -- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c127a30 msgr2=0x7f649c127e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.404+0000 7f649a7fc640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c127a30 0x7f649c127e10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f649c129570 tx=0x7f649000ec00 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.408+0000 7f6483fff640 1 -- 172.21.15.5:0/3681496642 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6490017070 con 0x7f649c127a30 2024-08-18T21:05:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.408+0000 7f6483fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.408+0000 7f6483fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:05:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.408+0000 7f6483fff640 10 monclient: dump: 2024-08-18T21:05:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.425 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.408+0000 7f6483fff640 1 -- 172.21.15.5:0/3681496642 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f649000c980 con 0x7f649c127a30 2024-08-18T21:05:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.408+0000 7f6483fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.408+0000 7f6483fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.408+0000 7f6483fff640 1 -- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c127a30 msgr2=0x7f649c127e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.408+0000 7f6483fff640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c127a30 0x7f649c127e10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f649c129570 tx=0x7f649000ec00 comp rx=0 tx=0).stop 2024-08-18T21:05:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.408+0000 7f6483fff640 1 -- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c127a30 msgr2=0x7f649c127e10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.408+0000 7f6483fff640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c127a30 0x7f649c127e10 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f649c129570 tx=0x7f649000ec00 comp rx=0 tx=0).stop 2024-08-18T21:05:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.408+0000 7f649b7fe640 1 --2- 172.21.15.5:0/3681496642 >> v2:172.21.15.157:6812/631023601 conn(0x7f648803bdb0 0x7f648803e270 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f648c009b80 tx=0x7f648c009190 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.412+0000 7f64a18b4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.412+0000 7f64a18b4640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c0a1fb0 0x7f649c0a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.412+0000 7f64a18b4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.412+0000 7f64a18b4640 1 -- 172.21.15.5:0/3681496642 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f649c0aa7c0 con 0x7f649c0a1fb0 2024-08-18T21:05:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.412+0000 7f649a7fc640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c0a1fb0 0x7f649c0a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.412+0000 7f649a7fc640 10 monclient: get_auth_request con 0x7f649c0a1fb0 auth_method 0 2024-08-18T21:05:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.412+0000 7f649a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.412+0000 7f649a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.412+0000 7f649a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.412+0000 7f649a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.412+0000 7f649a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.412+0000 7f649a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.412+0000 7f649a7fc640 10 monclient(hunting): handle_auth_done global_id 34136 payload 824 2024-08-18T21:05:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.412+0000 7f649a7fc640 1 -- 172.21.15.5:0/3681496642 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f649c128350 con 0x7f649c0a1fb0 2024-08-18T21:05:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f649a7fc640 1 -- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c0a1fb0 msgr2=0x7f649c0a23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f649a7fc640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c0a1fb0 0x7f649c0a23c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f649c129570 tx=0x7f64900058e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f649a7fc640 1 -- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c0a1fb0 msgr2=0x7f649c0a23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-18T21:05:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f649a7fc640 1 -- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c0a1fb0 msgr2=0x7f649c0a23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:05:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f649a7fc640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c0a1fb0 0x7f649c0a23c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f649c129570 tx=0x7f64900058e0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f649a7fc640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c0a1fb0 0x7f649c0a23c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f649c129570 tx=0x7f64900058e0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f6483fff640 1 -- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c0a1fb0 msgr2=0x7f649c0a23c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f6483fff640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c0a1fb0 0x7f649c0a23c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f6483fff640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f64880428a0 0x7f6488044c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f6483fff640 1 -- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c0a1fb0 msgr2=0x7f649c0a23c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f6483fff640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f649c0a1fb0 0x7f649c0a23c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f6483fff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f6483fff640 1 -- 172.21.15.5:0/3681496642 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f6488042310 con 0x7f64880428a0 2024-08-18T21:05:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f649a7fc640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f64880428a0 0x7f6488044c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f649a7fc640 10 monclient: get_auth_request con 0x7f64880428a0 auth_method 0 2024-08-18T21:05:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f649a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f649a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f649a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f649a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f649a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f649a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f649a7fc640 10 monclient(hunting): handle_auth_done global_id 34145 payload 824 2024-08-18T21:05:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.416+0000 7f649a7fc640 1 -- 172.21.15.5:0/3681496642 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f649000c980 con 0x7f64880428a0 2024-08-18T21:05:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f649a7fc640 1 -- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f64880428a0 msgr2=0x7f6488044c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f649a7fc640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f64880428a0 0x7f6488044c90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f649c0aa940 tx=0x7f6490009400 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f6483fff640 1 -- 172.21.15.5:0/3681496642 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6490034070 con 0x7f64880428a0 2024-08-18T21:05:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f6483fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f6483fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:05:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f6483fff640 10 monclient: dump: 2024-08-18T21:05:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.431 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f6483fff640 1 -- 172.21.15.5:0/3681496642 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9246 (secure 0 0 0) 0x7f6490030410 con 0x7f64880428a0 2024-08-18T21:05:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f6483fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f6483fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f6483fff640 1 -- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f64880428a0 msgr2=0x7f6488044c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f6483fff640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f64880428a0 0x7f6488044c90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f649c0aa940 tx=0x7f6490009400 comp rx=0 tx=0).stop 2024-08-18T21:05:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f6483fff640 1 -- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f64880428a0 msgr2=0x7f6488044c90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f649b7fe640 1 -- 172.21.15.5:0/3681496642 reap_dead start 2024-08-18T21:05:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f6483fff640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f64880428a0 0x7f6488044c90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.432 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:01.432 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:01.432 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:01.432 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:01.432 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:01.432 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 21215, 2024-08-18T21:05:01.432 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:01.433 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:01.433 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:01.433 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:01.433 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:01.433 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:01.433 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:01.433 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:01.433 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:01.433 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:01.433 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.433 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:05:01.433 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:01.433 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:01.433 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:01.434 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.434 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.434 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.434 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.434 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.434 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.434 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.434 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.434 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.434 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.434 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.434 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.434 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:01.435 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:01.435 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.435 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.435 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.435 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.435 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.435 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.435 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.435 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.435 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.435 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.435 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.435 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.436 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:01.436 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:01.436 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:01.436 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:01.436 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:01.436 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:01.436 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:01.436 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:01.436 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:01.436 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:01.436 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:01.436 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:01.436 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:01.436 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:01.437 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:01.437 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:01.437 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:01.437 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.437 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.437 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.437 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.437 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.437 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.437 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.437 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.437 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.437 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.437 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.438 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.438 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:01.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.438 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:01.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.438 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:01.438 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:01.438 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.438 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.438 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.438 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:01.438 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.439 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.439 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.439 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:01.439 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.439 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.439 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.439 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:01.439 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:01.439 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.439 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.439 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.439 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.440 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:01.440 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:01.440 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.440 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.440 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:01.440 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.440 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:01.440 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.440 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.441 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.441 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:01.441 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:01.441 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.441 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.441 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.441 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:01.441 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:01.441 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.441 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.442 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.442 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:01.442 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.442 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.442 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:01.442 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.442 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.442 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.442 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:01.442 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:01.443 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.443 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.443 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.443 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:01.443 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:01.443 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.443 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.443 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:01.443 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.444 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.444 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:01.444 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.444 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.444 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.444 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:01.444 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:01.444 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.444 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.444 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.445 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:01.445 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:01.445 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.445 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.445 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:01.445 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.445 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:01.445 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.445 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.445 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.446 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:01.446 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:01.446 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.446 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.446 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.446 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:01.446 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:01.446 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.446 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.447 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.447 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:01.447 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.447 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.447 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:01.447 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.447 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.447 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:01.447 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:01.447 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.448 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.448 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.448 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:01.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:01.448 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.448 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.448 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:01.448 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.449 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:01.449 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.449 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.449 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.449 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:01.449 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:01.449 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.449 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.449 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.449 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:01.454 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:01.454 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:01.454 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.454 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.454 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:01.454 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f64a18b4640 1 -- 172.21.15.5:0/3681496642 >> v2:172.21.15.157:6812/631023601 conn(0x7f648803bdb0 msgr2=0x7f648803e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f64a18b4640 1 --2- 172.21.15.5:0/3681496642 >> v2:172.21.15.157:6812/631023601 conn(0x7f648803bdb0 0x7f648803e270 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f648c009b80 tx=0x7f648c009190 comp rx=0 tx=0).stop 2024-08-18T21:05:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f64a18b4640 10 monclient: shutdown 2024-08-18T21:05:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f64a18b4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f64a18b4640 1 -- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f649c0a4bb0 msgr2=0x7f649c129a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f64a18b4640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f649c0a4bb0 0x7f649c129a60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f649401c680 tx=0x7f64940195f0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f64a18b4640 1 -- 172.21.15.5:0/3681496642 shutdown_connections 2024-08-18T21:05:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f64a18b4640 1 --2- 172.21.15.5:0/3681496642 >> v2:172.21.15.157:6812/631023601 conn(0x7f648803bdb0 0x7f648803e270 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f64a18b4640 1 --2- 172.21.15.5:0/3681496642 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f649c0a4bb0 0x7f649c129a60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f64a18b4640 1 -- 172.21.15.5:0/3681496642 >> 172.21.15.5:0/3681496642 conn(0x7f649c0aa1b0 msgr2=0x7f649c0a15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f64a18b4640 1 -- 172.21.15.5:0/3681496642 shutdown_connections 2024-08-18T21:05:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.420+0000 7f64a18b4640 1 -- 172.21.15.5:0/3681496642 wait complete. 2024-08-18T21:05:01.456 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:01.456 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:05:01.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:05:01.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.576+0000 7fba282f9640 10 monclient: get_monmap_and_config 2024-08-18T21:05:01.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.576+0000 7fba282f9640 10 monclient: build_initial_monmap 2024-08-18T21:05:01.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.576+0000 7fba282f9640 10 monclient: monmap: 2024-08-18T21:05:01.582 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:01.582 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.582 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:01.584350+0000 2024-08-18T21:05:01.583 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:01.584350+0000 2024-08-18T21:05:01.583 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:01.583 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.583 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:01.583 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:01.583 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:01.583 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:01.583 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:01.583 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:01.583 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:01.583 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:01.583 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:01.583 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:01.584 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:01.584 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 1 Processor -- start 2024-08-18T21:05:01.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 1 -- start start 2024-08-18T21:05:01.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 10 monclient: init 2024-08-18T21:05:01.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:01.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 10 monclient: _add_conns ranks=[2,7,5,10,0,4,8,3,9,6,1] 2024-08-18T21:05:01.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fba200a6ce0 0x7fba200a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 10 monclient(hunting): picked mon.noname-b con 0x7fba200a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:01.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fba200a7600 0x7fba20139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 10 monclient(hunting): picked mon.noname-i con 0x7fba200a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:01.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fba20139fe0 0x7fba2013a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 10 monclient(hunting): picked mon.noname-h con 0x7fba20139fe0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:01.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fba200a5000 con 0x7fba200a6ce0 2024-08-18T21:05:01.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fba200a4360 con 0x7fba20139fe0 2024-08-18T21:05:01.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fba200a45d0 con 0x7fba200a7600 2024-08-18T21:05:01.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:01.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba282f9640 10 monclient(hunting): authenticate will time out at 1068.597485s 2024-08-18T21:05:01.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fba200a6ce0 0x7fba200a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fba200a6ce0 0x7fba200a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34310/0 (socket says 172.21.15.5:34310) 2024-08-18T21:05:01.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 1 -- 172.21.15.5:0/2859538864 learned_addr learned my addr 172.21.15.5:0/2859538864 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:01.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 10 monclient(hunting): get_auth_request con 0x7fba200a6ce0 auth_method 0 2024-08-18T21:05:01.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba25894640 1 --2- 172.21.15.5:0/2859538864 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fba200a7600 0x7fba20139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26896640 1 --2- 172.21.15.5:0/2859538864 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fba20139fe0 0x7fba2013a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26896640 10 monclient(hunting): get_auth_request con 0x7fba20139fe0 auth_method 0 2024-08-18T21:05:01.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26896640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26896640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26896640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba25894640 10 monclient(hunting): get_auth_request con 0x7fba200a7600 auth_method 0 2024-08-18T21:05:01.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba25894640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba25894640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba25894640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 10 monclient(hunting): handle_auth_done global_id 4754 payload 274 2024-08-18T21:05:01.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 1 -- 172.21.15.5:0/2859538864 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fba200a7600 msgr2=0x7fba20139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:01.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 1 --2- 172.21.15.5:0/2859538864 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fba200a7600 0x7fba20139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 1 -- 172.21.15.5:0/2859538864 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fba20139fe0 msgr2=0x7fba2013a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:01.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 1 --2- 172.21.15.5:0/2859538864 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fba20139fe0 0x7fba2013a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 10 monclient: _finish_hunting 0 2024-08-18T21:05:01.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 1 monclient: found mon.noname-b 2024-08-18T21:05:01.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:01.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:01.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.580+0000 7fba26095640 1 -- 172.21.15.5:0/2859538864 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba200a32d0 con 0x7fba200a6ce0 2024-08-18T21:05:01.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.584+0000 7fba26095640 1 -- 172.21.15.5:0/2859538864 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fba200a6ce0 msgr2=0x7fba200a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.584+0000 7fba26095640 1 --2- 172.21.15.5:0/2859538864 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fba200a6ce0 0x7fba200a70c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0098d0 tx=0x7fba1c01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80c11e568a5b581e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25093640 1 -- 172.21.15.5:0/2859538864 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba1c0b0070 con 0x7fba200a6ce0 2024-08-18T21:05:01.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25093640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25093640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:01.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25093640 10 monclient: dump: 2024-08-18T21:05:01.594 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.594 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.594 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.594 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.594 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.594 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.595 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.595 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.595 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.595 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.595 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.595 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.595 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.595 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.595 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.595 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25093640 10 monclient: _finish_auth 0 2024-08-18T21:05:01.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25093640 10 monclient: _check_auth_tickets 2024-08-18T21:05:01.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25093640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:01.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25093640 1 -- 172.21.15.5:0/2859538864 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba1c0aa810 con 0x7fba200a6ce0 2024-08-18T21:05:01.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25093640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:01.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25093640 1 -- 172.21.15.5:0/2859538864 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba1c0aae30 con 0x7fba200a6ce0 2024-08-18T21:05:01.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25093640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25093640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:01.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25093640 10 monclient: dump: 2024-08-18T21:05:01.596 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.596 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.596 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.596 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.596 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.596 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.596 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.597 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.597 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.597 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.597 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.597 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.597 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.597 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.597 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.597 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 5 monclient: authenticate success, global_id 4754 2024-08-18T21:05:01.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:01.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 4 set_mon_vals no callback set 2024-08-18T21:05:01.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 10 monclient: shutdown 2024-08-18T21:05:01.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:01.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 -- 172.21.15.5:0/2859538864 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fba200a6ce0 msgr2=0x7fba200a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 --2- 172.21.15.5:0/2859538864 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fba200a6ce0 0x7fba200a70c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0098d0 tx=0x7fba1c01c440 comp rx=0 tx=0).stop 2024-08-18T21:05:01.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 -- 172.21.15.5:0/2859538864 shutdown_connections 2024-08-18T21:05:01.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 --2- 172.21.15.5:0/2859538864 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fba20139fe0 0x7fba2013a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 --2- 172.21.15.5:0/2859538864 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fba200a7600 0x7fba20139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 --2- 172.21.15.5:0/2859538864 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fba200a6ce0 0x7fba200a70c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 -- 172.21.15.5:0/2859538864 >> 172.21.15.5:0/2859538864 conn(0x7fba200acbc0 msgr2=0x7fba200a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:01.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 -- 172.21.15.5:0/2859538864 shutdown_connections 2024-08-18T21:05:01.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 -- 172.21.15.5:0/2859538864 wait complete. 2024-08-18T21:05:01.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 10 monclient: build_initial_monmap 2024-08-18T21:05:01.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 10 monclient: monmap: 2024-08-18T21:05:01.599 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:01.599 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:01.599 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:01.599 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:01.599 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:01.599 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.599 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:01.599 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:01.599 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:01.599 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:01.599 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:01.600 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:01.600 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:01.600 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:01.600 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:01.600 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 Processor -- start 2024-08-18T21:05:01.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 -- start start 2024-08-18T21:05:01.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 10 monclient: init 2024-08-18T21:05:01.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:01.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 10 monclient: _add_conns ranks=[4,6,3,0,7,2,1,8,5] 2024-08-18T21:05:01.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fba200a6ce0 0x7fba201d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 10 monclient(hunting): picked mon.noname-c con 0x7fba200a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:01.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fba200a7600 0x7fba2013fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 10 monclient(hunting): picked mon.noname-d con 0x7fba200a7600 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:01.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba20139fe0 0x7fba20140200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 10 monclient(hunting): picked mon.noname-g con 0x7fba20139fe0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:01.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fba200a79e0 con 0x7fba20139fe0 2024-08-18T21:05:01.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fba200a8220 con 0x7fba200a6ce0 2024-08-18T21:05:01.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fba200abf00 con 0x7fba200a7600 2024-08-18T21:05:01.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:01.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba282f9640 10 monclient(hunting): authenticate will time out at 1068.606347s 2024-08-18T21:05:01.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fba200a6ce0 0x7fba201d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25894640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fba200a7600 0x7fba2013fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fba200a6ce0 0x7fba201d16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:40188/0 (socket says 172.21.15.5:40188) 2024-08-18T21:05:01.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 1 -- 172.21.15.5:0/227388636 learned_addr learned my addr 172.21.15.5:0/227388636 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:01.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25894640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fba200a7600 0x7fba2013fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:60426/0 (socket says 172.21.15.5:60426) 2024-08-18T21:05:01.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 10 monclient(hunting): get_auth_request con 0x7fba200a6ce0 auth_method 0 2024-08-18T21:05:01.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25894640 10 monclient(hunting): get_auth_request con 0x7fba200a7600 auth_method 0 2024-08-18T21:05:01.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25894640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25894640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25894640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25894640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25894640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba25894640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26896640 1 --2- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba20139fe0 0x7fba20140200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26896640 10 monclient(hunting): get_auth_request con 0x7fba20139fe0 auth_method 0 2024-08-18T21:05:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26896640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26896640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26896640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 10 monclient(hunting): handle_auth_done global_id 4720 payload 824 2024-08-18T21:05:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 1 -- 172.21.15.5:0/227388636 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fba200a7600 msgr2=0x7fba2013fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 1 --2- 172.21.15.5:0/227388636 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fba200a7600 0x7fba2013fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 1 -- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba20139fe0 msgr2=0x7fba20140200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 1 --2- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba20139fe0 0x7fba20140200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 10 monclient: _finish_hunting 0 2024-08-18T21:05:01.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 1 monclient: found mon.noname-c 2024-08-18T21:05:01.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:01.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:05:01.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.588+0000 7fba26095640 1 -- 172.21.15.5:0/227388636 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba200aa390 con 0x7fba200a6ce0 2024-08-18T21:05:01.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba26095640 1 -- 172.21.15.5:0/227388636 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fba200a6ce0 msgr2=0x7fba201d16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba26095640 1 --2- 172.21.15.5:0/227388636 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fba200a6ce0 0x7fba201d16b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0097c0 tx=0x7fba1c0191e0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba16ffd640 1 -- 172.21.15.5:0/227388636 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba1c0b0070 con 0x7fba200a6ce0 2024-08-18T21:05:01.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba16ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba16ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:05:01.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba16ffd640 10 monclient: dump: 2024-08-18T21:05:01.607 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.608 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.608 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.608 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.608 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.608 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.608 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.608 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.608 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.609 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.609 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.609 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.609 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.609 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.609 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.609 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba16ffd640 10 monclient: _finish_auth 0 2024-08-18T21:05:01.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba16ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:05:01.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba16ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:01.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba16ffd640 1 -- 172.21.15.5:0/227388636 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba1c0b1040 con 0x7fba200a6ce0 2024-08-18T21:05:01.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba282f9640 5 monclient: authenticate success, global_id 4720 2024-08-18T21:05:01.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba282f9640 10 monclient: _renew_subs 2024-08-18T21:05:01.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba282f9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:05:01.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba282f9640 1 -- 172.21.15.5:0/227388636 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba20140740 con 0x7fba200a6ce0 2024-08-18T21:05:01.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba16ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:01.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba16ffd640 1 -- 172.21.15.5:0/227388636 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba1c004450 con 0x7fba200a6ce0 2024-08-18T21:05:01.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba16ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba16ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:01.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba16ffd640 10 monclient: dump: 2024-08-18T21:05:01.610 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.610 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.610 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.611 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.611 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.611 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.611 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.611 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.611 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.611 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.611 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.611 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.611 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.611 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.611 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.612 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba24892640 4 set_mon_vals no callback set 2024-08-18T21:05:01.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba282f9640 10 monclient: _renew_subs 2024-08-18T21:05:01.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba282f9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:05:01.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba282f9640 1 -- 172.21.15.5:0/227388636 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fba2013def0 con 0x7fba200a6ce0 2024-08-18T21:05:01.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba282f9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:01.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba282f9640 1 --2- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba2013ab20 0x7fba2013af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba282f9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba282f9640 1 -- 172.21.15.5:0/227388636 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fba200a7b60 con 0x7fba2013ab20 2024-08-18T21:05:01.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba16ffd640 1 -- 172.21.15.5:0/227388636 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fba1c0bc060 con 0x7fba200a6ce0 2024-08-18T21:05:01.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba16ffd640 1 --2- 172.21.15.5:0/227388636 >> v2:172.21.15.157:6812/631023601 conn(0x7fba0403bdc0 0x7fba0403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba25894640 1 --2- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba2013ab20 0x7fba2013af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba16ffd640 1 -- 172.21.15.5:0/227388636 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(46..46 src has 11..46) ==== 3898+0+0 (secure 0 0 0) 0x7fba1c0e79b0 con 0x7fba200a6ce0 2024-08-18T21:05:01.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba25894640 10 monclient: get_auth_request con 0x7fba2013ab20 auth_method 0 2024-08-18T21:05:01.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba25894640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba25894640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba25894640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba25894640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba25894640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba25894640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba26896640 1 --2- 172.21.15.5:0/227388636 >> v2:172.21.15.157:6812/631023601 conn(0x7fba0403bdc0 0x7fba0403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba26896640 10 monclient: get_auth_request con 0x7fba0403bdc0 auth_method 0 2024-08-18T21:05:01.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba25894640 10 monclient(hunting): handle_auth_done global_id 4555 payload 824 2024-08-18T21:05:01.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.592+0000 7fba25894640 1 -- 172.21.15.5:0/227388636 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba2013cf90 con 0x7fba2013ab20 2024-08-18T21:05:01.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.596+0000 7fba25894640 1 -- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba2013ab20 msgr2=0x7fba2013af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.596+0000 7fba25894640 1 --2- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba2013ab20 0x7fba2013af00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba100107f0 tx=0x7fba10010cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.596+0000 7fba26896640 1 --2- 172.21.15.5:0/227388636 >> v2:172.21.15.157:6812/631023601 conn(0x7fba0403bdc0 0x7fba0403e280 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fba20135c40 tx=0x7fba1800b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.596+0000 7fba16ffd640 1 -- 172.21.15.5:0/227388636 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba10018020 con 0x7fba2013ab20 2024-08-18T21:05:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.596+0000 7fba16ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.596+0000 7fba16ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:05:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.596+0000 7fba16ffd640 10 monclient: dump: 2024-08-18T21:05:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.615 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.596+0000 7fba16ffd640 1 -- 172.21.15.5:0/227388636 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fba10004450 con 0x7fba2013ab20 2024-08-18T21:05:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.596+0000 7fba16ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.596+0000 7fba16ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.596+0000 7fba16ffd640 1 -- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba2013ab20 msgr2=0x7fba2013af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.596+0000 7fba16ffd640 1 --2- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba2013ab20 0x7fba2013af00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba100107f0 tx=0x7fba10010cb0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.596+0000 7fba16ffd640 1 -- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba2013ab20 msgr2=0x7fba2013af00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:01.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.596+0000 7fba16ffd640 1 --2- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba2013ab20 0x7fba2013af00 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba100107f0 tx=0x7fba10010cb0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.604+0000 7fba282f9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:01.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.604+0000 7fba282f9640 1 --2- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba2013b440 0x7fba2009da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.604+0000 7fba282f9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.604+0000 7fba282f9640 1 -- 172.21.15.5:0/227388636 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fba20051140 con 0x7fba2013b440 2024-08-18T21:05:01.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.604+0000 7fba25894640 1 --2- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba2013b440 0x7fba2009da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.604+0000 7fba25894640 10 monclient: get_auth_request con 0x7fba2013b440 auth_method 0 2024-08-18T21:05:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.604+0000 7fba25894640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.604+0000 7fba25894640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.604+0000 7fba25894640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.604+0000 7fba25894640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.604+0000 7fba25894640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.604+0000 7fba25894640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.604+0000 7fba25894640 10 monclient(hunting): handle_auth_done global_id 4564 payload 824 2024-08-18T21:05:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.604+0000 7fba25894640 1 -- 172.21.15.5:0/227388636 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fba20069580 con 0x7fba2013b440 2024-08-18T21:05:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba25894640 1 -- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba2013b440 msgr2=0x7fba2009da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba25894640 1 --2- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba2013b440 0x7fba2009da30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fba100107f0 tx=0x7fba100046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba16ffd640 1 -- 172.21.15.5:0/227388636 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba10018040 con 0x7fba2013b440 2024-08-18T21:05:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba16ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba16ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:05:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba16ffd640 10 monclient: dump: 2024-08-18T21:05:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.620 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba16ffd640 1 -- 172.21.15.5:0/227388636 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7fba10003620 con 0x7fba2013b440 2024-08-18T21:05:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba16ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba16ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba16ffd640 1 -- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba2013b440 msgr2=0x7fba2009da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba16ffd640 1 --2- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba2013b440 0x7fba2009da30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fba100107f0 tx=0x7fba100046d0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba16ffd640 1 -- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba2013b440 msgr2=0x7fba2009da30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba16ffd640 1 --2- 172.21.15.5:0/227388636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba2013b440 0x7fba2009da30 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fba100107f0 tx=0x7fba100046d0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.621 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:01.621 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:01.621 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:01.621 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:01.621 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:01.621 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 110690, 2024-08-18T21:05:01.621 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:01.621 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:01.621 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:01.621 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:01.622 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:01.622 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:01.622 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:01.622 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:01.622 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:01.622 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:01.622 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.622 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:05:01.622 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:01.622 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:01.622 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:01.622 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.622 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.623 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.623 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.623 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.623 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.623 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.623 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.623 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.623 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.624 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.624 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.624 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:01.624 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:01.624 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.624 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.624 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.624 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.624 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.624 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.624 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.624 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.624 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.624 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.625 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.625 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.625 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:01.625 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:01.625 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:01.625 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:01.625 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:01.625 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:01.625 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:01.625 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:01.625 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:01.625 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:01.626 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:01.626 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:01.626 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:01.626 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:01.626 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:01.626 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:01.626 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:01.626 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.626 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.626 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.626 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.626 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.626 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.627 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.627 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.627 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.627 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.627 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.627 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.627 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:01.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.627 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:01.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.627 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:01.627 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:01.627 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.628 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.628 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.628 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.628 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:01.628 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.628 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.628 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.628 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:01.628 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.628 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.628 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.629 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:01.629 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:01.629 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.629 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.629 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.629 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.629 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:01.629 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:01.629 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.629 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.629 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.629 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.629 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:01.630 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.630 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.630 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.630 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:01.630 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.630 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.630 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.630 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:01.630 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:01.630 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.630 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.631 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.631 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:01.631 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:01.631 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.631 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.631 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.631 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:01.631 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.631 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.632 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:01.632 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.632 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.632 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.632 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:01.632 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:01.632 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.632 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.632 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.633 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:01.633 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:01.633 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.633 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.633 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.633 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:01.633 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.633 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.634 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:01.634 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.634 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.634 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.634 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:01.634 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:01.634 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.634 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.634 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.635 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:01.635 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:01.635 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.635 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.635 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.635 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:01.635 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.635 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.635 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:01.635 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.635 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.636 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.636 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:01.636 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:01.636 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.636 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.636 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.636 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:01.636 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:01.636 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.636 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.637 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.637 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:01.637 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.637 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.637 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:01.637 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.637 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.637 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.637 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:01.638 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:01.638 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.638 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.638 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.638 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:01.638 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:01.638 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.638 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.638 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.638 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:01.638 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.639 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.639 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:01.639 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.639 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.639 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.639 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:01.639 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:01.639 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.639 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.639 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.640 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:01.640 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:01.640 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.640 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.640 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.640 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:01.640 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.641 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.641 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:01.641 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.641 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.641 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.641 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:01.641 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:01.641 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.641 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.642 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.642 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:01.642 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:01.642 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.642 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.642 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.642 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:01.642 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.643 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.643 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:01.643 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.643 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.643 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.643 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:01.643 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:01.643 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.643 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.643 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.643 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.643 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.644 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:01.644 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:01.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.644 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:01.644 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:01.644 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:01.644 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.644 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.644 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:01.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.644 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:01.644 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:01.644 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:01.644 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.645 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.645 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:01.645 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba282f9640 1 -- 172.21.15.5:0/227388636 >> v2:172.21.15.157:6812/631023601 conn(0x7fba0403bdc0 msgr2=0x7fba0403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba282f9640 1 --2- 172.21.15.5:0/227388636 >> v2:172.21.15.157:6812/631023601 conn(0x7fba0403bdc0 0x7fba0403e280 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fba20135c40 tx=0x7fba1800b040 comp rx=0 tx=0).stop 2024-08-18T21:05:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba282f9640 10 monclient: shutdown 2024-08-18T21:05:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba282f9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba282f9640 1 -- 172.21.15.5:0/227388636 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fba200a6ce0 msgr2=0x7fba201d16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba282f9640 1 --2- 172.21.15.5:0/227388636 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fba200a6ce0 0x7fba201d16b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0097c0 tx=0x7fba1c0191e0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba26896640 1 -- 172.21.15.5:0/227388636 reap_dead start 2024-08-18T21:05:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba282f9640 1 -- 172.21.15.5:0/227388636 shutdown_connections 2024-08-18T21:05:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba282f9640 1 --2- 172.21.15.5:0/227388636 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fba200a6ce0 0x7fba201d16b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba282f9640 1 -- 172.21.15.5:0/227388636 >> 172.21.15.5:0/227388636 conn(0x7fba200acbc0 msgr2=0x7fba20135c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba282f9640 1 -- 172.21.15.5:0/227388636 shutdown_connections 2024-08-18T21:05:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.608+0000 7fba282f9640 1 -- 172.21.15.5:0/227388636 wait complete. 2024-08-18T21:05:01.647 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:01.647 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:05:01.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:05:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 10 monclient: get_monmap_and_config 2024-08-18T21:05:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 10 monclient: build_initial_monmap 2024-08-18T21:05:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 10 monclient: monmap: 2024-08-18T21:05:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:01.765087+0000 2024-08-18T21:05:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:01.765087+0000 2024-08-18T21:05:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:01.765 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 1 Processor -- start 2024-08-18T21:05:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 1 -- start start 2024-08-18T21:05:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 10 monclient: init 2024-08-18T21:05:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 10 monclient: _add_conns ranks=[6,3,5,10,8,1,2,7,4,9,0] 2024-08-18T21:05:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdd9c0a1ff0 0x7fdd9c137430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 10 monclient(hunting): picked mon.noname-d con 0x7fdd9c0a1ff0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c137970 0x7fdd9c137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 10 monclient(hunting): picked mon.noname-g con 0x7fdd9c137970 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd9c133eb0 0x7fdd9c134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 10 monclient(hunting): picked mon.noname-h con 0x7fdd9c133eb0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdd9c09dd50 con 0x7fdd9c137970 2024-08-18T21:05:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdd9c0a23d0 con 0x7fdd9c133eb0 2024-08-18T21:05:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fdd9c09e970 con 0x7fdd9c0a1ff0 2024-08-18T21:05:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda4300640 10 monclient(hunting): authenticate will time out at 1068.778162s 2024-08-18T21:05:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdd9c0a1ff0 0x7fdd9c137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdd9c0a1ff0 0x7fdd9c137430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:60430/0 (socket says 172.21.15.5:60430) 2024-08-18T21:05:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 1 -- 172.21.15.5:0/1911081368 learned_addr learned my addr 172.21.15.5:0/1911081368 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 10 monclient(hunting): get_auth_request con 0x7fdd9c0a1ff0 auth_method 0 2024-08-18T21:05:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda189b640 1 --2- 172.21.15.5:0/1911081368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c137970 0x7fdd9c137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda289d640 1 --2- 172.21.15.5:0/1911081368 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd9c133eb0 0x7fdd9c134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda189b640 10 monclient(hunting): get_auth_request con 0x7fdd9c137970 auth_method 0 2024-08-18T21:05:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda189b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda189b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda189b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda289d640 10 monclient(hunting): get_auth_request con 0x7fdd9c133eb0 auth_method 0 2024-08-18T21:05:01.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda289d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda289d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda289d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 10 monclient(hunting): handle_auth_done global_id 4686 payload 274 2024-08-18T21:05:01.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 1 -- 172.21.15.5:0/1911081368 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd9c133eb0 msgr2=0x7fdd9c134330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:01.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 1 --2- 172.21.15.5:0/1911081368 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd9c133eb0 0x7fdd9c134330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 1 -- 172.21.15.5:0/1911081368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c137970 msgr2=0x7fdd9c137dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:01.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 1 --2- 172.21.15.5:0/1911081368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c137970 0x7fdd9c137dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 10 monclient: _finish_hunting 0 2024-08-18T21:05:01.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 1 monclient: found mon.noname-d 2024-08-18T21:05:01.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:01.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:05:01.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda209c640 1 -- 172.21.15.5:0/1911081368 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd9c09ec50 con 0x7fdd9c0a1ff0 2024-08-18T21:05:01.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.760+0000 7fdda189b640 1 --2- 172.21.15.5:0/1911081368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c137970 0x7fdd9c137dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:05:01.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.764+0000 7fdda209c640 1 -- 172.21.15.5:0/1911081368 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdd9c0a1ff0 msgr2=0x7fdd9c137430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.764+0000 7fdda209c640 1 --2- 172.21.15.5:0/1911081368 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdd9c0a1ff0 0x7fdd9c137430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009e80 tx=0x7fdd9801c910 comp rx=0 tx=0).ready entity=mon.6 client_cookie=6995e6fcba89af09 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.764+0000 7fdda109a640 1 -- 172.21.15.5:0/1911081368 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd980090d0 con 0x7fdd9c0a1ff0 2024-08-18T21:05:01.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.764+0000 7fdda109a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.764+0000 7fdda109a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:05:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.764+0000 7fdda109a640 10 monclient: dump: 2024-08-18T21:05:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.775 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.775 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.775 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.775 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda109a640 10 monclient: _finish_auth 0 2024-08-18T21:05:01.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda109a640 10 monclient: _check_auth_tickets 2024-08-18T21:05:01.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda109a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:01.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda109a640 1 -- 172.21.15.5:0/1911081368 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd980a6970 con 0x7fdd9c0a1ff0 2024-08-18T21:05:01.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda109a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:01.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda109a640 1 -- 172.21.15.5:0/1911081368 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd980af480 con 0x7fdd9c0a1ff0 2024-08-18T21:05:01.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 5 monclient: authenticate success, global_id 4686 2024-08-18T21:05:01.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 4 set_mon_vals no callback set 2024-08-18T21:05:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda109a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda109a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:05:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda109a640 10 monclient: dump: 2024-08-18T21:05:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.777 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 10 monclient: shutdown 2024-08-18T21:05:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 -- 172.21.15.5:0/1911081368 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdd9c0a1ff0 msgr2=0x7fdd9c137430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 --2- 172.21.15.5:0/1911081368 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdd9c0a1ff0 0x7fdd9c137430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009e80 tx=0x7fdd9801c910 comp rx=0 tx=0).stop 2024-08-18T21:05:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 -- 172.21.15.5:0/1911081368 shutdown_connections 2024-08-18T21:05:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 --2- 172.21.15.5:0/1911081368 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd9c133eb0 0x7fdd9c134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 --2- 172.21.15.5:0/1911081368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c137970 0x7fdd9c137dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 --2- 172.21.15.5:0/1911081368 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdd9c0a1ff0 0x7fdd9c137430 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 -- 172.21.15.5:0/1911081368 >> 172.21.15.5:0/1911081368 conn(0x7fdd9c0a8020 msgr2=0x7fdd9c0a8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 -- 172.21.15.5:0/1911081368 shutdown_connections 2024-08-18T21:05:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 -- 172.21.15.5:0/1911081368 wait complete. 2024-08-18T21:05:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 10 monclient: build_initial_monmap 2024-08-18T21:05:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 10 monclient: monmap: 2024-08-18T21:05:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:01.779 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 Processor -- start 2024-08-18T21:05:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 -- start start 2024-08-18T21:05:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 10 monclient: init 2024-08-18T21:05:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 10 monclient: _add_conns ranks=[2,5,1,3,0,7,6,8,4] 2024-08-18T21:05:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdd9c0a1ff0 0x7fdd9c130b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 10 monclient(hunting): picked mon.noname-b con 0x7fdd9c0a1ff0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd9c133eb0 0x7fdd9c13a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 10 monclient(hunting): picked mon.noname-h con 0x7fdd9c133eb0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd9c137970 0x7fdd9c13a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 10 monclient(hunting): picked mon.noname-f con 0x7fdd9c137970 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:05:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9c141370 con 0x7fdd9c137970 2024-08-18T21:05:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fdd9c1411f0 con 0x7fdd9c0a1ff0 2024-08-18T21:05:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdd9c1414f0 con 0x7fdd9c133eb0 2024-08-18T21:05:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda4300640 10 monclient(hunting): authenticate will time out at 1068.786253s 2024-08-18T21:05:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdd9c0a1ff0 0x7fdd9c130b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdd9c0a1ff0 0x7fdd9c130b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34312/0 (socket says 172.21.15.5:34312) 2024-08-18T21:05:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 1 -- 172.21.15.5:0/494115270 learned_addr learned my addr 172.21.15.5:0/494115270 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 10 monclient(hunting): get_auth_request con 0x7fdd9c0a1ff0 auth_method 0 2024-08-18T21:05:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda189b640 1 --2- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd9c133eb0 0x7fdd9c13a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 10 monclient(hunting): handle_auth_done global_id 4763 payload 824 2024-08-18T21:05:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 1 -- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd9c133eb0 msgr2=0x7fdd9c13a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 1 --2- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd9c133eb0 0x7fdd9c13a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda289d640 1 --2- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd9c137970 0x7fdd9c13a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 1 -- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd9c137970 msgr2=0x7fdd9c13a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 1 --2- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd9c137970 0x7fdd9c13a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 10 monclient: _finish_hunting 0 2024-08-18T21:05:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 1 monclient: found mon.noname-b 2024-08-18T21:05:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.768+0000 7fdda209c640 1 -- 172.21.15.5:0/494115270 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd9c131790 con 0x7fdd9c0a1ff0 2024-08-18T21:05:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda209c640 1 -- 172.21.15.5:0/494115270 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdd9c0a1ff0 msgr2=0x7fdd9c130b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda209c640 1 --2- 172.21.15.5:0/494115270 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdd9c0a1ff0 0x7fdd9c130b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdd9801d1b0 tx=0x7fdd980196b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdd92ffd640 1 -- 172.21.15.5:0/494115270 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd98003e10 con 0x7fdd9c0a1ff0 2024-08-18T21:05:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdd92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdd92ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdd92ffd640 10 monclient: dump: 2024-08-18T21:05:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.787 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdd92ffd640 10 monclient: _finish_auth 0 2024-08-18T21:05:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdd92ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:05:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdd92ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda4300640 5 monclient: authenticate success, global_id 4763 2024-08-18T21:05:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda4300640 10 monclient: _renew_subs 2024-08-18T21:05:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdd92ffd640 1 -- 172.21.15.5:0/494115270 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd980a6d30 con 0x7fdd9c0a1ff0 2024-08-18T21:05:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda4300640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda4300640 1 -- 172.21.15.5:0/494115270 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd9c1376f0 con 0x7fdd9c0a1ff0 2024-08-18T21:05:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdd92ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdd92ffd640 1 -- 172.21.15.5:0/494115270 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd980044b0 con 0x7fdd9c0a1ff0 2024-08-18T21:05:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdd92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdd92ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda0899640 4 set_mon_vals no callback set 2024-08-18T21:05:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdd92ffd640 10 monclient: dump: 2024-08-18T21:05:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.789 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda4300640 10 monclient: _renew_subs 2024-08-18T21:05:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda4300640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda4300640 1 -- 172.21.15.5:0/494115270 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd9c13db00 con 0x7fdd9c0a1ff0 2024-08-18T21:05:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda4300640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda4300640 1 --2- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c13aef0 0x7fdd9c13b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda4300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda4300640 1 -- 172.21.15.5:0/494115270 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdd9c051140 con 0x7fdd9c13aef0 2024-08-18T21:05:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdd92ffd640 1 -- 172.21.15.5:0/494115270 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fdd980b7070 con 0x7fdd9c0a1ff0 2024-08-18T21:05:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdd92ffd640 1 --2- 172.21.15.5:0/494115270 >> v2:172.21.15.157:6812/631023601 conn(0x7fdd8003bdc0 0x7fdd8003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda189b640 1 --2- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c13aef0 0x7fdd9c13b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdd92ffd640 1 -- 172.21.15.5:0/494115270 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(46..46 src has 11..46) ==== 3898+0+0 (secure 0 0 0) 0x7fdd980e88a0 con 0x7fdd9c0a1ff0 2024-08-18T21:05:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda189b640 10 monclient: get_auth_request con 0x7fdd9c13aef0 auth_method 0 2024-08-18T21:05:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda189b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda189b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda189b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda189b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda189b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda189b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda289d640 1 --2- 172.21.15.5:0/494115270 >> v2:172.21.15.157:6812/631023601 conn(0x7fdd8003bdc0 0x7fdd8003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda289d640 10 monclient: get_auth_request con 0x7fdd8003bdc0 auth_method 0 2024-08-18T21:05:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda189b640 10 monclient(hunting): handle_auth_done global_id 4647 payload 824 2024-08-18T21:05:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.772+0000 7fdda189b640 1 -- 172.21.15.5:0/494115270 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd9c13bd60 con 0x7fdd9c13aef0 2024-08-18T21:05:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.776+0000 7fdda189b640 1 -- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c13aef0 msgr2=0x7fdd9c13b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.776+0000 7fdda189b640 1 --2- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c13aef0 0x7fdd9c13b2d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c13c3d0 tx=0x7fdd8c00e880 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.776+0000 7fdda289d640 1 --2- 172.21.15.5:0/494115270 >> v2:172.21.15.157:6812/631023601 conn(0x7fdd8003bdc0 0x7fdd8003e280 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c073650 tx=0x7fdd94008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.776+0000 7fdd92ffd640 1 -- 172.21.15.5:0/494115270 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd8c017020 con 0x7fdd9c13aef0 2024-08-18T21:05:01.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.776+0000 7fdd92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.776+0000 7fdd92ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:05:01.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.776+0000 7fdd92ffd640 10 monclient: dump: 2024-08-18T21:05:01.792 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.792 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.792 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.792 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.792 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.792 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.792 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.792 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.793 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.776+0000 7fdd92ffd640 1 -- 172.21.15.5:0/494115270 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdd8c013700 con 0x7fdd9c13aef0 2024-08-18T21:05:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.776+0000 7fdd92ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.776+0000 7fdd92ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.776+0000 7fdd92ffd640 1 -- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c13aef0 msgr2=0x7fdd9c13b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.776+0000 7fdd92ffd640 1 --2- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c13aef0 0x7fdd9c13b2d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c13c3d0 tx=0x7fdd8c00e880 comp rx=0 tx=0).stop 2024-08-18T21:05:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.776+0000 7fdd92ffd640 1 -- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c13aef0 msgr2=0x7fdd9c13b2d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.776+0000 7fdd92ffd640 1 --2- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c13aef0 0x7fdd9c13b2d0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c13c3d0 tx=0x7fdd8c00e880 comp rx=0 tx=0).stop 2024-08-18T21:05:01.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.784+0000 7fdda4300640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:01.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.784+0000 7fdda4300640 1 --2- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c0a2920 0x7fdd9c0a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.784+0000 7fdda4300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.784+0000 7fdda4300640 1 -- 172.21.15.5:0/494115270 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdd9c134330 con 0x7fdd9c0a2920 2024-08-18T21:05:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.784+0000 7fdda189b640 1 --2- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c0a2920 0x7fdd9c0a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.784+0000 7fdda189b640 10 monclient: get_auth_request con 0x7fdd9c0a2920 auth_method 0 2024-08-18T21:05:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.784+0000 7fdda189b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.784+0000 7fdda189b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.784+0000 7fdda189b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.784+0000 7fdda189b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.784+0000 7fdda189b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.784+0000 7fdda189b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.784+0000 7fdda189b640 10 monclient(hunting): handle_auth_done global_id 4656 payload 824 2024-08-18T21:05:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.784+0000 7fdda189b640 1 -- 172.21.15.5:0/494115270 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdd9c06d150 con 0x7fdd9c0a2920 2024-08-18T21:05:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdda189b640 1 -- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c0a2920 msgr2=0x7fdd9c0a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdda189b640 1 --2- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c0a2920 0x7fdd9c0a2d30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c13c3d0 tx=0x7fdd8c0046d0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdd92ffd640 1 -- 172.21.15.5:0/494115270 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd8c017040 con 0x7fdd9c0a2920 2024-08-18T21:05:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdd92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdd92ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:05:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdd92ffd640 10 monclient: dump: 2024-08-18T21:05:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.798 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdd92ffd640 1 -- 172.21.15.5:0/494115270 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7fdd8c026400 con 0x7fdd9c0a2920 2024-08-18T21:05:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdd92ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdd92ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdd92ffd640 1 -- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c0a2920 msgr2=0x7fdd9c0a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdd92ffd640 1 --2- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c0a2920 0x7fdd9c0a2d30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c13c3d0 tx=0x7fdd8c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdd92ffd640 1 -- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c0a2920 msgr2=0x7fdd9c0a2d30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdd92ffd640 1 --2- 172.21.15.5:0/494115270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd9c0a2920 0x7fdd9c0a2d30 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c13c3d0 tx=0x7fdd8c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.799 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:01.799 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:01.799 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:01.799 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:01.799 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:01.799 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 110882, 2024-08-18T21:05:01.799 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:01.799 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:01.799 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:01.800 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:01.800 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:01.800 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:01.800 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:01.800 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:01.800 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:01.800 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:01.800 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.800 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:05:01.800 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:01.800 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:01.800 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:01.800 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.801 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.801 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.801 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.801 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.801 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.801 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.801 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.801 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.801 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.801 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.801 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.801 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:01.801 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:01.802 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.802 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.802 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.802 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.802 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.802 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.802 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.802 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.802 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.802 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.802 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.802 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.803 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:01.803 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:01.803 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:01.803 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:01.803 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:01.803 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:01.803 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:01.803 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:01.803 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:01.803 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:01.803 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:01.803 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:01.804 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:01.804 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:01.804 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:01.804 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:01.804 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:01.804 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.804 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.804 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.804 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.805 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.805 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.805 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.805 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.805 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.805 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.805 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.805 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.805 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:01.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.805 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:01.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.805 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:01.806 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:01.806 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.806 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.806 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.806 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.806 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:01.806 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.806 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.806 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.806 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:01.806 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.806 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.807 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.807 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:01.807 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:01.807 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.807 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.807 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.807 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.807 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:01.807 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:01.807 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.807 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.808 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.808 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.808 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:01.808 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.808 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.808 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.808 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:01.808 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.808 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.808 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.808 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:01.809 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:01.809 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.809 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.809 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.809 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:01.809 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:01.809 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.809 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.809 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.809 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:01.809 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.810 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.810 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:01.810 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.810 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.810 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.810 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:01.810 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:01.810 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.810 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.811 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.811 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:01.811 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:01.811 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.811 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.811 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.811 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:01.811 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.812 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.812 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:01.812 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.812 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.812 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.812 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:01.812 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:01.812 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.812 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.812 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.813 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:01.813 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:01.813 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.813 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.813 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.813 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:01.813 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.813 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.813 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:01.813 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.813 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.814 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.814 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:01.814 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:01.814 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.814 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.814 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.814 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.814 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:01.814 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:01.814 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.815 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.815 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.815 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:01.815 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.815 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.816 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:01.816 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.816 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.816 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.816 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:01.816 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:01.816 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.816 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.816 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.816 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.816 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:01.817 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:01.817 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.817 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.817 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.817 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:01.817 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.817 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.817 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:01.817 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.817 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.817 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.818 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:01.818 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:01.818 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.818 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.818 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.818 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:01.818 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:01.818 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.818 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.819 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.819 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:01.819 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.819 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.819 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:01.819 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.819 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.819 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.819 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:01.819 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:01.819 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.820 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.820 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.820 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:01.820 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:01.820 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.820 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.820 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.820 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:01.820 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.821 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:01.821 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.821 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.821 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:01.821 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:01.821 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.821 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.821 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.821 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.822 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.822 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:01.822 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:01.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.822 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:01.822 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:01.822 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:01.822 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.822 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.822 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:01.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.822 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:01.822 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:01.823 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:05:01.823 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.823 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.823 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:01.823 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdda4300640 1 -- 172.21.15.5:0/494115270 >> v2:172.21.15.157:6812/631023601 conn(0x7fdd8003bdc0 msgr2=0x7fdd8003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdda4300640 1 --2- 172.21.15.5:0/494115270 >> v2:172.21.15.157:6812/631023601 conn(0x7fdd8003bdc0 0x7fdd8003e280 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c073650 tx=0x7fdd94008040 comp rx=0 tx=0).stop 2024-08-18T21:05:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdda4300640 10 monclient: shutdown 2024-08-18T21:05:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdda4300640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdda4300640 1 -- 172.21.15.5:0/494115270 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdd9c0a1ff0 msgr2=0x7fdd9c130b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdda4300640 1 --2- 172.21.15.5:0/494115270 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdd9c0a1ff0 0x7fdd9c130b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdd9801d1b0 tx=0x7fdd980196b0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdda289d640 1 -- 172.21.15.5:0/494115270 reap_dead start 2024-08-18T21:05:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdda289d640 1 -- 172.21.15.5:0/494115270 reap_dead start 2024-08-18T21:05:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdda4300640 1 -- 172.21.15.5:0/494115270 shutdown_connections 2024-08-18T21:05:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdda4300640 1 -- 172.21.15.5:0/494115270 >> 172.21.15.5:0/494115270 conn(0x7fdd9c0a8020 msgr2=0x7fdd9c09f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdda4300640 1 -- 172.21.15.5:0/494115270 shutdown_connections 2024-08-18T21:05:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.788+0000 7fdda4300640 1 -- 172.21.15.5:0/494115270 wait complete. 2024-08-18T21:05:01.825 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:01.826 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:05:01.826 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:05:01.918 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:01.918 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28298]: starting. 2024-08-18T21:05:01.919 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28298]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28262 2024-08-18T21:05:01.919 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28298]: shutting down. 2024-08-18T21:05:01.920 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:01.920 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:01.921 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:05:01.923 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:05:01.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.940+0000 7fe6426a4640 10 monclient: get_monmap_and_config 2024-08-18T21:05:01.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.940+0000 7fe6426a4640 10 monclient: build_initial_monmap 2024-08-18T21:05:01.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.940+0000 7fe6426a4640 10 monclient: monmap: 2024-08-18T21:05:01.946 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:01.946 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.946 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:01.947939+0000 2024-08-18T21:05:01.946 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:01.947939+0000 2024-08-18T21:05:01.946 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:01.946 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.946 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:01.946 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:01.946 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:01.947 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:01.947 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:01.947 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:01.947 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:01.947 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:01.947 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:01.947 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:01.947 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:01.947 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 1 Processor -- start 2024-08-18T21:05:01.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 1 -- start start 2024-08-18T21:05:01.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 10 monclient: init 2024-08-18T21:05:01.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:01.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 10 monclient: _add_conns ranks=[0,8,2,4,3,7,6,9,1,10,5] 2024-08-18T21:05:01.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe63c0a6bd0 addr v1:172.21.15.5:6789/0 2024-08-18T21:05:01.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe63c09f080 0x7fe63c13ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 10 monclient(hunting): picked mon.noname-e con 0x7fe63c09f080 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:05:01.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe63c0a76c0 0x7fe63c141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 10 monclient(hunting): picked mon.noname-b con 0x7fe63c0a76c0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:01.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe63c0a7fb0 con 0x7fe63c0a6bd0 2024-08-18T21:05:01.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fe63c09e4c0 con 0x7fe63c0a76c0 2024-08-18T21:05:01.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fe63c06f930 con 0x7fe63c09f080 2024-08-18T21:05:01.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:01.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe6426a4640 10 monclient(hunting): authenticate will time out at 1068.961004s 2024-08-18T21:05:01.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe63c0a6bd0 0x7fe63c0a6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56806/0 (socket says 172.21.15.5:56806) 2024-08-18T21:05:01.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe63c09f080 0x7fe63c13ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63bfff640 1 -- 172.21.15.5:0/1936934335 learned_addr learned my addr 172.21.15.5:0/1936934335 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:05:01.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe640c41640 1 --2- 172.21.15.5:0/1936934335 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe63c0a76c0 0x7fe63c141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 10 monclient(hunting): get_auth_request con 0x7fe63c09f080 auth_method 0 2024-08-18T21:05:01.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe640c41640 10 monclient(hunting): get_auth_request con 0x7fe63c0a76c0 auth_method 0 2024-08-18T21:05:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe640c41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe640c41640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe640c41640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe640c41640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe640c41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe640c41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 10 monclient(hunting): handle_auth_done global_id 34154 payload 274 2024-08-18T21:05:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 1 -- 172.21.15.5:0/1936934335 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe63c0a76c0 msgr2=0x7fe63c141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 1 --2- 172.21.15.5:0/1936934335 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe63c0a76c0 0x7fe63c141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 1 -- 172.21.15.5:0/1936934335 >> v1:172.21.15.5:6789/0 conn(0x7fe63c0a6bd0 legacy=0x7fe63c0a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:01.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:05:01.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 1 monclient: found mon.noname-e 2024-08-18T21:05:01.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:01.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:05:01.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.944+0000 7fe63b7fe640 1 -- 172.21.15.5:0/1936934335 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe63c09de70 con 0x7fe63c09f080 2024-08-18T21:05:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe63b7fe640 1 -- 172.21.15.5:0/1936934335 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe63c09f080 msgr2=0x7fe63c13ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe63b7fe640 1 --2- 172.21.15.5:0/1936934335 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe63c09f080 0x7fe63c13ede0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe6300097f0 tx=0x7fe63001c430 comp rx=0 tx=0).ready entity=mon.8 client_cookie=8a1484eae9f5061c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe63affd640 1 -- 172.21.15.5:0/1936934335 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe6300b0070 con 0x7fe63c09f080 2024-08-18T21:05:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe63affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe63affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:05:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe63affd640 10 monclient: dump: 2024-08-18T21:05:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.961 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.961 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.961 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe63affd640 10 monclient: _finish_auth 0 2024-08-18T21:05:01.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe63affd640 10 monclient: _check_auth_tickets 2024-08-18T21:05:01.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe63affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:01.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe63affd640 1 -- 172.21.15.5:0/1936934335 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6300aa810 con 0x7fe63c09f080 2024-08-18T21:05:01.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 5 monclient: authenticate success, global_id 34154 2024-08-18T21:05:01.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:05:01.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe63affd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:01.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:01.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe63affd640 1 -- 172.21.15.5:0/1936934335 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe6300a9300 con 0x7fe63c09f080 2024-08-18T21:05:01.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 4 set_mon_vals no callback set 2024-08-18T21:05:01.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe63affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe63affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:05:01.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe63affd640 10 monclient: dump: 2024-08-18T21:05:01.962 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.962 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.962 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.962 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.962 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.962 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.962 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.962 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.962 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.963 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.963 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.963 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.963 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.963 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.963 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.963 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 10 monclient: shutdown 2024-08-18T21:05:01.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:01.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 1 -- 172.21.15.5:0/1936934335 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe63c09f080 msgr2=0x7fe63c13ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 1 --2- 172.21.15.5:0/1936934335 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe63c09f080 0x7fe63c13ede0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe6300097f0 tx=0x7fe63001c430 comp rx=0 tx=0).stop 2024-08-18T21:05:01.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 1 -- 172.21.15.5:0/1936934335 shutdown_connections 2024-08-18T21:05:01.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 1 --2- 172.21.15.5:0/1936934335 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe63c0a76c0 0x7fe63c141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 1 --2- 172.21.15.5:0/1936934335 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe63c09f080 0x7fe63c13ede0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 1 -- 172.21.15.5:0/1936934335 >> 172.21.15.5:0/1936934335 conn(0x7fe63c068700 msgr2=0x7fe63c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:01.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 1 -- 172.21.15.5:0/1936934335 shutdown_connections 2024-08-18T21:05:01.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 1 -- 172.21.15.5:0/1936934335 wait complete. 2024-08-18T21:05:01.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 10 monclient: build_initial_monmap 2024-08-18T21:05:01.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 10 monclient: monmap: 2024-08-18T21:05:01.964 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:01.964 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:01.964 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:01.964 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:01.965 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:01.965 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.965 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:01.965 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:01.965 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:01.965 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:01.965 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:01.965 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:01.965 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:01.965 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:01.965 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:01.965 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 1 Processor -- start 2024-08-18T21:05:01.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 1 -- start start 2024-08-18T21:05:01.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 10 monclient: init 2024-08-18T21:05:01.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:01.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 10 monclient: _add_conns ranks=[2,7,0,4,1,3,5,8,6] 2024-08-18T21:05:01.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe63c09f080 0x7fe63c128ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 10 monclient(hunting): picked mon.noname-b con 0x7fe63c09f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:01.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe63c0a6bd0 0x7fe63c13fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 10 monclient(hunting): picked mon.noname-i con 0x7fe63c0a6bd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:01.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe63c0a76c0 0x7fe63c126910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 10 monclient(hunting): picked mon.noname-a con 0x7fe63c0a76c0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:05:01.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c144210 con 0x7fe63c0a76c0 2024-08-18T21:05:01.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.948+0000 7fe6426a4640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fe63c144090 con 0x7fe63c09f080 2024-08-18T21:05:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe6426a4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe6426a4640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fe63c144390 con 0x7fe63c0a6bd0 2024-08-18T21:05:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe6426a4640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe6426a4640 10 monclient(hunting): authenticate will time out at 1068.968016s 2024-08-18T21:05:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe63bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe63c09f080 0x7fe63c128ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe63c0a76c0 0x7fe63c126910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe63c0a76c0 0x7fe63c126910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37002/0 (socket says 172.21.15.5:37002) 2024-08-18T21:05:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 1 -- 172.21.15.5:0/4201850005 learned_addr learned my addr 172.21.15.5:0/4201850005 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 10 monclient(hunting): get_auth_request con 0x7fe63c0a76c0 auth_method 0 2024-08-18T21:05:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe63bfff640 10 monclient(hunting): get_auth_request con 0x7fe63c09f080 auth_method 0 2024-08-18T21:05:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe63bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe63bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe63bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe63bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe63bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe63bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe63b7fe640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe63c0a6bd0 0x7fe63c13fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe63b7fe640 10 monclient(hunting): get_auth_request con 0x7fe63c0a6bd0 auth_method 0 2024-08-18T21:05:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe63b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe63b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe63b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 10 monclient(hunting): handle_auth_done global_id 4788 payload 824 2024-08-18T21:05:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 1 -- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe63c0a6bd0 msgr2=0x7fe63c13fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe63c0a6bd0 0x7fe63c13fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 1 -- 172.21.15.5:0/4201850005 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe63c09f080 msgr2=0x7fe63c128ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe63c09f080 0x7fe63c128ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 10 monclient: _finish_hunting 0 2024-08-18T21:05:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 1 monclient: found mon.noname-a 2024-08-18T21:05:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:05:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 1 -- 172.21.15.5:0/4201850005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe63c1d2140 con 0x7fe63c0a76c0 2024-08-18T21:05:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe63b7fe640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe63c0a6bd0 0x7fe63c13fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:05:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe63bfff640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe63c09f080 0x7fe63c128ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 1 -- 172.21.15.5:0/4201850005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe63c0a76c0 msgr2=0x7fe63c126910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe640c41640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe63c0a76c0 0x7fe63c126910 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe63400efc0 tx=0x7fe63400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe638ff9640 1 -- 172.21.15.5:0/4201850005 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe634018020 con 0x7fe63c0a76c0 2024-08-18T21:05:01.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe638ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe638ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:05:01.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe638ff9640 10 monclient: dump: 2024-08-18T21:05:01.970 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.970 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.970 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.970 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.970 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.970 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.970 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.970 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.971 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe638ff9640 10 monclient: _finish_auth 0 2024-08-18T21:05:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe638ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:05:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe638ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe6426a4640 5 monclient: authenticate success, global_id 4788 2024-08-18T21:05:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe638ff9640 1 -- 172.21.15.5:0/4201850005 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6340148f0 con 0x7fe63c0a76c0 2024-08-18T21:05:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe638ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe638ff9640 1 -- 172.21.15.5:0/4201850005 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe6340133e0 con 0x7fe63c0a76c0 2024-08-18T21:05:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe638ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe638ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:05:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe638ff9640 10 monclient: dump: 2024-08-18T21:05:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.973 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe639ffb640 4 set_mon_vals no callback set 2024-08-18T21:05:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe6426a4640 10 monclient: _renew_subs 2024-08-18T21:05:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe6426a4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:05:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe6426a4640 1 -- 172.21.15.5:0/4201850005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe63c128360 con 0x7fe63c0a76c0 2024-08-18T21:05:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe6426a4640 10 monclient: _renew_subs 2024-08-18T21:05:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe6426a4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:05:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.952+0000 7fe6426a4640 1 -- 172.21.15.5:0/4201850005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe63c0aba70 con 0x7fe63c0a76c0 2024-08-18T21:05:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe6426a4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe6426a4640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe63c140270 0x7fe63c126e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe6426a4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe6426a4640 1 -- 172.21.15.5:0/4201850005 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe63c051140 con 0x7fe63c140270 2024-08-18T21:05:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe63bfff640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe63c140270 0x7fe63c126e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe63bfff640 10 monclient: get_auth_request con 0x7fe63c140270 auth_method 0 2024-08-18T21:05:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe63bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe63bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe63bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe638ff9640 1 -- 172.21.15.5:0/4201850005 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe63401b020 con 0x7fe63c0a76c0 2024-08-18T21:05:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe63bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe63bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe63bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe638ff9640 1 --2- 172.21.15.5:0/4201850005 >> v2:172.21.15.157:6812/631023601 conn(0x7fe62803bdf0 0x7fe62803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe638ff9640 1 -- 172.21.15.5:0/4201850005 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 11..47) ==== 3506+0+0 (secure 0 0 0) 0x7fe63404eed0 con 0x7fe63c0a76c0 2024-08-18T21:05:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe63bfff640 10 monclient(hunting): handle_auth_done global_id 34142 payload 824 2024-08-18T21:05:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe63bfff640 1 -- 172.21.15.5:0/4201850005 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe63c1409d0 con 0x7fe63c140270 2024-08-18T21:05:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe63b7fe640 1 --2- 172.21.15.5:0/4201850005 >> v2:172.21.15.157:6812/631023601 conn(0x7fe62803bdf0 0x7fe62803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe63b7fe640 10 monclient: get_auth_request con 0x7fe62803bdf0 auth_method 0 2024-08-18T21:05:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe63bfff640 1 -- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe63c140270 msgr2=0x7fe63c126e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe63bfff640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe63c140270 0x7fe63c126e50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0072a0 tx=0x7fe62c007760 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe638ff9640 1 -- 172.21.15.5:0/4201850005 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe62c005d30 con 0x7fe63c140270 2024-08-18T21:05:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe638ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe638ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:05:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe638ff9640 10 monclient: dump: 2024-08-18T21:05:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.979 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.956+0000 7fe63b7fe640 1 --2- 172.21.15.5:0/4201850005 >> v2:172.21.15.157:6812/631023601 conn(0x7fe62803bdf0 0x7fe62803e2b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe63c09db50 tx=0x7fe6300a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.960+0000 7fe638ff9640 1 -- 172.21.15.5:0/4201850005 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe62c00fce0 con 0x7fe63c140270 2024-08-18T21:05:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.960+0000 7fe638ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.960+0000 7fe638ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.960+0000 7fe638ff9640 1 -- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe63c140270 msgr2=0x7fe63c126e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.960+0000 7fe638ff9640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe63c140270 0x7fe63c126e50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0072a0 tx=0x7fe62c007760 comp rx=0 tx=0).stop 2024-08-18T21:05:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.960+0000 7fe638ff9640 1 -- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe63c140270 msgr2=0x7fe63c126e50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.960+0000 7fe638ff9640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe63c140270 0x7fe63c126e50 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0072a0 tx=0x7fe62c007760 comp rx=0 tx=0).stop 2024-08-18T21:05:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.964+0000 7fe6426a4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.964+0000 7fe6426a4640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe63c12a340 0x7fe63c127390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.964+0000 7fe6426a4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.964+0000 7fe6426a4640 1 -- 172.21.15.5:0/4201850005 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe63c0a6fb0 con 0x7fe63c12a340 2024-08-18T21:05:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.964+0000 7fe63bfff640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe63c12a340 0x7fe63c127390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.964+0000 7fe63bfff640 10 monclient: get_auth_request con 0x7fe63c12a340 auth_method 0 2024-08-18T21:05:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.964+0000 7fe63bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.964+0000 7fe63bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.964+0000 7fe63bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.964+0000 7fe63bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.964+0000 7fe63bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.964+0000 7fe63bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.964+0000 7fe63bfff640 10 monclient(hunting): handle_auth_done global_id 34160 payload 824 2024-08-18T21:05:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.964+0000 7fe63bfff640 1 -- 172.21.15.5:0/4201850005 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe63c0746d0 con 0x7fe63c12a340 2024-08-18T21:05:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe63bfff640 1 -- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe63c12a340 msgr2=0x7fe63c127390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe63bfff640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe63c12a340 0x7fe63c127390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0072a0 tx=0x7fe62c004950 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe638ff9640 1 -- 172.21.15.5:0/4201850005 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe62c01ee40 con 0x7fe63c12a340 2024-08-18T21:05:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe638ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe638ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:05:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe638ff9640 10 monclient: dump: 2024-08-18T21:05:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:01.983 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe638ff9640 1 -- 172.21.15.5:0/4201850005 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9246 (secure 0 0 0) 0x7fe62c006240 con 0x7fe63c12a340 2024-08-18T21:05:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe638ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe638ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe638ff9640 1 -- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe63c12a340 msgr2=0x7fe63c127390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe638ff9640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe63c12a340 0x7fe63c127390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0072a0 tx=0x7fe62c004950 comp rx=0 tx=0).stop 2024-08-18T21:05:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe638ff9640 1 -- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe63c12a340 msgr2=0x7fe63c127390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe638ff9640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe63c12a340 0x7fe63c127390 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0072a0 tx=0x7fe62c004950 comp rx=0 tx=0).stop 2024-08-18T21:05:01.984 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:01.984 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:01.984 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:01.984 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:01.984 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:01.984 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 21763, 2024-08-18T21:05:01.984 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:01.984 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:01.984 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:01.984 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:01.984 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:01.984 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:01.985 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:01.985 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:01.985 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:01.985 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:01.985 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.985 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:05:01.985 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:01.985 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:01.985 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:01.985 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.985 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.985 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.985 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.985 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.986 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.986 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.986 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.986 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.986 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.986 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.986 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.986 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:01.986 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:01.986 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.986 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.986 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.987 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.987 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.987 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.987 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.987 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.987 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.987 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.987 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.987 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.987 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.987 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:01.987 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:01.987 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:01.987 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:01.988 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:01.988 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:01.988 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:01.988 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:01.988 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:01.988 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:01.988 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:01.988 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:01.988 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:01.988 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:01.988 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:01.988 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:01.988 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:01.989 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:01.989 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:01.989 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:01.989 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:01.989 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:01.989 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:01.989 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:01.989 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:01.989 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:01.989 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:01.989 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:01.989 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:01.989 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:01.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.990 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:01.990 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.990 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:01.990 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:01.990 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.990 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.990 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.990 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.990 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:01.990 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.990 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.991 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.991 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:01.991 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.991 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.991 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.991 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:01.991 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:01.991 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.991 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.991 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.991 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.992 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:01.992 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:01.992 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.992 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.992 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.992 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.992 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:01.992 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.992 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.992 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.992 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:01.993 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.993 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.993 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.993 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:01.993 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:01.993 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.993 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.993 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.993 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.993 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:01.993 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:01.993 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.994 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.994 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.994 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:01.994 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.994 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.994 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:01.994 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.994 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.994 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.995 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:01.995 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:01.995 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.995 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.995 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.995 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.995 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:01.995 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:01.995 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.995 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.995 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.995 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.996 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:01.996 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.996 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.996 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.996 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:01.996 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.996 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.996 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.996 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:01.996 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:01.996 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.996 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.997 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.997 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:01.997 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:01.997 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.997 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.997 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.997 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:01.997 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.997 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.998 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:01.998 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.998 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:01.998 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:01.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.998 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:01.998 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:01.998 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:01.998 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:01.998 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:01.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.998 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:01.999 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:01.999 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:01.999 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:01.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.999 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:01.999 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:01.999 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:01.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:01.999 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:01.999 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:01.999 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:01.999 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.000 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.000 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:02.000 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:02.000 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:02.000 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:02.000 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:02.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.000 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:02.000 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:02.000 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:02.000 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:02.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.001 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:02.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:02.001 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.001 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:02.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:02.001 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.001 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.001 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:02.001 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:02.001 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:02.002 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:02.002 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:02.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.002 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:02.002 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:02.002 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:02.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:02.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.002 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:02.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:02.002 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.003 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:02.003 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:02.003 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.003 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.003 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.003 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:02.003 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:02.004 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:02.004 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:02.004 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:02.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.004 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:02.004 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:02.004 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:02.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:02.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:02.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:02.004 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:02.005 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:02.005 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.005 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.005 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.005 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:02.005 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:02.005 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:02.005 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:02.005 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:02.005 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.006 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.006 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:02.006 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:02.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.006 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:02.006 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:02.006 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:02.006 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.006 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:02.006 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:02.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.006 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:02.006 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:02.007 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:02.007 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.007 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.007 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:02.007 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe6426a4640 1 -- 172.21.15.5:0/4201850005 >> v2:172.21.15.157:6812/631023601 conn(0x7fe62803bdf0 msgr2=0x7fe62803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe6426a4640 1 --2- 172.21.15.5:0/4201850005 >> v2:172.21.15.157:6812/631023601 conn(0x7fe62803bdf0 0x7fe62803e2b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe63c09db50 tx=0x7fe6300a6000 comp rx=0 tx=0).stop 2024-08-18T21:05:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe6426a4640 10 monclient: shutdown 2024-08-18T21:05:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe6426a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe6426a4640 1 -- 172.21.15.5:0/4201850005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe63c0a76c0 msgr2=0x7fe63c126910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe6426a4640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe63c0a76c0 0x7fe63c126910 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe63400efc0 tx=0x7fe63400c490 comp rx=0 tx=0).stop 2024-08-18T21:05:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe640c41640 1 -- 172.21.15.5:0/4201850005 reap_dead start 2024-08-18T21:05:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe6426a4640 1 -- 172.21.15.5:0/4201850005 shutdown_connections 2024-08-18T21:05:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe6426a4640 1 --2- 172.21.15.5:0/4201850005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe63c0a76c0 0x7fe63c126910 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe6426a4640 1 -- 172.21.15.5:0/4201850005 >> 172.21.15.5:0/4201850005 conn(0x7fe63c068700 msgr2=0x7fe63c0a5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe6426a4640 1 -- 172.21.15.5:0/4201850005 shutdown_connections 2024-08-18T21:05:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:01.968+0000 7fe6426a4640 1 -- 172.21.15.5:0/4201850005 wait complete. 2024-08-18T21:05:02.009 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:02.009 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:05:02.010 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:05:02.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 10 monclient: get_monmap_and_config 2024-08-18T21:05:02.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 10 monclient: build_initial_monmap 2024-08-18T21:05:02.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 10 monclient: monmap: 2024-08-18T21:05:02.124 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:02.124 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:02.124 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:02.125837+0000 2024-08-18T21:05:02.124 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:02.125837+0000 2024-08-18T21:05:02.124 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:02.124 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:02.124 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:02.124 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:02.124 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:02.124 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:02.124 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:02.124 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:02.124 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:02.125 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:02.125 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:02.125 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:02.125 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:02.125 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:02.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 1 Processor -- start 2024-08-18T21:05:02.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 1 -- start start 2024-08-18T21:05:02.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 10 monclient: init 2024-08-18T21:05:02.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:02.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 10 monclient: _add_conns ranks=[9,3,5,0,10,8,4,2,7,6,1] 2024-08-18T21:05:02.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f838806c950 0x7f83880a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:02.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 10 monclient(hunting): picked mon.noname-a con 0x7f838806c950 addr v2:172.21.15.5:3300/0 2024-08-18T21:05:02.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838806cd30 0x7f838806d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:02.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 10 monclient(hunting): picked mon.noname-g con 0x7f838806cd30 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:02.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8388137800 0x7f8388137cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:02.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 10 monclient(hunting): picked mon.noname-h con 0x7f8388137800 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:02.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:02.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f83880a04c0 con 0x7f838806c950 2024-08-18T21:05:02.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:02.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f83880a0970 con 0x7f838806cd30 2024-08-18T21:05:02.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:02.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f83880a0c50 con 0x7f8388137800 2024-08-18T21:05:02.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:02.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f838d3bd640 10 monclient(hunting): authenticate will time out at 1069.139713s 2024-08-18T21:05:02.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f8386ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f838806c950 0x7f83880a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:02.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f8386ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f838806c950 0x7f83880a4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37008/0 (socket says 172.21.15.5:37008) 2024-08-18T21:05:02.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f8386ffd640 1 -- 172.21.15.5:0/2479841014 learned_addr learned my addr 172.21.15.5:0/2479841014 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:02.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f8386ffd640 10 monclient(hunting): get_auth_request con 0x7f838806c950 auth_method 0 2024-08-18T21:05:02.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f8386ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f8386ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f8386ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f8386ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f8386ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.120+0000 7f8386ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.124+0000 7f8386ffd640 10 monclient(hunting): handle_auth_done global_id 4806 payload 274 2024-08-18T21:05:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.124+0000 7f8386ffd640 1 -- 172.21.15.5:0/2479841014 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8388137800 msgr2=0x7f8388137cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.124+0000 7f8386ffd640 1 --2- 172.21.15.5:0/2479841014 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8388137800 0x7f8388137cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.124+0000 7f8386ffd640 1 -- 172.21.15.5:0/2479841014 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838806cd30 msgr2=0x7f838806d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.124+0000 7f8386ffd640 1 --2- 172.21.15.5:0/2479841014 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838806cd30 0x7f838806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.124+0000 7f8386ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:05:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.124+0000 7f8386ffd640 1 monclient: found mon.noname-a 2024-08-18T21:05:02.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.124+0000 7f8386ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:02.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.124+0000 7f8386ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:05:02.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.124+0000 7f8386ffd640 1 -- 172.21.15.5:0/2479841014 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83880a1bf0 con 0x7f838806c950 2024-08-18T21:05:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f8386ffd640 1 -- 172.21.15.5:0/2479841014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838806c950 msgr2=0x7f83880a4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f8386ffd640 1 --2- 172.21.15.5:0/2479841014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838806c950 0x7f83880a4cd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8378009870 tx=0x7f837801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268d6a95826cbf9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83867fc640 1 -- 172.21.15.5:0/2479841014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f83780b1070 con 0x7f838806c950 2024-08-18T21:05:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83867fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:05:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83867fc640 10 monclient: dump: 2024-08-18T21:05:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:02.132 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83867fc640 10 monclient: _finish_auth 0 2024-08-18T21:05:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83867fc640 10 monclient: _check_auth_tickets 2024-08-18T21:05:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 5 monclient: authenticate success, global_id 4806 2024-08-18T21:05:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83867fc640 1 -- 172.21.15.5:0/2479841014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83780ab830 con 0x7f838806c950 2024-08-18T21:05:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83867fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83867fc640 1 -- 172.21.15.5:0/2479841014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f83780aa400 con 0x7f838806c950 2024-08-18T21:05:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 4 set_mon_vals no callback set 2024-08-18T21:05:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83867fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:05:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83867fc640 10 monclient: dump: 2024-08-18T21:05:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:02.134 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:02.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 10 monclient: shutdown 2024-08-18T21:05:02.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:02.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 -- 172.21.15.5:0/2479841014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838806c950 msgr2=0x7f83880a4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:02.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 --2- 172.21.15.5:0/2479841014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838806c950 0x7f83880a4cd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8378009870 tx=0x7f837801c420 comp rx=0 tx=0).stop 2024-08-18T21:05:02.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 -- 172.21.15.5:0/2479841014 shutdown_connections 2024-08-18T21:05:02.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 --2- 172.21.15.5:0/2479841014 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8388137800 0x7f8388137cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 --2- 172.21.15.5:0/2479841014 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838806cd30 0x7f838806d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 --2- 172.21.15.5:0/2479841014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838806c950 0x7f83880a4cd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 -- 172.21.15.5:0/2479841014 >> 172.21.15.5:0/2479841014 conn(0x7f83880688d0 msgr2=0x7f8388068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:02.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 -- 172.21.15.5:0/2479841014 shutdown_connections 2024-08-18T21:05:02.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 -- 172.21.15.5:0/2479841014 wait complete. 2024-08-18T21:05:02.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 10 monclient: build_initial_monmap 2024-08-18T21:05:02.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 10 monclient: monmap: 2024-08-18T21:05:02.138 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:02.138 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:02.138 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:02.138 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:02.139 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:02.139 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:02.139 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:02.139 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:02.139 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:02.139 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:02.139 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:02.139 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:02.139 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:02.139 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:02.139 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:02.139 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:02.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 Processor -- start 2024-08-18T21:05:02.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 -- start start 2024-08-18T21:05:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 10 monclient: init 2024-08-18T21:05:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 10 monclient: _add_conns ranks=[4,3,6,7,0,8,1,2,5] 2024-08-18T21:05:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f838806c950 0x7f83881d1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 10 monclient(hunting): picked mon.noname-c con 0x7f838806c950 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838806cd30 0x7f8388136830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 10 monclient(hunting): picked mon.noname-g con 0x7f838806cd30 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8388137800 0x7f8388136d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 10 monclient(hunting): picked mon.noname-d con 0x7f8388137800 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8388141480 con 0x7f838806cd30 2024-08-18T21:05:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f838809fe50 con 0x7f838806c950 2024-08-18T21:05:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f8388141600 con 0x7f8388137800 2024-08-18T21:05:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f838d3bd640 10 monclient(hunting): authenticate will time out at 1069.147158s 2024-08-18T21:05:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f8386ffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f838806c950 0x7f83881d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f8386ffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f838806c950 0x7f83881d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:40202/0 (socket says 172.21.15.5:40202) 2024-08-18T21:05:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f8386ffd640 1 -- 172.21.15.5:0/2285501052 learned_addr learned my addr 172.21.15.5:0/2285501052 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f8386ffd640 10 monclient(hunting): get_auth_request con 0x7f838806c950 auth_method 0 2024-08-18T21:05:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f8386ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f8386ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f8386ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8388137800 0x7f8388136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 10 monclient(hunting): get_auth_request con 0x7f8388137800 auth_method 0 2024-08-18T21:05:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f8386ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f8386ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f8386ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f837e7fc640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838806cd30 0x7f8388136830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f837e7fc640 10 monclient(hunting): get_auth_request con 0x7f838806cd30 auth_method 0 2024-08-18T21:05:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f837e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f837e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f837e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 10 monclient(hunting): handle_auth_done global_id 4713 payload 824 2024-08-18T21:05:02.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 1 -- 172.21.15.5:0/2285501052 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f838806c950 msgr2=0x7f83881d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:02.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f838806c950 0x7f83881d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 1 -- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838806cd30 msgr2=0x7f8388136830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:02.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838806cd30 0x7f8388136830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 10 monclient: _finish_hunting 0 2024-08-18T21:05:02.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 1 monclient: found mon.noname-d 2024-08-18T21:05:02.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:02.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:05:02.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f83877fe640 1 -- 172.21.15.5:0/2285501052 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8388121e90 con 0x7f8388137800 2024-08-18T21:05:02.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.128+0000 7f837e7fc640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838806cd30 0x7f8388136830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:05:02.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f83877fe640 1 -- 172.21.15.5:0/2285501052 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8388137800 msgr2=0x7f8388136d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:02.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f83877fe640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8388137800 0x7f8388136d70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f838000be20 tx=0x7f838000bf10 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:02.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f837ffff640 1 -- 172.21.15.5:0/2285501052 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8380019070 con 0x7f8388137800 2024-08-18T21:05:02.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f837ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:02.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f837ffff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:05:02.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f837ffff640 10 monclient: dump: 2024-08-18T21:05:02.146 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:02.148 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f837ffff640 10 monclient: _finish_auth 0 2024-08-18T21:05:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f837ffff640 10 monclient: _check_auth_tickets 2024-08-18T21:05:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f837ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f837ffff640 1 -- 172.21.15.5:0/2285501052 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83800127b0 con 0x7f8388137800 2024-08-18T21:05:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f838d3bd640 5 monclient: authenticate success, global_id 4713 2024-08-18T21:05:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f837ffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f837ffff640 1 -- 172.21.15.5:0/2285501052 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8380012dd0 con 0x7f8388137800 2024-08-18T21:05:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f837ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f837ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:05:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f8385ffb640 4 set_mon_vals no callback set 2024-08-18T21:05:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.132+0000 7f837ffff640 10 monclient: dump: 2024-08-18T21:05:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:02.150 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f838d3bd640 10 monclient: _renew_subs 2024-08-18T21:05:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f838d3bd640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f838d3bd640 1 -- 172.21.15.5:0/2285501052 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8388068ed0 con 0x7f8388137800 2024-08-18T21:05:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f838d3bd640 10 monclient: _renew_subs 2024-08-18T21:05:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f838d3bd640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f838d3bd640 1 -- 172.21.15.5:0/2285501052 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f83881229f0 con 0x7f8388137800 2024-08-18T21:05:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f837ffff640 1 -- 172.21.15.5:0/2285501052 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f8380012960 con 0x7f8388137800 2024-08-18T21:05:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f838d3bd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f838d3bd640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f83881204c0 0x7f83881208a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f838d3bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f838d3bd640 1 -- 172.21.15.5:0/2285501052 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f8388051140 con 0x7f83881204c0 2024-08-18T21:05:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f837ffff640 1 --2- 172.21.15.5:0/2285501052 >> v2:172.21.15.157:6812/631023601 conn(0x7f836803bdc0 0x7f836803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f837ffff640 1 -- 172.21.15.5:0/2285501052 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(47..47 src has 11..47) ==== 3506+0+0 (secure 0 0 0) 0x7f838004e3f0 con 0x7f8388137800 2024-08-18T21:05:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f837e7fc640 1 --2- 172.21.15.5:0/2285501052 >> v2:172.21.15.157:6812/631023601 conn(0x7f836803bdc0 0x7f836803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f837e7fc640 10 monclient: get_auth_request con 0x7f836803bdc0 auth_method 0 2024-08-18T21:05:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f8386ffd640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f83881204c0 0x7f83881208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f8386ffd640 10 monclient: get_auth_request con 0x7f83881204c0 auth_method 0 2024-08-18T21:05:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f8386ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f8386ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f8386ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f8386ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f8386ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f8386ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f8386ffd640 10 monclient(hunting): handle_auth_done global_id 4597 payload 824 2024-08-18T21:05:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.136+0000 7f8386ffd640 1 -- 172.21.15.5:0/2285501052 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83880a8cd0 con 0x7f83881204c0 2024-08-18T21:05:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.140+0000 7f837e7fc640 1 --2- 172.21.15.5:0/2285501052 >> v2:172.21.15.157:6812/631023601 conn(0x7f836803bdc0 0x7f836803e280 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8388121ba0 tx=0x7f8370008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.140+0000 7f8386ffd640 1 -- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f83881204c0 msgr2=0x7f83881208a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.140+0000 7f8386ffd640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f83881204c0 0x7f83881208a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f83780097c0 tx=0x7f837801ac60 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.140+0000 7f837ffff640 1 -- 172.21.15.5:0/2285501052 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f83780b1050 con 0x7f83881204c0 2024-08-18T21:05:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.140+0000 7f837ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.140+0000 7f837ffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:05:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.140+0000 7f837ffff640 10 monclient: dump: 2024-08-18T21:05:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:02.154 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.140+0000 7f837ffff640 1 -- 172.21.15.5:0/2285501052 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f83780b2040 con 0x7f83881204c0 2024-08-18T21:05:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.140+0000 7f837ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.140+0000 7f837ffff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.140+0000 7f837ffff640 1 -- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f83881204c0 msgr2=0x7f83881208a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.140+0000 7f837ffff640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f83881204c0 0x7f83881208a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f83780097c0 tx=0x7f837801ac60 comp rx=0 tx=0).stop 2024-08-18T21:05:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.140+0000 7f837ffff640 1 -- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f83881204c0 msgr2=0x7f83881208a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.140+0000 7f837ffff640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f83881204c0 0x7f83881208a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.148+0000 7f838d3bd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.148+0000 7f838d3bd640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8388120de0 0x7f8388070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.148+0000 7f838d3bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.148+0000 7f838d3bd640 1 -- 172.21.15.5:0/2285501052 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f838806b7e0 con 0x7f8388120de0 2024-08-18T21:05:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.148+0000 7f8386ffd640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8388120de0 0x7f8388070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.148+0000 7f8386ffd640 10 monclient: get_auth_request con 0x7f8388120de0 auth_method 0 2024-08-18T21:05:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.148+0000 7f8386ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.148+0000 7f8386ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.148+0000 7f8386ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.148+0000 7f8386ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.148+0000 7f8386ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.148+0000 7f8386ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.148+0000 7f8386ffd640 10 monclient(hunting): handle_auth_done global_id 4606 payload 824 2024-08-18T21:05:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.148+0000 7f8386ffd640 1 -- 172.21.15.5:0/2285501052 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8388122cb0 con 0x7f8388120de0 2024-08-18T21:05:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f8386ffd640 1 -- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8388120de0 msgr2=0x7f8388070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f8386ffd640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8388120de0 0x7f8388070030 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8378009870 tx=0x7f83780191c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f837ffff640 1 -- 172.21.15.5:0/2285501052 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f83780c0b90 con 0x7f8388120de0 2024-08-18T21:05:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f837ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f837ffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:05:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f837ffff640 10 monclient: dump: 2024-08-18T21:05:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:02.158 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:02.158 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:02.158 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:02.158 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:02.158 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:02.158 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:02.158 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:02.158 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:02.158 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:02.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f837ffff640 1 -- 172.21.15.5:0/2285501052 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f83780c0720 con 0x7f8388120de0 2024-08-18T21:05:02.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f837ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:02.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f837ffff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:02.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f837ffff640 1 -- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8388120de0 msgr2=0x7f8388070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:02.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f837ffff640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8388120de0 0x7f8388070030 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8378009870 tx=0x7f83780191c0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f837ffff640 1 -- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8388120de0 msgr2=0x7f8388070030 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:02.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f837ffff640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8388120de0 0x7f8388070030 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.160 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 111250, 2024-08-18T21:05:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:05:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:02.171 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:02.171 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:02.171 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:02.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.171 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:02.171 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:02.171 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:02.171 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:02.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.171 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:02.171 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:02.171 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.172 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:02.172 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:02.172 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.172 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.172 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.172 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:02.172 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:02.172 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:02.172 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:02.172 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:02.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.172 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:02.173 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:02.173 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:02.173 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:02.173 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.173 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:02.173 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:02.173 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.173 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.173 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:02.173 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:02.173 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.173 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.173 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.174 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:02.174 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:02.174 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:02.174 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:02.174 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:02.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.174 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.174 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:02.174 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:02.174 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:02.174 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:02.174 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.175 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:02.175 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:02.175 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.175 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:02.175 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:02.175 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.175 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.175 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.175 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:02.175 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:02.175 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:02.176 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:02.176 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:02.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.176 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:02.176 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:02.176 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:02.176 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:02.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.176 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:02.176 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:02.176 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.177 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:02.177 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:02.177 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.177 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.177 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.177 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:02.177 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:02.177 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:02.177 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:02.177 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:02.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.178 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:02.178 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:02.178 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:02.178 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:02.178 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.178 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:02.178 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:02.178 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.178 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.178 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:02.178 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:02.178 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.178 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:02.180 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:02.180 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.180 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:02.180 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:02.180 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:02.180 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.180 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.180 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:02.180 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:02.180 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:02.180 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:02.180 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:02.181 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.181 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.181 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:02.181 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:02.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.181 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:02.181 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:02.181 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:02.181 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.181 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:02.181 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:05:02.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.181 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:02.181 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:02.182 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:05:02.182 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.182 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:02.182 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:02.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:02.182 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:02.182 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:02.182 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:05:02.182 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:02.182 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:02.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:02.182 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:02.182 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f838d3bd640 1 -- 172.21.15.5:0/2285501052 >> v2:172.21.15.157:6812/631023601 conn(0x7f836803bdc0 msgr2=0x7f836803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f838d3bd640 1 --2- 172.21.15.5:0/2285501052 >> v2:172.21.15.157:6812/631023601 conn(0x7f836803bdc0 0x7f836803e280 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8388121ba0 tx=0x7f8370008040 comp rx=0 tx=0).stop 2024-08-18T21:05:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f838d3bd640 10 monclient: shutdown 2024-08-18T21:05:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f838d3bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f838d3bd640 1 -- 172.21.15.5:0/2285501052 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8388137800 msgr2=0x7f8388136d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f838d3bd640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8388137800 0x7f8388136d70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f838000be20 tx=0x7f838000bf10 comp rx=0 tx=0).stop 2024-08-18T21:05:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f83877fe640 1 -- 172.21.15.5:0/2285501052 reap_dead start 2024-08-18T21:05:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f838d3bd640 1 -- 172.21.15.5:0/2285501052 shutdown_connections 2024-08-18T21:05:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f838d3bd640 1 --2- 172.21.15.5:0/2285501052 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8388137800 0x7f8388136d70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f838d3bd640 1 -- 172.21.15.5:0/2285501052 >> 172.21.15.5:0/2285501052 conn(0x7f83880688d0 msgr2=0x7f838813d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f838d3bd640 1 -- 172.21.15.5:0/2285501052 shutdown_connections 2024-08-18T21:05:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.152+0000 7f838d3bd640 1 -- 172.21.15.5:0/2285501052 wait complete. 2024-08-18T21:05:02.185 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:02.185 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-18T21:05:02.185 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-18T21:05:02.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 10 monclient: get_monmap_and_config 2024-08-18T21:05:02.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 10 monclient: build_initial_monmap 2024-08-18T21:05:02.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 10 monclient: monmap: 2024-08-18T21:05:02.303 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:02.305567+0000 2024-08-18T21:05:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:02.305567+0000 2024-08-18T21:05:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:02.305 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:02.305 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:02.305 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:02.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 1 Processor -- start 2024-08-18T21:05:02.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 1 -- start start 2024-08-18T21:05:02.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 10 monclient: init 2024-08-18T21:05:02.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:02.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 10 monclient: _add_conns ranks=[7,1,3,5,9,2,4,6,0,8,10] 2024-08-18T21:05:02.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f91200a6ce0 0x7f91200a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:02.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 10 monclient(hunting): picked mon.noname-i con 0x7f91200a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:02.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f91200a7600 addr v1:172.21.15.157:6789/0 2024-08-18T21:05:02.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f912013a1b0 0x7f9120141d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:02.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 10 monclient(hunting): picked mon.noname-g con 0x7f912013a1b0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:02.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91200a45d0 con 0x7f91200a7600 2024-08-18T21:05:02.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:02.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f91200a5000 con 0x7f912013a1b0 2024-08-18T21:05:02.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:02.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f91200a32d0 con 0x7f91200a6ce0 2024-08-18T21:05:02.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:02.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f91270fa640 10 monclient(hunting): authenticate will time out at 1069.318945s 2024-08-18T21:05:02.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f911ffff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f91200a7600 0x7f9120139aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:35316/0 (socket says 172.21.15.5:35316) 2024-08-18T21:05:02.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f911ffff640 1 -- 172.21.15.5:0/2223048748 learned_addr learned my addr 172.21.15.5:0/2223048748 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:05:02.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9124e96640 1 --2- 172.21.15.5:0/2223048748 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f91200a6ce0 0x7f91200a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:02.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 1 --2- 172.21.15.5:0/2223048748 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f912013a1b0 0x7f9120141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:02.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 10 monclient(hunting): get_auth_request con 0x7f912013a1b0 auth_method 0 2024-08-18T21:05:02.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:02.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:02.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:02.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9124e96640 10 monclient(hunting): get_auth_request con 0x7f91200a6ce0 auth_method 0 2024-08-18T21:05:02.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9124e96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:02.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9124e96640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:02.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9124e96640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:02.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:02.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:02.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:02.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9124e96640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:02.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9124e96640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:02.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9124e96640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:02.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 10 monclient(hunting): handle_auth_done global_id 4683 payload 274 2024-08-18T21:05:02.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 1 -- 172.21.15.5:0/2223048748 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f91200a6ce0 msgr2=0x7f91200a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:02.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 1 --2- 172.21.15.5:0/2223048748 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f91200a6ce0 0x7f91200a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 1 -- 172.21.15.5:0/2223048748 >> v1:172.21.15.157:6789/0 conn(0x7f91200a7600 legacy=0x7f9120139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:02.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 10 monclient: _finish_hunting 0 2024-08-18T21:05:02.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 1 monclient: found mon.noname-g 2024-08-18T21:05:02.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:02.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:05:02.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9125697640 1 -- 172.21.15.5:0/2223048748 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91200a8900 con 0x7f912013a1b0 2024-08-18T21:05:02.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.300+0000 7f9124e96640 1 --2- 172.21.15.5:0/2223048748 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f91200a6ce0 0x7f91200a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:02.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f9125697640 1 -- 172.21.15.5:0/2223048748 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f912013a1b0 msgr2=0x7f9120141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:02.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f9125697640 1 --2- 172.21.15.5:0/2223048748 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f912013a1b0 0x7f9120141d00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f91100097f0 tx=0x7f911001c3a0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=7533b2b05563b8fc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:02.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f911f7fe640 1 -- 172.21.15.5:0/2223048748 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91100b0070 con 0x7f912013a1b0 2024-08-18T21:05:02.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f911f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:02.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f911f7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:05:02.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f911f7fe640 10 monclient: dump: 2024-08-18T21:05:02.313 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:02.313 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:02.313 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.313 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.313 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:02.313 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:02.313 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:02.313 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:02.313 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:02.313 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:02.313 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:02.313 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:02.313 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:02.314 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:02.314 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:02.314 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:02.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f911f7fe640 10 monclient: _finish_auth 0 2024-08-18T21:05:02.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f911f7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:05:02.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f911f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:02.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f911f7fe640 1 -- 172.21.15.5:0/2223048748 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91100aa810 con 0x7f912013a1b0 2024-08-18T21:05:02.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f911f7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:02.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f911f7fe640 1 -- 172.21.15.5:0/2223048748 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91100aae30 con 0x7f912013a1b0 2024-08-18T21:05:02.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 5 monclient: authenticate success, global_id 4683 2024-08-18T21:05:02.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:02.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 4 set_mon_vals no callback set 2024-08-18T21:05:02.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f911f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:02.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f911f7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:05:02.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f911f7fe640 10 monclient: dump: 2024-08-18T21:05:02.315 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:02.315 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:02.315 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.315 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.315 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:02.315 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:02.315 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:02.315 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:02.315 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:02.315 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:02.315 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:02.315 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:02.316 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:02.316 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:02.316 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:02.316 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:02.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 10 monclient: shutdown 2024-08-18T21:05:02.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:02.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 1 -- 172.21.15.5:0/2223048748 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f912013a1b0 msgr2=0x7f9120141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:02.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 1 --2- 172.21.15.5:0/2223048748 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f912013a1b0 0x7f9120141d00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f91100097f0 tx=0x7f911001c3a0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 1 -- 172.21.15.5:0/2223048748 shutdown_connections 2024-08-18T21:05:02.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 1 --2- 172.21.15.5:0/2223048748 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f912013a1b0 0x7f9120141d00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 1 --2- 172.21.15.5:0/2223048748 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f91200a6ce0 0x7f91200a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 1 -- 172.21.15.5:0/2223048748 >> 172.21.15.5:0/2223048748 conn(0x7f91200acbc0 msgr2=0x7f91200a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:02.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 1 -- 172.21.15.5:0/2223048748 shutdown_connections 2024-08-18T21:05:02.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 1 -- 172.21.15.5:0/2223048748 wait complete. 2024-08-18T21:05:02.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 10 monclient: build_initial_monmap 2024-08-18T21:05:02.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 10 monclient: monmap: 2024-08-18T21:05:02.321 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:02.321 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:02.323 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 1 Processor -- start 2024-08-18T21:05:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 1 -- start start 2024-08-18T21:05:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 10 monclient: init 2024-08-18T21:05:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 10 monclient: _add_conns ranks=[5,6,7,8,4,1,0,2,3] 2024-08-18T21:05:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f91200a6ce0 0x7f9120134ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 10 monclient(hunting): picked mon.noname-h con 0x7f91200a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91200a7600 0x7f9120135220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 10 monclient(hunting): picked mon.noname-d con 0x7f91200a7600 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f912013a1b0 0x7f912013aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 10 monclient(hunting): picked mon.noname-i con 0x7f912013a1b0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f91200a79e0 con 0x7f91200a6ce0 2024-08-18T21:05:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f91200a8220 con 0x7f91200a7600 2024-08-18T21:05:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f91200a20b0 con 0x7f912013a1b0 2024-08-18T21:05:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.308+0000 7f91270fa640 10 monclient(hunting): authenticate will time out at 1069.327914s 2024-08-18T21:05:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91200a7600 0x7f9120135220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91200a7600 0x7f9120135220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:60452/0 (socket says 172.21.15.5:60452) 2024-08-18T21:05:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 1 -- 172.21.15.5:0/2231250705 learned_addr learned my addr 172.21.15.5:0/2231250705 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 10 monclient(hunting): get_auth_request con 0x7f91200a7600 auth_method 0 2024-08-18T21:05:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f9124e96640 1 --2- 172.21.15.5:0/2231250705 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f91200a6ce0 0x7f9120134ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f9125697640 1 --2- 172.21.15.5:0/2231250705 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f912013a1b0 0x7f912013aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f9124e96640 10 monclient(hunting): get_auth_request con 0x7f91200a6ce0 auth_method 0 2024-08-18T21:05:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f9124e96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f9124e96640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f9124e96640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f9125697640 10 monclient(hunting): get_auth_request con 0x7f912013a1b0 auth_method 0 2024-08-18T21:05:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f9125697640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f9125697640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f9125697640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 10 monclient(hunting): handle_auth_done global_id 4722 payload 824 2024-08-18T21:05:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 1 -- 172.21.15.5:0/2231250705 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f912013a1b0 msgr2=0x7f912013aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 1 --2- 172.21.15.5:0/2231250705 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f912013a1b0 0x7f912013aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 1 -- 172.21.15.5:0/2231250705 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f91200a6ce0 msgr2=0x7f9120134ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 1 --2- 172.21.15.5:0/2231250705 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f91200a6ce0 0x7f9120134ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 10 monclient: _finish_hunting 0 2024-08-18T21:05:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 1 monclient: found mon.noname-d 2024-08-18T21:05:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:05:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 1 -- 172.21.15.5:0/2231250705 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91200a2520 con 0x7f91200a7600 2024-08-18T21:05:02.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 1 -- 172.21.15.5:0/2231250705 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91200a7600 msgr2=0x7f9120135220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:02.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911ffff640 1 --2- 172.21.15.5:0/2231250705 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91200a7600 0x7f9120135220 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f910800c4a0 tx=0x7f910800c960 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:02.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911d7fa640 1 -- 172.21.15.5:0/2231250705 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9108017070 con 0x7f91200a7600 2024-08-18T21:05:02.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:02.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911d7fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:05:02.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911d7fa640 10 monclient: dump: 2024-08-18T21:05:02.327 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:02.327 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:02.327 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.327 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.327 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:02.327 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:02.327 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:02.328 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911d7fa640 10 monclient: _finish_auth 0 2024-08-18T21:05:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911d7fa640 10 monclient: _check_auth_tickets 2024-08-18T21:05:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911d7fa640 1 -- 172.21.15.5:0/2231250705 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9108005d00 con 0x7f91200a7600 2024-08-18T21:05:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911d7fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911d7fa640 1 -- 172.21.15.5:0/2231250705 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91080074e0 con 0x7f91200a7600 2024-08-18T21:05:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f91270fa640 5 monclient: authenticate success, global_id 4722 2024-08-18T21:05:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f91270fa640 10 monclient: _renew_subs 2024-08-18T21:05:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f91270fa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f91270fa640 1 -- 172.21.15.5:0/2231250705 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f912013c130 con 0x7f91200a7600 2024-08-18T21:05:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911effd640 4 set_mon_vals no callback set 2024-08-18T21:05:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:05:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f911d7fa640 10 monclient: dump: 2024-08-18T21:05:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:02.330 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f91270fa640 10 monclient: _renew_subs 2024-08-18T21:05:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f91270fa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f91270fa640 1 -- 172.21.15.5:0/2231250705 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f9120141940 con 0x7f91200a7600 2024-08-18T21:05:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f91270fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f91270fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f91270fa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.312+0000 7f91270fa640 1 -- 172.21.15.5:0/2231250705 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f912013e220 con 0x7f91200a7600 2024-08-18T21:05:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.316+0000 7f911d7fa640 1 -- 172.21.15.5:0/2231250705 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f9108007070 con 0x7f91200a7600 2024-08-18T21:05:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.316+0000 7f911d7fa640 1 --2- 172.21.15.5:0/2231250705 >> v2:172.21.15.157:6812/631023601 conn(0x7f910403bdc0 0x7f910403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.316+0000 7f911d7fa640 1 -- 172.21.15.5:0/2231250705 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(47..47 src has 11..47) ==== 3506+0+0 (secure 0 0 0) 0x7f910804d930 con 0x7f91200a7600 2024-08-18T21:05:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.316+0000 7f9124e96640 1 --2- 172.21.15.5:0/2231250705 >> v2:172.21.15.157:6812/631023601 conn(0x7f910403bdc0 0x7f910403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.316+0000 7f9124e96640 10 monclient: get_auth_request con 0x7f910403bdc0 auth_method 0 2024-08-18T21:05:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.316+0000 7f9124e96640 1 --2- 172.21.15.5:0/2231250705 >> v2:172.21.15.157:6812/631023601 conn(0x7f910403bdc0 0x7f910403e280 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9118009bd0 tx=0x7f911800d040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.320+0000 7f911d7fa640 1 -- 172.21.15.5:0/2231250705 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f91080113a0 con 0x7f91200a7600 2024-08-18T21:05:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.320+0000 7f911d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.320+0000 7f911d7fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.552+0000 7f91270fa640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-18T21:05:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.552+0000 7f91270fa640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-18T21:05:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.552+0000 7f91270fa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.552+0000 7f91270fa640 1 -- 172.21.15.5:0/2231250705 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f91200a70c0 con 0x7f91200a7600 2024-08-18T21:05:02.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.556+0000 7f911d7fa640 1 -- 172.21.15.5:0/2231250705 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f9108011630 con 0x7f91200a7600 2024-08-18T21:05:02.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.556+0000 7f911d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-18T21:05:02.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.556+0000 7f911d7fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:02.565 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:02.565 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=10,kv=8,logm=70} crc {auth=1369989190,config=1618278320,health=1612073594,kv=4118927575,logm=376429488}) 2024-08-18T21:05:02.565 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=11,config=2,health=12,kv=10,logm=65} crc {auth=4052246136,config=1618278320,health=1074507897,kv=450215431,logm=3197740169}) 2024-08-18T21:05:02.565 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:02.565 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=10,kv=8,logm=70} crc {auth=1369989190,config=1618278320,health=1612073594,kv=4118927575,logm=376429488}) 2024-08-18T21:05:02.565 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=11,config=2,health=12,kv=10,logm=65} crc {auth=4052246136,config=1618278320,health=2571603466,kv=3664197221,logm=3815430906}) 2024-08-18T21:05:02.565 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:02.565 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=10,kv=8,logm=70} crc {auth=1369989190,config=1618278320,health=1612073594,kv=4118927575,logm=376429488}) 2024-08-18T21:05:02.565 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=9,config=2,health=12,kv=10,logm=67} crc {auth=4124308549,config=1618278320,health=1074507897,kv=3664197221,logm=1799719287}) 2024-08-18T21:05:02.565 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:02.566 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=10,kv=8,logm=70} crc {auth=1369989190,config=1618278320,health=1612073594,kv=4118927575,logm=376429488}) 2024-08-18T21:05:02.566 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=11,config=2,health=12,kv=9,logm=66} crc {auth=1419454249,config=1618278320,health=1074507897,kv=1842565136,logm=1546249707}) 2024-08-18T21:05:02.566 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:02.566 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=10,kv=8,logm=70} crc {auth=1369989190,config=1618278320,health=1612073594,kv=4118927575,logm=376429488}) 2024-08-18T21:05:02.566 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=11,config=1,health=12,kv=10,logm=66} crc {auth=4052246136,config=1228700967,health=1074507897,kv=3664197221,logm=972795226}) 2024-08-18T21:05:02.566 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:02.566 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=10,kv=8,logm=70} crc {auth=1369989190,config=1618278320,health=1612073594,kv=4118927575,logm=376429488}) 2024-08-18T21:05:02.566 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=10,config=2,health=10,kv=10,logm=68} crc {auth=845158530,config=1618278320,health=135564123,kv=3664197221,logm=3941262858}) 2024-08-18T21:05:02.566 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:02.566 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=10,kv=8,logm=70} crc {auth=1369989190,config=1618278320,health=1612073594,kv=4118927575,logm=376429488}) 2024-08-18T21:05:02.566 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=11,config=2,health=11,kv=10,logm=66} crc {auth=4052246136,config=1618278320,health=3689114337,kv=3664197221,logm=1243653172}) 2024-08-18T21:05:02.566 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:02.566 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=10,kv=8,logm=70} crc {auth=1369989190,config=1618278320,health=1612073594,kv=4118927575,logm=376429488}) 2024-08-18T21:05:02.566 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=11,config=2,health=12,kv=10,logm=65} crc {auth=4052246136,config=1618278320,health=1074507897,kv=3664197221,logm=2737947637}) 2024-08-18T21:05:02.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f91270fa640 1 -- 172.21.15.5:0/2231250705 >> v2:172.21.15.157:6812/631023601 conn(0x7f910403bdc0 msgr2=0x7f910403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:02.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f91270fa640 1 --2- 172.21.15.5:0/2231250705 >> v2:172.21.15.157:6812/631023601 conn(0x7f910403bdc0 0x7f910403e280 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9118009bd0 tx=0x7f911800d040 comp rx=0 tx=0).stop 2024-08-18T21:05:02.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f91270fa640 10 monclient: shutdown 2024-08-18T21:05:02.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f91270fa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:02.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f91270fa640 1 -- 172.21.15.5:0/2231250705 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91200a7600 msgr2=0x7f9120135220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f91270fa640 1 --2- 172.21.15.5:0/2231250705 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91200a7600 0x7f9120135220 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f910800c4a0 tx=0x7f910800c960 comp rx=0 tx=0).stop 2024-08-18T21:05:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f91270fa640 1 -- 172.21.15.5:0/2231250705 shutdown_connections 2024-08-18T21:05:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f91270fa640 1 --2- 172.21.15.5:0/2231250705 >> v2:172.21.15.157:6812/631023601 conn(0x7f910403bdc0 0x7f910403e280 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f91270fa640 1 --2- 172.21.15.5:0/2231250705 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f912013a1b0 0x7f912013aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f91270fa640 1 --2- 172.21.15.5:0/2231250705 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91200a7600 0x7f9120135220 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f91270fa640 1 --2- 172.21.15.5:0/2231250705 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f91200a6ce0 0x7f9120134ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f91270fa640 1 -- 172.21.15.5:0/2231250705 >> 172.21.15.5:0/2231250705 conn(0x7f91200acbc0 msgr2=0x7f91200aaa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f91270fa640 1 -- 172.21.15.5:0/2231250705 shutdown_connections 2024-08-18T21:05:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:02.560+0000 7f91270fa640 1 -- 172.21.15.5:0/2231250705 wait complete. 2024-08-18T21:05:02.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:02.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4264351059}) 2024-08-18T21:05:02.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=661640458}) 2024-08-18T21:05:02.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:02.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4264351059}) 2024-08-18T21:05:02.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=62607320}) 2024-08-18T21:05:02.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:02.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4264351059}) 2024-08-18T21:05:02.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3640539321}) 2024-08-18T21:05:02.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:02.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4264351059}) 2024-08-18T21:05:02.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2315443118}) 2024-08-18T21:05:02.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:02.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4264351059}) 2024-08-18T21:05:02.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1132585371}) 2024-08-18T21:05:02.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:02.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4264351059}) 2024-08-18T21:05:02.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1855521670}) 2024-08-18T21:05:02.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:02.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4264351059}) 2024-08-18T21:05:02.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2855110349}) 2024-08-18T21:05:02.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:02.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4264351059}) 2024-08-18T21:05:02.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:02.568+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=116788449}) 2024-08-18T21:05:02.585 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-18T21:05:03.152 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.152 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=737272935}) 2024-08-18T21:05:03.152 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=448952907}) 2024-08-18T21:05:03.152 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.152 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=737272935}) 2024-08-18T21:05:03.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1267230809}) 2024-08-18T21:05:03.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=737272935}) 2024-08-18T21:05:03.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3494215220}) 2024-08-18T21:05:03.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=737272935}) 2024-08-18T21:05:03.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=834814018}) 2024-08-18T21:05:03.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=737272935}) 2024-08-18T21:05:03.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3209388702}) 2024-08-18T21:05:03.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=737272935}) 2024-08-18T21:05:03.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3662196342}) 2024-08-18T21:05:03.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=737272935}) 2024-08-18T21:05:03.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2939022782}) 2024-08-18T21:05:03.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=737272935}) 2024-08-18T21:05:03.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.148+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3253803887}) 2024-08-18T21:05:03.159 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.159 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1967295594}) 2024-08-18T21:05:03.159 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3609330171}) 2024-08-18T21:05:03.159 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.159 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1967295594}) 2024-08-18T21:05:03.159 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1686430857}) 2024-08-18T21:05:03.159 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.159 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1967295594}) 2024-08-18T21:05:03.160 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1706379514}) 2024-08-18T21:05:03.160 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.160 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1967295594}) 2024-08-18T21:05:03.160 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1174458652}) 2024-08-18T21:05:03.160 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.160 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1967295594}) 2024-08-18T21:05:03.160 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2151849845}) 2024-08-18T21:05:03.160 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.160 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1967295594}) 2024-08-18T21:05:03.160 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=549594317}) 2024-08-18T21:05:03.161 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.161 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1967295594}) 2024-08-18T21:05:03.161 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3426738012}) 2024-08-18T21:05:03.161 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.161 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1967295594}) 2024-08-18T21:05:03.161 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.156+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1167868229}) 2024-08-18T21:05:03.164 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.164 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974127489}) 2024-08-18T21:05:03.164 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1953020574}) 2024-08-18T21:05:03.164 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.165 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974127489}) 2024-08-18T21:05:03.165 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2323956754}) 2024-08-18T21:05:03.165 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.165 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974127489}) 2024-08-18T21:05:03.165 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1717838718}) 2024-08-18T21:05:03.165 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.165 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974127489}) 2024-08-18T21:05:03.165 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=343203929}) 2024-08-18T21:05:03.165 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.165 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974127489}) 2024-08-18T21:05:03.165 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2002079372}) 2024-08-18T21:05:03.165 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.165 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974127489}) 2024-08-18T21:05:03.166 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4186313681}) 2024-08-18T21:05:03.166 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.166 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974127489}) 2024-08-18T21:05:03.166 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2859350553}) 2024-08-18T21:05:03.166 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.166 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974127489}) 2024-08-18T21:05:03.166 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.160+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=633415873}) 2024-08-18T21:05:03.173 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=7139758}) 2024-08-18T21:05:03.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3686646600}) 2024-08-18T21:05:03.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=7139758}) 2024-08-18T21:05:03.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3478411690}) 2024-08-18T21:05:03.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=7139758}) 2024-08-18T21:05:03.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4049697496}) 2024-08-18T21:05:03.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=7139758}) 2024-08-18T21:05:03.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2734902700}) 2024-08-18T21:05:03.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=7139758}) 2024-08-18T21:05:03.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2827224014}) 2024-08-18T21:05:03.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=7139758}) 2024-08-18T21:05:03.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3079775832}) 2024-08-18T21:05:03.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=7139758}) 2024-08-18T21:05:03.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3678964626}) 2024-08-18T21:05:03.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=7139758}) 2024-08-18T21:05:03.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.168+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1934184917}) 2024-08-18T21:05:03.180 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.172+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.180 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.172+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=14} crc {logm=3403336476,mdsmap=4274512535,mgr=4111398058,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1928900651,mon_config_key=2147202552,monmap=3438368439,osd_metadata=553867591,osd_pg_creating=3798172390,osd_snap=723727393,osdmap=3636026846}) 2024-08-18T21:05:03.180 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.172+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=43,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=2755652824,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1928900651,mon_config_key=2034131424,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3798172390,osd_snap=723727393,osdmap=1325741914}) 2024-08-18T21:05:03.180 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.172+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.180 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.172+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=14} crc {logm=3403336476,mdsmap=4274512535,mgr=4111398058,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1928900651,mon_config_key=2147202552,monmap=3438368439,osd_metadata=553867591,osd_pg_creating=3798172390,osd_snap=723727393,osdmap=3636026846}) 2024-08-18T21:05:03.180 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.172+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=43,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=7,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=14} crc {logm=1734314525,mdsmap=3086720944,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1928900651,mon_config_key=1282707525,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3798172390,osd_snap=723727393,osdmap=657759394}) 2024-08-18T21:05:03.180 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.172+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.180 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.172+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=14} crc {logm=3403336476,mdsmap=4274512535,mgr=4111398058,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1928900651,mon_config_key=2147202552,monmap=3438368439,osd_metadata=553867591,osd_pg_creating=3798172390,osd_snap=723727393,osdmap=3636026846}) 2024-08-18T21:05:03.180 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.172+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=43,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=14} crc {logm=1917879170,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=4203279597,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3798172390,osd_snap=723727393,osdmap=3648180860}) 2024-08-18T21:05:03.181 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.176+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.181 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.176+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=14} crc {logm=3403336476,mdsmap=4274512535,mgr=4111398058,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1928900651,mon_config_key=2147202552,monmap=3438368439,osd_metadata=553867591,osd_pg_creating=3798172390,osd_snap=723727393,osdmap=3636026846}) 2024-08-18T21:05:03.181 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.176+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=44,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=14} crc {logm=687360263,mdsmap=4274512535,mgr=695303193,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1928900651,mon_config_key=2147202552,monmap=3438368439,osd_metadata=3887816624,osd_pg_creating=3798172390,osd_snap=723727393,osdmap=2800816300}) 2024-08-18T21:05:03.181 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.176+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.181 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.176+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=14} crc {logm=3403336476,mdsmap=4274512535,mgr=4111398058,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1928900651,mon_config_key=2147202552,monmap=3438368439,osd_metadata=553867591,osd_pg_creating=3798172390,osd_snap=723727393,osdmap=3636026846}) 2024-08-18T21:05:03.181 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.176+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=42,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=7,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=15} crc {logm=3818410684,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1928900651,mon_config_key=1282707525,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3798172390,osd_snap=723727393,osdmap=607438081}) 2024-08-18T21:05:03.181 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.176+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.181 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.176+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=14} crc {logm=3403336476,mdsmap=4274512535,mgr=4111398058,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1928900651,mon_config_key=2147202552,monmap=3438368439,osd_metadata=553867591,osd_pg_creating=3798172390,osd_snap=723727393,osdmap=3636026846}) 2024-08-18T21:05:03.181 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.176+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=43,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=16} crc {logm=180215039,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1928900651,mon_config_key=3907713352,monmap=2014654014,osd_metadata=2816397922,osd_pg_creating=3798172390,osd_snap=723727393,osdmap=4025302338}) 2024-08-18T21:05:03.181 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.176+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.181 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.176+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=14} crc {logm=3403336476,mdsmap=4274512535,mgr=4111398058,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1928900651,mon_config_key=2147202552,monmap=3438368439,osd_metadata=553867591,osd_pg_creating=3798172390,osd_snap=723727393,osdmap=3636026846}) 2024-08-18T21:05:03.182 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.176+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=44,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=2376333337,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1928900651,mon_config_key=2147202552,monmap=2014654014,osd_metadata=2816397922,osd_pg_creating=3798172390,osd_snap=723727393,osdmap=1584722421}) 2024-08-18T21:05:03.182 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.176+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.182 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.176+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=14} crc {logm=3403336476,mdsmap=4274512535,mgr=4111398058,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1928900651,mon_config_key=2147202552,monmap=3438368439,osd_metadata=553867591,osd_pg_creating=3798172390,osd_snap=723727393,osdmap=3636026846}) 2024-08-18T21:05:03.182 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.176+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=42,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=16} crc {logm=2892319534,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1928900651,mon_config_key=1801287425,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3798172390,osd_snap=723727393,osdmap=3871156594}) 2024-08-18T21:05:03.187 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.180+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.187 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.180+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=62} crc {osdmap=3151585185}) 2024-08-18T21:05:03.187 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.180+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=57} crc {osdmap=2436160183}) 2024-08-18T21:05:03.187 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.180+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.187 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.180+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=62} crc {osdmap=3151585185}) 2024-08-18T21:05:03.187 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.180+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=61} crc {osdmap=1644139030}) 2024-08-18T21:05:03.187 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.180+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.187 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.180+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=62} crc {osdmap=3151585185}) 2024-08-18T21:05:03.187 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.180+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=55} crc {osdmap=567165445}) 2024-08-18T21:05:03.187 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.180+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.187 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.180+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=62} crc {osdmap=3151585185}) 2024-08-18T21:05:03.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.180+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=58} crc {osdmap=2379688664}) 2024-08-18T21:05:03.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.180+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.180+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=62} crc {osdmap=3151585185}) 2024-08-18T21:05:03.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.180+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=59} crc {osdmap=3088301746}) 2024-08-18T21:05:03.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.184+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.184+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=62} crc {osdmap=3151585185}) 2024-08-18T21:05:03.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.184+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=60} crc {osdmap=1326156635}) 2024-08-18T21:05:03.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.184+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.184+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=62} crc {osdmap=3151585185}) 2024-08-18T21:05:03.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.184+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=57} crc {osdmap=150601314}) 2024-08-18T21:05:03.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.184+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:05:03.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.184+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=62} crc {osdmap=3151585185}) 2024-08-18T21:05:03.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:05:03.184+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=59} crc {osdmap=1106627890}) 2024-08-18T21:05:03.587 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:05:03.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:05:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 10 monclient: get_monmap_and_config 2024-08-18T21:05:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 10 monclient: build_initial_monmap 2024-08-18T21:05:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 10 monclient: monmap: 2024-08-18T21:05:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:03.722683+0000 2024-08-18T21:05:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:03.722683+0000 2024-08-18T21:05:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:03.722 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 1 Processor -- start 2024-08-18T21:05:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 1 -- start start 2024-08-18T21:05:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 10 monclient: init 2024-08-18T21:05:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 10 monclient: _add_conns ranks=[0,3,4,7,8,6,5,10,9,2,1] 2024-08-18T21:05:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7faff00a6ce0 addr v1:172.21.15.5:6789/0 2024-08-18T21:05:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faff00a77d0 0x7faff013ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 10 monclient(hunting): picked mon.noname-g con 0x7faff00a77d0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7faff013f220 0x7faff0141610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 10 monclient(hunting): picked mon.noname-c con 0x7faff013f220 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff00a45d0 con 0x7faff00a6ce0 2024-08-18T21:05:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7faff00a5000 con 0x7faff00a77d0 2024-08-18T21:05:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7faff00a4360 con 0x7faff013f220 2024-08-18T21:05:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.716+0000 7faff60cd640 10 monclient(hunting): authenticate will time out at 1070.735889s 2024-08-18T21:05:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafef7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faff00a6ce0 0x7faff00a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56818/0 (socket says 172.21.15.5:56818) 2024-08-18T21:05:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafef7fe640 1 -- 172.21.15.5:0/3023013900 learned_addr learned my addr 172.21.15.5:0/3023013900 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:05:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 1 --2- 172.21.15.5:0/3023013900 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7faff013f220 0x7faff0141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 10 monclient(hunting): get_auth_request con 0x7faff013f220 auth_method 0 2024-08-18T21:05:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeeffd640 1 --2- 172.21.15.5:0/3023013900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faff00a77d0 0x7faff013ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeeffd640 10 monclient(hunting): get_auth_request con 0x7faff00a77d0 auth_method 0 2024-08-18T21:05:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeeffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 10 monclient(hunting): handle_auth_done global_id 4747 payload 274 2024-08-18T21:05:03.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 1 -- 172.21.15.5:0/3023013900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faff00a77d0 msgr2=0x7faff013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:03.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 1 --2- 172.21.15.5:0/3023013900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faff00a77d0 0x7faff013ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:03.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 1 -- 172.21.15.5:0/3023013900 >> v1:172.21.15.5:6789/0 conn(0x7faff00a6ce0 legacy=0x7faff00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:03.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 10 monclient: _finish_hunting 0 2024-08-18T21:05:03.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 1 monclient: found mon.noname-c 2024-08-18T21:05:03.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:03.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:05:03.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.720+0000 7fafeffff640 1 -- 172.21.15.5:0/3023013900 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff00a32d0 con 0x7faff013f220 2024-08-18T21:05:03.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeffff640 1 -- 172.21.15.5:0/3023013900 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7faff013f220 msgr2=0x7faff0141610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:03.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeffff640 1 --2- 172.21.15.5:0/3023013900 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7faff013f220 0x7faff0141610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fafe00097f0 tx=0x7fafe001c3a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=16798e78330b310a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:03.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafee7fc640 1 -- 172.21.15.5:0/3023013900 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fafe00b0070 con 0x7faff013f220 2024-08-18T21:05:03.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafee7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:05:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafee7fc640 10 monclient: dump: 2024-08-18T21:05:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:03.732 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafee7fc640 10 monclient: _finish_auth 0 2024-08-18T21:05:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafee7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:05:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafee7fc640 1 -- 172.21.15.5:0/3023013900 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe00aa810 con 0x7faff013f220 2024-08-18T21:05:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafee7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafee7fc640 1 -- 172.21.15.5:0/3023013900 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fafe00aae30 con 0x7faff013f220 2024-08-18T21:05:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 5 monclient: authenticate success, global_id 4747 2024-08-18T21:05:03.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:03.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 4 set_mon_vals no callback set 2024-08-18T21:05:03.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:03.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafee7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:03.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafee7fc640 10 monclient: dump: 2024-08-18T21:05:03.733 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:03.733 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:03.733 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:03.733 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:03.733 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:03.733 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:03.733 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:03.733 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:03.733 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:03.734 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:03.734 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:03.734 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:03.734 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:03.734 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:03.734 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:03.734 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:03.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 10 monclient: shutdown 2024-08-18T21:05:03.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:03.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 1 -- 172.21.15.5:0/3023013900 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7faff013f220 msgr2=0x7faff0141610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:03.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 1 --2- 172.21.15.5:0/3023013900 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7faff013f220 0x7faff0141610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fafe00097f0 tx=0x7fafe001c3a0 comp rx=0 tx=0).stop 2024-08-18T21:05:03.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 1 -- 172.21.15.5:0/3023013900 shutdown_connections 2024-08-18T21:05:03.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 1 --2- 172.21.15.5:0/3023013900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faff00a77d0 0x7faff013ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:03.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 1 --2- 172.21.15.5:0/3023013900 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7faff013f220 0x7faff0141610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:03.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 1 -- 172.21.15.5:0/3023013900 >> 172.21.15.5:0/3023013900 conn(0x7faff00acbc0 msgr2=0x7faff00a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:03.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 1 -- 172.21.15.5:0/3023013900 shutdown_connections 2024-08-18T21:05:03.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 1 -- 172.21.15.5:0/3023013900 wait complete. 2024-08-18T21:05:03.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 10 monclient: build_initial_monmap 2024-08-18T21:05:03.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 10 monclient: monmap: 2024-08-18T21:05:03.735 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:03.735 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:03.735 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:03.735 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:03.735 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:03.735 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:03.735 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:03.736 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:03.736 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:03.736 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:03.736 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:03.736 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:03.736 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:03.736 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:03.736 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:03.736 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:03.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 1 Processor -- start 2024-08-18T21:05:03.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 1 -- start start 2024-08-18T21:05:03.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 10 monclient: init 2024-08-18T21:05:03.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:03.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 10 monclient: _add_conns ranks=[8,2,7,3,5,0,1,4,6] 2024-08-18T21:05:03.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7faff00a6ce0 0x7faff01398e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:03.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 10 monclient(hunting): picked mon.noname-e con 0x7faff00a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:05:03.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faff00a77d0 0x7faff00a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:03.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 10 monclient(hunting): picked mon.noname-b con 0x7faff00a77d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:03.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7faff013f220 0x7faff00a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:03.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 10 monclient(hunting): picked mon.noname-i con 0x7faff013f220 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:03.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:03.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7faff00a83a0 con 0x7faff00a77d0 2024-08-18T21:05:03.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:03.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7faff00a8220 con 0x7faff013f220 2024-08-18T21:05:03.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:03.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7faff0144370 con 0x7faff00a6ce0 2024-08-18T21:05:03.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:03.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7faff60cd640 10 monclient(hunting): authenticate will time out at 1070.743037s 2024-08-18T21:05:03.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafef7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7faff00a6ce0 0x7faff01398e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:03.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafef7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7faff00a6ce0 0x7faff01398e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:49620/0 (socket says 172.21.15.5:49620) 2024-08-18T21:05:03.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafef7fe640 1 -- 172.21.15.5:0/1283992106 learned_addr learned my addr 172.21.15.5:0/1283992106 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:03.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafef7fe640 10 monclient(hunting): get_auth_request con 0x7faff00a6ce0 auth_method 0 2024-08-18T21:05:03.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faff00a77d0 0x7faff00a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:03.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:03.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:03.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:03.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 10 monclient(hunting): get_auth_request con 0x7faff00a77d0 auth_method 0 2024-08-18T21:05:03.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:03.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:03.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:03.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:03.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:03.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:03.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeffff640 1 --2- 172.21.15.5:0/1283992106 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7faff013f220 0x7faff00a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeffff640 10 monclient(hunting): get_auth_request con 0x7faff013f220 auth_method 0 2024-08-18T21:05:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 10 monclient(hunting): handle_auth_done global_id 4790 payload 824 2024-08-18T21:05:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 1 -- 172.21.15.5:0/1283992106 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7faff00a6ce0 msgr2=0x7faff01398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 1 --2- 172.21.15.5:0/1283992106 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7faff00a6ce0 0x7faff01398e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 1 -- 172.21.15.5:0/1283992106 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7faff013f220 msgr2=0x7faff00a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 1 --2- 172.21.15.5:0/1283992106 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7faff013f220 0x7faff00a0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 10 monclient: _finish_hunting 0 2024-08-18T21:05:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 1 monclient: found mon.noname-b 2024-08-18T21:05:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:03.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:03.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeeffd640 1 -- 172.21.15.5:0/1283992106 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff0122f40 con 0x7faff00a77d0 2024-08-18T21:05:03.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafeffff640 1 --2- 172.21.15.5:0/1283992106 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7faff013f220 0x7faff00a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:05:03.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.724+0000 7fafef7fe640 1 --2- 172.21.15.5:0/1283992106 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7faff00a6ce0 0x7faff01398e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:03.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafeeffd640 1 -- 172.21.15.5:0/1283992106 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faff00a77d0 msgr2=0x7faff00a0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafeeffd640 1 --2- 172.21.15.5:0/1283992106 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faff00a77d0 0x7faff00a0710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fafe8007e90 tx=0x7fafe800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafe7fff640 1 -- 172.21.15.5:0/1283992106 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fafe8014890 con 0x7faff00a77d0 2024-08-18T21:05:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafe7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafe7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafe7fff640 10 monclient: dump: 2024-08-18T21:05:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:03.743 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafe7fff640 10 monclient: _finish_auth 0 2024-08-18T21:05:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafe7fff640 10 monclient: _check_auth_tickets 2024-08-18T21:05:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafe7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafe7fff640 1 -- 172.21.15.5:0/1283992106 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe8019070 con 0x7faff00a77d0 2024-08-18T21:05:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafe7fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:03.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafe7fff640 1 -- 172.21.15.5:0/1283992106 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fafe8013380 con 0x7faff00a77d0 2024-08-18T21:05:03.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafe7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:03.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafe7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:03.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafedffb640 4 set_mon_vals no callback set 2024-08-18T21:05:03.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafe7fff640 10 monclient: dump: 2024-08-18T21:05:03.744 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:03.744 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:03.744 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:03.744 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:03.744 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:03.744 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:03.744 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:03.744 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:03.744 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:03.745 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7faff60cd640 5 monclient: authenticate success, global_id 4790 2024-08-18T21:05:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7faff60cd640 10 monclient: _renew_subs 2024-08-18T21:05:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7faff60cd640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7faff60cd640 1 -- 172.21.15.5:0/1283992106 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff0124090 con 0x7faff00a77d0 2024-08-18T21:05:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7faff60cd640 10 monclient: _renew_subs 2024-08-18T21:05:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7faff60cd640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7faff60cd640 1 -- 172.21.15.5:0/1283992106 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faff0141280 con 0x7faff00a77d0 2024-08-18T21:05:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7faff60cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7faff60cd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7faff60cd640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7faff60cd640 1 -- 172.21.15.5:0/1283992106 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faff0140d50 con 0x7faff00a77d0 2024-08-18T21:05:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafe7fff640 1 -- 172.21.15.5:0/1283992106 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fafe8014420 con 0x7faff00a77d0 2024-08-18T21:05:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafe7fff640 1 --2- 172.21.15.5:0/1283992106 >> v2:172.21.15.157:6812/631023601 conn(0x7fafd003bdf0 0x7fafd003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafe7fff640 1 -- 172.21.15.5:0/1283992106 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(48..48 src has 11..48) ==== 3898+0+0 (secure 0 0 0) 0x7fafe804ec30 con 0x7faff00a77d0 2024-08-18T21:05:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafef7fe640 1 --2- 172.21.15.5:0/1283992106 >> v2:172.21.15.157:6812/631023601 conn(0x7fafd003bdf0 0x7fafd003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.728+0000 7fafef7fe640 10 monclient: get_auth_request con 0x7fafd003bdf0 auth_method 0 2024-08-18T21:05:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.732+0000 7fafef7fe640 1 --2- 172.21.15.5:0/1283992106 >> v2:172.21.15.157:6812/631023601 conn(0x7fafd003bdf0 0x7fafd003e2b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fafd8007d60 tx=0x7fafd8007cb0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.736+0000 7fafe7fff640 1 -- 172.21.15.5:0/1283992106 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fafe8023020 con 0x7faff00a77d0 2024-08-18T21:05:03.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.736+0000 7fafe7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:03.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.736+0000 7fafe7fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.972+0000 7faff60cd640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:05:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.972+0000 7faff60cd640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:05:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.972+0000 7faff60cd640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.972+0000 7faff60cd640 1 -- 172.21.15.5:0/1283992106 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7faff00a70c0 con 0x7faff00a77d0 2024-08-18T21:05:03.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.972+0000 7fafe7fff640 1 -- 172.21.15.5:0/1283992106 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3172 (secure 0 0 0) 0x7fafe8014d00 con 0x7faff00a77d0 2024-08-18T21:05:03.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.972+0000 7fafe7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:05:03.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.972+0000 7fafe7fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:03.977 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":30,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:05:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.976+0000 7faff60cd640 1 -- 172.21.15.5:0/1283992106 >> v2:172.21.15.157:6812/631023601 conn(0x7fafd003bdf0 msgr2=0x7fafd003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.976+0000 7faff60cd640 1 --2- 172.21.15.5:0/1283992106 >> v2:172.21.15.157:6812/631023601 conn(0x7fafd003bdf0 0x7fafd003e2b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fafd8007d60 tx=0x7fafd8007cb0 comp rx=0 tx=0).stop 2024-08-18T21:05:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.976+0000 7faff60cd640 10 monclient: shutdown 2024-08-18T21:05:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.976+0000 7faff60cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.976+0000 7faff60cd640 1 -- 172.21.15.5:0/1283992106 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faff00a77d0 msgr2=0x7faff00a0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.976+0000 7faff60cd640 1 --2- 172.21.15.5:0/1283992106 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faff00a77d0 0x7faff00a0710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fafe8007e90 tx=0x7fafe800e4b0 comp rx=0 tx=0).stop 2024-08-18T21:05:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.976+0000 7faff60cd640 1 -- 172.21.15.5:0/1283992106 shutdown_connections 2024-08-18T21:05:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.976+0000 7faff60cd640 1 --2- 172.21.15.5:0/1283992106 >> v2:172.21.15.157:6812/631023601 conn(0x7fafd003bdf0 0x7fafd003e2b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.976+0000 7faff60cd640 1 --2- 172.21.15.5:0/1283992106 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7faff013f220 0x7faff00a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.976+0000 7faff60cd640 1 --2- 172.21.15.5:0/1283992106 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faff00a77d0 0x7faff00a0710 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.976+0000 7faff60cd640 1 --2- 172.21.15.5:0/1283992106 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7faff00a6ce0 0x7faff01398e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.976+0000 7faff60cd640 1 -- 172.21.15.5:0/1283992106 >> 172.21.15.5:0/1283992106 conn(0x7faff00acbc0 msgr2=0x7faff013ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.976+0000 7faff60cd640 1 -- 172.21.15.5:0/1283992106 shutdown_connections 2024-08-18T21:05:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:03.976+0000 7faff60cd640 1 -- 172.21.15.5:0/1283992106 wait complete. 2024-08-18T21:05:03.996 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:05:03.996 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-18T21:05:03.996 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:05:03.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:05:04.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 10 monclient: get_monmap_and_config 2024-08-18T21:05:04.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 10 monclient: build_initial_monmap 2024-08-18T21:05:04.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 10 monclient: monmap: 2024-08-18T21:05:04.126 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:04.127 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.127 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:04.128527+0000 2024-08-18T21:05:04.127 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:04.128527+0000 2024-08-18T21:05:04.127 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:04.127 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.127 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:04.127 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:04.127 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:04.127 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:04.127 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:04.127 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:04.127 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:04.127 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:04.128 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:04.128 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:04.128 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:04.128 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 1 Processor -- start 2024-08-18T21:05:04.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 1 -- start start 2024-08-18T21:05:04.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 10 monclient: init 2024-08-18T21:05:04.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:04.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 10 monclient: _add_conns ranks=[2,0,10,9,8,4,1,3,7,6,5] 2024-08-18T21:05:04.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f29240a5a50 0x7f29240a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 10 monclient(hunting): picked mon.noname-b con 0x7f29240a5a50 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:04.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f29240a6370 addr v1:172.21.15.5:6789/0 2024-08-18T21:05:04.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f292413a300 0x7f2924141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 10 monclient(hunting): picked mon.noname-f con 0x7f292413a300 addr v2:172.21.15.157:3300/0 2024-08-18T21:05:04.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f292406e660 con 0x7f29240a6370 2024-08-18T21:05:04.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f292406df10 con 0x7f292413a300 2024-08-18T21:05:04.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f292406e320 con 0x7f29240a5a50 2024-08-18T21:05:04.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:04.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f292ac99640 10 monclient(hunting): authenticate will time out at 1071.141695s 2024-08-18T21:05:04.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f29240a5a50 0x7f29240a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2923fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f29240a6370 0x7f2924139bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51406/0 (socket says 172.21.15.5:51406) 2024-08-18T21:05:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f29240a5a50 0x7f29240a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:46010/0 (socket says 172.21.15.5:46010) 2024-08-18T21:05:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2923fff640 1 -- 172.21.15.5:0/2517424880 learned_addr learned my addr 172.21.15.5:0/2517424880 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:05:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 10 monclient(hunting): get_auth_request con 0x7f29240a5a50 auth_method 0 2024-08-18T21:05:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2929236640 1 --2- 172.21.15.5:0/2517424880 >> v2:172.21.15.157:3300/0 conn(0x7f292413a300 0x7f2924141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2929236640 10 monclient(hunting): get_auth_request con 0x7f292413a300 auth_method 0 2024-08-18T21:05:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2929236640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2929236640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2929236640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2929236640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2929236640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2929236640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 10 monclient(hunting): handle_auth_done global_id 4799 payload 274 2024-08-18T21:05:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 1 -- 172.21.15.5:0/2517424880 >> v2:172.21.15.157:3300/0 conn(0x7f292413a300 msgr2=0x7f2924141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 1 --2- 172.21.15.5:0/2517424880 >> v2:172.21.15.157:3300/0 conn(0x7f292413a300 0x7f2924141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 1 -- 172.21.15.5:0/2517424880 >> v1:172.21.15.5:6789/0 conn(0x7f29240a6370 legacy=0x7f2924139bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 10 monclient: _finish_hunting 0 2024-08-18T21:05:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 1 monclient: found mon.noname-b 2024-08-18T21:05:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.124+0000 7f2928a35640 1 -- 172.21.15.5:0/2517424880 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292406f670 con 0x7f29240a5a50 2024-08-18T21:05:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f2928a35640 1 -- 172.21.15.5:0/2517424880 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f29240a5a50 msgr2=0x7f29240a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f2928a35640 1 --2- 172.21.15.5:0/2517424880 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f29240a5a50 0x7f29240a5e30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f291c0097c0 tx=0x7f291c01c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c6c39c738da3963 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f29237fe640 1 -- 172.21.15.5:0/2517424880 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f291c0b0070 con 0x7f29240a5a50 2024-08-18T21:05:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f29237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f29237fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f29237fe640 10 monclient: dump: 2024-08-18T21:05:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.138 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f29237fe640 10 monclient: _finish_auth 0 2024-08-18T21:05:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f29237fe640 10 monclient: _check_auth_tickets 2024-08-18T21:05:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f29237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f29237fe640 1 -- 172.21.15.5:0/2517424880 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f291c0aa810 con 0x7f29240a5a50 2024-08-18T21:05:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f292ac99640 5 monclient: authenticate success, global_id 4799 2024-08-18T21:05:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f292ac99640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:05:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f29237fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f29237fe640 1 -- 172.21.15.5:0/2517424880 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f291c0aae30 con 0x7f29240a5a50 2024-08-18T21:05:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f29237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f29237fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f29237fe640 10 monclient: dump: 2024-08-18T21:05:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.140 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f292ac99640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f292ac99640 4 set_mon_vals no callback set 2024-08-18T21:05:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f292ac99640 10 monclient: shutdown 2024-08-18T21:05:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f292ac99640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f292ac99640 1 -- 172.21.15.5:0/2517424880 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f29240a5a50 msgr2=0x7f29240a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f292ac99640 1 --2- 172.21.15.5:0/2517424880 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f29240a5a50 0x7f29240a5e30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f291c0097c0 tx=0x7f291c01c360 comp rx=0 tx=0).stop 2024-08-18T21:05:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f292ac99640 1 -- 172.21.15.5:0/2517424880 shutdown_connections 2024-08-18T21:05:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f292ac99640 1 --2- 172.21.15.5:0/2517424880 >> v2:172.21.15.157:3300/0 conn(0x7f292413a300 0x7f2924141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f292ac99640 1 --2- 172.21.15.5:0/2517424880 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f29240a5a50 0x7f29240a5e30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f292ac99640 1 -- 172.21.15.5:0/2517424880 >> 172.21.15.5:0/2517424880 conn(0x7f29240aa700 msgr2=0x7f29240a6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f292ac99640 1 -- 172.21.15.5:0/2517424880 shutdown_connections 2024-08-18T21:05:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.128+0000 7f292ac99640 1 -- 172.21.15.5:0/2517424880 wait complete. 2024-08-18T21:05:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 10 monclient: build_initial_monmap 2024-08-18T21:05:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 10 monclient: monmap: 2024-08-18T21:05:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:04.142 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 1 Processor -- start 2024-08-18T21:05:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 1 -- start start 2024-08-18T21:05:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 10 monclient: init 2024-08-18T21:05:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 10 monclient: _add_conns ranks=[2,8,5,3,6,0,1,7,4] 2024-08-18T21:05:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f29240a5a50 0x7f2924136000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 10 monclient(hunting): picked mon.noname-b con 0x7f29240a5a50 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f29240a6370 0x7f2924136540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 10 monclient(hunting): picked mon.noname-e con 0x7f29240a6370 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:05:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f292413a300 0x7f292413ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 10 monclient(hunting): picked mon.noname-h con 0x7f292413a300 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f29240a2340 con 0x7f29240a5a50 2024-08-18T21:05:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f29240a21c0 con 0x7f292413a300 2024-08-18T21:05:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f2924144c20 con 0x7f29240a6370 2024-08-18T21:05:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f292ac99640 10 monclient(hunting): authenticate will time out at 1071.149465s 2024-08-18T21:05:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f29240a5a50 0x7f2924136000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f29240a5a50 0x7f2924136000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:46024/0 (socket says 172.21.15.5:46024) 2024-08-18T21:05:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 1 -- 172.21.15.5:0/2716471483 learned_addr learned my addr 172.21.15.5:0/2716471483 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2923fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f29240a6370 0x7f2924136540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 10 monclient(hunting): get_auth_request con 0x7f29240a5a50 auth_method 0 2024-08-18T21:05:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2923fff640 10 monclient(hunting): get_auth_request con 0x7f29240a6370 auth_method 0 2024-08-18T21:05:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2923fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2923fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2923fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2929236640 1 --2- 172.21.15.5:0/2716471483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f292413a300 0x7f292413ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2923fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2923fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2923fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2929236640 10 monclient(hunting): get_auth_request con 0x7f292413a300 auth_method 0 2024-08-18T21:05:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2929236640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2929236640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2929236640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 10 monclient(hunting): handle_auth_done global_id 4808 payload 824 2024-08-18T21:05:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 1 -- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f29240a6370 msgr2=0x7f2924136540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 1 --2- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f29240a6370 0x7f2924136540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 1 -- 172.21.15.5:0/2716471483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f292413a300 msgr2=0x7f292413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 1 --2- 172.21.15.5:0/2716471483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f292413a300 0x7f292413ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 10 monclient: _finish_hunting 0 2024-08-18T21:05:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 1 monclient: found mon.noname-b 2024-08-18T21:05:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:04.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.132+0000 7f2928a35640 1 -- 172.21.15.5:0/2716471483 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292413d8e0 con 0x7f29240a5a50 2024-08-18T21:05:04.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f2928a35640 1 -- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f29240a5a50 msgr2=0x7f2924136000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f2928a35640 1 --2- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f29240a5a50 0x7f2924136000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f291c0ae040 tx=0x7f291c019100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f29217fa640 1 -- 172.21.15.5:0/2716471483 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f291c0b0040 con 0x7f29240a5a50 2024-08-18T21:05:04.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f29217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f29217fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f29217fa640 10 monclient: dump: 2024-08-18T21:05:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.150 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f29217fa640 10 monclient: _finish_auth 0 2024-08-18T21:05:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f29217fa640 10 monclient: _check_auth_tickets 2024-08-18T21:05:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f29217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f292ac99640 5 monclient: authenticate success, global_id 4808 2024-08-18T21:05:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f29217fa640 1 -- 172.21.15.5:0/2716471483 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f291c0044b0 con 0x7f29240a5a50 2024-08-18T21:05:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f29217fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f292ac99640 10 monclient: _renew_subs 2024-08-18T21:05:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f29217fa640 1 -- 172.21.15.5:0/2716471483 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f291c003a90 con 0x7f29240a5a50 2024-08-18T21:05:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f292ac99640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f292ac99640 1 -- 172.21.15.5:0/2716471483 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29240a9550 con 0x7f29240a5a50 2024-08-18T21:05:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f2922ffd640 4 set_mon_vals no callback set 2024-08-18T21:05:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f29217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f29217fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f29217fa640 10 monclient: dump: 2024-08-18T21:05:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.152 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f292ac99640 10 monclient: _renew_subs 2024-08-18T21:05:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f292ac99640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f292ac99640 1 -- 172.21.15.5:0/2716471483 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f29240a9a60 con 0x7f29240a5a50 2024-08-18T21:05:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f292ac99640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f292ac99640 1 --2- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f292413b1b0 0x7f292413b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f292ac99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f292ac99640 1 -- 172.21.15.5:0/2716471483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2924051140 con 0x7f292413b1b0 2024-08-18T21:05:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f2923fff640 1 --2- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f292413b1b0 0x7f292413b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f2923fff640 10 monclient: get_auth_request con 0x7f292413b1b0 auth_method 0 2024-08-18T21:05:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f2923fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f2923fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f2923fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f29217fa640 1 -- 172.21.15.5:0/2716471483 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f291c003c50 con 0x7f29240a5a50 2024-08-18T21:05:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f2923fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f2923fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f2923fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f2923fff640 10 monclient(hunting): handle_auth_done global_id 4815 payload 824 2024-08-18T21:05:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f2923fff640 1 -- 172.21.15.5:0/2716471483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2924136a80 con 0x7f292413b1b0 2024-08-18T21:05:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f29217fa640 1 --2- 172.21.15.5:0/2716471483 >> v2:172.21.15.157:6812/631023601 conn(0x7f290403bdc0 0x7f290403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f29217fa640 1 -- 172.21.15.5:0/2716471483 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(48..48 src has 11..48) ==== 3898+0+0 (secure 0 0 0) 0x7f291c0e7ff0 con 0x7f29240a5a50 2024-08-18T21:05:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f2929236640 1 --2- 172.21.15.5:0/2716471483 >> v2:172.21.15.157:6812/631023601 conn(0x7f290403bdc0 0x7f290403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.136+0000 7f2929236640 10 monclient: get_auth_request con 0x7f290403bdc0 auth_method 0 2024-08-18T21:05:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.140+0000 7f2923fff640 1 -- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f292413b1b0 msgr2=0x7f292413b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.140+0000 7f2923fff640 1 --2- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f292413b1b0 0x7f292413b590 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f29240a7b80 tx=0x7f290c00eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.140+0000 7f29217fa640 1 -- 172.21.15.5:0/2716471483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f290c00ccb0 con 0x7f292413b1b0 2024-08-18T21:05:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.140+0000 7f29217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.140+0000 7f29217fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:05:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.140+0000 7f29217fa640 10 monclient: dump: 2024-08-18T21:05:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.155 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.140+0000 7f29217fa640 1 -- 172.21.15.5:0/2716471483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f290c019070 con 0x7f292413b1b0 2024-08-18T21:05:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.140+0000 7f29217fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.140+0000 7f29217fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.140+0000 7f29217fa640 1 -- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f292413b1b0 msgr2=0x7f292413b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.140+0000 7f29217fa640 1 --2- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f292413b1b0 0x7f292413b590 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f29240a7b80 tx=0x7f290c00eb30 comp rx=0 tx=0).stop 2024-08-18T21:05:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.140+0000 7f29217fa640 1 -- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f292413b1b0 msgr2=0x7f292413b590 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.140+0000 7f29217fa640 1 --2- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f292413b1b0 0x7f292413b590 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.140+0000 7f2929236640 1 --2- 172.21.15.5:0/2716471483 >> v2:172.21.15.157:6812/631023601 conn(0x7f290403bdc0 0x7f290403e280 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f29140073f0 tx=0x7f291400b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.144+0000 7f292ac99640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.144+0000 7f292ac99640 1 --2- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2924071250 0x7f2924071660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.144+0000 7f292ac99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.144+0000 7f292ac99640 1 -- 172.21.15.5:0/2716471483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f292413bad0 con 0x7f2924071250 2024-08-18T21:05:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.144+0000 7f2923fff640 1 --2- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2924071250 0x7f2924071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.144+0000 7f2923fff640 10 monclient: get_auth_request con 0x7f2924071250 auth_method 0 2024-08-18T21:05:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.144+0000 7f2923fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.144+0000 7f2923fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.144+0000 7f2923fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.144+0000 7f2923fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.144+0000 7f2923fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.144+0000 7f2923fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.144+0000 7f2923fff640 10 monclient(hunting): handle_auth_done global_id 4824 payload 824 2024-08-18T21:05:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.144+0000 7f2923fff640 1 -- 172.21.15.5:0/2716471483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f292413d1b0 con 0x7f2924071250 2024-08-18T21:05:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f2923fff640 1 -- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2924071250 msgr2=0x7f2924071660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f2923fff640 1 --2- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2924071250 0x7f2924071660 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f290c007930 tx=0x7f290c004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f29217fa640 1 -- 172.21.15.5:0/2716471483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f290c024070 con 0x7f2924071250 2024-08-18T21:05:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f29217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f29217fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:05:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f29217fa640 10 monclient: dump: 2024-08-18T21:05:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.160 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f29217fa640 1 -- 172.21.15.5:0/2716471483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9416 (secure 0 0 0) 0x7f290c014480 con 0x7f2924071250 2024-08-18T21:05:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f29217fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f29217fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f29217fa640 1 -- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2924071250 msgr2=0x7f2924071660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f29217fa640 1 --2- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2924071250 0x7f2924071660 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f290c007930 tx=0x7f290c004950 comp rx=0 tx=0).stop 2024-08-18T21:05:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f29217fa640 1 -- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2924071250 msgr2=0x7f2924071660 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f29217fa640 1 --2- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2924071250 0x7f2924071660 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f290c007930 tx=0x7f290c004950 comp rx=0 tx=0).stop 2024-08-18T21:05:04.161 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:04.161 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:04.161 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:04.161 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:05:04.161 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:04.161 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 113270, 2024-08-18T21:05:04.161 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:04.161 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:04.162 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:04.162 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:04.162 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:04.162 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:04.162 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:04.162 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:04.162 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:04.162 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:04.162 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.162 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:05:04.162 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:04.162 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:04.162 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:04.163 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:04.163 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:04.163 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:04.163 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:04.163 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:04.163 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:04.163 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:04.163 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:04.163 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:04.163 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:04.163 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:04.163 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.163 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:04.163 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:04.163 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:04.164 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:04.164 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:04.164 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:04.164 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:04.164 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:04.164 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:04.164 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:04.164 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:04.164 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:04.164 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:04.164 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.164 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:04.164 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:04.165 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:04.165 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:04.165 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:04.165 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:04.165 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:04.165 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:04.165 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:04.165 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:04.165 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:04.165 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:04.165 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:04.165 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:04.165 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:04.166 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:04.166 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:04.166 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:04.166 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:04.166 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:04.166 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:04.166 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:04.166 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:04.166 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:04.166 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:04.166 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:04.166 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:04.167 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:04.167 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.167 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:04.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.167 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:04.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.167 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:04.167 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:04.167 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.167 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.167 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.167 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:04.168 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.168 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.168 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:04.168 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.168 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.168 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.168 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:04.168 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:04.168 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.168 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.169 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.169 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:04.169 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:04.169 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.169 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.169 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.169 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:04.169 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.169 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.169 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:04.170 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.170 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.170 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.170 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:04.170 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:04.170 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.170 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.170 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.170 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:04.170 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:04.171 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.171 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.171 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.171 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:04.171 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.171 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.171 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:04.171 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.171 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.171 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.171 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:04.172 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:04.172 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.172 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.172 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.172 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:04.172 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:04.172 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.172 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.172 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.172 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:04.172 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.173 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.173 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.173 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:04.173 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.173 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.173 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.173 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:04.173 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:04.173 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.173 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.173 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.174 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.174 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:04.174 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:04.174 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.174 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.174 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.174 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.174 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:04.174 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.174 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.174 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.176 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.176 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.176 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:04.176 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.176 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.176 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:04.176 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.176 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.176 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.176 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:04.177 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:04.177 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.177 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.177 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.177 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:04.177 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:04.177 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.177 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.177 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.177 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:04.178 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.178 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.178 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.178 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:04.178 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.178 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.178 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.178 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:04.178 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:04.178 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.178 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.179 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.179 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:04.179 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:04.179 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.179 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.179 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.179 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:04.179 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.179 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.179 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:04.180 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.180 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.180 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.180 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:04.180 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:04.180 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.180 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.180 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.180 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:04.180 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:04.181 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.181 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.181 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.181 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:04.181 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.181 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.181 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:04.181 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.181 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.181 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:04.182 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:04.182 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.182 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.182 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.182 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.182 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.182 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:04.182 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:04.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.182 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:04.182 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:04.183 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:04.183 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.183 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.183 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:04.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.183 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:04.183 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:04.183 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:05:04.183 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.183 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.183 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:05:04.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.183 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:04.183 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:04.183 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:04.184 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.184 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.184 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:04.184 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f292ac99640 1 -- 172.21.15.5:0/2716471483 >> v2:172.21.15.157:6812/631023601 conn(0x7f290403bdc0 msgr2=0x7f290403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f292ac99640 1 --2- 172.21.15.5:0/2716471483 >> v2:172.21.15.157:6812/631023601 conn(0x7f290403bdc0 0x7f290403e280 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f29140073f0 tx=0x7f291400b040 comp rx=0 tx=0).stop 2024-08-18T21:05:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f292ac99640 10 monclient: shutdown 2024-08-18T21:05:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f292ac99640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f292ac99640 1 -- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f29240a5a50 msgr2=0x7f2924136000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f292ac99640 1 --2- 172.21.15.5:0/2716471483 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f29240a5a50 0x7f2924136000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f291c0ae040 tx=0x7f291c019100 comp rx=0 tx=0).stop 2024-08-18T21:05:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f2929236640 1 -- 172.21.15.5:0/2716471483 reap_dead start 2024-08-18T21:05:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f2929236640 1 -- 172.21.15.5:0/2716471483 reap_dead start 2024-08-18T21:05:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f292ac99640 1 -- 172.21.15.5:0/2716471483 shutdown_connections 2024-08-18T21:05:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f292ac99640 1 -- 172.21.15.5:0/2716471483 >> 172.21.15.5:0/2716471483 conn(0x7f29240aa700 msgr2=0x7f292409fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f292ac99640 1 -- 172.21.15.5:0/2716471483 shutdown_connections 2024-08-18T21:05:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.148+0000 7f292ac99640 1 -- 172.21.15.5:0/2716471483 wait complete. 2024-08-18T21:05:04.186 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:04.186 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:05:04.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:05:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 10 monclient: get_monmap_and_config 2024-08-18T21:05:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 10 monclient: build_initial_monmap 2024-08-18T21:05:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 10 monclient: monmap: 2024-08-18T21:05:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:04.306101+0000 2024-08-18T21:05:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:04.306101+0000 2024-08-18T21:05:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:04.305 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 1 Processor -- start 2024-08-18T21:05:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 1 -- start start 2024-08-18T21:05:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 10 monclient: init 2024-08-18T21:05:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 10 monclient: _add_conns ranks=[3,10,5,0,1,4,9,7,6,8,2] 2024-08-18T21:05:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb690073ad0 0x7fb690136700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 10 monclient(hunting): picked mon.noname-g con 0x7fb690073ad0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb690073eb0 0x7fb6900a4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 10 monclient(hunting): picked mon.noname-f con 0x7fb690073eb0 addr v2:172.21.15.157:3300/0 2024-08-18T21:05:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb6900742f0 0x7fb6900a4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 10 monclient(hunting): picked mon.noname-h con 0x7fb6900742f0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb6900a2260 con 0x7fb690073eb0 2024-08-18T21:05:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb69006fab0 con 0x7fb690073ad0 2024-08-18T21:05:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fb69006fd90 con 0x7fb6900742f0 2024-08-18T21:05:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb6960fb640 10 monclient(hunting): authenticate will time out at 1071.319371s 2024-08-18T21:05:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb68effd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb690073eb0 0x7fb6900a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb68effd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb690073eb0 0x7fb6900a4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:60234/0 (socket says 172.21.15.5:60234) 2024-08-18T21:05:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb68effd640 1 -- 172.21.15.5:0/3014265591 learned_addr learned my addr 172.21.15.5:0/3014265591 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb68effd640 10 monclient(hunting): get_auth_request con 0x7fb690073eb0 auth_method 0 2024-08-18T21:05:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb68effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb68effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb68effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb68ffff640 1 --2- 172.21.15.5:0/3014265591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb6900742f0 0x7fb6900a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb68ffff640 10 monclient(hunting): get_auth_request con 0x7fb6900742f0 auth_method 0 2024-08-18T21:05:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb68ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb68ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb68ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.300+0000 7fb68f7fe640 1 --2- 172.21.15.5:0/3014265591 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb690073ad0 0x7fb690136700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68f7fe640 10 monclient(hunting): get_auth_request con 0x7fb690073ad0 auth_method 0 2024-08-18T21:05:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68effd640 10 monclient(hunting): handle_auth_done global_id 4600 payload 274 2024-08-18T21:05:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68effd640 1 -- 172.21.15.5:0/3014265591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb6900742f0 msgr2=0x7fb6900a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68effd640 1 --2- 172.21.15.5:0/3014265591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb6900742f0 0x7fb6900a4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68effd640 1 -- 172.21.15.5:0/3014265591 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb690073ad0 msgr2=0x7fb690136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68effd640 1 --2- 172.21.15.5:0/3014265591 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb690073ad0 0x7fb690136700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68effd640 10 monclient: _finish_hunting 0 2024-08-18T21:05:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68effd640 1 monclient: found mon.noname-f 2024-08-18T21:05:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68effd640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:05:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68effd640 1 -- 172.21.15.5:0/3014265591 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb690068b00 con 0x7fb690073eb0 2024-08-18T21:05:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.304+0000 7fb68f7fe640 1 --2- 172.21.15.5:0/3014265591 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb690073ad0 0x7fb690136700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb68effd640 1 -- 172.21.15.5:0/3014265591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb690073eb0 msgr2=0x7fb6900a4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb68effd640 1 --2- 172.21.15.5:0/3014265591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb690073eb0 0x7fb6900a4210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb684009870 tx=0x7fb68401c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=835179fb26fb05cc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb68e7fc640 1 -- 172.21.15.5:0/3014265591 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb6840b0070 con 0x7fb690073eb0 2024-08-18T21:05:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb68e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb68e7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:05:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb68e7fc640 10 monclient: dump: 2024-08-18T21:05:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.314 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb68e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:05:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb68e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:05:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb68e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb68e7fc640 1 -- 172.21.15.5:0/3014265591 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6840aa810 con 0x7fb690073eb0 2024-08-18T21:05:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb68e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb68e7fc640 1 -- 172.21.15.5:0/3014265591 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb6840aae30 con 0x7fb690073eb0 2024-08-18T21:05:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 5 monclient: authenticate success, global_id 4600 2024-08-18T21:05:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 4 set_mon_vals no callback set 2024-08-18T21:05:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb68e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb68e7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:05:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb68e7fc640 10 monclient: dump: 2024-08-18T21:05:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.316 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 10 monclient: shutdown 2024-08-18T21:05:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 1 -- 172.21.15.5:0/3014265591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb690073eb0 msgr2=0x7fb6900a4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 1 --2- 172.21.15.5:0/3014265591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb690073eb0 0x7fb6900a4210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb684009870 tx=0x7fb68401c420 comp rx=0 tx=0).stop 2024-08-18T21:05:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 1 -- 172.21.15.5:0/3014265591 shutdown_connections 2024-08-18T21:05:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 1 --2- 172.21.15.5:0/3014265591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb6900742f0 0x7fb6900a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 1 --2- 172.21.15.5:0/3014265591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb690073eb0 0x7fb6900a4210 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 1 --2- 172.21.15.5:0/3014265591 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb690073ad0 0x7fb690136700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 1 -- 172.21.15.5:0/3014265591 >> 172.21.15.5:0/3014265591 conn(0x7fb6900a9000 msgr2=0x7fb6900a5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 1 -- 172.21.15.5:0/3014265591 shutdown_connections 2024-08-18T21:05:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 1 -- 172.21.15.5:0/3014265591 wait complete. 2024-08-18T21:05:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 10 monclient: build_initial_monmap 2024-08-18T21:05:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 10 monclient: monmap: 2024-08-18T21:05:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:04.324 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 1 Processor -- start 2024-08-18T21:05:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 1 -- start start 2024-08-18T21:05:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.308+0000 7fb6960fb640 10 monclient: init 2024-08-18T21:05:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 10 monclient: _add_conns ranks=[3,1,6,4,0,8,2,7,5] 2024-08-18T21:05:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb690073ad0 0x7fb6901d1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 10 monclient(hunting): picked mon.noname-g con 0x7fb690073ad0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb690073eb0 0x7fb69013f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 10 monclient(hunting): picked mon.noname-f con 0x7fb690073eb0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:05:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb6900742f0 0x7fb69013fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 10 monclient(hunting): picked mon.noname-d con 0x7fb6900742f0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb690143500 con 0x7fb690073eb0 2024-08-18T21:05:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb6900a50a0 con 0x7fb690073ad0 2024-08-18T21:05:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fb690143680 con 0x7fb6900742f0 2024-08-18T21:05:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 10 monclient(hunting): authenticate will time out at 1071.328293s 2024-08-18T21:05:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb6900742f0 0x7fb69013fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb6900742f0 0x7fb69013fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:36108/0 (socket says 172.21.15.5:36108) 2024-08-18T21:05:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 1 -- 172.21.15.5:0/3345235373 learned_addr learned my addr 172.21.15.5:0/3345235373 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 10 monclient(hunting): get_auth_request con 0x7fb6900742f0 auth_method 0 2024-08-18T21:05:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68f7fe640 1 --2- 172.21.15.5:0/3345235373 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb690073ad0 0x7fb6901d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68effd640 1 --2- 172.21.15.5:0/3345235373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb690073eb0 0x7fb69013f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68f7fe640 10 monclient(hunting): get_auth_request con 0x7fb690073ad0 auth_method 0 2024-08-18T21:05:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68effd640 10 monclient(hunting): get_auth_request con 0x7fb690073eb0 auth_method 0 2024-08-18T21:05:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 10 monclient(hunting): handle_auth_done global_id 4731 payload 824 2024-08-18T21:05:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 1 -- 172.21.15.5:0/3345235373 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb690073ad0 msgr2=0x7fb6901d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 1 --2- 172.21.15.5:0/3345235373 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb690073ad0 0x7fb6901d1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 1 -- 172.21.15.5:0/3345235373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb690073eb0 msgr2=0x7fb69013f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 1 --2- 172.21.15.5:0/3345235373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb690073eb0 0x7fb69013f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 10 monclient: _finish_hunting 0 2024-08-18T21:05:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 1 monclient: found mon.noname-d 2024-08-18T21:05:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:05:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 1 -- 172.21.15.5:0/3345235373 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6901d1ea0 con 0x7fb6900742f0 2024-08-18T21:05:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 1 -- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb6900742f0 msgr2=0x7fb69013fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68ffff640 1 --2- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb6900742f0 0x7fb69013fb60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb6901d2070 tx=0x7fb68800c490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb677fff640 1 -- 172.21.15.5:0/3345235373 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb688018020 con 0x7fb6900742f0 2024-08-18T21:05:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb677fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb677fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:05:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb677fff640 10 monclient: dump: 2024-08-18T21:05:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.329 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb677fff640 10 monclient: _finish_auth 0 2024-08-18T21:05:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb677fff640 10 monclient: _check_auth_tickets 2024-08-18T21:05:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb677fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 5 monclient: authenticate success, global_id 4731 2024-08-18T21:05:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb677fff640 1 -- 172.21.15.5:0/3345235373 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6880148f0 con 0x7fb6900742f0 2024-08-18T21:05:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb677fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 10 monclient: _renew_subs 2024-08-18T21:05:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb677fff640 1 -- 172.21.15.5:0/3345235373 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb6880133e0 con 0x7fb6900742f0 2024-08-18T21:05:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 1 -- 172.21.15.5:0/3345235373 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6901352a0 con 0x7fb6900742f0 2024-08-18T21:05:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb677fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb68d7fa640 4 set_mon_vals no callback set 2024-08-18T21:05:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb677fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:05:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb677fff640 10 monclient: dump: 2024-08-18T21:05:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.332 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 10 monclient: _renew_subs 2024-08-18T21:05:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.312+0000 7fb6960fb640 1 -- 172.21.15.5:0/3345235373 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fb69013b830 con 0x7fb6900742f0 2024-08-18T21:05:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb6960fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb6960fb640 1 --2- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb69013bbd0 0x7fb690138c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb6960fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb6960fb640 1 -- 172.21.15.5:0/3345235373 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fb690051140 con 0x7fb69013bbd0 2024-08-18T21:05:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb68f7fe640 1 --2- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb69013bbd0 0x7fb690138c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb68f7fe640 10 monclient: get_auth_request con 0x7fb69013bbd0 auth_method 0 2024-08-18T21:05:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb68f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb68f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb68f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb677fff640 1 -- 172.21.15.5:0/3345235373 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fb68801b020 con 0x7fb6900742f0 2024-08-18T21:05:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb68f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb68f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb68f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb68f7fe640 10 monclient(hunting): handle_auth_done global_id 4817 payload 824 2024-08-18T21:05:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb677fff640 1 --2- 172.21.15.5:0/3345235373 >> v2:172.21.15.157:6812/631023601 conn(0x7fb67c03bdc0 0x7fb67c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb68f7fe640 1 -- 172.21.15.5:0/3345235373 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb690135b90 con 0x7fb69013bbd0 2024-08-18T21:05:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb677fff640 1 -- 172.21.15.5:0/3345235373 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(48..48 src has 11..48) ==== 3898+0+0 (secure 0 0 0) 0x7fb68804f050 con 0x7fb6900742f0 2024-08-18T21:05:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb68effd640 1 --2- 172.21.15.5:0/3345235373 >> v2:172.21.15.157:6812/631023601 conn(0x7fb67c03bdc0 0x7fb67c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb68effd640 10 monclient: get_auth_request con 0x7fb67c03bdc0 auth_method 0 2024-08-18T21:05:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb68f7fe640 1 -- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb69013bbd0 msgr2=0x7fb690138c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb68f7fe640 1 --2- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb69013bbd0 0x7fb690138c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb680011600 tx=0x7fb680011ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb677fff640 1 -- 172.21.15.5:0/3345235373 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb68000fea0 con 0x7fb69013bbd0 2024-08-18T21:05:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb677fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb677fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb677fff640 10 monclient: dump: 2024-08-18T21:05:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.335 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb677fff640 1 -- 172.21.15.5:0/3345235373 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb68000fa30 con 0x7fb69013bbd0 2024-08-18T21:05:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb677fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb677fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb677fff640 1 -- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb69013bbd0 msgr2=0x7fb690138c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb677fff640 1 --2- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb69013bbd0 0x7fb690138c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb680011600 tx=0x7fb680011ac0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb677fff640 1 -- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb69013bbd0 msgr2=0x7fb690138c20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.316+0000 7fb677fff640 1 --2- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb69013bbd0 0x7fb690138c20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.320+0000 7fb68effd640 1 --2- 172.21.15.5:0/3345235373 >> v2:172.21.15.157:6812/631023601 conn(0x7fb67c03bdc0 0x7fb67c03e280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb6840ab000 tx=0x7fb6840a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.324+0000 7fb6960fb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.324+0000 7fb6960fb640 1 --2- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb69002d1d0 0x7fb69002d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.324+0000 7fb6960fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.324+0000 7fb6960fb640 1 -- 172.21.15.5:0/3345235373 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fb690069fa0 con 0x7fb69002d1d0 2024-08-18T21:05:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.324+0000 7fb68f7fe640 1 --2- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb69002d1d0 0x7fb69002d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.324+0000 7fb68f7fe640 10 monclient: get_auth_request con 0x7fb69002d1d0 auth_method 0 2024-08-18T21:05:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.324+0000 7fb68f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.324+0000 7fb68f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.324+0000 7fb68f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.324+0000 7fb68f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.324+0000 7fb68f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.324+0000 7fb68f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.324+0000 7fb68f7fe640 10 monclient(hunting): handle_auth_done global_id 4826 payload 824 2024-08-18T21:05:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.324+0000 7fb68f7fe640 1 -- 172.21.15.5:0/3345235373 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb690136700 con 0x7fb69002d1d0 2024-08-18T21:05:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb68f7fe640 1 -- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb69002d1d0 msgr2=0x7fb69002d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb68f7fe640 1 --2- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb69002d1d0 0x7fb69002d5e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb680011600 tx=0x7fb6800046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb677fff640 1 -- 172.21.15.5:0/3345235373 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb680004470 con 0x7fb69002d1d0 2024-08-18T21:05:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb677fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb677fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb677fff640 10 monclient: dump: 2024-08-18T21:05:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.340 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb677fff640 1 -- 172.21.15.5:0/3345235373 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7fb680026070 con 0x7fb69002d1d0 2024-08-18T21:05:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb677fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb677fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb677fff640 1 -- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb69002d1d0 msgr2=0x7fb69002d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb677fff640 1 --2- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb69002d1d0 0x7fb69002d5e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb680011600 tx=0x7fb6800046d0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb677fff640 1 -- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb69002d1d0 msgr2=0x7fb69002d5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb677fff640 1 --2- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb69002d1d0 0x7fb69002d5e0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb680011600 tx=0x7fb6800046d0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.341 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:04.341 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:04.341 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:04.341 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:04.341 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:04.341 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 113442, 2024-08-18T21:05:04.341 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:04.341 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:04.341 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:04.341 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:04.341 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:04.341 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:04.341 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:04.342 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:04.342 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:04.342 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:04.342 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.342 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:05:04.342 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:04.342 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:04.342 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:04.342 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:04.342 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:04.342 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:04.342 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:04.342 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:04.343 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:04.343 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:04.343 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:04.343 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:04.343 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:04.343 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:04.343 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.343 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:04.343 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:04.343 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:04.343 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:04.343 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:04.343 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:04.343 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:04.344 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:04.344 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:04.344 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:04.344 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:04.344 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:04.344 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:04.344 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.344 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:04.344 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:04.344 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:04.344 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:04.344 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:04.344 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:04.345 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:04.345 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:04.345 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:04.345 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:04.345 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:04.345 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:04.345 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:04.345 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:04.345 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:04.345 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:04.345 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:04.345 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:04.345 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:04.345 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:04.346 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:04.346 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:04.346 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:04.346 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:04.346 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:04.346 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:04.346 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:04.346 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:04.346 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.346 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:04.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.346 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:04.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.347 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:04.347 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:04.347 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.347 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.347 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.347 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:04.347 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.347 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.347 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:04.347 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.348 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.348 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.348 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:04.348 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:04.348 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.348 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.348 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.348 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:04.348 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:04.348 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.348 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.349 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.349 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:04.349 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.349 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.349 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:04.349 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.349 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.349 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.349 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:04.349 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:04.350 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.350 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.350 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.350 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:04.350 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:04.350 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.350 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.350 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.350 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:04.350 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.351 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.351 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:04.351 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.351 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.351 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.351 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:04.351 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:04.351 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.351 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.351 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.351 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:04.352 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:04.352 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.352 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.352 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.352 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:04.352 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.352 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.352 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:04.352 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.352 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.352 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.353 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:04.353 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:04.353 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.353 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.353 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.353 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.353 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:04.353 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:04.353 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.353 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.353 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.353 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.354 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:04.354 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.354 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.354 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:04.354 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.354 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.354 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.354 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:04.354 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:04.354 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.355 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.355 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.355 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:04.355 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:04.355 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.355 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.355 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.355 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:04.355 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.356 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.356 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:04.356 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.356 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.356 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.356 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:04.356 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:04.356 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.356 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.356 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.356 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.357 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:04.357 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:04.357 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.357 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.357 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.357 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.357 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:04.357 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.357 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.357 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.357 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:04.357 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.358 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.358 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.358 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:04.358 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:04.358 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.358 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.358 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.358 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.358 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:04.358 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:04.358 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.359 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.359 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.359 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.359 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:04.359 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.359 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.359 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.359 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:04.359 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.359 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.359 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.360 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:04.360 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:04.360 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.360 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.360 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.360 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.360 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:04.360 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:04.360 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.360 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.360 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.360 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.361 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:04.361 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.361 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.361 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.361 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:04.361 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.361 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.361 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.361 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:04.361 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:04.361 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.361 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.361 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.362 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.362 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.362 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:04.362 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:04.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.362 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:04.362 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:04.362 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:04.362 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.362 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.362 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:05:04.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.363 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:04.363 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:04.363 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:05:04.363 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.363 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.363 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:04.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.363 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:04.363 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:04.363 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:04.363 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.363 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.364 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:04.364 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb6960fb640 1 -- 172.21.15.5:0/3345235373 >> v2:172.21.15.157:6812/631023601 conn(0x7fb67c03bdc0 msgr2=0x7fb67c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb6960fb640 1 --2- 172.21.15.5:0/3345235373 >> v2:172.21.15.157:6812/631023601 conn(0x7fb67c03bdc0 0x7fb67c03e280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb6840ab000 tx=0x7fb6840a6000 comp rx=0 tx=0).stop 2024-08-18T21:05:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb6960fb640 10 monclient: shutdown 2024-08-18T21:05:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb6960fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb6960fb640 1 -- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb6900742f0 msgr2=0x7fb69013fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb6960fb640 1 --2- 172.21.15.5:0/3345235373 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb6900742f0 0x7fb69013fb60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb6901d2070 tx=0x7fb68800c490 comp rx=0 tx=0).stop 2024-08-18T21:05:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb68ffff640 1 -- 172.21.15.5:0/3345235373 reap_dead start 2024-08-18T21:05:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb68ffff640 1 -- 172.21.15.5:0/3345235373 reap_dead start 2024-08-18T21:05:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb6960fb640 1 -- 172.21.15.5:0/3345235373 shutdown_connections 2024-08-18T21:05:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb6960fb640 1 -- 172.21.15.5:0/3345235373 >> 172.21.15.5:0/3345235373 conn(0x7fb6900a9000 msgr2=0x7fb690070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb6960fb640 1 -- 172.21.15.5:0/3345235373 shutdown_connections 2024-08-18T21:05:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.328+0000 7fb6960fb640 1 -- 172.21.15.5:0/3345235373 wait complete. 2024-08-18T21:05:04.366 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:04.367 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:05:04.367 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:05:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 10 monclient: get_monmap_and_config 2024-08-18T21:05:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 10 monclient: build_initial_monmap 2024-08-18T21:05:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 10 monclient: monmap: 2024-08-18T21:05:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:04.485600+0000 2024-08-18T21:05:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:04.485600+0000 2024-08-18T21:05:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:04.485 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 1 Processor -- start 2024-08-18T21:05:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 1 -- start start 2024-08-18T21:05:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 10 monclient: init 2024-08-18T21:05:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 10 monclient: _add_conns ranks=[3,2,1,4,7,8,0,9,5,6,10] 2024-08-18T21:05:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78480a6ce0 0x7f78480a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 10 monclient(hunting): picked mon.noname-g con 0x7f78480a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f78480a7600 0x7f7848139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 10 monclient(hunting): picked mon.noname-b con 0x7f78480a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7848139fe0 addr v1:172.21.15.157:6789/0 2024-08-18T21:05:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78480a45d0 con 0x7f7848139fe0 2024-08-18T21:05:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f78480a5000 con 0x7f78480a7600 2024-08-18T21:05:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f78480a32d0 con 0x7f78480a6ce0 2024-08-18T21:05:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f78504ee640 10 monclient(hunting): authenticate will time out at 1071.499264s 2024-08-18T21:05:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f78480a7600 0x7f7848139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f78480a7600 0x7f7848139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:46052/0 (socket says 172.21.15.5:46052) 2024-08-18T21:05:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 1 -- 172.21.15.5:0/1582476490 learned_addr learned my addr 172.21.15.5:0/1582476490 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 10 monclient(hunting): get_auth_request con 0x7f78480a7600 auth_method 0 2024-08-18T21:05:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784e28a640 1 --2- 172.21.15.5:0/1582476490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78480a6ce0 0x7f78480a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784e28a640 10 monclient(hunting): get_auth_request con 0x7f78480a6ce0 auth_method 0 2024-08-18T21:05:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784e28a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784e28a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784e28a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 10 monclient(hunting): handle_auth_done global_id 4835 payload 274 2024-08-18T21:05:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 1 -- 172.21.15.5:0/1582476490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78480a6ce0 msgr2=0x7f78480a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 1 --2- 172.21.15.5:0/1582476490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78480a6ce0 0x7f78480a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 1 -- 172.21.15.5:0/1582476490 >> v1:172.21.15.157:6789/0 conn(0x7f7848139fe0 legacy=0x7f7848140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 10 monclient: _finish_hunting 0 2024-08-18T21:05:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 1 monclient: found mon.noname-b 2024-08-18T21:05:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784da89640 1 -- 172.21.15.5:0/1582476490 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78480a8900 con 0x7f78480a7600 2024-08-18T21:05:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.480+0000 7f784e28a640 1 --2- 172.21.15.5:0/1582476490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78480a6ce0 0x7f78480a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:05:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f784da89640 1 -- 172.21.15.5:0/1582476490 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f78480a7600 msgr2=0x7f7848139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f784da89640 1 --2- 172.21.15.5:0/1582476490 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f78480a7600 0x7f7848139aa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f78380098a0 tx=0x7f783801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc712c7ce27da19e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f784d288640 1 -- 172.21.15.5:0/1582476490 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f78380b2070 con 0x7f78480a7600 2024-08-18T21:05:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f784d288640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f784d288640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f784d288640 10 monclient: dump: 2024-08-18T21:05:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.493 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f784d288640 10 monclient: _finish_auth 0 2024-08-18T21:05:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f784d288640 10 monclient: _check_auth_tickets 2024-08-18T21:05:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f784d288640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f784d288640 1 -- 172.21.15.5:0/1582476490 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78380a9070 con 0x7f78480a7600 2024-08-18T21:05:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f784d288640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f784d288640 1 -- 172.21.15.5:0/1582476490 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f78380abc40 con 0x7f78480a7600 2024-08-18T21:05:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 5 monclient: authenticate success, global_id 4835 2024-08-18T21:05:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 4 set_mon_vals no callback set 2024-08-18T21:05:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f784d288640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f784d288640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f784d288640 10 monclient: dump: 2024-08-18T21:05:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.496 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 10 monclient: shutdown 2024-08-18T21:05:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 1 -- 172.21.15.5:0/1582476490 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f78480a7600 msgr2=0x7f7848139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 1 --2- 172.21.15.5:0/1582476490 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f78480a7600 0x7f7848139aa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f78380098a0 tx=0x7f783801c440 comp rx=0 tx=0).stop 2024-08-18T21:05:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 1 -- 172.21.15.5:0/1582476490 shutdown_connections 2024-08-18T21:05:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 1 --2- 172.21.15.5:0/1582476490 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f78480a7600 0x7f7848139aa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 1 --2- 172.21.15.5:0/1582476490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78480a6ce0 0x7f78480a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 1 -- 172.21.15.5:0/1582476490 >> 172.21.15.5:0/1582476490 conn(0x7f78480acbc0 msgr2=0x7f78480a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 1 -- 172.21.15.5:0/1582476490 shutdown_connections 2024-08-18T21:05:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 1 -- 172.21.15.5:0/1582476490 wait complete. 2024-08-18T21:05:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 10 monclient: build_initial_monmap 2024-08-18T21:05:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 10 monclient: monmap: 2024-08-18T21:05:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:04.503 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 1 Processor -- start 2024-08-18T21:05:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 1 -- start start 2024-08-18T21:05:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 10 monclient: init 2024-08-18T21:05:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 10 monclient: _add_conns ranks=[4,5,6,3,2,7,1,0,8] 2024-08-18T21:05:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78480a6ce0 0x7f784813b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 10 monclient(hunting): picked mon.noname-c con 0x7f78480a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f78480a7600 0x7f784813b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 10 monclient(hunting): picked mon.noname-h con 0x7f78480a7600 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7848139fe0 0x7f784813be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.488+0000 7f78504ee640 10 monclient(hunting): picked mon.noname-d con 0x7f7848139fe0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f78480a79e0 con 0x7f78480a6ce0 2024-08-18T21:05:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f78480a9810 con 0x7f78480a7600 2024-08-18T21:05:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f784813f630 con 0x7f7848139fe0 2024-08-18T21:05:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 10 monclient(hunting): authenticate will time out at 1071.508029s 2024-08-18T21:05:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784e28a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78480a6ce0 0x7f784813b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7848139fe0 0x7f784813be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7848139fe0 0x7f784813be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:36122/0 (socket says 172.21.15.5:36122) 2024-08-18T21:05:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 1 -- 172.21.15.5:0/3824360718 learned_addr learned my addr 172.21.15.5:0/3824360718 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 10 monclient(hunting): get_auth_request con 0x7f7848139fe0 auth_method 0 2024-08-18T21:05:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784e28a640 10 monclient(hunting): get_auth_request con 0x7f78480a6ce0 auth_method 0 2024-08-18T21:05:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784e28a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784e28a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784e28a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784e28a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784e28a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784e28a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784da89640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f78480a7600 0x7f784813b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784da89640 10 monclient(hunting): get_auth_request con 0x7f78480a7600 auth_method 0 2024-08-18T21:05:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784da89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784da89640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784da89640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 10 monclient(hunting): handle_auth_done global_id 4740 payload 824 2024-08-18T21:05:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 1 -- 172.21.15.5:0/3824360718 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f78480a7600 msgr2=0x7f784813b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f78480a7600 0x7f784813b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 1 -- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78480a6ce0 msgr2=0x7f784813b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78480a6ce0 0x7f784813b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 10 monclient: _finish_hunting 0 2024-08-18T21:05:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 1 monclient: found mon.noname-d 2024-08-18T21:05:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:05:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 1 -- 172.21.15.5:0/3824360718 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7848142130 con 0x7f7848139fe0 2024-08-18T21:05:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784e28a640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78480a6ce0 0x7f784813b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784da89640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f78480a7600 0x7f784813b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:05:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 1 -- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7848139fe0 msgr2=0x7f784813be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ea8b640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7848139fe0 0x7f784813be30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f784000b410 tx=0x7f784000b8d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f783effd640 1 -- 172.21.15.5:0/3824360718 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7840015020 con 0x7f7848139fe0 2024-08-18T21:05:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f783effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f783effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:05:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f783effd640 10 monclient: dump: 2024-08-18T21:05:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.509 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f783effd640 10 monclient: _finish_auth 0 2024-08-18T21:05:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f783effd640 10 monclient: _check_auth_tickets 2024-08-18T21:05:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f783effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f783effd640 1 -- 172.21.15.5:0/3824360718 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7840011cb0 con 0x7f7848139fe0 2024-08-18T21:05:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f783effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f783effd640 1 -- 172.21.15.5:0/3824360718 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7840011e60 con 0x7f7848139fe0 2024-08-18T21:05:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f783effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f783effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:05:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f783effd640 10 monclient: dump: 2024-08-18T21:05:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.511 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f784ca87640 4 set_mon_vals no callback set 2024-08-18T21:05:04.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 5 monclient: authenticate success, global_id 4740 2024-08-18T21:05:04.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 10 monclient: _renew_subs 2024-08-18T21:05:04.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:04.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 1 -- 172.21.15.5:0/3824360718 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f784813ee50 con 0x7f7848139fe0 2024-08-18T21:05:04.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 10 monclient: _renew_subs 2024-08-18T21:05:04.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:04.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 1 -- 172.21.15.5:0/3824360718 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f78480aadd0 con 0x7f7848139fe0 2024-08-18T21:05:04.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:04.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78481d19c0 0x7f78481d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.492+0000 7f78504ee640 1 -- 172.21.15.5:0/3824360718 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f78480a7b60 con 0x7f78481d19c0 2024-08-18T21:05:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f784e28a640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78481d19c0 0x7f78481d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f784e28a640 10 monclient: get_auth_request con 0x7f78481d19c0 auth_method 0 2024-08-18T21:05:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f784e28a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f784e28a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f784e28a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f784ea8b640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7848139fe0 0x7f784813be30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f784000b410 tx=0x7f784000b8d0 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7f784004e170 osd_map(48..48 src has 11..48) 2024-08-18T21:05:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f783effd640 1 -- 172.21.15.5:0/3824360718 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f7840018020 con 0x7f7848139fe0 2024-08-18T21:05:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f784e28a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f784e28a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f784e28a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f784e28a640 10 monclient(hunting): handle_auth_done global_id 4765 payload 824 2024-08-18T21:05:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f784e28a640 1 -- 172.21.15.5:0/3824360718 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78480aa880 con 0x7f78481d19c0 2024-08-18T21:05:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f783effd640 1 --2- 172.21.15.5:0/3824360718 >> v2:172.21.15.157:6812/631023601 conn(0x7f782c03bdc0 0x7f782c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f784da89640 1 --2- 172.21.15.5:0/3824360718 >> v2:172.21.15.157:6812/631023601 conn(0x7f782c03bdc0 0x7f782c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f784da89640 10 monclient: get_auth_request con 0x7f782c03bdc0 auth_method 0 2024-08-18T21:05:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f784e28a640 1 -- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78481d19c0 msgr2=0x7f78481d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f784e28a640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78481d19c0 0x7f78481d1da0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7844007590 tx=0x7f7844007a50 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f783effd640 1 -- 172.21.15.5:0/3824360718 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7844014d50 con 0x7f78481d19c0 2024-08-18T21:05:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f783effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f783effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f783effd640 10 monclient: dump: 2024-08-18T21:05:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.514 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f783effd640 1 -- 172.21.15.5:0/3824360718 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f784401a070 con 0x7f78481d19c0 2024-08-18T21:05:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f783effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f783effd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f783effd640 1 -- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78481d19c0 msgr2=0x7f78481d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f783effd640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78481d19c0 0x7f78481d1da0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7844007590 tx=0x7f7844007a50 comp rx=0 tx=0).stop 2024-08-18T21:05:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f783effd640 1 -- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78481d19c0 msgr2=0x7f78481d1da0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f783effd640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78481d19c0 0x7f78481d1da0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7844007590 tx=0x7f7844007a50 comp rx=0 tx=0).stop 2024-08-18T21:05:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.496+0000 7f784da89640 1 --2- 172.21.15.5:0/3824360718 >> v2:172.21.15.157:6812/631023601 conn(0x7f782c03bdc0 0x7f782c03e280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f78380ac000 tx=0x7f78380a7000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.504+0000 7f78504ee640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.504+0000 7f78504ee640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78481d22e0 0x7f784809e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.504+0000 7f78504ee640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.504+0000 7f78504ee640 1 -- 172.21.15.5:0/3824360718 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f7848051140 con 0x7f78481d22e0 2024-08-18T21:05:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.504+0000 7f784e28a640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78481d22e0 0x7f784809e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.504+0000 7f784e28a640 10 monclient: get_auth_request con 0x7f78481d22e0 auth_method 0 2024-08-18T21:05:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.504+0000 7f784e28a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.504+0000 7f784e28a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.504+0000 7f784e28a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.504+0000 7f784e28a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.504+0000 7f784e28a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.504+0000 7f784e28a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.504+0000 7f784e28a640 10 monclient(hunting): handle_auth_done global_id 4774 payload 824 2024-08-18T21:05:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.504+0000 7f784e28a640 1 -- 172.21.15.5:0/3824360718 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f78480a8220 con 0x7f78481d22e0 2024-08-18T21:05:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f784e28a640 1 -- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78481d22e0 msgr2=0x7f784809e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f784e28a640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78481d22e0 0x7f784809e7b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7844007590 tx=0x7f7844004a50 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f783effd640 1 -- 172.21.15.5:0/3824360718 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f78440158f0 con 0x7f78481d22e0 2024-08-18T21:05:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f783effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f783effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f783effd640 10 monclient: dump: 2024-08-18T21:05:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.519 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f783effd640 1 -- 172.21.15.5:0/3824360718 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f7844015480 con 0x7f78481d22e0 2024-08-18T21:05:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f783effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f783effd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f783effd640 1 -- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78481d22e0 msgr2=0x7f784809e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f783effd640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78481d22e0 0x7f784809e7b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7844007590 tx=0x7f7844004a50 comp rx=0 tx=0).stop 2024-08-18T21:05:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f783effd640 1 -- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78481d22e0 msgr2=0x7f784809e7b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f783effd640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f78481d22e0 0x7f784809e7b0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7844007590 tx=0x7f7844004a50 comp rx=0 tx=0).stop 2024-08-18T21:05:04.520 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:04.521 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:04.521 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:04.521 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:04.521 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:04.521 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 113626, 2024-08-18T21:05:04.521 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:04.521 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:04.521 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:04.521 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:04.521 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:04.521 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:04.521 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:04.522 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:04.522 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:04.522 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:04.522 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.522 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:05:04.522 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:04.522 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:04.522 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:04.522 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:04.522 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:04.522 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:04.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:04.523 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:04.523 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:04.523 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:04.523 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:04.523 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:04.523 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:04.523 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:04.523 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.523 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:04.523 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:04.523 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:04.523 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:04.524 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:04.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:04.524 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:04.524 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:04.524 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:04.524 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:04.524 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:04.524 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:04.524 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:04.524 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.524 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:04.524 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:04.525 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:04.525 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:04.525 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:04.525 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:04.525 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:04.525 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:04.525 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:04.525 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:04.525 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:04.525 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:04.525 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:04.526 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:04.526 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:04.526 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:04.526 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:04.526 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:04.526 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:04.526 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:04.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:04.526 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:04.526 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:04.526 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:04.526 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:04.526 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:04.527 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:04.527 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:04.527 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.527 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:04.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.527 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:04.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.527 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:04.527 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:04.527 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.527 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.527 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.528 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:04.528 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.528 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.528 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:04.528 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.528 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.528 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.528 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:04.528 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:04.529 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.529 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.529 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.529 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.529 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:04.529 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:04.529 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.529 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.529 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.529 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.529 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:04.529 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.530 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.530 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.530 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:04.530 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.530 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.530 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.530 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:04.530 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:04.530 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.530 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.530 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.531 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:04.531 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:04.531 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.531 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.531 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.531 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:04.531 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.531 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.531 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:04.532 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.532 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.532 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.532 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:04.532 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:04.532 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.532 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.532 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.532 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.532 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:04.532 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:04.532 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.533 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.533 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.533 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:04.533 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.533 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.533 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:04.533 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.533 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.533 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.533 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:04.533 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:04.534 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.534 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.534 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.534 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:04.534 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:04.534 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.534 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.534 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.534 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.534 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:04.534 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.535 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.535 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.535 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:04.535 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.535 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.535 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.535 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:04.535 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:04.535 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.535 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.535 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.536 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:04.536 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:04.536 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.536 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.536 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.536 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.536 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:04.536 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.536 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.536 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.536 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:04.537 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.537 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.537 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.537 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:04.537 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:04.537 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.537 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.537 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.537 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:04.537 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:04.538 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.538 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.538 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.538 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:04.538 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.538 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.538 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:04.538 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.538 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.538 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.539 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:04.539 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:04.539 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.539 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.539 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.539 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:04.539 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:04.539 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.539 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.540 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.540 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:04.540 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.540 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.540 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:04.540 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.540 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.540 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.540 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:04.540 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:04.540 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.541 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.541 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.541 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:04.541 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:04.541 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.541 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.541 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.541 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:04.541 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.542 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.542 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.542 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:04.542 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.542 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.542 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.542 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:04.542 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:04.542 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.542 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.542 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.542 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.543 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.543 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:04.543 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:04.543 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.543 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:04.543 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:04.543 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:04.543 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.543 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.543 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:05:04.543 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.543 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:04.543 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:04.544 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:05:04.544 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.544 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.544 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:04.544 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.544 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:04.544 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:04.544 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:04.544 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.544 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.544 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.544 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:04.544 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f78504ee640 1 -- 172.21.15.5:0/3824360718 >> v2:172.21.15.157:6812/631023601 conn(0x7f782c03bdc0 msgr2=0x7f782c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f78504ee640 1 --2- 172.21.15.5:0/3824360718 >> v2:172.21.15.157:6812/631023601 conn(0x7f782c03bdc0 0x7f782c03e280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f78380ac000 tx=0x7f78380a7000 comp rx=0 tx=0).stop 2024-08-18T21:05:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f78504ee640 10 monclient: shutdown 2024-08-18T21:05:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f78504ee640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f78504ee640 1 -- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7848139fe0 msgr2=0x7f784813be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f78504ee640 1 --2- 172.21.15.5:0/3824360718 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7848139fe0 0x7f784813be30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f784000b410 tx=0x7f784000b8d0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f784ea8b640 1 -- 172.21.15.5:0/3824360718 reap_dead start 2024-08-18T21:05:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f784ea8b640 1 -- 172.21.15.5:0/3824360718 reap_dead start 2024-08-18T21:05:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f783effd640 1 -- 172.21.15.5:0/3824360718 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(48..48 src has 11..48) ==== 3898+0+0 (unknown 0 0 0) 0x7f784004e170 con 0x7f7848139fe0 2024-08-18T21:05:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f78504ee640 1 -- 172.21.15.5:0/3824360718 shutdown_connections 2024-08-18T21:05:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f78504ee640 1 -- 172.21.15.5:0/3824360718 >> 172.21.15.5:0/3824360718 conn(0x7f78480acbc0 msgr2=0x7f784809de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f78504ee640 1 -- 172.21.15.5:0/3824360718 shutdown_connections 2024-08-18T21:05:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.508+0000 7f78504ee640 1 -- 172.21.15.5:0/3824360718 wait complete. 2024-08-18T21:05:04.547 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:04.547 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:05:04.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:05:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.676+0000 7fabd54c7640 10 monclient: get_monmap_and_config 2024-08-18T21:05:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.676+0000 7fabd54c7640 10 monclient: build_initial_monmap 2024-08-18T21:05:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.676+0000 7fabd54c7640 10 monclient: monmap: 2024-08-18T21:05:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:04.683650+0000 2024-08-18T21:05:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:04.683650+0000 2024-08-18T21:05:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:04.683 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 1 Processor -- start 2024-08-18T21:05:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 1 -- start start 2024-08-18T21:05:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 10 monclient: init 2024-08-18T21:05:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 10 monclient: _add_conns ranks=[0,7,10,6,8,3,5,9,1,4,2] 2024-08-18T21:05:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fabd00a4960 addr v1:172.21.15.5:6789/0 2024-08-18T21:05:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fabd00a5450 0x7fabd013ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 10 monclient(hunting): picked mon.noname-i con 0x7fabd00a5450 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fabd013f290 0x7fabd0141680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 10 monclient(hunting): picked mon.noname-f con 0x7fabd013f290 addr v2:172.21.15.157:3300/0 2024-08-18T21:05:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd009da30 con 0x7fabd00a4960 2024-08-18T21:05:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fabd006ccb0 con 0x7fabd013f290 2024-08-18T21:05:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fabd006ce80 con 0x7fabd00a5450 2024-08-18T21:05:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabd54c7640 10 monclient(hunting): authenticate will time out at 1071.696862s 2024-08-18T21:05:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabceffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fabd00a4960 0x7fabd00a4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51422/0 (socket says 172.21.15.5:51422) 2024-08-18T21:05:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabceffd640 1 -- 172.21.15.5:0/3133189754 learned_addr learned my addr 172.21.15.5:0/3133189754 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:05:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 1 --2- 172.21.15.5:0/3133189754 >> v2:172.21.15.157:3300/0 conn(0x7fabd013f290 0x7fabd0141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabce7fc640 1 --2- 172.21.15.5:0/3133189754 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fabd00a5450 0x7fabd013ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 10 monclient(hunting): get_auth_request con 0x7fabd013f290 auth_method 0 2024-08-18T21:05:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabce7fc640 10 monclient(hunting): get_auth_request con 0x7fabd00a5450 auth_method 0 2024-08-18T21:05:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabce7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabce7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabce7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabce7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabce7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 10 monclient(hunting): handle_auth_done global_id 4618 payload 274 2024-08-18T21:05:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 1 -- 172.21.15.5:0/3133189754 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fabd00a5450 msgr2=0x7fabd013ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 1 --2- 172.21.15.5:0/3133189754 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fabd00a5450 0x7fabd013ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 1 -- 172.21.15.5:0/3133189754 >> v1:172.21.15.5:6789/0 conn(0x7fabd00a4960 legacy=0x7fabd00a4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:05:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 1 monclient: found mon.noname-f 2024-08-18T21:05:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:05:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.680+0000 7fabcf7fe640 1 -- 172.21.15.5:0/3133189754 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd006d090 con 0x7fabd013f290 2024-08-18T21:05:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabcf7fe640 1 -- 172.21.15.5:0/3133189754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabd013f290 msgr2=0x7fabd0141680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabcf7fe640 1 --2- 172.21.15.5:0/3133189754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabd013f290 0x7fabd0141680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fabd006e530 tx=0x7fabc801c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6131afe90562c04b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabcdffb640 1 -- 172.21.15.5:0/3133189754 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fabc80ac070 con 0x7fabd013f290 2024-08-18T21:05:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabcdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabcdffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:05:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabcdffb640 10 monclient: dump: 2024-08-18T21:05:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.691 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabcdffb640 10 monclient: _finish_auth 0 2024-08-18T21:05:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabcdffb640 10 monclient: _check_auth_tickets 2024-08-18T21:05:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabcdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabd54c7640 5 monclient: authenticate success, global_id 4618 2024-08-18T21:05:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabd54c7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:05:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabcdffb640 1 -- 172.21.15.5:0/3133189754 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc80a68b0 con 0x7fabd013f290 2024-08-18T21:05:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabcdffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabd54c7640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabd54c7640 4 set_mon_vals no callback set 2024-08-18T21:05:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabcdffb640 1 -- 172.21.15.5:0/3133189754 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fabc80a7420 con 0x7fabd013f290 2024-08-18T21:05:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabcdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabcdffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:05:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabcdffb640 10 monclient: dump: 2024-08-18T21:05:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.693 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabd54c7640 10 monclient: shutdown 2024-08-18T21:05:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabd54c7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabd54c7640 1 -- 172.21.15.5:0/3133189754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabd013f290 msgr2=0x7fabd0141680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabd54c7640 1 --2- 172.21.15.5:0/3133189754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabd013f290 0x7fabd0141680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fabd006e530 tx=0x7fabc801c7f0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabd54c7640 1 -- 172.21.15.5:0/3133189754 shutdown_connections 2024-08-18T21:05:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabd54c7640 1 --2- 172.21.15.5:0/3133189754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabd013f290 0x7fabd0141680 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabd54c7640 1 --2- 172.21.15.5:0/3133189754 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fabd00a5450 0x7fabd013ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabd54c7640 1 -- 172.21.15.5:0/3133189754 >> 172.21.15.5:0/3133189754 conn(0x7fabd00a6440 msgr2=0x7fabd0068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabd54c7640 1 -- 172.21.15.5:0/3133189754 shutdown_connections 2024-08-18T21:05:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabd54c7640 1 -- 172.21.15.5:0/3133189754 wait complete. 2024-08-18T21:05:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabd54c7640 10 monclient: build_initial_monmap 2024-08-18T21:05:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.684+0000 7fabd54c7640 10 monclient: monmap: 2024-08-18T21:05:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:04.695 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 1 Processor -- start 2024-08-18T21:05:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 1 -- start start 2024-08-18T21:05:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 10 monclient: init 2024-08-18T21:05:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 10 monclient: _add_conns ranks=[6,0,2,7,4,3,5,8,1] 2024-08-18T21:05:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd00a4960 0x7fabd01d15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 10 monclient(hunting): picked mon.noname-d con 0x7fabd00a4960 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd00a5450 0x7fabd01d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 10 monclient(hunting): picked mon.noname-a con 0x7fabd00a5450 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:05:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fabd013f290 0x7fabd01d2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 10 monclient(hunting): picked mon.noname-b con 0x7fabd013f290 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fabd0144560 con 0x7fabd00a5450 2024-08-18T21:05:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fabd01443e0 con 0x7fabd013f290 2024-08-18T21:05:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fabd01446e0 con 0x7fabd00a4960 2024-08-18T21:05:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabd54c7640 10 monclient(hunting): authenticate will time out at 1071.704793s 2024-08-18T21:05:04.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabce7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd00a5450 0x7fabd01d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd00a4960 0x7fabd01d15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabcf7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fabd013f290 0x7fabd01d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabcf7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fabd013f290 0x7fabd01d2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:46068/0 (socket says 172.21.15.5:46068) 2024-08-18T21:05:04.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabcf7fe640 1 -- 172.21.15.5:0/76697315 learned_addr learned my addr 172.21.15.5:0/76697315 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:04.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabcf7fe640 10 monclient(hunting): get_auth_request con 0x7fabd013f290 auth_method 0 2024-08-18T21:05:04.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd00a4960 0x7fabd01d15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:36126/0 (socket says 172.21.15.5:36126) 2024-08-18T21:05:04.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabcf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabcf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabcf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 10 monclient(hunting): get_auth_request con 0x7fabd00a4960 auth_method 0 2024-08-18T21:05:04.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabce7fc640 10 monclient(hunting): get_auth_request con 0x7fabd00a5450 auth_method 0 2024-08-18T21:05:04.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabce7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabce7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabce7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabce7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabce7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 10 monclient(hunting): handle_auth_done global_id 4749 payload 824 2024-08-18T21:05:04.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 1 -- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fabd013f290 msgr2=0x7fabd01d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 1 --2- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fabd013f290 0x7fabd01d2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 1 -- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd00a5450 msgr2=0x7fabd01d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 1 --2- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd00a5450 0x7fabd01d1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 10 monclient: _finish_hunting 0 2024-08-18T21:05:04.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 1 monclient: found mon.noname-d 2024-08-18T21:05:04.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:04.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:05:04.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 1 -- 172.21.15.5:0/76697315 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd01285a0 con 0x7fabd00a4960 2024-08-18T21:05:04.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabce7fc640 1 --2- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd00a5450 0x7fabd01d1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:04.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 1 -- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd00a4960 msgr2=0x7fabd01d15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.688+0000 7fabceffd640 1 --2- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd00a4960 0x7fabd01d15f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fabc000c410 tx=0x7fabc000c8d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabb77fe640 1 -- 172.21.15.5:0/76697315 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fabc0017070 con 0x7fabd00a4960 2024-08-18T21:05:04.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabb77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabb77fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:05:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabb77fe640 10 monclient: dump: 2024-08-18T21:05:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.706 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.706 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.706 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.706 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.706 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabb77fe640 10 monclient: _finish_auth 0 2024-08-18T21:05:04.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabb77fe640 10 monclient: _check_auth_tickets 2024-08-18T21:05:04.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabb77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:04.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabb77fe640 1 -- 172.21.15.5:0/76697315 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc0005d00 con 0x7fabd00a4960 2024-08-18T21:05:04.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabb77fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:04.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabb77fe640 1 -- 172.21.15.5:0/76697315 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fabc0007540 con 0x7fabd00a4960 2024-08-18T21:05:04.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabb77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabb77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:05:04.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabb77fe640 10 monclient: dump: 2024-08-18T21:05:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.708 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabcd7fa640 4 set_mon_vals no callback set 2024-08-18T21:05:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabd54c7640 5 monclient: authenticate success, global_id 4749 2024-08-18T21:05:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabd54c7640 10 monclient: _renew_subs 2024-08-18T21:05:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabd54c7640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabd54c7640 1 -- 172.21.15.5:0/76697315 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd00689b0 con 0x7fabd00a4960 2024-08-18T21:05:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabd54c7640 10 monclient: _renew_subs 2024-08-18T21:05:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabd54c7640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:05:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabd54c7640 1 -- 172.21.15.5:0/76697315 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd0126240 con 0x7fabd00a4960 2024-08-18T21:05:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabd54c7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabd54c7640 1 --2- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd01289c0 0x7fabd01248e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabd54c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabd54c7640 1 -- 172.21.15.5:0/76697315 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fabd0051140 con 0x7fabd01289c0 2024-08-18T21:05:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabce7fc640 1 --2- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd01289c0 0x7fabd01248e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabce7fc640 10 monclient: get_auth_request con 0x7fabd01289c0 auth_method 0 2024-08-18T21:05:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabce7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabce7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabceffd640 1 --2- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd00a4960 0x7fabd01d15f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fabc000c410 tx=0x7fabc000c8d0 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7fabc0007070 mgrmap(e 5) 2024-08-18T21:05:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabb77fe640 1 -- 172.21.15.5:0/76697315 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fabc0007070 con 0x7fabd00a4960 2024-08-18T21:05:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabce7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabce7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabce7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabce7fc640 10 monclient(hunting): handle_auth_done global_id 4758 payload 824 2024-08-18T21:05:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabb77fe640 1 --2- 172.21.15.5:0/76697315 >> v2:172.21.15.157:6812/631023601 conn(0x7fabbc03bdc0 0x7fabbc03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabce7fc640 1 -- 172.21.15.5:0/76697315 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fabd01283e0 con 0x7fabd01289c0 2024-08-18T21:05:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabcf7fe640 1 --2- 172.21.15.5:0/76697315 >> v2:172.21.15.157:6812/631023601 conn(0x7fabbc03bdc0 0x7fabbc03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.692+0000 7fabcf7fe640 10 monclient: get_auth_request con 0x7fabbc03bdc0 auth_method 0 2024-08-18T21:05:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.696+0000 7fabce7fc640 1 -- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd01289c0 msgr2=0x7fabd01248e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.696+0000 7fabce7fc640 1 --2- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd01289c0 0x7fabd01248e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fabd01268b0 tx=0x7fabc400f610 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.696+0000 7fabb77fe640 1 -- 172.21.15.5:0/76697315 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fabc40044a0 con 0x7fabd01289c0 2024-08-18T21:05:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.696+0000 7fabb77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.696+0000 7fabb77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:05:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.696+0000 7fabb77fe640 10 monclient: dump: 2024-08-18T21:05:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.711 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.696+0000 7fabb77fe640 1 -- 172.21.15.5:0/76697315 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fabc400fe40 con 0x7fabd01289c0 2024-08-18T21:05:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.696+0000 7fabb77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.696+0000 7fabb77fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.696+0000 7fabb77fe640 1 -- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd01289c0 msgr2=0x7fabd01248e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.696+0000 7fabb77fe640 1 --2- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd01289c0 0x7fabd01248e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fabd01268b0 tx=0x7fabc400f610 comp rx=0 tx=0).stop 2024-08-18T21:05:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.696+0000 7fabb77fe640 1 -- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd01289c0 msgr2=0x7fabd01248e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.696+0000 7fabb77fe640 1 --2- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd01289c0 0x7fabd01248e0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fabd01268b0 tx=0x7fabc400f610 comp rx=0 tx=0).stop 2024-08-18T21:05:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.696+0000 7fabcf7fe640 1 --2- 172.21.15.5:0/76697315 >> v2:172.21.15.157:6812/631023601 conn(0x7fabbc03bdc0 0x7fabbc03e280 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009bd0 tx=0x7fabc80a7000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.700+0000 7fabd54c7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:04.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.700+0000 7fabd54c7640 1 --2- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd0124e20 0x7fabd0125200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.700+0000 7fabd54c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.700+0000 7fabd54c7640 1 -- 172.21.15.5:0/76697315 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fabd0127e90 con 0x7fabd0124e20 2024-08-18T21:05:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.700+0000 7fabce7fc640 1 --2- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd0124e20 0x7fabd0125200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.700+0000 7fabce7fc640 10 monclient: get_auth_request con 0x7fabd0124e20 auth_method 0 2024-08-18T21:05:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.700+0000 7fabce7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.700+0000 7fabce7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.700+0000 7fabce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.700+0000 7fabce7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.700+0000 7fabce7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.700+0000 7fabce7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.700+0000 7fabce7fc640 10 monclient(hunting): handle_auth_done global_id 4767 payload 824 2024-08-18T21:05:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.700+0000 7fabce7fc640 1 -- 172.21.15.5:0/76697315 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fabd0125740 con 0x7fabd0124e20 2024-08-18T21:05:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabce7fc640 1 -- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd0124e20 msgr2=0x7fabd0125200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabce7fc640 1 --2- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd0124e20 0x7fabd0125200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fabd01268b0 tx=0x7fabc40046d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabb77fe640 1 -- 172.21.15.5:0/76697315 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fabc4003ca0 con 0x7fabd0124e20 2024-08-18T21:05:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabb77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabb77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:05:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabb77fe640 10 monclient: dump: 2024-08-18T21:05:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.716 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabb77fe640 1 -- 172.21.15.5:0/76697315 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7fabc4003e40 con 0x7fabd0124e20 2024-08-18T21:05:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabb77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabb77fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabb77fe640 1 -- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd0124e20 msgr2=0x7fabd0125200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabb77fe640 1 --2- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd0124e20 0x7fabd0125200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fabd01268b0 tx=0x7fabc40046d0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabb77fe640 1 -- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd0124e20 msgr2=0x7fabd0125200 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabb77fe640 1 --2- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd0124e20 0x7fabd0125200 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fabd01268b0 tx=0x7fabc40046d0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.717 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:04.717 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:04.717 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:04.717 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:04.717 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:04.717 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 113814, 2024-08-18T21:05:04.717 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:04.717 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:04.717 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:04.717 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:04.717 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:04.718 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:04.718 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:04.718 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:04.718 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:04.718 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:04.718 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.718 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:05:04.718 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:04.718 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:04.718 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:04.718 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:04.718 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:05:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:04.740 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:04.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabd54c7640 1 -- 172.21.15.5:0/76697315 >> v2:172.21.15.157:6812/631023601 conn(0x7fabbc03bdc0 msgr2=0x7fabbc03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabd54c7640 1 --2- 172.21.15.5:0/76697315 >> v2:172.21.15.157:6812/631023601 conn(0x7fabbc03bdc0 0x7fabbc03e280 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009bd0 tx=0x7fabc80a7000 comp rx=0 tx=0).stop 2024-08-18T21:05:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabd54c7640 10 monclient: shutdown 2024-08-18T21:05:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabd54c7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabd54c7640 1 -- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd00a4960 msgr2=0x7fabd01d15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabd54c7640 1 --2- 172.21.15.5:0/76697315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fabd00a4960 0x7fabd01d15f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fabc000c410 tx=0x7fabc000c8d0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabcf7fe640 1 -- 172.21.15.5:0/76697315 reap_dead start 2024-08-18T21:05:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabb77fe640 1 -- 172.21.15.5:0/76697315 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(49..49 src has 11..49) ==== 3898+0+0 (unknown 0 0 0) 0x7fabc004da90 con 0x7fabd00a4960 2024-08-18T21:05:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabcf7fe640 1 -- 172.21.15.5:0/76697315 reap_dead start 2024-08-18T21:05:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabd54c7640 1 -- 172.21.15.5:0/76697315 shutdown_connections 2024-08-18T21:05:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabd54c7640 1 -- 172.21.15.5:0/76697315 >> 172.21.15.5:0/76697315 conn(0x7fabd00a6440 msgr2=0x7fabd01410b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabd54c7640 1 -- 172.21.15.5:0/76697315 shutdown_connections 2024-08-18T21:05:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.704+0000 7fabd54c7640 1 -- 172.21.15.5:0/76697315 wait complete. 2024-08-18T21:05:04.743 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:04.743 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:05:04.743 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:05:04.770 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28396]: starting. 2024-08-18T21:05:04.770 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28396]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28395 2024-08-18T21:05:04.771 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28396]: created object 0... 2024-08-18T21:05:04.771 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28396]: created object 25... 2024-08-18T21:05:04.771 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28396]: created object 49... 2024-08-18T21:05:04.771 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28396]: finishing. 2024-08-18T21:05:04.771 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28396]: shutting down. 2024-08-18T21:05:04.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.856+0000 7fd9ec0dd640 10 monclient: get_monmap_and_config 2024-08-18T21:05:04.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.856+0000 7fd9ec0dd640 10 monclient: build_initial_monmap 2024-08-18T21:05:04.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.856+0000 7fd9ec0dd640 10 monclient: monmap: 2024-08-18T21:05:04.861 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:04.861 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.861 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:04.863441+0000 2024-08-18T21:05:04.861 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:04.863441+0000 2024-08-18T21:05:04.862 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:04.862 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.862 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:04.862 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:04.862 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:04.862 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:04.862 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:04.862 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:04.862 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:04.862 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:04.862 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:04.863 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:04.863 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:04.863 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 1 Processor -- start 2024-08-18T21:05:04.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 1 -- start start 2024-08-18T21:05:04.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 10 monclient: init 2024-08-18T21:05:04.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:04.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 10 monclient: _add_conns ranks=[3,5,1,9,10,6,0,2,7,8,4] 2024-08-18T21:05:04.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e41332e0 0x7fd9e41336c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 10 monclient(hunting): picked mon.noname-g con 0x7fd9e41332e0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:04.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd9e40a2bc0 0x7fd9e40a4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 10 monclient(hunting): picked mon.noname-h con 0x7fd9e40a2bc0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:04.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd9e40a4750 addr v1:172.21.15.157:6789/0 2024-08-18T21:05:04.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9e40a61b0 con 0x7fd9e40a4750 2024-08-18T21:05:04.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd9e4072430 con 0x7fd9e41332e0 2024-08-18T21:05:04.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fd9e4070a60 con 0x7fd9e40a2bc0 2024-08-18T21:05:04.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:04.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9ec0dd640 10 monclient(hunting): authenticate will time out at 1071.877258s 2024-08-18T21:05:04.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e41332e0 0x7fd9e41336c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e41332e0 0x7fd9e41336c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:52926/0 (socket says 172.21.15.5:52926) 2024-08-18T21:05:04.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 1 -- 172.21.15.5:0/1432321445 learned_addr learned my addr 172.21.15.5:0/1432321445 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:04.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 10 monclient(hunting): get_auth_request con 0x7fd9e41332e0 auth_method 0 2024-08-18T21:05:04.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9678640 1 --2- 172.21.15.5:0/1432321445 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd9e40a2bc0 0x7fd9e40a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9678640 10 monclient(hunting): get_auth_request con 0x7fd9e40a2bc0 auth_method 0 2024-08-18T21:05:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9678640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9678640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9678640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9678640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9678640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9678640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 10 monclient(hunting): handle_auth_done global_id 4728 payload 274 2024-08-18T21:05:04.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 1 -- 172.21.15.5:0/1432321445 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd9e40a2bc0 msgr2=0x7fd9e40a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:04.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 1 --2- 172.21.15.5:0/1432321445 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd9e40a2bc0 0x7fd9e40a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 1 -- 172.21.15.5:0/1432321445 >> v1:172.21.15.157:6789/0 conn(0x7fd9e40a4750 legacy=0x7fd9e413d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:04.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 10 monclient: _finish_hunting 0 2024-08-18T21:05:04.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 1 monclient: found mon.noname-g 2024-08-18T21:05:04.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:04.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:05:04.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.860+0000 7fd9e9e79640 1 -- 172.21.15.5:0/1432321445 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e4071b00 con 0x7fd9e41332e0 2024-08-18T21:05:04.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9e9e79640 1 -- 172.21.15.5:0/1432321445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e41332e0 msgr2=0x7fd9e41336c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9e9e79640 1 --2- 172.21.15.5:0/1432321445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e41332e0 0x7fd9e41336c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00098a0 tx=0x7fd9e001c410 comp rx=0 tx=0).ready entity=mon.3 client_cookie=2d78d6267a844c92 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9e8e77640 1 -- 172.21.15.5:0/1432321445 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd9e00b0070 con 0x7fd9e41332e0 2024-08-18T21:05:04.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9e8e77640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9e8e77640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:05:04.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9e8e77640 10 monclient: dump: 2024-08-18T21:05:04.869 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.870 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.870 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.870 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.870 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.870 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.870 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.870 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.870 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.870 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.870 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.870 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.870 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.870 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.871 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9e8e77640 10 monclient: _finish_auth 0 2024-08-18T21:05:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9e8e77640 10 monclient: _check_auth_tickets 2024-08-18T21:05:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9e8e77640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9e8e77640 1 -- 172.21.15.5:0/1432321445 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e00044a0 con 0x7fd9e41332e0 2024-08-18T21:05:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9e8e77640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9e8e77640 1 -- 172.21.15.5:0/1432321445 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd9e0003a90 con 0x7fd9e41332e0 2024-08-18T21:05:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9ec0dd640 5 monclient: authenticate success, global_id 4728 2024-08-18T21:05:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9ec0dd640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9ec0dd640 4 set_mon_vals no callback set 2024-08-18T21:05:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9e8e77640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9e8e77640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:05:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9e8e77640 10 monclient: dump: 2024-08-18T21:05:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.873 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.873 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9ec0dd640 10 monclient: shutdown 2024-08-18T21:05:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9ec0dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9ec0dd640 1 -- 172.21.15.5:0/1432321445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e41332e0 msgr2=0x7fd9e41336c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9ec0dd640 1 --2- 172.21.15.5:0/1432321445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e41332e0 0x7fd9e41336c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00098a0 tx=0x7fd9e001c410 comp rx=0 tx=0).stop 2024-08-18T21:05:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9ec0dd640 1 -- 172.21.15.5:0/1432321445 shutdown_connections 2024-08-18T21:05:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9ec0dd640 1 --2- 172.21.15.5:0/1432321445 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd9e40a2bc0 0x7fd9e40a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9ec0dd640 1 --2- 172.21.15.5:0/1432321445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e41332e0 0x7fd9e41336c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9ec0dd640 1 -- 172.21.15.5:0/1432321445 >> 172.21.15.5:0/1432321445 conn(0x7fd9e40a8e00 msgr2=0x7fd9e40a5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.864+0000 7fd9ec0dd640 1 -- 172.21.15.5:0/1432321445 shutdown_connections 2024-08-18T21:05:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 1 -- 172.21.15.5:0/1432321445 wait complete. 2024-08-18T21:05:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 10 monclient: build_initial_monmap 2024-08-18T21:05:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 10 monclient: monmap: 2024-08-18T21:05:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:04.879 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 1 Processor -- start 2024-08-18T21:05:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 1 -- start start 2024-08-18T21:05:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 10 monclient: init 2024-08-18T21:05:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 10 monclient: _add_conns ranks=[3,0,6,2,4,8,5,7,1] 2024-08-18T21:05:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e40a2bc0 0x7fd9e41d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 10 monclient(hunting): picked mon.noname-g con 0x7fd9e40a2bc0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9e40a4750 0x7fd9e4132730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 10 monclient(hunting): picked mon.noname-a con 0x7fd9e40a4750 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:05:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd9e41332e0 0x7fd9e413c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 10 monclient(hunting): picked mon.noname-d con 0x7fd9e41332e0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e4072ee0 con 0x7fd9e40a4750 2024-08-18T21:05:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd9e4072d60 con 0x7fd9e40a2bc0 2024-08-18T21:05:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fd9e4133c00 con 0x7fd9e41332e0 2024-08-18T21:05:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ec0dd640 10 monclient(hunting): authenticate will time out at 1071.885888s 2024-08-18T21:05:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9e40a4750 0x7fd9e4132730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9e40a4750 0x7fd9e4132730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42696/0 (socket says 172.21.15.5:42696) 2024-08-18T21:05:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 1 -- 172.21.15.5:0/912401207 learned_addr learned my addr 172.21.15.5:0/912401207 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 10 monclient(hunting): get_auth_request con 0x7fd9e40a4750 auth_method 0 2024-08-18T21:05:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ea67a640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd9e41332e0 0x7fd9e413c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ea67a640 1 -- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd9e41332e0 msgr2=0x7fd9e413c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-18T21:05:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ea67a640 1 -- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd9e41332e0 msgr2=0x7fd9e413c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:05:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ea67a640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd9e41332e0 0x7fd9e413c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9ea67a640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd9e41332e0 0x7fd9e413c370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9e79640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e40a2bc0 0x7fd9e41d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9e79640 10 monclient(hunting): get_auth_request con 0x7fd9e40a2bc0 auth_method 0 2024-08-18T21:05:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9e79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9e79640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9e79640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 10 monclient(hunting): handle_auth_done global_id 4842 payload 824 2024-08-18T21:05:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 1 -- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd9e41332e0 msgr2=0x7fd9e413c370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:05:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd9e41332e0 0x7fd9e413c370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 1 -- 172.21.15.5:0/912401207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e40a2bc0 msgr2=0x7fd9e41d1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e40a2bc0 0x7fd9e41d1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 10 monclient: _finish_hunting 0 2024-08-18T21:05:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 1 monclient: found mon.noname-a 2024-08-18T21:05:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:05:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.868+0000 7fd9e9678640 1 -- 172.21.15.5:0/912401207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e4070410 con 0x7fd9e40a4750 2024-08-18T21:05:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9e9678640 1 -- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9e40a4750 msgr2=0x7fd9e4132730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9e9678640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9e40a4750 0x7fd9e4132730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400e840 tx=0x7fd9d400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9da7fc640 1 -- 172.21.15.5:0/912401207 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd9d4017070 con 0x7fd9e40a4750 2024-08-18T21:05:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9da7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9da7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:05:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9da7fc640 10 monclient: dump: 2024-08-18T21:05:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.884 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9da7fc640 10 monclient: _finish_auth 0 2024-08-18T21:05:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9da7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:05:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9da7fc640 1 -- 172.21.15.5:0/912401207 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d400ee90 con 0x7fd9e40a4750 2024-08-18T21:05:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9da7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9da7fc640 1 -- 172.21.15.5:0/912401207 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd9d40138e0 con 0x7fd9e40a4750 2024-08-18T21:05:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9da7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9da7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:05:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9da7fc640 10 monclient: dump: 2024-08-18T21:05:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.886 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9ec0dd640 5 monclient: authenticate success, global_id 4842 2024-08-18T21:05:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9db7fe640 4 set_mon_vals no callback set 2024-08-18T21:05:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9ec0dd640 10 monclient: _renew_subs 2024-08-18T21:05:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9ec0dd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:05:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9ec0dd640 1 -- 172.21.15.5:0/912401207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e411f310 con 0x7fd9e40a4750 2024-08-18T21:05:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9ec0dd640 10 monclient: _renew_subs 2024-08-18T21:05:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9ec0dd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:05:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9ec0dd640 1 -- 172.21.15.5:0/912401207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e41d2880 con 0x7fd9e40a4750 2024-08-18T21:05:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9ec0dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9ec0dd640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd9e4132c70 0x7fd9e413c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9ec0dd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9ec0dd640 1 -- 172.21.15.5:0/912401207 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fd9e4051140 con 0x7fd9e4132c70 2024-08-18T21:05:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9e9e79640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd9e4132c70 0x7fd9e413c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9e9e79640 10 monclient: get_auth_request con 0x7fd9e4132c70 auth_method 0 2024-08-18T21:05:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9e9e79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9e9e79640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9e9e79640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9e9e79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9e9e79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9e9e79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9e9e79640 10 monclient(hunting): handle_auth_done global_id 34199 payload 824 2024-08-18T21:05:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9e9e79640 1 -- 172.21.15.5:0/912401207 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9e40a4210 con 0x7fd9e4132c70 2024-08-18T21:05:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9da7fc640 1 -- 172.21.15.5:0/912401207 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fd9d401a070 con 0x7fd9e40a4750 2024-08-18T21:05:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9da7fc640 1 --2- 172.21.15.5:0/912401207 >> v2:172.21.15.157:6812/631023601 conn(0x7fd9c803bdc0 0x7fd9c803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9da7fc640 1 -- 172.21.15.5:0/912401207 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(49..49 src has 11..49) ==== 3898+0+0 (secure 0 0 0) 0x7fd9d400f040 con 0x7fd9e40a4750 2024-08-18T21:05:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9ea67a640 1 --2- 172.21.15.5:0/912401207 >> v2:172.21.15.157:6812/631023601 conn(0x7fd9c803bdc0 0x7fd9c803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.872+0000 7fd9ea67a640 10 monclient: get_auth_request con 0x7fd9c803bdc0 auth_method 0 2024-08-18T21:05:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.876+0000 7fd9e9e79640 1 -- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd9e4132c70 msgr2=0x7fd9e413c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.876+0000 7fd9e9e79640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd9e4132c70 0x7fd9e413c8b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00ad000 tx=0x7fd9e00191b0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.876+0000 7fd9da7fc640 1 -- 172.21.15.5:0/912401207 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd9e00ba070 con 0x7fd9e4132c70 2024-08-18T21:05:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.876+0000 7fd9da7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.876+0000 7fd9da7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:05:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.876+0000 7fd9da7fc640 10 monclient: dump: 2024-08-18T21:05:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.892 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.876+0000 7fd9da7fc640 1 -- 172.21.15.5:0/912401207 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd9e0003830 con 0x7fd9e4132c70 2024-08-18T21:05:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.876+0000 7fd9da7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.876+0000 7fd9da7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.876+0000 7fd9da7fc640 1 -- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd9e4132c70 msgr2=0x7fd9e413c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.876+0000 7fd9da7fc640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd9e4132c70 0x7fd9e413c8b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00ad000 tx=0x7fd9e00191b0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.876+0000 7fd9da7fc640 1 -- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd9e4132c70 msgr2=0x7fd9e413c8b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.876+0000 7fd9da7fc640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd9e4132c70 0x7fd9e413c8b0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00ad000 tx=0x7fd9e00191b0 comp rx=0 tx=0).stop 2024-08-18T21:05:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.876+0000 7fd9ea67a640 1 --2- 172.21.15.5:0/912401207 >> v2:172.21.15.157:6812/631023601 conn(0x7fd9c803bdc0 0x7fd9c803e280 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4120570 tx=0x7fd9dc009040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.880+0000 7fd9ec0dd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.880+0000 7fd9ec0dd640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd9e413cdf0 0x7fd9e413d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.880+0000 7fd9ec0dd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.880+0000 7fd9ec0dd640 1 -- 172.21.15.5:0/912401207 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fd9e413d740 con 0x7fd9e413cdf0 2024-08-18T21:05:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.880+0000 7fd9e9e79640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd9e413cdf0 0x7fd9e413d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.880+0000 7fd9e9e79640 10 monclient: get_auth_request con 0x7fd9e413cdf0 auth_method 0 2024-08-18T21:05:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.880+0000 7fd9e9e79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.880+0000 7fd9e9e79640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.880+0000 7fd9e9e79640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.880+0000 7fd9e9e79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.880+0000 7fd9e9e79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9e9e79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9e9e79640 10 monclient(hunting): handle_auth_done global_id 34208 payload 824 2024-08-18T21:05:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9e9e79640 1 -- 172.21.15.5:0/912401207 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd9e40a6ce0 con 0x7fd9e413cdf0 2024-08-18T21:05:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9e9e79640 1 -- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd9e413cdf0 msgr2=0x7fd9e413d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9e9e79640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd9e413cdf0 0x7fd9e413d200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009870 tx=0x7fd9e0009240 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9da7fc640 1 -- 172.21.15.5:0/912401207 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd9e00b0040 con 0x7fd9e413cdf0 2024-08-18T21:05:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9da7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9da7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:05:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9da7fc640 10 monclient: dump: 2024-08-18T21:05:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:04.895 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9da7fc640 1 -- 172.21.15.5:0/912401207 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9246 (secure 0 0 0) 0x7fd9e00abb50 con 0x7fd9e413cdf0 2024-08-18T21:05:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9da7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9da7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9da7fc640 1 -- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd9e413cdf0 msgr2=0x7fd9e413d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9da7fc640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd9e413cdf0 0x7fd9e413d200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009870 tx=0x7fd9e0009240 comp rx=0 tx=0).stop 2024-08-18T21:05:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9da7fc640 1 -- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd9e413cdf0 msgr2=0x7fd9e413d200 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9da7fc640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd9e413cdf0 0x7fd9e413d200 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009870 tx=0x7fd9e0009240 comp rx=0 tx=0).stop 2024-08-18T21:05:04.896 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:04.896 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:04.897 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:04.897 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:04.897 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:04.897 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 24679, 2024-08-18T21:05:04.897 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:04.897 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:04.897 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:04.897 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:04.897 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:04.897 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:04.897 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:04.897 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:04.897 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:04.898 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:04.898 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.898 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:05:04.898 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:04.898 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:04.898 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:04.898 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:04.898 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:04.898 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:04.898 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:04.898 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:04.898 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:04.898 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:04.899 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:04.899 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:04.899 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:04.899 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:04.899 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.899 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:04.899 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:04.899 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:04.899 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:04.900 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:04.900 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:04.900 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:04.900 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:04.900 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:04.900 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:04.900 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:04.900 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:04.900 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:04.900 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.900 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:04.900 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:04.901 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:04.901 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:04.901 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:04.901 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:04.901 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:04.901 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:04.901 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:04.901 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:04.901 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:04.901 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:04.901 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:04.901 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:04.901 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:04.901 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:04.902 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:04.902 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:04.902 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:04.902 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:04.902 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:04.902 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:04.902 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:04.902 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:04.902 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:04.902 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:04.902 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:04.902 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:04.902 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.903 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:04.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.903 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:04.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.903 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:04.903 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:04.903 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.903 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.903 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.903 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:04.903 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.904 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.904 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:04.904 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.904 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.904 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.904 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:04.904 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:04.904 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.904 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.904 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.905 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:04.905 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:04.905 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.905 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.905 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.905 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:04.905 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.905 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.905 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:04.906 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.906 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.906 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.906 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:04.906 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:04.906 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.906 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.906 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.906 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:04.906 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:04.907 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.907 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.907 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.907 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:04.907 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.907 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.907 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:04.907 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.907 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.907 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.908 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:04.908 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:04.908 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.908 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.908 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.908 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:04.908 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:04.908 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.908 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.908 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.909 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:04.909 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.909 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.909 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:04.909 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.909 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.909 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.909 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:04.909 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:04.909 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.909 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.910 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.910 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:04.910 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:04.910 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.910 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.910 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.910 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:04.910 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.910 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.911 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:04.911 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.911 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.911 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.911 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:04.911 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:04.911 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.911 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.911 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.911 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:04.911 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:04.912 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.912 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.912 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.912 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:04.912 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.912 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.912 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:04.912 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.912 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.912 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.913 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:04.913 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:04.913 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.913 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.913 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.913 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:04.913 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:04.913 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.913 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.913 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.914 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:04.914 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.914 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.914 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:04.914 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.914 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.914 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.914 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:04.914 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:04.914 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.915 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.915 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.915 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:04.915 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:04.915 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.915 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.915 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.915 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:04.915 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.916 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.916 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:04.916 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.916 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.916 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.916 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:04.916 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:04.916 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.916 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.916 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.916 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:04.917 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:04.917 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:04.917 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:04.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.917 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:04.917 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:04.917 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.917 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:04.917 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:04.917 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:04.917 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.917 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.918 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:04.918 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:04.918 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:04.918 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:04.918 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:04.918 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.918 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.918 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:04.918 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:04.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.918 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:04.919 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:04.919 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:04.919 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.919 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:04.919 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:04.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:04.919 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:04.919 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:04.919 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:04.919 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:04.919 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:04.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:04.919 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:04.919 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9ec0dd640 1 -- 172.21.15.5:0/912401207 >> v2:172.21.15.157:6812/631023601 conn(0x7fd9c803bdc0 msgr2=0x7fd9c803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9ec0dd640 1 --2- 172.21.15.5:0/912401207 >> v2:172.21.15.157:6812/631023601 conn(0x7fd9c803bdc0 0x7fd9c803e280 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4120570 tx=0x7fd9dc009040 comp rx=0 tx=0).stop 2024-08-18T21:05:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9ec0dd640 10 monclient: shutdown 2024-08-18T21:05:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9ec0dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9ec0dd640 1 -- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9e40a4750 msgr2=0x7fd9e4132730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9ec0dd640 1 --2- 172.21.15.5:0/912401207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9e40a4750 0x7fd9e4132730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400e840 tx=0x7fd9d400ec40 comp rx=0 tx=0).stop 2024-08-18T21:05:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9ea67a640 1 -- 172.21.15.5:0/912401207 reap_dead start 2024-08-18T21:05:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9ea67a640 1 -- 172.21.15.5:0/912401207 reap_dead start 2024-08-18T21:05:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9ec0dd640 1 -- 172.21.15.5:0/912401207 shutdown_connections 2024-08-18T21:05:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9ec0dd640 1 -- 172.21.15.5:0/912401207 >> 172.21.15.5:0/912401207 conn(0x7fd9e40a8e00 msgr2=0x7fd9e409da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9ec0dd640 1 -- 172.21.15.5:0/912401207 shutdown_connections 2024-08-18T21:05:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:04.884+0000 7fd9ec0dd640 1 -- 172.21.15.5:0/912401207 wait complete. 2024-08-18T21:05:04.922 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:04.922 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:05:04.922 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:05:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 10 monclient: get_monmap_and_config 2024-08-18T21:05:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 10 monclient: build_initial_monmap 2024-08-18T21:05:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 10 monclient: monmap: 2024-08-18T21:05:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:05.045232+0000 2024-08-18T21:05:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:05.045232+0000 2024-08-18T21:05:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:05.044 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 1 Processor -- start 2024-08-18T21:05:05.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 1 -- start start 2024-08-18T21:05:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 10 monclient: init 2024-08-18T21:05:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 10 monclient: _add_conns ranks=[0,2,3,1,5,7,9,6,8,4,10] 2024-08-18T21:05:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7e2c0a6ce0 addr v1:172.21.15.5:6789/0 2024-08-18T21:05:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7e2c0a77d0 0x7f7e2c13ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 10 monclient(hunting): picked mon.noname-b con 0x7f7e2c0a77d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e2c13f220 0x7f7e2c141610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 10 monclient(hunting): picked mon.noname-g con 0x7f7e2c13f220 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e2c0a45d0 con 0x7f7e2c0a6ce0 2024-08-18T21:05:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2c0a5000 con 0x7f7e2c0a77d0 2024-08-18T21:05:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2c0a4360 con 0x7f7e2c13f220 2024-08-18T21:05:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e32300640 10 monclient(hunting): authenticate will time out at 1072.058412s 2024-08-18T21:05:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7e2c0a77d0 0x7f7e2c13ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7e2c0a6ce0 0x7f7e2c0a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51424/0 (socket says 172.21.15.5:51424) 2024-08-18T21:05:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2bfff640 1 -- 172.21.15.5:0/3541882481 learned_addr learned my addr 172.21.15.5:0/3541882481 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:05:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 10 monclient(hunting): get_auth_request con 0x7f7e2c0a77d0 auth_method 0 2024-08-18T21:05:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e3089d640 1 --2- 172.21.15.5:0/3541882481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e2c13f220 0x7f7e2c141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_done global_id 4853 payload 274 2024-08-18T21:05:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 1 -- 172.21.15.5:0/3541882481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e2c13f220 msgr2=0x7f7e2c141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 1 --2- 172.21.15.5:0/3541882481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e2c13f220 0x7f7e2c141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 1 -- 172.21.15.5:0/3541882481 >> v1:172.21.15.5:6789/0 conn(0x7f7e2c0a6ce0 legacy=0x7f7e2c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:05:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 1 monclient: found mon.noname-b 2024-08-18T21:05:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e2b7fe640 1 -- 172.21.15.5:0/3541882481 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c0a32d0 con 0x7f7e2c0a77d0 2024-08-18T21:05:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e3089d640 10 monclient: get_auth_request con 0x7f7e2c13f220 auth_method 0 2024-08-18T21:05:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.040+0000 7f7e3089d640 1 --2- 172.21.15.5:0/3541882481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e2c13f220 0x7f7e2c141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:05:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e2b7fe640 1 -- 172.21.15.5:0/3541882481 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7e2c0a77d0 msgr2=0x7f7e2c13ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e2b7fe640 1 --2- 172.21.15.5:0/3541882481 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7e2c0a77d0 0x7f7e2c13ece0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009df0 tx=0x7f7e1c01c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1e7c63a6771ae07 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e2affd640 1 -- 172.21.15.5:0/3541882481 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7e1c0b2070 con 0x7f7e2c0a77d0 2024-08-18T21:05:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e2affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e2affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e2affd640 10 monclient: dump: 2024-08-18T21:05:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.053 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e2affd640 10 monclient: _finish_auth 0 2024-08-18T21:05:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e2affd640 10 monclient: _check_auth_tickets 2024-08-18T21:05:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e2affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e2affd640 1 -- 172.21.15.5:0/3541882481 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e1c0a5a70 con 0x7f7e2c0a77d0 2024-08-18T21:05:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e2affd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e2affd640 1 -- 172.21.15.5:0/3541882481 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7e1c0a5c20 con 0x7f7e2c0a77d0 2024-08-18T21:05:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e32300640 5 monclient: authenticate success, global_id 4853 2024-08-18T21:05:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e32300640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e32300640 4 set_mon_vals no callback set 2024-08-18T21:05:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e2affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e2affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.044+0000 7f7e2affd640 10 monclient: dump: 2024-08-18T21:05:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.055 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 10 monclient: shutdown 2024-08-18T21:05:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 1 -- 172.21.15.5:0/3541882481 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7e2c0a77d0 msgr2=0x7f7e2c13ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 1 --2- 172.21.15.5:0/3541882481 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7e2c0a77d0 0x7f7e2c13ece0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009df0 tx=0x7f7e1c01c850 comp rx=0 tx=0).stop 2024-08-18T21:05:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 1 -- 172.21.15.5:0/3541882481 shutdown_connections 2024-08-18T21:05:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 1 --2- 172.21.15.5:0/3541882481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e2c13f220 0x7f7e2c141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 1 --2- 172.21.15.5:0/3541882481 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7e2c0a77d0 0x7f7e2c13ece0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 1 -- 172.21.15.5:0/3541882481 >> 172.21.15.5:0/3541882481 conn(0x7f7e2c0acbc0 msgr2=0x7f7e2c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 1 -- 172.21.15.5:0/3541882481 shutdown_connections 2024-08-18T21:05:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 1 -- 172.21.15.5:0/3541882481 wait complete. 2024-08-18T21:05:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 10 monclient: build_initial_monmap 2024-08-18T21:05:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 10 monclient: monmap: 2024-08-18T21:05:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:05.057 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 1 Processor -- start 2024-08-18T21:05:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 1 -- start start 2024-08-18T21:05:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 10 monclient: init 2024-08-18T21:05:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 10 monclient: _add_conns ranks=[2,8,4,6,1,3,0,7,5] 2024-08-18T21:05:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7e2c0a6ce0 0x7f7e2c1d1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 10 monclient(hunting): picked mon.noname-b con 0x7f7e2c0a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7e2c13f220 0x7f7e2c0a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 10 monclient(hunting): picked mon.noname-e con 0x7f7e2c13f220 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:05:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7e2c0a22d0 0x7f7e2c13d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 10 monclient(hunting): picked mon.noname-c con 0x7f7e2c0a22d0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2c0a83a0 con 0x7f7e2c0a6ce0 2024-08-18T21:05:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f7e2c0a8220 con 0x7f7e2c0a22d0 2024-08-18T21:05:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f7e2c144370 con 0x7f7e2c13f220 2024-08-18T21:05:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e32300640 10 monclient(hunting): authenticate will time out at 1072.066000s 2024-08-18T21:05:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7e2c0a6ce0 0x7f7e2c1d1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7e2c0a6ce0 0x7f7e2c1d1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:46092/0 (socket says 172.21.15.5:46092) 2024-08-18T21:05:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 1 -- 172.21.15.5:0/250512864 learned_addr learned my addr 172.21.15.5:0/250512864 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 10 monclient(hunting): get_auth_request con 0x7f7e2c0a6ce0 auth_method 0 2024-08-18T21:05:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e3089d640 1 --2- 172.21.15.5:0/250512864 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7e2c0a22d0 0x7f7e2c13d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2b7fe640 1 --2- 172.21.15.5:0/250512864 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7e2c13f220 0x7f7e2c0a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e3089d640 10 monclient(hunting): get_auth_request con 0x7f7e2c0a22d0 auth_method 0 2024-08-18T21:05:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e3089d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e3089d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e3089d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2b7fe640 10 monclient(hunting): get_auth_request con 0x7f7e2c13f220 auth_method 0 2024-08-18T21:05:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e3089d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e3089d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e3089d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 10 monclient(hunting): handle_auth_done global_id 4862 payload 824 2024-08-18T21:05:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 1 -- 172.21.15.5:0/250512864 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7e2c13f220 msgr2=0x7f7e2c0a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 1 --2- 172.21.15.5:0/250512864 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7e2c13f220 0x7f7e2c0a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 1 -- 172.21.15.5:0/250512864 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7e2c0a22d0 msgr2=0x7f7e2c13d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 1 --2- 172.21.15.5:0/250512864 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7e2c0a22d0 0x7f7e2c13d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:05:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 1 monclient: found mon.noname-b 2024-08-18T21:05:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.048+0000 7f7e2bfff640 1 -- 172.21.15.5:0/250512864 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c09da30 con 0x7f7e2c0a6ce0 2024-08-18T21:05:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e2bfff640 1 -- 172.21.15.5:0/250512864 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7e2c0a6ce0 msgr2=0x7f7e2c1d1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e2bfff640 1 --2- 172.21.15.5:0/250512864 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7e2c0a6ce0 0x7f7e2c1d1460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c470 tx=0x7f7e1400c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e28ff9640 1 -- 172.21.15.5:0/250512864 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7e14005d00 con 0x7f7e2c0a6ce0 2024-08-18T21:05:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e28ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e28ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e28ff9640 10 monclient: dump: 2024-08-18T21:05:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.067 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e28ff9640 10 monclient: _finish_auth 0 2024-08-18T21:05:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e28ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:05:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e28ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e28ff9640 1 -- 172.21.15.5:0/250512864 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e140074e0 con 0x7f7e2c0a6ce0 2024-08-18T21:05:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e28ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e28ff9640 1 -- 172.21.15.5:0/250512864 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7e14007690 con 0x7f7e2c0a6ce0 2024-08-18T21:05:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e28ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e28ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e28ff9640 10 monclient: dump: 2024-08-18T21:05:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.069 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e2a7fc640 4 set_mon_vals no callback set 2024-08-18T21:05:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e32300640 5 monclient: authenticate success, global_id 4862 2024-08-18T21:05:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e32300640 10 monclient: _renew_subs 2024-08-18T21:05:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e32300640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e32300640 1 -- 172.21.15.5:0/250512864 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e2c0ab0f0 con 0x7f7e2c0a6ce0 2024-08-18T21:05:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e32300640 10 monclient: _renew_subs 2024-08-18T21:05:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e32300640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e32300640 1 -- 172.21.15.5:0/250512864 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e2c13ebb0 con 0x7f7e2c0a6ce0 2024-08-18T21:05:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e32300640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e32300640 1 --2- 172.21.15.5:0/250512864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e2c13d7a0 0x7f7e2c13db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e32300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e32300640 1 -- 172.21.15.5:0/250512864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c051140 con 0x7f7e2c13d7a0 2024-08-18T21:05:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e28ff9640 1 -- 172.21.15.5:0/250512864 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f7e14007070 con 0x7f7e2c0a6ce0 2024-08-18T21:05:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e28ff9640 1 --2- 172.21.15.5:0/250512864 >> v2:172.21.15.157:6812/631023601 conn(0x7f7e0c03bdf0 0x7f7e0c03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e2b7fe640 1 --2- 172.21.15.5:0/250512864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e2c13d7a0 0x7f7e2c13db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e2b7fe640 10 monclient: get_auth_request con 0x7f7e2c13d7a0 auth_method 0 2024-08-18T21:05:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e2b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e2b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e2b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e28ff9640 1 -- 172.21.15.5:0/250512864 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(49..49 src has 11..49) ==== 3898+0+0 (secure 0 0 0) 0x7f7e1404e310 con 0x7f7e2c0a6ce0 2024-08-18T21:05:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e3089d640 1 --2- 172.21.15.5:0/250512864 >> v2:172.21.15.157:6812/631023601 conn(0x7f7e0c03bdf0 0x7f7e0c03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e3089d640 10 monclient: get_auth_request con 0x7f7e0c03bdf0 auth_method 0 2024-08-18T21:05:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_done global_id 4627 payload 824 2024-08-18T21:05:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.052+0000 7f7e2b7fe640 1 -- 172.21.15.5:0/250512864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e2c13e0c0 con 0x7f7e2c13d7a0 2024-08-18T21:05:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.056+0000 7f7e2b7fe640 1 -- 172.21.15.5:0/250512864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e2c13d7a0 msgr2=0x7f7e2c13db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.056+0000 7f7e2b7fe640 1 --2- 172.21.15.5:0/250512864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e2c13d7a0 0x7f7e2c13db80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c06df00 tx=0x7f7e1c0195f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.056+0000 7f7e3089d640 1 --2- 172.21.15.5:0/250512864 >> v2:172.21.15.157:6812/631023601 conn(0x7f7e0c03bdf0 0x7f7e0c03e2b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400aa40 tx=0x7f7e24008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.056+0000 7f7e28ff9640 1 -- 172.21.15.5:0/250512864 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7e1c0bd070 con 0x7f7e2c13d7a0 2024-08-18T21:05:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.056+0000 7f7e28ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.056+0000 7f7e28ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:05:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.056+0000 7f7e28ff9640 10 monclient: dump: 2024-08-18T21:05:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.073 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.056+0000 7f7e28ff9640 1 -- 172.21.15.5:0/250512864 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7e1c004560 con 0x7f7e2c13d7a0 2024-08-18T21:05:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.056+0000 7f7e28ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.056+0000 7f7e28ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.056+0000 7f7e28ff9640 1 -- 172.21.15.5:0/250512864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e2c13d7a0 msgr2=0x7f7e2c13db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.056+0000 7f7e28ff9640 1 --2- 172.21.15.5:0/250512864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e2c13d7a0 0x7f7e2c13db80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c06df00 tx=0x7f7e1c0195f0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.056+0000 7f7e28ff9640 1 -- 172.21.15.5:0/250512864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e2c13d7a0 msgr2=0x7f7e2c13db80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.056+0000 7f7e28ff9640 1 --2- 172.21.15.5:0/250512864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e2c13d7a0 0x7f7e2c13db80 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c06df00 tx=0x7f7e1c0195f0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.064+0000 7f7e32300640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:05.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.064+0000 7f7e32300640 1 --2- 172.21.15.5:0/250512864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e2c13f600 0x7f7e2c13fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.064+0000 7f7e32300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.064+0000 7f7e32300640 1 -- 172.21.15.5:0/250512864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c069fa0 con 0x7f7e2c13f600 2024-08-18T21:05:05.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.064+0000 7f7e2b7fe640 1 --2- 172.21.15.5:0/250512864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e2c13f600 0x7f7e2c13fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.064+0000 7f7e2b7fe640 10 monclient: get_auth_request con 0x7f7e2c13f600 auth_method 0 2024-08-18T21:05:05.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.064+0000 7f7e2b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.064+0000 7f7e2b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.064+0000 7f7e2b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.064+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.064+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.064+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.064+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_done global_id 4636 payload 824 2024-08-18T21:05:05.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.064+0000 7f7e2b7fe640 1 -- 172.21.15.5:0/250512864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7e2c09f2f0 con 0x7f7e2c13f600 2024-08-18T21:05:05.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e2b7fe640 1 -- 172.21.15.5:0/250512864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e2c13f600 msgr2=0x7f7e2c13fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e2b7fe640 1 --2- 172.21.15.5:0/250512864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e2c13f600 0x7f7e2c13fa10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c000f90 tx=0x7f7e1c0a7000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e28ff9640 1 -- 172.21.15.5:0/250512864 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7e1c0b2040 con 0x7f7e2c13f600 2024-08-18T21:05:05.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e28ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e28ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:05:05.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e28ff9640 10 monclient: dump: 2024-08-18T21:05:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.078 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e28ff9640 1 -- 172.21.15.5:0/250512864 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f7e1c0b9670 con 0x7f7e2c13f600 2024-08-18T21:05:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e28ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e28ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e28ff9640 1 -- 172.21.15.5:0/250512864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e2c13f600 msgr2=0x7f7e2c13fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e28ff9640 1 --2- 172.21.15.5:0/250512864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e2c13f600 0x7f7e2c13fa10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c000f90 tx=0x7f7e1c0a7000 comp rx=0 tx=0).stop 2024-08-18T21:05:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e28ff9640 1 -- 172.21.15.5:0/250512864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e2c13f600 msgr2=0x7f7e2c13fa10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e28ff9640 1 --2- 172.21.15.5:0/250512864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e2c13f600 0x7f7e2c13fa10 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c000f90 tx=0x7f7e1c0a7000 comp rx=0 tx=0).stop 2024-08-18T21:05:05.078 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 114146, 2024-08-18T21:05:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:05:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.092 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:05.092 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:05.092 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:05.092 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:05.094 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:05.094 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.094 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.094 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.095 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:05.095 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:05.095 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.095 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.095 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.095 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:05.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:05.095 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.095 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.096 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:05.096 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.096 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.096 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:05.096 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.096 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.096 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.096 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:05.096 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:05.096 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.096 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.097 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.097 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:05.097 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:05.097 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.097 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.097 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.097 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:05.097 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:05.098 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.098 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.098 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:05.098 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:05.098 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.098 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.098 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.099 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:05.099 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:05.099 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:05.099 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:05.099 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.100 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.100 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.100 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:05.100 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:05.100 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.100 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.100 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.100 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.100 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.100 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:05.100 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:05.102 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:05.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e32300640 1 -- 172.21.15.5:0/250512864 >> v2:172.21.15.157:6812/631023601 conn(0x7f7e0c03bdf0 msgr2=0x7f7e0c03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e32300640 1 --2- 172.21.15.5:0/250512864 >> v2:172.21.15.157:6812/631023601 conn(0x7f7e0c03bdf0 0x7f7e0c03e2b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400aa40 tx=0x7f7e24008040 comp rx=0 tx=0).stop 2024-08-18T21:05:05.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e32300640 10 monclient: shutdown 2024-08-18T21:05:05.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e32300640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:05.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e32300640 1 -- 172.21.15.5:0/250512864 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7e2c0a6ce0 msgr2=0x7f7e2c1d1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e32300640 1 --2- 172.21.15.5:0/250512864 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7e2c0a6ce0 0x7f7e2c1d1460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c470 tx=0x7f7e1400c930 comp rx=0 tx=0).stop 2024-08-18T21:05:05.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e3089d640 1 -- 172.21.15.5:0/250512864 reap_dead start 2024-08-18T21:05:05.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e3089d640 1 -- 172.21.15.5:0/250512864 reap_dead start 2024-08-18T21:05:05.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e32300640 1 -- 172.21.15.5:0/250512864 shutdown_connections 2024-08-18T21:05:05.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e32300640 1 -- 172.21.15.5:0/250512864 >> 172.21.15.5:0/250512864 conn(0x7f7e2c0acbc0 msgr2=0x7f7e2c13b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:05.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e32300640 1 -- 172.21.15.5:0/250512864 shutdown_connections 2024-08-18T21:05:05.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.068+0000 7f7e32300640 1 -- 172.21.15.5:0/250512864 wait complete. 2024-08-18T21:05:05.104 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:05.104 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:05:05.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:05:05.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 10 monclient: get_monmap_and_config 2024-08-18T21:05:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 10 monclient: build_initial_monmap 2024-08-18T21:05:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 10 monclient: monmap: 2024-08-18T21:05:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:05.225801+0000 2024-08-18T21:05:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:05.225801+0000 2024-08-18T21:05:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:05.225 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 1 Processor -- start 2024-08-18T21:05:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 1 -- start start 2024-08-18T21:05:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 10 monclient: init 2024-08-18T21:05:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 10 monclient: _add_conns ranks=[8,10,2,0,6,5,1,7,3,4,9] 2024-08-18T21:05:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe3c80a6ce0 0x7fe3c80a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 10 monclient(hunting): picked mon.noname-e con 0x7fe3c80a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:05:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3c80a7600 0x7fe3c8139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 10 monclient(hunting): picked mon.noname-f con 0x7fe3c80a7600 addr v2:172.21.15.157:3300/0 2024-08-18T21:05:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe3c8139fe0 0x7fe3c813a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 10 monclient(hunting): picked mon.noname-b con 0x7fe3c8139fe0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe3c80a5000 con 0x7fe3c80a7600 2024-08-18T21:05:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fe3c80a4360 con 0x7fe3c8139fe0 2024-08-18T21:05:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fe3c80a45d0 con 0x7fe3c80a6ce0 2024-08-18T21:05:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cf67d640 10 monclient(hunting): authenticate will time out at 1072.238932s 2024-08-18T21:05:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cdc1a640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe3c8139fe0 0x7fe3c813a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe3c80a6ce0 0x7fe3c80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cdc1a640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe3c8139fe0 0x7fe3c813a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:46094/0 (socket says 172.21.15.5:46094) 2024-08-18T21:05:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe3c80a6ce0 0x7fe3c80a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:59374/0 (socket says 172.21.15.5:59374) 2024-08-18T21:05:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cdc1a640 1 -- 172.21.15.5:0/3967139935 learned_addr learned my addr 172.21.15.5:0/3967139935 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cdc1a640 10 monclient(hunting): get_auth_request con 0x7fe3c8139fe0 auth_method 0 2024-08-18T21:05:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cdc1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cdc1a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cdc1a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 10 monclient(hunting): get_auth_request con 0x7fe3c80a6ce0 auth_method 0 2024-08-18T21:05:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cdc1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cdc1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cdc1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3ccc18640 1 --2- 172.21.15.5:0/3967139935 >> v2:172.21.15.157:3300/0 conn(0x7fe3c80a7600 0x7fe3c8139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3ccc18640 10 monclient(hunting): get_auth_request con 0x7fe3c80a7600 auth_method 0 2024-08-18T21:05:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3ccc18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3ccc18640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3ccc18640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 10 monclient(hunting): handle_auth_done global_id 34226 payload 274 2024-08-18T21:05:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 1 -- 172.21.15.5:0/3967139935 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe3c8139fe0 msgr2=0x7fe3c813a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 1 --2- 172.21.15.5:0/3967139935 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe3c8139fe0 0x7fe3c813a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 1 -- 172.21.15.5:0/3967139935 >> v2:172.21.15.157:3300/0 conn(0x7fe3c80a7600 msgr2=0x7fe3c8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 1 --2- 172.21.15.5:0/3967139935 >> v2:172.21.15.157:3300/0 conn(0x7fe3c80a7600 0x7fe3c8139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 10 monclient: _finish_hunting 0 2024-08-18T21:05:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 1 monclient: found mon.noname-e 2024-08-18T21:05:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:05:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cd419640 1 -- 172.21.15.5:0/3967139935 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c80a32d0 con 0x7fe3c80a6ce0 2024-08-18T21:05:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.220+0000 7fe3cdc1a640 1 --2- 172.21.15.5:0/3967139935 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe3c8139fe0 0x7fe3c813a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:05.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cd419640 1 -- 172.21.15.5:0/3967139935 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe3c80a6ce0 msgr2=0x7fe3c80a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cd419640 1 --2- 172.21.15.5:0/3967139935 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe3c80a6ce0 0x7fe3c80a70c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009dc0 tx=0x7fe3b801c810 comp rx=0 tx=0).ready entity=mon.8 client_cookie=48e9ceb4385d2d6b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3c7fff640 1 -- 172.21.15.5:0/3967139935 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe3b80b2070 con 0x7fe3c80a6ce0 2024-08-18T21:05:05.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3c7fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:05:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3c7fff640 10 monclient: dump: 2024-08-18T21:05:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.237 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.237 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.237 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.237 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.237 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3c7fff640 10 monclient: _finish_auth 0 2024-08-18T21:05:05.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3c7fff640 10 monclient: _check_auth_tickets 2024-08-18T21:05:05.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:05.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 5 monclient: authenticate success, global_id 34226 2024-08-18T21:05:05.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:05:05.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3c7fff640 1 -- 172.21.15.5:0/3967139935 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b80a59b0 con 0x7fe3c80a6ce0 2024-08-18T21:05:05.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3c7fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:05.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:05.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 4 set_mon_vals no callback set 2024-08-18T21:05:05.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3c7fff640 1 -- 172.21.15.5:0/3967139935 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe3b80ab340 con 0x7fe3c80a6ce0 2024-08-18T21:05:05.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3c7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:05:05.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3c7fff640 10 monclient: dump: 2024-08-18T21:05:05.238 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.238 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.238 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.238 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.238 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.238 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.238 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.238 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.239 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 10 monclient: shutdown 2024-08-18T21:05:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 -- 172.21.15.5:0/3967139935 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe3c80a6ce0 msgr2=0x7fe3c80a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 --2- 172.21.15.5:0/3967139935 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe3c80a6ce0 0x7fe3c80a70c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009dc0 tx=0x7fe3b801c810 comp rx=0 tx=0).stop 2024-08-18T21:05:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 -- 172.21.15.5:0/3967139935 shutdown_connections 2024-08-18T21:05:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 --2- 172.21.15.5:0/3967139935 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe3c8139fe0 0x7fe3c813a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 --2- 172.21.15.5:0/3967139935 >> v2:172.21.15.157:3300/0 conn(0x7fe3c80a7600 0x7fe3c8139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 --2- 172.21.15.5:0/3967139935 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe3c80a6ce0 0x7fe3c80a70c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 -- 172.21.15.5:0/3967139935 >> 172.21.15.5:0/3967139935 conn(0x7fe3c80acbc0 msgr2=0x7fe3c80a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 -- 172.21.15.5:0/3967139935 shutdown_connections 2024-08-18T21:05:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 -- 172.21.15.5:0/3967139935 wait complete. 2024-08-18T21:05:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 10 monclient: build_initial_monmap 2024-08-18T21:05:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 10 monclient: monmap: 2024-08-18T21:05:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.241 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:05.241 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:05.241 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:05.241 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:05.241 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:05.241 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:05.241 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:05.241 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:05.241 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:05.241 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 Processor -- start 2024-08-18T21:05:05.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 -- start start 2024-08-18T21:05:05.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 10 monclient: init 2024-08-18T21:05:05.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:05.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 10 monclient: _add_conns ranks=[3,7,1,4,2,5,0,8,6] 2024-08-18T21:05:05.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c80a6ce0 0x7fe3c8135e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 10 monclient(hunting): picked mon.noname-g con 0x7fe3c80a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:05.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe3c80a7600 0x7fe3c8136380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 10 monclient(hunting): picked mon.noname-i con 0x7fe3c80a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:05.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3c8139fe0 0x7fe3c813bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 10 monclient(hunting): picked mon.noname-f con 0x7fe3c8139fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:05:05.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c80a79e0 con 0x7fe3c8139fe0 2024-08-18T21:05:05.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe3c80a8220 con 0x7fe3c80a6ce0 2024-08-18T21:05:05.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fe3c813f490 con 0x7fe3c80a7600 2024-08-18T21:05:05.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:05.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.228+0000 7fe3cf67d640 10 monclient(hunting): authenticate will time out at 1072.247617s 2024-08-18T21:05:05.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3c8139fe0 0x7fe3c813bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3ccc18640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe3c80a7600 0x7fe3c8136380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3c8139fe0 0x7fe3c813bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:60302/0 (socket says 172.21.15.5:60302) 2024-08-18T21:05:05.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 1 -- 172.21.15.5:0/3626612445 learned_addr learned my addr 172.21.15.5:0/3626612445 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:05.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 10 monclient(hunting): get_auth_request con 0x7fe3c8139fe0 auth_method 0 2024-08-18T21:05:05.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3ccc18640 10 monclient(hunting): get_auth_request con 0x7fe3c80a7600 auth_method 0 2024-08-18T21:05:05.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3ccc18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3ccc18640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3ccc18640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cd419640 1 --2- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c80a6ce0 0x7fe3c8135e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cd419640 10 monclient(hunting): get_auth_request con 0x7fe3c80a6ce0 auth_method 0 2024-08-18T21:05:05.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cd419640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cd419640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cd419640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3ccc18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3ccc18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3ccc18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cd419640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cd419640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cd419640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 10 monclient(hunting): handle_auth_done global_id 4654 payload 824 2024-08-18T21:05:05.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 1 -- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe3c80a7600 msgr2=0x7fe3c8136380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 1 --2- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe3c80a7600 0x7fe3c8136380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 1 -- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c80a6ce0 msgr2=0x7fe3c8135e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 1 --2- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c80a6ce0 0x7fe3c8135e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 10 monclient: _finish_hunting 0 2024-08-18T21:05:05.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 1 monclient: found mon.noname-f 2024-08-18T21:05:05.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:05.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:05:05.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 1 -- 172.21.15.5:0/3626612445 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c813d670 con 0x7fe3c8139fe0 2024-08-18T21:05:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 1 -- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3c8139fe0 msgr2=0x7fe3c813bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cdc1a640 1 --2- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3c8139fe0 0x7fe3c813bab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000e930 tx=0x7fe3c000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3c5ffb640 1 -- 172.21.15.5:0/3626612445 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe3c0017070 con 0x7fe3c8139fe0 2024-08-18T21:05:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3c5ffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:05:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3c5ffb640 10 monclient: dump: 2024-08-18T21:05:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.250 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3c5ffb640 10 monclient: _finish_auth 0 2024-08-18T21:05:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3c5ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:05:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3c5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3c5ffb640 1 -- 172.21.15.5:0/3626612445 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c0013470 con 0x7fe3c8139fe0 2024-08-18T21:05:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cf67d640 5 monclient: authenticate success, global_id 4654 2024-08-18T21:05:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3c5ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cf67d640 10 monclient: _renew_subs 2024-08-18T21:05:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cf67d640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:05:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cf67d640 1 -- 172.21.15.5:0/3626612445 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c80a1f30 con 0x7fe3c8139fe0 2024-08-18T21:05:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3c5ffb640 1 -- 172.21.15.5:0/3626612445 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe3c0013620 con 0x7fe3c8139fe0 2024-08-18T21:05:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3c5ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:05:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3c5ffb640 10 monclient: dump: 2024-08-18T21:05:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.252 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3c77fe640 4 set_mon_vals no callback set 2024-08-18T21:05:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cf67d640 10 monclient: _renew_subs 2024-08-18T21:05:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cf67d640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:05:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.232+0000 7fe3cf67d640 1 -- 172.21.15.5:0/3626612445 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c80aa6d0 con 0x7fe3c8139fe0 2024-08-18T21:05:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3cf67d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3cf67d640 1 --2- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c813bff0 0x7fe3c813c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3cf67d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3cf67d640 1 -- 172.21.15.5:0/3626612445 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe3c80a7b60 con 0x7fe3c813bff0 2024-08-18T21:05:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3cd419640 1 --2- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c813bff0 0x7fe3c813c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3cd419640 10 monclient: get_auth_request con 0x7fe3c813bff0 auth_method 0 2024-08-18T21:05:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3cd419640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3cd419640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3cd419640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3cd419640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3cd419640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3cd419640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3c5ffb640 1 -- 172.21.15.5:0/3626612445 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe3c000cb50 con 0x7fe3c8139fe0 2024-08-18T21:05:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3c5ffb640 1 --2- 172.21.15.5:0/3626612445 >> v2:172.21.15.157:6812/631023601 conn(0x7fe3b403bdc0 0x7fe3b403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3c5ffb640 1 -- 172.21.15.5:0/3626612445 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(49..49 src has 11..49) ==== 3898+0+0 (secure 0 0 0) 0x7fe3c000f040 con 0x7fe3c8139fe0 2024-08-18T21:05:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3cd419640 10 monclient(hunting): handle_auth_done global_id 4755 payload 824 2024-08-18T21:05:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3cd419640 1 -- 172.21.15.5:0/3626612445 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3c813c910 con 0x7fe3c813bff0 2024-08-18T21:05:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3ccc18640 1 --2- 172.21.15.5:0/3626612445 >> v2:172.21.15.157:6812/631023601 conn(0x7fe3b403bdc0 0x7fe3b403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.236+0000 7fe3ccc18640 10 monclient: get_auth_request con 0x7fe3b403bdc0 auth_method 0 2024-08-18T21:05:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.240+0000 7fe3cd419640 1 -- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c813bff0 msgr2=0x7fe3c813c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.240+0000 7fe3cd419640 1 --2- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c813bff0 0x7fe3c813c3d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80af000 tx=0x7fe3b80195b0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.240+0000 7fe3c5ffb640 1 -- 172.21.15.5:0/3626612445 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe3b80bd070 con 0x7fe3c813bff0 2024-08-18T21:05:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.240+0000 7fe3c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.240+0000 7fe3c5ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:05:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.240+0000 7fe3c5ffb640 10 monclient: dump: 2024-08-18T21:05:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.255 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.240+0000 7fe3ccc18640 1 --2- 172.21.15.5:0/3626612445 >> v2:172.21.15.157:6812/631023601 conn(0x7fe3b403bdc0 0x7fe3b403e280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe3c813d210 tx=0x7fe3bc008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.240+0000 7fe3c5ffb640 1 -- 172.21.15.5:0/3626612445 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe3b8004560 con 0x7fe3c813bff0 2024-08-18T21:05:05.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.240+0000 7fe3c5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:05.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.240+0000 7fe3c5ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:05.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.240+0000 7fe3c5ffb640 1 -- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c813bff0 msgr2=0x7fe3c813c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.240+0000 7fe3c5ffb640 1 --2- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c813bff0 0x7fe3c813c3d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80af000 tx=0x7fe3b80195b0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.240+0000 7fe3c5ffb640 1 -- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c813bff0 msgr2=0x7fe3c813c3d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:05.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.240+0000 7fe3c5ffb640 1 --2- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c813bff0 0x7fe3c813c3d0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80af000 tx=0x7fe3b80195b0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.244+0000 7fe3cf67d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:05.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.244+0000 7fe3cf67d640 1 --2- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c809df20 0x7fe3c809e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.244+0000 7fe3cf67d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.244+0000 7fe3cf67d640 1 -- 172.21.15.5:0/3626612445 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe3c8051140 con 0x7fe3c809df20 2024-08-18T21:05:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.244+0000 7fe3cd419640 1 --2- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c809df20 0x7fe3c809e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.244+0000 7fe3cd419640 10 monclient: get_auth_request con 0x7fe3c809df20 auth_method 0 2024-08-18T21:05:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.244+0000 7fe3cd419640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.244+0000 7fe3cd419640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.244+0000 7fe3cd419640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.244+0000 7fe3cd419640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.244+0000 7fe3cd419640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.248+0000 7fe3cd419640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.248+0000 7fe3cd419640 10 monclient(hunting): handle_auth_done global_id 4764 payload 824 2024-08-18T21:05:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.248+0000 7fe3cd419640 1 -- 172.21.15.5:0/3626612445 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe3c813f270 con 0x7fe3c809df20 2024-08-18T21:05:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.248+0000 7fe3cd419640 1 -- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c809df20 msgr2=0x7fe3c809e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.248+0000 7fe3cd419640 1 --2- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c809df20 0x7fe3c809e300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe3b801d0b0 tx=0x7fe3b80a7000 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.248+0000 7fe3c5ffb640 1 -- 172.21.15.5:0/3626612445 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe3b80b2040 con 0x7fe3c809df20 2024-08-18T21:05:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.248+0000 7fe3c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.248+0000 7fe3c5ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:05:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.248+0000 7fe3c5ffb640 10 monclient: dump: 2024-08-18T21:05:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.260 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.260 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.260 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.260 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.260 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.260 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.260 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.260 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.260 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3c5ffb640 1 -- 172.21.15.5:0/3626612445 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7fe3b80b9460 con 0x7fe3c809df20 2024-08-18T21:05:05.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3c5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:05.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3c5ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:05.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3c5ffb640 1 -- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c809df20 msgr2=0x7fe3c809e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3c5ffb640 1 --2- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c809df20 0x7fe3c809e300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe3b801d0b0 tx=0x7fe3b80a7000 comp rx=0 tx=0).stop 2024-08-18T21:05:05.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3c5ffb640 1 -- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c809df20 msgr2=0x7fe3c809e300 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:05.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3c5ffb640 1 --2- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3c809df20 0x7fe3c809e300 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe3b801d0b0 tx=0x7fe3b80a7000 comp rx=0 tx=0).stop 2024-08-18T21:05:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:05.261 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:05.261 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:05.261 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:05.261 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:05.261 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 114346, 2024-08-18T21:05:05.261 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:05.262 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:05.262 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:05.262 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:05.262 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:05.262 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:05.262 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:05.262 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:05.262 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:05.262 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:05.262 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.262 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:05:05.262 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:05.262 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:05.263 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:05.263 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:05.263 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:05.263 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:05.263 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:05.263 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:05.263 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:05.263 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:05.263 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:05.263 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:05.263 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:05.263 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:05.263 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.263 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:05.264 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:05.264 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:05.264 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:05.264 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:05.264 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:05.264 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:05.264 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:05.264 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:05.264 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:05.264 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:05.264 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:05.264 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:05.264 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.265 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:05.265 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:05.265 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:05.265 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:05.265 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:05.265 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:05.265 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:05.265 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:05.265 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:05.265 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:05.265 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:05.265 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:05.265 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:05.265 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:05.266 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:05.266 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:05.266 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:05.266 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:05.266 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:05.266 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:05.266 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:05.266 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:05.266 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:05.266 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:05.266 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:05.266 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:05.266 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:05.266 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:05.267 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.267 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:05.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.267 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:05.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:05.267 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:05.267 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.267 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.267 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.267 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:05.267 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.268 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.268 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:05.268 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.268 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.268 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.268 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:05.268 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:05.268 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.268 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.268 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:05.269 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:05.269 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.269 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.269 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:05.269 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.269 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:05.270 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.270 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.270 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.270 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:05.270 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:05.270 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.270 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.270 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:05.270 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:05.270 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.271 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.271 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:05.271 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.271 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:05.271 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.271 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.271 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.272 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:05.272 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:05.272 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.272 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.272 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.272 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:05.272 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:05.272 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.272 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.272 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.272 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:05.273 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.273 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.273 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:05.273 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.273 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.273 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.273 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:05.273 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:05.273 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.273 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.273 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.274 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:05.274 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:05.274 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.274 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.274 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.274 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:05.274 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.274 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.275 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:05.275 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.275 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.275 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.275 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:05.275 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:05.275 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.275 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.275 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.275 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:05.275 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:05.276 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.276 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.276 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.276 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:05.276 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.276 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.276 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:05.276 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.276 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.276 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.277 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:05.277 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:05.277 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.277 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.277 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:05.277 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:05.277 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.277 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.277 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.277 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:05.278 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.278 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.278 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:05.278 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.278 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.278 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.278 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:05.278 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:05.278 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.279 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.279 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.279 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:05.279 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:05.279 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.279 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.279 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.279 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:05.279 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:05.281 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:05.281 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.281 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.281 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.281 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:05.281 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.281 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.281 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:05.281 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.281 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.281 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.282 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:05.282 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:05.282 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.282 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.282 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.282 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.282 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.282 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:05.282 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:05.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.283 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:05.283 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:05.283 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:05.283 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.283 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.283 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:05.283 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.283 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:05.283 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:05.283 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:05:05.283 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.283 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.283 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:05.284 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:05.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3cf67d640 1 -- 172.21.15.5:0/3626612445 >> v2:172.21.15.157:6812/631023601 conn(0x7fe3b403bdc0 msgr2=0x7fe3b403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3cf67d640 1 --2- 172.21.15.5:0/3626612445 >> v2:172.21.15.157:6812/631023601 conn(0x7fe3b403bdc0 0x7fe3b403e280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe3c813d210 tx=0x7fe3bc008040 comp rx=0 tx=0).stop 2024-08-18T21:05:05.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3cf67d640 10 monclient: shutdown 2024-08-18T21:05:05.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3cf67d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:05.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3cf67d640 1 -- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3c8139fe0 msgr2=0x7fe3c813bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3cf67d640 1 --2- 172.21.15.5:0/3626612445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3c8139fe0 0x7fe3c813bab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000e930 tx=0x7fe3c000edf0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3cdc1a640 1 -- 172.21.15.5:0/3626612445 reap_dead start 2024-08-18T21:05:05.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3cdc1a640 1 -- 172.21.15.5:0/3626612445 reap_dead start 2024-08-18T21:05:05.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3cf67d640 1 -- 172.21.15.5:0/3626612445 shutdown_connections 2024-08-18T21:05:05.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3cf67d640 1 -- 172.21.15.5:0/3626612445 >> 172.21.15.5:0/3626612445 conn(0x7fe3c80acbc0 msgr2=0x7fe3c80aae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:05.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3cf67d640 1 -- 172.21.15.5:0/3626612445 shutdown_connections 2024-08-18T21:05:05.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.252+0000 7fe3cf67d640 1 -- 172.21.15.5:0/3626612445 wait complete. 2024-08-18T21:05:05.286 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:05.286 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:05:05.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:05:05.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.400+0000 7fe0320a7640 10 monclient: get_monmap_and_config 2024-08-18T21:05:05.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.400+0000 7fe0320a7640 10 monclient: build_initial_monmap 2024-08-18T21:05:05.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.400+0000 7fe0320a7640 10 monclient: monmap: 2024-08-18T21:05:05.405 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:05.405 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.405 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:05.406964+0000 2024-08-18T21:05:05.405 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:05.406964+0000 2024-08-18T21:05:05.405 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:05.406 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.400+0000 7fe0320a7640 1 Processor -- start 2024-08-18T21:05:05.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.400+0000 7fe0320a7640 1 -- start start 2024-08-18T21:05:05.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.400+0000 7fe0320a7640 10 monclient: init 2024-08-18T21:05:05.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe0320a7640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:05.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe0320a7640 10 monclient: _add_conns ranks=[4,9,10,0,6,5,1,8,3,2,7] 2024-08-18T21:05:05.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe0320a7640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe02c0a5a50 0x7fe02c137800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe0320a7640 10 monclient(hunting): picked mon.noname-c con 0x7fe02c0a5a50 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:05.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe0320a7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe02c137d40 0x7fe02c138120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe0320a7640 10 monclient(hunting): picked mon.noname-a con 0x7fe02c137d40 addr v2:172.21.15.5:3300/0 2024-08-18T21:05:05.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe0320a7640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe02c0a1540 0x7fe02c0a1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe0320a7640 10 monclient(hunting): picked mon.noname-f con 0x7fe02c0a1540 addr v2:172.21.15.157:3300/0 2024-08-18T21:05:05.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe0320a7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe0320a7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe02c0a5e30 con 0x7fe02c137d40 2024-08-18T21:05:05.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe0320a7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe0320a7640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe02c0a3740 con 0x7fe02c0a1540 2024-08-18T21:05:05.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe0320a7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe0320a7640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fe02c0a67a0 con 0x7fe02c0a5a50 2024-08-18T21:05:05.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe0320a7640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:05.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe0320a7640 10 monclient(hunting): authenticate will time out at 1072.420153s 2024-08-18T21:05:05.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe02c137d40 0x7fe02c138120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe02c0a5a50 0x7fe02c137800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe02c137d40 0x7fe02c138120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42704/0 (socket says 172.21.15.5:42704) 2024-08-18T21:05:05.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02affd640 1 -- 172.21.15.5:0/273035678 learned_addr learned my addr 172.21.15.5:0/273035678 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:05.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 10 monclient(hunting): get_auth_request con 0x7fe02c0a5a50 auth_method 0 2024-08-18T21:05:05.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02affd640 10 monclient(hunting): get_auth_request con 0x7fe02c137d40 auth_method 0 2024-08-18T21:05:05.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 10 monclient(hunting): handle_auth_done global_id 4792 payload 274 2024-08-18T21:05:05.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02bfff640 1 --2- 172.21.15.5:0/273035678 >> v2:172.21.15.157:3300/0 conn(0x7fe02c0a1540 0x7fe02c0a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 1 -- 172.21.15.5:0/273035678 >> v2:172.21.15.157:3300/0 conn(0x7fe02c0a1540 msgr2=0x7fe02c0a1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:05.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 1 --2- 172.21.15.5:0/273035678 >> v2:172.21.15.157:3300/0 conn(0x7fe02c0a1540 0x7fe02c0a1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 1 -- 172.21.15.5:0/273035678 >> v2:172.21.15.5:3300/0 conn(0x7fe02c137d40 msgr2=0x7fe02c138120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:05.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 1 --2- 172.21.15.5:0/273035678 >> v2:172.21.15.5:3300/0 conn(0x7fe02c137d40 0x7fe02c138120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:05:05.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 1 monclient: found mon.noname-c 2024-08-18T21:05:05.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:05.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:05:05.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02b7fe640 1 -- 172.21.15.5:0/273035678 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c0a2660 con 0x7fe02c0a5a50 2024-08-18T21:05:05.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02bfff640 10 monclient: get_auth_request con 0x7fe02c0a1540 auth_method 0 2024-08-18T21:05:05.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02affd640 1 --2- 172.21.15.5:0/273035678 >> v2:172.21.15.5:3300/0 conn(0x7fe02c137d40 0x7fe02c138120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:05.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.404+0000 7fe02bfff640 1 --2- 172.21.15.5:0/273035678 >> v2:172.21.15.157:3300/0 conn(0x7fe02c0a1540 0x7fe02c0a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:05:05.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02b7fe640 1 -- 172.21.15.5:0/273035678 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe02c0a5a50 msgr2=0x7fe02c137800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02b7fe640 1 --2- 172.21.15.5:0/273035678 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe02c0a5a50 0x7fe02c137800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0a2e60 tx=0x7fe01c01c320 comp rx=0 tx=0).ready entity=mon.4 client_cookie=63684bfa1b08927a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02a7fc640 1 -- 172.21.15.5:0/273035678 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe01c0b0070 con 0x7fe02c0a5a50 2024-08-18T21:05:05.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:05:05.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02a7fc640 10 monclient: dump: 2024-08-18T21:05:05.417 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.417 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.417 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.418 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.418 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.418 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.418 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.418 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.418 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.418 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.418 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.418 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.418 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.418 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.418 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.418 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02a7fc640 10 monclient: _finish_auth 0 2024-08-18T21:05:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02a7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:05:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02a7fc640 1 -- 172.21.15.5:0/273035678 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe01c0aa810 con 0x7fe02c0a5a50 2024-08-18T21:05:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02a7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02a7fc640 1 -- 172.21.15.5:0/273035678 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe01c0aae30 con 0x7fe02c0a5a50 2024-08-18T21:05:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 5 monclient: authenticate success, global_id 4792 2024-08-18T21:05:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 4 set_mon_vals no callback set 2024-08-18T21:05:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02a7fc640 10 monclient: dump: 2024-08-18T21:05:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.420 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.420 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.420 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.420 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.420 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.420 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.420 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.420 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.420 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.420 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.420 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.420 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.420 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.421 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 10 monclient: shutdown 2024-08-18T21:05:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 -- 172.21.15.5:0/273035678 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe02c0a5a50 msgr2=0x7fe02c137800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 --2- 172.21.15.5:0/273035678 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe02c0a5a50 0x7fe02c137800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0a2e60 tx=0x7fe01c01c320 comp rx=0 tx=0).stop 2024-08-18T21:05:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 -- 172.21.15.5:0/273035678 shutdown_connections 2024-08-18T21:05:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 --2- 172.21.15.5:0/273035678 >> v2:172.21.15.157:3300/0 conn(0x7fe02c0a1540 0x7fe02c0a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 --2- 172.21.15.5:0/273035678 >> v2:172.21.15.5:3300/0 conn(0x7fe02c137d40 0x7fe02c138120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 --2- 172.21.15.5:0/273035678 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe02c0a5a50 0x7fe02c137800 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 -- 172.21.15.5:0/273035678 >> 172.21.15.5:0/273035678 conn(0x7fe02c0688d0 msgr2=0x7fe02c068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 -- 172.21.15.5:0/273035678 shutdown_connections 2024-08-18T21:05:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 -- 172.21.15.5:0/273035678 wait complete. 2024-08-18T21:05:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 10 monclient: build_initial_monmap 2024-08-18T21:05:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 10 monclient: monmap: 2024-08-18T21:05:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:05.423 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:05.423 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:05.423 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:05.423 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:05.423 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 Processor -- start 2024-08-18T21:05:05.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 -- start start 2024-08-18T21:05:05.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 10 monclient: init 2024-08-18T21:05:05.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:05.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 10 monclient: _add_conns ranks=[7,4,2,1,0,8,5,3,6] 2024-08-18T21:05:05.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe02c0a1540 0x7fe02c1341f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 10 monclient(hunting): picked mon.noname-i con 0x7fe02c0a1540 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:05.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe02c0a5a50 0x7fe02c134730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 10 monclient(hunting): picked mon.noname-c con 0x7fe02c0a5a50 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe02c137d40 0x7fe02c139a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 10 monclient(hunting): picked mon.noname-b con 0x7fe02c137d40 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fe02c0a2420 con 0x7fe02c137d40 2024-08-18T21:05:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fe02c0a22a0 con 0x7fe02c0a5a50 2024-08-18T21:05:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fe02c141480 con 0x7fe02c0a1540 2024-08-18T21:05:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe0320a7640 10 monclient(hunting): authenticate will time out at 1072.427378s 2024-08-18T21:05:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe02c0a5a50 0x7fe02c134730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe02c0a5a50 0x7fe02c134730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:49264/0 (socket says 172.21.15.5:49264) 2024-08-18T21:05:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 1 -- 172.21.15.5:0/2007293139 learned_addr learned my addr 172.21.15.5:0/2007293139 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:05.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 10 monclient(hunting): get_auth_request con 0x7fe02c0a5a50 auth_method 0 2024-08-18T21:05:05.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02bfff640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe02c137d40 0x7fe02c139a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02bfff640 10 monclient(hunting): get_auth_request con 0x7fe02c137d40 auth_method 0 2024-08-18T21:05:05.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02b7fe640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe02c0a1540 0x7fe02c1341f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 10 monclient(hunting): handle_auth_done global_id 4801 payload 824 2024-08-18T21:05:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 1 -- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe02c0a1540 msgr2=0x7fe02c1341f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe02c0a1540 0x7fe02c1341f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 1 -- 172.21.15.5:0/2007293139 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe02c137d40 msgr2=0x7fe02c139a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe02c137d40 0x7fe02c139a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 10 monclient: _finish_hunting 0 2024-08-18T21:05:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 1 monclient: found mon.noname-c 2024-08-18T21:05:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:05:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02affd640 1 -- 172.21.15.5:0/2007293139 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c13d490 con 0x7fe02c0a5a50 2024-08-18T21:05:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02b7fe640 10 monclient: get_auth_request con 0x7fe02c0a1540 auth_method 0 2024-08-18T21:05:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.408+0000 7fe02b7fe640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe02c0a1540 0x7fe02c1341f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:05:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe02affd640 1 -- 172.21.15.5:0/2007293139 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe02c0a5a50 msgr2=0x7fe02c134730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe02affd640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe02c0a5a50 0x7fe02c134730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe02000e9d0 tx=0x7fe02000ee90 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe013fff640 1 -- 172.21.15.5:0/2007293139 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe020017070 con 0x7fe02c0a5a50 2024-08-18T21:05:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe013fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe013fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:05:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe013fff640 10 monclient: dump: 2024-08-18T21:05:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.428 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.428 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.428 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.428 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.428 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.428 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.428 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe013fff640 10 monclient: _finish_auth 0 2024-08-18T21:05:05.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe013fff640 10 monclient: _check_auth_tickets 2024-08-18T21:05:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe013fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe013fff640 1 -- 172.21.15.5:0/2007293139 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02000cc70 con 0x7fe02c0a5a50 2024-08-18T21:05:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe013fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe013fff640 1 -- 172.21.15.5:0/2007293139 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe02000ce20 con 0x7fe02c0a5a50 2024-08-18T21:05:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe013fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe013fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe013fff640 10 monclient: dump: 2024-08-18T21:05:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.430 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe029ffb640 4 set_mon_vals no callback set 2024-08-18T21:05:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe0320a7640 5 monclient: authenticate success, global_id 4801 2024-08-18T21:05:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe0320a7640 10 monclient: _renew_subs 2024-08-18T21:05:05.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe0320a7640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:05:05.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe0320a7640 1 -- 172.21.15.5:0/2007293139 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02c13d770 con 0x7fe02c0a5a50 2024-08-18T21:05:05.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe0320a7640 10 monclient: _renew_subs 2024-08-18T21:05:05.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe0320a7640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:05:05.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe0320a7640 1 -- 172.21.15.5:0/2007293139 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fe02c13dfa0 con 0x7fe02c0a5a50 2024-08-18T21:05:05.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe0320a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:05.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe0320a7640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe02c139f40 0x7fe02c13a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe0320a7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe0320a7640 1 -- 172.21.15.5:0/2007293139 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe02c051140 con 0x7fe02c139f40 2024-08-18T21:05:05.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.412+0000 7fe013fff640 1 -- 172.21.15.5:0/2007293139 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe02001a070 con 0x7fe02c0a5a50 2024-08-18T21:05:05.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe013fff640 1 --2- 172.21.15.5:0/2007293139 >> v2:172.21.15.157:6812/631023601 conn(0x7fe01803bdc0 0x7fe01803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe02b7fe640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe02c139f40 0x7fe02c13a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe013fff640 1 -- 172.21.15.5:0/2007293139 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(49..49 src has 11..49) ==== 3898+0+0 (secure 0 0 0) 0x7fe02000f040 con 0x7fe02c0a5a50 2024-08-18T21:05:05.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe02b7fe640 10 monclient: get_auth_request con 0x7fe02c139f40 auth_method 0 2024-08-18T21:05:05.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe02b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe02b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe02b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe02b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe02b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe02b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe02bfff640 1 --2- 172.21.15.5:0/2007293139 >> v2:172.21.15.157:6812/631023601 conn(0x7fe01803bdc0 0x7fe01803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe02bfff640 10 monclient: get_auth_request con 0x7fe01803bdc0 auth_method 0 2024-08-18T21:05:05.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe02b7fe640 10 monclient(hunting): handle_auth_done global_id 34214 payload 824 2024-08-18T21:05:05.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe02b7fe640 1 -- 172.21.15.5:0/2007293139 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe02c068cb0 con 0x7fe02c139f40 2024-08-18T21:05:05.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe02b7fe640 1 -- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe02c139f40 msgr2=0x7fe02c13a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe02b7fe640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe02c139f40 0x7fe02c13a320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0ab000 tx=0x7fe01c0190c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe02bfff640 1 --2- 172.21.15.5:0/2007293139 >> v2:172.21.15.157:6812/631023601 conn(0x7fe01803bdc0 0x7fe01803e280 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe02c13b4e0 tx=0x7fe0240074a0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe013fff640 1 -- 172.21.15.5:0/2007293139 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe01c0b9020 con 0x7fe02c139f40 2024-08-18T21:05:05.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe013fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe013fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:05:05.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.416+0000 7fe013fff640 10 monclient: dump: 2024-08-18T21:05:05.436 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.436 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.436 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.437 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.420+0000 7fe013fff640 1 -- 172.21.15.5:0/2007293139 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe01c003910 con 0x7fe02c139f40 2024-08-18T21:05:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.420+0000 7fe013fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.420+0000 7fe013fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.420+0000 7fe013fff640 1 -- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe02c139f40 msgr2=0x7fe02c13a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.420+0000 7fe013fff640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe02c139f40 0x7fe02c13a320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0ab000 tx=0x7fe01c0190c0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.420+0000 7fe013fff640 1 -- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe02c139f40 msgr2=0x7fe02c13a320 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.420+0000 7fe013fff640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe02c139f40 0x7fe02c13a320 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0ab000 tx=0x7fe01c0190c0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.424+0000 7fe0320a7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.424+0000 7fe0320a7640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe02c13a860 0x7fe02c0719d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.424+0000 7fe0320a7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.424+0000 7fe0320a7640 1 -- 172.21.15.5:0/2007293139 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe02c137800 con 0x7fe02c13a860 2024-08-18T21:05:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.424+0000 7fe02b7fe640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe02c13a860 0x7fe02c0719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.424+0000 7fe02b7fe640 10 monclient: get_auth_request con 0x7fe02c13a860 auth_method 0 2024-08-18T21:05:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.424+0000 7fe02b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.424+0000 7fe02b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.424+0000 7fe02b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.424+0000 7fe02b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.424+0000 7fe02b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.424+0000 7fe02b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.424+0000 7fe02b7fe640 10 monclient(hunting): handle_auth_done global_id 34223 payload 824 2024-08-18T21:05:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.424+0000 7fe02b7fe640 1 -- 172.21.15.5:0/2007293139 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe02c13baf0 con 0x7fe02c13a860 2024-08-18T21:05:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.428+0000 7fe02b7fe640 1 -- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe02c13a860 msgr2=0x7fe02c0719d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.428+0000 7fe02b7fe640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe02c13a860 0x7fe02c0719d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe01c01a9d0 tx=0x7fe01c0a8000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.428+0000 7fe013fff640 1 -- 172.21.15.5:0/2007293139 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe01c0b9040 con 0x7fe02c13a860 2024-08-18T21:05:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.428+0000 7fe013fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.428+0000 7fe013fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:05:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.428+0000 7fe013fff640 10 monclient: dump: 2024-08-18T21:05:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.441 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.428+0000 7fe013fff640 1 -- 172.21.15.5:0/2007293139 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9246 (secure 0 0 0) 0x7fe01c0be620 con 0x7fe02c13a860 2024-08-18T21:05:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.428+0000 7fe013fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.428+0000 7fe013fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.428+0000 7fe013fff640 1 -- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe02c13a860 msgr2=0x7fe02c0719d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.428+0000 7fe013fff640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe02c13a860 0x7fe02c0719d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe01c01a9d0 tx=0x7fe01c0a8000 comp rx=0 tx=0).stop 2024-08-18T21:05:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.428+0000 7fe013fff640 1 -- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe02c13a860 msgr2=0x7fe02c0719d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.428+0000 7fe013fff640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe02c13a860 0x7fe02c0719d0 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe01c01a9d0 tx=0x7fe01c0a8000 comp rx=0 tx=0).stop 2024-08-18T21:05:05.442 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 25223, 2024-08-18T21:05:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:05:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.460 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:05.460 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:05.460 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.460 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.460 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.460 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.460 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.460 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:05.460 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:05.460 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.460 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.460 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.460 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.460 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:05.461 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.461 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.461 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.461 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:05.461 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.461 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.461 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.461 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:05.461 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:05.461 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.461 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.461 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.462 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:05.462 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:05.462 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.462 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.462 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.462 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:05.462 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.462 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.463 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:05.463 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.463 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.463 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.463 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:05.463 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:05.463 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.463 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.463 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.463 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.463 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.463 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:05.464 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:05.464 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.464 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:05.464 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:05.464 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:05.464 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.464 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.464 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:05.464 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.464 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:05.464 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:05.464 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:05.464 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.464 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.465 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:05.465 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:05.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.432+0000 7fe0320a7640 1 -- 172.21.15.5:0/2007293139 >> v2:172.21.15.157:6812/631023601 conn(0x7fe01803bdc0 msgr2=0x7fe01803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.432+0000 7fe0320a7640 1 --2- 172.21.15.5:0/2007293139 >> v2:172.21.15.157:6812/631023601 conn(0x7fe01803bdc0 0x7fe01803e280 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe02c13b4e0 tx=0x7fe0240074a0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.432+0000 7fe0320a7640 10 monclient: shutdown 2024-08-18T21:05:05.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.432+0000 7fe0320a7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:05.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.432+0000 7fe0320a7640 1 -- 172.21.15.5:0/2007293139 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe02c0a5a50 msgr2=0x7fe02c134730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.432+0000 7fe0320a7640 1 --2- 172.21.15.5:0/2007293139 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe02c0a5a50 0x7fe02c134730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe02000e9d0 tx=0x7fe02000ee90 comp rx=0 tx=0).stop 2024-08-18T21:05:05.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.432+0000 7fe02bfff640 1 -- 172.21.15.5:0/2007293139 reap_dead start 2024-08-18T21:05:05.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.432+0000 7fe02bfff640 1 -- 172.21.15.5:0/2007293139 reap_dead start 2024-08-18T21:05:05.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.432+0000 7fe0320a7640 1 -- 172.21.15.5:0/2007293139 shutdown_connections 2024-08-18T21:05:05.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.432+0000 7fe0320a7640 1 -- 172.21.15.5:0/2007293139 >> 172.21.15.5:0/2007293139 conn(0x7fe02c0688d0 msgr2=0x7fe02c0a8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:05.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.432+0000 7fe0320a7640 1 -- 172.21.15.5:0/2007293139 shutdown_connections 2024-08-18T21:05:05.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.432+0000 7fe0320a7640 1 -- 172.21.15.5:0/2007293139 wait complete. 2024-08-18T21:05:05.467 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:05.468 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:05:05.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:05:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 10 monclient: get_monmap_and_config 2024-08-18T21:05:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 10 monclient: build_initial_monmap 2024-08-18T21:05:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 10 monclient: monmap: 2024-08-18T21:05:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:05.593212+0000 2024-08-18T21:05:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:05.593212+0000 2024-08-18T21:05:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:05.592 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.592 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:05.592 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:05.592 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:05.592 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:05.592 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:05.592 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:05.592 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:05.592 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:05.592 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:05.592 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:05.592 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:05.592 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 1 Processor -- start 2024-08-18T21:05:05.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 1 -- start start 2024-08-18T21:05:05.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 10 monclient: init 2024-08-18T21:05:05.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:05.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 10 monclient: _add_conns ranks=[5,7,3,8,1,10,2,4,0,9,6] 2024-08-18T21:05:05.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f18280a1ff0 0x7f1828137430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 10 monclient(hunting): picked mon.noname-h con 0x7f18280a1ff0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:05.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1828137970 0x7f1828137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 10 monclient(hunting): picked mon.noname-i con 0x7f1828137970 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1828133eb0 0x7f1828134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 10 monclient(hunting): picked mon.noname-g con 0x7f1828133eb0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f182809dd50 con 0x7f1828133eb0 2024-08-18T21:05:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f18280a23d0 con 0x7f18280a1ff0 2024-08-18T21:05:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f182809e970 con 0x7f1828137970 2024-08-18T21:05:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f18304b1640 10 monclient(hunting): authenticate will time out at 1072.606292s 2024-08-18T21:05:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f18280a1ff0 0x7f1828137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f18280a1ff0 0x7f1828137430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:41242/0 (socket says 172.21.15.5:41242) 2024-08-18T21:05:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 1 -- 172.21.15.5:0/2481480823 learned_addr learned my addr 172.21.15.5:0/2481480823 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 10 monclient(hunting): get_auth_request con 0x7f18280a1ff0 auth_method 0 2024-08-18T21:05:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182da4c640 1 --2- 172.21.15.5:0/2481480823 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1828137970 0x7f1828137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182da4c640 10 monclient(hunting): get_auth_request con 0x7f1828137970 auth_method 0 2024-08-18T21:05:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182da4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182da4c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182da4c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182ea4e640 1 --2- 172.21.15.5:0/2481480823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1828133eb0 0x7f1828134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182ea4e640 10 monclient(hunting): get_auth_request con 0x7f1828133eb0 auth_method 0 2024-08-18T21:05:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182ea4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182ea4e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182ea4e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182da4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182da4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182da4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182ea4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182ea4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182ea4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 10 monclient(hunting): handle_auth_done global_id 34232 payload 274 2024-08-18T21:05:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 1 -- 172.21.15.5:0/2481480823 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1828137970 msgr2=0x7f1828137dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:05.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 1 --2- 172.21.15.5:0/2481480823 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1828137970 0x7f1828137dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 1 -- 172.21.15.5:0/2481480823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1828133eb0 msgr2=0x7f1828134330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:05.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 1 --2- 172.21.15.5:0/2481480823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1828133eb0 0x7f1828134330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 10 monclient: _finish_hunting 0 2024-08-18T21:05:05.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 1 monclient: found mon.noname-h 2024-08-18T21:05:05.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:05.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:05:05.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.588+0000 7f182e24d640 1 -- 172.21.15.5:0/2481480823 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182809ec50 con 0x7f18280a1ff0 2024-08-18T21:05:05.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.592+0000 7f182e24d640 1 -- 172.21.15.5:0/2481480823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f18280a1ff0 msgr2=0x7f1828137430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 1 --2- 172.21.15.5:0/2481480823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f18280a1ff0 0x7f1828137430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f18240098a0 tx=0x7f182401c440 comp rx=0 tx=0).ready entity=mon.5 client_cookie=57a0859af8c65049 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182d24b640 1 -- 172.21.15.5:0/2481480823 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f18240b0070 con 0x7f18280a1ff0 2024-08-18T21:05:05.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182d24b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182d24b640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:05:05.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182d24b640 10 monclient: dump: 2024-08-18T21:05:05.603 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.603 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.603 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.603 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.603 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.604 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182d24b640 10 monclient: _finish_auth 0 2024-08-18T21:05:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182d24b640 10 monclient: _check_auth_tickets 2024-08-18T21:05:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182d24b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182d24b640 1 -- 172.21.15.5:0/2481480823 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18240aa810 con 0x7f18280a1ff0 2024-08-18T21:05:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182d24b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182d24b640 1 -- 172.21.15.5:0/2481480823 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f18240a9300 con 0x7f18280a1ff0 2024-08-18T21:05:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182d24b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182d24b640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:05:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182d24b640 10 monclient: dump: 2024-08-18T21:05:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.606 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 5 monclient: authenticate success, global_id 34232 2024-08-18T21:05:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 4 set_mon_vals no callback set 2024-08-18T21:05:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 10 monclient: shutdown 2024-08-18T21:05:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 -- 172.21.15.5:0/2481480823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f18280a1ff0 msgr2=0x7f1828137430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 --2- 172.21.15.5:0/2481480823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f18280a1ff0 0x7f1828137430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f18240098a0 tx=0x7f182401c440 comp rx=0 tx=0).stop 2024-08-18T21:05:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 -- 172.21.15.5:0/2481480823 shutdown_connections 2024-08-18T21:05:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 --2- 172.21.15.5:0/2481480823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1828133eb0 0x7f1828134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 --2- 172.21.15.5:0/2481480823 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1828137970 0x7f1828137dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 --2- 172.21.15.5:0/2481480823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f18280a1ff0 0x7f1828137430 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 -- 172.21.15.5:0/2481480823 >> 172.21.15.5:0/2481480823 conn(0x7f18280a8020 msgr2=0x7f18280a8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 -- 172.21.15.5:0/2481480823 shutdown_connections 2024-08-18T21:05:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 -- 172.21.15.5:0/2481480823 wait complete. 2024-08-18T21:05:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 10 monclient: build_initial_monmap 2024-08-18T21:05:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 10 monclient: monmap: 2024-08-18T21:05:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:05.609 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 Processor -- start 2024-08-18T21:05:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 -- start start 2024-08-18T21:05:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 10 monclient: init 2024-08-18T21:05:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 10 monclient: _add_conns ranks=[6,3,5,4,2,7,0,1,8] 2024-08-18T21:05:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f18280a1ff0 0x7f182813c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 10 monclient(hunting): picked mon.noname-d con 0x7f18280a1ff0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1828133eb0 0x7f182813cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 10 monclient(hunting): picked mon.noname-g con 0x7f1828133eb0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1828137970 0x7f182813d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 10 monclient(hunting): picked mon.noname-h con 0x7f1828137970 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1828141370 con 0x7f1828133eb0 2024-08-18T21:05:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f18281411f0 con 0x7f1828137970 2024-08-18T21:05:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f18281414f0 con 0x7f18280a1ff0 2024-08-18T21:05:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f18304b1640 10 monclient(hunting): authenticate will time out at 1072.614829s 2024-08-18T21:05:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f18280a1ff0 0x7f182813c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f18280a1ff0 0x7f182813c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:36148/0 (socket says 172.21.15.5:36148) 2024-08-18T21:05:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 1 -- 172.21.15.5:0/1110024107 learned_addr learned my addr 172.21.15.5:0/1110024107 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 10 monclient(hunting): get_auth_request con 0x7f18280a1ff0 auth_method 0 2024-08-18T21:05:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182ea4e640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1828137970 0x7f182813d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182ea4e640 10 monclient(hunting): get_auth_request con 0x7f1828137970 auth_method 0 2024-08-18T21:05:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182ea4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182ea4e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182ea4e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182da4c640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1828133eb0 0x7f182813cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 10 monclient(hunting): handle_auth_done global_id 4776 payload 824 2024-08-18T21:05:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 1 -- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1828137970 msgr2=0x7f182813d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1828137970 0x7f182813d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 1 -- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1828133eb0 msgr2=0x7f182813cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1828133eb0 0x7f182813cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 10 monclient: _finish_hunting 0 2024-08-18T21:05:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 1 monclient: found mon.noname-d 2024-08-18T21:05:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:05:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182e24d640 1 -- 172.21.15.5:0/1110024107 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18281369e0 con 0x7f18280a1ff0 2024-08-18T21:05:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182da4c640 10 monclient: get_auth_request con 0x7f1828133eb0 auth_method 0 2024-08-18T21:05:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.596+0000 7f182da4c640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1828133eb0 0x7f182813cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:05:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182e24d640 1 -- 172.21.15.5:0/1110024107 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f18280a1ff0 msgr2=0x7f182813c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182e24d640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f18280a1ff0 0x7f182813c890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1824000c10 tx=0x7f18240191e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182e24d640 1 -- 172.21.15.5:0/1110024107 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f18280a1ff0 msgr2=0x7f182813c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-18T21:05:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182e24d640 1 -- 172.21.15.5:0/1110024107 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f18280a1ff0 msgr2=0x7f182813c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:05:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182e24d640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f18280a1ff0 0x7f182813c890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1824000c10 tx=0x7f18240191e0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182e24d640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f18280a1ff0 0x7f182813c890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1824000c10 tx=0x7f18240191e0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 10 monclient: ms_handle_reset current mon [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f18280a1ff0 msgr2=0x7f182813c890 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f18280a1ff0 0x7f182813c890 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 10 monclient: _add_conns ranks=[1,8,7,2,0,4] 2024-08-18T21:05:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f180c0035e0 0x7f180c005a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 10 monclient(hunting): picked mon.noname-f con 0x7f180c0035e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:05:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f180c006580 0x7f180c008a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 10 monclient(hunting): picked mon.noname-e con 0x7f180c006580 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:05:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f180c0095b0 0x7f180c00ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 10 monclient(hunting): picked mon.noname-i con 0x7f180c0095b0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f180c00c660 con 0x7f180c0035e0 2024-08-18T21:05:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f180c00c7e0 con 0x7f180c0095b0 2024-08-18T21:05:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f180c00c9e0 con 0x7f180c006580 2024-08-18T21:05:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f181effd640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f180c0095b0 0x7f180c00ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 10 monclient(hunting): get_auth_request con 0x7f180c0095b0 auth_method 0 2024-08-18T21:05:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:05:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 10 monclient(hunting): handle_auth_done global_id 4776 payload 293 2024-08-18T21:05:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 1 -- 172.21.15.5:0/1110024107 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f180c006580 msgr2=0x7f180c008a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f180c006580 0x7f180c008a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 1 -- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f180c0035e0 msgr2=0x7f180c005a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:05:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f180c0035e0 0x7f180c005a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 10 monclient: _finish_hunting 0 2024-08-18T21:05:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 1 monclient: found mon.noname-i 2024-08-18T21:05:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:05:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 1 -- 172.21.15.5:0/1110024107 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180c00cca0 con 0x7f180c0095b0 2024-08-18T21:05:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.600+0000 7f182ea4e640 1 -- 172.21.15.5:0/1110024107 reap_dead start 2024-08-18T21:05:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.604+0000 7f182ea4e640 1 -- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f180c0095b0 msgr2=0x7f180c00ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.604+0000 7f182ea4e640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f180c0095b0 0x7f180c00ba70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f18200095f0 tx=0x7f18240a6000 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1820019020 con 0x7f180c0095b0 2024-08-18T21:05:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f181effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f181effd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:05:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f181effd640 10 monclient: dump: 2024-08-18T21:05:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.621 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f181effd640 10 monclient: _finish_auth 0 2024-08-18T21:05:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f181effd640 10 monclient: _check_auth_tickets 2024-08-18T21:05:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f181effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1820009bd0 con 0x7f180c0095b0 2024-08-18T21:05:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f181effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1820009db0 con 0x7f180c0095b0 2024-08-18T21:05:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f181effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f181effd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:05:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f181effd640 10 monclient: dump: 2024-08-18T21:05:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.623 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f18304b1640 5 monclient: authenticate success, global_id 4776 2024-08-18T21:05:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f18304b1640 10 monclient: _renew_subs 2024-08-18T21:05:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f182ca4a640 4 set_mon_vals no callback set 2024-08-18T21:05:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f18304b1640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:05:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f18304b1640 1 -- 172.21.15.5:0/1110024107 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18280691a0 con 0x7f180c0095b0 2024-08-18T21:05:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f18304b1640 10 monclient: _renew_subs 2024-08-18T21:05:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f18304b1640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:05:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f18304b1640 1 -- 172.21.15.5:0/1110024107 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f1828073740 con 0x7f180c0095b0 2024-08-18T21:05:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f18304b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f18304b1640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813c890 0x7f182813cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f18304b1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f18304b1640 1 -- 172.21.15.5:0/1110024107 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f1828051140 con 0x7f182813c890 2024-08-18T21:05:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f182e24d640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813c890 0x7f182813cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f182e24d640 10 monclient: get_auth_request con 0x7f182813c890 auth_method 0 2024-08-18T21:05:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f182e24d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f182e24d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f182e24d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f182e24d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f182e24d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f182e24d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.625 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28397]: starting. 2024-08-18T21:05:05.625 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28397]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28395 2024-08-18T21:05:05.625 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28397]: shutting down. 2024-08-18T21:05:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f182e24d640 10 monclient(hunting): handle_auth_done global_id 4669 payload 824 2024-08-18T21:05:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f182e24d640 1 -- 172.21.15.5:0/1110024107 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1828068e50 con 0x7f182813c890 2024-08-18T21:05:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 <== mon.7 v2:172.21.15.157:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f182001c020 con 0x7f180c0095b0 2024-08-18T21:05:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f181effd640 1 --2- 172.21.15.5:0/1110024107 >> v2:172.21.15.157:6812/631023601 conn(0x7f180c040950 0x7f180c042e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 <== mon.7 v2:172.21.15.157:3303/0 5 ==== osd_map(50..50 src has 11..50) ==== 3506+0+0 (secure 0 0 0) 0x7f1820012040 con 0x7f180c0095b0 2024-08-18T21:05:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f182da4c640 1 --2- 172.21.15.5:0/1110024107 >> v2:172.21.15.157:6812/631023601 conn(0x7f180c040950 0x7f180c042e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.612+0000 7f182da4c640 10 monclient: get_auth_request con 0x7f180c040950 auth_method 0 2024-08-18T21:05:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.616+0000 7f182da4c640 1 --2- 172.21.15.5:0/1110024107 >> v2:172.21.15.157:6812/631023601 conn(0x7f180c040950 0x7f180c042e10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1818009160 tx=0x7f1818008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.620+0000 7f182e24d640 1 -- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813c890 msgr2=0x7f182813cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.620+0000 7f182e24d640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813c890 0x7f182813cc70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f182401c480 tx=0x7f1824009240 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.628+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f18240c2070 con 0x7f182813c890 2024-08-18T21:05:05.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.628+0000 7f181effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.628+0000 7f181effd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:05:05.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.628+0000 7f181effd640 10 monclient: dump: 2024-08-18T21:05:05.630 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.630 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.630 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.631 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.631 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.631 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.631 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.631 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.631 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.631 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.631 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.631 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.631 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.631 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.631 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.631 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.628+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f18240aa7e0 con 0x7f182813c890 2024-08-18T21:05:05.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.628+0000 7f181effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:05.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.628+0000 7f181effd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:05.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.628+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813c890 msgr2=0x7f182813cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.628+0000 7f181effd640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813c890 0x7f182813cc70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f182401c480 tx=0x7f1824009240 comp rx=0 tx=0).stop 2024-08-18T21:05:05.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.628+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813c890 msgr2=0x7f182813cc70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:05.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.628+0000 7f181effd640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813c890 0x7f182813cc70 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f182401c480 tx=0x7f1824009240 comp rx=0 tx=0).stop 2024-08-18T21:05:05.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.632+0000 7f18304b1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:05.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.632+0000 7f18304b1640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813d1b0 0x7f18281d1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.632+0000 7f18304b1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.632+0000 7f18304b1640 1 -- 172.21.15.5:0/1110024107 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f182813e160 con 0x7f182813d1b0 2024-08-18T21:05:05.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.632+0000 7f182e24d640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813d1b0 0x7f18281d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.632+0000 7f182e24d640 10 monclient: get_auth_request con 0x7f182813d1b0 auth_method 0 2024-08-18T21:05:05.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.632+0000 7f182e24d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.632+0000 7f182e24d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.632+0000 7f182e24d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.632+0000 7f182e24d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.632+0000 7f182e24d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.632+0000 7f182e24d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.632+0000 7f182e24d640 10 monclient(hunting): handle_auth_done global_id 4687 payload 824 2024-08-18T21:05:05.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.632+0000 7f182e24d640 1 -- 172.21.15.5:0/1110024107 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f182807d350 con 0x7f182813d1b0 2024-08-18T21:05:05.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f182e24d640 1 -- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813d1b0 msgr2=0x7f18281d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f182e24d640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813d1b0 0x7f18281d1720 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1824019220 tx=0x7f18240b4000 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f18240b9070 con 0x7f182813d1b0 2024-08-18T21:05:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f181effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f181effd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:05:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f181effd640 10 monclient: dump: 2024-08-18T21:05:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.642 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.642 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.642 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.642 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.642 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.642 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.642 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.642 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.642 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f18240d0450 con 0x7f182813d1b0 2024-08-18T21:05:05.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f181effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:05.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f181effd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:05.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813d1b0 msgr2=0x7f18281d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f181effd640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813d1b0 0x7f18281d1720 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1824019220 tx=0x7f18240b4000 comp rx=0 tx=0).stop 2024-08-18T21:05:05.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f181effd640 1 -- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813d1b0 msgr2=0x7f18281d1720 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:05.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f181effd640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813d1b0 0x7f18281d1720 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1824019220 tx=0x7f18240b4000 comp rx=0 tx=0).stop 2024-08-18T21:05:05.643 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:05.643 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:05.643 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:05.643 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:05.643 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 30, 2024-08-18T21:05:05.643 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 114734, 2024-08-18T21:05:05.643 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:05.644 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:05.644 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:05.644 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:05.644 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:05.644 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:05.644 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:05.644 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:05:05.644 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:05:05.644 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:05:05.644 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.644 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:05:05.644 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:05.644 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:05.645 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:05.645 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:05.645 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:05.645 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:05.645 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:05.645 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:05.645 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:05.645 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:05.645 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:05.645 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:05.645 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:05.645 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:05.645 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.646 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:05.646 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:05.646 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:05.646 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:05.646 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:05.646 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:05.646 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:05.646 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:05.646 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:05.646 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:05.646 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:05.646 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:05.646 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:05.646 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.647 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:05.647 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:05.647 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:05.647 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:05.647 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:05.647 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:05.647 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:05.647 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:05.647 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:05.647 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:05.647 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:05.647 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:05.648 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:05.648 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:05.648 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:05.648 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:05.648 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:05.648 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:05.648 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:05.648 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:05.648 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:05.648 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:05.648 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:05.648 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:05.648 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:05.648 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:05.649 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:05.649 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:05.649 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.649 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:05.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.649 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:05.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.649 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:05.649 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:05.649 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.649 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.649 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.650 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:05.650 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.650 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.650 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.650 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:05.650 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.650 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.650 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.650 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:05.650 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:05.651 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.651 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.651 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.651 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:05.651 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:05.651 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.651 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.651 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.651 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:05.651 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.652 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.652 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.652 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:05.652 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.652 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.652 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.652 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:05.652 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:05.652 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.652 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.652 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.653 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:05.653 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:05.653 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.653 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.653 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.653 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:05.653 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.653 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.653 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:05.653 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.654 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.654 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.654 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:05.654 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:05.654 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.654 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.654 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.654 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.654 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:05.654 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:05.654 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.655 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.655 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.655 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.655 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:05.655 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.655 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.655 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.655 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:05.655 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.655 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.655 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.655 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:05.656 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:05.656 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.656 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.656 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.656 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.656 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:05.656 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:05.656 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.656 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.656 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.656 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.656 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:05.657 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.657 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.657 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.657 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:05.657 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.657 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.657 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.657 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:05.657 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:05.657 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.657 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.658 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.658 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:05.658 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:05.658 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.658 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.658 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.658 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:05.658 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.659 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.659 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:05.659 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.659 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.659 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.659 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:05.659 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:05.659 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.659 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.659 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.660 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:05.660 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:05.660 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.660 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:05.660 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.660 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:05.660 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.660 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.661 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.661 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:05.661 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:05.661 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.661 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.661 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.661 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:05.661 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:05.661 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.661 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.662 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.662 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:05.662 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.662 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.662 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:05.662 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.662 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.662 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.662 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:05.662 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:05.663 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.663 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.663 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.663 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:05.663 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:05.663 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:05.663 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:05.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.663 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:05.663 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:05.663 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.664 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:05.664 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:05.664 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:05.664 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.664 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.664 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:05.664 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:05.664 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:05.664 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:05.664 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:05.664 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.665 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.665 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:05.665 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:05.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.665 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:05.665 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:05.665 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:05.665 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.665 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.665 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:05:05.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.665 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:05.665 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:05.666 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:05:05.666 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.666 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:05.666 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:05.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:05.666 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:05.666 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:05.666 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:05:05.666 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:05.666 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:05.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:05.666 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:05.666 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f18304b1640 1 -- 172.21.15.5:0/1110024107 >> v2:172.21.15.157:6812/631023601 conn(0x7f180c040950 msgr2=0x7f180c042e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f18304b1640 1 --2- 172.21.15.5:0/1110024107 >> v2:172.21.15.157:6812/631023601 conn(0x7f180c040950 0x7f180c042e10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1818009160 tx=0x7f1818008040 comp rx=0 tx=0).stop 2024-08-18T21:05:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f18304b1640 10 monclient: shutdown 2024-08-18T21:05:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f18304b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f18304b1640 1 -- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f180c0095b0 msgr2=0x7f180c00ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f18304b1640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f180c0095b0 0x7f180c00ba70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f18200095f0 tx=0x7f18240a6000 comp rx=0 tx=0).stop 2024-08-18T21:05:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f18304b1640 1 -- 172.21.15.5:0/1110024107 shutdown_connections 2024-08-18T21:05:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f18304b1640 1 --2- 172.21.15.5:0/1110024107 >> v2:172.21.15.157:6812/631023601 conn(0x7f180c040950 0x7f180c042e10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f18304b1640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f180c0095b0 0x7f180c00ba70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f18304b1640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813c890 0x7f182813cc70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f18304b1640 1 --2- 172.21.15.5:0/1110024107 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f182813d1b0 0x7f18281d1720 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f18304b1640 1 -- 172.21.15.5:0/1110024107 >> 172.21.15.5:0/1110024107 conn(0x7f18280a8020 msgr2=0x7f1828132c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:05.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f18304b1640 1 -- 172.21.15.5:0/1110024107 shutdown_connections 2024-08-18T21:05:05.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.636+0000 7f18304b1640 1 -- 172.21.15.5:0/1110024107 wait complete. 2024-08-18T21:05:05.669 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:05:05.669 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['d', 'e'] 2024-08-18T21:05:05.669 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-18T21:05:05.669 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d 2024-08-18T21:05:05.670 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2024-08-18T21:05:05.670 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-08-18T21:05:05.670 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:05:05.681 INFO:tasks.ceph.mon.d:Stopped 2024-08-18T21:05:05.681 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-08-18T21:05:05.681 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-08-18T21:05:05.681 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-08-18T21:05:05.681 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:05:05.733 INFO:tasks.ceph.mon.e:Stopped 2024-08-18T21:05:05.733 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 7 2024-08-18T21:05:05.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:05:05.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.884+0000 7f7438ce8640 10 monclient: get_monmap_and_config 2024-08-18T21:05:05.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.884+0000 7f7438ce8640 10 monclient: build_initial_monmap 2024-08-18T21:05:05.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.884+0000 7f7438ce8640 10 monclient: monmap: 2024-08-18T21:05:05.890 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:05.890 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.890 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:05.892108+0000 2024-08-18T21:05:05.890 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:05.892108+0000 2024-08-18T21:05:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:05.891 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 1 Processor -- start 2024-08-18T21:05:05.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 1 -- start start 2024-08-18T21:05:05.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 10 monclient: init 2024-08-18T21:05:05.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:05.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 10 monclient: _add_conns ranks=[6,7,5,3,10,0,1,8,9,2,4] 2024-08-18T21:05:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f74340a6ce0 0x7f74340a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 10 monclient(hunting): picked mon.noname-d con 0x7f74340a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f74340a7600 0x7f7434139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 10 monclient(hunting): picked mon.noname-i con 0x7f74340a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7434139fe0 0x7f743413a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 10 monclient(hunting): picked mon.noname-h con 0x7f7434139fe0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f74340a5000 con 0x7f7434139fe0 2024-08-18T21:05:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f74340a4360 con 0x7f74340a6ce0 2024-08-18T21:05:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f74340a45d0 con 0x7f74340a7600 2024-08-18T21:05:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7438ce8640 10 monclient(hunting): authenticate will time out at 1072.905279s 2024-08-18T21:05:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f743259c640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f74340a6ce0 msgr2=0x7f74340a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:05:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f743259c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f74340a6ce0 0x7f74340a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7434139fe0 0x7f743413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7431d9b640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f74340a7600 0x7f7434139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7434139fe0 0x7f743413a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:41268/0 (socket says 172.21.15.5:41268) 2024-08-18T21:05:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 1 -- 172.21.15.5:0/2654498315 learned_addr learned my addr 172.21.15.5:0/2654498315 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 10 monclient(hunting): get_auth_request con 0x7f7434139fe0 auth_method 0 2024-08-18T21:05:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7431d9b640 10 monclient(hunting): get_auth_request con 0x7f74340a7600 auth_method 0 2024-08-18T21:05:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7431d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7431d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7431d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7431d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7431d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7431d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 10 monclient(hunting): handle_auth_done global_id 34259 payload 274 2024-08-18T21:05:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 1 -- 172.21.15.5:0/2654498315 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f74340a7600 msgr2=0x7f7434139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 1 --2- 172.21.15.5:0/2654498315 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f74340a7600 0x7f7434139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 1 -- 172.21.15.5:0/2654498315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f74340a6ce0 msgr2=0x7f74340a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 1 --2- 172.21.15.5:0/2654498315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f74340a6ce0 0x7f74340a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 10 monclient: _finish_hunting 0 2024-08-18T21:05:05.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 1 monclient: found mon.noname-h 2024-08-18T21:05:05.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:05.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:05:05.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7432d9d640 1 -- 172.21.15.5:0/2654498315 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74340a32d0 con 0x7f7434139fe0 2024-08-18T21:05:05.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.888+0000 7f7431d9b640 1 --2- 172.21.15.5:0/2654498315 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f74340a7600 0x7f7434139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f7432d9d640 1 -- 172.21.15.5:0/2654498315 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7434139fe0 msgr2=0x7f743413a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f7432d9d640 1 --2- 172.21.15.5:0/2654498315 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7434139fe0 0x7f743413a440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f742c009eb0 tx=0x7f742c01c910 comp rx=0 tx=0).ready entity=mon.5 client_cookie=913ec9d51d70758 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f743159a640 1 -- 172.21.15.5:0/2654498315 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f742c0090d0 con 0x7f7434139fe0 2024-08-18T21:05:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f743159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f743159a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:05:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f743159a640 10 monclient: dump: 2024-08-18T21:05:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.904 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.904 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.904 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.904 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.904 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.904 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.904 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.904 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.904 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.904 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.904 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.904 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.904 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f743159a640 10 monclient: _finish_auth 0 2024-08-18T21:05:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f743159a640 10 monclient: _check_auth_tickets 2024-08-18T21:05:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f743159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f743159a640 1 -- 172.21.15.5:0/2654498315 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742c0a5a50 con 0x7f7434139fe0 2024-08-18T21:05:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f743159a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f743159a640 1 -- 172.21.15.5:0/2654498315 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f742c0a5c40 con 0x7f7434139fe0 2024-08-18T21:05:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f743159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f743159a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:05:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f743159a640 10 monclient: dump: 2024-08-18T21:05:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.906 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.907 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f7438ce8640 5 monclient: authenticate success, global_id 34259 2024-08-18T21:05:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f7438ce8640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.892+0000 7f7438ce8640 4 set_mon_vals no callback set 2024-08-18T21:05:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 10 monclient: shutdown 2024-08-18T21:05:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 -- 172.21.15.5:0/2654498315 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7434139fe0 msgr2=0x7f743413a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 --2- 172.21.15.5:0/2654498315 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7434139fe0 0x7f743413a440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f742c009eb0 tx=0x7f742c01c910 comp rx=0 tx=0).stop 2024-08-18T21:05:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 -- 172.21.15.5:0/2654498315 shutdown_connections 2024-08-18T21:05:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 --2- 172.21.15.5:0/2654498315 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7434139fe0 0x7f743413a440 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 --2- 172.21.15.5:0/2654498315 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f74340a7600 0x7f7434139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 --2- 172.21.15.5:0/2654498315 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f74340a6ce0 0x7f74340a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 -- 172.21.15.5:0/2654498315 >> 172.21.15.5:0/2654498315 conn(0x7f74340acbc0 msgr2=0x7f74340a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 -- 172.21.15.5:0/2654498315 shutdown_connections 2024-08-18T21:05:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 -- 172.21.15.5:0/2654498315 wait complete. 2024-08-18T21:05:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 10 monclient: build_initial_monmap 2024-08-18T21:05:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 10 monclient: monmap: 2024-08-18T21:05:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:05.909 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 Processor -- start 2024-08-18T21:05:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 -- start start 2024-08-18T21:05:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 10 monclient: init 2024-08-18T21:05:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 10 monclient: _add_conns ranks=[5,6,1,7,4,8,0,3,2] 2024-08-18T21:05:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74340a6ce0 0x7f7434134e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 10 monclient(hunting): picked mon.noname-h con 0x7f74340a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f74340a7600 0x7f7434135350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 10 monclient(hunting): picked mon.noname-d con 0x7f74340a7600 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7434139fe0 0x7f743413aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 10 monclient(hunting): picked mon.noname-f con 0x7f7434139fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:05:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f74340a79e0 con 0x7f7434139fe0 2024-08-18T21:05:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f74340a8220 con 0x7f74340a6ce0 2024-08-18T21:05:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f74340a70c0 con 0x7f74340a7600 2024-08-18T21:05:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7438ce8640 10 monclient(hunting): authenticate will time out at 1072.914252s 2024-08-18T21:05:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7431d9b640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f74340a7600 msgr2=0x7f7434135350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:05:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7431d9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f74340a7600 0x7f7434135350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74340a6ce0 0x7f7434134e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74340a6ce0 0x7f7434134e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:41272/0 (socket says 172.21.15.5:41272) 2024-08-18T21:05:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 1 -- 172.21.15.5:0/1083371006 learned_addr learned my addr 172.21.15.5:0/1083371006 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 10 monclient(hunting): get_auth_request con 0x7f74340a6ce0 auth_method 0 2024-08-18T21:05:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7432d9d640 1 --2- 172.21.15.5:0/1083371006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7434139fe0 0x7f743413aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7432d9d640 10 monclient(hunting): get_auth_request con 0x7f7434139fe0 auth_method 0 2024-08-18T21:05:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7432d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7432d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7432d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7432d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7432d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f7432d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 10 monclient(hunting): handle_auth_done global_id 34268 payload 824 2024-08-18T21:05:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 1 -- 172.21.15.5:0/1083371006 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f74340a7600 msgr2=0x7f7434135350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:05:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 1 --2- 172.21.15.5:0/1083371006 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f74340a7600 0x7f7434135350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 1 -- 172.21.15.5:0/1083371006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7434139fe0 msgr2=0x7f743413aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 1 --2- 172.21.15.5:0/1083371006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7434139fe0 0x7f743413aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 10 monclient: _finish_hunting 0 2024-08-18T21:05:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 1 monclient: found mon.noname-h 2024-08-18T21:05:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:05:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.896+0000 7f743259c640 1 -- 172.21.15.5:0/1083371006 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743413c1c0 con 0x7f74340a6ce0 2024-08-18T21:05:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f743259c640 1 -- 172.21.15.5:0/1083371006 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74340a6ce0 msgr2=0x7f7434134e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f743259c640 1 --2- 172.21.15.5:0/1083371006 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74340a6ce0 0x7f7434134e10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f742800b550 tx=0x7f742800ba10 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7422ffd640 1 -- 172.21.15.5:0/1083371006 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f74280092d0 con 0x7f74340a6ce0 2024-08-18T21:05:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7422ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7422ffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:05:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7422ffd640 10 monclient: dump: 2024-08-18T21:05:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.917 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7422ffd640 10 monclient: _finish_auth 0 2024-08-18T21:05:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7422ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:05:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7422ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7438ce8640 5 monclient: authenticate success, global_id 34268 2024-08-18T21:05:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7438ce8640 10 monclient: _renew_subs 2024-08-18T21:05:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7422ffd640 1 -- 172.21.15.5:0/1083371006 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7428015070 con 0x7f74340a6ce0 2024-08-18T21:05:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7438ce8640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:05:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7438ce8640 1 -- 172.21.15.5:0/1083371006 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f743413dc80 con 0x7f74340a6ce0 2024-08-18T21:05:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7422ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:05.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7422ffd640 1 -- 172.21.15.5:0/1083371006 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7428003de0 con 0x7f74340a6ce0 2024-08-18T21:05:05.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7422ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:05.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7422ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:05:05.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7430d99640 4 set_mon_vals no callback set 2024-08-18T21:05:05.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7422ffd640 10 monclient: dump: 2024-08-18T21:05:05.918 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:05.918 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:05.918 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.918 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:05.918 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:05.918 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:05.918 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:05.918 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:05.919 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:05.919 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:05.919 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:05.919 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:05.919 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:05.919 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:05.919 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:05.919 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:05.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7438ce8640 10 monclient: _renew_subs 2024-08-18T21:05:05.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7438ce8640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:05:05.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7438ce8640 1 -- 172.21.15.5:0/1083371006 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f743413cd20 con 0x7f74340a6ce0 2024-08-18T21:05:05.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7438ce8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:05.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7438ce8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:05.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7438ce8640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:05:05.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7438ce8640 1 -- 172.21.15.5:0/1083371006 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7434139aa0 con 0x7f74340a6ce0 2024-08-18T21:05:05.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.900+0000 7f7422ffd640 1 -- 172.21.15.5:0/1083371006 <== mon.5 v2:172.21.15.157:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f74280050f0 con 0x7f74340a6ce0 2024-08-18T21:05:05.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.904+0000 7f7422ffd640 1 --2- 172.21.15.5:0/1083371006 >> v2:172.21.15.157:6812/631023601 conn(0x7f741403bdc0 0x7f741403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:05.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.904+0000 7f7422ffd640 1 -- 172.21.15.5:0/1083371006 <== mon.5 v2:172.21.15.157:3302/0 5 ==== osd_map(50..50 src has 11..50) ==== 3506+0+0 (secure 0 0 0) 0x7f742800d040 con 0x7f74340a6ce0 2024-08-18T21:05:05.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.904+0000 7f7431d9b640 1 --2- 172.21.15.5:0/1083371006 >> v2:172.21.15.157:6812/631023601 conn(0x7f741403bdc0 0x7f741403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:05.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.904+0000 7f7431d9b640 10 monclient: get_auth_request con 0x7f741403bdc0 auth_method 0 2024-08-18T21:05:05.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.904+0000 7f7431d9b640 1 --2- 172.21.15.5:0/1083371006 >> v2:172.21.15.157:6812/631023601 conn(0x7f741403bdc0 0x7f741403e280 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7424009580 tx=0x7f7424009190 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:05.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.916+0000 7f7422ffd640 1 -- 172.21.15.5:0/1083371006 <== mon.5 v2:172.21.15.157:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f742804cb30 con 0x7f74340a6ce0 2024-08-18T21:05:05.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.916+0000 7f7422ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:05.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:05.916+0000 7f7422ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:06.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.148+0000 7f7438ce8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:05:06.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.148+0000 7f7438ce8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:05:06.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.148+0000 7f7438ce8640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:05:06.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.148+0000 7f7438ce8640 1 -- 172.21.15.5:0/1083371006 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f743413ef20 con 0x7f74340a6ce0 2024-08-18T21:05:06.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.148+0000 7f7422ffd640 1 -- 172.21.15.5:0/1083371006 <== mon.5 v2:172.21.15.157:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3172 (secure 0 0 0) 0x7f742804ceb0 con 0x7f74340a6ce0 2024-08-18T21:05:06.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.148+0000 7f7422ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:05:06.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.148+0000 7f7422ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:06.152 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":30,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:05:06.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.152+0000 7f7438ce8640 1 -- 172.21.15.5:0/1083371006 >> v2:172.21.15.157:6812/631023601 conn(0x7f741403bdc0 msgr2=0x7f741403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:06.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.152+0000 7f7438ce8640 1 --2- 172.21.15.5:0/1083371006 >> v2:172.21.15.157:6812/631023601 conn(0x7f741403bdc0 0x7f741403e280 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7424009580 tx=0x7f7424009190 comp rx=0 tx=0).stop 2024-08-18T21:05:06.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.152+0000 7f7438ce8640 10 monclient: shutdown 2024-08-18T21:05:06.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.152+0000 7f7438ce8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:06.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.152+0000 7f7438ce8640 1 -- 172.21.15.5:0/1083371006 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74340a6ce0 msgr2=0x7f7434134e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:06.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.152+0000 7f7438ce8640 1 --2- 172.21.15.5:0/1083371006 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74340a6ce0 0x7f7434134e10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f742800b550 tx=0x7f742800ba10 comp rx=0 tx=0).stop 2024-08-18T21:05:06.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.152+0000 7f7438ce8640 1 -- 172.21.15.5:0/1083371006 shutdown_connections 2024-08-18T21:05:06.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.152+0000 7f7438ce8640 1 --2- 172.21.15.5:0/1083371006 >> v2:172.21.15.157:6812/631023601 conn(0x7f741403bdc0 0x7f741403e280 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:06.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.152+0000 7f7438ce8640 1 --2- 172.21.15.5:0/1083371006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7434139fe0 0x7f743413aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:06.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.152+0000 7f7438ce8640 1 --2- 172.21.15.5:0/1083371006 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f74340a7600 0x7f7434135350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:06.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.152+0000 7f7438ce8640 1 --2- 172.21.15.5:0/1083371006 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74340a6ce0 0x7f7434134e10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:06.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.152+0000 7f7438ce8640 1 -- 172.21.15.5:0/1083371006 >> 172.21.15.5:0/1083371006 conn(0x7f74340acbc0 msgr2=0x7f7434138610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:06.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.152+0000 7f7438ce8640 1 -- 172.21.15.5:0/1083371006 shutdown_connections 2024-08-18T21:05:06.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:06.152+0000 7f7438ce8640 1 -- 172.21.15.5:0/1083371006 wait complete. 2024-08-18T21:05:09.171 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:05:09.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 10 monclient: get_monmap_and_config 2024-08-18T21:05:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 10 monclient: build_initial_monmap 2024-08-18T21:05:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 10 monclient: monmap: 2024-08-18T21:05:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:09.305976+0000 2024-08-18T21:05:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:09.305976+0000 2024-08-18T21:05:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:09.305 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:09.305 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:09.305 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:09.305 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:09.305 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:09.305 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:09.305 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:09.305 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:09.305 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:09.305 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:09.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 1 Processor -- start 2024-08-18T21:05:09.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 1 -- start start 2024-08-18T21:05:09.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 10 monclient: init 2024-08-18T21:05:09.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:09.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 10 monclient: _add_conns ranks=[9,1,4,5,10,2,6,8,3,7,0] 2024-08-18T21:05:09.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f271c0a6ce0 0x7f271c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:09.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 10 monclient(hunting): picked mon.noname-a con 0x7f271c0a6ce0 addr v2:172.21.15.5:3300/0 2024-08-18T21:05:09.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f271c0a7600 addr v1:172.21.15.157:6789/0 2024-08-18T21:05:09.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f271c13a1b0 0x7f271c141d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:09.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 10 monclient(hunting): picked mon.noname-c con 0x7f271c13a1b0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:09.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f271c0a45d0 con 0x7f271c0a7600 2024-08-18T21:05:09.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:09.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f271c0a5000 con 0x7f271c0a6ce0 2024-08-18T21:05:09.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:09.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f271c0a4360 con 0x7f271c13a1b0 2024-08-18T21:05:09.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:09.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f27218a2640 10 monclient(hunting): authenticate will time out at 1076.319210s 2024-08-18T21:05:09.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271b7fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f271c13a1b0 0x7f271c141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:09.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f271c0a6ce0 0x7f271c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:09.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271b7fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f271c13a1b0 0x7f271c141d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:49278/0 (socket says 172.21.15.5:49278) 2024-08-18T21:05:09.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f271c0a6ce0 0x7f271c0a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42718/0 (socket says 172.21.15.5:42718) 2024-08-18T21:05:09.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271b7fe640 1 -- 172.21.15.5:0/1251047966 learned_addr learned my addr 172.21.15.5:0/1251047966 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:09.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271b7fe640 10 monclient(hunting): get_auth_request con 0x7f271c13a1b0 auth_method 0 2024-08-18T21:05:09.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:09.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:09.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:09.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 10 monclient(hunting): get_auth_request con 0x7f271c0a6ce0 auth_method 0 2024-08-18T21:05:09.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:09.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:09.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:09.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:09.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:09.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:09.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 10 monclient(hunting): handle_auth_done global_id 4869 payload 274 2024-08-18T21:05:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 1 -- 172.21.15.5:0/1251047966 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f271c13a1b0 msgr2=0x7f271c141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 1 --2- 172.21.15.5:0/1251047966 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f271c13a1b0 0x7f271c141d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 1 -- 172.21.15.5:0/1251047966 >> v1:172.21.15.157:6789/0 conn(0x7f271c0a7600 legacy=0x7f271c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 10 monclient: _finish_hunting 0 2024-08-18T21:05:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 1 monclient: found mon.noname-a 2024-08-18T21:05:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:05:09.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.300+0000 7f271affd640 1 -- 172.21.15.5:0/1251047966 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c0a3300 con 0x7f271c0a6ce0 2024-08-18T21:05:09.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 1 -- 172.21.15.5:0/1251047966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f271c0a6ce0 msgr2=0x7f271c0a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:09.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 1 --2- 172.21.15.5:0/1251047966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f271c0a6ce0 0x7f271c0a70c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2714009d90 tx=0x7f271401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfd7a4680db3222 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2719ffb640 1 -- 172.21.15.5:0/1251047966 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f27140b2070 con 0x7f271c0a6ce0 2024-08-18T21:05:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2719ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2719ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:05:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2719ffb640 10 monclient: dump: 2024-08-18T21:05:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:09.316 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2719ffb640 10 monclient: _finish_auth 0 2024-08-18T21:05:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2719ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:05:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2719ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2719ffb640 1 -- 172.21.15.5:0/1251047966 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27140a59d0 con 0x7f271c0a6ce0 2024-08-18T21:05:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 5 monclient: authenticate success, global_id 4869 2024-08-18T21:05:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:05:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2719ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 4 set_mon_vals no callback set 2024-08-18T21:05:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2719ffb640 1 -- 172.21.15.5:0/1251047966 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f27140a5bc0 con 0x7f271c0a6ce0 2024-08-18T21:05:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2719ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2719ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:05:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2719ffb640 10 monclient: dump: 2024-08-18T21:05:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:09.318 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient: shutdown 2024-08-18T21:05:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 -- 172.21.15.5:0/1251047966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f271c0a6ce0 msgr2=0x7f271c0a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 --2- 172.21.15.5:0/1251047966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f271c0a6ce0 0x7f271c0a70c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2714009d90 tx=0x7f271401c830 comp rx=0 tx=0).stop 2024-08-18T21:05:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 -- 172.21.15.5:0/1251047966 shutdown_connections 2024-08-18T21:05:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 --2- 172.21.15.5:0/1251047966 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f271c13a1b0 0x7f271c141d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 --2- 172.21.15.5:0/1251047966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f271c0a6ce0 0x7f271c0a70c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 -- 172.21.15.5:0/1251047966 >> 172.21.15.5:0/1251047966 conn(0x7f271c0acbc0 msgr2=0x7f271c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 -- 172.21.15.5:0/1251047966 shutdown_connections 2024-08-18T21:05:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 -- 172.21.15.5:0/1251047966 wait complete. 2024-08-18T21:05:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient: build_initial_monmap 2024-08-18T21:05:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient: monmap: 2024-08-18T21:05:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:09.321 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 Processor -- start 2024-08-18T21:05:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 -- start start 2024-08-18T21:05:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient: init 2024-08-18T21:05:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient: _add_conns ranks=[2,3,7,1,8,6,0,4,5] 2024-08-18T21:05:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f271c0a6ce0 0x7f271c140a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient(hunting): picked mon.noname-b con 0x7f271c0a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f271c0a7600 0x7f271c140f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient(hunting): picked mon.noname-g con 0x7f271c0a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f271c13a1b0 0x7f271c09ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient(hunting): picked mon.noname-i con 0x7f271c13a1b0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f271c0a79e0 con 0x7f271c0a6ce0 2024-08-18T21:05:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f271c0a8220 con 0x7f271c0a7600 2024-08-18T21:05:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f271c0a1a60 con 0x7f271c13a1b0 2024-08-18T21:05:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient(hunting): authenticate will time out at 1076.326648s 2024-08-18T21:05:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f271c0a6ce0 0x7f271c140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f271c0a6ce0 0x7f271c140a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:46104/0 (socket says 172.21.15.5:46104) 2024-08-18T21:05:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 1 -- 172.21.15.5:0/304156104 learned_addr learned my addr 172.21.15.5:0/304156104 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 10 monclient(hunting): get_auth_request con 0x7f271c0a6ce0 auth_method 0 2024-08-18T21:05:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271a7fc640 1 --2- 172.21.15.5:0/304156104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f271c0a7600 0x7f271c140f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 10 monclient(hunting): handle_auth_done global_id 4907 payload 824 2024-08-18T21:05:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 1 -- 172.21.15.5:0/304156104 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f271c13a1b0 msgr2=0x7f271c09ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271b7fe640 1 --2- 172.21.15.5:0/304156104 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f271c13a1b0 0x7f271c09ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 1 --2- 172.21.15.5:0/304156104 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f271c13a1b0 0x7f271c09ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 1 -- 172.21.15.5:0/304156104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f271c0a7600 msgr2=0x7f271c140f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 1 --2- 172.21.15.5:0/304156104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f271c0a7600 0x7f271c140f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 10 monclient: _finish_hunting 0 2024-08-18T21:05:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 1 monclient: found mon.noname-b 2024-08-18T21:05:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 1 -- 172.21.15.5:0/304156104 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c13bd60 con 0x7f271c0a6ce0 2024-08-18T21:05:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271a7fc640 10 monclient: get_auth_request con 0x7f271c0a7600 auth_method 0 2024-08-18T21:05:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271a7fc640 1 --2- 172.21.15.5:0/304156104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f271c0a7600 0x7f271c140f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:05:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 1 -- 172.21.15.5:0/304156104 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f271c0a6ce0 msgr2=0x7f271c140a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271affd640 1 --2- 172.21.15.5:0/304156104 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f271c0a6ce0 0x7f271c140a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f271401c660 tx=0x7f27140195d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2713fff640 1 -- 172.21.15.5:0/304156104 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f27140b2050 con 0x7f271c0a6ce0 2024-08-18T21:05:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2713fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2713fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2713fff640 10 monclient: dump: 2024-08-18T21:05:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:09.328 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:09.328 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:09.328 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:09.328 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:09.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2713fff640 10 monclient: _finish_auth 0 2024-08-18T21:05:09.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2713fff640 10 monclient: _check_auth_tickets 2024-08-18T21:05:09.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2713fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:09.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2713fff640 1 -- 172.21.15.5:0/304156104 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27140be070 con 0x7f271c0a6ce0 2024-08-18T21:05:09.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2713fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:09.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2713fff640 1 -- 172.21.15.5:0/304156104 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f27140b9450 con 0x7f271c0a6ce0 2024-08-18T21:05:09.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 5 monclient: authenticate success, global_id 4907 2024-08-18T21:05:09.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient: _renew_subs 2024-08-18T21:05:09.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 -- 172.21.15.5:0/304156104 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271c13c2f0 con 0x7f271c0a6ce0 2024-08-18T21:05:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27197fa640 4 set_mon_vals no callback set 2024-08-18T21:05:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2713fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2713fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2713fff640 10 monclient: dump: 2024-08-18T21:05:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:09.330 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient: _renew_subs 2024-08-18T21:05:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 -- 172.21.15.5:0/304156104 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f271c13aa60 con 0x7f271c0a6ce0 2024-08-18T21:05:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2713fff640 1 -- 172.21.15.5:0/304156104 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f2714004040 con 0x7f271c0a6ce0 2024-08-18T21:05:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f27218a2640 1 -- 172.21.15.5:0/304156104 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f271c0a70c0 con 0x7f271c0a6ce0 2024-08-18T21:05:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2713fff640 1 --2- 172.21.15.5:0/304156104 >> v2:172.21.15.157:6812/631023601 conn(0x7f26fc03bdc0 0x7f26fc03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f2713fff640 1 -- 172.21.15.5:0/304156104 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(50..50 src has 11..50) ==== 3506+0+0 (secure 0 0 0) 0x7f27140e9250 con 0x7f271c0a6ce0 2024-08-18T21:05:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271a7fc640 1 --2- 172.21.15.5:0/304156104 >> v2:172.21.15.157:6812/631023601 conn(0x7f26fc03bdc0 0x7f26fc03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.312+0000 7f271a7fc640 10 monclient: get_auth_request con 0x7f26fc03bdc0 auth_method 0 2024-08-18T21:05:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.316+0000 7f271a7fc640 1 --2- 172.21.15.5:0/304156104 >> v2:172.21.15.157:6812/631023601 conn(0x7f26fc03bdc0 0x7f26fc03e280 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f271c0a1610 tx=0x7f2704009040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.316+0000 7f2713fff640 1 -- 172.21.15.5:0/304156104 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f27140c7020 con 0x7f271c0a6ce0 2024-08-18T21:05:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.316+0000 7f2713fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.316+0000 7f2713fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:09.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:05:09.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:05:09.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:09.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 1 -- 172.21.15.5:0/304156104 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f271c13c070 con 0x7f271c0a6ce0 2024-08-18T21:05:09.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f2713fff640 1 -- 172.21.15.5:0/304156104 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3172 (secure 0 0 0) 0x7f2714016540 con 0x7f271c0a6ce0 2024-08-18T21:05:09.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f2713fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:05:09.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f2713fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:09.555 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":30,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:05:09.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 1 -- 172.21.15.5:0/304156104 >> v2:172.21.15.157:6812/631023601 conn(0x7f26fc03bdc0 msgr2=0x7f26fc03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:09.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 1 --2- 172.21.15.5:0/304156104 >> v2:172.21.15.157:6812/631023601 conn(0x7f26fc03bdc0 0x7f26fc03e280 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f271c0a1610 tx=0x7f2704009040 comp rx=0 tx=0).stop 2024-08-18T21:05:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 10 monclient: shutdown 2024-08-18T21:05:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 1 -- 172.21.15.5:0/304156104 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f271c0a6ce0 msgr2=0x7f271c140a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 1 --2- 172.21.15.5:0/304156104 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f271c0a6ce0 0x7f271c140a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f271401c660 tx=0x7f27140195d0 comp rx=0 tx=0).stop 2024-08-18T21:05:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 1 -- 172.21.15.5:0/304156104 shutdown_connections 2024-08-18T21:05:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 1 --2- 172.21.15.5:0/304156104 >> v2:172.21.15.157:6812/631023601 conn(0x7f26fc03bdc0 0x7f26fc03e280 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 1 --2- 172.21.15.5:0/304156104 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f271c13a1b0 0x7f271c09ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 1 --2- 172.21.15.5:0/304156104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f271c0a7600 0x7f271c140f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 1 --2- 172.21.15.5:0/304156104 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f271c0a6ce0 0x7f271c140a30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 1 -- 172.21.15.5:0/304156104 >> 172.21.15.5:0/304156104 conn(0x7f271c0acbc0 msgr2=0x7f271c09dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 1 -- 172.21.15.5:0/304156104 shutdown_connections 2024-08-18T21:05:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:09.552+0000 7f27218a2640 1 -- 172.21.15.5:0/304156104 wait complete. 2024-08-18T21:05:12.574 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:05:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 10 monclient: get_monmap_and_config 2024-08-18T21:05:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 10 monclient: build_initial_monmap 2024-08-18T21:05:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 10 monclient: monmap: 2024-08-18T21:05:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:12.710333+0000 2024-08-18T21:05:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:12.710333+0000 2024-08-18T21:05:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:12.711 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:12.711 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 1 Processor -- start 2024-08-18T21:05:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 1 -- start start 2024-08-18T21:05:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 10 monclient: init 2024-08-18T21:05:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 10 monclient: _add_conns ranks=[6,3,4,0,1,5,7,10,8,9,2] 2024-08-18T21:05:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f25000a6ce0 0x7f25000a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 10 monclient(hunting): picked mon.noname-d con 0x7f25000a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25000a7600 0x7f2500139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 10 monclient(hunting): picked mon.noname-g con 0x7f25000a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2500139fe0 0x7f250013a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:12.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 10 monclient(hunting): picked mon.noname-c con 0x7f2500139fe0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:12.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:12.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f25000a5000 con 0x7f25000a7600 2024-08-18T21:05:12.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:12.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f25000a4360 con 0x7f2500139fe0 2024-08-18T21:05:12.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:12.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f25000a45d0 con 0x7f25000a6ce0 2024-08-18T21:05:12.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f250750b640 10 monclient(hunting): authenticate will time out at 1079.723513s 2024-08-18T21:05:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f25052a7640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f25000a6ce0 msgr2=0x7f25000a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:05:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f25052a7640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f25000a6ce0 0x7f25000a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f2505aa8640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2500139fe0 0x7f250013a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f2505aa8640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2500139fe0 0x7f250013a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:49280/0 (socket says 172.21.15.5:49280) 2024-08-18T21:05:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f2505aa8640 1 -- 172.21.15.5:0/905637737 learned_addr learned my addr 172.21.15.5:0/905637737 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f2505aa8640 10 monclient(hunting): get_auth_request con 0x7f2500139fe0 auth_method 0 2024-08-18T21:05:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f2505aa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f2505aa8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f2505aa8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f2505aa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f2505aa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f2505aa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f2504aa6640 1 --2- 172.21.15.5:0/905637737 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25000a7600 0x7f2500139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f2504aa6640 10 monclient(hunting): get_auth_request con 0x7f25000a7600 auth_method 0 2024-08-18T21:05:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f2504aa6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f2504aa6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.708+0000 7f2504aa6640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.712+0000 7f2505aa8640 10 monclient(hunting): handle_auth_done global_id 4828 payload 274 2024-08-18T21:05:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.712+0000 7f2505aa8640 1 -- 172.21.15.5:0/905637737 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f25000a6ce0 msgr2=0x7f25000a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.712+0000 7f2505aa8640 1 --2- 172.21.15.5:0/905637737 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f25000a6ce0 0x7f25000a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.712+0000 7f2505aa8640 1 -- 172.21.15.5:0/905637737 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25000a7600 msgr2=0x7f2500139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.712+0000 7f2505aa8640 1 --2- 172.21.15.5:0/905637737 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25000a7600 0x7f2500139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.712+0000 7f2505aa8640 10 monclient: _finish_hunting 0 2024-08-18T21:05:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.712+0000 7f2505aa8640 1 monclient: found mon.noname-c 2024-08-18T21:05:12.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.712+0000 7f2505aa8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:12.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.712+0000 7f2505aa8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:05:12.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.712+0000 7f2505aa8640 1 -- 172.21.15.5:0/905637737 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25000a32d0 con 0x7f2500139fe0 2024-08-18T21:05:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2505aa8640 1 -- 172.21.15.5:0/905637737 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2500139fe0 msgr2=0x7f250013a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2505aa8640 1 --2- 172.21.15.5:0/905637737 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2500139fe0 0x7f250013a440 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009e80 tx=0x7f24f801c930 comp rx=0 tx=0).ready entity=mon.4 client_cookie=e3b1286278e3cfaa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f24f7fff640 1 -- 172.21.15.5:0/905637737 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f24f80090d0 con 0x7f2500139fe0 2024-08-18T21:05:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f24f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f24f7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:05:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f24f7fff640 10 monclient: dump: 2024-08-18T21:05:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:12.724 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f24f7fff640 10 monclient: _finish_auth 0 2024-08-18T21:05:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f24f7fff640 10 monclient: _check_auth_tickets 2024-08-18T21:05:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f24f7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 5 monclient: authenticate success, global_id 4828 2024-08-18T21:05:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f24f7fff640 1 -- 172.21.15.5:0/905637737 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f80a5a70 con 0x7f2500139fe0 2024-08-18T21:05:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:05:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f24f7fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 4 set_mon_vals no callback set 2024-08-18T21:05:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f24f7fff640 1 -- 172.21.15.5:0/905637737 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f24f80a5c20 con 0x7f2500139fe0 2024-08-18T21:05:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f24f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f24f7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f24f7fff640 10 monclient: dump: 2024-08-18T21:05:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:12.726 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 10 monclient: shutdown 2024-08-18T21:05:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 -- 172.21.15.5:0/905637737 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2500139fe0 msgr2=0x7f250013a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 --2- 172.21.15.5:0/905637737 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2500139fe0 0x7f250013a440 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009e80 tx=0x7f24f801c930 comp rx=0 tx=0).stop 2024-08-18T21:05:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 -- 172.21.15.5:0/905637737 shutdown_connections 2024-08-18T21:05:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 --2- 172.21.15.5:0/905637737 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2500139fe0 0x7f250013a440 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 --2- 172.21.15.5:0/905637737 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25000a7600 0x7f2500139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 --2- 172.21.15.5:0/905637737 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f25000a6ce0 0x7f25000a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 -- 172.21.15.5:0/905637737 >> 172.21.15.5:0/905637737 conn(0x7f25000acbc0 msgr2=0x7f25000a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:12.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 -- 172.21.15.5:0/905637737 shutdown_connections 2024-08-18T21:05:12.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 -- 172.21.15.5:0/905637737 wait complete. 2024-08-18T21:05:12.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 10 monclient: build_initial_monmap 2024-08-18T21:05:12.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 10 monclient: monmap: 2024-08-18T21:05:12.727 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:12.727 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:12.727 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:12.727 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:12.728 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:12.728 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:12.728 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:12.728 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:12.728 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:12.728 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:12.728 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:12.728 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:12.728 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:12.728 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:12.728 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:12.728 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:12.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 Processor -- start 2024-08-18T21:05:12.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 -- start start 2024-08-18T21:05:12.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 10 monclient: init 2024-08-18T21:05:12.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:12.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 10 monclient: _add_conns ranks=[8,2,4,3,0,1,5,6,7] 2024-08-18T21:05:12.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25000a6ce0 0x7f2500134d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:12.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 10 monclient(hunting): picked mon.noname-e con 0x7f25000a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:05:12.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25000a7600 0x7f2500135280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:12.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 10 monclient(hunting): picked mon.noname-b con 0x7f25000a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:12.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2500139fe0 0x7f250013aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:12.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 10 monclient(hunting): picked mon.noname-c con 0x7f2500139fe0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:12.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:12.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f25000a79e0 con 0x7f25000a7600 2024-08-18T21:05:12.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:12.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f25000a8220 con 0x7f2500139fe0 2024-08-18T21:05:12.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:12.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f250013a500 con 0x7f25000a6ce0 2024-08-18T21:05:12.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:12.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f250750b640 10 monclient(hunting): authenticate will time out at 1079.730804s 2024-08-18T21:05:12.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f25052a7640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25000a6ce0 msgr2=0x7f2500134d40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:05:12.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f25052a7640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25000a6ce0 0x7f2500134d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:12.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25000a7600 0x7f2500135280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:12.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25000a7600 0x7f2500135280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:46110/0 (socket says 172.21.15.5:46110) 2024-08-18T21:05:12.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2505aa8640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2500139fe0 0x7f250013aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:12.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 1 -- 172.21.15.5:0/2652134958 learned_addr learned my addr 172.21.15.5:0/2652134958 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:12.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 10 monclient(hunting): get_auth_request con 0x7f25000a7600 auth_method 0 2024-08-18T21:05:12.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2505aa8640 10 monclient(hunting): get_auth_request con 0x7f2500139fe0 auth_method 0 2024-08-18T21:05:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2505aa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2505aa8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2505aa8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2505aa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2505aa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2505aa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 10 monclient(hunting): handle_auth_done global_id 4916 payload 824 2024-08-18T21:05:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 1 -- 172.21.15.5:0/2652134958 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25000a6ce0 msgr2=0x7f2500134d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:05:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 1 --2- 172.21.15.5:0/2652134958 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25000a6ce0 0x7f2500134d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 1 -- 172.21.15.5:0/2652134958 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2500139fe0 msgr2=0x7f250013aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 1 --2- 172.21.15.5:0/2652134958 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2500139fe0 0x7f250013aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 10 monclient: _finish_hunting 0 2024-08-18T21:05:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 1 monclient: found mon.noname-b 2024-08-18T21:05:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2504aa6640 1 -- 172.21.15.5:0/2652134958 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25000aa270 con 0x7f25000a7600 2024-08-18T21:05:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.716+0000 7f2505aa8640 1 --2- 172.21.15.5:0/2652134958 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2500139fe0 0x7f250013aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f2504aa6640 1 -- 172.21.15.5:0/2652134958 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25000a7600 msgr2=0x7f2500135280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f2504aa6640 1 --2- 172.21.15.5:0/2652134958 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25000a7600 0x7f2500135280 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f24f000d830 tx=0x7f24f000dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f5ffb640 1 -- 172.21.15.5:0/2652134958 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f24f000bce0 con 0x7f25000a7600 2024-08-18T21:05:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f5ffb640 10 monclient: dump: 2024-08-18T21:05:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:12.734 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f5ffb640 10 monclient: _finish_auth 0 2024-08-18T21:05:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f5ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:05:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f5ffb640 1 -- 172.21.15.5:0/2652134958 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f0019070 con 0x7f25000a7600 2024-08-18T21:05:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f250750b640 5 monclient: authenticate success, global_id 4916 2024-08-18T21:05:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f250750b640 10 monclient: _renew_subs 2024-08-18T21:05:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f250750b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f250750b640 1 -- 172.21.15.5:0/2652134958 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250013dc90 con 0x7f25000a7600 2024-08-18T21:05:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f5ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f5ffb640 1 -- 172.21.15.5:0/2652134958 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f24f00148a0 con 0x7f25000a7600 2024-08-18T21:05:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f5ffb640 10 monclient: dump: 2024-08-18T21:05:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:12.736 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:12.736 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:12.736 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:12.736 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:12.736 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:12.736 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:12.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f250750b640 10 monclient: _renew_subs 2024-08-18T21:05:12.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f77fe640 4 set_mon_vals no callback set 2024-08-18T21:05:12.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f250750b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:12.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f250750b640 1 -- 172.21.15.5:0/2652134958 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f250013cd30 con 0x7f25000a7600 2024-08-18T21:05:12.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f250750b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:12.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f250750b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:12.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f250750b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:12.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f250750b640 1 -- 172.21.15.5:0/2652134958 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2500139aa0 con 0x7f25000a7600 2024-08-18T21:05:12.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f5ffb640 1 -- 172.21.15.5:0/2652134958 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f24f0014430 con 0x7f25000a7600 2024-08-18T21:05:12.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f5ffb640 1 --2- 172.21.15.5:0/2652134958 >> v2:172.21.15.157:6812/631023601 conn(0x7f24e403bdc0 0x7f24e403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:12.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f24f5ffb640 1 -- 172.21.15.5:0/2652134958 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(50..50 src has 11..50) ==== 3506+0+0 (secure 0 0 0) 0x7f24f000f040 con 0x7f25000a7600 2024-08-18T21:05:12.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f25052a7640 1 --2- 172.21.15.5:0/2652134958 >> v2:172.21.15.157:6812/631023601 conn(0x7f24e403bdc0 0x7f24e403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:12.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f25052a7640 10 monclient: get_auth_request con 0x7f24e403bdc0 auth_method 0 2024-08-18T21:05:12.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f25052a7640 1 -- 172.21.15.5:0/2652134958 >> v2:172.21.15.157:6812/631023601 conn(0x7f24e403bdc0 msgr2=0x7f24e403e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-18T21:05:12.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f25052a7640 1 -- 172.21.15.5:0/2652134958 >> v2:172.21.15.157:6812/631023601 conn(0x7f24e403bdc0 msgr2=0x7f24e403e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:05:12.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f25052a7640 1 --2- 172.21.15.5:0/2652134958 >> v2:172.21.15.157:6812/631023601 conn(0x7f24e403bdc0 0x7f24e403e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:12.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.720+0000 7f25052a7640 1 --2- 172.21.15.5:0/2652134958 >> v2:172.21.15.157:6812/631023601 conn(0x7f24e403bdc0 0x7f24e403e280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:12.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.724+0000 7f24f5ffb640 1 -- 172.21.15.5:0/2652134958 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f24f0022020 con 0x7f25000a7600 2024-08-18T21:05:12.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.724+0000 7f24f5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:12.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.724+0000 7f24f5ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:12.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.924+0000 7f25052a7640 1 --2- 172.21.15.5:0/2652134958 >> v2:172.21.15.157:6812/631023601 conn(0x7f24e403bdc0 0x7f24e403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:12.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.924+0000 7f25052a7640 10 monclient: get_auth_request con 0x7f24e403bdc0 auth_method 0 2024-08-18T21:05:12.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.924+0000 7f25052a7640 1 --2- 172.21.15.5:0/2652134958 >> v2:172.21.15.157:6812/631023601 conn(0x7f24e403bdc0 0x7f24e403e280 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f24fc003990 tx=0x7f24fc008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.956+0000 7f250750b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:05:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.956+0000 7f250750b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:05:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.956+0000 7f250750b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.956+0000 7f250750b640 1 -- 172.21.15.5:0/2652134958 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2500069580 con 0x7f25000a7600 2024-08-18T21:05:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f24f5ffb640 1 -- 172.21.15.5:0/2652134958 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7f25000aa270 con 0x7f25000a7600 2024-08-18T21:05:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f24f5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:05:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f24f5ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:12.959 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":30,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:05:12.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f250750b640 1 -- 172.21.15.5:0/2652134958 >> v2:172.21.15.157:6812/631023601 conn(0x7f24e403bdc0 msgr2=0x7f24e403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f250750b640 1 --2- 172.21.15.5:0/2652134958 >> v2:172.21.15.157:6812/631023601 conn(0x7f24e403bdc0 0x7f24e403e280 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f24fc003990 tx=0x7f24fc008040 comp rx=0 tx=0).stop 2024-08-18T21:05:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f250750b640 10 monclient: shutdown 2024-08-18T21:05:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f250750b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f250750b640 1 -- 172.21.15.5:0/2652134958 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25000a7600 msgr2=0x7f2500135280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f250750b640 1 --2- 172.21.15.5:0/2652134958 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25000a7600 0x7f2500135280 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f24f000d830 tx=0x7f24f000dcf0 comp rx=0 tx=0).stop 2024-08-18T21:05:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f250750b640 1 -- 172.21.15.5:0/2652134958 shutdown_connections 2024-08-18T21:05:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f250750b640 1 --2- 172.21.15.5:0/2652134958 >> v2:172.21.15.157:6812/631023601 conn(0x7f24e403bdc0 0x7f24e403e280 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f250750b640 1 --2- 172.21.15.5:0/2652134958 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2500139fe0 0x7f250013aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f250750b640 1 --2- 172.21.15.5:0/2652134958 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25000a7600 0x7f2500135280 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f250750b640 1 --2- 172.21.15.5:0/2652134958 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25000a6ce0 0x7f2500134d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f250750b640 1 -- 172.21.15.5:0/2652134958 >> 172.21.15.5:0/2652134958 conn(0x7f25000acbc0 msgr2=0x7f2500138440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f250750b640 1 -- 172.21.15.5:0/2652134958 shutdown_connections 2024-08-18T21:05:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:12.960+0000 7f250750b640 1 -- 172.21.15.5:0/2652134958 wait complete. 2024-08-18T21:05:15.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:05:16.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 10 monclient: get_monmap_and_config 2024-08-18T21:05:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 10 monclient: build_initial_monmap 2024-08-18T21:05:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 10 monclient: monmap: 2024-08-18T21:05:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:16.113705+0000 2024-08-18T21:05:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:16.113705+0000 2024-08-18T21:05:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:16.114 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:16.114 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:16.114 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:16.114 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:16.114 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:16.114 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:16.114 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:16.114 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:16.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 1 Processor -- start 2024-08-18T21:05:16.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 1 -- start start 2024-08-18T21:05:16.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 10 monclient: init 2024-08-18T21:05:16.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:16.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 10 monclient: _add_conns ranks=[7,1,4,2,9,8,0,10,3,6,5] 2024-08-18T21:05:16.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 0x7f02700a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:16.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 10 monclient(hunting): picked mon.noname-i con 0x7f02700a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:16.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f02700a7600 addr v1:172.21.15.157:6789/0 2024-08-18T21:05:16.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 0x7f0270141d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:16.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 10 monclient(hunting): picked mon.noname-c con 0x7f027013a1b0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:16.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02700a45d0 con 0x7f02700a7600 2024-08-18T21:05:16.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:16.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f02700a5000 con 0x7f027013a1b0 2024-08-18T21:05:16.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:16.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f02700a32d0 con 0x7f02700a6ce0 2024-08-18T21:05:16.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:16.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f0275c04640 10 monclient(hunting): authenticate will time out at 1083.126962s 2024-08-18T21:05:16.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026ffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 0x7f0270141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:16.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026ffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 0x7f0270141d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:33762/0 (socket says 172.21.15.5:33762) 2024-08-18T21:05:16.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 learned_addr learned my addr 172.21.15.5:0/1920511673 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:16.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026ffff640 10 monclient(hunting): get_auth_request con 0x7f027013a1b0 auth_method 0 2024-08-18T21:05:16.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:16.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:16.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:16.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 msgr2=0x7f0270141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:05:16.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 msgr2=0x7f0270141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:16.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 0x7f0270141d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:16.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 0x7f0270141d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:16.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 0x7f02700a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:16.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026f7fe640 10 monclient(hunting): get_auth_request con 0x7f02700a6ce0 auth_method 0 2024-08-18T21:05:16.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:16.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:16.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:16.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 msgr2=0x7f02700a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:16.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 msgr2=0x7f02700a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:16.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 0x7f02700a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:16.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.112+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 0x7f02700a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:16.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.116+0000 7f026effd640 1 -- 172.21.15.5:0/1920511673 >> v1:172.21.15.157:6789/0 conn(0x7f02700a7600 legacy=0x7f0270139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:16.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 0x7f02700a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:16.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026f7fe640 10 monclient(hunting): get_auth_request con 0x7f02700a6ce0 auth_method 0 2024-08-18T21:05:16.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:16.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:16.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:16.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 msgr2=0x7f02700a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:16.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 msgr2=0x7f02700a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:16.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 0x7f02700a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:16.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 0x7f02700a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:05:16.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 0x7f0270141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:16.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026ffff640 10 monclient(hunting): get_auth_request con 0x7f027013a1b0 auth_method 0 2024-08-18T21:05:16.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:16.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:16.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:16.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 msgr2=0x7f0270141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:05:16.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 msgr2=0x7f0270141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:16.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 0x7f0270141d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:16.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.316+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 0x7f0270141d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:05:16.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 0x7f0270141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:16.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026ffff640 10 monclient(hunting): get_auth_request con 0x7f027013a1b0 auth_method 0 2024-08-18T21:05:16.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:16.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:16.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:16.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 msgr2=0x7f0270141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:16.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 msgr2=0x7f0270141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:16.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 0x7f0270141d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:16.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 0x7f0270141d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:05:16.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 0x7f02700a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:16.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026f7fe640 10 monclient(hunting): get_auth_request con 0x7f02700a6ce0 auth_method 0 2024-08-18T21:05:16.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:16.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:16.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:16.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 msgr2=0x7f02700a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:05:16.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 msgr2=0x7f02700a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:16.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 0x7f02700a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:16.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:16.720+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 0x7f02700a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:05:17.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 0x7f0270141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:17.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026ffff640 10 monclient(hunting): get_auth_request con 0x7f027013a1b0 auth_method 0 2024-08-18T21:05:17.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:17.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:17.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:17.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 msgr2=0x7f0270141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:05:17.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 msgr2=0x7f0270141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:17.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 0x7f0270141d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:17.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 0x7f0270141d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:05:17.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 0x7f02700a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:17.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026f7fe640 10 monclient(hunting): get_auth_request con 0x7f02700a6ce0 auth_method 0 2024-08-18T21:05:17.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:17.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:17.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:17.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 msgr2=0x7f02700a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:17.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 msgr2=0x7f02700a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:17.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 0x7f02700a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:17.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:17.524+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 0x7f02700a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:05:19.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 10 monclient(hunting): tick 2024-08-18T21:05:19.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:05:19.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 1 monclient(hunting): continuing hunt 2024-08-18T21:05:19.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:05:19.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 msgr2=0x7f02700a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:19.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02700a6ce0 0x7f02700a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:19.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 msgr2=0x7f0270141d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:19.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f027013a1b0 0x7f0270141d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:19.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 1 -- 172.21.15.5:0/1920511673 >> v1:172.21.15.157:6789/0 conn(0x7f02700a7600 legacy=0x7f0270139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:19.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 10 monclient: _add_conns ranks=[2,10,9,0,3,8,5,6] 2024-08-18T21:05:19.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 0x7f0250005ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 10 monclient(hunting): picked mon.noname-b con 0x7f02500038b0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 0x7f0250008750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 10 monclient(hunting): picked mon.noname-f con 0x7f02500062e0 addr v2:172.21.15.157:3300/0 2024-08-18T21:05:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 0x7f025000b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 10 monclient(hunting): picked mon.noname-a con 0x7f0250008e10 addr v2:172.21.15.5:3300/0 2024-08-18T21:05:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 1 -- 172.21.15.5:0/1920511673 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f02700a32d0 con 0x7f0250008e10 2024-08-18T21:05:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 1 -- 172.21.15.5:0/1920511673 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f025000b9a0 con 0x7f02500062e0 2024-08-18T21:05:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 1 -- 172.21.15.5:0/1920511673 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f025000bba0 con 0x7f02500038b0 2024-08-18T21:05:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026d7fa640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 0x7f0250005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 0x7f025000b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026f7fe640 10 monclient(hunting): get_auth_request con 0x7f02500038b0 auth_method 0 2024-08-18T21:05:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026ffff640 10 monclient(hunting): get_auth_request con 0x7f0250008e10 auth_method 0 2024-08-18T21:05:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 msgr2=0x7f0250005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 msgr2=0x7f025000b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:05:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 msgr2=0x7f0250005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.111+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 msgr2=0x7f025000b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.115+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 0x7f0250005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.115+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 0x7f025000b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.115+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 0x7f025000b2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.115+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 0x7f0250005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.115+0000 7f026effd640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 0x7f0250008750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.115+0000 7f026effd640 10 monclient(hunting): get_auth_request con 0x7f02500062e0 auth_method 0 2024-08-18T21:05:19.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.115+0000 7f026effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:19.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.115+0000 7f026effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:19.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.115+0000 7f026effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:19.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.115+0000 7f026effd640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 msgr2=0x7f0250008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:05:19.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.115+0000 7f026effd640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 msgr2=0x7f0250008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:19.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.115+0000 7f026effd640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 0x7f0250008750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:19.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.115+0000 7f026effd640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 0x7f0250008750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:19.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 0x7f0250005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:19.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 0x7f025000b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026f7fe640 10 monclient(hunting): get_auth_request con 0x7f02500038b0 auth_method 0 2024-08-18T21:05:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026ffff640 10 monclient(hunting): get_auth_request con 0x7f0250008e10 auth_method 0 2024-08-18T21:05:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026effd640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 0x7f0250008750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026effd640 10 monclient(hunting): get_auth_request con 0x7f02500062e0 auth_method 0 2024-08-18T21:05:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:19.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026effd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 msgr2=0x7f0250005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:05:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 msgr2=0x7f0250005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 0x7f0250005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 msgr2=0x7f025000b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:05:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 msgr2=0x7f025000b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 0x7f025000b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 0x7f0250005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:05:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 0x7f025000b2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:05:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026effd640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 msgr2=0x7f0250008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026effd640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 msgr2=0x7f0250008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026effd640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 0x7f0250008750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:19.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.319+0000 7f026effd640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 0x7f0250008750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:05:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 0x7f0250005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 0x7f025000b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026f7fe640 10 monclient(hunting): get_auth_request con 0x7f02500038b0 auth_method 0 2024-08-18T21:05:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026ffff640 10 monclient(hunting): get_auth_request con 0x7f0250008e10 auth_method 0 2024-08-18T21:05:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 msgr2=0x7f0250005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:05:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 msgr2=0x7f0250005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 0x7f0250005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 msgr2=0x7f025000b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 msgr2=0x7f025000b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 0x7f025000b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 0x7f0250005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:05:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026effd640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 0x7f0250008750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 0x7f025000b2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:05:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026effd640 10 monclient(hunting): get_auth_request con 0x7f02500062e0 auth_method 0 2024-08-18T21:05:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026effd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026effd640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 msgr2=0x7f0250008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:05:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026effd640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 msgr2=0x7f0250008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026effd640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 0x7f0250008750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:19.723+0000 7f026effd640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 0x7f0250008750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:05:20.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 0x7f025000b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:20.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 0x7f0250005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:20.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026ffff640 10 monclient(hunting): get_auth_request con 0x7f0250008e10 auth_method 0 2024-08-18T21:05:20.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:20.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:20.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:20.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026f7fe640 10 monclient(hunting): get_auth_request con 0x7f02500038b0 auth_method 0 2024-08-18T21:05:20.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:20.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:20.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:20.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 msgr2=0x7f025000b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:05:20.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 msgr2=0x7f025000b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:20.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 0x7f025000b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:20.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 msgr2=0x7f0250005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:20.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 msgr2=0x7f0250005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:20.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 0x7f0250005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:20.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026effd640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 0x7f0250008750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:20.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 0x7f025000b2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:05:20.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 0x7f0250005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:05:20.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026effd640 10 monclient(hunting): get_auth_request con 0x7f02500062e0 auth_method 0 2024-08-18T21:05:20.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:20.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:20.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026effd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:20.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026effd640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 msgr2=0x7f0250008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:05:20.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026effd640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 msgr2=0x7f0250008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:20.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026effd640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 0x7f0250008750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:20.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:20.527+0000 7f026effd640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 0x7f0250008750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:05:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 10 monclient(hunting): tick 2024-08-18T21:05:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:05:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 1 monclient(hunting): continuing hunt 2024-08-18T21:05:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:05:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 msgr2=0x7f0250005ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02500038b0 0x7f0250005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 msgr2=0x7f0250008750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.157:3300/0 conn(0x7f02500062e0 0x7f0250008750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 1 -- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 msgr2=0x7f025000b2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 1 --2- 172.21.15.5:0/1920511673 >> v2:172.21.15.5:3300/0 conn(0x7f0250008e10 0x7f025000b2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 10 monclient: _add_conns ranks=[8,0,5,6,3] 2024-08-18T21:05:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 reap_dead start 2024-08-18T21:05:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f025000c140 0x7f025000e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 10 monclient(hunting): picked mon.noname-e con 0x7f025000c140 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:05:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 reap_dead start 2024-08-18T21:05:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0250003cd0 addr v1:172.21.15.5:6789/0 2024-08-18T21:05:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f025000a9e0 0x7f0250008750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 10 monclient(hunting): picked mon.noname-h con 0x7f025000a9e0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 1 -- 172.21.15.5:0/1920511673 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02700a8900 con 0x7f0250003cd0 2024-08-18T21:05:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 1 -- 172.21.15.5:0/1920511673 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f02700a32d0 con 0x7f025000a9e0 2024-08-18T21:05:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 1 -- 172.21.15.5:0/1920511673 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f025000b9a0 con 0x7f025000c140 2024-08-18T21:05:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026d7fa640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026f7fe640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f025000c140 msgr2=0x7f025000e530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:05:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.111+0000 7f026f7fe640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f025000c140 0x7f025000e530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f025000a9e0 0x7f0250008750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 10 monclient(hunting): get_auth_request con 0x7f025000a9e0 auth_method 0 2024-08-18T21:05:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 10 monclient(hunting): handle_auth_done global_id 34277 payload 274 2024-08-18T21:05:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f025000c140 msgr2=0x7f025000e530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f025000c140 0x7f025000e530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> v1:172.21.15.5:6789/0 conn(0x7f0250003cd0 legacy=0x7f02500092c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 10 monclient: _finish_hunting 0 2024-08-18T21:05:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 1 monclient: found mon.noname-h 2024-08-18T21:05:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:05:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.115+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f025000afe0 con 0x7f025000a9e0 2024-08-18T21:05:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f026ffff640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f025000a9e0 msgr2=0x7f0250008750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f026ffff640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f025000a9e0 0x7f0250008750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f02700a43b0 tx=0x7f026801da00 comp rx=0 tx=0).ready entity=mon.5 client_cookie=db1182f94918f9d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f026e7fc640 1 -- 172.21.15.5:0/1920511673 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f026800f040 con 0x7f025000a9e0 2024-08-18T21:05:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f026e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f026e7fc640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:05:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f026e7fc640 10 monclient: dump: 2024-08-18T21:05:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.126 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f026e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:05:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f026e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:05:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f026e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f026e7fc640 1 -- 172.21.15.5:0/1920511673 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02680af070 con 0x7f025000a9e0 2024-08-18T21:05:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f026e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f026e7fc640 1 -- 172.21.15.5:0/1920511673 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0268003a90 con 0x7f025000a9e0 2024-08-18T21:05:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f026e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f026e7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:05:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f026e7fc640 10 monclient: dump: 2024-08-18T21:05:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.128 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f0275c04640 5 monclient: authenticate success, global_id 34277 2024-08-18T21:05:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f0275c04640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f0275c04640 4 set_mon_vals no callback set 2024-08-18T21:05:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f0275c04640 10 monclient: shutdown 2024-08-18T21:05:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f0275c04640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f0275c04640 1 -- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f025000a9e0 msgr2=0x7f0250008750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f0275c04640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f025000a9e0 0x7f0250008750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f02700a43b0 tx=0x7f026801da00 comp rx=0 tx=0).stop 2024-08-18T21:05:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f0275c04640 1 -- 172.21.15.5:0/1920511673 shutdown_connections 2024-08-18T21:05:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f0275c04640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f025000a9e0 0x7f0250008750 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f0275c04640 1 --2- 172.21.15.5:0/1920511673 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f025000c140 0x7f025000e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f0275c04640 1 -- 172.21.15.5:0/1920511673 >> 172.21.15.5:0/1920511673 conn(0x7f02700acbc0 msgr2=0x7f02700a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f0275c04640 1 -- 172.21.15.5:0/1920511673 shutdown_connections 2024-08-18T21:05:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.123+0000 7f0275c04640 1 -- 172.21.15.5:0/1920511673 wait complete. 2024-08-18T21:05:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 10 monclient: build_initial_monmap 2024-08-18T21:05:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 10 monclient: monmap: 2024-08-18T21:05:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:22.133 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 1 Processor -- start 2024-08-18T21:05:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 1 -- start start 2024-08-18T21:05:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 10 monclient: init 2024-08-18T21:05:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 10 monclient: _add_conns ranks=[6,4,2,0,7,5,8,1,3] 2024-08-18T21:05:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0250003cd0 0x7f02701d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 10 monclient(hunting): picked mon.noname-d con 0x7f0250003cd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f025000a9e0 0x7f0270138b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 10 monclient(hunting): picked mon.noname-c con 0x7f025000a9e0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f025000c140 0x7f0270139040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 10 monclient(hunting): picked mon.noname-b con 0x7f025000c140 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f02700a79e0 con 0x7f025000c140 2024-08-18T21:05:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f02700a8220 con 0x7f025000a9e0 2024-08-18T21:05:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f0270125f00 con 0x7f0250003cd0 2024-08-18T21:05:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f0275c04640 10 monclient(hunting): authenticate will time out at 1089.142620s 2024-08-18T21:05:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026f7fe640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0250003cd0 msgr2=0x7f02701d1b80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:05:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026f7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0250003cd0 0x7f02701d1b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026ffff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f025000c140 0x7f0270139040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f025000a9e0 0x7f0270138b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f025000a9e0 0x7f0270138b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:33808/0 (socket says 172.21.15.5:33808) 2024-08-18T21:05:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026ffff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f025000c140 0x7f0270139040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59844/0 (socket says 172.21.15.5:59844) 2024-08-18T21:05:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 1 -- 172.21.15.5:0/359166728 learned_addr learned my addr 172.21.15.5:0/359166728 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 10 monclient(hunting): get_auth_request con 0x7f025000a9e0 auth_method 0 2024-08-18T21:05:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026ffff640 10 monclient(hunting): get_auth_request con 0x7f025000c140 auth_method 0 2024-08-18T21:05:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 10 monclient(hunting): handle_auth_done global_id 4846 payload 824 2024-08-18T21:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 1 -- 172.21.15.5:0/359166728 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0250003cd0 msgr2=0x7f02701d1b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 1 --2- 172.21.15.5:0/359166728 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0250003cd0 0x7f02701d1b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 1 -- 172.21.15.5:0/359166728 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f025000c140 msgr2=0x7f0270139040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 1 --2- 172.21.15.5:0/359166728 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f025000c140 0x7f0270139040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 10 monclient: _finish_hunting 0 2024-08-18T21:05:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 1 monclient: found mon.noname-c 2024-08-18T21:05:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:05:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.127+0000 7f026effd640 1 -- 172.21.15.5:0/359166728 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0270124160 con 0x7f025000a9e0 2024-08-18T21:05:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f026effd640 1 -- 172.21.15.5:0/359166728 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f025000a9e0 msgr2=0x7f0270138b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f026effd640 1 --2- 172.21.15.5:0/359166728 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f025000a9e0 0x7f0270138b00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0260007100 tx=0x7f02600075c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0267fff640 1 -- 172.21.15.5:0/359166728 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f026001a070 con 0x7f025000a9e0 2024-08-18T21:05:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0267fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0267fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:05:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0267fff640 10 monclient: dump: 2024-08-18T21:05:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0267fff640 10 monclient: _finish_auth 0 2024-08-18T21:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0267fff640 10 monclient: _check_auth_tickets 2024-08-18T21:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0267fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0267fff640 1 -- 172.21.15.5:0/359166728 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0260013de0 con 0x7f025000a9e0 2024-08-18T21:05:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0267fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0267fff640 1 -- 172.21.15.5:0/359166728 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f02600168c0 con 0x7f025000a9e0 2024-08-18T21:05:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0275c04640 5 monclient: authenticate success, global_id 4846 2024-08-18T21:05:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0275c04640 10 monclient: _renew_subs 2024-08-18T21:05:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0275c04640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:05:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f026dffb640 4 set_mon_vals no callback set 2024-08-18T21:05:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0275c04640 1 -- 172.21.15.5:0/359166728 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027006ea50 con 0x7f025000a9e0 2024-08-18T21:05:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0267fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0267fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0267fff640 10 monclient: dump: 2024-08-18T21:05:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0275c04640 10 monclient: _renew_subs 2024-08-18T21:05:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0275c04640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:05:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0275c04640 1 -- 172.21.15.5:0/359166728 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f0270122930 con 0x7f025000a9e0 2024-08-18T21:05:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0267fff640 1 -- 172.21.15.5:0/359166728 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f0260016450 con 0x7f025000a9e0 2024-08-18T21:05:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0275c04640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0275c04640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0275c04640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:05:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0267fff640 1 --2- 172.21.15.5:0/359166728 >> v2:172.21.15.157:6812/631023601 conn(0x7f025003e020 0x7f02500404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0275c04640 1 -- 172.21.15.5:0/359166728 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0270139aa0 con 0x7f025000a9e0 2024-08-18T21:05:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.131+0000 7f0267fff640 1 -- 172.21.15.5:0/359166728 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(50..50 src has 11..50) ==== 3506+0+0 (secure 0 0 0) 0x7f0260010040 con 0x7f025000a9e0 2024-08-18T21:05:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.135+0000 7f026f7fe640 1 --2- 172.21.15.5:0/359166728 >> v2:172.21.15.157:6812/631023601 conn(0x7f025003e020 0x7f02500404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.135+0000 7f026f7fe640 10 monclient: get_auth_request con 0x7f025003e020 auth_method 0 2024-08-18T21:05:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.135+0000 7f026f7fe640 1 --2- 172.21.15.5:0/359166728 >> v2:172.21.15.157:6812/631023601 conn(0x7f025003e020 0x7f02500404e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0258000ee0 tx=0x7f0258008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.139+0000 7f0267fff640 1 -- 172.21.15.5:0/359166728 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f0260023030 con 0x7f025000a9e0 2024-08-18T21:05:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.139+0000 7f0267fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.139+0000 7f0267fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:22.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.387+0000 7f0275c04640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:05:22.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.387+0000 7f0275c04640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:05:22.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.387+0000 7f0275c04640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:05:22.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.387+0000 7f0275c04640 1 -- 172.21.15.5:0/359166728 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0270069580 con 0x7f025000a9e0 2024-08-18T21:05:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.387+0000 7f0267fff640 1 -- 172.21.15.5:0/359166728 <== mon.4 v2:172.21.15.5:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3160 (secure 0 0 0) 0x7f0260014c60 con 0x7f025000a9e0 2024-08-18T21:05:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.387+0000 7f0267fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:05:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.387+0000 7f0267fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:22.389 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":38,"quorum":[0,1,2,3,4,5,7],"quorum_names":["a","f","b","g","c","h","i"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:05:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.391+0000 7f0275c04640 1 -- 172.21.15.5:0/359166728 >> v2:172.21.15.157:6812/631023601 conn(0x7f025003e020 msgr2=0x7f02500404e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.391+0000 7f0275c04640 1 --2- 172.21.15.5:0/359166728 >> v2:172.21.15.157:6812/631023601 conn(0x7f025003e020 0x7f02500404e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0258000ee0 tx=0x7f0258008040 comp rx=0 tx=0).stop 2024-08-18T21:05:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.391+0000 7f0275c04640 10 monclient: shutdown 2024-08-18T21:05:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.391+0000 7f0275c04640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.391+0000 7f0275c04640 1 -- 172.21.15.5:0/359166728 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f025000a9e0 msgr2=0x7f0270138b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.391+0000 7f0275c04640 1 --2- 172.21.15.5:0/359166728 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f025000a9e0 0x7f0270138b00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0260007100 tx=0x7f02600075c0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.391+0000 7f0275c04640 1 -- 172.21.15.5:0/359166728 shutdown_connections 2024-08-18T21:05:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.391+0000 7f0275c04640 1 --2- 172.21.15.5:0/359166728 >> v2:172.21.15.157:6812/631023601 conn(0x7f025003e020 0x7f02500404e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.391+0000 7f0275c04640 1 --2- 172.21.15.5:0/359166728 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f025000c140 0x7f0270139040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.391+0000 7f0275c04640 1 --2- 172.21.15.5:0/359166728 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f025000a9e0 0x7f0270138b00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.391+0000 7f0275c04640 1 --2- 172.21.15.5:0/359166728 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0250003cd0 0x7f02701d1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.391+0000 7f0275c04640 1 -- 172.21.15.5:0/359166728 >> 172.21.15.5:0/359166728 conn(0x7f02700acbc0 msgr2=0x7f02700a8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.391+0000 7f0275c04640 1 -- 172.21.15.5:0/359166728 shutdown_connections 2024-08-18T21:05:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.391+0000 7f0275c04640 1 -- 172.21.15.5:0/359166728 wait complete. 2024-08-18T21:05:22.410 INFO:tasks.mon_thrash.ceph_manager:quorum is size 7 2024-08-18T21:05:22.410 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon a 2024-08-18T21:05:22.410 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:05:22.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 10 monclient: get_monmap_and_config 2024-08-18T21:05:22.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 10 monclient: build_initial_monmap 2024-08-18T21:05:22.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 10 monclient: monmap: 2024-08-18T21:05:22.535 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:22.536 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.536 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:22.537120+0000 2024-08-18T21:05:22.536 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:22.537120+0000 2024-08-18T21:05:22.536 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:22.536 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.536 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:22.536 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:22.536 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:22.536 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:22.536 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:22.537 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:22.537 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:22.537 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:22.537 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:22.537 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:22.537 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:22.537 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 1 Processor -- start 2024-08-18T21:05:22.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 1 -- start start 2024-08-18T21:05:22.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 10 monclient: init 2024-08-18T21:05:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 10 monclient: _add_conns ranks=[3,10,8,1,5,0,4,7,6,9,2] 2024-08-18T21:05:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97640a6ce0 0x7f97640a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 10 monclient(hunting): picked mon.noname-g con 0x7f97640a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f97640a7600 0x7f9764139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 10 monclient(hunting): picked mon.noname-f con 0x7f97640a7600 addr v2:172.21.15.157:3300/0 2024-08-18T21:05:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9764139fe0 0x7f976413a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 10 monclient(hunting): picked mon.noname-e con 0x7f9764139fe0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:05:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f97640a5000 con 0x7f97640a7600 2024-08-18T21:05:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f97640a4360 con 0x7f97640a6ce0 2024-08-18T21:05:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f97640a45d0 con 0x7f9764139fe0 2024-08-18T21:05:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f976a345640 10 monclient(hunting): authenticate will time out at 1089.550240s 2024-08-18T21:05:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f97688e2640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9764139fe0 msgr2=0x7f976413a440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:05:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f97688e2640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9764139fe0 0x7f976413a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f97640a7600 0x7f9764139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f9763fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97640a6ce0 0x7f97640a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f97640a7600 0x7f9764139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:59576/0 (socket says 172.21.15.5:59576) 2024-08-18T21:05:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 1 -- 172.21.15.5:0/1626868651 learned_addr learned my addr 172.21.15.5:0/1626868651 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 10 monclient(hunting): get_auth_request con 0x7f97640a7600 auth_method 0 2024-08-18T21:05:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f9763fff640 10 monclient(hunting): get_auth_request con 0x7f97640a6ce0 auth_method 0 2024-08-18T21:05:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f9763fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f9763fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f9763fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f9763fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f9763fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f9763fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 10 monclient(hunting): handle_auth_done global_id 4681 payload 274 2024-08-18T21:05:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 1 -- 172.21.15.5:0/1626868651 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9764139fe0 msgr2=0x7f976413a440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 1 --2- 172.21.15.5:0/1626868651 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9764139fe0 0x7f976413a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 1 -- 172.21.15.5:0/1626868651 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97640a6ce0 msgr2=0x7f97640a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 1 --2- 172.21.15.5:0/1626868651 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97640a6ce0 0x7f97640a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:05:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 1 monclient: found mon.noname-f 2024-08-18T21:05:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:05:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f975bfff640 1 -- 172.21.15.5:0/1626868651 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97640a32d0 con 0x7f97640a7600 2024-08-18T21:05:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.535+0000 7f9763fff640 1 --2- 172.21.15.5:0/1626868651 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97640a6ce0 0x7f97640a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.539+0000 7f975bfff640 1 -- 172.21.15.5:0/1626868651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97640a7600 msgr2=0x7f9764139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.539+0000 7f975bfff640 1 --2- 172.21.15.5:0/1626868651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97640a7600 0x7f9764139aa0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f974c009870 tx=0x7f974c01c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c95a60237375e53 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97637fe640 1 -- 172.21.15.5:0/1626868651 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f974c0b0070 con 0x7f97640a7600 2024-08-18T21:05:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97637fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:05:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97637fe640 10 monclient: dump: 2024-08-18T21:05:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.552 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97637fe640 10 monclient: _finish_auth 0 2024-08-18T21:05:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97637fe640 10 monclient: _check_auth_tickets 2024-08-18T21:05:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97637fe640 1 -- 172.21.15.5:0/1626868651 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f974c0aa810 con 0x7f97640a7600 2024-08-18T21:05:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 5 monclient: authenticate success, global_id 4681 2024-08-18T21:05:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:05:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97637fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97637fe640 1 -- 172.21.15.5:0/1626868651 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f974c0aae30 con 0x7f97640a7600 2024-08-18T21:05:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 4 set_mon_vals no callback set 2024-08-18T21:05:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97637fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:05:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97637fe640 10 monclient: dump: 2024-08-18T21:05:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.554 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 10 monclient: shutdown 2024-08-18T21:05:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 -- 172.21.15.5:0/1626868651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97640a7600 msgr2=0x7f9764139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 --2- 172.21.15.5:0/1626868651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97640a7600 0x7f9764139aa0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f974c009870 tx=0x7f974c01c440 comp rx=0 tx=0).stop 2024-08-18T21:05:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 -- 172.21.15.5:0/1626868651 shutdown_connections 2024-08-18T21:05:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 --2- 172.21.15.5:0/1626868651 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9764139fe0 0x7f976413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 --2- 172.21.15.5:0/1626868651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97640a7600 0x7f9764139aa0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 --2- 172.21.15.5:0/1626868651 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97640a6ce0 0x7f97640a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 -- 172.21.15.5:0/1626868651 >> 172.21.15.5:0/1626868651 conn(0x7f97640acbc0 msgr2=0x7f97640a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 -- 172.21.15.5:0/1626868651 shutdown_connections 2024-08-18T21:05:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 -- 172.21.15.5:0/1626868651 wait complete. 2024-08-18T21:05:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 10 monclient: build_initial_monmap 2024-08-18T21:05:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 10 monclient: monmap: 2024-08-18T21:05:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 Processor -- start 2024-08-18T21:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 -- start start 2024-08-18T21:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 10 monclient: init 2024-08-18T21:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 10 monclient: _add_conns ranks=[1,3,2,4,5,6,0,8,7] 2024-08-18T21:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97640a6ce0 0x7f9764133a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 10 monclient(hunting): picked mon.noname-f con 0x7f97640a6ce0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:05:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97640a7600 0x7f9764133f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 10 monclient(hunting): picked mon.noname-g con 0x7f97640a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9764139fe0 0x7f97641344c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 10 monclient(hunting): picked mon.noname-b con 0x7f9764139fe0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f97640a79e0 con 0x7f97640a6ce0 2024-08-18T21:05:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f97640a8220 con 0x7f9764139fe0 2024-08-18T21:05:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f97640aa1e0 con 0x7f97640a7600 2024-08-18T21:05:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f976a345640 10 monclient(hunting): authenticate will time out at 1089.558838s 2024-08-18T21:05:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9764139fe0 0x7f97641344c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9764139fe0 0x7f97641344c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59858/0 (socket says 172.21.15.5:59858) 2024-08-18T21:05:22.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 1 -- 172.21.15.5:0/3547215311 learned_addr learned my addr 172.21.15.5:0/3547215311 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:22.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 10 monclient(hunting): get_auth_request con 0x7f9764139fe0 auth_method 0 2024-08-18T21:05:22.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f9763fff640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97640a6ce0 0x7f9764133a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f9763fff640 10 monclient(hunting): get_auth_request con 0x7f97640a6ce0 auth_method 0 2024-08-18T21:05:22.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f9763fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f9763fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f9763fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f975bfff640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97640a7600 0x7f9764133f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f975bfff640 10 monclient(hunting): get_auth_request con 0x7f97640a7600 auth_method 0 2024-08-18T21:05:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f975bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f975bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f975bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f9763fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f9763fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f9763fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 10 monclient(hunting): handle_auth_done global_id 4934 payload 824 2024-08-18T21:05:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 1 -- 172.21.15.5:0/3547215311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97640a7600 msgr2=0x7f9764133f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97640a7600 0x7f9764133f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 1 -- 172.21.15.5:0/3547215311 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97640a6ce0 msgr2=0x7f9764133a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97640a6ce0 0x7f9764133a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 10 monclient: _finish_hunting 0 2024-08-18T21:05:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 1 monclient: found mon.noname-b 2024-08-18T21:05:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.543+0000 7f97688e2640 1 -- 172.21.15.5:0/3547215311 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976413d5e0 con 0x7f9764139fe0 2024-08-18T21:05:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97688e2640 1 -- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9764139fe0 msgr2=0x7f97641344c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97688e2640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9764139fe0 0x7f97641344c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f975c00be90 tx=0x7f975c00bf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97617fa640 1 -- 172.21.15.5:0/3547215311 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f975c015850 con 0x7f9764139fe0 2024-08-18T21:05:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97617fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97617fa640 10 monclient: dump: 2024-08-18T21:05:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.562 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97617fa640 10 monclient: _finish_auth 0 2024-08-18T21:05:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97617fa640 10 monclient: _check_auth_tickets 2024-08-18T21:05:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97617fa640 1 -- 172.21.15.5:0/3547215311 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f975c010030 con 0x7f9764139fe0 2024-08-18T21:05:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97617fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97617fa640 1 -- 172.21.15.5:0/3547215311 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f975c0060d0 con 0x7f9764139fe0 2024-08-18T21:05:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97617fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f9762ffd640 4 set_mon_vals no callback set 2024-08-18T21:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97617fa640 10 monclient: dump: 2024-08-18T21:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.564 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f976a345640 5 monclient: authenticate success, global_id 4934 2024-08-18T21:05:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f976a345640 10 monclient: _renew_subs 2024-08-18T21:05:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f976a345640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f976a345640 1 -- 172.21.15.5:0/3547215311 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97640aa5a0 con 0x7f9764139fe0 2024-08-18T21:05:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f976a345640 10 monclient: _renew_subs 2024-08-18T21:05:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f976a345640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f976a345640 1 -- 172.21.15.5:0/3547215311 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f976413cd40 con 0x7f9764139fe0 2024-08-18T21:05:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f976a345640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f976a345640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9764137e10 0x7f97641381f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f976a345640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f976a345640 1 -- 172.21.15.5:0/3547215311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f97640a7b60 con 0x7f9764137e10 2024-08-18T21:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f9763fff640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9764137e10 0x7f97641381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f9763fff640 10 monclient: get_auth_request con 0x7f9764137e10 auth_method 0 2024-08-18T21:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f9763fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f9763fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f9763fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f9763fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f9763fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f9763fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97688e2640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9764139fe0 0x7f97641344c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f975c00be90 tx=0x7f975c00bf80 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7f975c04edf0 osd_map(51..51 src has 11..51) 2024-08-18T21:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97617fa640 1 -- 172.21.15.5:0/3547215311 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f975c0153e0 con 0x7f9764139fe0 2024-08-18T21:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f9763fff640 10 monclient(hunting): handle_auth_done global_id 4878 payload 824 2024-08-18T21:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f9763fff640 1 -- 172.21.15.5:0/3547215311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f976413cf40 con 0x7f9764137e10 2024-08-18T21:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f97617fa640 1 --2- 172.21.15.5:0/3547215311 >> v2:172.21.15.157:6812/631023601 conn(0x7f974403bdf0 0x7f974403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f975bfff640 1 --2- 172.21.15.5:0/3547215311 >> v2:172.21.15.157:6812/631023601 conn(0x7f974403bdf0 0x7f974403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.547+0000 7f975bfff640 10 monclient: get_auth_request con 0x7f974403bdf0 auth_method 0 2024-08-18T21:05:22.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.551+0000 7f9763fff640 1 -- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9764137e10 msgr2=0x7f97641381f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:22.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.551+0000 7f9763fff640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9764137e10 0x7f97641381f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f97540119d0 tx=0x7f9754011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.551+0000 7f97617fa640 1 -- 172.21.15.5:0/3547215311 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97540148b0 con 0x7f9764137e10 2024-08-18T21:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.551+0000 7f97617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.551+0000 7f97617fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.551+0000 7f97617fa640 10 monclient: dump: 2024-08-18T21:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.570 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.551+0000 7f97617fa640 1 -- 172.21.15.5:0/3547215311 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9754014440 con 0x7f9764137e10 2024-08-18T21:05:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.551+0000 7f97617fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.551+0000 7f97617fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.551+0000 7f97617fa640 1 -- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9764137e10 msgr2=0x7f97641381f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.551+0000 7f97617fa640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9764137e10 0x7f97641381f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f97540119d0 tx=0x7f9754011e90 comp rx=0 tx=0).stop 2024-08-18T21:05:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.551+0000 7f97617fa640 1 -- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9764137e10 msgr2=0x7f97641381f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.551+0000 7f97617fa640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9764137e10 0x7f97641381f0 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f97540119d0 tx=0x7f9754011e90 comp rx=0 tx=0).stop 2024-08-18T21:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.551+0000 7f975bfff640 1 --2- 172.21.15.5:0/3547215311 >> v2:172.21.15.157:6812/631023601 conn(0x7f974403bdf0 0x7f974403e2b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f974c009870 tx=0x7f974c0a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f976a345640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f976a345640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9764138730 0x7f976413aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f976a345640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f976a345640 1 -- 172.21.15.5:0/3547215311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9764051140 con 0x7f9764138730 2024-08-18T21:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f9763fff640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9764138730 0x7f976413aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f9763fff640 10 monclient: get_auth_request con 0x7f9764138730 auth_method 0 2024-08-18T21:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f9763fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f9763fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f9763fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f9763fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f9763fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f9763fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f9763fff640 10 monclient(hunting): handle_auth_done global_id 4887 payload 824 2024-08-18T21:05:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f9763fff640 1 -- 172.21.15.5:0/3547215311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9764139aa0 con 0x7f9764138730 2024-08-18T21:05:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f9763fff640 1 -- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9764138730 msgr2=0x7f976413aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f9763fff640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9764138730 0x7f976413aa40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f97540119d0 tx=0x7f97540046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f97617fa640 1 -- 172.21.15.5:0/3547215311 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f975401d870 con 0x7f9764138730 2024-08-18T21:05:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f97617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f97617fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:05:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f97617fa640 10 monclient: dump: 2024-08-18T21:05:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f97617fa640 1 -- 172.21.15.5:0/3547215311 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9394 (secure 0 0 0) 0x7f975401d400 con 0x7f9764138730 2024-08-18T21:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f97617fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f97617fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f97617fa640 1 -- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9764138730 msgr2=0x7f976413aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f97617fa640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9764138730 0x7f976413aa40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f97540119d0 tx=0x7f97540046d0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f97617fa640 1 -- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9764138730 msgr2=0x7f976413aa40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f97617fa640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9764138730 0x7f976413aa40 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f97540119d0 tx=0x7f97540046d0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.575 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:22.575 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:22.575 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:22.575 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:05:22.575 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 38, 2024-08-18T21:05:22.575 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 131681, 2024-08-18T21:05:22.576 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:22.576 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:22.576 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:22.576 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:22.576 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:22.576 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:22.576 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:22.576 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:05:22.576 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:22.576 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:05:22.576 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:22.576 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:22.576 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:22.577 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:22.577 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:22.577 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:22.577 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:22.577 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:22.577 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:22.577 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:22.577 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:22.577 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:22.577 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:22.577 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:22.577 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:22.577 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:22.578 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:22.578 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:22.578 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:22.578 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:22.578 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:22.578 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:22.578 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:22.578 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:22.578 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:22.578 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:22.578 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:22.579 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:22.579 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.579 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:22.579 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:22.579 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:22.579 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:22.579 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:22.579 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:22.579 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:22.579 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:22.579 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:22.580 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:22.580 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:22.580 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:22.580 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:22.580 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:22.580 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:22.580 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:22.580 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:22.580 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:22.580 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:22.580 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:22.580 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:22.580 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:22.581 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:22.581 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:22.581 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:22.581 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:22.581 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:22.581 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:22.581 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:22.581 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:22.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.581 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:22.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.581 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:22.582 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:22.582 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:22.582 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:22.582 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.582 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.583 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:22.583 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:22.583 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.583 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.583 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.583 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:22.583 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:22.583 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.584 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:22.584 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.584 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:22.584 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.584 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.585 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:22.585 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:22.585 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.585 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.585 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.585 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:22.585 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:22.585 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.585 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.585 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.586 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:22.586 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.586 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.586 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:22.586 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.586 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.587 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.587 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:22.587 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:22.587 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.587 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.587 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.587 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.587 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:22.587 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:22.587 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.587 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.588 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.588 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.588 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:22.588 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.588 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.588 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.588 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:22.588 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.588 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.588 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.597 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:22.597 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.597 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.597 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.597 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:22.597 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.597 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.597 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.597 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:22.597 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:22.597 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.597 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.598 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.598 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.598 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.598 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:22.598 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:22.598 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.598 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:22.599 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:22.599 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:22.599 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.599 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:22.599 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:22.599 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.599 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:22.599 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:22.599 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:05:22.599 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.599 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:22.599 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:05:22.599 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.599 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:22.600 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:22.600 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:22.600 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.600 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.600 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:22.600 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f976a345640 1 -- 172.21.15.5:0/3547215311 >> v2:172.21.15.157:6812/631023601 conn(0x7f974403bdf0 msgr2=0x7f974403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f976a345640 1 --2- 172.21.15.5:0/3547215311 >> v2:172.21.15.157:6812/631023601 conn(0x7f974403bdf0 0x7f974403e2b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f974c009870 tx=0x7f974c0a6000 comp rx=0 tx=0).stop 2024-08-18T21:05:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f976a345640 10 monclient: shutdown 2024-08-18T21:05:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f976a345640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f976a345640 1 -- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9764139fe0 msgr2=0x7f97641344c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f976a345640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9764139fe0 0x7f97641344c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f975c00be90 tx=0x7f975c00bf80 comp rx=0 tx=0).stop 2024-08-18T21:05:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f97688e2640 1 -- 172.21.15.5:0/3547215311 reap_dead start 2024-08-18T21:05:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f97617fa640 1 -- 172.21.15.5:0/3547215311 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(51..51 src has 11..51) ==== 3898+0+0 (unknown 0 0 0) 0x7f975c04edf0 con 0x7f9764139fe0 2024-08-18T21:05:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f976a345640 1 -- 172.21.15.5:0/3547215311 shutdown_connections 2024-08-18T21:05:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f976a345640 1 --2- 172.21.15.5:0/3547215311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9764139fe0 0x7f97641344c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f976a345640 1 -- 172.21.15.5:0/3547215311 >> 172.21.15.5:0/3547215311 conn(0x7f97640acbc0 msgr2=0x7f97641354c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f976a345640 1 -- 172.21.15.5:0/3547215311 shutdown_connections 2024-08-18T21:05:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.559+0000 7f976a345640 1 -- 172.21.15.5:0/3547215311 wait complete. 2024-08-18T21:05:22.603 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:05:22.603 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon b 2024-08-18T21:05:22.603 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:05:22.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 10 monclient: get_monmap_and_config 2024-08-18T21:05:22.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 10 monclient: build_initial_monmap 2024-08-18T21:05:22.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 10 monclient: monmap: 2024-08-18T21:05:22.728 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:22.728 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.728 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:22.729697+0000 2024-08-18T21:05:22.728 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:22.729697+0000 2024-08-18T21:05:22.728 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:22.729 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.729 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:22.729 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:22.729 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:22.729 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:22.729 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:22.729 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:22.729 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:22.729 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:22.729 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:22.729 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:22.729 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:22.729 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 1 Processor -- start 2024-08-18T21:05:22.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 1 -- start start 2024-08-18T21:05:22.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 10 monclient: init 2024-08-18T21:05:22.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:22.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 10 monclient: _add_conns ranks=[6,2,0,5,8,10,1,9,3,4,7] 2024-08-18T21:05:22.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f561c0a4bb0 0x7f561c06f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 10 monclient(hunting): picked mon.noname-d con 0x7f561c0a4bb0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:22.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c0a4f90 0x7f561c0a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 10 monclient(hunting): picked mon.noname-b con 0x7f561c0a4f90 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:22.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f561c132cf0 addr v1:172.21.15.5:6789/0 2024-08-18T21:05:22.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f561c06db40 con 0x7f561c132cf0 2024-08-18T21:05:22.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f561c0aaf10 con 0x7f561c0a4f90 2024-08-18T21:05:22.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f561c06e5e0 con 0x7f561c0a4bb0 2024-08-18T21:05:22.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:22.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f5621066640 10 monclient(hunting): authenticate will time out at 1089.743107s 2024-08-18T21:05:22.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561ad9d640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f561c0a4bb0 msgr2=0x7f561c06f2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:05:22.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561ad9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f561c0a4bb0 0x7f561c06f2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:22.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561b59e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f561c132cf0 0x7f561c133180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55546/0 (socket says 172.21.15.5:55546) 2024-08-18T21:05:22.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561b59e640 1 -- 172.21.15.5:0/4228724228 learned_addr learned my addr 172.21.15.5:0/4228724228 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:05:22.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 1 --2- 172.21.15.5:0/4228724228 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c0a4f90 0x7f561c0a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 10 monclient(hunting): get_auth_request con 0x7f561c0a4f90 auth_method 0 2024-08-18T21:05:22.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 10 monclient(hunting): handle_auth_done global_id 4943 payload 274 2024-08-18T21:05:22.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 1 -- 172.21.15.5:0/4228724228 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f561c0a4bb0 msgr2=0x7f561c06f2a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:22.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 1 --2- 172.21.15.5:0/4228724228 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f561c0a4bb0 0x7f561c06f2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 1 -- 172.21.15.5:0/4228724228 >> v1:172.21.15.5:6789/0 conn(0x7f561c132cf0 legacy=0x7f561c133180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:22.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 10 monclient: _finish_hunting 0 2024-08-18T21:05:22.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 1 monclient: found mon.noname-b 2024-08-18T21:05:22.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:22.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:22.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.727+0000 7f561a59c640 1 -- 172.21.15.5:0/4228724228 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561c06e8c0 con 0x7f561c0a4f90 2024-08-18T21:05:22.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.731+0000 7f561a59c640 1 -- 172.21.15.5:0/4228724228 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c0a4f90 msgr2=0x7f561c0a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:22.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.731+0000 7f561a59c640 1 --2- 172.21.15.5:0/4228724228 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c0a4f90 0x7f561c0a5370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f56040097f0 tx=0x7f560401c1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e78f71b956ad0f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.731+0000 7f5619d9b640 1 -- 172.21.15.5:0/4228724228 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f56040b0070 con 0x7f561c0a4f90 2024-08-18T21:05:22.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5619d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5619d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:22.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5619d9b640 10 monclient: dump: 2024-08-18T21:05:22.738 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.739 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.739 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.739 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.739 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.739 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.739 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.739 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.739 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.739 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.739 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.739 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.739 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.739 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.740 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5619d9b640 10 monclient: _finish_auth 0 2024-08-18T21:05:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5619d9b640 10 monclient: _check_auth_tickets 2024-08-18T21:05:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5619d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5619d9b640 1 -- 172.21.15.5:0/4228724228 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56040aa810 con 0x7f561c0a4f90 2024-08-18T21:05:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5619d9b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5619d9b640 1 -- 172.21.15.5:0/4228724228 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f56040a93e0 con 0x7f561c0a4f90 2024-08-18T21:05:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 5 monclient: authenticate success, global_id 4943 2024-08-18T21:05:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 4 set_mon_vals no callback set 2024-08-18T21:05:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5619d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5619d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5619d9b640 10 monclient: dump: 2024-08-18T21:05:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.742 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.742 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.742 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.742 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.742 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 10 monclient: shutdown 2024-08-18T21:05:22.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:22.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 1 -- 172.21.15.5:0/4228724228 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c0a4f90 msgr2=0x7f561c0a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 1 --2- 172.21.15.5:0/4228724228 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c0a4f90 0x7f561c0a5370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f56040097f0 tx=0x7f560401c1b0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 1 -- 172.21.15.5:0/4228724228 shutdown_connections 2024-08-18T21:05:22.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 1 --2- 172.21.15.5:0/4228724228 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c0a4f90 0x7f561c0a5370 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 1 --2- 172.21.15.5:0/4228724228 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f561c0a4bb0 0x7f561c06f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 1 -- 172.21.15.5:0/4228724228 >> 172.21.15.5:0/4228724228 conn(0x7f561c069090 msgr2=0x7f561c0aa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:22.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 1 -- 172.21.15.5:0/4228724228 shutdown_connections 2024-08-18T21:05:22.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 1 -- 172.21.15.5:0/4228724228 wait complete. 2024-08-18T21:05:22.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 10 monclient: build_initial_monmap 2024-08-18T21:05:22.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 10 monclient: monmap: 2024-08-18T21:05:22.743 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:22.743 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:22.743 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:22.743 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:22.743 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:22.743 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.743 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:22.743 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:22.744 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 1 Processor -- start 2024-08-18T21:05:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 1 -- start start 2024-08-18T21:05:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 10 monclient: init 2024-08-18T21:05:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 10 monclient: _add_conns ranks=[1,3,8,7,0,2,4,6,5] 2024-08-18T21:05:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f561c0a4bb0 0x7f561c132030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 10 monclient(hunting): picked mon.noname-f con 0x7f561c0a4bb0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:05:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f561c132cf0 0x7f561c132570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 10 monclient(hunting): picked mon.noname-g con 0x7f561c132cf0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f561c1ce6b0 0x7f561c1ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 10 monclient(hunting): picked mon.noname-e con 0x7f561c1ce6b0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:05:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f561c1445e0 con 0x7f561c0a4bb0 2024-08-18T21:05:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f561c144460 con 0x7f561c132cf0 2024-08-18T21:05:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f561c144760 con 0x7f561c1ce6b0 2024-08-18T21:05:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f5621066640 10 monclient(hunting): authenticate will time out at 1089.750465s 2024-08-18T21:05:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561b59e640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f561c1ce6b0 msgr2=0x7f561c1ceb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:05:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561b59e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f561c1ce6b0 0x7f561c1ceb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f561c132cf0 0x7f561c132570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f561c132cf0 0x7f561c132570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:55930/0 (socket says 172.21.15.5:55930) 2024-08-18T21:05:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 1 -- 172.21.15.5:0/3047699979 learned_addr learned my addr 172.21.15.5:0/3047699979 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 10 monclient(hunting): get_auth_request con 0x7f561c132cf0 auth_method 0 2024-08-18T21:05:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561ad9d640 1 --2- 172.21.15.5:0/3047699979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f561c0a4bb0 0x7f561c132030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561ad9d640 10 monclient(hunting): get_auth_request con 0x7f561c0a4bb0 auth_method 0 2024-08-18T21:05:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 10 monclient(hunting): handle_auth_done global_id 4836 payload 824 2024-08-18T21:05:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 1 -- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f561c1ce6b0 msgr2=0x7f561c1ceb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:05:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 1 --2- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f561c1ce6b0 0x7f561c1ceb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 1 -- 172.21.15.5:0/3047699979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f561c0a4bb0 msgr2=0x7f561c132030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 1 --2- 172.21.15.5:0/3047699979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f561c0a4bb0 0x7f561c132030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 10 monclient: _finish_hunting 0 2024-08-18T21:05:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 1 monclient: found mon.noname-g 2024-08-18T21:05:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:05:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.735+0000 7f561a59c640 1 -- 172.21.15.5:0/3047699979 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561c13a430 con 0x7f561c132cf0 2024-08-18T21:05:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f561a59c640 1 -- 172.21.15.5:0/3047699979 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f561c132cf0 msgr2=0x7f561c132570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f561a59c640 1 --2- 172.21.15.5:0/3047699979 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f561c132cf0 0x7f561c132570 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f560401ca50 tx=0x7f5604018f50 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f56137fe640 1 -- 172.21.15.5:0/3047699979 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f56040b9070 con 0x7f561c132cf0 2024-08-18T21:05:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f56137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f56137fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:05:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f56137fe640 10 monclient: dump: 2024-08-18T21:05:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.752 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.752 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.752 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.752 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.752 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.752 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.752 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.752 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f56137fe640 10 monclient: _finish_auth 0 2024-08-18T21:05:22.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f56137fe640 10 monclient: _check_auth_tickets 2024-08-18T21:05:22.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f56137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:22.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f56137fe640 1 -- 172.21.15.5:0/3047699979 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56040aae20 con 0x7f561c132cf0 2024-08-18T21:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f56137fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f5621066640 5 monclient: authenticate success, global_id 4836 2024-08-18T21:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f56137fe640 1 -- 172.21.15.5:0/3047699979 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f56040b0040 con 0x7f561c132cf0 2024-08-18T21:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f5621066640 10 monclient: _renew_subs 2024-08-18T21:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f5621066640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.157:3301/0 2024-08-18T21:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f5621066640 1 -- 172.21.15.5:0/3047699979 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f561c138320 con 0x7f561c132cf0 2024-08-18T21:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f561959a640 4 set_mon_vals no callback set 2024-08-18T21:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f56137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f56137fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f56137fe640 10 monclient: dump: 2024-08-18T21:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.754 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f5621066640 10 monclient: _renew_subs 2024-08-18T21:05:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f5621066640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.157:3301/0 2024-08-18T21:05:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f5621066640 1 -- 172.21.15.5:0/3047699979 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f561c132ab0 con 0x7f561c132cf0 2024-08-18T21:05:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f5621066640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.739+0000 7f5621066640 1 --2- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c1cf070 0x7f561c09f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f5621066640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f5621066640 1 -- 172.21.15.5:0/3047699979 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f561c051140 con 0x7f561c1cf070 2024-08-18T21:05:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f561ad9d640 1 --2- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c1cf070 0x7f561c09f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f561ad9d640 10 monclient: get_auth_request con 0x7f561c1cf070 auth_method 0 2024-08-18T21:05:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f561ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f561ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f561ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f561ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f561ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f561ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f561ad9d640 10 monclient(hunting): handle_auth_done global_id 4952 payload 824 2024-08-18T21:05:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f561ad9d640 1 -- 172.21.15.5:0/3047699979 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f561c1389f0 con 0x7f561c1cf070 2024-08-18T21:05:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f56137fe640 1 -- 172.21.15.5:0/3047699979 <== mon.3 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f5604004030 con 0x7f561c132cf0 2024-08-18T21:05:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f56137fe640 1 --2- 172.21.15.5:0/3047699979 >> v2:172.21.15.157:6812/631023601 conn(0x7f55fc03bdf0 0x7f55fc03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f56137fe640 1 -- 172.21.15.5:0/3047699979 <== mon.3 v2:172.21.15.157:3301/0 5 ==== osd_map(51..51 src has 11..51) ==== 3898+0+0 (secure 0 0 0) 0x7f56040e7740 con 0x7f561c132cf0 2024-08-18T21:05:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f561ad9d640 1 -- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c1cf070 msgr2=0x7f561c09f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f561ad9d640 1 --2- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c1cf070 0x7f561c09f2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5614009fd0 tx=0x7f5614005420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f56137fe640 1 -- 172.21.15.5:0/3047699979 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5614019070 con 0x7f561c1cf070 2024-08-18T21:05:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f56137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f561b59e640 1 --2- 172.21.15.5:0/3047699979 >> v2:172.21.15.157:6812/631023601 conn(0x7f55fc03bdf0 0x7f55fc03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f56137fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f56137fe640 10 monclient: dump: 2024-08-18T21:05:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.758 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f561b59e640 10 monclient: get_auth_request con 0x7f55fc03bdf0 auth_method 0 2024-08-18T21:05:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f56137fe640 1 -- 172.21.15.5:0/3047699979 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5614012730 con 0x7f561c1cf070 2024-08-18T21:05:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f56137fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f56137fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f56137fe640 1 -- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c1cf070 msgr2=0x7f561c09f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f56137fe640 1 --2- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c1cf070 0x7f561c09f2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5614009fd0 tx=0x7f5614005420 comp rx=0 tx=0).stop 2024-08-18T21:05:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f56137fe640 1 -- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c1cf070 msgr2=0x7f561c09f2f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.743+0000 7f56137fe640 1 --2- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c1cf070 0x7f561c09f2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.751+0000 7f561b59e640 1 --2- 172.21.15.5:0/3047699979 >> v2:172.21.15.157:6812/631023601 conn(0x7f55fc03bdf0 0x7f55fc03e2b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f560c004820 tx=0x7f560c007af0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.751+0000 7f5621066640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:22.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.751+0000 7f5621066640 1 --2- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c09f830 0x7f561c09fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.751+0000 7f5621066640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.751+0000 7f5621066640 1 -- 172.21.15.5:0/3047699979 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f561c1387d0 con 0x7f561c09f830 2024-08-18T21:05:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.751+0000 7f561ad9d640 1 --2- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c09f830 0x7f561c09fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.751+0000 7f561ad9d640 10 monclient: get_auth_request con 0x7f561c09f830 auth_method 0 2024-08-18T21:05:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.751+0000 7f561ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.751+0000 7f561ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.751+0000 7f561ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.751+0000 7f561ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.751+0000 7f561ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.751+0000 7f561ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.751+0000 7f561ad9d640 10 monclient(hunting): handle_auth_done global_id 4961 payload 824 2024-08-18T21:05:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.751+0000 7f561ad9d640 1 -- 172.21.15.5:0/3047699979 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f561c135290 con 0x7f561c09f830 2024-08-18T21:05:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f561ad9d640 1 -- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c09f830 msgr2=0x7f561c09fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f561ad9d640 1 --2- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c09f830 0x7f561c09fc40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5614009fd0 tx=0x7f5614005d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f56137fe640 1 -- 172.21.15.5:0/3047699979 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5614019030 con 0x7f561c09f830 2024-08-18T21:05:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f56137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f56137fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f56137fe640 10 monclient: dump: 2024-08-18T21:05:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.763 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f56137fe640 1 -- 172.21.15.5:0/3047699979 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9392 (secure 0 0 0) 0x7f5614024410 con 0x7f561c09f830 2024-08-18T21:05:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f56137fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f56137fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f56137fe640 1 -- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c09f830 msgr2=0x7f561c09fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f56137fe640 1 --2- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c09f830 0x7f561c09fc40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5614009fd0 tx=0x7f5614005d60 comp rx=0 tx=0).stop 2024-08-18T21:05:22.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f56137fe640 1 -- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c09f830 msgr2=0x7f561c09fc40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:22.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f56137fe640 1 --2- 172.21.15.5:0/3047699979 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f561c09f830 0x7f561c09fc40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.764 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:22.764 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:22.764 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:22.764 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:22.764 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 38, 2024-08-18T21:05:22.764 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 131869, 2024-08-18T21:05:22.765 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:22.765 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:22.765 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:22.765 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:22.765 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:22.765 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:22.765 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:22.765 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:05:22.765 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:22.765 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:05:22.765 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:22.765 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:22.765 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:22.766 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:22.766 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:22.766 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:22.766 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:22.766 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:22.766 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:22.766 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:22.766 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:22.766 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:22.766 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:22.766 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:22.766 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:22.767 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:22.767 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:22.767 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:22.767 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:22.767 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:22.767 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:22.767 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:22.767 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:22.767 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:22.767 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:22.767 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:22.767 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:22.768 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:22.768 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.768 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:22.768 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:22.768 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:22.768 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:22.768 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:22.768 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:22.768 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:22.768 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:22.768 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:22.768 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:22.769 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:22.769 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:22.769 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:22.769 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:22.769 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:22.769 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:22.769 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:22.769 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:22.769 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:22.769 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:22.769 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:22.769 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:22.770 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:22.770 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:22.770 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:22.770 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:22.770 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:22.770 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:22.770 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:22.770 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:22.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.770 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:22.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.770 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:22.770 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:22.771 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.771 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.771 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.771 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:22.771 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.771 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.771 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:22.771 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.771 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.771 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.772 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:22.772 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:22.772 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.772 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.772 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.772 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:22.772 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:22.772 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.772 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.776 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.776 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.776 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:22.776 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:22.776 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.776 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.776 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.776 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:22.776 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.776 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.777 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:22.777 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.777 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.777 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.777 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:22.777 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:22.777 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.777 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.777 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.777 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:22.778 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:22.778 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.778 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.778 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.778 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:22.778 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.779 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.779 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:22.779 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.779 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.779 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.779 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:22.779 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:22.779 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.780 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.780 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.780 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:22.780 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:22.780 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.780 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.780 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.780 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:22.780 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.782 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:22.782 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:22.782 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.782 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.782 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.782 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:22.782 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.782 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.782 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:22.783 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.783 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.783 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.783 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:22.783 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:22.783 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.783 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.783 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.783 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:22.783 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:22.783 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.783 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.784 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.784 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:22.784 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.784 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.784 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:22.784 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.784 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.784 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.784 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:22.785 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:22.785 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.785 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.785 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.785 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:22.785 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:22.785 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.785 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.785 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.785 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:22.786 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.786 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.786 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:22.786 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.786 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.786 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.786 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:22.786 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:22.786 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.786 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.787 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.787 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.787 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.787 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:22.787 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:22.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.787 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:22.787 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:22.787 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:22.787 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.787 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:22.787 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:05:22.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.788 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:22.788 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:22.788 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:22.788 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.788 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:22.788 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:22.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.788 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:22.788 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:22.788 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:22.788 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.788 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.789 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:22.789 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:22.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f5621066640 1 -- 172.21.15.5:0/3047699979 >> v2:172.21.15.157:6812/631023601 conn(0x7f55fc03bdf0 msgr2=0x7f55fc03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f5621066640 1 --2- 172.21.15.5:0/3047699979 >> v2:172.21.15.157:6812/631023601 conn(0x7f55fc03bdf0 0x7f55fc03e2b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f560c004820 tx=0x7f560c007af0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f5621066640 10 monclient: shutdown 2024-08-18T21:05:22.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f5621066640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:22.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f5621066640 1 -- 172.21.15.5:0/3047699979 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f561c132cf0 msgr2=0x7f561c132570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f5621066640 1 --2- 172.21.15.5:0/3047699979 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f561c132cf0 0x7f561c132570 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f560401ca50 tx=0x7f5604018f50 comp rx=0 tx=0).stop 2024-08-18T21:05:22.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f561b59e640 1 -- 172.21.15.5:0/3047699979 reap_dead start 2024-08-18T21:05:22.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f5621066640 1 -- 172.21.15.5:0/3047699979 shutdown_connections 2024-08-18T21:05:22.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f5621066640 1 --2- 172.21.15.5:0/3047699979 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f561c132cf0 0x7f561c132570 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f5621066640 1 -- 172.21.15.5:0/3047699979 >> 172.21.15.5:0/3047699979 conn(0x7f561c069090 msgr2=0x7f561c0a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:22.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f5621066640 1 -- 172.21.15.5:0/3047699979 shutdown_connections 2024-08-18T21:05:22.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.755+0000 7f5621066640 1 -- 172.21.15.5:0/3047699979 wait complete. 2024-08-18T21:05:22.792 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:05:22.792 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon c 2024-08-18T21:05:22.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:05:22.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.911+0000 7f4375ace640 10 monclient: get_monmap_and_config 2024-08-18T21:05:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.911+0000 7f4375ace640 10 monclient: build_initial_monmap 2024-08-18T21:05:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 10 monclient: monmap: 2024-08-18T21:05:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:22.916392+0000 2024-08-18T21:05:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:22.916392+0000 2024-08-18T21:05:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:22.916 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 1 Processor -- start 2024-08-18T21:05:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 1 -- start start 2024-08-18T21:05:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 10 monclient: init 2024-08-18T21:05:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 10 monclient: _add_conns ranks=[9,6,5,1,0,3,7,2,8,10,4] 2024-08-18T21:05:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4370068700 0x7f4370068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 10 monclient(hunting): picked mon.noname-a con 0x7f4370068700 addr v2:172.21.15.5:3300/0 2024-08-18T21:05:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f43700745e0 0x7f4370069020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 10 monclient(hunting): picked mon.noname-d con 0x7f43700745e0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f43701367f0 0x7f4370136ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 10 monclient(hunting): picked mon.noname-h con 0x7f43701367f0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f43700a1a00 con 0x7f4370068700 2024-08-18T21:05:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f4370069750 con 0x7f43701367f0 2024-08-18T21:05:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f437009f6b0 con 0x7f43700745e0 2024-08-18T21:05:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f4375ace640 10 monclient(hunting): authenticate will time out at 1089.929435s 2024-08-18T21:05:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436effd640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f43700745e0 msgr2=0x7f4370069020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:05:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436effd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f43700745e0 0x7f4370069020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4370068700 0x7f4370068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4370068700 0x7f4370068ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34034/0 (socket says 172.21.15.5:34034) 2024-08-18T21:05:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 1 -- 172.21.15.5:0/2356996810 learned_addr learned my addr 172.21.15.5:0/2356996810 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 10 monclient(hunting): get_auth_request con 0x7f4370068700 auth_method 0 2024-08-18T21:05:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436ffff640 1 --2- 172.21.15.5:0/2356996810 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f43701367f0 0x7f4370136ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436ffff640 10 monclient(hunting): get_auth_request con 0x7f43701367f0 auth_method 0 2024-08-18T21:05:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 10 monclient(hunting): handle_auth_done global_id 4896 payload 274 2024-08-18T21:05:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 1 -- 172.21.15.5:0/2356996810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f43700745e0 msgr2=0x7f4370069020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 1 --2- 172.21.15.5:0/2356996810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f43700745e0 0x7f4370069020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 1 -- 172.21.15.5:0/2356996810 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f43701367f0 msgr2=0x7f4370136ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 1 --2- 172.21.15.5:0/2356996810 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f43701367f0 0x7f4370136ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:05:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 1 monclient: found mon.noname-a 2024-08-18T21:05:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:05:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.915+0000 7f436f7fe640 1 -- 172.21.15.5:0/2356996810 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43700a0ff0 con 0x7f4370068700 2024-08-18T21:05:22.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f436f7fe640 1 -- 172.21.15.5:0/2356996810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4370068700 msgr2=0x7f4370068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:22.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f436f7fe640 1 --2- 172.21.15.5:0/2356996810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4370068700 0x7f4370068ae0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4358009870 tx=0x7f435801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd351f4d60985e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f436e7fc640 1 -- 172.21.15.5:0/2356996810 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f43580b0070 con 0x7f4370068700 2024-08-18T21:05:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f436e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f436e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:05:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f436e7fc640 10 monclient: dump: 2024-08-18T21:05:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.926 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f436e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:05:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f436e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:05:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f436e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f436e7fc640 1 -- 172.21.15.5:0/2356996810 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43580a4e50 con 0x7f4370068700 2024-08-18T21:05:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 5 monclient: authenticate success, global_id 4896 2024-08-18T21:05:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:05:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f436e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f436e7fc640 1 -- 172.21.15.5:0/2356996810 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f43580aac80 con 0x7f4370068700 2024-08-18T21:05:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f436e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 4 set_mon_vals no callback set 2024-08-18T21:05:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f436e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:05:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f436e7fc640 10 monclient: dump: 2024-08-18T21:05:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.928 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 10 monclient: shutdown 2024-08-18T21:05:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 1 -- 172.21.15.5:0/2356996810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4370068700 msgr2=0x7f4370068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 1 --2- 172.21.15.5:0/2356996810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4370068700 0x7f4370068ae0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4358009870 tx=0x7f435801c440 comp rx=0 tx=0).stop 2024-08-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 1 -- 172.21.15.5:0/2356996810 shutdown_connections 2024-08-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 1 --2- 172.21.15.5:0/2356996810 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f43701367f0 0x7f4370136ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 1 --2- 172.21.15.5:0/2356996810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f43700745e0 0x7f4370069020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 1 --2- 172.21.15.5:0/2356996810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4370068700 0x7f4370068ae0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 1 -- 172.21.15.5:0/2356996810 >> 172.21.15.5:0/2356996810 conn(0x7f43700a8020 msgr2=0x7f43700a8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 1 -- 172.21.15.5:0/2356996810 shutdown_connections 2024-08-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 1 -- 172.21.15.5:0/2356996810 wait complete. 2024-08-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 10 monclient: build_initial_monmap 2024-08-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 10 monclient: monmap: 2024-08-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:22.931 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.919+0000 7f4375ace640 1 Processor -- start 2024-08-18T21:05:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 1 -- start start 2024-08-18T21:05:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 10 monclient: init 2024-08-18T21:05:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 10 monclient: _add_conns ranks=[7,1,6,0,5,2,4,3,8] 2024-08-18T21:05:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4370068700 0x7f43701d1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 10 monclient(hunting): picked mon.noname-i con 0x7f4370068700 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43700745e0 0x7f4370131850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 10 monclient(hunting): picked mon.noname-f con 0x7f43700745e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:05:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f43701367f0 0x7f4370131d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 10 monclient(hunting): picked mon.noname-d con 0x7f43701367f0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f43701402d0 con 0x7f43700745e0 2024-08-18T21:05:22.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f4370069560 con 0x7f43701367f0 2024-08-18T21:05:22.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f4370140450 con 0x7f4370068700 2024-08-18T21:05:22.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:22.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f4375ace640 10 monclient(hunting): authenticate will time out at 1089.936562s 2024-08-18T21:05:22.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436ffff640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f43701367f0 msgr2=0x7f4370131d90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:05:22.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436ffff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f43701367f0 0x7f4370131d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:22.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43700745e0 0x7f4370131850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43700745e0 0x7f4370131850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:59596/0 (socket says 172.21.15.5:59596) 2024-08-18T21:05:22.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 1 -- 172.21.15.5:0/3744091053 learned_addr learned my addr 172.21.15.5:0/3744091053 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:22.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 10 monclient(hunting): get_auth_request con 0x7f43700745e0 auth_method 0 2024-08-18T21:05:22.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436f7fe640 1 --2- 172.21.15.5:0/3744091053 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4370068700 0x7f43701d1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436f7fe640 10 monclient(hunting): get_auth_request con 0x7f4370068700 auth_method 0 2024-08-18T21:05:22.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 10 monclient(hunting): handle_auth_done global_id 4708 payload 824 2024-08-18T21:05:22.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 1 -- 172.21.15.5:0/3744091053 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4370068700 msgr2=0x7f43701d1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 1 --2- 172.21.15.5:0/3744091053 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4370068700 0x7f43701d1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 1 -- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f43701367f0 msgr2=0x7f4370131d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:05:22.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 1 --2- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f43701367f0 0x7f4370131d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 10 monclient: _finish_hunting 0 2024-08-18T21:05:22.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 1 monclient: found mon.noname-f 2024-08-18T21:05:22.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:22.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:05:22.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.923+0000 7f436effd640 1 -- 172.21.15.5:0/3744091053 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4370072bc0 con 0x7f43700745e0 2024-08-18T21:05:22.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f436effd640 1 -- 172.21.15.5:0/3744091053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43700745e0 msgr2=0x7f4370131850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:22.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f436effd640 1 --2- 172.21.15.5:0/3744091053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43700745e0 0x7f4370131850 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f436000b9e0 tx=0x7f436000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4367fff640 1 -- 172.21.15.5:0/3744091053 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f436000cbb0 con 0x7f43700745e0 2024-08-18T21:05:22.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4367fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4367fff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:05:22.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4367fff640 10 monclient: dump: 2024-08-18T21:05:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.940 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.940 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.940 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4367fff640 10 monclient: _finish_auth 0 2024-08-18T21:05:22.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4367fff640 10 monclient: _check_auth_tickets 2024-08-18T21:05:22.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4367fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:22.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4367fff640 1 -- 172.21.15.5:0/3744091053 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4360010070 con 0x7f43700745e0 2024-08-18T21:05:22.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4367fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:22.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4367fff640 1 -- 172.21.15.5:0/3744091053 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f436000cd90 con 0x7f43700745e0 2024-08-18T21:05:22.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4375ace640 5 monclient: authenticate success, global_id 4708 2024-08-18T21:05:22.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4375ace640 10 monclient: _renew_subs 2024-08-18T21:05:22.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4375ace640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:05:22.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4375ace640 1 -- 172.21.15.5:0/3744091053 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43700a8400 con 0x7f43700745e0 2024-08-18T21:05:22.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f436d7fa640 4 set_mon_vals no callback set 2024-08-18T21:05:22.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4367fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4367fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:05:22.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4367fff640 10 monclient: dump: 2024-08-18T21:05:22.941 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.941 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.941 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.941 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.941 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.941 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.941 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.941 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.941 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.941 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.942 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.942 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.942 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.942 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.942 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.942 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4375ace640 10 monclient: _renew_subs 2024-08-18T21:05:22.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4375ace640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:05:22.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4375ace640 1 -- 172.21.15.5:0/3744091053 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f437011ec50 con 0x7f43700745e0 2024-08-18T21:05:22.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4375ace640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:22.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4375ace640 1 --2- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f43700711a0 0x7f4370071580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4375ace640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4375ace640 1 -- 172.21.15.5:0/3744091053 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f4370051140 con 0x7f43700711a0 2024-08-18T21:05:22.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f436f7fe640 1 --2- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f43700711a0 0x7f4370071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f436f7fe640 10 monclient: get_auth_request con 0x7f43700711a0 auth_method 0 2024-08-18T21:05:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f436f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f436f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f436f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f436f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f436f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f436f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f436f7fe640 10 monclient(hunting): handle_auth_done global_id 4855 payload 824 2024-08-18T21:05:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f436f7fe640 1 -- 172.21.15.5:0/3744091053 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f437011e670 con 0x7f43700711a0 2024-08-18T21:05:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4367fff640 1 -- 172.21.15.5:0/3744091053 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f4360003d10 con 0x7f43700745e0 2024-08-18T21:05:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4367fff640 1 --2- 172.21.15.5:0/3744091053 >> v2:172.21.15.157:6812/631023601 conn(0x7f435003bdf0 0x7f435003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f4367fff640 1 -- 172.21.15.5:0/3744091053 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(51..51 src has 11..51) ==== 3898+0+0 (secure 0 0 0) 0x7f436004e4b0 con 0x7f43700745e0 2024-08-18T21:05:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f436ffff640 1 --2- 172.21.15.5:0/3744091053 >> v2:172.21.15.157:6812/631023601 conn(0x7f435003bdf0 0x7f435003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.927+0000 7f436ffff640 10 monclient: get_auth_request con 0x7f435003bdf0 auth_method 0 2024-08-18T21:05:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.931+0000 7f436f7fe640 1 -- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f43700711a0 msgr2=0x7f4370071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.931+0000 7f436f7fe640 1 --2- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f43700711a0 0x7f4370071580 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f437009faf0 tx=0x7f43580191e0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.931+0000 7f4367fff640 1 -- 172.21.15.5:0/3744091053 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f43580ba020 con 0x7f43700711a0 2024-08-18T21:05:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.931+0000 7f4367fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.931+0000 7f4367fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.931+0000 7f4367fff640 10 monclient: dump: 2024-08-18T21:05:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.945 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.931+0000 7f4367fff640 1 -- 172.21.15.5:0/3744091053 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4358003830 con 0x7f43700711a0 2024-08-18T21:05:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.931+0000 7f4367fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.931+0000 7f4367fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.931+0000 7f4367fff640 1 -- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f43700711a0 msgr2=0x7f4370071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.931+0000 7f4367fff640 1 --2- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f43700711a0 0x7f4370071580 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f437009faf0 tx=0x7f43580191e0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.931+0000 7f4367fff640 1 -- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f43700711a0 msgr2=0x7f4370071580 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.931+0000 7f4367fff640 1 --2- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f43700711a0 0x7f4370071580 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f437009faf0 tx=0x7f43580191e0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.931+0000 7f436ffff640 1 --2- 172.21.15.5:0/3744091053 >> v2:172.21.15.157:6812/631023601 conn(0x7f435003bdf0 0x7f435003e2b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4368006f60 tx=0x7f4368008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.935+0000 7f4375ace640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.935+0000 7f4375ace640 1 --2- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4370071ac0 0x7f43700a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.935+0000 7f4375ace640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.935+0000 7f4375ace640 1 -- 172.21.15.5:0/3744091053 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f437006d150 con 0x7f4370071ac0 2024-08-18T21:05:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.935+0000 7f436f7fe640 1 --2- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4370071ac0 0x7f43700a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.935+0000 7f436f7fe640 10 monclient: get_auth_request con 0x7f4370071ac0 auth_method 0 2024-08-18T21:05:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.935+0000 7f436f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.935+0000 7f436f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.935+0000 7f436f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.935+0000 7f436f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.935+0000 7f436f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.935+0000 7f436f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.935+0000 7f436f7fe640 10 monclient(hunting): handle_auth_done global_id 4864 payload 824 2024-08-18T21:05:22.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.935+0000 7f436f7fe640 1 -- 172.21.15.5:0/3744091053 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4370136c60 con 0x7f4370071ac0 2024-08-18T21:05:22.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f436f7fe640 1 -- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4370071ac0 msgr2=0x7f43700a2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:22.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f436f7fe640 1 --2- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4370071ac0 0x7f43700a2920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f435801c270 tx=0x7f43580a8000 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:22.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4367fff640 1 -- 172.21.15.5:0/3744091053 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f43580ba040 con 0x7f4370071ac0 2024-08-18T21:05:22.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4367fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:22.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4367fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:22.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4367fff640 10 monclient: dump: 2024-08-18T21:05:22.948 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:22.948 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:22.948 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.948 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:22.948 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:22.949 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:22.949 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:22.949 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:22.949 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:22.949 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:22.949 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:22.949 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:22.949 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:22.949 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:22.949 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:22.949 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:22.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4367fff640 1 -- 172.21.15.5:0/3744091053 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9392 (secure 0 0 0) 0x7f43580b6470 con 0x7f4370071ac0 2024-08-18T21:05:22.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4367fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:22.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4367fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:22.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4367fff640 1 -- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4370071ac0 msgr2=0x7f43700a2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4367fff640 1 --2- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4370071ac0 0x7f43700a2920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f435801c270 tx=0x7f43580a8000 comp rx=0 tx=0).stop 2024-08-18T21:05:22.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4367fff640 1 -- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4370071ac0 msgr2=0x7f43700a2920 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:22.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4367fff640 1 --2- 172.21.15.5:0/3744091053 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4370071ac0 0x7f43700a2920 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f435801c270 tx=0x7f43580a8000 comp rx=0 tx=0).stop 2024-08-18T21:05:22.950 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:22.950 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:22.950 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:22.950 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:22.951 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 38, 2024-08-18T21:05:22.951 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 132057, 2024-08-18T21:05:22.951 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:22.951 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:22.951 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:22.951 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:22.951 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:22.951 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:22.951 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:22.951 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:05:22.951 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:22.951 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:05:22.951 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:22.951 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:22.952 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:22.952 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:22.952 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:22.952 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:22.952 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:22.952 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:22.952 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:22.952 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:22.952 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:22.952 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:22.952 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:22.952 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:22.952 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:22.953 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:22.953 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:22.953 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:22.953 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:22.953 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:22.953 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:22.953 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:22.953 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:22.953 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:22.953 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:22.953 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:22.953 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:22.953 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:22.954 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.954 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:22.954 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:22.954 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:22.954 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:22.954 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:22.954 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:22.954 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:22.954 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:22.954 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:22.954 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:22.955 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:22.955 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:22.955 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:22.955 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:22.955 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:22.955 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:22.955 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:22.955 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:22.955 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:22.955 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:22.955 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:22.955 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:22.956 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:22.956 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:22.956 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:22.956 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:22.956 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:22.956 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:22.956 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:22.956 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:22.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.956 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:22.956 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.956 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:22.956 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:22.956 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.956 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.957 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.957 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.957 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:22.957 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.957 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.957 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.957 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:22.957 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.957 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.957 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.957 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:22.957 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:22.958 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.958 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.958 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.958 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:22.958 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:22.958 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.958 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.958 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.958 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:22.958 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.959 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.959 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.959 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:22.959 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.959 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.959 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.959 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:22.959 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:22.959 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.959 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.959 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.959 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.960 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:22.960 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:22.960 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.960 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.960 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.960 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:22.960 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.960 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.960 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.960 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:22.960 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.960 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.961 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.961 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:22.961 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:22.961 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.961 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.961 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.961 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.961 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:22.961 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:22.961 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.961 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.961 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.962 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.962 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:22.962 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.962 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.962 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.962 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.962 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:22.962 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.962 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.962 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.962 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.963 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:22.963 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:22.963 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.963 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.963 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.963 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.963 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:22.963 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:22.963 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.963 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.963 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.963 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.964 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:22.964 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.964 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.964 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.964 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:22.964 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.964 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.964 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.964 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:22.964 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:22.964 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.964 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.965 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.965 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.965 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:22.965 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:22.965 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.965 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.965 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.965 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.965 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:22.965 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.966 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.966 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.966 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:22.966 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.966 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.966 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.966 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:22.966 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:22.966 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.966 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.966 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.967 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.967 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:22.967 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:22.967 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.967 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.967 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.967 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.967 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:22.967 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.967 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.967 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.967 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:22.968 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.968 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.968 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.968 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.968 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:22.968 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:22.968 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.968 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.968 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.968 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.968 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.968 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:22.968 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:22.969 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.969 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.969 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.969 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.969 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:22.969 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.969 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.969 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.969 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.969 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:22.969 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.969 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.969 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.970 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:22.970 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:22.970 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.970 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.970 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.970 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.970 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:22.970 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:22.970 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:22.970 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:22.970 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.971 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:22.971 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:22.971 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.971 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.971 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:22.971 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:22.971 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:22.971 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.971 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.971 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:22.972 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:22.972 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:22.972 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:22.972 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:22.972 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.972 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.972 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.972 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:22.972 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:22.972 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.972 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:22.972 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:22.972 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:22.972 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.973 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:22.973 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:05:22.973 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.973 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:22.973 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:22.973 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:05:22.973 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.973 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:22.973 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:22.973 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:22.973 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:22.973 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:22.973 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:22.974 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:22.974 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:22.974 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:22.974 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:22.974 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:22.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4375ace640 1 -- 172.21.15.5:0/3744091053 >> v2:172.21.15.157:6812/631023601 conn(0x7f435003bdf0 msgr2=0x7f435003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4375ace640 1 --2- 172.21.15.5:0/3744091053 >> v2:172.21.15.157:6812/631023601 conn(0x7f435003bdf0 0x7f435003e2b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4368006f60 tx=0x7f4368008040 comp rx=0 tx=0).stop 2024-08-18T21:05:22.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4375ace640 10 monclient: shutdown 2024-08-18T21:05:22.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4375ace640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:22.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4375ace640 1 -- 172.21.15.5:0/3744091053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43700745e0 msgr2=0x7f4370131850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4375ace640 1 --2- 172.21.15.5:0/3744091053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43700745e0 0x7f4370131850 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f436000b9e0 tx=0x7f436000bea0 comp rx=0 tx=0).stop 2024-08-18T21:05:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f436ffff640 1 -- 172.21.15.5:0/3744091053 reap_dead start 2024-08-18T21:05:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f436ffff640 1 -- 172.21.15.5:0/3744091053 reap_dead start 2024-08-18T21:05:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4375ace640 1 -- 172.21.15.5:0/3744091053 shutdown_connections 2024-08-18T21:05:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4375ace640 1 -- 172.21.15.5:0/3744091053 >> 172.21.15.5:0/3744091053 conn(0x7f43700a8020 msgr2=0x7f437013d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4375ace640 1 -- 172.21.15.5:0/3744091053 shutdown_connections 2024-08-18T21:05:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:22.939+0000 7f4375ace640 1 -- 172.21.15.5:0/3744091053 wait complete. 2024-08-18T21:05:22.976 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:05:22.976 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon f 2024-08-18T21:05:22.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:05:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 10 monclient: get_monmap_and_config 2024-08-18T21:05:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 10 monclient: build_initial_monmap 2024-08-18T21:05:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 10 monclient: monmap: 2024-08-18T21:05:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:23.101678+0000 2024-08-18T21:05:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:23.101678+0000 2024-08-18T21:05:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:23.102 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 1 Processor -- start 2024-08-18T21:05:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 1 -- start start 2024-08-18T21:05:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 10 monclient: init 2024-08-18T21:05:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 10 monclient: _add_conns ranks=[2,8,9,6,0,10,5,3,7,1,4] 2024-08-18T21:05:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7440a6bd0 0x7fd7440a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 10 monclient(hunting): picked mon.noname-b con 0x7fd7440a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd74409f080 0x7fd7440a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 10 monclient(hunting): picked mon.noname-e con 0x7fd74409f080 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:05:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd744139990 0x7fd744139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 10 monclient(hunting): picked mon.noname-a con 0x7fd744139990 addr v2:172.21.15.5:3300/0 2024-08-18T21:05:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd74409e4c0 con 0x7fd744139990 2024-08-18T21:05:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fd74406f930 con 0x7fd7440a6bd0 2024-08-18T21:05:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fd7440a7a30 con 0x7fd74409f080 2024-08-18T21:05:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd748955640 10 monclient(hunting): authenticate will time out at 1090.114784s 2024-08-18T21:05:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd741d9b640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd74409f080 msgr2=0x7fd7440a74f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:05:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd741d9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd74409f080 0x7fd7440a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd742d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd744139990 0x7fd744139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7440a6bd0 0x7fd7440a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd742d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd744139990 0x7fd744139e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34042/0 (socket says 172.21.15.5:34042) 2024-08-18T21:05:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd742d9d640 1 -- 172.21.15.5:0/194078793 learned_addr learned my addr 172.21.15.5:0/194078793 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd742d9d640 10 monclient(hunting): get_auth_request con 0x7fd744139990 auth_method 0 2024-08-18T21:05:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd742d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd742d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd742d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 10 monclient(hunting): get_auth_request con 0x7fd7440a6bd0 auth_method 0 2024-08-18T21:05:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd742d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd742d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd742d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 10 monclient(hunting): handle_auth_done global_id 4970 payload 274 2024-08-18T21:05:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 1 -- 172.21.15.5:0/194078793 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd74409f080 msgr2=0x7fd7440a74f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 1 --2- 172.21.15.5:0/194078793 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd74409f080 0x7fd7440a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 1 -- 172.21.15.5:0/194078793 >> v2:172.21.15.5:3300/0 conn(0x7fd744139990 msgr2=0x7fd744139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 1 --2- 172.21.15.5:0/194078793 >> v2:172.21.15.5:3300/0 conn(0x7fd744139990 0x7fd744139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 10 monclient: _finish_hunting 0 2024-08-18T21:05:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 1 monclient: found mon.noname-b 2024-08-18T21:05:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd74259c640 1 -- 172.21.15.5:0/194078793 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7440a7fb0 con 0x7fd7440a6bd0 2024-08-18T21:05:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.099+0000 7fd742d9d640 1 --2- 172.21.15.5:0/194078793 >> v2:172.21.15.5:3300/0 conn(0x7fd744139990 0x7fd744139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:23.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd74259c640 1 -- 172.21.15.5:0/194078793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7440a6bd0 msgr2=0x7fd7440a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd74259c640 1 --2- 172.21.15.5:0/194078793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7440a6bd0 0x7fd7440a6fb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009dc0 tx=0x7fd73c01c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfb53b1c67a621b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd74159a640 1 -- 172.21.15.5:0/194078793 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd73c0b2070 con 0x7fd7440a6bd0 2024-08-18T21:05:23.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd74159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd74159a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:23.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd74159a640 10 monclient: dump: 2024-08-18T21:05:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.117 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.117 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.117 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.117 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.117 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd74159a640 10 monclient: _finish_auth 0 2024-08-18T21:05:23.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd74159a640 10 monclient: _check_auth_tickets 2024-08-18T21:05:23.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd74159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:23.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd74159a640 1 -- 172.21.15.5:0/194078793 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd73c0a59d0 con 0x7fd7440a6bd0 2024-08-18T21:05:23.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd748955640 5 monclient: authenticate success, global_id 4970 2024-08-18T21:05:23.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd748955640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:05:23.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd74159a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:23.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd748955640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:23.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd748955640 4 set_mon_vals no callback set 2024-08-18T21:05:23.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd74159a640 1 -- 172.21.15.5:0/194078793 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd73c0ab340 con 0x7fd7440a6bd0 2024-08-18T21:05:23.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd74159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd74159a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:23.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.103+0000 7fd74159a640 10 monclient: dump: 2024-08-18T21:05:23.118 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.118 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.118 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.118 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.119 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.119 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.119 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.119 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.119 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.119 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.119 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.119 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.119 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.119 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.119 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.120 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 10 monclient: shutdown 2024-08-18T21:05:23.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:23.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 -- 172.21.15.5:0/194078793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7440a6bd0 msgr2=0x7fd7440a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 --2- 172.21.15.5:0/194078793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7440a6bd0 0x7fd7440a6fb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009dc0 tx=0x7fd73c01c830 comp rx=0 tx=0).stop 2024-08-18T21:05:23.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 -- 172.21.15.5:0/194078793 shutdown_connections 2024-08-18T21:05:23.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 --2- 172.21.15.5:0/194078793 >> v2:172.21.15.5:3300/0 conn(0x7fd744139990 0x7fd744139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 --2- 172.21.15.5:0/194078793 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd74409f080 0x7fd7440a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 --2- 172.21.15.5:0/194078793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7440a6bd0 0x7fd7440a6fb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 -- 172.21.15.5:0/194078793 >> 172.21.15.5:0/194078793 conn(0x7fd744068700 msgr2=0x7fd744068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:23.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 -- 172.21.15.5:0/194078793 shutdown_connections 2024-08-18T21:05:23.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 -- 172.21.15.5:0/194078793 wait complete. 2024-08-18T21:05:23.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 10 monclient: build_initial_monmap 2024-08-18T21:05:23.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 10 monclient: monmap: 2024-08-18T21:05:23.121 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:23.121 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:23.121 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:23.121 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:23.121 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:23.121 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.121 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:23.121 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:23.122 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:23.122 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:23.122 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:23.122 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:23.122 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:23.122 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:23.122 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:23.122 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 Processor -- start 2024-08-18T21:05:23.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 -- start start 2024-08-18T21:05:23.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 10 monclient: init 2024-08-18T21:05:23.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:23.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 10 monclient: _add_conns ranks=[5,2,4,0,7,1,8,6,3] 2024-08-18T21:05:23.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd74409f080 0x7fd7441d1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 10 monclient(hunting): picked mon.noname-h con 0x7fd74409f080 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:23.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7440a6bd0 0x7fd744136f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 10 monclient(hunting): picked mon.noname-b con 0x7fd7440a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:23.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd744139990 0x7fd74413c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 10 monclient(hunting): picked mon.noname-c con 0x7fd744139990 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:23.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fd7440a89f0 con 0x7fd7440a6bd0 2024-08-18T21:05:23.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fd7440a7ce0 con 0x7fd744139990 2024-08-18T21:05:23.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fd744143610 con 0x7fd74409f080 2024-08-18T21:05:23.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:23.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd748955640 10 monclient(hunting): authenticate will time out at 1090.122094s 2024-08-18T21:05:23.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7440a6bd0 0x7fd744136f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7440a6bd0 0x7fd744136f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59902/0 (socket says 172.21.15.5:59902) 2024-08-18T21:05:23.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd742d9d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd744139990 0x7fd74413c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 1 -- 172.21.15.5:0/2837607100 learned_addr learned my addr 172.21.15.5:0/2837607100 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:23.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 10 monclient(hunting): get_auth_request con 0x7fd7440a6bd0 auth_method 0 2024-08-18T21:05:23.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd742d9d640 10 monclient(hunting): get_auth_request con 0x7fd744139990 auth_method 0 2024-08-18T21:05:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd742d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd742d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd742d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd742d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd742d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd742d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd74259c640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd74409f080 0x7fd7441d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd74259c640 10 monclient(hunting): get_auth_request con 0x7fd74409f080 auth_method 0 2024-08-18T21:05:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd74259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd74259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd74259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 10 monclient(hunting): handle_auth_done global_id 4979 payload 824 2024-08-18T21:05:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 1 -- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd74409f080 msgr2=0x7fd7441d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd74409f080 0x7fd7441d1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 1 -- 172.21.15.5:0/2837607100 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd744139990 msgr2=0x7fd74413c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd744139990 0x7fd74413c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:05:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 1 monclient: found mon.noname-b 2024-08-18T21:05:23.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:23.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:23.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd741d9b640 1 -- 172.21.15.5:0/2837607100 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7440ab680 con 0x7fd7440a6bd0 2024-08-18T21:05:23.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd74259c640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd74409f080 0x7fd7441d1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:05:23.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.107+0000 7fd742d9d640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd744139990 0x7fd74413c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:23.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd741d9b640 1 -- 172.21.15.5:0/2837607100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7440a6bd0 msgr2=0x7fd744136f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd741d9b640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7440a6bd0 0x7fd744136f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd73800b550 tx=0x7fd73800ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd732ffd640 1 -- 172.21.15.5:0/2837607100 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd7380092d0 con 0x7fd7440a6bd0 2024-08-18T21:05:23.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd732ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd732ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:23.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd732ffd640 10 monclient: dump: 2024-08-18T21:05:23.128 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.128 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.128 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.128 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.128 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.128 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.128 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.128 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.128 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.128 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.128 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.129 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd732ffd640 10 monclient: _finish_auth 0 2024-08-18T21:05:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd732ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:05:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd732ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd732ffd640 1 -- 172.21.15.5:0/2837607100 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd738015070 con 0x7fd7440a6bd0 2024-08-18T21:05:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd748955640 5 monclient: authenticate success, global_id 4979 2024-08-18T21:05:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd748955640 10 monclient: _renew_subs 2024-08-18T21:05:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd748955640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd748955640 1 -- 172.21.15.5:0/2837607100 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74413f860 con 0x7fd7440a6bd0 2024-08-18T21:05:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd732ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd732ffd640 1 -- 172.21.15.5:0/2837607100 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd738003e00 con 0x7fd7440a6bd0 2024-08-18T21:05:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd732ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd732ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd732ffd640 10 monclient: dump: 2024-08-18T21:05:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.132 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.132 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd740d99640 4 set_mon_vals no callback set 2024-08-18T21:05:23.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd748955640 10 monclient: _renew_subs 2024-08-18T21:05:23.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd748955640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:23.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd748955640 1 -- 172.21.15.5:0/2837607100 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd74413e620 con 0x7fd7440a6bd0 2024-08-18T21:05:23.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd748955640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:23.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd748955640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd74413fa60 0x7fd74413c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd748955640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd748955640 1 -- 172.21.15.5:0/2837607100 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd744051140 con 0x7fd74413fa60 2024-08-18T21:05:23.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd732ffd640 1 -- 172.21.15.5:0/2837607100 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fd7380050f0 con 0x7fd7440a6bd0 2024-08-18T21:05:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd74259c640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd74413fa60 0x7fd74413c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd732ffd640 1 --2- 172.21.15.5:0/2837607100 >> v2:172.21.15.157:6812/631023601 conn(0x7fd72403bdf0 0x7fd72403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd74259c640 10 monclient: get_auth_request con 0x7fd74413fa60 auth_method 0 2024-08-18T21:05:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd74259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd74259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd74259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd732ffd640 1 -- 172.21.15.5:0/2837607100 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(51..51 src has 11..51) ==== 3898+0+0 (secure 0 0 0) 0x7fd73804e4c0 con 0x7fd7440a6bd0 2024-08-18T21:05:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd74259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd74259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd74259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd74259c640 10 monclient(hunting): handle_auth_done global_id 4717 payload 824 2024-08-18T21:05:23.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.111+0000 7fd74259c640 1 -- 172.21.15.5:0/2837607100 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7440ab150 con 0x7fd74413fa60 2024-08-18T21:05:23.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.115+0000 7fd742d9d640 1 --2- 172.21.15.5:0/2837607100 >> v2:172.21.15.157:6812/631023601 conn(0x7fd72403bdf0 0x7fd72403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.115+0000 7fd742d9d640 10 monclient: get_auth_request con 0x7fd72403bdf0 auth_method 0 2024-08-18T21:05:23.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.115+0000 7fd74259c640 1 -- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd74413fa60 msgr2=0x7fd74413c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.115+0000 7fd74259c640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd74413fa60 0x7fd74413c5e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd7440a6890 tx=0x7fd73c0195d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.115+0000 7fd732ffd640 1 -- 172.21.15.5:0/2837607100 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd73c0bc070 con 0x7fd74413fa60 2024-08-18T21:05:23.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.115+0000 7fd732ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.115+0000 7fd732ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:05:23.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.115+0000 7fd732ffd640 10 monclient: dump: 2024-08-18T21:05:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.138 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.138 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.138 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.138 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.115+0000 7fd732ffd640 1 -- 172.21.15.5:0/2837607100 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd73c0043f0 con 0x7fd74413fa60 2024-08-18T21:05:23.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.115+0000 7fd732ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:23.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.115+0000 7fd732ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:23.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.115+0000 7fd732ffd640 1 -- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd74413fa60 msgr2=0x7fd74413c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.115+0000 7fd732ffd640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd74413fa60 0x7fd74413c5e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd7440a6890 tx=0x7fd73c0195d0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.115+0000 7fd732ffd640 1 -- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd74413fa60 msgr2=0x7fd74413c5e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:23.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.115+0000 7fd732ffd640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd74413fa60 0x7fd74413c5e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.119+0000 7fd742d9d640 1 --2- 172.21.15.5:0/2837607100 >> v2:172.21.15.157:6812/631023601 conn(0x7fd72403bdf0 0x7fd72403e2b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd7340096b0 tx=0x7fd734009240 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.123+0000 7fd748955640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.123+0000 7fd748955640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd744137460 0x7fd74413cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.123+0000 7fd748955640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.123+0000 7fd748955640 1 -- 172.21.15.5:0/2837607100 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd744075b20 con 0x7fd744137460 2024-08-18T21:05:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.123+0000 7fd74259c640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd744137460 0x7fd74413cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.123+0000 7fd74259c640 10 monclient: get_auth_request con 0x7fd744137460 auth_method 0 2024-08-18T21:05:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.123+0000 7fd74259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.123+0000 7fd74259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.123+0000 7fd74259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.123+0000 7fd74259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.123+0000 7fd74259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.123+0000 7fd74259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.123+0000 7fd74259c640 10 monclient(hunting): handle_auth_done global_id 4726 payload 824 2024-08-18T21:05:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.123+0000 7fd74259c640 1 -- 172.21.15.5:0/2837607100 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd744139e10 con 0x7fd744137460 2024-08-18T21:05:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd74259c640 1 -- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd744137460 msgr2=0x7fd74413cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd74259c640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd744137460 0x7fd74413cb20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd73c01c870 tx=0x7fd73c0a7000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd732ffd640 1 -- 172.21.15.5:0/2837607100 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd73c0b2040 con 0x7fd744137460 2024-08-18T21:05:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd732ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd732ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:05:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd732ffd640 10 monclient: dump: 2024-08-18T21:05:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.142 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd732ffd640 1 -- 172.21.15.5:0/2837607100 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9225 (secure 0 0 0) 0x7fd73c0a5e00 con 0x7fd744137460 2024-08-18T21:05:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd732ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd732ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd732ffd640 1 -- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd744137460 msgr2=0x7fd74413cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd732ffd640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd744137460 0x7fd74413cb20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd73c01c870 tx=0x7fd73c0a7000 comp rx=0 tx=0).stop 2024-08-18T21:05:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd732ffd640 1 -- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd744137460 msgr2=0x7fd74413cb20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd732ffd640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd744137460 0x7fd74413cb20 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd73c01c870 tx=0x7fd73c0a7000 comp rx=0 tx=0).stop 2024-08-18T21:05:23.143 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:23.143 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:23.143 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:23.143 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:23.143 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 38, 2024-08-18T21:05:23.143 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 132206, 2024-08-18T21:05:23.143 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:23.143 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:23.143 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:23.144 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:23.144 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:23.144 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:23.144 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:23.144 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:05:23.144 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.144 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:05:23.144 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:23.144 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:23.144 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:23.144 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:23.145 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:23.145 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:23.145 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:23.145 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:23.145 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:23.145 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:23.145 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:23.145 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:23.145 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:23.145 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:23.145 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.146 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:23.146 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:23.146 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:23.146 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:23.146 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:23.146 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:23.146 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:23.146 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:23.146 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:23.146 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:23.147 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:23.147 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:23.147 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:23.147 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.147 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:23.147 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:23.147 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:23.147 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:23.147 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:23.147 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:23.148 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:23.148 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:23.148 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:23.148 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:23.148 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:23.148 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:23.148 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:23.148 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:23.148 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:23.148 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:23.148 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:23.149 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:23.149 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:23.149 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:23.149 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:23.149 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:23.149 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:23.149 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:23.149 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:23.149 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:23.149 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:23.150 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:23.150 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.150 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:23.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.150 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:23.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.150 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:23.150 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:23.150 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.150 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.151 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.151 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:23.151 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.151 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.151 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:23.151 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.151 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.151 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.152 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:23.152 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:23.152 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.152 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.152 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.152 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.152 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:23.152 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:23.152 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.153 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.153 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.153 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:23.153 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.153 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.153 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:23.153 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.153 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.154 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.154 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:23.154 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:23.154 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.154 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.154 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.154 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.154 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:23.155 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:23.155 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.155 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.155 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.155 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:23.155 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.155 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.155 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:23.155 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.156 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.156 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.156 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:23.156 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:23.156 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.156 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.156 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.156 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.157 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:23.157 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:23.157 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.157 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.157 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.157 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:23.157 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.157 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.158 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:23.158 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.158 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.158 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.158 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:23.158 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:23.158 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.158 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.158 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.159 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:23.159 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:23.159 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.159 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.159 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.159 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:23.159 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.160 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.160 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:23.160 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.160 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.160 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.160 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:23.160 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:23.160 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.160 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.160 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.161 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:23.161 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:23.161 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.161 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.161 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.161 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:23.161 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.162 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.162 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:23.162 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.162 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.162 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.162 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:23.162 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:23.162 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.162 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.163 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.163 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:23.163 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:23.163 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.163 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.163 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.163 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:23.163 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.164 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.164 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:23.164 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.164 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.164 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.164 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:23.164 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:23.164 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.164 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.164 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.165 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:23.165 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:23.165 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.165 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.165 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.165 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:23.165 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.166 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.166 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:23.166 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.166 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.166 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.166 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:23.166 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:23.166 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.166 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.166 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.167 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:23.221 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:23.222 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.222 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.222 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.222 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.222 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:23.222 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.222 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.222 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.223 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:23.223 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.223 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.223 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.223 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:23.223 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:23.223 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.223 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.223 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.223 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.223 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.224 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:23.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:23.224 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.224 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:23.224 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:23.224 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:23.224 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.224 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.224 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:23.224 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.225 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:23.225 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:23.225 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:05:23.225 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.225 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.225 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:23.225 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:23.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd748955640 1 -- 172.21.15.5:0/2837607100 >> v2:172.21.15.157:6812/631023601 conn(0x7fd72403bdf0 msgr2=0x7fd72403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd748955640 1 --2- 172.21.15.5:0/2837607100 >> v2:172.21.15.157:6812/631023601 conn(0x7fd72403bdf0 0x7fd72403e2b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd7340096b0 tx=0x7fd734009240 comp rx=0 tx=0).stop 2024-08-18T21:05:23.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd748955640 10 monclient: shutdown 2024-08-18T21:05:23.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd748955640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:23.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd748955640 1 -- 172.21.15.5:0/2837607100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7440a6bd0 msgr2=0x7fd744136f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd748955640 1 --2- 172.21.15.5:0/2837607100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7440a6bd0 0x7fd744136f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd73800b550 tx=0x7fd73800ba10 comp rx=0 tx=0).stop 2024-08-18T21:05:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd742d9d640 1 -- 172.21.15.5:0/2837607100 reap_dead start 2024-08-18T21:05:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd742d9d640 1 -- 172.21.15.5:0/2837607100 reap_dead start 2024-08-18T21:05:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd748955640 1 -- 172.21.15.5:0/2837607100 shutdown_connections 2024-08-18T21:05:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd748955640 1 -- 172.21.15.5:0/2837607100 >> 172.21.15.5:0/2837607100 conn(0x7fd744068700 msgr2=0x7fd7440a20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd748955640 1 -- 172.21.15.5:0/2837607100 shutdown_connections 2024-08-18T21:05:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.127+0000 7fd748955640 1 -- 172.21.15.5:0/2837607100 wait complete. 2024-08-18T21:05:23.228 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:05:23.228 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon g 2024-08-18T21:05:23.229 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:05:23.342 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:23.342 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28430]: starting. 2024-08-18T21:05:23.342 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28430]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28395 2024-08-18T21:05:23.342 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28430]: created object 0... 2024-08-18T21:05:23.342 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28430]: created object 25... 2024-08-18T21:05:23.343 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28430]: created object 49... 2024-08-18T21:05:23.343 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28430]: finishing. 2024-08-18T21:05:23.343 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28430]: shutting down. 2024-08-18T21:05:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 10 monclient: get_monmap_and_config 2024-08-18T21:05:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 10 monclient: build_initial_monmap 2024-08-18T21:05:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 10 monclient: monmap: 2024-08-18T21:05:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:23.357380+0000 2024-08-18T21:05:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:23.357380+0000 2024-08-18T21:05:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:23.357 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 1 Processor -- start 2024-08-18T21:05:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 1 -- start start 2024-08-18T21:05:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 10 monclient: init 2024-08-18T21:05:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 10 monclient: _add_conns ranks=[3,6,4,0,10,2,9,8,7,1,5] 2024-08-18T21:05:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e740a6bd0 0x7f0e740a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 10 monclient(hunting): picked mon.noname-g con 0x7f0e740a6bd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0e7409f080 0x7f0e740a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 10 monclient(hunting): picked mon.noname-d con 0x7f0e7409f080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e74139990 0x7f0e74139df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 10 monclient(hunting): picked mon.noname-c con 0x7f0e74139990 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0e7409e4c0 con 0x7f0e740a6bd0 2024-08-18T21:05:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f0e7406f930 con 0x7f0e74139990 2024-08-18T21:05:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f0e740a7a30 con 0x7f0e7409f080 2024-08-18T21:05:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e796c9640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0e7409f080 msgr2=0x7f0e740a74f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:05:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7c12e640 10 monclient(hunting): authenticate will time out at 1090.370951s 2024-08-18T21:05:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e796c9640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0e7409f080 0x7f0e740a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e74139990 0x7f0e74139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e74139990 0x7f0e74139df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:33854/0 (socket says 172.21.15.5:33854) 2024-08-18T21:05:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 1 -- 172.21.15.5:0/3123003825 learned_addr learned my addr 172.21.15.5:0/3123003825 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 10 monclient(hunting): get_auth_request con 0x7f0e74139990 auth_method 0 2024-08-18T21:05:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e79eca640 1 --2- 172.21.15.5:0/3123003825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e740a6bd0 0x7f0e740a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e79eca640 10 monclient(hunting): get_auth_request con 0x7f0e740a6bd0 auth_method 0 2024-08-18T21:05:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e79eca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e79eca640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e79eca640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e79eca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e79eca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e79eca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 10 monclient(hunting): handle_auth_done global_id 4882 payload 274 2024-08-18T21:05:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 1 -- 172.21.15.5:0/3123003825 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0e7409f080 msgr2=0x7f0e740a74f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 1 --2- 172.21.15.5:0/3123003825 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0e7409f080 0x7f0e740a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 1 -- 172.21.15.5:0/3123003825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e740a6bd0 msgr2=0x7f0e740a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 1 --2- 172.21.15.5:0/3123003825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e740a6bd0 0x7f0e740a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 10 monclient: _finish_hunting 0 2024-08-18T21:05:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 1 monclient: found mon.noname-c 2024-08-18T21:05:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:05:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.355+0000 7f0e7a6cb640 1 -- 172.21.15.5:0/3123003825 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e740a7fb0 con 0x7f0e74139990 2024-08-18T21:05:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7a6cb640 1 -- 172.21.15.5:0/3123003825 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e74139990 msgr2=0x7f0e74139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7a6cb640 1 --2- 172.21.15.5:0/3123003825 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e74139990 0x7f0e74139df0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c009e80 tx=0x7f0e6c01c930 comp rx=0 tx=0).ready entity=mon.4 client_cookie=dc51419fc4154abb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e78ec8640 1 -- 172.21.15.5:0/3123003825 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0e6c0090d0 con 0x7f0e74139990 2024-08-18T21:05:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e78ec8640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e78ec8640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:05:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e78ec8640 10 monclient: dump: 2024-08-18T21:05:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.370 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e78ec8640 10 monclient: _finish_auth 0 2024-08-18T21:05:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e78ec8640 10 monclient: _check_auth_tickets 2024-08-18T21:05:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e78ec8640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e78ec8640 1 -- 172.21.15.5:0/3123003825 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e6c0a5a90 con 0x7f0e74139990 2024-08-18T21:05:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 5 monclient: authenticate success, global_id 4882 2024-08-18T21:05:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:05:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e78ec8640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 4 set_mon_vals no callback set 2024-08-18T21:05:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e78ec8640 1 -- 172.21.15.5:0/3123003825 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0e6c0a5c40 con 0x7f0e74139990 2024-08-18T21:05:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e78ec8640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e78ec8640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:23.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e78ec8640 10 monclient: dump: 2024-08-18T21:05:23.371 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.371 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.371 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.371 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.371 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.371 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.371 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.371 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.371 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.371 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.371 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.372 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.372 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.372 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.372 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.372 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 10 monclient: shutdown 2024-08-18T21:05:23.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:23.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 -- 172.21.15.5:0/3123003825 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e74139990 msgr2=0x7f0e74139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 --2- 172.21.15.5:0/3123003825 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e74139990 0x7f0e74139df0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c009e80 tx=0x7f0e6c01c930 comp rx=0 tx=0).stop 2024-08-18T21:05:23.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 -- 172.21.15.5:0/3123003825 shutdown_connections 2024-08-18T21:05:23.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 --2- 172.21.15.5:0/3123003825 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e74139990 0x7f0e74139df0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 --2- 172.21.15.5:0/3123003825 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0e7409f080 0x7f0e740a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 --2- 172.21.15.5:0/3123003825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e740a6bd0 0x7f0e740a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 -- 172.21.15.5:0/3123003825 >> 172.21.15.5:0/3123003825 conn(0x7f0e74068700 msgr2=0x7f0e74068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:23.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 -- 172.21.15.5:0/3123003825 shutdown_connections 2024-08-18T21:05:23.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 -- 172.21.15.5:0/3123003825 wait complete. 2024-08-18T21:05:23.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 10 monclient: build_initial_monmap 2024-08-18T21:05:23.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 10 monclient: monmap: 2024-08-18T21:05:23.373 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:23.373 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:23.373 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:23.373 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:23.373 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:23.373 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.373 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:23.374 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 Processor -- start 2024-08-18T21:05:23.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 -- start start 2024-08-18T21:05:23.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 10 monclient: init 2024-08-18T21:05:23.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:23.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 10 monclient: _add_conns ranks=[6,1,0,5,3,2,7,4,8] 2024-08-18T21:05:23.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0e7409f080 0x7f0e741d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 10 monclient(hunting): picked mon.noname-d con 0x7f0e7409f080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:23.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e740a6bd0 0x7f0e741389e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 10 monclient(hunting): picked mon.noname-f con 0x7f0e740a6bd0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:05:23.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e74139990 0x7f0e7413db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 10 monclient(hunting): picked mon.noname-a con 0x7f0e74139990 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:05:23.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0e740a89f0 con 0x7f0e74139990 2024-08-18T21:05:23.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e79eca640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0e7409f080 msgr2=0x7f0e741d15a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:05:23.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0e740a7ce0 con 0x7f0e740a6bd0 2024-08-18T21:05:23.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f0e74143610 con 0x7f0e7409f080 2024-08-18T21:05:23.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e79eca640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0e7409f080 0x7f0e741d15a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:23.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:23.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7c12e640 10 monclient(hunting): authenticate will time out at 1090.379685s 2024-08-18T21:05:23.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7a6cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e74139990 0x7f0e7413db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7a6cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e74139990 0x7f0e7413db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34050/0 (socket says 172.21.15.5:34050) 2024-08-18T21:05:23.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7a6cb640 1 -- 172.21.15.5:0/2825575266 learned_addr learned my addr 172.21.15.5:0/2825575266 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:23.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7a6cb640 10 monclient(hunting): get_auth_request con 0x7f0e74139990 auth_method 0 2024-08-18T21:05:23.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7a6cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7a6cb640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7a6cb640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7a6cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7a6cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e7a6cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e796c9640 1 --2- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e740a6bd0 0x7f0e741389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e796c9640 10 monclient(hunting): get_auth_request con 0x7f0e740a6bd0 auth_method 0 2024-08-18T21:05:23.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e796c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e796c9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.363+0000 7f0e796c9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e796c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e796c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e796c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7a6cb640 10 monclient(hunting): handle_auth_done global_id 4914 payload 824 2024-08-18T21:05:23.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7a6cb640 1 -- 172.21.15.5:0/2825575266 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0e7409f080 msgr2=0x7f0e741d15a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:05:23.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7a6cb640 1 --2- 172.21.15.5:0/2825575266 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0e7409f080 0x7f0e741d15a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7a6cb640 1 -- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e740a6bd0 msgr2=0x7f0e741389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7a6cb640 1 --2- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e740a6bd0 0x7f0e741389e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7a6cb640 10 monclient: _finish_hunting 0 2024-08-18T21:05:23.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7a6cb640 1 monclient: found mon.noname-a 2024-08-18T21:05:23.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7a6cb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:23.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7a6cb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:05:23.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7a6cb640 1 -- 172.21.15.5:0/2825575266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e74124380 con 0x7f0e74139990 2024-08-18T21:05:23.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7a6cb640 1 -- 172.21.15.5:0/2825575266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e74139990 msgr2=0x7f0e7413db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7a6cb640 1 --2- 172.21.15.5:0/2825575266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e74139990 0x7f0e7413db10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c009040 tx=0x7f0e6c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e6a7fc640 1 -- 172.21.15.5:0/2825575266 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0e6c0bc030 con 0x7f0e74139990 2024-08-18T21:05:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e6a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:05:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e6a7fc640 10 monclient: dump: 2024-08-18T21:05:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.385 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.385 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.385 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.385 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.385 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e6a7fc640 10 monclient: _finish_auth 0 2024-08-18T21:05:23.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e6a7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:05:23.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e6a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:23.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e6a7fc640 1 -- 172.21.15.5:0/2825575266 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e6c003dc0 con 0x7f0e74139990 2024-08-18T21:05:23.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7c12e640 5 monclient: authenticate success, global_id 4914 2024-08-18T21:05:23.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7c12e640 10 monclient: _renew_subs 2024-08-18T21:05:23.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7c12e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:05:23.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7c12e640 1 -- 172.21.15.5:0/2825575266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e7413fdd0 con 0x7f0e74139990 2024-08-18T21:05:23.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e6a7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:23.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e6a7fc640 1 -- 172.21.15.5:0/2825575266 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0e6c0b7450 con 0x7f0e74139990 2024-08-18T21:05:23.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e6a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:05:23.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e6bfff640 4 set_mon_vals no callback set 2024-08-18T21:05:23.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e6a7fc640 10 monclient: dump: 2024-08-18T21:05:23.386 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.386 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.386 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.386 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.386 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.386 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.387 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.387 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.387 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.387 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.387 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.387 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.387 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.387 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.387 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.387 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7c12e640 10 monclient: _renew_subs 2024-08-18T21:05:23.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7c12e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:05:23.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7c12e640 1 -- 172.21.15.5:0/2825575266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e74123ae0 con 0x7f0e74139990 2024-08-18T21:05:23.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7c12e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:23.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7c12e640 1 --2- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e74122b80 0x7f0e7413e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7c12e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e7c12e640 1 -- 172.21.15.5:0/2825575266 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0e74051140 con 0x7f0e74122b80 2024-08-18T21:05:23.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.367+0000 7f0e6a7fc640 1 -- 172.21.15.5:0/2825575266 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f0e6c0bf070 con 0x7f0e74139990 2024-08-18T21:05:23.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e79eca640 1 --2- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e74122b80 0x7f0e7413e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e79eca640 10 monclient: get_auth_request con 0x7f0e74122b80 auth_method 0 2024-08-18T21:05:23.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e79eca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e79eca640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e79eca640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e6a7fc640 1 --2- 172.21.15.5:0/2825575266 >> v2:172.21.15.157:6812/631023601 conn(0x7f0e5803bde0 0x7f0e5803e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e6a7fc640 1 -- 172.21.15.5:0/2825575266 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 11..52) ==== 3898+0+0 (secure 0 0 0) 0x7f0e6c0bd070 con 0x7f0e74139990 2024-08-18T21:05:23.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e79eca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e79eca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e79eca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e79eca640 10 monclient(hunting): handle_auth_done global_id 4854 payload 824 2024-08-18T21:05:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e79eca640 1 -- 172.21.15.5:0/2825575266 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e740ab0e0 con 0x7f0e74122b80 2024-08-18T21:05:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e796c9640 1 --2- 172.21.15.5:0/2825575266 >> v2:172.21.15.157:6812/631023601 conn(0x7f0e5803bde0 0x7f0e5803e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e796c9640 10 monclient: get_auth_request con 0x7f0e5803bde0 auth_method 0 2024-08-18T21:05:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e79eca640 1 -- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e74122b80 msgr2=0x7f0e7413e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e79eca640 1 --2- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e74122b80 0x7f0e7413e050 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009510 tx=0x7f0e7000ec00 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e6a7fc640 1 -- 172.21.15.5:0/2825575266 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0e70017070 con 0x7f0e74122b80 2024-08-18T21:05:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e6a7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:05:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.371+0000 7f0e6a7fc640 10 monclient: dump: 2024-08-18T21:05:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.391 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.375+0000 7f0e6a7fc640 1 -- 172.21.15.5:0/2825575266 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0e7000ee50 con 0x7f0e74122b80 2024-08-18T21:05:23.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.375+0000 7f0e6a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:23.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.375+0000 7f0e6a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:23.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.375+0000 7f0e6a7fc640 1 -- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e74122b80 msgr2=0x7f0e7413e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.375+0000 7f0e6a7fc640 1 --2- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e74122b80 0x7f0e7413e050 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009510 tx=0x7f0e7000ec00 comp rx=0 tx=0).stop 2024-08-18T21:05:23.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.375+0000 7f0e6a7fc640 1 -- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e74122b80 msgr2=0x7f0e7413e050 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:23.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.375+0000 7f0e6a7fc640 1 --2- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e74122b80 0x7f0e7413e050 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009510 tx=0x7f0e7000ec00 comp rx=0 tx=0).stop 2024-08-18T21:05:23.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.375+0000 7f0e796c9640 1 --2- 172.21.15.5:0/2825575266 >> v2:172.21.15.157:6812/631023601 conn(0x7f0e5803bde0 0x7f0e5803e2a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0e7413f270 tx=0x7f0e64009110 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.379+0000 7f0e7c12e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:23.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.379+0000 7f0e7c12e640 1 --2- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e74123cb0 0x7f0e7413e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.379+0000 7f0e7c12e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.379+0000 7f0e7c12e640 1 -- 172.21.15.5:0/2825575266 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0e74139df0 con 0x7f0e74123cb0 2024-08-18T21:05:23.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.379+0000 7f0e79eca640 1 --2- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e74123cb0 0x7f0e7413e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.379+0000 7f0e79eca640 10 monclient: get_auth_request con 0x7f0e74123cb0 auth_method 0 2024-08-18T21:05:23.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.379+0000 7f0e79eca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.379+0000 7f0e79eca640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.379+0000 7f0e79eca640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.379+0000 7f0e79eca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.379+0000 7f0e79eca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.379+0000 7f0e79eca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.379+0000 7f0e79eca640 10 monclient(hunting): handle_auth_done global_id 4863 payload 824 2024-08-18T21:05:23.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.379+0000 7f0e79eca640 1 -- 172.21.15.5:0/2825575266 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0e740746d0 con 0x7f0e74123cb0 2024-08-18T21:05:23.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e79eca640 1 -- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e74123cb0 msgr2=0x7f0e7413e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e79eca640 1 --2- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e74123cb0 0x7f0e7413e590 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009510 tx=0x7f0e70004740 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e6a7fc640 1 -- 172.21.15.5:0/2825575266 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0e70017070 con 0x7f0e74123cb0 2024-08-18T21:05:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e6a7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:05:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e6a7fc640 10 monclient: dump: 2024-08-18T21:05:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.395 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.395 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.395 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.395 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.395 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.395 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e6a7fc640 1 -- 172.21.15.5:0/2825575266 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9225 (secure 0 0 0) 0x7f0e70003620 con 0x7f0e74123cb0 2024-08-18T21:05:23.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e6a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:23.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e6a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:23.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e6a7fc640 1 -- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e74123cb0 msgr2=0x7f0e7413e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e6a7fc640 1 --2- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e74123cb0 0x7f0e7413e590 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009510 tx=0x7f0e70004740 comp rx=0 tx=0).stop 2024-08-18T21:05:23.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e6a7fc640 1 -- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e74123cb0 msgr2=0x7f0e7413e590 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:23.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e6a7fc640 1 --2- 172.21.15.5:0/2825575266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e74123cb0 0x7f0e7413e590 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009510 tx=0x7f0e70004740 comp rx=0 tx=0).stop 2024-08-18T21:05:23.396 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:23.396 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:23.396 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:23.396 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:23.396 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 38, 2024-08-18T21:05:23.396 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 132478, 2024-08-18T21:05:23.397 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:23.397 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:23.397 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:23.397 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:23.397 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:23.397 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:23.397 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:23.397 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:05:23.397 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.397 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:05:23.397 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:23.398 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:23.398 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:23.398 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:23.398 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:23.398 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:23.398 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:23.398 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:23.398 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:23.399 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:23.399 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:23.399 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:23.399 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:23.399 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:23.399 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.399 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:23.399 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:23.399 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:23.399 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:23.399 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:23.399 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:23.400 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:23.400 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:23.400 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:23.400 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:23.400 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:23.400 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:23.400 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:23.400 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.400 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:23.400 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:23.400 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:23.401 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:23.401 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:23.401 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:23.401 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:23.401 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:23.401 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:23.401 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:23.401 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:23.401 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:23.401 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:23.402 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:23.402 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:23.402 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:23.402 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:23.402 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:23.402 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:23.402 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:23.402 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:23.402 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:23.402 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:23.402 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:23.402 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:23.402 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:23.403 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:23.403 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:23.403 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.403 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:23.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.403 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:23.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.403 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:23.403 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:23.403 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.403 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.403 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.403 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:23.404 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.404 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.404 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.404 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:23.404 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.404 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.404 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.404 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:23.404 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:23.404 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.404 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.405 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.405 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:23.405 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:23.405 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.405 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.405 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:23.405 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.406 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:23.406 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.406 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.406 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.406 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:23.406 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:23.406 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.406 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.406 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.407 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:23.407 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:23.407 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.407 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.407 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.407 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:23.407 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.408 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.408 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.408 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:23.408 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.408 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.408 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.408 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:23.408 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:23.408 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.408 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.408 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.409 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.409 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:23.409 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:23.409 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.409 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.409 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.409 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.409 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:23.409 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.409 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.409 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.409 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:23.410 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.410 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.410 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.410 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:23.410 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:23.410 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.410 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.410 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.410 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:23.410 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:23.411 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.411 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.411 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.411 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:23.411 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.411 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.411 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:23.411 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.411 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.411 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.412 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:23.412 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:23.412 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.412 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.412 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.412 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:23.412 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:23.412 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.412 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.412 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.413 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:23.413 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.413 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.413 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.413 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:23.413 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.413 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.413 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.413 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:23.413 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:23.413 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.413 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.413 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.414 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.414 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:23.414 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:23.414 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.414 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.414 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.414 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.414 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:23.414 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.414 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.414 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.414 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:23.415 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.415 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.415 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.415 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:23.415 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:23.415 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.415 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.415 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.415 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.415 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:23.415 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:23.415 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.416 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.416 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.416 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.416 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:23.416 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.416 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.416 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.416 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:23.416 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.416 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.416 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.416 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:23.417 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:23.417 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.417 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.417 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.417 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.417 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.417 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:23.417 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:23.417 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.417 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.417 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.417 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.417 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:23.418 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.418 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.418 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.418 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:23.418 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.418 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.418 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.418 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:23.418 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:23.418 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.418 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.419 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.419 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.419 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.419 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.419 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:23.419 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:23.419 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.419 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:23.419 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:23.419 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:23.419 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.419 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.419 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:23.419 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.420 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:23.420 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:23.420 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:05:23.420 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.420 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.420 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:23.420 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:23.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e7c12e640 1 -- 172.21.15.5:0/2825575266 >> v2:172.21.15.157:6812/631023601 conn(0x7f0e5803bde0 msgr2=0x7f0e5803e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e7c12e640 1 --2- 172.21.15.5:0/2825575266 >> v2:172.21.15.157:6812/631023601 conn(0x7f0e5803bde0 0x7f0e5803e2a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0e7413f270 tx=0x7f0e64009110 comp rx=0 tx=0).stop 2024-08-18T21:05:23.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e7c12e640 10 monclient: shutdown 2024-08-18T21:05:23.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e7c12e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:23.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e7c12e640 1 -- 172.21.15.5:0/2825575266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e74139990 msgr2=0x7f0e7413db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e7c12e640 1 --2- 172.21.15.5:0/2825575266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e74139990 0x7f0e7413db10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c009040 tx=0x7f0e6c0196d0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e7a6cb640 1 -- 172.21.15.5:0/2825575266 reap_dead start 2024-08-18T21:05:23.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e7c12e640 1 -- 172.21.15.5:0/2825575266 shutdown_connections 2024-08-18T21:05:23.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e7c12e640 1 --2- 172.21.15.5:0/2825575266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e74139990 0x7f0e7413db10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e7c12e640 1 -- 172.21.15.5:0/2825575266 >> 172.21.15.5:0/2825575266 conn(0x7f0e74068700 msgr2=0x7f0e740aba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:23.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e7c12e640 1 -- 172.21.15.5:0/2825575266 shutdown_connections 2024-08-18T21:05:23.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.383+0000 7f0e7c12e640 1 -- 172.21.15.5:0/2825575266 wait complete. 2024-08-18T21:05:23.422 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:05:23.422 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon h 2024-08-18T21:05:23.423 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:05:23.423 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:23.423 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28432]: starting. 2024-08-18T21:05:23.423 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28432]: listing objects. 2024-08-18T21:05:23.424 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28432]: listed object 0... 2024-08-18T21:05:23.424 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28432]: listed object 25... 2024-08-18T21:05:23.424 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28432]: saw 50 objects 2024-08-18T21:05:23.424 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28432]: shutting down. 2024-08-18T21:05:23.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 10 monclient: get_monmap_and_config 2024-08-18T21:05:23.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 10 monclient: build_initial_monmap 2024-08-18T21:05:23.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 10 monclient: monmap: 2024-08-18T21:05:23.551 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:23.551 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.551 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:23.552477+0000 2024-08-18T21:05:23.551 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:23.552477+0000 2024-08-18T21:05:23.551 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:23.551 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.551 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:23.551 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:23.551 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:23.552 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:23.552 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:23.552 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:23.552 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:23.552 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:23.552 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:23.552 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:23.552 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:23.552 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 1 Processor -- start 2024-08-18T21:05:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 1 -- start start 2024-08-18T21:05:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 10 monclient: init 2024-08-18T21:05:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 10 monclient: _add_conns ranks=[6,5,2,0,3,9,8,1,4,7,10] 2024-08-18T21:05:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f63c00a6bd0 0x7f63c00a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 10 monclient(hunting): picked mon.noname-d con 0x7f63c00a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c009f080 0x7f63c00a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 10 monclient(hunting): picked mon.noname-h con 0x7f63c009f080 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63c0139990 0x7f63c0139df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 10 monclient(hunting): picked mon.noname-b con 0x7f63c0139990 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f63c009e4c0 con 0x7f63c0139990 2024-08-18T21:05:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f63c006f930 con 0x7f63c009f080 2024-08-18T21:05:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f63c00a7a30 con 0x7f63c00a6bd0 2024-08-18T21:05:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c65d3640 10 monclient(hunting): authenticate will time out at 1090.565648s 2024-08-18T21:05:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63bffff640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f63c00a6bd0 msgr2=0x7f63c00a6fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:05:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63bffff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f63c00a6bd0 0x7f63c00a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63c0139990 0x7f63c0139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63c0139990 0x7f63c0139df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59918/0 (socket says 172.21.15.5:59918) 2024-08-18T21:05:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 1 -- 172.21.15.5:0/1905560973 learned_addr learned my addr 172.21.15.5:0/1905560973 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 10 monclient(hunting): get_auth_request con 0x7f63c0139990 auth_method 0 2024-08-18T21:05:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63bf7fe640 1 --2- 172.21.15.5:0/1905560973 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c009f080 0x7f63c00a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 10 monclient(hunting): handle_auth_done global_id 4988 payload 274 2024-08-18T21:05:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 1 -- 172.21.15.5:0/1905560973 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f63c00a6bd0 msgr2=0x7f63c00a6fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 1 --2- 172.21.15.5:0/1905560973 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f63c00a6bd0 0x7f63c00a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 1 -- 172.21.15.5:0/1905560973 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c009f080 msgr2=0x7f63c00a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 1 --2- 172.21.15.5:0/1905560973 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c009f080 0x7f63c00a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 10 monclient: _finish_hunting 0 2024-08-18T21:05:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 1 monclient: found mon.noname-b 2024-08-18T21:05:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:23.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:23.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63c4b70640 1 -- 172.21.15.5:0/1905560973 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c00a7fb0 con 0x7f63c0139990 2024-08-18T21:05:23.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63bf7fe640 10 monclient: get_auth_request con 0x7f63c009f080 auth_method 0 2024-08-18T21:05:23.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.551+0000 7f63bf7fe640 1 --2- 172.21.15.5:0/1905560973 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c009f080 0x7f63c00a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:05:23.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63c4b70640 1 -- 172.21.15.5:0/1905560973 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63c0139990 msgr2=0x7f63c0139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63c4b70640 1 --2- 172.21.15.5:0/1905560973 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63c0139990 0x7f63c0139df0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009e80 tx=0x7f63b801c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0968a2c743b26a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63beffd640 1 -- 172.21.15.5:0/1905560973 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63b80091b0 con 0x7f63c0139990 2024-08-18T21:05:23.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63beffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63beffd640 10 monclient: dump: 2024-08-18T21:05:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.563 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.563 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.563 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.563 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.563 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63beffd640 10 monclient: _finish_auth 0 2024-08-18T21:05:23.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63beffd640 10 monclient: _check_auth_tickets 2024-08-18T21:05:23.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:23.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63beffd640 1 -- 172.21.15.5:0/1905560973 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63b80a5a90 con 0x7f63c0139990 2024-08-18T21:05:23.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63beffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:23.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63beffd640 1 -- 172.21.15.5:0/1905560973 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63b80a5c40 con 0x7f63c0139990 2024-08-18T21:05:23.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63c65d3640 5 monclient: authenticate success, global_id 4988 2024-08-18T21:05:23.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63c65d3640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:23.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63c65d3640 4 set_mon_vals no callback set 2024-08-18T21:05:23.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63beffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:23.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63beffd640 10 monclient: dump: 2024-08-18T21:05:23.564 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.564 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.564 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.564 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.564 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.564 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.564 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.564 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.564 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.565 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63c65d3640 10 monclient: shutdown 2024-08-18T21:05:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63c65d3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63c65d3640 1 -- 172.21.15.5:0/1905560973 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63c0139990 msgr2=0x7f63c0139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63c65d3640 1 --2- 172.21.15.5:0/1905560973 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63c0139990 0x7f63c0139df0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009e80 tx=0x7f63b801c930 comp rx=0 tx=0).stop 2024-08-18T21:05:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63c65d3640 1 -- 172.21.15.5:0/1905560973 shutdown_connections 2024-08-18T21:05:23.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63c65d3640 1 --2- 172.21.15.5:0/1905560973 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63c0139990 0x7f63c0139df0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63c65d3640 1 --2- 172.21.15.5:0/1905560973 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c009f080 0x7f63c00a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63c65d3640 1 --2- 172.21.15.5:0/1905560973 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f63c00a6bd0 0x7f63c00a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63c65d3640 1 -- 172.21.15.5:0/1905560973 >> 172.21.15.5:0/1905560973 conn(0x7f63c0068700 msgr2=0x7f63c0068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63c65d3640 1 -- 172.21.15.5:0/1905560973 shutdown_connections 2024-08-18T21:05:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.555+0000 7f63c65d3640 1 -- 172.21.15.5:0/1905560973 wait complete. 2024-08-18T21:05:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 10 monclient: build_initial_monmap 2024-08-18T21:05:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 10 monclient: monmap: 2024-08-18T21:05:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.567 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:23.567 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:23.567 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:23.567 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:23.567 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:23.567 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:23.567 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:23.567 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:23.567 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:23.567 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 1 Processor -- start 2024-08-18T21:05:23.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 1 -- start start 2024-08-18T21:05:23.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 10 monclient: init 2024-08-18T21:05:23.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:23.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 10 monclient: _add_conns ranks=[8,3,2,7,4,5,6,1,0] 2024-08-18T21:05:23.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f63c009f080 0x7f63c0138360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 10 monclient(hunting): picked mon.noname-e con 0x7f63c009f080 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:05:23.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63c00a6bd0 0x7f63c01388a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 10 monclient(hunting): picked mon.noname-g con 0x7f63c00a6bd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:23.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63c0139990 0x7f63c013d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 10 monclient(hunting): picked mon.noname-b con 0x7f63c0139990 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:23.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f63c00a89f0 con 0x7f63c0139990 2024-08-18T21:05:23.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f63c00a7ce0 con 0x7f63c00a6bd0 2024-08-18T21:05:23.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f63c0143610 con 0x7f63c009f080 2024-08-18T21:05:23.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:23.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c65d3640 10 monclient(hunting): authenticate will time out at 1090.573476s 2024-08-18T21:05:23.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63bffff640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f63c009f080 msgr2=0x7f63c0138360 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:05:23.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63bffff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f63c009f080 0x7f63c0138360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:23.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63c0139990 0x7f63c013d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63c0139990 0x7f63c013d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59926/0 (socket says 172.21.15.5:59926) 2024-08-18T21:05:23.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 1 -- 172.21.15.5:0/3648853994 learned_addr learned my addr 172.21.15.5:0/3648853994 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:23.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 10 monclient(hunting): get_auth_request con 0x7f63c0139990 auth_method 0 2024-08-18T21:05:23.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 10 monclient(hunting): handle_auth_done global_id 4997 payload 824 2024-08-18T21:05:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 1 -- 172.21.15.5:0/3648853994 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f63c009f080 msgr2=0x7f63c0138360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:05:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f63c009f080 0x7f63c0138360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 1 -- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63c00a6bd0 msgr2=0x7f63c01388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63c00a6bd0 0x7f63c01388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 10 monclient: _finish_hunting 0 2024-08-18T21:05:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 1 monclient: found mon.noname-b 2024-08-18T21:05:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.559+0000 7f63c4b70640 1 -- 172.21.15.5:0/3648853994 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c0123e60 con 0x7f63c0139990 2024-08-18T21:05:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63c4b70640 1 -- 172.21.15.5:0/3648853994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63c0139990 msgr2=0x7f63c013d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63c4b70640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63c0139990 0x7f63c013d9c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009040 tx=0x7f63b80196d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bcff9640 1 -- 172.21.15.5:0/3648853994 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63b80bc020 con 0x7f63c0139990 2024-08-18T21:05:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bcff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bcff9640 10 monclient: dump: 2024-08-18T21:05:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.576 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bcff9640 10 monclient: _finish_auth 0 2024-08-18T21:05:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bcff9640 10 monclient: _check_auth_tickets 2024-08-18T21:05:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bcff9640 1 -- 172.21.15.5:0/3648853994 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63b80044b0 con 0x7f63c0139990 2024-08-18T21:05:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63c65d3640 5 monclient: authenticate success, global_id 4997 2024-08-18T21:05:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63c65d3640 10 monclient: _renew_subs 2024-08-18T21:05:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63c65d3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63c65d3640 1 -- 172.21.15.5:0/3648853994 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63c0124140 con 0x7f63c0139990 2024-08-18T21:05:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bcff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bcff9640 1 -- 172.21.15.5:0/3648853994 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63b8004660 con 0x7f63c0139990 2024-08-18T21:05:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63be7fc640 4 set_mon_vals no callback set 2024-08-18T21:05:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bcff9640 10 monclient: dump: 2024-08-18T21:05:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.579 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63c65d3640 10 monclient: _renew_subs 2024-08-18T21:05:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63c65d3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63c65d3640 1 -- 172.21.15.5:0/3648853994 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f63c00ab2e0 con 0x7f63c0139990 2024-08-18T21:05:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63c65d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63c65d3640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013df00 0x7f63c013e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63c65d3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63c65d3640 1 -- 172.21.15.5:0/3648853994 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f63c0122940 con 0x7f63c013df00 2024-08-18T21:05:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bcff9640 1 -- 172.21.15.5:0/3648853994 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f63b80bf020 con 0x7f63c0139990 2024-08-18T21:05:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bcff9640 1 --2- 172.21.15.5:0/3648853994 >> v2:172.21.15.157:6812/631023601 conn(0x7f63ac03bdc0 0x7f63ac03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bcff9640 1 -- 172.21.15.5:0/3648853994 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(52..52 src has 11..52) ==== 3898+0+0 (secure 0 0 0) 0x7f63b80b3040 con 0x7f63c0139990 2024-08-18T21:05:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bffff640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013df00 0x7f63c013e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bffff640 10 monclient: get_auth_request con 0x7f63c013df00 auth_method 0 2024-08-18T21:05:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bf7fe640 1 --2- 172.21.15.5:0/3648853994 >> v2:172.21.15.157:6812/631023601 conn(0x7f63ac03bdc0 0x7f63ac03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bf7fe640 10 monclient: get_auth_request con 0x7f63ac03bdc0 auth_method 0 2024-08-18T21:05:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bffff640 10 monclient(hunting): handle_auth_done global_id 34304 payload 824 2024-08-18T21:05:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.563+0000 7f63bffff640 1 -- 172.21.15.5:0/3648853994 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63c0139540 con 0x7f63c013df00 2024-08-18T21:05:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bffff640 1 -- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013df00 msgr2=0x7f63c013e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bffff640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013df00 0x7f63c013e2e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f63b0003990 tx=0x7f63b000b810 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bf7fe640 1 --2- 172.21.15.5:0/3648853994 >> v2:172.21.15.157:6812/631023601 conn(0x7f63ac03bdc0 0x7f63ac03e280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f63c013f0a0 tx=0x7f63b4008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bffff640 1 -- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013df00 msgr2=0x7f63c013e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-18T21:05:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bffff640 1 -- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013df00 msgr2=0x7f63c013e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:05:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bffff640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013df00 0x7f63c013e2e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f63b0003990 tx=0x7f63b000b810 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bffff640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013df00 0x7f63c013e2e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f63b0003990 tx=0x7f63b000b810 comp rx=0 tx=0).stop 2024-08-18T21:05:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bcff9640 1 -- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013df00 msgr2=0x7f63c013e2e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bcff9640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013df00 0x7f63c013e2e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bcff9640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63ac041f00 0x7f63ac044320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bcff9640 1 -- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013df00 msgr2=0x7f63c013e2e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bcff9640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013df00 0x7f63c013e2e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bcff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bcff9640 1 -- 172.21.15.5:0/3648853994 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f63ac044960 con 0x7f63ac041f00 2024-08-18T21:05:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bffff640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63ac041f00 0x7f63ac044320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bffff640 10 monclient: get_auth_request con 0x7f63ac041f00 auth_method 0 2024-08-18T21:05:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bffff640 10 monclient(hunting): handle_auth_done global_id 34313 payload 824 2024-08-18T21:05:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.567+0000 7f63bffff640 1 -- 172.21.15.5:0/3648853994 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63b80c2e50 con 0x7f63ac041f00 2024-08-18T21:05:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.571+0000 7f63bffff640 1 -- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63ac041f00 msgr2=0x7f63ac044320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.571+0000 7f63bffff640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63ac041f00 0x7f63ac044320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009fd0 tx=0x7f63b0003800 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.571+0000 7f63bcff9640 1 -- 172.21.15.5:0/3648853994 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63b0016070 con 0x7f63ac041f00 2024-08-18T21:05:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.571+0000 7f63bcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.571+0000 7f63bcff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:05:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.571+0000 7f63bcff9640 10 monclient: dump: 2024-08-18T21:05:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.584 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.571+0000 7f63bcff9640 1 -- 172.21.15.5:0/3648853994 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f63b0012c40 con 0x7f63ac041f00 2024-08-18T21:05:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.571+0000 7f63bcff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.571+0000 7f63bcff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.571+0000 7f63bcff9640 1 -- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63ac041f00 msgr2=0x7f63ac044320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.571+0000 7f63bcff9640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63ac041f00 0x7f63ac044320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009fd0 tx=0x7f63b0003800 comp rx=0 tx=0).stop 2024-08-18T21:05:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.571+0000 7f63bcff9640 1 -- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63ac041f00 msgr2=0x7f63ac044320 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.571+0000 7f63bcff9640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63ac041f00 0x7f63ac044320 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009fd0 tx=0x7f63b0003800 comp rx=0 tx=0).stop 2024-08-18T21:05:23.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.579+0000 7f63c65d3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.579+0000 7f63c65d3640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013e820 0x7f63c00a3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.579+0000 7f63c65d3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.579+0000 7f63c65d3640 1 -- 172.21.15.5:0/3648853994 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f63c0051140 con 0x7f63c013e820 2024-08-18T21:05:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.579+0000 7f63bffff640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013e820 0x7f63c00a3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.579+0000 7f63bffff640 10 monclient: get_auth_request con 0x7f63c013e820 auth_method 0 2024-08-18T21:05:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.579+0000 7f63bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.579+0000 7f63bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.579+0000 7f63bffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.579+0000 7f63bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.579+0000 7f63bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.579+0000 7f63bffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.579+0000 7f63bffff640 10 monclient(hunting): handle_auth_done global_id 34322 payload 824 2024-08-18T21:05:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.579+0000 7f63bffff640 1 -- 172.21.15.5:0/3648853994 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f63c00a64c0 con 0x7f63c013e820 2024-08-18T21:05:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.583+0000 7f63bffff640 1 -- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013e820 msgr2=0x7f63c00a3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.583+0000 7f63bffff640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013e820 0x7f63c00a3d30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f63b0021000 tx=0x7f63b0014000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.583+0000 7f63bcff9640 1 -- 172.21.15.5:0/3648853994 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63b002e070 con 0x7f63c013e820 2024-08-18T21:05:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.583+0000 7f63bcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.583+0000 7f63bcff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:05:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.583+0000 7f63bcff9640 10 monclient: dump: 2024-08-18T21:05:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.588 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.583+0000 7f63bcff9640 1 -- 172.21.15.5:0/3648853994 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9224 (secure 0 0 0) 0x7f63b002a2b0 con 0x7f63c013e820 2024-08-18T21:05:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.583+0000 7f63bcff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.583+0000 7f63bcff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.583+0000 7f63bcff9640 1 -- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013e820 msgr2=0x7f63c00a3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.583+0000 7f63bcff9640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013e820 0x7f63c00a3d30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f63b0021000 tx=0x7f63b0014000 comp rx=0 tx=0).stop 2024-08-18T21:05:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.583+0000 7f63bcff9640 1 -- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013e820 msgr2=0x7f63c00a3d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.583+0000 7f63bcff9640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63c013e820 0x7f63c00a3d30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.587+0000 7f63c4b70640 1 -- 172.21.15.5:0/3648853994 reap_dead start 2024-08-18T21:05:23.590 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:23.590 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:23.590 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:23.590 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:23.590 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 38, 2024-08-18T21:05:23.590 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 43375, 2024-08-18T21:05:23.590 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:23.590 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:23.590 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:23.590 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:23.591 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:23.591 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:23.591 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:23.591 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:05:23.591 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.591 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:05:23.591 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:23.591 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:23.591 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:23.591 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:23.591 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:23.591 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:23.591 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:23.592 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:23.592 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:23.592 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:23.592 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:23.592 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:23.592 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:23.592 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:23.592 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.592 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:23.592 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:23.592 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:23.592 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:23.592 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:23.594 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:23.594 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:23.594 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:23.594 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:23.594 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:23.594 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:23.594 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:23.594 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:23.594 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:23.594 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:23.594 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:23.594 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:23.595 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:23.595 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:23.595 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:23.595 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:23.595 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:23.595 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:23.595 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:23.595 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:23.595 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:23.595 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:23.595 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:23.595 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:23.595 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:23.596 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:23.596 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.596 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:23.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.596 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:23.596 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.596 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:23.596 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:23.596 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.596 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.596 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.596 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.596 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:23.596 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.597 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.597 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.597 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:23.597 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.597 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.597 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.597 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:23.597 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:23.597 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.597 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.597 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.597 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.598 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:23.598 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:23.598 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.598 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.598 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.598 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.598 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:23.598 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.598 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.598 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.598 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:23.599 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.599 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.599 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.599 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.599 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:23.599 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:23.599 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.599 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.599 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.599 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.599 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.599 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:23.599 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:23.600 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.600 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.600 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.600 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.600 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:23.600 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.600 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.600 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.600 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:23.600 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.600 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.601 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.601 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:23.601 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:23.601 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.601 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.601 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.601 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.601 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:23.601 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:23.601 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.601 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.601 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.602 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.602 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:23.602 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.602 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.602 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.602 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:23.602 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.602 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.602 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.603 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.603 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:23.603 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:23.603 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.603 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.603 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.603 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.603 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.603 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:23.603 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:23.603 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.603 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.604 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.604 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.604 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:23.604 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.604 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.604 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.604 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:23.604 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.604 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.604 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.604 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:23.605 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:23.605 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.605 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.605 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.605 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.605 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:23.605 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:23.605 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.605 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.605 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.605 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.610 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.610 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.610 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:23.610 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:23.610 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.610 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.610 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.610 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.610 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:23.610 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:23.610 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.611 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.611 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.611 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.611 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:23.611 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.611 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.611 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.611 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:23.611 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.611 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.611 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:23.613 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.587+0000 7f63c65d3640 1 -- 172.21.15.5:0/3648853994 >> v2:172.21.15.157:6812/631023601 conn(0x7f63ac03bdc0 msgr2=0x7f63ac03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.587+0000 7f63c65d3640 1 --2- 172.21.15.5:0/3648853994 >> v2:172.21.15.157:6812/631023601 conn(0x7f63ac03bdc0 0x7f63ac03e280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f63c013f0a0 tx=0x7f63b4008040 comp rx=0 tx=0).stop 2024-08-18T21:05:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.587+0000 7f63c65d3640 10 monclient: shutdown 2024-08-18T21:05:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.587+0000 7f63c65d3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.587+0000 7f63c65d3640 1 -- 172.21.15.5:0/3648853994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63c0139990 msgr2=0x7f63c013d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.587+0000 7f63c65d3640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63c0139990 0x7f63c013d9c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009040 tx=0x7f63b80196d0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.587+0000 7f63c65d3640 1 -- 172.21.15.5:0/3648853994 shutdown_connections 2024-08-18T21:05:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.587+0000 7f63c65d3640 1 --2- 172.21.15.5:0/3648853994 >> v2:172.21.15.157:6812/631023601 conn(0x7f63ac03bdc0 0x7f63ac03e280 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.587+0000 7f63c65d3640 1 --2- 172.21.15.5:0/3648853994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63c0139990 0x7f63c013d9c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.587+0000 7f63c65d3640 1 -- 172.21.15.5:0/3648853994 >> 172.21.15.5:0/3648853994 conn(0x7f63c0068700 msgr2=0x7f63c01404e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.587+0000 7f63c65d3640 1 -- 172.21.15.5:0/3648853994 shutdown_connections 2024-08-18T21:05:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.587+0000 7f63c65d3640 1 -- 172.21.15.5:0/3648853994 wait complete. 2024-08-18T21:05:23.616 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:05:23.616 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon i 2024-08-18T21:05:23.616 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:05:23.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 10 monclient: get_monmap_and_config 2024-08-18T21:05:23.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 10 monclient: build_initial_monmap 2024-08-18T21:05:23.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 10 monclient: monmap: 2024-08-18T21:05:23.736 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:23.736 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.736 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:23.738013+0000 2024-08-18T21:05:23.737 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:23.738013+0000 2024-08-18T21:05:23.737 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:23.737 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.737 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:23.737 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:23.737 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:23.737 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:23.737 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:23.737 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:23.737 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:23.737 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:23.737 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:23.737 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:23.738 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:23.738 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 1 Processor -- start 2024-08-18T21:05:23.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 1 -- start start 2024-08-18T21:05:23.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 10 monclient: init 2024-08-18T21:05:23.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:23.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 10 monclient: _add_conns ranks=[8,6,7,10,9,4,1,2,5,3,0] 2024-08-18T21:05:23.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff48c0a6bd0 0x7ff48c0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 10 monclient(hunting): picked mon.noname-e con 0x7ff48c0a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:05:23.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff48c09f080 0x7ff48c0a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 10 monclient(hunting): picked mon.noname-d con 0x7ff48c09f080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:23.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c139990 0x7ff48c139df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 10 monclient(hunting): picked mon.noname-i con 0x7ff48c139990 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:23.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7ff48c09e4c0 con 0x7ff48c09f080 2024-08-18T21:05:23.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7ff48c06f930 con 0x7ff48c139990 2024-08-18T21:05:23.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff48c0a7a30 con 0x7ff48c0a6bd0 2024-08-18T21:05:23.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:23.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff492a7c640 10 monclient(hunting): authenticate will time out at 1090.751151s 2024-08-18T21:05:23.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff48bfff640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff48c09f080 msgr2=0x7ff48c0a74f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:05:23.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff490818640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff48c0a6bd0 msgr2=0x7ff48c0a6fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:05:23.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff48c09f080 0x7ff48c0a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:23.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff490818640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff48c0a6bd0 0x7ff48c0a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff491019640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c139990 0x7ff48c139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff491019640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c139990 0x7ff48c139df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:46528/0 (socket says 172.21.15.5:46528) 2024-08-18T21:05:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff491019640 1 -- 172.21.15.5:0/4228256388 learned_addr learned my addr 172.21.15.5:0/4228256388 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff491019640 10 monclient(hunting): get_auth_request con 0x7ff48c139990 auth_method 0 2024-08-18T21:05:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff491019640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff491019640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff491019640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff491019640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff491019640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.735+0000 7ff491019640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.739+0000 7ff491019640 10 monclient(hunting): handle_auth_done global_id 4732 payload 274 2024-08-18T21:05:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.739+0000 7ff491019640 1 -- 172.21.15.5:0/4228256388 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff48c0a6bd0 msgr2=0x7ff48c0a6fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:23.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.739+0000 7ff491019640 1 --2- 172.21.15.5:0/4228256388 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff48c0a6bd0 0x7ff48c0a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.739+0000 7ff491019640 1 -- 172.21.15.5:0/4228256388 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff48c09f080 msgr2=0x7ff48c0a74f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:23.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.739+0000 7ff491019640 1 --2- 172.21.15.5:0/4228256388 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff48c09f080 0x7ff48c0a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.739+0000 7ff491019640 10 monclient: _finish_hunting 0 2024-08-18T21:05:23.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.739+0000 7ff491019640 1 monclient: found mon.noname-i 2024-08-18T21:05:23.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.739+0000 7ff491019640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:23.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.739+0000 7ff491019640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:05:23.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.739+0000 7ff491019640 1 -- 172.21.15.5:0/4228256388 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c0a7fb0 con 0x7ff48c139990 2024-08-18T21:05:23.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff491019640 1 -- 172.21.15.5:0/4228256388 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c139990 msgr2=0x7ff48c139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff491019640 1 --2- 172.21.15.5:0/4228256388 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c139990 0x7ff48c139df0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff4840098a0 tx=0x7ff48401c480 comp rx=0 tx=0).ready entity=mon.7 client_cookie=e88fbf5448790af7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff48b7fe640 1 -- 172.21.15.5:0/4228256388 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4840b0070 con 0x7ff48c139990 2024-08-18T21:05:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff48b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff48b7fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:05:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff48b7fe640 10 monclient: dump: 2024-08-18T21:05:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.747 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff48b7fe640 10 monclient: _finish_auth 0 2024-08-18T21:05:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff48b7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:05:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff48b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff48b7fe640 1 -- 172.21.15.5:0/4228256388 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4840aa810 con 0x7ff48c139990 2024-08-18T21:05:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff48b7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:23.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff48b7fe640 1 -- 172.21.15.5:0/4228256388 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4840aae30 con 0x7ff48c139990 2024-08-18T21:05:23.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff48b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff48b7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:05:23.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff48b7fe640 10 monclient: dump: 2024-08-18T21:05:23.748 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.748 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.748 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.748 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.748 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.748 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.748 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.748 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.748 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.749 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.749 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.749 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.749 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.749 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.749 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.749 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff492a7c640 5 monclient: authenticate success, global_id 4732 2024-08-18T21:05:23.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff492a7c640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:23.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff492a7c640 4 set_mon_vals no callback set 2024-08-18T21:05:23.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff492a7c640 10 monclient: shutdown 2024-08-18T21:05:23.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff492a7c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:23.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff492a7c640 1 -- 172.21.15.5:0/4228256388 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c139990 msgr2=0x7ff48c139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff492a7c640 1 --2- 172.21.15.5:0/4228256388 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c139990 0x7ff48c139df0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff4840098a0 tx=0x7ff48401c480 comp rx=0 tx=0).stop 2024-08-18T21:05:23.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff492a7c640 1 -- 172.21.15.5:0/4228256388 shutdown_connections 2024-08-18T21:05:23.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff492a7c640 1 --2- 172.21.15.5:0/4228256388 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c139990 0x7ff48c139df0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff492a7c640 1 --2- 172.21.15.5:0/4228256388 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff48c09f080 0x7ff48c0a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff492a7c640 1 --2- 172.21.15.5:0/4228256388 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff48c0a6bd0 0x7ff48c0a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff492a7c640 1 -- 172.21.15.5:0/4228256388 >> 172.21.15.5:0/4228256388 conn(0x7ff48c068700 msgr2=0x7ff48c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:23.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff492a7c640 1 -- 172.21.15.5:0/4228256388 shutdown_connections 2024-08-18T21:05:23.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff492a7c640 1 -- 172.21.15.5:0/4228256388 wait complete. 2024-08-18T21:05:23.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff492a7c640 10 monclient: build_initial_monmap 2024-08-18T21:05:23.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.743+0000 7ff492a7c640 10 monclient: monmap: 2024-08-18T21:05:23.755 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:23.755 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:23.755 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:23.755 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:23.755 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:23.755 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.755 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:23.755 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:23.755 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:23.755 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:23.755 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:23.756 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:23.756 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:23.756 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:23.756 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:23.756 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 1 Processor -- start 2024-08-18T21:05:23.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 1 -- start start 2024-08-18T21:05:23.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 10 monclient: init 2024-08-18T21:05:23.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:23.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 10 monclient: _add_conns ranks=[0,7,6,2,3,1,4,8,5] 2024-08-18T21:05:23.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff48c09f080 0x7ff48c138950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 10 monclient(hunting): picked mon.noname-a con 0x7ff48c09f080 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:05:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c0a6bd0 0x7ff48c13dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 10 monclient(hunting): picked mon.noname-i con 0x7ff48c0a6bd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff48c139990 0x7ff48c13e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 10 monclient(hunting): picked mon.noname-d con 0x7ff48c139990 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:05:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c0a89f0 con 0x7ff48c09f080 2024-08-18T21:05:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7ff48c0a7ce0 con 0x7ff48c139990 2024-08-18T21:05:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7ff48c143610 con 0x7ff48c0a6bd0 2024-08-18T21:05:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff492a7c640 10 monclient(hunting): authenticate will time out at 1090.761011s 2024-08-18T21:05:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff491019640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff48c139990 msgr2=0x7ff48c13e210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:05:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff491019640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff48c139990 0x7ff48c13e210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff48c09f080 0x7ff48c138950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff48c09f080 0x7ff48c138950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34052/0 (socket says 172.21.15.5:34052) 2024-08-18T21:05:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 1 -- 172.21.15.5:0/2289837948 learned_addr learned my addr 172.21.15.5:0/2289837948 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 10 monclient(hunting): get_auth_request con 0x7ff48c09f080 auth_method 0 2024-08-18T21:05:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff48bfff640 1 --2- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c0a6bd0 0x7ff48c13dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff48bfff640 10 monclient(hunting): get_auth_request con 0x7ff48c0a6bd0 auth_method 0 2024-08-18T21:05:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff48bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff48bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff48bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 10 monclient(hunting): handle_auth_done global_id 4923 payload 824 2024-08-18T21:05:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 1 -- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c0a6bd0 msgr2=0x7ff48c13dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 1 --2- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c0a6bd0 0x7ff48c13dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 1 -- 172.21.15.5:0/2289837948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff48c139990 msgr2=0x7ff48c13e210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:05:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 1 --2- 172.21.15.5:0/2289837948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff48c139990 0x7ff48c13e210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 10 monclient: _finish_hunting 0 2024-08-18T21:05:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 1 monclient: found mon.noname-a 2024-08-18T21:05:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:05:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 1 -- 172.21.15.5:0/2289837948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c13f570 con 0x7ff48c09f080 2024-08-18T21:05:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 1 -- 172.21.15.5:0/2289837948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff48c09f080 msgr2=0x7ff48c138950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.747+0000 7ff490818640 1 --2- 172.21.15.5:0/2289837948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff48c09f080 0x7ff48c138950 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00b9e0 tx=0x7ff47c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff4897fa640 1 -- 172.21.15.5:0/2289837948 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff47c00cbb0 con 0x7ff48c09f080 2024-08-18T21:05:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff4897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff490818640 1 --2- 172.21.15.5:0/2289837948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff48c09f080 0x7ff48c138950 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00b9e0 tx=0x7ff47c00bea0 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7ff47c00cd90 mon_map magic: 0 2024-08-18T21:05:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff4897fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:05:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff4897fa640 10 monclient: dump: 2024-08-18T21:05:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.761 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff4897fa640 10 monclient: _finish_auth 0 2024-08-18T21:05:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff4897fa640 10 monclient: _check_auth_tickets 2024-08-18T21:05:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff4897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff4897fa640 1 -- 172.21.15.5:0/2289837948 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff47c010070 con 0x7ff48c09f080 2024-08-18T21:05:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff492a7c640 5 monclient: authenticate success, global_id 4923 2024-08-18T21:05:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff492a7c640 10 monclient: _renew_subs 2024-08-18T21:05:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff492a7c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:05:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff492a7c640 1 -- 172.21.15.5:0/2289837948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48c124310 con 0x7ff48c09f080 2024-08-18T21:05:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff4897fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff492a7c640 10 monclient: _renew_subs 2024-08-18T21:05:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff48a7fc640 4 set_mon_vals no callback set 2024-08-18T21:05:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff492a7c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:05:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff492a7c640 1 -- 172.21.15.5:0/2289837948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff48c0a6510 con 0x7ff48c09f080 2024-08-18T21:05:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff492a7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff492a7c640 1 --2- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c138e90 0x7ff48c13e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff492a7c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff492a7c640 1 -- 172.21.15.5:0/2289837948 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7ff48c051140 con 0x7ff48c138e90 2024-08-18T21:05:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff4897fa640 1 -- 172.21.15.5:0/2289837948 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff47c00cd90 con 0x7ff48c09f080 2024-08-18T21:05:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff4897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff4897fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:05:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff4897fa640 10 monclient: dump: 2024-08-18T21:05:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.764 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff48bfff640 1 --2- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c138e90 0x7ff48c13e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff4897fa640 1 -- 172.21.15.5:0/2289837948 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7ff47c015470 con 0x7ff48c09f080 2024-08-18T21:05:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff48bfff640 10 monclient: get_auth_request con 0x7ff48c138e90 auth_method 0 2024-08-18T21:05:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff48bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff48bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff48bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff48bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff48bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff48bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff4897fa640 1 --2- 172.21.15.5:0/2289837948 >> v2:172.21.15.157:6812/631023601 conn(0x7ff47803be40 0x7ff47803e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff48bfff640 10 monclient(hunting): handle_auth_done global_id 4750 payload 824 2024-08-18T21:05:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff48bfff640 1 -- 172.21.15.5:0/2289837948 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff48c0ab300 con 0x7ff48c138e90 2024-08-18T21:05:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff491019640 1 --2- 172.21.15.5:0/2289837948 >> v2:172.21.15.157:6812/631023601 conn(0x7ff47803be40 0x7ff47803e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.751+0000 7ff491019640 10 monclient: get_auth_request con 0x7ff47803be40 auth_method 0 2024-08-18T21:05:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.755+0000 7ff48bfff640 1 -- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c138e90 msgr2=0x7ff48c13e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.755+0000 7ff48bfff640 1 --2- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c138e90 0x7ff48c13e750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff480003990 tx=0x7ff48000db90 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.755+0000 7ff4897fa640 1 -- 172.21.15.5:0/2289837948 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff480018070 con 0x7ff48c138e90 2024-08-18T21:05:23.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.755+0000 7ff4897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.755+0000 7ff4897fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:05:23.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.755+0000 7ff4897fa640 10 monclient: dump: 2024-08-18T21:05:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.769 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.755+0000 7ff491019640 1 --2- 172.21.15.5:0/2289837948 >> v2:172.21.15.157:6812/631023601 conn(0x7ff47803be40 0x7ff47803e300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff4840ab000 tx=0x7ff4840a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.755+0000 7ff4897fa640 1 -- 172.21.15.5:0/2289837948 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff480005c60 con 0x7ff48c138e90 2024-08-18T21:05:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.755+0000 7ff4897fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.755+0000 7ff4897fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.755+0000 7ff4897fa640 1 -- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c138e90 msgr2=0x7ff48c13e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.755+0000 7ff4897fa640 1 --2- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c138e90 0x7ff48c13e750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff480003990 tx=0x7ff48000db90 comp rx=0 tx=0).stop 2024-08-18T21:05:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.755+0000 7ff4897fa640 1 -- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c138e90 msgr2=0x7ff48c13e750 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.755+0000 7ff4897fa640 1 --2- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c138e90 0x7ff48c13e750 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff480003990 tx=0x7ff48000db90 comp rx=0 tx=0).stop 2024-08-18T21:05:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.759+0000 7ff492a7c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:05:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.759+0000 7ff492a7c640 1 --2- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c13ec90 0x7ff48c0a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.759+0000 7ff492a7c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.759+0000 7ff492a7c640 1 -- 172.21.15.5:0/2289837948 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7ff48c13fe10 con 0x7ff48c13ec90 2024-08-18T21:05:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.763+0000 7ff48bfff640 1 --2- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c13ec90 0x7ff48c0a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.763+0000 7ff48bfff640 10 monclient: get_auth_request con 0x7ff48c13ec90 auth_method 0 2024-08-18T21:05:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.763+0000 7ff48bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.763+0000 7ff48bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.763+0000 7ff48bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.763+0000 7ff48bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.763+0000 7ff48bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.763+0000 7ff48bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.763+0000 7ff48bfff640 10 monclient(hunting): handle_auth_done global_id 4759 payload 824 2024-08-18T21:05:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.763+0000 7ff48bfff640 1 -- 172.21.15.5:0/2289837948 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff48c13f0a0 con 0x7ff48c13ec90 2024-08-18T21:05:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.763+0000 7ff48bfff640 1 -- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c13ec90 msgr2=0x7ff48c0a4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.763+0000 7ff48bfff640 1 --2- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c13ec90 0x7ff48c0a4170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff48000b130 tx=0x7ff4800059e0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.763+0000 7ff4897fa640 1 -- 172.21.15.5:0/2289837948 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff480018050 con 0x7ff48c13ec90 2024-08-18T21:05:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.763+0000 7ff4897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.763+0000 7ff4897fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:05:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.763+0000 7ff4897fa640 10 monclient: dump: 2024-08-18T21:05:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:23.772 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff4897fa640 1 -- 172.21.15.5:0/2289837948 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9392 (secure 0 0 0) 0x7ff480019040 con 0x7ff48c13ec90 2024-08-18T21:05:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff4897fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:05:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff4897fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff4897fa640 1 -- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c13ec90 msgr2=0x7ff48c0a4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff4897fa640 1 --2- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c13ec90 0x7ff48c0a4170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff48000b130 tx=0x7ff4800059e0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff4897fa640 1 -- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c13ec90 msgr2=0x7ff48c0a4170 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:05:23.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff4897fa640 1 --2- 172.21.15.5:0/2289837948 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff48c13ec90 0x7ff48c0a4170 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff48000b130 tx=0x7ff4800059e0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.773 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:05:23.773 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:23.773 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:23.773 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:05:23.773 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 38, 2024-08-18T21:05:23.773 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 132858, 2024-08-18T21:05:23.773 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:05:23.774 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:05:23.774 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:05:23.774 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:05:23.774 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:05:23.774 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:05:23.774 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:05:23.774 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:05:23.774 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.774 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:05:23.774 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:23.774 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:05:23.774 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:05:23.775 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:23.775 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:23.775 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:23.775 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:23.775 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:23.775 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:23.775 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:23.775 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:23.775 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:23.775 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:23.775 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:23.775 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.776 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:05:23.776 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:05:23.776 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:23.776 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:23.776 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:23.776 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:23.776 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:23.776 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:23.776 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:23.776 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:23.776 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:23.776 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:23.776 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:23.776 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.777 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:05:23.777 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:05:23.777 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:05:23.777 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:05:23.777 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:05:23.777 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:05:23.777 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:23.777 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:05:23.777 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:05:23.777 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:05:23.777 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:05:23.777 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:05:23.778 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:05:23.778 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:05:23.778 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:05:23.778 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:05:23.778 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:05:23.778 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:05:23.778 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:05:23.778 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:05:23.778 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:05:23.778 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:05:23.778 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:05:23.778 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:05:23.779 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:05:23.779 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:05:23.779 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:05:23.779 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:05:23.779 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.779 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:05:23.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.779 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:05:23.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.779 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:05:23.779 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:05:23.779 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.779 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.779 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.780 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:05:23.780 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.780 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.780 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:05:23.780 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.780 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.780 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.780 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:05:23.780 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:05:23.780 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.781 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.781 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.781 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:05:23.781 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:05:23.781 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.781 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.781 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.781 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:05:23.781 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.782 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.782 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:05:23.782 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.782 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.782 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.782 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:05:23.782 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:05:23.782 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.782 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:05:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:05:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:05:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:05:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:05:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:05:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:05:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:05:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:05:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:05:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:05:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:05:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:05:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:05:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:05:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:05:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:05:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:05:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:05:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:05:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:05:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:05:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:05:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:05:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:05:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:05:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:05:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:05:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:05:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:05:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:05:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:05:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:05:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.794 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:05:23.794 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:05:23.794 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.794 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:05:23.794 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:05:23.794 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:05:23.794 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.794 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.794 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:05:23.795 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:05:23.795 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:05:23.795 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:05:23.795 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:05:23.795 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.795 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.795 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:05:23.795 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:05:23.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.795 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:23.795 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:23.795 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:23.796 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.796 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.796 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:05:23.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.796 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:23.796 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:23.796 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:05:23.796 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.796 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:05:23.796 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:05:23.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:05:23.796 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:05:23.796 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:05:23.796 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:05:23.797 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:05:23.797 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:05:23.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:05:23.797 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:05:23.797 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:05:23.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff492a7c640 1 -- 172.21.15.5:0/2289837948 >> v2:172.21.15.157:6812/631023601 conn(0x7ff47803be40 msgr2=0x7ff47803e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff492a7c640 1 --2- 172.21.15.5:0/2289837948 >> v2:172.21.15.157:6812/631023601 conn(0x7ff47803be40 0x7ff47803e300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff4840ab000 tx=0x7ff4840a6000 comp rx=0 tx=0).stop 2024-08-18T21:05:23.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff492a7c640 10 monclient: shutdown 2024-08-18T21:05:23.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff492a7c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:23.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff492a7c640 1 -- 172.21.15.5:0/2289837948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff48c09f080 msgr2=0x7ff48c138950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:23.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff492a7c640 1 --2- 172.21.15.5:0/2289837948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff48c09f080 0x7ff48c138950 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00b9e0 tx=0x7ff47c00bea0 comp rx=0 tx=0).stop 2024-08-18T21:05:23.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff491019640 1 -- 172.21.15.5:0/2289837948 reap_dead start 2024-08-18T21:05:23.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff4897fa640 1 -- 172.21.15.5:0/2289837948 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 11..52) ==== 3898+0+0 (unknown 0 0 0) 0x7ff47c04ee30 con 0x7ff48c09f080 2024-08-18T21:05:23.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff491019640 1 -- 172.21.15.5:0/2289837948 reap_dead start 2024-08-18T21:05:23.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff492a7c640 1 -- 172.21.15.5:0/2289837948 shutdown_connections 2024-08-18T21:05:23.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff492a7c640 1 -- 172.21.15.5:0/2289837948 >> 172.21.15.5:0/2289837948 conn(0x7ff48c068700 msgr2=0x7ff48c0aa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:23.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff492a7c640 1 -- 172.21.15.5:0/2289837948 shutdown_connections 2024-08-18T21:05:23.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:23.767+0000 7ff492a7c640 1 -- 172.21.15.5:0/2289837948 wait complete. 2024-08-18T21:05:23.799 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:05:23.800 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-18T21:05:24.203 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:24.203 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28431]: starting. 2024-08-18T21:05:24.203 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28431]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28395 2024-08-18T21:05:24.203 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28431]: shutting down. 2024-08-18T21:05:24.208 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:24.208 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:24.208 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:05:24.211 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:05:26.387 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28483]: starting. 2024-08-18T21:05:26.387 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28483]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28482 2024-08-18T21:05:26.387 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28483]: created object 0... 2024-08-18T21:05:26.387 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28483]: created object 25... 2024-08-18T21:05:26.387 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28483]: created object 49... 2024-08-18T21:05:26.387 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28483]: finishing. 2024-08-18T21:05:26.387 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28483]: shutting down. 2024-08-18T21:05:27.169 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28484]: starting. 2024-08-18T21:05:27.169 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28484]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28482 2024-08-18T21:05:27.169 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28484]: shutting down. 2024-08-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28518]: starting. 2024-08-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28518]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28482 2024-08-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28518]: created object 0... 2024-08-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28518]: created object 25... 2024-08-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28518]: created object 49... 2024-08-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28518]: finishing. 2024-08-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28518]: shutting down. 2024-08-18T21:05:30.188 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:30.188 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28520]: starting. 2024-08-18T21:05:30.188 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28520]: listing objects. 2024-08-18T21:05:30.188 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28520]: listed object 0... 2024-08-18T21:05:30.188 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28520]: listed object 25... 2024-08-18T21:05:30.188 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28520]: saw 50 objects 2024-08-18T21:05:30.189 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28520]: shutting down. 2024-08-18T21:05:31.468 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:31.468 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28519]: starting. 2024-08-18T21:05:31.468 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28519]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28482 2024-08-18T21:05:31.468 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28519]: shutting down. 2024-08-18T21:05:31.470 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:31.470 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:31.470 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:05:31.476 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:05:33.721 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28572]: starting. 2024-08-18T21:05:33.721 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28572]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28571 2024-08-18T21:05:33.721 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28572]: created object 0... 2024-08-18T21:05:33.721 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28572]: created object 25... 2024-08-18T21:05:33.721 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28572]: created object 49... 2024-08-18T21:05:33.721 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28572]: finishing. 2024-08-18T21:05:33.721 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28572]: shutting down. 2024-08-18T21:05:34.496 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28573]: starting. 2024-08-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28573]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28571 2024-08-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28573]: shutting down. 2024-08-18T21:05:36.734 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:36.735 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28607]: starting. 2024-08-18T21:05:36.735 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28607]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28571 2024-08-18T21:05:36.735 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28607]: created object 0... 2024-08-18T21:05:36.735 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28607]: created object 25... 2024-08-18T21:05:36.735 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28607]: created object 49... 2024-08-18T21:05:36.735 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28607]: finishing. 2024-08-18T21:05:36.735 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28607]: shutting down. 2024-08-18T21:05:36.789 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:36.789 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28609]: starting. 2024-08-18T21:05:36.789 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28609]: listing objects. 2024-08-18T21:05:36.789 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28609]: listed object 0... 2024-08-18T21:05:36.789 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28609]: listed object 25... 2024-08-18T21:05:36.789 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28609]: saw 50 objects 2024-08-18T21:05:36.789 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28609]: shutting down. 2024-08-18T21:05:37.525 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:37.525 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28608]: starting. 2024-08-18T21:05:37.526 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28608]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28571 2024-08-18T21:05:37.526 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28608]: shutting down. 2024-08-18T21:05:37.530 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:37.531 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:37.531 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:05:37.535 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:05:39.772 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28661]: starting. 2024-08-18T21:05:39.772 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28661]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28660 2024-08-18T21:05:39.772 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28661]: created object 0... 2024-08-18T21:05:39.773 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28661]: created object 25... 2024-08-18T21:05:39.773 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28661]: created object 49... 2024-08-18T21:05:39.773 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28661]: finishing. 2024-08-18T21:05:39.773 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28661]: shutting down. 2024-08-18T21:05:40.172 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28662]: starting. 2024-08-18T21:05:40.172 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28662]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28660 2024-08-18T21:05:40.172 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28662]: shutting down. 2024-08-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28696]: starting. 2024-08-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28696]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28660 2024-08-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28696]: created object 0... 2024-08-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28696]: created object 25... 2024-08-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28696]: created object 49... 2024-08-18T21:05:42.405 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28696]: finishing. 2024-08-18T21:05:42.405 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28696]: shutting down. 2024-08-18T21:05:42.462 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:42.462 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28698]: starting. 2024-08-18T21:05:42.462 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28698]: listing objects. 2024-08-18T21:05:42.462 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28698]: listed object 0... 2024-08-18T21:05:42.462 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28698]: listed object 25... 2024-08-18T21:05:42.462 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28698]: saw 50 objects 2024-08-18T21:05:42.462 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28698]: shutting down. 2024-08-18T21:05:43.800 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2024-08-18T21:05:43.800 INFO:tasks.ceph.mon.d:Restarting daemon 2024-08-18T21:05:43.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-08-18T21:05:43.803 INFO:tasks.ceph.mon.d:Started 2024-08-18T21:05:43.803 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-08-18T21:05:43.804 INFO:tasks.ceph.mon.e:Restarting daemon 2024-08-18T21:05:43.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-08-18T21:05:43.806 INFO:tasks.ceph.mon.e:Started 2024-08-18T21:05:43.807 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:05:43.807 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:05:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 10 monclient: get_monmap_and_config 2024-08-18T21:05:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 10 monclient: build_initial_monmap 2024-08-18T21:05:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 10 monclient: monmap: 2024-08-18T21:05:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:43.933274+0000 2024-08-18T21:05:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:43.933274+0000 2024-08-18T21:05:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:43.933 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 1 Processor -- start 2024-08-18T21:05:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 1 -- start start 2024-08-18T21:05:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 10 monclient: init 2024-08-18T21:05:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 10 monclient: _add_conns ranks=[2,1,3,7,8,5,4,0,6,9,10] 2024-08-18T21:05:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7feb740a6bd0 0x7feb740a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 10 monclient(hunting): picked mon.noname-b con 0x7feb740a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7feb7409f080 addr v1:172.21.15.157:6789/0 2024-08-18T21:05:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb740a74f0 0x7feb7413a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 10 monclient(hunting): picked mon.noname-g con 0x7feb740a74f0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb740a7fb0 con 0x7feb7409f080 2024-08-18T21:05:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7feb7409e4c0 con 0x7feb740a6bd0 2024-08-18T21:05:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb7406f930 con 0x7feb740a74f0 2024-08-18T21:05:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7bea1640 10 monclient(hunting): authenticate will time out at 1110.946158s 2024-08-18T21:05:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7feb740a6bd0 0x7feb740a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7feb740a6bd0 0x7feb740a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:35372/0 (socket says 172.21.15.5:35372) 2024-08-18T21:05:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 1 -- 172.21.15.5:0/3709247459 learned_addr learned my addr 172.21.15.5:0/3709247459 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 10 monclient(hunting): get_auth_request con 0x7feb740a6bd0 auth_method 0 2024-08-18T21:05:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7a43e640 1 --2- 172.21.15.5:0/3709247459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb740a74f0 0x7feb7413a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 10 monclient(hunting): handle_auth_done global_id 5042 payload 274 2024-08-18T21:05:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 1 -- 172.21.15.5:0/3709247459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb740a74f0 msgr2=0x7feb7413a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 1 --2- 172.21.15.5:0/3709247459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb740a74f0 0x7feb7413a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 1 -- 172.21.15.5:0/3709247459 >> v1:172.21.15.157:6789/0 conn(0x7feb7409f080 legacy=0x7feb74139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 10 monclient: _finish_hunting 0 2024-08-18T21:05:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 1 monclient: found mon.noname-b 2024-08-18T21:05:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:05:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb79c3d640 1 -- 172.21.15.5:0/3709247459 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7409de70 con 0x7feb740a6bd0 2024-08-18T21:05:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7a43e640 10 monclient: get_auth_request con 0x7feb740a74f0 auth_method 0 2024-08-18T21:05:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.930+0000 7feb7a43e640 1 --2- 172.21.15.5:0/3709247459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb740a74f0 0x7feb7413a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:05:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb79c3d640 1 -- 172.21.15.5:0/3709247459 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7feb740a6bd0 msgr2=0x7feb740a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb79c3d640 1 --2- 172.21.15.5:0/3709247459 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7feb740a6bd0 0x7feb740a6fb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feb700098a0 tx=0x7feb7001cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee563b01052257e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb78c3b640 1 -- 172.21.15.5:0/3709247459 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feb700b0070 con 0x7feb740a6bd0 2024-08-18T21:05:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb78c3b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb78c3b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:05:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb78c3b640 10 monclient: dump: 2024-08-18T21:05:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:43.944 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb78c3b640 10 monclient: _finish_auth 0 2024-08-18T21:05:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb78c3b640 10 monclient: _check_auth_tickets 2024-08-18T21:05:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb78c3b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb78c3b640 1 -- 172.21.15.5:0/3709247459 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb700aa810 con 0x7feb740a6bd0 2024-08-18T21:05:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb78c3b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb78c3b640 1 -- 172.21.15.5:0/3709247459 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feb700aae30 con 0x7feb740a6bd0 2024-08-18T21:05:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb7bea1640 5 monclient: authenticate success, global_id 5042 2024-08-18T21:05:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb7bea1640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb7bea1640 4 set_mon_vals no callback set 2024-08-18T21:05:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb78c3b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb78c3b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb78c3b640 10 monclient: dump: 2024-08-18T21:05:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:43.946 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb7bea1640 10 monclient: shutdown 2024-08-18T21:05:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb7bea1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb7bea1640 1 -- 172.21.15.5:0/3709247459 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7feb740a6bd0 msgr2=0x7feb740a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb7bea1640 1 --2- 172.21.15.5:0/3709247459 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7feb740a6bd0 0x7feb740a6fb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feb700098a0 tx=0x7feb7001cea0 comp rx=0 tx=0).stop 2024-08-18T21:05:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb7bea1640 1 -- 172.21.15.5:0/3709247459 shutdown_connections 2024-08-18T21:05:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb7bea1640 1 --2- 172.21.15.5:0/3709247459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb740a74f0 0x7feb7413a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb7bea1640 1 --2- 172.21.15.5:0/3709247459 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7feb740a6bd0 0x7feb740a6fb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb7bea1640 1 -- 172.21.15.5:0/3709247459 >> 172.21.15.5:0/3709247459 conn(0x7feb74068700 msgr2=0x7feb74068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb7bea1640 1 -- 172.21.15.5:0/3709247459 shutdown_connections 2024-08-18T21:05:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.934+0000 7feb7bea1640 1 -- 172.21.15.5:0/3709247459 wait complete. 2024-08-18T21:05:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 10 monclient: build_initial_monmap 2024-08-18T21:05:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 10 monclient: monmap: 2024-08-18T21:05:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:43.948 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 1 Processor -- start 2024-08-18T21:05:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 1 -- start start 2024-08-18T21:05:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 10 monclient: init 2024-08-18T21:05:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 10 monclient: _add_conns ranks=[7,3,4,0,6,1,2,8,5] 2024-08-18T21:05:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7feb7409f080 0x7feb74138d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 10 monclient(hunting): picked mon.noname-i con 0x7feb7409f080 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb740a6bd0 0x7feb741392c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 10 monclient(hunting): picked mon.noname-g con 0x7feb740a6bd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7feb740a74f0 0x7feb7413e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 10 monclient(hunting): picked mon.noname-c con 0x7feb740a74f0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb7413a5e0 con 0x7feb740a6bd0 2024-08-18T21:05:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7feb740a89f0 con 0x7feb740a74f0 2024-08-18T21:05:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7feb7413a760 con 0x7feb7409f080 2024-08-18T21:05:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7bea1640 10 monclient(hunting): authenticate will time out at 1110.953195s 2024-08-18T21:05:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7feb740a74f0 0x7feb7413e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7feb740a74f0 0x7feb7413e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:59502/0 (socket says 172.21.15.5:59502) 2024-08-18T21:05:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 1 -- 172.21.15.5:0/722374870 learned_addr learned my addr 172.21.15.5:0/722374870 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 10 monclient(hunting): get_auth_request con 0x7feb740a74f0 auth_method 0 2024-08-18T21:05:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7943c640 1 --2- 172.21.15.5:0/722374870 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb740a6bd0 0x7feb741392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7943c640 10 monclient(hunting): get_auth_request con 0x7feb740a6bd0 auth_method 0 2024-08-18T21:05:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7943c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7943c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7943c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb79c3d640 1 --2- 172.21.15.5:0/722374870 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7feb7409f080 0x7feb74138d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb79c3d640 10 monclient(hunting): get_auth_request con 0x7feb7409f080 auth_method 0 2024-08-18T21:05:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb79c3d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb79c3d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb79c3d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 10 monclient(hunting): handle_auth_done global_id 4990 payload 824 2024-08-18T21:05:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 1 -- 172.21.15.5:0/722374870 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7feb7409f080 msgr2=0x7feb74138d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 1 --2- 172.21.15.5:0/722374870 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7feb7409f080 0x7feb74138d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 1 -- 172.21.15.5:0/722374870 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb740a6bd0 msgr2=0x7feb741392c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 1 --2- 172.21.15.5:0/722374870 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb740a6bd0 0x7feb741392c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 10 monclient: _finish_hunting 0 2024-08-18T21:05:43.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 1 monclient: found mon.noname-c 2024-08-18T21:05:43.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:43.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:05:43.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7a43e640 1 -- 172.21.15.5:0/722374870 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb740a2d80 con 0x7feb740a74f0 2024-08-18T21:05:43.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.938+0000 7feb7943c640 1 --2- 172.21.15.5:0/722374870 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb740a6bd0 0x7feb741392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:05:43.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb7a43e640 1 -- 172.21.15.5:0/722374870 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7feb740a74f0 msgr2=0x7feb7413e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:43.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb7a43e640 1 --2- 172.21.15.5:0/722374870 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7feb740a74f0 0x7feb7413e600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00cd80 tx=0x7feb6c00a650 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:43.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6a7fc640 1 -- 172.21.15.5:0/722374870 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feb6c00fb00 con 0x7feb740a74f0 2024-08-18T21:05:43.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:43.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:05:43.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6a7fc640 10 monclient: dump: 2024-08-18T21:05:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:43.956 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6a7fc640 10 monclient: _finish_auth 0 2024-08-18T21:05:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6a7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:05:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6a7fc640 1 -- 172.21.15.5:0/722374870 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb6c00fce0 con 0x7feb740a74f0 2024-08-18T21:05:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6a7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6a7fc640 1 -- 172.21.15.5:0/722374870 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feb6c018870 con 0x7feb740a74f0 2024-08-18T21:05:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb7bea1640 5 monclient: authenticate success, global_id 4990 2024-08-18T21:05:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:05:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6bfff640 4 set_mon_vals no callback set 2024-08-18T21:05:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6a7fc640 10 monclient: dump: 2024-08-18T21:05:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:43.958 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb7bea1640 10 monclient: _renew_subs 2024-08-18T21:05:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb7bea1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:05:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb7bea1640 1 -- 172.21.15.5:0/722374870 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb74123a90 con 0x7feb740a74f0 2024-08-18T21:05:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb7bea1640 10 monclient: _renew_subs 2024-08-18T21:05:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb7bea1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:05:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb7bea1640 1 -- 172.21.15.5:0/722374870 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7feb741234d0 con 0x7feb740a74f0 2024-08-18T21:05:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb7bea1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb7bea1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb7bea1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:05:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb7bea1640 1 -- 172.21.15.5:0/722374870 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb74123cd0 con 0x7feb740a74f0 2024-08-18T21:05:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6a7fc640 1 -- 172.21.15.5:0/722374870 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7feb6c018400 con 0x7feb740a74f0 2024-08-18T21:05:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6a7fc640 1 --2- 172.21.15.5:0/722374870 >> v2:172.21.15.157:6812/631023601 conn(0x7feb5803bdc0 0x7feb5803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb6a7fc640 1 -- 172.21.15.5:0/722374870 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(71..71 src has 22..71) ==== 3898+0+0 (secure 0 0 0) 0x7feb6c04f390 con 0x7feb740a74f0 2024-08-18T21:05:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb79c3d640 1 --2- 172.21.15.5:0/722374870 >> v2:172.21.15.157:6812/631023601 conn(0x7feb5803bdc0 0x7feb5803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.942+0000 7feb79c3d640 10 monclient: get_auth_request con 0x7feb5803bdc0 auth_method 0 2024-08-18T21:05:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.946+0000 7feb79c3d640 1 --2- 172.21.15.5:0/722374870 >> v2:172.21.15.157:6812/631023601 conn(0x7feb5803bdc0 0x7feb5803e280 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feb700098a0 tx=0x7feb70004740 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.946+0000 7feb6a7fc640 1 -- 172.21.15.5:0/722374870 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7feb740a2d80 con 0x7feb740a74f0 2024-08-18T21:05:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.946+0000 7feb6a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:43.946+0000 7feb6a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:44.106 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:44.107 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28697]: starting. 2024-08-18T21:05:44.107 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28697]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28660 2024-08-18T21:05:44.107 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28697]: shutting down. 2024-08-18T21:05:44.109 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:44.109 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:05:44.110 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:05:44.112 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:05:44.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:44.202+0000 7feb7bea1640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:05:44.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:44.202+0000 7feb7bea1640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:05:44.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:44.202+0000 7feb7bea1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:05:44.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:44.202+0000 7feb7bea1640 1 -- 172.21.15.5:0/722374870 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feb741406a0 con 0x7feb740a74f0 2024-08-18T21:05:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:46.938+0000 7feb697fa640 10 monclient: tick 2024-08-18T21:05:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:46.938+0000 7feb697fa640 10 monclient: _check_auth_tickets 2024-08-18T21:05:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:46.938+0000 7feb697fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:46.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:46.938+0000 7feb697fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:47.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:47.938+0000 7feb697fa640 10 monclient: tick 2024-08-18T21:05:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:47.938+0000 7feb697fa640 10 monclient: _check_auth_tickets 2024-08-18T21:05:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:47.938+0000 7feb697fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:48.938+0000 7feb697fa640 10 monclient: tick 2024-08-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:48.938+0000 7feb697fa640 10 monclient: _check_auth_tickets 2024-08-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:48.938+0000 7feb697fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.130+0000 7feb6a7fc640 1 -- 172.21.15.5:0/722374870 <== mon.4 v2:172.21.15.5:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3160 (secure 0 0 0) 0x7feb6c014030 con 0x7feb740a74f0 2024-08-18T21:05:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.130+0000 7feb6a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:05:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.130+0000 7feb6a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:49.132 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":42,"quorum":[0,1,2,3,4,5,7],"quorum_names":["a","f","b","g","c","h","i"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:05:49.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.134+0000 7feb7bea1640 1 -- 172.21.15.5:0/722374870 >> v2:172.21.15.157:6812/631023601 conn(0x7feb5803bdc0 msgr2=0x7feb5803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:49.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.134+0000 7feb7bea1640 1 --2- 172.21.15.5:0/722374870 >> v2:172.21.15.157:6812/631023601 conn(0x7feb5803bdc0 0x7feb5803e280 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feb700098a0 tx=0x7feb70004740 comp rx=0 tx=0).stop 2024-08-18T21:05:49.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.134+0000 7feb7bea1640 10 monclient: shutdown 2024-08-18T21:05:49.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.134+0000 7feb7bea1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:49.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.134+0000 7feb7bea1640 1 -- 172.21.15.5:0/722374870 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7feb740a74f0 msgr2=0x7feb7413e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:49.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.134+0000 7feb7bea1640 1 --2- 172.21.15.5:0/722374870 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7feb740a74f0 0x7feb7413e600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00cd80 tx=0x7feb6c00a650 comp rx=0 tx=0).stop 2024-08-18T21:05:49.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.134+0000 7feb7bea1640 1 -- 172.21.15.5:0/722374870 shutdown_connections 2024-08-18T21:05:49.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.134+0000 7feb7bea1640 1 --2- 172.21.15.5:0/722374870 >> v2:172.21.15.157:6812/631023601 conn(0x7feb5803bdc0 0x7feb5803e280 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:49.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.134+0000 7feb7bea1640 1 --2- 172.21.15.5:0/722374870 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7feb740a74f0 0x7feb7413e600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.134+0000 7feb7bea1640 1 --2- 172.21.15.5:0/722374870 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb740a6bd0 0x7feb741392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.134+0000 7feb7bea1640 1 --2- 172.21.15.5:0/722374870 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7feb7409f080 0x7feb74138d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.134+0000 7feb7bea1640 1 -- 172.21.15.5:0/722374870 >> 172.21.15.5:0/722374870 conn(0x7feb74068700 msgr2=0x7feb740a15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.134+0000 7feb7bea1640 1 -- 172.21.15.5:0/722374870 shutdown_connections 2024-08-18T21:05:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:49.134+0000 7feb7bea1640 1 -- 172.21.15.5:0/722374870 wait complete. 2024-08-18T21:05:52.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:05:52.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 10 monclient: get_monmap_and_config 2024-08-18T21:05:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 10 monclient: build_initial_monmap 2024-08-18T21:05:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 10 monclient: monmap: 2024-08-18T21:05:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:52.297902+0000 2024-08-18T21:05:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:52.297902+0000 2024-08-18T21:05:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:52.298 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:52.298 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:52.298 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:52.298 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:52.298 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:52.298 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:52.298 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:52.298 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:52.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 1 Processor -- start 2024-08-18T21:05:52.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 1 -- start start 2024-08-18T21:05:52.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 10 monclient: init 2024-08-18T21:05:52.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:52.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 10 monclient: _add_conns ranks=[2,10,1,5,9,8,4,6,3,0,7] 2024-08-18T21:05:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1cf80a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 10 monclient(hunting): picked mon.noname-b con 0x7f1cf80a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 0x7f1cf8139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 10 monclient(hunting): picked mon.noname-f con 0x7f1cf80a7600 addr v2:172.21.15.157:3300/0 2024-08-18T21:05:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f1cf8139fe0 addr v1:172.21.15.157:6789/0 2024-08-18T21:05:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cf80a45d0 con 0x7f1cf8139fe0 2024-08-18T21:05:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1cf80a5000 con 0x7f1cf80a7600 2024-08-18T21:05:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf80a4360 con 0x7f1cf80a6ce0 2024-08-18T21:05:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.294+0000 7f1cfdc91640 10 monclient(hunting): authenticate will time out at 1119.311915s 2024-08-18T21:05:52.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1cf77fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1cf80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:52.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1cf77fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1cf80a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:58990/0 (socket says 172.21.15.5:58990) 2024-08-18T21:05:52.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1cf77fe640 1 -- 172.21.15.5:0/2324017040 learned_addr learned my addr 172.21.15.5:0/2324017040 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:52.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1cf77fe640 10 monclient(hunting): get_auth_request con 0x7f1cf80a6ce0 auth_method 0 2024-08-18T21:05:52.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1cf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:52.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1cf77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:52.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1cf77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:52.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1cf77fe640 1 -- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 msgr2=0x7f1cf80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:52.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1cf77fe640 1 -- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 msgr2=0x7f1cf80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:52.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1cf77fe640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1cf80a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:52.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1ceffff640 1 --2- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 0x7f1cf8139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:52.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1cf77fe640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1cf80a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:52.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1ceffff640 10 monclient(hunting): get_auth_request con 0x7f1cf80a7600 auth_method 0 2024-08-18T21:05:52.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1ceffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:52.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1ceffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:52.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1ceffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:52.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1ceffff640 1 -- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 msgr2=0x7f1cf8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:05:52.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1ceffff640 1 -- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 msgr2=0x7f1cf8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:52.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1ceffff640 1 --2- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 0x7f1cf8139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:52.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1ceffff640 1 --2- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 0x7f1cf8139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:52.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.298+0000 7f1cf7fff640 1 -- 172.21.15.5:0/2324017040 >> v1:172.21.15.157:6789/0 conn(0x7f1cf8139fe0 legacy=0x7f1cf8140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:52.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1ceffff640 1 --2- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 0x7f1cf8139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:52.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1ceffff640 10 monclient(hunting): get_auth_request con 0x7f1cf80a7600 auth_method 0 2024-08-18T21:05:52.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1ceffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:52.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1ceffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:52.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1ceffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:52.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1ceffff640 1 -- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 msgr2=0x7f1cf8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:52.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1ceffff640 1 -- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 msgr2=0x7f1cf8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:52.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1ceffff640 1 --2- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 0x7f1cf8139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:52.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1ceffff640 1 --2- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 0x7f1cf8139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:05:52.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1cf77fe640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1cf80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:52.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1cf77fe640 10 monclient(hunting): get_auth_request con 0x7f1cf80a6ce0 auth_method 0 2024-08-18T21:05:52.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1cf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:52.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1cf77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:52.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1cf77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:52.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1cf77fe640 1 -- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 msgr2=0x7f1cf80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:52.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1cf77fe640 1 -- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 msgr2=0x7f1cf80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:52.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1cf77fe640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1cf80a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:52.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.502+0000 7f1cf77fe640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1cf80a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:05:52.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1cf77fe640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1cf80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:52.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1cf77fe640 10 monclient(hunting): get_auth_request con 0x7f1cf80a6ce0 auth_method 0 2024-08-18T21:05:52.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1cf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:52.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1cf77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:52.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1cf77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:52.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1cf77fe640 1 -- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 msgr2=0x7f1cf80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:52.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1cf77fe640 1 -- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 msgr2=0x7f1cf80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:52.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1cf77fe640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1cf80a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:52.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1cf77fe640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1cf80a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:05:52.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1ceffff640 1 --2- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 0x7f1cf8139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:52.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1ceffff640 10 monclient(hunting): get_auth_request con 0x7f1cf80a7600 auth_method 0 2024-08-18T21:05:52.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1ceffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:52.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1ceffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:52.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1ceffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:52.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1ceffff640 1 -- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 msgr2=0x7f1cf8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:05:52.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1ceffff640 1 -- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 msgr2=0x7f1cf8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:52.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1ceffff640 1 --2- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 0x7f1cf8139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:52.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:52.906+0000 7f1ceffff640 1 --2- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 0x7f1cf8139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:05:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1cf77fe640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1cf80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1cf77fe640 10 monclient(hunting): get_auth_request con 0x7f1cf80a6ce0 auth_method 0 2024-08-18T21:05:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1cf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1cf77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1cf77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1cf77fe640 1 -- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 msgr2=0x7f1cf80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1cf77fe640 1 -- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 msgr2=0x7f1cf80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1cf77fe640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1cf80a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1cf77fe640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1cf80a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:05:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1ceffff640 1 --2- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 0x7f1cf8139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1ceffff640 10 monclient(hunting): get_auth_request con 0x7f1cf80a7600 auth_method 0 2024-08-18T21:05:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1ceffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1ceffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1ceffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1ceffff640 1 -- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 msgr2=0x7f1cf8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:05:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1ceffff640 1 -- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 msgr2=0x7f1cf8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1ceffff640 1 --2- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 0x7f1cf8139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:53.710+0000 7f1ceffff640 1 --2- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 0x7f1cf8139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:05:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.550+0000 7f1cf6ffd640 1 -- 172.21.15.5:0/2324017040 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 523887961 0 0) 0x7f1cf80a45d0 con 0x7f1cf8139fe0 2024-08-18T21:05:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.550+0000 7f1cf6ffd640 10 monclient(hunting): _negotiate 2024-08-18T21:05:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.550+0000 7f1cf6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.550+0000 7f1cf6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.550+0000 7f1cf6ffd640 10 monclient(hunting): my global_id is 4816 2024-08-18T21:05:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.550+0000 7f1cf6ffd640 1 -- 172.21.15.5:0/2324017040 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ce4003530 con 0x7f1cf8139fe0 2024-08-18T21:05:54.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 1 -- 172.21.15.5:0/2324017040 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 776653999 0 0) 0x7f1ce4003530 con 0x7f1cf8139fe0 2024-08-18T21:05:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 1 -- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 msgr2=0x7f1cf80a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1cf80a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 1 -- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 msgr2=0x7f1cf8139aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:05:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 1 --2- 172.21.15.5:0/2324017040 >> v2:172.21.15.157:3300/0 conn(0x7f1cf80a7600 0x7f1cf8139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:05:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 1 monclient: found mon.noname-f-legacy 2024-08-18T21:05:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient: _send_mon_message to mon.noname-f-legacy at v1:172.21.15.157:6789/0 2024-08-18T21:05:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 1 -- 172.21.15.5:0/2324017040 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf80a8900 con 0x7f1cf8139fe0 2024-08-18T21:05:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:05:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:05:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 1 -- 172.21.15.5:0/2324017040 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 4141550541 0 0) 0x7f1cf0001ff0 con 0x7f1cf8139fe0 2024-08-18T21:05:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient: got monmap 1 from mon.noname-f-legacy (according to old e1) 2024-08-18T21:05:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient: dump: 2024-08-18T21:05:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:54.569 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 1 monclient: mon.f has (v2) addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] but i'm connected to v1:172.21.15.157:6789/0, reconnecting 2024-08-18T21:05:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 1 -- 172.21.15.5:0/2324017040 >> v1:172.21.15.157:6789/0 conn(0x7f1cf8139fe0 legacy=0x7f1cf8140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient: _add_conns ranks=[5,2,4,7,8,6,1,3,0] 2024-08-18T21:05:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1ce4004260 0x7f1ce4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient(hunting): picked mon.h con 0x7f1ce4004260 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1ce4004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient(hunting): picked mon.b con 0x7f1cf80a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:05:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f1ce40099c0 0x7f1ce400bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient(hunting): picked mon.c con 0x7f1ce40099c0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:05:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 1 -- 172.21.15.5:0/2324017040 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf80a4360 con 0x7f1cf80a6ce0 2024-08-18T21:05:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 1 -- 172.21.15.5:0/2324017040 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f1ce400c480 con 0x7f1ce40099c0 2024-08-18T21:05:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 1 -- 172.21.15.5:0/2324017040 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f1ce400c600 con 0x7f1ce4004260 2024-08-18T21:05:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf6ffd640 10 monclient(hunting): _finish_auth 0 2024-08-18T21:05:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1ce4004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf7fff640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f1ce40099c0 0x7f1ce400bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 10 monclient(hunting): get_auth_request con 0x7f1cf80a6ce0 auth_method 0 2024-08-18T21:05:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf7fff640 10 monclient(hunting): get_auth_request con 0x7f1ce40099c0 auth_method 0 2024-08-18T21:05:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:05:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf7fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:05:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf77fe640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1ce4004260 0x7f1ce4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf77fe640 10 monclient(hunting): get_auth_request con 0x7f1ce4004260 auth_method 0 2024-08-18T21:05:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 10 monclient(hunting): handle_auth_done global_id 4816 payload 293 2024-08-18T21:05:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 1 -- 172.21.15.5:0/2324017040 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1ce4004260 msgr2=0x7f1ce4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1ce4004260 0x7f1ce4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 1 -- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f1ce40099c0 msgr2=0x7f1ce400bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:05:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f1ce40099c0 0x7f1ce400bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 10 monclient: _finish_hunting 0 2024-08-18T21:05:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 1 monclient: found mon.b 2024-08-18T21:05:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:05:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 1 -- 172.21.15.5:0/2324017040 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce4003530 con 0x7f1cf80a6ce0 2024-08-18T21:05:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 10 monclient: _finish_auth 0 2024-08-18T21:05:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 10 monclient: _check_auth_tickets 2024-08-18T21:05:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1ceffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cfdc91640 5 monclient: authenticate success, global_id 4816 2024-08-18T21:05:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cfdc91640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:05:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.562+0000 7f1cf7fff640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f1ce40099c0 0x7f1ce400bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:05:54.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.566+0000 7f1ceffff640 1 -- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 msgr2=0x7f1ce4004ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.566+0000 7f1ceffff640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1ce4004ed0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80129c0 tx=0x7f1ce801d150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6c180c238d53651 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cf6ffd640 1 -- 172.21.15.5:0/2324017040 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1ce80b3070 con 0x7f1cf80a6ce0 2024-08-18T21:05:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cf6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cf6ffd640 10 monclient: dump: 2024-08-18T21:05:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:54.579 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cf6ffd640 1 -- 172.21.15.5:0/2324017040 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce80ac780 con 0x7f1cf80a6ce0 2024-08-18T21:05:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:05:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cf6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 10 monclient: get_monmap_and_config success 2024-08-18T21:05:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cf6ffd640 1 -- 172.21.15.5:0/2324017040 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1ce800f040 con 0x7f1cf80a6ce0 2024-08-18T21:05:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 4 set_mon_vals no callback set 2024-08-18T21:05:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cf6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:05:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cf6ffd640 10 monclient: dump: 2024-08-18T21:05:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:54.581 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 10 monclient: shutdown 2024-08-18T21:05:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 1 -- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 msgr2=0x7f1ce4004ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 1 --2- 172.21.15.5:0/2324017040 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1cf80a6ce0 0x7f1ce4004ed0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80129c0 tx=0x7f1ce801d150 comp rx=0 tx=0).stop 2024-08-18T21:05:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cf7fff640 1 -- 172.21.15.5:0/2324017040 reap_dead start 2024-08-18T21:05:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 1 -- 172.21.15.5:0/2324017040 shutdown_connections 2024-08-18T21:05:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 1 -- 172.21.15.5:0/2324017040 >> 172.21.15.5:0/2324017040 conn(0x7f1cf80acbc0 msgr2=0x7f1cf80a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 1 -- 172.21.15.5:0/2324017040 shutdown_connections 2024-08-18T21:05:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 1 -- 172.21.15.5:0/2324017040 wait complete. 2024-08-18T21:05:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 10 monclient: build_initial_monmap 2024-08-18T21:05:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 10 monclient: monmap: 2024-08-18T21:05:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:05:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:05:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:05:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:05:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:05:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:54.583 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 1 Processor -- start 2024-08-18T21:05:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 1 -- start start 2024-08-18T21:05:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 10 monclient: init 2024-08-18T21:05:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 10 monclient: _add_conns ranks=[8,7,3,6,4,2,0,1,5] 2024-08-18T21:05:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1cf80a6ce0 0x7f1cf8122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 10 monclient(hunting): picked mon.noname-e con 0x7f1cf80a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:05:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1cf8122e70 0x7f1cf81232b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 10 monclient(hunting): picked mon.noname-i con 0x7f1cf8122e70 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cf81d19d0 0x7f1cf81d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 10 monclient(hunting): picked mon.noname-g con 0x7f1cf81d19d0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf80a79e0 con 0x7f1cf81d19d0 2024-08-18T21:05:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f1cf80a9810 con 0x7f1cf8122e70 2024-08-18T21:05:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f1cf81252a0 con 0x7f1cf80a6ce0 2024-08-18T21:05:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cfdc91640 10 monclient(hunting): authenticate will time out at 1121.587886s 2024-08-18T21:05:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.570+0000 7f1cf77fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1cf80a6ce0 0x7f1cf8122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf77fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1cf80a6ce0 0x7f1cf8122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:48536/0 (socket says 172.21.15.5:48536) 2024-08-18T21:05:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf77fe640 1 -- 172.21.15.5:0/4261227926 learned_addr learned my addr 172.21.15.5:0/4261227926 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf77fe640 10 monclient(hunting): get_auth_request con 0x7f1cf80a6ce0 auth_method 0 2024-08-18T21:05:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf77fe640 1 -- 172.21.15.5:0/4261227926 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1cf80a6ce0 msgr2=0x7f1cf8122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-18T21:05:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf77fe640 1 -- 172.21.15.5:0/4261227926 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1cf80a6ce0 msgr2=0x7f1cf8122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:05:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf77fe640 1 --2- 172.21.15.5:0/4261227926 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1cf80a6ce0 0x7f1cf8122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 1 --2- 172.21.15.5:0/4261227926 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1cf8122e70 0x7f1cf81232b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:54.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf77fe640 1 --2- 172.21.15.5:0/4261227926 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1cf80a6ce0 0x7f1cf8122930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:54.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 10 monclient(hunting): get_auth_request con 0x7f1cf8122e70 auth_method 0 2024-08-18T21:05:54.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:54.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:54.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:54.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf7fff640 1 --2- 172.21.15.5:0/4261227926 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cf81d19d0 0x7f1cf81d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:54.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf7fff640 10 monclient(hunting): get_auth_request con 0x7f1cf81d19d0 auth_method 0 2024-08-18T21:05:54.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:54.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:54.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:54.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:54.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:54.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:54.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:05:54.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:05:54.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:05:54.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 10 monclient(hunting): handle_auth_done global_id 4831 payload 824 2024-08-18T21:05:54.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 1 -- 172.21.15.5:0/4261227926 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1cf80a6ce0 msgr2=0x7f1cf8122930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:05:54.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 1 --2- 172.21.15.5:0/4261227926 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1cf80a6ce0 0x7f1cf8122930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:54.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 1 -- 172.21.15.5:0/4261227926 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cf81d19d0 msgr2=0x7f1cf81d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:54.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 1 --2- 172.21.15.5:0/4261227926 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cf81d19d0 0x7f1cf81d1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:54.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 10 monclient: _finish_hunting 0 2024-08-18T21:05:54.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 1 monclient: found mon.noname-i 2024-08-18T21:05:54.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:05:54.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:05:54.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 1 -- 172.21.15.5:0/4261227926 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf80a1d30 con 0x7f1cf8122e70 2024-08-18T21:05:54.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 1 -- 172.21.15.5:0/4261227926 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1cf8122e70 msgr2=0x7f1cf81232b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:05:54.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1ceffff640 1 --2- 172.21.15.5:0/4261227926 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1cf8122e70 0x7f1cf81232b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80b0000 tx=0x7f1ce8019ef0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:54.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf4ff9640 1 -- 172.21.15.5:0/4261227926 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1ce80b3070 con 0x7f1cf8122e70 2024-08-18T21:05:54.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:54.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf4ff9640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:05:54.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf4ff9640 10 monclient: dump: 2024-08-18T21:05:54.591 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:54.591 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:54.591 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:54.591 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:54.591 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:54.591 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:54.591 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:54.591 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:54.591 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:54.592 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf4ff9640 10 monclient: _finish_auth 0 2024-08-18T21:05:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf4ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:05:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:05:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cfdc91640 5 monclient: authenticate success, global_id 4831 2024-08-18T21:05:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf4ff9640 1 -- 172.21.15.5:0/4261227926 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce80b4040 con 0x7f1cf8122e70 2024-08-18T21:05:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf4ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:05:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf4ff9640 1 -- 172.21.15.5:0/4261227926 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1ce80ace10 con 0x7f1cf8122e70 2024-08-18T21:05:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:05:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf4ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:05:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf67fc640 4 set_mon_vals no callback set 2024-08-18T21:05:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.574+0000 7f1cf4ff9640 10 monclient: dump: 2024-08-18T21:05:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:05:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:05:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:05:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:05:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:05:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:05:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:05:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:05:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:05:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:05:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:05:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:05:54.594 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.578+0000 7f1cfdc91640 10 monclient: _renew_subs 2024-08-18T21:05:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.578+0000 7f1cfdc91640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:05:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.578+0000 7f1cfdc91640 1 -- 172.21.15.5:0/4261227926 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf80aa430 con 0x7f1cf8122e70 2024-08-18T21:05:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.578+0000 7f1cfdc91640 10 monclient: _renew_subs 2024-08-18T21:05:54.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.578+0000 7f1cfdc91640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:05:54.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.578+0000 7f1cfdc91640 1 -- 172.21.15.5:0/4261227926 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf80aa960 con 0x7f1cf8122e70 2024-08-18T21:05:54.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.578+0000 7f1cfdc91640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:54.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.578+0000 7f1cfdc91640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:54.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.578+0000 7f1cfdc91640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:05:54.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.578+0000 7f1cfdc91640 1 -- 172.21.15.5:0/4261227926 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf80a8220 con 0x7f1cf8122e70 2024-08-18T21:05:54.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.578+0000 7f1cf4ff9640 1 -- 172.21.15.5:0/4261227926 <== mon.7 v2:172.21.15.157:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f1ce80ae410 con 0x7f1cf8122e70 2024-08-18T21:05:54.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.578+0000 7f1cf4ff9640 1 --2- 172.21.15.5:0/4261227926 >> v2:172.21.15.157:6812/631023601 conn(0x7f1cd803bdc0 0x7f1cd803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:54.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.578+0000 7f1cf4ff9640 1 -- 172.21.15.5:0/4261227926 <== mon.7 v2:172.21.15.157:3303/0 5 ==== osd_map(72..72 src has 22..72) ==== 3506+0+0 (secure 0 0 0) 0x7f1ce80bd070 con 0x7f1cf8122e70 2024-08-18T21:05:54.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.578+0000 7f1cf77fe640 1 --2- 172.21.15.5:0/4261227926 >> v2:172.21.15.157:6812/631023601 conn(0x7f1cd803bdc0 0x7f1cd803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:54.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.578+0000 7f1cf77fe640 10 monclient: get_auth_request con 0x7f1cd803bdc0 auth_method 0 2024-08-18T21:05:54.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.582+0000 7f1cf77fe640 1 --2- 172.21.15.5:0/4261227926 >> v2:172.21.15.157:6812/631023601 conn(0x7f1cd803bdc0 0x7f1cd803e280 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00122d0 tx=0x7f1ce0008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:05:54.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.582+0000 7f1cf4ff9640 1 -- 172.21.15.5:0/4261227926 <== mon.7 v2:172.21.15.157:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f1cf80aa430 con 0x7f1cf8122e70 2024-08-18T21:05:54.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.582+0000 7f1cf4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:05:54.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.582+0000 7f1cf4ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:05:54.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.822+0000 7f1cfdc91640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:05:54.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.822+0000 7f1cfdc91640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:05:54.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.822+0000 7f1cfdc91640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:05:54.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.822+0000 7f1cfdc91640 1 -- 172.21.15.5:0/4261227926 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1cf8069580 con 0x7f1cf8122e70 2024-08-18T21:05:54.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cf4ff9640 1 -- 172.21.15.5:0/4261227926 <== mon.7 v2:172.21.15.157:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3166 (secure 0 0 0) 0x7f1ce80c6c70 con 0x7f1cf8122e70 2024-08-18T21:05:54.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cf4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:05:54.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cf4ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:05:54.828 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":46,"quorum":[0,1,2,3,4,5,7,8],"quorum_names":["a","f","b","g","c","h","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:05:54.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cfdc91640 1 -- 172.21.15.5:0/4261227926 >> v2:172.21.15.157:6812/631023601 conn(0x7f1cd803bdc0 msgr2=0x7f1cd803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:54.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cfdc91640 1 --2- 172.21.15.5:0/4261227926 >> v2:172.21.15.157:6812/631023601 conn(0x7f1cd803bdc0 0x7f1cd803e280 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00122d0 tx=0x7f1ce0008040 comp rx=0 tx=0).stop 2024-08-18T21:05:54.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cfdc91640 10 monclient: shutdown 2024-08-18T21:05:54.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cfdc91640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:05:54.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cfdc91640 1 -- 172.21.15.5:0/4261227926 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1cf8122e70 msgr2=0x7f1cf81232b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:05:54.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cfdc91640 1 --2- 172.21.15.5:0/4261227926 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1cf8122e70 0x7f1cf81232b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80b0000 tx=0x7f1ce8019ef0 comp rx=0 tx=0).stop 2024-08-18T21:05:54.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cfdc91640 1 -- 172.21.15.5:0/4261227926 shutdown_connections 2024-08-18T21:05:54.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cfdc91640 1 --2- 172.21.15.5:0/4261227926 >> v2:172.21.15.157:6812/631023601 conn(0x7f1cd803bdc0 0x7f1cd803e280 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:54.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cfdc91640 1 --2- 172.21.15.5:0/4261227926 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cf81d19d0 0x7f1cf81d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:54.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cfdc91640 1 --2- 172.21.15.5:0/4261227926 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1cf8122e70 0x7f1cf81232b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:54.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cfdc91640 1 --2- 172.21.15.5:0/4261227926 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1cf80a6ce0 0x7f1cf8122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:05:54.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cfdc91640 1 -- 172.21.15.5:0/4261227926 >> 172.21.15.5:0/4261227926 conn(0x7f1cf80acbc0 msgr2=0x7f1cf80a1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:05:54.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cfdc91640 1 -- 172.21.15.5:0/4261227926 shutdown_connections 2024-08-18T21:05:54.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:54.826+0000 7f1cfdc91640 1 -- 172.21.15.5:0/4261227926 wait complete. 2024-08-18T21:05:57.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:05:57.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 10 monclient: get_monmap_and_config 2024-08-18T21:05:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 10 monclient: build_initial_monmap 2024-08-18T21:05:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 10 monclient: monmap: 2024-08-18T21:05:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:05:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:05:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:05:57.981677+0000 2024-08-18T21:05:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:05:57.981677+0000 2024-08-18T21:05:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:05:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:05:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:05:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:05:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:05:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:05:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:05:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:05:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:05:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:05:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:05:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:05:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:05:57.982 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:05:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 1 Processor -- start 2024-08-18T21:05:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 1 -- start start 2024-08-18T21:05:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 10 monclient: init 2024-08-18T21:05:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 10 monclient: _reopen_session rank -1 2024-08-18T21:05:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 10 monclient: _add_conns ranks=[5,7,3,6,8,4,2,1,0,9,10] 2024-08-18T21:05:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 0x7fe0500a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 10 monclient(hunting): picked mon.noname-h con 0x7fe05006c950 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:05:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 0x7fe05006d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 10 monclient(hunting): picked mon.noname-i con 0x7fe05006cd30 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:05:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 0x7fe050137af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:05:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 10 monclient(hunting): picked mon.noname-g con 0x7fe0501376b0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:05:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe0500a11c0 con 0x7fe0501376b0 2024-08-18T21:05:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe0500a0890 con 0x7fe05006c950 2024-08-18T21:05:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:05:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fe0500a0e50 con 0x7fe05006cd30 2024-08-18T21:05:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 10 monclient(hunting): _renew_subs 2024-08-18T21:05:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe0584a5640 10 monclient(hunting): authenticate will time out at 1124.995247s 2024-08-18T21:05:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe056a42640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 0x7fe050137af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe055a40640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 0x7fe05006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe056241640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 0x7fe0500a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe055a40640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 0x7fe05006d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:45952/0 (socket says 172.21.15.5:45952) 2024-08-18T21:05:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe056241640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 0x7fe0500a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:43380/0 (socket says 172.21.15.5:43380) 2024-08-18T21:05:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe055a40640 1 -- 172.21.15.5:0/3098840631 learned_addr learned my addr 172.21.15.5:0/3098840631 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:05:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe055a40640 10 monclient(hunting): get_auth_request con 0x7fe05006cd30 auth_method 0 2024-08-18T21:05:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe055a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe055a40640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe055a40640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:57.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe056a42640 10 monclient(hunting): get_auth_request con 0x7fe0501376b0 auth_method 0 2024-08-18T21:05:57.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe056a42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:57.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe056a42640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:57.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe056a42640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:57.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe056241640 10 monclient(hunting): get_auth_request con 0x7fe05006c950 auth_method 0 2024-08-18T21:05:57.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe056241640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:57.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe056241640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:57.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe056241640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:05:57.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe055a40640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 msgr2=0x7fe05006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:05:57.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe055a40640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 msgr2=0x7fe05006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:57.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe056241640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 msgr2=0x7fe0500a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:57.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe055a40640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 0x7fe05006d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:57.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe056241640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 msgr2=0x7fe0500a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:57.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.978+0000 7fe056241640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 0x7fe0500a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:57.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.982+0000 7fe056a42640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 msgr2=0x7fe050137af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:05:57.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.982+0000 7fe056a42640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 msgr2=0x7fe050137af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:57.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.982+0000 7fe056a42640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 0x7fe050137af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:57.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.982+0000 7fe056241640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 0x7fe0500a4c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:57.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.982+0000 7fe055a40640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 0x7fe05006d110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:57.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:57.982+0000 7fe056a42640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 0x7fe050137af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:05:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056241640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 0x7fe0500a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe055a40640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 0x7fe05006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056a42640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 0x7fe050137af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056241640 10 monclient(hunting): get_auth_request con 0x7fe05006c950 auth_method 0 2024-08-18T21:05:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056241640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056241640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056241640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056a42640 10 monclient(hunting): get_auth_request con 0x7fe0501376b0 auth_method 0 2024-08-18T21:05:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056a42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056a42640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056a42640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe055a40640 10 monclient(hunting): get_auth_request con 0x7fe05006cd30 auth_method 0 2024-08-18T21:05:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe055a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe055a40640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe055a40640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056241640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 msgr2=0x7fe0500a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056241640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 msgr2=0x7fe0500a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056241640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 0x7fe0500a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056a42640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 msgr2=0x7fe050137af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:05:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056a42640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 msgr2=0x7fe050137af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056a42640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 0x7fe050137af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056241640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 0x7fe0500a4c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:05:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe056a42640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 0x7fe050137af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:05:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe055a40640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 msgr2=0x7fe05006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:05:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe055a40640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 msgr2=0x7fe05006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe055a40640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 0x7fe05006d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.186+0000 7fe055a40640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 0x7fe05006d110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:05:58.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056241640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 0x7fe0500a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:58.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056a42640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 0x7fe050137af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:58.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056241640 10 monclient(hunting): get_auth_request con 0x7fe05006c950 auth_method 0 2024-08-18T21:05:58.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056241640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056241640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056241640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056a42640 10 monclient(hunting): get_auth_request con 0x7fe0501376b0 auth_method 0 2024-08-18T21:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056a42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056a42640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056a42640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe055a40640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 0x7fe05006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe055a40640 10 monclient(hunting): get_auth_request con 0x7fe05006cd30 auth_method 0 2024-08-18T21:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe055a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe055a40640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe055a40640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056241640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 msgr2=0x7fe0500a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056241640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 msgr2=0x7fe0500a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056241640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 0x7fe0500a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:58.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056a42640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 msgr2=0x7fe050137af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:05:58.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056a42640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 msgr2=0x7fe050137af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:58.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056a42640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 0x7fe050137af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:58.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056241640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 0x7fe0500a4c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:05:58.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe056a42640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 0x7fe050137af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:05:58.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe055a40640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 msgr2=0x7fe05006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:05:58.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe055a40640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 msgr2=0x7fe05006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:58.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe055a40640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 0x7fe05006d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:58.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:58.590+0000 7fe055a40640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 0x7fe05006d110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056a42640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 0x7fe050137af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056241640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 0x7fe0500a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056a42640 10 monclient(hunting): get_auth_request con 0x7fe0501376b0 auth_method 0 2024-08-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056a42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056a42640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056a42640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056241640 10 monclient(hunting): get_auth_request con 0x7fe05006c950 auth_method 0 2024-08-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056241640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056241640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056241640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe055a40640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 0x7fe05006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe055a40640 10 monclient(hunting): get_auth_request con 0x7fe05006cd30 auth_method 0 2024-08-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe055a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe055a40640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe055a40640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056a42640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 msgr2=0x7fe050137af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056a42640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 msgr2=0x7fe050137af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056241640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 msgr2=0x7fe0500a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056a42640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 0x7fe050137af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056241640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 msgr2=0x7fe0500a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056241640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 0x7fe0500a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056241640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 0x7fe0500a4c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe056a42640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 0x7fe050137af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe055a40640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 msgr2=0x7fe05006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe055a40640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 msgr2=0x7fe05006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe055a40640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 0x7fe05006d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:05:59.394+0000 7fe055a40640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 0x7fe05006d110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:06:00.843 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28750]: starting. 2024-08-18T21:06:00.843 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28750]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28749 2024-08-18T21:06:00.843 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28750]: created object 0... 2024-08-18T21:06:00.843 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28750]: created object 25... 2024-08-18T21:06:00.843 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28750]: created object 49... 2024-08-18T21:06:00.843 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28750]: finishing. 2024-08-18T21:06:00.843 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28750]: shutting down. 2024-08-18T21:06:00.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 10 monclient(hunting): tick 2024-08-18T21:06:00.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:06:00.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 1 monclient(hunting): continuing hunt 2024-08-18T21:06:00.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:06:00.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 msgr2=0x7fe05006d110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:06:00.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe05006cd30 0x7fe05006d110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:00.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 msgr2=0x7fe0500a4c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:06:00.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe05006c950 0x7fe0500a4c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:00.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 msgr2=0x7fe050137af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:06:00.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0501376b0 0x7fe050137af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:00.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 10 monclient: _add_conns ranks=[2,6,9,0,10,4,1,8] 2024-08-18T21:06:00.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe03c003810 0x7fe03c005c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:00.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 10 monclient(hunting): picked mon.noname-b con 0x7fe03c003810 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:00.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe03c006220 0x7fe03c0086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:00.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 10 monclient(hunting): picked mon.noname-d con 0x7fe03c006220 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:00.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 1 --2- 172.21.15.5:0/3098840631 >> v2:172.21.15.5:3300/0 conn(0x7fe03c008d30 0x7fe03c00b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:00.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 10 monclient(hunting): picked mon.noname-a con 0x7fe03c008d30 addr v2:172.21.15.5:3300/0 2024-08-18T21:06:00.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:00.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 1 -- 172.21.15.5:0/3098840631 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe0500a11c0 con 0x7fe03c008d30 2024-08-18T21:06:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 1 -- 172.21.15.5:0/3098840631 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fe0500a0890 con 0x7fe03c003810 2024-08-18T21:06:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 1 -- 172.21.15.5:0/3098840631 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fe0500a0e50 con 0x7fe03c006220 2024-08-18T21:06:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe047fff640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe03c003810 0x7fe03c005c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe055a40640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe03c006220 0x7fe03c0086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056a42640 1 --2- 172.21.15.5:0/3098840631 >> v2:172.21.15.5:3300/0 conn(0x7fe03c008d30 0x7fe03c00b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 10 monclient(hunting): get_auth_request con 0x7fe03c003810 auth_method 0 2024-08-18T21:06:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056a42640 10 monclient(hunting): get_auth_request con 0x7fe03c008d30 auth_method 0 2024-08-18T21:06:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056a42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056a42640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056a42640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe055a40640 10 monclient(hunting): get_auth_request con 0x7fe03c006220 auth_method 0 2024-08-18T21:06:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe055a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe055a40640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe055a40640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056a42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056a42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056a42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe055a40640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe03c006220 msgr2=0x7fe03c0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:06:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe055a40640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe03c006220 msgr2=0x7fe03c0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe055a40640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe03c006220 0x7fe03c0086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe055a40640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe03c006220 0x7fe03c0086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:06:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 10 monclient(hunting): handle_auth_done global_id 5051 payload 274 2024-08-18T21:06:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe03c006220 msgr2=0x7fe03c0086b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:06:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe03c006220 0x7fe03c0086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 1 -- 172.21.15.5:0/3098840631 >> v2:172.21.15.5:3300/0 conn(0x7fe03c008d30 msgr2=0x7fe03c00b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 1 --2- 172.21.15.5:0/3098840631 >> v2:172.21.15.5:3300/0 conn(0x7fe03c008d30 0x7fe03c00b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 10 monclient: _finish_hunting 0 2024-08-18T21:06:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 1 monclient: found mon.noname-b 2024-08-18T21:06:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:06:00.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056241640 1 -- 172.21.15.5:0/3098840631 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0500a0b70 con 0x7fe03c003810 2024-08-18T21:06:00.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056a42640 1 --2- 172.21.15.5:0/3098840631 >> v2:172.21.15.5:3300/0 conn(0x7fe03c008d30 0x7fe03c00b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:06:00.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.982+0000 7fe056a42640 1 -- 172.21.15.5:0/3098840631 reap_dead start 2024-08-18T21:06:00.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe056241640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe03c003810 msgr2=0x7fe03c005c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:00.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe056241640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe03c003810 0x7fe03c005c40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe04c000ee0 tx=0x7fe04c01cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d371f96af197434f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:00.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe05523f640 1 -- 172.21.15.5:0/3098840631 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe04c00f040 con 0x7fe03c003810 2024-08-18T21:06:00.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe05523f640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:00.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe05523f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:06:00.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe05523f640 10 monclient: dump: 2024-08-18T21:06:00.993 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:00.993 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:00.993 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:00.993 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:00.993 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:00.994 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:00.994 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:00.994 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:00.994 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:00.994 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:00.994 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:00.997 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:00.997 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:00.998 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:00.998 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:00.998 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:00.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe05523f640 10 monclient: _finish_auth 0 2024-08-18T21:06:00.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe05523f640 10 monclient: _check_auth_tickets 2024-08-18T21:06:00.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe05523f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:00.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe05523f640 1 -- 172.21.15.5:0/3098840631 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c0b1070 con 0x7fe03c003810 2024-08-18T21:06:00.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe05523f640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:00.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe05523f640 1 -- 172.21.15.5:0/3098840631 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe04c0accd0 con 0x7fe03c003810 2024-08-18T21:06:00.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe05523f640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:00.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe05523f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:06:00.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe05523f640 10 monclient: dump: 2024-08-18T21:06:00.999 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:00.999 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:00.999 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:00.999 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:00.999 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:00.999 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:00.999 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:00.999 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:00.999 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:00.999 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:00.999 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:00.999 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:00.999 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:01.000 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:01.000 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:01.000 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:01.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe0584a5640 5 monclient: authenticate success, global_id 5051 2024-08-18T21:06:01.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe0584a5640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:01.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe0584a5640 4 set_mon_vals no callback set 2024-08-18T21:06:01.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe0584a5640 10 monclient: shutdown 2024-08-18T21:06:01.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe0584a5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:01.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe0584a5640 1 -- 172.21.15.5:0/3098840631 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe03c003810 msgr2=0x7fe03c005c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:01.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe0584a5640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe03c003810 0x7fe03c005c40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe04c000ee0 tx=0x7fe04c01cdb0 comp rx=0 tx=0).stop 2024-08-18T21:06:01.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe0584a5640 1 -- 172.21.15.5:0/3098840631 shutdown_connections 2024-08-18T21:06:01.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe0584a5640 1 --2- 172.21.15.5:0/3098840631 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe03c003810 0x7fe03c005c40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:01.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe0584a5640 1 -- 172.21.15.5:0/3098840631 >> 172.21.15.5:0/3098840631 conn(0x7fe0500688d0 msgr2=0x7fe050068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe0584a5640 1 -- 172.21.15.5:0/3098840631 shutdown_connections 2024-08-18T21:06:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.990+0000 7fe0584a5640 1 -- 172.21.15.5:0/3098840631 wait complete. 2024-08-18T21:06:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 10 monclient: build_initial_monmap 2024-08-18T21:06:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 10 monclient: monmap: 2024-08-18T21:06:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:01.007 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:01.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 1 Processor -- start 2024-08-18T21:06:01.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 1 -- start start 2024-08-18T21:06:01.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 10 monclient: init 2024-08-18T21:06:01.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:01.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 10 monclient: _add_conns ranks=[3,8,2,0,1,4,6,7,5] 2024-08-18T21:06:01.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe03c003810 0x7fe050136710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:01.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 10 monclient(hunting): picked mon.noname-g con 0x7fe03c003810 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:06:01.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe050136c50 0x7fe0501221b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:01.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 10 monclient(hunting): picked mon.noname-e con 0x7fe050136c50 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe0501226f0 0x7fe050122b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 10 monclient(hunting): picked mon.noname-b con 0x7fe0501226f0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fe05013b700 con 0x7fe0501226f0 2024-08-18T21:06:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe05013b580 con 0x7fe03c003810 2024-08-18T21:06:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fe05013b880 con 0x7fe050136c50 2024-08-18T21:06:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe0584a5640 10 monclient(hunting): authenticate will time out at 1128.010493s 2024-08-18T21:06:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe0501226f0 0x7fe050122b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe055a40640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe050136c50 0x7fe0501221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe0501226f0 0x7fe050122b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59774/0 (socket says 172.21.15.5:59774) 2024-08-18T21:06:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 1 -- 172.21.15.5:0/179820056 learned_addr learned my addr 172.21.15.5:0/179820056 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 10 monclient(hunting): get_auth_request con 0x7fe0501226f0 auth_method 0 2024-08-18T21:06:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe055a40640 10 monclient(hunting): get_auth_request con 0x7fe050136c50 auth_method 0 2024-08-18T21:06:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe055a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe055a40640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe055a40640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056241640 1 --2- 172.21.15.5:0/179820056 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe03c003810 0x7fe050136710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056241640 10 monclient(hunting): get_auth_request con 0x7fe03c003810 auth_method 0 2024-08-18T21:06:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056241640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056241640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056241640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe055a40640 1 -- 172.21.15.5:0/179820056 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe050136c50 msgr2=0x7fe0501221b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-18T21:06:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe055a40640 1 -- 172.21.15.5:0/179820056 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe050136c50 msgr2=0x7fe0501221b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:06:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe055a40640 1 --2- 172.21.15.5:0/179820056 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe050136c50 0x7fe0501221b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe055a40640 1 --2- 172.21.15.5:0/179820056 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe050136c50 0x7fe0501221b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:06:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056241640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056241640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056241640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 10 monclient(hunting): handle_auth_done global_id 5060 payload 824 2024-08-18T21:06:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 1 -- 172.21.15.5:0/179820056 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe050136c50 msgr2=0x7fe0501221b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:06:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 1 --2- 172.21.15.5:0/179820056 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe050136c50 0x7fe0501221b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 1 -- 172.21.15.5:0/179820056 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe03c003810 msgr2=0x7fe050136710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 1 --2- 172.21.15.5:0/179820056 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe03c003810 0x7fe050136710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 10 monclient: _finish_hunting 0 2024-08-18T21:06:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 1 monclient: found mon.noname-b 2024-08-18T21:06:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:06:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.994+0000 7fe056a42640 1 -- 172.21.15.5:0/179820056 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe050137410 con 0x7fe0501226f0 2024-08-18T21:06:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe056a42640 1 -- 172.21.15.5:0/179820056 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe0501226f0 msgr2=0x7fe050122b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe056a42640 1 --2- 172.21.15.5:0/179820056 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe0501226f0 0x7fe050122b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00b890 tx=0x7fe048016710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe046ffd640 1 -- 172.21.15.5:0/179820056 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe04801c070 con 0x7fe0501226f0 2024-08-18T21:06:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe046ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe046ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:06:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe046ffd640 10 monclient: dump: 2024-08-18T21:06:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:01.014 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe046ffd640 10 monclient: _finish_auth 0 2024-08-18T21:06:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe046ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:06:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe046ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe046ffd640 1 -- 172.21.15.5:0/179820056 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0480218d0 con 0x7fe0501226f0 2024-08-18T21:06:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe046ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe046ffd640 1 -- 172.21.15.5:0/179820056 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe048018420 con 0x7fe0501226f0 2024-08-18T21:06:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe046ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe046ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:06:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe046ffd640 10 monclient: dump: 2024-08-18T21:06:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:01.016 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe054a3e640 4 set_mon_vals no callback set 2024-08-18T21:06:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe0584a5640 5 monclient: authenticate success, global_id 5060 2024-08-18T21:06:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe0584a5640 10 monclient: _renew_subs 2024-08-18T21:06:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe0584a5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:06:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe0584a5640 1 -- 172.21.15.5:0/179820056 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0500a2850 con 0x7fe0501226f0 2024-08-18T21:06:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe0584a5640 10 monclient: _renew_subs 2024-08-18T21:06:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe0584a5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:06:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe0584a5640 1 -- 172.21.15.5:0/179820056 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe050125e30 con 0x7fe0501226f0 2024-08-18T21:06:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe0584a5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe0584a5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe0584a5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:06:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe046ffd640 1 -- 172.21.15.5:0/179820056 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe048015040 con 0x7fe0501226f0 2024-08-18T21:06:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe0584a5640 1 -- 172.21.15.5:0/179820056 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe05013ba00 con 0x7fe0501226f0 2024-08-18T21:06:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe046ffd640 1 --2- 172.21.15.5:0/179820056 >> v2:172.21.15.157:6812/631023601 conn(0x7fe03c03d010 0x7fe03c03f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:00.998+0000 7fe046ffd640 1 -- 172.21.15.5:0/179820056 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(74..74 src has 22..74) ==== 3898+0+0 (secure 0 0 0) 0x7fe048012040 con 0x7fe0501226f0 2024-08-18T21:06:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.002+0000 7fe056241640 1 --2- 172.21.15.5:0/179820056 >> v2:172.21.15.157:6812/631023601 conn(0x7fe03c03d010 0x7fe03c03f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.002+0000 7fe056241640 10 monclient: get_auth_request con 0x7fe03c03d010 auth_method 0 2024-08-18T21:06:01.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.002+0000 7fe056241640 1 --2- 172.21.15.5:0/179820056 >> v2:172.21.15.157:6812/631023601 conn(0x7fe03c03d010 0x7fe03c03f4d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0ad000 tx=0x7fe04c0b7040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:01.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.006+0000 7fe046ffd640 1 -- 172.21.15.5:0/179820056 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fe048028020 con 0x7fe0501226f0 2024-08-18T21:06:01.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.006+0000 7fe046ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:01.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.006+0000 7fe046ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.246+0000 7fe0584a5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:06:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.246+0000 7fe0584a5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:06:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.246+0000 7fe0584a5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:06:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.246+0000 7fe0584a5640 1 -- 172.21.15.5:0/179820056 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe050124630 con 0x7fe0501226f0 2024-08-18T21:06:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe046ffd640 1 -- 172.21.15.5:0/179820056 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3166 (secure 0 0 0) 0x7fe04801f360 con 0x7fe0501226f0 2024-08-18T21:06:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe046ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:06:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe046ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:01.252 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":54,"quorum":[0,1,2,3,4,5,7,8],"quorum_names":["a","f","b","g","c","h","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:06:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe0584a5640 1 -- 172.21.15.5:0/179820056 >> v2:172.21.15.157:6812/631023601 conn(0x7fe03c03d010 msgr2=0x7fe03c03f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe0584a5640 1 --2- 172.21.15.5:0/179820056 >> v2:172.21.15.157:6812/631023601 conn(0x7fe03c03d010 0x7fe03c03f4d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0ad000 tx=0x7fe04c0b7040 comp rx=0 tx=0).stop 2024-08-18T21:06:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe0584a5640 10 monclient: shutdown 2024-08-18T21:06:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe0584a5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe0584a5640 1 -- 172.21.15.5:0/179820056 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe0501226f0 msgr2=0x7fe050122b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe0584a5640 1 --2- 172.21.15.5:0/179820056 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe0501226f0 0x7fe050122b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00b890 tx=0x7fe048016710 comp rx=0 tx=0).stop 2024-08-18T21:06:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe0584a5640 1 -- 172.21.15.5:0/179820056 shutdown_connections 2024-08-18T21:06:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe0584a5640 1 --2- 172.21.15.5:0/179820056 >> v2:172.21.15.157:6812/631023601 conn(0x7fe03c03d010 0x7fe03c03f4d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe0584a5640 1 --2- 172.21.15.5:0/179820056 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe0501226f0 0x7fe050122b50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe0584a5640 1 --2- 172.21.15.5:0/179820056 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe050136c50 0x7fe0501221b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe0584a5640 1 --2- 172.21.15.5:0/179820056 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe03c003810 0x7fe050136710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe0584a5640 1 -- 172.21.15.5:0/179820056 >> 172.21.15.5:0/179820056 conn(0x7fe0500688d0 msgr2=0x7fe0500a7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe0584a5640 1 -- 172.21.15.5:0/179820056 shutdown_connections 2024-08-18T21:06:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:01.250+0000 7fe0584a5640 1 -- 172.21.15.5:0/179820056 wait complete. 2024-08-18T21:06:04.272 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 10 monclient: get_monmap_and_config 2024-08-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 10 monclient: build_initial_monmap 2024-08-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 10 monclient: monmap: 2024-08-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:04.405959+0000 2024-08-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:04.405959+0000 2024-08-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 1 Processor -- start 2024-08-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 1 -- start start 2024-08-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 10 monclient: init 2024-08-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 10 monclient: _add_conns ranks=[1,0,2,9,8,4,6,3,10,5,7] 2024-08-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f98e00a6ce0 addr v1:172.21.15.157:6789/0 2024-08-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f98e00a77d0 addr v1:172.21.15.5:6789/0 2024-08-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 0x7f98e01427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 10 monclient(hunting): picked mon.noname-b con 0x7f98e0140400 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98e00a45d0 con 0x7f98e00a77d0 2024-08-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98e00a32d0 con 0x7f98e00a6ce0 2024-08-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f98e00a5000 con 0x7f98e0140400 2024-08-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e6778640 10 monclient(hunting): authenticate will time out at 1131.419172s 2024-08-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e4d15640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 0x7f98e01427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e4d15640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 0x7f98e01427f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34284/0 (socket says 172.21.15.5:34284) 2024-08-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e4d15640 1 -- 172.21.15.5:0/1260363841 learned_addr learned my addr 172.21.15.5:0/1260363841 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e4d15640 10 monclient(hunting): get_auth_request con 0x7f98e0140400 auth_method 0 2024-08-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e4d15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e4d15640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e4d15640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e4d15640 1 -- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 msgr2=0x7f98e01427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e4d15640 1 -- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 msgr2=0x7f98e01427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e4d15640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 0x7f98e01427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.402+0000 7f98e4d15640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 0x7f98e01427f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:06:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.406+0000 7f98df7fe640 1 -- 172.21.15.5:0/1260363841 >> v1:172.21.15.5:6789/0 conn(0x7f98e00a77d0 legacy=0x7f98e013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.406+0000 7f98dffff640 1 -- 172.21.15.5:0/1260363841 >> v1:172.21.15.157:6789/0 conn(0x7f98e00a6ce0 legacy=0x7f98e00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.406+0000 7f98dffff640 1 -- 172.21.15.5:0/1260363841 >> v1:172.21.15.157:6789/0 conn(0x7f98e00a6ce0 legacy=0x7f98e00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-08-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.406+0000 7f98dffff640 1 -- 172.21.15.5:0/1260363841 >> v1:172.21.15.157:6789/0 conn(0x7f98e00a6ce0 legacy=0x7f98e00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.406+0000 7f98dffff640 1 --1- 172.21.15.5:0/1260363841 >> v1:172.21.15.157:6789/0 conn(0x7f98e00a6ce0 0x7f98e00a70c0 :-1 s=OPENED pgs=166 cs=1 l=1).handle_message read tag failed 2024-08-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.406+0000 7f98dffff640 1 --1- 172.21.15.5:0/1260363841 >> v1:172.21.15.157:6789/0 conn(0x7f98e00a6ce0 0x7f98e00a70c0 :-1 s=OPENED pgs=166 cs=1 l=1).fault on lossy channel, failing 2024-08-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.406+0000 7f98deffd640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.157:6789/0 2024-08-18T21:06:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.606+0000 7f98e4d15640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 0x7f98e01427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.606+0000 7f98e4d15640 10 monclient(hunting): get_auth_request con 0x7f98e0140400 auth_method 0 2024-08-18T21:06:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.606+0000 7f98e4d15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.606+0000 7f98e4d15640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.606+0000 7f98e4d15640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.606+0000 7f98e4d15640 1 -- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 msgr2=0x7f98e01427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:06:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.606+0000 7f98e4d15640 1 -- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 msgr2=0x7f98e01427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.606+0000 7f98e4d15640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 0x7f98e01427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:04.606+0000 7f98e4d15640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 0x7f98e01427f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:06:05.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.010+0000 7f98e4d15640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 0x7f98e01427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.010+0000 7f98e4d15640 10 monclient(hunting): get_auth_request con 0x7f98e0140400 auth_method 0 2024-08-18T21:06:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.010+0000 7f98e4d15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.010+0000 7f98e4d15640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.010+0000 7f98e4d15640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.010+0000 7f98e4d15640 1 -- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 msgr2=0x7f98e01427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:06:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.010+0000 7f98e4d15640 1 -- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 msgr2=0x7f98e01427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.010+0000 7f98e4d15640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 0x7f98e01427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.010+0000 7f98e4d15640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 0x7f98e01427f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:06:05.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.814+0000 7f98e4d15640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 0x7f98e01427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:05.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.814+0000 7f98e4d15640 10 monclient(hunting): get_auth_request con 0x7f98e0140400 auth_method 0 2024-08-18T21:06:05.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.814+0000 7f98e4d15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:05.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.814+0000 7f98e4d15640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:05.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.814+0000 7f98e4d15640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:05.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.814+0000 7f98e4d15640 1 -- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 msgr2=0x7f98e01427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:06:05.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.814+0000 7f98e4d15640 1 -- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 msgr2=0x7f98e01427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:05.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.814+0000 7f98e4d15640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 0x7f98e01427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:05.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:05.814+0000 7f98e4d15640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 0x7f98e01427f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:06:06.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.566+0000 7f98deffd640 1 -- 172.21.15.5:0/1260363841 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2051496880 0 0) 0x7f98e00a45d0 con 0x7f98e00a77d0 2024-08-18T21:06:06.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.566+0000 7f98deffd640 10 monclient(hunting): _negotiate 2024-08-18T21:06:06.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.566+0000 7f98deffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:06.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.566+0000 7f98deffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:06.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.566+0000 7f98deffd640 10 monclient(hunting): my global_id is 5022 2024-08-18T21:06:06.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.566+0000 7f98deffd640 1 -- 172.21.15.5:0/1260363841 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98cc003530 con 0x7f98e00a77d0 2024-08-18T21:06:06.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 1 -- 172.21.15.5:0/1260363841 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1031699508 0 0) 0x7f98cc003530 con 0x7f98e00a77d0 2024-08-18T21:06:06.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 1 -- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 msgr2=0x7f98e01427f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:06:06.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0140400 0x7f98e01427f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:06.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 1 -- 172.21.15.5:0/1260363841 >> v1:172.21.15.157:6789/0 conn(0x7f98e00a6ce0 legacy=0x7f98e00a70c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:06.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 10 monclient: _finish_hunting 0 2024-08-18T21:06:06.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 1 monclient: found mon.noname-a-legacy 2024-08-18T21:06:06.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:06.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.5:6789/0 2024-08-18T21:06:06.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 1 -- 172.21.15.5:0/1260363841 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e00a8900 con 0x7f98e00a77d0 2024-08-18T21:06:06.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 10 monclient: _finish_auth 0 2024-08-18T21:06:06.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 10 monclient: _check_auth_tickets 2024-08-18T21:06:06.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:06.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 1 -- 172.21.15.5:0/1260363841 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 4141550541 0 0) 0x7f98c8001ff0 con 0x7f98e00a77d0 2024-08-18T21:06:06.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:06.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-08-18T21:06:06.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 10 monclient: dump: 2024-08-18T21:06:06.578 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:06.578 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:06.578 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:06.579 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:06.579 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:06.579 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:06.579 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:06.579 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:06.579 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:06.579 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:06.579 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:06.579 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:06.579 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:06.579 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:06.579 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:06.579 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:06.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] but i'm connected to v1:172.21.15.5:6789/0, reconnecting 2024-08-18T21:06:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 1 -- 172.21.15.5:0/1260363841 >> v1:172.21.15.5:6789/0 conn(0x7f98e00a77d0 legacy=0x7f98e013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 10 monclient: _add_conns ranks=[7,5,6,4,3,1,0,2,8] 2024-08-18T21:06:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f98cc004210 0x7f98cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 10 monclient(hunting): picked mon.i con 0x7f98cc004210 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f98cc004e70 0x7f98cc0099c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 10 monclient(hunting): picked mon.h con 0x7f98cc004e70 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98cc009f00 0x7f98cc00c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.570+0000 7f98deffd640 10 monclient(hunting): picked mon.d con 0x7f98cc009f00 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98deffd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98deffd640 1 -- 172.21.15.5:0/1260363841 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f98cc00ca10 con 0x7f98cc004e70 2024-08-18T21:06:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98deffd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98deffd640 1 -- 172.21.15.5:0/1260363841 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f98cc00cbc0 con 0x7f98cc009f00 2024-08-18T21:06:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98deffd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98deffd640 1 -- 172.21.15.5:0/1260363841 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f98cc00cd70 con 0x7f98cc004210 2024-08-18T21:06:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98deffd640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98deffd640 10 monclient(hunting): _finish_auth 0 2024-08-18T21:06:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98e4d15640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98cc009f00 0x7f98cc00c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98e4d15640 10 monclient(hunting): get_auth_request con 0x7f98cc009f00 auth_method 0 2024-08-18T21:06:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98e4d15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98e4d15640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98e4d15640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f98cc004210 0x7f98cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98df7fe640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f98cc004e70 0x7f98cc0099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98e4d15640 1 -- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98cc009f00 msgr2=0x7f98cc00c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:06:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 10 monclient(hunting): get_auth_request con 0x7f98cc004210 auth_method 0 2024-08-18T21:06:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98e4d15640 1 -- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98cc009f00 msgr2=0x7f98cc00c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98e4d15640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98cc009f00 0x7f98cc00c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98df7fe640 10 monclient(hunting): get_auth_request con 0x7f98cc004e70 auth_method 0 2024-08-18T21:06:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98df7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98df7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98e4d15640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98cc009f00 0x7f98cc00c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:06:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:06:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98df7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98df7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:06.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98df7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:06:06.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 10 monclient(hunting): handle_auth_done global_id 5022 payload 293 2024-08-18T21:06:06.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 1 -- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98cc009f00 msgr2=0x7f98cc00c2f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:06:06.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98cc009f00 0x7f98cc00c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:06.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 1 -- 172.21.15.5:0/1260363841 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f98cc004e70 msgr2=0x7f98cc0099c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:06.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f98cc004e70 0x7f98cc0099c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:06.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 10 monclient: _finish_hunting 0 2024-08-18T21:06:06.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 1 monclient: found mon.i 2024-08-18T21:06:06.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:06.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98e4d15640 1 -- 172.21.15.5:0/1260363841 reap_dead start 2024-08-18T21:06:06.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:06:06.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 1 -- 172.21.15.5:0/1260363841 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98cc003530 con 0x7f98cc004210 2024-08-18T21:06:06.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 10 monclient: _finish_auth 0 2024-08-18T21:06:06.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 10 monclient: _check_auth_tickets 2024-08-18T21:06:06.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98dffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:06.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98e6778640 5 monclient: authenticate success, global_id 5022 2024-08-18T21:06:06.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98e6778640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:06:06.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.574+0000 7f98df7fe640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f98cc004e70 0x7f98cc0099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:06:06.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.578+0000 7f98dffff640 1 -- 172.21.15.5:0/1260363841 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f98cc004210 msgr2=0x7f98cc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:06.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98dffff640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f98cc004210 0x7f98cc004810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f98d0001540 tx=0x7f98d001c770 comp rx=0 tx=0).ready entity=mon.7 client_cookie=7e3e63c96b1abe7c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:06.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98deffd640 1 -- 172.21.15.5:0/1260363841 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f98d00ad070 con 0x7f98cc004210 2024-08-18T21:06:06.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:06.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98deffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:06:06.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98deffd640 10 monclient: dump: 2024-08-18T21:06:06.586 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:06.586 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:06.586 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:06.586 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:06.586 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:06.586 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:06.586 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:06.586 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:06.586 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:06.586 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:06.586 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:06.586 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:06.586 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:06.587 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98deffd640 1 -- 172.21.15.5:0/1260363841 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d00074e0 con 0x7f98cc004210 2024-08-18T21:06:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98deffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98deffd640 1 -- 172.21.15.5:0/1260363841 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f98d00079b0 con 0x7f98cc004210 2024-08-18T21:06:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98e6778640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98e6778640 4 set_mon_vals no callback set 2024-08-18T21:06:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98deffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:06:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98deffd640 10 monclient: dump: 2024-08-18T21:06:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:06.588 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98e6778640 10 monclient: shutdown 2024-08-18T21:06:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98e6778640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98e6778640 1 -- 172.21.15.5:0/1260363841 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f98cc004210 msgr2=0x7f98cc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98e6778640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f98cc004210 0x7f98cc004810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f98d0001540 tx=0x7f98d001c770 comp rx=0 tx=0).stop 2024-08-18T21:06:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98e6778640 1 -- 172.21.15.5:0/1260363841 shutdown_connections 2024-08-18T21:06:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98e6778640 1 --2- 172.21.15.5:0/1260363841 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f98cc004210 0x7f98cc004810 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98e6778640 1 -- 172.21.15.5:0/1260363841 >> 172.21.15.5:0/1260363841 conn(0x7f98e00acbc0 msgr2=0x7f98e00a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98e6778640 1 -- 172.21.15.5:0/1260363841 shutdown_connections 2024-08-18T21:06:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.582+0000 7f98e6778640 1 -- 172.21.15.5:0/1260363841 wait complete. 2024-08-18T21:06:06.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 10 monclient: build_initial_monmap 2024-08-18T21:06:06.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 10 monclient: monmap: 2024-08-18T21:06:06.591 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:06.593 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 1 Processor -- start 2024-08-18T21:06:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 1 -- start start 2024-08-18T21:06:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 10 monclient: init 2024-08-18T21:06:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 10 monclient: _add_conns ranks=[0,2,7,3,1,6,4,5,8] 2024-08-18T21:06:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98cc004210 0x7f98e0137af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 10 monclient(hunting): picked mon.noname-a con 0x7f98cc004210 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:06:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0138850 0x7f98e0122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 10 monclient(hunting): picked mon.noname-b con 0x7f98e0138850 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f98e0138030 0x7f98e0122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 10 monclient(hunting): picked mon.noname-i con 0x7f98e0138030 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f98e00a7650 con 0x7f98cc004210 2024-08-18T21:06:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f98e00a74d0 con 0x7f98e0138850 2024-08-18T21:06:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f98e00a8220 con 0x7f98e0138030 2024-08-18T21:06:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e6778640 10 monclient(hunting): authenticate will time out at 1133.602975s 2024-08-18T21:06:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98cc004210 0x7f98e0137af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98df7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0138850 0x7f98e0122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98cc004210 0x7f98e0137af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40618/0 (socket says 172.21.15.5:40618) 2024-08-18T21:06:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 1 -- 172.21.15.5:0/3448260480 learned_addr learned my addr 172.21.15.5:0/3448260480 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 10 monclient(hunting): get_auth_request con 0x7f98cc004210 auth_method 0 2024-08-18T21:06:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98df7fe640 10 monclient(hunting): get_auth_request con 0x7f98e0138850 auth_method 0 2024-08-18T21:06:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98df7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98df7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e4d15640 1 --2- 172.21.15.5:0/3448260480 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f98e0138030 0x7f98e0122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98df7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98df7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98df7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e4d15640 10 monclient(hunting): get_auth_request con 0x7f98e0138030 auth_method 0 2024-08-18T21:06:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e4d15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e4d15640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e4d15640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e4d15640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e4d15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98e4d15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 10 monclient(hunting): handle_auth_done global_id 5031 payload 824 2024-08-18T21:06:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 1 -- 172.21.15.5:0/3448260480 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f98e0138030 msgr2=0x7f98e0122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 1 --2- 172.21.15.5:0/3448260480 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f98e0138030 0x7f98e0122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 1 -- 172.21.15.5:0/3448260480 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0138850 msgr2=0x7f98e0122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 1 --2- 172.21.15.5:0/3448260480 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0138850 0x7f98e0122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 10 monclient: _finish_hunting 0 2024-08-18T21:06:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 1 monclient: found mon.noname-a 2024-08-18T21:06:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:06:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.586+0000 7f98dffff640 1 -- 172.21.15.5:0/3448260480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e00aa1e0 con 0x7f98cc004210 2024-08-18T21:06:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98dffff640 1 -- 172.21.15.5:0/3448260480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98cc004210 msgr2=0x7f98e0137af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98dffff640 1 --2- 172.21.15.5:0/3448260480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98cc004210 0x7f98e0137af0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f98d001d010 tx=0x7f98cc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98dcff9640 1 -- 172.21.15.5:0/3448260480 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f98d00ad070 con 0x7f98cc004210 2024-08-18T21:06:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98dcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98dcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:06:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98dcff9640 10 monclient: dump: 2024-08-18T21:06:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:06.600 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:06.600 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:06.600 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:06.600 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:06.600 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:06.600 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:06.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98dcff9640 10 monclient: _finish_auth 0 2024-08-18T21:06:06.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98dcff9640 10 monclient: _check_auth_tickets 2024-08-18T21:06:06.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98dcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:06.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98dcff9640 1 -- 172.21.15.5:0/3448260480 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d00b8070 con 0x7f98cc004210 2024-08-18T21:06:06.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98e6778640 5 monclient: authenticate success, global_id 5031 2024-08-18T21:06:06.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98e6778640 10 monclient: _renew_subs 2024-08-18T21:06:06.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98e6778640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:06:06.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98e6778640 1 -- 172.21.15.5:0/3448260480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98e00aa5a0 con 0x7f98cc004210 2024-08-18T21:06:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98dcff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98dcff9640 1 -- 172.21.15.5:0/3448260480 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f98d00079b0 con 0x7f98cc004210 2024-08-18T21:06:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98dcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98dcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:06:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98dcff9640 10 monclient: dump: 2024-08-18T21:06:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:06.602 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98de7fc640 4 set_mon_vals no callback set 2024-08-18T21:06:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98e6778640 10 monclient: _renew_subs 2024-08-18T21:06:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98e6778640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:06:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98e6778640 1 -- 172.21.15.5:0/3448260480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98e0124a60 con 0x7f98cc004210 2024-08-18T21:06:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98e6778640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98e6778640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98e6778640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:06:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.590+0000 7f98e6778640 1 -- 172.21.15.5:0/3448260480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98e0125c00 con 0x7f98cc004210 2024-08-18T21:06:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.594+0000 7f98dcff9640 1 -- 172.21.15.5:0/3448260480 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f98d00059e0 con 0x7f98cc004210 2024-08-18T21:06:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.594+0000 7f98dcff9640 1 --2- 172.21.15.5:0/3448260480 >> v2:172.21.15.157:6812/631023601 conn(0x7f98c003bdc0 0x7f98c003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.594+0000 7f98dcff9640 1 -- 172.21.15.5:0/3448260480 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 22..74) ==== 3898+0+0 (secure 0 0 0) 0x7f98d00e8320 con 0x7f98cc004210 2024-08-18T21:06:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.594+0000 7f98df7fe640 1 --2- 172.21.15.5:0/3448260480 >> v2:172.21.15.157:6812/631023601 conn(0x7f98c003bdc0 0x7f98c003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.594+0000 7f98df7fe640 10 monclient: get_auth_request con 0x7f98c003bdc0 auth_method 0 2024-08-18T21:06:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.594+0000 7f98df7fe640 1 --2- 172.21.15.5:0/3448260480 >> v2:172.21.15.157:6812/631023601 conn(0x7f98c003bdc0 0x7f98c003e280 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f98c80014a0 tx=0x7f98c8001f20 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.598+0000 7f98dcff9640 1 -- 172.21.15.5:0/3448260480 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f98d00164d0 con 0x7f98cc004210 2024-08-18T21:06:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.598+0000 7f98dcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.598+0000 7f98dcff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:06.856 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28751]: starting. 2024-08-18T21:06:06.856 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28751]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28749 2024-08-18T21:06:06.856 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28751]: shutting down. 2024-08-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.862+0000 7f98e6778640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.862+0000 7f98e6778640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.862+0000 7f98e6778640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.862+0000 7f98e6778640 1 -- 172.21.15.5:0/3448260480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f98e013a2b0 con 0x7f98cc004210 2024-08-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.862+0000 7f98dcff9640 1 -- 172.21.15.5:0/3448260480 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3166 (secure 0 0 0) 0x7f98d0005cd0 con 0x7f98cc004210 2024-08-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.862+0000 7f98dcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.862+0000 7f98dcff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":58,"quorum":[0,1,2,3,4,5,7,8],"quorum_names":["a","f","b","g","c","h","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:06:06.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.866+0000 7f98e6778640 1 -- 172.21.15.5:0/3448260480 >> v2:172.21.15.157:6812/631023601 conn(0x7f98c003bdc0 msgr2=0x7f98c003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:06.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.866+0000 7f98e6778640 1 --2- 172.21.15.5:0/3448260480 >> v2:172.21.15.157:6812/631023601 conn(0x7f98c003bdc0 0x7f98c003e280 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f98c80014a0 tx=0x7f98c8001f20 comp rx=0 tx=0).stop 2024-08-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.866+0000 7f98e6778640 10 monclient: shutdown 2024-08-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.866+0000 7f98e6778640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.866+0000 7f98e6778640 1 -- 172.21.15.5:0/3448260480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98cc004210 msgr2=0x7f98e0137af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.866+0000 7f98e6778640 1 --2- 172.21.15.5:0/3448260480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98cc004210 0x7f98e0137af0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f98d001d010 tx=0x7f98cc005840 comp rx=0 tx=0).stop 2024-08-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.866+0000 7f98e6778640 1 -- 172.21.15.5:0/3448260480 shutdown_connections 2024-08-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.866+0000 7f98e6778640 1 --2- 172.21.15.5:0/3448260480 >> v2:172.21.15.157:6812/631023601 conn(0x7f98c003bdc0 0x7f98c003e280 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.866+0000 7f98e6778640 1 --2- 172.21.15.5:0/3448260480 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f98e0138850 0x7f98e0122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.866+0000 7f98e6778640 1 --2- 172.21.15.5:0/3448260480 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f98e0138030 0x7f98e0122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.866+0000 7f98e6778640 1 --2- 172.21.15.5:0/3448260480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98cc004210 0x7f98e0137af0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.866+0000 7f98e6778640 1 -- 172.21.15.5:0/3448260480 >> 172.21.15.5:0/3448260480 conn(0x7f98e00acbc0 msgr2=0x7f98e0138ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.866+0000 7f98e6778640 1 -- 172.21.15.5:0/3448260480 shutdown_connections 2024-08-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:06.866+0000 7f98e6778640 1 -- 172.21.15.5:0/3448260480 wait complete. 2024-08-18T21:06:09.089 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:09.089 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28784]: starting. 2024-08-18T21:06:09.089 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28784]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28749 2024-08-18T21:06:09.089 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28784]: created object 0... 2024-08-18T21:06:09.089 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28784]: created object 25... 2024-08-18T21:06:09.090 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28784]: created object 49... 2024-08-18T21:06:09.090 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28784]: finishing. 2024-08-18T21:06:09.090 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28784]: shutting down. 2024-08-18T21:06:09.238 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:09.238 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28786]: starting. 2024-08-18T21:06:09.238 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28786]: listing objects. 2024-08-18T21:06:09.238 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28786]: listed object 0... 2024-08-18T21:06:09.238 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28786]: listed object 25... 2024-08-18T21:06:09.238 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28786]: saw 50 objects 2024-08-18T21:06:09.238 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28786]: shutting down. 2024-08-18T21:06:09.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 10 monclient: get_monmap_and_config 2024-08-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 10 monclient: build_initial_monmap 2024-08-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 10 monclient: monmap: 2024-08-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:10.022009+0000 2024-08-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:10.022009+0000 2024-08-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:10.023 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 1 Processor -- start 2024-08-18T21:06:10.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 1 -- start start 2024-08-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 10 monclient: init 2024-08-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 10 monclient: _add_conns ranks=[5,7,2,4,1,3,8,6,10,9,0] 2024-08-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74a00a6ce0 0x7f74a00a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 10 monclient(hunting): picked mon.noname-h con 0x7f74a00a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f74a00a7600 0x7f74a0139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 10 monclient(hunting): picked mon.noname-i con 0x7f74a00a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f74a0139fe0 0x7f74a013a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 10 monclient(hunting): picked mon.noname-b con 0x7f74a0139fe0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f74a00a5000 con 0x7f74a0139fe0 2024-08-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f74a00a4360 con 0x7f74a00a6ce0 2024-08-18T21:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f74a00a45d0 con 0x7f74a00a7600 2024-08-18T21:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f74a5506640 10 monclient(hunting): authenticate will time out at 1137.035210s 2024-08-18T21:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f74a0139fe0 0x7f74a013a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f74a0139fe0 0x7f74a013a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34336/0 (socket says 172.21.15.5:34336) 2024-08-18T21:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 1 -- 172.21.15.5:0/4165971659 learned_addr learned my addr 172.21.15.5:0/4165971659 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 10 monclient(hunting): get_auth_request con 0x7f74a0139fe0 auth_method 0 2024-08-18T21:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749e7fc640 1 --2- 172.21.15.5:0/4165971659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f74a00a7600 0x7f74a0139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 10 monclient(hunting): handle_auth_done global_id 5096 payload 274 2024-08-18T21:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 1 -- 172.21.15.5:0/4165971659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f74a00a7600 msgr2=0x7f74a0139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 1 --2- 172.21.15.5:0/4165971659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f74a00a7600 0x7f74a0139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749effd640 1 --2- 172.21.15.5:0/4165971659 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74a00a6ce0 0x7f74a00a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 1 -- 172.21.15.5:0/4165971659 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74a00a6ce0 msgr2=0x7f74a00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 1 --2- 172.21.15.5:0/4165971659 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74a00a6ce0 0x7f74a00a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 1 monclient: found mon.noname-b 2024-08-18T21:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749f7fe640 1 -- 172.21.15.5:0/4165971659 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a00a32d0 con 0x7f74a0139fe0 2024-08-18T21:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749e7fc640 10 monclient: get_auth_request con 0x7f74a00a7600 auth_method 0 2024-08-18T21:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749e7fc640 1 --2- 172.21.15.5:0/4165971659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f74a00a7600 0x7f74a0139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749effd640 10 monclient: get_auth_request con 0x7f74a00a6ce0 auth_method 0 2024-08-18T21:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.018+0000 7f749effd640 1 --2- 172.21.15.5:0/4165971659 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74a00a6ce0 0x7f74a00a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749f7fe640 1 -- 172.21.15.5:0/4165971659 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f74a0139fe0 msgr2=0x7f74a013a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749f7fe640 1 --2- 172.21.15.5:0/4165971659 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f74a0139fe0 0x7f74a013a440 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f74980098d0 tx=0x7f749801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=256c22e927230fe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749dffb640 1 -- 172.21.15.5:0/4165971659 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f74980b0070 con 0x7f74a0139fe0 2024-08-18T21:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749dffb640 10 monclient: dump: 2024-08-18T21:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749dffb640 10 monclient: _finish_auth 0 2024-08-18T21:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749dffb640 10 monclient: _check_auth_tickets 2024-08-18T21:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 5 monclient: authenticate success, global_id 5096 2024-08-18T21:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749dffb640 1 -- 172.21.15.5:0/4165971659 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74980aa810 con 0x7f74a0139fe0 2024-08-18T21:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749dffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 4 set_mon_vals no callback set 2024-08-18T21:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749dffb640 1 -- 172.21.15.5:0/4165971659 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f74980aae30 con 0x7f74a0139fe0 2024-08-18T21:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:06:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749dffb640 10 monclient: dump: 2024-08-18T21:06:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.036 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 10 monclient: shutdown 2024-08-18T21:06:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 -- 172.21.15.5:0/4165971659 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f74a0139fe0 msgr2=0x7f74a013a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 --2- 172.21.15.5:0/4165971659 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f74a0139fe0 0x7f74a013a440 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f74980098d0 tx=0x7f749801c440 comp rx=0 tx=0).stop 2024-08-18T21:06:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 -- 172.21.15.5:0/4165971659 shutdown_connections 2024-08-18T21:06:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 --2- 172.21.15.5:0/4165971659 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f74a0139fe0 0x7f74a013a440 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 --2- 172.21.15.5:0/4165971659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f74a00a7600 0x7f74a0139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 --2- 172.21.15.5:0/4165971659 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74a00a6ce0 0x7f74a00a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 -- 172.21.15.5:0/4165971659 >> 172.21.15.5:0/4165971659 conn(0x7f74a00acbc0 msgr2=0x7f74a00a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 -- 172.21.15.5:0/4165971659 shutdown_connections 2024-08-18T21:06:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 -- 172.21.15.5:0/4165971659 wait complete. 2024-08-18T21:06:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 10 monclient: build_initial_monmap 2024-08-18T21:06:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 10 monclient: monmap: 2024-08-18T21:06:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:10.038 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 Processor -- start 2024-08-18T21:06:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 -- start start 2024-08-18T21:06:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 10 monclient: init 2024-08-18T21:06:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:10.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 10 monclient: _add_conns ranks=[4,1,5,2,3,0,8,6,7] 2024-08-18T21:06:10.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f74a00a6ce0 0x7f74a0134db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 10 monclient(hunting): picked mon.noname-c con 0x7f74a00a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:10.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74a00a7600 0x7f74a01352f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 10 monclient(hunting): picked mon.noname-f con 0x7f74a00a7600 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:06:10.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74a0139fe0 0x7f74a013aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 10 monclient(hunting): picked mon.noname-h con 0x7f74a0139fe0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:10.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f74a00a79e0 con 0x7f74a00a7600 2024-08-18T21:06:10.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f74a00a8220 con 0x7f74a00a6ce0 2024-08-18T21:06:10.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f74a013e560 con 0x7f74a0139fe0 2024-08-18T21:06:10.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:10.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f74a5506640 10 monclient(hunting): authenticate will time out at 1137.042604s 2024-08-18T21:06:10.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f74a00a6ce0 0x7f74a0134db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f74a00a6ce0 0x7f74a0134db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:60262/0 (socket says 172.21.15.5:60262) 2024-08-18T21:06:10.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 1 -- 172.21.15.5:0/831626217 learned_addr learned my addr 172.21.15.5:0/831626217 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:10.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 10 monclient(hunting): get_auth_request con 0x7f74a00a6ce0 auth_method 0 2024-08-18T21:06:10.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749e7fc640 1 --2- 172.21.15.5:0/831626217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74a00a7600 0x7f74a01352f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 10 monclient(hunting): handle_auth_done global_id 5026 payload 824 2024-08-18T21:06:10.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749f7fe640 1 --2- 172.21.15.5:0/831626217 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74a0139fe0 0x7f74a013aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 1 -- 172.21.15.5:0/831626217 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74a0139fe0 msgr2=0x7f74a013aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 1 --2- 172.21.15.5:0/831626217 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74a0139fe0 0x7f74a013aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 1 -- 172.21.15.5:0/831626217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74a00a7600 msgr2=0x7f74a01352f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 1 --2- 172.21.15.5:0/831626217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74a00a7600 0x7f74a01352f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 10 monclient: _finish_hunting 0 2024-08-18T21:06:10.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 1 monclient: found mon.noname-c 2024-08-18T21:06:10.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:10.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:06:10.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749effd640 1 -- 172.21.15.5:0/831626217 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a00aa300 con 0x7f74a00a6ce0 2024-08-18T21:06:10.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749f7fe640 10 monclient: get_auth_request con 0x7f74a0139fe0 auth_method 0 2024-08-18T21:06:10.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.026+0000 7f749f7fe640 1 --2- 172.21.15.5:0/831626217 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74a0139fe0 0x7f74a013aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:06:10.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f749effd640 1 -- 172.21.15.5:0/831626217 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f74a00a6ce0 msgr2=0x7f74a0134db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:10.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f749effd640 1 --2- 172.21.15.5:0/831626217 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f74a00a6ce0 0x7f74a0134db0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f749000c7c0 tx=0x7f749000cc80 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74877fe640 1 -- 172.21.15.5:0/831626217 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7490015070 con 0x7f74a00a6ce0 2024-08-18T21:06:10.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74877fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:06:10.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74877fe640 10 monclient: dump: 2024-08-18T21:06:10.044 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.044 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.044 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.044 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.044 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.044 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.044 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.045 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.045 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.045 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.045 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.045 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.045 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.045 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.045 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.045 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74877fe640 10 monclient: _finish_auth 0 2024-08-18T21:06:10.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74877fe640 10 monclient: _check_auth_tickets 2024-08-18T21:06:10.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:10.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74877fe640 1 -- 172.21.15.5:0/831626217 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74900113f0 con 0x7f74a00a6ce0 2024-08-18T21:06:10.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74877fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:10.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74877fe640 1 -- 172.21.15.5:0/831626217 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7490011a10 con 0x7f74a00a6ce0 2024-08-18T21:06:10.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74877fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:10.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74877fe640 10 monclient: dump: 2024-08-18T21:06:10.046 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.046 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.046 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.046 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.046 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.046 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.047 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74a5506640 5 monclient: authenticate success, global_id 5026 2024-08-18T21:06:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74a5506640 10 monclient: _renew_subs 2024-08-18T21:06:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74a5506640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:06:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74a5506640 1 -- 172.21.15.5:0/831626217 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a013a570 con 0x7f74a00a6ce0 2024-08-18T21:06:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f749cff9640 4 set_mon_vals no callback set 2024-08-18T21:06:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74a5506640 10 monclient: _renew_subs 2024-08-18T21:06:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74a5506640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:06:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74a5506640 1 -- 172.21.15.5:0/831626217 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a013df10 con 0x7f74a00a6ce0 2024-08-18T21:06:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74a5506640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74a5506640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74a5506640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:06:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74877fe640 1 -- 172.21.15.5:0/831626217 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f7490018070 con 0x7f74a00a6ce0 2024-08-18T21:06:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74a5506640 1 -- 172.21.15.5:0/831626217 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74a0139aa0 con 0x7f74a00a6ce0 2024-08-18T21:06:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74877fe640 1 --2- 172.21.15.5:0/831626217 >> v2:172.21.15.157:6812/631023601 conn(0x7f748c03bdc0 0x7f748c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f74877fe640 1 -- 172.21.15.5:0/831626217 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(77..77 src has 22..77) ==== 3898+0+0 (secure 0 0 0) 0x7f749004e5c0 con 0x7f74a00a6ce0 2024-08-18T21:06:10.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f749e7fc640 1 --2- 172.21.15.5:0/831626217 >> v2:172.21.15.157:6812/631023601 conn(0x7f748c03bdc0 0x7f748c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.030+0000 7f749e7fc640 10 monclient: get_auth_request con 0x7f748c03bdc0 auth_method 0 2024-08-18T21:06:10.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.034+0000 7f749e7fc640 1 --2- 172.21.15.5:0/831626217 >> v2:172.21.15.157:6812/631023601 conn(0x7f748c03bdc0 0x7f748c03e280 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f74a00a2850 tx=0x7f7494008460 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.034+0000 7f74877fe640 1 -- 172.21.15.5:0/831626217 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f74a00aa300 con 0x7f74a00a6ce0 2024-08-18T21:06:10.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.034+0000 7f74877fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:10.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.034+0000 7f74877fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.278+0000 7f74a5506640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:06:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.278+0000 7f74a5506640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:06:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.278+0000 7f74a5506640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:06:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.278+0000 7f74a5506640 1 -- 172.21.15.5:0/831626217 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f74a0069580 con 0x7f74a00a6ce0 2024-08-18T21:06:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.278+0000 7f74877fe640 1 -- 172.21.15.5:0/831626217 <== mon.4 v2:172.21.15.5:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3172 (secure 0 0 0) 0x7f7490010350 con 0x7f74a00a6ce0 2024-08-18T21:06:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.278+0000 7f74877fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:06:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.278+0000 7f74877fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:10.281 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":60,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:06:10.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.282+0000 7f74a5506640 1 -- 172.21.15.5:0/831626217 >> v2:172.21.15.157:6812/631023601 conn(0x7f748c03bdc0 msgr2=0x7f748c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.282+0000 7f74a5506640 1 --2- 172.21.15.5:0/831626217 >> v2:172.21.15.157:6812/631023601 conn(0x7f748c03bdc0 0x7f748c03e280 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f74a00a2850 tx=0x7f7494008460 comp rx=0 tx=0).stop 2024-08-18T21:06:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.282+0000 7f74a5506640 10 monclient: shutdown 2024-08-18T21:06:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.282+0000 7f74a5506640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.282+0000 7f74a5506640 1 -- 172.21.15.5:0/831626217 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f74a00a6ce0 msgr2=0x7f74a0134db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.282+0000 7f74a5506640 1 --2- 172.21.15.5:0/831626217 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f74a00a6ce0 0x7f74a0134db0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f749000c7c0 tx=0x7f749000cc80 comp rx=0 tx=0).stop 2024-08-18T21:06:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.282+0000 7f74a5506640 1 -- 172.21.15.5:0/831626217 shutdown_connections 2024-08-18T21:06:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.282+0000 7f74a5506640 1 --2- 172.21.15.5:0/831626217 >> v2:172.21.15.157:6812/631023601 conn(0x7f748c03bdc0 0x7f748c03e280 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.282+0000 7f74a5506640 1 --2- 172.21.15.5:0/831626217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74a00a7600 0x7f74a01352f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.282+0000 7f74a5506640 1 --2- 172.21.15.5:0/831626217 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f74a0139fe0 0x7f74a013aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.282+0000 7f74a5506640 1 --2- 172.21.15.5:0/831626217 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f74a00a6ce0 0x7f74a0134db0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.282+0000 7f74a5506640 1 -- 172.21.15.5:0/831626217 >> 172.21.15.5:0/831626217 conn(0x7f74a00acbc0 msgr2=0x7f74a0135c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.282+0000 7f74a5506640 1 -- 172.21.15.5:0/831626217 shutdown_connections 2024-08-18T21:06:10.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.282+0000 7f74a5506640 1 -- 172.21.15.5:0/831626217 wait complete. 2024-08-18T21:06:10.300 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:06:10.300 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:06:10.300 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:06:10.394 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:10.395 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28785]: starting. 2024-08-18T21:06:10.395 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28785]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28749 2024-08-18T21:06:10.395 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28785]: shutting down. 2024-08-18T21:06:10.396 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:10.396 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:10.396 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:06:10.398 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:06:10.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 10 monclient: get_monmap_and_config 2024-08-18T21:06:10.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 10 monclient: build_initial_monmap 2024-08-18T21:06:10.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 10 monclient: monmap: 2024-08-18T21:06:10.432 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:10.432 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.432 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:10.433540+0000 2024-08-18T21:06:10.432 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:10.433540+0000 2024-08-18T21:06:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:10.434 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 1 Processor -- start 2024-08-18T21:06:10.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 1 -- start start 2024-08-18T21:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 10 monclient: init 2024-08-18T21:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 10 monclient: _add_conns ranks=[5,2,4,10,9,0,1,3,7,8,6] 2024-08-18T21:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd35806c950 0x7fd3580a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 10 monclient(hunting): picked mon.noname-h con 0x7fd35806c950 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd3580a1b60 0x7fd35806cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 10 monclient(hunting): picked mon.noname-b con 0x7fd3580a1b60 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd35806d270 0x7fd3581376b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 10 monclient(hunting): picked mon.noname-c con 0x7fd35806d270 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fd3580a11a0 con 0x7fd3580a1b60 2024-08-18T21:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fd35809fdd0 con 0x7fd35806d270 2024-08-18T21:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fd3580a0ec0 con 0x7fd35806c950 2024-08-18T21:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd35d522640 10 monclient(hunting): authenticate will time out at 1137.446648s 2024-08-18T21:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd34ffff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd3580a1b60 0x7fd35806cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd35806d270 0x7fd3581376b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd35806d270 0x7fd3581376b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:60268/0 (socket says 172.21.15.5:60268) 2024-08-18T21:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd356ffd640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd35806c950 0x7fd3580a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 1 -- 172.21.15.5:0/2395299001 learned_addr learned my addr 172.21.15.5:0/2395299001 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 10 monclient(hunting): get_auth_request con 0x7fd35806d270 auth_method 0 2024-08-18T21:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd34ffff640 10 monclient(hunting): get_auth_request con 0x7fd3580a1b60 auth_method 0 2024-08-18T21:06:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd34ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd34ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd34ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd356ffd640 10 monclient(hunting): get_auth_request con 0x7fd35806c950 auth_method 0 2024-08-18T21:06:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd356ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd356ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd356ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd356ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd356ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd356ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 10 monclient(hunting): handle_auth_done global_id 5035 payload 274 2024-08-18T21:06:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 1 -- 172.21.15.5:0/2395299001 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd35806c950 msgr2=0x7fd3580a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 1 --2- 172.21.15.5:0/2395299001 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd35806c950 0x7fd3580a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 1 -- 172.21.15.5:0/2395299001 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd3580a1b60 msgr2=0x7fd35806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 1 --2- 172.21.15.5:0/2395299001 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd3580a1b60 0x7fd35806cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 10 monclient: _finish_hunting 0 2024-08-18T21:06:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 1 monclient: found mon.noname-c 2024-08-18T21:06:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:06:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd3577fe640 1 -- 172.21.15.5:0/2395299001 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3580699c0 con 0x7fd35806d270 2024-08-18T21:06:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.430+0000 7fd34ffff640 1 --2- 172.21.15.5:0/2395299001 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd3580a1b60 0x7fd35806cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:06:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd3577fe640 1 -- 172.21.15.5:0/2395299001 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd35806d270 msgr2=0x7fd3581376b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd3577fe640 1 --2- 172.21.15.5:0/2395299001 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd35806d270 0x7fd3581376b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd350009e80 tx=0x7fd35001c650 comp rx=0 tx=0).ready entity=mon.4 client_cookie=a30f6bac0690d82b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd3567fc640 1 -- 172.21.15.5:0/2395299001 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd3500090d0 con 0x7fd35806d270 2024-08-18T21:06:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd3567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd3567fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:06:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd3567fc640 10 monclient: dump: 2024-08-18T21:06:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.445 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd3567fc640 10 monclient: _finish_auth 0 2024-08-18T21:06:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd3567fc640 10 monclient: _check_auth_tickets 2024-08-18T21:06:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd3567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd35d522640 5 monclient: authenticate success, global_id 5035 2024-08-18T21:06:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd3567fc640 1 -- 172.21.15.5:0/2395299001 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3500ae070 con 0x7fd35806d270 2024-08-18T21:06:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd35d522640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:06:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd3567fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd35d522640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd35d522640 4 set_mon_vals no callback set 2024-08-18T21:06:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd3567fc640 1 -- 172.21.15.5:0/2395299001 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd3500a9d30 con 0x7fd35806d270 2024-08-18T21:06:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd3567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd3567fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.434+0000 7fd3567fc640 10 monclient: dump: 2024-08-18T21:06:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.447 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 10 monclient: shutdown 2024-08-18T21:06:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 -- 172.21.15.5:0/2395299001 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd35806d270 msgr2=0x7fd3581376b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 --2- 172.21.15.5:0/2395299001 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd35806d270 0x7fd3581376b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd350009e80 tx=0x7fd35001c650 comp rx=0 tx=0).stop 2024-08-18T21:06:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 -- 172.21.15.5:0/2395299001 shutdown_connections 2024-08-18T21:06:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 --2- 172.21.15.5:0/2395299001 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd3580a1b60 0x7fd35806cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 --2- 172.21.15.5:0/2395299001 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd35806d270 0x7fd3581376b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 --2- 172.21.15.5:0/2395299001 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd35806c950 0x7fd3580a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 -- 172.21.15.5:0/2395299001 >> 172.21.15.5:0/2395299001 conn(0x7fd3580688d0 msgr2=0x7fd358068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 -- 172.21.15.5:0/2395299001 shutdown_connections 2024-08-18T21:06:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 -- 172.21.15.5:0/2395299001 wait complete. 2024-08-18T21:06:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 10 monclient: build_initial_monmap 2024-08-18T21:06:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 10 monclient: monmap: 2024-08-18T21:06:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:10.450 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 Processor -- start 2024-08-18T21:06:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 -- start start 2024-08-18T21:06:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 10 monclient: init 2024-08-18T21:06:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 10 monclient: _add_conns ranks=[3,1,7,2,6,8,5,0,4] 2024-08-18T21:06:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd35806c950 0x7fd3581340e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 10 monclient(hunting): picked mon.noname-g con 0x7fd35806c950 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:06:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd35806d270 0x7fd358134620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 10 monclient(hunting): picked mon.noname-f con 0x7fd35806d270 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:06:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd35813c980 0x7fd35813aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 10 monclient(hunting): picked mon.noname-i con 0x7fd35813c980 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd35813f6b0 con 0x7fd35806d270 2024-08-18T21:06:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd35813f530 con 0x7fd35806c950 2024-08-18T21:06:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fd35813f830 con 0x7fd35813c980 2024-08-18T21:06:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd35d522640 10 monclient(hunting): authenticate will time out at 1137.454103s 2024-08-18T21:06:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd35806c950 0x7fd3581340e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd3577fe640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd35813c980 0x7fd35813aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd35806c950 0x7fd3581340e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:56830/0 (socket says 172.21.15.5:56830) 2024-08-18T21:06:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd3577fe640 1 --2- 172.21.15.5:0/1175511512 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd35813c980 0x7fd35813aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:46156/0 (socket says 172.21.15.5:46156) 2024-08-18T21:06:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 1 -- 172.21.15.5:0/1175511512 learned_addr learned my addr 172.21.15.5:0/1175511512 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 10 monclient(hunting): get_auth_request con 0x7fd35806c950 auth_method 0 2024-08-18T21:06:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd3577fe640 10 monclient(hunting): get_auth_request con 0x7fd35813c980 auth_method 0 2024-08-18T21:06:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd3577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd3577fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd3577fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd34ffff640 1 --2- 172.21.15.5:0/1175511512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd35806d270 0x7fd358134620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd34ffff640 10 monclient(hunting): get_auth_request con 0x7fd35806d270 auth_method 0 2024-08-18T21:06:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd34ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd34ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd34ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd34ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd34ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd34ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd3577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd3577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd3577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 10 monclient(hunting): handle_auth_done global_id 5025 payload 824 2024-08-18T21:06:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 1 -- 172.21.15.5:0/1175511512 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd35813c980 msgr2=0x7fd35813aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 1 --2- 172.21.15.5:0/1175511512 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd35813c980 0x7fd35813aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 1 -- 172.21.15.5:0/1175511512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd35806d270 msgr2=0x7fd358134620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 1 --2- 172.21.15.5:0/1175511512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd35806d270 0x7fd358134620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:06:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 1 monclient: found mon.noname-g 2024-08-18T21:06:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:06:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.438+0000 7fd356ffd640 1 -- 172.21.15.5:0/1175511512 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35811f9d0 con 0x7fd35806c950 2024-08-18T21:06:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd356ffd640 1 -- 172.21.15.5:0/1175511512 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd35806c950 msgr2=0x7fd3581340e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd356ffd640 1 --2- 172.21.15.5:0/1175511512 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd35806c950 0x7fd3581340e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd34000e930 tx=0x7fd34000edf0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34f7fe640 1 -- 172.21.15.5:0/1175511512 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd340017070 con 0x7fd35806c950 2024-08-18T21:06:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34f7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:06:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34f7fe640 10 monclient: dump: 2024-08-18T21:06:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.459 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34f7fe640 10 monclient: _finish_auth 0 2024-08-18T21:06:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34f7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:06:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34f7fe640 1 -- 172.21.15.5:0/1175511512 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd34000cc10 con 0x7fd35806c950 2024-08-18T21:06:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34f7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34f7fe640 1 -- 172.21.15.5:0/1175511512 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd34000cdc0 con 0x7fd35806c950 2024-08-18T21:06:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34f7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:06:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34f7fe640 10 monclient: dump: 2024-08-18T21:06:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.461 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd35d522640 5 monclient: authenticate success, global_id 5025 2024-08-18T21:06:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd355ffb640 4 set_mon_vals no callback set 2024-08-18T21:06:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd35d522640 10 monclient: _renew_subs 2024-08-18T21:06:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd35d522640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.157:3301/0 2024-08-18T21:06:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd35d522640 1 -- 172.21.15.5:0/1175511512 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd35811fcb0 con 0x7fd35806c950 2024-08-18T21:06:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd35d522640 10 monclient: _renew_subs 2024-08-18T21:06:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd35d522640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.157:3301/0 2024-08-18T21:06:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd35d522640 1 -- 172.21.15.5:0/1175511512 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd35811f6f0 con 0x7fd35806c950 2024-08-18T21:06:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd35d522640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd35d522640 1 --2- 172.21.15.5:0/1175511512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580a1b60 0x7fd35813af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd35d522640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd35d522640 1 -- 172.21.15.5:0/1175511512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd35813ce00 con 0x7fd3580a1b60 2024-08-18T21:06:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34f7fe640 1 -- 172.21.15.5:0/1175511512 <== mon.3 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fd34001a070 con 0x7fd35806c950 2024-08-18T21:06:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34ffff640 1 --2- 172.21.15.5:0/1175511512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580a1b60 0x7fd35813af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34ffff640 10 monclient: get_auth_request con 0x7fd3580a1b60 auth_method 0 2024-08-18T21:06:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34f7fe640 1 --2- 172.21.15.5:0/1175511512 >> v2:172.21.15.157:6812/631023601 conn(0x7fd33803bdc0 0x7fd33803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34f7fe640 1 -- 172.21.15.5:0/1175511512 <== mon.3 v2:172.21.15.157:3301/0 5 ==== osd_map(78..78 src has 22..78) ==== 3506+0+0 (secure 0 0 0) 0x7fd34000f040 con 0x7fd35806c950 2024-08-18T21:06:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd3577fe640 1 --2- 172.21.15.5:0/1175511512 >> v2:172.21.15.157:6812/631023601 conn(0x7fd33803bdc0 0x7fd33803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd3577fe640 10 monclient: get_auth_request con 0x7fd33803bdc0 auth_method 0 2024-08-18T21:06:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34ffff640 10 monclient(hunting): handle_auth_done global_id 5058 payload 824 2024-08-18T21:06:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.442+0000 7fd34ffff640 1 -- 172.21.15.5:0/1175511512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd35806dbf0 con 0x7fd3580a1b60 2024-08-18T21:06:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.446+0000 7fd3577fe640 1 --2- 172.21.15.5:0/1175511512 >> v2:172.21.15.157:6812/631023601 conn(0x7fd33803bdc0 0x7fd33803e280 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd350009e50 tx=0x7fd3500a7000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.446+0000 7fd34ffff640 1 -- 172.21.15.5:0/1175511512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580a1b60 msgr2=0x7fd35813af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.446+0000 7fd34ffff640 1 --2- 172.21.15.5:0/1175511512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580a1b60 0x7fd35813af40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd348014a60 tx=0x7fd348014f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.446+0000 7fd34f7fe640 1 -- 172.21.15.5:0/1175511512 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd3480198b0 con 0x7fd3580a1b60 2024-08-18T21:06:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.446+0000 7fd34f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.446+0000 7fd34f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:06:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.446+0000 7fd34f7fe640 10 monclient: dump: 2024-08-18T21:06:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.465 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.446+0000 7fd34f7fe640 1 -- 172.21.15.5:0/1175511512 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd34801e070 con 0x7fd3580a1b60 2024-08-18T21:06:10.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.446+0000 7fd34f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:10.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.446+0000 7fd34f7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:10.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.446+0000 7fd34f7fe640 1 -- 172.21.15.5:0/1175511512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580a1b60 msgr2=0x7fd35813af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.446+0000 7fd34f7fe640 1 --2- 172.21.15.5:0/1175511512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580a1b60 0x7fd35813af40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd348014a60 tx=0x7fd348014f20 comp rx=0 tx=0).stop 2024-08-18T21:06:10.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.446+0000 7fd34f7fe640 1 -- 172.21.15.5:0/1175511512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580a1b60 msgr2=0x7fd35813af40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:10.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.446+0000 7fd34f7fe640 1 --2- 172.21.15.5:0/1175511512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580a1b60 0x7fd35813af40 secure :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd348014a60 tx=0x7fd348014f20 comp rx=0 tx=0).stop 2024-08-18T21:06:10.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd35d522640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:10.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd35d522640 1 --2- 172.21.15.5:0/1175511512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35813b480 0x7fd35813b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd35d522640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd35d522640 1 -- 172.21.15.5:0/1175511512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd358051140 con 0x7fd35813b480 2024-08-18T21:06:10.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd34ffff640 1 --2- 172.21.15.5:0/1175511512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35813b480 0x7fd35813b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd34ffff640 10 monclient: get_auth_request con 0x7fd35813b480 auth_method 0 2024-08-18T21:06:10.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd34ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd34ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd34ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd34ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd34ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd34ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd34ffff640 10 monclient(hunting): handle_auth_done global_id 5067 payload 824 2024-08-18T21:06:10.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd34ffff640 1 -- 172.21.15.5:0/1175511512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd3581376b0 con 0x7fd35813b480 2024-08-18T21:06:10.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd34ffff640 1 -- 172.21.15.5:0/1175511512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35813b480 msgr2=0x7fd35813b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:10.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd34ffff640 1 --2- 172.21.15.5:0/1175511512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35813b480 0x7fd35813b860 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd348014a60 tx=0x7fd3480046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd34f7fe640 1 -- 172.21.15.5:0/1175511512 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd348019e60 con 0x7fd35813b480 2024-08-18T21:06:10.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd34f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd34f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:06:10.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.454+0000 7fd34f7fe640 10 monclient: dump: 2024-08-18T21:06:10.468 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.468 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.468 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.468 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.468 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.468 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.468 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.468 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.468 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.468 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.468 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.469 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.469 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.469 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.469 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.469 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd34f7fe640 1 -- 172.21.15.5:0/1175511512 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9416 (secure 0 0 0) 0x7fd348023be0 con 0x7fd35813b480 2024-08-18T21:06:10.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd34f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:10.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd34f7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:10.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd34f7fe640 1 -- 172.21.15.5:0/1175511512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35813b480 msgr2=0x7fd35813b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd34f7fe640 1 --2- 172.21.15.5:0/1175511512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35813b480 0x7fd35813b860 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd348014a60 tx=0x7fd3480046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd34f7fe640 1 -- 172.21.15.5:0/1175511512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35813b480 msgr2=0x7fd35813b860 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:10.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd34f7fe640 1 --2- 172.21.15.5:0/1175511512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35813b480 0x7fd35813b860 secure :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd348014a60 tx=0x7fd3480046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.470 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:10.470 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:10.470 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:10.470 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:06:10.470 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:10.470 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 179575, 2024-08-18T21:06:10.470 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:10.470 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:10.470 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:10.470 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:10.471 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:10.471 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:10.471 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:10.471 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:10.471 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:10.471 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:10.471 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:10.471 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:06:10.471 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:10.471 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:10.471 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:10.471 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:10.471 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:10.472 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:10.472 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:10.472 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:10.472 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:10.472 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:10.472 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:10.472 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:10.472 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:10.472 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:10.472 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:10.472 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:10.472 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:10.472 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:10.473 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:10.473 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:10.473 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:10.473 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:10.473 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:10.473 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:10.473 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:10.473 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:10.473 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:10.473 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:10.473 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.473 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:10.474 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:10.474 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:10.474 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:10.474 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:10.474 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:10.474 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:10.474 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:10.474 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:10.474 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:10.474 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:10.474 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:10.474 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:10.474 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:10.475 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:10.475 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:10.475 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:10.475 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:10.475 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:10.475 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:10.475 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:10.475 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:10.475 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:10.475 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:10.475 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:10.475 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:10.475 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:10.475 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:10.476 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:10.476 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:10.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:10.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.476 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:10.476 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:10.476 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:10.476 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.477 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.477 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:10.477 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.477 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.477 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.477 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:10.477 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:10.477 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.477 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.477 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.478 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:10.478 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:10.478 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.478 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.478 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:10.478 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.479 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:10.479 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.479 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.479 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.479 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:10.479 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:10.479 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.479 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.479 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.479 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:10.480 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:10.480 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.480 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.480 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.480 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:10.480 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.480 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.480 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:10.480 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.480 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.481 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.481 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:10.481 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:10.481 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.481 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.481 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.481 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.481 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:10.481 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:10.481 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.481 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.482 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:10.482 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.482 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:10.482 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.482 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.482 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.482 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:10.482 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:10.483 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.483 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.483 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.483 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:10.483 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:10.483 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.483 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.483 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.483 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:10.483 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.484 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.484 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:10.484 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.484 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.484 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.484 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:10.484 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:10.484 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.484 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.484 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.485 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.485 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:10.485 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:10.485 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.485 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.485 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.485 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.485 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:10.485 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.485 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.485 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.485 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:10.486 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.486 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.486 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.486 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:10.486 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:10.486 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.486 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.486 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.486 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:10.486 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:10.487 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:10.487 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:10.487 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.487 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.487 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:10.488 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:10.488 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.488 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.488 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.488 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:10.488 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:10.488 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.488 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:10.489 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.489 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.489 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:10.489 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.489 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.489 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.489 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:10.489 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:10.489 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.489 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.490 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.490 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:10.490 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:10.490 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.490 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.490 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.490 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:10.490 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.491 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.491 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:10.491 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.491 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.491 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.491 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:10.491 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:10.491 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.491 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.491 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.491 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.491 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.492 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:10.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:10.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.492 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:10.492 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:10.492 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:10.492 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.492 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:10.492 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:10.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.492 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:10.492 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:10.492 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:06:10.493 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.493 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:10.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:06:10.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.493 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:10.493 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:10.493 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:10.493 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.493 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.493 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:10.493 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:10.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd35d522640 1 -- 172.21.15.5:0/1175511512 >> v2:172.21.15.157:6812/631023601 conn(0x7fd33803bdc0 msgr2=0x7fd33803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd35d522640 1 --2- 172.21.15.5:0/1175511512 >> v2:172.21.15.157:6812/631023601 conn(0x7fd33803bdc0 0x7fd33803e280 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd350009e50 tx=0x7fd3500a7000 comp rx=0 tx=0).stop 2024-08-18T21:06:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd35d522640 10 monclient: shutdown 2024-08-18T21:06:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd35d522640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd35d522640 1 -- 172.21.15.5:0/1175511512 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd35806c950 msgr2=0x7fd3581340e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd35d522640 1 --2- 172.21.15.5:0/1175511512 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd35806c950 0x7fd3581340e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd34000e930 tx=0x7fd34000edf0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd3577fe640 1 -- 172.21.15.5:0/1175511512 reap_dead start 2024-08-18T21:06:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd3577fe640 1 -- 172.21.15.5:0/1175511512 reap_dead start 2024-08-18T21:06:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd35d522640 1 -- 172.21.15.5:0/1175511512 shutdown_connections 2024-08-18T21:06:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd35d522640 1 -- 172.21.15.5:0/1175511512 >> 172.21.15.5:0/1175511512 conn(0x7fd3580688d0 msgr2=0x7fd35813ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd35d522640 1 -- 172.21.15.5:0/1175511512 shutdown_connections 2024-08-18T21:06:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.458+0000 7fd35d522640 1 -- 172.21.15.5:0/1175511512 wait complete. 2024-08-18T21:06:10.496 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:10.496 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:06:10.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:06:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.606+0000 7fbadcbe8640 10 monclient: get_monmap_and_config 2024-08-18T21:06:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.606+0000 7fbadcbe8640 10 monclient: build_initial_monmap 2024-08-18T21:06:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.606+0000 7fbadcbe8640 10 monclient: monmap: 2024-08-18T21:06:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:10.611805+0000 2024-08-18T21:06:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:10.611805+0000 2024-08-18T21:06:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:10.612 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 1 Processor -- start 2024-08-18T21:06:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 1 -- start start 2024-08-18T21:06:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 10 monclient: init 2024-08-18T21:06:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 10 monclient: _add_conns ranks=[10,4,9,3,7,2,8,0,5,1,6] 2024-08-18T21:06:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbad80a6ce0 0x7fbad80a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 10 monclient(hunting): picked mon.noname-f con 0x7fbad80a6ce0 addr v2:172.21.15.157:3300/0 2024-08-18T21:06:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbad80a7600 0x7fbad8139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 10 monclient(hunting): picked mon.noname-c con 0x7fbad80a7600 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbad8139fe0 0x7fbad813a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 10 monclient(hunting): picked mon.noname-a con 0x7fbad8139fe0 addr v2:172.21.15.5:3300/0 2024-08-18T21:06:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbad80a5000 con 0x7fbad8139fe0 2024-08-18T21:06:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fbad80a4360 con 0x7fbad80a6ce0 2024-08-18T21:06:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fbad80a45d0 con 0x7fbad80a7600 2024-08-18T21:06:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbadcbe8640 10 monclient(hunting): authenticate will time out at 1137.625119s 2024-08-18T21:06:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbad80a7600 0x7fbad8139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbad80a7600 0x7fbad8139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:60272/0 (socket says 172.21.15.5:60272) 2024-08-18T21:06:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 1 -- 172.21.15.5:0/4235704310 learned_addr learned my addr 172.21.15.5:0/4235704310 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 10 monclient(hunting): get_auth_request con 0x7fbad80a7600 auth_method 0 2024-08-18T21:06:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad6d9d640 1 --2- 172.21.15.5:0/4235704310 >> v2:172.21.15.5:3300/0 conn(0x7fbad8139fe0 0x7fbad813a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad6d9d640 10 monclient(hunting): get_auth_request con 0x7fbad8139fe0 auth_method 0 2024-08-18T21:06:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad659c640 1 --2- 172.21.15.5:0/4235704310 >> v2:172.21.15.157:3300/0 conn(0x7fbad80a6ce0 0x7fbad80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad659c640 10 monclient(hunting): get_auth_request con 0x7fbad80a6ce0 auth_method 0 2024-08-18T21:06:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 10 monclient(hunting): handle_auth_done global_id 5053 payload 274 2024-08-18T21:06:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 1 -- 172.21.15.5:0/4235704310 >> v2:172.21.15.157:3300/0 conn(0x7fbad80a6ce0 msgr2=0x7fbad80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 1 --2- 172.21.15.5:0/4235704310 >> v2:172.21.15.157:3300/0 conn(0x7fbad80a6ce0 0x7fbad80a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 1 -- 172.21.15.5:0/4235704310 >> v2:172.21.15.5:3300/0 conn(0x7fbad8139fe0 msgr2=0x7fbad813a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 1 --2- 172.21.15.5:0/4235704310 >> v2:172.21.15.5:3300/0 conn(0x7fbad8139fe0 0x7fbad813a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:06:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 1 monclient: found mon.noname-c 2024-08-18T21:06:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:06:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad5d9b640 1 -- 172.21.15.5:0/4235704310 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad80a32d0 con 0x7fbad80a7600 2024-08-18T21:06:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.610+0000 7fbad6d9d640 1 --2- 172.21.15.5:0/4235704310 >> v2:172.21.15.5:3300/0 conn(0x7fbad8139fe0 0x7fbad813a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:06:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbad5d9b640 1 -- 172.21.15.5:0/4235704310 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbad80a7600 msgr2=0x7fbad8139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbad5d9b640 1 --2- 172.21.15.5:0/4235704310 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbad80a7600 0x7fbad8139aa0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbad806df00 tx=0x7fbacc01c3e0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=171c2ada98128c04 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbad559a640 1 -- 172.21.15.5:0/4235704310 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbacc0b0070 con 0x7fbad80a7600 2024-08-18T21:06:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbad559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbad559a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:06:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbad559a640 10 monclient: dump: 2024-08-18T21:06:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.623 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbad559a640 10 monclient: _finish_auth 0 2024-08-18T21:06:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbad559a640 10 monclient: _check_auth_tickets 2024-08-18T21:06:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbad559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 5 monclient: authenticate success, global_id 5053 2024-08-18T21:06:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbad559a640 1 -- 172.21.15.5:0/4235704310 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbacc0aa810 con 0x7fbad80a7600 2024-08-18T21:06:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:06:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbad559a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 4 set_mon_vals no callback set 2024-08-18T21:06:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbad559a640 1 -- 172.21.15.5:0/4235704310 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbacc0a9300 con 0x7fbad80a7600 2024-08-18T21:06:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbad559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbad559a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbad559a640 10 monclient: dump: 2024-08-18T21:06:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.625 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 10 monclient: shutdown 2024-08-18T21:06:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 1 -- 172.21.15.5:0/4235704310 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbad80a7600 msgr2=0x7fbad8139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 1 --2- 172.21.15.5:0/4235704310 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbad80a7600 0x7fbad8139aa0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbad806df00 tx=0x7fbacc01c3e0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 1 -- 172.21.15.5:0/4235704310 shutdown_connections 2024-08-18T21:06:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 1 --2- 172.21.15.5:0/4235704310 >> v2:172.21.15.5:3300/0 conn(0x7fbad8139fe0 0x7fbad813a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 1 --2- 172.21.15.5:0/4235704310 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbad80a7600 0x7fbad8139aa0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 1 --2- 172.21.15.5:0/4235704310 >> v2:172.21.15.157:3300/0 conn(0x7fbad80a6ce0 0x7fbad80a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 1 -- 172.21.15.5:0/4235704310 >> 172.21.15.5:0/4235704310 conn(0x7fbad80acbc0 msgr2=0x7fbad80a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 1 -- 172.21.15.5:0/4235704310 shutdown_connections 2024-08-18T21:06:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 1 -- 172.21.15.5:0/4235704310 wait complete. 2024-08-18T21:06:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 10 monclient: build_initial_monmap 2024-08-18T21:06:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.614+0000 7fbadcbe8640 10 monclient: monmap: 2024-08-18T21:06:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:10.627 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 1 Processor -- start 2024-08-18T21:06:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 1 -- start start 2024-08-18T21:06:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 10 monclient: init 2024-08-18T21:06:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 10 monclient: _add_conns ranks=[8,4,0,3,5,7,6,2,1] 2024-08-18T21:06:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbad80a6ce0 0x7fbad8134ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 10 monclient(hunting): picked mon.noname-e con 0x7fbad80a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbad80a7600 0x7fbad8135220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 10 monclient(hunting): picked mon.noname-c con 0x7fbad80a7600 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad8139fe0 0x7fbad813aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 10 monclient(hunting): picked mon.noname-a con 0x7fbad8139fe0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:06:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbad80a79e0 con 0x7fbad8139fe0 2024-08-18T21:06:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fbad80a8220 con 0x7fbad80a7600 2024-08-18T21:06:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fbad813e360 con 0x7fbad80a6ce0 2024-08-18T21:06:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 10 monclient(hunting): authenticate will time out at 1137.632684s 2024-08-18T21:06:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad8139fe0 0x7fbad813aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad659c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbad80a6ce0 0x7fbad8134ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad8139fe0 0x7fbad813aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40638/0 (socket says 172.21.15.5:40638) 2024-08-18T21:06:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 1 -- 172.21.15.5:0/1173301469 learned_addr learned my addr 172.21.15.5:0/1173301469 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad659c640 10 monclient(hunting): get_auth_request con 0x7fbad80a6ce0 auth_method 0 2024-08-18T21:06:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad5d9b640 1 --2- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbad80a7600 0x7fbad8135220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 10 monclient(hunting): get_auth_request con 0x7fbad8139fe0 auth_method 0 2024-08-18T21:06:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad5d9b640 10 monclient(hunting): get_auth_request con 0x7fbad80a7600 auth_method 0 2024-08-18T21:06:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 10 monclient(hunting): handle_auth_done global_id 5085 payload 824 2024-08-18T21:06:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 1 -- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbad80a6ce0 msgr2=0x7fbad8134ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 1 --2- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbad80a6ce0 0x7fbad8134ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 1 -- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbad80a7600 msgr2=0x7fbad8135220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 1 --2- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbad80a7600 0x7fbad8135220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 10 monclient: _finish_hunting 0 2024-08-18T21:06:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 1 monclient: found mon.noname-a 2024-08-18T21:06:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:06:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 1 -- 172.21.15.5:0/1173301469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad813db00 con 0x7fbad8139fe0 2024-08-18T21:06:10.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 1 -- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad8139fe0 msgr2=0x7fbad813aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:10.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad6d9d640 1 --2- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad8139fe0 0x7fbad813aa60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbad000efc0 tx=0x7fbad000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbac6ffd640 1 -- 172.21.15.5:0/1173301469 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbad0018030 con 0x7fbad8139fe0 2024-08-18T21:06:10.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbac6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbac6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:06:10.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbac6ffd640 10 monclient: dump: 2024-08-18T21:06:10.636 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.636 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.636 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.636 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.637 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbac6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:06:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbac6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:06:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbac6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 5 monclient: authenticate success, global_id 5085 2024-08-18T21:06:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbac6ffd640 1 -- 172.21.15.5:0/1173301469 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad00148f0 con 0x7fbad8139fe0 2024-08-18T21:06:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbac6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbac6ffd640 1 -- 172.21.15.5:0/1173301469 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbad00133e0 con 0x7fbad8139fe0 2024-08-18T21:06:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 10 monclient: _renew_subs 2024-08-18T21:06:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:06:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbadcbe8640 1 -- 172.21.15.5:0/1173301469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad80aa500 con 0x7fbad8139fe0 2024-08-18T21:06:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbad4d99640 4 set_mon_vals no callback set 2024-08-18T21:06:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbac6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbac6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:06:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.618+0000 7fbac6ffd640 10 monclient: dump: 2024-08-18T21:06:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.640 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbadcbe8640 10 monclient: _renew_subs 2024-08-18T21:06:10.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbadcbe8640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:06:10.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbadcbe8640 1 -- 172.21.15.5:0/1173301469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad813e080 con 0x7fbad8139fe0 2024-08-18T21:06:10.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbadcbe8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:10.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbadcbe8640 1 --2- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbad813b760 0x7fbad802d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbadcbe8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbadcbe8640 1 -- 172.21.15.5:0/1173301469 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fbad80a7b60 con 0x7fbad813b760 2024-08-18T21:06:10.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbad659c640 1 --2- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbad813b760 0x7fbad802d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbad659c640 10 monclient: get_auth_request con 0x7fbad813b760 auth_method 0 2024-08-18T21:06:10.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbad659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbad659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbad659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbad659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbad659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbad659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbad659c640 10 monclient(hunting): handle_auth_done global_id 5123 payload 824 2024-08-18T21:06:10.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbad659c640 1 -- 172.21.15.5:0/1173301469 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbad8139aa0 con 0x7fbad813b760 2024-08-18T21:06:10.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbac6ffd640 1 -- 172.21.15.5:0/1173301469 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fbad001b070 con 0x7fbad8139fe0 2024-08-18T21:06:10.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbac6ffd640 1 --2- 172.21.15.5:0/1173301469 >> v2:172.21.15.157:6812/631023601 conn(0x7fbab803bdc0 0x7fbab803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbac6ffd640 1 -- 172.21.15.5:0/1173301469 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 22..78) ==== 3506+0+0 (secure 0 0 0) 0x7fbad0019070 con 0x7fbad8139fe0 2024-08-18T21:06:10.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbad5d9b640 1 --2- 172.21.15.5:0/1173301469 >> v2:172.21.15.157:6812/631023601 conn(0x7fbab803bdc0 0x7fbab803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbad5d9b640 10 monclient: get_auth_request con 0x7fbab803bdc0 auth_method 0 2024-08-18T21:06:10.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbad659c640 1 -- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbad813b760 msgr2=0x7fbad802d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:10.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbad659c640 1 --2- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbad813b760 0x7fbad802d1d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbac8010820 tx=0x7fbac8010ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbac6ffd640 1 -- 172.21.15.5:0/1173301469 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbac8018020 con 0x7fbad813b760 2024-08-18T21:06:10.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbac6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbac6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:06:10.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbac6ffd640 10 monclient: dump: 2024-08-18T21:06:10.642 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.642 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.642 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.642 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.642 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.642 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.642 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.642 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.642 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.642 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.643 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbac6ffd640 1 -- 172.21.15.5:0/1173301469 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbac8004450 con 0x7fbad813b760 2024-08-18T21:06:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbac6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbac6ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbac6ffd640 1 -- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbad813b760 msgr2=0x7fbad802d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbac6ffd640 1 --2- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbad813b760 0x7fbad802d1d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbac8010820 tx=0x7fbac8010ce0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbac6ffd640 1 -- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbad813b760 msgr2=0x7fbad802d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.622+0000 7fbac6ffd640 1 --2- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbad813b760 0x7fbad802d1d0 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbac8010820 tx=0x7fbac8010ce0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.626+0000 7fbad5d9b640 1 --2- 172.21.15.5:0/1173301469 >> v2:172.21.15.157:6812/631023601 conn(0x7fbab803bdc0 0x7fbab803e280 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbad80a7ef0 tx=0x7fbacc0a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.630+0000 7fbadcbe8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.630+0000 7fbadcbe8640 1 --2- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbad813bb40 0x7fbad802d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.630+0000 7fbadcbe8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.630+0000 7fbadcbe8640 1 -- 172.21.15.5:0/1173301469 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fbad8051140 con 0x7fbad813bb40 2024-08-18T21:06:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.630+0000 7fbad659c640 1 --2- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbad813bb40 0x7fbad802d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.630+0000 7fbad659c640 10 monclient: get_auth_request con 0x7fbad813bb40 auth_method 0 2024-08-18T21:06:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.630+0000 7fbad659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.630+0000 7fbad659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.630+0000 7fbad659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.630+0000 7fbad659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.630+0000 7fbad659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.630+0000 7fbad659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.630+0000 7fbad659c640 10 monclient(hunting): handle_auth_done global_id 5132 payload 824 2024-08-18T21:06:10.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.630+0000 7fbad659c640 1 -- 172.21.15.5:0/1173301469 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbad809f140 con 0x7fbad813bb40 2024-08-18T21:06:10.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbad659c640 1 -- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbad813bb40 msgr2=0x7fbad802d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:10.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbad659c640 1 --2- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbad813bb40 0x7fbad802d710 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbac8000c10 tx=0x7fbac80046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbac6ffd640 1 -- 172.21.15.5:0/1173301469 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbac8018040 con 0x7fbad813bb40 2024-08-18T21:06:10.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbac6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbac6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:06:10.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbac6ffd640 10 monclient: dump: 2024-08-18T21:06:10.645 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.645 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.645 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.645 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.645 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.645 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.645 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.646 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.646 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.646 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.646 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.646 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.646 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.646 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.646 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.646 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbac6ffd640 1 -- 172.21.15.5:0/1173301469 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7fbac8003620 con 0x7fbad813bb40 2024-08-18T21:06:10.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbac6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:10.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbac6ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:10.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbac6ffd640 1 -- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbad813bb40 msgr2=0x7fbad802d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbac6ffd640 1 --2- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbad813bb40 0x7fbad802d710 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbac8000c10 tx=0x7fbac80046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbac6ffd640 1 -- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbad813bb40 msgr2=0x7fbad802d710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:10.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbac6ffd640 1 --2- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbad813bb40 0x7fbad802d710 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbac8000c10 tx=0x7fbac80046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.647 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:10.647 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:10.647 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:10.647 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:10.647 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:10.647 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 179747, 2024-08-18T21:06:10.647 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:10.647 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:10.648 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:10.648 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:10.648 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:10.648 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:10.648 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:10.648 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:10.648 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:10.648 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:10.648 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:10.648 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:06:10.648 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:10.648 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:10.648 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:10.649 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:10.649 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:10.649 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:10.649 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:10.649 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:10.649 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:10.649 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:10.649 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:10.649 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:10.649 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:10.649 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:10.649 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:10.649 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:10.649 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:10.650 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:10.650 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:10.650 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:10.650 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:10.650 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:10.650 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:10.650 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:10.650 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:10.650 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:10.650 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:10.650 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:10.650 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.651 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:10.651 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:10.651 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:10.651 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:10.651 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:10.651 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:10.651 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:10.651 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:10.651 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:10.651 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:10.651 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:10.651 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:10.651 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:10.651 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:10.652 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:10.652 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:10.652 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:10.652 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:10.652 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:10.652 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:10.652 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:10.652 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:10.652 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:10.652 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:10.652 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:10.652 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:10.652 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:10.652 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:10.653 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:10.653 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:10.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.653 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:10.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.653 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:10.653 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:10.653 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.653 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.653 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.653 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:10.653 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.654 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.654 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:10.654 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.654 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.654 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.654 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:10.654 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:10.654 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.654 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.654 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.655 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.655 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:10.655 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:10.655 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.655 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.655 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.655 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.655 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:10.655 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.655 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.655 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.655 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:10.656 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.656 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.656 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.656 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:10.656 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:10.656 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.656 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.656 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.656 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.656 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:10.656 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:10.657 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.657 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.657 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.657 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.657 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:10.657 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.657 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.657 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.657 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:10.657 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.657 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.657 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.658 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:10.658 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:10.658 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.658 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.658 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.658 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:10.658 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:10.658 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.658 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.658 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.658 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:10.659 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.659 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.659 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:10.659 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.659 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.659 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.659 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:10.659 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:10.659 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.659 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.659 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.660 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:10.660 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:10.660 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.660 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:10.660 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.661 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.661 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:10.661 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.661 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.661 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.661 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:10.661 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:10.661 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.661 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.661 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.662 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:10.662 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:10.662 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.662 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.662 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.662 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:10.662 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.662 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.662 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:10.663 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.663 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.663 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.663 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:10.663 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:10.663 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.663 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.663 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.663 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:10.663 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:10.664 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.664 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.664 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.664 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:10.664 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.664 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.664 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:10.664 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.664 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.664 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.665 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:10.665 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:10.665 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.665 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.665 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.665 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:10.665 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:10.665 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.665 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.665 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.666 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:10.666 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.666 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.666 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:10.666 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.666 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.666 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.666 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:10.666 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:10.666 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.666 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.667 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.667 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:10.667 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:10.667 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.667 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.667 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.667 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:10.667 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.667 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.668 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:10.668 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.668 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.668 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.668 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:10.668 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:10.668 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.668 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.668 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.668 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.668 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.669 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:10.669 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:10.669 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.669 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:10.669 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:10.669 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:10.669 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.669 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:10.669 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:06:10.669 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.669 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:10.669 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:10.669 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:10.669 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.670 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:10.670 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:10.670 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.670 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:10.670 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:10.670 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:10.670 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.670 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.670 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:10.670 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbadcbe8640 1 -- 172.21.15.5:0/1173301469 >> v2:172.21.15.157:6812/631023601 conn(0x7fbab803bdc0 msgr2=0x7fbab803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbadcbe8640 1 --2- 172.21.15.5:0/1173301469 >> v2:172.21.15.157:6812/631023601 conn(0x7fbab803bdc0 0x7fbab803e280 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbad80a7ef0 tx=0x7fbacc0a6000 comp rx=0 tx=0).stop 2024-08-18T21:06:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbadcbe8640 10 monclient: shutdown 2024-08-18T21:06:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbadcbe8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbadcbe8640 1 -- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad8139fe0 msgr2=0x7fbad813aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbadcbe8640 1 --2- 172.21.15.5:0/1173301469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad8139fe0 0x7fbad813aa60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbad000efc0 tx=0x7fbad000c490 comp rx=0 tx=0).stop 2024-08-18T21:06:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbad6d9d640 1 -- 172.21.15.5:0/1173301469 reap_dead start 2024-08-18T21:06:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbad6d9d640 1 -- 172.21.15.5:0/1173301469 reap_dead start 2024-08-18T21:06:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbadcbe8640 1 -- 172.21.15.5:0/1173301469 shutdown_connections 2024-08-18T21:06:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbadcbe8640 1 -- 172.21.15.5:0/1173301469 >> 172.21.15.5:0/1173301469 conn(0x7fbad80acbc0 msgr2=0x7fbad81386a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbadcbe8640 1 -- 172.21.15.5:0/1173301469 shutdown_connections 2024-08-18T21:06:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.634+0000 7fbadcbe8640 1 -- 172.21.15.5:0/1173301469 wait complete. 2024-08-18T21:06:10.673 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:10.673 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:06:10.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:06:10.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 10 monclient: get_monmap_and_config 2024-08-18T21:06:10.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 10 monclient: build_initial_monmap 2024-08-18T21:06:10.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 10 monclient: monmap: 2024-08-18T21:06:10.788 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:10.788 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.788 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:10.789017+0000 2024-08-18T21:06:10.788 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:10.789017+0000 2024-08-18T21:06:10.788 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:10.788 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.788 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:10.788 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:10.788 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:10.789 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 1 Processor -- start 2024-08-18T21:06:10.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 1 -- start start 2024-08-18T21:06:10.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 10 monclient: init 2024-08-18T21:06:10.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:10.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 10 monclient: _add_conns ranks=[3,8,10,6,2,0,5,9,4,1,7] 2024-08-18T21:06:10.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0640a6ce0 0x7ff0640a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 10 monclient(hunting): picked mon.noname-g con 0x7ff0640a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:06:10.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff0640a7600 0x7ff064139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 10 monclient(hunting): picked mon.noname-e con 0x7ff0640a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff064139fe0 0x7ff06413a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 10 monclient(hunting): picked mon.noname-f con 0x7ff064139fe0 addr v2:172.21.15.157:3300/0 2024-08-18T21:06:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff0640a5000 con 0x7ff064139fe0 2024-08-18T21:06:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff0640a4360 con 0x7ff0640a6ce0 2024-08-18T21:06:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff0640a45d0 con 0x7ff0640a7600 2024-08-18T21:06:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06c6de640 10 monclient(hunting): authenticate will time out at 1137.802321s 2024-08-18T21:06:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff0640a7600 0x7ff064139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff0640a7600 0x7ff064139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:55960/0 (socket says 172.21.15.5:55960) 2024-08-18T21:06:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 1 -- 172.21.15.5:0/3412360004 learned_addr learned my addr 172.21.15.5:0/3412360004 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 10 monclient(hunting): get_auth_request con 0x7ff0640a7600 auth_method 0 2024-08-18T21:06:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06a47a640 1 --2- 172.21.15.5:0/3412360004 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0640a6ce0 0x7ff0640a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06ac7b640 1 --2- 172.21.15.5:0/3412360004 >> v2:172.21.15.157:3300/0 conn(0x7ff064139fe0 0x7ff06413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06ac7b640 10 monclient(hunting): get_auth_request con 0x7ff064139fe0 auth_method 0 2024-08-18T21:06:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06ac7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06ac7b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06ac7b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06a47a640 10 monclient(hunting): get_auth_request con 0x7ff0640a6ce0 auth_method 0 2024-08-18T21:06:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06a47a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06a47a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff06a47a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 10 monclient(hunting): handle_auth_done global_id 54125 payload 274 2024-08-18T21:06:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 1 -- 172.21.15.5:0/3412360004 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0640a6ce0 msgr2=0x7ff0640a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 1 --2- 172.21.15.5:0/3412360004 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0640a6ce0 0x7ff0640a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 1 -- 172.21.15.5:0/3412360004 >> v2:172.21.15.157:3300/0 conn(0x7ff064139fe0 msgr2=0x7ff06413a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 1 --2- 172.21.15.5:0/3412360004 >> v2:172.21.15.157:3300/0 conn(0x7ff064139fe0 0x7ff06413a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 10 monclient: _finish_hunting 0 2024-08-18T21:06:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 1 monclient: found mon.noname-e 2024-08-18T21:06:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:06:10.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.786+0000 7ff069c79640 1 -- 172.21.15.5:0/3412360004 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0640a32d0 con 0x7ff0640a7600 2024-08-18T21:06:10.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff069c79640 1 -- 172.21.15.5:0/3412360004 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff0640a7600 msgr2=0x7ff064139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff069c79640 1 --2- 172.21.15.5:0/3412360004 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff0640a7600 0x7ff064139aa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff0600098a0 tx=0x7ff06001c400 comp rx=0 tx=0).ready entity=mon.8 client_cookie=401adb97c62348a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff069478640 1 -- 172.21.15.5:0/3412360004 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff0600b0070 con 0x7ff0640a7600 2024-08-18T21:06:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff069478640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff069478640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:06:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff069478640 10 monclient: dump: 2024-08-18T21:06:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.804 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff069478640 10 monclient: _finish_auth 0 2024-08-18T21:06:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff069478640 10 monclient: _check_auth_tickets 2024-08-18T21:06:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff069478640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff069478640 1 -- 172.21.15.5:0/3412360004 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0600aa810 con 0x7ff0640a7600 2024-08-18T21:06:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff069478640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff069478640 1 -- 172.21.15.5:0/3412360004 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff0600a9300 con 0x7ff0640a7600 2024-08-18T21:06:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff069478640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff069478640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff069478640 10 monclient: dump: 2024-08-18T21:06:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.806 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff06c6de640 5 monclient: authenticate success, global_id 54125 2024-08-18T21:06:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff06c6de640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff06c6de640 4 set_mon_vals no callback set 2024-08-18T21:06:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff06c6de640 10 monclient: shutdown 2024-08-18T21:06:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff06c6de640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff06c6de640 1 -- 172.21.15.5:0/3412360004 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff0640a7600 msgr2=0x7ff064139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff06c6de640 1 --2- 172.21.15.5:0/3412360004 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff0640a7600 0x7ff064139aa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff0600098a0 tx=0x7ff06001c400 comp rx=0 tx=0).stop 2024-08-18T21:06:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff06c6de640 1 -- 172.21.15.5:0/3412360004 shutdown_connections 2024-08-18T21:06:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff06c6de640 1 --2- 172.21.15.5:0/3412360004 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff0640a7600 0x7ff064139aa0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff06c6de640 1 --2- 172.21.15.5:0/3412360004 >> v2:172.21.15.157:3300/0 conn(0x7ff064139fe0 0x7ff06413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff06c6de640 1 --2- 172.21.15.5:0/3412360004 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0640a6ce0 0x7ff0640a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.790+0000 7ff06c6de640 1 -- 172.21.15.5:0/3412360004 >> 172.21.15.5:0/3412360004 conn(0x7ff0640acbc0 msgr2=0x7ff0640a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 1 -- 172.21.15.5:0/3412360004 shutdown_connections 2024-08-18T21:06:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 1 -- 172.21.15.5:0/3412360004 wait complete. 2024-08-18T21:06:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 10 monclient: build_initial_monmap 2024-08-18T21:06:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 10 monclient: monmap: 2024-08-18T21:06:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:10.808 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 1 Processor -- start 2024-08-18T21:06:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 1 -- start start 2024-08-18T21:06:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 10 monclient: init 2024-08-18T21:06:10.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:10.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 10 monclient: _add_conns ranks=[1,2,0,4,7,8,3,5,6] 2024-08-18T21:06:10.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0640a6ce0 0x7ff06413af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 10 monclient(hunting): picked mon.noname-f con 0x7ff0640a6ce0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:06:10.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff0640a7600 0x7ff06413b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 10 monclient(hunting): picked mon.noname-b con 0x7ff0640a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:10.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff064139fe0 0x7ff0641d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 10 monclient(hunting): picked mon.noname-a con 0x7ff064139fe0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:06:10.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff0640a79e0 con 0x7ff064139fe0 2024-08-18T21:06:10.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff0640a8220 con 0x7ff0640a6ce0 2024-08-18T21:06:10.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7ff064140880 con 0x7ff0640a7600 2024-08-18T21:06:10.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:10.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06c6de640 10 monclient(hunting): authenticate will time out at 1137.809737s 2024-08-18T21:06:10.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff0640a7600 0x7ff06413b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06ac7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff064139fe0 0x7ff0641d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff0640a7600 0x7ff06413b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34370/0 (socket says 172.21.15.5:34370) 2024-08-18T21:06:10.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 1 -- 172.21.15.5:0/2252520 learned_addr learned my addr 172.21.15.5:0/2252520 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:10.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 10 monclient(hunting): get_auth_request con 0x7ff0640a7600 auth_method 0 2024-08-18T21:06:10.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06ac7b640 10 monclient(hunting): get_auth_request con 0x7ff064139fe0 auth_method 0 2024-08-18T21:06:10.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06ac7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06ac7b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06ac7b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06ac7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06ac7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06ac7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06a47a640 1 --2- 172.21.15.5:0/2252520 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0640a6ce0 0x7ff06413af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06a47a640 10 monclient(hunting): get_auth_request con 0x7ff0640a6ce0 auth_method 0 2024-08-18T21:06:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06a47a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06a47a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06a47a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 10 monclient(hunting): handle_auth_done global_id 5141 payload 824 2024-08-18T21:06:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 1 -- 172.21.15.5:0/2252520 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0640a6ce0 msgr2=0x7ff06413af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 1 --2- 172.21.15.5:0/2252520 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0640a6ce0 0x7ff06413af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 1 -- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff064139fe0 msgr2=0x7ff0641d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 1 --2- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff064139fe0 0x7ff0641d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 10 monclient: _finish_hunting 0 2024-08-18T21:06:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 1 monclient: found mon.noname-b 2024-08-18T21:06:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:06:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff069c79640 1 -- 172.21.15.5:0/2252520 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0640a1f00 con 0x7ff0640a7600 2024-08-18T21:06:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.794+0000 7ff06ac7b640 1 --2- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff064139fe0 0x7ff0641d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:06:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff069c79640 1 -- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff0640a7600 msgr2=0x7ff06413b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff069c79640 1 --2- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff0640a7600 0x7ff06413b440 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff06001cca0 tx=0x7ff0600191a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff05affd640 1 -- 172.21.15.5:0/2252520 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff0600b0040 con 0x7ff0640a7600 2024-08-18T21:06:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff05affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff05affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:06:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff05affd640 10 monclient: dump: 2024-08-18T21:06:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.814 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff05affd640 10 monclient: _finish_auth 0 2024-08-18T21:06:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff05affd640 10 monclient: _check_auth_tickets 2024-08-18T21:06:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff05affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff05affd640 1 -- 172.21.15.5:0/2252520 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff060004240 con 0x7ff0640a7600 2024-08-18T21:06:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff05affd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff05affd640 1 -- 172.21.15.5:0/2252520 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff0600043f0 con 0x7ff0640a7600 2024-08-18T21:06:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff05affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff05affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:06:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff05affd640 10 monclient: dump: 2024-08-18T21:06:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.816 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff068c77640 4 set_mon_vals no callback set 2024-08-18T21:06:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06c6de640 5 monclient: authenticate success, global_id 5141 2024-08-18T21:06:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06c6de640 10 monclient: _renew_subs 2024-08-18T21:06:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06c6de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:06:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06c6de640 1 -- 172.21.15.5:0/2252520 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0640aa690 con 0x7ff0640a7600 2024-08-18T21:06:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06c6de640 10 monclient: _renew_subs 2024-08-18T21:06:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06c6de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:06:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06c6de640 1 -- 172.21.15.5:0/2252520 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff06413d830 con 0x7ff0640a7600 2024-08-18T21:06:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06c6de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06c6de640 1 --2- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff0641d1c00 0x7ff0641d1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06c6de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06c6de640 1 -- 172.21.15.5:0/2252520 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff06413d040 con 0x7ff0641d1c00 2024-08-18T21:06:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06a47a640 1 --2- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff0641d1c00 0x7ff0641d1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06a47a640 10 monclient: get_auth_request con 0x7ff0641d1c00 auth_method 0 2024-08-18T21:06:10.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06a47a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06a47a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06a47a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06a47a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06a47a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06a47a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff05affd640 1 -- 172.21.15.5:0/2252520 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7ff0600bb060 con 0x7ff0640a7600 2024-08-18T21:06:10.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06a47a640 10 monclient(hunting): handle_auth_done global_id 5071 payload 824 2024-08-18T21:06:10.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06a47a640 1 -- 172.21.15.5:0/2252520 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0641d2520 con 0x7ff0641d1c00 2024-08-18T21:06:10.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff05affd640 1 --2- 172.21.15.5:0/2252520 >> v2:172.21.15.157:6812/631023601 conn(0x7ff04803bdc0 0x7ff04803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff05affd640 1 -- 172.21.15.5:0/2252520 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(78..78 src has 22..78) ==== 3506+0+0 (secure 0 0 0) 0x7ff0600e77c0 con 0x7ff0640a7600 2024-08-18T21:06:10.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06ac7b640 1 --2- 172.21.15.5:0/2252520 >> v2:172.21.15.157:6812/631023601 conn(0x7ff04803bdc0 0x7ff04803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.798+0000 7ff06ac7b640 10 monclient: get_auth_request con 0x7ff04803bdc0 auth_method 0 2024-08-18T21:06:10.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.802+0000 7ff06a47a640 1 -- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff0641d1c00 msgr2=0x7ff0641d1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:10.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.802+0000 7ff06a47a640 1 --2- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff0641d1c00 0x7ff0641d1fe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff05400f4b0 tx=0x7ff05400f970 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.802+0000 7ff05affd640 1 -- 172.21.15.5:0/2252520 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff054019020 con 0x7ff0641d1c00 2024-08-18T21:06:10.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.802+0000 7ff05affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.802+0000 7ff05affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:10.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.802+0000 7ff05affd640 10 monclient: dump: 2024-08-18T21:06:10.820 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.820 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.820 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.820 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.820 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.821 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.802+0000 7ff05affd640 1 -- 172.21.15.5:0/2252520 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff054014880 con 0x7ff0641d1c00 2024-08-18T21:06:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.802+0000 7ff05affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.802+0000 7ff05affd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:10.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.802+0000 7ff05affd640 1 -- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff0641d1c00 msgr2=0x7ff0641d1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.802+0000 7ff05affd640 1 --2- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff0641d1c00 0x7ff0641d1fe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff05400f4b0 tx=0x7ff05400f970 comp rx=0 tx=0).stop 2024-08-18T21:06:10.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.802+0000 7ff05affd640 1 -- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff0641d1c00 msgr2=0x7ff0641d1fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:10.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.802+0000 7ff05affd640 1 --2- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff0641d1c00 0x7ff0641d1fe0 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff05400f4b0 tx=0x7ff05400f970 comp rx=0 tx=0).stop 2024-08-18T21:06:10.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.802+0000 7ff06ac7b640 1 --2- 172.21.15.5:0/2252520 >> v2:172.21.15.157:6812/631023601 conn(0x7ff04803bdc0 0x7ff04803e280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0076a0 tx=0x7ff05c009780 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.806+0000 7ff06c6de640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:10.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.806+0000 7ff06c6de640 1 --2- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff064137f20 0x7ff064138330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.806+0000 7ff06c6de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.806+0000 7ff06c6de640 1 -- 172.21.15.5:0/2252520 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff0640a7b60 con 0x7ff064137f20 2024-08-18T21:06:10.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.806+0000 7ff06a47a640 1 --2- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff064137f20 0x7ff064138330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.806+0000 7ff06a47a640 10 monclient: get_auth_request con 0x7ff064137f20 auth_method 0 2024-08-18T21:06:10.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.806+0000 7ff06a47a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.806+0000 7ff06a47a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.806+0000 7ff06a47a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.806+0000 7ff06a47a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.806+0000 7ff06a47a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.806+0000 7ff06a47a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.806+0000 7ff06a47a640 10 monclient(hunting): handle_auth_done global_id 5080 payload 824 2024-08-18T21:06:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.806+0000 7ff06a47a640 1 -- 172.21.15.5:0/2252520 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff0640a70c0 con 0x7ff064137f20 2024-08-18T21:06:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff06a47a640 1 -- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff064137f20 msgr2=0x7ff064138330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff06a47a640 1 --2- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff064137f20 0x7ff064138330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff05400f4b0 tx=0x7ff0540046d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff05affd640 1 -- 172.21.15.5:0/2252520 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff054019040 con 0x7ff064137f20 2024-08-18T21:06:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff05affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff05affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff05affd640 10 monclient: dump: 2024-08-18T21:06:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.824 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff05affd640 1 -- 172.21.15.5:0/2252520 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7ff054004030 con 0x7ff064137f20 2024-08-18T21:06:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff05affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:10.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff05affd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:10.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff05affd640 1 -- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff064137f20 msgr2=0x7ff064138330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff05affd640 1 --2- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff064137f20 0x7ff064138330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff05400f4b0 tx=0x7ff0540046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff05affd640 1 -- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff064137f20 msgr2=0x7ff064138330 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:10.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff05affd640 1 --2- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff064137f20 0x7ff064138330 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff05400f4b0 tx=0x7ff0540046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.825 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:10.825 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:10.825 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:10.825 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:10.825 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:10.825 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 179927, 2024-08-18T21:06:10.826 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:10.826 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:10.826 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:10.826 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:10.826 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:10.826 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:10.826 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:10.826 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:10.826 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:10.826 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:10.826 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:10.826 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:06:10.826 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:10.827 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:10.827 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:10.827 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:10.827 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:10.827 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:10.827 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:10.827 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:10.827 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:10.827 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:10.827 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:10.827 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:10.827 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:10.827 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:10.827 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:10.827 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:10.828 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:10.828 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:10.828 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:10.828 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:10.828 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:10.828 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:10.828 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:10.828 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:10.828 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:10.828 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:10.828 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:10.828 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:10.828 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.829 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:10.829 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:10.829 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:10.829 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:10.829 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:10.829 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:10.829 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:10.829 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:10.829 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:10.829 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:10.829 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:10.829 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:10.829 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:10.829 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:10.830 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:10.830 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:10.830 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:10.830 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:10.830 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:10.830 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:10.830 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:10.830 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:10.830 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:10.830 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:10.830 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:10.830 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:10.830 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:10.831 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:10.831 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:10.831 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:10.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.831 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:10.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.831 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:10.831 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:10.831 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.831 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.831 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.831 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:10.831 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.832 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.832 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.832 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:10.832 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.832 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.832 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.832 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:10.832 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:10.832 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.832 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.832 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.833 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:10.833 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:10.833 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.833 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.833 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.833 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:10.833 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.833 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.833 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:10.834 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.834 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.834 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.834 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:10.834 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:10.834 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.834 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.834 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.834 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.834 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:10.834 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:10.835 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.835 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.835 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.835 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.835 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:10.835 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.835 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.835 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.835 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:10.835 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.835 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.835 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.836 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:10.836 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:10.836 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.836 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.836 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.836 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:10.836 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:10.836 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.836 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.836 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.837 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:10.837 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.837 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.837 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:10.837 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.837 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.837 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.837 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:10.837 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:10.837 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.837 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.838 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.838 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.838 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:10.838 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:10.838 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.838 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.838 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.838 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.838 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:10.838 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.838 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.839 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.839 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:10.839 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.839 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.839 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.839 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:10.839 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:10.839 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.839 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.839 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.839 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.839 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:10.840 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:10.840 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.840 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.840 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.840 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.840 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:10.840 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.840 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.840 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.840 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:10.840 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.840 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.841 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.841 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:10.841 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:10.841 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.841 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.841 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.841 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.841 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:10.841 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:10.841 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.841 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.841 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.841 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.842 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:10.842 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.842 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.842 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.842 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:10.842 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.842 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.842 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.842 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:10.842 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:10.842 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.843 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.843 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.843 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.843 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:10.843 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:10.843 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.843 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.843 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.843 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.843 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:10.843 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.843 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.844 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.844 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:10.844 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.844 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.844 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.844 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:10.844 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:10.844 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.844 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.844 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.844 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.845 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:10.845 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:10.845 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:10.845 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:10.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.845 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:10.845 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:10.845 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.845 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:10.845 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:10.845 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:10.845 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.846 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.846 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:10.846 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:10.846 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:10.846 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:10.846 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:10.846 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.846 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.846 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:10.846 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:10.846 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.847 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:10.847 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:10.847 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:10.847 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.847 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:10.847 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:06:10.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.847 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:10.847 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:10.847 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:06:10.847 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.847 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:10.847 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:10.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:10.847 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:10.848 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:10.848 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:10.848 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:10.848 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:10.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:10.848 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:10.848 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:10.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff06c6de640 1 -- 172.21.15.5:0/2252520 >> v2:172.21.15.157:6812/631023601 conn(0x7ff04803bdc0 msgr2=0x7ff04803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff06c6de640 1 --2- 172.21.15.5:0/2252520 >> v2:172.21.15.157:6812/631023601 conn(0x7ff04803bdc0 0x7ff04803e280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0076a0 tx=0x7ff05c009780 comp rx=0 tx=0).stop 2024-08-18T21:06:10.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff06c6de640 10 monclient: shutdown 2024-08-18T21:06:10.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff06c6de640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:10.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff06c6de640 1 -- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff0640a7600 msgr2=0x7ff06413b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff06c6de640 1 --2- 172.21.15.5:0/2252520 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff0640a7600 0x7ff06413b440 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff06001cca0 tx=0x7ff0600191a0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff06ac7b640 1 -- 172.21.15.5:0/2252520 reap_dead start 2024-08-18T21:06:10.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff06ac7b640 1 -- 172.21.15.5:0/2252520 reap_dead start 2024-08-18T21:06:10.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff06c6de640 1 -- 172.21.15.5:0/2252520 shutdown_connections 2024-08-18T21:06:10.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff06c6de640 1 -- 172.21.15.5:0/2252520 >> 172.21.15.5:0/2252520 conn(0x7ff0640acbc0 msgr2=0x7ff0640abb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:10.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff06c6de640 1 -- 172.21.15.5:0/2252520 shutdown_connections 2024-08-18T21:06:10.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.810+0000 7ff06c6de640 1 -- 172.21.15.5:0/2252520 wait complete. 2024-08-18T21:06:10.851 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:10.851 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:06:10.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:06:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 10 monclient: get_monmap_and_config 2024-08-18T21:06:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 10 monclient: build_initial_monmap 2024-08-18T21:06:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 10 monclient: monmap: 2024-08-18T21:06:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:10.973967+0000 2024-08-18T21:06:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:10.973967+0000 2024-08-18T21:06:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:10.974 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 1 Processor -- start 2024-08-18T21:06:10.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 1 -- start start 2024-08-18T21:06:10.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 10 monclient: init 2024-08-18T21:06:10.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:10.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 10 monclient: _add_conns ranks=[5,10,8,4,7,1,3,0,6,2,9] 2024-08-18T21:06:10.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdbf8133470 0x7fdbf8133850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 10 monclient(hunting): picked mon.noname-h con 0x7fdbf8133470 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:10.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdbf8073f10 0x7fdbf80a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 10 monclient(hunting): picked mon.noname-f con 0x7fdbf8073f10 addr v2:172.21.15.157:3300/0 2024-08-18T21:06:10.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdbf80a7be0 0x7fdbf80a8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 10 monclient(hunting): picked mon.noname-e con 0x7fdbf80a7be0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:10.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fdbf8133d90 con 0x7fdbf8073f10 2024-08-18T21:06:10.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdbf806f9f0 con 0x7fdbf8133470 2024-08-18T21:06:10.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fdbf8073530 con 0x7fdbf80a7be0 2024-08-18T21:06:10.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:10.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdc00153640 10 monclient(hunting): authenticate will time out at 1137.987134s 2024-08-18T21:06:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdbf80a7be0 0x7fdbf80a8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdbf80a7be0 0x7fdbf80a8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:55966/0 (socket says 172.21.15.5:55966) 2024-08-18T21:06:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 1 -- 172.21.15.5:0/3183303697 learned_addr learned my addr 172.21.15.5:0/3183303697 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 10 monclient(hunting): get_auth_request con 0x7fdbf80a7be0 auth_method 0 2024-08-18T21:06:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfd6ee640 1 --2- 172.21.15.5:0/3183303697 >> v2:172.21.15.157:3300/0 conn(0x7fdbf8073f10 0x7fdbf80a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfd6ee640 10 monclient(hunting): get_auth_request con 0x7fdbf8073f10 auth_method 0 2024-08-18T21:06:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfd6ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfd6ee640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfd6ee640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 10 monclient(hunting): handle_auth_done global_id 54134 payload 274 2024-08-18T21:06:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 1 -- 172.21.15.5:0/3183303697 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdbf8133470 msgr2=0x7fdbf8133850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 1 --2- 172.21.15.5:0/3183303697 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdbf8133470 0x7fdbf8133850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 1 -- 172.21.15.5:0/3183303697 >> v2:172.21.15.157:3300/0 conn(0x7fdbf8073f10 msgr2=0x7fdbf80a76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 1 --2- 172.21.15.5:0/3183303697 >> v2:172.21.15.157:3300/0 conn(0x7fdbf8073f10 0x7fdbf80a76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 10 monclient: _finish_hunting 0 2024-08-18T21:06:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 1 monclient: found mon.noname-e 2024-08-18T21:06:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:06:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.970+0000 7fdbfe6f0640 1 -- 172.21.15.5:0/3183303697 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf80a2ed0 con 0x7fdbf80a7be0 2024-08-18T21:06:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.974+0000 7fdbfe6f0640 1 -- 172.21.15.5:0/3183303697 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdbf80a7be0 msgr2=0x7fdbf80a8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.974+0000 7fdbfe6f0640 1 --2- 172.21.15.5:0/3183303697 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdbf80a7be0 0x7fdbf80a8090 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0009e80 tx=0x7fdbf001c8a0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=845ba77aa9346c38 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfceed640 1 -- 172.21.15.5:0/3183303697 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbf00090d0 con 0x7fdbf80a7be0 2024-08-18T21:06:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfceed640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfceed640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:06:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfceed640 10 monclient: dump: 2024-08-18T21:06:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.984 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfceed640 10 monclient: _finish_auth 0 2024-08-18T21:06:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfceed640 10 monclient: _check_auth_tickets 2024-08-18T21:06:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfceed640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfceed640 1 -- 172.21.15.5:0/3183303697 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf00a5b50 con 0x7fdbf80a7be0 2024-08-18T21:06:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 5 monclient: authenticate success, global_id 54134 2024-08-18T21:06:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:06:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfceed640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfceed640 1 -- 172.21.15.5:0/3183303697 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbf00a5d00 con 0x7fdbf80a7be0 2024-08-18T21:06:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfceed640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfceed640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfceed640 10 monclient: dump: 2024-08-18T21:06:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.986 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:10.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 4 set_mon_vals no callback set 2024-08-18T21:06:10.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 10 monclient: shutdown 2024-08-18T21:06:10.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:10.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 -- 172.21.15.5:0/3183303697 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdbf80a7be0 msgr2=0x7fdbf80a8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 --2- 172.21.15.5:0/3183303697 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdbf80a7be0 0x7fdbf80a8090 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0009e80 tx=0x7fdbf001c8a0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 -- 172.21.15.5:0/3183303697 shutdown_connections 2024-08-18T21:06:10.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 --2- 172.21.15.5:0/3183303697 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdbf80a7be0 0x7fdbf80a8090 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 --2- 172.21.15.5:0/3183303697 >> v2:172.21.15.157:3300/0 conn(0x7fdbf8073f10 0x7fdbf80a76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 --2- 172.21.15.5:0/3183303697 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdbf8133470 0x7fdbf8133850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 -- 172.21.15.5:0/3183303697 >> 172.21.15.5:0/3183303697 conn(0x7fdbf80a8d90 msgr2=0x7fdbf80a5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:10.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 -- 172.21.15.5:0/3183303697 shutdown_connections 2024-08-18T21:06:10.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 -- 172.21.15.5:0/3183303697 wait complete. 2024-08-18T21:06:10.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 10 monclient: build_initial_monmap 2024-08-18T21:06:10.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 10 monclient: monmap: 2024-08-18T21:06:10.988 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:10.988 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:10.988 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:10.988 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:10.988 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:10.988 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.988 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:10.988 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:10.988 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:10.988 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:10.988 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:10.988 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:10.989 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:10.989 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:10.989 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:10.989 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 Processor -- start 2024-08-18T21:06:10.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 -- start start 2024-08-18T21:06:10.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 10 monclient: init 2024-08-18T21:06:10.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:10.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 10 monclient: _add_conns ranks=[1,0,4,2,5,7,8,3,6] 2024-08-18T21:06:10.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbf8073f10 0x7fdbf80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 10 monclient(hunting): picked mon.noname-f con 0x7fdbf8073f10 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:06:10.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf80a7be0 0x7fdbf8070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 10 monclient(hunting): picked mon.noname-a con 0x7fdbf80a7be0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:06:10.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf8133470 0x7fdbf8071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:10.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 10 monclient(hunting): picked mon.noname-c con 0x7fdbf8133470 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:10.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf8068ae0 con 0x7fdbf80a7be0 2024-08-18T21:06:10.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf8068960 con 0x7fdbf8073f10 2024-08-18T21:06:10.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:10.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fdbf81414a0 con 0x7fdbf8133470 2024-08-18T21:06:10.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:10.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdc00153640 10 monclient(hunting): authenticate will time out at 1137.994452s 2024-08-18T21:06:10.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf8133470 0x7fdbf8071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfd6ee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf80a7be0 0x7fdbf8070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf8133470 0x7fdbf8071460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:60306/0 (socket says 172.21.15.5:60306) 2024-08-18T21:06:10.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 1 -- 172.21.15.5:0/750565852 learned_addr learned my addr 172.21.15.5:0/750565852 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:10.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 10 monclient(hunting): get_auth_request con 0x7fdbf8133470 auth_method 0 2024-08-18T21:06:10.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfd6ee640 10 monclient(hunting): get_auth_request con 0x7fdbf80a7be0 auth_method 0 2024-08-18T21:06:10.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfd6ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfd6ee640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfd6ee640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfd6ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfd6ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfd6ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfdeef640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbf8073f10 0x7fdbf80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:10.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfdeef640 10 monclient(hunting): get_auth_request con 0x7fdbf8073f10 auth_method 0 2024-08-18T21:06:10.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfdeef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:10.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfdeef640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:10.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfdeef640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:10.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfdeef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:10.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfdeef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:10.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfdeef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:10.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 10 monclient(hunting): handle_auth_done global_id 5089 payload 824 2024-08-18T21:06:10.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 1 -- 172.21.15.5:0/750565852 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbf8073f10 msgr2=0x7fdbf80709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbf8073f10 0x7fdbf80709e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 1 -- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf80a7be0 msgr2=0x7fdbf8070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:10.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf80a7be0 0x7fdbf8070f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:10.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 10 monclient: _finish_hunting 0 2024-08-18T21:06:10.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 1 monclient: found mon.noname-c 2024-08-18T21:06:10.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:10.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:06:10.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfe6f0640 1 -- 172.21.15.5:0/750565852 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf80724d0 con 0x7fdbf8133470 2024-08-18T21:06:10.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.978+0000 7fdbfd6ee640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf80a7be0 0x7fdbf8070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:06:10.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbfe6f0640 1 -- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf8133470 msgr2=0x7fdbf8071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:10.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbfe6f0640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf8133470 0x7fdbf8071460 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdbf001c6d0 tx=0x7fdbf0019640 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:10.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbee7fc640 1 -- 172.21.15.5:0/750565852 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbf00bc020 con 0x7fdbf8133470 2024-08-18T21:06:10.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:10.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbee7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:06:10.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbee7fc640 10 monclient: dump: 2024-08-18T21:06:10.997 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:10.997 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:10.997 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.997 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:10.997 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:10.997 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:10.997 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:10.997 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:10.997 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:10.997 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:10.997 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:10.997 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:10.998 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:10.998 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:10.998 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:10.998 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:10.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbee7fc640 10 monclient: _finish_auth 0 2024-08-18T21:06:10.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbee7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:06:10.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:10.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbee7fc640 1 -- 172.21.15.5:0/750565852 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf0003bb0 con 0x7fdbf8133470 2024-08-18T21:06:10.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdc00153640 5 monclient: authenticate success, global_id 5089 2024-08-18T21:06:10.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdc00153640 10 monclient: _renew_subs 2024-08-18T21:06:10.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdc00153640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:06:10.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdc00153640 1 -- 172.21.15.5:0/750565852 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf80a5390 con 0x7fdbf8133470 2024-08-18T21:06:10.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbee7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbee7fc640 1 -- 172.21.15.5:0/750565852 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbf0003d60 con 0x7fdbf8133470 2024-08-18T21:06:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbee7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbee7fc640 10 monclient: dump: 2024-08-18T21:06:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.002 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.002 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.002 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.002 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.002 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.002 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.002 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.002 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.002 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.002 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.002 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.002 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.002 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.003 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.003 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbeffff640 4 set_mon_vals no callback set 2024-08-18T21:06:11.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdc00153640 10 monclient: _renew_subs 2024-08-18T21:06:11.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdc00153640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:06:11.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdc00153640 1 -- 172.21.15.5:0/750565852 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf80a1b30 con 0x7fdbf8133470 2024-08-18T21:06:11.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdc00153640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:11.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdc00153640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf81d1450 0x7fdbf81d1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdc00153640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdc00153640 1 -- 172.21.15.5:0/750565852 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fdbf8051140 con 0x7fdbf81d1450 2024-08-18T21:06:11.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbfdeef640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf81d1450 0x7fdbf81d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbfdeef640 10 monclient: get_auth_request con 0x7fdbf81d1450 auth_method 0 2024-08-18T21:06:11.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbfdeef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbfdeef640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbfdeef640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbfdeef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbfdeef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbfdeef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbfe6f0640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf8133470 0x7fdbf8071460 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdbf001c6d0 tx=0x7fdbf0019640 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7fdbf00bf020 mgrmap(e 5) 2024-08-18T21:06:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbfdeef640 10 monclient(hunting): handle_auth_done global_id 54105 payload 824 2024-08-18T21:06:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbfdeef640 1 -- 172.21.15.5:0/750565852 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdbf80a76a0 con 0x7fdbf81d1450 2024-08-18T21:06:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbee7fc640 1 -- 172.21.15.5:0/750565852 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fdbf00bf020 con 0x7fdbf8133470 2024-08-18T21:06:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbee7fc640 1 --2- 172.21.15.5:0/750565852 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbdc03bdc0 0x7fdbdc03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbfd6ee640 1 --2- 172.21.15.5:0/750565852 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbdc03bdc0 0x7fdbdc03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.982+0000 7fdbfd6ee640 10 monclient: get_auth_request con 0x7fdbdc03bdc0 auth_method 0 2024-08-18T21:06:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.986+0000 7fdbfdeef640 1 -- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf81d1450 msgr2=0x7fdbf81d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.986+0000 7fdbfdeef640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf81d1450 0x7fdbf81d1830 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400e7a0 tx=0x7fdbf400ec60 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.986+0000 7fdbee7fc640 1 -- 172.21.15.5:0/750565852 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbf4017070 con 0x7fdbf81d1450 2024-08-18T21:06:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.986+0000 7fdbee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.986+0000 7fdbee7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.986+0000 7fdbee7fc640 10 monclient: dump: 2024-08-18T21:06:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.006 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.986+0000 7fdbee7fc640 1 -- 172.21.15.5:0/750565852 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdbf400c9b0 con 0x7fdbf81d1450 2024-08-18T21:06:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.986+0000 7fdbee7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.986+0000 7fdbee7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.986+0000 7fdbee7fc640 1 -- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf81d1450 msgr2=0x7fdbf81d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.986+0000 7fdbee7fc640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf81d1450 0x7fdbf81d1830 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400e7a0 tx=0x7fdbf400ec60 comp rx=0 tx=0).stop 2024-08-18T21:06:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.986+0000 7fdbee7fc640 1 -- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf81d1450 msgr2=0x7fdbf81d1830 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.986+0000 7fdbee7fc640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf81d1450 0x7fdbf81d1830 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400e7a0 tx=0x7fdbf400ec60 comp rx=0 tx=0).stop 2024-08-18T21:06:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.986+0000 7fdbfd6ee640 1 --2- 172.21.15.5:0/750565852 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbdc03bdc0 0x7fdbdc03e280 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8072140 tx=0x7fdbe8008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdc00153640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdc00153640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf81d1d70 0x7fdbf8130220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdc00153640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdc00153640 1 -- 172.21.15.5:0/750565852 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fdbf8136aa0 con 0x7fdbf81d1d70 2024-08-18T21:06:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbfdeef640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf81d1d70 0x7fdbf8130220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbfdeef640 10 monclient: get_auth_request con 0x7fdbf81d1d70 auth_method 0 2024-08-18T21:06:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbfdeef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbfdeef640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbfdeef640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbfdeef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbfdeef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbfdeef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbfdeef640 10 monclient(hunting): handle_auth_done global_id 54114 payload 824 2024-08-18T21:06:11.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbfdeef640 1 -- 172.21.15.5:0/750565852 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdbf806d960 con 0x7fdbf81d1d70 2024-08-18T21:06:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbfdeef640 1 -- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf81d1d70 msgr2=0x7fdbf8130220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbfdeef640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf81d1d70 0x7fdbf8130220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400e7a0 tx=0x7fdbf4004740 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbee7fc640 1 -- 172.21.15.5:0/750565852 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbf4017070 con 0x7fdbf81d1d70 2024-08-18T21:06:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbee7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbee7fc640 10 monclient: dump: 2024-08-18T21:06:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.010 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbee7fc640 1 -- 172.21.15.5:0/750565852 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9246 (secure 0 0 0) 0x7fdbf4006540 con 0x7fdbf81d1d70 2024-08-18T21:06:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbee7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbee7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbee7fc640 1 -- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf81d1d70 msgr2=0x7fdbf8130220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbee7fc640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf81d1d70 0x7fdbf8130220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400e7a0 tx=0x7fdbf4004740 comp rx=0 tx=0).stop 2024-08-18T21:06:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbee7fc640 1 -- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf81d1d70 msgr2=0x7fdbf8130220 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbee7fc640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf81d1d70 0x7fdbf8130220 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400e7a0 tx=0x7fdbf4004740 comp rx=0 tx=0).stop 2024-08-18T21:06:11.011 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:11.011 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:11.011 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:11.011 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:11.012 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:11.012 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 27111, 2024-08-18T21:06:11.012 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:11.012 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:11.012 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:11.012 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:11.012 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:11.012 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:11.012 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:11.012 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:11.012 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:11.012 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:11.012 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.013 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:06:11.013 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:11.013 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:11.013 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:11.013 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.013 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.013 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.013 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.013 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.013 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.013 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.013 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.013 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.014 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.014 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.014 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.014 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:11.014 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:11.014 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.014 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.014 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.014 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.014 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.014 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.014 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.014 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.015 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.015 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.015 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.015 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.015 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:11.015 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:11.015 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:11.015 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:11.015 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:11.015 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:11.015 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:11.015 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:11.016 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:11.016 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:11.016 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:11.016 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:11.016 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:11.016 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:11.016 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:11.016 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:11.016 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:11.016 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.016 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.016 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.016 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.017 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.017 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.017 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.017 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.017 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.017 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.017 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.017 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.017 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:11.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.017 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:11.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.017 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:11.018 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:11.018 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.018 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.018 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.018 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:11.018 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.018 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.018 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:11.018 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.018 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.019 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.019 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:11.019 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:11.019 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.019 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.019 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.019 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.019 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:11.019 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:11.019 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.019 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.019 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.020 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:11.020 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.020 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:11.020 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.020 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.020 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.020 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:11.020 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:11.021 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.021 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.021 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.021 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:11.021 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:11.021 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.021 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.021 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.021 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:11.021 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.022 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.022 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:11.022 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.022 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.022 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.022 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:11.022 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:11.022 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.022 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.023 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.023 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:11.023 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:11.023 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.023 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.023 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:11.023 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.024 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:11.024 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.024 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.024 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.024 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:11.024 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:11.024 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.024 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.024 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.024 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:11.024 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:11.024 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:11.025 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:11.025 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.025 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.025 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:11.025 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:11.025 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.026 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.026 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.026 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:11.026 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:11.026 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.026 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.026 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.026 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:11.026 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:11.027 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.027 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.027 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:11.027 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:11.027 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.027 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.027 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.027 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:11.028 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:11.028 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.028 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.028 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.028 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:11.028 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.028 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.028 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:11.028 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.028 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.028 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.029 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:11.029 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:11.029 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.029 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.029 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.029 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:11.029 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:11.029 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.029 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.029 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.029 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:11.029 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.030 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:11.030 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.030 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.030 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.030 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:11.030 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:11.030 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.030 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.030 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.031 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:11.031 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:11.031 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.031 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:11.031 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.031 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.032 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:11.032 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.032 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.032 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.032 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:11.032 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:11.032 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.032 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.032 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.032 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.032 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.033 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:11.033 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:11.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.033 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:11.033 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:11.033 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:11.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.033 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.033 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:11.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.033 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:11.033 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:11.033 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:11.034 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.034 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.034 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:11.034 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:11.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdc00153640 1 -- 172.21.15.5:0/750565852 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbdc03bdc0 msgr2=0x7fdbdc03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdc00153640 1 --2- 172.21.15.5:0/750565852 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbdc03bdc0 0x7fdbdc03e280 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8072140 tx=0x7fdbe8008040 comp rx=0 tx=0).stop 2024-08-18T21:06:11.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdc00153640 10 monclient: shutdown 2024-08-18T21:06:11.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdc00153640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:11.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdc00153640 1 -- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf8133470 msgr2=0x7fdbf8071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbfe6f0640 1 -- 172.21.15.5:0/750565852 reap_dead start 2024-08-18T21:06:11.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdc00153640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf8133470 0x7fdbf8071460 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdbf001c6d0 tx=0x7fdbf0019640 comp rx=0 tx=0).stop 2024-08-18T21:06:11.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.994+0000 7fdbee7fc640 1 -- 172.21.15.5:0/750565852 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(78..78 src has 22..78) ==== 3506+0+0 (unknown 0 0 0) 0x7fdbf00e9480 con 0x7fdbf8133470 2024-08-18T21:06:11.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.998+0000 7fdc00153640 1 -- 172.21.15.5:0/750565852 shutdown_connections 2024-08-18T21:06:11.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.998+0000 7fdc00153640 1 --2- 172.21.15.5:0/750565852 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf8133470 0x7fdbf8071460 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.998+0000 7fdc00153640 1 -- 172.21.15.5:0/750565852 >> 172.21.15.5:0/750565852 conn(0x7fdbf80a8d90 msgr2=0x7fdbf8131650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:11.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.998+0000 7fdc00153640 1 -- 172.21.15.5:0/750565852 shutdown_connections 2024-08-18T21:06:11.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:10.998+0000 7fdc00153640 1 -- 172.21.15.5:0/750565852 wait complete. 2024-08-18T21:06:11.036 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:11.037 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:06:11.037 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:06:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 10 monclient: get_monmap_and_config 2024-08-18T21:06:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 10 monclient: build_initial_monmap 2024-08-18T21:06:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 10 monclient: monmap: 2024-08-18T21:06:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:11.156742+0000 2024-08-18T21:06:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:11.156742+0000 2024-08-18T21:06:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:11.157 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 1 Processor -- start 2024-08-18T21:06:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 1 -- start start 2024-08-18T21:06:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 10 monclient: init 2024-08-18T21:06:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 10 monclient: _add_conns ranks=[1,3,9,7,6,4,5,10,2,8,0] 2024-08-18T21:06:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f1a2c0a6bd0 addr v1:172.21.15.157:6789/0 2024-08-18T21:06:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a2c09f080 0x7f1a2c13ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 10 monclient(hunting): picked mon.noname-g con 0x7f1a2c09f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:06:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a2c0a76c0 0x7f1a2c141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 10 monclient(hunting): picked mon.noname-a con 0x7f1a2c0a76c0 addr v2:172.21.15.5:3300/0 2024-08-18T21:06:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2c0a7fb0 con 0x7f1a2c0a6bd0 2024-08-18T21:06:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1a2c09e4c0 con 0x7f1a2c0a76c0 2024-08-18T21:06:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1a2c06f930 con 0x7f1a2c09f080 2024-08-18T21:06:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a3320c640 10 monclient(hunting): authenticate will time out at 1138.169921s 2024-08-18T21:06:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a2c0a76c0 0x7f1a2c141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a2c0a76c0 0x7f1a2c141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40656/0 (socket says 172.21.15.5:40656) 2024-08-18T21:06:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 1 -- 172.21.15.5:0/2774912310 learned_addr learned my addr 172.21.15.5:0/2774912310 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 10 monclient(hunting): get_auth_request con 0x7f1a2c0a76c0 auth_method 0 2024-08-18T21:06:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a2bfff640 1 --2- 172.21.15.5:0/2774912310 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a2c09f080 0x7f1a2c13ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a2bfff640 10 monclient(hunting): get_auth_request con 0x7f1a2c09f080 auth_method 0 2024-08-18T21:06:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a2bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a2bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a2bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a2bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 10 monclient(hunting): handle_auth_done global_id 5112 payload 274 2024-08-18T21:06:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 1 -- 172.21.15.5:0/2774912310 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a2c09f080 msgr2=0x7f1a2c13ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 1 --2- 172.21.15.5:0/2774912310 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a2c09f080 0x7f1a2c13ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 1 -- 172.21.15.5:0/2774912310 >> v1:172.21.15.157:6789/0 conn(0x7f1a2c0a6bd0 legacy=0x7f1a2c0a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 10 monclient: _finish_hunting 0 2024-08-18T21:06:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 1 monclient: found mon.noname-a 2024-08-18T21:06:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:06:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.154+0000 7f1a317a9640 1 -- 172.21.15.5:0/2774912310 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2c09de70 con 0x7f1a2c0a76c0 2024-08-18T21:06:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a317a9640 1 -- 172.21.15.5:0/2774912310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a2c0a76c0 msgr2=0x7f1a2c141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a317a9640 1 --2- 172.21.15.5:0/2774912310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a2c0a76c0 0x7f1a2c141330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009e50 tx=0x7f1a1c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db813f7616d96d67 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a2b7fe640 1 -- 172.21.15.5:0/2774912310 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a1c0090d0 con 0x7f1a2c0a76c0 2024-08-18T21:06:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a2b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:06:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a2b7fe640 10 monclient: dump: 2024-08-18T21:06:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.168 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a2b7fe640 10 monclient: _finish_auth 0 2024-08-18T21:06:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a2b7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:06:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a2b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a2b7fe640 1 -- 172.21.15.5:0/2774912310 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0a5a30 con 0x7f1a2c0a76c0 2024-08-18T21:06:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a3320c640 5 monclient: authenticate success, global_id 5112 2024-08-18T21:06:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a3320c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:06:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a2b7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a3320c640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a3320c640 4 set_mon_vals no callback set 2024-08-18T21:06:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a2b7fe640 1 -- 172.21.15.5:0/2774912310 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a1c0a5be0 con 0x7f1a2c0a76c0 2024-08-18T21:06:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a2b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:06:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a2b7fe640 10 monclient: dump: 2024-08-18T21:06:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.170 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.170 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.170 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.170 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.170 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.170 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.170 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.170 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.170 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a3320c640 10 monclient: shutdown 2024-08-18T21:06:11.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a3320c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:11.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a3320c640 1 -- 172.21.15.5:0/2774912310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a2c0a76c0 msgr2=0x7f1a2c141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a3320c640 1 --2- 172.21.15.5:0/2774912310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a2c0a76c0 0x7f1a2c141330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009e50 tx=0x7f1a1c01c8f0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a3320c640 1 -- 172.21.15.5:0/2774912310 shutdown_connections 2024-08-18T21:06:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a3320c640 1 --2- 172.21.15.5:0/2774912310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a2c0a76c0 0x7f1a2c141330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a3320c640 1 --2- 172.21.15.5:0/2774912310 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a2c09f080 0x7f1a2c13ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a3320c640 1 -- 172.21.15.5:0/2774912310 >> 172.21.15.5:0/2774912310 conn(0x7f1a2c068700 msgr2=0x7f1a2c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a3320c640 1 -- 172.21.15.5:0/2774912310 shutdown_connections 2024-08-18T21:06:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.158+0000 7f1a3320c640 1 -- 172.21.15.5:0/2774912310 wait complete. 2024-08-18T21:06:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 10 monclient: build_initial_monmap 2024-08-18T21:06:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 10 monclient: monmap: 2024-08-18T21:06:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:11.172 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 1 Processor -- start 2024-08-18T21:06:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 1 -- start start 2024-08-18T21:06:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 10 monclient: init 2024-08-18T21:06:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 10 monclient: _add_conns ranks=[3,1,6,0,5,7,4,2,8] 2024-08-18T21:06:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a2c09f080 0x7f1a2c1291c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 10 monclient(hunting): picked mon.noname-g con 0x7f1a2c09f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:06:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a2c0a6bd0 0x7f1a2c127160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 10 monclient(hunting): picked mon.noname-f con 0x7f1a2c0a6bd0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:06:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1a2c0a76c0 0x7f1a2c140030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 10 monclient(hunting): picked mon.noname-d con 0x7f1a2c0a76c0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c144210 con 0x7f1a2c0a6bd0 2024-08-18T21:06:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1a2c144090 con 0x7f1a2c09f080 2024-08-18T21:06:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f1a2c144390 con 0x7f1a2c0a76c0 2024-08-18T21:06:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a3320c640 10 monclient(hunting): authenticate will time out at 1138.177434s 2024-08-18T21:06:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1a2c0a76c0 0x7f1a2c140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1a2c0a76c0 0x7f1a2c140030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:45378/0 (socket says 172.21.15.5:45378) 2024-08-18T21:06:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 1 -- 172.21.15.5:0/1608154691 learned_addr learned my addr 172.21.15.5:0/1608154691 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 10 monclient(hunting): get_auth_request con 0x7f1a2c0a76c0 auth_method 0 2024-08-18T21:06:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a30fa8640 1 --2- 172.21.15.5:0/1608154691 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a2c09f080 0x7f1a2c1291c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a2bfff640 1 --2- 172.21.15.5:0/1608154691 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a2c0a6bd0 0x7f1a2c127160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a30fa8640 10 monclient(hunting): get_auth_request con 0x7f1a2c09f080 auth_method 0 2024-08-18T21:06:11.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a30fa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a30fa8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a30fa8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a2bfff640 10 monclient(hunting): get_auth_request con 0x7f1a2c0a6bd0 auth_method 0 2024-08-18T21:06:11.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a2bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 10 monclient(hunting): handle_auth_done global_id 54123 payload 824 2024-08-18T21:06:11.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 1 -- 172.21.15.5:0/1608154691 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a2c09f080 msgr2=0x7f1a2c1291c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 1 --2- 172.21.15.5:0/1608154691 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a2c09f080 0x7f1a2c1291c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 1 -- 172.21.15.5:0/1608154691 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a2c0a6bd0 msgr2=0x7f1a2c127160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 1 --2- 172.21.15.5:0/1608154691 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a2c0a6bd0 0x7f1a2c127160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 10 monclient: _finish_hunting 0 2024-08-18T21:06:11.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 1 monclient: found mon.noname-d 2024-08-18T21:06:11.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:11.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:06:11.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.162+0000 7f1a317a9640 1 -- 172.21.15.5:0/1608154691 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2c140cd0 con 0x7f1a2c0a76c0 2024-08-18T21:06:11.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a317a9640 1 -- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1a2c0a76c0 msgr2=0x7f1a2c140030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a317a9640 1 --2- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1a2c0a76c0 0x7f1a2c140030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0af040 tx=0x7f1a1c019690 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a297fa640 1 -- 172.21.15.5:0/1608154691 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a1c0bc020 con 0x7f1a2c0a76c0 2024-08-18T21:06:11.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a297fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:06:11.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a297fa640 10 monclient: dump: 2024-08-18T21:06:11.180 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.180 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.180 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.180 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.180 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.180 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.181 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a297fa640 10 monclient: _finish_auth 0 2024-08-18T21:06:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a297fa640 10 monclient: _check_auth_tickets 2024-08-18T21:06:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a297fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a297fa640 1 -- 172.21.15.5:0/1608154691 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c003e10 con 0x7f1a2c0a76c0 2024-08-18T21:06:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a297fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a297fa640 1 -- 172.21.15.5:0/1608154691 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a1c0044b0 con 0x7f1a2c0a76c0 2024-08-18T21:06:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a3320c640 5 monclient: authenticate success, global_id 54123 2024-08-18T21:06:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a3320c640 10 monclient: _renew_subs 2024-08-18T21:06:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a3320c640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a3320c640 1 -- 172.21.15.5:0/1608154691 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2c0aba70 con 0x7f1a2c0a76c0 2024-08-18T21:06:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a2affd640 4 set_mon_vals no callback set 2024-08-18T21:06:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a297fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a297fa640 10 monclient: dump: 2024-08-18T21:06:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.183 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a3320c640 10 monclient: _renew_subs 2024-08-18T21:06:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a3320c640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a3320c640 1 -- 172.21.15.5:0/1608154691 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a2c12a9c0 con 0x7f1a2c0a76c0 2024-08-18T21:06:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a3320c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a3320c640 1 --2- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1a2c140570 0x7f1a2c1d1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a3320c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a3320c640 1 -- 172.21.15.5:0/1608154691 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f1a2c051140 con 0x7f1a2c140570 2024-08-18T21:06:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a30fa8640 1 --2- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1a2c140570 0x7f1a2c1d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a30fa8640 10 monclient: get_auth_request con 0x7f1a2c140570 auth_method 0 2024-08-18T21:06:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a297fa640 1 -- 172.21.15.5:0/1608154691 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f1a1c0bf020 con 0x7f1a2c0a76c0 2024-08-18T21:06:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a30fa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a30fa8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a30fa8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a30fa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a30fa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a30fa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a297fa640 1 --2- 172.21.15.5:0/1608154691 >> v2:172.21.15.157:6812/631023601 conn(0x7f1a0c03bdc0 0x7f1a0c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a297fa640 1 -- 172.21.15.5:0/1608154691 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(78..78 src has 22..78) ==== 3506+0+0 (secure 0 0 0) 0x7f1a1c0e9390 con 0x7f1a2c0a76c0 2024-08-18T21:06:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a30fa8640 10 monclient(hunting): handle_auth_done global_id 54143 payload 824 2024-08-18T21:06:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a30fa8640 1 -- 172.21.15.5:0/1608154691 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a2c0a6040 con 0x7f1a2c140570 2024-08-18T21:06:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a2bfff640 1 --2- 172.21.15.5:0/1608154691 >> v2:172.21.15.157:6812/631023601 conn(0x7f1a0c03bdc0 0x7f1a0c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.166+0000 7f1a2bfff640 10 monclient: get_auth_request con 0x7f1a0c03bdc0 auth_method 0 2024-08-18T21:06:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.170+0000 7f1a30fa8640 1 -- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1a2c140570 msgr2=0x7f1a2c1d1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.170+0000 7f1a30fa8640 1 --2- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1a2c140570 0x7f1a2c1d1480 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400e450 tx=0x7f1a2400e910 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.170+0000 7f1a297fa640 1 -- 172.21.15.5:0/1608154691 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a24006c50 con 0x7f1a2c140570 2024-08-18T21:06:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.170+0000 7f1a297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.170+0000 7f1a297fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.170+0000 7f1a297fa640 10 monclient: dump: 2024-08-18T21:06:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.187 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.170+0000 7f1a297fa640 1 -- 172.21.15.5:0/1608154691 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1a24007450 con 0x7f1a2c140570 2024-08-18T21:06:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.170+0000 7f1a297fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.170+0000 7f1a297fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.170+0000 7f1a297fa640 1 -- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1a2c140570 msgr2=0x7f1a2c1d1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.170+0000 7f1a297fa640 1 --2- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1a2c140570 0x7f1a2c1d1480 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400e450 tx=0x7f1a2400e910 comp rx=0 tx=0).stop 2024-08-18T21:06:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.170+0000 7f1a297fa640 1 -- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1a2c140570 msgr2=0x7f1a2c1d1480 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.170+0000 7f1a297fa640 1 --2- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1a2c140570 0x7f1a2c1d1480 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400e450 tx=0x7f1a2400e910 comp rx=0 tx=0).stop 2024-08-18T21:06:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.170+0000 7f1a2bfff640 1 --2- 172.21.15.5:0/1608154691 >> v2:172.21.15.157:6812/631023601 conn(0x7f1a0c03bdc0 0x7f1a0c03e280 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c1283b0 tx=0x7f1a14008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.174+0000 7f1a3320c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.174+0000 7f1a3320c640 1 --2- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1a2c1d19c0 0x7f1a2c1d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.174+0000 7f1a3320c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.174+0000 7f1a3320c640 1 -- 172.21.15.5:0/1608154691 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f1a2c1d2310 con 0x7f1a2c1d19c0 2024-08-18T21:06:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.174+0000 7f1a30fa8640 1 --2- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1a2c1d19c0 0x7f1a2c1d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.174+0000 7f1a30fa8640 10 monclient: get_auth_request con 0x7f1a2c1d19c0 auth_method 0 2024-08-18T21:06:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.174+0000 7f1a30fa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.174+0000 7f1a30fa8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.174+0000 7f1a30fa8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.174+0000 7f1a30fa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.174+0000 7f1a30fa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.174+0000 7f1a30fa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.174+0000 7f1a30fa8640 10 monclient(hunting): handle_auth_done global_id 54152 payload 824 2024-08-18T21:06:11.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.174+0000 7f1a30fa8640 1 -- 172.21.15.5:0/1608154691 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1a2c0746d0 con 0x7f1a2c1d19c0 2024-08-18T21:06:11.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a30fa8640 1 -- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1a2c1d19c0 msgr2=0x7f1a2c1d1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a30fa8640 1 --2- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1a2c1d19c0 0x7f1a2c1d1dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400e450 tx=0x7f1a24003770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a297fa640 1 -- 172.21.15.5:0/1608154691 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a24028890 con 0x7f1a2c1d19c0 2024-08-18T21:06:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a297fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a297fa640 10 monclient: dump: 2024-08-18T21:06:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.191 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a297fa640 1 -- 172.21.15.5:0/1608154691 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9246 (secure 0 0 0) 0x7f1a24028420 con 0x7f1a2c1d19c0 2024-08-18T21:06:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a297fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a297fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a297fa640 1 -- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1a2c1d19c0 msgr2=0x7f1a2c1d1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a297fa640 1 --2- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1a2c1d19c0 0x7f1a2c1d1dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400e450 tx=0x7f1a24003770 comp rx=0 tx=0).stop 2024-08-18T21:06:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a297fa640 1 -- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1a2c1d19c0 msgr2=0x7f1a2c1d1dd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a297fa640 1 --2- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1a2c1d19c0 0x7f1a2c1d1dd0 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400e450 tx=0x7f1a24003770 comp rx=0 tx=0).stop 2024-08-18T21:06:11.192 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 27299, 2024-08-18T21:06:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:06:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.198 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:11.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:11.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.198 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:11.198 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:11.198 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.198 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.198 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.198 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:11.198 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.199 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.199 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:11.199 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.199 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.199 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.199 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:11.199 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:11.199 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.199 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.199 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.200 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:11.200 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:11.200 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.200 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.200 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:11.200 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.200 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:11.201 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.201 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.201 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.201 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:11.201 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:11.201 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.201 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.201 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.201 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.201 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:11.201 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:11.202 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.202 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.202 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.202 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.202 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:11.202 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.202 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.202 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.202 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:11.202 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.202 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.203 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:11.205 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:11.205 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.205 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.206 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.206 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:11.206 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:11.206 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.206 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.206 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.206 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:11.206 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:11.207 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.207 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.207 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:11.207 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:11.207 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.207 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.207 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.208 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:11.208 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:11.208 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.208 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.208 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.208 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:11.208 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.208 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.208 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:11.209 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.209 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.209 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.209 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:11.209 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:11.209 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.209 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.209 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.209 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:11.209 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:11.210 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.210 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.210 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.210 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:11.210 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.210 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.210 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:11.210 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.210 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.211 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.211 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:11.211 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:11.211 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.211 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.211 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.211 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.211 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:11.211 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:11.211 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.211 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.212 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.212 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:11.212 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.212 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.212 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:11.212 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.212 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.212 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.212 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:11.212 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:11.212 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.213 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.213 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.213 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:11.213 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:11.213 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.213 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.213 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.213 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:11.213 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.214 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.214 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:11.214 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.214 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.214 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.214 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:11.214 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:11.214 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.214 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.214 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.216 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:11.216 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.216 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.216 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.216 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:11.216 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:11.216 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.216 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.216 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.216 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.216 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.216 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:11.216 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:11.216 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.217 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:11.217 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:11.217 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:11.217 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.217 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.217 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:11.217 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.217 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:11.217 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:11.217 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:11.217 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.217 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.218 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:11.218 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:11.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a3320c640 1 -- 172.21.15.5:0/1608154691 >> v2:172.21.15.157:6812/631023601 conn(0x7f1a0c03bdc0 msgr2=0x7f1a0c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a3320c640 1 --2- 172.21.15.5:0/1608154691 >> v2:172.21.15.157:6812/631023601 conn(0x7f1a0c03bdc0 0x7f1a0c03e280 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c1283b0 tx=0x7f1a14008040 comp rx=0 tx=0).stop 2024-08-18T21:06:11.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a3320c640 10 monclient: shutdown 2024-08-18T21:06:11.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a3320c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:11.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a3320c640 1 -- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1a2c0a76c0 msgr2=0x7f1a2c140030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a3320c640 1 --2- 172.21.15.5:0/1608154691 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1a2c0a76c0 0x7f1a2c140030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0af040 tx=0x7f1a1c019690 comp rx=0 tx=0).stop 2024-08-18T21:06:11.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a317a9640 1 -- 172.21.15.5:0/1608154691 reap_dead start 2024-08-18T21:06:11.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a317a9640 1 -- 172.21.15.5:0/1608154691 reap_dead start 2024-08-18T21:06:11.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a3320c640 1 -- 172.21.15.5:0/1608154691 shutdown_connections 2024-08-18T21:06:11.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a3320c640 1 -- 172.21.15.5:0/1608154691 >> 172.21.15.5:0/1608154691 conn(0x7f1a2c068700 msgr2=0x7f1a2c0a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:11.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a3320c640 1 -- 172.21.15.5:0/1608154691 shutdown_connections 2024-08-18T21:06:11.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.178+0000 7f1a3320c640 1 -- 172.21.15.5:0/1608154691 wait complete. 2024-08-18T21:06:11.220 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:11.220 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:06:11.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:06:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 10 monclient: get_monmap_and_config 2024-08-18T21:06:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 10 monclient: build_initial_monmap 2024-08-18T21:06:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 10 monclient: monmap: 2024-08-18T21:06:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:11.340643+0000 2024-08-18T21:06:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:11.340643+0000 2024-08-18T21:06:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:11.341 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 1 Processor -- start 2024-08-18T21:06:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 1 -- start start 2024-08-18T21:06:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 10 monclient: init 2024-08-18T21:06:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 10 monclient: _add_conns ranks=[4,5,6,3,7,8,10,9,2,0,1] 2024-08-18T21:06:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f518406c950 0x7f518406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 10 monclient(hunting): picked mon.noname-c con 0x7f518406c950 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f518406d270 0x7f518413dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 10 monclient(hunting): picked mon.noname-h con 0x7f518406d270 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f518413e3e0 0x7f518413e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 10 monclient(hunting): picked mon.noname-d con 0x7f518413e3e0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f518409f780 con 0x7f518406c950 2024-08-18T21:06:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f51840a5220 con 0x7f518406d270 2024-08-18T21:06:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f518409e320 con 0x7f518413e3e0 2024-08-18T21:06:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518bc17640 10 monclient(hunting): authenticate will time out at 1138.353833s 2024-08-18T21:06:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f518406c950 0x7f518406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518a1b4640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f518413e3e0 0x7f518413e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f518406c950 0x7f518406cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:60320/0 (socket says 172.21.15.5:60320) 2024-08-18T21:06:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 1 -- 172.21.15.5:0/2702588110 learned_addr learned my addr 172.21.15.5:0/2702588110 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 10 monclient(hunting): get_auth_request con 0x7f518406c950 auth_method 0 2024-08-18T21:06:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518a1b4640 10 monclient(hunting): get_auth_request con 0x7f518413e3e0 auth_method 0 2024-08-18T21:06:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518a1b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518a1b4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518a1b4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518a1b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518a1b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518a1b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51891b2640 1 --2- 172.21.15.5:0/2702588110 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f518406d270 0x7f518413dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 10 monclient(hunting): handle_auth_done global_id 5098 payload 274 2024-08-18T21:06:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 1 -- 172.21.15.5:0/2702588110 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f518413e3e0 msgr2=0x7f518413e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 1 --2- 172.21.15.5:0/2702588110 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f518413e3e0 0x7f518413e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 1 -- 172.21.15.5:0/2702588110 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f518406d270 msgr2=0x7f518413dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 1 --2- 172.21.15.5:0/2702588110 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f518406d270 0x7f518413dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 10 monclient: _finish_hunting 0 2024-08-18T21:06:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 1 monclient: found mon.noname-c 2024-08-18T21:06:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:06:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51899b3640 1 -- 172.21.15.5:0/2702588110 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518409e600 con 0x7f518406c950 2024-08-18T21:06:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51891b2640 10 monclient: get_auth_request con 0x7f518406d270 auth_method 0 2024-08-18T21:06:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f518a1b4640 1 --2- 172.21.15.5:0/2702588110 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f518413e3e0 0x7f518413e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:06:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.338+0000 7f51891b2640 1 --2- 172.21.15.5:0/2702588110 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f518406d270 0x7f518413dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:06:11.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f51899b3640 1 -- 172.21.15.5:0/2702588110 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f518406c950 msgr2=0x7f518406cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f51899b3640 1 --2- 172.21.15.5:0/2702588110 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f518406c950 0x7f518406cd30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f516c009e80 tx=0x7f516c01c910 comp rx=0 tx=0).ready entity=mon.4 client_cookie=2af115f447ece3e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f51889b1640 1 -- 172.21.15.5:0/2702588110 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f516c0090d0 con 0x7f518406c950 2024-08-18T21:06:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f51889b1640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f51889b1640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:06:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f51889b1640 10 monclient: dump: 2024-08-18T21:06:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.352 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f51889b1640 10 monclient: _finish_auth 0 2024-08-18T21:06:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f51889b1640 10 monclient: _check_auth_tickets 2024-08-18T21:06:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f51889b1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f51889b1640 1 -- 172.21.15.5:0/2702588110 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f516c0a5a30 con 0x7f518406c950 2024-08-18T21:06:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f518bc17640 5 monclient: authenticate success, global_id 5098 2024-08-18T21:06:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f518bc17640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:06:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f51889b1640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f518bc17640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f51889b1640 1 -- 172.21.15.5:0/2702588110 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f516c0a5be0 con 0x7f518406c950 2024-08-18T21:06:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f51889b1640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f518bc17640 4 set_mon_vals no callback set 2024-08-18T21:06:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f51889b1640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f51889b1640 10 monclient: dump: 2024-08-18T21:06:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.354 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f518bc17640 10 monclient: shutdown 2024-08-18T21:06:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f518bc17640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f518bc17640 1 -- 172.21.15.5:0/2702588110 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f518406c950 msgr2=0x7f518406cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f518bc17640 1 --2- 172.21.15.5:0/2702588110 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f518406c950 0x7f518406cd30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f516c009e80 tx=0x7f516c01c910 comp rx=0 tx=0).stop 2024-08-18T21:06:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f518bc17640 1 -- 172.21.15.5:0/2702588110 shutdown_connections 2024-08-18T21:06:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f518bc17640 1 --2- 172.21.15.5:0/2702588110 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f518413e3e0 0x7f518413e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f518bc17640 1 --2- 172.21.15.5:0/2702588110 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f518406d270 0x7f518413dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f518bc17640 1 --2- 172.21.15.5:0/2702588110 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f518406c950 0x7f518406cd30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f518bc17640 1 -- 172.21.15.5:0/2702588110 >> 172.21.15.5:0/2702588110 conn(0x7f51840688d0 msgr2=0x7f5184068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f518bc17640 1 -- 172.21.15.5:0/2702588110 shutdown_connections 2024-08-18T21:06:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.342+0000 7f518bc17640 1 -- 172.21.15.5:0/2702588110 wait complete. 2024-08-18T21:06:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 10 monclient: build_initial_monmap 2024-08-18T21:06:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 10 monclient: monmap: 2024-08-18T21:06:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:11.356 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:11.356 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:11.356 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.356 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:11.356 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:11.356 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:11.356 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:11.356 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:11.356 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:11.356 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:11.356 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:11.356 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:11.356 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 1 Processor -- start 2024-08-18T21:06:11.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 1 -- start start 2024-08-18T21:06:11.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 10 monclient: init 2024-08-18T21:06:11.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:11.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 10 monclient: _add_conns ranks=[5,7,8,1,0,4,2,3,6] 2024-08-18T21:06:11.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f518406c950 0x7f51841419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 10 monclient(hunting): picked mon.noname-h con 0x7f518406c950 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:11.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f518406d270 0x7f5184141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 10 monclient(hunting): picked mon.noname-i con 0x7f518406d270 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:11.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f518413e3e0 0x7f5184142470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 10 monclient(hunting): picked mon.noname-e con 0x7f518413e3e0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:11.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f51840a4f30 con 0x7f518406c950 2024-08-18T21:06:11.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f51840a4db0 con 0x7f518406d270 2024-08-18T21:06:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f518409da30 con 0x7f518413e3e0 2024-08-18T21:06:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518bc17640 10 monclient(hunting): authenticate will time out at 1138.361417s 2024-08-18T21:06:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f518413e3e0 0x7f5184142470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f518413e3e0 0x7f5184142470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:55992/0 (socket says 172.21.15.5:55992) 2024-08-18T21:06:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 1 -- 172.21.15.5:0/2374698720 learned_addr learned my addr 172.21.15.5:0/2374698720 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 10 monclient(hunting): get_auth_request con 0x7f518413e3e0 auth_method 0 2024-08-18T21:06:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f51899b3640 1 --2- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f518406c950 0x7f51841419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f51891b2640 1 --2- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f518406d270 0x7f5184141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f51899b3640 10 monclient(hunting): get_auth_request con 0x7f518406c950 auth_method 0 2024-08-18T21:06:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f51899b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f51899b3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f51899b3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f51891b2640 10 monclient(hunting): get_auth_request con 0x7f518406d270 auth_method 0 2024-08-18T21:06:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f51891b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f51891b2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f51891b2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 10 monclient(hunting): handle_auth_done global_id 54161 payload 824 2024-08-18T21:06:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 1 -- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f518406d270 msgr2=0x7f5184141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 1 --2- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f518406d270 0x7f5184141f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 1 -- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f518406c950 msgr2=0x7f51841419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 1 --2- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f518406c950 0x7f51841419f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 10 monclient: _finish_hunting 0 2024-08-18T21:06:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 1 monclient: found mon.noname-e 2024-08-18T21:06:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:06:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.346+0000 7f518a1b4640 1 -- 172.21.15.5:0/2374698720 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5184128020 con 0x7f518413e3e0 2024-08-18T21:06:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f518a1b4640 1 -- 172.21.15.5:0/2374698720 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f518413e3e0 msgr2=0x7f5184142470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f518a1b4640 1 --2- 172.21.15.5:0/2374698720 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f518413e3e0 0x7f5184142470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f517400e950 tx=0x7f517400ee10 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51827fc640 1 -- 172.21.15.5:0/2374698720 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5174017070 con 0x7f518413e3e0 2024-08-18T21:06:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51827fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:06:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51827fc640 10 monclient: dump: 2024-08-18T21:06:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.365 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51827fc640 10 monclient: _finish_auth 0 2024-08-18T21:06:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51827fc640 10 monclient: _check_auth_tickets 2024-08-18T21:06:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51827fc640 1 -- 172.21.15.5:0/2374698720 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517400cc10 con 0x7f518413e3e0 2024-08-18T21:06:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51827fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51827fc640 1 -- 172.21.15.5:0/2374698720 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f517400cdc0 con 0x7f518413e3e0 2024-08-18T21:06:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f518bc17640 5 monclient: authenticate success, global_id 54161 2024-08-18T21:06:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f518bc17640 10 monclient: _renew_subs 2024-08-18T21:06:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f518bc17640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:06:11.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f518bc17640 1 -- 172.21.15.5:0/2374698720 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5184128300 con 0x7f518413e3e0 2024-08-18T21:06:11.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f5183fff640 4 set_mon_vals no callback set 2024-08-18T21:06:11.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51827fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:11.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51827fc640 10 monclient: dump: 2024-08-18T21:06:11.366 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.366 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.366 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.366 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.366 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.366 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.366 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.367 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f518bc17640 10 monclient: _renew_subs 2024-08-18T21:06:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f518bc17640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:06:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f518bc17640 1 -- 172.21.15.5:0/2374698720 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f51840a2f50 con 0x7f518413e3e0 2024-08-18T21:06:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f518bc17640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f518bc17640 1 --2- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51841d5720 0x7f51841d5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f518bc17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f518bc17640 1 -- 172.21.15.5:0/2374698720 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f51840a7dc0 con 0x7f51841d5720 2024-08-18T21:06:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51827fc640 1 -- 172.21.15.5:0/2374698720 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f517401a070 con 0x7f518413e3e0 2024-08-18T21:06:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51827fc640 1 --2- 172.21.15.5:0/2374698720 >> v2:172.21.15.157:6812/631023601 conn(0x7f516403bdc0 0x7f516403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51899b3640 1 --2- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51841d5720 0x7f51841d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51899b3640 10 monclient: get_auth_request con 0x7f51841d5720 auth_method 0 2024-08-18T21:06:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51899b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51899b3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51899b3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51827fc640 1 -- 172.21.15.5:0/2374698720 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(78..78 src has 22..78) ==== 3506+0+0 (secure 0 0 0) 0x7f517400f040 con 0x7f518413e3e0 2024-08-18T21:06:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51899b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51899b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51899b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51891b2640 1 --2- 172.21.15.5:0/2374698720 >> v2:172.21.15.157:6812/631023601 conn(0x7f516403bdc0 0x7f516403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51891b2640 10 monclient: get_auth_request con 0x7f516403bdc0 auth_method 0 2024-08-18T21:06:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51899b3640 10 monclient(hunting): handle_auth_done global_id 4933 payload 824 2024-08-18T21:06:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.350+0000 7f51899b3640 1 -- 172.21.15.5:0/2374698720 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5184128800 con 0x7f51841d5720 2024-08-18T21:06:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.354+0000 7f51899b3640 1 -- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51841d5720 msgr2=0x7f51841d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.354+0000 7f51899b3640 1 --2- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51841d5720 0x7f51841d5b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f516c009e50 tx=0x7f516c0196b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.354+0000 7f51891b2640 1 --2- 172.21.15.5:0/2374698720 >> v2:172.21.15.157:6812/631023601 conn(0x7f516403bdc0 0x7f516403e280 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5184143a30 tx=0x7f517c008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.354+0000 7f51827fc640 1 -- 172.21.15.5:0/2374698720 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f516c0bd070 con 0x7f51841d5720 2024-08-18T21:06:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.354+0000 7f51827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.354+0000 7f51827fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:06:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.354+0000 7f51827fc640 10 monclient: dump: 2024-08-18T21:06:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.371 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.354+0000 7f51827fc640 1 -- 172.21.15.5:0/2374698720 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f516c004250 con 0x7f51841d5720 2024-08-18T21:06:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.354+0000 7f51827fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.354+0000 7f51827fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.354+0000 7f51827fc640 1 -- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51841d5720 msgr2=0x7f51841d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.354+0000 7f51827fc640 1 --2- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51841d5720 0x7f51841d5b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f516c009e50 tx=0x7f516c0196b0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.354+0000 7f51827fc640 1 -- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51841d5720 msgr2=0x7f51841d5b00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.354+0000 7f51827fc640 1 --2- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51841d5720 0x7f51841d5b00 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f516c009e50 tx=0x7f516c0196b0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.362+0000 7f518bc17640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.362+0000 7f518bc17640 1 --2- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51841d6040 0x7f5184071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.362+0000 7f518bc17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.362+0000 7f518bc17640 1 -- 172.21.15.5:0/2374698720 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5184051140 con 0x7f51841d6040 2024-08-18T21:06:11.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.362+0000 7f51899b3640 1 --2- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51841d6040 0x7f5184071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.362+0000 7f51899b3640 10 monclient: get_auth_request con 0x7f51841d6040 auth_method 0 2024-08-18T21:06:11.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.362+0000 7f51899b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.362+0000 7f51899b3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.362+0000 7f51899b3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.362+0000 7f51899b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.362+0000 7f51899b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.362+0000 7f51899b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.362+0000 7f51899b3640 10 monclient(hunting): handle_auth_done global_id 4942 payload 824 2024-08-18T21:06:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.362+0000 7f51899b3640 1 -- 172.21.15.5:0/2374698720 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f518406dbf0 con 0x7f51841d6040 2024-08-18T21:06:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f51899b3640 1 -- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51841d6040 msgr2=0x7f5184071f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f51899b3640 1 --2- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51841d6040 0x7f5184071f70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f516c01c950 tx=0x7f516c0a7000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f51827fc640 1 -- 172.21.15.5:0/2374698720 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f516c0c2de0 con 0x7f51841d6040 2024-08-18T21:06:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f51827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f51827fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:06:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f51827fc640 10 monclient: dump: 2024-08-18T21:06:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.375 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.375 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.375 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.375 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.375 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.375 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.375 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.375 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.375 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.375 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.375 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f51827fc640 1 -- 172.21.15.5:0/2374698720 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f516c0c2de0 con 0x7f51841d6040 2024-08-18T21:06:11.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f51827fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f51827fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f51827fc640 1 -- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51841d6040 msgr2=0x7f5184071f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f51827fc640 1 --2- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51841d6040 0x7f5184071f70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f516c01c950 tx=0x7f516c0a7000 comp rx=0 tx=0).stop 2024-08-18T21:06:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f51827fc640 1 -- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51841d6040 msgr2=0x7f5184071f70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f51827fc640 1 --2- 172.21.15.5:0/2374698720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51841d6040 0x7f5184071f70 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f516c01c950 tx=0x7f516c0a7000 comp rx=0 tx=0).stop 2024-08-18T21:06:11.376 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 180446, 2024-08-18T21:06:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:06:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.379 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.379 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.379 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:11.379 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:11.379 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.379 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.379 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.379 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.379 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.379 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.379 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.379 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.379 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.379 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.380 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.380 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.380 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:11.380 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:11.380 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:11.380 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:11.380 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:11.380 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:11.380 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:11.380 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:11.380 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:11.380 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:11.380 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:11.380 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:11.381 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:11.381 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:11.381 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:11.381 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:11.381 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:11.381 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.381 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.381 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.381 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.381 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.381 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.381 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.381 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.381 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.382 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.382 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.382 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.382 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:11.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.382 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:11.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.382 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:11.382 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:11.382 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.382 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.382 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.383 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:11.383 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.383 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.383 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:11.383 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.383 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.383 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.383 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:11.383 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:11.383 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.383 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.384 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.384 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:11.384 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:11.384 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.384 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:11.384 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.385 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.385 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.385 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:11.385 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.385 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.385 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.385 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:11.385 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:11.385 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.385 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.385 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.385 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.386 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:11.386 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:11.386 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.386 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.386 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.386 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:11.386 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.386 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.386 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:11.386 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:11.388 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:11.388 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.388 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.388 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:11.389 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:11.389 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.389 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.389 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.389 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:11.389 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:11.389 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.389 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:11.389 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.390 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.390 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:11.390 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.390 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.390 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.390 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:11.390 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:11.390 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.390 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.391 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.391 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:11.391 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:11.391 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:11.391 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.392 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:11.392 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.392 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.392 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.392 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:11.392 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:11.392 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.392 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.392 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.392 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:11.393 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:11.393 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:11.393 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:11.393 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.393 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.394 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.394 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:11.394 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:11.394 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.394 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.394 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.394 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:11.394 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:11.394 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.394 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.395 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.395 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:11.395 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.395 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.395 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:11.395 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.395 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.395 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.395 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:11.396 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:11.396 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.396 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.396 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.396 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:11.396 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:11.396 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.396 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.396 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.396 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:11.397 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.397 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.397 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.397 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:11.397 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.397 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.397 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.397 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:11.397 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:11.397 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.397 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.398 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.398 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.398 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.398 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:11.398 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:11.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.398 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:11.398 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:11.398 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:11.398 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.398 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.398 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:11.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.399 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:11.399 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:11.399 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:06:11.399 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.399 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.399 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:11.399 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f518bc17640 1 -- 172.21.15.5:0/2374698720 >> v2:172.21.15.157:6812/631023601 conn(0x7f516403bdc0 msgr2=0x7f516403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f518bc17640 1 --2- 172.21.15.5:0/2374698720 >> v2:172.21.15.157:6812/631023601 conn(0x7f516403bdc0 0x7f516403e280 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5184143a30 tx=0x7f517c008040 comp rx=0 tx=0).stop 2024-08-18T21:06:11.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f518bc17640 10 monclient: shutdown 2024-08-18T21:06:11.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f518bc17640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:11.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f518bc17640 1 -- 172.21.15.5:0/2374698720 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f518413e3e0 msgr2=0x7f5184142470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f518bc17640 1 --2- 172.21.15.5:0/2374698720 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f518413e3e0 0x7f5184142470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f517400e950 tx=0x7f517400ee10 comp rx=0 tx=0).stop 2024-08-18T21:06:11.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f518a1b4640 1 -- 172.21.15.5:0/2374698720 reap_dead start 2024-08-18T21:06:11.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f518a1b4640 1 -- 172.21.15.5:0/2374698720 reap_dead start 2024-08-18T21:06:11.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f518bc17640 1 -- 172.21.15.5:0/2374698720 shutdown_connections 2024-08-18T21:06:11.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f518bc17640 1 -- 172.21.15.5:0/2374698720 >> 172.21.15.5:0/2374698720 conn(0x7f51840688d0 msgr2=0x7f51840a75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:11.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f518bc17640 1 -- 172.21.15.5:0/2374698720 shutdown_connections 2024-08-18T21:06:11.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.366+0000 7f518bc17640 1 -- 172.21.15.5:0/2374698720 wait complete. 2024-08-18T21:06:11.401 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:11.402 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:06:11.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:06:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 10 monclient: get_monmap_and_config 2024-08-18T21:06:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 10 monclient: build_initial_monmap 2024-08-18T21:06:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 10 monclient: monmap: 2024-08-18T21:06:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:11.525717+0000 2024-08-18T21:06:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:11.525717+0000 2024-08-18T21:06:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:11.526 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 1 Processor -- start 2024-08-18T21:06:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 1 -- start start 2024-08-18T21:06:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 10 monclient: init 2024-08-18T21:06:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 10 monclient: _add_conns ranks=[8,10,1,9,7,5,0,4,2,6,3] 2024-08-18T21:06:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7facc00a1ff0 0x7facc0137430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 10 monclient(hunting): picked mon.noname-e con 0x7facc00a1ff0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7facc0137970 0x7facc0137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 10 monclient(hunting): picked mon.noname-f con 0x7facc0137970 addr v2:172.21.15.157:3300/0 2024-08-18T21:06:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7facc0133eb0 addr v1:172.21.15.157:6789/0 2024-08-18T21:06:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facc00a23d0 con 0x7facc0133eb0 2024-08-18T21:06:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7facc009dd50 con 0x7facc0137970 2024-08-18T21:06:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7facc009e970 con 0x7facc00a1ff0 2024-08-18T21:06:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facc4dce640 10 monclient(hunting): authenticate will time out at 1138.538950s 2024-08-18T21:06:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7facc00a1ff0 0x7facc0137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7facc00a1ff0 0x7facc0137430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:55998/0 (socket says 172.21.15.5:55998) 2024-08-18T21:06:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 1 -- 172.21.15.5:0/2259012350 learned_addr learned my addr 172.21.15.5:0/2259012350 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 10 monclient(hunting): get_auth_request con 0x7facc00a1ff0 auth_method 0 2024-08-18T21:06:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbdd9b640 1 --2- 172.21.15.5:0/2259012350 >> v2:172.21.15.157:3300/0 conn(0x7facc0137970 0x7facc0137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbdd9b640 10 monclient(hunting): get_auth_request con 0x7facc0137970 auth_method 0 2024-08-18T21:06:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbdd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbdd9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 10 monclient(hunting): handle_auth_done global_id 54170 payload 274 2024-08-18T21:06:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 1 -- 172.21.15.5:0/2259012350 >> v2:172.21.15.157:3300/0 conn(0x7facc0137970 msgr2=0x7facc0137dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 1 --2- 172.21.15.5:0/2259012350 >> v2:172.21.15.157:3300/0 conn(0x7facc0137970 0x7facc0137dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 1 -- 172.21.15.5:0/2259012350 >> v1:172.21.15.157:6789/0 conn(0x7facc0133eb0 legacy=0x7facc0134360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 10 monclient: _finish_hunting 0 2024-08-18T21:06:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 1 monclient: found mon.noname-e 2024-08-18T21:06:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:06:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.522+0000 7facbe59c640 1 -- 172.21.15.5:0/2259012350 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc009ec50 con 0x7facc00a1ff0 2024-08-18T21:06:11.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facbe59c640 1 -- 172.21.15.5:0/2259012350 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7facc00a1ff0 msgr2=0x7facc0137430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facbe59c640 1 --2- 172.21.15.5:0/2259012350 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7facc00a1ff0 0x7facc0137430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7facb8009e50 tx=0x7facb801c890 comp rx=0 tx=0).ready entity=mon.8 client_cookie=fdcd8f380db9264f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facbd59a640 1 -- 172.21.15.5:0/2259012350 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7facb80090d0 con 0x7facc00a1ff0 2024-08-18T21:06:11.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facbd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facbd59a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:06:11.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facbd59a640 10 monclient: dump: 2024-08-18T21:06:11.535 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.535 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.535 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.535 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.536 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facbd59a640 10 monclient: _finish_auth 0 2024-08-18T21:06:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facbd59a640 10 monclient: _check_auth_tickets 2024-08-18T21:06:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facbd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facbd59a640 1 -- 172.21.15.5:0/2259012350 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb80a5980 con 0x7facc00a1ff0 2024-08-18T21:06:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facc4dce640 5 monclient: authenticate success, global_id 54170 2024-08-18T21:06:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facc4dce640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:06:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facbd59a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facc4dce640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facc4dce640 4 set_mon_vals no callback set 2024-08-18T21:06:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facbd59a640 1 -- 172.21.15.5:0/2259012350 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7facb80ad3f0 con 0x7facc00a1ff0 2024-08-18T21:06:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facbd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facbd59a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.526+0000 7facbd59a640 10 monclient: dump: 2024-08-18T21:06:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.539 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 10 monclient: shutdown 2024-08-18T21:06:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 1 -- 172.21.15.5:0/2259012350 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7facc00a1ff0 msgr2=0x7facc0137430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 1 --2- 172.21.15.5:0/2259012350 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7facc00a1ff0 0x7facc0137430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7facb8009e50 tx=0x7facb801c890 comp rx=0 tx=0).stop 2024-08-18T21:06:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 1 -- 172.21.15.5:0/2259012350 shutdown_connections 2024-08-18T21:06:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 1 --2- 172.21.15.5:0/2259012350 >> v2:172.21.15.157:3300/0 conn(0x7facc0137970 0x7facc0137dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 1 --2- 172.21.15.5:0/2259012350 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7facc00a1ff0 0x7facc0137430 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 1 -- 172.21.15.5:0/2259012350 >> 172.21.15.5:0/2259012350 conn(0x7facc00a8020 msgr2=0x7facc00a8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 1 -- 172.21.15.5:0/2259012350 shutdown_connections 2024-08-18T21:06:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 1 -- 172.21.15.5:0/2259012350 wait complete. 2024-08-18T21:06:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 10 monclient: build_initial_monmap 2024-08-18T21:06:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 10 monclient: monmap: 2024-08-18T21:06:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:11.541 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 1 Processor -- start 2024-08-18T21:06:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 1 -- start start 2024-08-18T21:06:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 10 monclient: init 2024-08-18T21:06:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 10 monclient: _add_conns ranks=[0,6,7,2,4,5,8,1,3] 2024-08-18T21:06:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facc00a1ff0 0x7facc01cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 10 monclient(hunting): picked mon.noname-a con 0x7facc00a1ff0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:06:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7facc0133eb0 0x7facc013e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 10 monclient(hunting): picked mon.noname-d con 0x7facc0133eb0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7facc0137970 0x7facc013ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 10 monclient(hunting): picked mon.noname-i con 0x7facc0137970 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:11.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7facc0142200 con 0x7facc00a1ff0 2024-08-18T21:06:11.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7facc00a1e00 con 0x7facc0133eb0 2024-08-18T21:06:11.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7facc0142380 con 0x7facc0137970 2024-08-18T21:06:11.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:11.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facc4dce640 10 monclient(hunting): authenticate will time out at 1138.546113s 2024-08-18T21:06:11.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7facc0133eb0 0x7facc013e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facc00a1ff0 0x7facc01cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7facc0133eb0 0x7facc013e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:45406/0 (socket says 172.21.15.5:45406) 2024-08-18T21:06:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facc00a1ff0 0x7facc01cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40658/0 (socket says 172.21.15.5:40658) 2024-08-18T21:06:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 1 -- 172.21.15.5:0/2261511866 learned_addr learned my addr 172.21.15.5:0/2261511866 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 10 monclient(hunting): get_auth_request con 0x7facc0133eb0 auth_method 0 2024-08-18T21:06:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbe59c640 10 monclient(hunting): get_auth_request con 0x7facc00a1ff0 auth_method 0 2024-08-18T21:06:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbe59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbe59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbe59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbe59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbe59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbe59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbed9d640 1 --2- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7facc0137970 0x7facc013ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbed9d640 10 monclient(hunting): get_auth_request con 0x7facc0137970 auth_method 0 2024-08-18T21:06:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbed9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 10 monclient(hunting): handle_auth_done global_id 54141 payload 824 2024-08-18T21:06:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 1 -- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7facc0137970 msgr2=0x7facc013ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 1 --2- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7facc0137970 0x7facc013ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 1 -- 172.21.15.5:0/2261511866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facc00a1ff0 msgr2=0x7facc01cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 1 --2- 172.21.15.5:0/2261511866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facc00a1ff0 0x7facc01cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 10 monclient: _finish_hunting 0 2024-08-18T21:06:11.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 1 monclient: found mon.noname-d 2024-08-18T21:06:11.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:11.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:06:11.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.530+0000 7facbdd9b640 1 -- 172.21.15.5:0/2261511866 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc0139fa0 con 0x7facc0133eb0 2024-08-18T21:06:11.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facbdd9b640 1 -- 172.21.15.5:0/2261511866 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7facc0133eb0 msgr2=0x7facc013e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facbdd9b640 1 --2- 172.21.15.5:0/2261511866 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7facc0133eb0 0x7facc013e840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7facb000d600 tx=0x7facb000dac0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facb6ffd640 1 -- 172.21.15.5:0/2261511866 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7facb0004450 con 0x7facc0133eb0 2024-08-18T21:06:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facb6ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:06:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facb6ffd640 10 monclient: dump: 2024-08-18T21:06:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.549 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facb6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:06:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facb6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:06:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facb6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facc4dce640 5 monclient: authenticate success, global_id 54141 2024-08-18T21:06:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facc4dce640 10 monclient: _renew_subs 2024-08-18T21:06:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facc4dce640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facc4dce640 1 -- 172.21.15.5:0/2261511866 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc013f2c0 con 0x7facc0133eb0 2024-08-18T21:06:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facc4dce640 10 monclient: _renew_subs 2024-08-18T21:06:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facc4dce640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facc4dce640 1 -- 172.21.15.5:0/2261511866 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7facc013ba60 con 0x7facc0133eb0 2024-08-18T21:06:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facb6ffd640 1 -- 172.21.15.5:0/2261511866 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb0003620 con 0x7facc0133eb0 2024-08-18T21:06:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facb6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facb6ffd640 1 -- 172.21.15.5:0/2261511866 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7facb0003c40 con 0x7facc0133eb0 2024-08-18T21:06:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facb6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facbcd99640 4 set_mon_vals no callback set 2024-08-18T21:06:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facb6ffd640 10 monclient: dump: 2024-08-18T21:06:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.552 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facc4dce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facc4dce640 1 --2- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac98002890 0x7fac98004d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facc4dce640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facc4dce640 1 -- 172.21.15.5:0/2261511866 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fac98007cc0 con 0x7fac98002890 2024-08-18T21:06:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facb6ffd640 1 -- 172.21.15.5:0/2261511866 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7facb00037d0 con 0x7facc0133eb0 2024-08-18T21:06:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facb6ffd640 1 --2- 172.21.15.5:0/2261511866 >> v2:172.21.15.157:6812/631023601 conn(0x7faca403be20 0x7faca403e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facbe59c640 1 --2- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac98002890 0x7fac98004d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facb6ffd640 1 -- 172.21.15.5:0/2261511866 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(78..78 src has 22..78) ==== 3506+0+0 (secure 0 0 0) 0x7facb000f040 con 0x7facc0133eb0 2024-08-18T21:06:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facbe59c640 10 monclient: get_auth_request con 0x7fac98002890 auth_method 0 2024-08-18T21:06:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facbe59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facbe59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facbe59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facbe59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facbe59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facbe59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facbed9d640 1 --2- 172.21.15.5:0/2261511866 >> v2:172.21.15.157:6812/631023601 conn(0x7faca403be20 0x7faca403e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facbed9d640 10 monclient: get_auth_request con 0x7faca403be20 auth_method 0 2024-08-18T21:06:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facbe59c640 10 monclient(hunting): handle_auth_done global_id 5061 payload 824 2024-08-18T21:06:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.534+0000 7facbe59c640 1 -- 172.21.15.5:0/2261511866 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac98007ec0 con 0x7fac98002890 2024-08-18T21:06:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.538+0000 7facbe59c640 1 -- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac98002890 msgr2=0x7fac98004d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.538+0000 7facbe59c640 1 --2- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac98002890 0x7fac98004d30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7facb80ae000 tx=0x7facb8019690 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.538+0000 7facbed9d640 1 --2- 172.21.15.5:0/2261511866 >> v2:172.21.15.157:6812/631023601 conn(0x7faca403be20 0x7faca403e2e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7facc0073f60 tx=0x7faca8009040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.538+0000 7facb6ffd640 1 -- 172.21.15.5:0/2261511866 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7facb80a5510 con 0x7fac98002890 2024-08-18T21:06:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.538+0000 7facb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.538+0000 7facb6ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:06:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.538+0000 7facb6ffd640 10 monclient: dump: 2024-08-18T21:06:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.555 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.538+0000 7facb6ffd640 1 -- 172.21.15.5:0/2261511866 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7facb8004540 con 0x7fac98002890 2024-08-18T21:06:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.538+0000 7facb6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.538+0000 7facb6ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.538+0000 7facb6ffd640 1 -- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac98002890 msgr2=0x7fac98004d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.538+0000 7facb6ffd640 1 --2- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac98002890 0x7fac98004d30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7facb80ae000 tx=0x7facb8019690 comp rx=0 tx=0).stop 2024-08-18T21:06:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.538+0000 7facb6ffd640 1 -- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac98002890 msgr2=0x7fac98004d30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.538+0000 7facb6ffd640 1 --2- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac98002890 0x7fac98004d30 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7facb80ae000 tx=0x7facb8019690 comp rx=0 tx=0).stop 2024-08-18T21:06:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.546+0000 7facc4dce640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.546+0000 7facc4dce640 1 --2- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac98006ce0 0x7fac98007170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.546+0000 7facc4dce640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.546+0000 7facc4dce640 1 -- 172.21.15.5:0/2261511866 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fac9800a200 con 0x7fac98006ce0 2024-08-18T21:06:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.546+0000 7facbe59c640 1 --2- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac98006ce0 0x7fac98007170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.546+0000 7facbe59c640 10 monclient: get_auth_request con 0x7fac98006ce0 auth_method 0 2024-08-18T21:06:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.546+0000 7facbe59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.546+0000 7facbe59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.546+0000 7facbe59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.546+0000 7facbe59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.546+0000 7facbe59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.546+0000 7facbe59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.546+0000 7facbe59c640 10 monclient(hunting): handle_auth_done global_id 5070 payload 824 2024-08-18T21:06:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.546+0000 7facbe59c640 1 -- 172.21.15.5:0/2261511866 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fac980076b0 con 0x7fac98006ce0 2024-08-18T21:06:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facbe59c640 1 -- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac98006ce0 msgr2=0x7fac98007170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facbe59c640 1 --2- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac98006ce0 0x7fac98007170 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7facb8000f90 tx=0x7facb80a7000 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facb6ffd640 1 -- 172.21.15.5:0/2261511866 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7facb80c2c10 con 0x7fac98006ce0 2024-08-18T21:06:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facb6ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:06:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facb6ffd640 10 monclient: dump: 2024-08-18T21:06:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.560 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facb6ffd640 1 -- 172.21.15.5:0/2261511866 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7facb80c6070 con 0x7fac98006ce0 2024-08-18T21:06:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facb6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facb6ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facb6ffd640 1 -- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac98006ce0 msgr2=0x7fac98007170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facb6ffd640 1 --2- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac98006ce0 0x7fac98007170 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7facb8000f90 tx=0x7facb80a7000 comp rx=0 tx=0).stop 2024-08-18T21:06:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facb6ffd640 1 -- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac98006ce0 msgr2=0x7fac98007170 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facb6ffd640 1 --2- 172.21.15.5:0/2261511866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac98006ce0 0x7fac98007170 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7facb8000f90 tx=0x7facb80a7000 comp rx=0 tx=0).stop 2024-08-18T21:06:11.561 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:11.561 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:11.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:11.562 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:11.562 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:11.562 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 180646, 2024-08-18T21:06:11.562 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:11.562 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:11.562 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:11.562 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:11.562 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:11.562 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:11.562 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:11.562 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:11.562 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:11.563 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:11.563 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.563 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:06:11.563 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:11.563 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:11.563 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:11.563 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.563 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.563 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.563 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.563 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.563 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.563 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.564 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.564 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.564 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.564 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.564 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.564 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:11.564 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:11.564 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.564 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.564 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.564 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.564 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.564 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.564 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.565 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.565 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.565 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.565 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.565 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.565 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:11.565 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:11.565 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:11.565 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:11.565 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:11.565 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:11.565 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:11.566 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:11.566 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:11.566 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:11.566 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:11.566 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:11.566 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:11.566 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:11.566 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:11.566 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:11.566 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:11.566 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.566 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.566 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.567 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.567 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.567 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.567 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.567 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.567 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.567 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.567 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.567 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.567 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:11.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.567 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:11.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.568 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:11.568 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:11.568 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.568 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.568 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.568 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:11.568 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.568 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.568 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:11.569 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.569 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.569 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.569 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:11.569 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:11.569 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.569 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.569 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.570 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:11.570 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:11.570 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.570 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.570 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.570 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:11.570 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.570 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:11.571 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.571 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.571 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:11.571 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:11.571 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.571 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.571 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.571 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:11.572 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:11.572 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.572 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.572 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.572 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:11.572 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.572 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.572 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:11.572 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.572 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.573 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.573 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:11.573 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:11.573 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.573 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.573 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.573 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:11.573 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:11.573 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.573 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.574 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:11.574 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.574 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:11.574 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.574 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.574 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:11.574 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:11.575 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.575 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.575 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.575 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:11.575 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:11.575 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.575 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.575 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:11.575 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.576 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:11.576 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.576 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.576 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:11.576 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:11.576 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.576 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.576 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.577 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:11.577 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:11.577 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:11.577 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:11.577 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.578 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.578 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.578 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:11.578 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:11.578 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.578 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.578 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.578 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:11.578 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:11.578 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.578 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.579 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.579 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:11.579 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.579 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.579 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:11.579 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.579 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.579 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.579 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:11.580 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:11.580 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.580 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.580 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.580 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:11.580 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:11.580 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.581 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:11.581 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.581 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:11.581 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.581 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.581 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:11.582 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:11.582 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.582 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.582 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.582 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:11.582 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:11.582 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:11.583 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.583 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:11.583 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.583 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.583 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:11.583 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:11.583 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.583 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.584 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.584 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.584 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:11.584 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:11.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.584 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:11.584 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:11.584 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:11.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.584 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.584 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:06:11.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.585 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:11.585 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:11.585 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:11.585 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.585 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.585 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:11.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.585 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:11.585 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:11.585 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:06:11.585 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.585 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.585 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:11.585 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:11.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facc4dce640 1 -- 172.21.15.5:0/2261511866 >> v2:172.21.15.157:6812/631023601 conn(0x7faca403be20 msgr2=0x7faca403e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facc4dce640 1 --2- 172.21.15.5:0/2261511866 >> v2:172.21.15.157:6812/631023601 conn(0x7faca403be20 0x7faca403e2e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7facc0073f60 tx=0x7faca8009040 comp rx=0 tx=0).stop 2024-08-18T21:06:11.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facc4dce640 10 monclient: shutdown 2024-08-18T21:06:11.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facc4dce640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:11.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facc4dce640 1 -- 172.21.15.5:0/2261511866 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7facc0133eb0 msgr2=0x7facc013e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facc4dce640 1 --2- 172.21.15.5:0/2261511866 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7facc0133eb0 0x7facc013e840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7facb000d600 tx=0x7facb000dac0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facbed9d640 1 -- 172.21.15.5:0/2261511866 reap_dead start 2024-08-18T21:06:11.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facc4dce640 1 -- 172.21.15.5:0/2261511866 shutdown_connections 2024-08-18T21:06:11.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facc4dce640 1 --2- 172.21.15.5:0/2261511866 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7facc0133eb0 0x7facc013e840 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facc4dce640 1 -- 172.21.15.5:0/2261511866 >> 172.21.15.5:0/2261511866 conn(0x7facc00a8020 msgr2=0x7facc0131db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:11.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facc4dce640 1 -- 172.21.15.5:0/2261511866 shutdown_connections 2024-08-18T21:06:11.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.550+0000 7facc4dce640 1 -- 172.21.15.5:0/2261511866 wait complete. 2024-08-18T21:06:11.588 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:11.588 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:06:11.588 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:06:11.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 10 monclient: get_monmap_and_config 2024-08-18T21:06:11.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 10 monclient: build_initial_monmap 2024-08-18T21:06:11.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 10 monclient: monmap: 2024-08-18T21:06:11.703 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:11.704 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.704 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:11.704581+0000 2024-08-18T21:06:11.704 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:11.704581+0000 2024-08-18T21:06:11.704 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:11.704 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.704 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:11.704 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:11.704 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:11.704 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:11.704 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:11.704 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:11.704 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:11.705 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:11.705 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:11.705 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:11.705 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:11.705 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 1 Processor -- start 2024-08-18T21:06:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 1 -- start start 2024-08-18T21:06:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 10 monclient: init 2024-08-18T21:06:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 10 monclient: _add_conns ranks=[1,8,10,6,3,9,2,5,7,0,4] 2024-08-18T21:06:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f4d30137a70 addr v1:172.21.15.157:6789/0 2024-08-18T21:06:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4d300a4c10 0x7f4d300a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 10 monclient(hunting): picked mon.noname-e con 0x7f4d300a4c10 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:11.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4d3013c8f0 0x7f4d3013ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 10 monclient(hunting): picked mon.noname-f con 0x7f4d3013c8f0 addr v2:172.21.15.157:3300/0 2024-08-18T21:06:11.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3009fe40 con 0x7f4d30137a70 2024-08-18T21:06:11.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4d300a03e0 con 0x7f4d3013c8f0 2024-08-18T21:06:11.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f4d300a08e0 con 0x7f4d300a4c10 2024-08-18T21:06:11.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:11.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d36b56640 10 monclient(hunting): authenticate will time out at 1138.717775s 2024-08-18T21:06:11.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4d300a4c10 0x7f4d300a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4d300a4c10 0x7f4d300a1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:56010/0 (socket says 172.21.15.5:56010) 2024-08-18T21:06:11.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 1 -- 172.21.15.5:0/2676469044 learned_addr learned my addr 172.21.15.5:0/2676469044 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:11.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 10 monclient(hunting): get_auth_request con 0x7f4d300a4c10 auth_method 0 2024-08-18T21:06:11.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d350f3640 1 --2- 172.21.15.5:0/2676469044 >> v2:172.21.15.157:3300/0 conn(0x7f4d3013c8f0 0x7f4d3013ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d350f3640 10 monclient(hunting): get_auth_request con 0x7f4d3013c8f0 auth_method 0 2024-08-18T21:06:11.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d350f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d350f3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d350f3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d350f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d350f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d350f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 10 monclient(hunting): handle_auth_done global_id 54179 payload 274 2024-08-18T21:06:11.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 1 -- 172.21.15.5:0/2676469044 >> v2:172.21.15.157:3300/0 conn(0x7f4d3013c8f0 msgr2=0x7f4d3013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:11.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 1 --2- 172.21.15.5:0/2676469044 >> v2:172.21.15.157:3300/0 conn(0x7f4d3013c8f0 0x7f4d3013ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 1 -- 172.21.15.5:0/2676469044 >> v1:172.21.15.157:6789/0 conn(0x7f4d30137a70 legacy=0x7f4d30137e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:11.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 10 monclient: _finish_hunting 0 2024-08-18T21:06:11.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 1 monclient: found mon.noname-e 2024-08-18T21:06:11.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:11.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:06:11.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.702+0000 7f4d2ffff640 1 -- 172.21.15.5:0/2676469044 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d300a0bc0 con 0x7f4d300a4c10 2024-08-18T21:06:11.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d2ffff640 1 -- 172.21.15.5:0/2676469044 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4d300a4c10 msgr2=0x7f4d300a1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d2ffff640 1 --2- 172.21.15.5:0/2676469044 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4d300a4c10 0x7f4d300a1b60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009870 tx=0x7f4d1801c420 comp rx=0 tx=0).ready entity=mon.8 client_cookie=cf0ab82fd55d32bd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d2f7fe640 1 -- 172.21.15.5:0/2676469044 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4d180b0070 con 0x7f4d300a4c10 2024-08-18T21:06:11.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d2f7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:06:11.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d2f7fe640 10 monclient: dump: 2024-08-18T21:06:11.714 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.714 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.714 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.714 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.714 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.714 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.715 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d2f7fe640 10 monclient: _finish_auth 0 2024-08-18T21:06:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d2f7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:06:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d2f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d2f7fe640 1 -- 172.21.15.5:0/2676469044 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d180a9980 con 0x7f4d300a4c10 2024-08-18T21:06:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d2f7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d2f7fe640 1 -- 172.21.15.5:0/2676469044 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4d180aa3a0 con 0x7f4d300a4c10 2024-08-18T21:06:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d2f7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d2f7fe640 10 monclient: dump: 2024-08-18T21:06:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.717 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d36b56640 5 monclient: authenticate success, global_id 54179 2024-08-18T21:06:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d36b56640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.706+0000 7f4d36b56640 4 set_mon_vals no callback set 2024-08-18T21:06:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 10 monclient: shutdown 2024-08-18T21:06:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 1 -- 172.21.15.5:0/2676469044 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4d300a4c10 msgr2=0x7f4d300a1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 1 --2- 172.21.15.5:0/2676469044 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4d300a4c10 0x7f4d300a1b60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009870 tx=0x7f4d1801c420 comp rx=0 tx=0).stop 2024-08-18T21:06:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 1 -- 172.21.15.5:0/2676469044 shutdown_connections 2024-08-18T21:06:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 1 --2- 172.21.15.5:0/2676469044 >> v2:172.21.15.157:3300/0 conn(0x7f4d3013c8f0 0x7f4d3013ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 1 --2- 172.21.15.5:0/2676469044 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4d300a4c10 0x7f4d300a1b60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 1 -- 172.21.15.5:0/2676469044 >> 172.21.15.5:0/2676469044 conn(0x7f4d300688d0 msgr2=0x7f4d30068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 1 -- 172.21.15.5:0/2676469044 shutdown_connections 2024-08-18T21:06:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 1 -- 172.21.15.5:0/2676469044 wait complete. 2024-08-18T21:06:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 10 monclient: build_initial_monmap 2024-08-18T21:06:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 10 monclient: monmap: 2024-08-18T21:06:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:11.719 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.719 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:11.719 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:11.719 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:11.719 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:11.719 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:11.719 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:11.719 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:11.719 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:11.719 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:11.719 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 1 Processor -- start 2024-08-18T21:06:11.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 1 -- start start 2024-08-18T21:06:11.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 10 monclient: init 2024-08-18T21:06:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 10 monclient: _add_conns ranks=[3,4,5,6,7,0,8,1,2] 2024-08-18T21:06:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d300a4c10 0x7f4d301d1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 10 monclient(hunting): picked mon.noname-g con 0x7f4d300a4c10 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:06:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4d30137a70 0x7f4d30136a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 10 monclient(hunting): picked mon.noname-c con 0x7f4d30137a70 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d3013c8f0 0x7f4d301386a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 10 monclient(hunting): picked mon.noname-h con 0x7f4d3013c8f0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4d30141dd0 con 0x7f4d300a4c10 2024-08-18T21:06:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f4d30141c50 con 0x7f4d30137a70 2024-08-18T21:06:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f4d30141f50 con 0x7f4d3013c8f0 2024-08-18T21:06:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d36b56640 10 monclient(hunting): authenticate will time out at 1138.725750s 2024-08-18T21:06:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4d30137a70 0x7f4d30136a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4d30137a70 0x7f4d30136a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:60330/0 (socket says 172.21.15.5:60330) 2024-08-18T21:06:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 1 -- 172.21.15.5:0/578507823 learned_addr learned my addr 172.21.15.5:0/578507823 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 10 monclient(hunting): get_auth_request con 0x7f4d30137a70 auth_method 0 2024-08-18T21:06:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d350f3640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d3013c8f0 0x7f4d301386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d348f2640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d300a4c10 0x7f4d301d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d348f2640 10 monclient(hunting): get_auth_request con 0x7f4d300a4c10 auth_method 0 2024-08-18T21:06:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d348f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d348f2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d348f2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 10 monclient(hunting): handle_auth_done global_id 5107 payload 824 2024-08-18T21:06:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 1 -- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d3013c8f0 msgr2=0x7f4d301386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d3013c8f0 0x7f4d301386a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 1 -- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d300a4c10 msgr2=0x7f4d301d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d300a4c10 0x7f4d301d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 10 monclient: _finish_hunting 0 2024-08-18T21:06:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 1 monclient: found mon.noname-c 2024-08-18T21:06:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:06:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d2ffff640 1 -- 172.21.15.5:0/578507823 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3013c1d0 con 0x7f4d30137a70 2024-08-18T21:06:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d350f3640 10 monclient: get_auth_request con 0x7f4d3013c8f0 auth_method 0 2024-08-18T21:06:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.710+0000 7f4d350f3640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d3013c8f0 0x7f4d301386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:06:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2ffff640 1 -- 172.21.15.5:0/578507823 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4d30137a70 msgr2=0x7f4d30136a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2ffff640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4d30137a70 0x7f4d30136a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4d180097c0 tx=0x7f4d180191c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2d7fa640 1 -- 172.21.15.5:0/578507823 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4d180b9070 con 0x7f4d30137a70 2024-08-18T21:06:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:06:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2d7fa640 10 monclient: dump: 2024-08-18T21:06:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.727 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2d7fa640 10 monclient: _finish_auth 0 2024-08-18T21:06:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2d7fa640 10 monclient: _check_auth_tickets 2024-08-18T21:06:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2d7fa640 1 -- 172.21.15.5:0/578507823 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d18004250 con 0x7f4d30137a70 2024-08-18T21:06:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d36b56640 5 monclient: authenticate success, global_id 5107 2024-08-18T21:06:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d36b56640 10 monclient: _renew_subs 2024-08-18T21:06:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d36b56640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:06:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d36b56640 1 -- 172.21.15.5:0/578507823 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d3013ab50 con 0x7f4d30137a70 2024-08-18T21:06:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2d7fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2d7fa640 1 -- 172.21.15.5:0/578507823 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4d180b0040 con 0x7f4d30137a70 2024-08-18T21:06:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2d7fa640 10 monclient: dump: 2024-08-18T21:06:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.729 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d36b56640 10 monclient: _renew_subs 2024-08-18T21:06:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d36b56640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:06:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d36b56640 1 -- 172.21.15.5:0/578507823 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d30068dd0 con 0x7f4d30137a70 2024-08-18T21:06:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2e7fc640 4 set_mon_vals no callback set 2024-08-18T21:06:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d36b56640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d36b56640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d30136fb0 0x7f4d30138be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d36b56640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d36b56640 1 -- 172.21.15.5:0/578507823 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f4d3013bb70 con 0x7f4d30136fb0 2024-08-18T21:06:11.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2d7fa640 1 -- 172.21.15.5:0/578507823 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f4d18003620 con 0x7f4d30137a70 2024-08-18T21:06:11.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d348f2640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d30136fb0 0x7f4d30138be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d348f2640 10 monclient: get_auth_request con 0x7f4d30136fb0 auth_method 0 2024-08-18T21:06:11.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d348f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d348f2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d348f2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2d7fa640 1 --2- 172.21.15.5:0/578507823 >> v2:172.21.15.157:6812/631023601 conn(0x7f4d1003bdc0 0x7f4d1003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d2d7fa640 1 -- 172.21.15.5:0/578507823 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(78..78 src has 22..78) ==== 3506+0+0 (secure 0 0 0) 0x7f4d180e7a80 con 0x7f4d30137a70 2024-08-18T21:06:11.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d348f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d348f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d348f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d350f3640 1 --2- 172.21.15.5:0/578507823 >> v2:172.21.15.157:6812/631023601 conn(0x7f4d1003bdc0 0x7f4d1003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d348f2640 10 monclient(hunting): handle_auth_done global_id 34475 payload 824 2024-08-18T21:06:11.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d348f2640 1 -- 172.21.15.5:0/578507823 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4d30139e90 con 0x7f4d30136fb0 2024-08-18T21:06:11.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.714+0000 7f4d350f3640 10 monclient: get_auth_request con 0x7f4d1003bdc0 auth_method 0 2024-08-18T21:06:11.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.718+0000 7f4d348f2640 1 -- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d30136fb0 msgr2=0x7f4d30138be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.718+0000 7f4d348f2640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d30136fb0 0x7f4d30138be0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000e450 tx=0x7f4d2000e910 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.718+0000 7f4d350f3640 1 --2- 172.21.15.5:0/578507823 >> v2:172.21.15.157:6812/631023601 conn(0x7f4d1003bdc0 0x7f4d1003e280 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4d28007440 tx=0x7f4d2800b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.718+0000 7f4d2d7fa640 1 -- 172.21.15.5:0/578507823 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4d20006c50 con 0x7f4d30136fb0 2024-08-18T21:06:11.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.718+0000 7f4d2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.718+0000 7f4d2d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:06:11.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.718+0000 7f4d2d7fa640 10 monclient: dump: 2024-08-18T21:06:11.731 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.731 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.732 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.732 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.732 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.732 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.732 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.732 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.732 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.732 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.732 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.732 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.732 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.732 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.732 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.732 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.718+0000 7f4d2d7fa640 1 -- 172.21.15.5:0/578507823 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4d20007450 con 0x7f4d30136fb0 2024-08-18T21:06:11.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.718+0000 7f4d2d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:11.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.718+0000 7f4d2d7fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:11.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.718+0000 7f4d2d7fa640 1 -- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d30136fb0 msgr2=0x7f4d30138be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.718+0000 7f4d2d7fa640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d30136fb0 0x7f4d30138be0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000e450 tx=0x7f4d2000e910 comp rx=0 tx=0).stop 2024-08-18T21:06:11.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.718+0000 7f4d2d7fa640 1 -- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d30136fb0 msgr2=0x7f4d30138be0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:11.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.718+0000 7f4d2d7fa640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d30136fb0 0x7f4d30138be0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000e450 tx=0x7f4d2000e910 comp rx=0 tx=0).stop 2024-08-18T21:06:11.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.726+0000 7f4d36b56640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:11.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.726+0000 7f4d36b56640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d30139120 0x7f4d3006ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.726+0000 7f4d36b56640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.726+0000 7f4d36b56640 1 -- 172.21.15.5:0/578507823 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f4d30139530 con 0x7f4d30139120 2024-08-18T21:06:11.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.726+0000 7f4d348f2640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d30139120 0x7f4d3006ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.726+0000 7f4d348f2640 10 monclient: get_auth_request con 0x7f4d30139120 auth_method 0 2024-08-18T21:06:11.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.726+0000 7f4d348f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.726+0000 7f4d348f2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.726+0000 7f4d348f2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.726+0000 7f4d348f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.726+0000 7f4d348f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.726+0000 7f4d348f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.726+0000 7f4d348f2640 10 monclient(hunting): handle_auth_done global_id 34484 payload 824 2024-08-18T21:06:11.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.726+0000 7f4d348f2640 1 -- 172.21.15.5:0/578507823 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4d3006dbf0 con 0x7f4d30139120 2024-08-18T21:06:11.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d348f2640 1 -- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d30139120 msgr2=0x7f4d3006ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d348f2640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d30139120 0x7f4d3006ff60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000e450 tx=0x7f4d20003770 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d2d7fa640 1 -- 172.21.15.5:0/578507823 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4d2001ebd0 con 0x7f4d30139120 2024-08-18T21:06:11.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d2d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:06:11.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d2d7fa640 10 monclient: dump: 2024-08-18T21:06:11.736 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.736 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.736 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.736 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.737 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d2d7fa640 1 -- 172.21.15.5:0/578507823 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9246 (secure 0 0 0) 0x7f4d2001e760 con 0x7f4d30139120 2024-08-18T21:06:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d2d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d2d7fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d2d7fa640 1 -- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d30139120 msgr2=0x7f4d3006ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d2d7fa640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d30139120 0x7f4d3006ff60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000e450 tx=0x7f4d20003770 comp rx=0 tx=0).stop 2024-08-18T21:06:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d2d7fa640 1 -- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d30139120 msgr2=0x7f4d3006ff60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d2d7fa640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d30139120 0x7f4d3006ff60 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000e450 tx=0x7f4d20003770 comp rx=0 tx=0).stop 2024-08-18T21:06:11.738 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:11.738 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:11.738 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:11.738 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:11.739 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:11.739 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 91523, 2024-08-18T21:06:11.739 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:11.739 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:11.739 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:11.739 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:11.739 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:11.739 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:11.739 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:11.739 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:11.739 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:11.739 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:11.739 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.740 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:06:11.740 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:11.740 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:11.740 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:11.740 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.740 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.740 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.740 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.740 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.740 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.740 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.740 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.740 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.742 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.742 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.742 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.742 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:11.742 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:11.742 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:11.742 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:11.742 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:11.742 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:11.742 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:11.742 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:11.742 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.744 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.744 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.744 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.744 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.744 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.744 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.744 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:11.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.744 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:11.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.744 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:11.744 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:11.744 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:11.745 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:11.745 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.745 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.745 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:11.746 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:11.746 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.746 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.746 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.746 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:11.746 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:11.746 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.746 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.746 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.746 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:11.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:11.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.747 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.747 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:11.747 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:11.747 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.747 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.747 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.748 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:11.748 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:11.748 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:11.748 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:11.749 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.749 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:11.749 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:11.749 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.749 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.749 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.749 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:11.749 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:11.750 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:11.750 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:11.750 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.750 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.751 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.751 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:11.751 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:11.751 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.751 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.751 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.751 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:11.751 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:11.751 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.751 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:11.752 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:11.752 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.752 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.752 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:11.752 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:11.752 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.753 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.753 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.753 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:11.753 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:11.753 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:11.753 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:11.754 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.754 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.754 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:11.754 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:11.754 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.754 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.754 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.754 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:11.755 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:11.755 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:11.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:11.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.755 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.755 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:11.756 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:11.756 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.756 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.756 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.756 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:11.756 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:11.756 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.756 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:11.757 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:11.757 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.757 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.757 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:11.757 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:11.757 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.757 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.758 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.758 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:11.758 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:11.758 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:11.758 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.759 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:11.759 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.759 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.759 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:11.759 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:11.759 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.759 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.759 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.759 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.759 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.760 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:11.760 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:11.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.760 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:11.760 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:11.760 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:11.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.760 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.760 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:11.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.760 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:11.760 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:11.760 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:11.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.760 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.761 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:11.761 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d36b56640 1 -- 172.21.15.5:0/578507823 >> v2:172.21.15.157:6812/631023601 conn(0x7f4d1003bdc0 msgr2=0x7f4d1003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d36b56640 1 --2- 172.21.15.5:0/578507823 >> v2:172.21.15.157:6812/631023601 conn(0x7f4d1003bdc0 0x7f4d1003e280 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4d28007440 tx=0x7f4d2800b040 comp rx=0 tx=0).stop 2024-08-18T21:06:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d36b56640 10 monclient: shutdown 2024-08-18T21:06:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d36b56640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d36b56640 1 -- 172.21.15.5:0/578507823 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4d30137a70 msgr2=0x7f4d30136a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d36b56640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4d30137a70 0x7f4d30136a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4d180097c0 tx=0x7f4d180191c0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d350f3640 1 -- 172.21.15.5:0/578507823 reap_dead start 2024-08-18T21:06:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d36b56640 1 -- 172.21.15.5:0/578507823 shutdown_connections 2024-08-18T21:06:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d36b56640 1 --2- 172.21.15.5:0/578507823 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4d30137a70 0x7f4d30136a70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.730+0000 7f4d36b56640 1 -- 172.21.15.5:0/578507823 >> 172.21.15.5:0/578507823 conn(0x7f4d300688d0 msgr2=0x7f4d3006c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.734+0000 7f4d36b56640 1 -- 172.21.15.5:0/578507823 shutdown_connections 2024-08-18T21:06:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.734+0000 7f4d36b56640 1 -- 172.21.15.5:0/578507823 wait complete. 2024-08-18T21:06:11.763 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:11.764 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:06:11.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.874+0000 7f52d5022640 10 monclient: get_monmap_and_config 2024-08-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.874+0000 7f52d5022640 10 monclient: build_initial_monmap 2024-08-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.874+0000 7f52d5022640 10 monclient: monmap: 2024-08-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:11.879068+0000 2024-08-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:11.879068+0000 2024-08-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.874+0000 7f52d5022640 1 Processor -- start 2024-08-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.874+0000 7f52d5022640 1 -- start start 2024-08-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.874+0000 7f52d5022640 10 monclient: init 2024-08-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.874+0000 7f52d5022640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52d5022640 10 monclient: _add_conns ranks=[0,3,10,1,2,7,6,4,5,8,9] 2024-08-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52d5022640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f52d00a1ff0 addr v1:172.21.15.5:6789/0 2024-08-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52d5022640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f52d0137b40 0x7f52d013c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52d5022640 10 monclient(hunting): picked mon.noname-g con 0x7f52d0137b40 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52d5022640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f52d0137fa0 0x7f52d013ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52d5022640 10 monclient(hunting): picked mon.noname-f con 0x7f52d0137fa0 addr v2:172.21.15.157:3300/0 2024-08-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52d5022640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d00a23d0 con 0x7f52d00a1ff0 2024-08-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52d5022640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52d5022640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f52d009dd50 con 0x7f52d0137fa0 2024-08-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52d5022640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52d5022640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f52d009e970 con 0x7f52d0137b40 2024-08-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52d5022640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52d5022640 10 monclient(hunting): authenticate will time out at 1138.892102s 2024-08-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52ced9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f52d00a1ff0 0x7f52d0137430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36768/0 (socket says 172.21.15.5:36768) 2024-08-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52ced9d640 1 -- 172.21.15.5:0/1959197143 learned_addr learned my addr 172.21.15.5:0/1959197143 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 1 --2- 172.21.15.5:0/1959197143 >> v2:172.21.15.157:3300/0 conn(0x7f52d0137fa0 0x7f52d013ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 10 monclient(hunting): get_auth_request con 0x7f52d0137fa0 auth_method 0 2024-08-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52ce59c640 1 --2- 172.21.15.5:0/1959197143 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f52d0137b40 0x7f52d013c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52ce59c640 10 monclient(hunting): get_auth_request con 0x7f52d0137b40 auth_method 0 2024-08-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52ce59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52ce59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52ce59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52ce59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52ce59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52ce59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 10 monclient(hunting): handle_auth_done global_id 4969 payload 274 2024-08-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 1 -- 172.21.15.5:0/1959197143 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f52d0137b40 msgr2=0x7f52d013c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 1 --2- 172.21.15.5:0/1959197143 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f52d0137b40 0x7f52d013c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 1 -- 172.21.15.5:0/1959197143 >> v1:172.21.15.5:6789/0 conn(0x7f52d00a1ff0 legacy=0x7f52d0137430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 10 monclient: _finish_hunting 0 2024-08-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 1 monclient: found mon.noname-f 2024-08-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.878+0000 7f52cf59e640 1 -- 172.21.15.5:0/1959197143 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d009ec50 con 0x7f52d0137fa0 2024-08-18T21:06:11.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52cf59e640 1 -- 172.21.15.5:0/1959197143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52d0137fa0 msgr2=0x7f52d013ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52cf59e640 1 --2- 172.21.15.5:0/1959197143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52d0137fa0 0x7f52d013ed00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f52c00097c0 tx=0x7f52c001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47825f96629af4f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52cdd9b640 1 -- 172.21.15.5:0/1959197143 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f52c00b0070 con 0x7f52d0137fa0 2024-08-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52cdd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52cdd9b640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52cdd9b640 10 monclient: dump: 2024-08-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52cdd9b640 10 monclient: _finish_auth 0 2024-08-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52cdd9b640 10 monclient: _check_auth_tickets 2024-08-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52cdd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52cdd9b640 1 -- 172.21.15.5:0/1959197143 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c00aa810 con 0x7f52d0137fa0 2024-08-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52cdd9b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52cdd9b640 1 -- 172.21.15.5:0/1959197143 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f52c00aae30 con 0x7f52d0137fa0 2024-08-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52cdd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52cdd9b640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52cdd9b640 10 monclient: dump: 2024-08-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 5 monclient: authenticate success, global_id 4969 2024-08-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 4 set_mon_vals no callback set 2024-08-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 10 monclient: shutdown 2024-08-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 1 -- 172.21.15.5:0/1959197143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52d0137fa0 msgr2=0x7f52d013ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 1 --2- 172.21.15.5:0/1959197143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52d0137fa0 0x7f52d013ed00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f52c00097c0 tx=0x7f52c001c360 comp rx=0 tx=0).stop 2024-08-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 1 -- 172.21.15.5:0/1959197143 shutdown_connections 2024-08-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 1 --2- 172.21.15.5:0/1959197143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52d0137fa0 0x7f52d013ed00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 1 --2- 172.21.15.5:0/1959197143 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f52d0137b40 0x7f52d013c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 1 -- 172.21.15.5:0/1959197143 >> 172.21.15.5:0/1959197143 conn(0x7f52d00a8020 msgr2=0x7f52d00a8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 1 -- 172.21.15.5:0/1959197143 shutdown_connections 2024-08-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 1 -- 172.21.15.5:0/1959197143 wait complete. 2024-08-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 10 monclient: build_initial_monmap 2024-08-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 10 monclient: monmap: 2024-08-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 1 Processor -- start 2024-08-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 1 -- start start 2024-08-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.882+0000 7f52d5022640 10 monclient: init 2024-08-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52d5022640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52d5022640 10 monclient: _add_conns ranks=[0,5,4,1,8,3,7,6,2] 2024-08-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52d5022640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d00a1ff0 0x7f52d012de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52d5022640 10 monclient(hunting): picked mon.noname-a con 0x7f52d00a1ff0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52d5022640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f52d0137b40 0x7f52d006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52d5022640 10 monclient(hunting): picked mon.noname-h con 0x7f52d0137b40 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52d5022640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f52d0137fa0 0x7f52d0070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52d5022640 10 monclient(hunting): picked mon.noname-c con 0x7f52d0137fa0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52d5022640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52d5022640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f52d0141c70 con 0x7f52d00a1ff0 2024-08-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52d5022640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52d5022640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f52d00a1e00 con 0x7f52d0137fa0 2024-08-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52d5022640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52d5022640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f52d0141df0 con 0x7f52d0137b40 2024-08-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52d5022640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52d5022640 10 monclient(hunting): authenticate will time out at 1138.900417s 2024-08-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f52d0137fa0 0x7f52d0070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f52d0137fa0 0x7f52d0070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:60336/0 (socket says 172.21.15.5:60336) 2024-08-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52ced9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d00a1ff0 0x7f52d012de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 1 -- 172.21.15.5:0/409882340 learned_addr learned my addr 172.21.15.5:0/409882340 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 10 monclient(hunting): get_auth_request con 0x7f52d0137fa0 auth_method 0 2024-08-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52ced9d640 10 monclient(hunting): get_auth_request con 0x7f52d00a1ff0 auth_method 0 2024-08-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52ced9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52ced9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52ced9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52ced9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52ced9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52ced9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52ce59c640 1 --2- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f52d0137b40 0x7f52d006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52ce59c640 10 monclient(hunting): get_auth_request con 0x7f52d0137b40 auth_method 0 2024-08-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52ce59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52ce59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52ce59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 10 monclient(hunting): handle_auth_done global_id 5116 payload 824 2024-08-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 1 -- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f52d0137b40 msgr2=0x7f52d006fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 1 --2- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f52d0137b40 0x7f52d006fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 1 -- 172.21.15.5:0/409882340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d00a1ff0 msgr2=0x7f52d012de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 1 --2- 172.21.15.5:0/409882340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d00a1ff0 0x7f52d012de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 10 monclient: _finish_hunting 0 2024-08-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 1 monclient: found mon.noname-c 2024-08-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 1 -- 172.21.15.5:0/409882340 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d00a3cc0 con 0x7f52d0137fa0 2024-08-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 1 -- 172.21.15.5:0/409882340 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f52d0137fa0 msgr2=0x7f52d0070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.886+0000 7f52cf59e640 1 --2- 172.21.15.5:0/409882340 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f52d0137fa0 0x7f52d0070260 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f52c00097c0 tx=0x7f52c0019100 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52b77fe640 1 -- 172.21.15.5:0/409882340 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f52c00b0040 con 0x7f52d0137fa0 2024-08-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52b77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52b77fe640 10 monclient: dump: 2024-08-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52b77fe640 10 monclient: _finish_auth 0 2024-08-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52b77fe640 10 monclient: _check_auth_tickets 2024-08-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52d5022640 5 monclient: authenticate success, global_id 5116 2024-08-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52d5022640 10 monclient: _renew_subs 2024-08-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52b77fe640 1 -- 172.21.15.5:0/409882340 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c00ba070 con 0x7f52d0137fa0 2024-08-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52d5022640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52d5022640 1 -- 172.21.15.5:0/409882340 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d013dde0 con 0x7f52d0137fa0 2024-08-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52b77fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52b77fe640 1 -- 172.21.15.5:0/409882340 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f52c0004240 con 0x7f52d0137fa0 2024-08-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52b77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52b77fe640 10 monclient: dump: 2024-08-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52d5022640 10 monclient: _renew_subs 2024-08-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52cd59a640 4 set_mon_vals no callback set 2024-08-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52d5022640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52d5022640 1 -- 172.21.15.5:0/409882340 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d013e350 con 0x7f52d0137fa0 2024-08-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52d5022640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52d5022640 1 --2- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f52d012e340 0x7f52d00707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52d5022640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52d5022640 1 -- 172.21.15.5:0/409882340 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f52d0051140 con 0x7f52d012e340 2024-08-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52b77fe640 1 -- 172.21.15.5:0/409882340 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f52c0003620 con 0x7f52d0137fa0 2024-08-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52ced9d640 1 --2- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f52d012e340 0x7f52d00707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52ced9d640 10 monclient: get_auth_request con 0x7f52d012e340 auth_method 0 2024-08-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52ced9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52ced9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52ced9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52b77fe640 1 --2- 172.21.15.5:0/409882340 >> v2:172.21.15.157:6812/631023601 conn(0x7f52bc03bdf0 0x7f52bc03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52b77fe640 1 -- 172.21.15.5:0/409882340 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(78..78 src has 22..78) ==== 3506+0+0 (secure 0 0 0) 0x7f52c00e7e40 con 0x7f52d0137fa0 2024-08-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52ced9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52ced9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52ced9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52ce59c640 1 --2- 172.21.15.5:0/409882340 >> v2:172.21.15.157:6812/631023601 conn(0x7f52bc03bdf0 0x7f52bc03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52ce59c640 10 monclient: get_auth_request con 0x7f52bc03bdf0 auth_method 0 2024-08-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52ced9d640 10 monclient(hunting): handle_auth_done global_id 4921 payload 824 2024-08-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.890+0000 7f52ced9d640 1 -- 172.21.15.5:0/409882340 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52d0137430 con 0x7f52d012e340 2024-08-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.894+0000 7f52ced9d640 1 -- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f52d012e340 msgr2=0x7f52d00707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.894+0000 7f52ced9d640 1 --2- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f52d012e340 0x7f52d00707a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f52c800eaa0 tx=0x7f52c800eb90 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.894+0000 7f52ce59c640 1 --2- 172.21.15.5:0/409882340 >> v2:172.21.15.157:6812/631023601 conn(0x7f52bc03bdf0 0x7f52bc03e2b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f52d0071480 tx=0x7f52c400d040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.894+0000 7f52b77fe640 1 -- 172.21.15.5:0/409882340 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f52c800ee60 con 0x7f52d012e340 2024-08-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.894+0000 7f52b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.894+0000 7f52b77fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.894+0000 7f52b77fe640 10 monclient: dump: 2024-08-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.894+0000 7f52b77fe640 1 -- 172.21.15.5:0/409882340 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f52c8019070 con 0x7f52d012e340 2024-08-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.894+0000 7f52b77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.894+0000 7f52b77fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.894+0000 7f52b77fe640 1 -- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f52d012e340 msgr2=0x7f52d00707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.894+0000 7f52b77fe640 1 --2- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f52d012e340 0x7f52d00707a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f52c800eaa0 tx=0x7f52c800eb90 comp rx=0 tx=0).stop 2024-08-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.894+0000 7f52b77fe640 1 -- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f52d012e340 msgr2=0x7f52d00707a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.894+0000 7f52b77fe640 1 --2- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f52d012e340 0x7f52d00707a0 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f52c800eaa0 tx=0x7f52c800eb90 comp rx=0 tx=0).stop 2024-08-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.902+0000 7f52d5022640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.902+0000 7f52d5022640 1 --2- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f52d0070ce0 0x7f52d0131d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.902+0000 7f52d5022640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.902+0000 7f52d5022640 1 -- 172.21.15.5:0/409882340 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f52d0137150 con 0x7f52d0070ce0 2024-08-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.902+0000 7f52ced9d640 1 --2- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f52d0070ce0 0x7f52d0131d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.902+0000 7f52ced9d640 10 monclient: get_auth_request con 0x7f52d0070ce0 auth_method 0 2024-08-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.902+0000 7f52ced9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.902+0000 7f52ced9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.902+0000 7f52ced9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.902+0000 7f52ced9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.902+0000 7f52ced9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.902+0000 7f52ced9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.902+0000 7f52ced9d640 10 monclient(hunting): handle_auth_done global_id 4930 payload 824 2024-08-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.902+0000 7f52ced9d640 1 -- 172.21.15.5:0/409882340 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f52d00710f0 con 0x7f52d0070ce0 2024-08-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52ced9d640 1 -- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f52d0070ce0 msgr2=0x7f52d0131d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52ced9d640 1 --2- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f52d0070ce0 0x7f52d0131d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f52c8007930 tx=0x7f52c8004950 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52b77fe640 1 -- 172.21.15.5:0/409882340 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f52c8024070 con 0x7f52d0070ce0 2024-08-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52b77fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52b77fe640 10 monclient: dump: 2024-08-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52b77fe640 1 -- 172.21.15.5:0/409882340 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f52c8014480 con 0x7f52d0070ce0 2024-08-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52b77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52b77fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52b77fe640 1 -- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f52d0070ce0 msgr2=0x7f52d0131d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52b77fe640 1 --2- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f52d0070ce0 0x7f52d0131d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f52c8007930 tx=0x7f52c8004950 comp rx=0 tx=0).stop 2024-08-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52b77fe640 1 -- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f52d0070ce0 msgr2=0x7f52d0131d90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52b77fe640 1 --2- 172.21.15.5:0/409882340 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f52d0070ce0 0x7f52d0131d90 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f52c8007930 tx=0x7f52c8004950 comp rx=0 tx=0).stop 2024-08-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 181002, 2024-08-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52d5022640 1 -- 172.21.15.5:0/409882340 >> v2:172.21.15.157:6812/631023601 conn(0x7f52bc03bdf0 msgr2=0x7f52bc03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52d5022640 1 --2- 172.21.15.5:0/409882340 >> v2:172.21.15.157:6812/631023601 conn(0x7f52bc03bdf0 0x7f52bc03e2b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f52d0071480 tx=0x7f52c400d040 comp rx=0 tx=0).stop 2024-08-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52d5022640 10 monclient: shutdown 2024-08-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52d5022640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52d5022640 1 -- 172.21.15.5:0/409882340 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f52d0137fa0 msgr2=0x7f52d0070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52d5022640 1 --2- 172.21.15.5:0/409882340 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f52d0137fa0 0x7f52d0070260 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f52c00097c0 tx=0x7f52c0019100 comp rx=0 tx=0).stop 2024-08-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52cf59e640 1 -- 172.21.15.5:0/409882340 reap_dead start 2024-08-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52cf59e640 1 -- 172.21.15.5:0/409882340 reap_dead start 2024-08-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52d5022640 1 -- 172.21.15.5:0/409882340 shutdown_connections 2024-08-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52d5022640 1 -- 172.21.15.5:0/409882340 >> 172.21.15.5:0/409882340 conn(0x7f52d00a8020 msgr2=0x7f52d0136020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52d5022640 1 -- 172.21.15.5:0/409882340 shutdown_connections 2024-08-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:11.906+0000 7f52d5022640 1 -- 172.21.15.5:0/409882340 wait complete. 2024-08-18T21:06:11.938 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:11.938 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-18T21:06:11.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-18T21:06:12.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 10 monclient: get_monmap_and_config 2024-08-18T21:06:12.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 10 monclient: build_initial_monmap 2024-08-18T21:06:12.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 10 monclient: monmap: 2024-08-18T21:06:12.053 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:12.054511+0000 2024-08-18T21:06:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:12.054511+0000 2024-08-18T21:06:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:12.055 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 1 Processor -- start 2024-08-18T21:06:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 1 -- start start 2024-08-18T21:06:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 10 monclient: init 2024-08-18T21:06:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 10 monclient: _add_conns ranks=[9,10,4,1,7,2,3,8,6,5,0] 2024-08-18T21:06:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14a00a6ce0 0x7f14a00a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 10 monclient(hunting): picked mon.noname-a con 0x7f14a00a6ce0 addr v2:172.21.15.5:3300/0 2024-08-18T21:06:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f14a00a7600 0x7f14a0139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 10 monclient(hunting): picked mon.noname-f con 0x7f14a00a7600 addr v2:172.21.15.157:3300/0 2024-08-18T21:06:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f14a0139fe0 0x7f14a013a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 10 monclient(hunting): picked mon.noname-c con 0x7f14a0139fe0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f14a00a5000 con 0x7f14a00a6ce0 2024-08-18T21:06:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f14a00a4360 con 0x7f14a00a7600 2024-08-18T21:06:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f14a00a45d0 con 0x7f14a0139fe0 2024-08-18T21:06:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a84a6640 10 monclient(hunting): authenticate will time out at 1139.067632s 2024-08-18T21:06:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a6242640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14a00a6ce0 0x7f14a00a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a6a43640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f14a0139fe0 0x7f14a013a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a6242640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14a00a6ce0 0x7f14a00a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40672/0 (socket says 172.21.15.5:40672) 2024-08-18T21:06:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a6242640 1 -- 172.21.15.5:0/4260994642 learned_addr learned my addr 172.21.15.5:0/4260994642 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a6242640 10 monclient(hunting): get_auth_request con 0x7f14a00a6ce0 auth_method 0 2024-08-18T21:06:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a6242640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a6242640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a6242640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a6a43640 10 monclient(hunting): get_auth_request con 0x7f14a0139fe0 auth_method 0 2024-08-18T21:06:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a6a43640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a6a43640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a6a43640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a6a43640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.050+0000 7f14a6a43640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a6a43640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a6242640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a6242640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a6242640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a5a41640 1 --2- 172.21.15.5:0/4260994642 >> v2:172.21.15.157:3300/0 conn(0x7f14a00a7600 0x7f14a0139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a5a41640 10 monclient(hunting): get_auth_request con 0x7f14a00a7600 auth_method 0 2024-08-18T21:06:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a5a41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a5a41640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a5a41640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a6a43640 10 monclient(hunting): handle_auth_done global_id 5125 payload 274 2024-08-18T21:06:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a6a43640 1 -- 172.21.15.5:0/4260994642 >> v2:172.21.15.157:3300/0 conn(0x7f14a00a7600 msgr2=0x7f14a0139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a6a43640 1 --2- 172.21.15.5:0/4260994642 >> v2:172.21.15.157:3300/0 conn(0x7f14a00a7600 0x7f14a0139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a6a43640 1 -- 172.21.15.5:0/4260994642 >> v2:172.21.15.5:3300/0 conn(0x7f14a00a6ce0 msgr2=0x7f14a00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a6a43640 1 --2- 172.21.15.5:0/4260994642 >> v2:172.21.15.5:3300/0 conn(0x7f14a00a6ce0 0x7f14a00a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a6a43640 10 monclient: _finish_hunting 0 2024-08-18T21:06:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a6a43640 1 monclient: found mon.noname-c 2024-08-18T21:06:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a6a43640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a6a43640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:06:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.054+0000 7f14a6a43640 1 -- 172.21.15.5:0/4260994642 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a00a32d0 con 0x7f14a0139fe0 2024-08-18T21:06:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a6a43640 1 -- 172.21.15.5:0/4260994642 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f14a0139fe0 msgr2=0x7f14a013a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a6a43640 1 --2- 172.21.15.5:0/4260994642 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f14a0139fe0 0x7f14a013a490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f14a00a81b0 tx=0x7f149801c340 comp rx=0 tx=0).ready entity=mon.4 client_cookie=9f33d1b5894d2f75 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a5240640 1 -- 172.21.15.5:0/4260994642 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f14980b0070 con 0x7f14a0139fe0 2024-08-18T21:06:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a5240640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a5240640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:06:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a5240640 10 monclient: dump: 2024-08-18T21:06:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:12.065 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a5240640 10 monclient: _finish_auth 0 2024-08-18T21:06:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a5240640 10 monclient: _check_auth_tickets 2024-08-18T21:06:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a5240640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a5240640 1 -- 172.21.15.5:0/4260994642 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14980aa810 con 0x7f14a0139fe0 2024-08-18T21:06:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a84a6640 5 monclient: authenticate success, global_id 5125 2024-08-18T21:06:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a5240640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a84a6640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a5240640 1 -- 172.21.15.5:0/4260994642 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f14980aae30 con 0x7f14a0139fe0 2024-08-18T21:06:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a84a6640 4 set_mon_vals no callback set 2024-08-18T21:06:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a5240640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a5240640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a5240640 10 monclient: dump: 2024-08-18T21:06:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:12.067 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a84a6640 10 monclient: shutdown 2024-08-18T21:06:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a84a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a84a6640 1 -- 172.21.15.5:0/4260994642 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f14a0139fe0 msgr2=0x7f14a013a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a84a6640 1 --2- 172.21.15.5:0/4260994642 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f14a0139fe0 0x7f14a013a490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f14a00a81b0 tx=0x7f149801c340 comp rx=0 tx=0).stop 2024-08-18T21:06:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a84a6640 1 -- 172.21.15.5:0/4260994642 shutdown_connections 2024-08-18T21:06:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a84a6640 1 --2- 172.21.15.5:0/4260994642 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f14a0139fe0 0x7f14a013a490 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a84a6640 1 --2- 172.21.15.5:0/4260994642 >> v2:172.21.15.157:3300/0 conn(0x7f14a00a7600 0x7f14a0139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a84a6640 1 --2- 172.21.15.5:0/4260994642 >> v2:172.21.15.5:3300/0 conn(0x7f14a00a6ce0 0x7f14a00a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a84a6640 1 -- 172.21.15.5:0/4260994642 >> 172.21.15.5:0/4260994642 conn(0x7f14a00acbc0 msgr2=0x7f14a00a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a84a6640 1 -- 172.21.15.5:0/4260994642 shutdown_connections 2024-08-18T21:06:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a84a6640 1 -- 172.21.15.5:0/4260994642 wait complete. 2024-08-18T21:06:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a84a6640 10 monclient: build_initial_monmap 2024-08-18T21:06:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.058+0000 7f14a84a6640 10 monclient: monmap: 2024-08-18T21:06:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:12.069 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 1 Processor -- start 2024-08-18T21:06:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 1 -- start start 2024-08-18T21:06:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 10 monclient: init 2024-08-18T21:06:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 10 monclient: _add_conns ranks=[5,6,0,8,1,7,3,2,4] 2024-08-18T21:06:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f14a00a6ce0 0x7f14a0134d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 10 monclient(hunting): picked mon.noname-h con 0x7f14a00a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f14a00a7600 0x7f14a0135280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 10 monclient(hunting): picked mon.noname-d con 0x7f14a00a7600 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14a0139fe0 0x7f14a013aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 10 monclient(hunting): picked mon.noname-a con 0x7f14a0139fe0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:06:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f14a00a79e0 con 0x7f14a0139fe0 2024-08-18T21:06:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f14a00a8220 con 0x7f14a00a6ce0 2024-08-18T21:06:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f14a013ee30 con 0x7f14a00a7600 2024-08-18T21:06:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a84a6640 10 monclient(hunting): authenticate will time out at 1139.076906s 2024-08-18T21:06:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a6a43640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14a0139fe0 0x7f14a013aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f14a00a7600 0x7f14a0135280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a6a43640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14a0139fe0 0x7f14a013aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40684/0 (socket says 172.21.15.5:40684) 2024-08-18T21:06:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a6a43640 1 -- 172.21.15.5:0/2732579304 learned_addr learned my addr 172.21.15.5:0/2732579304 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f14a00a7600 0x7f14a0135280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:45412/0 (socket says 172.21.15.5:45412) 2024-08-18T21:06:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a6a43640 10 monclient(hunting): get_auth_request con 0x7f14a0139fe0 auth_method 0 2024-08-18T21:06:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a6a43640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a6a43640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a6a43640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 10 monclient(hunting): get_auth_request con 0x7f14a00a7600 auth_method 0 2024-08-18T21:06:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a6a43640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a6a43640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a6a43640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a6242640 1 --2- 172.21.15.5:0/2732579304 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f14a00a6ce0 0x7f14a0134d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a6242640 10 monclient(hunting): get_auth_request con 0x7f14a00a6ce0 auth_method 0 2024-08-18T21:06:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a6242640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a6242640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a6242640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 10 monclient(hunting): handle_auth_done global_id 54150 payload 824 2024-08-18T21:06:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 1 -- 172.21.15.5:0/2732579304 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f14a00a6ce0 msgr2=0x7f14a0134d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 1 --2- 172.21.15.5:0/2732579304 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f14a00a6ce0 0x7f14a0134d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 1 -- 172.21.15.5:0/2732579304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14a0139fe0 msgr2=0x7f14a013aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 1 --2- 172.21.15.5:0/2732579304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14a0139fe0 0x7f14a013aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 10 monclient: _finish_hunting 0 2024-08-18T21:06:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 1 monclient: found mon.noname-d 2024-08-18T21:06:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:06:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 1 -- 172.21.15.5:0/2732579304 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a013e400 con 0x7f14a00a7600 2024-08-18T21:06:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a6a43640 1 --2- 172.21.15.5:0/2732579304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14a0139fe0 0x7f14a013aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:06:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 1 -- 172.21.15.5:0/2732579304 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f14a00a7600 msgr2=0x7f14a0135280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.062+0000 7f14a5a41640 1 --2- 172.21.15.5:0/2732579304 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f14a00a7600 0x7f14a0135280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1490007e90 tx=0x7f149000e4b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f149effd640 1 -- 172.21.15.5:0/2732579304 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f149000ee70 con 0x7f14a00a7600 2024-08-18T21:06:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f149effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f149effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:06:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f149effd640 10 monclient: dump: 2024-08-18T21:06:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:12.077 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f149effd640 10 monclient: _finish_auth 0 2024-08-18T21:06:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f149effd640 10 monclient: _check_auth_tickets 2024-08-18T21:06:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f149effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f149effd640 1 -- 172.21.15.5:0/2732579304 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1490019070 con 0x7f14a00a7600 2024-08-18T21:06:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f149effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f149effd640 1 -- 172.21.15.5:0/2732579304 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1490014420 con 0x7f14a00a7600 2024-08-18T21:06:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f149effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f149effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f149effd640 10 monclient: dump: 2024-08-18T21:06:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:12.079 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f14a84a6640 5 monclient: authenticate success, global_id 54150 2024-08-18T21:06:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f14a84a6640 10 monclient: _renew_subs 2024-08-18T21:06:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f14a84a6640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f14a84a6640 1 -- 172.21.15.5:0/2732579304 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a00abe70 con 0x7f14a00a7600 2024-08-18T21:06:12.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.066+0000 7f14a4a3f640 4 set_mon_vals no callback set 2024-08-18T21:06:12.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.070+0000 7f14a84a6640 10 monclient: _renew_subs 2024-08-18T21:06:12.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.070+0000 7f14a84a6640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:12.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.070+0000 7f14a84a6640 1 -- 172.21.15.5:0/2732579304 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a013db60 con 0x7f14a00a7600 2024-08-18T21:06:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.070+0000 7f149effd640 1 -- 172.21.15.5:0/2732579304 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f1490014680 con 0x7f14a00a7600 2024-08-18T21:06:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.070+0000 7f149cff9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.070+0000 7f149effd640 1 --2- 172.21.15.5:0/2732579304 >> v2:172.21.15.157:6812/631023601 conn(0x7f148003bdc0 0x7f148003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.070+0000 7f149effd640 1 -- 172.21.15.5:0/2732579304 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(79..79 src has 22..79) ==== 3898+0+0 (secure 0 0 0) 0x7f149004eb90 con 0x7f14a00a7600 2024-08-18T21:06:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.070+0000 7f149cff9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.070+0000 7f149cff9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.070+0000 7f149cff9640 1 -- 172.21.15.5:0/2732579304 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14a0139aa0 con 0x7f14a00a7600 2024-08-18T21:06:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.070+0000 7f14a6242640 1 --2- 172.21.15.5:0/2732579304 >> v2:172.21.15.157:6812/631023601 conn(0x7f148003bdc0 0x7f148003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.070+0000 7f14a6242640 10 monclient: get_auth_request con 0x7f148003bdc0 auth_method 0 2024-08-18T21:06:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.074+0000 7f14a6242640 1 --2- 172.21.15.5:0/2732579304 >> v2:172.21.15.157:6812/631023601 conn(0x7f148003bdc0 0x7f148003e280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1488009a60 tx=0x7f1488008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.078+0000 7f149effd640 1 -- 172.21.15.5:0/2732579304 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f1490023020 con 0x7f14a00a7600 2024-08-18T21:06:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.078+0000 7f149effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.078+0000 7f149effd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.314+0000 7f149cff9640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-18T21:06:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.314+0000 7f149cff9640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-18T21:06:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.314+0000 7f149cff9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.314+0000 7f149cff9640 1 -- 172.21.15.5:0/2732579304 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f14a01408f0 con 0x7f14a00a7600 2024-08-18T21:06:12.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f149effd640 1 -- 172.21.15.5:0/2732579304 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f149001c360 con 0x7f14a00a7600 2024-08-18T21:06:12.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f149effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-18T21:06:12.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f149effd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:12.321 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.321 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=11,kv=9,logm=67} crc {auth=1048670363,config=1618278320,health=3677445099,kv=672252078,logm=3287244677}) 2024-08-18T21:06:12.321 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=13,config=2,health=11,kv=9,logm=65} crc {auth=2082099420,config=1618278320,health=3966795812,kv=3058383650,logm=2622630153}) 2024-08-18T21:06:12.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=11,kv=9,logm=67} crc {auth=1048670363,config=1618278320,health=3677445099,kv=672252078,logm=3287244677}) 2024-08-18T21:06:12.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=13,health=11,kv=10,logm=66} crc {auth=2082099420,health=1394053703,kv=3664197221,logm=3390513151}) 2024-08-18T21:06:12.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=11,kv=9,logm=67} crc {auth=1048670363,config=1618278320,health=3677445099,kv=672252078,logm=3287244677}) 2024-08-18T21:06:12.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=13,config=1,health=12,kv=10,logm=64} crc {auth=2082099420,config=2457401934,health=906682742,kv=3664197221,logm=339724709}) 2024-08-18T21:06:12.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=11,kv=9,logm=67} crc {auth=1048670363,config=1618278320,health=3677445099,kv=672252078,logm=3287244677}) 2024-08-18T21:06:12.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=12,config=2,health=11,kv=9,logm=66} crc {auth=920445102,config=1618278320,health=1394053703,kv=334268416,logm=646860454}) 2024-08-18T21:06:12.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=11,kv=9,logm=67} crc {auth=1048670363,config=1618278320,health=3677445099,kv=672252078,logm=3287244677}) 2024-08-18T21:06:12.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=13,config=2,health=11,kv=10,logm=64} crc {auth=2082099420,config=1618278320,health=2223430764,kv=3664197221,logm=1512980048}) 2024-08-18T21:06:12.323 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.323 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=11,kv=9,logm=67} crc {auth=1048670363,config=1618278320,health=3677445099,kv=672252078,logm=3287244677}) 2024-08-18T21:06:12.323 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=13,config=2,health=12,kv=9,logm=64} crc {auth=2082099420,config=1618278320,health=2206154626,kv=147916585,logm=3110286283}) 2024-08-18T21:06:12.323 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.323 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=11,kv=9,logm=67} crc {auth=1048670363,config=1618278320,health=3677445099,kv=672252078,logm=3287244677}) 2024-08-18T21:06:12.323 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=13,config=2,health=12,kv=10,logm=63} crc {auth=891694587,config=1618278320,health=906682742,kv=3664197221,logm=635810763}) 2024-08-18T21:06:12.323 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.323 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=11,kv=9,logm=67} crc {auth=1048670363,config=1618278320,health=3677445099,kv=672252078,logm=3287244677}) 2024-08-18T21:06:12.323 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.318+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=12,config=2,health=12,kv=9,logm=65} crc {auth=4290712537,config=1618278320,health=906682742,kv=147916585,logm=3430637437}) 2024-08-18T21:06:12.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.322+0000 7f149cff9640 1 -- 172.21.15.5:0/2732579304 >> v2:172.21.15.157:6812/631023601 conn(0x7f148003bdc0 msgr2=0x7f148003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:12.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.322+0000 7f149cff9640 1 --2- 172.21.15.5:0/2732579304 >> v2:172.21.15.157:6812/631023601 conn(0x7f148003bdc0 0x7f148003e280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1488009a60 tx=0x7f1488008040 comp rx=0 tx=0).stop 2024-08-18T21:06:12.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.322+0000 7f149cff9640 10 monclient: shutdown 2024-08-18T21:06:12.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.322+0000 7f149cff9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:12.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.322+0000 7f149cff9640 1 -- 172.21.15.5:0/2732579304 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f14a00a7600 msgr2=0x7f14a0135280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.322+0000 7f149cff9640 1 --2- 172.21.15.5:0/2732579304 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f14a00a7600 0x7f14a0135280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1490007e90 tx=0x7f149000e4b0 comp rx=0 tx=0).stop 2024-08-18T21:06:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.322+0000 7f149cff9640 1 -- 172.21.15.5:0/2732579304 shutdown_connections 2024-08-18T21:06:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.322+0000 7f149cff9640 1 --2- 172.21.15.5:0/2732579304 >> v2:172.21.15.157:6812/631023601 conn(0x7f148003bdc0 0x7f148003e280 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.322+0000 7f149cff9640 1 --2- 172.21.15.5:0/2732579304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14a0139fe0 0x7f14a013aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.322+0000 7f149cff9640 1 --2- 172.21.15.5:0/2732579304 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f14a00a7600 0x7f14a0135280 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.322+0000 7f149cff9640 1 --2- 172.21.15.5:0/2732579304 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f14a00a6ce0 0x7f14a0134d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.322+0000 7f149cff9640 1 -- 172.21.15.5:0/2732579304 >> 172.21.15.5:0/2732579304 conn(0x7f14a00acbc0 msgr2=0x7f14a0135c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.322+0000 7f149cff9640 1 -- 172.21.15.5:0/2732579304 shutdown_connections 2024-08-18T21:06:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:12.322+0000 7f149cff9640 1 -- 172.21.15.5:0/2732579304 wait complete. 2024-08-18T21:06:12.331 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.331 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3427740004}) 2024-08-18T21:06:12.331 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1605280812}) 2024-08-18T21:06:12.331 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.331 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3427740004}) 2024-08-18T21:06:12.331 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=473161982}) 2024-08-18T21:06:12.332 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.332 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3427740004}) 2024-08-18T21:06:12.332 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3107351823}) 2024-08-18T21:06:12.332 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.332 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3427740004}) 2024-08-18T21:06:12.332 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1164541673}) 2024-08-18T21:06:12.332 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.332 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3427740004}) 2024-08-18T21:06:12.332 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1037596053}) 2024-08-18T21:06:12.332 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.332 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3427740004}) 2024-08-18T21:06:12.332 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1278507588}) 2024-08-18T21:06:12.332 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.332 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3427740004}) 2024-08-18T21:06:12.333 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1194942358}) 2024-08-18T21:06:12.333 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.333 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3427740004}) 2024-08-18T21:06:12.333 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.326+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3980523240}) 2024-08-18T21:06:12.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1880641737}) 2024-08-18T21:06:12.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2165102484}) 2024-08-18T21:06:12.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1880641737}) 2024-08-18T21:06:12.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4113487531}) 2024-08-18T21:06:12.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1880641737}) 2024-08-18T21:06:12.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4196179574}) 2024-08-18T21:06:12.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1880641737}) 2024-08-18T21:06:12.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3552684958}) 2024-08-18T21:06:12.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1880641737}) 2024-08-18T21:06:12.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2324193888}) 2024-08-18T21:06:12.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1880641737}) 2024-08-18T21:06:12.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2603713970}) 2024-08-18T21:06:12.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1880641737}) 2024-08-18T21:06:12.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2070156805}) 2024-08-18T21:06:12.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1880641737}) 2024-08-18T21:06:12.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.330+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=371113730}) 2024-08-18T21:06:12.338 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.338 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153703804}) 2024-08-18T21:06:12.338 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1116639123}) 2024-08-18T21:06:12.338 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153703804}) 2024-08-18T21:06:12.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=914074029}) 2024-08-18T21:06:12.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153703804}) 2024-08-18T21:06:12.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1632954345}) 2024-08-18T21:06:12.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153703804}) 2024-08-18T21:06:12.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1993671092}) 2024-08-18T21:06:12.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153703804}) 2024-08-18T21:06:12.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1821250863}) 2024-08-18T21:06:12.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153703804}) 2024-08-18T21:06:12.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=911462067}) 2024-08-18T21:06:12.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153703804}) 2024-08-18T21:06:12.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1274447678}) 2024-08-18T21:06:12.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153703804}) 2024-08-18T21:06:12.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.334+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3500580152}) 2024-08-18T21:06:12.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1376772068}) 2024-08-18T21:06:12.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3321820274}) 2024-08-18T21:06:12.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1376772068}) 2024-08-18T21:06:12.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3365395241}) 2024-08-18T21:06:12.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1376772068}) 2024-08-18T21:06:12.342 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=682949074}) 2024-08-18T21:06:12.342 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.342 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1376772068}) 2024-08-18T21:06:12.342 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3112200132}) 2024-08-18T21:06:12.342 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.342 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1376772068}) 2024-08-18T21:06:12.342 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2909233271}) 2024-08-18T21:06:12.342 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.342 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1376772068}) 2024-08-18T21:06:12.342 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2602346494}) 2024-08-18T21:06:12.342 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.342 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1376772068}) 2024-08-18T21:06:12.342 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=183691890}) 2024-08-18T21:06:12.342 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.343 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1376772068}) 2024-08-18T21:06:12.343 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=324751126}) 2024-08-18T21:06:12.344 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-18T21:06:12.345 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.345 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1695905949}) 2024-08-18T21:06:12.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=907168907}) 2024-08-18T21:06:12.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1695905949}) 2024-08-18T21:06:12.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3188541471}) 2024-08-18T21:06:12.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1695905949}) 2024-08-18T21:06:12.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1489146213}) 2024-08-18T21:06:12.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1695905949}) 2024-08-18T21:06:12.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1628275077}) 2024-08-18T21:06:12.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1695905949}) 2024-08-18T21:06:12.347 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.338+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4041585751}) 2024-08-18T21:06:12.347 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.347 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1695905949}) 2024-08-18T21:06:12.347 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2767490271}) 2024-08-18T21:06:12.347 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.347 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1695905949}) 2024-08-18T21:06:12.347 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1142790038}) 2024-08-18T21:06:12.347 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.347 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1695905949}) 2024-08-18T21:06:12.347 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=51188571}) 2024-08-18T21:06:12.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1510534462}) 2024-08-18T21:06:12.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=45746355}) 2024-08-18T21:06:12.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1510534462}) 2024-08-18T21:06:12.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3268493452}) 2024-08-18T21:06:12.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1510534462}) 2024-08-18T21:06:12.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=503831584}) 2024-08-18T21:06:12.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1510534462}) 2024-08-18T21:06:12.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1485340874}) 2024-08-18T21:06:12.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1510534462}) 2024-08-18T21:06:12.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3992899823}) 2024-08-18T21:06:12.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1510534462}) 2024-08-18T21:06:12.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1750294833}) 2024-08-18T21:06:12.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1510534462}) 2024-08-18T21:06:12.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2271979296}) 2024-08-18T21:06:12.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:12.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1510534462}) 2024-08-18T21:06:12.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:12.342+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4048121047}) 2024-08-18T21:06:13.032 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1886481315}) 2024-08-18T21:06:13.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3175133368}) 2024-08-18T21:06:13.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1886481315}) 2024-08-18T21:06:13.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3406781878}) 2024-08-18T21:06:13.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1886481315}) 2024-08-18T21:06:13.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3117502273}) 2024-08-18T21:06:13.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1886481315}) 2024-08-18T21:06:13.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3064941626}) 2024-08-18T21:06:13.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1886481315}) 2024-08-18T21:06:13.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1709331142}) 2024-08-18T21:06:13.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1886481315}) 2024-08-18T21:06:13.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3686958419}) 2024-08-18T21:06:13.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1886481315}) 2024-08-18T21:06:13.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1902622586}) 2024-08-18T21:06:13.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1886481315}) 2024-08-18T21:06:13.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.030+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3930486560}) 2024-08-18T21:06:13.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2091931959}) 2024-08-18T21:06:13.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=447987290}) 2024-08-18T21:06:13.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2091931959}) 2024-08-18T21:06:13.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2959761061}) 2024-08-18T21:06:13.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2091931959}) 2024-08-18T21:06:13.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3198106574}) 2024-08-18T21:06:13.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2091931959}) 2024-08-18T21:06:13.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3680285583}) 2024-08-18T21:06:13.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2091931959}) 2024-08-18T21:06:13.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1133694160}) 2024-08-18T21:06:13.039 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.039 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2091931959}) 2024-08-18T21:06:13.039 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=154585771}) 2024-08-18T21:06:13.039 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.039 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2091931959}) 2024-08-18T21:06:13.039 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=136679385}) 2024-08-18T21:06:13.039 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.039 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2091931959}) 2024-08-18T21:06:13.039 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.034+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2652523546}) 2024-08-18T21:06:13.042 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.042 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=368015290}) 2024-08-18T21:06:13.042 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2669124187}) 2024-08-18T21:06:13.042 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.042 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=368015290}) 2024-08-18T21:06:13.042 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1711191763}) 2024-08-18T21:06:13.042 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=368015290}) 2024-08-18T21:06:13.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1745021132}) 2024-08-18T21:06:13.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=368015290}) 2024-08-18T21:06:13.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=932888756}) 2024-08-18T21:06:13.046 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.046 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=368015290}) 2024-08-18T21:06:13.046 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2108304186}) 2024-08-18T21:06:13.046 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.046 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=368015290}) 2024-08-18T21:06:13.046 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1973090994}) 2024-08-18T21:06:13.046 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.046 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=368015290}) 2024-08-18T21:06:13.046 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4172957517}) 2024-08-18T21:06:13.047 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.047 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=368015290}) 2024-08-18T21:06:13.047 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.038+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3772591558}) 2024-08-18T21:06:13.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1449669487}) 2024-08-18T21:06:13.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3008722727}) 2024-08-18T21:06:13.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1449669487}) 2024-08-18T21:06:13.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3828475463}) 2024-08-18T21:06:13.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1449669487}) 2024-08-18T21:06:13.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1479553041}) 2024-08-18T21:06:13.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1449669487}) 2024-08-18T21:06:13.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=592619249}) 2024-08-18T21:06:13.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1449669487}) 2024-08-18T21:06:13.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3007095839}) 2024-08-18T21:06:13.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1449669487}) 2024-08-18T21:06:13.051 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4069475456}) 2024-08-18T21:06:13.051 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.051 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1449669487}) 2024-08-18T21:06:13.051 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=626569993}) 2024-08-18T21:06:13.051 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.051 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1449669487}) 2024-08-18T21:06:13.051 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.042+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1366362741}) 2024-08-18T21:06:13.053 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.053 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=8} crc {logm=21656085,mdsmap=4274512535,mgr=3067700994,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3559611257,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2468562996,osd_snap=723727393,osdmap=1782417919}) 2024-08-18T21:06:13.053 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=49,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=2,osd_metadata=3,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3364012039,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=2893739158,mon_config_key=2147202552,monmap=3140514009,osd_metadata=1658331104,osd_pg_creating=2468562996,osd_snap=723727393,osdmap=2025992839}) 2024-08-18T21:06:13.053 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=8} crc {logm=21656085,mdsmap=4274512535,mgr=3067700994,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3559611257,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2468562996,osd_snap=723727393,osdmap=1782417919}) 2024-08-18T21:06:13.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=46,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=7,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=14} crc {logm=337976291,mdsmap=3140514009,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=125387567,mon_config_key=1437320355,monmap=3438368439,osd_metadata=953966191,osd_pg_creating=2468562996,osd_snap=723727393,osdmap=3793222159}) 2024-08-18T21:06:13.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=8} crc {logm=21656085,mdsmap=4274512535,mgr=3067700994,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3559611257,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2468562996,osd_snap=723727393,osdmap=1782417919}) 2024-08-18T21:06:13.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=51,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=7} crc {logm=189605491,mdsmap=4274512535,mgr=2612373359,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3559611257,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2468562996,osd_snap=723727393,osdmap=1393692008}) 2024-08-18T21:06:13.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=8} crc {logm=21656085,mdsmap=4274512535,mgr=3067700994,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3559611257,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2468562996,osd_snap=723727393,osdmap=1782417919}) 2024-08-18T21:06:13.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=49,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=3,osd_metadata=5,osd_snap=2,osdmap=10} crc {logm=3250394782,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3559611257,mon_config_key=2147202552,monmap=3438368439,osd_metadata=515261042,osd_snap=723727393,osdmap=1194627750}) 2024-08-18T21:06:13.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=8} crc {logm=21656085,mdsmap=4274512535,mgr=3067700994,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3559611257,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2468562996,osd_snap=723727393,osdmap=1782417919}) 2024-08-18T21:06:13.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=50,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=8} crc {logm=1690996134,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3559611257,mon_config_key=2147202552,monmap=3140514009,osd_metadata=2816397922,osd_pg_creating=2468562996,osd_snap=723727393,osdmap=1825783446}) 2024-08-18T21:06:13.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=8} crc {logm=21656085,mdsmap=4274512535,mgr=3067700994,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3559611257,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2468562996,osd_snap=723727393,osdmap=1782417919}) 2024-08-18T21:06:13.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=48,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=11} crc {logm=2215951608,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3350131637,mon_config_key=2147202552,monmap=3438368439,osd_metadata=3887816624,osd_pg_creating=2468562996,osd_snap=723727393,osdmap=3794982227}) 2024-08-18T21:06:13.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=8} crc {logm=21656085,mdsmap=4274512535,mgr=3067700994,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3559611257,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2468562996,osd_snap=723727393,osdmap=1782417919}) 2024-08-18T21:06:13.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=46,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=3,osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=2075941304,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3559611257,mon_config_key=2147202552,monmap=3438368439,osd_metadata=3172975089,osd_pg_creating=2468562996,osd_snap=723727393,osdmap=2025992839}) 2024-08-18T21:06:13.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=8} crc {logm=21656085,mdsmap=4274512535,mgr=3067700994,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3559611257,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2468562996,osd_snap=723727393,osdmap=1782417919}) 2024-08-18T21:06:13.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.050+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=52,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=7} crc {logm=2319695190,mdsmap=485591938,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=2810023275,mon_config_key=1177028462,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2468562996,osd_snap=723727393,osdmap=3278613163}) 2024-08-18T21:06:13.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2072860709}) 2024-08-18T21:06:13.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=90} crc {osdmap=2562756809}) 2024-08-18T21:06:13.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2072860709}) 2024-08-18T21:06:13.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=91} crc {osdmap=347063439}) 2024-08-18T21:06:13.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2072860709}) 2024-08-18T21:06:13.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=92} crc {osdmap=2911938359}) 2024-08-18T21:06:13.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2072860709}) 2024-08-18T21:06:13.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=88} crc {osdmap=505388155}) 2024-08-18T21:06:13.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2072860709}) 2024-08-18T21:06:13.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=94} crc {osdmap=430422600}) 2024-08-18T21:06:13.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2072860709}) 2024-08-18T21:06:13.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=91} crc {osdmap=4179412511}) 2024-08-18T21:06:13.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2072860709}) 2024-08-18T21:06:13.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=91} crc {osdmap=814712151}) 2024-08-18T21:06:13.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:06:13.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2072860709}) 2024-08-18T21:06:13.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:06:13.062+0000 7f62d2da5640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=94} crc {osdmap=3070179005}) 2024-08-18T21:06:13.300 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28838]: starting. 2024-08-18T21:06:13.301 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28838]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28837 2024-08-18T21:06:13.301 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28838]: created object 0... 2024-08-18T21:06:13.301 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28838]: created object 25... 2024-08-18T21:06:13.301 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28838]: created object 49... 2024-08-18T21:06:13.301 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28838]: finishing. 2024-08-18T21:06:13.301 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28838]: shutting down. 2024-08-18T21:06:13.345 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:06:13.345 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 10 monclient: get_monmap_and_config 2024-08-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 10 monclient: build_initial_monmap 2024-08-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 10 monclient: monmap: 2024-08-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:13.478266+0000 2024-08-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:13.478266+0000 2024-08-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:13.479 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:13.479 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 1 Processor -- start 2024-08-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 1 -- start start 2024-08-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 10 monclient: init 2024-08-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 10 monclient: _add_conns ranks=[0,1,9,10,2,6,5,3,4,8,7] 2024-08-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe04c0a6bd0 addr v1:172.21.15.5:6789/0 2024-08-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fe04c09f080 addr v1:172.21.15.157:6789/0 2024-08-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe04c0a76c0 0x7fe04c142510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 10 monclient(hunting): picked mon.noname-a con 0x7fe04c0a76c0 addr v2:172.21.15.5:3300/0 2024-08-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe04c0a7fb0 con 0x7fe04c0a6bd0 2024-08-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe04c09de70 con 0x7fe04c09f080 2024-08-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe04c09e4c0 con 0x7fe04c0a76c0 2024-08-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe052e2b640 10 monclient(hunting): authenticate will time out at 1140.491421s 2024-08-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe0513c8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe04c0a76c0 0x7fe04c142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe0513c8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe04c0a76c0 0x7fe04c142510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40692/0 (socket says 172.21.15.5:40692) 2024-08-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe0513c8640 1 -- 172.21.15.5:0/1765590737 learned_addr learned my addr 172.21.15.5:0/1765590737 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe0513c8640 10 monclient(hunting): get_auth_request con 0x7fe04c0a76c0 auth_method 0 2024-08-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe0513c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe0513c8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe0513c8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.474+0000 7fe050bc7640 1 --1- 172.21.15.5:0/1765590737 >> v1:172.21.15.5:6789/0 conn(0x7fe04c0a6bd0 0x7fe04c0a6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36780/0 (socket says 172.21.15.5:36780) 2024-08-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.478+0000 7fe050bc7640 1 -- 172.21.15.5:0/1765590737 >> v1:172.21.15.5:6789/0 conn(0x7fe04c0a6bd0 legacy=0x7fe04c0a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.478+0000 7fe0513c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.478+0000 7fe0513c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.478+0000 7fe0513c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.478+0000 7fe0513c8640 10 monclient(hunting): handle_auth_done global_id 5157 payload 274 2024-08-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.478+0000 7fe0513c8640 1 -- 172.21.15.5:0/1765590737 >> v1:172.21.15.157:6789/0 conn(0x7fe04c09f080 legacy=0x7fe04c13ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.478+0000 7fe0513c8640 1 -- 172.21.15.5:0/1765590737 >> v1:172.21.15.5:6789/0 conn(0x7fe04c0a6bd0 legacy=0x7fe04c0a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.478+0000 7fe0513c8640 10 monclient: _finish_hunting 0 2024-08-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.478+0000 7fe0513c8640 1 monclient: found mon.noname-a 2024-08-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.478+0000 7fe0513c8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.478+0000 7fe0513c8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.478+0000 7fe0513c8640 1 -- 172.21.15.5:0/1765590737 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04c06f280 con 0x7fe04c0a76c0 2024-08-18T21:06:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe0513c8640 1 -- 172.21.15.5:0/1765590737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe04c0a76c0 msgr2=0x7fe04c142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe0513c8640 1 --2- 172.21.15.5:0/1765590737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe04c0a76c0 0x7fe04c142510 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe044009ed0 tx=0x7fe04401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9106cba4692788 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe04b7fe640 1 -- 172.21.15.5:0/1765590737 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe0440091b0 con 0x7fe04c0a76c0 2024-08-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe04b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe04b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe04b7fe640 10 monclient: dump: 2024-08-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe04b7fe640 10 monclient: _finish_auth 0 2024-08-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe04b7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe04b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe04b7fe640 1 -- 172.21.15.5:0/1765590737 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0440a5a80 con 0x7fe04c0a76c0 2024-08-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe04b7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe04b7fe640 1 -- 172.21.15.5:0/1765590737 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe0440a5c30 con 0x7fe04c0a76c0 2024-08-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe052e2b640 5 monclient: authenticate success, global_id 5157 2024-08-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe052e2b640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe04b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe052e2b640 4 set_mon_vals no callback set 2024-08-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe04b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe04b7fe640 10 monclient: dump: 2024-08-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe052e2b640 10 monclient: shutdown 2024-08-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe052e2b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe052e2b640 1 -- 172.21.15.5:0/1765590737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe04c0a76c0 msgr2=0x7fe04c142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe052e2b640 1 --2- 172.21.15.5:0/1765590737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe04c0a76c0 0x7fe04c142510 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe044009ed0 tx=0x7fe04401c970 comp rx=0 tx=0).stop 2024-08-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe052e2b640 1 -- 172.21.15.5:0/1765590737 shutdown_connections 2024-08-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe052e2b640 1 --2- 172.21.15.5:0/1765590737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe04c0a76c0 0x7fe04c142510 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe052e2b640 1 -- 172.21.15.5:0/1765590737 >> 172.21.15.5:0/1765590737 conn(0x7fe04c068700 msgr2=0x7fe04c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe052e2b640 1 -- 172.21.15.5:0/1765590737 shutdown_connections 2024-08-18T21:06:13.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe052e2b640 1 -- 172.21.15.5:0/1765590737 wait complete. 2024-08-18T21:06:13.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe052e2b640 10 monclient: build_initial_monmap 2024-08-18T21:06:13.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.482+0000 7fe052e2b640 10 monclient: monmap: 2024-08-18T21:06:13.495 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:13.495 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:13.495 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:13.495 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:13.495 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:13.495 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:13.496 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:13.496 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:13.496 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:13.496 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:13.496 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:13.496 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:13.496 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:13.496 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:13.496 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:13.496 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:13.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 1 Processor -- start 2024-08-18T21:06:13.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 1 -- start start 2024-08-18T21:06:13.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 10 monclient: init 2024-08-18T21:06:13.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:13.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 10 monclient: _add_conns ranks=[6,7,1,2,8,5,4,3,0] 2024-08-18T21:06:13.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe04c09f080 0x7fe04c126710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:13.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 10 monclient(hunting): picked mon.noname-d con 0x7fe04c09f080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:13.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe04c0a6bd0 0x7fe04c126c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:13.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 10 monclient(hunting): picked mon.noname-i con 0x7fe04c0a6bd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:13.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe04c0a76c0 0x7fe04c127190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:13.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 10 monclient(hunting): picked mon.noname-f con 0x7fe04c0a76c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:06:13.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:13.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c145a10 con 0x7fe04c0a76c0 2024-08-18T21:06:13.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:13.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fe04c145890 con 0x7fe04c09f080 2024-08-18T21:06:13.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:13.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fe04c145b90 con 0x7fe04c0a6bd0 2024-08-18T21:06:13.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:13.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe052e2b640 10 monclient(hunting): authenticate will time out at 1140.500984s 2024-08-18T21:06:13.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe04c09f080 0x7fe04c126710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:13.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe04c09f080 0x7fe04c126710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:45414/0 (socket says 172.21.15.5:45414) 2024-08-18T21:06:13.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 1 -- 172.21.15.5:0/2398689133 learned_addr learned my addr 172.21.15.5:0/2398689133 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:13.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 10 monclient(hunting): get_auth_request con 0x7fe04c09f080 auth_method 0 2024-08-18T21:06:13.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:13.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:13.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:13.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:13.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:13.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:13.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe0513c8640 1 --2- 172.21.15.5:0/2398689133 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe04c0a76c0 0x7fe04c127190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:13.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe04bfff640 1 --2- 172.21.15.5:0/2398689133 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe04c0a6bd0 0x7fe04c126c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:13.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe0513c8640 10 monclient(hunting): get_auth_request con 0x7fe04c0a76c0 auth_method 0 2024-08-18T21:06:13.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe0513c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:13.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe0513c8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:13.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe0513c8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:13.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe04bfff640 10 monclient(hunting): get_auth_request con 0x7fe04c0a6bd0 auth_method 0 2024-08-18T21:06:13.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe04bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:13.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe04bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:13.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe04bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:13.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 10 monclient(hunting): handle_auth_done global_id 54159 payload 824 2024-08-18T21:06:13.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 1 -- 172.21.15.5:0/2398689133 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe04c0a6bd0 msgr2=0x7fe04c126c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:13.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 1 --2- 172.21.15.5:0/2398689133 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe04c0a6bd0 0x7fe04c126c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 1 -- 172.21.15.5:0/2398689133 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe04c0a76c0 msgr2=0x7fe04c127190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 1 --2- 172.21.15.5:0/2398689133 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe04c0a76c0 0x7fe04c127190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 10 monclient: _finish_hunting 0 2024-08-18T21:06:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 1 monclient: found mon.noname-d 2024-08-18T21:06:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:06:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 1 -- 172.21.15.5:0/2398689133 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04c12a440 con 0x7fe04c09f080 2024-08-18T21:06:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe0513c8640 1 --2- 172.21.15.5:0/2398689133 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe04c0a76c0 0x7fe04c127190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:06:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 1 -- 172.21.15.5:0/2398689133 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe04c09f080 msgr2=0x7fe04c126710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.486+0000 7fe050bc7640 1 --2- 172.21.15.5:0/2398689133 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe04c09f080 0x7fe04c126710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00c460 tx=0x7fe03c00c920 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe0497fa640 1 -- 172.21.15.5:0/2398689133 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe03c004c60 con 0x7fe04c09f080 2024-08-18T21:06:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe0497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe0497fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:06:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe0497fa640 10 monclient: dump: 2024-08-18T21:06:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:13.502 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe0497fa640 10 monclient: _finish_auth 0 2024-08-18T21:06:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe0497fa640 10 monclient: _check_auth_tickets 2024-08-18T21:06:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe0497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe0497fa640 1 -- 172.21.15.5:0/2398689133 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe03c007490 con 0x7fe04c09f080 2024-08-18T21:06:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe0497fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe0497fa640 1 -- 172.21.15.5:0/2398689133 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe03c004e60 con 0x7fe04c09f080 2024-08-18T21:06:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe052e2b640 5 monclient: authenticate success, global_id 54159 2024-08-18T21:06:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe052e2b640 10 monclient: _renew_subs 2024-08-18T21:06:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe052e2b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe052e2b640 1 -- 172.21.15.5:0/2398689133 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe04c0a5e80 con 0x7fe04c09f080 2024-08-18T21:06:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe0497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe04affd640 4 set_mon_vals no callback set 2024-08-18T21:06:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe0497fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe0497fa640 10 monclient: dump: 2024-08-18T21:06:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:13.504 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe052e2b640 10 monclient: _renew_subs 2024-08-18T21:06:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe052e2b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe052e2b640 1 -- 172.21.15.5:0/2398689133 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fe04c1295d0 con 0x7fe04c09f080 2024-08-18T21:06:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe052e2b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe052e2b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe052e2b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe052e2b640 1 -- 172.21.15.5:0/2398689133 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe04c0a6fb0 con 0x7fe04c09f080 2024-08-18T21:06:13.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe0497fa640 1 -- 172.21.15.5:0/2398689133 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe03c01a020 con 0x7fe04c09f080 2024-08-18T21:06:13.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe0497fa640 1 --2- 172.21.15.5:0/2398689133 >> v2:172.21.15.157:6812/631023601 conn(0x7fe03803bdc0 0x7fe03803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:13.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe0497fa640 1 -- 172.21.15.5:0/2398689133 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(80..80 src has 22..80) ==== 3898+0+0 (secure 0 0 0) 0x7fe03c04dd10 con 0x7fe04c09f080 2024-08-18T21:06:13.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe04bfff640 1 --2- 172.21.15.5:0/2398689133 >> v2:172.21.15.157:6812/631023601 conn(0x7fe03803bdc0 0x7fe03803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:13.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.490+0000 7fe04bfff640 10 monclient: get_auth_request con 0x7fe03803bdc0 auth_method 0 2024-08-18T21:06:13.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.494+0000 7fe04bfff640 1 --2- 172.21.15.5:0/2398689133 >> v2:172.21.15.157:6812/631023601 conn(0x7fe03803bdc0 0x7fe03803e280 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe04c128750 tx=0x7fe040009040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:13.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.494+0000 7fe0497fa640 1 -- 172.21.15.5:0/2398689133 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fe03c054080 con 0x7fe04c09f080 2024-08-18T21:06:13.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.494+0000 7fe0497fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:13.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.494+0000 7fe0497fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.730+0000 7fe052e2b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:06:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.730+0000 7fe052e2b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:06:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.730+0000 7fe052e2b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.730+0000 7fe052e2b640 1 -- 172.21.15.5:0/2398689133 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe04c0746d0 con 0x7fe04c09f080 2024-08-18T21:06:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.730+0000 7fe0497fa640 1 -- 172.21.15.5:0/2398689133 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3172 (secure 0 0 0) 0x7fe03c0113a0 con 0x7fe04c09f080 2024-08-18T21:06:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.730+0000 7fe0497fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:06:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.730+0000 7fe0497fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:13.734 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":60,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:06:13.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.734+0000 7fe052e2b640 1 -- 172.21.15.5:0/2398689133 >> v2:172.21.15.157:6812/631023601 conn(0x7fe03803bdc0 msgr2=0x7fe03803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.734+0000 7fe052e2b640 1 --2- 172.21.15.5:0/2398689133 >> v2:172.21.15.157:6812/631023601 conn(0x7fe03803bdc0 0x7fe03803e280 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe04c128750 tx=0x7fe040009040 comp rx=0 tx=0).stop 2024-08-18T21:06:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.734+0000 7fe052e2b640 10 monclient: shutdown 2024-08-18T21:06:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.734+0000 7fe052e2b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.734+0000 7fe052e2b640 1 -- 172.21.15.5:0/2398689133 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe04c09f080 msgr2=0x7fe04c126710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.734+0000 7fe052e2b640 1 --2- 172.21.15.5:0/2398689133 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe04c09f080 0x7fe04c126710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00c460 tx=0x7fe03c00c920 comp rx=0 tx=0).stop 2024-08-18T21:06:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.734+0000 7fe052e2b640 1 -- 172.21.15.5:0/2398689133 shutdown_connections 2024-08-18T21:06:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.734+0000 7fe052e2b640 1 --2- 172.21.15.5:0/2398689133 >> v2:172.21.15.157:6812/631023601 conn(0x7fe03803bdc0 0x7fe03803e280 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.734+0000 7fe052e2b640 1 --2- 172.21.15.5:0/2398689133 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe04c0a76c0 0x7fe04c127190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.734+0000 7fe052e2b640 1 --2- 172.21.15.5:0/2398689133 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe04c0a6bd0 0x7fe04c126c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.734+0000 7fe052e2b640 1 --2- 172.21.15.5:0/2398689133 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe04c09f080 0x7fe04c126710 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:13.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.734+0000 7fe052e2b640 1 -- 172.21.15.5:0/2398689133 >> 172.21.15.5:0/2398689133 conn(0x7fe04c068700 msgr2=0x7fe04c0a55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:13.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.734+0000 7fe052e2b640 1 -- 172.21.15.5:0/2398689133 shutdown_connections 2024-08-18T21:06:13.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.734+0000 7fe052e2b640 1 -- 172.21.15.5:0/2398689133 wait complete. 2024-08-18T21:06:13.753 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:06:13.753 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-18T21:06:13.753 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:06:13.754 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:06:13.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.878+0000 7fc20cfd6640 10 monclient: get_monmap_and_config 2024-08-18T21:06:13.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.878+0000 7fc20cfd6640 10 monclient: build_initial_monmap 2024-08-18T21:06:13.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.878+0000 7fc20cfd6640 10 monclient: monmap: 2024-08-18T21:06:13.883 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:13.883 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:13.883 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:13.884095+0000 2024-08-18T21:06:13.883 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:13.884095+0000 2024-08-18T21:06:13.883 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:13.883 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:13.883 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:13.884 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 1 Processor -- start 2024-08-18T21:06:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 1 -- start start 2024-08-18T21:06:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 10 monclient: init 2024-08-18T21:06:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 10 monclient: _add_conns ranks=[8,1,9,0,4,7,2,6,5,10,3] 2024-08-18T21:06:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc2080a6ce0 0x7fc2080a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 10 monclient(hunting): picked mon.noname-e con 0x7fc2080a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fc2080a7600 addr v1:172.21.15.157:6789/0 2024-08-18T21:06:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc20813a1b0 0x7fc208141d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 10 monclient(hunting): picked mon.noname-a con 0x7fc20813a1b0 addr v2:172.21.15.5:3300/0 2024-08-18T21:06:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2080a45d0 con 0x7fc2080a7600 2024-08-18T21:06:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc2080a5000 con 0x7fc20813a1b0 2024-08-18T21:06:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fc2080a4360 con 0x7fc2080a6ce0 2024-08-18T21:06:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20cfd6640 10 monclient(hunting): authenticate will time out at 1140.897424s 2024-08-18T21:06:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc2080a6ce0 0x7fc2080a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc206d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc20813a1b0 0x7fc208141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc206d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc20813a1b0 0x7fc208141d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40698/0 (socket says 172.21.15.5:40698) 2024-08-18T21:06:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc206d9d640 1 -- 172.21.15.5:0/2388692759 learned_addr learned my addr 172.21.15.5:0/2388692759 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc2080a6ce0 0x7fc2080a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:56024/0 (socket says 172.21.15.5:56024) 2024-08-18T21:06:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc206d9d640 10 monclient(hunting): get_auth_request con 0x7fc20813a1b0 auth_method 0 2024-08-18T21:06:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc206d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc206d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc206d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 10 monclient(hunting): get_auth_request con 0x7fc2080a6ce0 auth_method 0 2024-08-18T21:06:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc206d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc206d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc206d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 10 monclient(hunting): handle_auth_done global_id 54188 payload 274 2024-08-18T21:06:13.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 1 -- 172.21.15.5:0/2388692759 >> v2:172.21.15.5:3300/0 conn(0x7fc20813a1b0 msgr2=0x7fc208141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:13.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 1 --2- 172.21.15.5:0/2388692759 >> v2:172.21.15.5:3300/0 conn(0x7fc20813a1b0 0x7fc208141d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:13.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 1 -- 172.21.15.5:0/2388692759 >> v1:172.21.15.157:6789/0 conn(0x7fc2080a7600 legacy=0x7fc208139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:13.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 10 monclient: _finish_hunting 0 2024-08-18T21:06:13.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 1 monclient: found mon.noname-e 2024-08-18T21:06:13.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:13.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:06:13.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc20659c640 1 -- 172.21.15.5:0/2388692759 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2080a8900 con 0x7fc2080a6ce0 2024-08-18T21:06:13.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.882+0000 7fc206d9d640 1 --2- 172.21.15.5:0/2388692759 >> v2:172.21.15.5:3300/0 conn(0x7fc20813a1b0 0x7fc208141d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:06:13.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20659c640 1 -- 172.21.15.5:0/2388692759 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc2080a6ce0 msgr2=0x7fc2080a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:13.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20659c640 1 --2- 172.21.15.5:0/2388692759 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc2080a6ce0 0x7fc2080a70c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8009d90 tx=0x7fc1f801c830 comp rx=0 tx=0).ready entity=mon.8 client_cookie=ff0c3ec07daa7ce5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:13.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20559a640 1 -- 172.21.15.5:0/2388692759 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc1f80b2070 con 0x7fc2080a6ce0 2024-08-18T21:06:13.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:13.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20559a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:06:13.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20559a640 10 monclient: dump: 2024-08-18T21:06:13.894 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:13.894 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:13.894 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.895 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.895 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:13.895 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:13.895 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:13.895 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:13.895 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:13.895 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:13.895 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:13.895 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:13.895 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:13.895 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:13.895 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:13.895 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20559a640 10 monclient: _finish_auth 0 2024-08-18T21:06:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20559a640 10 monclient: _check_auth_tickets 2024-08-18T21:06:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20cfd6640 5 monclient: authenticate success, global_id 54188 2024-08-18T21:06:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20cfd6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:06:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20559a640 1 -- 172.21.15.5:0/2388692759 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f80a5ae0 con 0x7fc2080a6ce0 2024-08-18T21:06:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20559a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20cfd6640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20559a640 1 -- 172.21.15.5:0/2388692759 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc1f80a5cd0 con 0x7fc2080a6ce0 2024-08-18T21:06:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20cfd6640 4 set_mon_vals no callback set 2024-08-18T21:06:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20559a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20559a640 10 monclient: dump: 2024-08-18T21:06:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:13.898 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20cfd6640 10 monclient: shutdown 2024-08-18T21:06:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20cfd6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20cfd6640 1 -- 172.21.15.5:0/2388692759 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc2080a6ce0 msgr2=0x7fc2080a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20cfd6640 1 --2- 172.21.15.5:0/2388692759 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc2080a6ce0 0x7fc2080a70c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8009d90 tx=0x7fc1f801c830 comp rx=0 tx=0).stop 2024-08-18T21:06:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20cfd6640 1 -- 172.21.15.5:0/2388692759 shutdown_connections 2024-08-18T21:06:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20cfd6640 1 --2- 172.21.15.5:0/2388692759 >> v2:172.21.15.5:3300/0 conn(0x7fc20813a1b0 0x7fc208141d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20cfd6640 1 --2- 172.21.15.5:0/2388692759 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc2080a6ce0 0x7fc2080a70c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20cfd6640 1 -- 172.21.15.5:0/2388692759 >> 172.21.15.5:0/2388692759 conn(0x7fc2080acbc0 msgr2=0x7fc2080a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20cfd6640 1 -- 172.21.15.5:0/2388692759 shutdown_connections 2024-08-18T21:06:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20cfd6640 1 -- 172.21.15.5:0/2388692759 wait complete. 2024-08-18T21:06:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20cfd6640 10 monclient: build_initial_monmap 2024-08-18T21:06:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.886+0000 7fc20cfd6640 10 monclient: monmap: 2024-08-18T21:06:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:13.900 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:13.900 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:13.900 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:13.900 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:13.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 1 Processor -- start 2024-08-18T21:06:13.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 1 -- start start 2024-08-18T21:06:13.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 10 monclient: init 2024-08-18T21:06:13.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:13.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 10 monclient: _add_conns ranks=[7,3,5,4,8,1,2,6,0] 2024-08-18T21:06:13.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc2080a6ce0 0x7fc208134cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:13.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 10 monclient(hunting): picked mon.noname-i con 0x7fc2080a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:13.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2080a7600 0x7fc2081351f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:13.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 10 monclient(hunting): picked mon.noname-g con 0x7fc2080a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:06:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc20813a1b0 0x7fc20813a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 10 monclient(hunting): picked mon.noname-h con 0x7fc20813a1b0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc2080a79e0 con 0x7fc2080a7600 2024-08-18T21:06:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fc2080a8220 con 0x7fc20813a1b0 2024-08-18T21:06:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fc20813e430 con 0x7fc2080a6ce0 2024-08-18T21:06:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20cfd6640 10 monclient(hunting): authenticate will time out at 1140.904769s 2024-08-18T21:06:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc20813a1b0 0x7fc20813a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20659c640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc2080a6ce0 0x7fc208134cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc205d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2080a7600 0x7fc2081351f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc20813a1b0 0x7fc20813a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:33954/0 (socket says 172.21.15.5:33954) 2024-08-18T21:06:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20659c640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc2080a6ce0 0x7fc208134cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:46184/0 (socket says 172.21.15.5:46184) 2024-08-18T21:06:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 1 -- 172.21.15.5:0/3172862671 learned_addr learned my addr 172.21.15.5:0/3172862671 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 10 monclient(hunting): get_auth_request con 0x7fc20813a1b0 auth_method 0 2024-08-18T21:06:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20659c640 10 monclient(hunting): get_auth_request con 0x7fc2080a6ce0 auth_method 0 2024-08-18T21:06:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc205d9b640 10 monclient(hunting): get_auth_request con 0x7fc2080a7600 auth_method 0 2024-08-18T21:06:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc205d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc205d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc205d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc20659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc205d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc205d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc205d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 10 monclient(hunting): handle_auth_done global_id 34511 payload 824 2024-08-18T21:06:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 1 -- 172.21.15.5:0/3172862671 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc2080a6ce0 msgr2=0x7fc208134cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:13.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 1 --2- 172.21.15.5:0/3172862671 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc2080a6ce0 0x7fc208134cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:13.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 1 -- 172.21.15.5:0/3172862671 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2080a7600 msgr2=0x7fc2081351f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:13.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 1 --2- 172.21.15.5:0/3172862671 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2080a7600 0x7fc2081351f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:13.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 10 monclient: _finish_hunting 0 2024-08-18T21:06:13.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 1 monclient: found mon.noname-h 2024-08-18T21:06:13.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:13.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:06:13.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.890+0000 7fc206d9d640 1 -- 172.21.15.5:0/3172862671 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20813c330 con 0x7fc20813a1b0 2024-08-18T21:06:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc206d9d640 1 -- 172.21.15.5:0/3172862671 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc20813a1b0 msgr2=0x7fc20813a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc206d9d640 1 --2- 172.21.15.5:0/3172862671 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc20813a1b0 0x7fc20813a9d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc20000e930 tx=0x7fc20000edf0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f6ffd640 1 -- 172.21.15.5:0/3172862671 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc200017070 con 0x7fc20813a1b0 2024-08-18T21:06:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f6ffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:06:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f6ffd640 10 monclient: dump: 2024-08-18T21:06:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:13.909 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:06:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:06:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f6ffd640 1 -- 172.21.15.5:0/3172862671 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc200013470 con 0x7fc20813a1b0 2024-08-18T21:06:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20cfd6640 5 monclient: authenticate success, global_id 34511 2024-08-18T21:06:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20cfd6640 10 monclient: _renew_subs 2024-08-18T21:06:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20cfd6640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:06:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20cfd6640 1 -- 172.21.15.5:0/3172862671 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc20813e150 con 0x7fc20813a1b0 2024-08-18T21:06:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f6ffd640 1 -- 172.21.15.5:0/3172862671 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc200013620 con 0x7fc20813a1b0 2024-08-18T21:06:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f6ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:06:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f6ffd640 10 monclient: dump: 2024-08-18T21:06:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.911 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.911 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:13.911 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:13.911 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:13.911 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:13.911 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:13.911 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:13.911 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:13.911 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:13.911 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:13.911 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:13.911 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:13.911 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20cfd6640 10 monclient: _renew_subs 2024-08-18T21:06:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20cfd6640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:06:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20cfd6640 1 -- 172.21.15.5:0/3172862671 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2080a2570 con 0x7fc20813a1b0 2024-08-18T21:06:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f7fff640 4 set_mon_vals no callback set 2024-08-18T21:06:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20cfd6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20cfd6640 1 --2- 172.21.15.5:0/3172862671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc20813af10 0x7fc20813b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20cfd6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20cfd6640 1 -- 172.21.15.5:0/3172862671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc2080a7b60 con 0x7fc20813af10 2024-08-18T21:06:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20659c640 1 --2- 172.21.15.5:0/3172862671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc20813af10 0x7fc20813b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20659c640 10 monclient: get_auth_request con 0x7fc20813af10 auth_method 0 2024-08-18T21:06:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20659c640 10 monclient(hunting): handle_auth_done global_id 5184 payload 824 2024-08-18T21:06:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc20659c640 1 -- 172.21.15.5:0/3172862671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2080a27a0 con 0x7fc20813af10 2024-08-18T21:06:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f6ffd640 1 -- 172.21.15.5:0/3172862671 <== mon.5 v2:172.21.15.157:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fc20000cb50 con 0x7fc20813a1b0 2024-08-18T21:06:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f6ffd640 1 --2- 172.21.15.5:0/3172862671 >> v2:172.21.15.157:6812/631023601 conn(0x7fc1e803bdf0 0x7fc1e803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc1f6ffd640 1 -- 172.21.15.5:0/3172862671 <== mon.5 v2:172.21.15.157:3302/0 5 ==== osd_map(80..80 src has 22..80) ==== 3898+0+0 (secure 0 0 0) 0x7fc20000f040 con 0x7fc20813a1b0 2024-08-18T21:06:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc205d9b640 1 --2- 172.21.15.5:0/3172862671 >> v2:172.21.15.157:6812/631023601 conn(0x7fc1e803bdf0 0x7fc1e803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.894+0000 7fc205d9b640 10 monclient: get_auth_request con 0x7fc1e803bdf0 auth_method 0 2024-08-18T21:06:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.898+0000 7fc20659c640 1 -- 172.21.15.5:0/3172862671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc20813af10 msgr2=0x7fc20813b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.898+0000 7fc20659c640 1 --2- 172.21.15.5:0/3172862671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc20813af10 0x7fc20813b2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80af000 tx=0x7fc1f80195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.898+0000 7fc1f6ffd640 1 -- 172.21.15.5:0/3172862671 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc1f80bc070 con 0x7fc20813af10 2024-08-18T21:06:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.898+0000 7fc1f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.898+0000 7fc1f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:06:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.898+0000 7fc1f6ffd640 10 monclient: dump: 2024-08-18T21:06:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:13.915 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:13.915 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:13.915 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:13.915 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:13.915 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:13.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.898+0000 7fc1f6ffd640 1 -- 172.21.15.5:0/3172862671 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc1f80b3040 con 0x7fc20813af10 2024-08-18T21:06:13.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.898+0000 7fc1f6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:13.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.898+0000 7fc1f6ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:13.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.898+0000 7fc1f6ffd640 1 -- 172.21.15.5:0/3172862671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc20813af10 msgr2=0x7fc20813b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:13.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.898+0000 7fc1f6ffd640 1 --2- 172.21.15.5:0/3172862671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc20813af10 0x7fc20813b2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80af000 tx=0x7fc1f80195d0 comp rx=0 tx=0).stop 2024-08-18T21:06:13.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.898+0000 7fc1f6ffd640 1 -- 172.21.15.5:0/3172862671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc20813af10 msgr2=0x7fc20813b2f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:13.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.898+0000 7fc1f6ffd640 1 --2- 172.21.15.5:0/3172862671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc20813af10 0x7fc20813b2f0 secure :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80af000 tx=0x7fc1f80195d0 comp rx=0 tx=0).stop 2024-08-18T21:06:13.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.898+0000 7fc205d9b640 1 --2- 172.21.15.5:0/3172862671 >> v2:172.21.15.157:6812/631023601 conn(0x7fc1e803bdf0 0x7fc1e803e2b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc20813cbc0 tx=0x7fc1fc007e40 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:13.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.902+0000 7fc20cfd6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:13.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.902+0000 7fc20cfd6640 1 --2- 172.21.15.5:0/3172862671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc20813b830 0x7fc208138eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:13.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.902+0000 7fc20cfd6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:13.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.902+0000 7fc20cfd6640 1 -- 172.21.15.5:0/3172862671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc208051140 con 0x7fc20813b830 2024-08-18T21:06:13.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.902+0000 7fc20659c640 1 --2- 172.21.15.5:0/3172862671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc20813b830 0x7fc208138eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:13.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.902+0000 7fc20659c640 10 monclient: get_auth_request con 0x7fc20813b830 auth_method 0 2024-08-18T21:06:13.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.902+0000 7fc20659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:13.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.902+0000 7fc20659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:13.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.902+0000 7fc20659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:13.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.902+0000 7fc20659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:13.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.902+0000 7fc20659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:13.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.902+0000 7fc20659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:13.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.902+0000 7fc20659c640 10 monclient(hunting): handle_auth_done global_id 5193 payload 824 2024-08-18T21:06:13.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.902+0000 7fc20659c640 1 -- 172.21.15.5:0/3172862671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc2080a70c0 con 0x7fc20813b830 2024-08-18T21:06:13.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc20659c640 1 -- 172.21.15.5:0/3172862671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc20813b830 msgr2=0x7fc208138eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:13.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc20659c640 1 --2- 172.21.15.5:0/3172862671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc20813b830 0x7fc208138eb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc1f801c660 tx=0x7fc1f80a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:13.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc1f6ffd640 1 -- 172.21.15.5:0/3172862671 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc1f80b2070 con 0x7fc20813b830 2024-08-18T21:06:13.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc1f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:13.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc1f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:06:13.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc1f6ffd640 10 monclient: dump: 2024-08-18T21:06:13.919 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:13.919 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:13.919 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.919 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:13.919 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:13.919 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:13.919 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:13.919 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:13.919 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:13.919 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:13.919 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:13.919 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:13.919 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:13.920 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:13.920 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:13.920 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:13.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc1f6ffd640 1 -- 172.21.15.5:0/3172862671 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9416 (secure 0 0 0) 0x7fc1f80ad860 con 0x7fc20813b830 2024-08-18T21:06:13.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc1f6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:13.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc1f6ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:13.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc1f6ffd640 1 -- 172.21.15.5:0/3172862671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc20813b830 msgr2=0x7fc208138eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:13.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc1f6ffd640 1 --2- 172.21.15.5:0/3172862671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc20813b830 0x7fc208138eb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc1f801c660 tx=0x7fc1f80a7000 comp rx=0 tx=0).stop 2024-08-18T21:06:13.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc1f6ffd640 1 -- 172.21.15.5:0/3172862671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc20813b830 msgr2=0x7fc208138eb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:13.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc1f6ffd640 1 --2- 172.21.15.5:0/3172862671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc20813b830 0x7fc208138eb0 secure :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc1f801c660 tx=0x7fc1f80a7000 comp rx=0 tx=0).stop 2024-08-18T21:06:13.920 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:13.921 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:13.921 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:13.921 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:06:13.921 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:13.921 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 183027, 2024-08-18T21:06:13.921 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:13.921 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:13.921 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:13.921 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:13.921 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:13.921 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:13.921 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:13.922 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:13.922 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:13.922 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:13.922 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:13.922 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:06:13.922 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:13.922 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:13.922 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:13.922 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:13.922 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:13.922 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:13.922 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:13.923 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:13.923 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:13.923 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:13.923 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:13.923 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:13.923 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:13.923 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:13.923 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:13.923 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:13.923 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:13.923 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:13.923 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:13.923 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:13.923 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:13.924 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:13.924 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:13.924 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:13.924 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:13.924 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:13.924 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:13.924 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:13.924 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:13.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.924 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:13.924 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:13.924 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:13.924 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:13.925 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:13.925 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:13.925 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:13.925 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:13.925 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:13.925 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:13.925 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:13.925 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:13.925 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:13.925 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:13.925 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:13.926 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:13.926 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:13.926 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:13.926 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:13.926 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:13.926 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:13.926 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:13.926 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:13.926 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:13.926 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:13.926 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:13.926 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:13.927 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:13.927 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:13.927 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:13.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.927 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:13.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.927 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:13.927 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:13.927 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:13.927 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:13.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.927 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:13.928 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:13.928 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:13.928 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:13.928 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.928 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:13.928 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:13.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.928 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:13.928 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:13.928 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:13.929 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:13.929 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:13.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.929 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:13.929 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:13.929 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:13.929 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:13.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.929 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:13.929 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:13.929 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:13.930 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:13.930 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.930 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:13.930 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:13.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.930 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:13.930 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:13.930 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:13.930 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:13.930 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:13.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.931 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:13.931 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:13.931 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:13.931 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:13.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.931 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:13.931 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:13.931 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.931 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:13.932 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:13.932 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.932 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:13.932 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:13.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.932 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:13.932 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:13.932 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:13.932 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:13.932 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:13.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.932 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:13.933 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:13.933 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:13.933 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:13.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.933 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:13.933 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:13.933 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.933 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:13.933 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:13.933 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:13.934 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:13.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.934 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:13.934 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:13.934 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:13.934 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:13.934 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:13.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.934 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:13.934 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:13.934 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:13.934 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:13.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:13.935 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:13.935 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:13.935 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:13.935 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.935 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:13.935 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:13.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.935 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:13.935 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:13.935 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:13.936 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:13.936 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:13.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.936 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:13.936 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:13.936 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:13.936 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:13.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.936 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:13.936 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:13.936 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.937 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:13.937 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:13.937 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.937 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:13.937 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:13.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.937 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:13.937 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:13.937 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:13.937 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:13.937 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:13.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.937 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:13.938 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:13.938 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:13.938 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:13.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.938 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:13.938 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:13.938 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.938 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:13.938 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:13.938 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.938 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:13.939 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:13.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.939 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:13.939 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:13.939 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:13.939 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:13.939 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:13.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.939 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:13.939 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:13.939 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:13.939 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:13.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.940 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:13.940 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:13.940 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.940 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:13.940 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:13.940 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.940 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:13.940 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:13.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.940 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:13.940 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:13.940 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:13.941 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:13.941 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:13.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.941 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:13.941 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:13.941 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:13.941 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:13.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.941 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:13.941 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:13.941 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.942 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:13.942 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:13.942 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:13.942 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:13.942 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:13.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.942 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:13.942 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:13.942 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:13.942 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:13.942 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:13.942 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:13.943 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:13.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.943 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:13.943 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:13.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.943 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:13.943 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:13.943 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:13.943 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:13.943 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:13.943 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:13.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.943 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:13.943 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:13.944 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:06:13.944 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:13.944 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:13.944 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:06:13.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:13.944 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:13.944 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:13.944 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:13.944 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:13.944 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:13.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:13.944 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:13.944 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:13.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc20cfd6640 1 -- 172.21.15.5:0/3172862671 >> v2:172.21.15.157:6812/631023601 conn(0x7fc1e803bdf0 msgr2=0x7fc1e803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:13.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc20cfd6640 1 --2- 172.21.15.5:0/3172862671 >> v2:172.21.15.157:6812/631023601 conn(0x7fc1e803bdf0 0x7fc1e803e2b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc20813cbc0 tx=0x7fc1fc007e40 comp rx=0 tx=0).stop 2024-08-18T21:06:13.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc20cfd6640 10 monclient: shutdown 2024-08-18T21:06:13.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc20cfd6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:13.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc20cfd6640 1 -- 172.21.15.5:0/3172862671 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc20813a1b0 msgr2=0x7fc20813a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:13.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc20cfd6640 1 --2- 172.21.15.5:0/3172862671 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc20813a1b0 0x7fc20813a9d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc20000e930 tx=0x7fc20000edf0 comp rx=0 tx=0).stop 2024-08-18T21:06:13.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc206d9d640 1 -- 172.21.15.5:0/3172862671 reap_dead start 2024-08-18T21:06:13.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc206d9d640 1 -- 172.21.15.5:0/3172862671 reap_dead start 2024-08-18T21:06:13.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc20cfd6640 1 -- 172.21.15.5:0/3172862671 shutdown_connections 2024-08-18T21:06:13.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc20cfd6640 1 -- 172.21.15.5:0/3172862671 >> 172.21.15.5:0/3172862671 conn(0x7fc2080acbc0 msgr2=0x7fc20809da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:13.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc20cfd6640 1 -- 172.21.15.5:0/3172862671 shutdown_connections 2024-08-18T21:06:13.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:13.906+0000 7fc20cfd6640 1 -- 172.21.15.5:0/3172862671 wait complete. 2024-08-18T21:06:13.947 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:13.947 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:06:13.947 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:06:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.070+0000 7fea7c092640 10 monclient: get_monmap_and_config 2024-08-18T21:06:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.070+0000 7fea7c092640 10 monclient: build_initial_monmap 2024-08-18T21:06:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.070+0000 7fea7c092640 10 monclient: monmap: 2024-08-18T21:06:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:14.075549+0000 2024-08-18T21:06:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:14.075549+0000 2024-08-18T21:06:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:14.079 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:14.079 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:14.079 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:14.079 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 1 Processor -- start 2024-08-18T21:06:14.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 1 -- start start 2024-08-18T21:06:14.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 10 monclient: init 2024-08-18T21:06:14.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:14.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 10 monclient: _add_conns ranks=[6,0,5,4,9,2,10,8,7,3,1] 2024-08-18T21:06:14.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fea7409da30 0x7fea7409de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 10 monclient(hunting): picked mon.noname-d con 0x7fea7409da30 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:14.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fea7409e350 addr v1:172.21.15.5:6789/0 2024-08-18T21:06:14.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fea7409e730 0x7fea74145b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 10 monclient(hunting): picked mon.noname-h con 0x7fea7409e730 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea7406d4e0 con 0x7fea7409e350 2024-08-18T21:06:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fea7406e550 con 0x7fea7409e730 2024-08-18T21:06:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fea7406e960 con 0x7fea7409da30 2024-08-18T21:06:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7c092640 10 monclient(hunting): authenticate will time out at 1141.089414s 2024-08-18T21:06:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fea7409da30 0x7fea7409de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fea7409da30 0x7fea7409de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:55418/0 (socket says 172.21.15.5:55418) 2024-08-18T21:06:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 1 -- 172.21.15.5:0/1046937275 learned_addr learned my addr 172.21.15.5:0/1046937275 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 10 monclient(hunting): get_auth_request con 0x7fea7409da30 auth_method 0 2024-08-18T21:06:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7a62f640 1 --2- 172.21.15.5:0/1046937275 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fea7409e730 0x7fea74145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7a62f640 10 monclient(hunting): get_auth_request con 0x7fea7409e730 auth_method 0 2024-08-18T21:06:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7a62f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7a62f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea7a62f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 10 monclient(hunting): handle_auth_done global_id 54168 payload 274 2024-08-18T21:06:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 1 -- 172.21.15.5:0/1046937275 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fea7409e730 msgr2=0x7fea74145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 1 --2- 172.21.15.5:0/1046937275 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fea7409e730 0x7fea74145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 1 -- 172.21.15.5:0/1046937275 >> v1:172.21.15.5:6789/0 conn(0x7fea7409e350 legacy=0x7fea741423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 10 monclient: _finish_hunting 0 2024-08-18T21:06:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 1 monclient: found mon.noname-d 2024-08-18T21:06:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:06:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.074+0000 7fea79e2e640 1 -- 172.21.15.5:0/1046937275 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7406eba0 con 0x7fea7409da30 2024-08-18T21:06:14.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea79e2e640 1 -- 172.21.15.5:0/1046937275 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fea7409da30 msgr2=0x7fea7409de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea79e2e640 1 --2- 172.21.15.5:0/1046937275 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fea7409da30 0x7fea7409de10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009e80 tx=0x7fea6c01c910 comp rx=0 tx=0).ready entity=mon.6 client_cookie=b176116137086c42 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea78e2c640 1 -- 172.21.15.5:0/1046937275 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fea6c0090d0 con 0x7fea7409da30 2024-08-18T21:06:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea78e2c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea78e2c640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:06:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea78e2c640 10 monclient: dump: 2024-08-18T21:06:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.086 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea78e2c640 10 monclient: _finish_auth 0 2024-08-18T21:06:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea78e2c640 10 monclient: _check_auth_tickets 2024-08-18T21:06:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea78e2c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea78e2c640 1 -- 172.21.15.5:0/1046937275 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea6c0a5a50 con 0x7fea7409da30 2024-08-18T21:06:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea78e2c640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea78e2c640 1 -- 172.21.15.5:0/1046937275 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fea6c0a5c00 con 0x7fea7409da30 2024-08-18T21:06:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea7c092640 5 monclient: authenticate success, global_id 54168 2024-08-18T21:06:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea7c092640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea7c092640 4 set_mon_vals no callback set 2024-08-18T21:06:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea78e2c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea78e2c640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.078+0000 7fea78e2c640 10 monclient: dump: 2024-08-18T21:06:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.088 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 10 monclient: shutdown 2024-08-18T21:06:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 1 -- 172.21.15.5:0/1046937275 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fea7409da30 msgr2=0x7fea7409de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 1 --2- 172.21.15.5:0/1046937275 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fea7409da30 0x7fea7409de10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009e80 tx=0x7fea6c01c910 comp rx=0 tx=0).stop 2024-08-18T21:06:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 1 -- 172.21.15.5:0/1046937275 shutdown_connections 2024-08-18T21:06:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 1 --2- 172.21.15.5:0/1046937275 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fea7409e730 0x7fea74145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 1 --2- 172.21.15.5:0/1046937275 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fea7409da30 0x7fea7409de10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 1 -- 172.21.15.5:0/1046937275 >> 172.21.15.5:0/1046937275 conn(0x7fea740a4b20 msgr2=0x7fea740a4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 1 -- 172.21.15.5:0/1046937275 shutdown_connections 2024-08-18T21:06:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 1 -- 172.21.15.5:0/1046937275 wait complete. 2024-08-18T21:06:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 10 monclient: build_initial_monmap 2024-08-18T21:06:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 10 monclient: monmap: 2024-08-18T21:06:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:14.090 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 1 Processor -- start 2024-08-18T21:06:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 1 -- start start 2024-08-18T21:06:14.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 10 monclient: init 2024-08-18T21:06:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 10 monclient: _add_conns ranks=[0,4,1,2,6,7,3,5,8] 2024-08-18T21:06:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea7409da30 0x7fea7412e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 10 monclient(hunting): picked mon.noname-a con 0x7fea7409da30 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:06:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fea7409e350 0x7fea74145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 10 monclient(hunting): picked mon.noname-c con 0x7fea7409e350 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea7412c120 0x7fea741d57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 10 monclient(hunting): picked mon.noname-f con 0x7fea7412c120 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:06:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fea74069a00 con 0x7fea7409da30 2024-08-18T21:06:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fea740a2460 con 0x7fea7412c120 2024-08-18T21:06:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fea74148870 con 0x7fea7409e350 2024-08-18T21:06:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7c092640 10 monclient(hunting): authenticate will time out at 1141.098092s 2024-08-18T21:06:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea79e2e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea7409da30 0x7fea7412e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fea7409e350 0x7fea74145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea79e2e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea7409da30 0x7fea7412e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39570/0 (socket says 172.21.15.5:39570) 2024-08-18T21:06:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea79e2e640 1 -- 172.21.15.5:0/941267613 learned_addr learned my addr 172.21.15.5:0/941267613 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea79e2e640 10 monclient(hunting): get_auth_request con 0x7fea7409da30 auth_method 0 2024-08-18T21:06:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea79e2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea79e2e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea79e2e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 10 monclient(hunting): get_auth_request con 0x7fea7409e350 auth_method 0 2024-08-18T21:06:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea79e2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea79e2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea79e2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7a62f640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea7412c120 0x7fea741d57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7a62f640 10 monclient(hunting): get_auth_request con 0x7fea7412c120 auth_method 0 2024-08-18T21:06:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7a62f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7a62f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7a62f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 10 monclient(hunting): handle_auth_done global_id 5134 payload 824 2024-08-18T21:06:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 1 -- 172.21.15.5:0/941267613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea7412c120 msgr2=0x7fea741d57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea7412c120 0x7fea741d57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 1 -- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea7409da30 msgr2=0x7fea7412e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea7409da30 0x7fea7412e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 10 monclient: _finish_hunting 0 2024-08-18T21:06:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 1 monclient: found mon.noname-c 2024-08-18T21:06:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:06:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7962d640 1 -- 172.21.15.5:0/941267613 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7412fa00 con 0x7fea7409e350 2024-08-18T21:06:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea79e2e640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea7409da30 0x7fea7412e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:06:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.082+0000 7fea7a62f640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea7412c120 0x7fea741d57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:06:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea7962d640 1 -- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fea7409e350 msgr2=0x7fea74145070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea7962d640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fea7409e350 0x7fea74145070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fea6400c410 tx=0x7fea6400c8d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6a7fc640 1 -- 172.21.15.5:0/941267613 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fea64017070 con 0x7fea7409e350 2024-08-18T21:06:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:06:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6a7fc640 10 monclient: dump: 2024-08-18T21:06:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.101 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6a7fc640 10 monclient: _finish_auth 0 2024-08-18T21:06:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6a7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:06:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea7c092640 5 monclient: authenticate success, global_id 5134 2024-08-18T21:06:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6a7fc640 1 -- 172.21.15.5:0/941267613 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea64006c50 con 0x7fea7409e350 2024-08-18T21:06:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea7c092640 10 monclient: _renew_subs 2024-08-18T21:06:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea7c092640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:06:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea7c092640 1 -- 172.21.15.5:0/941267613 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea74122070 con 0x7fea7409e350 2024-08-18T21:06:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6a7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6a7fc640 1 -- 172.21.15.5:0/941267613 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fea64006e00 con 0x7fea7409e350 2024-08-18T21:06:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6bfff640 4 set_mon_vals no callback set 2024-08-18T21:06:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6a7fc640 10 monclient: dump: 2024-08-18T21:06:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.103 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea7c092640 10 monclient: _renew_subs 2024-08-18T21:06:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea7c092640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:06:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea7c092640 1 -- 172.21.15.5:0/941267613 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fea74145d10 con 0x7fea7409e350 2024-08-18T21:06:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea7c092640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea7c092640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea7409e730 0x7fea741d5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea7c092640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea7c092640 1 -- 172.21.15.5:0/941267613 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fea74051140 con 0x7fea7409e730 2024-08-18T21:06:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea79e2e640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea7409e730 0x7fea741d5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea79e2e640 10 monclient: get_auth_request con 0x7fea7409e730 auth_method 0 2024-08-18T21:06:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea79e2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea79e2e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea79e2e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6a7fc640 1 -- 172.21.15.5:0/941267613 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fea640067e0 con 0x7fea7409e350 2024-08-18T21:06:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea79e2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea79e2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea79e2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6a7fc640 1 --2- 172.21.15.5:0/941267613 >> v2:172.21.15.157:6812/631023601 conn(0x7fea5803bdf0 0x7fea5803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea79e2e640 10 monclient(hunting): handle_auth_done global_id 5150 payload 824 2024-08-18T21:06:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea6a7fc640 1 -- 172.21.15.5:0/941267613 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(80..80 src has 22..80) ==== 3898+0+0 (secure 0 0 0) 0x7fea6404d9c0 con 0x7fea7409e350 2024-08-18T21:06:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea79e2e640 1 -- 172.21.15.5:0/941267613 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fea7409de10 con 0x7fea7409e730 2024-08-18T21:06:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea7a62f640 1 --2- 172.21.15.5:0/941267613 >> v2:172.21.15.157:6812/631023601 conn(0x7fea5803bdf0 0x7fea5803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.086+0000 7fea7a62f640 10 monclient: get_auth_request con 0x7fea5803bdf0 auth_method 0 2024-08-18T21:06:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.090+0000 7fea79e2e640 1 -- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea7409e730 msgr2=0x7fea741d5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.090+0000 7fea79e2e640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea7409e730 0x7fea741d5d30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0af040 tx=0x7fea6c0196b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.090+0000 7fea6a7fc640 1 -- 172.21.15.5:0/941267613 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fea6c0bd070 con 0x7fea7409e730 2024-08-18T21:06:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.090+0000 7fea6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.090+0000 7fea6a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:06:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.090+0000 7fea6a7fc640 10 monclient: dump: 2024-08-18T21:06:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.106 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.090+0000 7fea6a7fc640 1 -- 172.21.15.5:0/941267613 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fea6c004460 con 0x7fea7409e730 2024-08-18T21:06:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.090+0000 7fea6a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:14.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.090+0000 7fea6a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:14.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.090+0000 7fea6a7fc640 1 -- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea7409e730 msgr2=0x7fea741d5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.090+0000 7fea6a7fc640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea7409e730 0x7fea741d5d30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0af040 tx=0x7fea6c0196b0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.090+0000 7fea6a7fc640 1 -- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea7409e730 msgr2=0x7fea741d5d30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:14.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.090+0000 7fea6a7fc640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea7409e730 0x7fea741d5d30 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0af040 tx=0x7fea6c0196b0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.090+0000 7fea7a62f640 1 --2- 172.21.15.5:0/941267613 >> v2:172.21.15.157:6812/631023601 conn(0x7fea5803bdf0 0x7fea5803e2b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fea7000b970 tx=0x7fea70008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.094+0000 7fea7c092640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.094+0000 7fea7c092640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea741455b0 0x7fea741d6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.094+0000 7fea7c092640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.094+0000 7fea7c092640 1 -- 172.21.15.5:0/941267613 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fea7412d6a0 con 0x7fea741455b0 2024-08-18T21:06:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.094+0000 7fea79e2e640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea741455b0 0x7fea741d6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.094+0000 7fea79e2e640 10 monclient: get_auth_request con 0x7fea741455b0 auth_method 0 2024-08-18T21:06:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.094+0000 7fea79e2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.094+0000 7fea79e2e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.094+0000 7fea79e2e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.094+0000 7fea79e2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.094+0000 7fea79e2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.098+0000 7fea79e2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.098+0000 7fea79e2e640 10 monclient(hunting): handle_auth_done global_id 5159 payload 824 2024-08-18T21:06:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.098+0000 7fea79e2e640 1 -- 172.21.15.5:0/941267613 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fea7406d150 con 0x7fea741455b0 2024-08-18T21:06:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.098+0000 7fea79e2e640 1 -- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea741455b0 msgr2=0x7fea741d6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.098+0000 7fea79e2e640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea741455b0 0x7fea741d6270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0bc000 tx=0x7fea6c0a7000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.098+0000 7fea6a7fc640 1 -- 172.21.15.5:0/941267613 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fea6c0b7ab0 con 0x7fea741455b0 2024-08-18T21:06:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.098+0000 7fea6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.098+0000 7fea6a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:06:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.098+0000 7fea6a7fc640 10 monclient: dump: 2024-08-18T21:06:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.111 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.098+0000 7fea6a7fc640 1 -- 172.21.15.5:0/941267613 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7fea6c0b7640 con 0x7fea741455b0 2024-08-18T21:06:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.098+0000 7fea6a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.098+0000 7fea6a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.098+0000 7fea6a7fc640 1 -- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea741455b0 msgr2=0x7fea741d6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.098+0000 7fea6a7fc640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea741455b0 0x7fea741d6270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0bc000 tx=0x7fea6c0a7000 comp rx=0 tx=0).stop 2024-08-18T21:06:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.098+0000 7fea6a7fc640 1 -- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea741455b0 msgr2=0x7fea741d6270 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.098+0000 7fea6a7fc640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea741455b0 0x7fea741d6270 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0bc000 tx=0x7fea6c0a7000 comp rx=0 tx=0).stop 2024-08-18T21:06:14.112 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 183211, 2024-08-18T21:06:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:06:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:06:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:06:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:14.135 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:14.137 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28839]: starting. 2024-08-18T21:06:14.137 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28839]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28837 2024-08-18T21:06:14.137 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28839]: shutting down. 2024-08-18T21:06:14.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.102+0000 7fea7c092640 1 -- 172.21.15.5:0/941267613 >> v2:172.21.15.157:6812/631023601 conn(0x7fea5803bdf0 msgr2=0x7fea5803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.102+0000 7fea7c092640 1 --2- 172.21.15.5:0/941267613 >> v2:172.21.15.157:6812/631023601 conn(0x7fea5803bdf0 0x7fea5803e2b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fea7000b970 tx=0x7fea70008040 comp rx=0 tx=0).stop 2024-08-18T21:06:14.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.102+0000 7fea7c092640 10 monclient: shutdown 2024-08-18T21:06:14.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.102+0000 7fea7c092640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:14.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.102+0000 7fea7c092640 1 -- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fea7409e350 msgr2=0x7fea74145070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.102+0000 7fea7c092640 1 --2- 172.21.15.5:0/941267613 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fea7409e350 0x7fea74145070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fea6400c410 tx=0x7fea6400c8d0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.102+0000 7fea7a62f640 1 -- 172.21.15.5:0/941267613 reap_dead start 2024-08-18T21:06:14.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.102+0000 7fea7a62f640 1 -- 172.21.15.5:0/941267613 reap_dead start 2024-08-18T21:06:14.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.102+0000 7fea7c092640 1 -- 172.21.15.5:0/941267613 shutdown_connections 2024-08-18T21:06:14.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.102+0000 7fea7c092640 1 -- 172.21.15.5:0/941267613 >> 172.21.15.5:0/941267613 conn(0x7fea740a4b20 msgr2=0x7fea740a3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:14.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.102+0000 7fea7c092640 1 -- 172.21.15.5:0/941267613 shutdown_connections 2024-08-18T21:06:14.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.102+0000 7fea7c092640 1 -- 172.21.15.5:0/941267613 wait complete. 2024-08-18T21:06:14.139 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:14.139 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:06:14.139 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:06:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 10 monclient: get_monmap_and_config 2024-08-18T21:06:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 10 monclient: build_initial_monmap 2024-08-18T21:06:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 10 monclient: monmap: 2024-08-18T21:06:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:14.257042+0000 2024-08-18T21:06:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:14.257042+0000 2024-08-18T21:06:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:14.257 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 1 Processor -- start 2024-08-18T21:06:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 1 -- start start 2024-08-18T21:06:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 10 monclient: init 2024-08-18T21:06:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 10 monclient: _add_conns ranks=[4,2,3,6,1,7,0,5,9,8,10] 2024-08-18T21:06:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a80a6ce0 0x7f63a80a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 10 monclient(hunting): picked mon.noname-c con 0x7f63a80a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63a80a7600 0x7f63a8139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 10 monclient(hunting): picked mon.noname-b con 0x7f63a80a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63a8139fe0 0x7f63a813a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 10 monclient(hunting): picked mon.noname-g con 0x7f63a8139fe0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:06:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f63a80a5000 con 0x7f63a80a7600 2024-08-18T21:06:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f63a80a4360 con 0x7f63a8139fe0 2024-08-18T21:06:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f63a80a45d0 con 0x7f63a80a6ce0 2024-08-18T21:06:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63afc06640 10 monclient(hunting): authenticate will time out at 1141.270941s 2024-08-18T21:06:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad9a2640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a80a6ce0 0x7f63a80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63a80a7600 0x7f63a8139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad9a2640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a80a6ce0 0x7f63a80a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:33646/0 (socket says 172.21.15.5:33646) 2024-08-18T21:06:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad9a2640 1 -- 172.21.15.5:0/1645410829 learned_addr learned my addr 172.21.15.5:0/1645410829 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad9a2640 10 monclient(hunting): get_auth_request con 0x7f63a80a6ce0 auth_method 0 2024-08-18T21:06:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad9a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad9a2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad9a2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 10 monclient(hunting): get_auth_request con 0x7f63a80a7600 auth_method 0 2024-08-18T21:06:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad9a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad9a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad9a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ae1a3640 1 --2- 172.21.15.5:0/1645410829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63a8139fe0 0x7f63a813a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ae1a3640 10 monclient(hunting): get_auth_request con 0x7f63a8139fe0 auth_method 0 2024-08-18T21:06:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ae1a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ae1a3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ae1a3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 10 monclient(hunting): handle_auth_done global_id 5195 payload 274 2024-08-18T21:06:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 1 -- 172.21.15.5:0/1645410829 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a80a6ce0 msgr2=0x7f63a80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 1 --2- 172.21.15.5:0/1645410829 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a80a6ce0 0x7f63a80a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 1 -- 172.21.15.5:0/1645410829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63a8139fe0 msgr2=0x7f63a813a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 1 --2- 172.21.15.5:0/1645410829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63a8139fe0 0x7f63a813a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 10 monclient: _finish_hunting 0 2024-08-18T21:06:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 1 monclient: found mon.noname-b 2024-08-18T21:06:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:06:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad1a1640 1 -- 172.21.15.5:0/1645410829 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a80a32d0 con 0x7f63a80a7600 2024-08-18T21:06:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.254+0000 7f63ad9a2640 1 --2- 172.21.15.5:0/1645410829 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a80a6ce0 0x7f63a80a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:06:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.258+0000 7f63ad1a1640 1 -- 172.21.15.5:0/1645410829 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63a80a7600 msgr2=0x7f63a8139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.258+0000 7f63ad1a1640 1 --2- 172.21.15.5:0/1645410829 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63a80a7600 0x7f63a8139aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f639c009820 tx=0x7f639c01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90bc70b4442751af server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.258+0000 7f63ac9a0640 1 -- 172.21.15.5:0/1645410829 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f639c0b0070 con 0x7f63a80a7600 2024-08-18T21:06:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.258+0000 7f63ac9a0640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.258+0000 7f63ac9a0640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:06:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.258+0000 7f63ac9a0640 10 monclient: dump: 2024-08-18T21:06:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.269 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ac9a0640 10 monclient: _finish_auth 0 2024-08-18T21:06:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ac9a0640 10 monclient: _check_auth_tickets 2024-08-18T21:06:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ac9a0640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ac9a0640 1 -- 172.21.15.5:0/1645410829 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639c0aa810 con 0x7f63a80a7600 2024-08-18T21:06:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 5 monclient: authenticate success, global_id 5195 2024-08-18T21:06:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:06:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ac9a0640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ac9a0640 1 -- 172.21.15.5:0/1645410829 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f639c0aae30 con 0x7f63a80a7600 2024-08-18T21:06:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 4 set_mon_vals no callback set 2024-08-18T21:06:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ac9a0640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ac9a0640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:06:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ac9a0640 10 monclient: dump: 2024-08-18T21:06:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.275 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 10 monclient: shutdown 2024-08-18T21:06:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 -- 172.21.15.5:0/1645410829 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63a80a7600 msgr2=0x7f63a8139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 --2- 172.21.15.5:0/1645410829 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63a80a7600 0x7f63a8139aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f639c009820 tx=0x7f639c01c380 comp rx=0 tx=0).stop 2024-08-18T21:06:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 -- 172.21.15.5:0/1645410829 shutdown_connections 2024-08-18T21:06:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 --2- 172.21.15.5:0/1645410829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63a8139fe0 0x7f63a813a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 --2- 172.21.15.5:0/1645410829 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63a80a7600 0x7f63a8139aa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 --2- 172.21.15.5:0/1645410829 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a80a6ce0 0x7f63a80a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 -- 172.21.15.5:0/1645410829 >> 172.21.15.5:0/1645410829 conn(0x7f63a80acbc0 msgr2=0x7f63a80a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 -- 172.21.15.5:0/1645410829 shutdown_connections 2024-08-18T21:06:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 -- 172.21.15.5:0/1645410829 wait complete. 2024-08-18T21:06:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 10 monclient: build_initial_monmap 2024-08-18T21:06:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 10 monclient: monmap: 2024-08-18T21:06:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:14.277 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 Processor -- start 2024-08-18T21:06:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 -- start start 2024-08-18T21:06:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 10 monclient: init 2024-08-18T21:06:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 10 monclient: _add_conns ranks=[0,2,7,5,3,4,1,8,6] 2024-08-18T21:06:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63a80a6ce0 0x7f63a80a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 10 monclient(hunting): picked mon.noname-a con 0x7f63a80a6ce0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:06:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63a80a7600 0x7f63a80a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 10 monclient(hunting): picked mon.noname-b con 0x7f63a80a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f63a8139fe0 0x7f63a80a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 10 monclient(hunting): picked mon.noname-i con 0x7f63a8139fe0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f63a80a79e0 con 0x7f63a80a6ce0 2024-08-18T21:06:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f63a80a8220 con 0x7f63a80a7600 2024-08-18T21:06:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f63a80aa400 con 0x7f63a8139fe0 2024-08-18T21:06:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63afc06640 10 monclient(hunting): authenticate will time out at 1141.278531s 2024-08-18T21:06:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63a80a7600 0x7f63a80a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63a80a7600 0x7f63a80a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:40850/0 (socket says 172.21.15.5:40850) 2024-08-18T21:06:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 1 -- 172.21.15.5:0/1646846232 learned_addr learned my addr 172.21.15.5:0/1646846232 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 10 monclient(hunting): get_auth_request con 0x7f63a80a7600 auth_method 0 2024-08-18T21:06:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad9a2640 1 --2- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63a80a6ce0 0x7f63a80a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad9a2640 10 monclient(hunting): get_auth_request con 0x7f63a80a6ce0 auth_method 0 2024-08-18T21:06:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad9a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad9a2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad9a2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad9a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad9a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad9a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ae1a3640 1 --2- 172.21.15.5:0/1646846232 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f63a8139fe0 0x7f63a80a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 10 monclient(hunting): handle_auth_done global_id 5204 payload 824 2024-08-18T21:06:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 1 -- 172.21.15.5:0/1646846232 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f63a8139fe0 msgr2=0x7f63a80a1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 1 --2- 172.21.15.5:0/1646846232 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f63a8139fe0 0x7f63a80a1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 1 -- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63a80a6ce0 msgr2=0x7f63a80a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 1 --2- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63a80a6ce0 0x7f63a80a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 10 monclient: _finish_hunting 0 2024-08-18T21:06:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 1 monclient: found mon.noname-b 2024-08-18T21:06:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:06:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.262+0000 7f63ad1a1640 1 -- 172.21.15.5:0/1646846232 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a80a7350 con 0x7f63a80a7600 2024-08-18T21:06:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63ad1a1640 1 -- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63a80a7600 msgr2=0x7f63a80a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63ad1a1640 1 --2- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63a80a7600 0x7f63a80a0ed0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f639c009710 tx=0x7f639c019120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639a7fc640 1 -- 172.21.15.5:0/1646846232 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f639c0b0040 con 0x7f63a80a7600 2024-08-18T21:06:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:06:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639a7fc640 10 monclient: dump: 2024-08-18T21:06:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.287 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639a7fc640 10 monclient: _finish_auth 0 2024-08-18T21:06:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639a7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:06:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639a7fc640 1 -- 172.21.15.5:0/1646846232 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639c0b9070 con 0x7f63a80a7600 2024-08-18T21:06:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639a7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639a7fc640 1 -- 172.21.15.5:0/1646846232 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f639c004250 con 0x7f63a80a7600 2024-08-18T21:06:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63afc06640 5 monclient: authenticate success, global_id 5204 2024-08-18T21:06:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63afc06640 10 monclient: _renew_subs 2024-08-18T21:06:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63afc06640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:06:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63afc06640 1 -- 172.21.15.5:0/1646846232 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a813c150 con 0x7f63a80a7600 2024-08-18T21:06:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639b7fe640 4 set_mon_vals no callback set 2024-08-18T21:06:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:06:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639a7fc640 10 monclient: dump: 2024-08-18T21:06:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.290 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63afc06640 10 monclient: _renew_subs 2024-08-18T21:06:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63afc06640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:06:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63afc06640 1 -- 172.21.15.5:0/1646846232 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a813af10 con 0x7f63a80a7600 2024-08-18T21:06:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63afc06640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63afc06640 1 --2- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a81d1390 0x7f63a81d1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63afc06640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63afc06640 1 -- 172.21.15.5:0/1646846232 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f63a80689d0 con 0x7f63a81d1390 2024-08-18T21:06:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63ad9a2640 1 --2- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a81d1390 0x7f63a81d1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639a7fc640 1 -- 172.21.15.5:0/1646846232 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f639c0b3070 con 0x7f63a80a7600 2024-08-18T21:06:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63ad9a2640 10 monclient: get_auth_request con 0x7f63a81d1390 auth_method 0 2024-08-18T21:06:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63ad9a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63ad9a2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63ad9a2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63ad9a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63ad9a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63ad9a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639a7fc640 1 --2- 172.21.15.5:0/1646846232 >> v2:172.21.15.157:6812/631023601 conn(0x7f638c03bdf0 0x7f638c03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63ad9a2640 10 monclient(hunting): handle_auth_done global_id 5161 payload 824 2024-08-18T21:06:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63ad9a2640 1 -- 172.21.15.5:0/1646846232 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63a813c830 con 0x7f63a81d1390 2024-08-18T21:06:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f639a7fc640 1 -- 172.21.15.5:0/1646846232 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(81..81 src has 22..81) ==== 3506+0+0 (secure 0 0 0) 0x7f639c0e8090 con 0x7f63a80a7600 2024-08-18T21:06:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63ae1a3640 1 --2- 172.21.15.5:0/1646846232 >> v2:172.21.15.157:6812/631023601 conn(0x7f638c03bdf0 0x7f638c03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.266+0000 7f63ae1a3640 10 monclient: get_auth_request con 0x7f638c03bdf0 auth_method 0 2024-08-18T21:06:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.270+0000 7f63ad9a2640 1 -- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a81d1390 msgr2=0x7f63a81d1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.270+0000 7f63ad9a2640 1 --2- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a81d1390 0x7f63a81d1770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f63a40118f0 tx=0x7f63a4011db0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.270+0000 7f639a7fc640 1 -- 172.21.15.5:0/1646846232 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63a400fd90 con 0x7f63a81d1390 2024-08-18T21:06:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.270+0000 7f639a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.270+0000 7f639a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.270+0000 7f639a7fc640 10 monclient: dump: 2024-08-18T21:06:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.293 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.270+0000 7f639a7fc640 1 -- 172.21.15.5:0/1646846232 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f63a400fd90 con 0x7f63a81d1390 2024-08-18T21:06:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.270+0000 7f639a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.270+0000 7f639a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.270+0000 7f639a7fc640 1 -- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a81d1390 msgr2=0x7f63a81d1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.270+0000 7f639a7fc640 1 --2- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a81d1390 0x7f63a81d1770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f63a40118f0 tx=0x7f63a4011db0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.270+0000 7f639a7fc640 1 -- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a81d1390 msgr2=0x7f63a81d1770 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.270+0000 7f639a7fc640 1 --2- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a81d1390 0x7f63a81d1770 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f63a40118f0 tx=0x7f63a4011db0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.270+0000 7f63ae1a3640 1 --2- 172.21.15.5:0/1646846232 >> v2:172.21.15.157:6812/631023601 conn(0x7f638c03bdf0 0x7f638c03e2b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f63a80a81b0 tx=0x7f63a000b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63afc06640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63afc06640 1 --2- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a81d1cb0 0x7f63a8133c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63afc06640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63afc06640 1 -- 172.21.15.5:0/1646846232 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f63a80a7b60 con 0x7f63a81d1cb0 2024-08-18T21:06:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63ad9a2640 1 --2- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a81d1cb0 0x7f63a8133c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63ad9a2640 10 monclient: get_auth_request con 0x7f63a81d1cb0 auth_method 0 2024-08-18T21:06:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63ad9a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63ad9a2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63ad9a2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63ad9a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63ad9a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63ad9a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63ad9a2640 10 monclient(hunting): handle_auth_done global_id 5170 payload 824 2024-08-18T21:06:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63ad9a2640 1 -- 172.21.15.5:0/1646846232 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f63a8139aa0 con 0x7f63a81d1cb0 2024-08-18T21:06:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63ad9a2640 1 -- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a81d1cb0 msgr2=0x7f63a8133c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63ad9a2640 1 --2- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a81d1cb0 0x7f63a8133c50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f63a40118f0 tx=0x7f63a40046d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f639a7fc640 1 -- 172.21.15.5:0/1646846232 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63a4014ac0 con 0x7f63a81d1cb0 2024-08-18T21:06:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f639a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f639a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f639a7fc640 10 monclient: dump: 2024-08-18T21:06:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.296 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f639a7fc640 1 -- 172.21.15.5:0/1646846232 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f63a402b470 con 0x7f63a81d1cb0 2024-08-18T21:06:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f639a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:14.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f639a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:14.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f639a7fc640 1 -- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a81d1cb0 msgr2=0x7f63a8133c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f639a7fc640 1 --2- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a81d1cb0 0x7f63a8133c50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f63a40118f0 tx=0x7f63a40046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f639a7fc640 1 -- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a81d1cb0 msgr2=0x7f63a8133c50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:14.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f639a7fc640 1 --2- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63a81d1cb0 0x7f63a8133c50 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f63a40118f0 tx=0x7f63a40046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.297 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:14.297 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:14.297 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:14.297 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:14.297 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:14.298 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 183395, 2024-08-18T21:06:14.298 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:14.298 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:14.298 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:14.298 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:14.298 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:14.298 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:14.298 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:14.298 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:14.298 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:14.298 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:14.298 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.298 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:06:14.299 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:14.299 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:14.299 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:14.299 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:14.299 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:14.299 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:14.299 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:14.299 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:14.299 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:14.299 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:14.299 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:14.299 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:14.299 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:14.300 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:14.300 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.300 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:14.300 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:14.300 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:14.300 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:14.300 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:14.300 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:14.300 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:14.300 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:14.300 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:14.300 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:14.300 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:14.300 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:14.301 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:14.301 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.301 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:14.301 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:14.301 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:14.301 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:14.301 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:14.301 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:14.301 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:14.301 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:14.301 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:14.301 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:14.302 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:14.302 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:14.302 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:14.302 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:14.302 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:14.302 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:14.302 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:14.302 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:14.302 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:14.302 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:14.302 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:14.302 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:14.302 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:14.303 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:14.303 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:14.303 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:14.303 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:14.303 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:14.303 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.303 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:14.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.303 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:14.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.303 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:14.303 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:14.303 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:14.304 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:14.304 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.304 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.304 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:14.305 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:14.305 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.305 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.305 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.305 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:14.305 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:14.305 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:14.305 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:14.306 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.306 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.306 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:14.306 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:14.307 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.307 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.307 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.307 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:14.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:14.307 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:14.307 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.308 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:14.308 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.308 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.308 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:14.308 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:14.308 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.308 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.308 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.309 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:14.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:14.309 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:14.309 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:14.309 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.310 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.310 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:14.310 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:14.310 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.310 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.310 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.310 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:14.310 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:14.310 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:14.311 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:14.311 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.311 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.311 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:14.312 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:14.312 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.312 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.312 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.312 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:14.312 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:14.312 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.312 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:14.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:14.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.313 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:14.313 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:14.313 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.313 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.313 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.314 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:14.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:14.314 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.314 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:14.314 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.314 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:14.315 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.315 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.315 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:14.315 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:14.315 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.315 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.315 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.315 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:14.315 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:14.316 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:14.316 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:14.316 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.316 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.316 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.317 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:14.317 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:14.317 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.317 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.317 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.317 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:14.317 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:14.317 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.317 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.317 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.318 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:14.318 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.318 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:14.318 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.318 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.318 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.318 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:14.318 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:14.319 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.319 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.319 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.319 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.319 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.319 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:14.319 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:14.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.319 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:14.319 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:14.319 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:06:14.321 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.321 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.321 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:14.321 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63afc06640 1 -- 172.21.15.5:0/1646846232 >> v2:172.21.15.157:6812/631023601 conn(0x7f638c03bdf0 msgr2=0x7f638c03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63afc06640 1 --2- 172.21.15.5:0/1646846232 >> v2:172.21.15.157:6812/631023601 conn(0x7f638c03bdf0 0x7f638c03e2b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f63a80a81b0 tx=0x7f63a000b040 comp rx=0 tx=0).stop 2024-08-18T21:06:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63afc06640 10 monclient: shutdown 2024-08-18T21:06:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63afc06640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63afc06640 1 -- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63a80a7600 msgr2=0x7f63a80a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63afc06640 1 --2- 172.21.15.5:0/1646846232 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f63a80a7600 0x7f63a80a0ed0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f639c009710 tx=0x7f639c019120 comp rx=0 tx=0).stop 2024-08-18T21:06:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63ae1a3640 1 -- 172.21.15.5:0/1646846232 reap_dead start 2024-08-18T21:06:14.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63ae1a3640 1 -- 172.21.15.5:0/1646846232 reap_dead start 2024-08-18T21:06:14.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63afc06640 1 -- 172.21.15.5:0/1646846232 shutdown_connections 2024-08-18T21:06:14.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63afc06640 1 -- 172.21.15.5:0/1646846232 >> 172.21.15.5:0/1646846232 conn(0x7f63a80acbc0 msgr2=0x7f63a8138a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:14.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63afc06640 1 -- 172.21.15.5:0/1646846232 shutdown_connections 2024-08-18T21:06:14.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.278+0000 7f63afc06640 1 -- 172.21.15.5:0/1646846232 wait complete. 2024-08-18T21:06:14.323 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:14.323 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:06:14.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:06:14.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 10 monclient: get_monmap_and_config 2024-08-18T21:06:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 10 monclient: build_initial_monmap 2024-08-18T21:06:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 10 monclient: monmap: 2024-08-18T21:06:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:14.449066+0000 2024-08-18T21:06:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:14.449066+0000 2024-08-18T21:06:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:14.449 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 1 Processor -- start 2024-08-18T21:06:14.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 1 -- start start 2024-08-18T21:06:14.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 10 monclient: init 2024-08-18T21:06:14.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:14.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 10 monclient: _add_conns ranks=[5,4,7,8,9,2,3,6,1,0,10] 2024-08-18T21:06:14.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f10c40a6ce0 0x7f10c40a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 10 monclient(hunting): picked mon.noname-h con 0x7f10c40a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:14.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f10c40a7600 0x7f10c4139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 10 monclient(hunting): picked mon.noname-c con 0x7f10c40a7600 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:14.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f10c4139fe0 0x7f10c413a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 10 monclient(hunting): picked mon.noname-i con 0x7f10c4139fe0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:14.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f10c40a5000 con 0x7f10c40a7600 2024-08-18T21:06:14.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f10c40a4360 con 0x7f10c40a6ce0 2024-08-18T21:06:14.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f10c40a45d0 con 0x7f10c4139fe0 2024-08-18T21:06:14.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:14.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c8b53640 10 monclient(hunting): authenticate will time out at 1141.462329s 2024-08-18T21:06:14.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f10c40a7600 0x7f10c4139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f10c40a7600 0x7f10c4139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:33690/0 (socket says 172.21.15.5:33690) 2024-08-18T21:06:14.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 1 -- 172.21.15.5:0/3006446722 learned_addr learned my addr 172.21.15.5:0/3006446722 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:14.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 10 monclient(hunting): get_auth_request con 0x7f10c40a7600 auth_method 0 2024-08-18T21:06:14.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c2d9d640 1 --2- 172.21.15.5:0/3006446722 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f10c4139fe0 0x7f10c413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c2d9d640 10 monclient(hunting): get_auth_request con 0x7f10c4139fe0 auth_method 0 2024-08-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c2d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c259c640 1 --2- 172.21.15.5:0/3006446722 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f10c40a6ce0 0x7f10c40a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 10 monclient(hunting): handle_auth_done global_id 5179 payload 274 2024-08-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 1 -- 172.21.15.5:0/3006446722 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f10c4139fe0 msgr2=0x7f10c413a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 1 --2- 172.21.15.5:0/3006446722 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f10c4139fe0 0x7f10c413a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 1 -- 172.21.15.5:0/3006446722 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f10c40a6ce0 msgr2=0x7f10c40a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 1 --2- 172.21.15.5:0/3006446722 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f10c40a6ce0 0x7f10c40a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 1 monclient: found mon.noname-c 2024-08-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c1d9b640 1 -- 172.21.15.5:0/3006446722 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c40a32d0 con 0x7f10c40a7600 2024-08-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c259c640 10 monclient: get_auth_request con 0x7f10c40a6ce0 auth_method 0 2024-08-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.446+0000 7f10c259c640 1 --2- 172.21.15.5:0/3006446722 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f10c40a6ce0 0x7f10c40a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c1d9b640 1 -- 172.21.15.5:0/3006446722 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f10c40a7600 msgr2=0x7f10c4139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c1d9b640 1 --2- 172.21.15.5:0/3006446722 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f10c40a7600 0x7f10c4139aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f10b80098d0 tx=0x7f10b801c440 comp rx=0 tx=0).ready entity=mon.4 client_cookie=7f19697bbe54bc76 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c159a640 1 -- 172.21.15.5:0/3006446722 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f10b80b0070 con 0x7f10c40a7600 2024-08-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c159a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c159a640 10 monclient: dump: 2024-08-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c159a640 10 monclient: _finish_auth 0 2024-08-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c159a640 10 monclient: _check_auth_tickets 2024-08-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c159a640 1 -- 172.21.15.5:0/3006446722 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b80aa810 con 0x7f10c40a7600 2024-08-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c159a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c159a640 1 -- 172.21.15.5:0/3006446722 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f10b80a9300 con 0x7f10c40a7600 2024-08-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c159a640 10 monclient: dump: 2024-08-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c8b53640 5 monclient: authenticate success, global_id 5179 2024-08-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c8b53640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.450+0000 7f10c8b53640 4 set_mon_vals no callback set 2024-08-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 10 monclient: shutdown 2024-08-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 -- 172.21.15.5:0/3006446722 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f10c40a7600 msgr2=0x7f10c4139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 --2- 172.21.15.5:0/3006446722 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f10c40a7600 0x7f10c4139aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f10b80098d0 tx=0x7f10b801c440 comp rx=0 tx=0).stop 2024-08-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 -- 172.21.15.5:0/3006446722 shutdown_connections 2024-08-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 --2- 172.21.15.5:0/3006446722 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f10c4139fe0 0x7f10c413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 --2- 172.21.15.5:0/3006446722 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f10c40a7600 0x7f10c4139aa0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 --2- 172.21.15.5:0/3006446722 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f10c40a6ce0 0x7f10c40a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 -- 172.21.15.5:0/3006446722 >> 172.21.15.5:0/3006446722 conn(0x7f10c40acbc0 msgr2=0x7f10c40a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 -- 172.21.15.5:0/3006446722 shutdown_connections 2024-08-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 -- 172.21.15.5:0/3006446722 wait complete. 2024-08-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 10 monclient: build_initial_monmap 2024-08-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 10 monclient: monmap: 2024-08-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 Processor -- start 2024-08-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 -- start start 2024-08-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 10 monclient: init 2024-08-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 10 monclient: _add_conns ranks=[8,6,1,2,4,0,7,5,3] 2024-08-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f10c40a6ce0 0x7f10c4135030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 10 monclient(hunting): picked mon.noname-e con 0x7f10c40a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c40a7600 0x7f10c4135570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 10 monclient(hunting): picked mon.noname-d con 0x7f10c40a7600 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10c4139fe0 0x7f10c413aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 10 monclient(hunting): picked mon.noname-f con 0x7f10c4139fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f10c40a79e0 con 0x7f10c4139fe0 2024-08-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f10c40a8220 con 0x7f10c40a7600 2024-08-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f10c413e580 con 0x7f10c40a6ce0 2024-08-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c8b53640 10 monclient(hunting): authenticate will time out at 1141.469910s 2024-08-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c40a7600 0x7f10c4135570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c259c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f10c40a6ce0 0x7f10c4135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c40a7600 0x7f10c4135570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:55434/0 (socket says 172.21.15.5:55434) 2024-08-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 1 -- 172.21.15.5:0/3232777992 learned_addr learned my addr 172.21.15.5:0/3232777992 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c259c640 10 monclient(hunting): get_auth_request con 0x7f10c40a6ce0 auth_method 0 2024-08-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 10 monclient(hunting): get_auth_request con 0x7f10c40a7600 auth_method 0 2024-08-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c2d9d640 1 --2- 172.21.15.5:0/3232777992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10c4139fe0 0x7f10c413aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c2d9d640 10 monclient(hunting): get_auth_request con 0x7f10c4139fe0 auth_method 0 2024-08-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c2d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 10 monclient(hunting): handle_auth_done global_id 54195 payload 824 2024-08-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 1 -- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f10c40a6ce0 msgr2=0x7f10c4135030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 1 --2- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f10c40a6ce0 0x7f10c4135030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 1 -- 172.21.15.5:0/3232777992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10c4139fe0 msgr2=0x7f10c413aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 1 --2- 172.21.15.5:0/3232777992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10c4139fe0 0x7f10c413aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 1 monclient: found mon.noname-d 2024-08-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c1d9b640 1 -- 172.21.15.5:0/3232777992 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c4140a00 con 0x7f10c40a7600 2024-08-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.454+0000 7f10c259c640 1 --2- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f10c40a6ce0 0x7f10c4135030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c1d9b640 1 -- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c40a7600 msgr2=0x7f10c4135570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c1d9b640 1 --2- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c40a7600 0x7f10c4135570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f10b80ae040 tx=0x7f10b80191e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10b2ffd640 1 -- 172.21.15.5:0/3232777992 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f10b80b9070 con 0x7f10c40a7600 2024-08-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10b2ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10b2ffd640 10 monclient: dump: 2024-08-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10b2ffd640 10 monclient: _finish_auth 0 2024-08-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10b2ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c8b53640 5 monclient: authenticate success, global_id 54195 2024-08-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10b2ffd640 1 -- 172.21.15.5:0/3232777992 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b8004250 con 0x7f10c40a7600 2024-08-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10b2ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10b2ffd640 1 -- 172.21.15.5:0/3232777992 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f10b80b0040 con 0x7f10c40a7600 2024-08-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c8b53640 10 monclient: _renew_subs 2024-08-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c8b53640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c8b53640 1 -- 172.21.15.5:0/3232777992 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c40aa430 con 0x7f10c40a7600 2024-08-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c0d99640 4 set_mon_vals no callback set 2024-08-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10b2ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10b2ffd640 10 monclient: dump: 2024-08-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c8b53640 10 monclient: _renew_subs 2024-08-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c8b53640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c8b53640 1 -- 172.21.15.5:0/3232777992 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c413c220 con 0x7f10c40a7600 2024-08-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c8b53640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c8b53640 1 --2- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c413e0a0 0x7f10c413b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c8b53640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c8b53640 1 -- 172.21.15.5:0/3232777992 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f10c413dd40 con 0x7f10c413e0a0 2024-08-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c259c640 1 --2- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c413e0a0 0x7f10c413b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c259c640 10 monclient: get_auth_request con 0x7f10c413e0a0 auth_method 0 2024-08-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10b2ffd640 1 -- 172.21.15.5:0/3232777992 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f10b8003620 con 0x7f10c40a7600 2024-08-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c259c640 10 monclient(hunting): handle_auth_done global_id 54204 payload 824 2024-08-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c259c640 1 -- 172.21.15.5:0/3232777992 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10c4139aa0 con 0x7f10c413e0a0 2024-08-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10b2ffd640 1 --2- 172.21.15.5:0/3232777992 >> v2:172.21.15.157:6812/631023601 conn(0x7f10a403bde0 0x7f10a403e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10b2ffd640 1 -- 172.21.15.5:0/3232777992 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(81..81 src has 22..81) ==== 3506+0+0 (secure 0 0 0) 0x7f10b80e77a0 con 0x7f10c40a7600 2024-08-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c2d9d640 1 --2- 172.21.15.5:0/3232777992 >> v2:172.21.15.157:6812/631023601 conn(0x7f10a403bde0 0x7f10a403e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.458+0000 7f10c2d9d640 10 monclient: get_auth_request con 0x7f10a403bde0 auth_method 0 2024-08-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.462+0000 7f10c259c640 1 -- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c413e0a0 msgr2=0x7f10c413b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.462+0000 7f10c259c640 1 --2- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c413e0a0 0x7f10c413b7b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f10b400fca0 tx=0x7f10b400d590 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.462+0000 7f10b2ffd640 1 -- 172.21.15.5:0/3232777992 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f10b4013ac0 con 0x7f10c413e0a0 2024-08-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.462+0000 7f10b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.462+0000 7f10b2ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.462+0000 7f10b2ffd640 10 monclient: dump: 2024-08-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.462+0000 7f10b2ffd640 1 -- 172.21.15.5:0/3232777992 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f10b4013650 con 0x7f10c413e0a0 2024-08-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.462+0000 7f10b2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.462+0000 7f10b2ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.462+0000 7f10b2ffd640 1 -- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c413e0a0 msgr2=0x7f10c413b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.462+0000 7f10b2ffd640 1 --2- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c413e0a0 0x7f10c413b7b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f10b400fca0 tx=0x7f10b400d590 comp rx=0 tx=0).stop 2024-08-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.462+0000 7f10b2ffd640 1 -- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c413e0a0 msgr2=0x7f10c413b7b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.462+0000 7f10b2ffd640 1 --2- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c413e0a0 0x7f10c413b7b0 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f10b400fca0 tx=0x7f10b400d590 comp rx=0 tx=0).stop 2024-08-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.462+0000 7f10c2d9d640 1 --2- 172.21.15.5:0/3232777992 >> v2:172.21.15.157:6812/631023601 conn(0x7f10a403bde0 0x7f10a403e2a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f10c413da80 tx=0x7f10bc00b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.466+0000 7f10c8b53640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.466+0000 7f10c8b53640 1 --2- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c402d1d0 0x7f10c402d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.466+0000 7f10c8b53640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.466+0000 7f10c8b53640 1 -- 172.21.15.5:0/3232777992 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f10c40a7b60 con 0x7f10c402d1d0 2024-08-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.466+0000 7f10c259c640 1 --2- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c402d1d0 0x7f10c402d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.466+0000 7f10c259c640 10 monclient: get_auth_request con 0x7f10c402d1d0 auth_method 0 2024-08-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.466+0000 7f10c259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.466+0000 7f10c259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.466+0000 7f10c259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.466+0000 7f10c259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.466+0000 7f10c259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.466+0000 7f10c259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.466+0000 7f10c259c640 10 monclient(hunting): handle_auth_done global_id 54213 payload 824 2024-08-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.466+0000 7f10c259c640 1 -- 172.21.15.5:0/3232777992 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f10c409f140 con 0x7f10c402d1d0 2024-08-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10c259c640 1 -- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c402d1d0 msgr2=0x7f10c402d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10c259c640 1 --2- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c402d1d0 0x7f10c402d5e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f10b400fca0 tx=0x7f10b40046d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10b2ffd640 1 -- 172.21.15.5:0/3232777992 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f10b4020e00 con 0x7f10c402d1d0 2024-08-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10b2ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10b2ffd640 10 monclient: dump: 2024-08-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10b2ffd640 1 -- 172.21.15.5:0/3232777992 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9246 (secure 0 0 0) 0x7f10b4000e50 con 0x7f10c402d1d0 2024-08-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10b2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10b2ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10b2ffd640 1 -- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c402d1d0 msgr2=0x7f10c402d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10b2ffd640 1 --2- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c402d1d0 0x7f10c402d5e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f10b400fca0 tx=0x7f10b40046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10b2ffd640 1 -- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c402d1d0 msgr2=0x7f10c402d5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10b2ffd640 1 --2- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c402d1d0 0x7f10c402d5e0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f10b400fca0 tx=0x7f10b40046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 30587, 2024-08-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:14.512 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10c8b53640 1 -- 172.21.15.5:0/3232777992 >> v2:172.21.15.157:6812/631023601 conn(0x7f10a403bde0 msgr2=0x7f10a403e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10c8b53640 1 --2- 172.21.15.5:0/3232777992 >> v2:172.21.15.157:6812/631023601 conn(0x7f10a403bde0 0x7f10a403e2a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f10c413da80 tx=0x7f10bc00b040 comp rx=0 tx=0).stop 2024-08-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10c8b53640 10 monclient: shutdown 2024-08-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10c8b53640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10c8b53640 1 -- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c40a7600 msgr2=0x7f10c4135570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10c8b53640 1 --2- 172.21.15.5:0/3232777992 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f10c40a7600 0x7f10c4135570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f10b80ae040 tx=0x7f10b80191e0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10c2d9d640 1 -- 172.21.15.5:0/3232777992 reap_dead start 2024-08-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10c2d9d640 1 -- 172.21.15.5:0/3232777992 reap_dead start 2024-08-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10c8b53640 1 -- 172.21.15.5:0/3232777992 shutdown_connections 2024-08-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10c8b53640 1 -- 172.21.15.5:0/3232777992 >> 172.21.15.5:0/3232777992 conn(0x7f10c40acbc0 msgr2=0x7f10c4138780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10c8b53640 1 -- 172.21.15.5:0/3232777992 shutdown_connections 2024-08-18T21:06:14.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.470+0000 7f10c8b53640 1 -- 172.21.15.5:0/3232777992 wait complete. 2024-08-18T21:06:14.514 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:14.514 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:06:14.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:06:14.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 10 monclient: get_monmap_and_config 2024-08-18T21:06:14.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 10 monclient: build_initial_monmap 2024-08-18T21:06:14.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 10 monclient: monmap: 2024-08-18T21:06:14.640 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:14.640 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.640 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:14.641114+0000 2024-08-18T21:06:14.640 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:14.641114+0000 2024-08-18T21:06:14.640 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:14.640 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:14.641 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 1 Processor -- start 2024-08-18T21:06:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 1 -- start start 2024-08-18T21:06:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 10 monclient: init 2024-08-18T21:06:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 10 monclient: _add_conns ranks=[6,8,10,1,3,5,0,4,9,2,7] 2024-08-18T21:06:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc6e80a6bd0 0x7fc6e80a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 10 monclient(hunting): picked mon.noname-d con 0x7fc6e80a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e809f080 0x7fc6e80a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 10 monclient(hunting): picked mon.noname-e con 0x7fc6e809f080 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc6e8139990 0x7fc6e8139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 10 monclient(hunting): picked mon.noname-f con 0x7fc6e8139990 addr v2:172.21.15.157:3300/0 2024-08-18T21:06:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc6e809e4c0 con 0x7fc6e8139990 2024-08-18T21:06:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fc6e806f930 con 0x7fc6e80a6bd0 2024-08-18T21:06:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fc6e80a7a30 con 0x7fc6e809f080 2024-08-18T21:06:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eeca5640 10 monclient(hunting): authenticate will time out at 1141.654327s 2024-08-18T21:06:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eca41640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc6e80a6bd0 0x7fc6e80a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e809f080 0x7fc6e80a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e809f080 0x7fc6e80a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:43120/0 (socket says 172.21.15.5:43120) 2024-08-18T21:06:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eca41640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc6e80a6bd0 0x7fc6e80a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:55468/0 (socket says 172.21.15.5:55468) 2024-08-18T21:06:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 1 -- 172.21.15.5:0/1865207408 learned_addr learned my addr 172.21.15.5:0/1865207408 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eca41640 10 monclient(hunting): get_auth_request con 0x7fc6e80a6bd0 auth_method 0 2024-08-18T21:06:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eca41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eca41640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eca41640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 10 monclient(hunting): get_auth_request con 0x7fc6e809f080 auth_method 0 2024-08-18T21:06:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eca41640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eca41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eca41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6ed242640 1 --2- 172.21.15.5:0/1865207408 >> v2:172.21.15.157:3300/0 conn(0x7fc6e8139990 0x7fc6e8139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6ed242640 10 monclient(hunting): get_auth_request con 0x7fc6e8139990 auth_method 0 2024-08-18T21:06:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6ed242640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6ed242640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6ed242640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 10 monclient(hunting): handle_auth_done global_id 54224 payload 274 2024-08-18T21:06:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 1 -- 172.21.15.5:0/1865207408 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc6e80a6bd0 msgr2=0x7fc6e80a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 1 --2- 172.21.15.5:0/1865207408 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc6e80a6bd0 0x7fc6e80a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 1 -- 172.21.15.5:0/1865207408 >> v2:172.21.15.157:3300/0 conn(0x7fc6e8139990 msgr2=0x7fc6e8139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 1 --2- 172.21.15.5:0/1865207408 >> v2:172.21.15.157:3300/0 conn(0x7fc6e8139990 0x7fc6e8139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:06:14.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 1 monclient: found mon.noname-e 2024-08-18T21:06:14.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:14.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:06:14.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6e7fff640 1 -- 172.21.15.5:0/1865207408 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e80a7fb0 con 0x7fc6e809f080 2024-08-18T21:06:14.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.638+0000 7fc6eca41640 1 --2- 172.21.15.5:0/1865207408 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc6e80a6bd0 0x7fc6e80a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:06:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6e7fff640 1 -- 172.21.15.5:0/1865207408 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e809f080 msgr2=0x7fc6e80a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6e7fff640 1 --2- 172.21.15.5:0/1865207408 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e809f080 0x7fc6e80a74f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80098a0 tx=0x7fc6d801c400 comp rx=0 tx=0).ready entity=mon.8 client_cookie=c31be060a9e39604 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6e77fe640 1 -- 172.21.15.5:0/1865207408 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc6d80b0070 con 0x7fc6e809f080 2024-08-18T21:06:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6e77fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:06:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6e77fe640 10 monclient: dump: 2024-08-18T21:06:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.655 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6e77fe640 10 monclient: _finish_auth 0 2024-08-18T21:06:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6e77fe640 10 monclient: _check_auth_tickets 2024-08-18T21:06:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6e77fe640 1 -- 172.21.15.5:0/1865207408 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d80aa810 con 0x7fc6e809f080 2024-08-18T21:06:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6e77fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6e77fe640 1 -- 172.21.15.5:0/1865207408 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc6d80aae30 con 0x7fc6e809f080 2024-08-18T21:06:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6eeca5640 5 monclient: authenticate success, global_id 54224 2024-08-18T21:06:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6eeca5640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6eeca5640 4 set_mon_vals no callback set 2024-08-18T21:06:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6e77fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6e77fe640 10 monclient: dump: 2024-08-18T21:06:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.657 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6eeca5640 10 monclient: shutdown 2024-08-18T21:06:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6eeca5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:14.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6eeca5640 1 -- 172.21.15.5:0/1865207408 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e809f080 msgr2=0x7fc6e80a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6eeca5640 1 --2- 172.21.15.5:0/1865207408 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e809f080 0x7fc6e80a74f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80098a0 tx=0x7fc6d801c400 comp rx=0 tx=0).stop 2024-08-18T21:06:14.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6eeca5640 1 -- 172.21.15.5:0/1865207408 shutdown_connections 2024-08-18T21:06:14.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6eeca5640 1 --2- 172.21.15.5:0/1865207408 >> v2:172.21.15.157:3300/0 conn(0x7fc6e8139990 0x7fc6e8139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6eeca5640 1 --2- 172.21.15.5:0/1865207408 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e809f080 0x7fc6e80a74f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6eeca5640 1 --2- 172.21.15.5:0/1865207408 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc6e80a6bd0 0x7fc6e80a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.642+0000 7fc6eeca5640 1 -- 172.21.15.5:0/1865207408 >> 172.21.15.5:0/1865207408 conn(0x7fc6e8068700 msgr2=0x7fc6e8068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:14.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 1 -- 172.21.15.5:0/1865207408 shutdown_connections 2024-08-18T21:06:14.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 1 -- 172.21.15.5:0/1865207408 wait complete. 2024-08-18T21:06:14.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 10 monclient: build_initial_monmap 2024-08-18T21:06:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 10 monclient: monmap: 2024-08-18T21:06:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:14.660 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 1 Processor -- start 2024-08-18T21:06:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 1 -- start start 2024-08-18T21:06:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 10 monclient: init 2024-08-18T21:06:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 10 monclient: _add_conns ranks=[3,6,8,4,5,7,2,0,1] 2024-08-18T21:06:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6e809f080 0x7fc6e81d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 10 monclient(hunting): picked mon.noname-g con 0x7fc6e809f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:06:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc6e80a6bd0 0x7fc6e81369f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 10 monclient(hunting): picked mon.noname-d con 0x7fc6e80a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e8139990 0x7fc6e813be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 10 monclient(hunting): picked mon.noname-e con 0x7fc6e8139990 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e80a89f0 con 0x7fc6e809f080 2024-08-18T21:06:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fc6e80a7ce0 con 0x7fc6e80a6bd0 2024-08-18T21:06:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fc6e8143610 con 0x7fc6e8139990 2024-08-18T21:06:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eeca5640 10 monclient(hunting): authenticate will time out at 1141.661575s 2024-08-18T21:06:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6ed242640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e8139990 0x7fc6e813be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc6e80a6bd0 0x7fc6e81369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6ed242640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e8139990 0x7fc6e813be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:43124/0 (socket says 172.21.15.5:43124) 2024-08-18T21:06:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6ed242640 1 -- 172.21.15.5:0/1078319104 learned_addr learned my addr 172.21.15.5:0/1078319104 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 10 monclient(hunting): get_auth_request con 0x7fc6e80a6bd0 auth_method 0 2024-08-18T21:06:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6ed242640 10 monclient(hunting): get_auth_request con 0x7fc6e8139990 auth_method 0 2024-08-18T21:06:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6ed242640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6ed242640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6ed242640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6ed242640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6ed242640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6ed242640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 10 monclient(hunting): handle_auth_done global_id 54231 payload 824 2024-08-18T21:06:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eca41640 1 --2- 172.21.15.5:0/1078319104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6e809f080 0x7fc6e81d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 1 -- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e8139990 msgr2=0x7fc6e813be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 1 --2- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e8139990 0x7fc6e813be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 1 -- 172.21.15.5:0/1078319104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6e809f080 msgr2=0x7fc6e81d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 1 --2- 172.21.15.5:0/1078319104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6e809f080 0x7fc6e81d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:06:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 1 monclient: found mon.noname-d 2024-08-18T21:06:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:06:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6e7fff640 1 -- 172.21.15.5:0/1078319104 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e80ab150 con 0x7fc6e80a6bd0 2024-08-18T21:06:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eca41640 10 monclient: get_auth_request con 0x7fc6e809f080 auth_method 0 2024-08-18T21:06:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.646+0000 7fc6eca41640 1 --2- 172.21.15.5:0/1078319104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6e809f080 0x7fc6e81d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:06:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e7fff640 1 -- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc6e80a6bd0 msgr2=0x7fc6e81369f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e7fff640 1 --2- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc6e80a6bd0 0x7fc6e81369f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80ad000 tx=0x7fc6d80191a0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e57fa640 1 -- 172.21.15.5:0/1078319104 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc6d80b0070 con 0x7fc6e80a6bd0 2024-08-18T21:06:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e57fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:06:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e57fa640 10 monclient: dump: 2024-08-18T21:06:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.665 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e57fa640 10 monclient: _finish_auth 0 2024-08-18T21:06:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e57fa640 10 monclient: _check_auth_tickets 2024-08-18T21:06:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e57fa640 1 -- 172.21.15.5:0/1078319104 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d80b1040 con 0x7fc6e80a6bd0 2024-08-18T21:06:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eeca5640 5 monclient: authenticate success, global_id 54231 2024-08-18T21:06:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eeca5640 10 monclient: _renew_subs 2024-08-18T21:06:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eeca5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eeca5640 1 -- 172.21.15.5:0/1078319104 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e813fe10 con 0x7fc6e80a6bd0 2024-08-18T21:06:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e57fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e57fa640 1 -- 172.21.15.5:0/1078319104 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc6d80044b0 con 0x7fc6e80a6bd0 2024-08-18T21:06:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e57fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e57fa640 10 monclient: dump: 2024-08-18T21:06:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.668 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eeca5640 10 monclient: _renew_subs 2024-08-18T21:06:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e6ffd640 4 set_mon_vals no callback set 2024-08-18T21:06:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eeca5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eeca5640 1 -- 172.21.15.5:0/1078319104 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e813dcb0 con 0x7fc6e80a6bd0 2024-08-18T21:06:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eeca5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eeca5640 1 --2- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e8136f30 0x7fc6e813c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eeca5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eeca5640 1 -- 172.21.15.5:0/1078319104 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fc6e8051140 con 0x7fc6e8136f30 2024-08-18T21:06:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eca41640 1 --2- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e8136f30 0x7fc6e813c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eca41640 10 monclient: get_auth_request con 0x7fc6e8136f30 auth_method 0 2024-08-18T21:06:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eca41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eca41640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eca41640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eca41640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eca41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eca41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e57fa640 1 -- 172.21.15.5:0/1078319104 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fc6d8004040 con 0x7fc6e80a6bd0 2024-08-18T21:06:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eca41640 10 monclient(hunting): handle_auth_done global_id 54242 payload 824 2024-08-18T21:06:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6eca41640 1 -- 172.21.15.5:0/1078319104 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6e8139e10 con 0x7fc6e8136f30 2024-08-18T21:06:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e57fa640 1 --2- 172.21.15.5:0/1078319104 >> v2:172.21.15.157:6812/631023601 conn(0x7fc6d403bdf0 0x7fc6d403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6e57fa640 1 -- 172.21.15.5:0/1078319104 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(81..81 src has 22..81) ==== 3506+0+0 (secure 0 0 0) 0x7fc6d80e7a80 con 0x7fc6e80a6bd0 2024-08-18T21:06:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6ed242640 1 --2- 172.21.15.5:0/1078319104 >> v2:172.21.15.157:6812/631023601 conn(0x7fc6d403bdf0 0x7fc6d403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.650+0000 7fc6ed242640 10 monclient: get_auth_request con 0x7fc6d403bdf0 auth_method 0 2024-08-18T21:06:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.654+0000 7fc6eca41640 1 -- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e8136f30 msgr2=0x7fc6e813c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.654+0000 7fc6eca41640 1 --2- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e8136f30 0x7fc6e813c360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc010790 tx=0x7fc6dc010c50 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.654+0000 7fc6e57fa640 1 -- 172.21.15.5:0/1078319104 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc6dc00f040 con 0x7fc6e8136f30 2024-08-18T21:06:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.654+0000 7fc6e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.654+0000 7fc6e57fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.654+0000 7fc6e57fa640 10 monclient: dump: 2024-08-18T21:06:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.673 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.654+0000 7fc6e57fa640 1 -- 172.21.15.5:0/1078319104 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc6dc01c400 con 0x7fc6e8136f30 2024-08-18T21:06:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.654+0000 7fc6e57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.654+0000 7fc6e57fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.654+0000 7fc6e57fa640 1 -- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e8136f30 msgr2=0x7fc6e813c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.654+0000 7fc6e57fa640 1 --2- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e8136f30 0x7fc6e813c360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc010790 tx=0x7fc6dc010c50 comp rx=0 tx=0).stop 2024-08-18T21:06:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.654+0000 7fc6e57fa640 1 -- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e8136f30 msgr2=0x7fc6e813c360 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.654+0000 7fc6e57fa640 1 --2- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e8136f30 0x7fc6e813c360 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc010790 tx=0x7fc6dc010c50 comp rx=0 tx=0).stop 2024-08-18T21:06:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.654+0000 7fc6ed242640 1 --2- 172.21.15.5:0/1078319104 >> v2:172.21.15.157:6812/631023601 conn(0x7fc6d403bdf0 0x7fc6d403e2b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc6e809f810 tx=0x7fc6e0009830 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.658+0000 7fc6eeca5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.658+0000 7fc6eeca5640 1 --2- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e813c8a0 0x7fc6e80a44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.658+0000 7fc6eeca5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.658+0000 7fc6eeca5640 1 -- 172.21.15.5:0/1078319104 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fc6e813cc80 con 0x7fc6e813c8a0 2024-08-18T21:06:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.658+0000 7fc6eca41640 1 --2- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e813c8a0 0x7fc6e80a44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.658+0000 7fc6eca41640 10 monclient: get_auth_request con 0x7fc6e813c8a0 auth_method 0 2024-08-18T21:06:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.658+0000 7fc6eca41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.658+0000 7fc6eca41640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.658+0000 7fc6eca41640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.658+0000 7fc6eca41640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.658+0000 7fc6eca41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.658+0000 7fc6eca41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.658+0000 7fc6eca41640 10 monclient(hunting): handle_auth_done global_id 54251 payload 824 2024-08-18T21:06:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.658+0000 7fc6eca41640 1 -- 172.21.15.5:0/1078319104 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc6e813e240 con 0x7fc6e813c8a0 2024-08-18T21:06:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6eca41640 1 -- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e813c8a0 msgr2=0x7fc6e80a44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6eca41640 1 --2- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e813c8a0 0x7fc6e80a44e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc010790 tx=0x7fc6dc0046d0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6e57fa640 1 -- 172.21.15.5:0/1078319104 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc6dc005c30 con 0x7fc6e813c8a0 2024-08-18T21:06:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6e57fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6e57fa640 10 monclient: dump: 2024-08-18T21:06:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.677 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6e57fa640 1 -- 172.21.15.5:0/1078319104 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9246 (secure 0 0 0) 0x7fc6dc029400 con 0x7fc6e813c8a0 2024-08-18T21:06:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6e57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6e57fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6e57fa640 1 -- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e813c8a0 msgr2=0x7fc6e80a44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6e57fa640 1 --2- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e813c8a0 0x7fc6e80a44e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc010790 tx=0x7fc6dc0046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6e57fa640 1 -- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e813c8a0 msgr2=0x7fc6e80a44e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6e57fa640 1 --2- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc6e813c8a0 0x7fc6e80a44e0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc010790 tx=0x7fc6dc0046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.678 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:14.678 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:14.678 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:14.678 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:14.678 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:14.678 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 30783, 2024-08-18T21:06:14.678 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:14.678 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:14.678 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:14.678 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:14.679 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:14.679 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:14.679 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:14.679 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:14.679 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:14.679 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:14.679 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.679 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:06:14.679 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:14.679 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:14.679 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:14.679 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:14.679 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:14.679 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:14.680 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:14.680 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:14.680 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:14.680 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:14.681 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:14.681 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:14.682 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:14.682 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:14.682 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.682 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:14.682 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:14.682 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:14.682 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:14.682 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:14.682 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:14.682 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:14.682 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:14.682 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:14.683 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:14.683 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:14.683 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:14.683 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:14.683 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.683 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:14.683 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:14.683 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:14.683 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:14.683 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:14.683 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:14.683 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:14.684 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:14.684 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:14.684 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:14.684 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:14.684 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:14.684 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:14.684 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:14.684 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:14.684 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:14.684 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:14.684 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:14.684 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:14.684 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:14.685 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:14.685 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:14.685 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:14.685 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:14.685 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:14.685 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:14.685 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:14.685 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:14.685 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.685 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:14.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.685 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:14.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.685 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.687 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:14.687 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:14.687 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.687 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.687 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.687 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:14.687 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:14.688 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.688 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:14.688 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.688 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:14.688 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.688 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.688 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:14.689 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:14.689 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.689 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.689 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.689 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:14.689 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:14.689 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.690 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:14.690 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.690 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:14.690 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.690 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.690 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:14.691 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:14.691 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.691 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.691 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.691 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:14.691 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:14.691 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:14.692 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:14.692 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.692 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.692 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:14.692 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:14.693 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.693 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.693 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.693 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:14.693 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:14.693 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.693 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:14.693 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:14.694 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.694 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.694 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:14.694 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:14.694 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.694 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.694 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.695 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:14.695 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:14.695 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:14.695 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:14.695 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.696 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.696 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.696 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:14.696 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:14.696 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.696 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.696 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.696 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:14.696 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:14.696 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.697 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:14.697 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.697 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:14.697 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.697 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.697 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:14.698 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:14.698 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.698 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.698 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.698 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:14.698 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:14.698 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.699 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:14.699 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.699 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:14.699 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.699 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.699 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.700 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:14.700 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:14.700 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.700 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.700 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.700 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:14.700 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:14.700 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.700 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.700 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.701 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:14.701 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.701 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.701 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:14.701 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.701 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.701 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.701 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:14.701 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:14.701 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.701 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.702 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.702 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.702 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.702 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:14.702 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:14.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.702 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:14.702 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:14.702 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:14.703 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.703 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.703 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:14.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.703 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:14.703 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:14.703 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:14.703 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.703 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.703 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:14.703 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6eeca5640 1 -- 172.21.15.5:0/1078319104 >> v2:172.21.15.157:6812/631023601 conn(0x7fc6d403bdf0 msgr2=0x7fc6d403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6eeca5640 1 --2- 172.21.15.5:0/1078319104 >> v2:172.21.15.157:6812/631023601 conn(0x7fc6d403bdf0 0x7fc6d403e2b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc6e809f810 tx=0x7fc6e0009830 comp rx=0 tx=0).stop 2024-08-18T21:06:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6eeca5640 10 monclient: shutdown 2024-08-18T21:06:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6eeca5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6eeca5640 1 -- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc6e80a6bd0 msgr2=0x7fc6e81369f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6eeca5640 1 --2- 172.21.15.5:0/1078319104 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc6e80a6bd0 0x7fc6e81369f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80ad000 tx=0x7fc6d80191a0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6ed242640 1 -- 172.21.15.5:0/1078319104 reap_dead start 2024-08-18T21:06:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6ed242640 1 -- 172.21.15.5:0/1078319104 reap_dead start 2024-08-18T21:06:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6eeca5640 1 -- 172.21.15.5:0/1078319104 shutdown_connections 2024-08-18T21:06:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6eeca5640 1 -- 172.21.15.5:0/1078319104 >> 172.21.15.5:0/1078319104 conn(0x7fc6e8068700 msgr2=0x7fc6e80a1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6eeca5640 1 -- 172.21.15.5:0/1078319104 shutdown_connections 2024-08-18T21:06:14.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.662+0000 7fc6eeca5640 1 -- 172.21.15.5:0/1078319104 wait complete. 2024-08-18T21:06:14.706 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:14.706 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:06:14.706 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:06:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 10 monclient: get_monmap_and_config 2024-08-18T21:06:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 10 monclient: build_initial_monmap 2024-08-18T21:06:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 10 monclient: monmap: 2024-08-18T21:06:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:14.832915+0000 2024-08-18T21:06:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:14.832915+0000 2024-08-18T21:06:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:14.833 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:14.833 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:14.833 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:14.833 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:14.833 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:14.833 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:14.833 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:14.833 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 1 Processor -- start 2024-08-18T21:06:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 1 -- start start 2024-08-18T21:06:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 10 monclient: init 2024-08-18T21:06:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 10 monclient: _add_conns ranks=[8,9,1,6,5,3,10,0,4,2,7] 2024-08-18T21:06:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd2040a6bd0 0x7fd2040a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 10 monclient(hunting): picked mon.noname-e con 0x7fd2040a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd20409f080 0x7fd2040a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 10 monclient(hunting): picked mon.noname-a con 0x7fd20409f080 addr v2:172.21.15.5:3300/0 2024-08-18T21:06:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd204139990 addr v1:172.21.15.157:6789/0 2024-08-18T21:06:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2040a7fb0 con 0x7fd204139990 2024-08-18T21:06:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd20409e4c0 con 0x7fd20409f080 2024-08-18T21:06:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fd20406f930 con 0x7fd2040a6bd0 2024-08-18T21:06:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20b97f640 10 monclient(hunting): authenticate will time out at 1141.846120s 2024-08-18T21:06:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd20409f080 0x7fd2040a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd20409f080 0x7fd2040a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39596/0 (socket says 172.21.15.5:39596) 2024-08-18T21:06:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 1 -- 172.21.15.5:0/1261609750 learned_addr learned my addr 172.21.15.5:0/1261609750 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 10 monclient(hunting): get_auth_request con 0x7fd20409f080 auth_method 0 2024-08-18T21:06:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20971b640 1 --2- 172.21.15.5:0/1261609750 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd2040a6bd0 0x7fd2040a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20971b640 10 monclient(hunting): get_auth_request con 0x7fd2040a6bd0 auth_method 0 2024-08-18T21:06:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20971b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20971b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20971b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20971b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20971b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd20971b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 10 monclient(hunting): handle_auth_done global_id 5229 payload 274 2024-08-18T21:06:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 1 -- 172.21.15.5:0/1261609750 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd2040a6bd0 msgr2=0x7fd2040a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:14.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 1 --2- 172.21.15.5:0/1261609750 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd2040a6bd0 0x7fd2040a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 1 -- 172.21.15.5:0/1261609750 >> v1:172.21.15.157:6789/0 conn(0x7fd204139990 legacy=0x7fd204139e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:14.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 10 monclient: _finish_hunting 0 2024-08-18T21:06:14.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 1 monclient: found mon.noname-a 2024-08-18T21:06:14.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:14.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:06:14.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.830+0000 7fd208f1a640 1 -- 172.21.15.5:0/1261609750 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20409de70 con 0x7fd20409f080 2024-08-18T21:06:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd208f1a640 1 -- 172.21.15.5:0/1261609750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd20409f080 msgr2=0x7fd2040a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd208f1a640 1 --2- 172.21.15.5:0/1261609750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd20409f080 0x7fd2040a74f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009870 tx=0x7fd1f801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805f31c8d2004cad server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd203fff640 1 -- 172.21.15.5:0/1261609750 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd1f80b0070 con 0x7fd20409f080 2024-08-18T21:06:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd203fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd203fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:06:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd203fff640 10 monclient: dump: 2024-08-18T21:06:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.844 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd203fff640 10 monclient: _finish_auth 0 2024-08-18T21:06:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd203fff640 10 monclient: _check_auth_tickets 2024-08-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd203fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd203fff640 1 -- 172.21.15.5:0/1261609750 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f80aa810 con 0x7fd20409f080 2024-08-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd20b97f640 5 monclient: authenticate success, global_id 5229 2024-08-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd20b97f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd203fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd203fff640 1 -- 172.21.15.5:0/1261609750 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd1f80aae30 con 0x7fd20409f080 2024-08-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd203fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd203fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd203fff640 10 monclient: dump: 2024-08-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd20b97f640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd20b97f640 4 set_mon_vals no callback set 2024-08-18T21:06:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd20b97f640 10 monclient: shutdown 2024-08-18T21:06:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd20b97f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd20b97f640 1 -- 172.21.15.5:0/1261609750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd20409f080 msgr2=0x7fd2040a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.834+0000 7fd20b97f640 1 --2- 172.21.15.5:0/1261609750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd20409f080 0x7fd2040a74f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009870 tx=0x7fd1f801c420 comp rx=0 tx=0).stop 2024-08-18T21:06:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 1 -- 172.21.15.5:0/1261609750 shutdown_connections 2024-08-18T21:06:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 1 --2- 172.21.15.5:0/1261609750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd20409f080 0x7fd2040a74f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 1 --2- 172.21.15.5:0/1261609750 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd2040a6bd0 0x7fd2040a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 1 -- 172.21.15.5:0/1261609750 >> 172.21.15.5:0/1261609750 conn(0x7fd204068700 msgr2=0x7fd204068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 1 -- 172.21.15.5:0/1261609750 shutdown_connections 2024-08-18T21:06:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 1 -- 172.21.15.5:0/1261609750 wait complete. 2024-08-18T21:06:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 10 monclient: build_initial_monmap 2024-08-18T21:06:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 10 monclient: monmap: 2024-08-18T21:06:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 1 Processor -- start 2024-08-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 1 -- start start 2024-08-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 10 monclient: init 2024-08-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 10 monclient: _add_conns ranks=[1,7,5,8,3,2,4,0,6] 2024-08-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2040a6bd0 0x7fd2041d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 10 monclient(hunting): picked mon.noname-f con 0x7fd2040a6bd0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd204139990 0x7fd204138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 10 monclient(hunting): picked mon.noname-i con 0x7fd204139990 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd204138fe0 0x7fd20413dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 10 monclient(hunting): picked mon.noname-h con 0x7fd204138fe0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd2041447a0 con 0x7fd2040a6bd0 2024-08-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fd204144620 con 0x7fd204138fe0 2024-08-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fd204144920 con 0x7fd204139990 2024-08-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20b97f640 10 monclient(hunting): authenticate will time out at 1141.853607s 2024-08-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd204139990 0x7fd204138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd209f1c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd204138fe0 0x7fd20413dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd204139990 0x7fd204138aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:50682/0 (socket says 172.21.15.5:50682) 2024-08-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 1 -- 172.21.15.5:0/2313037683 learned_addr learned my addr 172.21.15.5:0/2313037683 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 10 monclient(hunting): get_auth_request con 0x7fd204139990 auth_method 0 2024-08-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd209f1c640 10 monclient(hunting): get_auth_request con 0x7fd204138fe0 auth_method 0 2024-08-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd209f1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd209f1c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd209f1c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20971b640 1 --2- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2040a6bd0 0x7fd2041d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20971b640 10 monclient(hunting): get_auth_request con 0x7fd2040a6bd0 auth_method 0 2024-08-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20971b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20971b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20971b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd209f1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd209f1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd209f1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20971b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20971b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd20971b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 10 monclient(hunting): handle_auth_done global_id 4975 payload 824 2024-08-18T21:06:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 1 -- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd204138fe0 msgr2=0x7fd20413dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 1 --2- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd204138fe0 0x7fd20413dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 1 -- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2040a6bd0 msgr2=0x7fd2041d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 1 --2- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2040a6bd0 0x7fd2041d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 10 monclient: _finish_hunting 0 2024-08-18T21:06:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 1 monclient: found mon.noname-i 2024-08-18T21:06:14.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:14.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:06:14.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.838+0000 7fd208f1a640 1 -- 172.21.15.5:0/2313037683 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2040aafe0 con 0x7fd204139990 2024-08-18T21:06:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd208f1a640 1 -- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd204139990 msgr2=0x7fd204138aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd208f1a640 1 --2- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd204139990 0x7fd204138aa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80097c0 tx=0x7fd1f80191c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd201ffb640 1 -- 172.21.15.5:0/2313037683 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd1f80ba070 con 0x7fd204139990 2024-08-18T21:06:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd201ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd201ffb640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:06:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd201ffb640 10 monclient: dump: 2024-08-18T21:06:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.858 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd201ffb640 10 monclient: _finish_auth 0 2024-08-18T21:06:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd201ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:06:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd201ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd201ffb640 1 -- 172.21.15.5:0/2313037683 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f80b1040 con 0x7fd204139990 2024-08-18T21:06:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20b97f640 5 monclient: authenticate success, global_id 4975 2024-08-18T21:06:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20b97f640 10 monclient: _renew_subs 2024-08-18T21:06:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20b97f640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:06:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20b97f640 1 -- 172.21.15.5:0/2313037683 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20413f670 con 0x7fd204139990 2024-08-18T21:06:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd201ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd201ffb640 1 -- 172.21.15.5:0/2313037683 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd1f80b0070 con 0x7fd204139990 2024-08-18T21:06:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd201ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd201ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:06:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd201ffb640 10 monclient: dump: 2024-08-18T21:06:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.861 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20b97f640 10 monclient: _renew_subs 2024-08-18T21:06:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20b97f640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:06:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20b97f640 1 -- 172.21.15.5:0/2313037683 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fd204123430 con 0x7fd204139990 2024-08-18T21:06:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd202ffd640 4 set_mon_vals no callback set 2024-08-18T21:06:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20b97f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20b97f640 1 --2- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd20413e190 0x7fd20413e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20b97f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20b97f640 1 -- 172.21.15.5:0/2313037683 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd204051140 con 0x7fd20413e190 2024-08-18T21:06:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20971b640 1 --2- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd20413e190 0x7fd20413e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20971b640 10 monclient: get_auth_request con 0x7fd20413e190 auth_method 0 2024-08-18T21:06:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20971b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20971b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20971b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20971b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20971b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20971b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20971b640 10 monclient(hunting): handle_auth_done global_id 5041 payload 824 2024-08-18T21:06:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd20971b640 1 -- 172.21.15.5:0/2313037683 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2041d28e0 con 0x7fd20413e190 2024-08-18T21:06:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd201ffb640 1 -- 172.21.15.5:0/2313037683 <== mon.7 v2:172.21.15.157:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fd1f8004040 con 0x7fd204139990 2024-08-18T21:06:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd201ffb640 1 --2- 172.21.15.5:0/2313037683 >> v2:172.21.15.157:6812/631023601 conn(0x7fd1f003bdb0 0x7fd1f003e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.842+0000 7fd201ffb640 1 -- 172.21.15.5:0/2313037683 <== mon.7 v2:172.21.15.157:3303/0 5 ==== osd_map(81..81 src has 22..81) ==== 3506+0+0 (secure 0 0 0) 0x7fd1f80e7770 con 0x7fd204139990 2024-08-18T21:06:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.846+0000 7fd209f1c640 1 --2- 172.21.15.5:0/2313037683 >> v2:172.21.15.157:6812/631023601 conn(0x7fd1f003bdb0 0x7fd1f003e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.846+0000 7fd209f1c640 10 monclient: get_auth_request con 0x7fd1f003bdb0 auth_method 0 2024-08-18T21:06:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.846+0000 7fd20971b640 1 -- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd20413e190 msgr2=0x7fd20413e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.846+0000 7fd20971b640 1 --2- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd20413e190 0x7fd20413e570 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00f410 tx=0x7fd1fc00f8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.846+0000 7fd201ffb640 1 -- 172.21.15.5:0/2313037683 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd1fc019070 con 0x7fd20413e190 2024-08-18T21:06:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.846+0000 7fd201ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.846+0000 7fd201ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:06:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.846+0000 7fd201ffb640 10 monclient: dump: 2024-08-18T21:06:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.864 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.846+0000 7fd201ffb640 1 -- 172.21.15.5:0/2313037683 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd1fc003dc0 con 0x7fd20413e190 2024-08-18T21:06:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.846+0000 7fd201ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.846+0000 7fd201ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.846+0000 7fd201ffb640 1 -- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd20413e190 msgr2=0x7fd20413e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.846+0000 7fd201ffb640 1 --2- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd20413e190 0x7fd20413e570 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00f410 tx=0x7fd1fc00f8d0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.846+0000 7fd209f1c640 1 --2- 172.21.15.5:0/2313037683 >> v2:172.21.15.157:6812/631023601 conn(0x7fd1f003bdb0 0x7fd1f003e270 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd2041393e0 tx=0x7fd1f4006f60 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.846+0000 7fd201ffb640 1 -- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd20413e190 msgr2=0x7fd20413e570 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.846+0000 7fd201ffb640 1 --2- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd20413e190 0x7fd20413e570 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.854+0000 7fd20b97f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.854+0000 7fd20b97f640 1 --2- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2040a4370 0x7fd2040a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.854+0000 7fd20b97f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.854+0000 7fd20b97f640 1 -- 172.21.15.5:0/2313037683 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd2040ab350 con 0x7fd2040a4370 2024-08-18T21:06:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.854+0000 7fd20971b640 1 --2- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2040a4370 0x7fd2040a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.854+0000 7fd20971b640 10 monclient: get_auth_request con 0x7fd2040a4370 auth_method 0 2024-08-18T21:06:14.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.854+0000 7fd20971b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:14.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.854+0000 7fd20971b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:14.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.854+0000 7fd20971b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:14.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.854+0000 7fd20971b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:14.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.854+0000 7fd20971b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:14.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.854+0000 7fd20971b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:14.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.854+0000 7fd20971b640 10 monclient(hunting): handle_auth_done global_id 5050 payload 824 2024-08-18T21:06:14.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.854+0000 7fd20971b640 1 -- 172.21.15.5:0/2313037683 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd20413eab0 con 0x7fd2040a4370 2024-08-18T21:06:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd20971b640 1 -- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2040a4370 msgr2=0x7fd2040a4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd20971b640 1 --2- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2040a4370 0x7fd2040a4780 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00b010 tx=0x7fd1fc004a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd201ffb640 1 -- 172.21.15.5:0/2313037683 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd1fc02c020 con 0x7fd2040a4370 2024-08-18T21:06:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd201ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd201ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:06:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd201ffb640 10 monclient: dump: 2024-08-18T21:06:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:14.869 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd201ffb640 1 -- 172.21.15.5:0/2313037683 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7fd1fc015430 con 0x7fd2040a4370 2024-08-18T21:06:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd201ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd201ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd201ffb640 1 -- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2040a4370 msgr2=0x7fd2040a4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd201ffb640 1 --2- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2040a4370 0x7fd2040a4780 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00b010 tx=0x7fd1fc004a50 comp rx=0 tx=0).stop 2024-08-18T21:06:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd201ffb640 1 -- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2040a4370 msgr2=0x7fd2040a4780 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd201ffb640 1 --2- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2040a4370 0x7fd2040a4780 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00b010 tx=0x7fd1fc004a50 comp rx=0 tx=0).stop 2024-08-18T21:06:14.869 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:14.870 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:14.870 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:14.870 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:14.870 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:14.870 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 183938, 2024-08-18T21:06:14.870 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:14.870 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:14.870 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:14.870 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:14.870 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:14.870 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:14.870 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:14.870 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:14.871 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:14.871 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:14.871 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.871 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:06:14.871 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:14.871 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:14.871 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:14.871 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:14.871 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:14.871 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:14.871 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:14.871 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:14.871 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:14.872 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:14.872 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:14.872 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:14.872 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:14.872 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:14.872 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.872 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:14.872 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:14.872 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:14.872 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:14.872 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:14.872 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:14.872 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:14.872 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:14.873 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:14.873 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:14.873 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:14.873 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:14.873 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:14.873 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.873 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:14.873 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:14.873 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:14.873 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:14.873 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:14.873 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:14.873 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:14.874 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:14.874 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:14.874 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:14.874 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:14.874 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:14.874 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:14.874 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:14.874 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:14.874 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:14.874 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:14.874 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:14.874 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:14.874 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:14.875 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:14.875 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:14.875 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:14.875 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:14.875 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:14.875 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:14.875 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:14.875 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:14.875 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.875 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:14.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.875 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:14.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.876 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:14.876 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:14.876 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.876 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.876 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.876 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:14.876 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.876 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:14.877 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.877 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.877 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:14.877 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:14.877 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.877 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.877 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.877 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:14.878 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:14.878 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:14.878 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:14.878 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.878 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.879 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.879 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:14.879 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:14.879 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.879 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.879 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.879 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:14.879 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:14.880 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:14.880 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:14.880 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.880 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.881 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.881 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:14.881 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:14.881 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.881 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.881 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.881 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:14.881 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:14.881 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.881 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.882 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:14.882 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.882 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:14.882 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.882 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.882 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.883 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:14.883 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:14.883 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.883 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.883 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.883 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:14.883 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:14.883 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.883 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.885 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.885 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:14.885 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.886 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.886 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:14.886 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.886 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.886 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.886 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:14.886 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:14.886 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.886 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.886 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.888 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.888 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.888 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:14.888 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:14.888 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.888 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.888 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.889 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:14.889 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:14.889 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.889 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.889 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.889 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:14.889 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.889 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.889 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:14.889 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.889 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.890 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.890 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:14.890 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:14.890 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.890 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.890 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.890 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.890 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:14.890 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:14.890 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.890 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.891 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.891 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:14.891 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.891 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.891 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:14.891 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.891 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.891 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.891 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:14.892 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:14.892 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.892 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.892 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.892 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:14.892 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:14.892 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:14.892 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:14.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.892 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:14.892 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:14.892 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.893 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:14.893 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:14.893 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:14.893 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.893 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.893 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:14.893 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:14.893 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:14.893 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:14.893 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:14.894 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.894 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.894 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:14.894 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:14.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.894 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:14.894 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:14.894 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:14.894 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.894 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:14.894 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:14.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:14.895 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:14.895 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:14.895 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:14.895 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:14.895 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:14.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:14.895 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:14.895 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd20b97f640 1 -- 172.21.15.5:0/2313037683 >> v2:172.21.15.157:6812/631023601 conn(0x7fd1f003bdb0 msgr2=0x7fd1f003e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd20b97f640 1 --2- 172.21.15.5:0/2313037683 >> v2:172.21.15.157:6812/631023601 conn(0x7fd1f003bdb0 0x7fd1f003e270 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd2041393e0 tx=0x7fd1f4006f60 comp rx=0 tx=0).stop 2024-08-18T21:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd20b97f640 10 monclient: shutdown 2024-08-18T21:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd20b97f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd20b97f640 1 -- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd204139990 msgr2=0x7fd204138aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd20b97f640 1 --2- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd204139990 0x7fd204138aa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80097c0 tx=0x7fd1f80191c0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd209f1c640 1 -- 172.21.15.5:0/2313037683 reap_dead start 2024-08-18T21:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd20b97f640 1 -- 172.21.15.5:0/2313037683 shutdown_connections 2024-08-18T21:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd20b97f640 1 --2- 172.21.15.5:0/2313037683 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd204139990 0x7fd204138aa0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd20b97f640 1 -- 172.21.15.5:0/2313037683 >> 172.21.15.5:0/2313037683 conn(0x7fd204068700 msgr2=0x7fd2040a9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd20b97f640 1 -- 172.21.15.5:0/2313037683 shutdown_connections 2024-08-18T21:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:14.858+0000 7fd20b97f640 1 -- 172.21.15.5:0/2313037683 wait complete. 2024-08-18T21:06:14.898 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:14.898 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:06:14.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:06:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.014+0000 7f84b4e97640 10 monclient: get_monmap_and_config 2024-08-18T21:06:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.014+0000 7f84b4e97640 10 monclient: build_initial_monmap 2024-08-18T21:06:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.014+0000 7f84b4e97640 10 monclient: monmap: 2024-08-18T21:06:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:15.019075+0000 2024-08-18T21:06:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:15.019075+0000 2024-08-18T21:06:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:15.020 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:15.020 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 1 Processor -- start 2024-08-18T21:06:15.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 1 -- start start 2024-08-18T21:06:15.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 10 monclient: init 2024-08-18T21:06:15.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:15.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 10 monclient: _add_conns ranks=[10,7,0,5,3,4,1,9,8,2,6] 2024-08-18T21:06:15.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f84b00a6bd0 0x7f84b00a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 10 monclient(hunting): picked mon.noname-f con 0x7f84b00a6bd0 addr v2:172.21.15.157:3300/0 2024-08-18T21:06:15.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84b009f080 0x7f84b00a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 10 monclient(hunting): picked mon.noname-i con 0x7f84b009f080 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:15.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f84b0139990 addr v1:172.21.15.5:6789/0 2024-08-18T21:06:15.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84b00a7fb0 con 0x7f84b0139990 2024-08-18T21:06:15.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f84b009e4c0 con 0x7f84b00a6bd0 2024-08-18T21:06:15.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f84b006f930 con 0x7f84b009f080 2024-08-18T21:06:15.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:15.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84b4e97640 10 monclient(hunting): authenticate will time out at 1142.032903s 2024-08-18T21:06:15.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84aed9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f84b0139990 0x7f84b0139e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50556/0 (socket says 172.21.15.5:50556) 2024-08-18T21:06:15.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84aed9d640 1 -- 172.21.15.5:0/4234691225 learned_addr learned my addr 172.21.15.5:0/4234691225 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:06:15.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 1 --2- 172.21.15.5:0/4234691225 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84b009f080 0x7f84b00a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84ae59c640 1 --2- 172.21.15.5:0/4234691225 >> v2:172.21.15.157:3300/0 conn(0x7f84b00a6bd0 0x7f84b00a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 10 monclient(hunting): get_auth_request con 0x7f84b009f080 auth_method 0 2024-08-18T21:06:15.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84ae59c640 10 monclient(hunting): get_auth_request con 0x7f84b00a6bd0 auth_method 0 2024-08-18T21:06:15.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84ae59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84ae59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84ae59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84ae59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84ae59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84ae59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 10 monclient(hunting): handle_auth_done global_id 4984 payload 274 2024-08-18T21:06:15.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 1 -- 172.21.15.5:0/4234691225 >> v2:172.21.15.157:3300/0 conn(0x7f84b00a6bd0 msgr2=0x7f84b00a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:15.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 1 --2- 172.21.15.5:0/4234691225 >> v2:172.21.15.157:3300/0 conn(0x7f84b00a6bd0 0x7f84b00a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 1 -- 172.21.15.5:0/4234691225 >> v1:172.21.15.5:6789/0 conn(0x7f84b0139990 legacy=0x7f84b0139e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:15.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 10 monclient: _finish_hunting 0 2024-08-18T21:06:15.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 1 monclient: found mon.noname-i 2024-08-18T21:06:15.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:15.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:06:15.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84add9b640 1 -- 172.21.15.5:0/4234691225 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b009de70 con 0x7f84b009f080 2024-08-18T21:06:15.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.018+0000 7f84ae59c640 1 --2- 172.21.15.5:0/4234691225 >> v2:172.21.15.157:3300/0 conn(0x7f84b00a6bd0 0x7f84b00a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:06:15.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84add9b640 1 -- 172.21.15.5:0/4234691225 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84b009f080 msgr2=0x7f84b00a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:15.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84add9b640 1 --2- 172.21.15.5:0/4234691225 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84b009f080 0x7f84b00a74f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f84a00097c0 tx=0x7f84a001c360 comp rx=0 tx=0).ready entity=mon.7 client_cookie=fa4ec29b285da657 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:15.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84ad59a640 1 -- 172.21.15.5:0/4234691225 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f84a00b0070 con 0x7f84b009f080 2024-08-18T21:06:15.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84ad59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84ad59a640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:06:15.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84ad59a640 10 monclient: dump: 2024-08-18T21:06:15.027 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.027 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.027 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.028 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84ad59a640 10 monclient: _finish_auth 0 2024-08-18T21:06:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84ad59a640 10 monclient: _check_auth_tickets 2024-08-18T21:06:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84ad59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84ad59a640 1 -- 172.21.15.5:0/4234691225 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a00aa810 con 0x7f84b009f080 2024-08-18T21:06:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84ad59a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84ad59a640 1 -- 172.21.15.5:0/4234691225 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f84a00a9300 con 0x7f84b009f080 2024-08-18T21:06:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84ad59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84ad59a640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:06:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84ad59a640 10 monclient: dump: 2024-08-18T21:06:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.030 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.030 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.030 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.030 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.030 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.030 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.030 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.030 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.030 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.030 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.030 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.030 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.031 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84b4e97640 5 monclient: authenticate success, global_id 4984 2024-08-18T21:06:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84b4e97640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84b4e97640 4 set_mon_vals no callback set 2024-08-18T21:06:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.022+0000 7f84b4e97640 10 monclient: shutdown 2024-08-18T21:06:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 1 -- 172.21.15.5:0/4234691225 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84b009f080 msgr2=0x7f84b00a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 1 --2- 172.21.15.5:0/4234691225 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84b009f080 0x7f84b00a74f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f84a00097c0 tx=0x7f84a001c360 comp rx=0 tx=0).stop 2024-08-18T21:06:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 1 -- 172.21.15.5:0/4234691225 shutdown_connections 2024-08-18T21:06:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 1 --2- 172.21.15.5:0/4234691225 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84b009f080 0x7f84b00a74f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 1 --2- 172.21.15.5:0/4234691225 >> v2:172.21.15.157:3300/0 conn(0x7f84b00a6bd0 0x7f84b00a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 1 -- 172.21.15.5:0/4234691225 >> 172.21.15.5:0/4234691225 conn(0x7f84b0068700 msgr2=0x7f84b0068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 1 -- 172.21.15.5:0/4234691225 shutdown_connections 2024-08-18T21:06:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 1 -- 172.21.15.5:0/4234691225 wait complete. 2024-08-18T21:06:15.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 10 monclient: build_initial_monmap 2024-08-18T21:06:15.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 10 monclient: monmap: 2024-08-18T21:06:15.037 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:15.037 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:15.037 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:15.037 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:15.037 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:15.038 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 1 Processor -- start 2024-08-18T21:06:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 1 -- start start 2024-08-18T21:06:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 10 monclient: init 2024-08-18T21:06:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 10 monclient: _add_conns ranks=[7,2,1,4,8,0,5,6,3] 2024-08-18T21:06:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84b009f080 0x7f84b01383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 10 monclient(hunting): picked mon.noname-i con 0x7f84b009f080 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84b00a6bd0 0x7f84b0138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 10 monclient(hunting): picked mon.noname-b con 0x7f84b00a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84b0139990 0x7f84b013da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 10 monclient(hunting): picked mon.noname-f con 0x7f84b0139990 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:06:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f84b01447a0 con 0x7f84b0139990 2024-08-18T21:06:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f84b0144620 con 0x7f84b00a6bd0 2024-08-18T21:06:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f84b0144920 con 0x7f84b009f080 2024-08-18T21:06:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84b4e97640 10 monclient(hunting): authenticate will time out at 1142.042092s 2024-08-18T21:06:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84b00a6bd0 0x7f84b0138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84b00a6bd0 0x7f84b0138900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:40856/0 (socket says 172.21.15.5:40856) 2024-08-18T21:06:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 1 -- 172.21.15.5:0/3044621511 learned_addr learned my addr 172.21.15.5:0/3044621511 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 10 monclient(hunting): get_auth_request con 0x7f84b00a6bd0 auth_method 0 2024-08-18T21:06:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84ae59c640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84b009f080 0x7f84b01383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84aed9d640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84b0139990 0x7f84b013da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84aed9d640 10 monclient(hunting): get_auth_request con 0x7f84b0139990 auth_method 0 2024-08-18T21:06:15.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84aed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84aed9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84aed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84ae59c640 10 monclient(hunting): get_auth_request con 0x7f84b009f080 auth_method 0 2024-08-18T21:06:15.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84ae59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84ae59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84ae59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 10 monclient(hunting): handle_auth_done global_id 5213 payload 824 2024-08-18T21:06:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 1 -- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84b009f080 msgr2=0x7f84b01383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84b009f080 0x7f84b01383c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 1 -- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84b0139990 msgr2=0x7f84b013da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84b0139990 0x7f84b013da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 10 monclient: _finish_hunting 0 2024-08-18T21:06:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 1 monclient: found mon.noname-b 2024-08-18T21:06:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:06:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84add9b640 1 -- 172.21.15.5:0/3044621511 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b0140e20 con 0x7f84b00a6bd0 2024-08-18T21:06:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.026+0000 7f84aed9d640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84b0139990 0x7f84b013da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:06:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84add9b640 1 -- 172.21.15.5:0/3044621511 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84b00a6bd0 msgr2=0x7f84b0138900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84add9b640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84b00a6bd0 0x7f84b0138900 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f84a00ae040 tx=0x7f84a0019100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84a6ffd640 1 -- 172.21.15.5:0/3044621511 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f84a00b0040 con 0x7f84b00a6bd0 2024-08-18T21:06:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84a6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:06:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84a6ffd640 10 monclient: dump: 2024-08-18T21:06:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.044 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84a6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:06:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84a6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:06:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84a6ffd640 1 -- 172.21.15.5:0/3044621511 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a00044b0 con 0x7f84b00a6bd0 2024-08-18T21:06:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84a6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84a6ffd640 1 -- 172.21.15.5:0/3044621511 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f84a0003a90 con 0x7f84b00a6bd0 2024-08-18T21:06:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84b4e97640 5 monclient: authenticate success, global_id 5213 2024-08-18T21:06:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84b4e97640 10 monclient: _renew_subs 2024-08-18T21:06:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84b4e97640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:06:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84b4e97640 1 -- 172.21.15.5:0/3044621511 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b01231f0 con 0x7f84b00a6bd0 2024-08-18T21:06:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84acd99640 4 set_mon_vals no callback set 2024-08-18T21:06:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84a6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:06:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84a6ffd640 10 monclient: dump: 2024-08-18T21:06:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.047 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84b4e97640 10 monclient: _renew_subs 2024-08-18T21:06:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84b4e97640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:06:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84b4e97640 1 -- 172.21.15.5:0/3044621511 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b0122c30 con 0x7f84b00a6bd0 2024-08-18T21:06:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84b4e97640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84b4e97640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84b013df50 0x7f84b013e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84b4e97640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84b4e97640 1 -- 172.21.15.5:0/3044621511 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f84b013ffa0 con 0x7f84b013df50 2024-08-18T21:06:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84ae59c640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84b013df50 0x7f84b013e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84ae59c640 10 monclient: get_auth_request con 0x7f84b013df50 auth_method 0 2024-08-18T21:06:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84ae59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84ae59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84ae59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84a6ffd640 1 -- 172.21.15.5:0/3044621511 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f84a0003cf0 con 0x7f84b00a6bd0 2024-08-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84ae59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84ae59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84ae59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84a6ffd640 1 --2- 172.21.15.5:0/3044621511 >> v2:172.21.15.157:6812/631023601 conn(0x7f849003bdc0 0x7f849003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84a6ffd640 1 -- 172.21.15.5:0/3044621511 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(81..81 src has 22..81) ==== 3506+0+0 (secure 0 0 0) 0x7f84a00e8080 con 0x7f84b00a6bd0 2024-08-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84ae59c640 10 monclient(hunting): handle_auth_done global_id 5151 payload 824 2024-08-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84ae59c640 1 -- 172.21.15.5:0/3044621511 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84b0139e40 con 0x7f84b013df50 2024-08-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84aed9d640 1 --2- 172.21.15.5:0/3044621511 >> v2:172.21.15.157:6812/631023601 conn(0x7f849003bdc0 0x7f849003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.030+0000 7f84aed9d640 10 monclient: get_auth_request con 0x7f849003bdc0 auth_method 0 2024-08-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.034+0000 7f84ae59c640 1 -- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84b013df50 msgr2=0x7f84b013e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.034+0000 7f84ae59c640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84b013df50 0x7f84b013e330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8498011600 tx=0x7f8498011ac0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.034+0000 7f84a6ffd640 1 -- 172.21.15.5:0/3044621511 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f849800fea0 con 0x7f84b013df50 2024-08-18T21:06:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.034+0000 7f84a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.034+0000 7f84a6ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:06:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.034+0000 7f84a6ffd640 10 monclient: dump: 2024-08-18T21:06:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.050 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.050 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.050 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.050 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.050 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.050 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.050 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.034+0000 7f84aed9d640 1 --2- 172.21.15.5:0/3044621511 >> v2:172.21.15.157:6812/631023601 conn(0x7f849003bdc0 0x7f849003e280 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f84b0140d70 tx=0x7f84a8009550 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:15.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.034+0000 7f84a6ffd640 1 -- 172.21.15.5:0/3044621511 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f849800fa30 con 0x7f84b013df50 2024-08-18T21:06:15.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.034+0000 7f84a6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:15.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.034+0000 7f84a6ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:15.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.034+0000 7f84a6ffd640 1 -- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84b013df50 msgr2=0x7f84b013e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.034+0000 7f84a6ffd640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84b013df50 0x7f84b013e330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8498011600 tx=0x7f8498011ac0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.034+0000 7f84a6ffd640 1 -- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84b013df50 msgr2=0x7f84b013e330 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:15.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.034+0000 7f84a6ffd640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84b013df50 0x7f84b013e330 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8498011600 tx=0x7f8498011ac0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.042+0000 7f84b4e97640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:15.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.042+0000 7f84b4e97640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84b013e870 0x7f84b00a3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.042+0000 7f84b4e97640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.042+0000 7f84b4e97640 1 -- 172.21.15.5:0/3044621511 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f84b0051140 con 0x7f84b013e870 2024-08-18T21:06:15.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.042+0000 7f84ae59c640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84b013e870 0x7f84b00a3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.042+0000 7f84ae59c640 10 monclient: get_auth_request con 0x7f84b013e870 auth_method 0 2024-08-18T21:06:15.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.042+0000 7f84ae59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.042+0000 7f84ae59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.042+0000 7f84ae59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.042+0000 7f84ae59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.042+0000 7f84ae59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.042+0000 7f84ae59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.042+0000 7f84ae59c640 10 monclient(hunting): handle_auth_done global_id 5160 payload 824 2024-08-18T21:06:15.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.042+0000 7f84ae59c640 1 -- 172.21.15.5:0/3044621511 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f84b013fb20 con 0x7f84b013e870 2024-08-18T21:06:15.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84ae59c640 1 -- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84b013e870 msgr2=0x7f84b00a3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:15.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84ae59c640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84b013e870 0x7f84b00a3f30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8498011600 tx=0x7f84980046d0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:15.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84a6ffd640 1 -- 172.21.15.5:0/3044621511 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f84980064b0 con 0x7f84b013e870 2024-08-18T21:06:15.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84a6ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:06:15.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84a6ffd640 10 monclient: dump: 2024-08-18T21:06:15.054 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.054 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84a6ffd640 1 -- 172.21.15.5:0/3044621511 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f8498005f70 con 0x7f84b013e870 2024-08-18T21:06:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84a6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84a6ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84a6ffd640 1 -- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84b013e870 msgr2=0x7f84b00a3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84a6ffd640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84b013e870 0x7f84b00a3f30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8498011600 tx=0x7f84980046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84a6ffd640 1 -- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84b013e870 msgr2=0x7f84b00a3f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84a6ffd640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84b013e870 0x7f84b00a3f30 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8498011600 tx=0x7f84980046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.056 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:15.056 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:15.056 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 184142, 2024-08-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:15.062 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:15.062 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:15.062 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:15.062 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:15.062 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:15.062 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:15.062 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:15.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.062 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:15.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.062 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:15.062 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:15.062 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:15.065 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.065 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.065 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:15.065 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.065 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.065 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.065 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:15.065 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:15.065 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.066 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.066 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.066 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.066 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:15.066 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:15.066 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.066 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.066 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.066 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.066 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:15.066 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.067 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.067 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:15.067 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.067 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.067 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.067 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:15.067 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:15.067 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.067 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.067 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.068 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:15.068 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:15.068 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.068 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.068 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.068 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:15.068 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.068 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.068 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:15.068 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.069 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.069 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.069 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:15.069 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:15.069 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.069 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.069 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.069 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.069 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:15.069 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:15.070 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.070 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.070 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.070 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:15.070 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.070 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.070 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:15.070 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.070 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.070 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.071 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:15.071 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:15.071 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.071 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.071 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.071 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:15.071 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:15.071 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.071 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.071 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.071 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:15.072 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.072 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.072 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:15.072 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.072 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.072 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.072 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:15.072 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:15.072 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.072 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.072 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.073 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:15.073 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:15.073 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.073 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.073 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:15.073 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.074 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:15.074 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.074 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.074 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.074 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:15.074 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:15.074 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.074 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.074 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.075 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:15.075 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:15.075 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.075 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.075 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.075 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:15.075 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.075 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.075 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:15.075 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.075 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.076 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.076 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:15.076 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:15.076 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.076 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.076 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.076 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:15.076 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:15.076 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.076 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.077 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.077 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:15.077 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.077 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.077 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:15.077 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.077 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.077 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.077 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:15.078 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:15.078 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.078 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.078 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.078 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.078 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.078 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:15.078 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:15.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.078 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:15.078 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:15.079 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:15.079 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.079 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:15.079 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:15.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.079 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:15.079 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:15.079 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:06:15.079 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.079 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.079 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:15.079 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84b4e97640 1 -- 172.21.15.5:0/3044621511 >> v2:172.21.15.157:6812/631023601 conn(0x7f849003bdc0 msgr2=0x7f849003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84b4e97640 1 --2- 172.21.15.5:0/3044621511 >> v2:172.21.15.157:6812/631023601 conn(0x7f849003bdc0 0x7f849003e280 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f84b0140d70 tx=0x7f84a8009550 comp rx=0 tx=0).stop 2024-08-18T21:06:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84b4e97640 10 monclient: shutdown 2024-08-18T21:06:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84b4e97640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84b4e97640 1 -- 172.21.15.5:0/3044621511 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84b00a6bd0 msgr2=0x7f84b0138900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84b4e97640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84b00a6bd0 0x7f84b0138900 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f84a00ae040 tx=0x7f84a0019100 comp rx=0 tx=0).stop 2024-08-18T21:06:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84aed9d640 1 -- 172.21.15.5:0/3044621511 reap_dead start 2024-08-18T21:06:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84b4e97640 1 -- 172.21.15.5:0/3044621511 shutdown_connections 2024-08-18T21:06:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84b4e97640 1 --2- 172.21.15.5:0/3044621511 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84b00a6bd0 0x7f84b0138900 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84b4e97640 1 -- 172.21.15.5:0/3044621511 >> 172.21.15.5:0/3044621511 conn(0x7f84b0068700 msgr2=0x7f84b01416b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:15.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84b4e97640 1 -- 172.21.15.5:0/3044621511 shutdown_connections 2024-08-18T21:06:15.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.046+0000 7f84b4e97640 1 -- 172.21.15.5:0/3044621511 wait complete. 2024-08-18T21:06:15.082 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:15.082 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:06:15.082 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:06:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.214+0000 7f7aca02c640 10 monclient: get_monmap_and_config 2024-08-18T21:06:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.214+0000 7f7aca02c640 10 monclient: build_initial_monmap 2024-08-18T21:06:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.214+0000 7f7aca02c640 10 monclient: monmap: 2024-08-18T21:06:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:15.219804+0000 2024-08-18T21:06:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:15.219804+0000 2024-08-18T21:06:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:15.221 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:15.221 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:15.221 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:15.221 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 1 Processor -- start 2024-08-18T21:06:15.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 1 -- start start 2024-08-18T21:06:15.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 10 monclient: init 2024-08-18T21:06:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 10 monclient: _add_conns ranks=[5,7,10,2,8,0,6,9,4,3,1] 2024-08-18T21:06:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac409b5d0 0x7f7ac409dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 10 monclient(hunting): picked mon.noname-h con 0x7f7ac409b5d0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7ac409b9b0 0x7f7ac40a4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 10 monclient(hunting): picked mon.noname-i con 0x7f7ac409b9b0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7ac409bdb0 0x7f7ac40a4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 10 monclient(hunting): picked mon.noname-f con 0x7f7ac409bdb0 addr v2:172.21.15.157:3300/0 2024-08-18T21:06:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7ac409c800 con 0x7f7ac409bdb0 2024-08-18T21:06:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f7ac409cae0 con 0x7f7ac409b5d0 2024-08-18T21:06:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7ac409cdc0 con 0x7f7ac409b9b0 2024-08-18T21:06:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7aca02c640 10 monclient(hunting): authenticate will time out at 1142.232871s 2024-08-18T21:06:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac37fe640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac409b5d0 0x7f7ac409dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac3fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7ac409bdb0 0x7f7ac40a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac37fe640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac409b5d0 0x7f7ac409dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:43996/0 (socket says 172.21.15.5:43996) 2024-08-18T21:06:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7ac409b9b0 0x7f7ac40a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac37fe640 1 -- 172.21.15.5:0/1488702629 learned_addr learned my addr 172.21.15.5:0/1488702629 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac37fe640 10 monclient(hunting): get_auth_request con 0x7f7ac409b5d0 auth_method 0 2024-08-18T21:06:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac3fff640 10 monclient(hunting): get_auth_request con 0x7f7ac409bdb0 auth_method 0 2024-08-18T21:06:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 10 monclient(hunting): get_auth_request con 0x7f7ac409b9b0 auth_method 0 2024-08-18T21:06:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 10 monclient(hunting): handle_auth_done global_id 5002 payload 274 2024-08-18T21:06:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 1 -- 172.21.15.5:0/1488702629 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac409b5d0 msgr2=0x7f7ac409dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 1 --2- 172.21.15.5:0/1488702629 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac409b5d0 0x7f7ac409dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 1 -- 172.21.15.5:0/1488702629 >> v2:172.21.15.157:3300/0 conn(0x7f7ac409bdb0 msgr2=0x7f7ac40a4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 1 --2- 172.21.15.5:0/1488702629 >> v2:172.21.15.157:3300/0 conn(0x7f7ac409bdb0 0x7f7ac40a4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:06:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 1 monclient: found mon.noname-i 2024-08-18T21:06:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:06:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.218+0000 7f7ac2ffd640 1 -- 172.21.15.5:0/1488702629 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac409d0a0 con 0x7f7ac409b9b0 2024-08-18T21:06:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7ac2ffd640 1 -- 172.21.15.5:0/1488702629 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7ac409b9b0 msgr2=0x7f7ac40a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7ac2ffd640 1 --2- 172.21.15.5:0/1488702629 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7ac409b9b0 0x7f7ac40a4000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80097c0 tx=0x7f7ab801c360 comp rx=0 tx=0).ready entity=mon.7 client_cookie=9bf815358892ed7e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7ac27fc640 1 -- 172.21.15.5:0/1488702629 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7ab80b0070 con 0x7f7ac409b9b0 2024-08-18T21:06:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7ac27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7ac27fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:06:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7ac27fc640 10 monclient: dump: 2024-08-18T21:06:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.233 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7ac27fc640 10 monclient: _finish_auth 0 2024-08-18T21:06:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7ac27fc640 10 monclient: _check_auth_tickets 2024-08-18T21:06:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7ac27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7ac27fc640 1 -- 172.21.15.5:0/1488702629 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab80aa810 con 0x7f7ac409b9b0 2024-08-18T21:06:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7ac27fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7ac27fc640 1 -- 172.21.15.5:0/1488702629 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7ab80a9300 con 0x7f7ac409b9b0 2024-08-18T21:06:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7ac27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7ac27fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:06:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7ac27fc640 10 monclient: dump: 2024-08-18T21:06:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.235 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7aca02c640 5 monclient: authenticate success, global_id 5002 2024-08-18T21:06:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7aca02c640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7aca02c640 4 set_mon_vals no callback set 2024-08-18T21:06:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7aca02c640 10 monclient: shutdown 2024-08-18T21:06:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7aca02c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7aca02c640 1 -- 172.21.15.5:0/1488702629 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7ac409b9b0 msgr2=0x7f7ac40a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7aca02c640 1 --2- 172.21.15.5:0/1488702629 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7ac409b9b0 0x7f7ac40a4000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80097c0 tx=0x7f7ab801c360 comp rx=0 tx=0).stop 2024-08-18T21:06:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7aca02c640 1 -- 172.21.15.5:0/1488702629 shutdown_connections 2024-08-18T21:06:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7aca02c640 1 --2- 172.21.15.5:0/1488702629 >> v2:172.21.15.157:3300/0 conn(0x7f7ac409bdb0 0x7f7ac40a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7aca02c640 1 --2- 172.21.15.5:0/1488702629 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7ac409b9b0 0x7f7ac40a4000 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7aca02c640 1 --2- 172.21.15.5:0/1488702629 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac409b5d0 0x7f7ac409dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7aca02c640 1 -- 172.21.15.5:0/1488702629 >> 172.21.15.5:0/1488702629 conn(0x7f7ac40a50f0 msgr2=0x7f7ac40a54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7aca02c640 1 -- 172.21.15.5:0/1488702629 shutdown_connections 2024-08-18T21:06:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.222+0000 7f7aca02c640 1 -- 172.21.15.5:0/1488702629 wait complete. 2024-08-18T21:06:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 10 monclient: build_initial_monmap 2024-08-18T21:06:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 10 monclient: monmap: 2024-08-18T21:06:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:15.238 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 1 Processor -- start 2024-08-18T21:06:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 1 -- start start 2024-08-18T21:06:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 10 monclient: init 2024-08-18T21:06:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 10 monclient: _add_conns ranks=[2,8,4,5,3,7,6,1,0] 2024-08-18T21:06:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7ac409b5d0 0x7f7ac408f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 10 monclient(hunting): picked mon.noname-b con 0x7f7ac409b5d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7ac409b9b0 0x7f7ac408f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 10 monclient(hunting): picked mon.noname-e con 0x7f7ac409b9b0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7ac409bdb0 0x7f7ac408fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 10 monclient(hunting): picked mon.noname-c con 0x7f7ac409bdb0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac4143650 con 0x7f7ac409b5d0 2024-08-18T21:06:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f7ac41434d0 con 0x7f7ac409bdb0 2024-08-18T21:06:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f7ac41437d0 con 0x7f7ac409b9b0 2024-08-18T21:06:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7aca02c640 10 monclient(hunting): authenticate will time out at 1142.241373s 2024-08-18T21:06:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7ac409b5d0 0x7f7ac408f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7ac409b5d0 0x7f7ac408f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:40858/0 (socket says 172.21.15.5:40858) 2024-08-18T21:06:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac3fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7ac409bdb0 0x7f7ac408fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 1 -- 172.21.15.5:0/176275758 learned_addr learned my addr 172.21.15.5:0/176275758 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 10 monclient(hunting): get_auth_request con 0x7f7ac409b5d0 auth_method 0 2024-08-18T21:06:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac2ffd640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7ac409b9b0 0x7f7ac408f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac2ffd640 10 monclient(hunting): get_auth_request con 0x7f7ac409b9b0 auth_method 0 2024-08-18T21:06:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac3fff640 10 monclient(hunting): get_auth_request con 0x7f7ac409bdb0 auth_method 0 2024-08-18T21:06:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 10 monclient(hunting): handle_auth_done global_id 5222 payload 824 2024-08-18T21:06:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 1 -- 172.21.15.5:0/176275758 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7ac409b9b0 msgr2=0x7f7ac408f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7ac409b9b0 0x7f7ac408f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 1 -- 172.21.15.5:0/176275758 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7ac409bdb0 msgr2=0x7f7ac408fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7ac409bdb0 0x7f7ac408fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 10 monclient: _finish_hunting 0 2024-08-18T21:06:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 1 monclient: found mon.noname-b 2024-08-18T21:06:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:06:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac37fe640 1 -- 172.21.15.5:0/176275758 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac4092aa0 con 0x7f7ac409b5d0 2024-08-18T21:06:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.226+0000 7f7ac3fff640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7ac409bdb0 0x7f7ac408fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:06:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7ac37fe640 1 -- 172.21.15.5:0/176275758 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7ac409b5d0 msgr2=0x7f7ac408f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7ac37fe640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7ac409b5d0 0x7f7ac408f220 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400e900 tx=0x7f7ab400edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aabfff640 1 -- 172.21.15.5:0/176275758 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7ab4017070 con 0x7f7ac409b5d0 2024-08-18T21:06:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aabfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aabfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aabfff640 10 monclient: dump: 2024-08-18T21:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.244 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aabfff640 10 monclient: _finish_auth 0 2024-08-18T21:06:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aabfff640 10 monclient: _check_auth_tickets 2024-08-18T21:06:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aabfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aca02c640 5 monclient: authenticate success, global_id 5222 2024-08-18T21:06:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aabfff640 1 -- 172.21.15.5:0/176275758 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab400cc10 con 0x7f7ac409b5d0 2024-08-18T21:06:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aca02c640 10 monclient: _renew_subs 2024-08-18T21:06:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aca02c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:06:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aca02c640 1 -- 172.21.15.5:0/176275758 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac4092d80 con 0x7f7ac409b5d0 2024-08-18T21:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aabfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aabfff640 1 -- 172.21.15.5:0/176275758 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7ab400cdc0 con 0x7f7ac409b5d0 2024-08-18T21:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aabfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aabfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aabfff640 10 monclient: dump: 2024-08-18T21:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.246 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7ac1ffb640 4 set_mon_vals no callback set 2024-08-18T21:06:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aca02c640 10 monclient: _renew_subs 2024-08-18T21:06:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aca02c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:06:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aca02c640 1 -- 172.21.15.5:0/176275758 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac4091580 con 0x7f7ac409b5d0 2024-08-18T21:06:15.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aca02c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:15.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aca02c640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac4091100 0x7f7ac4092500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aca02c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aca02c640 1 -- 172.21.15.5:0/176275758 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f7ac4051140 con 0x7f7ac4091100 2024-08-18T21:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aabfff640 1 -- 172.21.15.5:0/176275758 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f7ab401a070 con 0x7f7ac409b5d0 2024-08-18T21:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7ac2ffd640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac4091100 0x7f7ac4092500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7ac2ffd640 10 monclient: get_auth_request con 0x7f7ac4091100 auth_method 0 2024-08-18T21:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7ac2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7ac2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7ac2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aabfff640 1 --2- 172.21.15.5:0/176275758 >> v2:172.21.15.157:6812/631023601 conn(0x7f7ab003bdc0 0x7f7ab003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7aabfff640 1 -- 172.21.15.5:0/176275758 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(83..83 src has 22..83) ==== 3898+0+0 (secure 0 0 0) 0x7f7ab400f040 con 0x7f7ac409b5d0 2024-08-18T21:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7ac2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7ac2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7ac2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7ac3fff640 1 --2- 172.21.15.5:0/176275758 >> v2:172.21.15.157:6812/631023601 conn(0x7f7ab003bdc0 0x7f7ab003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7ac3fff640 10 monclient: get_auth_request con 0x7f7ab003bdc0 auth_method 0 2024-08-18T21:06:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7ac2ffd640 10 monclient(hunting): handle_auth_done global_id 34565 payload 824 2024-08-18T21:06:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.230+0000 7f7ac2ffd640 1 -- 172.21.15.5:0/176275758 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ac409dad0 con 0x7f7ac4091100 2024-08-18T21:06:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.234+0000 7f7ac2ffd640 1 -- 172.21.15.5:0/176275758 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac4091100 msgr2=0x7f7ac4092500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.234+0000 7f7ac2ffd640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac4091100 0x7f7ac4092500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ac406f8b0 tx=0x7f7ab8019100 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.234+0000 7f7ac3fff640 1 --2- 172.21.15.5:0/176275758 >> v2:172.21.15.157:6812/631023601 conn(0x7f7ab003bdc0 0x7f7ab003e280 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009fd0 tx=0x7f7abc00b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.234+0000 7f7aabfff640 1 -- 172.21.15.5:0/176275758 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7ab80b0040 con 0x7f7ac4091100 2024-08-18T21:06:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.234+0000 7f7aabfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.234+0000 7f7aabfff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:06:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.234+0000 7f7aabfff640 10 monclient: dump: 2024-08-18T21:06:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.234+0000 7f7aabfff640 1 -- 172.21.15.5:0/176275758 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7ab8003830 con 0x7f7ac4091100 2024-08-18T21:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.234+0000 7f7aabfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.234+0000 7f7aabfff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.234+0000 7f7aabfff640 1 -- 172.21.15.5:0/176275758 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac4091100 msgr2=0x7f7ac4092500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.234+0000 7f7aabfff640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac4091100 0x7f7ac4092500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ac406f8b0 tx=0x7f7ab8019100 comp rx=0 tx=0).stop 2024-08-18T21:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.234+0000 7f7aabfff640 1 -- 172.21.15.5:0/176275758 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac4091100 msgr2=0x7f7ac4092500 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.234+0000 7f7aabfff640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac4091100 0x7f7ac4092500 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ac406f8b0 tx=0x7f7ab8019100 comp rx=0 tx=0).stop 2024-08-18T21:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7aca02c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7aca02c640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac41d1860 0x7f7ac41d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7aca02c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7aca02c640 1 -- 172.21.15.5:0/176275758 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f7ac406d960 con 0x7f7ac41d1860 2024-08-18T21:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7ac2ffd640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac41d1860 0x7f7ac41d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7ac2ffd640 10 monclient: get_auth_request con 0x7f7ac41d1860 auth_method 0 2024-08-18T21:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7ac2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7ac2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7ac2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7ac2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7ac2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7ac2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7ac2ffd640 10 monclient(hunting): handle_auth_done global_id 34574 payload 824 2024-08-18T21:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7ac2ffd640 1 -- 172.21.15.5:0/176275758 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7ac41dcbf0 con 0x7f7ac41d1860 2024-08-18T21:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7ac2ffd640 1 -- 172.21.15.5:0/176275758 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac41d1860 msgr2=0x7f7ac41d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7ac2ffd640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac41d1860 0x7f7ac41d1c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7ab801c3a0 tx=0x7f7ab80a8000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7aabfff640 1 -- 172.21.15.5:0/176275758 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7ab80b0070 con 0x7f7ac41d1860 2024-08-18T21:06:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7aabfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7aabfff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:06:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.242+0000 7f7aabfff640 10 monclient: dump: 2024-08-18T21:06:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.257 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aabfff640 1 -- 172.21.15.5:0/176275758 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9246 (secure 0 0 0) 0x7f7ab80b5b80 con 0x7f7ac41d1860 2024-08-18T21:06:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aabfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aabfff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aabfff640 1 -- 172.21.15.5:0/176275758 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac41d1860 msgr2=0x7f7ac41d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aabfff640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac41d1860 0x7f7ac41d1c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7ab801c3a0 tx=0x7f7ab80a8000 comp rx=0 tx=0).stop 2024-08-18T21:06:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aabfff640 1 -- 172.21.15.5:0/176275758 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac41d1860 msgr2=0x7f7ac41d1c40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aabfff640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7ac41d1860 0x7f7ac41d1c40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.258 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 95039, 2024-08-18T21:06:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:06:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:15.281 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aca02c640 1 -- 172.21.15.5:0/176275758 >> v2:172.21.15.157:6812/631023601 conn(0x7f7ab003bdc0 msgr2=0x7f7ab003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aca02c640 1 --2- 172.21.15.5:0/176275758 >> v2:172.21.15.157:6812/631023601 conn(0x7f7ab003bdc0 0x7f7ab003e280 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009fd0 tx=0x7f7abc00b040 comp rx=0 tx=0).stop 2024-08-18T21:06:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aca02c640 10 monclient: shutdown 2024-08-18T21:06:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aca02c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aca02c640 1 -- 172.21.15.5:0/176275758 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7ac409b5d0 msgr2=0x7f7ac408f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aca02c640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7ac409b5d0 0x7f7ac408f220 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400e900 tx=0x7f7ab400edc0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7ac3fff640 1 -- 172.21.15.5:0/176275758 reap_dead start 2024-08-18T21:06:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aca02c640 1 -- 172.21.15.5:0/176275758 shutdown_connections 2024-08-18T21:06:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aca02c640 1 --2- 172.21.15.5:0/176275758 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7ac409b5d0 0x7f7ac408f220 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aca02c640 1 -- 172.21.15.5:0/176275758 >> 172.21.15.5:0/176275758 conn(0x7f7ac40a50f0 msgr2=0x7f7ac40a1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aca02c640 1 -- 172.21.15.5:0/176275758 shutdown_connections 2024-08-18T21:06:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.246+0000 7f7aca02c640 1 -- 172.21.15.5:0/176275758 wait complete. 2024-08-18T21:06:15.284 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:15.284 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:06:15.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:06:15.300 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:15.300 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28872]: starting. 2024-08-18T21:06:15.300 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28872]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28837 2024-08-18T21:06:15.300 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28872]: created object 0... 2024-08-18T21:06:15.300 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28872]: created object 25... 2024-08-18T21:06:15.300 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28872]: created object 49... 2024-08-18T21:06:15.301 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28872]: finishing. 2024-08-18T21:06:15.301 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28872]: shutting down. 2024-08-18T21:06:15.350 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:15.350 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28874]: starting. 2024-08-18T21:06:15.350 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28874]: listing objects. 2024-08-18T21:06:15.350 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28874]: listed object 0... 2024-08-18T21:06:15.350 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28874]: listed object 25... 2024-08-18T21:06:15.350 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28874]: saw 50 objects 2024-08-18T21:06:15.350 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28874]: shutting down. 2024-08-18T21:06:15.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 10 monclient: get_monmap_and_config 2024-08-18T21:06:15.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 10 monclient: build_initial_monmap 2024-08-18T21:06:15.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 10 monclient: monmap: 2024-08-18T21:06:15.400 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:15.400 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.400 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:15.401069+0000 2024-08-18T21:06:15.400 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:15.401069+0000 2024-08-18T21:06:15.400 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:15.400 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.400 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:15.401 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:15.401 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:15.401 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:15.401 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:15.401 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:15.401 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:15.401 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:15.401 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:15.401 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:15.401 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:15.401 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 1 Processor -- start 2024-08-18T21:06:15.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 1 -- start start 2024-08-18T21:06:15.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 10 monclient: init 2024-08-18T21:06:15.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:15.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 10 monclient: _add_conns ranks=[6,10,1,9,3,4,0,8,2,7,5] 2024-08-18T21:06:15.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07d406c950 0x7f07d406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 10 monclient(hunting): picked mon.noname-d con 0x7f07d406c950 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:15.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f07d4069020 0x7f07d406d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 10 monclient(hunting): picked mon.noname-f con 0x7f07d4069020 addr v2:172.21.15.157:3300/0 2024-08-18T21:06:15.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f07d4137870 addr v1:172.21.15.157:6789/0 2024-08-18T21:06:15.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07d406e520 con 0x7f07d4137870 2024-08-18T21:06:15.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f07d40a2750 con 0x7f07d4069020 2024-08-18T21:06:15.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f07d406fc50 con 0x7f07d406c950 2024-08-18T21:06:15.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d912f640 10 monclient(hunting): authenticate will time out at 1142.414226s 2024-08-18T21:06:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07d406c950 0x7f07d406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07d406c950 0x7f07d406cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:55490/0 (socket says 172.21.15.5:55490) 2024-08-18T21:06:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 1 -- 172.21.15.5:0/2676959286 learned_addr learned my addr 172.21.15.5:0/2676959286 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 10 monclient(hunting): get_auth_request con 0x7f07d406c950 auth_method 0 2024-08-18T21:06:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d259c640 1 --2- 172.21.15.5:0/2676959286 >> v2:172.21.15.157:3300/0 conn(0x7f07d4069020 0x7f07d406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d259c640 10 monclient(hunting): get_auth_request con 0x7f07d4069020 auth_method 0 2024-08-18T21:06:15.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 10 monclient(hunting): handle_auth_done global_id 54240 payload 274 2024-08-18T21:06:15.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 1 -- 172.21.15.5:0/2676959286 >> v2:172.21.15.157:3300/0 conn(0x7f07d4069020 msgr2=0x7f07d406d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:15.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 1 --2- 172.21.15.5:0/2676959286 >> v2:172.21.15.157:3300/0 conn(0x7f07d4069020 0x7f07d406d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 1 -- 172.21.15.5:0/2676959286 >> v1:172.21.15.157:6789/0 conn(0x7f07d4137870 legacy=0x7f07d4137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:15.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 10 monclient: _finish_hunting 0 2024-08-18T21:06:15.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 1 monclient: found mon.noname-d 2024-08-18T21:06:15.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:15.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:06:15.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.398+0000 7f07d2d9d640 1 -- 172.21.15.5:0/2676959286 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d4068890 con 0x7f07d406c950 2024-08-18T21:06:15.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d2d9d640 1 -- 172.21.15.5:0/2676959286 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07d406c950 msgr2=0x7f07d406cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:15.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d2d9d640 1 --2- 172.21.15.5:0/2676959286 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07d406c950 0x7f07d406cd30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f07c4009870 tx=0x7f07c401c420 comp rx=0 tx=0).ready entity=mon.6 client_cookie=36e48e28d2d0ce75 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:15.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d2d9d640 1 -- 172.21.15.5:0/2676959286 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07d406c950 msgr2=0x7f07d406cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-08-18T21:06:15.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d2d9d640 1 -- 172.21.15.5:0/2676959286 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07d406c950 msgr2=0x7f07d406cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:06:15.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d2d9d640 1 --2- 172.21.15.5:0/2676959286 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07d406c950 0x7f07d406cd30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f07c4009870 tx=0x7f07c401c420 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:15.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d2d9d640 1 --2- 172.21.15.5:0/2676959286 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07d406c950 0x7f07d406cd30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f07c4009870 tx=0x7f07c401c420 comp rx=0 tx=0).stop 2024-08-18T21:06:15.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 10 monclient: ms_handle_reset current mon [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:15.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:15.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 1 -- 172.21.15.5:0/2676959286 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07d406c950 msgr2=0x7f07d406cd30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 1 --2- 172.21.15.5:0/2676959286 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07d406c950 0x7f07d406cd30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 10 monclient: _add_conns ranks=[5,3,9,0,2,4,7,8] 2024-08-18T21:06:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 1 --2- 172.21.15.5:0/2676959286 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f07b4003640 0x7f07b4005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 10 monclient(hunting): picked mon.noname-h con 0x7f07b4003640 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 1 --2- 172.21.15.5:0/2676959286 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b4006350 0x7f07b40087e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 10 monclient(hunting): picked mon.noname-g con 0x7f07b4006350 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:06:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 1 --2- 172.21.15.5:0/2676959286 >> v2:172.21.15.5:3300/0 conn(0x7f07b40090f0 0x7f07b400b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 10 monclient(hunting): picked mon.noname-a con 0x7f07b40090f0 addr v2:172.21.15.5:3300/0 2024-08-18T21:06:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 1 -- 172.21.15.5:0/2676959286 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f07b400bec0 con 0x7f07b40090f0 2024-08-18T21:06:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 1 -- 172.21.15.5:0/2676959286 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f07b400c040 con 0x7f07b4006350 2024-08-18T21:06:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 1 -- 172.21.15.5:0/2676959286 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f07b400c240 con 0x7f07b4003640 2024-08-18T21:06:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d1d9b640 10 monclient(hunting): ms_handle_reset stray mon [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 1 --2- 172.21.15.5:0/2676959286 >> v2:172.21.15.5:3300/0 conn(0x7f07b40090f0 0x7f07b400b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 10 monclient(hunting): get_auth_request con 0x7f07b40090f0 auth_method 0 2024-08-18T21:06:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:06:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d2d9d640 1 --2- 172.21.15.5:0/2676959286 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f07b4003640 0x7f07b4005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d259c640 1 --2- 172.21.15.5:0/2676959286 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b4006350 0x7f07b40087e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d2d9d640 10 monclient(hunting): get_auth_request con 0x7f07b4003640 auth_method 0 2024-08-18T21:06:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d2d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d2d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d259c640 10 monclient(hunting): get_auth_request con 0x7f07b4006350 auth_method 0 2024-08-18T21:06:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d259c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 10 monclient(hunting): handle_auth_done global_id 54240 payload 293 2024-08-18T21:06:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 1 -- 172.21.15.5:0/2676959286 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f07b4003640 msgr2=0x7f07b4005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 1 --2- 172.21.15.5:0/2676959286 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f07b4003640 0x7f07b4005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 1 -- 172.21.15.5:0/2676959286 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b4006350 msgr2=0x7f07b40087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 1 --2- 172.21.15.5:0/2676959286 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b4006350 0x7f07b40087e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 10 monclient: _finish_hunting 0 2024-08-18T21:06:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 1 monclient: found mon.noname-a 2024-08-18T21:06:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:06:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 1 -- 172.21.15.5:0/2676959286 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b400c500 con 0x7f07b40090f0 2024-08-18T21:06:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.402+0000 7f07d359e640 1 -- 172.21.15.5:0/2676959286 reap_dead start 2024-08-18T21:06:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d359e640 1 -- 172.21.15.5:0/2676959286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b40090f0 msgr2=0x7f07b400b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d359e640 1 --2- 172.21.15.5:0/2676959286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b40090f0 0x7f07b400b5b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f07bc007fd0 tx=0x7f07c4009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda72c7c9e1d5ad server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d1d9b640 1 -- 172.21.15.5:0/2676959286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07bc0039b0 con 0x7f07b40090f0 2024-08-18T21:06:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d1d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:06:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d1d9b640 10 monclient: dump: 2024-08-18T21:06:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.415 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d1d9b640 10 monclient: _finish_auth 0 2024-08-18T21:06:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d1d9b640 10 monclient: _check_auth_tickets 2024-08-18T21:06:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d1d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d1d9b640 1 -- 172.21.15.5:0/2676959286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07bc005260 con 0x7f07b40090f0 2024-08-18T21:06:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 5 monclient: authenticate success, global_id 54240 2024-08-18T21:06:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d1d9b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d1d9b640 1 -- 172.21.15.5:0/2676959286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07bc005410 con 0x7f07b40090f0 2024-08-18T21:06:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 4 set_mon_vals no callback set 2024-08-18T21:06:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d1d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:06:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d1d9b640 10 monclient: dump: 2024-08-18T21:06:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.417 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 10 monclient: shutdown 2024-08-18T21:06:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 1 -- 172.21.15.5:0/2676959286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b40090f0 msgr2=0x7f07b400b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 1 --2- 172.21.15.5:0/2676959286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b40090f0 0x7f07b400b5b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f07bc007fd0 tx=0x7f07c4009240 comp rx=0 tx=0).stop 2024-08-18T21:06:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 1 -- 172.21.15.5:0/2676959286 shutdown_connections 2024-08-18T21:06:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 1 --2- 172.21.15.5:0/2676959286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b40090f0 0x7f07b400b5b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 1 -- 172.21.15.5:0/2676959286 >> 172.21.15.5:0/2676959286 conn(0x7f07d40a90a0 msgr2=0x7f07d40a9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 1 -- 172.21.15.5:0/2676959286 shutdown_connections 2024-08-18T21:06:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 1 -- 172.21.15.5:0/2676959286 wait complete. 2024-08-18T21:06:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 10 monclient: build_initial_monmap 2024-08-18T21:06:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 10 monclient: monmap: 2024-08-18T21:06:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:15.425 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 1 Processor -- start 2024-08-18T21:06:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 1 -- start start 2024-08-18T21:06:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 10 monclient: init 2024-08-18T21:06:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 10 monclient: _add_conns ranks=[6,5,3,2,8,4,1,0,7] 2024-08-18T21:06:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.406+0000 7f07d912f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07b40090f0 0x7f07d4133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 10 monclient(hunting): picked mon.noname-d con 0x7f07b40090f0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f07d4134130 0x7f07d41cf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 10 monclient(hunting): picked mon.noname-h con 0x7f07d4134130 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07d41cf940 0x7f07d41cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 10 monclient(hunting): picked mon.noname-g con 0x7f07d41cf940 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:06:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f07d4137d00 con 0x7f07d41cf940 2024-08-18T21:06:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f07d40a0ef0 con 0x7f07d4134130 2024-08-18T21:06:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f07d4137e80 con 0x7f07b40090f0 2024-08-18T21:06:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 10 monclient(hunting): authenticate will time out at 1142.424046s 2024-08-18T21:06:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07b40090f0 0x7f07d4133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07b40090f0 0x7f07d4133bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:55504/0 (socket says 172.21.15.5:55504) 2024-08-18T21:06:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 1 -- 172.21.15.5:0/299360588 learned_addr learned my addr 172.21.15.5:0/299360588 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 10 monclient(hunting): get_auth_request con 0x7f07b40090f0 auth_method 0 2024-08-18T21:06:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d259c640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f07d4134130 0x7f07d41cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d359e640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07d41cf940 0x7f07d41cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d259c640 10 monclient(hunting): get_auth_request con 0x7f07d4134130 auth_method 0 2024-08-18T21:06:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d359e640 10 monclient(hunting): get_auth_request con 0x7f07d41cf940 auth_method 0 2024-08-18T21:06:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d359e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d359e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d359e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 10 monclient(hunting): handle_auth_done global_id 54249 payload 824 2024-08-18T21:06:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 1 -- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f07d4134130 msgr2=0x7f07d41cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f07d4134130 0x7f07d41cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 1 -- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07d41cf940 msgr2=0x7f07d41cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07d41cf940 0x7f07d41cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 10 monclient: _finish_hunting 0 2024-08-18T21:06:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 1 monclient: found mon.noname-d 2024-08-18T21:06:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:06:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 1 -- 172.21.15.5:0/299360588 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d413c5d0 con 0x7f07b40090f0 2024-08-18T21:06:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d359e640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07d41cf940 0x7f07d41cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:06:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 1 -- 172.21.15.5:0/299360588 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07b40090f0 msgr2=0x7f07d4133bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d2d9d640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07b40090f0 0x7f07d4133bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f07c4097c70 tx=0x7f07c40191c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07cb7fe640 1 -- 172.21.15.5:0/299360588 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07c40ba070 con 0x7f07b40090f0 2024-08-18T21:06:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07cb7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:06:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07cb7fe640 10 monclient: dump: 2024-08-18T21:06:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.431 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07cb7fe640 10 monclient: _finish_auth 0 2024-08-18T21:06:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07cb7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:06:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07cb7fe640 1 -- 172.21.15.5:0/299360588 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07c40ab870 con 0x7f07b40090f0 2024-08-18T21:06:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 5 monclient: authenticate success, global_id 54249 2024-08-18T21:06:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 10 monclient: _renew_subs 2024-08-18T21:06:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 1 -- 172.21.15.5:0/299360588 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d413da20 con 0x7f07b40090f0 2024-08-18T21:06:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07cb7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07cb7fe640 1 -- 172.21.15.5:0/299360588 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07c40b0070 con 0x7f07b40090f0 2024-08-18T21:06:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07cb7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07cb7fe640 10 monclient: dump: 2024-08-18T21:06:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.433 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.433 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.433 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.433 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 10 monclient: _renew_subs 2024-08-18T21:06:15.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:15.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 1 -- 172.21.15.5:0/299360588 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d40a4db0 con 0x7f07b40090f0 2024-08-18T21:06:15.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d159a640 4 set_mon_vals no callback set 2024-08-18T21:06:15.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:15.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07d40709f0 0x7f07d4070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.410+0000 7f07d912f640 1 -- 172.21.15.5:0/299360588 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f07d4051140 con 0x7f07d40709f0 2024-08-18T21:06:15.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07cb7fe640 1 -- 172.21.15.5:0/299360588 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f07c40bd070 con 0x7f07b40090f0 2024-08-18T21:06:15.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07d259c640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07d40709f0 0x7f07d4070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07d259c640 10 monclient: get_auth_request con 0x7f07d40709f0 auth_method 0 2024-08-18T21:06:15.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07d259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07d259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07d259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07cb7fe640 1 --2- 172.21.15.5:0/299360588 >> v2:172.21.15.157:6812/631023601 conn(0x7f07b803bdf0 0x7f07b803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07cb7fe640 1 -- 172.21.15.5:0/299360588 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(83..83 src has 22..83) ==== 3898+0+0 (secure 0 0 0) 0x7f07c40e90c0 con 0x7f07b40090f0 2024-08-18T21:06:15.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07d259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07d259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07d259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07d359e640 1 --2- 172.21.15.5:0/299360588 >> v2:172.21.15.157:6812/631023601 conn(0x7f07b803bdf0 0x7f07b803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07d359e640 10 monclient: get_auth_request con 0x7f07b803bdf0 auth_method 0 2024-08-18T21:06:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07d259c640 10 monclient(hunting): handle_auth_done global_id 5011 payload 824 2024-08-18T21:06:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07d259c640 1 -- 172.21.15.5:0/299360588 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07d413d2f0 con 0x7f07d40709f0 2024-08-18T21:06:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07d259c640 1 -- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07d40709f0 msgr2=0x7f07d4070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07d259c640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07d40709f0 0x7f07d4070dd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009bb0 tx=0x7f07cc007700 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07cb7fe640 1 -- 172.21.15.5:0/299360588 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07cc01a020 con 0x7f07d40709f0 2024-08-18T21:06:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07cb7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:06:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07cb7fe640 10 monclient: dump: 2024-08-18T21:06:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.436 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.414+0000 7f07d359e640 1 --2- 172.21.15.5:0/299360588 >> v2:172.21.15.157:6812/631023601 conn(0x7f07b803bdf0 0x7f07b803e2b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f07d406df70 tx=0x7f07bc009030 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.418+0000 7f07cb7fe640 1 -- 172.21.15.5:0/299360588 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f07cc016670 con 0x7f07d40709f0 2024-08-18T21:06:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.418+0000 7f07cb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.418+0000 7f07cb7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.418+0000 7f07cb7fe640 1 -- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07d40709f0 msgr2=0x7f07d4070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.418+0000 7f07cb7fe640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07d40709f0 0x7f07d4070dd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009bb0 tx=0x7f07cc007700 comp rx=0 tx=0).stop 2024-08-18T21:06:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.418+0000 7f07cb7fe640 1 -- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07d40709f0 msgr2=0x7f07d4070dd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.418+0000 7f07cb7fe640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07d40709f0 0x7f07d4070dd0 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009bb0 tx=0x7f07cc007700 comp rx=0 tx=0).stop 2024-08-18T21:06:15.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.422+0000 7f07d912f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:15.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.422+0000 7f07d912f640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07d4071310 0x7f07d41da770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.422+0000 7f07d912f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.422+0000 7f07d912f640 1 -- 172.21.15.5:0/299360588 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f07d41381b0 con 0x7f07d4071310 2024-08-18T21:06:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.422+0000 7f07d259c640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07d4071310 0x7f07d41da770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.422+0000 7f07d259c640 10 monclient: get_auth_request con 0x7f07d4071310 auth_method 0 2024-08-18T21:06:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.422+0000 7f07d259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.422+0000 7f07d259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.422+0000 7f07d259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.422+0000 7f07d259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.422+0000 7f07d259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.422+0000 7f07d259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.422+0000 7f07d259c640 10 monclient(hunting): handle_auth_done global_id 5020 payload 824 2024-08-18T21:06:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.422+0000 7f07d259c640 1 -- 172.21.15.5:0/299360588 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f07d413b6c0 con 0x7f07d4071310 2024-08-18T21:06:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07d259c640 1 -- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07d4071310 msgr2=0x7f07d41da770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07d259c640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07d4071310 0x7f07d41da770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07cc01b000 tx=0x7f07cc004ac0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07cb7fe640 1 -- 172.21.15.5:0/299360588 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07cc01a040 con 0x7f07d4071310 2024-08-18T21:06:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07cb7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:06:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07cb7fe640 10 monclient: dump: 2024-08-18T21:06:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:15.441 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07cb7fe640 1 -- 172.21.15.5:0/299360588 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f07cc01f410 con 0x7f07d4071310 2024-08-18T21:06:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07cb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07cb7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07cb7fe640 1 -- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07d4071310 msgr2=0x7f07d41da770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07cb7fe640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07d4071310 0x7f07d41da770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07cc01b000 tx=0x7f07cc004ac0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07cb7fe640 1 -- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07d4071310 msgr2=0x7f07d41da770 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07cb7fe640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f07d4071310 0x7f07d41da770 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07cc01b000 tx=0x7f07cc004ac0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.442 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 60, 2024-08-18T21:06:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 184522, 2024-08-18T21:06:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:06:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:06:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:06:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:15.466 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:15.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07d912f640 1 -- 172.21.15.5:0/299360588 >> v2:172.21.15.157:6812/631023601 conn(0x7f07b803bdf0 msgr2=0x7f07b803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07d912f640 1 --2- 172.21.15.5:0/299360588 >> v2:172.21.15.157:6812/631023601 conn(0x7f07b803bdf0 0x7f07b803e2b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f07d406df70 tx=0x7f07bc009030 comp rx=0 tx=0).stop 2024-08-18T21:06:15.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07d912f640 10 monclient: shutdown 2024-08-18T21:06:15.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07d912f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:15.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07d912f640 1 -- 172.21.15.5:0/299360588 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07b40090f0 msgr2=0x7f07d4133bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:15.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07d912f640 1 --2- 172.21.15.5:0/299360588 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f07b40090f0 0x7f07d4133bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f07c4097c70 tx=0x7f07c40191c0 comp rx=0 tx=0).stop 2024-08-18T21:06:15.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07d359e640 1 -- 172.21.15.5:0/299360588 reap_dead start 2024-08-18T21:06:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07d359e640 1 -- 172.21.15.5:0/299360588 reap_dead start 2024-08-18T21:06:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07d912f640 1 -- 172.21.15.5:0/299360588 shutdown_connections 2024-08-18T21:06:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07d912f640 1 -- 172.21.15.5:0/299360588 >> 172.21.15.5:0/299360588 conn(0x7f07d40a90a0 msgr2=0x7f07d413f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07d912f640 1 -- 172.21.15.5:0/299360588 shutdown_connections 2024-08-18T21:06:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:15.426+0000 7f07d912f640 1 -- 172.21.15.5:0/299360588 wait complete. 2024-08-18T21:06:15.468 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:06:15.468 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b', 'a'] 2024-08-18T21:06:15.469 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['g'] 2024-08-18T21:06:15.469 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-08-18T21:06:15.469 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-08-18T21:06:15.469 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-18T21:06:15.469 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:06:15.481 INFO:tasks.ceph.mon.b:Stopped 2024-08-18T21:06:15.481 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-18T21:06:15.481 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-18T21:06:15.481 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-18T21:06:15.481 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:06:15.538 INFO:tasks.ceph.mon.a:Stopped 2024-08-18T21:06:15.538 INFO:tasks.mon_thrash:Sending STOP to mon g 2024-08-18T21:06:15.538 INFO:tasks.ceph.mon.g:Sent signal 19 2024-08-18T21:06:15.538 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs to unfreeze mons 2024-08-18T21:06:35.539 INFO:tasks.mon_thrash:Sending CONT to mon g 2024-08-18T21:06:35.540 INFO:tasks.ceph.mon.g:Sent signal 18 2024-08-18T21:06:35.540 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 7 2024-08-18T21:06:35.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:06:35.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 10 monclient: get_monmap_and_config 2024-08-18T21:06:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 10 monclient: build_initial_monmap 2024-08-18T21:06:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 10 monclient: monmap: 2024-08-18T21:06:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:35.677713+0000 2024-08-18T21:06:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:35.677713+0000 2024-08-18T21:06:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:35.678 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 1 Processor -- start 2024-08-18T21:06:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 1 -- start start 2024-08-18T21:06:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 10 monclient: init 2024-08-18T21:06:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 10 monclient: _add_conns ranks=[8,4,2,3,7,9,1,10,6,5,0] 2024-08-18T21:06:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 0x7f69cc0a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 10 monclient(hunting): picked mon.noname-e con 0x7f69cc0a4a40 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 0x7f69cc0a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 10 monclient(hunting): picked mon.noname-c con 0x7f69cc0a0b40 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69cc1367f0 0x7f69cc136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 10 monclient(hunting): picked mon.noname-b con 0x7f69cc1367f0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f69cc0a58a0 con 0x7f69cc1367f0 2024-08-18T21:06:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f69cc069960 con 0x7f69cc0a0b40 2024-08-18T21:06:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f69cc09e490 con 0x7f69cc0a4a40 2024-08-18T21:06:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69d1e9c640 10 monclient(hunting): authenticate will time out at 1162.691595s 2024-08-18T21:06:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69cbfff640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69cc1367f0 msgr2=0x7f69cc136c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:06:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69cbfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69cc1367f0 0x7f69cc136c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:06:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69cb7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 0x7f69cc0a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69caffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 0x7f69cc0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69cb7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 0x7f69cc0a4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:44402/0 (socket says 172.21.15.5:44402) 2024-08-18T21:06:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 learned_addr learned my addr 172.21.15.5:0/860953435 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request con 0x7f69cc0a4a40 auth_method 0 2024-08-18T21:06:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69cb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69caffd640 10 monclient(hunting): get_auth_request con 0x7f69cc0a0b40 auth_method 0 2024-08-18T21:06:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69caffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69caffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 msgr2=0x7f69cc0a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:06:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 msgr2=0x7f69cc0a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.673+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 0x7f69cc0a4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.677+0000 7f69caffd640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 msgr2=0x7f69cc0a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:06:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.677+0000 7f69caffd640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 msgr2=0x7f69cc0a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.677+0000 7f69caffd640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 0x7f69cc0a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.677+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 0x7f69cc0a4e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:06:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.677+0000 7f69caffd640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 0x7f69cc0a5360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.877+0000 7f69cbfff640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69cc1367f0 msgr2=0x7f69cc136c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.877+0000 7f69cbfff640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69cc1367f0 0x7f69cc136c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 0x7f69cc0a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69caffd640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 0x7f69cc0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request con 0x7f69cc0a4a40 auth_method 0 2024-08-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69cb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69cb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69caffd640 10 monclient(hunting): get_auth_request con 0x7f69cc0a0b40 auth_method 0 2024-08-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69caffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69caffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69caffd640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 msgr2=0x7f69cc0a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69caffd640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 msgr2=0x7f69cc0a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69caffd640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 0x7f69cc0a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 msgr2=0x7f69cc0a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 msgr2=0x7f69cc0a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 0x7f69cc0a4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69caffd640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 0x7f69cc0a5360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:35.881+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 0x7f69cc0a4e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:06:36.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.281+0000 7f69cbfff640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69cc1367f0 msgr2=0x7f69cc136c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:06:36.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.281+0000 7f69cbfff640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69cc1367f0 0x7f69cc136c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:06:36.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69caffd640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 0x7f69cc0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:36.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 0x7f69cc0a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:36.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69caffd640 10 monclient(hunting): get_auth_request con 0x7f69cc0a0b40 auth_method 0 2024-08-18T21:06:36.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:36.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69caffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69caffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request con 0x7f69cc0a4a40 auth_method 0 2024-08-18T21:06:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69cb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69cb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69caffd640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 msgr2=0x7f69cc0a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:06:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69caffd640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 msgr2=0x7f69cc0a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69caffd640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 0x7f69cc0a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 msgr2=0x7f69cc0a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:06:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69caffd640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 0x7f69cc0a5360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:06:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 msgr2=0x7f69cc0a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 0x7f69cc0a4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:36.285+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 0x7f69cc0a4e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:06:37.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.085+0000 7f69cbfff640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69cc1367f0 msgr2=0x7f69cc136c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:06:37.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.085+0000 7f69cbfff640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69cc1367f0 0x7f69cc136c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:06:37.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 0x7f69cc0a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:37.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request con 0x7f69cc0a4a40 auth_method 0 2024-08-18T21:06:37.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:37.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69cb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:37.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69cb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:37.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 msgr2=0x7f69cc0a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:06:37.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 msgr2=0x7f69cc0a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:37.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 0x7f69cc0a4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 0x7f69cc0a4e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:06:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69caffd640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 0x7f69cc0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69caffd640 10 monclient(hunting): get_auth_request con 0x7f69cc0a0b40 auth_method 0 2024-08-18T21:06:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69caffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69caffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69caffd640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 msgr2=0x7f69cc0a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:06:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69caffd640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 msgr2=0x7f69cc0a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69caffd640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 0x7f69cc0a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:37.089+0000 7f69caffd640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 0x7f69cc0a5360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:06:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 10 monclient(hunting): tick 2024-08-18T21:06:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:06:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 1 monclient(hunting): continuing hunt 2024-08-18T21:06:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:06:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 msgr2=0x7f69cc0a4e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:06:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69cc0a4a40 0x7f69cc0a4e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 msgr2=0x7f69cc0a5360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:06:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69cc0a0b40 0x7f69cc0a5360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69cc1367f0 msgr2=0x7f69cc136c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:06:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69cc1367f0 0x7f69cc136c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 10 monclient: _add_conns ranks=[7,1,0,10,6,5,9,3] 2024-08-18T21:06:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 0x7f69b8007e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 10 monclient(hunting): picked mon.noname-i con 0x7f69b8005a70 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f69b8008480 addr v1:172.21.15.157:6789/0 2024-08-18T21:06:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f69b800c1b0 addr v1:172.21.15.5:6789/0 2024-08-18T21:06:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 1 -- 172.21.15.5:0/860953435 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69cc09f530 con 0x7f69b800c1b0 2024-08-18T21:06:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 1 -- 172.21.15.5:0/860953435 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69b8010f10 con 0x7f69b8008480 2024-08-18T21:06:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 1 -- 172.21.15.5:0/860953435 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f69cc0a58a0 con 0x7f69b8005a70 2024-08-18T21:06:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69c97fa640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69cbfff640 1 -- 172.21.15.5:0/860953435 >> v1:172.21.15.5:6789/0 conn(0x7f69b800c1b0 legacy=0x7f69b800e670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:06:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 0x7f69b8007e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request con 0x7f69b8005a70 auth_method 0 2024-08-18T21:06:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69cb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 msgr2=0x7f69b8007e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:06:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 msgr2=0x7f69b8007e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 0x7f69b8007e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 0x7f69b8007e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:06:38.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.677+0000 7f69caffd640 1 -- 172.21.15.5:0/860953435 >> v1:172.21.15.157:6789/0 conn(0x7f69b8008480 legacy=0x7f69b800a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.881+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 0x7f69b8007e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.881+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request con 0x7f69b8005a70 auth_method 0 2024-08-18T21:06:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.881+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.881+0000 7f69cb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.881+0000 7f69cb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.881+0000 7f69cbfff640 1 -- 172.21.15.5:0/860953435 >> v1:172.21.15.5:6789/0 conn(0x7f69b800c1b0 legacy=0x7f69b800e670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:06:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.881+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 msgr2=0x7f69b8007e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:06:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.881+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 msgr2=0x7f69b8007e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.881+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 0x7f69b8007e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:38.881+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 0x7f69b8007e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:06:39.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:39.285+0000 7f69cbfff640 1 -- 172.21.15.5:0/860953435 >> v1:172.21.15.5:6789/0 conn(0x7f69b800c1b0 legacy=0x7f69b800e670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:06:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:39.285+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 0x7f69b8007e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:39.285+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request con 0x7f69b8005a70 auth_method 0 2024-08-18T21:06:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:39.285+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:39.285+0000 7f69cb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:39.285+0000 7f69cb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:39.285+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 msgr2=0x7f69b8007e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:06:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:39.285+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 msgr2=0x7f69b8007e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:39.285+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 0x7f69b8007e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:39.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:39.285+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 0x7f69b8007e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:06:40.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.089+0000 7f69cbfff640 1 -- 172.21.15.5:0/860953435 >> v1:172.21.15.5:6789/0 conn(0x7f69b800c1b0 legacy=0x7f69b800e670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:06:40.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.089+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 0x7f69b8007e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:40.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.089+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request con 0x7f69b8005a70 auth_method 0 2024-08-18T21:06:40.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.089+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:40.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.089+0000 7f69cb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:40.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.089+0000 7f69cb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.089+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 msgr2=0x7f69b8007e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:06:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.089+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 msgr2=0x7f69b8007e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:06:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.089+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 0x7f69b8007e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.089+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 0x7f69b8007e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:06:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.577+0000 7f69ca7fc640 1 -- 172.21.15.5:0/860953435 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2437468301 0 0) 0x7f69b8010f10 con 0x7f69b8008480 2024-08-18T21:06:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.577+0000 7f69ca7fc640 10 monclient(hunting): _negotiate 2024-08-18T21:06:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.577+0000 7f69ca7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.577+0000 7f69ca7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.577+0000 7f69ca7fc640 10 monclient(hunting): my global_id is 5095 2024-08-18T21:06:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.577+0000 7f69ca7fc640 1 -- 172.21.15.5:0/860953435 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69b4003530 con 0x7f69b8008480 2024-08-18T21:06:40.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69ca7fc640 1 -- 172.21.15.5:0/860953435 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 972716887 0 0) 0x7f69b4003530 con 0x7f69b8008480 2024-08-18T21:06:40.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69ca7fc640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 msgr2=0x7f69b8007e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:06:40.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69ca7fc640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69b8005a70 0x7f69b8007e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69ca7fc640 1 -- 172.21.15.5:0/860953435 >> v1:172.21.15.5:6789/0 conn(0x7f69b800c1b0 legacy=0x7f69b800e670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:06:40.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69ca7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:06:40.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69ca7fc640 1 monclient: found mon.noname-f-legacy 2024-08-18T21:06:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69ca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69ca7fc640 10 monclient: _send_mon_message to mon.noname-f-legacy at v1:172.21.15.157:6789/0 2024-08-18T21:06:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69cbfff640 1 -- 172.21.15.5:0/860953435 reap_dead start 2024-08-18T21:06:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69ca7fc640 1 -- 172.21.15.5:0/860953435 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b8012270 con 0x7f69b8008480 2024-08-18T21:06:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69ca7fc640 10 monclient: _finish_auth 0 2024-08-18T21:06:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69ca7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:06:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69ca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69ca7fc640 1 -- 172.21.15.5:0/860953435 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 4141550541 0 0) 0x7f69c000d930 con 0x7f69b8008480 2024-08-18T21:06:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69ca7fc640 10 monclient: got monmap 1 from mon.noname-f-legacy (according to old e1) 2024-08-18T21:06:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.581+0000 7f69ca7fc640 10 monclient: dump: 2024-08-18T21:06:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:40.592 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 1 monclient: mon.f has (v2) addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] but i'm connected to v1:172.21.15.157:6789/0, reconnecting 2024-08-18T21:06:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 1 -- 172.21.15.5:0/860953435 >> v1:172.21.15.157:6789/0 conn(0x7f69b8008480 legacy=0x7f69b800a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 10 monclient: _add_conns ranks=[8,5,1,0,4,3,7,2,6] 2024-08-18T21:06:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69b4004210 0x7f69b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 10 monclient(hunting): picked mon.e con 0x7f69b4004210 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f69b4004e70 0x7f69b40099c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 10 monclient(hunting): picked mon.h con 0x7f69b4004e70 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69b4009f00 0x7f69b400c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 10 monclient(hunting): picked mon.f con 0x7f69b4009f00 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:06:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 1 -- 172.21.15.5:0/860953435 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc0a58a0 con 0x7f69b4009f00 2024-08-18T21:06:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 1 -- 172.21.15.5:0/860953435 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f69b400ca40 con 0x7f69b4004e70 2024-08-18T21:06:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 1 -- 172.21.15.5:0/860953435 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f69b400cbf0 con 0x7f69b4004210 2024-08-18T21:06:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69ca7fc640 10 monclient(hunting): _finish_auth 0 2024-08-18T21:06:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69b4004210 0x7f69b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request con 0x7f69b4004210 auth_method 0 2024-08-18T21:06:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69caffd640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f69b4004e70 0x7f69b40099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69caffd640 10 monclient(hunting): get_auth_request con 0x7f69b4004e70 auth_method 0 2024-08-18T21:06:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69caffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69caffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:06:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69caffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:06:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 10 monclient(hunting): handle_auth_done global_id 5095 payload 293 2024-08-18T21:06:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f69b4004e70 msgr2=0x7f69b40099c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f69b4004e70 0x7f69b40099c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69b4009f00 msgr2=0x7f69b400c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69b4009f00 0x7f69b400c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:06:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 1 monclient: found mon.e 2024-08-18T21:06:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:06:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b4003530 con 0x7f69b4004210 2024-08-18T21:06:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 10 monclient: _finish_auth 0 2024-08-18T21:06:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:06:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69d1e9c640 5 monclient: authenticate success, global_id 5095 2024-08-18T21:06:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.585+0000 7f69d1e9c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:06:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69cb7fe640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69b4004210 msgr2=0x7f69b4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69b4004210 0x7f69b4004810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f69b80036b0 tx=0x7f69bc01e970 comp rx=0 tx=0).ready entity=mon.8 client_cookie=29ce8279c27691cd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69ca7fc640 1 -- 172.21.15.5:0/860953435 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f69bc0b0020 con 0x7f69b4004210 2024-08-18T21:06:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69ca7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69ca7fc640 10 monclient: dump: 2024-08-18T21:06:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:40.599 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69d1e9c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:06:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69ca7fc640 1 -- 172.21.15.5:0/860953435 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69bc0a88a0 con 0x7f69b4004210 2024-08-18T21:06:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69ca7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69d1e9c640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69ca7fc640 1 -- 172.21.15.5:0/860953435 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f69bc0098a0 con 0x7f69b4004210 2024-08-18T21:06:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69d1e9c640 4 set_mon_vals no callback set 2024-08-18T21:06:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69ca7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69ca7fc640 10 monclient: dump: 2024-08-18T21:06:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:40.601 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69d1e9c640 10 monclient: shutdown 2024-08-18T21:06:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69d1e9c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69d1e9c640 1 -- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69b4004210 msgr2=0x7f69b4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69d1e9c640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69b4004210 0x7f69b4004810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f69b80036b0 tx=0x7f69bc01e970 comp rx=0 tx=0).stop 2024-08-18T21:06:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69d1e9c640 1 -- 172.21.15.5:0/860953435 shutdown_connections 2024-08-18T21:06:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69d1e9c640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69b4009f00 0x7f69b400c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69d1e9c640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f69b4004e70 0x7f69b40099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69d1e9c640 1 --2- 172.21.15.5:0/860953435 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69b4004210 0x7f69b4004810 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69d1e9c640 1 -- 172.21.15.5:0/860953435 >> 172.21.15.5:0/860953435 conn(0x7f69cc068700 msgr2=0x7f69cc068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69d1e9c640 1 -- 172.21.15.5:0/860953435 shutdown_connections 2024-08-18T21:06:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.593+0000 7f69d1e9c640 1 -- 172.21.15.5:0/860953435 wait complete. 2024-08-18T21:06:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 10 monclient: build_initial_monmap 2024-08-18T21:06:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 10 monclient: monmap: 2024-08-18T21:06:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:40.609 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 1 Processor -- start 2024-08-18T21:06:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 1 -- start start 2024-08-18T21:06:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 10 monclient: init 2024-08-18T21:06:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 10 monclient: _add_conns ranks=[2,4,8,0,6,7,5,3,1] 2024-08-18T21:06:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69b4004210 0x7f69cc1350f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 10 monclient(hunting): picked mon.noname-b con 0x7f69b4004210 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69b4004e70 0x7f69cc135630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 10 monclient(hunting): picked mon.noname-c con 0x7f69b4004e70 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69b4009f00 0x7f69cc0700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 10 monclient(hunting): picked mon.noname-e con 0x7f69b4009f00 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f69cc136fe0 con 0x7f69b4004210 2024-08-18T21:06:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f69cc136e60 con 0x7f69b4004e70 2024-08-18T21:06:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f69cc137160 con 0x7f69b4009f00 2024-08-18T21:06:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69d1e9c640 10 monclient(hunting): authenticate will time out at 1167.615017s 2024-08-18T21:06:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cb7fe640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69b4004210 msgr2=0x7f69cc1350f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:06:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cb7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69b4004210 0x7f69cc1350f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:06:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69b4009f00 0x7f69cc0700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69b4009f00 0x7f69cc0700a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:44454/0 (socket says 172.21.15.5:44454) 2024-08-18T21:06:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 1 -- 172.21.15.5:0/2441441851 learned_addr learned my addr 172.21.15.5:0/2441441851 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 10 monclient(hunting): get_auth_request con 0x7f69b4009f00 auth_method 0 2024-08-18T21:06:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69caffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69b4004e70 0x7f69cc135630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69caffd640 10 monclient(hunting): get_auth_request con 0x7f69b4004e70 auth_method 0 2024-08-18T21:06:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69caffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69caffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 10 monclient(hunting): handle_auth_done global_id 54278 payload 824 2024-08-18T21:06:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 1 -- 172.21.15.5:0/2441441851 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69b4004e70 msgr2=0x7f69cc135630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 1 --2- 172.21.15.5:0/2441441851 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69b4004e70 0x7f69cc135630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 1 -- 172.21.15.5:0/2441441851 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69b4004210 msgr2=0x7f69cc1350f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:06:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 1 --2- 172.21.15.5:0/2441441851 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69b4004210 0x7f69cc1350f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 10 monclient: _finish_hunting 0 2024-08-18T21:06:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 1 monclient: found mon.noname-e 2024-08-18T21:06:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:06:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.597+0000 7f69cbfff640 1 -- 172.21.15.5:0/2441441851 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69cc073dc0 con 0x7f69b4009f00 2024-08-18T21:06:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69cbfff640 1 -- 172.21.15.5:0/2441441851 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69b4009f00 msgr2=0x7f69cc0700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69cbfff640 1 --2- 172.21.15.5:0/2441441851 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69b4009f00 0x7f69cc0700a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f69cc069930 tx=0x7f69c400b810 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69b3fff640 1 -- 172.21.15.5:0/2441441851 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f69c4006750 con 0x7f69b4009f00 2024-08-18T21:06:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69b3fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:06:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69b3fff640 10 monclient: dump: 2024-08-18T21:06:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:40.614 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69b3fff640 10 monclient: _finish_auth 0 2024-08-18T21:06:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69b3fff640 10 monclient: _check_auth_tickets 2024-08-18T21:06:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69b3fff640 1 -- 172.21.15.5:0/2441441851 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69c4006950 con 0x7f69b4009f00 2024-08-18T21:06:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69d1e9c640 5 monclient: authenticate success, global_id 54278 2024-08-18T21:06:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69d1e9c640 10 monclient: _renew_subs 2024-08-18T21:06:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69d1e9c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:06:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69d1e9c640 1 -- 172.21.15.5:0/2441441851 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69cc1c2310 con 0x7f69b4009f00 2024-08-18T21:06:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69b3fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69b3fff640 1 -- 172.21.15.5:0/2441441851 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f69c4006b00 con 0x7f69b4009f00 2024-08-18T21:06:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69c9ffb640 4 set_mon_vals no callback set 2024-08-18T21:06:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69b3fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69b3fff640 10 monclient: dump: 2024-08-18T21:06:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:40.616 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69d1e9c640 10 monclient: _renew_subs 2024-08-18T21:06:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69d1e9c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:06:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69d1e9c640 1 -- 172.21.15.5:0/2441441851 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f69cc072620 con 0x7f69b4009f00 2024-08-18T21:06:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69d1e9c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69d1e9c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69d1e9c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:06:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69b3fff640 1 -- 172.21.15.5:0/2441441851 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f69c4010070 con 0x7f69b4009f00 2024-08-18T21:06:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.601+0000 7f69d1e9c640 1 -- 172.21.15.5:0/2441441851 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69cc137490 con 0x7f69b4009f00 2024-08-18T21:06:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.605+0000 7f69b3fff640 1 --2- 172.21.15.5:0/2441441851 >> v2:172.21.15.157:6812/631023601 conn(0x7f69b803cc90 0x7f69b803f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.605+0000 7f69b3fff640 1 -- 172.21.15.5:0/2441441851 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(83..83 src has 22..83) ==== 3898+0+0 (secure 0 0 0) 0x7f69c404d850 con 0x7f69b4009f00 2024-08-18T21:06:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.605+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/2441441851 >> v2:172.21.15.157:6812/631023601 conn(0x7f69b803cc90 0x7f69b803f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.605+0000 7f69cb7fe640 10 monclient: get_auth_request con 0x7f69b803cc90 auth_method 0 2024-08-18T21:06:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.605+0000 7f69cb7fe640 1 --2- 172.21.15.5:0/2441441851 >> v2:172.21.15.157:6812/631023601 conn(0x7f69b803cc90 0x7f69b803f150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0ae000 tx=0x7f69bc004ac0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.609+0000 7f69b3fff640 1 -- 172.21.15.5:0/2441441851 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f69c4018060 con 0x7f69b4009f00 2024-08-18T21:06:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.609+0000 7f69b3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.609+0000 7f69b3fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:40.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69d1e9c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:06:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69d1e9c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:06:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69d1e9c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:06:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69d1e9c640 1 -- 172.21.15.5:0/2441441851 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f69cc0748a0 con 0x7f69b4009f00 2024-08-18T21:06:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69b3fff640 1 -- 172.21.15.5:0/2441441851 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3160 (secure 0 0 0) 0x7f69c4006e20 con 0x7f69b4009f00 2024-08-18T21:06:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69b3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:06:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69b3fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:40.850 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":74,"quorum":[1,3,4,5,6,7,8],"quorum_names":["f","g","c","h","d","i","e"],"quorum_leader_name":"f","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:06:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69d1e9c640 1 -- 172.21.15.5:0/2441441851 >> v2:172.21.15.157:6812/631023601 conn(0x7f69b803cc90 msgr2=0x7f69b803f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69d1e9c640 1 --2- 172.21.15.5:0/2441441851 >> v2:172.21.15.157:6812/631023601 conn(0x7f69b803cc90 0x7f69b803f150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0ae000 tx=0x7f69bc004ac0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69d1e9c640 10 monclient: shutdown 2024-08-18T21:06:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69d1e9c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69d1e9c640 1 -- 172.21.15.5:0/2441441851 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69b4009f00 msgr2=0x7f69cc0700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69d1e9c640 1 --2- 172.21.15.5:0/2441441851 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69b4009f00 0x7f69cc0700a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f69cc069930 tx=0x7f69c400b810 comp rx=0 tx=0).stop 2024-08-18T21:06:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69d1e9c640 1 -- 172.21.15.5:0/2441441851 shutdown_connections 2024-08-18T21:06:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69d1e9c640 1 --2- 172.21.15.5:0/2441441851 >> v2:172.21.15.157:6812/631023601 conn(0x7f69b803cc90 0x7f69b803f150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69d1e9c640 1 --2- 172.21.15.5:0/2441441851 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f69b4009f00 0x7f69cc0700a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69d1e9c640 1 --2- 172.21.15.5:0/2441441851 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69b4004e70 0x7f69cc135630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.845+0000 7f69d1e9c640 1 --2- 172.21.15.5:0/2441441851 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69b4004210 0x7f69cc1350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.849+0000 7f69d1e9c640 1 -- 172.21.15.5:0/2441441851 >> 172.21.15.5:0/2441441851 conn(0x7f69cc068700 msgr2=0x7f69cc0a7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.849+0000 7f69d1e9c640 1 -- 172.21.15.5:0/2441441851 shutdown_connections 2024-08-18T21:06:40.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.849+0000 7f69d1e9c640 1 -- 172.21.15.5:0/2441441851 wait complete. 2024-08-18T21:06:40.867 INFO:tasks.mon_thrash.ceph_manager:quorum is size 7 2024-08-18T21:06:40.867 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon c 2024-08-18T21:06:40.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:06:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 10 monclient: get_monmap_and_config 2024-08-18T21:06:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 10 monclient: build_initial_monmap 2024-08-18T21:06:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 10 monclient: monmap: 2024-08-18T21:06:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:40.980618+0000 2024-08-18T21:06:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:40.980618+0000 2024-08-18T21:06:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:40.981 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 1 Processor -- start 2024-08-18T21:06:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 1 -- start start 2024-08-18T21:06:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 10 monclient: init 2024-08-18T21:06:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 10 monclient: _add_conns ranks=[10,1,4,8,6,5,0,2,9,7,3] 2024-08-18T21:06:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3c700a59e0 0x7f3c700a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 10 monclient(hunting): picked mon.noname-f con 0x7f3c700a59e0 addr v2:172.21.15.157:3300/0 2024-08-18T21:06:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f3c700a0cd0 addr v1:172.21.15.157:6789/0 2024-08-18T21:06:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c700a6300 0x7f3c7013a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 10 monclient(hunting): picked mon.noname-c con 0x7f3c700a6300 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c700a16b0 con 0x7f3c700a0cd0 2024-08-18T21:06:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3c7006de40 con 0x7f3c700a59e0 2024-08-18T21:06:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f3c7006f0f0 con 0x7f3c700a6300 2024-08-18T21:06:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c782c2640 10 monclient(hunting): authenticate will time out at 1167.993760s 2024-08-18T21:06:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c700a6300 0x7f3c7013a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c700a6300 0x7f3c7013a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:41216/0 (socket says 172.21.15.5:41216) 2024-08-18T21:06:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 1 -- 172.21.15.5:0/4257503530 learned_addr learned my addr 172.21.15.5:0/4257503530 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 10 monclient(hunting): get_auth_request con 0x7f3c700a6300 auth_method 0 2024-08-18T21:06:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7605e640 1 --2- 172.21.15.5:0/4257503530 >> v2:172.21.15.157:3300/0 conn(0x7f3c700a59e0 0x7f3c700a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7605e640 10 monclient(hunting): get_auth_request con 0x7f3c700a59e0 auth_method 0 2024-08-18T21:06:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7605e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7605e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7605e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 10 monclient(hunting): handle_auth_done global_id 5206 payload 274 2024-08-18T21:06:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 1 -- 172.21.15.5:0/4257503530 >> v2:172.21.15.157:3300/0 conn(0x7f3c700a59e0 msgr2=0x7f3c700a5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 1 --2- 172.21.15.5:0/4257503530 >> v2:172.21.15.157:3300/0 conn(0x7f3c700a59e0 0x7f3c700a5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 1 -- 172.21.15.5:0/4257503530 >> v1:172.21.15.157:6789/0 conn(0x7f3c700a0cd0 legacy=0x7f3c70139b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 10 monclient: _finish_hunting 0 2024-08-18T21:06:40.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 1 monclient: found mon.noname-c 2024-08-18T21:06:40.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:40.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:06:40.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7685f640 1 -- 172.21.15.5:0/4257503530 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7006f880 con 0x7f3c700a6300 2024-08-18T21:06:40.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.977+0000 7f3c7605e640 1 --2- 172.21.15.5:0/4257503530 >> v2:172.21.15.157:3300/0 conn(0x7f3c700a59e0 0x7f3c700a5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:06:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c7685f640 1 -- 172.21.15.5:0/4257503530 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c700a6300 msgr2=0x7f3c7013a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c7685f640 1 --2- 172.21.15.5:0/4257503530 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c700a6300 0x7f3c7013a290 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009870 tx=0x7f3c5801c4b0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=693eaf1dffbcacdf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c7505c640 1 -- 172.21.15.5:0/4257503530 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3c580b0070 con 0x7f3c700a6300 2024-08-18T21:06:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c7505c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c7505c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:06:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c7505c640 10 monclient: dump: 2024-08-18T21:06:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:40.989 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c7505c640 10 monclient: _finish_auth 0 2024-08-18T21:06:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c7505c640 10 monclient: _check_auth_tickets 2024-08-18T21:06:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c7505c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c782c2640 5 monclient: authenticate success, global_id 5206 2024-08-18T21:06:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c7505c640 1 -- 172.21.15.5:0/4257503530 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c580aa810 con 0x7f3c700a6300 2024-08-18T21:06:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c7505c640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c782c2640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c782c2640 4 set_mon_vals no callback set 2024-08-18T21:06:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c7505c640 1 -- 172.21.15.5:0/4257503530 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3c580aae30 con 0x7f3c700a6300 2024-08-18T21:06:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c7505c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:40.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c7505c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:40.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.981+0000 7f3c7505c640 10 monclient: dump: 2024-08-18T21:06:40.990 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:40.990 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:40.990 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:40.990 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:40.990 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:40.990 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:40.990 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:40.990 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:40.990 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:40.990 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:40.990 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:40.991 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:40.991 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:40.991 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:40.991 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:40.991 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:40.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 10 monclient: shutdown 2024-08-18T21:06:40.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:40.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 1 -- 172.21.15.5:0/4257503530 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c700a6300 msgr2=0x7f3c7013a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:40.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 1 --2- 172.21.15.5:0/4257503530 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c700a6300 0x7f3c7013a290 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009870 tx=0x7f3c5801c4b0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 1 -- 172.21.15.5:0/4257503530 shutdown_connections 2024-08-18T21:06:40.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 1 --2- 172.21.15.5:0/4257503530 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c700a6300 0x7f3c7013a290 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 1 --2- 172.21.15.5:0/4257503530 >> v2:172.21.15.157:3300/0 conn(0x7f3c700a59e0 0x7f3c700a5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:40.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 1 -- 172.21.15.5:0/4257503530 >> 172.21.15.5:0/4257503530 conn(0x7f3c700aa5d0 msgr2=0x7f3c700a6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:40.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 1 -- 172.21.15.5:0/4257503530 shutdown_connections 2024-08-18T21:06:40.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 1 -- 172.21.15.5:0/4257503530 wait complete. 2024-08-18T21:06:40.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 10 monclient: build_initial_monmap 2024-08-18T21:06:40.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 10 monclient: monmap: 2024-08-18T21:06:40.998 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:40.998 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:40.998 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:40.998 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:40.998 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:40.998 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:40.998 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:40.998 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:40.999 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 1 Processor -- start 2024-08-18T21:06:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 1 -- start start 2024-08-18T21:06:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 10 monclient: init 2024-08-18T21:06:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 10 monclient: _add_conns ranks=[6,2,7,5,3,0,8,1,4] 2024-08-18T21:06:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3c700a0cd0 0x7f3c70139180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 10 monclient(hunting): picked mon.noname-d con 0x7f3c700a0cd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c700a59e0 0x7f3c701396c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 10 monclient(hunting): picked mon.noname-b con 0x7f3c700a59e0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3c700a6300 0x7f3c7013d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 10 monclient(hunting): picked mon.noname-i con 0x7f3c700a6300 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f3c7006e080 con 0x7f3c700a59e0 2024-08-18T21:06:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f3c7013a9e0 con 0x7f3c700a0cd0 2024-08-18T21:06:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f3c7006e200 con 0x7f3c700a6300 2024-08-18T21:06:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c782c2640 10 monclient(hunting): authenticate will time out at 1168.002088s 2024-08-18T21:06:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7585d640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c700a59e0 msgr2=0x7f3c701396c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:06:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7585d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c700a59e0 0x7f3c701396c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:06:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3c700a0cd0 0x7f3c70139180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3c700a0cd0 0x7f3c70139180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:45080/0 (socket says 172.21.15.5:45080) 2024-08-18T21:06:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 1 -- 172.21.15.5:0/521632502 learned_addr learned my addr 172.21.15.5:0/521632502 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 10 monclient(hunting): get_auth_request con 0x7f3c700a0cd0 auth_method 0 2024-08-18T21:06:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7685f640 1 --2- 172.21.15.5:0/521632502 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3c700a6300 0x7f3c7013d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7685f640 10 monclient(hunting): get_auth_request con 0x7f3c700a6300 auth_method 0 2024-08-18T21:06:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7685f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7685f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7685f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 10 monclient(hunting): handle_auth_done global_id 54258 payload 824 2024-08-18T21:06:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 1 -- 172.21.15.5:0/521632502 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3c700a6300 msgr2=0x7f3c7013d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 1 --2- 172.21.15.5:0/521632502 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3c700a6300 0x7f3c7013d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 1 -- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c700a59e0 msgr2=0x7f3c701396c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:06:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 1 --2- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c700a59e0 0x7f3c701396c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 10 monclient: _finish_hunting 0 2024-08-18T21:06:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 1 monclient: found mon.noname-d 2024-08-18T21:06:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:06:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.985+0000 7f3c7605e640 1 -- 172.21.15.5:0/521632502 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c700a9b90 con 0x7f3c700a0cd0 2024-08-18T21:06:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c7605e640 1 -- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3c700a0cd0 msgr2=0x7f3c70139180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c7605e640 1 --2- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3c700a0cd0 0x7f3c70139180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000e810 tx=0x7f3c6000ecd0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c6effd640 1 -- 172.21.15.5:0/521632502 DispatchQueue::entry inject delay of 0.002000 2024-08-18T21:06:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c6effd640 1 -- 172.21.15.5:0/521632502 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3c60017070 con 0x7f3c700a0cd0 2024-08-18T21:06:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c6effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:06:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c6effd640 10 monclient: dump: 2024-08-18T21:06:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.004 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c6effd640 10 monclient: _finish_auth 0 2024-08-18T21:06:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c6effd640 10 monclient: _check_auth_tickets 2024-08-18T21:06:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c6effd640 1 -- 172.21.15.5:0/521632502 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c6000cd50 con 0x7f3c700a0cd0 2024-08-18T21:06:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c6effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c6effd640 1 -- 172.21.15.5:0/521632502 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3c6000f040 con 0x7f3c700a0cd0 2024-08-18T21:06:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c6effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c6effd640 10 monclient: dump: 2024-08-18T21:06:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.006 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.006 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.006 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.006 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c782c2640 5 monclient: authenticate success, global_id 54258 2024-08-18T21:06:41.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c6ffff640 4 set_mon_vals no callback set 2024-08-18T21:06:41.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c782c2640 10 monclient: _renew_subs 2024-08-18T21:06:41.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c782c2640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:41.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c782c2640 1 -- 172.21.15.5:0/521632502 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c70140d20 con 0x7f3c700a0cd0 2024-08-18T21:06:41.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c782c2640 10 monclient: _renew_subs 2024-08-18T21:06:41.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c782c2640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:41.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c782c2640 1 -- 172.21.15.5:0/521632502 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c7013fae0 con 0x7f3c700a0cd0 2024-08-18T21:06:41.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c782c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c782c2640 1 --2- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c7013d9d0 0x7f3c7013ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c782c2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.989+0000 7f3c782c2640 1 -- 172.21.15.5:0/521632502 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f3c70051140 con 0x7f3c7013d9d0 2024-08-18T21:06:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c7585d640 1 --2- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c7013d9d0 0x7f3c7013ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c7585d640 10 monclient: get_auth_request con 0x7f3c7013d9d0 auth_method 0 2024-08-18T21:06:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c7585d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c7585d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c7585d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c7585d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c7585d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c7585d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c6effd640 1 -- 172.21.15.5:0/521632502 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f3c6001a070 con 0x7f3c700a0cd0 2024-08-18T21:06:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c7585d640 10 monclient(hunting): handle_auth_done global_id 5215 payload 824 2024-08-18T21:06:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c7585d640 1 -- 172.21.15.5:0/521632502 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c7013e2f0 con 0x7f3c7013d9d0 2024-08-18T21:06:41.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c6effd640 1 --2- 172.21.15.5:0/521632502 >> v2:172.21.15.157:6812/631023601 conn(0x7f3c5003bdc0 0x7f3c5003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c6effd640 1 -- 172.21.15.5:0/521632502 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(83..83 src has 22..83) ==== 3898+0+0 (secure 0 0 0) 0x7f3c6004e220 con 0x7f3c700a0cd0 2024-08-18T21:06:41.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c7685f640 1 --2- 172.21.15.5:0/521632502 >> v2:172.21.15.157:6812/631023601 conn(0x7f3c5003bdc0 0x7f3c5003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c7685f640 10 monclient: get_auth_request con 0x7f3c5003bdc0 auth_method 0 2024-08-18T21:06:41.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c7585d640 1 -- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c7013d9d0 msgr2=0x7f3c7013ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c7585d640 1 --2- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c7013d9d0 0x7f3c7013ddb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c7013a6d0 tx=0x7f3c6800cb80 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c6effd640 1 -- 172.21.15.5:0/521632502 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3c68017070 con 0x7f3c7013d9d0 2024-08-18T21:06:41.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c6effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:41.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c6effd640 10 monclient: dump: 2024-08-18T21:06:41.010 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.010 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.012 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c6effd640 1 -- 172.21.15.5:0/521632502 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3c6800a600 con 0x7f3c7013d9d0 2024-08-18T21:06:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c6effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c6effd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c6effd640 1 -- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c7013d9d0 msgr2=0x7f3c7013ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c6effd640 1 --2- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c7013d9d0 0x7f3c7013ddb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c7013a6d0 tx=0x7f3c6800cb80 comp rx=0 tx=0).stop 2024-08-18T21:06:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c6effd640 1 -- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c7013d9d0 msgr2=0x7f3c7013ddb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c6effd640 1 --2- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c7013d9d0 0x7f3c7013ddb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:40.993+0000 7f3c7685f640 1 --2- 172.21.15.5:0/521632502 >> v2:172.21.15.157:6812/631023601 conn(0x7f3c5003bdc0 0x7f3c5003e280 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3c580ab000 tx=0x7f3c580a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c782c2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c782c2640 1 --2- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c7009e1f0 0x7f3c7009e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c782c2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c782c2640 1 -- 172.21.15.5:0/521632502 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f3c700a31d0 con 0x7f3c7009e1f0 2024-08-18T21:06:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c7585d640 1 --2- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c7009e1f0 0x7f3c7009e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c7585d640 10 monclient: get_auth_request con 0x7f3c7009e1f0 auth_method 0 2024-08-18T21:06:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c7585d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c7585d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c7585d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c7585d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c7585d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c7585d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c7585d640 10 monclient(hunting): handle_auth_done global_id 5224 payload 824 2024-08-18T21:06:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c7585d640 1 -- 172.21.15.5:0/521632502 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3c700a5dc0 con 0x7f3c7009e1f0 2024-08-18T21:06:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c7585d640 1 -- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c7009e1f0 msgr2=0x7f3c7009e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c7585d640 1 --2- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c7009e1f0 0x7f3c7009e600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3c68000f90 tx=0x7f3c68003b00 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c6effd640 1 -- 172.21.15.5:0/521632502 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3c68017040 con 0x7f3c7009e1f0 2024-08-18T21:06:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c6effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.001+0000 7f3c6effd640 10 monclient: dump: 2024-08-18T21:06:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.015 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c6effd640 1 -- 172.21.15.5:0/521632502 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9392 (secure 0 0 0) 0x7f3c68007070 con 0x7f3c7009e1f0 2024-08-18T21:06:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c6effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c6effd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c6effd640 1 -- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c7009e1f0 msgr2=0x7f3c7009e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c6effd640 1 --2- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c7009e1f0 0x7f3c7009e600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3c68000f90 tx=0x7f3c68003b00 comp rx=0 tx=0).stop 2024-08-18T21:06:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c6effd640 1 -- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c7009e1f0 msgr2=0x7f3c7009e600 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c6effd640 1 --2- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c7009e1f0 0x7f3c7009e600 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3c68000f90 tx=0x7f3c68003b00 comp rx=0 tx=0).stop 2024-08-18T21:06:41.015 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:41.015 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:41.015 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:41.016 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:41.016 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 74, 2024-08-18T21:06:41.016 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 210118, 2024-08-18T21:06:41.016 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:41.016 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:41.016 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:41.016 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:41.016 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:41.016 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:41.016 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:41.016 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:41.016 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.016 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:06:41.017 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:41.017 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:41.017 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:41.017 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.017 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.017 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.017 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.017 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.017 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.017 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.017 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.017 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.017 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.017 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.018 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.018 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:41.018 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:41.018 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.018 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.018 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.018 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.018 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.018 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.018 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.018 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.018 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.018 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.019 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.019 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.019 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:41.019 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:41.019 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:41.019 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:41.019 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:41.019 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:41.019 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:41.019 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:41.019 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:41.019 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:41.019 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:41.020 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:41.020 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:41.020 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:41.020 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:41.020 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:41.020 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:41.020 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.020 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.020 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.020 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.020 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.020 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.020 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.020 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.021 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.021 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.021 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.021 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.021 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:41.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.021 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:41.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.021 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:41.021 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:41.021 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.021 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.021 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.022 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:41.022 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.022 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.022 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:41.022 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.022 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.022 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.022 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:41.022 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:41.022 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.022 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.023 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.023 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:41.023 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:41.023 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.023 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.023 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:41.023 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.024 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:41.024 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.024 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.024 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.024 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:41.024 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:41.024 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.024 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.024 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.024 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:41.025 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:41.025 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:41.025 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:41.025 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.025 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.025 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.026 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:41.026 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:41.026 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.026 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.026 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.026 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:41.026 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:41.026 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.026 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:41.027 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:41.027 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.027 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.027 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:41.027 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:41.028 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.028 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.028 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.028 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:41.028 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:41.028 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.028 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.028 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.028 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:41.028 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.029 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.029 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:41.029 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.029 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.029 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.029 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:41.029 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:41.029 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.029 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.029 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.030 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:41.030 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:41.030 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.030 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.030 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:41.030 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.030 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:41.030 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.030 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.030 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:41.031 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:41.031 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.031 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.031 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.031 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:41.031 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:41.031 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.031 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:41.032 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.032 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:41.032 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.032 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.032 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.032 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:41.032 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:41.032 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.032 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.032 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.033 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:41.033 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:41.033 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.033 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.033 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.033 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:41.033 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.033 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.033 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:41.033 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.034 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.034 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.034 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:41.034 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:41.034 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.034 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.034 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.034 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:41.034 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:41.034 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.034 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.035 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.035 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:41.035 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.035 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.035 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:41.035 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.035 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.035 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.035 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:41.035 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:41.036 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.036 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.036 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.036 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.036 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.036 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:41.036 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:41.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.036 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:41.036 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:41.036 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:41.036 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.036 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.036 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:06:41.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.037 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:41.037 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:41.037 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:06:41.037 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.037 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.037 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:41.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.037 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:41.037 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:41.037 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:41.037 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.037 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.038 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:41.038 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c782c2640 1 -- 172.21.15.5:0/521632502 >> v2:172.21.15.157:6812/631023601 conn(0x7f3c5003bdc0 msgr2=0x7f3c5003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c782c2640 1 --2- 172.21.15.5:0/521632502 >> v2:172.21.15.157:6812/631023601 conn(0x7f3c5003bdc0 0x7f3c5003e280 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3c580ab000 tx=0x7f3c580a6000 comp rx=0 tx=0).stop 2024-08-18T21:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c782c2640 10 monclient: shutdown 2024-08-18T21:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c782c2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c782c2640 1 -- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3c700a0cd0 msgr2=0x7f3c70139180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c782c2640 1 --2- 172.21.15.5:0/521632502 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3c700a0cd0 0x7f3c70139180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000e810 tx=0x7f3c6000ecd0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c7685f640 1 -- 172.21.15.5:0/521632502 reap_dead start 2024-08-18T21:06:41.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c7685f640 1 -- 172.21.15.5:0/521632502 reap_dead start 2024-08-18T21:06:41.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c782c2640 1 -- 172.21.15.5:0/521632502 shutdown_connections 2024-08-18T21:06:41.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c782c2640 1 -- 172.21.15.5:0/521632502 >> 172.21.15.5:0/521632502 conn(0x7f3c700aa5d0 msgr2=0x7f3c700a0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:41.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c782c2640 1 -- 172.21.15.5:0/521632502 shutdown_connections 2024-08-18T21:06:41.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.005+0000 7f3c782c2640 1 -- 172.21.15.5:0/521632502 wait complete. 2024-08-18T21:06:41.040 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:06:41.040 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon d 2024-08-18T21:06:41.040 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.157+0000 7f028a00d640 10 monclient: get_monmap_and_config 2024-08-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.157+0000 7f028a00d640 10 monclient: build_initial_monmap 2024-08-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.157+0000 7f028a00d640 10 monclient: monmap: 2024-08-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:41.163584+0000 2024-08-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:41.163584+0000 2024-08-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 1 Processor -- start 2024-08-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 1 -- start start 2024-08-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 10 monclient: init 2024-08-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 10 monclient: _add_conns ranks=[10,2,8,9,4,3,0,6,1,7,5] 2024-08-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f02840a4240 0x7f02841333a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 10 monclient(hunting): picked mon.noname-f con 0x7f02840a4240 addr v2:172.21.15.157:3300/0 2024-08-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02840a4620 0x7f0284070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 10 monclient(hunting): picked mon.noname-b con 0x7f02840a4620 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f02840a4a40 0x7f0284071380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 10 monclient(hunting): picked mon.noname-e con 0x7f02840a4a40 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f0284072a70 con 0x7f02840a4240 2024-08-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f0284073b10 con 0x7f02840a4620 2024-08-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f0284073df0 con 0x7f02840a4a40 2024-08-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f028a00d640 10 monclient(hunting): authenticate will time out at 1168.177219s 2024-08-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0282ffd640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02840a4620 msgr2=0x7f0284070e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0282ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02840a4620 0x7f0284070e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f02840a4a40 0x7f0284071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f02840a4a40 0x7f0284071380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:44456/0 (socket says 172.21.15.5:44456) 2024-08-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 1 -- 172.21.15.5:0/3144702005 learned_addr learned my addr 172.21.15.5:0/3144702005 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 10 monclient(hunting): get_auth_request con 0x7f02840a4a40 auth_method 0 2024-08-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f02837fe640 1 --2- 172.21.15.5:0/3144702005 >> v2:172.21.15.157:3300/0 conn(0x7f02840a4240 0x7f02841333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f02837fe640 10 monclient(hunting): get_auth_request con 0x7f02840a4240 auth_method 0 2024-08-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f02837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f02837fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f02837fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 10 monclient(hunting): handle_auth_done global_id 54287 payload 274 2024-08-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 1 -- 172.21.15.5:0/3144702005 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02840a4620 msgr2=0x7f0284070e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 1 --2- 172.21.15.5:0/3144702005 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02840a4620 0x7f0284070e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 1 -- 172.21.15.5:0/3144702005 >> v2:172.21.15.157:3300/0 conn(0x7f02840a4240 msgr2=0x7f02841333a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 1 --2- 172.21.15.5:0/3144702005 >> v2:172.21.15.157:3300/0 conn(0x7f02840a4240 0x7f02841333a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 10 monclient: _finish_hunting 0 2024-08-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 1 monclient: found mon.noname-e 2024-08-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.161+0000 7f0283fff640 1 -- 172.21.15.5:0/3144702005 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0284072cb0 con 0x7f02840a4a40 2024-08-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f0283fff640 1 -- 172.21.15.5:0/3144702005 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f02840a4a40 msgr2=0x7f0284071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f0283fff640 1 --2- 172.21.15.5:0/3144702005 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f02840a4a40 0x7f0284071380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f027c009870 tx=0x7f027c01c440 comp rx=0 tx=0).ready entity=mon.8 client_cookie=1512895d13a6a326 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f02827fc640 1 -- 172.21.15.5:0/3144702005 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f027c0b0070 con 0x7f02840a4a40 2024-08-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f02827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f02827fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f02827fc640 10 monclient: dump: 2024-08-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f02827fc640 10 monclient: _finish_auth 0 2024-08-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f02827fc640 10 monclient: _check_auth_tickets 2024-08-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f02827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f028a00d640 5 monclient: authenticate success, global_id 54287 2024-08-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f028a00d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f02827fc640 1 -- 172.21.15.5:0/3144702005 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f027c0aa810 con 0x7f02840a4a40 2024-08-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f02827fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f028a00d640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f028a00d640 4 set_mon_vals no callback set 2024-08-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f02827fc640 1 -- 172.21.15.5:0/3144702005 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f027c0aae30 con 0x7f02840a4a40 2024-08-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f02827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f02827fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f02827fc640 10 monclient: dump: 2024-08-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f028a00d640 10 monclient: shutdown 2024-08-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f028a00d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f028a00d640 1 -- 172.21.15.5:0/3144702005 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f02840a4a40 msgr2=0x7f0284071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f028a00d640 1 --2- 172.21.15.5:0/3144702005 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f02840a4a40 0x7f0284071380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f027c009870 tx=0x7f027c01c440 comp rx=0 tx=0).stop 2024-08-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f028a00d640 1 -- 172.21.15.5:0/3144702005 shutdown_connections 2024-08-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f028a00d640 1 --2- 172.21.15.5:0/3144702005 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f02840a4a40 0x7f0284071380 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f028a00d640 1 --2- 172.21.15.5:0/3144702005 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f02840a4620 0x7f0284070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f028a00d640 1 --2- 172.21.15.5:0/3144702005 >> v2:172.21.15.157:3300/0 conn(0x7f02840a4240 0x7f02841333a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f028a00d640 1 -- 172.21.15.5:0/3144702005 >> 172.21.15.5:0/3144702005 conn(0x7f02840a8a90 msgr2=0x7f02840a8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.165+0000 7f028a00d640 1 -- 172.21.15.5:0/3144702005 shutdown_connections 2024-08-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 1 -- 172.21.15.5:0/3144702005 wait complete. 2024-08-18T21:06:41.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 10 monclient: build_initial_monmap 2024-08-18T21:06:41.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 10 monclient: monmap: 2024-08-18T21:06:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:41.183 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 1 Processor -- start 2024-08-18T21:06:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 1 -- start start 2024-08-18T21:06:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 10 monclient: init 2024-08-18T21:06:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 10 monclient: _add_conns ranks=[7,4,0,5,3,1,8,2,6] 2024-08-18T21:06:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02840a4240 0x7f028406fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 10 monclient(hunting): picked mon.noname-i con 0x7f02840a4240 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f02840a4620 0x7f02841389d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 10 monclient(hunting): picked mon.noname-c con 0x7f02840a4620 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02840a4a40 0x7f0284138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 10 monclient(hunting): picked mon.noname-a con 0x7f02840a4a40 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:06:41.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f02841402b0 con 0x7f02840a4a40 2024-08-18T21:06:41.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f0284140130 con 0x7f02840a4620 2024-08-18T21:06:41.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f0284140430 con 0x7f02840a4240 2024-08-18T21:06:41.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:41.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f028a00d640 10 monclient(hunting): authenticate will time out at 1168.185885s 2024-08-18T21:06:41.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0283fff640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02840a4a40 msgr2=0x7f0284138f10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:06:41.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0283fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02840a4a40 0x7f0284138f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:06:41.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f02840a4620 0x7f02841389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f02840a4620 0x7f02841389d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:41242/0 (socket says 172.21.15.5:41242) 2024-08-18T21:06:41.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 1 -- 172.21.15.5:0/2923395599 learned_addr learned my addr 172.21.15.5:0/2923395599 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 10 monclient(hunting): get_auth_request con 0x7f02840a4620 auth_method 0 2024-08-18T21:06:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f02837fe640 1 --2- 172.21.15.5:0/2923395599 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02840a4240 0x7f028406fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f02837fe640 10 monclient(hunting): get_auth_request con 0x7f02840a4240 auth_method 0 2024-08-18T21:06:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f02837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f02837fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f02837fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 10 monclient(hunting): handle_auth_done global_id 5233 payload 824 2024-08-18T21:06:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 1 -- 172.21.15.5:0/2923395599 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02840a4240 msgr2=0x7f028406fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 1 --2- 172.21.15.5:0/2923395599 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f02840a4240 0x7f028406fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 1 -- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02840a4a40 msgr2=0x7f0284138f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:06:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 1 --2- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02840a4a40 0x7f0284138f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:06:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 1 monclient: found mon.noname-c 2024-08-18T21:06:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:06:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.169+0000 7f0282ffd640 1 -- 172.21.15.5:0/2923395599 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02840a2a10 con 0x7f02840a4620 2024-08-18T21:06:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f0282ffd640 1 -- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f02840a4620 msgr2=0x7f02841389d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f0282ffd640 1 --2- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f02840a4620 0x7f02841389d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f027800b9e0 tx=0x7f027800bea0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f0282ffd640 1 --2- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f02840a4620 0x7f02841389d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f027800b9e0 tx=0x7f027800bea0 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7f027800cbb0 mon_map magic: 0 2024-08-18T21:06:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f026bfff640 1 -- 172.21.15.5:0/2923395599 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f027800cbb0 con 0x7f02840a4620 2024-08-18T21:06:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f026bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f026bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:06:41.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f026bfff640 10 monclient: dump: 2024-08-18T21:06:41.187 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.187 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.187 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.187 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.187 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.187 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.187 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.187 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.187 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.187 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.187 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.187 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.188 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f026bfff640 10 monclient: _finish_auth 0 2024-08-18T21:06:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f026bfff640 10 monclient: _check_auth_tickets 2024-08-18T21:06:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f026bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f026bfff640 1 -- 172.21.15.5:0/2923395599 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0278010070 con 0x7f02840a4620 2024-08-18T21:06:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f028a00d640 5 monclient: authenticate success, global_id 5233 2024-08-18T21:06:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f028a00d640 10 monclient: _renew_subs 2024-08-18T21:06:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f028a00d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:06:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f028a00d640 1 -- 172.21.15.5:0/2923395599 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f028413ae50 con 0x7f02840a4620 2024-08-18T21:06:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f026bfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f0281ffb640 4 set_mon_vals no callback set 2024-08-18T21:06:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f028a00d640 10 monclient: _renew_subs 2024-08-18T21:06:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f028a00d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:06:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f028a00d640 1 -- 172.21.15.5:0/2923395599 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f0284070710 con 0x7f02840a4620 2024-08-18T21:06:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f028a00d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f028a00d640 1 --2- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0284139450 0x7f02841cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f028a00d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f028a00d640 1 -- 172.21.15.5:0/2923395599 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f0284051140 con 0x7f0284139450 2024-08-18T21:06:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f02837fe640 1 --2- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0284139450 0x7f02841cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f02837fe640 10 monclient: get_auth_request con 0x7f0284139450 auth_method 0 2024-08-18T21:06:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f02837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f02837fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f02837fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f02837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f02837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f026bfff640 1 -- 172.21.15.5:0/2923395599 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f027800cd90 con 0x7f02840a4620 2024-08-18T21:06:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f02837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f026bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f026bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f026bfff640 10 monclient: dump: 2024-08-18T21:06:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.191 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f026bfff640 1 -- 172.21.15.5:0/2923395599 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f0278003d10 con 0x7f02840a4620 2024-08-18T21:06:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f02837fe640 10 monclient(hunting): handle_auth_done global_id 54267 payload 824 2024-08-18T21:06:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f02837fe640 1 -- 172.21.15.5:0/2923395599 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02840a8f70 con 0x7f0284139450 2024-08-18T21:06:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f026bfff640 1 --2- 172.21.15.5:0/2923395599 >> v2:172.21.15.157:6812/631023601 conn(0x7f027003be40 0x7f027003e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f0283fff640 1 --2- 172.21.15.5:0/2923395599 >> v2:172.21.15.157:6812/631023601 conn(0x7f027003be40 0x7f027003e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.173+0000 7f0283fff640 10 monclient: get_auth_request con 0x7f027003be40 auth_method 0 2024-08-18T21:06:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.177+0000 7f02837fe640 1 -- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0284139450 msgr2=0x7f02841cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.177+0000 7f02837fe640 1 --2- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0284139450 0x7f02841cf7c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f027400f510 tx=0x7f027400f9d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.177+0000 7f026bfff640 1 -- 172.21.15.5:0/2923395599 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0274019030 con 0x7f0284139450 2024-08-18T21:06:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.177+0000 7f026bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.177+0000 7f026bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.177+0000 7f026bfff640 10 monclient: dump: 2024-08-18T21:06:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.193 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.177+0000 7f026bfff640 1 -- 172.21.15.5:0/2923395599 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0274014880 con 0x7f0284139450 2024-08-18T21:06:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.177+0000 7f026bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.177+0000 7f026bfff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.177+0000 7f026bfff640 1 -- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0284139450 msgr2=0x7f02841cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.177+0000 7f026bfff640 1 --2- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0284139450 0x7f02841cf7c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f027400f510 tx=0x7f027400f9d0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.177+0000 7f026bfff640 1 -- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0284139450 msgr2=0x7f02841cf7c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.177+0000 7f026bfff640 1 --2- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0284139450 0x7f02841cf7c0 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f027400f510 tx=0x7f027400f9d0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.177+0000 7f0283fff640 1 --2- 172.21.15.5:0/2923395599 >> v2:172.21.15.157:6812/631023601 conn(0x7f027003be40 0x7f027003e300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f027c0ab000 tx=0x7f027c0a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f028a00d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:41.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f028a00d640 1 --2- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f02841cfd00 0x7f02841d0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f028a00d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f028a00d640 1 -- 172.21.15.5:0/2923395599 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f02841d0650 con 0x7f02841cfd00 2024-08-18T21:06:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f02837fe640 1 --2- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f02841cfd00 0x7f02841d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f02837fe640 10 monclient: get_auth_request con 0x7f02841cfd00 auth_method 0 2024-08-18T21:06:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f02837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f02837fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f02837fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f02837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f02837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f02837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f02837fe640 10 monclient(hunting): handle_auth_done global_id 54276 payload 824 2024-08-18T21:06:41.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f02837fe640 1 -- 172.21.15.5:0/2923395599 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f02841333a0 con 0x7f02841cfd00 2024-08-18T21:06:41.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f02837fe640 1 -- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f02841cfd00 msgr2=0x7f02841d0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f02837fe640 1 --2- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f02841cfd00 0x7f02841d0110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f027400f510 tx=0x7f02740046d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f026bfff640 1 -- 172.21.15.5:0/2923395599 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0274025070 con 0x7f02841cfd00 2024-08-18T21:06:41.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f026bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f026bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:41.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.185+0000 7f026bfff640 10 monclient: dump: 2024-08-18T21:06:41.197 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.197 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.197 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.197 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.197 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.197 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.198 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.198 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.198 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.198 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.198 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.198 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.198 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.198 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.198 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.198 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f026bfff640 1 -- 172.21.15.5:0/2923395599 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9224 (secure 0 0 0) 0x7f0274023070 con 0x7f02841cfd00 2024-08-18T21:06:41.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f026bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:41.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f026bfff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:41.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f026bfff640 1 -- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f02841cfd00 msgr2=0x7f02841d0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f026bfff640 1 --2- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f02841cfd00 0x7f02841d0110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f027400f510 tx=0x7f02740046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f026bfff640 1 -- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f02841cfd00 msgr2=0x7f02841d0110 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:41.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f026bfff640 1 --2- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f02841cfd00 0x7f02841d0110 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f027400f510 tx=0x7f02740046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.199 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:41.199 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:41.199 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:41.199 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:41.199 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 74, 2024-08-18T21:06:41.199 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 57302, 2024-08-18T21:06:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:06:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.201 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.201 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.201 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.201 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.201 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.201 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.201 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.201 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.201 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.201 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.201 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:41.201 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:41.201 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.202 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.202 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.202 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.202 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.202 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.202 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.202 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.202 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.202 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.202 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.202 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:41.202 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:41.203 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:41.203 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:41.203 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:41.203 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:41.203 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:41.203 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:41.203 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:41.203 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:41.203 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:41.203 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:41.203 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:41.203 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:41.203 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:41.203 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:41.203 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.206 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.206 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:41.206 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:41.206 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.206 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.206 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.206 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:41.206 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:41.206 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.206 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:41.207 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:41.207 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.207 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.207 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:41.207 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:41.207 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.208 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.208 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.208 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:41.208 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:41.208 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.208 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.208 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.208 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:41.208 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.209 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.209 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:41.209 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.209 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.209 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.209 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:41.209 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:41.209 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.209 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.209 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.210 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:41.210 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:41.210 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.210 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.210 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.210 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:41.210 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.210 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.210 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:41.211 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.211 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.211 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.211 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:41.211 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:41.211 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.211 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.211 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.211 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.211 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:41.211 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:41.212 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.212 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.212 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.212 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:41.212 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.212 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.212 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:41.212 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.212 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.212 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.213 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:41.213 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:41.213 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.213 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.213 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.213 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:41.213 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:41.213 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.213 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.213 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.214 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:41.214 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.214 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.214 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:41.214 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.214 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.214 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.214 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:41.214 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:41.214 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.215 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.215 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.215 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:41.215 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:41.215 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.215 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.215 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.215 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:41.215 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.215 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.216 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:41.216 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.216 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.216 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.216 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:41.216 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:41.216 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.216 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.216 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.216 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.216 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:41.217 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:41.217 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.217 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.217 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.217 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.217 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:41.217 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.217 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.217 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.217 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:41.217 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.217 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.217 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.218 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:41.218 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:41.218 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.218 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.218 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.218 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:41.218 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:41.218 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.218 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.218 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.218 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:41.219 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.219 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.219 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.219 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:41.219 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.219 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.219 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.219 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:41.219 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:41.219 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.219 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.220 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.220 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.220 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.220 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:41.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:41.220 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.220 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:41.220 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:41.220 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:41.220 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.220 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.220 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:41.220 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.220 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:41.221 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:41.221 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:06:41.221 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.221 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.221 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:41.221 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f028a00d640 1 -- 172.21.15.5:0/2923395599 >> v2:172.21.15.157:6812/631023601 conn(0x7f027003be40 msgr2=0x7f027003e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f028a00d640 1 --2- 172.21.15.5:0/2923395599 >> v2:172.21.15.157:6812/631023601 conn(0x7f027003be40 0x7f027003e300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f027c0ab000 tx=0x7f027c0a6000 comp rx=0 tx=0).stop 2024-08-18T21:06:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f028a00d640 10 monclient: shutdown 2024-08-18T21:06:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f028a00d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f028a00d640 1 -- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f02840a4620 msgr2=0x7f02841389d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f028a00d640 1 --2- 172.21.15.5:0/2923395599 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f02840a4620 0x7f02841389d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f027800b9e0 tx=0x7f027800bea0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f0283fff640 1 -- 172.21.15.5:0/2923395599 reap_dead start 2024-08-18T21:06:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f026bfff640 1 -- 172.21.15.5:0/2923395599 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(83..83 src has 22..83) ==== 3898+0+0 (unknown 0 0 0) 0x7f027804eaa0 con 0x7f02840a4620 2024-08-18T21:06:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f0283fff640 1 -- 172.21.15.5:0/2923395599 reap_dead start 2024-08-18T21:06:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f028a00d640 1 -- 172.21.15.5:0/2923395599 shutdown_connections 2024-08-18T21:06:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f028a00d640 1 -- 172.21.15.5:0/2923395599 >> 172.21.15.5:0/2923395599 conn(0x7f02840a8a90 msgr2=0x7f02840a3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f028a00d640 1 -- 172.21.15.5:0/2923395599 shutdown_connections 2024-08-18T21:06:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.189+0000 7f028a00d640 1 -- 172.21.15.5:0/2923395599 wait complete. 2024-08-18T21:06:41.224 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:06:41.224 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon e 2024-08-18T21:06:41.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:06:41.225 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:41.225 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28873]: starting. 2024-08-18T21:06:41.225 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28873]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28837 2024-08-18T21:06:41.225 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28873]: shutting down. 2024-08-18T21:06:41.225 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:41.225 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:41.225 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:06:41.226 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:06:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 10 monclient: get_monmap_and_config 2024-08-18T21:06:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 10 monclient: build_initial_monmap 2024-08-18T21:06:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 10 monclient: monmap: 2024-08-18T21:06:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:41.345988+0000 2024-08-18T21:06:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:41.345988+0000 2024-08-18T21:06:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:41.347 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 1 Processor -- start 2024-08-18T21:06:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 1 -- start start 2024-08-18T21:06:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 10 monclient: init 2024-08-18T21:06:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 10 monclient: _add_conns ranks=[0,6,3,1,10,4,5,2,7,8,9] 2024-08-18T21:06:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6ab40a4960 addr v1:172.21.15.5:6789/0 2024-08-18T21:06:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab406ce10 0x7f6ab413ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 10 monclient(hunting): picked mon.noname-d con 0x7f6ab406ce10 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ab40a5450 0x7f6ab4141230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 10 monclient(hunting): picked mon.noname-g con 0x7f6ab40a5450 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:06:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab409e7f0 con 0x7f6ab40a4960 2024-08-18T21:06:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab409da30 con 0x7f6ab40a5450 2024-08-18T21:06:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f6ab409e1c0 con 0x7f6ab406ce10 2024-08-18T21:06:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6abbf46640 10 monclient(hunting): authenticate will time out at 1168.359252s 2024-08-18T21:06:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab9ce2640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7f6ab40a4960 legacy=0x7f6ab40a4d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:06:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab94e1640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab406ce10 0x7f6ab413ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab94e1640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab406ce10 0x7f6ab413ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:45098/0 (socket says 172.21.15.5:45098) 2024-08-18T21:06:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab94e1640 1 -- 172.21.15.5:0/831060761 learned_addr learned my addr 172.21.15.5:0/831060761 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab94e1640 10 monclient(hunting): get_auth_request con 0x7f6ab406ce10 auth_method 0 2024-08-18T21:06:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab94e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab94e1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab94e1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab94e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab94e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab94e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6aba4e3640 1 --2- 172.21.15.5:0/831060761 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ab40a5450 0x7f6ab4141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6aba4e3640 10 monclient(hunting): get_auth_request con 0x7f6ab40a5450 auth_method 0 2024-08-18T21:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6aba4e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6aba4e3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6aba4e3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab94e1640 10 monclient(hunting): handle_auth_done global_id 54303 payload 274 2024-08-18T21:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab94e1640 1 -- 172.21.15.5:0/831060761 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ab40a5450 msgr2=0x7f6ab4141230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab94e1640 1 --2- 172.21.15.5:0/831060761 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ab40a5450 0x7f6ab4141230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab94e1640 1 -- 172.21.15.5:0/831060761 >> v1:172.21.15.5:6789/0 conn(0x7f6ab40a4960 legacy=0x7f6ab40a4d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab94e1640 10 monclient: _finish_hunting 0 2024-08-18T21:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.341+0000 7f6ab94e1640 1 monclient: found mon.noname-d 2024-08-18T21:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.345+0000 7f6ab94e1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.345+0000 7f6ab94e1640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.345+0000 7f6ab94e1640 1 -- 172.21.15.5:0/831060761 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab409dee0 con 0x7f6ab406ce10 2024-08-18T21:06:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6ab94e1640 1 -- 172.21.15.5:0/831060761 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab406ce10 msgr2=0x7f6ab413ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6ab94e1640 1 --2- 172.21.15.5:0/831060761 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab406ce10 0x7f6ab413ece0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80098a0 tx=0x7f6aa801ced0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=b0c6fcb5ecd8f121 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6ab8ce0640 1 -- 172.21.15.5:0/831060761 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6aa80b1070 con 0x7f6ab406ce10 2024-08-18T21:06:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6ab8ce0640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6ab8ce0640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:06:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6ab8ce0640 10 monclient: dump: 2024-08-18T21:06:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.356 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6ab8ce0640 10 monclient: _finish_auth 0 2024-08-18T21:06:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6ab8ce0640 10 monclient: _check_auth_tickets 2024-08-18T21:06:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6ab8ce0640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6ab8ce0640 1 -- 172.21.15.5:0/831060761 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa80ab820 con 0x7f6ab406ce10 2024-08-18T21:06:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6ab8ce0640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6ab8ce0640 1 -- 172.21.15.5:0/831060761 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6aa80abe40 con 0x7f6ab406ce10 2024-08-18T21:06:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 5 monclient: authenticate success, global_id 54303 2024-08-18T21:06:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 4 set_mon_vals no callback set 2024-08-18T21:06:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6ab8ce0640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6ab8ce0640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6ab8ce0640 10 monclient: dump: 2024-08-18T21:06:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.358 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 10 monclient: shutdown 2024-08-18T21:06:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 1 -- 172.21.15.5:0/831060761 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab406ce10 msgr2=0x7f6ab413ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 1 --2- 172.21.15.5:0/831060761 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab406ce10 0x7f6ab413ece0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80098a0 tx=0x7f6aa801ced0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 1 -- 172.21.15.5:0/831060761 shutdown_connections 2024-08-18T21:06:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 1 --2- 172.21.15.5:0/831060761 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ab40a5450 0x7f6ab4141230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 1 --2- 172.21.15.5:0/831060761 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab406ce10 0x7f6ab413ece0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 1 -- 172.21.15.5:0/831060761 >> 172.21.15.5:0/831060761 conn(0x7f6ab40a6440 msgr2=0x7f6ab4068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 1 -- 172.21.15.5:0/831060761 shutdown_connections 2024-08-18T21:06:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 1 -- 172.21.15.5:0/831060761 wait complete. 2024-08-18T21:06:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 10 monclient: build_initial_monmap 2024-08-18T21:06:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 10 monclient: monmap: 2024-08-18T21:06:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:41.361 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 1 Processor -- start 2024-08-18T21:06:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 1 -- start start 2024-08-18T21:06:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 10 monclient: init 2024-08-18T21:06:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 10 monclient: _add_conns ranks=[7,6,2,8,1,4,3,0,5] 2024-08-18T21:06:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6ab406ce10 0x7f6ab4133b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 10 monclient(hunting): picked mon.noname-i con 0x7f6ab406ce10 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab40a4960 0x7f6ab4134070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 10 monclient(hunting): picked mon.noname-d con 0x7f6ab40a4960 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6ab40a5450 0x7f6ab41d1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 10 monclient(hunting): picked mon.noname-b con 0x7f6ab40a5450 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.349+0000 7f6abbf46640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab4143f90 con 0x7f6ab40a5450 2024-08-18T21:06:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f6ab409f3c0 con 0x7f6ab40a4960 2024-08-18T21:06:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f6ab4144110 con 0x7f6ab406ce10 2024-08-18T21:06:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 10 monclient(hunting): authenticate will time out at 1168.368023s 2024-08-18T21:06:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aba4e3640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6ab40a5450 msgr2=0x7f6ab41d1200 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:06:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aba4e3640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6ab40a5450 0x7f6ab41d1200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:06:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab40a4960 0x7f6ab4134070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab40a4960 0x7f6ab4134070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:45114/0 (socket says 172.21.15.5:45114) 2024-08-18T21:06:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 1 -- 172.21.15.5:0/2842085491 learned_addr learned my addr 172.21.15.5:0/2842085491 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 10 monclient(hunting): get_auth_request con 0x7f6ab40a4960 auth_method 0 2024-08-18T21:06:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab9ce2640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6ab406ce10 0x7f6ab4133b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 10 monclient(hunting): handle_auth_done global_id 54312 payload 824 2024-08-18T21:06:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 1 -- 172.21.15.5:0/2842085491 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6ab406ce10 msgr2=0x7f6ab4133b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6ab406ce10 0x7f6ab4133b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 1 -- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6ab40a5450 msgr2=0x7f6ab41d1200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:06:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6ab40a5450 0x7f6ab41d1200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 10 monclient: _finish_hunting 0 2024-08-18T21:06:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 1 monclient: found mon.noname-d 2024-08-18T21:06:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:06:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 1 -- 172.21.15.5:0/2842085491 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab40a04e0 con 0x7f6ab40a4960 2024-08-18T21:06:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab9ce2640 10 monclient: get_auth_request con 0x7f6ab406ce10 auth_method 0 2024-08-18T21:06:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab9ce2640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6ab406ce10 0x7f6ab4133b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:06:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 1 -- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab40a4960 msgr2=0x7f6ab4134070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab40a4960 0x7f6ab4134070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80097c0 tx=0x7f6aa8019270 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6aa80b1070 con 0x7f6ab40a4960 2024-08-18T21:06:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:06:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient: dump: 2024-08-18T21:06:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.373 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient: _finish_auth 0 2024-08-18T21:06:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient: _check_auth_tickets 2024-08-18T21:06:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 5 monclient: authenticate success, global_id 54312 2024-08-18T21:06:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 10 monclient: _renew_subs 2024-08-18T21:06:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa80b2040 con 0x7f6ab40a4960 2024-08-18T21:06:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 1 -- 172.21.15.5:0/2842085491 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab413d730 con 0x7f6ab40a4960 2024-08-18T21:06:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6aa8004240 con 0x7f6ab40a4960 2024-08-18T21:06:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa7fff640 4 set_mon_vals no callback set 2024-08-18T21:06:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient: dump: 2024-08-18T21:06:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.375 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 10 monclient: _renew_subs 2024-08-18T21:06:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 1 -- 172.21.15.5:0/2842085491 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab413f1f0 con 0x7f6ab40a4960 2024-08-18T21:06:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 1 -- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab40a4960 msgr2=0x7f6ab4134070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-18T21:06:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 1 -- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab40a4960 msgr2=0x7f6ab4134070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:06:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab40a4960 0x7f6ab4134070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80097c0 tx=0x7f6aa8019270 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:06:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab94e1640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab40a4960 0x7f6ab4134070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80097c0 tx=0x7f6aa8019270 comp rx=0 tx=0).stop 2024-08-18T21:06:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient: ms_handle_reset current mon [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab40a4960 msgr2=0x7f6ab4134070 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6ab40a4960 0x7f6ab4134070 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient: _add_conns ranks=[7,1,6,2,8,4,0,3,5] 2024-08-18T21:06:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6ab406ce10 0x7f6a98006d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient(hunting): picked mon.i con 0x7f6ab406ce10 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a980074c0 0x7f6a980098b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient(hunting): picked mon.f con 0x7f6a980074c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:06:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6a9800a280 0x7f6a9800c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient(hunting): picked mon.d con 0x7f6a9800a280 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9800d1a0 con 0x7f6a980074c0 2024-08-18T21:06:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f6a9800d350 con 0x7f6a9800a280 2024-08-18T21:06:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f6a9800d500 con 0x7f6ab406ce10 2024-08-18T21:06:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aa67fc640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6ab41d1740 0x7f6ab41d1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6abbf46640 1 -- 172.21.15.5:0/2842085491 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f6ab4051140 con 0x7f6ab41d1740 2024-08-18T21:06:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aba4e3640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6a9800a280 0x7f6a9800c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aba4e3640 10 monclient(hunting): get_auth_request con 0x7f6a9800a280 auth_method 0 2024-08-18T21:06:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aba4e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aba4e3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aba4e3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab9ce2640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6ab41d1740 0x7f6ab41d1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab9ce2640 10 monclient(hunting): get_auth_request con 0x7f6ab41d1740 auth_method 0 2024-08-18T21:06:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab9ce2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab9ce2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6ab9ce2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aba4e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aba4e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.353+0000 7f6aba4e3640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:06:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6ab9ce2640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6ab406ce10 0x7f6a98006d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6ab9ce2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6ab9ce2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6ab9ce2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6ab9ce2640 10 monclient(hunting): get_auth_request con 0x7f6ab406ce10 auth_method 0 2024-08-18T21:06:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6ab9ce2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6ab9ce2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6ab9ce2640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:06:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aba4e3640 10 monclient(hunting): handle_auth_done global_id 54312 payload 293 2024-08-18T21:06:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aba4e3640 1 -- 172.21.15.5:0/2842085491 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6ab406ce10 msgr2=0x7f6a98006d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6ab94e1640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a980074c0 0x7f6a980098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aba4e3640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6ab406ce10 0x7f6a98006d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aba4e3640 1 -- 172.21.15.5:0/2842085491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a980074c0 msgr2=0x7f6a980098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aba4e3640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a980074c0 0x7f6a980098b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aba4e3640 10 monclient: _finish_hunting 0 2024-08-18T21:06:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aba4e3640 1 monclient: found mon.d 2024-08-18T21:06:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aba4e3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aba4e3640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:06:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aba4e3640 1 -- 172.21.15.5:0/2842085491 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7f6a9800d880 con 0x7f6a9800a280 2024-08-18T21:06:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aba4e3640 10 monclient: _finish_auth 0 2024-08-18T21:06:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aba4e3640 10 monclient: _check_auth_tickets 2024-08-18T21:06:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aba4e3640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6ab9ce2640 10 monclient(hunting): handle_auth_done global_id 54305 payload 824 2024-08-18T21:06:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6ab9ce2640 1 -- 172.21.15.5:0/2842085491 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ab41d2060 con 0x7f6ab41d1740 2024-08-18T21:06:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aba4e3640 1 -- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6a9800a280 msgr2=0x7f6a9800c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aba4e3640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6a9800a280 0x7f6a9800c710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6a98004940 tx=0x7f6aa8004740 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6ab9ce2640 1 -- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6ab41d1740 msgr2=0x7f6ab41d1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6ab9ce2640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6ab41d1740 0x7f6ab41d1b20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00109f0 tx=0x7f6ab0010eb0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6aac009ad0 con 0x7f6a9800a280 2024-08-18T21:06:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 10 monclient: dump: 2024-08-18T21:06:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.381 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aac007e30 con 0x7f6a9800a280 2024-08-18T21:06:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6ab001b070 con 0x7f6ab41d1740 2024-08-18T21:06:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa77fe640 4 set_mon_vals no callback set 2024-08-18T21:06:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 10 monclient: dump: 2024-08-18T21:06:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.383 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6ab0003de0 con 0x7f6ab41d1740 2024-08-18T21:06:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6ab41d1740 msgr2=0x7f6ab41d1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6ab41d1740 0x7f6ab41d1b20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00109f0 tx=0x7f6ab0010eb0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6ab41d1740 msgr2=0x7f6ab41d1b20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6ab41d1740 0x7f6ab41d1b20 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00109f0 tx=0x7f6ab0010eb0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f6aac012510 con 0x7f6a9800a280 2024-08-18T21:06:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 1 --2- 172.21.15.5:0/2842085491 >> v2:172.21.15.157:6812/631023601 conn(0x7f6ab40a4960 0x7f6a98046fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.357+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 <== mon.6 v2:172.21.15.5:3303/0 4 ==== osd_map(84..84 src has 22..84) ==== 3506+0+0 (secure 0 0 0) 0x7f6aac04c180 con 0x7f6a9800a280 2024-08-18T21:06:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.361+0000 7f6ab9ce2640 1 --2- 172.21.15.5:0/2842085491 >> v2:172.21.15.157:6812/631023601 conn(0x7f6ab40a4960 0x7f6a98046fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.361+0000 7f6ab9ce2640 10 monclient: get_auth_request con 0x7f6ab40a4960 auth_method 0 2024-08-18T21:06:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.361+0000 7f6ab9ce2640 1 --2- 172.21.15.5:0/2842085491 >> v2:172.21.15.157:6812/631023601 conn(0x7f6ab40a4960 0x7f6a98046fe0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00109f0 tx=0x7f6ab0008000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.365+0000 7f6abbf46640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.365+0000 7f6abbf46640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6ab4133b30 0x7f6ab4133f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.365+0000 7f6abbf46640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.365+0000 7f6abbf46640 1 -- 172.21.15.5:0/2842085491 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f6ab40a4d40 con 0x7f6ab4133b30 2024-08-18T21:06:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.365+0000 7f6ab94e1640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6ab4133b30 0x7f6ab4133f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.365+0000 7f6ab94e1640 10 monclient: get_auth_request con 0x7f6ab4133b30 auth_method 0 2024-08-18T21:06:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.365+0000 7f6ab94e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.365+0000 7f6ab94e1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.365+0000 7f6ab94e1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.365+0000 7f6ab94e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.365+0000 7f6ab94e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.365+0000 7f6ab94e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.365+0000 7f6ab94e1640 10 monclient(hunting): handle_auth_done global_id 54314 payload 824 2024-08-18T21:06:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.365+0000 7f6ab94e1640 1 -- 172.21.15.5:0/2842085491 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6ab40a3110 con 0x7f6ab4133b30 2024-08-18T21:06:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6ab94e1640 1 -- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6ab4133b30 msgr2=0x7f6ab4133f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6ab94e1640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6ab4133b30 0x7f6ab4133f10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80b7000 tx=0x7f6aa8009240 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6aa80ce070 con 0x7f6ab4133b30 2024-08-18T21:06:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6aa67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6aa67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6aa67fc640 10 monclient: dump: 2024-08-18T21:06:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.388 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9391 (secure 0 0 0) 0x7f6aa80ca620 con 0x7f6ab4133b30 2024-08-18T21:06:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6aa67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6aa67fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6ab4133b30 msgr2=0x7f6ab4133f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6aa67fc640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6ab4133b30 0x7f6ab4133f10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80b7000 tx=0x7f6aa8009240 comp rx=0 tx=0).stop 2024-08-18T21:06:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6aba4e3640 1 -- 172.21.15.5:0/2842085491 reap_dead start 2024-08-18T21:06:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6aa67fc640 1 -- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6ab4133b30 msgr2=0x7f6ab4133f10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6aa67fc640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6ab4133b30 0x7f6ab4133f10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.389 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:41.389 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 74, 2024-08-18T21:06:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 57490, 2024-08-18T21:06:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:06:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:41.396 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.396 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.396 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.396 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:41.396 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.396 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.396 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:41.396 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.397 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.397 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.397 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:41.397 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:41.397 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.397 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.397 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.397 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.397 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:41.397 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:41.398 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.398 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.398 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:41.398 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.398 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:41.398 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.398 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.398 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.399 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:41.399 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:41.399 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.399 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.399 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.399 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:41.399 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:41.399 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.399 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.400 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.400 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:41.400 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.400 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.400 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.400 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:41.400 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.400 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.400 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.400 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:41.400 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:41.400 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.401 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.401 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.401 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:41.401 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:41.401 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.401 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.401 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.401 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:41.401 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.402 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.402 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:41.402 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.402 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.402 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.402 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:41.402 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:41.402 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.402 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.402 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.402 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.402 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:41.403 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:41.403 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.403 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.403 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.403 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:41.403 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.403 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.403 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:41.403 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.403 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.403 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.404 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:41.404 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:41.404 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.404 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.404 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.404 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.404 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:41.404 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:41.404 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.404 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.404 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.405 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:41.405 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.405 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:41.405 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.405 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.405 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.405 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:41.405 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:41.405 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.406 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.406 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.406 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.406 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:41.406 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:41.406 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.406 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.406 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.406 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.406 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:41.406 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.407 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.407 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:41.407 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.407 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.407 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.407 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:41.407 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:41.407 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.407 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.407 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.408 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.408 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:41.408 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:41.408 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.408 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.408 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.408 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.408 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:41.408 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.408 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.408 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.408 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:41.409 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.409 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.409 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.409 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:41.409 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:41.409 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.409 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.409 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.409 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.409 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:41.409 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:41.410 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.410 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.410 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.410 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:41.410 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.410 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.410 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:41.410 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.410 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.410 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:06:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:06:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:41.413 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6abbf46640 1 -- 172.21.15.5:0/2842085491 >> v2:172.21.15.157:6812/631023601 conn(0x7f6ab40a4960 msgr2=0x7f6a98046fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6abbf46640 1 --2- 172.21.15.5:0/2842085491 >> v2:172.21.15.157:6812/631023601 conn(0x7f6ab40a4960 0x7f6a98046fe0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00109f0 tx=0x7f6ab0008000 comp rx=0 tx=0).stop 2024-08-18T21:06:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6abbf46640 10 monclient: shutdown 2024-08-18T21:06:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6abbf46640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6abbf46640 1 -- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6a9800a280 msgr2=0x7f6a9800c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6abbf46640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6a9800a280 0x7f6a9800c710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6a98004940 tx=0x7f6aa8004740 comp rx=0 tx=0).stop 2024-08-18T21:06:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6abbf46640 1 -- 172.21.15.5:0/2842085491 shutdown_connections 2024-08-18T21:06:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6abbf46640 1 --2- 172.21.15.5:0/2842085491 >> v2:172.21.15.157:6812/631023601 conn(0x7f6ab40a4960 0x7f6a98046fe0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6abbf46640 1 --2- 172.21.15.5:0/2842085491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6a9800a280 0x7f6a9800c710 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6abbf46640 1 -- 172.21.15.5:0/2842085491 >> 172.21.15.5:0/2842085491 conn(0x7f6ab40a6440 msgr2=0x7f6ab4136880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6abbf46640 1 -- 172.21.15.5:0/2842085491 shutdown_connections 2024-08-18T21:06:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.369+0000 7f6abbf46640 1 -- 172.21.15.5:0/2842085491 wait complete. 2024-08-18T21:06:41.415 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:06:41.415 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon f 2024-08-18T21:06:41.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:06:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 10 monclient: get_monmap_and_config 2024-08-18T21:06:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 10 monclient: build_initial_monmap 2024-08-18T21:06:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 10 monclient: monmap: 2024-08-18T21:06:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:41.533208+0000 2024-08-18T21:06:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:41.533208+0000 2024-08-18T21:06:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:41.534 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 1 Processor -- start 2024-08-18T21:06:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 1 -- start start 2024-08-18T21:06:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 10 monclient: init 2024-08-18T21:06:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 10 monclient: _add_conns ranks=[4,6,1,3,7,2,10,8,5,0,9] 2024-08-18T21:06:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3be0133040 0x7f3be0133420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 10 monclient(hunting): picked mon.noname-c con 0x7f3be0133040 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3be006f850 0x7f3be00a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 10 monclient(hunting): picked mon.noname-d con 0x7f3be006f850 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f3be00a6710 addr v1:172.21.15.157:6789/0 2024-08-18T21:06:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3be006e620 con 0x7f3be00a6710 2024-08-18T21:06:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f3be006e900 con 0x7f3be0133040 2024-08-18T21:06:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f3be006ebe0 con 0x7f3be006f850 2024-08-18T21:06:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be7ce1640 10 monclient(hunting): authenticate will time out at 1168.546366s 2024-08-18T21:06:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3be006f850 0x7f3be00a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be5a7d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3be0133040 0x7f3be0133420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be5a7d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3be0133040 0x7f3be0133420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:41248/0 (socket says 172.21.15.5:41248) 2024-08-18T21:06:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3be006f850 0x7f3be00a4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:45138/0 (socket says 172.21.15.5:45138) 2024-08-18T21:06:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be5a7d640 1 -- 172.21.15.5:0/3525493119 learned_addr learned my addr 172.21.15.5:0/3525493119 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be5a7d640 10 monclient(hunting): get_auth_request con 0x7f3be0133040 auth_method 0 2024-08-18T21:06:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be5a7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be5a7d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be5a7d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 10 monclient(hunting): get_auth_request con 0x7f3be006f850 auth_method 0 2024-08-18T21:06:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be5a7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be5a7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be5a7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 10 monclient(hunting): handle_auth_done global_id 54321 payload 274 2024-08-18T21:06:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 1 -- 172.21.15.5:0/3525493119 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3be0133040 msgr2=0x7f3be0133420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 1 --2- 172.21.15.5:0/3525493119 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3be0133040 0x7f3be0133420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 1 -- 172.21.15.5:0/3525493119 >> v1:172.21.15.157:6789/0 conn(0x7f3be00a6710 legacy=0x7f3be00a50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 10 monclient: _finish_hunting 0 2024-08-18T21:06:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 1 monclient: found mon.noname-d 2024-08-18T21:06:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:06:41.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.529+0000 7f3be527c640 1 -- 172.21.15.5:0/3525493119 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be00aaeb0 con 0x7f3be006f850 2024-08-18T21:06:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be527c640 1 -- 172.21.15.5:0/3525493119 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3be006f850 msgr2=0x7f3be00a4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be527c640 1 --2- 172.21.15.5:0/3525493119 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3be006f850 0x7f3be00a4bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3bd40097c0 tx=0x7f3bd401c3f0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=ce8d0bfb61ea8d8f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be4a7b640 1 -- 172.21.15.5:0/3525493119 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3bd40b0070 con 0x7f3be006f850 2024-08-18T21:06:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be4a7b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be4a7b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:06:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be4a7b640 10 monclient: dump: 2024-08-18T21:06:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.544 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be4a7b640 10 monclient: _finish_auth 0 2024-08-18T21:06:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be4a7b640 10 monclient: _check_auth_tickets 2024-08-18T21:06:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be4a7b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be4a7b640 1 -- 172.21.15.5:0/3525493119 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd40aa810 con 0x7f3be006f850 2024-08-18T21:06:41.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be7ce1640 5 monclient: authenticate success, global_id 54321 2024-08-18T21:06:41.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be7ce1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:06:41.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be4a7b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:41.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be7ce1640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:41.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be4a7b640 1 -- 172.21.15.5:0/3525493119 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3bd40a9300 con 0x7f3be006f850 2024-08-18T21:06:41.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be4a7b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be7ce1640 4 set_mon_vals no callback set 2024-08-18T21:06:41.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be4a7b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:41.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be4a7b640 10 monclient: dump: 2024-08-18T21:06:41.545 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.545 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.545 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.545 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.545 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.546 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be7ce1640 10 monclient: shutdown 2024-08-18T21:06:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be7ce1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be7ce1640 1 -- 172.21.15.5:0/3525493119 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3be006f850 msgr2=0x7f3be00a4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be7ce1640 1 --2- 172.21.15.5:0/3525493119 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3be006f850 0x7f3be00a4bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3bd40097c0 tx=0x7f3bd401c3f0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be7ce1640 1 -- 172.21.15.5:0/3525493119 shutdown_connections 2024-08-18T21:06:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be7ce1640 1 --2- 172.21.15.5:0/3525493119 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3be006f850 0x7f3be00a4bb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be7ce1640 1 --2- 172.21.15.5:0/3525493119 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3be0133040 0x7f3be0133420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.533+0000 7f3be7ce1640 1 -- 172.21.15.5:0/3525493119 >> 172.21.15.5:0/3525493119 conn(0x7f3be0069090 msgr2=0x7f3be00aa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 1 -- 172.21.15.5:0/3525493119 shutdown_connections 2024-08-18T21:06:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 1 -- 172.21.15.5:0/3525493119 wait complete. 2024-08-18T21:06:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 10 monclient: build_initial_monmap 2024-08-18T21:06:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 10 monclient: monmap: 2024-08-18T21:06:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:41.548 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 1 Processor -- start 2024-08-18T21:06:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 1 -- start start 2024-08-18T21:06:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 10 monclient: init 2024-08-18T21:06:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 10 monclient: _add_conns ranks=[0,2,1,6,7,3,4,8,5] 2024-08-18T21:06:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3be006f850 0x7f3be0131fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 10 monclient(hunting): picked mon.noname-a con 0x7f3be006f850 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:06:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3be00a6710 0x7f3be0132510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 10 monclient(hunting): picked mon.noname-b con 0x7f3be00a6710 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3be0133040 0x7f3be00a27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 10 monclient(hunting): picked mon.noname-f con 0x7f3be0133040 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:06:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3be0144440 con 0x7f3be006f850 2024-08-18T21:06:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3be00a5a10 con 0x7f3be0133040 2024-08-18T21:06:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f3be01445c0 con 0x7f3be00a6710 2024-08-18T21:06:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be7ce1640 10 monclient(hunting): authenticate will time out at 1168.553489s 2024-08-18T21:06:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be527c640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3be00a6710 msgr2=0x7f3be0132510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:06:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be527c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3be00a6710 0x7f3be0132510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:06:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be5a7d640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3be006f850 msgr2=0x7f3be0131fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:06:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be5a7d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3be006f850 0x7f3be0131fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:06:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3be0133040 0x7f3be00a27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3be0133040 0x7f3be00a27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:59320/0 (socket says 172.21.15.5:59320) 2024-08-18T21:06:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 1 -- 172.21.15.5:0/1598345862 learned_addr learned my addr 172.21.15.5:0/1598345862 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 10 monclient(hunting): get_auth_request con 0x7f3be0133040 auth_method 0 2024-08-18T21:06:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 10 monclient(hunting): handle_auth_done global_id 5131 payload 824 2024-08-18T21:06:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 1 -- 172.21.15.5:0/1598345862 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3be00a6710 msgr2=0x7f3be0132510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:06:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 1 --2- 172.21.15.5:0/1598345862 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3be00a6710 0x7f3be0132510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 1 -- 172.21.15.5:0/1598345862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3be006f850 msgr2=0x7f3be0131fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:06:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 1 --2- 172.21.15.5:0/1598345862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3be006f850 0x7f3be0131fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 10 monclient: _finish_hunting 0 2024-08-18T21:06:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 1 monclient: found mon.noname-f 2024-08-18T21:06:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:06:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.537+0000 7f3be627e640 1 -- 172.21.15.5:0/1598345862 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be01385b0 con 0x7f3be0133040 2024-08-18T21:06:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be627e640 1 -- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3be0133040 msgr2=0x7f3be00a27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be627e640 1 --2- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3be0133040 0x7f3be00a27b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00c3f0 tx=0x7f3bdc00c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3bd27fc640 1 -- 172.21.15.5:0/1598345862 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3bdc011c10 con 0x7f3be0133040 2024-08-18T21:06:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3bd27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3bd27fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:06:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3bd27fc640 10 monclient: dump: 2024-08-18T21:06:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.556 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3bd27fc640 10 monclient: _finish_auth 0 2024-08-18T21:06:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3bd27fc640 10 monclient: _check_auth_tickets 2024-08-18T21:06:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3bd27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be7ce1640 5 monclient: authenticate success, global_id 5131 2024-08-18T21:06:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be7ce1640 10 monclient: _renew_subs 2024-08-18T21:06:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be7ce1640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:06:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be7ce1640 1 -- 172.21.15.5:0/1598345862 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3be0134e00 con 0x7f3be0133040 2024-08-18T21:06:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be7ce1640 10 monclient: _renew_subs 2024-08-18T21:06:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be7ce1640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:06:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be7ce1640 1 -- 172.21.15.5:0/1598345862 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3be00a4110 con 0x7f3be0133040 2024-08-18T21:06:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3bd27fc640 1 -- 172.21.15.5:0/1598345862 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bdc017070 con 0x7f3be0133040 2024-08-18T21:06:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3bd27fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3bd27fc640 1 -- 172.21.15.5:0/1598345862 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3bdc011db0 con 0x7f3be0133040 2024-08-18T21:06:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3bd27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3bd27fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:06:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3bd27fc640 10 monclient: dump: 2024-08-18T21:06:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.558 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3bd3fff640 4 set_mon_vals no callback set 2024-08-18T21:06:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be7ce1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be7ce1640 1 --2- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc8002890 0x7f3bc8004d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be7ce1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be7ce1640 1 -- 172.21.15.5:0/1598345862 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc8007cc0 con 0x7f3bc8002890 2024-08-18T21:06:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be5a7d640 1 --2- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc8002890 0x7f3bc8004d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be5a7d640 10 monclient: get_auth_request con 0x7f3bc8002890 auth_method 0 2024-08-18T21:06:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be5a7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be5a7d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.541+0000 7f3be5a7d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3be5a7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3be5a7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3be5a7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3bd27fc640 1 -- 172.21.15.5:0/1598345862 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f3bdc0117a0 con 0x7f3be0133040 2024-08-18T21:06:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3be5a7d640 10 monclient(hunting): handle_auth_done global_id 5140 payload 824 2024-08-18T21:06:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3be5a7d640 1 -- 172.21.15.5:0/1598345862 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3bc8007ec0 con 0x7f3bc8002890 2024-08-18T21:06:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3bd27fc640 1 --2- 172.21.15.5:0/1598345862 >> v2:172.21.15.157:6812/631023601 conn(0x7f3bc403bdf0 0x7f3bc403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3bd27fc640 1 -- 172.21.15.5:0/1598345862 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(84..84 src has 22..84) ==== 3506+0+0 (secure 0 0 0) 0x7f3bdc04e1a0 con 0x7f3be0133040 2024-08-18T21:06:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3be527c640 1 --2- 172.21.15.5:0/1598345862 >> v2:172.21.15.157:6812/631023601 conn(0x7f3bc403bdf0 0x7f3bc403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3be527c640 10 monclient: get_auth_request con 0x7f3bc403bdf0 auth_method 0 2024-08-18T21:06:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3be5a7d640 1 -- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc8002890 msgr2=0x7f3bc8004d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3be5a7d640 1 --2- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc8002890 0x7f3bc8004d30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80072a0 tx=0x7f3bd800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3bd27fc640 1 -- 172.21.15.5:0/1598345862 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3bd800cd70 con 0x7f3bc8002890 2024-08-18T21:06:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3bd27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3bd27fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:06:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3bd27fc640 10 monclient: dump: 2024-08-18T21:06:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.562 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.545+0000 7f3be527c640 1 --2- 172.21.15.5:0/1598345862 >> v2:172.21.15.157:6812/631023601 conn(0x7f3bc403bdf0 0x7f3bc403e2b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3be0070e10 tx=0x7f3bd4008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.549+0000 7f3bd27fc640 1 -- 172.21.15.5:0/1598345862 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3bd8019070 con 0x7f3bc8002890 2024-08-18T21:06:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.549+0000 7f3bd27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.549+0000 7f3bd27fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.549+0000 7f3bd27fc640 1 -- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc8002890 msgr2=0x7f3bc8004d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.549+0000 7f3bd27fc640 1 --2- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc8002890 0x7f3bc8004d30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80072a0 tx=0x7f3bd800c490 comp rx=0 tx=0).stop 2024-08-18T21:06:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.549+0000 7f3bd27fc640 1 -- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc8002890 msgr2=0x7f3bc8004d30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.549+0000 7f3bd27fc640 1 --2- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc8002890 0x7f3bc8004d30 secure :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80072a0 tx=0x7f3bd800c490 comp rx=0 tx=0).stop 2024-08-18T21:06:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.553+0000 7f3be7ce1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.553+0000 7f3be7ce1640 1 --2- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc8006ce0 0x7f3bc8007170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.553+0000 7f3be7ce1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.553+0000 7f3be7ce1640 1 -- 172.21.15.5:0/1598345862 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc800a1e0 con 0x7f3bc8006ce0 2024-08-18T21:06:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.553+0000 7f3be5a7d640 1 --2- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc8006ce0 0x7f3bc8007170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.553+0000 7f3be5a7d640 10 monclient: get_auth_request con 0x7f3bc8006ce0 auth_method 0 2024-08-18T21:06:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.553+0000 7f3be5a7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.553+0000 7f3be5a7d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.553+0000 7f3be5a7d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.553+0000 7f3be5a7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.553+0000 7f3be5a7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.553+0000 7f3be5a7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.553+0000 7f3be5a7d640 10 monclient(hunting): handle_auth_done global_id 5149 payload 824 2024-08-18T21:06:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.553+0000 7f3be5a7d640 1 -- 172.21.15.5:0/1598345862 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3bc80076b0 con 0x7f3bc8006ce0 2024-08-18T21:06:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3be5a7d640 1 -- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc8006ce0 msgr2=0x7f3bc8007170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3be5a7d640 1 --2- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc8006ce0 0x7f3bc8007170 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8018000 tx=0x7f3bd8004ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3bd27fc640 1 -- 172.21.15.5:0/1598345862 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3bd8003dc0 con 0x7f3bc8006ce0 2024-08-18T21:06:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3bd27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3bd27fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:06:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3bd27fc640 10 monclient: dump: 2024-08-18T21:06:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.567 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3bd27fc640 1 -- 172.21.15.5:0/1598345862 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9227 (secure 0 0 0) 0x7f3bd8003dc0 con 0x7f3bc8006ce0 2024-08-18T21:06:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3bd27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3bd27fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3bd27fc640 1 -- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc8006ce0 msgr2=0x7f3bc8007170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3bd27fc640 1 --2- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc8006ce0 0x7f3bc8007170 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8018000 tx=0x7f3bd8004ac0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3bd27fc640 1 -- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc8006ce0 msgr2=0x7f3bc8007170 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3bd27fc640 1 --2- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc8006ce0 0x7f3bc8007170 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8018000 tx=0x7f3bd8004ac0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.567 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:41.567 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:06:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 74, 2024-08-18T21:06:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 210637, 2024-08-18T21:06:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:06:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.579 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:41.579 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:41.579 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.579 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.579 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.579 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:41.579 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.579 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.579 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:41.579 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.580 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.580 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.580 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:41.580 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:41.580 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.580 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.580 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.580 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:41.580 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:41.580 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.581 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:41.581 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.581 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:41.581 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.581 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.581 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:41.582 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:41.582 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.582 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.582 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.582 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:41.582 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:41.582 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:41.583 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.583 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:41.583 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.583 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.583 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:41.583 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:41.583 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.583 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.583 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.584 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:41.584 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:41.584 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.584 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:41.584 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.584 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:41.585 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.585 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.585 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.585 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:41.585 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:41.585 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.585 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.585 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.585 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:41.585 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:41.585 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.586 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.586 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.586 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:41.586 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.586 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.586 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:41.586 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.586 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.586 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.587 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:41.587 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:41.587 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.587 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.587 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.587 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.587 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:41.587 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:41.587 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.587 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.587 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.587 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.588 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:41.588 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.588 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.588 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.588 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:41.588 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.588 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.588 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.588 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:41.588 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:41.588 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.589 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.589 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.589 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.589 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.589 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:41.589 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:41.589 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.589 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:41.589 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:41.589 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:41.589 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.589 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.589 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:41.590 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.590 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:41.590 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:41.590 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:06:41.590 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.590 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.590 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:41.590 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:41.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3be7ce1640 1 -- 172.21.15.5:0/1598345862 >> v2:172.21.15.157:6812/631023601 conn(0x7f3bc403bdf0 msgr2=0x7f3bc403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3be7ce1640 1 --2- 172.21.15.5:0/1598345862 >> v2:172.21.15.157:6812/631023601 conn(0x7f3bc403bdf0 0x7f3bc403e2b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3be0070e10 tx=0x7f3bd4008040 comp rx=0 tx=0).stop 2024-08-18T21:06:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3be7ce1640 10 monclient: shutdown 2024-08-18T21:06:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3be7ce1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3be7ce1640 1 -- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3be0133040 msgr2=0x7f3be00a27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3be7ce1640 1 --2- 172.21.15.5:0/1598345862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3be0133040 0x7f3be00a27b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00c3f0 tx=0x7f3bdc00c8b0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3be627e640 1 -- 172.21.15.5:0/1598345862 reap_dead start 2024-08-18T21:06:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3be627e640 1 -- 172.21.15.5:0/1598345862 reap_dead start 2024-08-18T21:06:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3be7ce1640 1 -- 172.21.15.5:0/1598345862 shutdown_connections 2024-08-18T21:06:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3be7ce1640 1 -- 172.21.15.5:0/1598345862 >> 172.21.15.5:0/1598345862 conn(0x7f3be0069090 msgr2=0x7f3be00a6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3be7ce1640 1 -- 172.21.15.5:0/1598345862 shutdown_connections 2024-08-18T21:06:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.557+0000 7f3be7ce1640 1 -- 172.21.15.5:0/1598345862 wait complete. 2024-08-18T21:06:41.592 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:06:41.593 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon g 2024-08-18T21:06:41.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:06:41.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.697+0000 7f440db5a640 10 monclient: get_monmap_and_config 2024-08-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.697+0000 7f440db5a640 10 monclient: build_initial_monmap 2024-08-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.697+0000 7f440db5a640 10 monclient: monmap: 2024-08-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:41.703411+0000 2024-08-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:41.703411+0000 2024-08-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.697+0000 7f440db5a640 1 Processor -- start 2024-08-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.697+0000 7f440db5a640 1 -- start start 2024-08-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.697+0000 7f440db5a640 10 monclient: init 2024-08-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f440db5a640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f440db5a640 10 monclient: _add_conns ranks=[4,5,6,1,0,8,10,3,9,2,7] 2024-08-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f440db5a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f44080a6bd0 0x7f44080a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f440db5a640 10 monclient(hunting): picked mon.noname-c con 0x7f44080a6bd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f440db5a640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f440809f080 0x7f44080a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f440db5a640 10 monclient(hunting): picked mon.noname-h con 0x7f440809f080 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f440db5a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4408139990 0x7f4408139df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f440db5a640 10 monclient(hunting): picked mon.noname-d con 0x7f4408139990 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f440db5a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f440db5a640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f440809e4c0 con 0x7f44080a6bd0 2024-08-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f440db5a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f440db5a640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f440806f930 con 0x7f440809f080 2024-08-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f440db5a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f440db5a640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f44080a7a30 con 0x7f4408139990 2024-08-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f440db5a640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f440db5a640 10 monclient(hunting): authenticate will time out at 1168.716252s 2024-08-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f44077fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f44080a6bd0 0x7f44080a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4408139990 0x7f4408139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4408139990 0x7f4408139df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:45148/0 (socket says 172.21.15.5:45148) 2024-08-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f44077fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f44080a6bd0 0x7f44080a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:41264/0 (socket says 172.21.15.5:41264) 2024-08-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 1 -- 172.21.15.5:0/850725279 learned_addr learned my addr 172.21.15.5:0/850725279 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 10 monclient(hunting): get_auth_request con 0x7f4408139990 auth_method 0 2024-08-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f44077fe640 10 monclient(hunting): get_auth_request con 0x7f44080a6bd0 auth_method 0 2024-08-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f44077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f44077fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f44077fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f44077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f44077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f44077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4406ffd640 1 --2- 172.21.15.5:0/850725279 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f440809f080 0x7f44080a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 10 monclient(hunting): handle_auth_done global_id 54330 payload 274 2024-08-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 1 -- 172.21.15.5:0/850725279 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f440809f080 msgr2=0x7f44080a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 1 --2- 172.21.15.5:0/850725279 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f440809f080 0x7f44080a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 1 -- 172.21.15.5:0/850725279 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f44080a6bd0 msgr2=0x7f44080a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 1 --2- 172.21.15.5:0/850725279 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f44080a6bd0 0x7f44080a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 10 monclient: _finish_hunting 0 2024-08-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 1 monclient: found mon.noname-d 2024-08-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4407fff640 1 -- 172.21.15.5:0/850725279 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44080a7fb0 con 0x7f4408139990 2024-08-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4406ffd640 10 monclient: get_auth_request con 0x7f440809f080 auth_method 0 2024-08-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f4406ffd640 1 --2- 172.21.15.5:0/850725279 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f440809f080 0x7f44080a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.701+0000 7f44077fe640 1 --2- 172.21.15.5:0/850725279 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f44080a6bd0 0x7f44080a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f4407fff640 1 -- 172.21.15.5:0/850725279 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4408139990 msgr2=0x7f4408139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f4407fff640 1 --2- 172.21.15.5:0/850725279 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4408139990 0x7f4408139df0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4400009e80 tx=0x7f440001c910 comp rx=0 tx=0).ready entity=mon.6 client_cookie=d6a27309abd6cb8b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f44067fc640 1 -- 172.21.15.5:0/850725279 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f44000090d0 con 0x7f4408139990 2024-08-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f44067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f44067fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f44067fc640 10 monclient: dump: 2024-08-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f44067fc640 10 monclient: _finish_auth 0 2024-08-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f44067fc640 10 monclient: _check_auth_tickets 2024-08-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f44067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f44067fc640 1 -- 172.21.15.5:0/850725279 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44000a5a70 con 0x7f4408139990 2024-08-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 5 monclient: authenticate success, global_id 54330 2024-08-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f44067fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f44067fc640 1 -- 172.21.15.5:0/850725279 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f44000a5c20 con 0x7f4408139990 2024-08-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f44067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 4 set_mon_vals no callback set 2024-08-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f44067fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f44067fc640 10 monclient: dump: 2024-08-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 10 monclient: shutdown 2024-08-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 -- 172.21.15.5:0/850725279 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4408139990 msgr2=0x7f4408139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 --2- 172.21.15.5:0/850725279 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4408139990 0x7f4408139df0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4400009e80 tx=0x7f440001c910 comp rx=0 tx=0).stop 2024-08-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 -- 172.21.15.5:0/850725279 shutdown_connections 2024-08-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 --2- 172.21.15.5:0/850725279 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4408139990 0x7f4408139df0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 --2- 172.21.15.5:0/850725279 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f440809f080 0x7f44080a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 --2- 172.21.15.5:0/850725279 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f44080a6bd0 0x7f44080a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 -- 172.21.15.5:0/850725279 >> 172.21.15.5:0/850725279 conn(0x7f4408068700 msgr2=0x7f4408068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 -- 172.21.15.5:0/850725279 shutdown_connections 2024-08-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 -- 172.21.15.5:0/850725279 wait complete. 2024-08-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 10 monclient: build_initial_monmap 2024-08-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 10 monclient: monmap: 2024-08-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 Processor -- start 2024-08-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 -- start start 2024-08-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 10 monclient: init 2024-08-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 10 monclient: _add_conns ranks=[2,7,1,5,0,8,6,4,3] 2024-08-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f440809f080 0x7f44081380e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 10 monclient(hunting): picked mon.noname-b con 0x7f440809f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f44080a6bd0 0x7f4408138620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 10 monclient(hunting): picked mon.noname-i con 0x7f44080a6bd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4408139990 0x7f440813d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 10 monclient(hunting): picked mon.noname-f con 0x7f4408139990 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f44080a89f0 con 0x7f4408139990 2024-08-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f44080a7ce0 con 0x7f440809f080 2024-08-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f4408143610 con 0x7f44080a6bd0 2024-08-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f440db5a640 10 monclient(hunting): authenticate will time out at 1168.723439s 2024-08-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f44077fe640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f440809f080 msgr2=0x7f44081380e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f44077fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f440809f080 0x7f44081380e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f4407fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4408139990 0x7f440813d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f4406ffd640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f44080a6bd0 0x7f4408138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f4407fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4408139990 0x7f440813d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:59334/0 (socket says 172.21.15.5:59334) 2024-08-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f4407fff640 1 -- 172.21.15.5:0/4256744907 learned_addr learned my addr 172.21.15.5:0/4256744907 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f4407fff640 10 monclient(hunting): get_auth_request con 0x7f4408139990 auth_method 0 2024-08-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f4407fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f4407fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f4407fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f4406ffd640 10 monclient(hunting): get_auth_request con 0x7f44080a6bd0 auth_method 0 2024-08-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f4406ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f4406ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.705+0000 7f4406ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4407fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4407fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4407fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4406ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4406ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4406ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4407fff640 10 monclient(hunting): handle_auth_done global_id 5158 payload 824 2024-08-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4407fff640 1 -- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f44080a6bd0 msgr2=0x7f4408138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4407fff640 1 --2- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f44080a6bd0 0x7f4408138620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4407fff640 1 -- 172.21.15.5:0/4256744907 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f440809f080 msgr2=0x7f44081380e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4407fff640 1 --2- 172.21.15.5:0/4256744907 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f440809f080 0x7f44081380e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4407fff640 10 monclient: _finish_hunting 0 2024-08-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4407fff640 1 monclient: found mon.noname-f 2024-08-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4407fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4407fff640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:06:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4407fff640 1 -- 172.21.15.5:0/4256744907 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440813fa30 con 0x7f4408139990 2024-08-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4407fff640 1 -- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4408139990 msgr2=0x7f440813d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4407fff640 1 --2- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4408139990 0x7f440813d8e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f44000af040 tx=0x7f44000196b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f43fffff640 1 -- 172.21.15.5:0/4256744907 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f44000bc020 con 0x7f4408139990 2024-08-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f43fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f43fffff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f43fffff640 10 monclient: dump: 2024-08-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f43fffff640 10 monclient: _finish_auth 0 2024-08-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f43fffff640 10 monclient: _check_auth_tickets 2024-08-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f43fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f440db5a640 5 monclient: authenticate success, global_id 5158 2024-08-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f43fffff640 1 -- 172.21.15.5:0/4256744907 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4400003dc0 con 0x7f4408139990 2024-08-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f43fffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f440db5a640 10 monclient: _renew_subs 2024-08-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f440db5a640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f440db5a640 1 -- 172.21.15.5:0/4256744907 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4408123df0 con 0x7f4408139990 2024-08-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f43fffff640 1 -- 172.21.15.5:0/4256744907 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f44000044b0 con 0x7f4408139990 2024-08-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f43fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f4405ffb640 4 set_mon_vals no callback set 2024-08-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f43fffff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f43fffff640 10 monclient: dump: 2024-08-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f440db5a640 10 monclient: _renew_subs 2024-08-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f440db5a640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.709+0000 7f440db5a640 1 -- 172.21.15.5:0/4256744907 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44080ab200 con 0x7f4408139990 2024-08-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f440db5a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f440db5a640 1 --2- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f440813de20 0x7f440813e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f440db5a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f440db5a640 1 -- 172.21.15.5:0/4256744907 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4408051140 con 0x7f440813de20 2024-08-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f44077fe640 1 --2- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f440813de20 0x7f440813e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f44077fe640 10 monclient: get_auth_request con 0x7f440813de20 auth_method 0 2024-08-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f44077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f44077fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f44077fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f44077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f44077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f44077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f43fffff640 1 -- 172.21.15.5:0/4256744907 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f44000bf020 con 0x7f4408139990 2024-08-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f44077fe640 10 monclient(hunting): handle_auth_done global_id 5196 payload 824 2024-08-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f44077fe640 1 -- 172.21.15.5:0/4256744907 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44080a63f0 con 0x7f440813de20 2024-08-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f43fffff640 1 --2- 172.21.15.5:0/4256744907 >> v2:172.21.15.157:6812/631023601 conn(0x7f43e803bdc0 0x7f43e803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f43fffff640 1 -- 172.21.15.5:0/4256744907 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(84..84 src has 22..84) ==== 3506+0+0 (secure 0 0 0) 0x7f44000b3040 con 0x7f4408139990 2024-08-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f4406ffd640 1 --2- 172.21.15.5:0/4256744907 >> v2:172.21.15.157:6812/631023601 conn(0x7f43e803bdc0 0x7f43e803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f4406ffd640 10 monclient: get_auth_request con 0x7f43e803bdc0 auth_method 0 2024-08-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f44077fe640 1 -- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f440813de20 msgr2=0x7f440813e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f44077fe640 1 --2- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f440813de20 0x7f440813e200 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f43f80096a0 tx=0x7f43f800ec00 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f43fffff640 1 -- 172.21.15.5:0/4256744907 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f43f8017070 con 0x7f440813de20 2024-08-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f43fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f43fffff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.713+0000 7f43fffff640 10 monclient: dump: 2024-08-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.717+0000 7f43fffff640 1 -- 172.21.15.5:0/4256744907 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f43f800cbc0 con 0x7f440813de20 2024-08-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.717+0000 7f43fffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.717+0000 7f43fffff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.717+0000 7f43fffff640 1 -- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f440813de20 msgr2=0x7f440813e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.717+0000 7f43fffff640 1 --2- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f440813de20 0x7f440813e200 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f43f80096a0 tx=0x7f43f800ec00 comp rx=0 tx=0).stop 2024-08-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.717+0000 7f43fffff640 1 -- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f440813de20 msgr2=0x7f440813e200 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.717+0000 7f43fffff640 1 --2- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f440813de20 0x7f440813e200 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f43f80096a0 tx=0x7f43f800ec00 comp rx=0 tx=0).stop 2024-08-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.717+0000 7f4406ffd640 1 --2- 172.21.15.5:0/4256744907 >> v2:172.21.15.157:6812/631023601 conn(0x7f43e803bdc0 0x7f43e803e280 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f43f0006b20 tx=0x7f43f0008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.721+0000 7f440db5a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.721+0000 7f440db5a640 1 --2- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f440813e740 0x7f44080a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.721+0000 7f440db5a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.721+0000 7f440db5a640 1 -- 172.21.15.5:0/4256744907 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f44081228d0 con 0x7f440813e740 2024-08-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.721+0000 7f44077fe640 1 --2- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f440813e740 0x7f44080a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.721+0000 7f44077fe640 10 monclient: get_auth_request con 0x7f440813e740 auth_method 0 2024-08-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.721+0000 7f44077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.721+0000 7f44077fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.721+0000 7f44077fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.721+0000 7f44077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.721+0000 7f44077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.721+0000 7f44077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.721+0000 7f44077fe640 10 monclient(hunting): handle_auth_done global_id 5205 payload 824 2024-08-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.721+0000 7f44077fe640 1 -- 172.21.15.5:0/4256744907 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f440813fd90 con 0x7f440813e740 2024-08-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f44077fe640 1 -- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f440813e740 msgr2=0x7f44080a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f44077fe640 1 --2- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f440813e740 0x7f44080a3f70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f43f80096a0 tx=0x7f43f8004740 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f43fffff640 1 -- 172.21.15.5:0/4256744907 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f43f8017070 con 0x7f440813e740 2024-08-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f43fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f43fffff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f43fffff640 10 monclient: dump: 2024-08-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f43fffff640 1 -- 172.21.15.5:0/4256744907 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9392 (secure 0 0 0) 0x7f43f8006650 con 0x7f440813e740 2024-08-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f43fffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f43fffff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f43fffff640 1 -- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f440813e740 msgr2=0x7f44080a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f43fffff640 1 --2- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f440813e740 0x7f44080a3f70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f43f80096a0 tx=0x7f43f8004740 comp rx=0 tx=0).stop 2024-08-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f43fffff640 1 -- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f440813e740 msgr2=0x7f44080a3f70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f43fffff640 1 --2- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f440813e740 0x7f44080a3f70 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f43f80096a0 tx=0x7f43f8004740 comp rx=0 tx=0).stop 2024-08-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 74, 2024-08-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 210821, 2024-08-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f440db5a640 1 -- 172.21.15.5:0/4256744907 >> v2:172.21.15.157:6812/631023601 conn(0x7f43e803bdc0 msgr2=0x7f43e803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f440db5a640 1 --2- 172.21.15.5:0/4256744907 >> v2:172.21.15.157:6812/631023601 conn(0x7f43e803bdc0 0x7f43e803e280 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f43f0006b20 tx=0x7f43f0008040 comp rx=0 tx=0).stop 2024-08-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f440db5a640 10 monclient: shutdown 2024-08-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f440db5a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f440db5a640 1 -- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4408139990 msgr2=0x7f440813d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f440db5a640 1 --2- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4408139990 0x7f440813d8e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f44000af040 tx=0x7f44000196b0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f4407fff640 1 -- 172.21.15.5:0/4256744907 reap_dead start 2024-08-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f440db5a640 1 -- 172.21.15.5:0/4256744907 shutdown_connections 2024-08-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f440db5a640 1 --2- 172.21.15.5:0/4256744907 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4408139990 0x7f440813d8e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f440db5a640 1 -- 172.21.15.5:0/4256744907 >> 172.21.15.5:0/4256744907 conn(0x7f4408068700 msgr2=0x7f4408140600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f440db5a640 1 -- 172.21.15.5:0/4256744907 shutdown_connections 2024-08-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.725+0000 7f440db5a640 1 -- 172.21.15.5:0/4256744907 wait complete. 2024-08-18T21:06:41.763 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:06:41.764 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon h 2024-08-18T21:06:41.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:06:41.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.873+0000 7fef7323c640 10 monclient: get_monmap_and_config 2024-08-18T21:06:41.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.873+0000 7fef7323c640 10 monclient: build_initial_monmap 2024-08-18T21:06:41.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 10 monclient: monmap: 2024-08-18T21:06:41.880 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:41.880 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.880 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:41.880447+0000 2024-08-18T21:06:41.880 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:41.880447+0000 2024-08-18T21:06:41.880 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:41.880 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.880 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:41.880 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:41.880 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:41.880 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:41.880 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:41.881 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:41.881 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:41.881 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:41.881 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:41.881 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:41.881 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:41.881 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 1 Processor -- start 2024-08-18T21:06:41.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 1 -- start start 2024-08-18T21:06:41.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 10 monclient: init 2024-08-18T21:06:41.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:41.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 10 monclient: _add_conns ranks=[7,0,10,4,6,1,5,3,8,2,9] 2024-08-18T21:06:41.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fef6c138a10 0x7fef6c09efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 10 monclient(hunting): picked mon.noname-i con 0x7fef6c138a10 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:06:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fef6c0a4db0 addr v1:172.21.15.5:6789/0 2024-08-18T21:06:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fef6c13ead0 0x7fef6c140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 10 monclient(hunting): picked mon.noname-f con 0x7fef6c13ead0 addr v2:172.21.15.157:3300/0 2024-08-18T21:06:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef6c09dec0 con 0x7fef6c0a4db0 2024-08-18T21:06:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fef6c09f660 con 0x7fef6c13ead0 2024-08-18T21:06:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fef6c09e1a0 con 0x7fef6c138a10 2024-08-18T21:06:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef7323c640 10 monclient(hunting): authenticate will time out at 1168.893707s 2024-08-18T21:06:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef6bfff640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fef6c0a4db0 legacy=0x7fef6c138df0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:06:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fef6c13ead0 0x7fef6c140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fef6c13ead0 0x7fef6c140ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:59344/0 (socket says 172.21.15.5:59344) 2024-08-18T21:06:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 1 -- 172.21.15.5:0/1376607728 learned_addr learned my addr 172.21.15.5:0/1376607728 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 10 monclient(hunting): get_auth_request con 0x7fef6c13ead0 auth_method 0 2024-08-18T21:06:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef70fd8640 1 --2- 172.21.15.5:0/1376607728 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fef6c138a10 0x7fef6c09efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef70fd8640 10 monclient(hunting): get_auth_request con 0x7fef6c138a10 auth_method 0 2024-08-18T21:06:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef70fd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef70fd8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef70fd8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef70fd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef70fd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef70fd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 10 monclient(hunting): handle_auth_done global_id 5167 payload 274 2024-08-18T21:06:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 1 -- 172.21.15.5:0/1376607728 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fef6c138a10 msgr2=0x7fef6c09efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 1 --2- 172.21.15.5:0/1376607728 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fef6c138a10 0x7fef6c09efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 1 -- 172.21.15.5:0/1376607728 >> v1:172.21.15.5:6789/0 conn(0x7fef6c0a4db0 legacy=0x7fef6c138df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:06:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 10 monclient: _finish_hunting 0 2024-08-18T21:06:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 1 monclient: found mon.noname-f 2024-08-18T21:06:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:06:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.877+0000 7fef717d9640 1 -- 172.21.15.5:0/1376607728 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6c139500 con 0x7fef6c13ead0 2024-08-18T21:06:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef717d9640 1 -- 172.21.15.5:0/1376607728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef6c13ead0 msgr2=0x7fef6c140ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef717d9640 1 --2- 172.21.15.5:0/1376607728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef6c13ead0 0x7fef6c140ec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fef64009e50 tx=0x7fef6401c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f35f610a283df6aa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef6b7fe640 1 -- 172.21.15.5:0/1376607728 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fef640a59a0 con 0x7fef6c13ead0 2024-08-18T21:06:41.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef6b7fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:06:41.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef6b7fe640 10 monclient: dump: 2024-08-18T21:06:41.889 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.889 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.889 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.889 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.889 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.889 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.889 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.889 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.889 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.889 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.890 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef6b7fe640 10 monclient: _finish_auth 0 2024-08-18T21:06:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef6b7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:06:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef6b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef6b7fe640 1 -- 172.21.15.5:0/1376607728 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef640a5b60 con 0x7fef6c13ead0 2024-08-18T21:06:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef6b7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef6b7fe640 1 -- 172.21.15.5:0/1376607728 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fef640a5d50 con 0x7fef6c13ead0 2024-08-18T21:06:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef6b7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:06:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef6b7fe640 10 monclient: dump: 2024-08-18T21:06:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.892 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef7323c640 5 monclient: authenticate success, global_id 5167 2024-08-18T21:06:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef7323c640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef7323c640 4 set_mon_vals no callback set 2024-08-18T21:06:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef7323c640 10 monclient: shutdown 2024-08-18T21:06:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef7323c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef7323c640 1 -- 172.21.15.5:0/1376607728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef6c13ead0 msgr2=0x7fef6c140ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.881+0000 7fef7323c640 1 --2- 172.21.15.5:0/1376607728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef6c13ead0 0x7fef6c140ec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fef64009e50 tx=0x7fef6401c8f0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 1 -- 172.21.15.5:0/1376607728 shutdown_connections 2024-08-18T21:06:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 1 --2- 172.21.15.5:0/1376607728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef6c13ead0 0x7fef6c140ec0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 1 --2- 172.21.15.5:0/1376607728 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fef6c138a10 0x7fef6c09efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 1 -- 172.21.15.5:0/1376607728 >> 172.21.15.5:0/1376607728 conn(0x7fef6c0688d0 msgr2=0x7fef6c068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 1 -- 172.21.15.5:0/1376607728 shutdown_connections 2024-08-18T21:06:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 1 -- 172.21.15.5:0/1376607728 wait complete. 2024-08-18T21:06:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 10 monclient: build_initial_monmap 2024-08-18T21:06:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 10 monclient: monmap: 2024-08-18T21:06:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:41.894 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 1 Processor -- start 2024-08-18T21:06:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 1 -- start start 2024-08-18T21:06:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 10 monclient: init 2024-08-18T21:06:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 10 monclient: _add_conns ranks=[1,3,5,6,0,8,7,2,4] 2024-08-18T21:06:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef6c0a4db0 0x7fef6c11f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 10 monclient(hunting): picked mon.noname-f con 0x7fef6c0a4db0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:06:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef6c138a10 0x7fef6c120980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 10 monclient(hunting): picked mon.noname-g con 0x7fef6c138a10 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:06:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c13ead0 0x7fef6c1377f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 10 monclient(hunting): picked mon.noname-h con 0x7fef6c13ead0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c143fb0 con 0x7fef6c0a4db0 2024-08-18T21:06:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fef6c143e30 con 0x7fef6c138a10 2024-08-18T21:06:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fef6c144130 con 0x7fef6c13ead0 2024-08-18T21:06:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef7323c640 10 monclient(hunting): authenticate will time out at 1168.901785s 2024-08-18T21:06:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef717d9640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c13ead0 0x7fef6c1377f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef6c138a10 0x7fef6c120980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef70fd8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef6c0a4db0 0x7fef6c11f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef6c138a10 0x7fef6c120980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:56128/0 (socket says 172.21.15.5:56128) 2024-08-18T21:06:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 1 -- 172.21.15.5:0/158024855 learned_addr learned my addr 172.21.15.5:0/158024855 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 10 monclient(hunting): get_auth_request con 0x7fef6c138a10 auth_method 0 2024-08-18T21:06:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef717d9640 1 --2- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c13ead0 0x7fef6c1377f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:59720/0 (socket says 172.21.15.5:59720) 2024-08-18T21:06:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef70fd8640 10 monclient(hunting): get_auth_request con 0x7fef6c0a4db0 auth_method 0 2024-08-18T21:06:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef70fd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef70fd8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef70fd8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef717d9640 10 monclient(hunting): get_auth_request con 0x7fef6c13ead0 auth_method 0 2024-08-18T21:06:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef717d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef717d9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef717d9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef717d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef717d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef717d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef70fd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef70fd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef70fd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 10 monclient(hunting): handle_auth_done global_id 5214 payload 824 2024-08-18T21:06:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 1 -- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c13ead0 msgr2=0x7fef6c1377f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 1 --2- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c13ead0 0x7fef6c1377f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 1 -- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef6c0a4db0 msgr2=0x7fef6c11f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 1 --2- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef6c0a4db0 0x7fef6c11f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:06:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 1 monclient: found mon.noname-g 2024-08-18T21:06:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:06:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.885+0000 7fef6bfff640 1 -- 172.21.15.5:0/158024855 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6c06d070 con 0x7fef6c138a10 2024-08-18T21:06:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef6bfff640 1 -- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef6c138a10 msgr2=0x7fef6c120980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef6bfff640 1 --2- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef6c138a10 0x7fef6c120980 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00b4a0 tx=0x7fef5c00b960 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef697fa640 1 -- 172.21.15.5:0/158024855 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fef5c0092a0 con 0x7fef6c138a10 2024-08-18T21:06:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef697fa640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:06:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef697fa640 10 monclient: dump: 2024-08-18T21:06:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.905 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef697fa640 10 monclient: _finish_auth 0 2024-08-18T21:06:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef697fa640 10 monclient: _check_auth_tickets 2024-08-18T21:06:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef697fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef697fa640 1 -- 172.21.15.5:0/158024855 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef5c015070 con 0x7fef6c138a10 2024-08-18T21:06:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef697fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef7323c640 5 monclient: authenticate success, global_id 5214 2024-08-18T21:06:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef7323c640 10 monclient: _renew_subs 2024-08-18T21:06:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef7323c640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.157:3301/0 2024-08-18T21:06:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef7323c640 1 -- 172.21.15.5:0/158024855 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef6c1411d0 con 0x7fef6c138a10 2024-08-18T21:06:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef6a7fc640 4 set_mon_vals no callback set 2024-08-18T21:06:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef697fa640 1 -- 172.21.15.5:0/158024855 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fef5c003df0 con 0x7fef6c138a10 2024-08-18T21:06:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef697fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:06:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef697fa640 10 monclient: dump: 2024-08-18T21:06:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.907 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef7323c640 10 monclient: _renew_subs 2024-08-18T21:06:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef7323c640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.157:3301/0 2024-08-18T21:06:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef7323c640 1 -- 172.21.15.5:0/158024855 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fef6c13e290 con 0x7fef6c138a10 2024-08-18T21:06:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef7323c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef7323c640 1 --2- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c137d30 0x7fef6c1d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef7323c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef7323c640 1 -- 172.21.15.5:0/158024855 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fef6c051140 con 0x7fef6c137d30 2024-08-18T21:06:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef70fd8640 1 --2- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c137d30 0x7fef6c1d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef70fd8640 10 monclient: get_auth_request con 0x7fef6c137d30 auth_method 0 2024-08-18T21:06:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef70fd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef70fd8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef70fd8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef70fd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef70fd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef70fd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef697fa640 1 -- 172.21.15.5:0/158024855 <== mon.3 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fef5c0055b0 con 0x7fef6c138a10 2024-08-18T21:06:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef70fd8640 10 monclient(hunting): handle_auth_done global_id 34610 payload 824 2024-08-18T21:06:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef70fd8640 1 -- 172.21.15.5:0/158024855 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef6c06dbf0 con 0x7fef6c137d30 2024-08-18T21:06:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef697fa640 1 --2- 172.21.15.5:0/158024855 >> v2:172.21.15.157:6812/631023601 conn(0x7fef5803bdf0 0x7fef5803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef697fa640 1 -- 172.21.15.5:0/158024855 <== mon.3 v2:172.21.15.157:3301/0 5 ==== osd_map(84..84 src has 22..84) ==== 3506+0+0 (secure 0 0 0) 0x7fef5c00d040 con 0x7fef6c138a10 2024-08-18T21:06:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef717d9640 1 --2- 172.21.15.5:0/158024855 >> v2:172.21.15.157:6812/631023601 conn(0x7fef5803bdf0 0x7fef5803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.889+0000 7fef717d9640 10 monclient: get_auth_request con 0x7fef5803bdf0 auth_method 0 2024-08-18T21:06:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.893+0000 7fef70fd8640 1 -- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c137d30 msgr2=0x7fef6c1d10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.893+0000 7fef70fd8640 1 --2- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c137d30 0x7fef6c1d10b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fef600119d0 tx=0x7fef60011e90 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.893+0000 7fef697fa640 1 -- 172.21.15.5:0/158024855 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fef60019070 con 0x7fef6c137d30 2024-08-18T21:06:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.893+0000 7fef697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.893+0000 7fef697fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:06:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.893+0000 7fef697fa640 10 monclient: dump: 2024-08-18T21:06:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.910 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.893+0000 7fef717d9640 1 --2- 172.21.15.5:0/158024855 >> v2:172.21.15.157:6812/631023601 conn(0x7fef5803bdf0 0x7fef5803e2b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fef640ae000 tx=0x7fef640a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.893+0000 7fef697fa640 1 -- 172.21.15.5:0/158024855 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fef6000f950 con 0x7fef6c137d30 2024-08-18T21:06:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.893+0000 7fef697fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.893+0000 7fef697fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.893+0000 7fef697fa640 1 -- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c137d30 msgr2=0x7fef6c1d10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.893+0000 7fef697fa640 1 --2- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c137d30 0x7fef6c1d10b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fef600119d0 tx=0x7fef60011e90 comp rx=0 tx=0).stop 2024-08-18T21:06:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.893+0000 7fef697fa640 1 -- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c137d30 msgr2=0x7fef6c1d10b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.893+0000 7fef697fa640 1 --2- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c137d30 0x7fef6c1d10b0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fef600119d0 tx=0x7fef60011e90 comp rx=0 tx=0).stop 2024-08-18T21:06:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.901+0000 7fef7323c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.901+0000 7fef7323c640 1 --2- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c1d15f0 0x7fef6c1d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.901+0000 7fef7323c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.901+0000 7fef7323c640 1 -- 172.21.15.5:0/158024855 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fef6c1d1f40 con 0x7fef6c1d15f0 2024-08-18T21:06:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.901+0000 7fef70fd8640 1 --2- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c1d15f0 0x7fef6c1d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.901+0000 7fef70fd8640 10 monclient: get_auth_request con 0x7fef6c1d15f0 auth_method 0 2024-08-18T21:06:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.901+0000 7fef70fd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.901+0000 7fef70fd8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.901+0000 7fef70fd8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.901+0000 7fef70fd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.901+0000 7fef70fd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.901+0000 7fef70fd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.901+0000 7fef70fd8640 10 monclient(hunting): handle_auth_done global_id 34619 payload 824 2024-08-18T21:06:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.901+0000 7fef70fd8640 1 -- 172.21.15.5:0/158024855 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fef6c06d2a0 con 0x7fef6c1d15f0 2024-08-18T21:06:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef70fd8640 1 -- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c1d15f0 msgr2=0x7fef6c1d1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef70fd8640 1 --2- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c1d15f0 0x7fef6c1d1a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fef600096c0 tx=0x7fef600046d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef697fa640 1 -- 172.21.15.5:0/158024855 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fef60019040 con 0x7fef6c1d15f0 2024-08-18T21:06:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef697fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:06:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef697fa640 10 monclient: dump: 2024-08-18T21:06:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:41.915 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:41.915 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:41.915 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:41.915 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:41.915 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:41.915 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:41.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef697fa640 1 -- 172.21.15.5:0/158024855 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9225 (secure 0 0 0) 0x7fef6001e450 con 0x7fef6c1d15f0 2024-08-18T21:06:41.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef697fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:41.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef697fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:41.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef697fa640 1 -- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c1d15f0 msgr2=0x7fef6c1d1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef697fa640 1 --2- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c1d15f0 0x7fef6c1d1a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fef600096c0 tx=0x7fef600046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef697fa640 1 -- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c1d15f0 msgr2=0x7fef6c1d1a00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:41.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef697fa640 1 --2- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fef6c1d15f0 0x7fef6c1d1a00 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fef600096c0 tx=0x7fef600046d0 comp rx=0 tx=0).stop 2024-08-18T21:06:41.916 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:41.916 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:41.916 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:41.916 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:41.916 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 74, 2024-08-18T21:06:41.916 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 121698, 2024-08-18T21:06:41.916 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:41.916 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:41.916 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:41.916 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:41.916 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:41.917 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:41.917 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:41.917 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:41.917 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.917 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:06:41.917 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:41.917 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:41.917 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:41.917 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.917 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.917 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.917 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.917 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.917 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.918 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.918 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.918 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.918 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.918 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.918 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.918 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:41.918 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:41.918 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.918 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.918 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.918 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.918 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.918 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.919 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.919 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.919 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.919 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.919 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.919 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.919 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:41.919 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:41.919 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:41.919 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:41.919 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:41.919 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:41.919 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:41.920 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:41.920 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:41.920 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:41.920 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:41.920 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:41.920 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:41.920 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:41.920 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:41.920 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:41.920 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:41.920 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:41.920 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:41.920 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:41.921 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:41.921 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:41.921 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:41.921 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:41.921 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:41.921 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:41.921 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:41.921 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:41.921 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.921 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:41.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.921 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:41.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.921 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:41.921 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:41.922 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.922 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.922 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:41.922 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.922 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:41.922 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.922 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.922 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.923 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:41.923 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:41.923 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.923 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.923 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.923 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:41.923 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:41.923 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.923 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.923 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.923 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:41.924 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.925 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.925 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:41.925 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.925 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.925 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.925 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:41.926 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:41.926 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.926 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.926 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.926 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.926 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:41.926 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:41.926 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.926 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.926 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.926 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.926 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:41.926 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:41.933 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:41.933 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.933 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.933 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.933 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:41.933 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.933 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.933 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:41.933 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.933 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.934 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:41.934 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:41.934 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.934 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.934 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.934 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:41.934 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:41.934 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.934 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.934 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.935 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:41.935 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.935 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:41.935 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.935 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.935 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.935 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:41.935 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:41.935 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.935 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.935 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.936 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:41.936 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:41.936 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:41.936 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:41.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.936 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:41.936 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:41.936 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.936 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:41.937 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:41.937 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:41.937 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.937 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.937 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:41.937 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:41.937 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:41.937 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:41.937 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:41.937 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.937 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.937 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:41.937 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:41.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.938 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:41.938 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:41.938 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:41.938 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.938 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:41.938 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:41.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:41.938 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:41.938 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:41.938 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:06:41.938 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:41.938 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:41.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:41.939 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:41.939 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef7323c640 1 -- 172.21.15.5:0/158024855 >> v2:172.21.15.157:6812/631023601 conn(0x7fef5803bdf0 msgr2=0x7fef5803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef7323c640 1 --2- 172.21.15.5:0/158024855 >> v2:172.21.15.157:6812/631023601 conn(0x7fef5803bdf0 0x7fef5803e2b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fef640ae000 tx=0x7fef640a7070 comp rx=0 tx=0).stop 2024-08-18T21:06:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef7323c640 10 monclient: shutdown 2024-08-18T21:06:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef7323c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef7323c640 1 -- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef6c138a10 msgr2=0x7fef6c120980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef7323c640 1 --2- 172.21.15.5:0/158024855 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef6c138a10 0x7fef6c120980 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00b4a0 tx=0x7fef5c00b960 comp rx=0 tx=0).stop 2024-08-18T21:06:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef717d9640 1 -- 172.21.15.5:0/158024855 reap_dead start 2024-08-18T21:06:41.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef717d9640 1 -- 172.21.15.5:0/158024855 reap_dead start 2024-08-18T21:06:41.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef7323c640 1 -- 172.21.15.5:0/158024855 shutdown_connections 2024-08-18T21:06:41.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef7323c640 1 -- 172.21.15.5:0/158024855 >> 172.21.15.5:0/158024855 conn(0x7fef6c0688d0 msgr2=0x7fef6c0a22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:41.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef7323c640 1 -- 172.21.15.5:0/158024855 shutdown_connections 2024-08-18T21:06:41.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:41.905+0000 7fef7323c640 1 -- 172.21.15.5:0/158024855 wait complete. 2024-08-18T21:06:41.941 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:06:41.941 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon i 2024-08-18T21:06:41.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:06:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 10 monclient: get_monmap_and_config 2024-08-18T21:06:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 10 monclient: build_initial_monmap 2024-08-18T21:06:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 10 monclient: monmap: 2024-08-18T21:06:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:06:42.056850+0000 2024-08-18T21:06:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:06:42.056850+0000 2024-08-18T21:06:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:06:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:06:42.057 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:42.057 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:42.057 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:42.057 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:42.057 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:42.057 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:42.057 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:42.057 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:06:42.057 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:06:42.057 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 1 Processor -- start 2024-08-18T21:06:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 1 -- start start 2024-08-18T21:06:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 10 monclient: init 2024-08-18T21:06:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 10 monclient: _add_conns ranks=[6,8,4,9,10,0,1,2,7,3,5] 2024-08-18T21:06:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f20040a6ce0 0x7f20040a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 10 monclient(hunting): picked mon.noname-d con 0x7f20040a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20040a7600 0x7f2004139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 10 monclient(hunting): picked mon.noname-e con 0x7f20040a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:06:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2004139fe0 0x7f200413a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 10 monclient(hunting): picked mon.noname-c con 0x7f2004139fe0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f20040a5000 con 0x7f2004139fe0 2024-08-18T21:06:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f20040a4360 con 0x7f20040a6ce0 2024-08-18T21:06:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f20040a45d0 con 0x7f20040a7600 2024-08-18T21:06:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2008a60640 10 monclient(hunting): authenticate will time out at 1169.069988s 2024-08-18T21:06:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2002d9d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2004139fe0 0x7f200413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20040a7600 0x7f2004139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f200259c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f20040a6ce0 0x7f20040a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f200259c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f20040a6ce0 0x7f20040a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:45150/0 (socket says 172.21.15.5:45150) 2024-08-18T21:06:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20040a7600 0x7f2004139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:44492/0 (socket says 172.21.15.5:44492) 2024-08-18T21:06:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f200259c640 1 -- 172.21.15.5:0/2964373173 learned_addr learned my addr 172.21.15.5:0/2964373173 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2002d9d640 10 monclient(hunting): get_auth_request con 0x7f2004139fe0 auth_method 0 2024-08-18T21:06:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2002d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2002d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2002d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f200259c640 10 monclient(hunting): get_auth_request con 0x7f20040a6ce0 auth_method 0 2024-08-18T21:06:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f200259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f200259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f200259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 10 monclient(hunting): get_auth_request con 0x7f20040a7600 auth_method 0 2024-08-18T21:06:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f200259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f200259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f200259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2002d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2002d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2002d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 10 monclient(hunting): handle_auth_done global_id 54323 payload 274 2024-08-18T21:06:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 1 -- 172.21.15.5:0/2964373173 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f20040a6ce0 msgr2=0x7f20040a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 1 --2- 172.21.15.5:0/2964373173 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f20040a6ce0 0x7f20040a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 1 -- 172.21.15.5:0/2964373173 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2004139fe0 msgr2=0x7f200413a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:06:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 1 --2- 172.21.15.5:0/2964373173 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2004139fe0 0x7f200413a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:06:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 1 monclient: found mon.noname-e 2024-08-18T21:06:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:06:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f2001d9b640 1 -- 172.21.15.5:0/2964373173 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20040a32d0 con 0x7f20040a7600 2024-08-18T21:06:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.053+0000 7f200259c640 1 --2- 172.21.15.5:0/2964373173 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f20040a6ce0 0x7f20040a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:06:42.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f2001d9b640 1 -- 172.21.15.5:0/2964373173 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20040a7600 msgr2=0x7f2004139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f2001d9b640 1 --2- 172.21.15.5:0/2964373173 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20040a7600 0x7f2004139aa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009820 tx=0x7f1fec01c380 comp rx=0 tx=0).ready entity=mon.8 client_cookie=2df66f02e40b5250 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f200159a640 1 -- 172.21.15.5:0/2964373173 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1fec0b0070 con 0x7f20040a7600 2024-08-18T21:06:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f200159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f200159a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:06:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f200159a640 10 monclient: dump: 2024-08-18T21:06:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:42.071 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f200159a640 10 monclient: _finish_auth 0 2024-08-18T21:06:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f200159a640 10 monclient: _check_auth_tickets 2024-08-18T21:06:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f200159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f200159a640 1 -- 172.21.15.5:0/2964373173 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fec0aa810 con 0x7f20040a7600 2024-08-18T21:06:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f200159a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f200159a640 1 -- 172.21.15.5:0/2964373173 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1fec0aae30 con 0x7f20040a7600 2024-08-18T21:06:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f2008a60640 5 monclient: authenticate success, global_id 54323 2024-08-18T21:06:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f2008a60640 10 monclient: get_monmap_and_config success 2024-08-18T21:06:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f2008a60640 4 set_mon_vals no callback set 2024-08-18T21:06:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f200159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f200159a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:06:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f200159a640 10 monclient: dump: 2024-08-18T21:06:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:42.073 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f2008a60640 10 monclient: shutdown 2024-08-18T21:06:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f2008a60640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f2008a60640 1 -- 172.21.15.5:0/2964373173 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20040a7600 msgr2=0x7f2004139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f2008a60640 1 --2- 172.21.15.5:0/2964373173 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20040a7600 0x7f2004139aa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009820 tx=0x7f1fec01c380 comp rx=0 tx=0).stop 2024-08-18T21:06:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f2008a60640 1 -- 172.21.15.5:0/2964373173 shutdown_connections 2024-08-18T21:06:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f2008a60640 1 --2- 172.21.15.5:0/2964373173 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2004139fe0 0x7f200413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f2008a60640 1 --2- 172.21.15.5:0/2964373173 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20040a7600 0x7f2004139aa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f2008a60640 1 --2- 172.21.15.5:0/2964373173 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f20040a6ce0 0x7f20040a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f2008a60640 1 -- 172.21.15.5:0/2964373173 >> 172.21.15.5:0/2964373173 conn(0x7f20040acbc0 msgr2=0x7f20040a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f2008a60640 1 -- 172.21.15.5:0/2964373173 shutdown_connections 2024-08-18T21:06:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.057+0000 7f2008a60640 1 -- 172.21.15.5:0/2964373173 wait complete. 2024-08-18T21:06:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 10 monclient: build_initial_monmap 2024-08-18T21:06:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 10 monclient: monmap: 2024-08-18T21:06:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:06:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:06:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:06:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:06:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:06:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:06:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:06:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:06:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:06:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:06:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:06:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:06:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:06:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:06:42.075 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 1 Processor -- start 2024-08-18T21:06:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 1 -- start start 2024-08-18T21:06:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 10 monclient: init 2024-08-18T21:06:42.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 10 monclient: _reopen_session rank -1 2024-08-18T21:06:42.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 10 monclient: _add_conns ranks=[4,5,6,0,1,7,8,2,3] 2024-08-18T21:06:42.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f20040a6ce0 0x7f20041d1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:42.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 10 monclient(hunting): picked mon.noname-c con 0x7f20040a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:06:42.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f20040a7600 0x7f200413fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:42.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 10 monclient(hunting): picked mon.noname-h con 0x7f20040a7600 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:06:42.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2004139fe0 0x7f20041402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:42.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 10 monclient(hunting): picked mon.noname-d con 0x7f2004139fe0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:06:42.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:42.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f20040a79e0 con 0x7f20040a6ce0 2024-08-18T21:06:42.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:42.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f20040a8220 con 0x7f20040a7600 2024-08-18T21:06:42.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:42.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f2004140830 con 0x7f2004139fe0 2024-08-18T21:06:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 10 monclient(hunting): _renew_subs 2024-08-18T21:06:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2008a60640 10 monclient(hunting): authenticate will time out at 1169.077252s 2024-08-18T21:06:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f20040a6ce0 0x7f20041d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f20040a6ce0 0x7f20041d1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:41286/0 (socket says 172.21.15.5:41286) 2024-08-18T21:06:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 1 -- 172.21.15.5:0/3153701474 learned_addr learned my addr 172.21.15.5:0/3153701474 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:06:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 10 monclient(hunting): get_auth_request con 0x7f20040a6ce0 auth_method 0 2024-08-18T21:06:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2002d9d640 1 --2- 172.21.15.5:0/3153701474 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2004139fe0 0x7f20041402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2002d9d640 10 monclient(hunting): get_auth_request con 0x7f2004139fe0 auth_method 0 2024-08-18T21:06:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2002d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2002d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2002d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2002d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2002d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2002d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2001d9b640 1 --2- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f20040a7600 0x7f200413fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2001d9b640 10 monclient(hunting): get_auth_request con 0x7f20040a7600 auth_method 0 2024-08-18T21:06:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2001d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2001d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f2001d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 10 monclient(hunting): handle_auth_done global_id 5278 payload 824 2024-08-18T21:06:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 1 -- 172.21.15.5:0/3153701474 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2004139fe0 msgr2=0x7f20041402f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 1 --2- 172.21.15.5:0/3153701474 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2004139fe0 0x7f20041402f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 1 -- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f20040a7600 msgr2=0x7f200413fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 1 --2- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f20040a7600 0x7f200413fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:06:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 10 monclient: _finish_hunting 0 2024-08-18T21:06:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 1 monclient: found mon.noname-c 2024-08-18T21:06:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:06:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:06:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 1 -- 172.21.15.5:0/3153701474 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20040ac090 con 0x7f20040a6ce0 2024-08-18T21:06:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 1 -- 172.21.15.5:0/3153701474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f20040a6ce0 msgr2=0x7f20041d1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.061+0000 7f200259c640 1 --2- 172.21.15.5:0/3153701474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f20040a6ce0 0x7f20041d1650 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00efc0 tx=0x7f1ffc00c490 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f1ffaffd640 1 -- 172.21.15.5:0/3153701474 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1ffc0148f0 con 0x7f20040a6ce0 2024-08-18T21:06:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f1ffaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f1ffaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:06:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f1ffaffd640 10 monclient: dump: 2024-08-18T21:06:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:42.081 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f1ffaffd640 10 monclient: _finish_auth 0 2024-08-18T21:06:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f1ffaffd640 10 monclient: _check_auth_tickets 2024-08-18T21:06:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f1ffaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:06:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f1ffaffd640 1 -- 172.21.15.5:0/3153701474 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ffc019070 con 0x7f20040a6ce0 2024-08-18T21:06:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2008a60640 5 monclient: authenticate success, global_id 5278 2024-08-18T21:06:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f1ffaffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:06:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f1ffaffd640 1 -- 172.21.15.5:0/3153701474 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1ffc0073f0 con 0x7f20040a6ce0 2024-08-18T21:06:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f1ffaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f1ffaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:06:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f1ffaffd640 10 monclient: dump: 2024-08-18T21:06:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:42.083 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2000d99640 4 set_mon_vals no callback set 2024-08-18T21:06:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2008a60640 10 monclient: _renew_subs 2024-08-18T21:06:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2008a60640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:06:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2008a60640 1 -- 172.21.15.5:0/3153701474 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200413c520 con 0x7f20040a6ce0 2024-08-18T21:06:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2008a60640 10 monclient: _renew_subs 2024-08-18T21:06:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2008a60640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:06:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2008a60640 1 -- 172.21.15.5:0/3153701474 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f200413dfe0 con 0x7f20040a6ce0 2024-08-18T21:06:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2008a60640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2008a60640 1 --2- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f200413aaf0 0x7f200413aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2008a60640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2008a60640 1 -- 172.21.15.5:0/3153701474 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f20040a7b60 con 0x7f200413aaf0 2024-08-18T21:06:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f1ffaffd640 1 -- 172.21.15.5:0/3153701474 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f1ffc012050 con 0x7f20040a6ce0 2024-08-18T21:06:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f1ffaffd640 1 --2- 172.21.15.5:0/3153701474 >> v2:172.21.15.157:6812/631023601 conn(0x7f1fe403bdf0 0x7f1fe403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f1ffaffd640 1 -- 172.21.15.5:0/3153701474 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(84..84 src has 22..84) ==== 3506+0+0 (secure 0 0 0) 0x7f1ffc04e740 con 0x7f20040a6ce0 2024-08-18T21:06:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2001d9b640 1 --2- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f200413aaf0 0x7f200413aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2001d9b640 10 monclient: get_auth_request con 0x7f200413aaf0 auth_method 0 2024-08-18T21:06:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2001d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2001d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2001d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2001d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2001d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2001d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2002d9d640 1 --2- 172.21.15.5:0/3153701474 >> v2:172.21.15.157:6812/631023601 conn(0x7f1fe403bdf0 0x7f1fe403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2002d9d640 10 monclient: get_auth_request con 0x7f1fe403bdf0 auth_method 0 2024-08-18T21:06:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2001d9b640 10 monclient(hunting): handle_auth_done global_id 5074 payload 824 2024-08-18T21:06:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.065+0000 7f2001d9b640 1 -- 172.21.15.5:0/3153701474 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20040aa3c0 con 0x7f200413aaf0 2024-08-18T21:06:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.069+0000 7f2001d9b640 1 -- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f200413aaf0 msgr2=0x7f200413aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.069+0000 7f2001d9b640 1 --2- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f200413aaf0 0x7f200413aed0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0097f0 tx=0x7f1fec019120 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.069+0000 7f2002d9d640 1 --2- 172.21.15.5:0/3153701474 >> v2:172.21.15.157:6812/631023601 conn(0x7f1fe403bdf0 0x7f1fe403e2b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2004135c80 tx=0x7f1ff4009190 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.069+0000 7f1ffaffd640 1 -- 172.21.15.5:0/3153701474 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1fec0ba070 con 0x7f200413aaf0 2024-08-18T21:06:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.069+0000 7f1ffaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.069+0000 7f1ffaffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:06:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.069+0000 7f1ffaffd640 10 monclient: dump: 2024-08-18T21:06:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:42.088 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:42.088 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:42.088 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:42.088 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:42.088 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:42.088 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:42.088 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:42.088 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:42.088 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:42.088 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:42.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.069+0000 7f1ffaffd640 1 -- 172.21.15.5:0/3153701474 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1fec003a40 con 0x7f200413aaf0 2024-08-18T21:06:42.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.069+0000 7f1ffaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:06:42.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.069+0000 7f1ffaffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:06:42.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.069+0000 7f1ffaffd640 1 -- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f200413aaf0 msgr2=0x7f200413aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:42.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.069+0000 7f1ffaffd640 1 --2- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f200413aaf0 0x7f200413aed0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0097f0 tx=0x7f1fec019120 comp rx=0 tx=0).stop 2024-08-18T21:06:42.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.069+0000 7f1ffaffd640 1 -- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f200413aaf0 msgr2=0x7f200413aed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:42.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.069+0000 7f1ffaffd640 1 --2- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f200413aaf0 0x7f200413aed0 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0097f0 tx=0x7f1fec019120 comp rx=0 tx=0).stop 2024-08-18T21:06:42.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.077+0000 7f2008a60640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:06:42.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.077+0000 7f2008a60640 1 --2- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f200413b410 0x7f200409da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:06:42.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.077+0000 7f2008a60640 10 monclient(hunting): start opening mon connection 2024-08-18T21:06:42.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.077+0000 7f2008a60640 1 -- 172.21.15.5:0/3153701474 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f2004051140 con 0x7f200413b410 2024-08-18T21:06:42.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.077+0000 7f2001d9b640 1 --2- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f200413b410 0x7f200409da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:06:42.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.077+0000 7f2001d9b640 10 monclient: get_auth_request con 0x7f200413b410 auth_method 0 2024-08-18T21:06:42.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.077+0000 7f2001d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:06:42.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.077+0000 7f2001d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:06:42.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.077+0000 7f2001d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:06:42.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.077+0000 7f2001d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:06:42.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.077+0000 7f2001d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:06:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.077+0000 7f2001d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:06:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.077+0000 7f2001d9b640 10 monclient(hunting): handle_auth_done global_id 5083 payload 824 2024-08-18T21:06:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.077+0000 7f2001d9b640 1 -- 172.21.15.5:0/3153701474 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f200413e450 con 0x7f200413b410 2024-08-18T21:06:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.077+0000 7f2001d9b640 1 -- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f200413b410 msgr2=0x7f200409da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:06:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.077+0000 7f2001d9b640 1 --2- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f200413b410 0x7f200409da30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1fec01c3c0 tx=0x7f1fec0a8000 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:06:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f1ffaffd640 1 -- 172.21.15.5:0/3153701474 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1fec0b0040 con 0x7f200413b410 2024-08-18T21:06:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f1ffaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:06:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f1ffaffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:06:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f1ffaffd640 10 monclient: dump: 2024-08-18T21:06:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:06:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:06:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:06:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:06:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:06:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:06:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:06:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:06:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:06:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:06:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:06:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:06:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:06:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:06:42.091 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:06:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f1ffaffd640 1 -- 172.21.15.5:0/3153701474 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9225 (secure 0 0 0) 0x7f1fec0b68a0 con 0x7f200413b410 2024-08-18T21:06:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f1ffaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:06:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f1ffaffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:06:42.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f1ffaffd640 1 -- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f200413b410 msgr2=0x7f200409da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:42.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f1ffaffd640 1 --2- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f200413b410 0x7f200409da30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1fec01c3c0 tx=0x7f1fec0a8000 comp rx=0 tx=0).stop 2024-08-18T21:06:42.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f1ffaffd640 1 -- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f200413b410 msgr2=0x7f200409da30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:06:42.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f1ffaffd640 1 --2- 172.21.15.5:0/3153701474 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f200413b410 0x7f200409da30 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1fec01c3c0 tx=0x7f1fec0a8000 comp rx=0 tx=0).stop 2024-08-18T21:06:42.092 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:06:42.092 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:42.092 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:42.092 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:06:42.092 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 74, 2024-08-18T21:06:42.092 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 211177, 2024-08-18T21:06:42.092 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:06:42.093 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:06:42.093 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:06:42.093 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:06:42.093 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:06:42.093 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:06:42.093 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:06:42.093 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:06:42.093 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:42.093 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:06:42.093 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:42.093 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:06:42.093 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:06:42.093 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:42.093 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:42.094 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:42.094 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:42.094 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:42.094 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:42.094 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:42.094 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:42.094 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:42.094 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:42.094 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:42.094 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:42.094 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:06:42.094 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:06:42.095 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:42.095 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:42.095 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:42.095 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:42.095 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:42.095 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:42.095 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:42.095 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:42.095 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:42.095 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:42.095 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:42.095 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:42.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.095 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:06:42.096 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:06:42.096 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:06:42.096 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:06:42.096 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:06:42.096 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:06:42.096 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:42.096 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:06:42.096 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:06:42.096 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:06:42.096 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:06:42.096 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:06:42.096 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:06:42.096 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:06:42.096 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:06:42.097 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:06:42.097 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:06:42.097 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:06:42.097 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:06:42.097 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:06:42.097 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:06:42.097 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:06:42.097 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:06:42.097 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:06:42.097 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:06:42.097 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:06:42.097 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:06:42.097 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:06:42.098 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:42.098 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:06:42.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.098 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:06:42.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.098 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:06:42.098 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:06:42.098 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:42.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:42.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:42.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:06:42.098 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:06:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:06:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:06:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:42.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.100 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:06:42.100 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:06:42.100 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:42.100 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:42.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.100 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:42.100 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:06:42.100 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.100 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:42.100 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:06:42.101 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.101 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:42.101 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:42.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.101 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:06:42.101 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:06:42.101 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:42.101 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:42.101 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:42.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.101 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:06:42.101 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:06:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:06:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:06:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:06:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:06:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:06:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:06:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:06:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:06:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:06:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:06:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:06:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:06:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:06:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:06:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:06:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:06:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:06:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:06:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:06:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:06:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:06:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:06:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:06:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:06:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:06:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:06:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:06:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:06:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:06:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:06:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:06:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:06:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:06:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:06:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:06:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:06:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:06:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:06:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:06:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:06:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:06:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:06:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:06:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:06:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:06:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:06:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:06:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:06:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:06:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:06:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:06:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:06:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:06:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:06:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:06:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:06:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:06:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:06:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:06:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:06:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:06:42.114 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:06:42.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f2008a60640 1 -- 172.21.15.5:0/3153701474 >> v2:172.21.15.157:6812/631023601 conn(0x7f1fe403bdf0 msgr2=0x7f1fe403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:42.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f2008a60640 1 --2- 172.21.15.5:0/3153701474 >> v2:172.21.15.157:6812/631023601 conn(0x7f1fe403bdf0 0x7f1fe403e2b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2004135c80 tx=0x7f1ff4009190 comp rx=0 tx=0).stop 2024-08-18T21:06:42.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f2008a60640 10 monclient: shutdown 2024-08-18T21:06:42.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f2008a60640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:06:42.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f2008a60640 1 -- 172.21.15.5:0/3153701474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f20040a6ce0 msgr2=0x7f20041d1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:06:42.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f2008a60640 1 --2- 172.21.15.5:0/3153701474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f20040a6ce0 0x7f20041d1650 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00efc0 tx=0x7f1ffc00c490 comp rx=0 tx=0).stop 2024-08-18T21:06:42.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f2002d9d640 1 -- 172.21.15.5:0/3153701474 reap_dead start 2024-08-18T21:06:42.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f2002d9d640 1 -- 172.21.15.5:0/3153701474 reap_dead start 2024-08-18T21:06:42.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f2008a60640 1 -- 172.21.15.5:0/3153701474 shutdown_connections 2024-08-18T21:06:42.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f2008a60640 1 -- 172.21.15.5:0/3153701474 >> 172.21.15.5:0/3153701474 conn(0x7f20040acbc0 msgr2=0x7f2004135d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:06:42.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f2008a60640 1 -- 172.21.15.5:0/3153701474 shutdown_connections 2024-08-18T21:06:42.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:06:42.081+0000 7f2008a60640 1 -- 172.21.15.5:0/3153701474 wait complete. 2024-08-18T21:06:42.116 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-18T21:06:42.117 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-18T21:06:43.721 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28925]: starting. 2024-08-18T21:06:43.721 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28925]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28924 2024-08-18T21:06:43.722 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28925]: created object 0... 2024-08-18T21:06:43.722 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28925]: created object 25... 2024-08-18T21:06:43.722 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28925]: created object 49... 2024-08-18T21:06:43.722 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28925]: finishing. 2024-08-18T21:06:43.722 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[28925]: shutting down. 2024-08-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28926]: starting. 2024-08-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28926]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28924 2024-08-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[28926]: shutting down. 2024-08-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28961]: starting. 2024-08-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28961]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-28924 2024-08-18T21:06:46.336 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28961]: created object 0... 2024-08-18T21:06:46.336 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28961]: created object 25... 2024-08-18T21:06:46.336 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28961]: created object 49... 2024-08-18T21:06:46.336 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28961]: finishing. 2024-08-18T21:06:46.336 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[28961]: shutting down. 2024-08-18T21:06:46.396 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:46.396 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28963]: starting. 2024-08-18T21:06:46.396 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28963]: listing objects. 2024-08-18T21:06:46.396 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28963]: listed object 0... 2024-08-18T21:06:46.396 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28963]: listed object 25... 2024-08-18T21:06:46.396 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28963]: saw 50 objects 2024-08-18T21:06:46.396 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[28963]: shutting down. 2024-08-18T21:06:47.247 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:47.247 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28962]: starting. 2024-08-18T21:06:47.248 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28962]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-28924 2024-08-18T21:06:47.248 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[28962]: shutting down. 2024-08-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:06:47.254 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:06:49.768 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29016]: starting. 2024-08-18T21:06:49.768 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29016]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29015 2024-08-18T21:06:49.768 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29016]: created object 0... 2024-08-18T21:06:49.768 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29016]: created object 25... 2024-08-18T21:06:49.768 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29016]: created object 49... 2024-08-18T21:06:49.768 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29016]: finishing. 2024-08-18T21:06:49.768 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29016]: shutting down. 2024-08-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29017]: starting. 2024-08-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29017]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29015 2024-08-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29017]: shutting down. 2024-08-18T21:06:52.813 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:52.813 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29052]: starting. 2024-08-18T21:06:52.813 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29052]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29015 2024-08-18T21:06:52.813 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29052]: created object 0... 2024-08-18T21:06:52.813 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29052]: created object 25... 2024-08-18T21:06:52.813 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29052]: created object 49... 2024-08-18T21:06:52.814 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29052]: finishing. 2024-08-18T21:06:52.814 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29052]: shutting down. 2024-08-18T21:06:52.871 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:52.872 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29054]: starting. 2024-08-18T21:06:52.872 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29054]: listing objects. 2024-08-18T21:06:52.872 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29054]: listed object 0... 2024-08-18T21:06:52.872 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29054]: listed object 25... 2024-08-18T21:06:52.872 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29054]: saw 50 objects 2024-08-18T21:06:52.872 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29054]: shutting down. 2024-08-18T21:06:53.625 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:53.625 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29053]: starting. 2024-08-18T21:06:53.625 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29053]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29015 2024-08-18T21:06:53.625 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29053]: shutting down. 2024-08-18T21:06:53.628 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:53.628 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:53.628 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:06:53.632 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:06:55.858 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29107]: starting. 2024-08-18T21:06:55.858 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29107]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29106 2024-08-18T21:06:55.859 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29107]: created object 0... 2024-08-18T21:06:55.859 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29107]: created object 25... 2024-08-18T21:06:55.859 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29107]: created object 49... 2024-08-18T21:06:55.859 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29107]: finishing. 2024-08-18T21:06:55.859 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29107]: shutting down. 2024-08-18T21:06:55.970 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29108]: starting. 2024-08-18T21:06:55.970 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29108]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29106 2024-08-18T21:06:55.970 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29108]: shutting down. 2024-08-18T21:06:58.997 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:58.997 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29143]: starting. 2024-08-18T21:06:58.997 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29143]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29106 2024-08-18T21:06:58.998 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29143]: created object 0... 2024-08-18T21:06:58.998 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29143]: created object 25... 2024-08-18T21:06:58.998 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29143]: created object 49... 2024-08-18T21:06:58.998 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29143]: finishing. 2024-08-18T21:06:58.998 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29143]: shutting down. 2024-08-18T21:06:59.057 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:59.058 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29145]: starting. 2024-08-18T21:06:59.058 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29145]: listing objects. 2024-08-18T21:06:59.058 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29145]: listed object 0... 2024-08-18T21:06:59.058 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29145]: listed object 25... 2024-08-18T21:06:59.058 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29145]: saw 50 objects 2024-08-18T21:06:59.058 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29145]: shutting down. 2024-08-18T21:06:59.686 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:59.687 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29144]: starting. 2024-08-18T21:06:59.687 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29144]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29106 2024-08-18T21:06:59.687 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29144]: shutting down. 2024-08-18T21:06:59.690 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:59.690 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:06:59.690 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:06:59.694 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:07:01.978 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29198]: starting. 2024-08-18T21:07:01.978 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29198]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29197 2024-08-18T21:07:01.978 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29198]: created object 0... 2024-08-18T21:07:01.978 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29198]: created object 25... 2024-08-18T21:07:01.978 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29198]: created object 49... 2024-08-18T21:07:01.979 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29198]: finishing. 2024-08-18T21:07:01.979 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29198]: shutting down. 2024-08-18T21:07:02.117 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-08-18T21:07:02.118 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-18T21:07:02.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-18T21:07:02.120 INFO:tasks.ceph.mon.b:Started 2024-08-18T21:07:02.121 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-18T21:07:02.121 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-18T21:07:02.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-18T21:07:02.123 INFO:tasks.ceph.mon.a:Started 2024-08-18T21:07:02.123 INFO:tasks.mon_thrash:Sending STOP to mon g 2024-08-18T21:07:02.124 INFO:tasks.ceph.mon.g:Sent signal 19 2024-08-18T21:07:02.124 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs to unfreeze mons 2024-08-18T21:07:22.125 INFO:tasks.mon_thrash:Sending CONT to mon g 2024-08-18T21:07:22.126 INFO:tasks.ceph.mon.g:Sent signal 18 2024-08-18T21:07:22.126 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:07:22.127 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:07:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 10 monclient: get_monmap_and_config 2024-08-18T21:07:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 10 monclient: build_initial_monmap 2024-08-18T21:07:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 10 monclient: monmap: 2024-08-18T21:07:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:22.260931+0000 2024-08-18T21:07:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:22.260931+0000 2024-08-18T21:07:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:22.262 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 1 Processor -- start 2024-08-18T21:07:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 1 -- start start 2024-08-18T21:07:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 10 monclient: init 2024-08-18T21:07:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 10 monclient: _add_conns ranks=[6,2,1,5,0,9,8,3,10,4,7] 2024-08-18T21:07:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 0x7f08200a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 10 monclient(hunting): picked mon.noname-d con 0x7f08200a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 0x7f08200a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 10 monclient(hunting): picked mon.noname-b con 0x7f082009f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f0820139990 addr v1:172.21.15.157:6789/0 2024-08-18T21:07:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08200a7fb0 con 0x7f0820139990 2024-08-18T21:07:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f082009e4c0 con 0x7f082009f080 2024-08-18T21:07:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f082006f930 con 0x7f08200a6bd0 2024-08-18T21:07:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0827826640 10 monclient(hunting): authenticate will time out at 1209.274248s 2024-08-18T21:07:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f08255c2640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 0x7f08200a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0824dc1640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 0x7f08200a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0824dc1640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 0x7f08200a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:36304/0 (socket says 172.21.15.5:36304) 2024-08-18T21:07:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 learned_addr learned my addr 172.21.15.5:0/4154501042 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0824dc1640 10 monclient(hunting): get_auth_request con 0x7f082009f080 auth_method 0 2024-08-18T21:07:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0824dc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0824dc1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0824dc1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f08255c2640 10 monclient(hunting): get_auth_request con 0x7f08200a6bd0 auth_method 0 2024-08-18T21:07:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f08255c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f08255c2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f08255c2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 msgr2=0x7f08200a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:07:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 msgr2=0x7f08200a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 0x7f08200a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 0x7f08200a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f08255c2640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 msgr2=0x7f08200a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f08255c2640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 msgr2=0x7f08200a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 0x7f08200a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.260+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 0x7f08200a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.264+0000 7f0825dc3640 1 -- 172.21.15.5:0/4154501042 >> v1:172.21.15.157:6789/0 conn(0x7f0820139990 legacy=0x7f0820139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 0x7f08200a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f08255c2640 10 monclient(hunting): get_auth_request con 0x7f08200a6bd0 auth_method 0 2024-08-18T21:07:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f08255c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f08255c2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f08255c2640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f08255c2640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 msgr2=0x7f08200a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f08255c2640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 msgr2=0x7f08200a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 0x7f08200a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 0x7f08200a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 0x7f08200a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:22.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f0824dc1640 10 monclient(hunting): get_auth_request con 0x7f082009f080 auth_method 0 2024-08-18T21:07:22.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f0824dc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:22.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f0824dc1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:22.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f0824dc1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:22.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 msgr2=0x7f08200a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:22.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 msgr2=0x7f08200a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:22.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 0x7f08200a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:22.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.464+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 0x7f08200a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:22.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 0x7f08200a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:22.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f0824dc1640 10 monclient(hunting): get_auth_request con 0x7f082009f080 auth_method 0 2024-08-18T21:07:22.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f0824dc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:22.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f0824dc1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:22.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f0824dc1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 0x7f08200a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f08255c2640 10 monclient(hunting): get_auth_request con 0x7f08200a6bd0 auth_method 0 2024-08-18T21:07:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f08255c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f08255c2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f08255c2640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 msgr2=0x7f08200a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 msgr2=0x7f08200a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 0x7f08200a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f08255c2640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 msgr2=0x7f08200a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:07:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f08255c2640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 msgr2=0x7f08200a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 0x7f08200a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 0x7f08200a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:22.868+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 0x7f08200a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:23.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 0x7f08200a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:23.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 0x7f08200a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:23.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f08255c2640 10 monclient(hunting): get_auth_request con 0x7f08200a6bd0 auth_method 0 2024-08-18T21:07:23.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f08255c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:23.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f08255c2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:23.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f08255c2640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:23.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f0824dc1640 10 monclient(hunting): get_auth_request con 0x7f082009f080 auth_method 0 2024-08-18T21:07:23.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f0824dc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f0824dc1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f0824dc1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 msgr2=0x7f08200a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:07:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 msgr2=0x7f08200a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 0x7f08200a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f08255c2640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 msgr2=0x7f08200a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f08255c2640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 msgr2=0x7f08200a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 0x7f08200a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 0x7f08200a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:23.672+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 0x7f08200a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 10 monclient(hunting): tick 2024-08-18T21:07:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:07:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 1 monclient(hunting): continuing hunt 2024-08-18T21:07:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:07:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 msgr2=0x7f08200a6fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08200a6bd0 0x7f08200a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 msgr2=0x7f08200a74f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f082009f080 0x7f08200a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 1 -- 172.21.15.5:0/4154501042 >> v1:172.21.15.157:6789/0 conn(0x7f0820139990 legacy=0x7f0820139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:25.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 10 monclient: _add_conns ranks=[4,7,10,8,0,3,9,5] 2024-08-18T21:07:25.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 0x7f0804005d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:25.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 10 monclient(hunting): picked mon.noname-c con 0x7f0804003900 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:07:25.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 0x7f08040087f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:25.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 10 monclient(hunting): picked mon.noname-i con 0x7f0804006360 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:07:25.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 1 --2- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 0x7f080400b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:25.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 10 monclient(hunting): picked mon.noname-f con 0x7f0804008ec0 addr v2:172.21.15.157:3300/0 2024-08-18T21:07:25.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:25.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 1 -- 172.21.15.5:0/4154501042 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f082009e4c0 con 0x7f0804008ec0 2024-08-18T21:07:25.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:25.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 1 -- 172.21.15.5:0/4154501042 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f082006f930 con 0x7f0804003900 2024-08-18T21:07:25.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 1 -- 172.21.15.5:0/4154501042 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f080400ba70 con 0x7f0804006360 2024-08-18T21:07:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0816ffd640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 0x7f0804005d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f08255c2640 10 monclient(hunting): get_auth_request con 0x7f0804003900 auth_method 0 2024-08-18T21:07:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f08255c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f08255c2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f08255c2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 0x7f08040087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0825dc3640 1 --2- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 0x7f080400b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f08255c2640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 msgr2=0x7f0804005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f08255c2640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 msgr2=0x7f0804005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 0x7f0804005d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0824dc1640 10 monclient(hunting): get_auth_request con 0x7f0804006360 auth_method 0 2024-08-18T21:07:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0824dc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0824dc1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0824dc1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0825dc3640 10 monclient(hunting): get_auth_request con 0x7f0804008ec0 auth_method 0 2024-08-18T21:07:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0825dc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0825dc3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0825dc3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 0x7f0804005d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0825dc3640 1 -- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 msgr2=0x7f080400b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:07:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 msgr2=0x7f08040087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:07:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0825dc3640 1 -- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 msgr2=0x7f080400b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 msgr2=0x7f08040087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0825dc3640 1 --2- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 0x7f080400b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 0x7f08040087f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0825dc3640 1 --2- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 0x7f080400b380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.260+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 0x7f08040087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:25.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 0x7f0804005d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:25.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f08255c2640 10 monclient(hunting): get_auth_request con 0x7f0804003900 auth_method 0 2024-08-18T21:07:25.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f08255c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f08255c2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f08255c2640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f08255c2640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 msgr2=0x7f0804005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f08255c2640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 msgr2=0x7f0804005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 0x7f0804005d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0825dc3640 1 --2- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 0x7f080400b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 0x7f0804005d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0825dc3640 10 monclient(hunting): get_auth_request con 0x7f0804008ec0 auth_method 0 2024-08-18T21:07:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0825dc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0825dc3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0825dc3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 0x7f08040087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0824dc1640 10 monclient(hunting): get_auth_request con 0x7f0804006360 auth_method 0 2024-08-18T21:07:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0824dc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0824dc1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0824dc1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0825dc3640 1 -- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 msgr2=0x7f080400b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:07:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0825dc3640 1 -- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 msgr2=0x7f080400b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0825dc3640 1 --2- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 0x7f080400b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0825dc3640 1 --2- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 0x7f080400b380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 msgr2=0x7f08040087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:07:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 msgr2=0x7f08040087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 0x7f08040087f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.464+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 0x7f08040087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:25.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0825dc3640 1 --2- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 0x7f080400b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:25.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0825dc3640 10 monclient(hunting): get_auth_request con 0x7f0804008ec0 auth_method 0 2024-08-18T21:07:25.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0825dc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0825dc3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0825dc3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 0x7f08040087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0824dc1640 10 monclient(hunting): get_auth_request con 0x7f0804006360 auth_method 0 2024-08-18T21:07:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0824dc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0824dc1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0824dc1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0825dc3640 1 -- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 msgr2=0x7f080400b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0825dc3640 1 -- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 msgr2=0x7f080400b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0825dc3640 1 --2- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 0x7f080400b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0825dc3640 1 --2- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 0x7f080400b380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 msgr2=0x7f08040087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:07:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 msgr2=0x7f08040087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 0x7f08040087f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 0x7f08040087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 0x7f0804005d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f08255c2640 10 monclient(hunting): get_auth_request con 0x7f0804003900 auth_method 0 2024-08-18T21:07:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f08255c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f08255c2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f08255c2640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f08255c2640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 msgr2=0x7f0804005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f08255c2640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 msgr2=0x7f0804005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 0x7f0804005d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:25.868+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 0x7f0804005d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 0x7f08040087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0825dc3640 1 --2- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 0x7f080400b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0824dc1640 10 monclient(hunting): get_auth_request con 0x7f0804006360 auth_method 0 2024-08-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0824dc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0824dc1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0824dc1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0825dc3640 10 monclient(hunting): get_auth_request con 0x7f0804008ec0 auth_method 0 2024-08-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0825dc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0825dc3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0825dc3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 msgr2=0x7f08040087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0825dc3640 1 -- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 msgr2=0x7f080400b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 msgr2=0x7f08040087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0825dc3640 1 -- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 msgr2=0x7f080400b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0825dc3640 1 --2- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 0x7f080400b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 0x7f08040087f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0825dc3640 1 --2- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 0x7f080400b380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 0x7f08040087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 0x7f0804005d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f08255c2640 10 monclient(hunting): get_auth_request con 0x7f0804003900 auth_method 0 2024-08-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f08255c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f08255c2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f08255c2640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f08255c2640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 msgr2=0x7f0804005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f08255c2640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 msgr2=0x7f0804005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 0x7f0804005d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:26.672+0000 7f08255c2640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 0x7f0804005d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:27.697 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29199]: starting. 2024-08-18T21:07:27.697 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29199]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29197 2024-08-18T21:07:27.697 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29199]: shutting down. 2024-08-18T21:07:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 10 monclient(hunting): tick 2024-08-18T21:07:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:07:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 1 monclient(hunting): continuing hunt 2024-08-18T21:07:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:07:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 msgr2=0x7f08040087f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804006360 0x7f08040087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 msgr2=0x7f0804005d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0804003900 0x7f0804005d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 1 -- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 msgr2=0x7f080400b380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 1 --2- 172.21.15.5:0/4154501042 >> v2:172.21.15.157:3300/0 conn(0x7f0804008ec0 0x7f080400b380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0825dc3640 1 -- 172.21.15.5:0/4154501042 reap_dead start 2024-08-18T21:07:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 10 monclient: _add_conns ranks=[0,9,8,3,5] 2024-08-18T21:07:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0825dc3640 1 -- 172.21.15.5:0/4154501042 reap_dead start 2024-08-18T21:07:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0804003d20 addr v1:172.21.15.5:6789/0 2024-08-18T21:07:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 1 --2- 172.21.15.5:0/4154501042 >> v2:172.21.15.5:3300/0 conn(0x7f0804007ee0 0x7f080400b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 10 monclient(hunting): picked mon.noname-a con 0x7f0804007ee0 addr v2:172.21.15.5:3300/0 2024-08-18T21:07:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0804008390 0x7f080400e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 10 monclient(hunting): picked mon.noname-e con 0x7f0804008390 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:07:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 1 -- 172.21.15.5:0/4154501042 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f082009de70 con 0x7f0804003d20 2024-08-18T21:07:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 1 -- 172.21.15.5:0/4154501042 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f082009e4c0 con 0x7f0804007ee0 2024-08-18T21:07:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 1 -- 172.21.15.5:0/4154501042 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f082006f930 con 0x7f0804008390 2024-08-18T21:07:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0816ffd640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> v2:172.21.15.5:3300/0 conn(0x7f0804007ee0 0x7f080400b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0825dc3640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0804008390 0x7f080400e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0824dc1640 10 monclient(hunting): get_auth_request con 0x7f0804007ee0 auth_method 0 2024-08-18T21:07:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0824dc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0824dc1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0824dc1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0825dc3640 10 monclient(hunting): get_auth_request con 0x7f0804008390 auth_method 0 2024-08-18T21:07:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0825dc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0825dc3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0825dc3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0824dc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0824dc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0824dc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0825dc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0825dc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.259+0000 7f0825dc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.263+0000 7f0824dc1640 10 monclient(hunting): handle_auth_done global_id 74106 payload 274 2024-08-18T21:07:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.263+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0804008390 msgr2=0x7f080400e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.263+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0804008390 0x7f080400e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.263+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> v1:172.21.15.5:6789/0 conn(0x7f0804003d20 legacy=0x7f08040067c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.263+0000 7f0824dc1640 10 monclient: _finish_hunting 0 2024-08-18T21:07:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.263+0000 7f0824dc1640 1 monclient: found mon.noname-a 2024-08-18T21:07:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.263+0000 7f0824dc1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.263+0000 7f0824dc1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:07:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.263+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0804008850 con 0x7f0804007ee0 2024-08-18T21:07:28.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0824dc1640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0804007ee0 msgr2=0x7f080400b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:28.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0824dc1640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0804007ee0 0x7f080400b2b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0810009100 tx=0x7f081001de00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb4bf24fe0fe2e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:28.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0817fff640 1 -- 172.21.15.5:0/4154501042 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f08100b3070 con 0x7f0804007ee0 2024-08-18T21:07:28.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0817fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:28.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0817fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:07:28.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0817fff640 10 monclient: dump: 2024-08-18T21:07:28.273 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:28.273 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.273 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.273 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.273 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:28.273 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.273 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:28.273 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:28.273 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:28.273 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:28.273 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:28.273 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:28.273 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:28.274 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0817fff640 10 monclient: _finish_auth 0 2024-08-18T21:07:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0817fff640 10 monclient: _check_auth_tickets 2024-08-18T21:07:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0817fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0817fff640 1 -- 172.21.15.5:0/4154501042 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08100a6d80 con 0x7f0804007ee0 2024-08-18T21:07:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 5 monclient: authenticate success, global_id 74106 2024-08-18T21:07:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:07:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0817fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0817fff640 1 -- 172.21.15.5:0/4154501042 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f081000f040 con 0x7f0804007ee0 2024-08-18T21:07:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 4 set_mon_vals no callback set 2024-08-18T21:07:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0817fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0817fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:07:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0817fff640 10 monclient: dump: 2024-08-18T21:07:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:28.276 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 10 monclient: shutdown 2024-08-18T21:07:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 1 -- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0804007ee0 msgr2=0x7f080400b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0804007ee0 0x7f080400b2b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0810009100 tx=0x7f081001de00 comp rx=0 tx=0).stop 2024-08-18T21:07:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 1 -- 172.21.15.5:0/4154501042 shutdown_connections 2024-08-18T21:07:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0804008390 0x7f080400e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 1 --2- 172.21.15.5:0/4154501042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0804007ee0 0x7f080400b2b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 1 -- 172.21.15.5:0/4154501042 >> 172.21.15.5:0/4154501042 conn(0x7f0820068700 msgr2=0x7f0820068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 1 -- 172.21.15.5:0/4154501042 shutdown_connections 2024-08-18T21:07:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 1 -- 172.21.15.5:0/4154501042 wait complete. 2024-08-18T21:07:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 10 monclient: build_initial_monmap 2024-08-18T21:07:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 10 monclient: monmap: 2024-08-18T21:07:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:28.282 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.271+0000 7f0827826640 1 Processor -- start 2024-08-18T21:07:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 1 -- start start 2024-08-18T21:07:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 10 monclient: init 2024-08-18T21:07:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 10 monclient: _add_conns ranks=[6,7,1,2,4,3,8,5,0] 2024-08-18T21:07:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0804003d20 0x7f0820138e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 10 monclient(hunting): picked mon.noname-d con 0x7f0804003d20 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804007ee0 0x7f0820139340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 10 monclient(hunting): picked mon.noname-i con 0x7f0804007ee0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:07:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0804008390 0x7f0820122ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 10 monclient(hunting): picked mon.noname-f con 0x7f0804008390 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:07:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f082013a700 con 0x7f0804008390 2024-08-18T21:07:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f082013a580 con 0x7f0804003d20 2024-08-18T21:07:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f08200a6fb0 con 0x7f0804007ee0 2024-08-18T21:07:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0827826640 10 monclient(hunting): authenticate will time out at 1215.288801s 2024-08-18T21:07:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0804003d20 0x7f0820138e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0804003d20 0x7f0820138e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:60722/0 (socket says 172.21.15.5:60722) 2024-08-18T21:07:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 1 -- 172.21.15.5:0/141586683 learned_addr learned my addr 172.21.15.5:0/141586683 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 10 monclient(hunting): get_auth_request con 0x7f0804003d20 auth_method 0 2024-08-18T21:07:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0824dc1640 1 --2- 172.21.15.5:0/141586683 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804007ee0 0x7f0820139340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0825dc3640 1 --2- 172.21.15.5:0/141586683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0804008390 0x7f0820122ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0824dc1640 10 monclient(hunting): get_auth_request con 0x7f0804007ee0 auth_method 0 2024-08-18T21:07:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0824dc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0824dc1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0824dc1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0825dc3640 10 monclient(hunting): get_auth_request con 0x7f0804008390 auth_method 0 2024-08-18T21:07:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0825dc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0825dc3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f0825dc3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 10 monclient(hunting): handle_auth_done global_id 54411 payload 824 2024-08-18T21:07:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 1 -- 172.21.15.5:0/141586683 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804007ee0 msgr2=0x7f0820139340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 1 --2- 172.21.15.5:0/141586683 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804007ee0 0x7f0820139340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 1 -- 172.21.15.5:0/141586683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0804008390 msgr2=0x7f0820122ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 1 --2- 172.21.15.5:0/141586683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0804008390 0x7f0820122ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 10 monclient: _finish_hunting 0 2024-08-18T21:07:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 1 monclient: found mon.noname-d 2024-08-18T21:07:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:07:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 1 -- 172.21.15.5:0/141586683 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08200a1680 con 0x7f0804003d20 2024-08-18T21:07:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 1 -- 172.21.15.5:0/141586683 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0804003d20 msgr2=0x7f0820138e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.275+0000 7f08255c2640 1 --2- 172.21.15.5:0/141586683 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0804003d20 0x7f0820138e00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f081c016990 tx=0x7f081c016e50 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0815ffb640 1 -- 172.21.15.5:0/141586683 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f081c027070 con 0x7f0804003d20 2024-08-18T21:07:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0815ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0815ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:07:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0815ffb640 10 monclient: dump: 2024-08-18T21:07:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:28.288 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0815ffb640 10 monclient: _finish_auth 0 2024-08-18T21:07:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0815ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:07:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0815ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0815ffb640 1 -- 172.21.15.5:0/141586683 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f081c014d50 con 0x7f0804003d20 2024-08-18T21:07:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0827826640 5 monclient: authenticate success, global_id 54411 2024-08-18T21:07:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0815ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0815ffb640 1 -- 172.21.15.5:0/141586683 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f081c00f040 con 0x7f0804003d20 2024-08-18T21:07:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0827826640 10 monclient: _renew_subs 2024-08-18T21:07:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0827826640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:07:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0827826640 1 -- 172.21.15.5:0/141586683 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08201256a0 con 0x7f0804003d20 2024-08-18T21:07:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0815ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0815ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:07:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0815ffb640 10 monclient: dump: 2024-08-18T21:07:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:28.290 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f08177fe640 4 set_mon_vals no callback set 2024-08-18T21:07:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0827826640 10 monclient: _renew_subs 2024-08-18T21:07:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0827826640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:07:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0827826640 1 -- 172.21.15.5:0/141586683 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f08201267c0 con 0x7f0804003d20 2024-08-18T21:07:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0815ffb640 1 -- 172.21.15.5:0/141586683 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f081c0173e0 con 0x7f0804003d20 2024-08-18T21:07:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0827826640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0827826640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0827826640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:07:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0827826640 1 -- 172.21.15.5:0/141586683 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08200a7340 con 0x7f0804003d20 2024-08-18T21:07:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0815ffb640 1 --2- 172.21.15.5:0/141586683 >> v2:172.21.15.157:6812/631023601 conn(0x7f080403e1f0 0x7f08040406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0815ffb640 1 -- 172.21.15.5:0/141586683 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(105..105 src has 22..105) ==== 3506+0+0 (secure 0 0 0) 0x7f081c01f070 con 0x7f0804003d20 2024-08-18T21:07:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0824dc1640 1 --2- 172.21.15.5:0/141586683 >> v2:172.21.15.157:6812/631023601 conn(0x7f080403e1f0 0x7f08040406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.279+0000 7f0824dc1640 10 monclient: get_auth_request con 0x7f080403e1f0 auth_method 0 2024-08-18T21:07:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.283+0000 7f0824dc1640 1 --2- 172.21.15.5:0/141586683 >> v2:172.21.15.157:6812/631023601 conn(0x7f080403e1f0 0x7f08040406b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f08100ad000 tx=0x7f08100a8070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.283+0000 7f0815ffb640 1 -- 172.21.15.5:0/141586683 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f081c04e130 con 0x7f0804003d20 2024-08-18T21:07:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.283+0000 7f0815ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.283+0000 7f0815ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:28.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.531+0000 7f0827826640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:07:28.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.531+0000 7f0827826640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:07:28.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.531+0000 7f0827826640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:07:28.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.531+0000 7f0827826640 1 -- 172.21.15.5:0/141586683 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f08200746d0 con 0x7f0804003d20 2024-08-18T21:07:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.531+0000 7f0815ffb640 1 -- 172.21.15.5:0/141586683 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3172 (secure 0 0 0) 0x7f081c030c80 con 0x7f0804003d20 2024-08-18T21:07:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.531+0000 7f0815ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:07:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.531+0000 7f0815ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:28.534 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":94,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:07:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.535+0000 7f0827826640 1 -- 172.21.15.5:0/141586683 >> v2:172.21.15.157:6812/631023601 conn(0x7f080403e1f0 msgr2=0x7f08040406b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.535+0000 7f0827826640 1 --2- 172.21.15.5:0/141586683 >> v2:172.21.15.157:6812/631023601 conn(0x7f080403e1f0 0x7f08040406b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f08100ad000 tx=0x7f08100a8070 comp rx=0 tx=0).stop 2024-08-18T21:07:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.535+0000 7f0827826640 10 monclient: shutdown 2024-08-18T21:07:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.535+0000 7f0827826640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.535+0000 7f0827826640 1 -- 172.21.15.5:0/141586683 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0804003d20 msgr2=0x7f0820138e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.535+0000 7f0827826640 1 --2- 172.21.15.5:0/141586683 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0804003d20 0x7f0820138e00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f081c016990 tx=0x7f081c016e50 comp rx=0 tx=0).stop 2024-08-18T21:07:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.535+0000 7f0827826640 1 -- 172.21.15.5:0/141586683 shutdown_connections 2024-08-18T21:07:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.535+0000 7f0827826640 1 --2- 172.21.15.5:0/141586683 >> v2:172.21.15.157:6812/631023601 conn(0x7f080403e1f0 0x7f08040406b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.535+0000 7f0827826640 1 --2- 172.21.15.5:0/141586683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0804008390 0x7f0820122ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.535+0000 7f0827826640 1 --2- 172.21.15.5:0/141586683 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0804007ee0 0x7f0820139340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.535+0000 7f0827826640 1 --2- 172.21.15.5:0/141586683 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0804003d20 0x7f0820138e00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.535+0000 7f0827826640 1 -- 172.21.15.5:0/141586683 >> 172.21.15.5:0/141586683 conn(0x7f0820068700 msgr2=0x7f08200a1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.535+0000 7f0827826640 1 -- 172.21.15.5:0/141586683 shutdown_connections 2024-08-18T21:07:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.535+0000 7f0827826640 1 -- 172.21.15.5:0/141586683 wait complete. 2024-08-18T21:07:28.553 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:07:28.554 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:07:28.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:07:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 10 monclient: get_monmap_and_config 2024-08-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 10 monclient: build_initial_monmap 2024-08-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 10 monclient: monmap: 2024-08-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:28.673510+0000 2024-08-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:28.673510+0000 2024-08-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 1 Processor -- start 2024-08-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 1 -- start start 2024-08-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 10 monclient: init 2024-08-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 10 monclient: _add_conns ranks=[3,1,2,10,9,8,5,0,7,6,4] 2024-08-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc3f80a6ce0 0x7fc3f80a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 10 monclient(hunting): picked mon.noname-g con 0x7fc3f80a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fc3f80a7600 addr v1:172.21.15.157:6789/0 2024-08-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc3f813a1b0 0x7fc3f8141d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 10 monclient(hunting): picked mon.noname-b con 0x7fc3f813a1b0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3f80a45d0 con 0x7fc3f80a7600 2024-08-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fc3f80a5000 con 0x7fc3f813a1b0 2024-08-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc3f80a32d0 con 0x7fc3f80a6ce0 2024-08-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3ff8d5640 10 monclient(hunting): authenticate will time out at 1215.686691s 2024-08-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc3f813a1b0 0x7fc3f8141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc3f813a1b0 0x7fc3f8141d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:35614/0 (socket says 172.21.15.5:35614) 2024-08-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 1 -- 172.21.15.5:0/341979305 learned_addr learned my addr 172.21.15.5:0/341979305 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 10 monclient(hunting): get_auth_request con 0x7fc3f813a1b0 auth_method 0 2024-08-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fd671640 1 --2- 172.21.15.5:0/341979305 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc3f80a6ce0 0x7fc3f80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 10 monclient(hunting): handle_auth_done global_id 74117 payload 274 2024-08-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 1 -- 172.21.15.5:0/341979305 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc3f80a6ce0 msgr2=0x7fc3f80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 1 --2- 172.21.15.5:0/341979305 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc3f80a6ce0 0x7fc3f80a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 1 -- 172.21.15.5:0/341979305 >> v1:172.21.15.157:6789/0 conn(0x7fc3f80a7600 legacy=0x7fc3f8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 10 monclient: _finish_hunting 0 2024-08-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 1 monclient: found mon.noname-b 2024-08-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fde72640 1 -- 172.21.15.5:0/341979305 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f80a8900 con 0x7fc3f813a1b0 2024-08-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fd671640 10 monclient: get_auth_request con 0x7fc3f80a6ce0 auth_method 0 2024-08-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.671+0000 7fc3fd671640 1 --2- 172.21.15.5:0/341979305 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc3f80a6ce0 0x7fc3f80a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3fde72640 1 -- 172.21.15.5:0/341979305 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc3f813a1b0 msgr2=0x7fc3f8141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3fde72640 1 --2- 172.21.15.5:0/341979305 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc3f813a1b0 0x7fc3f8141d00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80098a0 tx=0x7fc3e801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c76de008df7d316 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3f7fff640 1 -- 172.21.15.5:0/341979305 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3e80b2070 con 0x7fc3f813a1b0 2024-08-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3f7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3f7fff640 10 monclient: dump: 2024-08-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3f7fff640 10 monclient: _finish_auth 0 2024-08-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3f7fff640 10 monclient: _check_auth_tickets 2024-08-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3f7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3ff8d5640 5 monclient: authenticate success, global_id 74117 2024-08-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3ff8d5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3f7fff640 1 -- 172.21.15.5:0/341979305 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e80a9070 con 0x7fc3f813a1b0 2024-08-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3f7fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3f7fff640 1 -- 172.21.15.5:0/341979305 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3e80abc40 con 0x7fc3f813a1b0 2024-08-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3f7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3f7fff640 10 monclient: dump: 2024-08-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3ff8d5640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.675+0000 7fc3ff8d5640 4 set_mon_vals no callback set 2024-08-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 10 monclient: shutdown 2024-08-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 1 -- 172.21.15.5:0/341979305 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc3f813a1b0 msgr2=0x7fc3f8141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 1 --2- 172.21.15.5:0/341979305 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc3f813a1b0 0x7fc3f8141d00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80098a0 tx=0x7fc3e801c440 comp rx=0 tx=0).stop 2024-08-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 1 -- 172.21.15.5:0/341979305 shutdown_connections 2024-08-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 1 --2- 172.21.15.5:0/341979305 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc3f813a1b0 0x7fc3f8141d00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 1 --2- 172.21.15.5:0/341979305 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc3f80a6ce0 0x7fc3f80a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 1 -- 172.21.15.5:0/341979305 >> 172.21.15.5:0/341979305 conn(0x7fc3f80acbc0 msgr2=0x7fc3f80a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 1 -- 172.21.15.5:0/341979305 shutdown_connections 2024-08-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 1 -- 172.21.15.5:0/341979305 wait complete. 2024-08-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 10 monclient: build_initial_monmap 2024-08-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 10 monclient: monmap: 2024-08-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 1 Processor -- start 2024-08-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 1 -- start start 2024-08-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 10 monclient: init 2024-08-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 10 monclient: _add_conns ranks=[5,8,1,2,6,7,0,3,4] 2024-08-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc3f80a6ce0 0x7fc3f8132c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 10 monclient(hunting): picked mon.noname-h con 0x7fc3f80a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc3f80a7600 0x7fc3f81331a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 10 monclient(hunting): picked mon.noname-e con 0x7fc3f80a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3f813a1b0 0x7fc3f809ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 10 monclient(hunting): picked mon.noname-f con 0x7fc3f813a1b0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f80a79e0 con 0x7fc3f813a1b0 2024-08-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fc3f80a8220 con 0x7fc3f80a6ce0 2024-08-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fc3f813ae10 con 0x7fc3f80a7600 2024-08-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3ff8d5640 10 monclient(hunting): authenticate will time out at 1215.693887s 2024-08-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc3f80a7600 0x7fc3f81331a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc3f80a7600 0x7fc3f81331a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:40606/0 (socket says 172.21.15.5:40606) 2024-08-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 1 -- 172.21.15.5:0/773274561 learned_addr learned my addr 172.21.15.5:0/773274561 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 10 monclient(hunting): get_auth_request con 0x7fc3f80a7600 auth_method 0 2024-08-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fd671640 1 --2- 172.21.15.5:0/773274561 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc3f80a6ce0 0x7fc3f8132c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fde72640 1 --2- 172.21.15.5:0/773274561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3f813a1b0 0x7fc3f809ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fd671640 10 monclient(hunting): get_auth_request con 0x7fc3f80a6ce0 auth_method 0 2024-08-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fd671640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fd671640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fd671640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fde72640 10 monclient(hunting): get_auth_request con 0x7fc3f813a1b0 auth_method 0 2024-08-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fde72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fde72640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fde72640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 10 monclient(hunting): handle_auth_done global_id 54422 payload 824 2024-08-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 1 -- 172.21.15.5:0/773274561 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc3f80a6ce0 msgr2=0x7fc3f8132c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 1 --2- 172.21.15.5:0/773274561 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc3f80a6ce0 0x7fc3f8132c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 1 -- 172.21.15.5:0/773274561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3f813a1b0 msgr2=0x7fc3f809ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 1 --2- 172.21.15.5:0/773274561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3f813a1b0 0x7fc3f809ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 10 monclient: _finish_hunting 0 2024-08-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 1 monclient: found mon.noname-e 2024-08-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.679+0000 7fc3fce70640 1 -- 172.21.15.5:0/773274561 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f813c330 con 0x7fc3f80a7600 2024-08-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3fce70640 1 -- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc3f80a7600 msgr2=0x7fc3f81331a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3fce70640 1 --2- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc3f80a7600 0x7fc3f81331a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00c7c0 tx=0x7fc3ec00cc80 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f5ffb640 1 -- 172.21.15.5:0/773274561 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3ec016020 con 0x7fc3f80a7600 2024-08-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f5ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f5ffb640 10 monclient: dump: 2024-08-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f5ffb640 10 monclient: _finish_auth 0 2024-08-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f5ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f5ffb640 1 -- 172.21.15.5:0/773274561 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ec012420 con 0x7fc3f80a7600 2024-08-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f5ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f5ffb640 1 -- 172.21.15.5:0/773274561 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3ec012a40 con 0x7fc3f80a7600 2024-08-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f5ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f5ffb640 10 monclient: dump: 2024-08-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f77fe640 4 set_mon_vals no callback set 2024-08-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3ff8d5640 5 monclient: authenticate success, global_id 54422 2024-08-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3ff8d5640 10 monclient: _renew_subs 2024-08-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3ff8d5640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3ff8d5640 1 -- 172.21.15.5:0/773274561 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f813c610 con 0x7fc3f80a7600 2024-08-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3ff8d5640 10 monclient: _renew_subs 2024-08-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3ff8d5640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3ff8d5640 1 -- 172.21.15.5:0/773274561 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f813c050 con 0x7fc3f80a7600 2024-08-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3ff8d5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3ff8d5640 1 --2- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80a04e0 0x7fc3f80a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3ff8d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3ff8d5640 1 -- 172.21.15.5:0/773274561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f80a7b60 con 0x7fc3f80a04e0 2024-08-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3fd671640 1 --2- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80a04e0 0x7fc3f80a08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3fd671640 10 monclient: get_auth_request con 0x7fc3f80a04e0 auth_method 0 2024-08-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3fd671640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3fd671640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3fd671640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3fd671640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3fd671640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3fd671640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f5ffb640 1 -- 172.21.15.5:0/773274561 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fc3ec019020 con 0x7fc3f80a7600 2024-08-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3fd671640 10 monclient(hunting): handle_auth_done global_id 74115 payload 824 2024-08-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3fd671640 1 -- 172.21.15.5:0/773274561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3f80aa8f0 con 0x7fc3f80a04e0 2024-08-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f5ffb640 1 --2- 172.21.15.5:0/773274561 >> v2:172.21.15.157:6812/631023601 conn(0x7fc3e403bdf0 0x7fc3e403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3f5ffb640 1 -- 172.21.15.5:0/773274561 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(105..105 src has 22..105) ==== 3506+0+0 (secure 0 0 0) 0x7fc3ec04e510 con 0x7fc3f80a7600 2024-08-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3fde72640 1 --2- 172.21.15.5:0/773274561 >> v2:172.21.15.157:6812/631023601 conn(0x7fc3e403bdf0 0x7fc3e403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.683+0000 7fc3fde72640 10 monclient: get_auth_request con 0x7fc3e403bdf0 auth_method 0 2024-08-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.687+0000 7fc3fd671640 1 -- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80a04e0 msgr2=0x7fc3f80a08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.687+0000 7fc3fd671640 1 --2- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80a04e0 0x7fc3f80a08c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000f4b0 tx=0x7fc3f000f970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.687+0000 7fc3f5ffb640 1 -- 172.21.15.5:0/773274561 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3f0018070 con 0x7fc3f80a04e0 2024-08-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.687+0000 7fc3f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.687+0000 7fc3f5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.687+0000 7fc3f5ffb640 10 monclient: dump: 2024-08-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.687+0000 7fc3f5ffb640 1 -- 172.21.15.5:0/773274561 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc3f0014980 con 0x7fc3f80a04e0 2024-08-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.687+0000 7fc3f5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.687+0000 7fc3f5ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.687+0000 7fc3f5ffb640 1 -- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80a04e0 msgr2=0x7fc3f80a08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.687+0000 7fc3f5ffb640 1 --2- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80a04e0 0x7fc3f80a08c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000f4b0 tx=0x7fc3f000f970 comp rx=0 tx=0).stop 2024-08-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.687+0000 7fc3f5ffb640 1 -- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80a04e0 msgr2=0x7fc3f80a08c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.687+0000 7fc3f5ffb640 1 --2- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80a04e0 0x7fc3f80a08c0 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000f4b0 tx=0x7fc3f000f970 comp rx=0 tx=0).stop 2024-08-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.687+0000 7fc3fde72640 1 --2- 172.21.15.5:0/773274561 >> v2:172.21.15.157:6812/631023601 conn(0x7fc3e403bdf0 0x7fc3e403e2b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80af000 tx=0x7fc3e80a7000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.691+0000 7fc3ff8d5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.691+0000 7fc3ff8d5640 1 --2- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80a0e00 0x7fc3f8136fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.691+0000 7fc3ff8d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.691+0000 7fc3ff8d5640 1 -- 172.21.15.5:0/773274561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f8051140 con 0x7fc3f80a0e00 2024-08-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3fd671640 1 --2- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80a0e00 0x7fc3f8136fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3fd671640 10 monclient: get_auth_request con 0x7fc3f80a0e00 auth_method 0 2024-08-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3fd671640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3fd671640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3fd671640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3fd671640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3fd671640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3fd671640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3fd671640 10 monclient(hunting): handle_auth_done global_id 74124 payload 824 2024-08-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3fd671640 1 -- 172.21.15.5:0/773274561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc3f80a70c0 con 0x7fc3f80a0e00 2024-08-18T21:07:28.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3fd671640 1 -- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80a0e00 msgr2=0x7fc3f8136fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:28.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3fd671640 1 --2- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80a0e00 0x7fc3f8136fa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000f4b0 tx=0x7fc3f00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3f5ffb640 1 -- 172.21.15.5:0/773274561 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3f0018050 con 0x7fc3f80a0e00 2024-08-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3f5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3f5ffb640 10 monclient: dump: 2024-08-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3f5ffb640 1 -- 172.21.15.5:0/773274561 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7fc3f0003be0 con 0x7fc3f80a0e00 2024-08-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3f5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3f5ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3f5ffb640 1 -- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80a0e00 msgr2=0x7fc3f8136fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3f5ffb640 1 --2- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80a0e00 0x7fc3f8136fa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000f4b0 tx=0x7fc3f00046d0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3f5ffb640 1 -- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80a0e00 msgr2=0x7fc3f8136fa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3f5ffb640 1 --2- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80a0e00 0x7fc3f8136fa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 26491, 2024-08-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3ff8d5640 1 -- 172.21.15.5:0/773274561 >> v2:172.21.15.157:6812/631023601 conn(0x7fc3e403bdf0 msgr2=0x7fc3e403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3ff8d5640 1 --2- 172.21.15.5:0/773274561 >> v2:172.21.15.157:6812/631023601 conn(0x7fc3e403bdf0 0x7fc3e403e2b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80af000 tx=0x7fc3e80a7000 comp rx=0 tx=0).stop 2024-08-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3ff8d5640 10 monclient: shutdown 2024-08-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3ff8d5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3ff8d5640 1 -- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc3f80a7600 msgr2=0x7fc3f81331a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3ff8d5640 1 --2- 172.21.15.5:0/773274561 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc3f80a7600 0x7fc3f81331a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00c7c0 tx=0x7fc3ec00cc80 comp rx=0 tx=0).stop 2024-08-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3fde72640 1 -- 172.21.15.5:0/773274561 reap_dead start 2024-08-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3fde72640 1 -- 172.21.15.5:0/773274561 reap_dead start 2024-08-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3ff8d5640 1 -- 172.21.15.5:0/773274561 shutdown_connections 2024-08-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3ff8d5640 1 -- 172.21.15.5:0/773274561 >> 172.21.15.5:0/773274561 conn(0x7fc3f80acbc0 msgr2=0x7fc3f809da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3ff8d5640 1 -- 172.21.15.5:0/773274561 shutdown_connections 2024-08-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.695+0000 7fc3ff8d5640 1 -- 172.21.15.5:0/773274561 wait complete. 2024-08-18T21:07:28.734 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:28.734 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:07:28.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:07:28.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 10 monclient: get_monmap_and_config 2024-08-18T21:07:28.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 10 monclient: build_initial_monmap 2024-08-18T21:07:28.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 10 monclient: monmap: 2024-08-18T21:07:28.853 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:28.853 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.853 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:28.853399+0000 2024-08-18T21:07:28.853 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:28.853399+0000 2024-08-18T21:07:28.853 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:28.853 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.853 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:28.853 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:28.853 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:28.853 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:28.853 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:28.853 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:28.854 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:28.854 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:28.854 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:28.854 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:28.854 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:28.854 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 1 Processor -- start 2024-08-18T21:07:28.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 1 -- start start 2024-08-18T21:07:28.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 10 monclient: init 2024-08-18T21:07:28.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:28.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 10 monclient: _add_conns ranks=[10,1,0,5,7,6,9,8,4,2,3] 2024-08-18T21:07:28.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f741c06c950 0x7f741c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 10 monclient(hunting): picked mon.noname-f con 0x7f741c06c950 addr v2:172.21.15.157:3300/0 2024-08-18T21:07:28.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f741c0a4d90 addr v1:172.21.15.157:6789/0 2024-08-18T21:07:28.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f741c06d270 addr v1:172.21.15.5:6789/0 2024-08-18T21:07:28.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f741c138620 con 0x7f741c06d270 2024-08-18T21:07:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f741c09fe20 con 0x7f741c0a4d90 2024-08-18T21:07:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f741c0a5610 con 0x7f741c06c950 2024-08-18T21:07:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f74233f1640 10 monclient(hunting): authenticate will time out at 1215.866572s 2024-08-18T21:07:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742198e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f741c06d270 0x7f741c137f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49438/0 (socket says 172.21.15.5:49438) 2024-08-18T21:07:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742198e640 1 -- 172.21.15.5:0/2006435501 learned_addr learned my addr 172.21.15.5:0/2006435501 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:07:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742118d640 1 --2- 172.21.15.5:0/2006435501 >> v2:172.21.15.157:3300/0 conn(0x7f741c06c950 0x7f741c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742118d640 10 monclient(hunting): get_auth_request con 0x7f741c06c950 auth_method 0 2024-08-18T21:07:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742118d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742118d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742118d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742118d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742118d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:28.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742118d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:28.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742118d640 10 monclient(hunting): handle_auth_done global_id 5275 payload 274 2024-08-18T21:07:28.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742118d640 1 -- 172.21.15.5:0/2006435501 >> v1:172.21.15.157:6789/0 conn(0x7f741c0a4d90 legacy=0x7f741c137800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:28.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742118d640 1 -- 172.21.15.5:0/2006435501 >> v1:172.21.15.5:6789/0 conn(0x7f741c06d270 legacy=0x7f741c137f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:28.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742118d640 10 monclient: _finish_hunting 0 2024-08-18T21:07:28.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742118d640 1 monclient: found mon.noname-f 2024-08-18T21:07:28.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742118d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:28.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742118d640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:07:28.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.851+0000 7f742118d640 1 -- 172.21.15.5:0/2006435501 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c0a09e0 con 0x7f741c06c950 2024-08-18T21:07:28.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742118d640 1 -- 172.21.15.5:0/2006435501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f741c06c950 msgr2=0x7f741c06cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:28.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742118d640 1 --2- 172.21.15.5:0/2006435501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f741c06c950 0x7f741c06cd30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7414009d90 tx=0x7f741401c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b6e30bd10cb8de4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f741bfff640 1 -- 172.21.15.5:0/2006435501 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f74140ac070 con 0x7f741c06c950 2024-08-18T21:07:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f741bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f741bfff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:07:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f741bfff640 10 monclient: dump: 2024-08-18T21:07:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:28.862 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:28.862 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:28.862 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:28.862 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:28.862 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:28.862 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:28.862 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f741bfff640 10 monclient: _finish_auth 0 2024-08-18T21:07:28.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f741bfff640 10 monclient: _check_auth_tickets 2024-08-18T21:07:28.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f741bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:28.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f741bfff640 1 -- 172.21.15.5:0/2006435501 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74140a69d0 con 0x7f741c06c950 2024-08-18T21:07:28.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f741bfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:28.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f741bfff640 1 -- 172.21.15.5:0/2006435501 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f74140a7460 con 0x7f741c06c950 2024-08-18T21:07:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f741bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f741bfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:07:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f741bfff640 10 monclient: dump: 2024-08-18T21:07:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:28.864 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:28.864 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:28.864 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:28.864 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 5 monclient: authenticate success, global_id 5275 2024-08-18T21:07:28.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:28.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 4 set_mon_vals no callback set 2024-08-18T21:07:28.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 10 monclient: shutdown 2024-08-18T21:07:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 1 -- 172.21.15.5:0/2006435501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f741c06c950 msgr2=0x7f741c06cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 1 --2- 172.21.15.5:0/2006435501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f741c06c950 0x7f741c06cd30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7414009d90 tx=0x7f741401c830 comp rx=0 tx=0).stop 2024-08-18T21:07:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 1 -- 172.21.15.5:0/2006435501 shutdown_connections 2024-08-18T21:07:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 1 --2- 172.21.15.5:0/2006435501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f741c06c950 0x7f741c06cd30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 1 -- 172.21.15.5:0/2006435501 >> 172.21.15.5:0/2006435501 conn(0x7f741c0688d0 msgr2=0x7f741c068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 1 -- 172.21.15.5:0/2006435501 shutdown_connections 2024-08-18T21:07:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 1 -- 172.21.15.5:0/2006435501 wait complete. 2024-08-18T21:07:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 10 monclient: build_initial_monmap 2024-08-18T21:07:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 10 monclient: monmap: 2024-08-18T21:07:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:28.870 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:28.870 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:28.870 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:28.870 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.870 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:28.870 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:28.870 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:28.870 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:28.870 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:28.870 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:28.870 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:28.871 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 1 Processor -- start 2024-08-18T21:07:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 1 -- start start 2024-08-18T21:07:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 10 monclient: init 2024-08-18T21:07:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 10 monclient: _add_conns ranks=[8,4,6,2,1,7,0,3,5] 2024-08-18T21:07:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f741c06c950 0x7f741c136d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 10 monclient(hunting): picked mon.noname-e con 0x7f741c06c950 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:07:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f741c06d270 0x7f741c137250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 10 monclient(hunting): picked mon.noname-c con 0x7f741c06d270 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:07:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f741c0a4d90 0x7f741c13d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 10 monclient(hunting): picked mon.noname-d con 0x7f741c0a4d90 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f741c1434a0 con 0x7f741c06d270 2024-08-18T21:07:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f741c0a3350 con 0x7f741c0a4d90 2024-08-18T21:07:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f741c143620 con 0x7f741c06c950 2024-08-18T21:07:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f74233f1640 10 monclient(hunting): authenticate will time out at 1215.875637s 2024-08-18T21:07:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742098c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f741c06d270 0x7f741c137250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742118d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f741c06c950 0x7f741c136d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742198e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f741c0a4d90 0x7f741c13d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742098c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f741c06d270 0x7f741c137250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:45184/0 (socket says 172.21.15.5:45184) 2024-08-18T21:07:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742098c640 1 -- 172.21.15.5:0/3475022404 learned_addr learned my addr 172.21.15.5:0/3475022404 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742098c640 10 monclient(hunting): get_auth_request con 0x7f741c06d270 auth_method 0 2024-08-18T21:07:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742098c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742098c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742098c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742118d640 10 monclient(hunting): get_auth_request con 0x7f741c06c950 auth_method 0 2024-08-18T21:07:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742118d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742118d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742118d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742198e640 10 monclient(hunting): get_auth_request con 0x7f741c0a4d90 auth_method 0 2024-08-18T21:07:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742198e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742198e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742198e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742118d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742118d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742118d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742198e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.859+0000 7f742198e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742198e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742118d640 10 monclient(hunting): handle_auth_done global_id 54431 payload 824 2024-08-18T21:07:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742118d640 1 -- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f741c0a4d90 msgr2=0x7f741c13d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742118d640 1 --2- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f741c0a4d90 0x7f741c13d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742118d640 1 -- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f741c06d270 msgr2=0x7f741c137250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742118d640 1 --2- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f741c06d270 0x7f741c137250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742118d640 10 monclient: _finish_hunting 0 2024-08-18T21:07:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742118d640 1 monclient: found mon.noname-e 2024-08-18T21:07:28.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742118d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:28.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742118d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:07:28.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742118d640 1 -- 172.21.15.5:0/3475022404 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c120cb0 con 0x7f741c06c950 2024-08-18T21:07:28.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742198e640 1 --2- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f741c0a4d90 0x7f741c13d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:07:28.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742098c640 1 --2- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f741c06d270 0x7f741c137250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:07:28.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742118d640 1 -- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f741c06c950 msgr2=0x7f741c136d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:28.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742118d640 1 --2- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f741c06c950 0x7f741c136d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f74140ae000 tx=0x7f74140195d0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:28.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f7419ffb640 1 -- 172.21.15.5:0/3475022404 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f74140ac070 con 0x7f741c06c950 2024-08-18T21:07:28.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f7419ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:28.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f7419ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:07:28.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f7419ffb640 10 monclient: dump: 2024-08-18T21:07:28.875 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:28.875 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.876 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.876 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.876 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:28.876 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.876 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:28.876 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:28.876 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:28.876 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:28.876 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:28.876 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:28.876 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:28.876 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:28.876 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:28.876 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f7419ffb640 10 monclient: _finish_auth 0 2024-08-18T21:07:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f7419ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:07:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f7419ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f7419ffb640 1 -- 172.21.15.5:0/3475022404 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7414003dc0 con 0x7f741c06c950 2024-08-18T21:07:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f74233f1640 5 monclient: authenticate success, global_id 54431 2024-08-18T21:07:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f74233f1640 10 monclient: _renew_subs 2024-08-18T21:07:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f74233f1640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:07:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f74233f1640 1 -- 172.21.15.5:0/3475022404 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f741c073630 con 0x7f741c06c950 2024-08-18T21:07:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f7419ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f7419ffb640 1 -- 172.21.15.5:0/3475022404 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f74140a7460 con 0x7f741c06c950 2024-08-18T21:07:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f7419ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f7419ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:07:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f7419ffb640 10 monclient: dump: 2024-08-18T21:07:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:28.879 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f741b7fe640 4 set_mon_vals no callback set 2024-08-18T21:07:28.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f74233f1640 10 monclient: _renew_subs 2024-08-18T21:07:28.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f74233f1640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:07:28.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f74233f1640 1 -- 172.21.15.5:0/3475022404 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f741c13ef70 con 0x7f741c06c950 2024-08-18T21:07:28.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f74233f1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:28.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f74233f1640 1 --2- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f741c13e310 0x7f741c13e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f74233f1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f74233f1640 1 -- 172.21.15.5:0/3475022404 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f741c051140 con 0x7f741c13e310 2024-08-18T21:07:28.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742098c640 1 --2- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f741c13e310 0x7f741c13e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742098c640 10 monclient: get_auth_request con 0x7f741c13e310 auth_method 0 2024-08-18T21:07:28.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742098c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742098c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f742098c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.863+0000 7f7419ffb640 1 -- 172.21.15.5:0/3475022404 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f74140af070 con 0x7f741c06c950 2024-08-18T21:07:28.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f742098c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:28.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f742098c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:28.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f742098c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:28.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f7419ffb640 1 --2- 172.21.15.5:0/3475022404 >> v2:172.21.15.157:6812/631023601 conn(0x7f740803bdf0 0x7f740803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f742098c640 10 monclient(hunting): handle_auth_done global_id 74126 payload 824 2024-08-18T21:07:28.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f742098c640 1 -- 172.21.15.5:0/3475022404 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f741c073b60 con 0x7f741c13e310 2024-08-18T21:07:28.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f7419ffb640 1 -- 172.21.15.5:0/3475022404 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(106..106 src has 22..106) ==== 3898+0+0 (secure 0 0 0) 0x7f74140b7070 con 0x7f741c06c950 2024-08-18T21:07:28.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f742198e640 1 --2- 172.21.15.5:0/3475022404 >> v2:172.21.15.157:6812/631023601 conn(0x7f740803bdf0 0x7f740803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f742198e640 10 monclient: get_auth_request con 0x7f740803bdf0 auth_method 0 2024-08-18T21:07:28.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f742098c640 1 -- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f741c13e310 msgr2=0x7f741c13e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:28.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f742098c640 1 --2- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f741c13e310 0x7f741c13e6f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f741c13d520 tx=0x7f741000db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:28.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f7419ffb640 1 -- 172.21.15.5:0/3475022404 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f741000bd80 con 0x7f741c13e310 2024-08-18T21:07:28.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f7419ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:28.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f7419ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:07:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f7419ffb640 10 monclient: dump: 2024-08-18T21:07:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:28.885 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:28.885 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:28.885 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:28.885 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f7419ffb640 1 -- 172.21.15.5:0/3475022404 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f741000b910 con 0x7f741c13e310 2024-08-18T21:07:28.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f7419ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:28.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f7419ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:28.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f7419ffb640 1 -- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f741c13e310 msgr2=0x7f741c13e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f7419ffb640 1 --2- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f741c13e310 0x7f741c13e6f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f741c13d520 tx=0x7f741000db90 comp rx=0 tx=0).stop 2024-08-18T21:07:28.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f7419ffb640 1 -- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f741c13e310 msgr2=0x7f741c13e6f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:28.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f7419ffb640 1 --2- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f741c13e310 0x7f741c13e6f0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f741c13d520 tx=0x7f741000db90 comp rx=0 tx=0).stop 2024-08-18T21:07:28.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.867+0000 7f742198e640 1 --2- 172.21.15.5:0/3475022404 >> v2:172.21.15.157:6812/631023601 conn(0x7f740803bdf0 0x7f740803e2b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f740c007ca0 tx=0x7f740c007bf0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.875+0000 7f74233f1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.875+0000 7f74233f1640 1 --2- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f741c02d1d0 0x7f741c02d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.875+0000 7f74233f1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.875+0000 7f74233f1640 1 -- 172.21.15.5:0/3475022404 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f741c06cd30 con 0x7f741c02d1d0 2024-08-18T21:07:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.875+0000 7f742098c640 1 --2- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f741c02d1d0 0x7f741c02d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.875+0000 7f742098c640 10 monclient: get_auth_request con 0x7f741c02d1d0 auth_method 0 2024-08-18T21:07:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.875+0000 7f742098c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.875+0000 7f742098c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.875+0000 7f742098c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.875+0000 7f742098c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.875+0000 7f742098c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.875+0000 7f742098c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.875+0000 7f742098c640 10 monclient(hunting): handle_auth_done global_id 74135 payload 824 2024-08-18T21:07:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.875+0000 7f742098c640 1 -- 172.21.15.5:0/3475022404 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f741c13a130 con 0x7f741c02d1d0 2024-08-18T21:07:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.875+0000 7f742098c640 1 -- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f741c02d1d0 msgr2=0x7f741c02d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.875+0000 7f742098c640 1 --2- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f741c02d1d0 0x7f741c02d5b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f741c13d520 tx=0x7f7410004700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f7419ffb640 1 -- 172.21.15.5:0/3475022404 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7410003a70 con 0x7f741c02d1d0 2024-08-18T21:07:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f7419ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f7419ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:07:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f7419ffb640 10 monclient: dump: 2024-08-18T21:07:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:28.888 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:28.888 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:28.888 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:28.888 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:28.888 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:28.888 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:28.888 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:28.888 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:28.888 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:28.888 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:28.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f7419ffb640 1 -- 172.21.15.5:0/3475022404 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9246 (secure 0 0 0) 0x7f7410003600 con 0x7f741c02d1d0 2024-08-18T21:07:28.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f7419ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:28.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f7419ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:28.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f7419ffb640 1 -- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f741c02d1d0 msgr2=0x7f741c02d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f7419ffb640 1 --2- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f741c02d1d0 0x7f741c02d5b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f741c13d520 tx=0x7f7410004700 comp rx=0 tx=0).stop 2024-08-18T21:07:28.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f7419ffb640 1 -- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f741c02d1d0 msgr2=0x7f741c02d5b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:28.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f7419ffb640 1 --2- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f741c02d1d0 0x7f741c02d5b0 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f741c13d520 tx=0x7f7410004700 comp rx=0 tx=0).stop 2024-08-18T21:07:28.889 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:28.889 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:28.889 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:28.889 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:07:28.889 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:28.890 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 26683, 2024-08-18T21:07:28.890 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:28.890 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:28.890 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:28.890 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:28.890 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:28.890 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:28.890 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:28.890 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:28.890 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:28.890 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:28.890 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:28.890 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:07:28.891 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:28.891 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:28.891 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:28.891 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:28.891 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:28.891 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:28.891 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:28.891 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:28.891 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:28.891 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:28.891 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:28.891 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:28.891 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:28.891 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:28.892 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:28.892 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:28.892 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:28.892 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:28.892 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:28.892 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:28.892 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:28.892 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:28.892 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:28.892 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:28.892 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:28.892 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:28.892 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:28.892 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:28.892 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.893 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:28.893 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:28.893 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:28.893 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:28.893 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:28.893 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:28.893 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:28.893 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:28.893 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:28.893 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:28.893 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:28.893 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:28.894 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:28.894 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:28.894 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:28.894 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:28.894 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:28.894 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:28.894 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:28.894 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:28.894 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:28.894 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:28.894 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:28.894 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:28.895 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:28.895 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:28.895 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:28.895 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:28.895 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:28.895 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:28.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.895 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:28.895 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.895 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:28.895 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:28.895 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.895 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.895 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.896 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.896 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:28.896 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.896 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.896 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.896 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:28.896 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.896 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.896 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.896 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:28.896 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:28.896 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.897 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.897 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.897 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:28.897 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:28.897 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.897 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.897 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.897 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:28.897 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.898 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.898 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:28.898 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.898 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.898 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.898 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:28.898 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:28.898 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.898 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.898 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.899 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:28.899 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:28.899 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.899 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.899 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.899 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:28.899 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.899 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.899 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:28.899 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.903 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.903 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:28.903 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.903 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.903 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.903 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:28.903 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:28.903 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.903 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.903 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:28.912 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:07:28.912 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:28.912 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:28.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:28.912 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:28.912 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:28.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f74233f1640 1 -- 172.21.15.5:0/3475022404 >> v2:172.21.15.157:6812/631023601 conn(0x7f740803bdf0 msgr2=0x7f740803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f74233f1640 1 --2- 172.21.15.5:0/3475022404 >> v2:172.21.15.157:6812/631023601 conn(0x7f740803bdf0 0x7f740803e2b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f740c007ca0 tx=0x7f740c007bf0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f74233f1640 10 monclient: shutdown 2024-08-18T21:07:28.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f74233f1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:28.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f74233f1640 1 -- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f741c06c950 msgr2=0x7f741c136d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:28.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f74233f1640 1 --2- 172.21.15.5:0/3475022404 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f741c06c950 0x7f741c136d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f74140ae000 tx=0x7f74140195d0 comp rx=0 tx=0).stop 2024-08-18T21:07:28.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f742198e640 1 -- 172.21.15.5:0/3475022404 reap_dead start 2024-08-18T21:07:28.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f742198e640 1 -- 172.21.15.5:0/3475022404 reap_dead start 2024-08-18T21:07:28.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f74233f1640 1 -- 172.21.15.5:0/3475022404 shutdown_connections 2024-08-18T21:07:28.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f74233f1640 1 -- 172.21.15.5:0/3475022404 >> 172.21.15.5:0/3475022404 conn(0x7f741c0688d0 msgr2=0x7f741c140400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:28.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f74233f1640 1 -- 172.21.15.5:0/3475022404 shutdown_connections 2024-08-18T21:07:28.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:28.879+0000 7f74233f1640 1 -- 172.21.15.5:0/3475022404 wait complete. 2024-08-18T21:07:28.914 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:28.915 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:07:28.915 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:07:29.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 10 monclient: get_monmap_and_config 2024-08-18T21:07:29.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 10 monclient: build_initial_monmap 2024-08-18T21:07:29.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 10 monclient: monmap: 2024-08-18T21:07:29.041 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:29.041 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.041 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:29.041400+0000 2024-08-18T21:07:29.041 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:29.041400+0000 2024-08-18T21:07:29.041 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:29.041 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.041 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:29.041 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:29.042 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:29.042 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:29.042 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:29.042 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:29.042 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:29.042 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:29.042 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:29.042 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:29.042 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:29.042 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 1 Processor -- start 2024-08-18T21:07:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 1 -- start start 2024-08-18T21:07:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 10 monclient: init 2024-08-18T21:07:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 10 monclient: _add_conns ranks=[5,6,1,7,2,9,8,4,0,3,10] 2024-08-18T21:07:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f37600a6bd0 0x7f37600a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 10 monclient(hunting): picked mon.noname-h con 0x7f37600a6bd0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:07:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f376009f080 0x7f37600a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 10 monclient(hunting): picked mon.noname-d con 0x7f376009f080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f3760139990 addr v1:172.21.15.157:6789/0 2024-08-18T21:07:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37600a7fb0 con 0x7f3760139990 2024-08-18T21:07:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f376009e4c0 con 0x7f37600a6bd0 2024-08-18T21:07:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f376006f930 con 0x7f376009f080 2024-08-18T21:07:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f376570e640 10 monclient(hunting): authenticate will time out at 1216.054555s 2024-08-18T21:07:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f376009f080 0x7f37600a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f376009f080 0x7f37600a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:60744/0 (socket says 172.21.15.5:60744) 2024-08-18T21:07:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 1 -- 172.21.15.5:0/776763284 learned_addr learned my addr 172.21.15.5:0/776763284 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 10 monclient(hunting): get_auth_request con 0x7f376009f080 auth_method 0 2024-08-18T21:07:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375effd640 1 --2- 172.21.15.5:0/776763284 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f37600a6bd0 0x7f37600a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375effd640 10 monclient(hunting): get_auth_request con 0x7f37600a6bd0 auth_method 0 2024-08-18T21:07:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 10 monclient(hunting): handle_auth_done global_id 54429 payload 274 2024-08-18T21:07:29.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 1 -- 172.21.15.5:0/776763284 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f37600a6bd0 msgr2=0x7f37600a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:29.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 1 --2- 172.21.15.5:0/776763284 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f37600a6bd0 0x7f37600a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 1 -- 172.21.15.5:0/776763284 >> v1:172.21.15.157:6789/0 conn(0x7f3760139990 legacy=0x7f3760139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:29.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:07:29.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 1 monclient: found mon.noname-d 2024-08-18T21:07:29.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:29.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:07:29.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.039+0000 7f375e7fc640 1 -- 172.21.15.5:0/776763284 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376009de70 con 0x7f376009f080 2024-08-18T21:07:29.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f375e7fc640 1 -- 172.21.15.5:0/776763284 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f376009f080 msgr2=0x7f37600a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f375e7fc640 1 --2- 172.21.15.5:0/776763284 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f376009f080 0x7f37600a74f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f37540098d0 tx=0x7f375401c440 comp rx=0 tx=0).ready entity=mon.6 client_cookie=fdb93d9f2246f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f375dffb640 1 -- 172.21.15.5:0/776763284 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f37540b0070 con 0x7f376009f080 2024-08-18T21:07:29.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f375dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f375dffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:07:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f375dffb640 10 monclient: dump: 2024-08-18T21:07:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.053 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f375dffb640 10 monclient: _finish_auth 0 2024-08-18T21:07:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f375dffb640 10 monclient: _check_auth_tickets 2024-08-18T21:07:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f375dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f375dffb640 1 -- 172.21.15.5:0/776763284 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37540aa810 con 0x7f376009f080 2024-08-18T21:07:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f376570e640 5 monclient: authenticate success, global_id 54429 2024-08-18T21:07:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f376570e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:07:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f375dffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f376570e640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f376570e640 4 set_mon_vals no callback set 2024-08-18T21:07:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f375dffb640 1 -- 172.21.15.5:0/776763284 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f37540a9300 con 0x7f376009f080 2024-08-18T21:07:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f375dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f375dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:07:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.043+0000 7f375dffb640 10 monclient: dump: 2024-08-18T21:07:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.055 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 10 monclient: shutdown 2024-08-18T21:07:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 1 -- 172.21.15.5:0/776763284 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f376009f080 msgr2=0x7f37600a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 1 --2- 172.21.15.5:0/776763284 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f376009f080 0x7f37600a74f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f37540098d0 tx=0x7f375401c440 comp rx=0 tx=0).stop 2024-08-18T21:07:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 1 -- 172.21.15.5:0/776763284 shutdown_connections 2024-08-18T21:07:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 1 --2- 172.21.15.5:0/776763284 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f376009f080 0x7f37600a74f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 1 --2- 172.21.15.5:0/776763284 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f37600a6bd0 0x7f37600a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 1 -- 172.21.15.5:0/776763284 >> 172.21.15.5:0/776763284 conn(0x7f3760068700 msgr2=0x7f3760068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 1 -- 172.21.15.5:0/776763284 shutdown_connections 2024-08-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 1 -- 172.21.15.5:0/776763284 wait complete. 2024-08-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 10 monclient: build_initial_monmap 2024-08-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 10 monclient: monmap: 2024-08-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 1 Processor -- start 2024-08-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 1 -- start start 2024-08-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 10 monclient: init 2024-08-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 10 monclient: _add_conns ranks=[8,5,4,1,0,2,6,3,7] 2024-08-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f376009f080 0x7f376013ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 10 monclient(hunting): picked mon.noname-e con 0x7f376009f080 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f37600a6bd0 0x7f37601d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 10 monclient(hunting): picked mon.noname-h con 0x7f37600a6bd0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3760139990 0x7f376013db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 10 monclient(hunting): picked mon.noname-c con 0x7f3760139990 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f37601447a0 con 0x7f3760139990 2024-08-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f3760144620 con 0x7f37600a6bd0 2024-08-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f3760144920 con 0x7f376009f080 2024-08-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f376570e640 10 monclient(hunting): authenticate will time out at 1216.062044s 2024-08-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f376009f080 0x7f376013ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f376009f080 0x7f376013ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:40624/0 (socket says 172.21.15.5:40624) 2024-08-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 1 -- 172.21.15.5:0/452074449 learned_addr learned my addr 172.21.15.5:0/452074449 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 10 monclient(hunting): get_auth_request con 0x7f376009f080 auth_method 0 2024-08-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375f7fe640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3760139990 0x7f376013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375f7fe640 10 monclient(hunting): get_auth_request con 0x7f3760139990 auth_method 0 2024-08-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375e7fc640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f37600a6bd0 0x7f37601d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 10 monclient(hunting): handle_auth_done global_id 54440 payload 824 2024-08-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 1 -- 172.21.15.5:0/452074449 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f37600a6bd0 msgr2=0x7f37601d1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f37600a6bd0 0x7f37601d1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 1 -- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3760139990 msgr2=0x7f376013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3760139990 0x7f376013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 10 monclient: _finish_hunting 0 2024-08-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 1 monclient: found mon.noname-e 2024-08-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375effd640 1 -- 172.21.15.5:0/452074449 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37600a6640 con 0x7f376009f080 2024-08-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375e7fc640 10 monclient: get_auth_request con 0x7f37600a6bd0 auth_method 0 2024-08-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.047+0000 7f375e7fc640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f37600a6bd0 0x7f37601d1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f375effd640 1 -- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f376009f080 msgr2=0x7f376013ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f375effd640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f376009f080 0x7f376013ffd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f375000d800 tx=0x7f375000dcc0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f37477fe640 1 -- 172.21.15.5:0/452074449 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f375000bd40 con 0x7f376009f080 2024-08-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f37477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f37477fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f37477fe640 10 monclient: dump: 2024-08-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f37477fe640 10 monclient: _finish_auth 0 2024-08-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f37477fe640 10 monclient: _check_auth_tickets 2024-08-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f37477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f37477fe640 1 -- 172.21.15.5:0/452074449 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3750019070 con 0x7f376009f080 2024-08-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f37477fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f37477fe640 1 -- 172.21.15.5:0/452074449 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f37500148a0 con 0x7f376009f080 2024-08-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f376570e640 5 monclient: authenticate success, global_id 54440 2024-08-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f376570e640 10 monclient: _renew_subs 2024-08-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f376570e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f376570e640 1 -- 172.21.15.5:0/452074449 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3760140960 con 0x7f376009f080 2024-08-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f375d7fa640 4 set_mon_vals no callback set 2024-08-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f37477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f37477fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f37477fe640 10 monclient: dump: 2024-08-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f376570e640 10 monclient: _renew_subs 2024-08-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f376570e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f376570e640 1 -- 172.21.15.5:0/452074449 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f37601231d0 con 0x7f376009f080 2024-08-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f376570e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f376570e640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f37601d2400 0x7f376013e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f376570e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f376570e640 1 -- 172.21.15.5:0/452074449 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f3760051140 con 0x7f37601d2400 2024-08-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f375e7fc640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f37601d2400 0x7f376013e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f375e7fc640 10 monclient: get_auth_request con 0x7f37601d2400 auth_method 0 2024-08-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f375e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f375e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f375e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f375e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f375e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f375e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f37477fe640 1 -- 172.21.15.5:0/452074449 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f3750014430 con 0x7f376009f080 2024-08-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f375e7fc640 10 monclient(hunting): handle_auth_done global_id 5386 payload 824 2024-08-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f375e7fc640 1 -- 172.21.15.5:0/452074449 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3760139e10 con 0x7f37601d2400 2024-08-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f37477fe640 1 --2- 172.21.15.5:0/452074449 >> v2:172.21.15.157:6812/631023601 conn(0x7f374c03bdc0 0x7f374c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f37477fe640 1 -- 172.21.15.5:0/452074449 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(106..106 src has 22..106) ==== 3898+0+0 (secure 0 0 0) 0x7f375000f040 con 0x7f376009f080 2024-08-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f375f7fe640 1 --2- 172.21.15.5:0/452074449 >> v2:172.21.15.157:6812/631023601 conn(0x7f374c03bdc0 0x7f374c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.051+0000 7f375f7fe640 10 monclient: get_auth_request con 0x7f374c03bdc0 auth_method 0 2024-08-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.055+0000 7f375e7fc640 1 -- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f37601d2400 msgr2=0x7f376013e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.055+0000 7f375e7fc640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f37601d2400 0x7f376013e090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f37540ad000 tx=0x7f37540191e0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.055+0000 7f37477fe640 1 -- 172.21.15.5:0/452074449 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f37540b0070 con 0x7f37601d2400 2024-08-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.055+0000 7f37477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.055+0000 7f37477fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.055+0000 7f37477fe640 10 monclient: dump: 2024-08-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.055+0000 7f37477fe640 1 -- 172.21.15.5:0/452074449 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f37540b1040 con 0x7f37601d2400 2024-08-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.055+0000 7f37477fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.055+0000 7f37477fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.055+0000 7f37477fe640 1 -- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f37601d2400 msgr2=0x7f376013e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.055+0000 7f37477fe640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f37601d2400 0x7f376013e090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f37540ad000 tx=0x7f37540191e0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.055+0000 7f37477fe640 1 -- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f37601d2400 msgr2=0x7f376013e090 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.055+0000 7f37477fe640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f37601d2400 0x7f376013e090 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f37540ad000 tx=0x7f37540191e0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.055+0000 7f375f7fe640 1 --2- 172.21.15.5:0/452074449 >> v2:172.21.15.157:6812/631023601 conn(0x7f374c03bdc0 0x7f374c03e280 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3758009f60 tx=0x7f375800d040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.059+0000 7f376570e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.059+0000 7f376570e640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f376013e5d0 0x7f37600a41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.059+0000 7f376570e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.059+0000 7f376570e640 1 -- 172.21.15.5:0/452074449 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f376013e9e0 con 0x7f376013e5d0 2024-08-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.059+0000 7f375e7fc640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f376013e5d0 0x7f37600a41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.059+0000 7f375e7fc640 10 monclient: get_auth_request con 0x7f376013e5d0 auth_method 0 2024-08-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.059+0000 7f375e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.059+0000 7f375e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.059+0000 7f375e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.059+0000 7f375e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.059+0000 7f375e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.059+0000 7f375e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.059+0000 7f375e7fc640 10 monclient(hunting): handle_auth_done global_id 5395 payload 824 2024-08-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.059+0000 7f375e7fc640 1 -- 172.21.15.5:0/452074449 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3760122da0 con 0x7f376013e5d0 2024-08-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f375e7fc640 1 -- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f376013e5d0 msgr2=0x7f37600a41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f375e7fc640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f376013e5d0 0x7f37600a41a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f375401c270 tx=0x7f37540a8000 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f37477fe640 1 -- 172.21.15.5:0/452074449 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f37540bfda0 con 0x7f376013e5d0 2024-08-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f37477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f37477fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f37477fe640 10 monclient: dump: 2024-08-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f37477fe640 1 -- 172.21.15.5:0/452074449 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f37540bfda0 con 0x7f376013e5d0 2024-08-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f37477fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f37477fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f37477fe640 1 -- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f376013e5d0 msgr2=0x7f37600a41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f37477fe640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f376013e5d0 0x7f37600a41a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f375401c270 tx=0x7f37540a8000 comp rx=0 tx=0).stop 2024-08-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f37477fe640 1 -- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f376013e5d0 msgr2=0x7f37600a41a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f37477fe640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f376013e5d0 0x7f37600a41a0 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f375401c270 tx=0x7f37540a8000 comp rx=0 tx=0).stop 2024-08-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 258181, 2024-08-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f376570e640 1 -- 172.21.15.5:0/452074449 >> v2:172.21.15.157:6812/631023601 conn(0x7f374c03bdc0 msgr2=0x7f374c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f376570e640 1 --2- 172.21.15.5:0/452074449 >> v2:172.21.15.157:6812/631023601 conn(0x7f374c03bdc0 0x7f374c03e280 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3758009f60 tx=0x7f375800d040 comp rx=0 tx=0).stop 2024-08-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f376570e640 10 monclient: shutdown 2024-08-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f376570e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f376570e640 1 -- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f376009f080 msgr2=0x7f376013ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f376570e640 1 --2- 172.21.15.5:0/452074449 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f376009f080 0x7f376013ffd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f375000d800 tx=0x7f375000dcc0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f375f7fe640 1 -- 172.21.15.5:0/452074449 reap_dead start 2024-08-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f375f7fe640 1 -- 172.21.15.5:0/452074449 reap_dead start 2024-08-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f376570e640 1 -- 172.21.15.5:0/452074449 shutdown_connections 2024-08-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f376570e640 1 -- 172.21.15.5:0/452074449 >> 172.21.15.5:0/452074449 conn(0x7f3760068700 msgr2=0x7f37600a9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:29.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f376570e640 1 -- 172.21.15.5:0/452074449 shutdown_connections 2024-08-18T21:07:29.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.063+0000 7f376570e640 1 -- 172.21.15.5:0/452074449 wait complete. 2024-08-18T21:07:29.102 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:29.102 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:07:29.102 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:07:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 10 monclient: get_monmap_and_config 2024-08-18T21:07:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 10 monclient: build_initial_monmap 2024-08-18T21:07:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 10 monclient: monmap: 2024-08-18T21:07:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:29.224932+0000 2024-08-18T21:07:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:29.224932+0000 2024-08-18T21:07:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:29.226 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:29.226 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 1 Processor -- start 2024-08-18T21:07:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 1 -- start start 2024-08-18T21:07:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 10 monclient: init 2024-08-18T21:07:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 10 monclient: _add_conns ranks=[2,1,7,4,6,10,5,8,3,0,9] 2024-08-18T21:07:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe9900a6ce0 0x7fe9900a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 10 monclient(hunting): picked mon.noname-b con 0x7fe9900a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fe9900a7600 addr v1:172.21.15.157:6789/0 2024-08-18T21:07:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe99013a1b0 0x7fe990141f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 10 monclient(hunting): picked mon.noname-i con 0x7fe99013a1b0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:07:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9900a4560 con 0x7fe9900a7600 2024-08-18T21:07:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fe9900a4310 con 0x7fe9900a6ce0 2024-08-18T21:07:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fe9900a32f0 con 0x7fe99013a1b0 2024-08-18T21:07:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe9970f2640 10 monclient(hunting): authenticate will time out at 1216.238330s 2024-08-18T21:07:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe9900a6ce0 0x7fe9900a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe9900a6ce0 0x7fe9900a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:35640/0 (socket says 172.21.15.5:35640) 2024-08-18T21:07:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 1 -- 172.21.15.5:0/2198343056 learned_addr learned my addr 172.21.15.5:0/2198343056 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 10 monclient(hunting): get_auth_request con 0x7fe9900a6ce0 auth_method 0 2024-08-18T21:07:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe99568f640 1 --2- 172.21.15.5:0/2198343056 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe99013a1b0 0x7fe990141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe99568f640 10 monclient(hunting): get_auth_request con 0x7fe99013a1b0 auth_method 0 2024-08-18T21:07:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe99568f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe99568f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe99568f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 10 monclient(hunting): handle_auth_done global_id 74144 payload 274 2024-08-18T21:07:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 1 -- 172.21.15.5:0/2198343056 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe99013a1b0 msgr2=0x7fe990141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 1 --2- 172.21.15.5:0/2198343056 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe99013a1b0 0x7fe990141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 1 -- 172.21.15.5:0/2198343056 >> v1:172.21.15.157:6789/0 conn(0x7fe9900a7600 legacy=0x7fe990139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 10 monclient: _finish_hunting 0 2024-08-18T21:07:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 1 monclient: found mon.noname-b 2024-08-18T21:07:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:07:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.223+0000 7fe994e8e640 1 -- 172.21.15.5:0/2198343056 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9900a37e0 con 0x7fe9900a6ce0 2024-08-18T21:07:29.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe994e8e640 1 -- 172.21.15.5:0/2198343056 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe9900a6ce0 msgr2=0x7fe9900a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe994e8e640 1 --2- 172.21.15.5:0/2198343056 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe9900a6ce0 0x7fe9900a70c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe9840098a0 tx=0x7fe98401c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e61198c082446746 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe98f7fe640 1 -- 172.21.15.5:0/2198343056 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe9840b0070 con 0x7fe9900a6ce0 2024-08-18T21:07:29.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe98f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe98f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:07:29.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe98f7fe640 10 monclient: dump: 2024-08-18T21:07:29.233 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.233 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.233 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.233 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.233 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.233 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.233 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.233 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.233 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.233 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe98f7fe640 10 monclient: _finish_auth 0 2024-08-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe98f7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe98f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe98f7fe640 1 -- 172.21.15.5:0/2198343056 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9840aa810 con 0x7fe9900a6ce0 2024-08-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe98f7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe98f7fe640 1 -- 172.21.15.5:0/2198343056 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe9840aae30 con 0x7fe9900a6ce0 2024-08-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe9970f2640 5 monclient: authenticate success, global_id 74144 2024-08-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe9970f2640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe9970f2640 4 set_mon_vals no callback set 2024-08-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe98f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe98f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe98f7fe640 10 monclient: dump: 2024-08-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe9970f2640 10 monclient: shutdown 2024-08-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe9970f2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe9970f2640 1 -- 172.21.15.5:0/2198343056 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe9900a6ce0 msgr2=0x7fe9900a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.227+0000 7fe9970f2640 1 --2- 172.21.15.5:0/2198343056 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe9900a6ce0 0x7fe9900a70c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe9840098a0 tx=0x7fe98401c440 comp rx=0 tx=0).stop 2024-08-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 1 -- 172.21.15.5:0/2198343056 shutdown_connections 2024-08-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 1 --2- 172.21.15.5:0/2198343056 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe99013a1b0 0x7fe990141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 1 --2- 172.21.15.5:0/2198343056 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe9900a6ce0 0x7fe9900a70c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 1 -- 172.21.15.5:0/2198343056 >> 172.21.15.5:0/2198343056 conn(0x7fe9900accd0 msgr2=0x7fe9900a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 1 -- 172.21.15.5:0/2198343056 shutdown_connections 2024-08-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 1 -- 172.21.15.5:0/2198343056 wait complete. 2024-08-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 10 monclient: build_initial_monmap 2024-08-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 10 monclient: monmap: 2024-08-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 1 Processor -- start 2024-08-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 1 -- start start 2024-08-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 10 monclient: init 2024-08-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 10 monclient: _add_conns ranks=[6,5,7,2,8,1,3,0,4] 2024-08-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe9900a6ce0 0x7fe99013dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 10 monclient(hunting): picked mon.noname-d con 0x7fe9900a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe9900a7600 0x7fe9901d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 10 monclient(hunting): picked mon.noname-h con 0x7fe9900a7600 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe99013a1b0 0x7fe9901d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 10 monclient(hunting): picked mon.noname-i con 0x7fe99013a1b0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe9900a81b0 con 0x7fe9900a7600 2024-08-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fe99006f270 con 0x7fe9900a6ce0 2024-08-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fe9900a79e0 con 0x7fe99013a1b0 2024-08-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe9970f2640 10 monclient(hunting): authenticate will time out at 1216.245793s 2024-08-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe9900a6ce0 0x7fe99013dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe9900a6ce0 0x7fe99013dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:60758/0 (socket says 172.21.15.5:60758) 2024-08-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 1 -- 172.21.15.5:0/1316156936 learned_addr learned my addr 172.21.15.5:0/1316156936 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 10 monclient(hunting): get_auth_request con 0x7fe9900a6ce0 auth_method 0 2024-08-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe99568f640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe99013a1b0 0x7fe9901d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe99568f640 10 monclient(hunting): get_auth_request con 0x7fe99013a1b0 auth_method 0 2024-08-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe99568f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe99568f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe99568f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe98ffff640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe9900a7600 0x7fe9901d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe98ffff640 10 monclient(hunting): get_auth_request con 0x7fe9900a7600 auth_method 0 2024-08-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe98ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe98ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe98ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 10 monclient(hunting): handle_auth_done global_id 54438 payload 824 2024-08-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 1 -- 172.21.15.5:0/1316156936 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe99013a1b0 msgr2=0x7fe9901d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe99013a1b0 0x7fe9901d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 1 -- 172.21.15.5:0/1316156936 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe9900a7600 msgr2=0x7fe9901d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe9900a7600 0x7fe9901d1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 10 monclient: _finish_hunting 0 2024-08-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 1 monclient: found mon.noname-d 2024-08-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.231+0000 7fe994e8e640 1 -- 172.21.15.5:0/1316156936 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9900a1e30 con 0x7fe9900a6ce0 2024-08-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe994e8e640 1 -- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe9900a6ce0 msgr2=0x7fe99013dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe994e8e640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe9900a6ce0 0x7fe99013dfa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe98401cce0 tx=0x7fe9840191e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98d7fa640 1 -- 172.21.15.5:0/1316156936 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe9840b0070 con 0x7fe9900a6ce0 2024-08-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98d7fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98d7fa640 10 monclient: dump: 2024-08-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98d7fa640 10 monclient: _finish_auth 0 2024-08-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98d7fa640 10 monclient: _check_auth_tickets 2024-08-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98d7fa640 1 -- 172.21.15.5:0/1316156936 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9840b1040 con 0x7fe9900a6ce0 2024-08-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe9970f2640 5 monclient: authenticate success, global_id 54438 2024-08-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe9970f2640 10 monclient: _renew_subs 2024-08-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe9970f2640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe9970f2640 1 -- 172.21.15.5:0/1316156936 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99013f4c0 con 0x7fe9900a6ce0 2024-08-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98d7fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98d7fa640 1 -- 172.21.15.5:0/1316156936 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe984004450 con 0x7fe9900a6ce0 2024-08-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98d7fa640 10 monclient: dump: 2024-08-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe9970f2640 10 monclient: _renew_subs 2024-08-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98effd640 4 set_mon_vals no callback set 2024-08-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe9970f2640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe9970f2640 1 -- 172.21.15.5:0/1316156936 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9900aa500 con 0x7fe9900a6ce0 2024-08-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe9970f2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe9970f2640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe9901d2480 0x7fe99013b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe9970f2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe9970f2640 1 -- 172.21.15.5:0/1316156936 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fe990051140 con 0x7fe9901d2480 2024-08-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98ffff640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe9901d2480 0x7fe99013b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98ffff640 10 monclient: get_auth_request con 0x7fe9901d2480 auth_method 0 2024-08-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98d7fa640 1 -- 172.21.15.5:0/1316156936 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe9840bc060 con 0x7fe9900a6ce0 2024-08-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98d7fa640 1 --2- 172.21.15.5:0/1316156936 >> v2:172.21.15.157:6812/631023601 conn(0x7fe97c03bdc0 0x7fe97c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98ffff640 10 monclient(hunting): handle_auth_done global_id 54447 payload 824 2024-08-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98ffff640 1 -- 172.21.15.5:0/1316156936 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9901d2860 con 0x7fe9901d2480 2024-08-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe98d7fa640 1 -- 172.21.15.5:0/1316156936 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(106..106 src has 22..106) ==== 3898+0+0 (secure 0 0 0) 0x7fe9840e7d70 con 0x7fe9900a6ce0 2024-08-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe99568f640 1 --2- 172.21.15.5:0/1316156936 >> v2:172.21.15.157:6812/631023601 conn(0x7fe97c03bdc0 0x7fe97c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.235+0000 7fe99568f640 10 monclient: get_auth_request con 0x7fe97c03bdc0 auth_method 0 2024-08-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.239+0000 7fe98ffff640 1 -- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe9901d2480 msgr2=0x7fe99013b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.239+0000 7fe98ffff640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe9901d2480 0x7fe99013b9e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe98000e790 tx=0x7fe98000ec50 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.239+0000 7fe98d7fa640 1 -- 172.21.15.5:0/1316156936 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe980015430 con 0x7fe9901d2480 2024-08-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.239+0000 7fe98d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.239+0000 7fe98d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.239+0000 7fe98d7fa640 10 monclient: dump: 2024-08-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.239+0000 7fe98d7fa640 1 -- 172.21.15.5:0/1316156936 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe98000cb50 con 0x7fe9901d2480 2024-08-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.239+0000 7fe98d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.239+0000 7fe98d7fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.239+0000 7fe98d7fa640 1 -- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe9901d2480 msgr2=0x7fe99013b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.239+0000 7fe98d7fa640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe9901d2480 0x7fe99013b9e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe98000e790 tx=0x7fe98000ec50 comp rx=0 tx=0).stop 2024-08-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.239+0000 7fe98d7fa640 1 -- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe9901d2480 msgr2=0x7fe99013b9e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.239+0000 7fe98d7fa640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe9901d2480 0x7fe99013b9e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.239+0000 7fe99568f640 1 --2- 172.21.15.5:0/1316156936 >> v2:172.21.15.157:6812/631023601 conn(0x7fe97c03bdc0 0x7fe97c03e280 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe99013dcc0 tx=0x7fe988008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.243+0000 7fe9970f2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.243+0000 7fe9970f2640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe99013bf20 0x7fe99013c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.243+0000 7fe9970f2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.243+0000 7fe9970f2640 1 -- 172.21.15.5:0/1316156936 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fe99013c870 con 0x7fe99013bf20 2024-08-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.243+0000 7fe98ffff640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe99013bf20 0x7fe99013c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.243+0000 7fe98ffff640 10 monclient: get_auth_request con 0x7fe99013bf20 auth_method 0 2024-08-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.243+0000 7fe98ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.243+0000 7fe98ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.243+0000 7fe98ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.243+0000 7fe98ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.243+0000 7fe98ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.243+0000 7fe98ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.243+0000 7fe98ffff640 10 monclient(hunting): handle_auth_done global_id 54456 payload 824 2024-08-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.243+0000 7fe98ffff640 1 -- 172.21.15.5:0/1316156936 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe9900a70c0 con 0x7fe99013bf20 2024-08-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe98ffff640 1 -- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe99013bf20 msgr2=0x7fe99013c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe98ffff640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe99013bf20 0x7fe99013c330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe98000e790 tx=0x7fe980003af0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe98d7fa640 1 -- 172.21.15.5:0/1316156936 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe9800074b0 con 0x7fe99013bf20 2024-08-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe98d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe98d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe98d7fa640 10 monclient: dump: 2024-08-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe98d7fa640 1 -- 172.21.15.5:0/1316156936 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7fe980015430 con 0x7fe99013bf20 2024-08-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe98d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe98d7fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe98d7fa640 1 -- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe99013bf20 msgr2=0x7fe99013c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe98d7fa640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe99013bf20 0x7fe99013c330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe98000e790 tx=0x7fe980003af0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe98d7fa640 1 -- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe99013bf20 msgr2=0x7fe99013c330 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe98d7fa640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe99013bf20 0x7fe99013c330 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe98000e790 tx=0x7fe980003af0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 105365, 2024-08-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe9970f2640 1 -- 172.21.15.5:0/1316156936 >> v2:172.21.15.157:6812/631023601 conn(0x7fe97c03bdc0 msgr2=0x7fe97c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe9970f2640 1 --2- 172.21.15.5:0/1316156936 >> v2:172.21.15.157:6812/631023601 conn(0x7fe97c03bdc0 0x7fe97c03e280 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe99013dcc0 tx=0x7fe988008040 comp rx=0 tx=0).stop 2024-08-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe9970f2640 10 monclient: shutdown 2024-08-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe9970f2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe9970f2640 1 -- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe9900a6ce0 msgr2=0x7fe99013dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe99568f640 1 -- 172.21.15.5:0/1316156936 reap_dead start 2024-08-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe9970f2640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe9900a6ce0 0x7fe99013dfa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe98401cce0 tx=0x7fe9840191e0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe9970f2640 1 -- 172.21.15.5:0/1316156936 shutdown_connections 2024-08-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe9970f2640 1 --2- 172.21.15.5:0/1316156936 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe9900a6ce0 0x7fe99013dfa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe9970f2640 1 -- 172.21.15.5:0/1316156936 >> 172.21.15.5:0/1316156936 conn(0x7fe9900accd0 msgr2=0x7fe9900a22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe9970f2640 1 -- 172.21.15.5:0/1316156936 shutdown_connections 2024-08-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.247+0000 7fe9970f2640 1 -- 172.21.15.5:0/1316156936 wait complete. 2024-08-18T21:07:29.283 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:29.283 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:07:29.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:07:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.399+0000 7f5e60e21640 10 monclient: get_monmap_and_config 2024-08-18T21:07:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.399+0000 7f5e60e21640 10 monclient: build_initial_monmap 2024-08-18T21:07:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.399+0000 7f5e60e21640 10 monclient: monmap: 2024-08-18T21:07:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:29.402944+0000 2024-08-18T21:07:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:29.402944+0000 2024-08-18T21:07:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:29.404 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.399+0000 7f5e60e21640 1 Processor -- start 2024-08-18T21:07:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.399+0000 7f5e60e21640 1 -- start start 2024-08-18T21:07:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.399+0000 7f5e60e21640 10 monclient: init 2024-08-18T21:07:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.399+0000 7f5e60e21640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e60e21640 10 monclient: _add_conns ranks=[4,2,3,10,7,0,5,9,8,6,1] 2024-08-18T21:07:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e60e21640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e5c0a6ce0 0x7f5e5c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e60e21640 10 monclient(hunting): picked mon.noname-c con 0x7f5e5c0a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:07:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e60e21640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5e5c0a7600 0x7f5e5c139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e60e21640 10 monclient(hunting): picked mon.noname-b con 0x7f5e5c0a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e60e21640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e5c139fe0 0x7f5e5c13a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e60e21640 10 monclient(hunting): picked mon.noname-g con 0x7f5e5c139fe0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e60e21640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e60e21640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f5e5c0a5000 con 0x7f5e5c0a7600 2024-08-18T21:07:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e60e21640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e60e21640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5e5c0a4360 con 0x7f5e5c139fe0 2024-08-18T21:07:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e60e21640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e60e21640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f5e5c0a45d0 con 0x7f5e5c0a6ce0 2024-08-18T21:07:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e60e21640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e60e21640 10 monclient(hunting): authenticate will time out at 1216.416128s 2024-08-18T21:07:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5a59c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e5c0a6ce0 0x7f5e5c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5e5c0a7600 0x7f5e5c139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5a59c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e5c0a6ce0 0x7f5e5c0a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:45212/0 (socket says 172.21.15.5:45212) 2024-08-18T21:07:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 10 monclient(hunting): get_auth_request con 0x7f5e5c0a7600 auth_method 0 2024-08-18T21:07:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5a59c640 1 -- 172.21.15.5:0/1468248600 learned_addr learned my addr 172.21.15.5:0/1468248600 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5a59c640 10 monclient(hunting): get_auth_request con 0x7f5e5c0a6ce0 auth_method 0 2024-08-18T21:07:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5ad9d640 1 --2- 172.21.15.5:0/1468248600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e5c139fe0 0x7f5e5c13a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5ad9d640 10 monclient(hunting): get_auth_request con 0x7f5e5c139fe0 auth_method 0 2024-08-18T21:07:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e5ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 10 monclient(hunting): handle_auth_done global_id 74153 payload 274 2024-08-18T21:07:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 1 -- 172.21.15.5:0/1468248600 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e5c0a6ce0 msgr2=0x7f5e5c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 1 --2- 172.21.15.5:0/1468248600 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e5c0a6ce0 0x7f5e5c0a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 1 -- 172.21.15.5:0/1468248600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e5c139fe0 msgr2=0x7f5e5c13a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 1 --2- 172.21.15.5:0/1468248600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e5c139fe0 0x7f5e5c13a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:07:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 1 monclient: found mon.noname-b 2024-08-18T21:07:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:07:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.403+0000 7f5e59d9b640 1 -- 172.21.15.5:0/1468248600 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5c0a32d0 con 0x7f5e5c0a7600 2024-08-18T21:07:29.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e59d9b640 1 -- 172.21.15.5:0/1468248600 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5e5c0a7600 msgr2=0x7f5e5c139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e59d9b640 1 --2- 172.21.15.5:0/1468248600 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5e5c0a7600 0x7f5e5c139aa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009820 tx=0x7f5e5001c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d1096db83fe9f79 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5959a640 1 -- 172.21.15.5:0/1468248600 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5e500b0070 con 0x7f5e5c0a7600 2024-08-18T21:07:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5959a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:07:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5959a640 10 monclient: dump: 2024-08-18T21:07:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.417 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5959a640 10 monclient: _finish_auth 0 2024-08-18T21:07:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5959a640 10 monclient: _check_auth_tickets 2024-08-18T21:07:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 5 monclient: authenticate success, global_id 74153 2024-08-18T21:07:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:07:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5959a640 1 -- 172.21.15.5:0/1468248600 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e500aa810 con 0x7f5e5c0a7600 2024-08-18T21:07:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5959a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 4 set_mon_vals no callback set 2024-08-18T21:07:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5959a640 1 -- 172.21.15.5:0/1468248600 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5e500a9300 con 0x7f5e5c0a7600 2024-08-18T21:07:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5959a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:07:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5959a640 10 monclient: dump: 2024-08-18T21:07:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.419 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 10 monclient: shutdown 2024-08-18T21:07:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 -- 172.21.15.5:0/1468248600 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5e5c0a7600 msgr2=0x7f5e5c139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 --2- 172.21.15.5:0/1468248600 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5e5c0a7600 0x7f5e5c139aa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009820 tx=0x7f5e5001c380 comp rx=0 tx=0).stop 2024-08-18T21:07:29.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 -- 172.21.15.5:0/1468248600 shutdown_connections 2024-08-18T21:07:29.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 --2- 172.21.15.5:0/1468248600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e5c139fe0 0x7f5e5c13a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 --2- 172.21.15.5:0/1468248600 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5e5c0a7600 0x7f5e5c139aa0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 --2- 172.21.15.5:0/1468248600 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e5c0a6ce0 0x7f5e5c0a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 -- 172.21.15.5:0/1468248600 >> 172.21.15.5:0/1468248600 conn(0x7f5e5c0acbc0 msgr2=0x7f5e5c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:29.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 -- 172.21.15.5:0/1468248600 shutdown_connections 2024-08-18T21:07:29.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 -- 172.21.15.5:0/1468248600 wait complete. 2024-08-18T21:07:29.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 10 monclient: build_initial_monmap 2024-08-18T21:07:29.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 10 monclient: monmap: 2024-08-18T21:07:29.420 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:29.420 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:29.420 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:29.421 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 Processor -- start 2024-08-18T21:07:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 -- start start 2024-08-18T21:07:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 10 monclient: init 2024-08-18T21:07:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 10 monclient: _add_conns ranks=[6,4,0,8,1,5,3,2,7] 2024-08-18T21:07:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5e5c0a6ce0 0x7f5e5c134a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 10 monclient(hunting): picked mon.noname-d con 0x7f5e5c0a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e5c0a7600 0x7f5e5c134f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 10 monclient(hunting): picked mon.noname-c con 0x7f5e5c0a7600 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:07:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e5c139fe0 0x7f5e5c1354d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 10 monclient(hunting): picked mon.noname-a con 0x7f5e5c139fe0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:07:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5c0a79e0 con 0x7f5e5c139fe0 2024-08-18T21:07:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f5e5c0a8220 con 0x7f5e5c0a7600 2024-08-18T21:07:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f5e5c0aa4a0 con 0x7f5e5c0a6ce0 2024-08-18T21:07:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e60e21640 10 monclient(hunting): authenticate will time out at 1216.423626s 2024-08-18T21:07:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5a59c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5e5c0a6ce0 0x7f5e5c134a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e59d9b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e5c0a7600 0x7f5e5c134f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5a59c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5e5c0a6ce0 0x7f5e5c134a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:60794/0 (socket says 172.21.15.5:60794) 2024-08-18T21:07:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5a59c640 1 -- 172.21.15.5:0/2525804145 learned_addr learned my addr 172.21.15.5:0/2525804145 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e59d9b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e5c0a7600 0x7f5e5c134f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:45220/0 (socket says 172.21.15.5:45220) 2024-08-18T21:07:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5a59c640 10 monclient(hunting): get_auth_request con 0x7f5e5c0a6ce0 auth_method 0 2024-08-18T21:07:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5ad9d640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e5c139fe0 0x7f5e5c1354d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e59d9b640 10 monclient(hunting): get_auth_request con 0x7f5e5c0a7600 auth_method 0 2024-08-18T21:07:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e59d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e59d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e59d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5ad9d640 10 monclient(hunting): get_auth_request con 0x7f5e5c139fe0 auth_method 0 2024-08-18T21:07:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e5ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e59d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e59d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.407+0000 7f5e59d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e59d9b640 10 monclient(hunting): handle_auth_done global_id 5413 payload 824 2024-08-18T21:07:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e59d9b640 1 -- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5e5c0a6ce0 msgr2=0x7f5e5c134a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e59d9b640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5e5c0a6ce0 0x7f5e5c134a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e59d9b640 1 -- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e5c139fe0 msgr2=0x7f5e5c1354d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e59d9b640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e5c139fe0 0x7f5e5c1354d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e59d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:07:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e59d9b640 1 monclient: found mon.noname-c 2024-08-18T21:07:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e59d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e59d9b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:07:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e59d9b640 1 -- 172.21.15.5:0/2525804145 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5c13c1d0 con 0x7f5e5c0a7600 2024-08-18T21:07:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e5a59c640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5e5c0a6ce0 0x7f5e5c134a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:07:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e5ad9d640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e5c139fe0 0x7f5e5c1354d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:07:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e59d9b640 1 -- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e5c0a7600 msgr2=0x7f5e5c134f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e59d9b640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e5c0a7600 0x7f5e5c134f90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5e500ab000 tx=0x7f5e50019120 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e4affd640 1 -- 172.21.15.5:0/2525804145 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5e500b0040 con 0x7f5e5c0a7600 2024-08-18T21:07:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e4affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:07:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e4affd640 10 monclient: dump: 2024-08-18T21:07:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.427 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e4affd640 10 monclient: _finish_auth 0 2024-08-18T21:07:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e4affd640 10 monclient: _check_auth_tickets 2024-08-18T21:07:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e4affd640 1 -- 172.21.15.5:0/2525804145 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e500aae30 con 0x7f5e5c0a7600 2024-08-18T21:07:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e60e21640 5 monclient: authenticate success, global_id 5413 2024-08-18T21:07:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e60e21640 10 monclient: _renew_subs 2024-08-18T21:07:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e60e21640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:07:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e60e21640 1 -- 172.21.15.5:0/2525804145 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e5c135af0 con 0x7f5e5c0a7600 2024-08-18T21:07:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e4affd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e4affd640 1 -- 172.21.15.5:0/2525804145 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5e50004250 con 0x7f5e5c0a7600 2024-08-18T21:07:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e4affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:07:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e4affd640 10 monclient: dump: 2024-08-18T21:07:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.430 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e4bfff640 4 set_mon_vals no callback set 2024-08-18T21:07:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e60e21640 10 monclient: _renew_subs 2024-08-18T21:07:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e60e21640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:07:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e60e21640 1 -- 172.21.15.5:0/2525804145 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e5c13e250 con 0x7f5e5c0a7600 2024-08-18T21:07:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e60e21640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e60e21640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e5c13bc30 0x7f5e5c063b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e60e21640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e60e21640 1 -- 172.21.15.5:0/2525804145 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f5e5c0a7b60 con 0x7f5e5c13bc30 2024-08-18T21:07:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e5a59c640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e5c13bc30 0x7f5e5c063b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e5a59c640 10 monclient: get_auth_request con 0x7f5e5c13bc30 auth_method 0 2024-08-18T21:07:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e5a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e5a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e5a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e4affd640 1 -- 172.21.15.5:0/2525804145 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f5e500bb020 con 0x7f5e5c0a7600 2024-08-18T21:07:29.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e5a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e5a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.411+0000 7f5e5a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e5a59c640 10 monclient(hunting): handle_auth_done global_id 54449 payload 824 2024-08-18T21:07:29.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e4affd640 1 --2- 172.21.15.5:0/2525804145 >> v2:172.21.15.157:6812/631023601 conn(0x7f5e3c03bdf0 0x7f5e3c03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e5a59c640 1 -- 172.21.15.5:0/2525804145 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e5c0aa0e0 con 0x7f5e5c13bc30 2024-08-18T21:07:29.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e4affd640 1 -- 172.21.15.5:0/2525804145 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(106..106 src has 22..106) ==== 3898+0+0 (secure 0 0 0) 0x7f5e500b9020 con 0x7f5e5c0a7600 2024-08-18T21:07:29.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e5ad9d640 1 --2- 172.21.15.5:0/2525804145 >> v2:172.21.15.157:6812/631023601 conn(0x7f5e3c03bdf0 0x7f5e3c03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e5ad9d640 10 monclient: get_auth_request con 0x7f5e3c03bdf0 auth_method 0 2024-08-18T21:07:29.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e5a59c640 1 -- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e5c13bc30 msgr2=0x7f5e5c063b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e5a59c640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e5c13bc30 0x7f5e5c063b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009ef0 tx=0x7f5e4c00f610 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e4affd640 1 -- 172.21.15.5:0/2525804145 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5e4c00fe50 con 0x7f5e5c13bc30 2024-08-18T21:07:29.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e4affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:07:29.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e4affd640 10 monclient: dump: 2024-08-18T21:07:29.434 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.434 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.434 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.435 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e4affd640 1 -- 172.21.15.5:0/2525804145 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5e4c00fe50 con 0x7f5e5c13bc30 2024-08-18T21:07:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e4affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e4affd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e4affd640 1 -- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e5c13bc30 msgr2=0x7f5e5c063b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e4affd640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e5c13bc30 0x7f5e5c063b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009ef0 tx=0x7f5e4c00f610 comp rx=0 tx=0).stop 2024-08-18T21:07:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e4affd640 1 -- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e5c13bc30 msgr2=0x7f5e5c063b30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e4affd640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e5c13bc30 0x7f5e5c063b30 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009ef0 tx=0x7f5e4c00f610 comp rx=0 tx=0).stop 2024-08-18T21:07:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.415+0000 7f5e5ad9d640 1 --2- 172.21.15.5:0/2525804145 >> v2:172.21.15.157:6812/631023601 conn(0x7f5e3c03bdf0 0x7f5e3c03e2b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009fd0 tx=0x7f5e5400b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.423+0000 7f5e60e21640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.423+0000 7f5e60e21640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e5c064070 0x7f5e5c02d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.423+0000 7f5e60e21640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.423+0000 7f5e60e21640 1 -- 172.21.15.5:0/2525804145 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f5e5c051140 con 0x7f5e5c064070 2024-08-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.423+0000 7f5e5a59c640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e5c064070 0x7f5e5c02d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.423+0000 7f5e5a59c640 10 monclient: get_auth_request con 0x7f5e5c064070 auth_method 0 2024-08-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.423+0000 7f5e5a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.423+0000 7f5e5a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.423+0000 7f5e5a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.423+0000 7f5e5a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.423+0000 7f5e5a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.423+0000 7f5e5a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.423+0000 7f5e5a59c640 10 monclient(hunting): handle_auth_done global_id 54458 payload 824 2024-08-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.423+0000 7f5e5a59c640 1 -- 172.21.15.5:0/2525804145 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5e5c13de20 con 0x7f5e5c064070 2024-08-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e5a59c640 1 -- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e5c064070 msgr2=0x7f5e5c02d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e5a59c640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e5c064070 0x7f5e5c02d1d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009ef0 tx=0x7f5e4c0046d0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e4affd640 1 -- 172.21.15.5:0/2525804145 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5e4c003ca0 con 0x7f5e5c064070 2024-08-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e4affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:07:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e4affd640 10 monclient: dump: 2024-08-18T21:07:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.439 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e4affd640 1 -- 172.21.15.5:0/2525804145 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f5e4c003830 con 0x7f5e5c064070 2024-08-18T21:07:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e4affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e4affd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e4affd640 1 -- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e5c064070 msgr2=0x7f5e5c02d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e4affd640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e5c064070 0x7f5e5c02d1d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009ef0 tx=0x7f5e4c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e4affd640 1 -- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e5c064070 msgr2=0x7f5e5c02d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e4affd640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e5c064070 0x7f5e5c02d1d0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009ef0 tx=0x7f5e4c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.440 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:07:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 105549, 2024-08-18T21:07:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:07:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:29.452 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.452 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:29.452 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.452 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.452 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.452 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:29.452 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:29.452 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.452 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.453 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.453 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:29.453 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:29.453 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.453 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.453 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.453 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:29.453 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.453 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.454 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:29.454 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.454 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.454 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.454 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:29.454 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:29.454 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.454 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.454 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.454 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:29.455 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:29.455 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.455 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.455 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:29.455 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.455 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:29.455 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.455 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.455 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.456 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:29.456 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:29.456 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.456 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.456 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.456 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:29.456 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:29.456 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.456 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.457 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:29.457 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.457 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.457 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:29.457 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.457 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.457 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.457 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:29.457 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:29.457 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.457 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.458 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.458 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:29.458 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:29.458 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.458 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.458 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.458 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:29.458 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.459 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.459 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:29.459 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.459 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.459 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.459 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:29.459 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:29.459 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.459 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.459 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.459 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:29.460 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:29.460 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.460 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.460 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.460 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.460 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:29.460 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.460 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.460 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.460 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.460 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:29.460 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.460 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.460 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.461 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:29.461 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:29.461 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.461 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.461 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.461 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.461 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.461 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:29.461 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:29.461 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.461 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:29.462 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:29.462 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:29.462 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.462 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.462 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:07:29.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.462 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:29.462 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:29.462 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:07:29.462 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.462 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.462 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:29.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.463 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:29.463 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:29.463 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:29.463 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.463 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.463 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:29.463 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:29.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e60e21640 1 -- 172.21.15.5:0/2525804145 >> v2:172.21.15.157:6812/631023601 conn(0x7f5e3c03bdf0 msgr2=0x7f5e3c03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e60e21640 1 --2- 172.21.15.5:0/2525804145 >> v2:172.21.15.157:6812/631023601 conn(0x7f5e3c03bdf0 0x7f5e3c03e2b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009fd0 tx=0x7f5e5400b040 comp rx=0 tx=0).stop 2024-08-18T21:07:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e60e21640 10 monclient: shutdown 2024-08-18T21:07:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e60e21640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e60e21640 1 -- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e5c0a7600 msgr2=0x7f5e5c134f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e60e21640 1 --2- 172.21.15.5:0/2525804145 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e5c0a7600 0x7f5e5c134f90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5e500ab000 tx=0x7f5e50019120 comp rx=0 tx=0).stop 2024-08-18T21:07:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e5ad9d640 1 -- 172.21.15.5:0/2525804145 reap_dead start 2024-08-18T21:07:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e5ad9d640 1 -- 172.21.15.5:0/2525804145 reap_dead start 2024-08-18T21:07:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e60e21640 1 -- 172.21.15.5:0/2525804145 shutdown_connections 2024-08-18T21:07:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e60e21640 1 -- 172.21.15.5:0/2525804145 >> 172.21.15.5:0/2525804145 conn(0x7f5e5c0acbc0 msgr2=0x7f5e5c138580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e60e21640 1 -- 172.21.15.5:0/2525804145 shutdown_connections 2024-08-18T21:07:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.427+0000 7f5e60e21640 1 -- 172.21.15.5:0/2525804145 wait complete. 2024-08-18T21:07:29.466 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:29.466 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:07:29.466 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:07:29.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.583+0000 7f929621f640 10 monclient: get_monmap_and_config 2024-08-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.583+0000 7f929621f640 10 monclient: build_initial_monmap 2024-08-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.583+0000 7f929621f640 10 monclient: monmap: 2024-08-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:29.588209+0000 2024-08-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:29.588209+0000 2024-08-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 1 Processor -- start 2024-08-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 1 -- start start 2024-08-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 10 monclient: init 2024-08-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 10 monclient: _add_conns ranks=[3,1,4,10,7,6,2,0,8,9,5] 2024-08-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92900a6bd0 0x7f92900a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 10 monclient(hunting): picked mon.noname-g con 0x7f92900a6bd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f929009f080 addr v1:172.21.15.157:6789/0 2024-08-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92900a74f0 0x7f929013a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 10 monclient(hunting): picked mon.noname-c con 0x7f92900a74f0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92900a7fb0 con 0x7f929009f080 2024-08-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f929009e4c0 con 0x7f92900a6bd0 2024-08-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f929006f930 con 0x7f92900a74f0 2024-08-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f929621f640 10 monclient(hunting): authenticate will time out at 1216.601383s 2024-08-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92900a74f0 0x7f929013a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92900a74f0 0x7f929013a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:45234/0 (socket says 172.21.15.5:45234) 2024-08-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 1 -- 172.21.15.5:0/3148522003 learned_addr learned my addr 172.21.15.5:0/3148522003 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 10 monclient(hunting): get_auth_request con 0x7f92900a74f0 auth_method 0 2024-08-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928f7fe640 1 --2- 172.21.15.5:0/3148522003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92900a6bd0 0x7f92900a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928f7fe640 10 monclient(hunting): get_auth_request con 0x7f92900a6bd0 auth_method 0 2024-08-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 10 monclient(hunting): handle_auth_done global_id 5422 payload 274 2024-08-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 1 -- 172.21.15.5:0/3148522003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92900a6bd0 msgr2=0x7f92900a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 1 --2- 172.21.15.5:0/3148522003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92900a6bd0 0x7f92900a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 1 -- 172.21.15.5:0/3148522003 >> v1:172.21.15.157:6789/0 conn(0x7f929009f080 legacy=0x7f9290139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 10 monclient: _finish_hunting 0 2024-08-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 1 monclient: found mon.noname-c 2024-08-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.587+0000 7f928ffff640 1 -- 172.21.15.5:0/3148522003 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929009de70 con 0x7f92900a74f0 2024-08-18T21:07:29.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f928ffff640 1 -- 172.21.15.5:0/3148522003 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92900a74f0 msgr2=0x7f929013a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f928ffff640 1 --2- 172.21.15.5:0/3148522003 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92900a74f0 0x7f929013a0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9288009eb0 tx=0x7f928801d350 comp rx=0 tx=0).ready entity=mon.4 client_cookie=93850524b617ce8f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f928e7fc640 1 -- 172.21.15.5:0/3148522003 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f92880090d0 con 0x7f92900a74f0 2024-08-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f928e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f928e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f928e7fc640 10 monclient: dump: 2024-08-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f928e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f928e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f928e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f928e7fc640 1 -- 172.21.15.5:0/3148522003 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92880a5a50 con 0x7f92900a74f0 2024-08-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f929621f640 5 monclient: authenticate success, global_id 5422 2024-08-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f929621f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f928e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f929621f640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f928e7fc640 1 -- 172.21.15.5:0/3148522003 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f92880a5c00 con 0x7f92900a74f0 2024-08-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f929621f640 4 set_mon_vals no callback set 2024-08-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f928e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f928e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f928e7fc640 10 monclient: dump: 2024-08-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f929621f640 10 monclient: shutdown 2024-08-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f929621f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f929621f640 1 -- 172.21.15.5:0/3148522003 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92900a74f0 msgr2=0x7f929013a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.591+0000 7f929621f640 1 --2- 172.21.15.5:0/3148522003 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92900a74f0 0x7f929013a0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9288009eb0 tx=0x7f928801d350 comp rx=0 tx=0).stop 2024-08-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 1 -- 172.21.15.5:0/3148522003 shutdown_connections 2024-08-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 1 --2- 172.21.15.5:0/3148522003 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92900a74f0 0x7f929013a0a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 1 --2- 172.21.15.5:0/3148522003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92900a6bd0 0x7f92900a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 1 -- 172.21.15.5:0/3148522003 >> 172.21.15.5:0/3148522003 conn(0x7f9290068700 msgr2=0x7f9290068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 1 -- 172.21.15.5:0/3148522003 shutdown_connections 2024-08-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 1 -- 172.21.15.5:0/3148522003 wait complete. 2024-08-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 10 monclient: build_initial_monmap 2024-08-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 10 monclient: monmap: 2024-08-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 1 Processor -- start 2024-08-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 1 -- start start 2024-08-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 10 monclient: init 2024-08-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 10 monclient: _add_conns ranks=[5,6,8,1,2,7,4,3,0] 2024-08-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f929009f080 0x7f9290138d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 10 monclient(hunting): picked mon.noname-h con 0x7f929009f080 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92900a6bd0 0x7f9290139290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 10 monclient(hunting): picked mon.noname-d con 0x7f92900a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f92900a74f0 0x7f929013f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 10 monclient(hunting): picked mon.noname-e con 0x7f92900a74f0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f929013a5e0 con 0x7f929009f080 2024-08-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f92900a89f0 con 0x7f92900a6bd0 2024-08-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f929013a760 con 0x7f92900a74f0 2024-08-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f929621f640 10 monclient(hunting): authenticate will time out at 1216.609795s 2024-08-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f92900a74f0 0x7f929013f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f92900a74f0 0x7f929013f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:40656/0 (socket says 172.21.15.5:40656) 2024-08-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 1 -- 172.21.15.5:0/1057732516 learned_addr learned my addr 172.21.15.5:0/1057732516 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 10 monclient(hunting): get_auth_request con 0x7f92900a74f0 auth_method 0 2024-08-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928effd640 1 --2- 172.21.15.5:0/1057732516 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92900a6bd0 0x7f9290139290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928effd640 10 monclient(hunting): get_auth_request con 0x7f92900a6bd0 auth_method 0 2024-08-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928f7fe640 1 --2- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f929009f080 0x7f9290138d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928f7fe640 10 monclient(hunting): get_auth_request con 0x7f929009f080 auth_method 0 2024-08-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 10 monclient(hunting): handle_auth_done global_id 54467 payload 824 2024-08-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 1 -- 172.21.15.5:0/1057732516 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92900a6bd0 msgr2=0x7f9290139290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 1 --2- 172.21.15.5:0/1057732516 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92900a6bd0 0x7f9290139290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 1 -- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f929009f080 msgr2=0x7f9290138d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 1 --2- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f929009f080 0x7f9290138d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 10 monclient: _finish_hunting 0 2024-08-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 1 monclient: found mon.noname-e 2024-08-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.595+0000 7f928ffff640 1 -- 172.21.15.5:0/1057732516 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9290123d50 con 0x7f92900a74f0 2024-08-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f928ffff640 1 -- 172.21.15.5:0/1057732516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f92900a74f0 msgr2=0x7f929013f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f928ffff640 1 --2- 172.21.15.5:0/1057732516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f92900a74f0 0x7f929013f780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9288009040 tx=0x7f9288019690 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f9277fff640 1 -- 172.21.15.5:0/1057732516 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f92880bc020 con 0x7f92900a74f0 2024-08-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f9277fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f9277fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f9277fff640 10 monclient: dump: 2024-08-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f9277fff640 10 monclient: _finish_auth 0 2024-08-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f9277fff640 10 monclient: _check_auth_tickets 2024-08-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f9277fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f9277fff640 1 -- 172.21.15.5:0/1057732516 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9288003dc0 con 0x7f92900a74f0 2024-08-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f9277fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f9277fff640 1 -- 172.21.15.5:0/1057732516 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f92880b8470 con 0x7f92900a74f0 2024-08-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f929621f640 5 monclient: authenticate success, global_id 54467 2024-08-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f929621f640 10 monclient: _renew_subs 2024-08-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f929621f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f929621f640 1 -- 172.21.15.5:0/1057732516 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9290122f00 con 0x7f92900a74f0 2024-08-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f9277fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f9277fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f928dffb640 4 set_mon_vals no callback set 2024-08-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f9277fff640 10 monclient: dump: 2024-08-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f929621f640 10 monclient: _renew_subs 2024-08-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f929621f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f929621f640 1 -- 172.21.15.5:0/1057732516 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f9290123790 con 0x7f92900a74f0 2024-08-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f929621f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f929621f640 1 --2- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9290140480 0x7f929002d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f929621f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f929621f640 1 -- 172.21.15.5:0/1057732516 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9290051140 con 0x7f9290140480 2024-08-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f9277fff640 1 -- 172.21.15.5:0/1057732516 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f92880bf020 con 0x7f92900a74f0 2024-08-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f928f7fe640 1 --2- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9290140480 0x7f929002d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f928f7fe640 10 monclient: get_auth_request con 0x7f9290140480 auth_method 0 2024-08-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f928f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f928f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f928f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f9277fff640 1 --2- 172.21.15.5:0/1057732516 >> v2:172.21.15.157:6812/631023601 conn(0x7f927c03bd20 0x7f927c03e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f9277fff640 1 -- 172.21.15.5:0/1057732516 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(106..106 src has 22..106) ==== 3898+0+0 (secure 0 0 0) 0x7f92880e9850 con 0x7f92900a74f0 2024-08-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f928f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f928f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f928f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f928effd640 1 --2- 172.21.15.5:0/1057732516 >> v2:172.21.15.157:6812/631023601 conn(0x7f927c03bd20 0x7f927c03e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f928effd640 10 monclient: get_auth_request con 0x7f927c03bd20 auth_method 0 2024-08-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f928f7fe640 10 monclient(hunting): handle_auth_done global_id 5284 payload 824 2024-08-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.599+0000 7f928f7fe640 1 -- 172.21.15.5:0/1057732516 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92900a6fb0 con 0x7f9290140480 2024-08-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.603+0000 7f928f7fe640 1 -- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9290140480 msgr2=0x7f929002d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.603+0000 7f928f7fe640 1 --2- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9290140480 0x7f929002d1d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f928000f510 tx=0x7f928000f9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.603+0000 7f928effd640 1 --2- 172.21.15.5:0/1057732516 >> v2:172.21.15.157:6812/631023601 conn(0x7f927c03bd20 0x7f927c03e1e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9290141640 tx=0x7f9284007e40 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.603+0000 7f9277fff640 1 -- 172.21.15.5:0/1057732516 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9280019030 con 0x7f9290140480 2024-08-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.603+0000 7f9277fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.603+0000 7f9277fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.603+0000 7f9277fff640 10 monclient: dump: 2024-08-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.618 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.603+0000 7f9277fff640 1 -- 172.21.15.5:0/1057732516 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9280014880 con 0x7f9290140480 2024-08-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.603+0000 7f9277fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.603+0000 7f9277fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.603+0000 7f9277fff640 1 -- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9290140480 msgr2=0x7f929002d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.603+0000 7f9277fff640 1 --2- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9290140480 0x7f929002d1d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f928000f510 tx=0x7f928000f9d0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.603+0000 7f9277fff640 1 -- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9290140480 msgr2=0x7f929002d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.603+0000 7f9277fff640 1 --2- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9290140480 0x7f929002d1d0 secure :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f928000f510 tx=0x7f928000f9d0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.611+0000 7f929621f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.611+0000 7f929621f640 1 --2- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9290140860 0x7f929002d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.611+0000 7f929621f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.611+0000 7f929621f640 1 -- 172.21.15.5:0/1057732516 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f92900ab180 con 0x7f9290140860 2024-08-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.611+0000 7f928f7fe640 1 --2- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9290140860 0x7f929002d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.611+0000 7f928f7fe640 10 monclient: get_auth_request con 0x7f9290140860 auth_method 0 2024-08-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.611+0000 7f928f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.611+0000 7f928f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.611+0000 7f928f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.611+0000 7f928f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.611+0000 7f928f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.611+0000 7f928f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.611+0000 7f928f7fe640 10 monclient(hunting): handle_auth_done global_id 5293 payload 824 2024-08-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.611+0000 7f928f7fe640 1 -- 172.21.15.5:0/1057732516 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9290123960 con 0x7f9290140860 2024-08-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f928f7fe640 1 -- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9290140860 msgr2=0x7f929002d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f928f7fe640 1 --2- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9290140860 0x7f929002d710 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f928000f510 tx=0x7f92800046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f9277fff640 1 -- 172.21.15.5:0/1057732516 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f928001fd10 con 0x7f9290140860 2024-08-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f9277fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f9277fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f9277fff640 10 monclient: dump: 2024-08-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f9277fff640 1 -- 172.21.15.5:0/1057732516 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f9280003620 con 0x7f9290140860 2024-08-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f9277fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f9277fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f9277fff640 1 -- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9290140860 msgr2=0x7f929002d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f9277fff640 1 --2- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9290140860 0x7f929002d710 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f928000f510 tx=0x7f92800046d0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f9277fff640 1 -- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9290140860 msgr2=0x7f929002d710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f9277fff640 1 --2- 172.21.15.5:0/1057732516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9290140860 0x7f929002d710 secure :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f928000f510 tx=0x7f92800046d0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 258697, 2024-08-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:29.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f929621f640 1 -- 172.21.15.5:0/1057732516 >> v2:172.21.15.157:6812/631023601 conn(0x7f927c03bd20 msgr2=0x7f927c03e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f929621f640 1 --2- 172.21.15.5:0/1057732516 >> v2:172.21.15.157:6812/631023601 conn(0x7f927c03bd20 0x7f927c03e1e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9290141640 tx=0x7f9284007e40 comp rx=0 tx=0).stop 2024-08-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f929621f640 10 monclient: shutdown 2024-08-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f929621f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f929621f640 1 -- 172.21.15.5:0/1057732516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f92900a74f0 msgr2=0x7f929013f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f929621f640 1 --2- 172.21.15.5:0/1057732516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f92900a74f0 0x7f929013f780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9288009040 tx=0x7f9288019690 comp rx=0 tx=0).stop 2024-08-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f928ffff640 1 -- 172.21.15.5:0/1057732516 reap_dead start 2024-08-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f928ffff640 1 -- 172.21.15.5:0/1057732516 reap_dead start 2024-08-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f929621f640 1 -- 172.21.15.5:0/1057732516 shutdown_connections 2024-08-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f929621f640 1 -- 172.21.15.5:0/1057732516 >> 172.21.15.5:0/1057732516 conn(0x7f9290068700 msgr2=0x7f92900aa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f929621f640 1 -- 172.21.15.5:0/1057732516 shutdown_connections 2024-08-18T21:07:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.615+0000 7f929621f640 1 -- 172.21.15.5:0/1057732516 wait complete. 2024-08-18T21:07:29.649 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:29.649 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:07:29.649 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:07:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.771+0000 7f6d64b34640 10 monclient: get_monmap_and_config 2024-08-18T21:07:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.771+0000 7f6d64b34640 10 monclient: build_initial_monmap 2024-08-18T21:07:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.771+0000 7f6d64b34640 10 monclient: monmap: 2024-08-18T21:07:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:29.775770+0000 2024-08-18T21:07:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:29.775770+0000 2024-08-18T21:07:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:29.776 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 1 Processor -- start 2024-08-18T21:07:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 1 -- start start 2024-08-18T21:07:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 10 monclient: init 2024-08-18T21:07:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 10 monclient: _add_conns ranks=[8,9,7,0,5,10,3,2,6,4,1] 2024-08-18T21:07:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6d600a1820 0x7f6d600a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 10 monclient(hunting): picked mon.noname-e con 0x7f6d600a1820 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:07:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d60137b80 0x7f6d60068700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 10 monclient(hunting): picked mon.noname-a con 0x7f6d60137b80 addr v2:172.21.15.5:3300/0 2024-08-18T21:07:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6d60068c40 0x7f6d600690c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 10 monclient(hunting): picked mon.noname-i con 0x7f6d60068c40 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:07:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6d6009fab0 con 0x7f6d60137b80 2024-08-18T21:07:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f6d6009fd50 con 0x7f6d60068c40 2024-08-18T21:07:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f6d600a0310 con 0x7f6d600a1820 2024-08-18T21:07:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d64b34640 10 monclient(hunting): authenticate will time out at 1216.791234s 2024-08-18T21:07:29.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d5dd9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d60137b80 0x7f6d60068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d5dd9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d60137b80 0x7f6d60068700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41378/0 (socket says 172.21.15.5:41378) 2024-08-18T21:07:29.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d5dd9b640 1 -- 172.21.15.5:0/195922630 learned_addr learned my addr 172.21.15.5:0/195922630 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:29.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d5dd9b640 10 monclient(hunting): get_auth_request con 0x7f6d60137b80 auth_method 0 2024-08-18T21:07:29.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d5dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d5dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d5dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d5ed9d640 1 --2- 172.21.15.5:0/195922630 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6d60068c40 0x7f6d600690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d5ed9d640 10 monclient(hunting): get_auth_request con 0x7f6d60068c40 auth_method 0 2024-08-18T21:07:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d5ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d5ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d5ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d5e59c640 1 --2- 172.21.15.5:0/195922630 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6d600a1820 0x7f6d600a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d5dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.775+0000 7f6d5dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5e59c640 10 monclient(hunting): get_auth_request con 0x7f6d600a1820 auth_method 0 2024-08-18T21:07:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5e59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5dd9b640 10 monclient(hunting): handle_auth_done global_id 74142 payload 274 2024-08-18T21:07:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5dd9b640 1 -- 172.21.15.5:0/195922630 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6d600a1820 msgr2=0x7f6d600a1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5dd9b640 1 --2- 172.21.15.5:0/195922630 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6d600a1820 0x7f6d600a1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5dd9b640 1 -- 172.21.15.5:0/195922630 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6d60068c40 msgr2=0x7f6d600690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5dd9b640 1 --2- 172.21.15.5:0/195922630 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6d60068c40 0x7f6d600690c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5dd9b640 10 monclient: _finish_hunting 0 2024-08-18T21:07:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5dd9b640 1 monclient: found mon.noname-a 2024-08-18T21:07:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5dd9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:07:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.779+0000 7f6d5dd9b640 1 -- 172.21.15.5:0/195922630 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d600a0030 con 0x7f6d60137b80 2024-08-18T21:07:29.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d5dd9b640 1 -- 172.21.15.5:0/195922630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d60137b80 msgr2=0x7f6d60068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d5dd9b640 1 --2- 172.21.15.5:0/195922630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d60137b80 0x7f6d60068700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009870 tx=0x7f6d5801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488c81acdefad76 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d5d59a640 1 -- 172.21.15.5:0/195922630 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6d580b0070 con 0x7f6d60137b80 2024-08-18T21:07:29.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d5d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d5d59a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:07:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d5d59a640 10 monclient: dump: 2024-08-18T21:07:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.787 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d5d59a640 10 monclient: _finish_auth 0 2024-08-18T21:07:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d5d59a640 10 monclient: _check_auth_tickets 2024-08-18T21:07:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d5d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 5 monclient: authenticate success, global_id 74142 2024-08-18T21:07:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d5d59a640 1 -- 172.21.15.5:0/195922630 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d580aa810 con 0x7f6d60137b80 2024-08-18T21:07:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d5d59a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d5d59a640 1 -- 172.21.15.5:0/195922630 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6d580a9300 con 0x7f6d60137b80 2024-08-18T21:07:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d5d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 4 set_mon_vals no callback set 2024-08-18T21:07:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d5d59a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:07:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d5d59a640 10 monclient: dump: 2024-08-18T21:07:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.789 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 10 monclient: shutdown 2024-08-18T21:07:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 1 -- 172.21.15.5:0/195922630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d60137b80 msgr2=0x7f6d60068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 1 --2- 172.21.15.5:0/195922630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d60137b80 0x7f6d60068700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009870 tx=0x7f6d5801c4b0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 1 -- 172.21.15.5:0/195922630 shutdown_connections 2024-08-18T21:07:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 1 --2- 172.21.15.5:0/195922630 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6d60068c40 0x7f6d600690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 1 --2- 172.21.15.5:0/195922630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d60137b80 0x7f6d60068700 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 1 --2- 172.21.15.5:0/195922630 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6d600a1820 0x7f6d600a1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 1 -- 172.21.15.5:0/195922630 >> 172.21.15.5:0/195922630 conn(0x7f6d600a8480 msgr2=0x7f6d600a8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 1 -- 172.21.15.5:0/195922630 shutdown_connections 2024-08-18T21:07:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 1 -- 172.21.15.5:0/195922630 wait complete. 2024-08-18T21:07:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 10 monclient: build_initial_monmap 2024-08-18T21:07:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 10 monclient: monmap: 2024-08-18T21:07:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:29.796 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 1 Processor -- start 2024-08-18T21:07:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 1 -- start start 2024-08-18T21:07:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.783+0000 7f6d64b34640 10 monclient: init 2024-08-18T21:07:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d64b34640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d64b34640 10 monclient: _add_conns ranks=[1,0,2,7,3,8,4,5,6] 2024-08-18T21:07:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d64b34640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d60068c40 0x7f6d601cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d64b34640 10 monclient(hunting): picked mon.noname-f con 0x7f6d60068c40 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:07:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d64b34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d600a1820 0x7f6d601d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d64b34640 10 monclient(hunting): picked mon.noname-a con 0x7f6d600a1820 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:07:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d64b34640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6d60137b80 0x7f6d60138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d64b34640 10 monclient(hunting): picked mon.noname-b con 0x7f6d60137b80 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d64b34640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d64b34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6d60141830 con 0x7f6d600a1820 2024-08-18T21:07:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d64b34640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d64b34640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6009ef60 con 0x7f6d60068c40 2024-08-18T21:07:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d64b34640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d64b34640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f6d601419b0 con 0x7f6d60137b80 2024-08-18T21:07:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d64b34640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d64b34640 10 monclient(hunting): authenticate will time out at 1216.800290s 2024-08-18T21:07:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d600a1820 0x7f6d601d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6d60137b80 0x7f6d60138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d600a1820 0x7f6d601d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41380/0 (socket says 172.21.15.5:41380) 2024-08-18T21:07:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5dd9b640 1 -- 172.21.15.5:0/571428475 learned_addr learned my addr 172.21.15.5:0/571428475 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5dd9b640 10 monclient(hunting): get_auth_request con 0x7f6d600a1820 auth_method 0 2024-08-18T21:07:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 10 monclient(hunting): get_auth_request con 0x7f6d60137b80 auth_method 0 2024-08-18T21:07:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5e59c640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d60068c40 0x7f6d601cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 10 monclient(hunting): handle_auth_done global_id 74162 payload 824 2024-08-18T21:07:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 1 -- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d60068c40 msgr2=0x7f6d601cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d60068c40 0x7f6d601cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 1 -- 172.21.15.5:0/571428475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d600a1820 msgr2=0x7f6d601d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d600a1820 0x7f6d601d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 10 monclient: _finish_hunting 0 2024-08-18T21:07:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 1 monclient: found mon.noname-b 2024-08-18T21:07:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:07:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 1 -- 172.21.15.5:0/571428475 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6013bfa0 con 0x7f6d60137b80 2024-08-18T21:07:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5e59c640 10 monclient: get_auth_request con 0x7f6d60068c40 auth_method 0 2024-08-18T21:07:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5dd9b640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d600a1820 0x7f6d601d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:07:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5e59c640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d60068c40 0x7f6d601cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:07:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 1 -- 172.21.15.5:0/571428475 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6d60137b80 msgr2=0x7f6d60138770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5ed9d640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6d60137b80 0x7f6d60138770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800e830 tx=0x7f6d4800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d56ffd640 1 -- 172.21.15.5:0/571428475 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6d48017070 con 0x7f6d60137b80 2024-08-18T21:07:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d56ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:07:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d56ffd640 10 monclient: dump: 2024-08-18T21:07:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.801 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d56ffd640 10 monclient: _finish_auth 0 2024-08-18T21:07:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d56ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:07:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d56ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d56ffd640 1 -- 172.21.15.5:0/571428475 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d48013470 con 0x7f6d60137b80 2024-08-18T21:07:29.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d56ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:29.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d56ffd640 1 -- 172.21.15.5:0/571428475 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6d48013a90 con 0x7f6d60137b80 2024-08-18T21:07:29.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d56ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:07:29.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d56ffd640 10 monclient: dump: 2024-08-18T21:07:29.802 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.802 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.802 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.802 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.802 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.802 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.802 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.802 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.802 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.803 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.803 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.803 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.803 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.803 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.803 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.803 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.787+0000 7f6d5cd99640 4 set_mon_vals no callback set 2024-08-18T21:07:29.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d64b34640 5 monclient: authenticate success, global_id 74162 2024-08-18T21:07:29.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d64b34640 10 monclient: _renew_subs 2024-08-18T21:07:29.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d64b34640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:07:29.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d64b34640 1 -- 172.21.15.5:0/571428475 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d600a5ae0 con 0x7f6d60137b80 2024-08-18T21:07:29.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d64b34640 10 monclient: _renew_subs 2024-08-18T21:07:29.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d64b34640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d64b34640 1 -- 172.21.15.5:0/571428475 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d600a88d0 con 0x7f6d60137b80 2024-08-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d64b34640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d64b34640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d60138cb0 0x7f6d60139090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d64b34640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d64b34640 1 -- 172.21.15.5:0/571428475 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6d60051140 con 0x7f6d60138cb0 2024-08-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d56ffd640 1 -- 172.21.15.5:0/571428475 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f6d4801a070 con 0x7f6d60137b80 2024-08-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d5e59c640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d60138cb0 0x7f6d60139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d5e59c640 10 monclient: get_auth_request con 0x7f6d60138cb0 auth_method 0 2024-08-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d5e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d5e59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d5e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d56ffd640 1 --2- 172.21.15.5:0/571428475 >> v2:172.21.15.157:6812/631023601 conn(0x7f6d4003bdc0 0x7f6d4003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d5e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d5e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d5e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d56ffd640 1 -- 172.21.15.5:0/571428475 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(107..107 src has 22..107) ==== 3898+0+0 (secure 0 0 0) 0x7f6d4800f040 con 0x7f6d60137b80 2024-08-18T21:07:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d5dd9b640 1 --2- 172.21.15.5:0/571428475 >> v2:172.21.15.157:6812/631023601 conn(0x7f6d4003bdc0 0x7f6d4003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d5dd9b640 10 monclient: get_auth_request con 0x7f6d4003bdc0 auth_method 0 2024-08-18T21:07:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d5e59c640 10 monclient(hunting): handle_auth_done global_id 5367 payload 824 2024-08-18T21:07:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.791+0000 7f6d5e59c640 1 -- 172.21.15.5:0/571428475 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d6007d350 con 0x7f6d60138cb0 2024-08-18T21:07:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.795+0000 7f6d5e59c640 1 -- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d60138cb0 msgr2=0x7f6d60139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.795+0000 7f6d5e59c640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d60138cb0 0x7f6d60139090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000f330 tx=0x7f6d5000f7f0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.795+0000 7f6d56ffd640 1 -- 172.21.15.5:0/571428475 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6d5000fe70 con 0x7f6d60138cb0 2024-08-18T21:07:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.795+0000 7f6d56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.795+0000 7f6d56ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:07:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.795+0000 7f6d56ffd640 10 monclient: dump: 2024-08-18T21:07:29.808 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.808 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.808 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.808 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.808 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.808 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.808 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.808 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.808 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.810 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.795+0000 7f6d5dd9b640 1 --2- 172.21.15.5:0/571428475 >> v2:172.21.15.157:6812/631023601 conn(0x7f6d4003bdc0 0x7f6d4003e280 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6d5801cd50 tx=0x7f6d580a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.795+0000 7f6d56ffd640 1 -- 172.21.15.5:0/571428475 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6d5000fe70 con 0x7f6d60138cb0 2024-08-18T21:07:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.795+0000 7f6d56ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.795+0000 7f6d56ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.795+0000 7f6d56ffd640 1 -- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d60138cb0 msgr2=0x7f6d60139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.795+0000 7f6d56ffd640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d60138cb0 0x7f6d60139090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000f330 tx=0x7f6d5000f7f0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.795+0000 7f6d56ffd640 1 -- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d60138cb0 msgr2=0x7f6d60139090 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.795+0000 7f6d56ffd640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d60138cb0 0x7f6d60139090 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000f330 tx=0x7f6d5000f7f0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.799+0000 7f6d64b34640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.799+0000 7f6d64b34640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d601395d0 0x7f6d60070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.799+0000 7f6d64b34640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.799+0000 7f6d64b34640 1 -- 172.21.15.5:0/571428475 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6d60069fa0 con 0x7f6d601395d0 2024-08-18T21:07:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.799+0000 7f6d5e59c640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d601395d0 0x7f6d60070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.799+0000 7f6d5e59c640 10 monclient: get_auth_request con 0x7f6d601395d0 auth_method 0 2024-08-18T21:07:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.799+0000 7f6d5e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.799+0000 7f6d5e59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.799+0000 7f6d5e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.799+0000 7f6d5e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.799+0000 7f6d5e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.799+0000 7f6d5e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.799+0000 7f6d5e59c640 10 monclient(hunting): handle_auth_done global_id 5376 payload 824 2024-08-18T21:07:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.799+0000 7f6d5e59c640 1 -- 172.21.15.5:0/571428475 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6d60076d90 con 0x7f6d601395d0 2024-08-18T21:07:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d5e59c640 1 -- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d601395d0 msgr2=0x7f6d60070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d5e59c640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d601395d0 0x7f6d60070d00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6d50018000 tx=0x7f6d50004a50 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d56ffd640 1 -- 172.21.15.5:0/571428475 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6d50014e40 con 0x7f6d601395d0 2024-08-18T21:07:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d56ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:07:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d56ffd640 10 monclient: dump: 2024-08-18T21:07:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.814 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d56ffd640 1 -- 172.21.15.5:0/571428475 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f6d50022070 con 0x7f6d601395d0 2024-08-18T21:07:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d56ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d56ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d56ffd640 1 -- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d601395d0 msgr2=0x7f6d60070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d56ffd640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d601395d0 0x7f6d60070d00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6d50018000 tx=0x7f6d50004a50 comp rx=0 tx=0).stop 2024-08-18T21:07:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d56ffd640 1 -- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d601395d0 msgr2=0x7f6d60070d00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d56ffd640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d601395d0 0x7f6d60070d00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.815 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:29.815 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:29.815 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:29.815 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:07:29.815 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:29.815 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 258901, 2024-08-18T21:07:29.815 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:29.815 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:29.815 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:29.815 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:07:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.817 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.817 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.817 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.817 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.817 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.817 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.817 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.817 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.817 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.817 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.817 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.817 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:29.817 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:29.817 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.818 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.818 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.818 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.818 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.818 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.818 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.818 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.818 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.818 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.818 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.818 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.818 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:29.819 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:29.819 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:29.819 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:29.819 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:29.819 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:29.819 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:29.819 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:29.819 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:29.819 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:29.819 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:29.819 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:29.819 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:29.819 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:29.819 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:29.820 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:29.820 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:29.820 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.820 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.820 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.820 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.820 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.820 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.820 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.820 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.820 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.820 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.820 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.820 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.821 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:29.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.821 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:29.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.821 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:29.821 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:29.821 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.821 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:29.821 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.822 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.822 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:29.822 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.822 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.822 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.822 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:29.822 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:29.822 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.822 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.822 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.823 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:29.823 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:29.823 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.823 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.823 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.823 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:29.823 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.823 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.823 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:29.823 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.824 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.824 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.824 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:29.824 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:29.824 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.824 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.824 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.824 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:29.824 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:29.824 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.825 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.825 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.825 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:29.825 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.825 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.825 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:29.825 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.825 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.825 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.825 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.827 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.827 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:29.827 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.827 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.827 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.827 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:29.827 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:29.827 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.827 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.827 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.828 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:29.828 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:29.828 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.828 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.828 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.828 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:29.828 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.828 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.828 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:29.829 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.829 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.829 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.829 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:29.829 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:29.829 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.829 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.829 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.829 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:29.829 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:29.829 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.829 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.830 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.830 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.830 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:29.830 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.830 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.830 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.830 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:29.830 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.830 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.830 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.830 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:07:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:07:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:29.838 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:29.838 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:29.838 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.838 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.838 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:29.838 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d64b34640 1 -- 172.21.15.5:0/571428475 >> v2:172.21.15.157:6812/631023601 conn(0x7f6d4003bdc0 msgr2=0x7f6d4003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d64b34640 1 --2- 172.21.15.5:0/571428475 >> v2:172.21.15.157:6812/631023601 conn(0x7f6d4003bdc0 0x7f6d4003e280 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6d5801cd50 tx=0x7f6d580a6000 comp rx=0 tx=0).stop 2024-08-18T21:07:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d64b34640 10 monclient: shutdown 2024-08-18T21:07:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d64b34640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d64b34640 1 -- 172.21.15.5:0/571428475 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6d60137b80 msgr2=0x7f6d60138770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d5ed9d640 1 -- 172.21.15.5:0/571428475 reap_dead start 2024-08-18T21:07:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d64b34640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6d60137b80 0x7f6d60138770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800e830 tx=0x7f6d4800ecf0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d64b34640 1 -- 172.21.15.5:0/571428475 shutdown_connections 2024-08-18T21:07:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d64b34640 1 --2- 172.21.15.5:0/571428475 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6d60137b80 0x7f6d60138770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d64b34640 1 -- 172.21.15.5:0/571428475 >> 172.21.15.5:0/571428475 conn(0x7f6d600a8480 msgr2=0x7f6d60098260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d64b34640 1 -- 172.21.15.5:0/571428475 shutdown_connections 2024-08-18T21:07:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.803+0000 7f6d64b34640 1 -- 172.21.15.5:0/571428475 wait complete. 2024-08-18T21:07:29.841 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:29.841 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:07:29.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:07:29.923 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:07:29.923 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29234]: starting. 2024-08-18T21:07:29.923 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29234]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29197 2024-08-18T21:07:29.923 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29234]: created object 0... 2024-08-18T21:07:29.923 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29234]: created object 25... 2024-08-18T21:07:29.923 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29234]: created object 49... 2024-08-18T21:07:29.924 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29234]: finishing. 2024-08-18T21:07:29.924 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29234]: shutting down. 2024-08-18T21:07:29.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.951+0000 7fb984395640 10 monclient: get_monmap_and_config 2024-08-18T21:07:29.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.951+0000 7fb984395640 10 monclient: build_initial_monmap 2024-08-18T21:07:29.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.951+0000 7fb984395640 10 monclient: monmap: 2024-08-18T21:07:29.955 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:29.955 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.955 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:29.955934+0000 2024-08-18T21:07:29.955 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:29.955934+0000 2024-08-18T21:07:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:29.956 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 1 Processor -- start 2024-08-18T21:07:29.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 1 -- start start 2024-08-18T21:07:29.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 10 monclient: init 2024-08-18T21:07:29.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 10 monclient: _add_conns ranks=[6,10,5,3,4,7,9,0,2,8,1] 2024-08-18T21:07:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb97c138a10 0x7fb97c09efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 10 monclient(hunting): picked mon.noname-d con 0x7fb97c138a10 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb97c0a4db0 0x7fb97c138df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 10 monclient(hunting): picked mon.noname-f con 0x7fb97c0a4db0 addr v2:172.21.15.157:3300/0 2024-08-18T21:07:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c139330 0x7fb97c06c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 10 monclient(hunting): picked mon.noname-h con 0x7fb97c139330 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:07:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb97c09f660 con 0x7fb97c0a4db0 2024-08-18T21:07:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fb97c09dec0 con 0x7fb97c139330 2024-08-18T21:07:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fb97c09e1a0 con 0x7fb97c138a10 2024-08-18T21:07:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb984395640 10 monclient(hunting): authenticate will time out at 1216.969029s 2024-08-18T21:07:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb97c138a10 0x7fb97c09efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb97c138a10 0x7fb97c09efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:60812/0 (socket says 172.21.15.5:60812) 2024-08-18T21:07:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 1 -- 172.21.15.5:0/3522788838 learned_addr learned my addr 172.21.15.5:0/3522788838 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 10 monclient(hunting): get_auth_request con 0x7fb97c138a10 auth_method 0 2024-08-18T21:07:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 10 monclient(hunting): handle_auth_done global_id 54483 payload 274 2024-08-18T21:07:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 1 -- 172.21.15.5:0/3522788838 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c139330 msgr2=0x7fb97c06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 1 --2- 172.21.15.5:0/3522788838 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c139330 0x7fb97c06c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb981930640 1 --2- 172.21.15.5:0/3522788838 >> v2:172.21.15.157:3300/0 conn(0x7fb97c0a4db0 0x7fb97c138df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 1 -- 172.21.15.5:0/3522788838 >> v2:172.21.15.157:3300/0 conn(0x7fb97c0a4db0 msgr2=0x7fb97c138df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:29.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 1 --2- 172.21.15.5:0/3522788838 >> v2:172.21.15.157:3300/0 conn(0x7fb97c0a4db0 0x7fb97c138df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 10 monclient: _finish_hunting 0 2024-08-18T21:07:29.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 1 monclient: found mon.noname-d 2024-08-18T21:07:29.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:29.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:07:29.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.955+0000 7fb982131640 1 -- 172.21.15.5:0/3522788838 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97c06ce90 con 0x7fb97c138a10 2024-08-18T21:07:29.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb982131640 1 -- 172.21.15.5:0/3522788838 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb97c138a10 msgr2=0x7fb97c09efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb982131640 1 --2- 172.21.15.5:0/3522788838 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb97c138a10 0x7fb97c09efd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009870 tx=0x7fb96c01c420 comp rx=0 tx=0).ready entity=mon.6 client_cookie=c8b6404947974e78 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb98112f640 1 -- 172.21.15.5:0/3522788838 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb96c0b0070 con 0x7fb97c138a10 2024-08-18T21:07:29.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb98112f640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb98112f640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:07:29.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb98112f640 10 monclient: dump: 2024-08-18T21:07:29.963 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.963 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.963 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.963 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.963 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.963 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.964 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb98112f640 10 monclient: _finish_auth 0 2024-08-18T21:07:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb98112f640 10 monclient: _check_auth_tickets 2024-08-18T21:07:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb98112f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb98112f640 1 -- 172.21.15.5:0/3522788838 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb96c0a9a60 con 0x7fb97c138a10 2024-08-18T21:07:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb98112f640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb98112f640 1 -- 172.21.15.5:0/3522788838 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb96c0a9c50 con 0x7fb97c138a10 2024-08-18T21:07:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 5 monclient: authenticate success, global_id 54483 2024-08-18T21:07:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 4 set_mon_vals no callback set 2024-08-18T21:07:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb98112f640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb98112f640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:07:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb98112f640 10 monclient: dump: 2024-08-18T21:07:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.966 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 10 monclient: shutdown 2024-08-18T21:07:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 1 -- 172.21.15.5:0/3522788838 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb97c138a10 msgr2=0x7fb97c09efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 1 --2- 172.21.15.5:0/3522788838 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb97c138a10 0x7fb97c09efd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009870 tx=0x7fb96c01c420 comp rx=0 tx=0).stop 2024-08-18T21:07:29.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 1 -- 172.21.15.5:0/3522788838 shutdown_connections 2024-08-18T21:07:29.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 1 --2- 172.21.15.5:0/3522788838 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c139330 0x7fb97c06c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 1 --2- 172.21.15.5:0/3522788838 >> v2:172.21.15.157:3300/0 conn(0x7fb97c0a4db0 0x7fb97c138df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 1 --2- 172.21.15.5:0/3522788838 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb97c138a10 0x7fb97c09efd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 1 -- 172.21.15.5:0/3522788838 >> 172.21.15.5:0/3522788838 conn(0x7fb97c0688d0 msgr2=0x7fb97c068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:29.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 1 -- 172.21.15.5:0/3522788838 shutdown_connections 2024-08-18T21:07:29.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 1 -- 172.21.15.5:0/3522788838 wait complete. 2024-08-18T21:07:29.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 10 monclient: build_initial_monmap 2024-08-18T21:07:29.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 10 monclient: monmap: 2024-08-18T21:07:29.967 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:29.967 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:29.967 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:29.967 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:29.967 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:29.967 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:29.968 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 1 Processor -- start 2024-08-18T21:07:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 1 -- start start 2024-08-18T21:07:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 10 monclient: init 2024-08-18T21:07:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.959+0000 7fb984395640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 10 monclient: _add_conns ranks=[3,1,2,8,7,0,4,5,6] 2024-08-18T21:07:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb97c0a4db0 0x7fb97c130e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 10 monclient(hunting): picked mon.noname-g con 0x7fb97c0a4db0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb97c138a10 0x7fb97c139c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 10 monclient(hunting): picked mon.noname-f con 0x7fb97c138a10 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:07:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb97c139330 0x7fb97c13a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 10 monclient(hunting): picked mon.noname-b con 0x7fb97c139330 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb97c143690 con 0x7fb97c138a10 2024-08-18T21:07:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fb97c143510 con 0x7fb97c139330 2024-08-18T21:07:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb97c143810 con 0x7fb97c0a4db0 2024-08-18T21:07:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 10 monclient(hunting): authenticate will time out at 1216.976063s 2024-08-18T21:07:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb97c139330 0x7fb97c13a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb97c139330 0x7fb97c13a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:35672/0 (socket says 172.21.15.5:35672) 2024-08-18T21:07:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 1 -- 172.21.15.5:0/1921553005 learned_addr learned my addr 172.21.15.5:0/1921553005 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 10 monclient(hunting): get_auth_request con 0x7fb97c139330 auth_method 0 2024-08-18T21:07:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 10 monclient(hunting): handle_auth_done global_id 74171 payload 824 2024-08-18T21:07:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 1 -- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb97c0a4db0 msgr2=0x7fb97c130e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 1 --2- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb97c0a4db0 0x7fb97c130e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 1 -- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb97c138a10 msgr2=0x7fb97c139c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 1 --2- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb97c138a10 0x7fb97c139c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 10 monclient: _finish_hunting 0 2024-08-18T21:07:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 1 monclient: found mon.noname-b 2024-08-18T21:07:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:07:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 1 -- 172.21.15.5:0/1921553005 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97c13da40 con 0x7fb97c139330 2024-08-18T21:07:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 1 -- 172.21.15.5:0/1921553005 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb97c139330 msgr2=0x7fb97c13a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb982932640 1 --2- 172.21.15.5:0/1921553005 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb97c139330 0x7fb97c13a1d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb97400b390 tx=0x7fb97400b850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb97affd640 1 -- 172.21.15.5:0/1921553005 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb974015020 con 0x7fb97c139330 2024-08-18T21:07:29.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb97affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb97affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:07:29.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb97affd640 10 monclient: dump: 2024-08-18T21:07:29.976 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.976 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.976 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.976 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.976 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.976 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.976 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.976 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.977 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb97affd640 10 monclient: _finish_auth 0 2024-08-18T21:07:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb97affd640 10 monclient: _check_auth_tickets 2024-08-18T21:07:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb97affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb97affd640 1 -- 172.21.15.5:0/1921553005 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb974011cb0 con 0x7fb97c139330 2024-08-18T21:07:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 5 monclient: authenticate success, global_id 74171 2024-08-18T21:07:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 10 monclient: _renew_subs 2024-08-18T21:07:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:07:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 1 -- 172.21.15.5:0/1921553005 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb97c1348f0 con 0x7fb97c139330 2024-08-18T21:07:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb97affd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb97affd640 1 -- 172.21.15.5:0/1921553005 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb9740107f0 con 0x7fb97c139330 2024-08-18T21:07:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb97affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb97affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:07:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb97affd640 10 monclient: dump: 2024-08-18T21:07:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.979 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb98092e640 4 set_mon_vals no callback set 2024-08-18T21:07:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 10 monclient: _renew_subs 2024-08-18T21:07:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:07:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 1 -- 172.21.15.5:0/1921553005 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb97c13d480 con 0x7fb97c139330 2024-08-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 1 --2- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c1313d0 0x7fb97c13a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb984395640 1 -- 172.21.15.5:0/1921553005 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fb97c13e470 con 0x7fb97c1313d0 2024-08-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.963+0000 7fb97affd640 1 -- 172.21.15.5:0/1921553005 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fb974018020 con 0x7fb97c139330 2024-08-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb982131640 1 --2- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c1313d0 0x7fb97c13a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb982131640 10 monclient: get_auth_request con 0x7fb97c1313d0 auth_method 0 2024-08-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb982131640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb982131640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb982131640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb97affd640 1 --2- 172.21.15.5:0/1921553005 >> v2:172.21.15.157:6812/631023601 conn(0x7fb96803bdc0 0x7fb96803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb97affd640 1 -- 172.21.15.5:0/1921553005 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(107..107 src has 22..107) ==== 3898+0+0 (secure 0 0 0) 0x7fb97404e6d0 con 0x7fb97c139330 2024-08-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb982131640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb982131640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb982131640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb981930640 1 --2- 172.21.15.5:0/1921553005 >> v2:172.21.15.157:6812/631023601 conn(0x7fb96803bdc0 0x7fb96803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb981930640 10 monclient: get_auth_request con 0x7fb96803bdc0 auth_method 0 2024-08-18T21:07:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb982131640 10 monclient(hunting): handle_auth_done global_id 34754 payload 824 2024-08-18T21:07:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb982131640 1 -- 172.21.15.5:0/1921553005 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb97c06dbf0 con 0x7fb97c1313d0 2024-08-18T21:07:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb982131640 1 -- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c1313d0 msgr2=0x7fb97c13a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb982131640 1 --2- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c1313d0 0x7fb97c13a710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0ad000 tx=0x7fb96c003850 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb981930640 1 --2- 172.21.15.5:0/1921553005 >> v2:172.21.15.157:6812/631023601 conn(0x7fb96803bdc0 0x7fb96803e280 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb97c13b3f0 tx=0x7fb9700073b0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb97affd640 1 -- 172.21.15.5:0/1921553005 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb96c0b0040 con 0x7fb97c1313d0 2024-08-18T21:07:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb97affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb97affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:07:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.967+0000 7fb97affd640 10 monclient: dump: 2024-08-18T21:07:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.982 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.971+0000 7fb97affd640 1 -- 172.21.15.5:0/1921553005 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb96c0b9070 con 0x7fb97c1313d0 2024-08-18T21:07:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.971+0000 7fb97affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.971+0000 7fb97affd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.971+0000 7fb97affd640 1 -- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c1313d0 msgr2=0x7fb97c13a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.971+0000 7fb97affd640 1 --2- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c1313d0 0x7fb97c13a710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0ad000 tx=0x7fb96c003850 comp rx=0 tx=0).stop 2024-08-18T21:07:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.971+0000 7fb97affd640 1 -- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c1313d0 msgr2=0x7fb97c13a710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.971+0000 7fb97affd640 1 --2- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c1313d0 0x7fb97c13a710 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0ad000 tx=0x7fb96c003850 comp rx=0 tx=0).stop 2024-08-18T21:07:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.975+0000 7fb984395640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.975+0000 7fb984395640 1 --2- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c13d650 0x7fb97c13ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.975+0000 7fb984395640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.975+0000 7fb984395640 1 -- 172.21.15.5:0/1921553005 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fb97c051140 con 0x7fb97c13d650 2024-08-18T21:07:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.975+0000 7fb982131640 1 --2- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c13d650 0x7fb97c13ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.975+0000 7fb982131640 10 monclient: get_auth_request con 0x7fb97c13d650 auth_method 0 2024-08-18T21:07:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.975+0000 7fb982131640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.975+0000 7fb982131640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.975+0000 7fb982131640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.975+0000 7fb982131640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.975+0000 7fb982131640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.975+0000 7fb982131640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.975+0000 7fb982131640 10 monclient(hunting): handle_auth_done global_id 34763 payload 824 2024-08-18T21:07:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.975+0000 7fb982131640 1 -- 172.21.15.5:0/1921553005 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb97c09efd0 con 0x7fb97c13d650 2024-08-18T21:07:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb982131640 1 -- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c13d650 msgr2=0x7fb97c13ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb982131640 1 --2- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c13d650 0x7fb97c13ac50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009870 tx=0x7fb96c0a8000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb97affd640 1 -- 172.21.15.5:0/1921553005 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb96c0b0040 con 0x7fb97c13d650 2024-08-18T21:07:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb97affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb97affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:07:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb97affd640 10 monclient: dump: 2024-08-18T21:07:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:29.987 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb97affd640 1 -- 172.21.15.5:0/1921553005 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7fb96c0a9ab0 con 0x7fb97c13d650 2024-08-18T21:07:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb97affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb97affd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb97affd640 1 -- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c13d650 msgr2=0x7fb97c13ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb97affd640 1 --2- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c13d650 0x7fb97c13ac50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009870 tx=0x7fb96c0a8000 comp rx=0 tx=0).stop 2024-08-18T21:07:29.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb97affd640 1 -- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c13d650 msgr2=0x7fb97c13ac50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:29.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb97affd640 1 --2- 172.21.15.5:0/1921553005 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb97c13d650 0x7fb97c13ac50 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009870 tx=0x7fb96c0a8000 comp rx=0 tx=0).stop 2024-08-18T21:07:29.988 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:29.988 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:29.988 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:29.988 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:07:29.988 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:29.988 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 169773, 2024-08-18T21:07:29.988 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:07:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.995 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.995 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.995 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:30.011 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb984395640 1 -- 172.21.15.5:0/1921553005 >> v2:172.21.15.157:6812/631023601 conn(0x7fb96803bdc0 msgr2=0x7fb96803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb984395640 1 --2- 172.21.15.5:0/1921553005 >> v2:172.21.15.157:6812/631023601 conn(0x7fb96803bdc0 0x7fb96803e280 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb97c13b3f0 tx=0x7fb9700073b0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb984395640 10 monclient: shutdown 2024-08-18T21:07:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb984395640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb984395640 1 -- 172.21.15.5:0/1921553005 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb97c139330 msgr2=0x7fb97c13a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb984395640 1 --2- 172.21.15.5:0/1921553005 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb97c139330 0x7fb97c13a1d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb97400b390 tx=0x7fb97400b850 comp rx=0 tx=0).stop 2024-08-18T21:07:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb982932640 1 -- 172.21.15.5:0/1921553005 reap_dead start 2024-08-18T21:07:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb984395640 1 -- 172.21.15.5:0/1921553005 shutdown_connections 2024-08-18T21:07:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb984395640 1 --2- 172.21.15.5:0/1921553005 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb97c139330 0x7fb97c13a1d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb984395640 1 -- 172.21.15.5:0/1921553005 >> 172.21.15.5:0/1921553005 conn(0x7fb97c0688d0 msgr2=0x7fb97c1337e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb984395640 1 -- 172.21.15.5:0/1921553005 shutdown_connections 2024-08-18T21:07:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:29.979+0000 7fb984395640 1 -- 172.21.15.5:0/1921553005 wait complete. 2024-08-18T21:07:30.014 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:30.014 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:07:30.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:07:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 10 monclient: get_monmap_and_config 2024-08-18T21:07:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 10 monclient: build_initial_monmap 2024-08-18T21:07:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 10 monclient: monmap: 2024-08-18T21:07:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:30.137762+0000 2024-08-18T21:07:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:30.137762+0000 2024-08-18T21:07:30.138 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:30.138 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:30.138 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:30.138 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:30.138 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:30.138 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:30.139 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 1 Processor -- start 2024-08-18T21:07:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 1 -- start start 2024-08-18T21:07:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 10 monclient: init 2024-08-18T21:07:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 10 monclient: _add_conns ranks=[4,8,2,10,0,1,7,9,3,6,5] 2024-08-18T21:07:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5b700a7db0 0x7f5b70138ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 10 monclient(hunting): picked mon.noname-c con 0x7f5b700a7db0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:07:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5b70068ab0 0x7f5b70139220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 10 monclient(hunting): picked mon.noname-e con 0x7f5b70068ab0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:07:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5b701397e0 0x7f5b70139c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 10 monclient(hunting): picked mon.noname-b con 0x7f5b701397e0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f5b700a93c0 con 0x7f5b701397e0 2024-08-18T21:07:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f5b700a8190 con 0x7f5b700a7db0 2024-08-18T21:07:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f5b70074570 con 0x7f5b70068ab0 2024-08-18T21:07:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b74987640 10 monclient(hunting): authenticate will time out at 1217.150727s 2024-08-18T21:07:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5b70068ab0 0x7f5b70139220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b6ffff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5b701397e0 0x7f5b70139c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5b70068ab0 0x7f5b70139220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:40690/0 (socket says 172.21.15.5:40690) 2024-08-18T21:07:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 1 -- 172.21.15.5:0/3176707716 learned_addr learned my addr 172.21.15.5:0/3176707716 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 10 monclient(hunting): get_auth_request con 0x7f5b70068ab0 auth_method 0 2024-08-18T21:07:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b6ffff640 10 monclient(hunting): get_auth_request con 0x7f5b701397e0 auth_method 0 2024-08-18T21:07:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b6ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b6ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b6ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b6f7fe640 1 --2- 172.21.15.5:0/3176707716 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5b700a7db0 0x7f5b70138ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b6ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b6ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b6ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b6f7fe640 10 monclient(hunting): get_auth_request con 0x7f5b700a7db0 auth_method 0 2024-08-18T21:07:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 10 monclient(hunting): handle_auth_done global_id 54485 payload 274 2024-08-18T21:07:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 1 -- 172.21.15.5:0/3176707716 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5b700a7db0 msgr2=0x7f5b70138ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 1 --2- 172.21.15.5:0/3176707716 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5b700a7db0 0x7f5b70138ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 1 -- 172.21.15.5:0/3176707716 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5b701397e0 msgr2=0x7f5b70139c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 1 --2- 172.21.15.5:0/3176707716 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5b701397e0 0x7f5b70139c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:07:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 1 monclient: found mon.noname-e 2024-08-18T21:07:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:07:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b66ffd640 1 -- 172.21.15.5:0/3176707716 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b70074850 con 0x7f5b70068ab0 2024-08-18T21:07:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.135+0000 7f5b6f7fe640 1 --2- 172.21.15.5:0/3176707716 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5b700a7db0 0x7f5b70138ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:07:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b66ffd640 1 -- 172.21.15.5:0/3176707716 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5b70068ab0 msgr2=0x7f5b70139220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b66ffd640 1 --2- 172.21.15.5:0/3176707716 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5b70068ab0 0x7f5b70139220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5b580098a0 tx=0x7f5b5801c440 comp rx=0 tx=0).ready entity=mon.8 client_cookie=4d5d1be1822fc9a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b6effd640 1 -- 172.21.15.5:0/3176707716 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b580b0070 con 0x7f5b70068ab0 2024-08-18T21:07:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b6effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:07:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b6effd640 10 monclient: dump: 2024-08-18T21:07:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.151 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:30.151 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:30.151 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:30.151 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:30.151 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:30.151 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:30.151 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:30.151 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:30.151 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:30.151 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:30.151 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:30.151 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:30.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b6effd640 10 monclient: _finish_auth 0 2024-08-18T21:07:30.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b6effd640 10 monclient: _check_auth_tickets 2024-08-18T21:07:30.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:30.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b74987640 5 monclient: authenticate success, global_id 54485 2024-08-18T21:07:30.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b74987640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:07:30.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b6effd640 1 -- 172.21.15.5:0/3176707716 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b580aa3a0 con 0x7f5b70068ab0 2024-08-18T21:07:30.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b6effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:30.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b6effd640 1 -- 172.21.15.5:0/3176707716 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b580aaa00 con 0x7f5b70068ab0 2024-08-18T21:07:30.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:30.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b6effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:07:30.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b6effd640 10 monclient: dump: 2024-08-18T21:07:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:30.154 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b74987640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.139+0000 7f5b74987640 4 set_mon_vals no callback set 2024-08-18T21:07:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 10 monclient: shutdown 2024-08-18T21:07:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 -- 172.21.15.5:0/3176707716 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5b70068ab0 msgr2=0x7f5b70139220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 --2- 172.21.15.5:0/3176707716 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5b70068ab0 0x7f5b70139220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5b580098a0 tx=0x7f5b5801c440 comp rx=0 tx=0).stop 2024-08-18T21:07:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 -- 172.21.15.5:0/3176707716 shutdown_connections 2024-08-18T21:07:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 --2- 172.21.15.5:0/3176707716 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5b701397e0 0x7f5b70139c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 --2- 172.21.15.5:0/3176707716 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5b70068ab0 0x7f5b70139220 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 --2- 172.21.15.5:0/3176707716 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5b700a7db0 0x7f5b70138ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 -- 172.21.15.5:0/3176707716 >> 172.21.15.5:0/3176707716 conn(0x7f5b700a6550 msgr2=0x7f5b700a1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 -- 172.21.15.5:0/3176707716 shutdown_connections 2024-08-18T21:07:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 -- 172.21.15.5:0/3176707716 wait complete. 2024-08-18T21:07:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 10 monclient: build_initial_monmap 2024-08-18T21:07:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 10 monclient: monmap: 2024-08-18T21:07:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:30.156 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 Processor -- start 2024-08-18T21:07:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 -- start start 2024-08-18T21:07:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 10 monclient: init 2024-08-18T21:07:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 10 monclient: _add_conns ranks=[1,0,4,5,3,2,8,6,7] 2024-08-18T21:07:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b70068ab0 0x7f5b7009b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 10 monclient(hunting): picked mon.noname-f con 0x7f5b70068ab0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:07:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b700a7db0 0x7f5b7013f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 10 monclient(hunting): picked mon.noname-a con 0x7f5b700a7db0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:07:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5b701397e0 0x7f5b701d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 10 monclient(hunting): picked mon.noname-c con 0x7f5b701397e0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:07:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5b70143540 con 0x7f5b700a7db0 2024-08-18T21:07:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5b70050da0 con 0x7f5b70068ab0 2024-08-18T21:07:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f5b701436c0 con 0x7f5b701397e0 2024-08-18T21:07:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b74987640 10 monclient(hunting): authenticate will time out at 1217.158729s 2024-08-18T21:07:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b700a7db0 0x7f5b7013f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b6ffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5b701397e0 0x7f5b701d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b700a7db0 0x7f5b7013f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41382/0 (socket says 172.21.15.5:41382) 2024-08-18T21:07:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 1 -- 172.21.15.5:0/1576244792 learned_addr learned my addr 172.21.15.5:0/1576244792 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 10 monclient(hunting): get_auth_request con 0x7f5b700a7db0 auth_method 0 2024-08-18T21:07:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b6ffff640 10 monclient(hunting): get_auth_request con 0x7f5b701397e0 auth_method 0 2024-08-18T21:07:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b6ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b6ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:30.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b6ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:30.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:30.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:30.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b6f7fe640 1 --2- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b70068ab0 0x7f5b7009b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:30.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:30.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b6ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:30.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b6ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:30.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b6ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:30.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b6f7fe640 10 monclient(hunting): get_auth_request con 0x7f5b70068ab0 auth_method 0 2024-08-18T21:07:30.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:30.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:30.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:30.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 10 monclient(hunting): handle_auth_done global_id 74160 payload 824 2024-08-18T21:07:30.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 1 -- 172.21.15.5:0/1576244792 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5b701397e0 msgr2=0x7f5b701d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 1 --2- 172.21.15.5:0/1576244792 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5b701397e0 0x7f5b701d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 1 -- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b70068ab0 msgr2=0x7f5b7009b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 1 --2- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b70068ab0 0x7f5b7009b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:07:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 1 monclient: found mon.noname-a 2024-08-18T21:07:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:07:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b66ffd640 1 -- 172.21.15.5:0/1576244792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b70140310 con 0x7f5b700a7db0 2024-08-18T21:07:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.143+0000 7f5b6f7fe640 1 --2- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b70068ab0 0x7f5b7009b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:07:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b66ffd640 1 -- 172.21.15.5:0/1576244792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b700a7db0 msgr2=0x7f5b7013f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b66ffd640 1 --2- 172.21.15.5:0/1576244792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b700a7db0 0x7f5b7013f930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b580ae040 tx=0x7f5b580191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6cff9640 1 -- 172.21.15.5:0/1576244792 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b580b9070 con 0x7f5b700a7db0 2024-08-18T21:07:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:07:30.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6cff9640 10 monclient: dump: 2024-08-18T21:07:30.161 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:30.161 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:30.161 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.161 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.161 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:30.161 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:30.161 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:30.161 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:30.161 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:30.161 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:30.161 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:30.161 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:30.161 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:30.162 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:30.162 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:30.162 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:30.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6cff9640 10 monclient: _finish_auth 0 2024-08-18T21:07:30.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6cff9640 10 monclient: _check_auth_tickets 2024-08-18T21:07:30.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:30.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6cff9640 1 -- 172.21.15.5:0/1576244792 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b58003b50 con 0x7f5b700a7db0 2024-08-18T21:07:30.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6cff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:30.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6cff9640 1 -- 172.21.15.5:0/1576244792 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b580b0040 con 0x7f5b700a7db0 2024-08-18T21:07:30.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:30.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:07:30.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6cff9640 10 monclient: dump: 2024-08-18T21:07:30.162 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:30.164 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:30.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6e7fc640 4 set_mon_vals no callback set 2024-08-18T21:07:30.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b74987640 5 monclient: authenticate success, global_id 74160 2024-08-18T21:07:30.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b74987640 10 monclient: _renew_subs 2024-08-18T21:07:30.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b74987640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:07:30.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b74987640 1 -- 172.21.15.5:0/1576244792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b70138d90 con 0x7f5b700a7db0 2024-08-18T21:07:30.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b74987640 10 monclient: _renew_subs 2024-08-18T21:07:30.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b74987640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:07:30.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b74987640 1 -- 172.21.15.5:0/1576244792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b7013be40 con 0x7f5b700a7db0 2024-08-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b74987640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b74987640 1 --2- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5b7013fe70 0x7f5b701d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b74987640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b74987640 1 -- 172.21.15.5:0/1576244792 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f5b70139c20 con 0x7f5b7013fe70 2024-08-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6cff9640 1 -- 172.21.15.5:0/1576244792 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f5b58003d00 con 0x7f5b700a7db0 2024-08-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6f7fe640 1 --2- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5b7013fe70 0x7f5b701d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6cff9640 1 --2- 172.21.15.5:0/1576244792 >> v2:172.21.15.157:6812/631023601 conn(0x7f5b5403bdc0 0x7f5b5403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6cff9640 1 -- 172.21.15.5:0/1576244792 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 22..107) ==== 3898+0+0 (secure 0 0 0) 0x7f5b580e75e0 con 0x7f5b700a7db0 2024-08-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6f7fe640 10 monclient: get_auth_request con 0x7f5b7013fe70 auth_method 0 2024-08-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6ffff640 1 --2- 172.21.15.5:0/1576244792 >> v2:172.21.15.157:6812/631023601 conn(0x7f5b5403bdc0 0x7f5b5403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.147+0000 7f5b6ffff640 10 monclient: get_auth_request con 0x7f5b5403bdc0 auth_method 0 2024-08-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.151+0000 7f5b6f7fe640 10 monclient(hunting): handle_auth_done global_id 5209 payload 824 2024-08-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.151+0000 7f5b6f7fe640 1 -- 172.21.15.5:0/1576244792 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b70064590 con 0x7f5b7013fe70 2024-08-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.151+0000 7f5b6ffff640 1 --2- 172.21.15.5:0/1576244792 >> v2:172.21.15.157:6812/631023601 conn(0x7f5b5403bdc0 0x7f5b5403e280 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5b700a2740 tx=0x7f5b6800b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.151+0000 7f5b6f7fe640 1 -- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5b7013fe70 msgr2=0x7f5b701d1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.151+0000 7f5b6f7fe640 1 --2- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5b7013fe70 0x7f5b701d1c00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5b60010790 tx=0x7f5b60010c50 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.151+0000 7f5b6cff9640 1 -- 172.21.15.5:0/1576244792 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b6001a020 con 0x7f5b7013fe70 2024-08-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.151+0000 7f5b6cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.151+0000 7f5b6cff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.151+0000 7f5b6cff9640 10 monclient: dump: 2024-08-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.155+0000 7f5b6cff9640 1 -- 172.21.15.5:0/1576244792 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5b6000ebe0 con 0x7f5b7013fe70 2024-08-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.155+0000 7f5b6cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.155+0000 7f5b6cff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.155+0000 7f5b6cff9640 1 -- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5b7013fe70 msgr2=0x7f5b701d1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.155+0000 7f5b6cff9640 1 --2- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5b7013fe70 0x7f5b701d1c00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5b60010790 tx=0x7f5b60010c50 comp rx=0 tx=0).stop 2024-08-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.155+0000 7f5b6cff9640 1 -- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5b7013fe70 msgr2=0x7f5b701d1c00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.155+0000 7f5b6cff9640 1 --2- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5b7013fe70 0x7f5b701d1c00 secure :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5b60010790 tx=0x7f5b60010c50 comp rx=0 tx=0).stop 2024-08-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.159+0000 7f5b74987640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.159+0000 7f5b74987640 1 --2- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5b701d2140 0x7f5b70098260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.159+0000 7f5b74987640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.159+0000 7f5b74987640 1 -- 172.21.15.5:0/1576244792 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f5b701d2550 con 0x7f5b701d2140 2024-08-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.159+0000 7f5b6f7fe640 1 --2- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5b701d2140 0x7f5b70098260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.159+0000 7f5b6f7fe640 10 monclient: get_auth_request con 0x7f5b701d2140 auth_method 0 2024-08-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.159+0000 7f5b6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.159+0000 7f5b6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.159+0000 7f5b6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.159+0000 7f5b6f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.159+0000 7f5b6f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.159+0000 7f5b6f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.159+0000 7f5b6f7fe640 10 monclient(hunting): handle_auth_done global_id 5218 payload 824 2024-08-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.159+0000 7f5b6f7fe640 1 -- 172.21.15.5:0/1576244792 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5b7013cc00 con 0x7f5b701d2140 2024-08-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b6f7fe640 1 -- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5b701d2140 msgr2=0x7f5b70098260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b6f7fe640 1 --2- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5b701d2140 0x7f5b70098260 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5b60010790 tx=0x7f5b600046d0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b6cff9640 1 -- 172.21.15.5:0/1576244792 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b6001a040 con 0x7f5b701d2140 2024-08-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b6cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b6cff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b6cff9640 10 monclient: dump: 2024-08-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b6cff9640 1 -- 172.21.15.5:0/1576244792 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f5b60015c80 con 0x7f5b701d2140 2024-08-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b6cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b6cff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b6cff9640 1 -- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5b701d2140 msgr2=0x7f5b70098260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b6cff9640 1 --2- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5b701d2140 0x7f5b70098260 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5b60010790 tx=0x7f5b600046d0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b6cff9640 1 -- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5b701d2140 msgr2=0x7f5b70098260 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b6cff9640 1 --2- 172.21.15.5:0/1576244792 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5b701d2140 0x7f5b70098260 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5b60010790 tx=0x7f5b600046d0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 259261, 2024-08-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b74987640 1 -- 172.21.15.5:0/1576244792 >> v2:172.21.15.157:6812/631023601 conn(0x7f5b5403bdc0 msgr2=0x7f5b5403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b74987640 1 --2- 172.21.15.5:0/1576244792 >> v2:172.21.15.157:6812/631023601 conn(0x7f5b5403bdc0 0x7f5b5403e280 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5b700a2740 tx=0x7f5b6800b040 comp rx=0 tx=0).stop 2024-08-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b74987640 10 monclient: shutdown 2024-08-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b74987640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b74987640 1 -- 172.21.15.5:0/1576244792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b700a7db0 msgr2=0x7f5b7013f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b74987640 1 --2- 172.21.15.5:0/1576244792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b700a7db0 0x7f5b7013f930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b580ae040 tx=0x7f5b580191e0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b6ffff640 1 -- 172.21.15.5:0/1576244792 reap_dead start 2024-08-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b6ffff640 1 -- 172.21.15.5:0/1576244792 reap_dead start 2024-08-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b74987640 1 -- 172.21.15.5:0/1576244792 shutdown_connections 2024-08-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b74987640 1 -- 172.21.15.5:0/1576244792 >> 172.21.15.5:0/1576244792 conn(0x7f5b700a6550 msgr2=0x7f5b7009fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b74987640 1 -- 172.21.15.5:0/1576244792 shutdown_connections 2024-08-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.163+0000 7f5b74987640 1 -- 172.21.15.5:0/1576244792 wait complete. 2024-08-18T21:07:30.201 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:30.202 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-18T21:07:30.202 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29236]: starting. 2024-08-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29236]: listing objects. 2024-08-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29236]: listed object 0... 2024-08-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29236]: listed object 25... 2024-08-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29236]: saw 50 objects 2024-08-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29236]: shutting down. 2024-08-18T21:07:30.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.319+0000 7f94282ac640 10 monclient: get_monmap_and_config 2024-08-18T21:07:30.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.319+0000 7f94282ac640 10 monclient: build_initial_monmap 2024-08-18T21:07:30.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.319+0000 7f94282ac640 10 monclient: monmap: 2024-08-18T21:07:30.323 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:30.323 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:30.323 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:30.323989+0000 2024-08-18T21:07:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:30.323989+0000 2024-08-18T21:07:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:30.325 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:30.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 1 Processor -- start 2024-08-18T21:07:30.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 1 -- start start 2024-08-18T21:07:30.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 10 monclient: init 2024-08-18T21:07:30.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:30.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 10 monclient: _add_conns ranks=[0,5,6,9,4,3,7,8,2,10,1] 2024-08-18T21:07:30.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f94200a5a50 addr v1:172.21.15.5:6789/0 2024-08-18T21:07:30.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9420137f10 0x7f942013cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:30.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 10 monclient(hunting): picked mon.noname-h con 0x7f9420137f10 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:07:30.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f94201382f0 0x7f942013f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 10 monclient(hunting): picked mon.noname-d con 0x7f94201382f0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94200a67a0 con 0x7f94200a5a50 2024-08-18T21:07:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f94200a5e30 con 0x7f9420137f10 2024-08-18T21:07:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f94200a3740 con 0x7f94201382f0 2024-08-18T21:07:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f94282ac640 10 monclient(hunting): authenticate will time out at 1217.337128s 2024-08-18T21:07:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f94201382f0 0x7f942013f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f94201382f0 0x7f942013f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:60828/0 (socket says 172.21.15.5:60828) 2024-08-18T21:07:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 1 -- 172.21.15.5:0/3966577402 learned_addr learned my addr 172.21.15.5:0/3966577402 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 10 monclient(hunting): get_auth_request con 0x7f94201382f0 auth_method 0 2024-08-18T21:07:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426048640 1 --1- 172.21.15.5:0/3966577402 >> v1:172.21.15.5:6789/0 conn(0x7f94200a5a50 0x7f9420137800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49442/0 (socket says 172.21.15.5:49442) 2024-08-18T21:07:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:30.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:30.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:30.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:30.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:30.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:30.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9425847640 1 --2- 172.21.15.5:0/3966577402 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9420137f10 0x7f942013cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:30.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 10 monclient(hunting): handle_auth_done global_id 54492 payload 274 2024-08-18T21:07:30.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 1 -- 172.21.15.5:0/3966577402 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9420137f10 msgr2=0x7f942013cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:30.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 1 --2- 172.21.15.5:0/3966577402 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9420137f10 0x7f942013cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 1 -- 172.21.15.5:0/3966577402 >> v1:172.21.15.5:6789/0 conn(0x7f94200a5a50 legacy=0x7f9420137800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:30.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 10 monclient: _finish_hunting 0 2024-08-18T21:07:30.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 1 monclient: found mon.noname-d 2024-08-18T21:07:30.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:30.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:07:30.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9426849640 1 -- 172.21.15.5:0/3966577402 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94200a2660 con 0x7f94201382f0 2024-08-18T21:07:30.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9425847640 10 monclient: get_auth_request con 0x7f9420137f10 auth_method 0 2024-08-18T21:07:30.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.323+0000 7f9425847640 1 --2- 172.21.15.5:0/3966577402 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9420137f10 0x7f942013cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:07:30.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f9426849640 1 -- 172.21.15.5:0/3966577402 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f94201382f0 msgr2=0x7f942013f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:30.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f9426849640 1 --2- 172.21.15.5:0/3966577402 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f94201382f0 0x7f942013f1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f94180098d0 tx=0x7f941801c440 comp rx=0 tx=0).ready entity=mon.6 client_cookie=f372b6b712ac41c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f9425046640 1 -- 172.21.15.5:0/3966577402 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f94180b0070 con 0x7f94201382f0 2024-08-18T21:07:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f9425046640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f9425046640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:07:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f9425046640 10 monclient: dump: 2024-08-18T21:07:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:30.335 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f9425046640 10 monclient: _finish_auth 0 2024-08-18T21:07:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f9425046640 10 monclient: _check_auth_tickets 2024-08-18T21:07:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f9425046640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f9425046640 1 -- 172.21.15.5:0/3966577402 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94180aa810 con 0x7f94201382f0 2024-08-18T21:07:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f9425046640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f9425046640 1 -- 172.21.15.5:0/3966577402 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f94180aae30 con 0x7f94201382f0 2024-08-18T21:07:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 5 monclient: authenticate success, global_id 54492 2024-08-18T21:07:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 4 set_mon_vals no callback set 2024-08-18T21:07:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f9425046640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f9425046640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:07:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f9425046640 10 monclient: dump: 2024-08-18T21:07:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:30.337 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:30.337 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:30.337 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:30.337 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:30.337 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:30.337 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:30.337 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:30.337 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:30.337 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:30.337 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:30.337 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:30.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 10 monclient: shutdown 2024-08-18T21:07:30.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:30.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 1 -- 172.21.15.5:0/3966577402 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f94201382f0 msgr2=0x7f942013f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:30.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 1 --2- 172.21.15.5:0/3966577402 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f94201382f0 0x7f942013f1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f94180098d0 tx=0x7f941801c440 comp rx=0 tx=0).stop 2024-08-18T21:07:30.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 1 -- 172.21.15.5:0/3966577402 shutdown_connections 2024-08-18T21:07:30.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 1 --2- 172.21.15.5:0/3966577402 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f94201382f0 0x7f942013f1a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 1 --2- 172.21.15.5:0/3966577402 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9420137f10 0x7f942013cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 1 -- 172.21.15.5:0/3966577402 >> 172.21.15.5:0/3966577402 conn(0x7f94200688d0 msgr2=0x7f9420068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:30.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 1 -- 172.21.15.5:0/3966577402 shutdown_connections 2024-08-18T21:07:30.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 1 -- 172.21.15.5:0/3966577402 wait complete. 2024-08-18T21:07:30.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 10 monclient: build_initial_monmap 2024-08-18T21:07:30.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 10 monclient: monmap: 2024-08-18T21:07:30.338 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:30.339 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:30.339 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:30.339 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:30.339 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:30.339 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:30.339 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:30.339 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:30.339 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:30.339 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:30.339 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:30.339 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:30.339 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:30.339 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:30.340 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:30.340 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:30.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 1 Processor -- start 2024-08-18T21:07:30.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 1 -- start start 2024-08-18T21:07:30.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.327+0000 7f94282ac640 10 monclient: init 2024-08-18T21:07:30.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f94282ac640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:30.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f94282ac640 10 monclient: _add_conns ranks=[4,5,1,6,2,3,0,8,7] 2024-08-18T21:07:30.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f94282ac640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f94200a5a50 0x7f94201d11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:30.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f94282ac640 10 monclient(hunting): picked mon.noname-c con 0x7f94200a5a50 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:07:30.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f94282ac640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9420137f10 0x7f9420135800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:30.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f94282ac640 10 monclient(hunting): picked mon.noname-h con 0x7f9420137f10 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:07:30.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f94282ac640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94201382f0 0x7f9420135d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:30.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f94282ac640 10 monclient(hunting): picked mon.noname-f con 0x7f94201382f0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:07:30.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f94282ac640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:30.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f94282ac640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9420142080 con 0x7f94201382f0 2024-08-18T21:07:30.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f94282ac640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:30.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f94282ac640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f9420141f00 con 0x7f94200a5a50 2024-08-18T21:07:30.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f94282ac640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:30.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f94282ac640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f9420142200 con 0x7f9420137f10 2024-08-18T21:07:30.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f94282ac640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:30.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f94282ac640 10 monclient(hunting): authenticate will time out at 1217.344469s 2024-08-18T21:07:30.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f94200a5a50 0x7f94201d11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:30.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f94200a5a50 0x7f94201d11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:45270/0 (socket says 172.21.15.5:45270) 2024-08-18T21:07:30.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 1 -- 172.21.15.5:0/3924153893 learned_addr learned my addr 172.21.15.5:0/3924153893 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:30.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 10 monclient(hunting): get_auth_request con 0x7f94200a5a50 auth_method 0 2024-08-18T21:07:30.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:30.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:30.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:30.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:30.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:30.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:30.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9425847640 1 --2- 172.21.15.5:0/3924153893 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9420137f10 0x7f9420135800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:30.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426849640 1 --2- 172.21.15.5:0/3924153893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94201382f0 0x7f9420135d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:30.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9425847640 10 monclient(hunting): get_auth_request con 0x7f9420137f10 auth_method 0 2024-08-18T21:07:30.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9425847640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:30.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9425847640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:30.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9425847640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:30.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 10 monclient(hunting): handle_auth_done global_id 5449 payload 824 2024-08-18T21:07:30.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 1 -- 172.21.15.5:0/3924153893 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9420137f10 msgr2=0x7f9420135800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:30.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 1 --2- 172.21.15.5:0/3924153893 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9420137f10 0x7f9420135800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 1 -- 172.21.15.5:0/3924153893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94201382f0 msgr2=0x7f9420135d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:30.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 1 --2- 172.21.15.5:0/3924153893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94201382f0 0x7f9420135d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 10 monclient: _finish_hunting 0 2024-08-18T21:07:30.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 1 monclient: found mon.noname-c 2024-08-18T21:07:30.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:30.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:07:30.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 1 -- 172.21.15.5:0/3924153893 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94201221d0 con 0x7f94200a5a50 2024-08-18T21:07:30.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426849640 10 monclient: get_auth_request con 0x7f94201382f0 auth_method 0 2024-08-18T21:07:30.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426849640 1 --2- 172.21.15.5:0/3924153893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94201382f0 0x7f9420135d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:07:30.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 1 -- 172.21.15.5:0/3924153893 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f94200a5a50 msgr2=0x7f94201d11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:30.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9426048640 1 --2- 172.21.15.5:0/3924153893 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f94200a5a50 0x7f94201d11a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f941c00ba80 tx=0x7f941c00bf40 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:30.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9416ffd640 1 -- 172.21.15.5:0/3924153893 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f941c019070 con 0x7f94200a5a50 2024-08-18T21:07:30.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9416ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:30.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9416ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:07:30.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9416ffd640 10 monclient: dump: 2024-08-18T21:07:30.347 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:30.347 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:30.347 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:30.349 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9416ffd640 10 monclient: _finish_auth 0 2024-08-18T21:07:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9416ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:07:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9416ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9416ffd640 1 -- 172.21.15.5:0/3924153893 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f941c00cc10 con 0x7f94200a5a50 2024-08-18T21:07:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9416ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9416ffd640 1 -- 172.21.15.5:0/3924153893 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f941c00cdc0 con 0x7f94200a5a50 2024-08-18T21:07:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9416ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9416ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:07:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9416ffd640 10 monclient: dump: 2024-08-18T21:07:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.350 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:30.350 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:30.350 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:30.350 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:30.350 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:30.350 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:30.350 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:30.350 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:30.350 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:30.350 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:30.350 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:30.350 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:30.350 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.331+0000 7f9424845640 4 set_mon_vals no callback set 2024-08-18T21:07:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.335+0000 7f94282ac640 5 monclient: authenticate success, global_id 5449 2024-08-18T21:07:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.335+0000 7f94282ac640 10 monclient: _renew_subs 2024-08-18T21:07:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.335+0000 7f94282ac640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:07:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.335+0000 7f94282ac640 1 -- 172.21.15.5:0/3924153893 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f942013f1e0 con 0x7f94200a5a50 2024-08-18T21:07:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.335+0000 7f94282ac640 10 monclient: _renew_subs 2024-08-18T21:07:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.335+0000 7f94282ac640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:07:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.335+0000 7f94282ac640 1 -- 172.21.15.5:0/3924153893 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f94200a5420 con 0x7f94200a5a50 2024-08-18T21:07:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.335+0000 7f94282ac640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.335+0000 7f94282ac640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.335+0000 7f94282ac640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:07:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.335+0000 7f94282ac640 1 -- 172.21.15.5:0/3924153893 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9420137800 con 0x7f94200a5a50 2024-08-18T21:07:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.335+0000 7f9416ffd640 1 -- 172.21.15.5:0/3924153893 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f941c01c360 con 0x7f94200a5a50 2024-08-18T21:07:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.335+0000 7f9416ffd640 1 --2- 172.21.15.5:0/3924153893 >> v2:172.21.15.157:6812/631023601 conn(0x7f940403bdf0 0x7f940403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.335+0000 7f9416ffd640 1 -- 172.21.15.5:0/3924153893 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(107..107 src has 22..107) ==== 3898+0+0 (secure 0 0 0) 0x7f941c04e3c0 con 0x7f94200a5a50 2024-08-18T21:07:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.335+0000 7f9425847640 1 --2- 172.21.15.5:0/3924153893 >> v2:172.21.15.157:6812/631023601 conn(0x7f940403bdf0 0x7f940403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.335+0000 7f9425847640 10 monclient: get_auth_request con 0x7f940403bdf0 auth_method 0 2024-08-18T21:07:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.339+0000 7f9425847640 1 --2- 172.21.15.5:0/3924153893 >> v2:172.21.15.157:6812/631023601 conn(0x7f940403bdf0 0x7f940403e2b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f94200738e0 tx=0x7f9410008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.339+0000 7f9416ffd640 1 -- 172.21.15.5:0/3924153893 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f941c01cad0 con 0x7f94200a5a50 2024-08-18T21:07:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.339+0000 7f9416ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.339+0000 7f9416ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:30.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.575+0000 7f94282ac640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-18T21:07:30.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.575+0000 7f94282ac640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-18T21:07:30.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.575+0000 7f94282ac640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:07:30.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.575+0000 7f94282ac640 1 -- 172.21.15.5:0/3924153893 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f942006cfa0 con 0x7f94200a5a50 2024-08-18T21:07:30.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.579+0000 7f9416ffd640 1 -- 172.21.15.5:0/3924153893 <== mon.4 v2:172.21.15.5:3302/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f941c04e190 con 0x7f94200a5a50 2024-08-18T21:07:30.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.579+0000 7f9416ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-18T21:07:30.582 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.579+0000 7f9416ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:30.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=10,logm=62} crc {auth=833565678,config=1618278320,health=120195358,kv=3664197221,logm=2016462479}) 2024-08-18T21:07:30.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=14,config=2,health=11,kv=10,logm=63} crc {auth=833565679,config=1618278320,health=3670799956,kv=3664197221,logm=833764158}) 2024-08-18T21:07:30.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=10,logm=62} crc {auth=833565678,config=1618278320,health=120195358,kv=3664197221,logm=2016462479}) 2024-08-18T21:07:30.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=13,config=2,health=12,kv=9,logm=64} crc {auth=152622994,config=3625383534,health=120195358,kv=1842565136,logm=3440694798}) 2024-08-18T21:07:30.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=10,logm=62} crc {auth=833565678,config=1618278320,health=120195358,kv=3664197221,logm=2016462479}) 2024-08-18T21:07:30.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=14,config=2,health=11,kv=9,logm=64} crc {auth=833565678,config=1618278320,health=1115704518,kv=1763992103,logm=1254979943}) 2024-08-18T21:07:30.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=10,logm=62} crc {auth=833565678,config=1618278320,health=120195358,kv=3664197221,logm=2016462479}) 2024-08-18T21:07:30.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=13,config=2,health=12,kv=10,logm=63} crc {auth=4124690691,config=1618278320,health=120195358,kv=3664197221,logm=3116556085}) 2024-08-18T21:07:30.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=10,logm=62} crc {auth=833565678,config=1618278320,health=120195358,kv=3664197221,logm=2016462479}) 2024-08-18T21:07:30.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=14,config=2,health=12,kv=10,logm=62} crc {auth=833565678,config=1618278320,health=2627179269,kv=3664197221,logm=3264623552}) 2024-08-18T21:07:30.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=10,logm=62} crc {auth=833565678,config=1618278320,health=120195358,kv=3664197221,logm=2016462479}) 2024-08-18T21:07:30.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=13,config=2,health=12,kv=9,logm=64} crc {auth=3591502005,config=1618278320,health=1345574074,kv=1842565136,logm=819280289}) 2024-08-18T21:07:30.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=10,logm=62} crc {auth=833565678,config=1618278320,health=120195358,kv=3664197221,logm=2016462479}) 2024-08-18T21:07:30.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=13,config=2,health=12,kv=10,logm=63} crc {auth=913185757,config=1618278320,health=120195358,kv=3664197221,logm=1267593158}) 2024-08-18T21:07:30.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=10,logm=62} crc {auth=833565678,config=1618278320,health=120195358,kv=3664197221,logm=2016462479}) 2024-08-18T21:07:30.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.579+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=12,config=2,health=12,kv=9,logm=65} crc {auth=2869125679,config=1618278320,health=120195358,kv=147916585,logm=146966754}) 2024-08-18T21:07:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.583+0000 7f94282ac640 1 -- 172.21.15.5:0/3924153893 >> v2:172.21.15.157:6812/631023601 conn(0x7f940403bdf0 msgr2=0x7f940403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.583+0000 7f94282ac640 1 --2- 172.21.15.5:0/3924153893 >> v2:172.21.15.157:6812/631023601 conn(0x7f940403bdf0 0x7f940403e2b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f94200738e0 tx=0x7f9410008040 comp rx=0 tx=0).stop 2024-08-18T21:07:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.583+0000 7f94282ac640 10 monclient: shutdown 2024-08-18T21:07:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.583+0000 7f94282ac640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.583+0000 7f94282ac640 1 -- 172.21.15.5:0/3924153893 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f94200a5a50 msgr2=0x7f94201d11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.583+0000 7f94282ac640 1 --2- 172.21.15.5:0/3924153893 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f94200a5a50 0x7f94201d11a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f941c00ba80 tx=0x7f941c00bf40 comp rx=0 tx=0).stop 2024-08-18T21:07:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.583+0000 7f94282ac640 1 -- 172.21.15.5:0/3924153893 shutdown_connections 2024-08-18T21:07:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.583+0000 7f94282ac640 1 --2- 172.21.15.5:0/3924153893 >> v2:172.21.15.157:6812/631023601 conn(0x7f940403bdf0 0x7f940403e2b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.583+0000 7f94282ac640 1 --2- 172.21.15.5:0/3924153893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94201382f0 0x7f9420135d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.583+0000 7f94282ac640 1 --2- 172.21.15.5:0/3924153893 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9420137f10 0x7f9420135800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.583+0000 7f94282ac640 1 --2- 172.21.15.5:0/3924153893 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f94200a5a50 0x7f94201d11a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.583+0000 7f94282ac640 1 -- 172.21.15.5:0/3924153893 >> 172.21.15.5:0/3924153893 conn(0x7f94200688d0 msgr2=0x7f94200a8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.583+0000 7f94282ac640 1 -- 172.21.15.5:0/3924153893 shutdown_connections 2024-08-18T21:07:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:30.583+0000 7f94282ac640 1 -- 172.21.15.5:0/3924153893 wait complete. 2024-08-18T21:07:30.593 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.593 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1589308951}) 2024-08-18T21:07:30.593 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=478820970}) 2024-08-18T21:07:30.593 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.593 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1589308951}) 2024-08-18T21:07:30.593 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=921285478}) 2024-08-18T21:07:30.593 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.593 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1589308951}) 2024-08-18T21:07:30.594 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2073464701}) 2024-08-18T21:07:30.594 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.594 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1589308951}) 2024-08-18T21:07:30.594 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3614367873}) 2024-08-18T21:07:30.594 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.594 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1589308951}) 2024-08-18T21:07:30.594 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3024895202}) 2024-08-18T21:07:30.594 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.594 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1589308951}) 2024-08-18T21:07:30.594 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1855987418}) 2024-08-18T21:07:30.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1589308951}) 2024-08-18T21:07:30.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1005016553}) 2024-08-18T21:07:30.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1589308951}) 2024-08-18T21:07:30.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.583+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1211217817}) 2024-08-18T21:07:30.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3188931215}) 2024-08-18T21:07:30.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1706402847}) 2024-08-18T21:07:30.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3188931215}) 2024-08-18T21:07:30.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=567114758}) 2024-08-18T21:07:30.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3188931215}) 2024-08-18T21:07:30.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1067343379}) 2024-08-18T21:07:30.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3188931215}) 2024-08-18T21:07:30.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2116175476}) 2024-08-18T21:07:30.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3188931215}) 2024-08-18T21:07:30.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3156772821}) 2024-08-18T21:07:30.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3188931215}) 2024-08-18T21:07:30.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1113744479}) 2024-08-18T21:07:30.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3188931215}) 2024-08-18T21:07:30.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2249918690}) 2024-08-18T21:07:30.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3188931215}) 2024-08-18T21:07:30.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.587+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1602989712}) 2024-08-18T21:07:30.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4282101186}) 2024-08-18T21:07:30.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1704250404}) 2024-08-18T21:07:30.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4282101186}) 2024-08-18T21:07:30.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=559762984}) 2024-08-18T21:07:30.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4282101186}) 2024-08-18T21:07:30.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1874520070}) 2024-08-18T21:07:30.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4282101186}) 2024-08-18T21:07:30.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=198424728}) 2024-08-18T21:07:30.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4282101186}) 2024-08-18T21:07:30.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1252857262}) 2024-08-18T21:07:30.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4282101186}) 2024-08-18T21:07:30.603 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=53158880}) 2024-08-18T21:07:30.603 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.603 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4282101186}) 2024-08-18T21:07:30.603 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=596926879}) 2024-08-18T21:07:30.603 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.603 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4282101186}) 2024-08-18T21:07:30.603 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.591+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=142941330}) 2024-08-18T21:07:30.603 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.603 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=66213959}) 2024-08-18T21:07:30.603 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3433069335}) 2024-08-18T21:07:30.603 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.603 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=66213959}) 2024-08-18T21:07:30.603 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2129275069}) 2024-08-18T21:07:30.604 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.604 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=66213959}) 2024-08-18T21:07:30.604 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4034945164}) 2024-08-18T21:07:30.604 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.604 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=66213959}) 2024-08-18T21:07:30.604 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3582779616}) 2024-08-18T21:07:30.604 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.604 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=66213959}) 2024-08-18T21:07:30.604 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=343250761}) 2024-08-18T21:07:30.604 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.604 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=66213959}) 2024-08-18T21:07:30.604 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2306389732}) 2024-08-18T21:07:30.605 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.605 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=66213959}) 2024-08-18T21:07:30.605 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=485021546}) 2024-08-18T21:07:30.605 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.605 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=66213959}) 2024-08-18T21:07:30.605 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.595+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1266199793}) 2024-08-18T21:07:30.608 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.608 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2388424947}) 2024-08-18T21:07:30.608 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2726724727}) 2024-08-18T21:07:30.608 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.608 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2388424947}) 2024-08-18T21:07:30.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=867079677}) 2024-08-18T21:07:30.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2388424947}) 2024-08-18T21:07:30.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3698476315}) 2024-08-18T21:07:30.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2388424947}) 2024-08-18T21:07:30.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3276357195}) 2024-08-18T21:07:30.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2388424947}) 2024-08-18T21:07:30.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3660514838}) 2024-08-18T21:07:30.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2388424947}) 2024-08-18T21:07:30.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2549193674}) 2024-08-18T21:07:30.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2388424947}) 2024-08-18T21:07:30.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2073696}) 2024-08-18T21:07:30.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.612 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2388424947}) 2024-08-18T21:07:30.612 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.599+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4200285619}) 2024-08-18T21:07:30.613 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-18T21:07:30.624 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.624 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881904475}) 2024-08-18T21:07:30.624 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=919644182}) 2024-08-18T21:07:30.624 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.624 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881904475}) 2024-08-18T21:07:30.624 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1974539109}) 2024-08-18T21:07:30.625 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.625 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881904475}) 2024-08-18T21:07:30.625 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3821786990}) 2024-08-18T21:07:30.625 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.625 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881904475}) 2024-08-18T21:07:30.625 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=842118588}) 2024-08-18T21:07:30.625 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.625 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881904475}) 2024-08-18T21:07:30.625 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=472480990}) 2024-08-18T21:07:30.625 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.625 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881904475}) 2024-08-18T21:07:30.625 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2157291559}) 2024-08-18T21:07:30.625 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.625 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881904475}) 2024-08-18T21:07:30.626 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1184548781}) 2024-08-18T21:07:30.626 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.626 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881904475}) 2024-08-18T21:07:30.626 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.603+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2545137160}) 2024-08-18T21:07:30.626 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.626 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=576813203}) 2024-08-18T21:07:30.626 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3202061002}) 2024-08-18T21:07:30.626 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.626 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=576813203}) 2024-08-18T21:07:30.626 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2042818885}) 2024-08-18T21:07:30.626 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.626 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=576813203}) 2024-08-18T21:07:30.626 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1362432737}) 2024-08-18T21:07:30.627 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.627 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=576813203}) 2024-08-18T21:07:30.627 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3257651836}) 2024-08-18T21:07:30.627 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.627 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=576813203}) 2024-08-18T21:07:30.627 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3992798912}) 2024-08-18T21:07:30.627 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.627 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=576813203}) 2024-08-18T21:07:30.627 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=656152113}) 2024-08-18T21:07:30.627 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.627 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=576813203}) 2024-08-18T21:07:30.627 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1773756641}) 2024-08-18T21:07:30.627 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.627 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=576813203}) 2024-08-18T21:07:30.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.607+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4208432288}) 2024-08-18T21:07:30.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4002382716}) 2024-08-18T21:07:30.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3687753548}) 2024-08-18T21:07:30.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4002382716}) 2024-08-18T21:07:30.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=918170906}) 2024-08-18T21:07:30.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4002382716}) 2024-08-18T21:07:30.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3458625626}) 2024-08-18T21:07:30.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4002382716}) 2024-08-18T21:07:30.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=191614855}) 2024-08-18T21:07:30.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4002382716}) 2024-08-18T21:07:30.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2376599160}) 2024-08-18T21:07:30.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4002382716}) 2024-08-18T21:07:30.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4192900602}) 2024-08-18T21:07:30.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4002382716}) 2024-08-18T21:07:30.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4000583947}) 2024-08-18T21:07:30.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4002382716}) 2024-08-18T21:07:30.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.611+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2102595366}) 2024-08-18T21:07:30.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2890318065}) 2024-08-18T21:07:30.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2274335133}) 2024-08-18T21:07:30.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2890318065}) 2024-08-18T21:07:30.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3839205757}) 2024-08-18T21:07:30.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2890318065}) 2024-08-18T21:07:30.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2318869764}) 2024-08-18T21:07:30.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2890318065}) 2024-08-18T21:07:30.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=817330023}) 2024-08-18T21:07:30.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2890318065}) 2024-08-18T21:07:30.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3623130251}) 2024-08-18T21:07:30.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2890318065}) 2024-08-18T21:07:30.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=886689920}) 2024-08-18T21:07:30.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2890318065}) 2024-08-18T21:07:30.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=445115521}) 2024-08-18T21:07:30.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2890318065}) 2024-08-18T21:07:30.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.615+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3436659350}) 2024-08-18T21:07:30.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=273190003}) 2024-08-18T21:07:30.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2214699026}) 2024-08-18T21:07:30.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=273190003}) 2024-08-18T21:07:30.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2741559330}) 2024-08-18T21:07:30.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=273190003}) 2024-08-18T21:07:30.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2180703800}) 2024-08-18T21:07:30.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=273190003}) 2024-08-18T21:07:30.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2257659060}) 2024-08-18T21:07:30.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=273190003}) 2024-08-18T21:07:30.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=465918591}) 2024-08-18T21:07:30.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=273190003}) 2024-08-18T21:07:30.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=892786448}) 2024-08-18T21:07:30.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=273190003}) 2024-08-18T21:07:30.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1652102150}) 2024-08-18T21:07:30.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=273190003}) 2024-08-18T21:07:30.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.619+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4171541672}) 2024-08-18T21:07:30.642 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.642 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2099309071}) 2024-08-18T21:07:30.642 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=919474189}) 2024-08-18T21:07:30.642 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.642 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2099309071}) 2024-08-18T21:07:30.642 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2283308315}) 2024-08-18T21:07:30.642 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.643 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2099309071}) 2024-08-18T21:07:30.643 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2553961848}) 2024-08-18T21:07:30.643 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.643 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2099309071}) 2024-08-18T21:07:30.643 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1556085257}) 2024-08-18T21:07:30.643 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.643 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2099309071}) 2024-08-18T21:07:30.643 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1798248512}) 2024-08-18T21:07:30.643 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.643 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2099309071}) 2024-08-18T21:07:30.643 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4232312752}) 2024-08-18T21:07:30.643 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.643 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2099309071}) 2024-08-18T21:07:30.644 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3718576199}) 2024-08-18T21:07:30.644 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.644 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2099309071}) 2024-08-18T21:07:30.644 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.623+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2297930575}) 2024-08-18T21:07:30.644 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.644 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2304492522}) 2024-08-18T21:07:30.644 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2734082753}) 2024-08-18T21:07:30.644 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.644 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2304492522}) 2024-08-18T21:07:30.644 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1020738639}) 2024-08-18T21:07:30.644 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.644 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2304492522}) 2024-08-18T21:07:30.644 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=6485008}) 2024-08-18T21:07:30.644 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.645 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2304492522}) 2024-08-18T21:07:30.645 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=449051057}) 2024-08-18T21:07:30.645 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.645 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2304492522}) 2024-08-18T21:07:30.645 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1555034866}) 2024-08-18T21:07:30.645 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.645 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2304492522}) 2024-08-18T21:07:30.645 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2245249212}) 2024-08-18T21:07:30.645 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.645 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2304492522}) 2024-08-18T21:07:30.645 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3816594419}) 2024-08-18T21:07:30.645 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.645 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2304492522}) 2024-08-18T21:07:30.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.627+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2225691525}) 2024-08-18T21:07:30.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1962732724}) 2024-08-18T21:07:30.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=951226713}) 2024-08-18T21:07:30.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1962732724}) 2024-08-18T21:07:30.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4229230083}) 2024-08-18T21:07:30.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1962732724}) 2024-08-18T21:07:30.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4071204525}) 2024-08-18T21:07:30.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1962732724}) 2024-08-18T21:07:30.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3940430151}) 2024-08-18T21:07:30.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1962732724}) 2024-08-18T21:07:30.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1884193294}) 2024-08-18T21:07:30.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1962732724}) 2024-08-18T21:07:30.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3756757221}) 2024-08-18T21:07:30.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1962732724}) 2024-08-18T21:07:30.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2008824729}) 2024-08-18T21:07:30.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1962732724}) 2024-08-18T21:07:30.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.631+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=966339378}) 2024-08-18T21:07:30.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546608865}) 2024-08-18T21:07:30.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2985490519}) 2024-08-18T21:07:30.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546608865}) 2024-08-18T21:07:30.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3755496696}) 2024-08-18T21:07:30.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546608865}) 2024-08-18T21:07:30.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4252033258}) 2024-08-18T21:07:30.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546608865}) 2024-08-18T21:07:30.649 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=323417082}) 2024-08-18T21:07:30.649 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.649 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546608865}) 2024-08-18T21:07:30.649 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=77679378}) 2024-08-18T21:07:30.649 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.649 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546608865}) 2024-08-18T21:07:30.649 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=189156506}) 2024-08-18T21:07:30.649 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.649 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546608865}) 2024-08-18T21:07:30.649 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1232655801}) 2024-08-18T21:07:30.649 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.649 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546608865}) 2024-08-18T21:07:30.649 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.635+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3589778874}) 2024-08-18T21:07:30.653 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.653 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=853474998}) 2024-08-18T21:07:30.653 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2682735925}) 2024-08-18T21:07:30.653 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.653 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=853474998}) 2024-08-18T21:07:30.653 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1413475398}) 2024-08-18T21:07:30.653 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.653 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=853474998}) 2024-08-18T21:07:30.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2672955759}) 2024-08-18T21:07:30.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=853474998}) 2024-08-18T21:07:30.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3644268400}) 2024-08-18T21:07:30.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=853474998}) 2024-08-18T21:07:30.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1235637719}) 2024-08-18T21:07:30.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=853474998}) 2024-08-18T21:07:30.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3716043761}) 2024-08-18T21:07:30.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=853474998}) 2024-08-18T21:07:30.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1837614574}) 2024-08-18T21:07:30.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=853474998}) 2024-08-18T21:07:30.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.643+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4229068708}) 2024-08-18T21:07:30.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3363619252}) 2024-08-18T21:07:30.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3373615174}) 2024-08-18T21:07:30.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3363619252}) 2024-08-18T21:07:30.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3168093104}) 2024-08-18T21:07:30.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3363619252}) 2024-08-18T21:07:30.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1062558515}) 2024-08-18T21:07:30.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3363619252}) 2024-08-18T21:07:30.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3290918121}) 2024-08-18T21:07:30.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3363619252}) 2024-08-18T21:07:30.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2086437556}) 2024-08-18T21:07:30.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3363619252}) 2024-08-18T21:07:30.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1072919512}) 2024-08-18T21:07:30.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3363619252}) 2024-08-18T21:07:30.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=357128958}) 2024-08-18T21:07:30.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3363619252}) 2024-08-18T21:07:30.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.647+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2366433476}) 2024-08-18T21:07:30.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=7,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=1213987351,mdsmap=4274512535,mgr=3067700994,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1543557609,mon_config_key=2147202552,monmap=3438368439,osd_metadata=1354666371,osd_pg_creating=1769581003,osd_snap=723727393,osdmap=3226953709}) 2024-08-18T21:07:30.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=6,mdsmap=1,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=53} crc {logm=1768118838,mdsmap=3196653366,mgr=695303193,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3207472072,mon_config_key=1177028462,monmap=3438368439,osd_metadata=1031801891,osd_pg_creating=1769581003,osd_snap=2941457380,osdmap=2669274061}) 2024-08-18T21:07:30.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=7,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=1213987351,mdsmap=4274512535,mgr=3067700994,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1543557609,mon_config_key=2147202552,monmap=3438368439,osd_metadata=1354666371,osd_pg_creating=1769581003,osd_snap=723727393,osdmap=3226953709}) 2024-08-18T21:07:30.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=7,mdsmap=3,mgr=7,mgr_metadata=1,mgrstat=12,mon_config_key=7,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=52} crc {logm=1213987351,mdsmap=4274512535,mgr=4111398058,mgr_metadata=2208114464,mgrstat=1697350930,mon_config_key=2309266927,monmap=3438368439,osd_metadata=1462106993,osd_pg_creating=1769581003,osd_snap=723727393,osdmap=1892756950}) 2024-08-18T21:07:30.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=7,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=1213987351,mdsmap=4274512535,mgr=3067700994,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1543557609,mon_config_key=2147202552,monmap=3438368439,osd_metadata=1354666371,osd_pg_creating=1769581003,osd_snap=723727393,osdmap=3226953709}) 2024-08-18T21:07:30.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=6,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=2389954483,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3916157610,mon_config_key=2034131424,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=1769581003,osd_snap=723727393,osdmap=106221378}) 2024-08-18T21:07:30.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=7,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=1213987351,mdsmap=4274512535,mgr=3067700994,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1543557609,mon_config_key=2147202552,monmap=3438368439,osd_metadata=1354666371,osd_pg_creating=1769581003,osd_snap=723727393,osdmap=3226953709}) 2024-08-18T21:07:30.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=7,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=6,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=1213987351,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1543557609,mon_config_key=1140424272,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=1769581003,osd_snap=723727393,osdmap=1608890402}) 2024-08-18T21:07:30.658 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.658 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=7,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=1213987351,mdsmap=4274512535,mgr=3067700994,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1543557609,mon_config_key=2147202552,monmap=3438368439,osd_metadata=1354666371,osd_pg_creating=1769581003,osd_snap=723727393,osdmap=3226953709}) 2024-08-18T21:07:30.658 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=6,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=7,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=1198537783,mdsmap=485591938,mgr=4111398058,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1543557609,mon_config_key=4097785744,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=1769581003,osd_snap=723727393,osdmap=2269495414}) 2024-08-18T21:07:30.658 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.658 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=7,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=1213987351,mdsmap=4274512535,mgr=3067700994,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1543557609,mon_config_key=2147202552,monmap=3438368439,osd_metadata=1354666371,osd_pg_creating=1769581003,osd_snap=723727393,osdmap=3226953709}) 2024-08-18T21:07:30.658 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=7,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=11,mon_config_key=7,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=1213987351,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgrstat=2775937966,mon_config_key=952762727,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=1769581003,osd_snap=723727393,osdmap=2086009041}) 2024-08-18T21:07:30.658 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.658 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=7,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=1213987351,mdsmap=4274512535,mgr=3067700994,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1543557609,mon_config_key=2147202552,monmap=3438368439,osd_metadata=1354666371,osd_pg_creating=1769581003,osd_snap=723727393,osdmap=3226953709}) 2024-08-18T21:07:30.658 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=7,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=2718463419,mdsmap=485591938,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1543557609,mon_config_key=2147202552,monmap=3438368439,osd_metadata=515261042,osd_pg_creating=1769581003,osd_snap=723727393,osdmap=2319804536}) 2024-08-18T21:07:30.658 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.658 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=7,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=1213987351,mdsmap=4274512535,mgr=3067700994,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1543557609,mon_config_key=2147202552,monmap=3438368439,osd_metadata=1354666371,osd_pg_creating=1769581003,osd_snap=723727393,osdmap=3226953709}) 2024-08-18T21:07:30.658 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.651+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=7,mdsmap=2,mgr=8,mgr_command_descs=1,mgrstat=13,mon_config_key=6,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=1,osdmap=53} crc {logm=1213987351,mdsmap=485591938,mgr=4115300050,mgr_command_descs=3328876062,mgrstat=1543557609,mon_config_key=3295629973,monmap=3438368439,osd_metadata=1462106993,osd_pg_creating=1769581003,osd_snap=2941457380,osdmap=401883593}) 2024-08-18T21:07:30.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=85} crc {osdmap=1999335098}) 2024-08-18T21:07:30.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=88} crc {osdmap=4005213676}) 2024-08-18T21:07:30.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=85} crc {osdmap=1999335098}) 2024-08-18T21:07:30.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=89} crc {osdmap=1542017162}) 2024-08-18T21:07:30.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=85} crc {osdmap=1999335098}) 2024-08-18T21:07:30.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=91} crc {osdmap=2402738723}) 2024-08-18T21:07:30.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=85} crc {osdmap=1999335098}) 2024-08-18T21:07:30.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=89} crc {osdmap=261251040}) 2024-08-18T21:07:30.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=85} crc {osdmap=1999335098}) 2024-08-18T21:07:30.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=91} crc {osdmap=3993185918}) 2024-08-18T21:07:30.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=85} crc {osdmap=1999335098}) 2024-08-18T21:07:30.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=86} crc {osdmap=3092231184}) 2024-08-18T21:07:30.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=85} crc {osdmap=1999335098}) 2024-08-18T21:07:30.667 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=87} crc {osdmap=3569191930}) 2024-08-18T21:07:30.667 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:07:30.667 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=85} crc {osdmap=1999335098}) 2024-08-18T21:07:30.667 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:07:30.663+0000 7fe73e86d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=88} crc {osdmap=116322781}) 2024-08-18T21:07:31.312 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:07:31.313 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29235]: starting. 2024-08-18T21:07:31.313 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29235]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29197 2024-08-18T21:07:31.313 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29235]: shutting down. 2024-08-18T21:07:31.315 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:07:31.315 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:07:31.315 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:07:31.319 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:07:31.614 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:07:31.615 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:07:31.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.743+0000 7f4a1142c640 10 monclient: get_monmap_and_config 2024-08-18T21:07:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.743+0000 7f4a1142c640 10 monclient: build_initial_monmap 2024-08-18T21:07:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.743+0000 7f4a1142c640 10 monclient: monmap: 2024-08-18T21:07:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:31.747328+0000 2024-08-18T21:07:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:31.747328+0000 2024-08-18T21:07:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:31.748 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:31.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.743+0000 7f4a1142c640 1 Processor -- start 2024-08-18T21:07:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.743+0000 7f4a1142c640 1 -- start start 2024-08-18T21:07:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.743+0000 7f4a1142c640 10 monclient: init 2024-08-18T21:07:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a1142c640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a1142c640 10 monclient: _add_conns ranks=[7,10,1,6,2,9,0,8,5,3,4] 2024-08-18T21:07:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a1142c640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4a0c0a6ce0 0x7f4a0c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a1142c640 10 monclient(hunting): picked mon.noname-i con 0x7f4a0c0a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:07:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a1142c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4a0c0a7600 0x7f4a0c139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a1142c640 10 monclient(hunting): picked mon.noname-f con 0x7f4a0c0a7600 addr v2:172.21.15.157:3300/0 2024-08-18T21:07:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a1142c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f4a0c139fe0 addr v1:172.21.15.157:6789/0 2024-08-18T21:07:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a1142c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a0c0a45d0 con 0x7f4a0c139fe0 2024-08-18T21:07:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a1142c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a1142c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4a0c0a5000 con 0x7f4a0c0a7600 2024-08-18T21:07:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a1142c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a1142c640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f4a0c0a4360 con 0x7f4a0c0a6ce0 2024-08-18T21:07:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a1142c640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a1142c640 10 monclient(hunting): authenticate will time out at 1218.760584s 2024-08-18T21:07:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4a0c0a6ce0 0x7f4a0c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0a7fc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4a0c0a7600 0x7f4a0c139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0b7fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f4a0c139fe0 0x7f4a0c140cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:35222/0 (socket says 172.21.15.5:35222) 2024-08-18T21:07:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0b7fe640 1 -- 172.21.15.5:0/105743246 learned_addr learned my addr 172.21.15.5:0/105743246 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:07:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 10 monclient(hunting): get_auth_request con 0x7f4a0c0a6ce0 auth_method 0 2024-08-18T21:07:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0a7fc640 10 monclient(hunting): get_auth_request con 0x7f4a0c0a7600 auth_method 0 2024-08-18T21:07:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 10 monclient(hunting): handle_auth_done global_id 5254 payload 274 2024-08-18T21:07:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 1 -- 172.21.15.5:0/105743246 >> v2:172.21.15.157:3300/0 conn(0x7f4a0c0a7600 msgr2=0x7f4a0c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 1 --2- 172.21.15.5:0/105743246 >> v2:172.21.15.157:3300/0 conn(0x7f4a0c0a7600 0x7f4a0c139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 1 -- 172.21.15.5:0/105743246 >> v1:172.21.15.157:6789/0 conn(0x7f4a0c139fe0 legacy=0x7f4a0c140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:31.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 10 monclient: _finish_hunting 0 2024-08-18T21:07:31.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 1 monclient: found mon.noname-i 2024-08-18T21:07:31.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:31.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:07:31.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0affd640 1 -- 172.21.15.5:0/105743246 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c0a8900 con 0x7f4a0c0a6ce0 2024-08-18T21:07:31.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.747+0000 7f4a0a7fc640 1 --2- 172.21.15.5:0/105743246 >> v2:172.21.15.157:3300/0 conn(0x7f4a0c0a7600 0x7f4a0c139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:07:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a0affd640 1 -- 172.21.15.5:0/105743246 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4a0c0a6ce0 msgr2=0x7f4a0c0a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a0affd640 1 --2- 172.21.15.5:0/105743246 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4a0c0a6ce0 0x7f4a0c0a70c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009d90 tx=0x7f4a0401c830 comp rx=0 tx=0).ready entity=mon.7 client_cookie=d0532b49473485ed server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a09ffb640 1 -- 172.21.15.5:0/105743246 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4a040b2070 con 0x7f4a0c0a6ce0 2024-08-18T21:07:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a09ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a09ffb640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:07:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a09ffb640 10 monclient: dump: 2024-08-18T21:07:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:31.758 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a09ffb640 10 monclient: _finish_auth 0 2024-08-18T21:07:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a09ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:07:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a09ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a09ffb640 1 -- 172.21.15.5:0/105743246 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a040a5b00 con 0x7f4a0c0a6ce0 2024-08-18T21:07:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a09ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a09ffb640 1 -- 172.21.15.5:0/105743246 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4a040a5cb0 con 0x7f4a0c0a6ce0 2024-08-18T21:07:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a09ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a09ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:07:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a09ffb640 10 monclient: dump: 2024-08-18T21:07:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:31.760 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a1142c640 5 monclient: authenticate success, global_id 5254 2024-08-18T21:07:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a1142c640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a1142c640 4 set_mon_vals no callback set 2024-08-18T21:07:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a1142c640 10 monclient: shutdown 2024-08-18T21:07:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a1142c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a1142c640 1 -- 172.21.15.5:0/105743246 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4a0c0a6ce0 msgr2=0x7f4a0c0a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a1142c640 1 --2- 172.21.15.5:0/105743246 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4a0c0a6ce0 0x7f4a0c0a70c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009d90 tx=0x7f4a0401c830 comp rx=0 tx=0).stop 2024-08-18T21:07:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a1142c640 1 -- 172.21.15.5:0/105743246 shutdown_connections 2024-08-18T21:07:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a1142c640 1 --2- 172.21.15.5:0/105743246 >> v2:172.21.15.157:3300/0 conn(0x7f4a0c0a7600 0x7f4a0c139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a1142c640 1 --2- 172.21.15.5:0/105743246 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4a0c0a6ce0 0x7f4a0c0a70c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a1142c640 1 -- 172.21.15.5:0/105743246 >> 172.21.15.5:0/105743246 conn(0x7f4a0c0acbc0 msgr2=0x7f4a0c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a1142c640 1 -- 172.21.15.5:0/105743246 shutdown_connections 2024-08-18T21:07:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.751+0000 7f4a1142c640 1 -- 172.21.15.5:0/105743246 wait complete. 2024-08-18T21:07:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 10 monclient: build_initial_monmap 2024-08-18T21:07:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 10 monclient: monmap: 2024-08-18T21:07:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:31.762 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 1 Processor -- start 2024-08-18T21:07:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 1 -- start start 2024-08-18T21:07:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 10 monclient: init 2024-08-18T21:07:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 10 monclient: _add_conns ranks=[8,1,6,5,7,2,3,0,4] 2024-08-18T21:07:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a0c0a6ce0 0x7f4a0c1d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 10 monclient(hunting): picked mon.noname-e con 0x7f4a0c0a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:07:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a0c0a7600 0x7f4a0c1d2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 10 monclient(hunting): picked mon.noname-f con 0x7f4a0c0a7600 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:07:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4a0c139fe0 0x7f4a0c13eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 10 monclient(hunting): picked mon.noname-d con 0x7f4a0c139fe0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c0a79e0 con 0x7f4a0c0a7600 2024-08-18T21:07:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f4a0c0a9810 con 0x7f4a0c139fe0 2024-08-18T21:07:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f4a0c122930 con 0x7f4a0c0a6ce0 2024-08-18T21:07:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a1142c640 10 monclient(hunting): authenticate will time out at 1218.769840s 2024-08-18T21:07:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4a0c139fe0 0x7f4a0c13eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0affd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a0c0a6ce0 0x7f4a0c1d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4a0c139fe0 0x7f4a0c13eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:60838/0 (socket says 172.21.15.5:60838) 2024-08-18T21:07:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0affd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a0c0a6ce0 0x7f4a0c1d1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:40704/0 (socket says 172.21.15.5:40704) 2024-08-18T21:07:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 1 -- 172.21.15.5:0/540114220 learned_addr learned my addr 172.21.15.5:0/540114220 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 10 monclient(hunting): get_auth_request con 0x7f4a0c139fe0 auth_method 0 2024-08-18T21:07:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0affd640 10 monclient(hunting): get_auth_request con 0x7f4a0c0a6ce0 auth_method 0 2024-08-18T21:07:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:31.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:31.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:31.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:31.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0a7fc640 1 --2- 172.21.15.5:0/540114220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a0c0a7600 0x7f4a0c1d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:31.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0a7fc640 10 monclient(hunting): get_auth_request con 0x7f4a0c0a7600 auth_method 0 2024-08-18T21:07:31.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:31.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:31.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:31.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 10 monclient(hunting): handle_auth_done global_id 54519 payload 824 2024-08-18T21:07:31.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 1 -- 172.21.15.5:0/540114220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a0c0a6ce0 msgr2=0x7f4a0c1d1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:31.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 1 --2- 172.21.15.5:0/540114220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a0c0a6ce0 0x7f4a0c1d1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:31.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 1 -- 172.21.15.5:0/540114220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a0c0a7600 msgr2=0x7f4a0c1d2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:31.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 1 --2- 172.21.15.5:0/540114220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a0c0a7600 0x7f4a0c1d2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:31.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:07:31.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 1 monclient: found mon.noname-d 2024-08-18T21:07:31.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:31.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:07:31.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0b7fe640 1 -- 172.21.15.5:0/540114220 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c1410a0 con 0x7f4a0c139fe0 2024-08-18T21:07:31.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.755+0000 7f4a0affd640 1 --2- 172.21.15.5:0/540114220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a0c0a6ce0 0x7f4a0c1d1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:07:31.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f4a0b7fe640 1 -- 172.21.15.5:0/540114220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4a0c139fe0 msgr2=0x7f4a0c13eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f4a0b7fe640 1 --2- 172.21.15.5:0/540114220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4a0c139fe0 0x7f4a0c13eaf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009fd0 tx=0x7f49fc00b870 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f49f37fe640 1 -- 172.21.15.5:0/540114220 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f49fc015020 con 0x7f4a0c139fe0 2024-08-18T21:07:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f49f37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f49f37fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:07:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f49f37fe640 10 monclient: dump: 2024-08-18T21:07:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:31.777 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:31.777 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:31.777 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:31.777 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:31.777 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:31.777 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:31.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f49f37fe640 10 monclient: _finish_auth 0 2024-08-18T21:07:31.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f49f37fe640 10 monclient: _check_auth_tickets 2024-08-18T21:07:31.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f49f37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:31.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f49f37fe640 1 -- 172.21.15.5:0/540114220 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49fc011cb0 con 0x7f4a0c139fe0 2024-08-18T21:07:31.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f4a1142c640 5 monclient: authenticate success, global_id 54519 2024-08-18T21:07:31.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f4a1142c640 10 monclient: _renew_subs 2024-08-18T21:07:31.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f4a1142c640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:07:31.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f4a1142c640 1 -- 172.21.15.5:0/540114220 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0c142130 con 0x7f4a0c139fe0 2024-08-18T21:07:31.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f49f37fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:31.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f49f37fe640 1 -- 172.21.15.5:0/540114220 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f49fc011e60 con 0x7f4a0c139fe0 2024-08-18T21:07:31.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f49f37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:31.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f49f37fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:07:31.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f4a08ff9640 4 set_mon_vals no callback set 2024-08-18T21:07:31.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f49f37fe640 10 monclient: dump: 2024-08-18T21:07:31.778 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:31.778 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:31.778 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:31.779 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:31.779 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:31.779 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:31.779 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:31.779 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:31.779 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:31.779 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:31.779 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:31.779 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:31.779 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:31.779 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:31.779 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:31.779 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:31.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f4a1142c640 10 monclient: _renew_subs 2024-08-18T21:07:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f4a1142c640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:07:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f4a1142c640 1 -- 172.21.15.5:0/540114220 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a0c0aa900 con 0x7f4a0c139fe0 2024-08-18T21:07:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f49f37fe640 1 -- 172.21.15.5:0/540114220 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f49fc018020 con 0x7f4a0c139fe0 2024-08-18T21:07:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f4a1142c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f4a1142c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f4a1142c640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:07:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f4a1142c640 1 -- 172.21.15.5:0/540114220 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a0c0a8220 con 0x7f4a0c139fe0 2024-08-18T21:07:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f49f37fe640 1 --2- 172.21.15.5:0/540114220 >> v2:172.21.15.157:6812/631023601 conn(0x7f49f803bdf0 0x7f49f803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f49f37fe640 1 -- 172.21.15.5:0/540114220 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(108..108 src has 22..108) ==== 3506+0+0 (secure 0 0 0) 0x7f49fc04e390 con 0x7f4a0c139fe0 2024-08-18T21:07:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f4a0affd640 1 --2- 172.21.15.5:0/540114220 >> v2:172.21.15.157:6812/631023601 conn(0x7f49f803bdf0 0x7f49f803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.759+0000 7f4a0affd640 10 monclient: get_auth_request con 0x7f49f803bdf0 auth_method 0 2024-08-18T21:07:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.763+0000 7f4a0affd640 1 --2- 172.21.15.5:0/540114220 >> v2:172.21.15.157:6812/631023601 conn(0x7f49f803bdf0 0x7f49f803e2b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4a040ac000 tx=0x7f4a040a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.763+0000 7f49f37fe640 1 -- 172.21.15.5:0/540114220 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f49fc01f020 con 0x7f4a0c139fe0 2024-08-18T21:07:31.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.763+0000 7f49f37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:31.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:31.763+0000 7f49f37fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:32.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.003+0000 7f4a1142c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:07:32.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.003+0000 7f4a1142c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:07:32.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.003+0000 7f4a1142c640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:07:32.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.003+0000 7f4a1142c640 1 -- 172.21.15.5:0/540114220 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4a0c069580 con 0x7f4a0c139fe0 2024-08-18T21:07:32.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.003+0000 7f49f37fe640 1 -- 172.21.15.5:0/540114220 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3172 (secure 0 0 0) 0x7f4a0c142130 con 0x7f4a0c139fe0 2024-08-18T21:07:32.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.003+0000 7f49f37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:07:32.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.003+0000 7f49f37fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:32.008 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":94,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:07:32.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.007+0000 7f4a1142c640 1 -- 172.21.15.5:0/540114220 >> v2:172.21.15.157:6812/631023601 conn(0x7f49f803bdf0 msgr2=0x7f49f803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.007+0000 7f4a1142c640 1 --2- 172.21.15.5:0/540114220 >> v2:172.21.15.157:6812/631023601 conn(0x7f49f803bdf0 0x7f49f803e2b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4a040ac000 tx=0x7f4a040a7070 comp rx=0 tx=0).stop 2024-08-18T21:07:32.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.007+0000 7f4a1142c640 10 monclient: shutdown 2024-08-18T21:07:32.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.007+0000 7f4a1142c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:32.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.007+0000 7f4a1142c640 1 -- 172.21.15.5:0/540114220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4a0c139fe0 msgr2=0x7f4a0c13eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.007+0000 7f4a1142c640 1 --2- 172.21.15.5:0/540114220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4a0c139fe0 0x7f4a0c13eaf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009fd0 tx=0x7f49fc00b870 comp rx=0 tx=0).stop 2024-08-18T21:07:32.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.007+0000 7f4a1142c640 1 -- 172.21.15.5:0/540114220 shutdown_connections 2024-08-18T21:07:32.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.007+0000 7f4a1142c640 1 --2- 172.21.15.5:0/540114220 >> v2:172.21.15.157:6812/631023601 conn(0x7f49f803bdf0 0x7f49f803e2b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.007+0000 7f4a1142c640 1 --2- 172.21.15.5:0/540114220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4a0c139fe0 0x7f4a0c13eaf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.007+0000 7f4a1142c640 1 --2- 172.21.15.5:0/540114220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a0c0a7600 0x7f4a0c1d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.007+0000 7f4a1142c640 1 --2- 172.21.15.5:0/540114220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a0c0a6ce0 0x7f4a0c1d1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.007+0000 7f4a1142c640 1 -- 172.21.15.5:0/540114220 >> 172.21.15.5:0/540114220 conn(0x7f4a0c0acbc0 msgr2=0x7f4a0c09deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:32.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.007+0000 7f4a1142c640 1 -- 172.21.15.5:0/540114220 shutdown_connections 2024-08-18T21:07:32.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.007+0000 7f4a1142c640 1 -- 172.21.15.5:0/540114220 wait complete. 2024-08-18T21:07:32.027 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:07:32.027 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-18T21:07:32.027 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:07:32.027 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:07:32.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 10 monclient: get_monmap_and_config 2024-08-18T21:07:32.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 10 monclient: build_initial_monmap 2024-08-18T21:07:32.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 10 monclient: monmap: 2024-08-18T21:07:32.148 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:32.148 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.148 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:32.148800+0000 2024-08-18T21:07:32.148 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:32.148800+0000 2024-08-18T21:07:32.149 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:32.149 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.149 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:32.149 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:32.149 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:32.149 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:32.149 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:32.149 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:32.149 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:32.149 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:32.149 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:32.149 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:32.149 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:32.149 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 1 Processor -- start 2024-08-18T21:07:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 1 -- start start 2024-08-18T21:07:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 10 monclient: init 2024-08-18T21:07:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 10 monclient: _add_conns ranks=[0,2,1,6,9,4,8,3,7,5,10] 2024-08-18T21:07:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3dcc09da30 addr v1:172.21.15.5:6789/0 2024-08-18T21:07:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3dcc0a03e0 0x7f3dcc13b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 10 monclient(hunting): picked mon.noname-b con 0x7f3dcc0a03e0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f3dcc0a3110 addr v1:172.21.15.157:6789/0 2024-08-18T21:07:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dcc09f7c0 con 0x7f3dcc09da30 2024-08-18T21:07:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dcc09f4e0 con 0x7f3dcc0a3110 2024-08-18T21:07:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f3dcc09faa0 con 0x7f3dcc0a03e0 2024-08-18T21:07:32.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:32.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dd0b54640 10 monclient(hunting): authenticate will time out at 1219.162645s 2024-08-18T21:07:32.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dc9d9b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3dcc0a03e0 0x7f3dcc13b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dca59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3dcc09da30 0x7f3dcc09de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49454/0 (socket says 172.21.15.5:49454) 2024-08-18T21:07:32.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dca59c640 1 -- 172.21.15.5:0/162465078 learned_addr learned my addr 172.21.15.5:0/162465078 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:07:32.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dc9d9b640 10 monclient(hunting): get_auth_request con 0x7f3dcc0a03e0 auth_method 0 2024-08-18T21:07:32.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dc9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dc9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dc9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dc9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dc9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dc9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dc9d9b640 10 monclient(hunting): handle_auth_done global_id 74189 payload 274 2024-08-18T21:07:32.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dc9d9b640 1 -- 172.21.15.5:0/162465078 >> v1:172.21.15.157:6789/0 conn(0x7f3dcc0a3110 legacy=0x7f3dcc13de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:32.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dc9d9b640 1 -- 172.21.15.5:0/162465078 >> v1:172.21.15.5:6789/0 conn(0x7f3dcc09da30 legacy=0x7f3dcc09de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:32.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dc9d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:07:32.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dc9d9b640 1 monclient: found mon.noname-b 2024-08-18T21:07:32.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dc9d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:32.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dc9d9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:07:32.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.147+0000 7f3dc9d9b640 1 -- 172.21.15.5:0/162465078 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dcc09fd80 con 0x7f3dcc0a03e0 2024-08-18T21:07:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dc9d9b640 1 -- 172.21.15.5:0/162465078 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3dcc0a03e0 msgr2=0x7f3dcc13b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dc9d9b640 1 --2- 172.21.15.5:0/162465078 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3dcc0a03e0 0x7f3dcc13b8e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009820 tx=0x7f3dc001c1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9000a73ff5f2c7c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dc959a640 1 -- 172.21.15.5:0/162465078 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3dc00b0070 con 0x7f3dcc0a03e0 2024-08-18T21:07:32.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dc959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dc959a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:07:32.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dc959a640 10 monclient: dump: 2024-08-18T21:07:32.156 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.156 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.157 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dc959a640 10 monclient: _finish_auth 0 2024-08-18T21:07:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dc959a640 10 monclient: _check_auth_tickets 2024-08-18T21:07:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dc959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dc959a640 1 -- 172.21.15.5:0/162465078 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc00aa810 con 0x7f3dcc0a03e0 2024-08-18T21:07:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dd0b54640 5 monclient: authenticate success, global_id 74189 2024-08-18T21:07:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dd0b54640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:07:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dc959a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dd0b54640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dc959a640 1 -- 172.21.15.5:0/162465078 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3dc00aae30 con 0x7f3dcc0a03e0 2024-08-18T21:07:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dd0b54640 4 set_mon_vals no callback set 2024-08-18T21:07:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dc959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dc959a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:07:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.151+0000 7f3dc959a640 10 monclient: dump: 2024-08-18T21:07:32.159 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.159 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.159 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.159 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.159 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.159 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.159 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.159 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.159 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.159 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.159 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.159 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.159 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.160 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 10 monclient: shutdown 2024-08-18T21:07:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 1 -- 172.21.15.5:0/162465078 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3dcc0a03e0 msgr2=0x7f3dcc13b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 1 --2- 172.21.15.5:0/162465078 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3dcc0a03e0 0x7f3dcc13b8e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009820 tx=0x7f3dc001c1a0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 1 -- 172.21.15.5:0/162465078 shutdown_connections 2024-08-18T21:07:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 1 --2- 172.21.15.5:0/162465078 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3dcc0a03e0 0x7f3dcc13b8e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 1 -- 172.21.15.5:0/162465078 >> 172.21.15.5:0/162465078 conn(0x7f3dcc0688d0 msgr2=0x7f3dcc068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 1 -- 172.21.15.5:0/162465078 shutdown_connections 2024-08-18T21:07:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 1 -- 172.21.15.5:0/162465078 wait complete. 2024-08-18T21:07:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 10 monclient: build_initial_monmap 2024-08-18T21:07:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 10 monclient: monmap: 2024-08-18T21:07:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:32.167 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 1 Processor -- start 2024-08-18T21:07:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 1 -- start start 2024-08-18T21:07:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 10 monclient: init 2024-08-18T21:07:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 10 monclient: _add_conns ranks=[3,6,2,5,4,7,0,8,1] 2024-08-18T21:07:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3dcc09da30 0x7f3dcc13bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 10 monclient(hunting): picked mon.noname-g con 0x7f3dcc09da30 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3dcc0a3110 0x7f3dcc13c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 10 monclient(hunting): picked mon.noname-d con 0x7f3dcc0a3110 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3dcc13c640 0x7f3dcc13caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 10 monclient(hunting): picked mon.noname-b con 0x7f3dcc13c640 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f3dcc06cce0 con 0x7f3dcc13c640 2024-08-18T21:07:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3dcc06cb60 con 0x7f3dcc09da30 2024-08-18T21:07:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f3dcc06ce60 con 0x7f3dcc0a3110 2024-08-18T21:07:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dd0b54640 10 monclient(hunting): authenticate will time out at 1219.170063s 2024-08-18T21:07:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3dcc0a3110 0x7f3dcc13c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3dcc0a3110 0x7f3dcc13c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:60852/0 (socket says 172.21.15.5:60852) 2024-08-18T21:07:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 1 -- 172.21.15.5:0/3977195311 learned_addr learned my addr 172.21.15.5:0/3977195311 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 10 monclient(hunting): get_auth_request con 0x7f3dcc0a3110 auth_method 0 2024-08-18T21:07:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dcad9d640 1 --2- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3dcc13c640 0x7f3dcc13caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dca59c640 1 --2- 172.21.15.5:0/3977195311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3dcc09da30 0x7f3dcc13bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dcad9d640 10 monclient(hunting): get_auth_request con 0x7f3dcc13c640 auth_method 0 2024-08-18T21:07:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dcad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dcad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dcad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dca59c640 10 monclient(hunting): get_auth_request con 0x7f3dcc09da30 auth_method 0 2024-08-18T21:07:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dca59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dca59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dca59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dcad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dcad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dcad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dca59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dca59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dca59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 10 monclient(hunting): handle_auth_done global_id 54528 payload 824 2024-08-18T21:07:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 1 -- 172.21.15.5:0/3977195311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3dcc09da30 msgr2=0x7f3dcc13bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 1 --2- 172.21.15.5:0/3977195311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3dcc09da30 0x7f3dcc13bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 1 -- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3dcc13c640 msgr2=0x7f3dcc13caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 1 --2- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3dcc13c640 0x7f3dcc13caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:07:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 1 monclient: found mon.noname-d 2024-08-18T21:07:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:07:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.155+0000 7f3dc9d9b640 1 -- 172.21.15.5:0/3977195311 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dcc11f8b0 con 0x7f3dcc0a3110 2024-08-18T21:07:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dc9d9b640 1 -- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3dcc0a3110 msgr2=0x7f3dcc13c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dc9d9b640 1 --2- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3dcc0a3110 0x7f3dcc13c100 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3dc001c680 tx=0x7f3dcc0a5840 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dbaffd640 1 -- 172.21.15.5:0/3977195311 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3dc00b0040 con 0x7f3dcc0a3110 2024-08-18T21:07:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dbaffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:07:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dbaffd640 10 monclient: dump: 2024-08-18T21:07:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.175 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dbaffd640 10 monclient: _finish_auth 0 2024-08-18T21:07:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dbaffd640 10 monclient: _check_auth_tickets 2024-08-18T21:07:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dbaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dbaffd640 1 -- 172.21.15.5:0/3977195311 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc0004240 con 0x7f3dcc0a3110 2024-08-18T21:07:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dd0b54640 5 monclient: authenticate success, global_id 54528 2024-08-18T21:07:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dd0b54640 10 monclient: _renew_subs 2024-08-18T21:07:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dd0b54640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:07:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dd0b54640 1 -- 172.21.15.5:0/3977195311 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dcc0a80d0 con 0x7f3dcc0a3110 2024-08-18T21:07:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dbaffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dbaffd640 1 -- 172.21.15.5:0/3977195311 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3dc00043f0 con 0x7f3dcc0a3110 2024-08-18T21:07:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dbaffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:07:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dbaffd640 10 monclient: dump: 2024-08-18T21:07:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.178 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dc8d99640 4 set_mon_vals no callback set 2024-08-18T21:07:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dd0b54640 10 monclient: _renew_subs 2024-08-18T21:07:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dd0b54640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:07:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dd0b54640 1 -- 172.21.15.5:0/3977195311 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dcc11f5d0 con 0x7f3dcc0a3110 2024-08-18T21:07:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dd0b54640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dd0b54640 1 --2- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc0a03e0 0x7f3dcc0701f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dd0b54640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dd0b54640 1 -- 172.21.15.5:0/3977195311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc13e080 con 0x7f3dcc0a03e0 2024-08-18T21:07:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dca59c640 1 --2- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc0a03e0 0x7f3dcc0701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dca59c640 10 monclient: get_auth_request con 0x7f3dcc0a03e0 auth_method 0 2024-08-18T21:07:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dca59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dca59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dca59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dca59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dca59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dca59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dbaffd640 1 -- 172.21.15.5:0/3977195311 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f3dc00b3070 con 0x7f3dcc0a3110 2024-08-18T21:07:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dca59c640 10 monclient(hunting): handle_auth_done global_id 74178 payload 824 2024-08-18T21:07:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dca59c640 1 -- 172.21.15.5:0/3977195311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3dcc06dbf0 con 0x7f3dcc0a03e0 2024-08-18T21:07:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dbaffd640 1 --2- 172.21.15.5:0/3977195311 >> v2:172.21.15.157:6812/631023601 conn(0x7f3dac03bdc0 0x7f3dac03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dbaffd640 1 -- 172.21.15.5:0/3977195311 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(108..108 src has 22..108) ==== 3506+0+0 (secure 0 0 0) 0x7f3dc00e8030 con 0x7f3dcc0a3110 2024-08-18T21:07:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dcad9d640 1 --2- 172.21.15.5:0/3977195311 >> v2:172.21.15.157:6812/631023601 conn(0x7f3dac03bdc0 0x7f3dac03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.159+0000 7f3dcad9d640 10 monclient: get_auth_request con 0x7f3dac03bdc0 auth_method 0 2024-08-18T21:07:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.163+0000 7f3dca59c640 1 -- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc0a03e0 msgr2=0x7f3dcc0701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.163+0000 7f3dca59c640 1 --2- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc0a03e0 0x7f3dcc0701f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00eaa0 tx=0x7f3dbc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.163+0000 7f3dbaffd640 1 -- 172.21.15.5:0/3977195311 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3dbc00ee60 con 0x7f3dcc0a03e0 2024-08-18T21:07:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.163+0000 7f3dbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.163+0000 7f3dbaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:07:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.163+0000 7f3dbaffd640 10 monclient: dump: 2024-08-18T21:07:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.181 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.163+0000 7f3dbaffd640 1 -- 172.21.15.5:0/3977195311 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3dbc019070 con 0x7f3dcc0a03e0 2024-08-18T21:07:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.163+0000 7f3dbaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.163+0000 7f3dbaffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.163+0000 7f3dbaffd640 1 -- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc0a03e0 msgr2=0x7f3dcc0701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.163+0000 7f3dbaffd640 1 --2- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc0a03e0 0x7f3dcc0701f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00eaa0 tx=0x7f3dbc00eb90 comp rx=0 tx=0).stop 2024-08-18T21:07:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.163+0000 7f3dbaffd640 1 -- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc0a03e0 msgr2=0x7f3dcc0701f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.163+0000 7f3dbaffd640 1 --2- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc0a03e0 0x7f3dcc0701f0 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00eaa0 tx=0x7f3dbc00eb90 comp rx=0 tx=0).stop 2024-08-18T21:07:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.163+0000 7f3dcad9d640 1 --2- 172.21.15.5:0/3977195311 >> v2:172.21.15.157:6812/631023601 conn(0x7f3dac03bdc0 0x7f3dac03e280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc09eed0 tx=0x7f3dc400d040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.167+0000 7f3dd0b54640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.167+0000 7f3dd0b54640 1 --2- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc070730 0x7f3dcc070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.167+0000 7f3dd0b54640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.167+0000 7f3dd0b54640 1 -- 172.21.15.5:0/3977195311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc051140 con 0x7f3dcc070730 2024-08-18T21:07:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.167+0000 7f3dca59c640 1 --2- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc070730 0x7f3dcc070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.167+0000 7f3dca59c640 10 monclient: get_auth_request con 0x7f3dcc070730 auth_method 0 2024-08-18T21:07:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.167+0000 7f3dca59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.167+0000 7f3dca59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.167+0000 7f3dca59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.167+0000 7f3dca59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.167+0000 7f3dca59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.167+0000 7f3dca59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dca59c640 10 monclient(hunting): handle_auth_done global_id 74187 payload 824 2024-08-18T21:07:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dca59c640 1 -- 172.21.15.5:0/3977195311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3dcc09de10 con 0x7f3dcc070730 2024-08-18T21:07:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dca59c640 1 -- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc070730 msgr2=0x7f3dcc070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dca59c640 1 --2- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc070730 0x7f3dcc070b40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0070c0 tx=0x7f3dbc004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dbaffd640 1 -- 172.21.15.5:0/3977195311 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3dbc024070 con 0x7f3dcc070730 2024-08-18T21:07:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dbaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:07:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dbaffd640 10 monclient: dump: 2024-08-18T21:07:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.186 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dbaffd640 1 -- 172.21.15.5:0/3977195311 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7f3dbc00ce80 con 0x7f3dcc070730 2024-08-18T21:07:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dbaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dbaffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dbaffd640 1 -- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc070730 msgr2=0x7f3dcc070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dbaffd640 1 --2- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc070730 0x7f3dcc070b40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0070c0 tx=0x7f3dbc004950 comp rx=0 tx=0).stop 2024-08-18T21:07:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dbaffd640 1 -- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc070730 msgr2=0x7f3dcc070b40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dbaffd640 1 --2- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc070730 0x7f3dcc070b40 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0070c0 tx=0x7f3dbc004950 comp rx=0 tx=0).stop 2024-08-18T21:07:32.187 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:32.187 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:32.187 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:32.187 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:07:32.187 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:32.187 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 29967, 2024-08-18T21:07:32.188 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:32.188 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:32.188 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:32.188 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:32.188 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:32.188 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:32.188 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:32.188 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:32.188 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:32.188 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:32.188 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.188 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:07:32.189 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:32.189 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:32.189 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:32.189 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:32.189 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:32.189 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:32.189 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:32.189 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:32.189 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:32.189 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:32.189 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:32.189 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:32.189 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:32.190 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:32.190 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.190 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:32.190 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:32.190 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:32.190 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:32.190 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:32.190 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:32.190 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:32.190 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:32.190 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:32.190 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:32.191 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:32.191 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:32.191 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:32.191 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.191 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:32.191 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:32.191 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:32.191 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:32.191 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:32.191 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:32.191 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:32.191 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:32.191 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:32.192 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:32.192 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:32.192 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:32.192 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:32.192 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:32.192 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:32.192 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:32.192 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:32.192 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:32.192 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:32.193 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:32.193 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:32.193 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:32.193 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:32.193 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:32.193 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:32.193 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:32.193 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:32.193 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:32.193 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.193 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:32.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.193 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:32.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.194 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:32.194 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:32.194 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:32.194 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:32.195 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.195 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.195 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:32.195 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:32.195 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.195 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.195 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:32.200 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.200 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:32.200 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.200 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.200 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.200 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:32.200 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:32.200 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.200 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.200 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.201 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.201 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:32.201 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:32.201 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.201 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.201 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.201 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.201 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:32.201 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.201 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.201 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.202 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:32.202 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.202 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.202 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.202 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:32.202 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:32.202 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.202 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.202 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.202 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.202 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:32.202 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:32.203 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.203 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.203 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.203 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:32.203 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.203 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.203 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:32.203 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.203 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.203 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.204 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:32.204 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:32.204 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.204 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.204 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.204 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.204 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:32.204 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:32.204 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.204 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.204 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.204 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.204 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:32.204 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:32.205 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.205 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.205 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:32.205 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:32.205 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.205 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.205 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.205 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:32.206 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:32.206 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.206 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.206 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.206 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:32.206 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.206 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.206 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:32.206 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.206 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.207 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:32.207 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:32.207 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.207 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.207 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.207 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:32.207 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:32.207 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.208 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.208 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:32.208 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.208 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.208 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:32.208 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.208 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.208 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.208 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:32.208 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:32.209 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.209 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.209 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.209 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.209 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.209 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:32.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:32.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.209 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:32.209 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:32.209 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:32.209 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.209 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.210 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:32.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.210 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:32.210 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:32.210 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:32.210 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.210 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.210 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:32.210 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dd0b54640 1 -- 172.21.15.5:0/3977195311 >> v2:172.21.15.157:6812/631023601 conn(0x7f3dac03bdc0 msgr2=0x7f3dac03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dd0b54640 1 --2- 172.21.15.5:0/3977195311 >> v2:172.21.15.157:6812/631023601 conn(0x7f3dac03bdc0 0x7f3dac03e280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc09eed0 tx=0x7f3dc400d040 comp rx=0 tx=0).stop 2024-08-18T21:07:32.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dd0b54640 10 monclient: shutdown 2024-08-18T21:07:32.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dd0b54640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:32.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dd0b54640 1 -- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3dcc0a3110 msgr2=0x7f3dcc13c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dd0b54640 1 --2- 172.21.15.5:0/3977195311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3dcc0a3110 0x7f3dcc13c100 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3dc001c680 tx=0x7f3dcc0a5840 comp rx=0 tx=0).stop 2024-08-18T21:07:32.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dcad9d640 1 -- 172.21.15.5:0/3977195311 reap_dead start 2024-08-18T21:07:32.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dcad9d640 1 -- 172.21.15.5:0/3977195311 reap_dead start 2024-08-18T21:07:32.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dd0b54640 1 -- 172.21.15.5:0/3977195311 shutdown_connections 2024-08-18T21:07:32.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dd0b54640 1 -- 172.21.15.5:0/3977195311 >> 172.21.15.5:0/3977195311 conn(0x7f3dcc0688d0 msgr2=0x7f3dcc1398d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:32.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dd0b54640 1 -- 172.21.15.5:0/3977195311 shutdown_connections 2024-08-18T21:07:32.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.171+0000 7f3dd0b54640 1 -- 172.21.15.5:0/3977195311 wait complete. 2024-08-18T21:07:32.213 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:32.213 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:07:32.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:07:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 10 monclient: get_monmap_and_config 2024-08-18T21:07:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 10 monclient: build_initial_monmap 2024-08-18T21:07:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 10 monclient: monmap: 2024-08-18T21:07:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:32.348537+0000 2024-08-18T21:07:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:32.348537+0000 2024-08-18T21:07:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:32.349 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:32.349 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:32.349 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:32.349 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:32.349 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:32.349 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:32.349 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:32.349 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:32.349 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:32.349 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:32.349 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 1 Processor -- start 2024-08-18T21:07:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 1 -- start start 2024-08-18T21:07:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 10 monclient: init 2024-08-18T21:07:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 10 monclient: _add_conns ranks=[8,2,3,4,10,5,6,9,0,1,7] 2024-08-18T21:07:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2bbc0a4000 0x7f2bbc0a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 10 monclient(hunting): picked mon.noname-e con 0x7f2bbc0a4000 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:07:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc0a2800 0x7f2bbc0a4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 10 monclient(hunting): picked mon.noname-b con 0x7f2bbc0a2800 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2bbc09b080 0x7f2bbc09b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 10 monclient(hunting): picked mon.noname-g con 0x7f2bbc09b080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f2bbc0689b0 con 0x7f2bbc0a2800 2024-08-18T21:07:32.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2bbc0a4e60 con 0x7f2bbc09b080 2024-08-18T21:07:32.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f2bbc0a2450 con 0x7f2bbc0a4000 2024-08-18T21:07:32.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:32.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc2369640 10 monclient(hunting): authenticate will time out at 1219.361628s 2024-08-18T21:07:32.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2bbc0a4000 0x7f2bbc0a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbb7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc0a2800 0x7f2bbc0a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2bbc0a4000 0x7f2bbc0a43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:40708/0 (socket says 172.21.15.5:40708) 2024-08-18T21:07:32.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 1 -- 172.21.15.5:0/1969042656 learned_addr learned my addr 172.21.15.5:0/1969042656 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:32.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbb7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc0a2800 0x7f2bbc0a4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:35702/0 (socket says 172.21.15.5:35702) 2024-08-18T21:07:32.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 10 monclient(hunting): get_auth_request con 0x7f2bbc0a4000 auth_method 0 2024-08-18T21:07:32.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbb7fe640 10 monclient(hunting): get_auth_request con 0x7f2bbc0a2800 auth_method 0 2024-08-18T21:07:32.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc0906640 1 --2- 172.21.15.5:0/1969042656 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2bbc09b080 0x7f2bbc09b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc0906640 10 monclient(hunting): get_auth_request con 0x7f2bbc09b080 auth_method 0 2024-08-18T21:07:32.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc0906640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc0906640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bc0906640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 10 monclient(hunting): handle_auth_done global_id 54530 payload 274 2024-08-18T21:07:32.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 1 -- 172.21.15.5:0/1969042656 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2bbc09b080 msgr2=0x7f2bbc09b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:32.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 1 --2- 172.21.15.5:0/1969042656 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2bbc09b080 0x7f2bbc09b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 1 -- 172.21.15.5:0/1969042656 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc0a2800 msgr2=0x7f2bbc0a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:32.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 1 --2- 172.21.15.5:0/1969042656 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc0a2800 0x7f2bbc0a4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 10 monclient: _finish_hunting 0 2024-08-18T21:07:32.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 1 monclient: found mon.noname-e 2024-08-18T21:07:32.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:32.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:07:32.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbbfff640 1 -- 172.21.15.5:0/1969042656 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bbc0a5f90 con 0x7f2bbc0a4000 2024-08-18T21:07:32.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.347+0000 7f2bbb7fe640 1 --2- 172.21.15.5:0/1969042656 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc0a2800 0x7f2bbc0a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:07:32.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bbbfff640 1 -- 172.21.15.5:0/1969042656 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2bbc0a4000 msgr2=0x7f2bbc0a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bbbfff640 1 --2- 172.21.15.5:0/1969042656 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2bbc0a4000 0x7f2bbc0a43e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0098a0 tx=0x7f2bac01c410 comp rx=0 tx=0).ready entity=mon.8 client_cookie=4cdf40be76ab8804 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bbaffd640 1 -- 172.21.15.5:0/1969042656 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2bac0b0070 con 0x7f2bbc0a4000 2024-08-18T21:07:32.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bbaffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:07:32.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bbaffd640 10 monclient: dump: 2024-08-18T21:07:32.362 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.362 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.362 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.362 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.362 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.362 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.362 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.362 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.362 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.362 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.362 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.362 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.363 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bbaffd640 10 monclient: _finish_auth 0 2024-08-18T21:07:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bbaffd640 10 monclient: _check_auth_tickets 2024-08-18T21:07:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bbaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bbaffd640 1 -- 172.21.15.5:0/1969042656 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bac0aa810 con 0x7f2bbc0a4000 2024-08-18T21:07:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 5 monclient: authenticate success, global_id 54530 2024-08-18T21:07:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:07:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bbaffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 4 set_mon_vals no callback set 2024-08-18T21:07:32.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bbaffd640 1 -- 172.21.15.5:0/1969042656 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2bac0aae30 con 0x7f2bbc0a4000 2024-08-18T21:07:32.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bbaffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:07:32.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bbaffd640 10 monclient: dump: 2024-08-18T21:07:32.364 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.364 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.364 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.364 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.364 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.364 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.364 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.364 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.364 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.364 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.365 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 10 monclient: shutdown 2024-08-18T21:07:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 1 -- 172.21.15.5:0/1969042656 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2bbc0a4000 msgr2=0x7f2bbc0a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 1 --2- 172.21.15.5:0/1969042656 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2bbc0a4000 0x7f2bbc0a43e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0098a0 tx=0x7f2bac01c410 comp rx=0 tx=0).stop 2024-08-18T21:07:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 1 -- 172.21.15.5:0/1969042656 shutdown_connections 2024-08-18T21:07:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 1 --2- 172.21.15.5:0/1969042656 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2bbc09b080 0x7f2bbc09b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 1 --2- 172.21.15.5:0/1969042656 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc0a2800 0x7f2bbc0a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 1 --2- 172.21.15.5:0/1969042656 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2bbc0a4000 0x7f2bbc0a43e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 1 -- 172.21.15.5:0/1969042656 >> 172.21.15.5:0/1969042656 conn(0x7f2bbc0a50f0 msgr2=0x7f2bbc0a54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 1 -- 172.21.15.5:0/1969042656 shutdown_connections 2024-08-18T21:07:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 1 -- 172.21.15.5:0/1969042656 wait complete. 2024-08-18T21:07:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 10 monclient: build_initial_monmap 2024-08-18T21:07:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.351+0000 7f2bc2369640 10 monclient: monmap: 2024-08-18T21:07:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:32.367 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:32.367 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:32.367 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:32.367 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:32.367 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:32.367 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:32.367 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:32.367 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 1 Processor -- start 2024-08-18T21:07:32.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 1 -- start start 2024-08-18T21:07:32.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 10 monclient: init 2024-08-18T21:07:32.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:32.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 10 monclient: _add_conns ranks=[8,2,1,7,6,5,4,0,3] 2024-08-18T21:07:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2bbc09b080 0x7f2bbc0739d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 10 monclient(hunting): picked mon.noname-e con 0x7f2bbc09b080 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:07:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc0a2800 0x7f2bbc073f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 10 monclient(hunting): picked mon.noname-b con 0x7f2bbc0a2800 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bbc0a4000 0x7f2bbc074450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 10 monclient(hunting): picked mon.noname-f con 0x7f2bbc0a4000 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:07:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc13ff40 con 0x7f2bbc0a4000 2024-08-18T21:07:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f2bbc13fdc0 con 0x7f2bbc0a2800 2024-08-18T21:07:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f2bbc1400c0 con 0x7f2bbc09b080 2024-08-18T21:07:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 10 monclient(hunting): authenticate will time out at 1219.368733s 2024-08-18T21:07:32.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2bbc09b080 0x7f2bbc0739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2bbc09b080 0x7f2bbc0739d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:40712/0 (socket says 172.21.15.5:40712) 2024-08-18T21:07:32.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 1 -- 172.21.15.5:0/361988741 learned_addr learned my addr 172.21.15.5:0/361988741 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:32.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 10 monclient(hunting): get_auth_request con 0x7f2bbc09b080 auth_method 0 2024-08-18T21:07:32.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbb7fe640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc0a2800 0x7f2bbc073f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbb7fe640 10 monclient(hunting): get_auth_request con 0x7f2bbc0a2800 auth_method 0 2024-08-18T21:07:32.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc0906640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bbc0a4000 0x7f2bbc074450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 10 monclient(hunting): handle_auth_done global_id 54539 payload 824 2024-08-18T21:07:32.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 1 -- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc0a2800 msgr2=0x7f2bbc073f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc0a2800 0x7f2bbc073f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 1 -- 172.21.15.5:0/361988741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bbc0a4000 msgr2=0x7f2bbc074450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bbc0a4000 0x7f2bbc074450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 10 monclient: _finish_hunting 0 2024-08-18T21:07:32.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 1 monclient: found mon.noname-e 2024-08-18T21:07:32.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:32.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:07:32.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 1 -- 172.21.15.5:0/361988741 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bbc13cbc0 con 0x7f2bbc09b080 2024-08-18T21:07:32.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc0906640 10 monclient: get_auth_request con 0x7f2bbc0a4000 auth_method 0 2024-08-18T21:07:32.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc0906640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bbc0a4000 0x7f2bbc074450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:07:32.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 1 -- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2bbc09b080 msgr2=0x7f2bbc0739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bbbfff640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2bbc09b080 0x7f2bbc0739d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2bac01ccb0 tx=0x7f2bac0191b0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bb8ff9640 1 -- 172.21.15.5:0/361988741 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2bac0b9020 con 0x7f2bbc09b080 2024-08-18T21:07:32.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bb8ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:07:32.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bb8ff9640 10 monclient: dump: 2024-08-18T21:07:32.371 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.371 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.371 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.372 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.372 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.372 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.372 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.372 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.372 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.372 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.372 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.372 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.372 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.372 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.372 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.372 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bb8ff9640 10 monclient: _finish_auth 0 2024-08-18T21:07:32.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bb8ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:07:32.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bb8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:32.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bb8ff9640 1 -- 172.21.15.5:0/361988741 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bac0044b0 con 0x7f2bbc09b080 2024-08-18T21:07:32.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 5 monclient: authenticate success, global_id 54539 2024-08-18T21:07:32.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 10 monclient: _renew_subs 2024-08-18T21:07:32.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:07:32.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 1 -- 172.21.15.5:0/361988741 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bbc0a7620 con 0x7f2bbc09b080 2024-08-18T21:07:32.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bb8ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:32.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bb8ff9640 1 -- 172.21.15.5:0/361988741 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2bac0b0040 con 0x7f2bbc09b080 2024-08-18T21:07:32.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bb8ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:07:32.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bba7fc640 4 set_mon_vals no callback set 2024-08-18T21:07:32.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bb8ff9640 10 monclient: dump: 2024-08-18T21:07:32.374 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.374 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.374 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.374 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.374 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.374 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.374 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.374 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.374 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.374 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.374 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.374 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.374 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.375 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.375 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.375 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 10 monclient: _renew_subs 2024-08-18T21:07:32.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:07:32.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.355+0000 7f2bc2369640 1 -- 172.21.15.5:0/361988741 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bbc139990 con 0x7f2bbc09b080 2024-08-18T21:07:32.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bc2369640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:32.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bc2369640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc137ff0 0x7f2bbc070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bc2369640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bc2369640 1 -- 172.21.15.5:0/361988741 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f2bbc051140 con 0x7f2bbc137ff0 2024-08-18T21:07:32.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bbb7fe640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc137ff0 0x7f2bbc070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bbb7fe640 10 monclient: get_auth_request con 0x7f2bbc137ff0 auth_method 0 2024-08-18T21:07:32.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bbb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bbb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bbb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bb8ff9640 1 -- 172.21.15.5:0/361988741 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f2bac0bc020 con 0x7f2bbc09b080 2024-08-18T21:07:32.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bbb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bbb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bbb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bb8ff9640 1 --2- 172.21.15.5:0/361988741 >> v2:172.21.15.157:6812/631023601 conn(0x7f2ba803bdb0 0x7f2ba803e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bbb7fe640 10 monclient(hunting): handle_auth_done global_id 74225 payload 824 2024-08-18T21:07:32.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bb8ff9640 1 -- 172.21.15.5:0/361988741 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(109..109 src has 22..109) ==== 3898+0+0 (secure 0 0 0) 0x7f2bac0e8270 con 0x7f2bbc09b080 2024-08-18T21:07:32.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bbb7fe640 1 -- 172.21.15.5:0/361988741 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2bbc074f20 con 0x7f2bbc137ff0 2024-08-18T21:07:32.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bc0906640 1 --2- 172.21.15.5:0/361988741 >> v2:172.21.15.157:6812/631023601 conn(0x7f2ba803bdb0 0x7f2ba803e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bc0906640 10 monclient: get_auth_request con 0x7f2ba803bdb0 auth_method 0 2024-08-18T21:07:32.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bbb7fe640 1 -- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc137ff0 msgr2=0x7f2bbc070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bbb7fe640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc137ff0 0x7f2bbc070010 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0a61b0 tx=0x7f2bb0011cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bb8ff9640 1 -- 172.21.15.5:0/361988741 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2bb000fd90 con 0x7f2bbc137ff0 2024-08-18T21:07:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bb8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:07:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bb8ff9640 10 monclient: dump: 2024-08-18T21:07:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.380 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.380 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.380 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.380 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.380 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.380 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.380 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.380 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bb8ff9640 1 -- 172.21.15.5:0/361988741 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2bb000fd90 con 0x7f2bbc137ff0 2024-08-18T21:07:32.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bb8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:32.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bb8ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:32.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bb8ff9640 1 -- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc137ff0 msgr2=0x7f2bbc070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bb8ff9640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc137ff0 0x7f2bbc070010 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0a61b0 tx=0x7f2bb0011cf0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bb8ff9640 1 -- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc137ff0 msgr2=0x7f2bbc070010 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:32.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.359+0000 7f2bb8ff9640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc137ff0 0x7f2bbc070010 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0a61b0 tx=0x7f2bb0011cf0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.363+0000 7f2bc0906640 1 --2- 172.21.15.5:0/361988741 >> v2:172.21.15.157:6812/631023601 conn(0x7f2ba803bdb0 0x7f2ba803e270 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc09e2b0 tx=0x7f2bb400b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.367+0000 7f2bc2369640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:32.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.367+0000 7f2bc2369640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc070550 0x7f2bbc070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.367+0000 7f2bc2369640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.367+0000 7f2bc2369640 1 -- 172.21.15.5:0/361988741 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f2bbc1397d0 con 0x7f2bbc070550 2024-08-18T21:07:32.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.367+0000 7f2bbb7fe640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc070550 0x7f2bbc070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.367+0000 7f2bbb7fe640 10 monclient: get_auth_request con 0x7f2bbc070550 auth_method 0 2024-08-18T21:07:32.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.367+0000 7f2bbb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.367+0000 7f2bbb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.367+0000 7f2bbb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.367+0000 7f2bbb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.367+0000 7f2bbb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.367+0000 7f2bbb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.367+0000 7f2bbb7fe640 10 monclient(hunting): handle_auth_done global_id 74234 payload 824 2024-08-18T21:07:32.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.367+0000 7f2bbb7fe640 1 -- 172.21.15.5:0/361988741 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2bbc09dfe0 con 0x7f2bbc070550 2024-08-18T21:07:32.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bbb7fe640 1 -- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc070550 msgr2=0x7f2bbc070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bbb7fe640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc070550 0x7f2bbc070960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0a61b0 tx=0x7f2bb00046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bb8ff9640 1 -- 172.21.15.5:0/361988741 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2bb00229e0 con 0x7f2bbc070550 2024-08-18T21:07:32.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bb8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:07:32.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bb8ff9640 10 monclient: dump: 2024-08-18T21:07:32.382 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.382 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.382 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.382 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.383 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.383 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.383 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.383 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.383 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.383 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.383 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.383 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.383 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.383 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.383 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.383 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bb8ff9640 1 -- 172.21.15.5:0/361988741 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9246 (secure 0 0 0) 0x7f2bb0022570 con 0x7f2bbc070550 2024-08-18T21:07:32.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bb8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:32.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bb8ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:32.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bb8ff9640 1 -- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc070550 msgr2=0x7f2bbc070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bb8ff9640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc070550 0x7f2bbc070960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0a61b0 tx=0x7f2bb00046d0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bb8ff9640 1 -- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc070550 msgr2=0x7f2bbc070960 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:32.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bb8ff9640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bbc070550 0x7f2bbc070960 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0a61b0 tx=0x7f2bb00046d0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.384 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:32.384 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:32.384 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:32.384 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:07:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 30175, 2024-08-18T21:07:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:07:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.407 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:32.407 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:32.407 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:32.407 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.407 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.407 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:32.407 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bc2369640 1 -- 172.21.15.5:0/361988741 >> v2:172.21.15.157:6812/631023601 conn(0x7f2ba803bdb0 msgr2=0x7f2ba803e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bc2369640 1 --2- 172.21.15.5:0/361988741 >> v2:172.21.15.157:6812/631023601 conn(0x7f2ba803bdb0 0x7f2ba803e270 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc09e2b0 tx=0x7f2bb400b040 comp rx=0 tx=0).stop 2024-08-18T21:07:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bc2369640 10 monclient: shutdown 2024-08-18T21:07:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bc2369640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bc2369640 1 -- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2bbc09b080 msgr2=0x7f2bbc0739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bc2369640 1 --2- 172.21.15.5:0/361988741 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2bbc09b080 0x7f2bbc0739d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2bac01ccb0 tx=0x7f2bac0191b0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bc0906640 1 -- 172.21.15.5:0/361988741 reap_dead start 2024-08-18T21:07:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bc0906640 1 -- 172.21.15.5:0/361988741 reap_dead start 2024-08-18T21:07:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bc2369640 1 -- 172.21.15.5:0/361988741 shutdown_connections 2024-08-18T21:07:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bc2369640 1 -- 172.21.15.5:0/361988741 >> 172.21.15.5:0/361988741 conn(0x7f2bbc0a50f0 msgr2=0x7f2bbc13bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bc2369640 1 -- 172.21.15.5:0/361988741 shutdown_connections 2024-08-18T21:07:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.371+0000 7f2bc2369640 1 -- 172.21.15.5:0/361988741 wait complete. 2024-08-18T21:07:32.409 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:32.409 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:07:32.410 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:07:32.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 10 monclient: get_monmap_and_config 2024-08-18T21:07:32.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 10 monclient: build_initial_monmap 2024-08-18T21:07:32.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 10 monclient: monmap: 2024-08-18T21:07:32.526 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:32.526 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.526 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:32.526031+0000 2024-08-18T21:07:32.526 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:32.526031+0000 2024-08-18T21:07:32.526 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:32.526 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.526 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:32.526 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:32.526 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:32.526 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:32.526 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:32.526 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:32.527 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 1 Processor -- start 2024-08-18T21:07:32.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 1 -- start start 2024-08-18T21:07:32.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 10 monclient: init 2024-08-18T21:07:32.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:32.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 10 monclient: _add_conns ranks=[3,7,2,5,0,8,9,1,4,10,6] 2024-08-18T21:07:32.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d0c139c00 0x7f8d0c139fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 10 monclient(hunting): picked mon.noname-g con 0x7f8d0c139c00 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8d0c06ce70 0x7f8d0c0a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 10 monclient(hunting): picked mon.noname-i con 0x7f8d0c06ce70 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:07:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8d0c0a4e30 0x7f8d0c0a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 10 monclient(hunting): picked mon.noname-b con 0x7f8d0c0a4e30 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f8d0c06cbb0 con 0x7f8d0c0a4e30 2024-08-18T21:07:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8d0c09dd10 con 0x7f8d0c139c00 2024-08-18T21:07:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f8d0c13a520 con 0x7f8d0c06ce70 2024-08-18T21:07:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d12984640 10 monclient(hunting): authenticate will time out at 1219.539664s 2024-08-18T21:07:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d10f21640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8d0c0a4e30 0x7f8d0c0a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d10f21640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8d0c0a4e30 0x7f8d0c0a5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:35732/0 (socket says 172.21.15.5:35732) 2024-08-18T21:07:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d10f21640 1 -- 172.21.15.5:0/3313015476 learned_addr learned my addr 172.21.15.5:0/3313015476 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d10f21640 10 monclient(hunting): get_auth_request con 0x7f8d0c0a4e30 auth_method 0 2024-08-18T21:07:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d10f21640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d10f21640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.523+0000 7f8d10f21640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d10f21640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d10f21640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d10f21640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d03fff640 1 --2- 172.21.15.5:0/3313015476 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8d0c06ce70 0x7f8d0c0a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d03fff640 10 monclient(hunting): get_auth_request con 0x7f8d0c06ce70 auth_method 0 2024-08-18T21:07:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d0bfff640 1 --2- 172.21.15.5:0/3313015476 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d0c139c00 0x7f8d0c139fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d03fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d03fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d0bfff640 10 monclient(hunting): get_auth_request con 0x7f8d0c139c00 auth_method 0 2024-08-18T21:07:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d0bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d0bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d0bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d10f21640 10 monclient(hunting): handle_auth_done global_id 74243 payload 274 2024-08-18T21:07:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d10f21640 1 -- 172.21.15.5:0/3313015476 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8d0c06ce70 msgr2=0x7f8d0c0a48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d10f21640 1 --2- 172.21.15.5:0/3313015476 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8d0c06ce70 0x7f8d0c0a48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d10f21640 1 -- 172.21.15.5:0/3313015476 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d0c139c00 msgr2=0x7f8d0c139fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:32.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d10f21640 1 --2- 172.21.15.5:0/3313015476 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d0c139c00 0x7f8d0c139fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d10f21640 10 monclient: _finish_hunting 0 2024-08-18T21:07:32.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d10f21640 1 monclient: found mon.noname-b 2024-08-18T21:07:32.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d10f21640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:32.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d10f21640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:07:32.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.527+0000 7f8d10f21640 1 -- 172.21.15.5:0/3313015476 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0c09dff0 con 0x7f8d0c0a4e30 2024-08-18T21:07:32.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.531+0000 7f8d10f21640 1 -- 172.21.15.5:0/3313015476 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8d0c0a4e30 msgr2=0x7f8d0c0a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.531+0000 7f8d10f21640 1 --2- 172.21.15.5:0/3313015476 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8d0c0a4e30 0x7f8d0c0a5290 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d04009eb0 tx=0x7f8d0401c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=596912381cb39025 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.531+0000 7f8d0b7fe640 1 -- 172.21.15.5:0/3313015476 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8d040090d0 con 0x7f8d0c0a4e30 2024-08-18T21:07:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.531+0000 7f8d0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.531+0000 7f8d0b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:07:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.531+0000 7f8d0b7fe640 10 monclient: dump: 2024-08-18T21:07:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.537 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.531+0000 7f8d0b7fe640 10 monclient: _finish_auth 0 2024-08-18T21:07:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.531+0000 7f8d0b7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:07:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.531+0000 7f8d0b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.531+0000 7f8d0b7fe640 1 -- 172.21.15.5:0/3313015476 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d040a6950 con 0x7f8d0c0a4e30 2024-08-18T21:07:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 5 monclient: authenticate success, global_id 74243 2024-08-18T21:07:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:07:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0b7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 4 set_mon_vals no callback set 2024-08-18T21:07:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0b7fe640 1 -- 172.21.15.5:0/3313015476 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8d040af480 con 0x7f8d0c0a4e30 2024-08-18T21:07:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:07:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0b7fe640 10 monclient: dump: 2024-08-18T21:07:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.539 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 10 monclient: shutdown 2024-08-18T21:07:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 -- 172.21.15.5:0/3313015476 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8d0c0a4e30 msgr2=0x7f8d0c0a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 --2- 172.21.15.5:0/3313015476 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8d0c0a4e30 0x7f8d0c0a5290 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d04009eb0 tx=0x7f8d0401c8f0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 -- 172.21.15.5:0/3313015476 shutdown_connections 2024-08-18T21:07:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 --2- 172.21.15.5:0/3313015476 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8d0c0a4e30 0x7f8d0c0a5290 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 --2- 172.21.15.5:0/3313015476 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8d0c06ce70 0x7f8d0c0a48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 --2- 172.21.15.5:0/3313015476 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d0c139c00 0x7f8d0c139fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 -- 172.21.15.5:0/3313015476 >> 172.21.15.5:0/3313015476 conn(0x7f8d0c0a6430 msgr2=0x7f8d0c068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 -- 172.21.15.5:0/3313015476 shutdown_connections 2024-08-18T21:07:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 -- 172.21.15.5:0/3313015476 wait complete. 2024-08-18T21:07:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 10 monclient: build_initial_monmap 2024-08-18T21:07:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 10 monclient: monmap: 2024-08-18T21:07:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:32.546 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 Processor -- start 2024-08-18T21:07:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 -- start start 2024-08-18T21:07:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 10 monclient: init 2024-08-18T21:07:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 10 monclient: _add_conns ranks=[4,7,1,2,0,3,8,5,6] 2024-08-18T21:07:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c06ce70 0x7f8d0c1318b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 10 monclient(hunting): picked mon.noname-c con 0x7f8d0c06ce70 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:07:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8d0c0a4e30 0x7f8d0c131df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 10 monclient(hunting): picked mon.noname-i con 0x7f8d0c0a4e30 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:07:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d0c139c00 0x7f8d0c13a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 10 monclient(hunting): picked mon.noname-f con 0x7f8d0c139c00 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:07:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0c1435c0 con 0x7f8d0c139c00 2024-08-18T21:07:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f8d0c09ece0 con 0x7f8d0c06ce70 2024-08-18T21:07:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f8d0c143740 con 0x7f8d0c0a4e30 2024-08-18T21:07:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d12984640 10 monclient(hunting): authenticate will time out at 1219.550306s 2024-08-18T21:07:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c06ce70 0x7f8d0c1318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c06ce70 0x7f8d0c1318b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:45276/0 (socket says 172.21.15.5:45276) 2024-08-18T21:07:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 1 -- 172.21.15.5:0/1864988256 learned_addr learned my addr 172.21.15.5:0/1864988256 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 10 monclient(hunting): get_auth_request con 0x7f8d0c06ce70 auth_method 0 2024-08-18T21:07:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d03fff640 1 --2- 172.21.15.5:0/1864988256 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8d0c0a4e30 0x7f8d0c131df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d10f21640 1 --2- 172.21.15.5:0/1864988256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d0c139c00 0x7f8d0c13a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d03fff640 10 monclient(hunting): get_auth_request con 0x7f8d0c0a4e30 auth_method 0 2024-08-18T21:07:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d03fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d03fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d10f21640 10 monclient(hunting): get_auth_request con 0x7f8d0c139c00 auth_method 0 2024-08-18T21:07:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d10f21640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d10f21640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d10f21640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 10 monclient(hunting): handle_auth_done global_id 5467 payload 824 2024-08-18T21:07:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 1 -- 172.21.15.5:0/1864988256 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8d0c0a4e30 msgr2=0x7f8d0c131df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 1 --2- 172.21.15.5:0/1864988256 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8d0c0a4e30 0x7f8d0c131df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 1 -- 172.21.15.5:0/1864988256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d0c139c00 msgr2=0x7f8d0c13a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 1 --2- 172.21.15.5:0/1864988256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d0c139c00 0x7f8d0c13a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:07:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 1 monclient: found mon.noname-c 2024-08-18T21:07:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:07:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.535+0000 7f8d0bfff640 1 -- 172.21.15.5:0/1864988256 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0c13e0a0 con 0x7f8d0c06ce70 2024-08-18T21:07:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d0bfff640 1 -- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c06ce70 msgr2=0x7f8d0c1318b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d0bfff640 1 --2- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c06ce70 0x7f8d0c1318b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00d620 tx=0x7f8cfc00dae0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d097fa640 1 -- 172.21.15.5:0/1864988256 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8cfc007380 con 0x7f8d0c06ce70 2024-08-18T21:07:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d097fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d097fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:07:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d097fa640 10 monclient: dump: 2024-08-18T21:07:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.551 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d097fa640 10 monclient: _finish_auth 0 2024-08-18T21:07:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d097fa640 10 monclient: _check_auth_tickets 2024-08-18T21:07:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d097fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d12984640 5 monclient: authenticate success, global_id 5467 2024-08-18T21:07:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d097fa640 1 -- 172.21.15.5:0/1864988256 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cfc019070 con 0x7f8d0c06ce70 2024-08-18T21:07:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d12984640 10 monclient: _renew_subs 2024-08-18T21:07:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d12984640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:07:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d12984640 1 -- 172.21.15.5:0/1864988256 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d0c13e380 con 0x7f8d0c06ce70 2024-08-18T21:07:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d097fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d097fa640 1 -- 172.21.15.5:0/1864988256 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8cfc00bca0 con 0x7f8d0c06ce70 2024-08-18T21:07:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d097fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d097fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:07:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d097fa640 10 monclient: dump: 2024-08-18T21:07:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.553 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d0affd640 4 set_mon_vals no callback set 2024-08-18T21:07:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d12984640 10 monclient: _renew_subs 2024-08-18T21:07:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d12984640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:07:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d12984640 1 -- 172.21.15.5:0/1864988256 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d0c13c020 con 0x7f8d0c06ce70 2024-08-18T21:07:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d12984640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d12984640 1 --2- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c13ac90 0x7f8d0c13b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d12984640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d12984640 1 -- 172.21.15.5:0/1864988256 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f8d0c051140 con 0x7f8d0c13ac90 2024-08-18T21:07:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d097fa640 1 -- 172.21.15.5:0/1864988256 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f8cfc00b830 con 0x7f8d0c06ce70 2024-08-18T21:07:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d03fff640 1 --2- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c13ac90 0x7f8d0c13b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d03fff640 10 monclient: get_auth_request con 0x7f8d0c13ac90 auth_method 0 2024-08-18T21:07:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d03fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d03fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d03fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d03fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d03fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d097fa640 1 --2- 172.21.15.5:0/1864988256 >> v2:172.21.15.157:6812/631023601 conn(0x7f8cec03bdc0 0x7f8cec03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d03fff640 10 monclient(hunting): handle_auth_done global_id 5476 payload 824 2024-08-18T21:07:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d097fa640 1 -- 172.21.15.5:0/1864988256 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(109..109 src has 22..109) ==== 3898+0+0 (secure 0 0 0) 0x7f8cfc00f040 con 0x7f8d0c06ce70 2024-08-18T21:07:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d03fff640 1 -- 172.21.15.5:0/1864988256 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d0c0a5290 con 0x7f8d0c13ac90 2024-08-18T21:07:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d10f21640 1 --2- 172.21.15.5:0/1864988256 >> v2:172.21.15.157:6812/631023601 conn(0x7f8cec03bdc0 0x7f8cec03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.539+0000 7f8d10f21640 10 monclient: get_auth_request con 0x7f8cec03bdc0 auth_method 0 2024-08-18T21:07:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.543+0000 7f8d03fff640 1 -- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c13ac90 msgr2=0x7f8d0c13b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.543+0000 7f8d03fff640 1 --2- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c13ac90 0x7f8d0c13b070 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c06d730 tx=0x7f8cf400f970 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.543+0000 7f8d097fa640 1 -- 172.21.15.5:0/1864988256 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8cf4019020 con 0x7f8d0c13ac90 2024-08-18T21:07:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.543+0000 7f8d097fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.543+0000 7f8d097fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:07:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.543+0000 7f8d097fa640 10 monclient: dump: 2024-08-18T21:07:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.559 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.543+0000 7f8d097fa640 1 -- 172.21.15.5:0/1864988256 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8cf4014880 con 0x7f8d0c13ac90 2024-08-18T21:07:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.543+0000 7f8d097fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.543+0000 7f8d097fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.543+0000 7f8d097fa640 1 -- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c13ac90 msgr2=0x7f8d0c13b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.543+0000 7f8d097fa640 1 --2- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c13ac90 0x7f8d0c13b070 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c06d730 tx=0x7f8cf400f970 comp rx=0 tx=0).stop 2024-08-18T21:07:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.543+0000 7f8d097fa640 1 -- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c13ac90 msgr2=0x7f8d0c13b070 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.543+0000 7f8d097fa640 1 --2- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c13ac90 0x7f8d0c13b070 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.543+0000 7f8d10f21640 1 --2- 172.21.15.5:0/1864988256 >> v2:172.21.15.157:6812/631023601 conn(0x7f8cec03bdc0 0x7f8cec03e280 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8d040ab000 tx=0x7f8d040a7000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d12984640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d12984640 1 --2- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c13b5b0 0x7f8d0c0a22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d12984640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d12984640 1 -- 172.21.15.5:0/1864988256 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f8d0c06c990 con 0x7f8d0c13b5b0 2024-08-18T21:07:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d03fff640 1 --2- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c13b5b0 0x7f8d0c0a22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d03fff640 10 monclient: get_auth_request con 0x7f8d0c13b5b0 auth_method 0 2024-08-18T21:07:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d03fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d03fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d03fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d03fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d03fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d03fff640 10 monclient(hunting): handle_auth_done global_id 5485 payload 824 2024-08-18T21:07:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d03fff640 1 -- 172.21.15.5:0/1864988256 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8d0c13dbd0 con 0x7f8d0c13b5b0 2024-08-18T21:07:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d03fff640 1 -- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c13b5b0 msgr2=0x7f8d0c0a22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d03fff640 1 --2- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c13b5b0 0x7f8d0c0a22f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8cf401a000 tx=0x7f8cf40046d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d097fa640 1 -- 172.21.15.5:0/1864988256 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8cf4019040 con 0x7f8d0c13b5b0 2024-08-18T21:07:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d097fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d097fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:07:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d097fa640 10 monclient: dump: 2024-08-18T21:07:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.561 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.562 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d097fa640 1 -- 172.21.15.5:0/1864988256 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f8cf4020a70 con 0x7f8d0c13b5b0 2024-08-18T21:07:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d097fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d097fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d097fa640 1 -- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c13b5b0 msgr2=0x7f8d0c0a22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d097fa640 1 --2- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c13b5b0 0x7f8d0c0a22f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8cf401a000 tx=0x7f8cf40046d0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d097fa640 1 -- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c13b5b0 msgr2=0x7f8d0c0a22f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:32.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d097fa640 1 --2- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c13b5b0 0x7f8d0c0a22f0 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8cf401a000 tx=0x7f8cf40046d0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.563 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:32.563 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:32.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:32.563 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:07:32.563 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:32.563 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 261669, 2024-08-18T21:07:32.564 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:32.564 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:32.564 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:32.564 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:32.564 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:32.564 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:32.564 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:32.564 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:32.564 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:32.564 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:32.564 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.564 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:07:32.564 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:32.564 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:32.565 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:32.565 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:32.565 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:32.565 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:32.565 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:32.565 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:32.565 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:32.565 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:32.565 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:32.565 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:32.565 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:32.565 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:32.565 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.565 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:32.566 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:32.566 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:32.566 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:32.566 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:32.566 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:32.566 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:32.566 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:32.566 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:32.566 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:32.566 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:32.566 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:32.566 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:32.566 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.567 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:32.567 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:32.567 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:32.567 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:32.567 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:32.567 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:32.567 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:32.567 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:32.567 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:32.567 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:32.567 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:32.567 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:32.567 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:32.568 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:32.568 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:32.568 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:32.568 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:32.568 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:32.568 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:32.568 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:32.568 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:32.568 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:32.568 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:32.568 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:32.568 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:32.568 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:32.568 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:32.569 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:32.569 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.569 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:32.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.569 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:32.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.569 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:32.569 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:32.569 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.569 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.569 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:32.569 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.570 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.570 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:32.570 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.570 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.570 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.570 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:32.570 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:32.570 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.570 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.570 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.571 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:32.571 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:32.571 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.571 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:32.571 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.571 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:32.572 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.572 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.572 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.572 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:32.572 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:32.572 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.572 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.572 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.572 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:32.572 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:32.572 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.573 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.573 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.573 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:32.573 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.573 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.573 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:32.573 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.573 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:32.574 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:32.574 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.574 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.574 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.574 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:32.574 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:32.574 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.574 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:32.575 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.575 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:32.575 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.575 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.575 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.575 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:32.575 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:32.575 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.575 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.576 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.576 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:32.576 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:32.576 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.576 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:32.576 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.576 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:32.577 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.577 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.577 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:32.577 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:32.577 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.577 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.577 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.577 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:32.577 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:32.578 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.578 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.578 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.578 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:32.578 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.578 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.578 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:32.578 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.578 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.578 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.579 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:32.579 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:32.579 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.579 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.579 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.579 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:32.579 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:32.579 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.579 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.579 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.580 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:32.580 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.580 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.580 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:32.580 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.580 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.580 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.580 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:32.580 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:32.580 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.581 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.581 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.581 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:32.581 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:32.581 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.581 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:32.581 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:32.582 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.582 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.582 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:32.582 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:32.582 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.582 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.582 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.582 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:32.583 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:32.583 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.583 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:32.583 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.583 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:32.583 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.583 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.583 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:32.584 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:32.584 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.584 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.584 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.584 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.584 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:32.584 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:32.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.584 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:32.584 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:32.585 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:32.585 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.585 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.585 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:07:32.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.585 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:32.585 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:32.585 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:07:32.585 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.585 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.585 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:32.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.585 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:32.585 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:32.586 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:07:32.586 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.586 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.586 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:32.586 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:32.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d12984640 1 -- 172.21.15.5:0/1864988256 >> v2:172.21.15.157:6812/631023601 conn(0x7f8cec03bdc0 msgr2=0x7f8cec03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d12984640 1 --2- 172.21.15.5:0/1864988256 >> v2:172.21.15.157:6812/631023601 conn(0x7f8cec03bdc0 0x7f8cec03e280 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8d040ab000 tx=0x7f8d040a7000 comp rx=0 tx=0).stop 2024-08-18T21:07:32.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d12984640 10 monclient: shutdown 2024-08-18T21:07:32.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d12984640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:32.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d12984640 1 -- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c06ce70 msgr2=0x7f8d0c1318b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d12984640 1 --2- 172.21.15.5:0/1864988256 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8d0c06ce70 0x7f8d0c1318b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00d620 tx=0x7f8cfc00dae0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d10f21640 1 -- 172.21.15.5:0/1864988256 reap_dead start 2024-08-18T21:07:32.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d10f21640 1 -- 172.21.15.5:0/1864988256 reap_dead start 2024-08-18T21:07:32.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d12984640 1 -- 172.21.15.5:0/1864988256 shutdown_connections 2024-08-18T21:07:32.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d12984640 1 -- 172.21.15.5:0/1864988256 >> 172.21.15.5:0/1864988256 conn(0x7f8d0c0a6430 msgr2=0x7f8d0c138ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:32.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.551+0000 7f8d12984640 1 -- 172.21.15.5:0/1864988256 shutdown_connections 2024-08-18T21:07:32.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.555+0000 7f8d12984640 1 -- 172.21.15.5:0/1864988256 wait complete. 2024-08-18T21:07:32.588 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:32.589 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:07:32.589 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:07:32.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 10 monclient: get_monmap_and_config 2024-08-18T21:07:32.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 10 monclient: build_initial_monmap 2024-08-18T21:07:32.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 10 monclient: monmap: 2024-08-18T21:07:32.705 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:32.705 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.705 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:32.705183+0000 2024-08-18T21:07:32.705 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:32.705183+0000 2024-08-18T21:07:32.706 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:32.706 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.706 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:32.706 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:32.706 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:32.706 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:32.706 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:32.706 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:32.706 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:32.706 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:32.707 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:32.707 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:32.707 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:32.707 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 1 Processor -- start 2024-08-18T21:07:32.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 1 -- start start 2024-08-18T21:07:32.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 10 monclient: init 2024-08-18T21:07:32.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:32.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 10 monclient: _add_conns ranks=[3,4,9,8,5,2,10,7,0,1,6] 2024-08-18T21:07:32.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefc40a6ce0 0x7fefc40a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 10 monclient(hunting): picked mon.noname-g con 0x7fefc40a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:32.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fefc40a7600 0x7fefc4139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 10 monclient(hunting): picked mon.noname-c con 0x7fefc40a7600 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:07:32.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fefc4139fe0 0x7fefc413a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 10 monclient(hunting): picked mon.noname-a con 0x7fefc4139fe0 addr v2:172.21.15.5:3300/0 2024-08-18T21:07:32.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fefc40a5000 con 0x7fefc4139fe0 2024-08-18T21:07:32.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fefc40a4360 con 0x7fefc40a6ce0 2024-08-18T21:07:32.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fefc40a45d0 con 0x7fefc40a7600 2024-08-18T21:07:32.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:32.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefca83c640 10 monclient(hunting): authenticate will time out at 1219.718886s 2024-08-18T21:07:32.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fefc4139fe0 0x7fefc413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fefc4139fe0 0x7fefc413a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41444/0 (socket says 172.21.15.5:41444) 2024-08-18T21:07:32.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc37fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fefc40a7600 0x7fefc4139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 1 -- 172.21.15.5:0/2584043736 learned_addr learned my addr 172.21.15.5:0/2584043736 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:32.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 10 monclient(hunting): get_auth_request con 0x7fefc4139fe0 auth_method 0 2024-08-18T21:07:32.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc37fe640 10 monclient(hunting): get_auth_request con 0x7fefc40a7600 auth_method 0 2024-08-18T21:07:32.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc3fff640 1 --2- 172.21.15.5:0/2584043736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefc40a6ce0 0x7fefc40a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 10 monclient(hunting): handle_auth_done global_id 74196 payload 274 2024-08-18T21:07:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 1 -- 172.21.15.5:0/2584043736 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fefc40a7600 msgr2=0x7fefc4139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 1 --2- 172.21.15.5:0/2584043736 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fefc40a7600 0x7fefc4139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 1 -- 172.21.15.5:0/2584043736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefc40a6ce0 msgr2=0x7fefc40a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 1 --2- 172.21.15.5:0/2584043736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefc40a6ce0 0x7fefc40a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 10 monclient: _finish_hunting 0 2024-08-18T21:07:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 1 monclient: found mon.noname-a 2024-08-18T21:07:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:32.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:07:32.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc8dd9640 1 -- 172.21.15.5:0/2584043736 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc40a32d0 con 0x7fefc4139fe0 2024-08-18T21:07:32.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc3fff640 10 monclient: get_auth_request con 0x7fefc40a6ce0 auth_method 0 2024-08-18T21:07:32.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.703+0000 7fefc3fff640 1 --2- 172.21.15.5:0/2584043736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefc40a6ce0 0x7fefc40a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:07:32.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.707+0000 7fefc8dd9640 1 -- 172.21.15.5:0/2584043736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefc4139fe0 msgr2=0x7fefc413a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.707+0000 7fefc8dd9640 1 --2- 172.21.15.5:0/2584043736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefc4139fe0 0x7fefc413a440 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009e50 tx=0x7fefbc01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e45c526d4445e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.707+0000 7fefc2ffd640 1 -- 172.21.15.5:0/2584043736 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefbc0090d0 con 0x7fefc4139fe0 2024-08-18T21:07:32.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.707+0000 7fefc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.707+0000 7fefc2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:07:32.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.707+0000 7fefc2ffd640 10 monclient: dump: 2024-08-18T21:07:32.719 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.721 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.707+0000 7fefc2ffd640 10 monclient: _finish_auth 0 2024-08-18T21:07:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.707+0000 7fefc2ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:07:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.707+0000 7fefc2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.707+0000 7fefca83c640 5 monclient: authenticate success, global_id 74196 2024-08-18T21:07:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.707+0000 7fefc2ffd640 1 -- 172.21.15.5:0/2584043736 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefbc0a5a90 con 0x7fefc4139fe0 2024-08-18T21:07:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.707+0000 7fefca83c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:07:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc2ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc2ffd640 1 -- 172.21.15.5:0/2584043736 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefbc0a5c40 con 0x7fefc4139fe0 2024-08-18T21:07:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:07:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc2ffd640 10 monclient: dump: 2024-08-18T21:07:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.723 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 4 set_mon_vals no callback set 2024-08-18T21:07:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 10 monclient: shutdown 2024-08-18T21:07:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 -- 172.21.15.5:0/2584043736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefc4139fe0 msgr2=0x7fefc413a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 --2- 172.21.15.5:0/2584043736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefc4139fe0 0x7fefc413a440 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009e50 tx=0x7fefbc01c8f0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 -- 172.21.15.5:0/2584043736 shutdown_connections 2024-08-18T21:07:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 --2- 172.21.15.5:0/2584043736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefc4139fe0 0x7fefc413a440 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 --2- 172.21.15.5:0/2584043736 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fefc40a7600 0x7fefc4139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 --2- 172.21.15.5:0/2584043736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefc40a6ce0 0x7fefc40a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 -- 172.21.15.5:0/2584043736 >> 172.21.15.5:0/2584043736 conn(0x7fefc40acbc0 msgr2=0x7fefc40a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 -- 172.21.15.5:0/2584043736 shutdown_connections 2024-08-18T21:07:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 -- 172.21.15.5:0/2584043736 wait complete. 2024-08-18T21:07:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 10 monclient: build_initial_monmap 2024-08-18T21:07:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 10 monclient: monmap: 2024-08-18T21:07:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:32.725 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 Processor -- start 2024-08-18T21:07:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 -- start start 2024-08-18T21:07:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 10 monclient: init 2024-08-18T21:07:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 10 monclient: _add_conns ranks=[7,1,4,5,6,0,2,8,3] 2024-08-18T21:07:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fefc40a6ce0 0x7fefc4134cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 10 monclient(hunting): picked mon.noname-i con 0x7fefc40a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:07:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefc40a7600 0x7fefc41351f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 10 monclient(hunting): picked mon.noname-f con 0x7fefc40a7600 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:07:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fefc4139fe0 0x7fefc413aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 10 monclient(hunting): picked mon.noname-c con 0x7fefc4139fe0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:07:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fefc40a79e0 con 0x7fefc40a7600 2024-08-18T21:07:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fefc40a8220 con 0x7fefc4139fe0 2024-08-18T21:07:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fefc413ed60 con 0x7fefc40a6ce0 2024-08-18T21:07:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefca83c640 10 monclient(hunting): authenticate will time out at 1219.726080s 2024-08-18T21:07:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fefc4139fe0 0x7fefc413aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fefc4139fe0 0x7fefc413aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:45314/0 (socket says 172.21.15.5:45314) 2024-08-18T21:07:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 1 -- 172.21.15.5:0/419031486 learned_addr learned my addr 172.21.15.5:0/419031486 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 10 monclient(hunting): get_auth_request con 0x7fefc4139fe0 auth_method 0 2024-08-18T21:07:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc3fff640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fefc40a6ce0 0x7fefc4134cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc37fe640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefc40a7600 0x7fefc41351f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc37fe640 10 monclient(hunting): get_auth_request con 0x7fefc40a7600 auth_method 0 2024-08-18T21:07:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc3fff640 10 monclient(hunting): get_auth_request con 0x7fefc40a6ce0 auth_method 0 2024-08-18T21:07:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 10 monclient(hunting): handle_auth_done global_id 5503 payload 824 2024-08-18T21:07:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 1 -- 172.21.15.5:0/419031486 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fefc40a6ce0 msgr2=0x7fefc4134cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fefc40a6ce0 0x7fefc4134cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 1 -- 172.21.15.5:0/419031486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefc40a7600 msgr2=0x7fefc41351f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefc40a7600 0x7fefc41351f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 10 monclient: _finish_hunting 0 2024-08-18T21:07:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 1 monclient: found mon.noname-c 2024-08-18T21:07:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:07:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc8dd9640 1 -- 172.21.15.5:0/419031486 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc413e330 con 0x7fefc4139fe0 2024-08-18T21:07:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.711+0000 7fefc37fe640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefc40a7600 0x7fefc41351f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:07:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc8dd9640 1 -- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fefc4139fe0 msgr2=0x7fefc413aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc8dd9640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fefc4139fe0 0x7fefc413aa40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009040 tx=0x7fefbc019690 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc0ff9640 1 -- 172.21.15.5:0/419031486 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefbc0bc020 con 0x7fefc4139fe0 2024-08-18T21:07:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:07:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc0ff9640 10 monclient: dump: 2024-08-18T21:07:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.731 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc0ff9640 10 monclient: _finish_auth 0 2024-08-18T21:07:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc0ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:07:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc0ff9640 1 -- 172.21.15.5:0/419031486 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefbc0044b0 con 0x7fefc4139fe0 2024-08-18T21:07:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefca83c640 5 monclient: authenticate success, global_id 5503 2024-08-18T21:07:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefca83c640 10 monclient: _renew_subs 2024-08-18T21:07:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefca83c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:07:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefca83c640 1 -- 172.21.15.5:0/419031486 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc413d7f0 con 0x7fefc4139fe0 2024-08-18T21:07:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc0ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc0ff9640 1 -- 172.21.15.5:0/419031486 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefbc004660 con 0x7fefc4139fe0 2024-08-18T21:07:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:07:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc0ff9640 10 monclient: dump: 2024-08-18T21:07:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.733 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefca83c640 10 monclient: _renew_subs 2024-08-18T21:07:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc27fc640 4 set_mon_vals no callback set 2024-08-18T21:07:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefca83c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:07:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefca83c640 1 -- 172.21.15.5:0/419031486 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc413e050 con 0x7fefc4139fe0 2024-08-18T21:07:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefca83c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefca83c640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fefc4063b30 0x7fefc4063f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefca83c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefca83c640 1 -- 172.21.15.5:0/419031486 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fefc40a7b60 con 0x7fefc4063b30 2024-08-18T21:07:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc3fff640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fefc4063b30 0x7fefc4063f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc3fff640 10 monclient: get_auth_request con 0x7fefc4063b30 auth_method 0 2024-08-18T21:07:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc0ff9640 1 -- 172.21.15.5:0/419031486 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fefbc0bf020 con 0x7fefc4139fe0 2024-08-18T21:07:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc0ff9640 1 --2- 172.21.15.5:0/419031486 >> v2:172.21.15.157:6812/631023601 conn(0x7fefb003bdc0 0x7fefb003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc0ff9640 1 -- 172.21.15.5:0/419031486 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(109..109 src has 22..109) ==== 3898+0+0 (secure 0 0 0) 0x7fefbc0b3040 con 0x7fefc4139fe0 2024-08-18T21:07:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc3fff640 10 monclient(hunting): handle_auth_done global_id 54537 payload 824 2024-08-18T21:07:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc3fff640 1 -- 172.21.15.5:0/419031486 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fefc413db80 con 0x7fefc4063b30 2024-08-18T21:07:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc37fe640 1 --2- 172.21.15.5:0/419031486 >> v2:172.21.15.157:6812/631023601 conn(0x7fefb003bdc0 0x7fefb003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.715+0000 7fefc37fe640 10 monclient: get_auth_request con 0x7fefb003bdc0 auth_method 0 2024-08-18T21:07:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.719+0000 7fefc3fff640 1 -- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fefc4063b30 msgr2=0x7fefc4063f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.719+0000 7fefc3fff640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fefc4063b30 0x7fefc4063f10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fefb400e770 tx=0x7fefb400ec30 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.719+0000 7fefc0ff9640 1 -- 172.21.15.5:0/419031486 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefb4019070 con 0x7fefc4063b30 2024-08-18T21:07:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.719+0000 7fefc0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.719+0000 7fefc0ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:07:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.719+0000 7fefc0ff9640 10 monclient: dump: 2024-08-18T21:07:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.739 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.719+0000 7fefc0ff9640 1 -- 172.21.15.5:0/419031486 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fefb400aba0 con 0x7fefc4063b30 2024-08-18T21:07:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.719+0000 7fefc0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.719+0000 7fefc0ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.719+0000 7fefc0ff9640 1 -- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fefc4063b30 msgr2=0x7fefc4063f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.719+0000 7fefc0ff9640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fefc4063b30 0x7fefc4063f10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fefb400e770 tx=0x7fefb400ec30 comp rx=0 tx=0).stop 2024-08-18T21:07:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.719+0000 7fefc0ff9640 1 -- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fefc4063b30 msgr2=0x7fefc4063f10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.719+0000 7fefc0ff9640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fefc4063b30 0x7fefc4063f10 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fefb400e770 tx=0x7fefb400ec30 comp rx=0 tx=0).stop 2024-08-18T21:07:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.719+0000 7fefc37fe640 1 --2- 172.21.15.5:0/419031486 >> v2:172.21.15.157:6812/631023601 conn(0x7fefb003bdc0 0x7fefb003e280 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fefc40a2670 tx=0x7fefb8008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.723+0000 7fefca83c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.723+0000 7fefca83c640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fefc402d1d0 0x7fefc402d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.723+0000 7fefca83c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.723+0000 7fefca83c640 1 -- 172.21.15.5:0/419031486 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fefc4051140 con 0x7fefc402d1d0 2024-08-18T21:07:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.723+0000 7fefc3fff640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fefc402d1d0 0x7fefc402d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.723+0000 7fefc3fff640 10 monclient: get_auth_request con 0x7fefc402d1d0 auth_method 0 2024-08-18T21:07:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.723+0000 7fefc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.723+0000 7fefc3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.723+0000 7fefc3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.723+0000 7fefc3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.723+0000 7fefc3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.723+0000 7fefc3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.723+0000 7fefc3fff640 10 monclient(hunting): handle_auth_done global_id 54546 payload 824 2024-08-18T21:07:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.723+0000 7fefc3fff640 1 -- 172.21.15.5:0/419031486 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fefc4139aa0 con 0x7fefc402d1d0 2024-08-18T21:07:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefc3fff640 1 -- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fefc402d1d0 msgr2=0x7fefc402d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefc3fff640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fefc402d1d0 0x7fefc402d5e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fefb400e770 tx=0x7fefb40046d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefc0ff9640 1 -- 172.21.15.5:0/419031486 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefb401ee30 con 0x7fefc402d1d0 2024-08-18T21:07:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefc0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefc0ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:07:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefc0ff9640 10 monclient: dump: 2024-08-18T21:07:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.742 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.742 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.742 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.742 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.742 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.742 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.742 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.742 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.742 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.742 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.742 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.742 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.743 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefc0ff9640 1 -- 172.21.15.5:0/419031486 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7fefb4003620 con 0x7fefc402d1d0 2024-08-18T21:07:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefc0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefc0ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefc0ff9640 1 -- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fefc402d1d0 msgr2=0x7fefc402d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefc0ff9640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fefc402d1d0 0x7fefc402d5e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fefb400e770 tx=0x7fefb40046d0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefc0ff9640 1 -- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fefc402d1d0 msgr2=0x7fefc402d5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefc0ff9640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fefc402d1d0 0x7fefc402d5e0 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fefb400e770 tx=0x7fefb40046d0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.743 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:32.744 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:32.744 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:32.744 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:07:32.744 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:32.744 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 108845, 2024-08-18T21:07:32.744 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:32.744 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:32.744 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:32.744 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:32.744 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:32.744 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:32.745 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:32.745 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:32.745 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:32.745 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:32.745 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.745 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:07:32.745 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:32.745 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:32.745 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:32.745 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:32.745 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:32.745 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:32.745 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:32.746 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:32.746 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:32.746 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:32.746 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:32.746 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:32.746 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:32.746 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:32.746 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.746 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:32.746 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:32.746 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:32.747 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:32.747 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:32.747 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:32.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:32.747 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:32.747 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:32.747 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:32.747 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:32.747 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:32.747 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:32.747 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.747 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:32.748 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:32.748 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:32.748 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:32.748 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:32.748 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:32.748 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:32.748 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:32.748 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:32.748 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:32.748 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:32.748 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:32.748 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:32.748 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:32.749 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:32.749 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:32.749 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:32.749 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:32.749 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:32.749 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:32.749 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:32.749 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:32.749 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:32.749 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:32.749 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:32.749 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:32.749 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:32.750 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:32.750 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.750 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:32.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.750 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:32.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.750 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:32.750 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:32.750 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:32.751 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.751 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.751 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:32.751 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.751 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.751 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.751 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:32.751 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:32.751 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.752 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.752 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.752 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:32.752 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:32.752 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:32.752 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:32.753 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.753 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.753 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:32.753 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:32.753 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.753 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.753 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.754 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:32.754 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:32.754 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.754 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:32.754 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.754 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:32.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.755 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.755 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:32.755 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:32.755 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.755 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.755 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.755 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:32.755 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:32.755 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.756 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:32.756 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.756 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:32.756 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.756 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.756 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:32.757 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:32.757 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.757 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.757 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.757 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:32.757 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:32.757 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:32.758 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:32.758 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.758 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.758 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:32.758 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:32.758 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.759 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.759 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.759 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:32.759 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:32.759 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.759 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:32.759 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:32.760 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.760 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:32.760 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:32.760 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.760 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.760 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.760 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:32.761 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:32.761 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.761 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.761 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.761 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:32.761 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.761 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.761 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:32.761 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.761 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.762 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.762 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:32.762 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:32.762 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.762 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.762 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.762 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:32.762 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:32.762 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.763 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.763 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.763 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.763 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:32.763 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.763 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.763 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.763 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.763 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:32.763 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.763 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.763 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.764 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:32.764 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:32.764 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.764 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.764 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.764 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:32.764 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:32.764 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.764 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.765 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.765 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:32.765 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.765 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.765 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:32.765 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.765 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.765 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.765 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:32.765 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:32.766 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.766 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.766 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.766 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.766 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.766 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:32.766 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:32.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.766 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:32.766 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:32.766 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:32.766 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.767 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.767 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:32.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.767 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:32.767 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:32.767 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:07:32.767 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.767 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.767 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:32.767 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:32.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefca83c640 1 -- 172.21.15.5:0/419031486 >> v2:172.21.15.157:6812/631023601 conn(0x7fefb003bdc0 msgr2=0x7fefb003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefca83c640 1 --2- 172.21.15.5:0/419031486 >> v2:172.21.15.157:6812/631023601 conn(0x7fefb003bdc0 0x7fefb003e280 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fefc40a2670 tx=0x7fefb8008040 comp rx=0 tx=0).stop 2024-08-18T21:07:32.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefca83c640 10 monclient: shutdown 2024-08-18T21:07:32.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefca83c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:32.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefca83c640 1 -- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fefc4139fe0 msgr2=0x7fefc413aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefca83c640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fefc4139fe0 0x7fefc413aa40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009040 tx=0x7fefbc019690 comp rx=0 tx=0).stop 2024-08-18T21:07:32.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefc8dd9640 1 -- 172.21.15.5:0/419031486 reap_dead start 2024-08-18T21:07:32.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefca83c640 1 -- 172.21.15.5:0/419031486 shutdown_connections 2024-08-18T21:07:32.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefca83c640 1 --2- 172.21.15.5:0/419031486 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fefc4139fe0 0x7fefc413aa40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefca83c640 1 -- 172.21.15.5:0/419031486 >> 172.21.15.5:0/419031486 conn(0x7fefc40acbc0 msgr2=0x7fefc41383b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:32.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefca83c640 1 -- 172.21.15.5:0/419031486 shutdown_connections 2024-08-18T21:07:32.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.727+0000 7fefca83c640 1 -- 172.21.15.5:0/419031486 wait complete. 2024-08-18T21:07:32.770 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:32.770 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:07:32.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:07:32.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 10 monclient: get_monmap_and_config 2024-08-18T21:07:32.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 10 monclient: build_initial_monmap 2024-08-18T21:07:32.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 10 monclient: monmap: 2024-08-18T21:07:32.882 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:32.883011+0000 2024-08-18T21:07:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:32.883011+0000 2024-08-18T21:07:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:32.884 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 1 Processor -- start 2024-08-18T21:07:32.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 1 -- start start 2024-08-18T21:07:32.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 10 monclient: init 2024-08-18T21:07:32.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:32.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 10 monclient: _add_conns ranks=[9,7,3,5,6,10,2,1,8,0,4] 2024-08-18T21:07:32.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f139c068700 0x7f139c068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 10 monclient(hunting): picked mon.noname-a con 0x7f139c068700 addr v2:172.21.15.5:3300/0 2024-08-18T21:07:32.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f139c0745e0 0x7f139c069020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 10 monclient(hunting): picked mon.noname-i con 0x7f139c0745e0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:07:32.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f139c1367f0 0x7f139c136ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 10 monclient(hunting): picked mon.noname-g con 0x7f139c1367f0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:32.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f139c0a1a00 con 0x7f139c068700 2024-08-18T21:07:32.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f139c069750 con 0x7f139c1367f0 2024-08-18T21:07:32.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f139c09f6b0 con 0x7f139c0745e0 2024-08-18T21:07:32.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:32.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a2f16640 10 monclient(hunting): authenticate will time out at 1219.895740s 2024-08-18T21:07:32.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a0cb2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f139c068700 0x7f139c068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a0cb2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f139c068700 0x7f139c068ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41446/0 (socket says 172.21.15.5:41446) 2024-08-18T21:07:32.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a0cb2640 1 -- 172.21.15.5:0/959482358 learned_addr learned my addr 172.21.15.5:0/959482358 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:32.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a0cb2640 10 monclient(hunting): get_auth_request con 0x7f139c068700 auth_method 0 2024-08-18T21:07:32.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a0cb2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a0cb2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.879+0000 7f13a0cb2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f13a0cb2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f13a0cb2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f13a0cb2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f1393fff640 1 --2- 172.21.15.5:0/959482358 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f139c0745e0 0x7f139c069020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f1393fff640 10 monclient(hunting): get_auth_request con 0x7f139c0745e0 auth_method 0 2024-08-18T21:07:32.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f1393fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f1393fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f1393fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f13a0cb2640 10 monclient(hunting): handle_auth_done global_id 74205 payload 274 2024-08-18T21:07:32.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f13a0cb2640 1 -- 172.21.15.5:0/959482358 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f139c0745e0 msgr2=0x7f139c069020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:32.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f13a0cb2640 1 --2- 172.21.15.5:0/959482358 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f139c0745e0 0x7f139c069020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f13a14b3640 1 --2- 172.21.15.5:0/959482358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f139c1367f0 0x7f139c136ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f13a0cb2640 1 -- 172.21.15.5:0/959482358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f139c1367f0 msgr2=0x7f139c136ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:32.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f13a0cb2640 1 --2- 172.21.15.5:0/959482358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f139c1367f0 0x7f139c136ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f13a0cb2640 10 monclient: _finish_hunting 0 2024-08-18T21:07:32.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f13a0cb2640 1 monclient: found mon.noname-a 2024-08-18T21:07:32.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f13a0cb2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:32.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f13a0cb2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:07:32.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.883+0000 7f13a0cb2640 1 -- 172.21.15.5:0/959482358 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139c0a0ff0 con 0x7f139c068700 2024-08-18T21:07:32.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 1 -- 172.21.15.5:0/959482358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f139c068700 msgr2=0x7f139c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 1 --2- 172.21.15.5:0/959482358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f139c068700 0x7f139c068ae0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1398009870 tx=0x7f139801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfc020135e27a0a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13937fe640 1 -- 172.21.15.5:0/959482358 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13980b0070 con 0x7f139c068700 2024-08-18T21:07:32.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13937fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:07:32.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13937fe640 10 monclient: dump: 2024-08-18T21:07:32.899 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.899 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.899 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.899 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.899 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.899 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.899 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.899 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.899 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.899 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.899 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.899 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.899 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.900 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.900 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.900 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13937fe640 10 monclient: _finish_auth 0 2024-08-18T21:07:32.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13937fe640 10 monclient: _check_auth_tickets 2024-08-18T21:07:32.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:32.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13937fe640 1 -- 172.21.15.5:0/959482358 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13980aa810 con 0x7f139c068700 2024-08-18T21:07:32.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13937fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:32.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13937fe640 1 -- 172.21.15.5:0/959482358 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13980aae30 con 0x7f139c068700 2024-08-18T21:07:32.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 5 monclient: authenticate success, global_id 74205 2024-08-18T21:07:32.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:32.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 4 set_mon_vals no callback set 2024-08-18T21:07:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13937fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:07:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13937fe640 10 monclient: dump: 2024-08-18T21:07:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.902 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 10 monclient: shutdown 2024-08-18T21:07:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 -- 172.21.15.5:0/959482358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f139c068700 msgr2=0x7f139c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 --2- 172.21.15.5:0/959482358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f139c068700 0x7f139c068ae0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1398009870 tx=0x7f139801c420 comp rx=0 tx=0).stop 2024-08-18T21:07:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 -- 172.21.15.5:0/959482358 shutdown_connections 2024-08-18T21:07:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 --2- 172.21.15.5:0/959482358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f139c1367f0 0x7f139c136ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 --2- 172.21.15.5:0/959482358 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f139c0745e0 0x7f139c069020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 --2- 172.21.15.5:0/959482358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f139c068700 0x7f139c068ae0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 -- 172.21.15.5:0/959482358 >> 172.21.15.5:0/959482358 conn(0x7f139c0a8020 msgr2=0x7f139c0a8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:32.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 -- 172.21.15.5:0/959482358 shutdown_connections 2024-08-18T21:07:32.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 -- 172.21.15.5:0/959482358 wait complete. 2024-08-18T21:07:32.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 10 monclient: build_initial_monmap 2024-08-18T21:07:32.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 10 monclient: monmap: 2024-08-18T21:07:32.903 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:32.903 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:32.903 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:32.903 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:32.904 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 Processor -- start 2024-08-18T21:07:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 -- start start 2024-08-18T21:07:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 10 monclient: init 2024-08-18T21:07:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 10 monclient: _add_conns ranks=[6,7,1,2,8,0,4,3,5] 2024-08-18T21:07:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f139c068700 0x7f139c11e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 10 monclient(hunting): picked mon.noname-d con 0x7f139c068700 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f139c0745e0 0x7f139c11ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 10 monclient(hunting): picked mon.noname-i con 0x7f139c0745e0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:07:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f139c1367f0 0x7f139c11f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 10 monclient(hunting): picked mon.noname-f con 0x7f139c1367f0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:07:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f139c09e240 con 0x7f139c1367f0 2024-08-18T21:07:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f139c069560 con 0x7f139c068700 2024-08-18T21:07:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f139c09e3c0 con 0x7f139c0745e0 2024-08-18T21:07:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a2f16640 10 monclient(hunting): authenticate will time out at 1219.903247s 2024-08-18T21:07:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f139c068700 0x7f139c11e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f139c068700 0x7f139c11e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:60874/0 (socket says 172.21.15.5:60874) 2024-08-18T21:07:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 1 -- 172.21.15.5:0/932375188 learned_addr learned my addr 172.21.15.5:0/932375188 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 10 monclient(hunting): get_auth_request con 0x7f139c068700 auth_method 0 2024-08-18T21:07:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a14b3640 1 --2- 172.21.15.5:0/932375188 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f139c1367f0 0x7f139c11f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f1393fff640 1 --2- 172.21.15.5:0/932375188 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f139c0745e0 0x7f139c11ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a14b3640 10 monclient(hunting): get_auth_request con 0x7f139c1367f0 auth_method 0 2024-08-18T21:07:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a14b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a14b3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a14b3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f1393fff640 10 monclient(hunting): get_auth_request con 0x7f139c0745e0 auth_method 0 2024-08-18T21:07:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f1393fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f1393fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f1393fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 10 monclient(hunting): handle_auth_done global_id 54555 payload 824 2024-08-18T21:07:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 1 -- 172.21.15.5:0/932375188 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f139c0745e0 msgr2=0x7f139c11ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 1 --2- 172.21.15.5:0/932375188 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f139c0745e0 0x7f139c11ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 1 -- 172.21.15.5:0/932375188 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f139c1367f0 msgr2=0x7f139c11f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 1 --2- 172.21.15.5:0/932375188 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f139c1367f0 0x7f139c11f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 10 monclient: _finish_hunting 0 2024-08-18T21:07:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 1 monclient: found mon.noname-d 2024-08-18T21:07:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:07:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.887+0000 7f13a0cb2640 1 -- 172.21.15.5:0/932375188 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139c0a85e0 con 0x7f139c068700 2024-08-18T21:07:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13a0cb2640 1 -- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f139c068700 msgr2=0x7f139c11e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13a0cb2640 1 --2- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f139c068700 0x7f139c11e670 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f139801c250 tx=0x7f13980191c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13917fa640 1 -- 172.21.15.5:0/932375188 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13980b9070 con 0x7f139c068700 2024-08-18T21:07:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13917fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:07:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13917fa640 10 monclient: dump: 2024-08-18T21:07:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.910 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13917fa640 10 monclient: _finish_auth 0 2024-08-18T21:07:32.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13917fa640 10 monclient: _check_auth_tickets 2024-08-18T21:07:32.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13917fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:32.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13917fa640 1 -- 172.21.15.5:0/932375188 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13980044b0 con 0x7f139c068700 2024-08-18T21:07:32.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13917fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:32.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13917fa640 1 -- 172.21.15.5:0/932375188 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13980b0040 con 0x7f139c068700 2024-08-18T21:07:32.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13917fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:07:32.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13917fa640 10 monclient: dump: 2024-08-18T21:07:32.910 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.910 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.912 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f1392ffd640 4 set_mon_vals no callback set 2024-08-18T21:07:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13a2f16640 5 monclient: authenticate success, global_id 54555 2024-08-18T21:07:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13a2f16640 10 monclient: _renew_subs 2024-08-18T21:07:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13a2f16640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:07:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13a2f16640 1 -- 172.21.15.5:0/932375188 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139c120880 con 0x7f139c068700 2024-08-18T21:07:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13a2f16640 10 monclient: _renew_subs 2024-08-18T21:07:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13a2f16640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:07:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13a2f16640 1 -- 172.21.15.5:0/932375188 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f139c0736d0 con 0x7f139c068700 2024-08-18T21:07:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13a2f16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13a2f16640 1 --2- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f139c1d0230 0x7f139c02d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13a2f16640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13a2f16640 1 -- 172.21.15.5:0/932375188 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f139c11ffd0 con 0x7f139c1d0230 2024-08-18T21:07:32.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f1393fff640 1 --2- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f139c1d0230 0x7f139c02d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f1393fff640 10 monclient: get_auth_request con 0x7f139c1d0230 auth_method 0 2024-08-18T21:07:32.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f1393fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f1393fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f1393fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13917fa640 1 -- 172.21.15.5:0/932375188 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f1398004040 con 0x7f139c068700 2024-08-18T21:07:32.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f1393fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f1393fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f1393fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f1393fff640 10 monclient(hunting): handle_auth_done global_id 54548 payload 824 2024-08-18T21:07:32.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f1393fff640 1 -- 172.21.15.5:0/932375188 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f139c136c60 con 0x7f139c1d0230 2024-08-18T21:07:32.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13917fa640 1 --2- 172.21.15.5:0/932375188 >> v2:172.21.15.157:6812/631023601 conn(0x7f138803bdf0 0x7f138803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13917fa640 1 -- 172.21.15.5:0/932375188 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(109..109 src has 22..109) ==== 3898+0+0 (secure 0 0 0) 0x7f13980e7c90 con 0x7f139c068700 2024-08-18T21:07:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13a14b3640 1 --2- 172.21.15.5:0/932375188 >> v2:172.21.15.157:6812/631023601 conn(0x7f138803bdf0 0x7f138803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.891+0000 7f13a14b3640 10 monclient: get_auth_request con 0x7f138803bdf0 auth_method 0 2024-08-18T21:07:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.895+0000 7f1393fff640 1 -- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f139c1d0230 msgr2=0x7f139c02d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.895+0000 7f1393fff640 1 --2- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f139c1d0230 0x7f139c02d1d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f139c13c510 tx=0x7f138c00f910 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.895+0000 7f13917fa640 1 -- 172.21.15.5:0/932375188 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f138c019020 con 0x7f139c1d0230 2024-08-18T21:07:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.895+0000 7f13917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.895+0000 7f13917fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:07:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.895+0000 7f13917fa640 10 monclient: dump: 2024-08-18T21:07:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.915 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.895+0000 7f13917fa640 1 -- 172.21.15.5:0/932375188 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f138c014880 con 0x7f139c1d0230 2024-08-18T21:07:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.895+0000 7f13917fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.895+0000 7f13917fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.895+0000 7f13917fa640 1 -- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f139c1d0230 msgr2=0x7f139c02d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.895+0000 7f13917fa640 1 --2- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f139c1d0230 0x7f139c02d1d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f139c13c510 tx=0x7f138c00f910 comp rx=0 tx=0).stop 2024-08-18T21:07:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.895+0000 7f13917fa640 1 -- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f139c1d0230 msgr2=0x7f139c02d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.895+0000 7f13917fa640 1 --2- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f139c1d0230 0x7f139c02d1d0 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f139c13c510 tx=0x7f138c00f910 comp rx=0 tx=0).stop 2024-08-18T21:07:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.895+0000 7f13a14b3640 1 --2- 172.21.15.5:0/932375188 >> v2:172.21.15.157:6812/631023601 conn(0x7f138803bdf0 0x7f138803e2b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f139c13d1d0 tx=0x7f13940073d0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13a2f16640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:32.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13a2f16640 1 --2- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f139c1d0610 0x7f139c02d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:32.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13a2f16640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:32.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13a2f16640 1 -- 172.21.15.5:0/932375188 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f139c051140 con 0x7f139c1d0610 2024-08-18T21:07:32.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f1393fff640 1 --2- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f139c1d0610 0x7f139c02d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:32.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f1393fff640 10 monclient: get_auth_request con 0x7f139c1d0610 auth_method 0 2024-08-18T21:07:32.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f1393fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:32.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f1393fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f1393fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f1393fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f1393fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f1393fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f1393fff640 10 monclient(hunting): handle_auth_done global_id 54557 payload 824 2024-08-18T21:07:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f1393fff640 1 -- 172.21.15.5:0/932375188 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f139c09e780 con 0x7f139c1d0610 2024-08-18T21:07:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f1393fff640 1 -- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f139c1d0610 msgr2=0x7f139c02d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f1393fff640 1 --2- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f139c1d0610 0x7f139c02d710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f138c01a000 tx=0x7f138c0046d0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13917fa640 1 -- 172.21.15.5:0/932375188 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f138c019040 con 0x7f139c1d0610 2024-08-18T21:07:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13917fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:07:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13917fa640 10 monclient: dump: 2024-08-18T21:07:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:32.920 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.920 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:32.920 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:32.920 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:32.920 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:32.920 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:32.920 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:32.920 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:32.920 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:32.920 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:32.920 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:32.920 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:32.920 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:32.920 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13917fa640 1 -- 172.21.15.5:0/932375188 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f138c004030 con 0x7f139c1d0610 2024-08-18T21:07:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13917fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13917fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13917fa640 1 -- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f139c1d0610 msgr2=0x7f139c02d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13917fa640 1 --2- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f139c1d0610 0x7f139c02d710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f138c01a000 tx=0x7f138c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13917fa640 1 -- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f139c1d0610 msgr2=0x7f139c02d710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13917fa640 1 --2- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f139c1d0610 0x7f139c02d710 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f138c01a000 tx=0x7f138c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.921 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:32.921 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:32.922 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:32.922 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:07:32.922 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:32.922 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 109025, 2024-08-18T21:07:32.922 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:32.922 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:32.922 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:32.922 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:32.922 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:32.922 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:32.922 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:32.922 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:32.922 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:32.923 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:32.923 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.923 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:07:32.923 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:32.923 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:32.923 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:32.923 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:32.923 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:32.923 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:32.923 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:32.923 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:32.923 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:32.924 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:32.924 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:32.924 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:32.924 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:32.924 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:32.924 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.924 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:32.924 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:32.924 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:32.924 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:32.924 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:32.924 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:32.924 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:32.924 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:32.925 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:32.925 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:32.925 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:32.925 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:32.925 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:32.925 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.925 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:32.925 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:32.925 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:32.925 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:32.925 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:32.925 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:32.926 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:32.926 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:32.926 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:32.926 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:32.926 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:32.926 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:32.926 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:32.926 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:32.926 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:32.926 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:32.926 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:32.926 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:32.926 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:32.927 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:32.927 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:32.927 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:32.927 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:32.927 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:32.927 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:32.927 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:32.927 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:32.927 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:32.927 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.927 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:32.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.928 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:32.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.928 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:32.928 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:32.928 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.928 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.928 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:32.928 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.929 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:32.929 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.929 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.929 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.929 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:32.929 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:32.929 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.929 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.929 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.929 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:32.929 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:32.930 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.930 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.930 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:32.930 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.930 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:32.930 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.930 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.930 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.931 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:32.931 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:32.931 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.931 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.931 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.931 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:32.931 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:32.931 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.931 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.932 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.932 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:32.932 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.932 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.932 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:32.932 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.932 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.932 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.932 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:32.932 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:32.933 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.933 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.933 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.933 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:32.933 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:32.933 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.933 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.933 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.933 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:32.933 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.934 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.934 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:32.934 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.934 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.934 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.934 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:32.934 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:32.934 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.934 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.934 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.935 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:32.935 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:32.935 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.935 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.935 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:32.935 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.936 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:32.936 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.936 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.936 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.936 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:32.936 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:32.936 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.936 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.936 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.936 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:32.937 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:32.937 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.937 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.937 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.937 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:32.937 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.937 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.937 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:32.937 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.938 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.938 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.938 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:32.938 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:32.938 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.938 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.938 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.938 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:32.938 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:32.938 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.939 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.939 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.939 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:32.939 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.939 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.939 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:32.939 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.939 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.939 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.939 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:32.940 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:32.940 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.940 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.940 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.940 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:32.940 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:32.940 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.940 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.940 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.940 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:32.941 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.941 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.941 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:32.941 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.941 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.941 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.941 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:32.941 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:32.941 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.941 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.941 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.942 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:32.942 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:32.942 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:32.942 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:32.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:32.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:32.943 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:32.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:32.943 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:32.943 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.943 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:32.944 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:32.944 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:32.944 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:32.944 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:32.944 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.944 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.944 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:32.944 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:32.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.944 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:32.944 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:32.945 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:32.945 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.945 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.945 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:07:32.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.945 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:32.945 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:32.945 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:07:32.945 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.945 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:32.945 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:32.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:32.945 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:32.946 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:32.946 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:32.946 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:32.946 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:32.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:32.946 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:32.946 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13a2f16640 1 -- 172.21.15.5:0/932375188 >> v2:172.21.15.157:6812/631023601 conn(0x7f138803bdf0 msgr2=0x7f138803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13a2f16640 1 --2- 172.21.15.5:0/932375188 >> v2:172.21.15.157:6812/631023601 conn(0x7f138803bdf0 0x7f138803e2b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f139c13d1d0 tx=0x7f13940073d0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13a2f16640 10 monclient: shutdown 2024-08-18T21:07:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13a2f16640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13a2f16640 1 -- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f139c068700 msgr2=0x7f139c11e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13a2f16640 1 --2- 172.21.15.5:0/932375188 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f139c068700 0x7f139c11e670 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f139801c250 tx=0x7f13980191c0 comp rx=0 tx=0).stop 2024-08-18T21:07:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13a14b3640 1 -- 172.21.15.5:0/932375188 reap_dead start 2024-08-18T21:07:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13a14b3640 1 -- 172.21.15.5:0/932375188 reap_dead start 2024-08-18T21:07:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13a2f16640 1 -- 172.21.15.5:0/932375188 shutdown_connections 2024-08-18T21:07:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13a2f16640 1 -- 172.21.15.5:0/932375188 >> 172.21.15.5:0/932375188 conn(0x7f139c0a8020 msgr2=0x7f139c071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13a2f16640 1 -- 172.21.15.5:0/932375188 shutdown_connections 2024-08-18T21:07:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:32.903+0000 7f13a2f16640 1 -- 172.21.15.5:0/932375188 wait complete. 2024-08-18T21:07:32.949 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:32.949 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:07:32.949 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:07:33.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 10 monclient: get_monmap_and_config 2024-08-18T21:07:33.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 10 monclient: build_initial_monmap 2024-08-18T21:07:33.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 10 monclient: monmap: 2024-08-18T21:07:33.060 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:33.061 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.061 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:33.061068+0000 2024-08-18T21:07:33.061 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:33.061068+0000 2024-08-18T21:07:33.061 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:33.061 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.061 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:33.061 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:33.061 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:33.061 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:33.061 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:33.062 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:33.062 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:33.062 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:33.062 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:33.062 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:33.062 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:33.062 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 1 Processor -- start 2024-08-18T21:07:33.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 1 -- start start 2024-08-18T21:07:33.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 10 monclient: init 2024-08-18T21:07:33.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 10 monclient: _add_conns ranks=[2,0,5,8,9,7,6,10,4,3,1] 2024-08-18T21:07:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95980a6bd0 0x7f95980a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 10 monclient(hunting): picked mon.noname-b con 0x7f95980a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f959809f080 addr v1:172.21.15.5:6789/0 2024-08-18T21:07:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f95980a74f0 0x7f959813a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 10 monclient(hunting): picked mon.noname-h con 0x7f95980a74f0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:07:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95980a7fb0 con 0x7f959809f080 2024-08-18T21:07:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f959809e4c0 con 0x7f95980a6bd0 2024-08-18T21:07:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f959806f930 con 0x7f95980a74f0 2024-08-18T21:07:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f95a0508640 10 monclient(hunting): authenticate will time out at 1220.074737s 2024-08-18T21:07:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959daa3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f959809f080 0x7f9598139990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49458/0 (socket says 172.21.15.5:49458) 2024-08-18T21:07:33.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959daa3640 1 -- 172.21.15.5:0/3624253997 learned_addr learned my addr 172.21.15.5:0/3624253997 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:07:33.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 1 --2- 172.21.15.5:0/3624253997 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95980a6bd0 0x7f95980a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 10 monclient(hunting): get_auth_request con 0x7f95980a6bd0 auth_method 0 2024-08-18T21:07:33.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959eaa5640 1 --2- 172.21.15.5:0/3624253997 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f95980a74f0 0x7f959813a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 10 monclient(hunting): handle_auth_done global_id 74252 payload 274 2024-08-18T21:07:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 1 -- 172.21.15.5:0/3624253997 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f95980a74f0 msgr2=0x7f959813a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 1 --2- 172.21.15.5:0/3624253997 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f95980a74f0 0x7f959813a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 1 -- 172.21.15.5:0/3624253997 >> v1:172.21.15.5:6789/0 conn(0x7f959809f080 legacy=0x7f9598139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 10 monclient: _finish_hunting 0 2024-08-18T21:07:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 1 monclient: found mon.noname-b 2024-08-18T21:07:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:07:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.059+0000 7f959e2a4640 1 -- 172.21.15.5:0/3624253997 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959809de70 con 0x7f95980a6bd0 2024-08-18T21:07:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f959e2a4640 1 -- 172.21.15.5:0/3624253997 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95980a6bd0 msgr2=0x7f95980a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f959e2a4640 1 --2- 172.21.15.5:0/3624253997 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95980a6bd0 0x7f95980a6fb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f95880097f0 tx=0x7f958801ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62e5ae039e71c533 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f959d2a2640 1 -- 172.21.15.5:0/3624253997 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f95880b0070 con 0x7f95980a6bd0 2024-08-18T21:07:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f959d2a2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f959d2a2640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:07:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f959d2a2640 10 monclient: dump: 2024-08-18T21:07:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.076 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f959d2a2640 10 monclient: _finish_auth 0 2024-08-18T21:07:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f959d2a2640 10 monclient: _check_auth_tickets 2024-08-18T21:07:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f959d2a2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f959d2a2640 1 -- 172.21.15.5:0/3624253997 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95880aa810 con 0x7f95980a6bd0 2024-08-18T21:07:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f959d2a2640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f959d2a2640 1 -- 172.21.15.5:0/3624253997 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f95880a4e60 con 0x7f95980a6bd0 2024-08-18T21:07:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f95a0508640 5 monclient: authenticate success, global_id 74252 2024-08-18T21:07:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f95a0508640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f95a0508640 4 set_mon_vals no callback set 2024-08-18T21:07:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f959d2a2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f959d2a2640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:07:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.063+0000 7f959d2a2640 10 monclient: dump: 2024-08-18T21:07:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.078 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 10 monclient: shutdown 2024-08-18T21:07:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 1 -- 172.21.15.5:0/3624253997 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95980a6bd0 msgr2=0x7f95980a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 1 --2- 172.21.15.5:0/3624253997 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95980a6bd0 0x7f95980a6fb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f95880097f0 tx=0x7f958801ce00 comp rx=0 tx=0).stop 2024-08-18T21:07:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 1 -- 172.21.15.5:0/3624253997 shutdown_connections 2024-08-18T21:07:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 1 --2- 172.21.15.5:0/3624253997 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f95980a74f0 0x7f959813a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 1 --2- 172.21.15.5:0/3624253997 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95980a6bd0 0x7f95980a6fb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 1 -- 172.21.15.5:0/3624253997 >> 172.21.15.5:0/3624253997 conn(0x7f9598068700 msgr2=0x7f9598068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 1 -- 172.21.15.5:0/3624253997 shutdown_connections 2024-08-18T21:07:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 1 -- 172.21.15.5:0/3624253997 wait complete. 2024-08-18T21:07:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 10 monclient: build_initial_monmap 2024-08-18T21:07:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 10 monclient: monmap: 2024-08-18T21:07:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:33.080 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 1 Processor -- start 2024-08-18T21:07:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 1 -- start start 2024-08-18T21:07:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 10 monclient: init 2024-08-18T21:07:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 10 monclient: _add_conns ranks=[2,7,6,5,0,4,3,8,1] 2024-08-18T21:07:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f959809f080 0x7f9598138d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 10 monclient(hunting): picked mon.noname-b con 0x7f959809f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f95980a6bd0 0x7f95981392a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 10 monclient(hunting): picked mon.noname-i con 0x7f95980a6bd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:07:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f95980a74f0 0x7f959813e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 10 monclient(hunting): picked mon.noname-d con 0x7f95980a74f0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f959813a5e0 con 0x7f959809f080 2024-08-18T21:07:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f95980a89f0 con 0x7f95980a74f0 2024-08-18T21:07:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f959813a760 con 0x7f95980a6bd0 2024-08-18T21:07:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f95a0508640 10 monclient(hunting): authenticate will time out at 1220.081870s 2024-08-18T21:07:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f959809f080 0x7f9598138d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f959809f080 0x7f9598138d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:35740/0 (socket says 172.21.15.5:35740) 2024-08-18T21:07:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 1 -- 172.21.15.5:0/136151589 learned_addr learned my addr 172.21.15.5:0/136151589 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 10 monclient(hunting): get_auth_request con 0x7f959809f080 auth_method 0 2024-08-18T21:07:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959eaa5640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f95980a74f0 0x7f959813e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959eaa5640 10 monclient(hunting): get_auth_request con 0x7f95980a74f0 auth_method 0 2024-08-18T21:07:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959eaa5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959eaa5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959eaa5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959eaa5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959eaa5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959eaa5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959daa3640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f95980a6bd0 0x7f95981392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959daa3640 10 monclient(hunting): get_auth_request con 0x7f95980a6bd0 auth_method 0 2024-08-18T21:07:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959daa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959daa3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959daa3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 10 monclient(hunting): handle_auth_done global_id 74261 payload 824 2024-08-18T21:07:33.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 1 -- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f95980a6bd0 msgr2=0x7f95981392a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f95980a6bd0 0x7f95981392a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 1 -- 172.21.15.5:0/136151589 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f95980a74f0 msgr2=0x7f959813e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f95980a74f0 0x7f959813e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 10 monclient: _finish_hunting 0 2024-08-18T21:07:33.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 1 monclient: found mon.noname-b 2024-08-18T21:07:33.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:33.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:07:33.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959e2a4640 1 -- 172.21.15.5:0/136151589 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95980a2e40 con 0x7f959809f080 2024-08-18T21:07:33.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.067+0000 7f959eaa5640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f95980a74f0 0x7f959813e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:07:33.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f959e2a4640 1 -- 172.21.15.5:0/136151589 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f959809f080 msgr2=0x7f9598138d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:33.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f959e2a4640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f959809f080 0x7f9598138d60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9588009710 tx=0x7f9588019140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f9596ffd640 1 -- 172.21.15.5:0/136151589 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f95880b0040 con 0x7f959809f080 2024-08-18T21:07:33.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f9596ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f9596ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:07:33.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f9596ffd640 10 monclient: dump: 2024-08-18T21:07:33.085 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.085 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.085 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.085 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.086 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f9596ffd640 10 monclient: _finish_auth 0 2024-08-18T21:07:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f9596ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:07:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f9596ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f9596ffd640 1 -- 172.21.15.5:0/136151589 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95880044b0 con 0x7f959809f080 2024-08-18T21:07:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f95a0508640 5 monclient: authenticate success, global_id 74261 2024-08-18T21:07:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f95a0508640 10 monclient: _renew_subs 2024-08-18T21:07:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f95a0508640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:07:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f95a0508640 1 -- 172.21.15.5:0/136151589 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9598123940 con 0x7f959809f080 2024-08-18T21:07:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f9596ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f9596ffd640 1 -- 172.21.15.5:0/136151589 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f95880aae10 con 0x7f959809f080 2024-08-18T21:07:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f9596ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f9596ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:07:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f9596ffd640 10 monclient: dump: 2024-08-18T21:07:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.089 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f959caa1640 4 set_mon_vals no callback set 2024-08-18T21:07:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f95a0508640 10 monclient: _renew_subs 2024-08-18T21:07:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f95a0508640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:07:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f95a0508640 1 -- 172.21.15.5:0/136151589 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9598123660 con 0x7f959809f080 2024-08-18T21:07:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f95a0508640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f95a0508640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959813eb40 0x7f959813ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f95a0508640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f95a0508640 1 -- 172.21.15.5:0/136151589 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9598051140 con 0x7f959813eb40 2024-08-18T21:07:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f9596ffd640 1 -- 172.21.15.5:0/136151589 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f9588004040 con 0x7f959809f080 2024-08-18T21:07:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f959daa3640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959813eb40 0x7f959813ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f9596ffd640 1 --2- 172.21.15.5:0/136151589 >> v2:172.21.15.157:6812/631023601 conn(0x7f958403bdc0 0x7f958403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f959daa3640 10 monclient: get_auth_request con 0x7f959813eb40 auth_method 0 2024-08-18T21:07:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f959daa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f959daa3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f959daa3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f9596ffd640 1 -- 172.21.15.5:0/136151589 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(109..109 src has 22..109) ==== 3898+0+0 (secure 0 0 0) 0x7f95880b9070 con 0x7f959809f080 2024-08-18T21:07:33.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f959daa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f959daa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f959daa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f959eaa5640 1 --2- 172.21.15.5:0/136151589 >> v2:172.21.15.157:6812/631023601 conn(0x7f958403bdc0 0x7f958403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f959eaa5640 10 monclient: get_auth_request con 0x7f958403bdc0 auth_method 0 2024-08-18T21:07:33.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f959daa3640 10 monclient(hunting): handle_auth_done global_id 5356 payload 824 2024-08-18T21:07:33.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.071+0000 7f959daa3640 1 -- 172.21.15.5:0/136151589 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f95980abb20 con 0x7f959813eb40 2024-08-18T21:07:33.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.075+0000 7f959daa3640 1 -- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959813eb40 msgr2=0x7f959813ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:33.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.075+0000 7f959daa3640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959813eb40 0x7f959813ef20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f959813e510 tx=0x7f958c00e960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.075+0000 7f959eaa5640 1 --2- 172.21.15.5:0/136151589 >> v2:172.21.15.157:6812/631023601 conn(0x7f958403bdc0 0x7f958403e280 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9598140aa0 tx=0x7f9590007650 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.075+0000 7f9596ffd640 1 -- 172.21.15.5:0/136151589 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f958c004e40 con 0x7f959813eb40 2024-08-18T21:07:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.075+0000 7f9596ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.075+0000 7f9596ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:07:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.075+0000 7f9596ffd640 10 monclient: dump: 2024-08-18T21:07:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.095 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.097 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.097 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.097 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.097 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.098 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.098 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.098 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.075+0000 7f9596ffd640 1 -- 172.21.15.5:0/136151589 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f958c018070 con 0x7f959813eb40 2024-08-18T21:07:33.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.075+0000 7f9596ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:33.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.075+0000 7f9596ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:33.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.075+0000 7f9596ffd640 1 -- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959813eb40 msgr2=0x7f959813ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.075+0000 7f9596ffd640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959813eb40 0x7f959813ef20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f959813e510 tx=0x7f958c00e960 comp rx=0 tx=0).stop 2024-08-18T21:07:33.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.075+0000 7f9596ffd640 1 -- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959813eb40 msgr2=0x7f959813ef20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:33.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.075+0000 7f9596ffd640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959813eb40 0x7f959813ef20 secure :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f959813e510 tx=0x7f958c00e960 comp rx=0 tx=0).stop 2024-08-18T21:07:33.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f95a0508640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:33.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f95a0508640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959813f460 0x7f959813abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f95a0508640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f95a0508640 1 -- 172.21.15.5:0/136151589 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f95980a6fb0 con 0x7f959813f460 2024-08-18T21:07:33.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f959daa3640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959813f460 0x7f959813abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f959daa3640 10 monclient: get_auth_request con 0x7f959813f460 auth_method 0 2024-08-18T21:07:33.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f959daa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f959daa3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f959daa3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f959daa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f959daa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f959daa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f959daa3640 10 monclient(hunting): handle_auth_done global_id 5365 payload 824 2024-08-18T21:07:33.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f959daa3640 1 -- 172.21.15.5:0/136151589 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9598122840 con 0x7f959813f460 2024-08-18T21:07:33.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f959daa3640 1 -- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959813f460 msgr2=0x7f959813abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:33.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f959daa3640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959813f460 0x7f959813abb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f959813fe10 tx=0x7f958c004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f9596ffd640 1 -- 172.21.15.5:0/136151589 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f958c028440 con 0x7f959813f460 2024-08-18T21:07:33.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f9596ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f9596ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:07:33.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.083+0000 7f9596ffd640 10 monclient: dump: 2024-08-18T21:07:33.100 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.100 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.100 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.100 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.100 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.100 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.100 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.101 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.101 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.101 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.101 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.101 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.101 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.101 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.101 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.101 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f9596ffd640 1 -- 172.21.15.5:0/136151589 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f958c0064f0 con 0x7f959813f460 2024-08-18T21:07:33.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f9596ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:33.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f9596ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:33.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f9596ffd640 1 -- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959813f460 msgr2=0x7f959813abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f9596ffd640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959813f460 0x7f959813abb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f959813fe10 tx=0x7f958c004950 comp rx=0 tx=0).stop 2024-08-18T21:07:33.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f9596ffd640 1 -- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959813f460 msgr2=0x7f959813abb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:33.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f9596ffd640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959813f460 0x7f959813abb0 secure :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f959813fe10 tx=0x7f958c004950 comp rx=0 tx=0).stop 2024-08-18T21:07:33.102 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:33.102 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:33.102 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:33.102 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:07:33.102 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:33.103 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 262169, 2024-08-18T21:07:33.103 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:33.103 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:33.103 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:33.103 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:33.103 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:33.103 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:33.103 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:33.103 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:33.103 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:33.103 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:33.103 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.103 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:07:33.103 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:33.104 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:33.104 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:33.104 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:33.104 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:33.104 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:33.104 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:33.104 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:33.104 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:33.104 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:33.104 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:33.104 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:33.104 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:33.104 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:33.105 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.105 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:33.105 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:33.105 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:33.105 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:33.105 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:33.105 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:33.105 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:33.105 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:33.105 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:33.105 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:33.105 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:33.105 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:33.105 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:33.106 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.106 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:33.106 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:33.106 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:33.106 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:33.106 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:33.106 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:33.106 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:33.106 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:33.106 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:33.106 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:33.106 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:33.106 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:33.107 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:33.107 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:33.107 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:33.107 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:33.107 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:33.107 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:33.107 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:33.107 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:33.107 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:33.107 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:33.107 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:33.107 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:33.107 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:33.107 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:33.108 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:33.108 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:33.108 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.108 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:33.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.108 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:33.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.108 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:33.108 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:33.108 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.108 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.108 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.108 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:33.109 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.109 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.109 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:33.109 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.109 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.109 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.109 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:33.109 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:33.109 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.109 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.109 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.110 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:33.110 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:33.110 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.110 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.110 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.110 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:33.110 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.110 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.110 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:33.111 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.111 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.111 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.111 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:33.111 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:33.111 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.111 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.111 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.111 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:33.111 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:33.112 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.112 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.112 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.112 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:33.112 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.112 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.112 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:33.112 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.112 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.113 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.113 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:33.113 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:33.113 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.113 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.113 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.113 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:33.113 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:33.113 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.114 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.114 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:33.114 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.114 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:33.114 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.114 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.114 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.115 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:33.115 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:33.115 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.115 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.115 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.115 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:33.115 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:33.115 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.115 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.115 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.115 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:33.116 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.116 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.116 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:33.116 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.116 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.116 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.116 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:33.116 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:33.116 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.116 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.116 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.117 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:33.117 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:33.117 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.117 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.117 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:33.117 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.117 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:33.118 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.118 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.118 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.118 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:33.118 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:33.118 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.118 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.118 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.118 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:33.119 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:33.119 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.119 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.119 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.119 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:33.119 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.119 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.119 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:33.119 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.119 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.119 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.120 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:33.120 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:33.120 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.120 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.120 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.120 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:33.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:33.120 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.120 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.120 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.121 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:33.121 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.121 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.121 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:33.121 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.121 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.121 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.121 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:33.121 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:33.121 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.121 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.122 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.122 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:33.122 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:33.122 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.122 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.122 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:33.122 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.123 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.123 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:33.123 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.123 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.123 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.123 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:33.123 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:33.123 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.123 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.123 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.124 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.124 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.124 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:33.124 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:33.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.124 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:33.124 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:33.124 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:33.124 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.124 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.124 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:33.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.125 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:33.125 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:33.125 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:33.125 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.125 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.125 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:33.125 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:33.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f95a0508640 1 -- 172.21.15.5:0/136151589 >> v2:172.21.15.157:6812/631023601 conn(0x7f958403bdc0 msgr2=0x7f958403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f95a0508640 1 --2- 172.21.15.5:0/136151589 >> v2:172.21.15.157:6812/631023601 conn(0x7f958403bdc0 0x7f958403e280 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9598140aa0 tx=0x7f9590007650 comp rx=0 tx=0).stop 2024-08-18T21:07:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f95a0508640 10 monclient: shutdown 2024-08-18T21:07:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f95a0508640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f95a0508640 1 -- 172.21.15.5:0/136151589 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f959809f080 msgr2=0x7f9598138d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f95a0508640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f959809f080 0x7f9598138d60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9588009710 tx=0x7f9588019140 comp rx=0 tx=0).stop 2024-08-18T21:07:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f959eaa5640 1 -- 172.21.15.5:0/136151589 reap_dead start 2024-08-18T21:07:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f95a0508640 1 -- 172.21.15.5:0/136151589 shutdown_connections 2024-08-18T21:07:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f95a0508640 1 --2- 172.21.15.5:0/136151589 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f959809f080 0x7f9598138d60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f95a0508640 1 -- 172.21.15.5:0/136151589 >> 172.21.15.5:0/136151589 conn(0x7f9598068700 msgr2=0x7f95981416a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f95a0508640 1 -- 172.21.15.5:0/136151589 shutdown_connections 2024-08-18T21:07:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.087+0000 7f95a0508640 1 -- 172.21.15.5:0/136151589 wait complete. 2024-08-18T21:07:33.128 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:33.128 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:07:33.128 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:07:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.243+0000 7eff5b300640 10 monclient: get_monmap_and_config 2024-08-18T21:07:33.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.243+0000 7eff5b300640 10 monclient: build_initial_monmap 2024-08-18T21:07:33.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.247+0000 7eff5b300640 10 monclient: monmap: 2024-08-18T21:07:33.249 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:33.249 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.249 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:33.248423+0000 2024-08-18T21:07:33.249 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:33.248423+0000 2024-08-18T21:07:33.249 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:33.249 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.249 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:33.249 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:33.249 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:33.250 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:33.250 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:33.250 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:33.250 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:33.250 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:33.250 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:33.250 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:33.250 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:33.250 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 1 Processor -- start 2024-08-18T21:07:33.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 1 -- start start 2024-08-18T21:07:33.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 10 monclient: init 2024-08-18T21:07:33.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:33.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 10 monclient: _add_conns ranks=[2,10,6,9,7,4,5,1,3,8,0] 2024-08-18T21:07:33.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff540a5640 0x7eff5409e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 10 monclient(hunting): picked mon.noname-b con 0x7eff540a5640 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:33.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7eff5409e9e0 0x7eff54135ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 10 monclient(hunting): picked mon.noname-f con 0x7eff5409e9e0 addr v2:172.21.15.157:3300/0 2024-08-18T21:07:33.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7eff54136010 0x7eff54136490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 10 monclient(hunting): picked mon.noname-d con 0x7eff54136010 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7eff5409fc80 con 0x7eff5409e9e0 2024-08-18T21:07:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7eff5409fed0 con 0x7eff540a5640 2024-08-18T21:07:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7eff5406e790 con 0x7eff54136010 2024-08-18T21:07:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5b300640 10 monclient(hunting): authenticate will time out at 1220.265626s 2024-08-18T21:07:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff540a5640 0x7eff5409e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff540a5640 0x7eff5409e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:35754/0 (socket says 172.21.15.5:35754) 2024-08-18T21:07:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 1 -- 172.21.15.5:0/1032136946 learned_addr learned my addr 172.21.15.5:0/1032136946 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 10 monclient(hunting): get_auth_request con 0x7eff540a5640 auth_method 0 2024-08-18T21:07:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5889b640 1 --2- 172.21.15.5:0/1032136946 >> v2:172.21.15.157:3300/0 conn(0x7eff5409e9e0 0x7eff54135ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5889b640 10 monclient(hunting): get_auth_request con 0x7eff5409e9e0 auth_method 0 2024-08-18T21:07:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5889b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5889b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5889b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5989d640 1 --2- 172.21.15.5:0/1032136946 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7eff54136010 0x7eff54136490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5889b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5889b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5889b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5989d640 10 monclient(hunting): get_auth_request con 0x7eff54136010 auth_method 0 2024-08-18T21:07:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5989d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5989d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5989d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5989d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5989d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5989d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 10 monclient(hunting): handle_auth_done global_id 74270 payload 274 2024-08-18T21:07:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 1 -- 172.21.15.5:0/1032136946 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7eff54136010 msgr2=0x7eff54136490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 1 --2- 172.21.15.5:0/1032136946 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7eff54136010 0x7eff54136490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 1 -- 172.21.15.5:0/1032136946 >> v2:172.21.15.157:3300/0 conn(0x7eff5409e9e0 msgr2=0x7eff54135ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 1 --2- 172.21.15.5:0/1032136946 >> v2:172.21.15.157:3300/0 conn(0x7eff5409e9e0 0x7eff54135ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 10 monclient: _finish_hunting 0 2024-08-18T21:07:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 1 monclient: found mon.noname-b 2024-08-18T21:07:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:07:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.251+0000 7eff5909c640 1 -- 172.21.15.5:0/1032136946 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5406d4e0 con 0x7eff540a5640 2024-08-18T21:07:33.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5909c640 1 -- 172.21.15.5:0/1032136946 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff540a5640 msgr2=0x7eff5409e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:33.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5909c640 1 --2- 172.21.15.5:0/1032136946 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff540a5640 0x7eff5409e4a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00af20 tx=0x7eff4c020cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=597ed16cc3d4b2e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff4bfff640 1 -- 172.21.15.5:0/1032136946 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7eff4c003e10 con 0x7eff540a5640 2024-08-18T21:07:33.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff4bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:07:33.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff4bfff640 10 monclient: dump: 2024-08-18T21:07:33.262 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.262 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.262 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.262 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.262 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.262 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.262 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.262 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.262 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.263 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.263 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.263 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.263 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.263 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.263 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.263 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff4bfff640 10 monclient: _finish_auth 0 2024-08-18T21:07:33.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff4bfff640 10 monclient: _check_auth_tickets 2024-08-18T21:07:33.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff4bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:33.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff4bfff640 1 -- 172.21.15.5:0/1032136946 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4c00a0d0 con 0x7eff540a5640 2024-08-18T21:07:33.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 5 monclient: authenticate success, global_id 74270 2024-08-18T21:07:33.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:07:33.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff4bfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:33.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:33.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 4 set_mon_vals no callback set 2024-08-18T21:07:33.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff4bfff640 1 -- 172.21.15.5:0/1032136946 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7eff4c0a9db0 con 0x7eff540a5640 2024-08-18T21:07:33.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff4bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:07:33.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff4bfff640 10 monclient: dump: 2024-08-18T21:07:33.264 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.264 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.265 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.265 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.265 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.265 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.265 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.265 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.265 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.265 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.265 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.265 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.265 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.265 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.265 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.266 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 10 monclient: shutdown 2024-08-18T21:07:33.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:33.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 1 -- 172.21.15.5:0/1032136946 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff540a5640 msgr2=0x7eff5409e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 1 --2- 172.21.15.5:0/1032136946 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff540a5640 0x7eff5409e4a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00af20 tx=0x7eff4c020cf0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 1 -- 172.21.15.5:0/1032136946 shutdown_connections 2024-08-18T21:07:33.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 1 --2- 172.21.15.5:0/1032136946 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7eff54136010 0x7eff54136490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 1 --2- 172.21.15.5:0/1032136946 >> v2:172.21.15.157:3300/0 conn(0x7eff5409e9e0 0x7eff54135ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 1 --2- 172.21.15.5:0/1032136946 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff540a5640 0x7eff5409e4a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 1 -- 172.21.15.5:0/1032136946 >> 172.21.15.5:0/1032136946 conn(0x7eff540a4b20 msgr2=0x7eff540a4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 1 -- 172.21.15.5:0/1032136946 shutdown_connections 2024-08-18T21:07:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 1 -- 172.21.15.5:0/1032136946 wait complete. 2024-08-18T21:07:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 10 monclient: build_initial_monmap 2024-08-18T21:07:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 10 monclient: monmap: 2024-08-18T21:07:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:33.273 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.273 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:33.273 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:33.273 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:33.273 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:33.273 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:33.273 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:33.273 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:33.273 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:33.273 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:33.273 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 1 Processor -- start 2024-08-18T21:07:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 1 -- start start 2024-08-18T21:07:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.259+0000 7eff5b300640 10 monclient: init 2024-08-18T21:07:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 10 monclient: _add_conns ranks=[3,8,1,4,6,7,0,5,2] 2024-08-18T21:07:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff5409e9e0 0x7eff5412eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 10 monclient(hunting): picked mon.noname-g con 0x7eff5409e9e0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7eff540a5640 0x7eff5412f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 10 monclient(hunting): picked mon.noname-e con 0x7eff540a5640 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:07:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff54136010 0x7eff54133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 10 monclient(hunting): picked mon.noname-f con 0x7eff54136010 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:07:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7eff5406eba0 con 0x7eff54136010 2024-08-18T21:07:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7eff54069de0 con 0x7eff5409e9e0 2024-08-18T21:07:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7eff540a5a20 con 0x7eff540a5640 2024-08-18T21:07:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 10 monclient(hunting): authenticate will time out at 1220.276406s 2024-08-18T21:07:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7eff540a5640 0x7eff5412f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7eff540a5640 0x7eff5412f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:40766/0 (socket says 172.21.15.5:40766) 2024-08-18T21:07:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 1 -- 172.21.15.5:0/2261843824 learned_addr learned my addr 172.21.15.5:0/2261843824 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 10 monclient(hunting): get_auth_request con 0x7eff540a5640 auth_method 0 2024-08-18T21:07:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 10 monclient(hunting): handle_auth_done global_id 54566 payload 824 2024-08-18T21:07:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 1 -- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff5409e9e0 msgr2=0x7eff5412eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5909c640 1 --2- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff5409e9e0 0x7eff5412eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 1 --2- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff5409e9e0 0x7eff5412eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 1 -- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff54136010 msgr2=0x7eff54133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 1 --2- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff54136010 0x7eff54133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 10 monclient: _finish_hunting 0 2024-08-18T21:07:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 1 monclient: found mon.noname-e 2024-08-18T21:07:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:07:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 1 -- 172.21.15.5:0/2261843824 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff540a0bd0 con 0x7eff540a5640 2024-08-18T21:07:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 1 -- 172.21.15.5:0/2261843824 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7eff540a5640 msgr2=0x7eff5412f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5889b640 1 --2- 172.21.15.5:0/2261843824 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7eff540a5640 0x7eff5412f0d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7eff4400e840 tx=0x7eff4400ec40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff49ffb640 1 -- 172.21.15.5:0/2261843824 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7eff44017070 con 0x7eff540a5640 2024-08-18T21:07:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff49ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff49ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:07:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff49ffb640 10 monclient: dump: 2024-08-18T21:07:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.278 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff49ffb640 10 monclient: _finish_auth 0 2024-08-18T21:07:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff49ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:07:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff49ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 5 monclient: authenticate success, global_id 54566 2024-08-18T21:07:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff49ffb640 1 -- 172.21.15.5:0/2261843824 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4400ee90 con 0x7eff540a5640 2024-08-18T21:07:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 10 monclient: _renew_subs 2024-08-18T21:07:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:07:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 1 -- 172.21.15.5:0/2261843824 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff541350d0 con 0x7eff540a5640 2024-08-18T21:07:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff49ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff49ffb640 1 -- 172.21.15.5:0/2261843824 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7eff440138e0 con 0x7eff540a5640 2024-08-18T21:07:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff49ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff49ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:07:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff4b7fe640 4 set_mon_vals no callback set 2024-08-18T21:07:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff49ffb640 10 monclient: dump: 2024-08-18T21:07:33.280 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.280 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.280 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.280 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.280 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.280 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.280 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.280 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.280 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.280 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.281 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.281 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.281 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.281 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.281 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.281 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 10 monclient: _renew_subs 2024-08-18T21:07:33.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:07:33.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.263+0000 7eff5b300640 1 -- 172.21.15.5:0/2261843824 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7eff5412f610 con 0x7eff540a5640 2024-08-18T21:07:33.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff5b300640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:33.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff5b300640 1 --2- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff54134400 0x7eff5402d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff5b300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff5b300640 1 -- 172.21.15.5:0/2261843824 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7eff54051140 con 0x7eff54134400 2024-08-18T21:07:33.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff49ffb640 1 -- 172.21.15.5:0/2261843824 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7eff4401a070 con 0x7eff540a5640 2024-08-18T21:07:33.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff49ffb640 1 --2- 172.21.15.5:0/2261843824 >> v2:172.21.15.157:6812/631023601 conn(0x7eff3803bdc0 0x7eff3803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff49ffb640 1 -- 172.21.15.5:0/2261843824 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(110..110 src has 22..110) ==== 3898+0+0 (secure 0 0 0) 0x7eff4400f040 con 0x7eff540a5640 2024-08-18T21:07:33.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff5909c640 1 --2- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff54134400 0x7eff5402d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff5909c640 10 monclient: get_auth_request con 0x7eff54134400 auth_method 0 2024-08-18T21:07:33.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff5909c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff5909c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff5909c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff5909c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff5909c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff5909c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff5989d640 1 --2- 172.21.15.5:0/2261843824 >> v2:172.21.15.157:6812/631023601 conn(0x7eff3803bdc0 0x7eff3803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff5989d640 10 monclient: get_auth_request con 0x7eff3803bdc0 auth_method 0 2024-08-18T21:07:33.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff5909c640 10 monclient(hunting): handle_auth_done global_id 5412 payload 824 2024-08-18T21:07:33.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.267+0000 7eff5909c640 1 -- 172.21.15.5:0/2261843824 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff5409edc0 con 0x7eff54134400 2024-08-18T21:07:33.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.271+0000 7eff5909c640 1 -- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff54134400 msgr2=0x7eff5402d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:33.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.271+0000 7eff5909c640 1 --2- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff54134400 0x7eff5402d1d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0b1000 tx=0x7eff4c01da90 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.271+0000 7eff5989d640 1 --2- 172.21.15.5:0/2261843824 >> v2:172.21.15.157:6812/631023601 conn(0x7eff3803bdc0 0x7eff3803e280 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff5000bb10 tx=0x7eff5000b5d0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.271+0000 7eff49ffb640 1 -- 172.21.15.5:0/2261843824 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7eff4c0bf020 con 0x7eff54134400 2024-08-18T21:07:33.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.271+0000 7eff49ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.271+0000 7eff49ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:07:33.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.271+0000 7eff49ffb640 10 monclient: dump: 2024-08-18T21:07:33.286 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.286 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.286 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.287 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.271+0000 7eff49ffb640 1 -- 172.21.15.5:0/2261843824 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7eff4c004030 con 0x7eff54134400 2024-08-18T21:07:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.271+0000 7eff49ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.271+0000 7eff49ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.271+0000 7eff49ffb640 1 -- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff54134400 msgr2=0x7eff5402d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.271+0000 7eff49ffb640 1 --2- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff54134400 0x7eff5402d1d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0b1000 tx=0x7eff4c01da90 comp rx=0 tx=0).stop 2024-08-18T21:07:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.271+0000 7eff49ffb640 1 -- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff54134400 msgr2=0x7eff5402d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.271+0000 7eff49ffb640 1 --2- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff54134400 0x7eff5402d1d0 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0b1000 tx=0x7eff4c01da90 comp rx=0 tx=0).stop 2024-08-18T21:07:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.279+0000 7eff5b300640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.279+0000 7eff5b300640 1 --2- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff541347e0 0x7eff5402d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.279+0000 7eff5b300640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.279+0000 7eff5b300640 1 -- 172.21.15.5:0/2261843824 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7eff540740e0 con 0x7eff541347e0 2024-08-18T21:07:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.279+0000 7eff5909c640 1 --2- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff541347e0 0x7eff5402d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.279+0000 7eff5909c640 10 monclient: get_auth_request con 0x7eff541347e0 auth_method 0 2024-08-18T21:07:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.279+0000 7eff5909c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.279+0000 7eff5909c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.279+0000 7eff5909c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.279+0000 7eff5909c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.279+0000 7eff5909c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.279+0000 7eff5909c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.279+0000 7eff5909c640 10 monclient(hunting): handle_auth_done global_id 5421 payload 824 2024-08-18T21:07:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.279+0000 7eff5909c640 1 -- 172.21.15.5:0/2261843824 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7eff5406d150 con 0x7eff541347e0 2024-08-18T21:07:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff5909c640 1 -- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff541347e0 msgr2=0x7eff5402d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff5909c640 1 --2- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff541347e0 0x7eff5402d710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7eff4c000f90 tx=0x7eff4c0ab000 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff49ffb640 1 -- 172.21.15.5:0/2261843824 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7eff4c0bf040 con 0x7eff541347e0 2024-08-18T21:07:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff49ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff49ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:07:33.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff49ffb640 10 monclient: dump: 2024-08-18T21:07:33.290 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.290 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.290 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.290 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.290 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.290 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.290 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.290 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.290 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.290 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.290 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.290 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.291 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff49ffb640 1 -- 172.21.15.5:0/2261843824 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7eff4c0c6020 con 0x7eff541347e0 2024-08-18T21:07:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff49ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff49ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff49ffb640 1 -- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff541347e0 msgr2=0x7eff5402d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff49ffb640 1 --2- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff541347e0 0x7eff5402d710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7eff4c000f90 tx=0x7eff4c0ab000 comp rx=0 tx=0).stop 2024-08-18T21:07:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff49ffb640 1 -- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff541347e0 msgr2=0x7eff5402d710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff49ffb640 1 --2- 172.21.15.5:0/2261843824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff541347e0 0x7eff5402d710 secure :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7eff4c000f90 tx=0x7eff4c0ab000 comp rx=0 tx=0).stop 2024-08-18T21:07:33.292 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:07:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 262381, 2024-08-18T21:07:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:07:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:07:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:07:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:33.318 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff5b300640 1 -- 172.21.15.5:0/2261843824 >> v2:172.21.15.157:6812/631023601 conn(0x7eff3803bdc0 msgr2=0x7eff3803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff5b300640 1 --2- 172.21.15.5:0/2261843824 >> v2:172.21.15.157:6812/631023601 conn(0x7eff3803bdc0 0x7eff3803e280 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff5000bb10 tx=0x7eff5000b5d0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff5b300640 10 monclient: shutdown 2024-08-18T21:07:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff5b300640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff5b300640 1 -- 172.21.15.5:0/2261843824 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7eff540a5640 msgr2=0x7eff5412f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff5b300640 1 --2- 172.21.15.5:0/2261843824 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7eff540a5640 0x7eff5412f0d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7eff4400e840 tx=0x7eff4400ec40 comp rx=0 tx=0).stop 2024-08-18T21:07:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff5989d640 1 -- 172.21.15.5:0/2261843824 reap_dead start 2024-08-18T21:07:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff5b300640 1 -- 172.21.15.5:0/2261843824 shutdown_connections 2024-08-18T21:07:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff5b300640 1 --2- 172.21.15.5:0/2261843824 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7eff540a5640 0x7eff5412f0d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff5b300640 1 -- 172.21.15.5:0/2261843824 >> 172.21.15.5:0/2261843824 conn(0x7eff540a4b20 msgr2=0x7eff540a33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff5b300640 1 -- 172.21.15.5:0/2261843824 shutdown_connections 2024-08-18T21:07:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.283+0000 7eff5b300640 1 -- 172.21.15.5:0/2261843824 wait complete. 2024-08-18T21:07:33.321 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:33.321 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:07:33.321 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:07:33.424 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29287]: starting. 2024-08-18T21:07:33.425 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29287]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29286 2024-08-18T21:07:33.425 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29287]: created object 0... 2024-08-18T21:07:33.425 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29287]: created object 25... 2024-08-18T21:07:33.425 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29287]: created object 49... 2024-08-18T21:07:33.425 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29287]: finishing. 2024-08-18T21:07:33.425 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29287]: shutting down. 2024-08-18T21:07:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 10 monclient: get_monmap_and_config 2024-08-18T21:07:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 10 monclient: build_initial_monmap 2024-08-18T21:07:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 10 monclient: monmap: 2024-08-18T21:07:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:33.430966+0000 2024-08-18T21:07:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:33.430966+0000 2024-08-18T21:07:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:33.432 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 1 Processor -- start 2024-08-18T21:07:33.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 1 -- start start 2024-08-18T21:07:33.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 10 monclient: init 2024-08-18T21:07:33.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:33.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 10 monclient: _add_conns ranks=[10,9,1,0,6,2,4,7,8,5,3] 2024-08-18T21:07:33.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f87800a1ff0 0x7f8780137430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 10 monclient(hunting): picked mon.noname-f con 0x7f87800a1ff0 addr v2:172.21.15.157:3300/0 2024-08-18T21:07:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8780137970 0x7f8780137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 10 monclient(hunting): picked mon.noname-a con 0x7f8780137970 addr v2:172.21.15.5:3300/0 2024-08-18T21:07:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f8780133eb0 addr v1:172.21.15.157:6789/0 2024-08-18T21:07:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87800a23d0 con 0x7f8780133eb0 2024-08-18T21:07:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f878009dd50 con 0x7f8780137970 2024-08-18T21:07:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f878009e970 con 0x7f87800a1ff0 2024-08-18T21:07:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f8784f6d640 10 monclient(hunting): authenticate will time out at 1220.443893s 2024-08-18T21:07:33.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.427+0000 7f877dd9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8780137970 0x7f8780137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8780137970 0x7f8780137dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41456/0 (socket says 172.21.15.5:41456) 2024-08-18T21:07:33.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 1 -- 172.21.15.5:0/1923004549 learned_addr learned my addr 172.21.15.5:0/1923004549 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:33.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 10 monclient(hunting): get_auth_request con 0x7f8780137970 auth_method 0 2024-08-18T21:07:33.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877e59c640 1 --2- 172.21.15.5:0/1923004549 >> v2:172.21.15.157:3300/0 conn(0x7f87800a1ff0 0x7f8780137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877e59c640 10 monclient(hunting): get_auth_request con 0x7f87800a1ff0 auth_method 0 2024-08-18T21:07:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877e59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 10 monclient(hunting): handle_auth_done global_id 74214 payload 274 2024-08-18T21:07:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 1 -- 172.21.15.5:0/1923004549 >> v2:172.21.15.157:3300/0 conn(0x7f87800a1ff0 msgr2=0x7f8780137430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 1 --2- 172.21.15.5:0/1923004549 >> v2:172.21.15.157:3300/0 conn(0x7f87800a1ff0 0x7f8780137430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 1 -- 172.21.15.5:0/1923004549 >> v1:172.21.15.157:6789/0 conn(0x7f8780133eb0 legacy=0x7f8780134340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 10 monclient: _finish_hunting 0 2024-08-18T21:07:33.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 1 monclient: found mon.noname-a 2024-08-18T21:07:33.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:33.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:07:33.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.431+0000 7f877dd9b640 1 -- 172.21.15.5:0/1923004549 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878009ec50 con 0x7f8780137970 2024-08-18T21:07:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877dd9b640 1 -- 172.21.15.5:0/1923004549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780137970 msgr2=0x7f8780137dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877dd9b640 1 --2- 172.21.15.5:0/1923004549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780137970 0x7f8780137dd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f87800a5ef0 tx=0x7f876801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e29e9e04acd35a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877d59a640 1 -- 172.21.15.5:0/1923004549 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f87680b0070 con 0x7f8780137970 2024-08-18T21:07:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877d59a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:07:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877d59a640 10 monclient: dump: 2024-08-18T21:07:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.446 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877d59a640 10 monclient: _finish_auth 0 2024-08-18T21:07:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877d59a640 10 monclient: _check_auth_tickets 2024-08-18T21:07:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877d59a640 1 -- 172.21.15.5:0/1923004549 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87680aa810 con 0x7f8780137970 2024-08-18T21:07:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877d59a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877d59a640 1 -- 172.21.15.5:0/1923004549 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f87680aae30 con 0x7f8780137970 2024-08-18T21:07:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 5 monclient: authenticate success, global_id 74214 2024-08-18T21:07:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 4 set_mon_vals no callback set 2024-08-18T21:07:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877d59a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:07:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877d59a640 10 monclient: dump: 2024-08-18T21:07:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.448 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 10 monclient: shutdown 2024-08-18T21:07:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 1 -- 172.21.15.5:0/1923004549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780137970 msgr2=0x7f8780137dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 1 --2- 172.21.15.5:0/1923004549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780137970 0x7f8780137dd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f87800a5ef0 tx=0x7f876801c3e0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 1 -- 172.21.15.5:0/1923004549 shutdown_connections 2024-08-18T21:07:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 1 --2- 172.21.15.5:0/1923004549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780137970 0x7f8780137dd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 1 --2- 172.21.15.5:0/1923004549 >> v2:172.21.15.157:3300/0 conn(0x7f87800a1ff0 0x7f8780137430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 1 -- 172.21.15.5:0/1923004549 >> 172.21.15.5:0/1923004549 conn(0x7f87800a8020 msgr2=0x7f87800a8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 1 -- 172.21.15.5:0/1923004549 shutdown_connections 2024-08-18T21:07:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 1 -- 172.21.15.5:0/1923004549 wait complete. 2024-08-18T21:07:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 10 monclient: build_initial_monmap 2024-08-18T21:07:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 10 monclient: monmap: 2024-08-18T21:07:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:33.450 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 1 Processor -- start 2024-08-18T21:07:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 1 -- start start 2024-08-18T21:07:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 10 monclient: init 2024-08-18T21:07:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 10 monclient: _add_conns ranks=[8,3,0,6,4,2,7,5,1] 2024-08-18T21:07:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f87800a1ff0 0x7f87800711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 10 monclient(hunting): picked mon.noname-e con 0x7f87800a1ff0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:07:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8780133eb0 0x7f87800716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 10 monclient(hunting): picked mon.noname-g con 0x7f8780133eb0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780137970 0x7f8780071c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 10 monclient(hunting): picked mon.noname-a con 0x7f8780137970 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:07:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8780134e60 con 0x7f8780137970 2024-08-18T21:07:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f87800a1e00 con 0x7f8780133eb0 2024-08-18T21:07:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f8780142200 con 0x7f87800a1ff0 2024-08-18T21:07:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f8784f6d640 10 monclient(hunting): authenticate will time out at 1220.450813s 2024-08-18T21:07:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877e59c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f87800a1ff0 0x7f87800711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780137970 0x7f8780071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877e59c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f87800a1ff0 0x7f87800711b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:40770/0 (socket says 172.21.15.5:40770) 2024-08-18T21:07:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877e59c640 1 -- 172.21.15.5:0/635714504 learned_addr learned my addr 172.21.15.5:0/635714504 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877e59c640 10 monclient(hunting): get_auth_request con 0x7f87800a1ff0 auth_method 0 2024-08-18T21:07:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877e59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 10 monclient(hunting): get_auth_request con 0x7f8780137970 auth_method 0 2024-08-18T21:07:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877dd9b640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8780133eb0 0x7f87800716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877dd9b640 10 monclient(hunting): get_auth_request con 0x7f8780133eb0 auth_method 0 2024-08-18T21:07:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 10 monclient(hunting): handle_auth_done global_id 74223 payload 824 2024-08-18T21:07:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 1 -- 172.21.15.5:0/635714504 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f87800a1ff0 msgr2=0x7f87800711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f87800a1ff0 0x7f87800711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 1 -- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8780133eb0 msgr2=0x7f87800716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8780133eb0 0x7f87800716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 10 monclient: _finish_hunting 0 2024-08-18T21:07:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 1 monclient: found mon.noname-a 2024-08-18T21:07:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:07:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877ed9d640 1 -- 172.21.15.5:0/635714504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8780138fb0 con 0x7f8780137970 2024-08-18T21:07:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.435+0000 7f877e59c640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f87800a1ff0 0x7f87800711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:07:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f877ed9d640 1 -- 172.21.15.5:0/635714504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780137970 msgr2=0x7f8780071c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f877ed9d640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780137970 0x7f8780071c30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f877800c440 tx=0x7f877800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8776ffd640 1 -- 172.21.15.5:0/635714504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8778011c10 con 0x7f8780137970 2024-08-18T21:07:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8776ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8776ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:07:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8776ffd640 10 monclient: dump: 2024-08-18T21:07:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.457 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8776ffd640 10 monclient: _finish_auth 0 2024-08-18T21:07:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8776ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:07:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8776ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8776ffd640 1 -- 172.21.15.5:0/635714504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8778017070 con 0x7f8780137970 2024-08-18T21:07:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8776ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8776ffd640 1 -- 172.21.15.5:0/635714504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8778011df0 con 0x7f8780137970 2024-08-18T21:07:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8784f6d640 5 monclient: authenticate success, global_id 74223 2024-08-18T21:07:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8784f6d640 10 monclient: _renew_subs 2024-08-18T21:07:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8784f6d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:07:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8784f6d640 1 -- 172.21.15.5:0/635714504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87800a31a0 con 0x7f8780137970 2024-08-18T21:07:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f877cd99640 4 set_mon_vals no callback set 2024-08-18T21:07:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8776ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8776ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:07:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8776ffd640 10 monclient: dump: 2024-08-18T21:07:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.459 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8784f6d640 10 monclient: _renew_subs 2024-08-18T21:07:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8784f6d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:07:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8784f6d640 1 -- 172.21.15.5:0/635714504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87800a2c90 con 0x7f8780137970 2024-08-18T21:07:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8784f6d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8784f6d640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f87801cf390 0x7f87801cf770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8784f6d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8784f6d640 1 -- 172.21.15.5:0/635714504 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f8780051140 con 0x7f87801cf390 2024-08-18T21:07:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8776ffd640 1 -- 172.21.15.5:0/635714504 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f87780117a0 con 0x7f8780137970 2024-08-18T21:07:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f877e59c640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f87801cf390 0x7f87801cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8776ffd640 1 --2- 172.21.15.5:0/635714504 >> v2:172.21.15.157:6812/631023601 conn(0x7f876003bdc0 0x7f876003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f877e59c640 10 monclient: get_auth_request con 0x7f87801cf390 auth_method 0 2024-08-18T21:07:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f877e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f877e59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f877e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f8776ffd640 1 -- 172.21.15.5:0/635714504 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 22..110) ==== 3898+0+0 (secure 0 0 0) 0x7f877804e400 con 0x7f8780137970 2024-08-18T21:07:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f877e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f877e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f877e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f877dd9b640 1 --2- 172.21.15.5:0/635714504 >> v2:172.21.15.157:6812/631023601 conn(0x7f876003bdc0 0x7f876003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f877dd9b640 10 monclient: get_auth_request con 0x7f876003bdc0 auth_method 0 2024-08-18T21:07:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f877e59c640 10 monclient(hunting): handle_auth_done global_id 34790 payload 824 2024-08-18T21:07:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.439+0000 7f877e59c640 1 -- 172.21.15.5:0/635714504 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f87800737d0 con 0x7f87801cf390 2024-08-18T21:07:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.443+0000 7f877e59c640 1 -- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f87801cf390 msgr2=0x7f87801cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.443+0000 7f877e59c640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f87801cf390 0x7f87801cf770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8770007590 tx=0x7f8770007a50 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.443+0000 7f877dd9b640 1 --2- 172.21.15.5:0/635714504 >> v2:172.21.15.157:6812/631023601 conn(0x7f876003bdc0 0x7f876003e280 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f87680ab000 tx=0x7f87680a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.443+0000 7f8776ffd640 1 -- 172.21.15.5:0/635714504 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8770015d50 con 0x7f87801cf390 2024-08-18T21:07:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.443+0000 7f8776ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.443+0000 7f8776ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:07:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.443+0000 7f8776ffd640 10 monclient: dump: 2024-08-18T21:07:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.464 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.443+0000 7f8776ffd640 1 -- 172.21.15.5:0/635714504 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f877001b070 con 0x7f87801cf390 2024-08-18T21:07:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.443+0000 7f8776ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.443+0000 7f8776ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.443+0000 7f8776ffd640 1 -- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f87801cf390 msgr2=0x7f87801cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.443+0000 7f8776ffd640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f87801cf390 0x7f87801cf770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8770007590 tx=0x7f8770007a50 comp rx=0 tx=0).stop 2024-08-18T21:07:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.443+0000 7f8776ffd640 1 -- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f87801cf390 msgr2=0x7f87801cf770 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.443+0000 7f8776ffd640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f87801cf390 0x7f87801cf770 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8770007590 tx=0x7f8770007a50 comp rx=0 tx=0).stop 2024-08-18T21:07:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.451+0000 7f8784f6d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.451+0000 7f8784f6d640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f87801cfcb0 0x7f878012ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.451+0000 7f8784f6d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.451+0000 7f8784f6d640 1 -- 172.21.15.5:0/635714504 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f8780072cb0 con 0x7f87801cfcb0 2024-08-18T21:07:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.451+0000 7f877e59c640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f87801cfcb0 0x7f878012ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.451+0000 7f877e59c640 10 monclient: get_auth_request con 0x7f87801cfcb0 auth_method 0 2024-08-18T21:07:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.451+0000 7f877e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.451+0000 7f877e59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.451+0000 7f877e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.451+0000 7f877e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.451+0000 7f877e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.451+0000 7f877e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.451+0000 7f877e59c640 10 monclient(hunting): handle_auth_done global_id 34799 payload 824 2024-08-18T21:07:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.451+0000 7f877e59c640 1 -- 172.21.15.5:0/635714504 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8780137430 con 0x7f87801cfcb0 2024-08-18T21:07:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f877e59c640 1 -- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f87801cfcb0 msgr2=0x7f878012ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f877e59c640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f87801cfcb0 0x7f878012ea10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8770007590 tx=0x7f8770004a50 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8776ffd640 1 -- 172.21.15.5:0/635714504 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f87700168f0 con 0x7f87801cfcb0 2024-08-18T21:07:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8776ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8776ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:07:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8776ffd640 10 monclient: dump: 2024-08-18T21:07:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.468 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8776ffd640 1 -- 172.21.15.5:0/635714504 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f8770016480 con 0x7f87801cfcb0 2024-08-18T21:07:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8776ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8776ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8776ffd640 1 -- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f87801cfcb0 msgr2=0x7f878012ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8776ffd640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f87801cfcb0 0x7f878012ea10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8770007590 tx=0x7f8770004a50 comp rx=0 tx=0).stop 2024-08-18T21:07:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8776ffd640 1 -- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f87801cfcb0 msgr2=0x7f878012ea10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8776ffd640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f87801cfcb0 0x7f878012ea10 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8770007590 tx=0x7f8770004a50 comp rx=0 tx=0).stop 2024-08-18T21:07:33.469 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:33.469 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:33.469 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:33.469 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:07:33.469 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:33.469 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 173249, 2024-08-18T21:07:33.469 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:33.470 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:33.470 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:33.470 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:33.470 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:33.470 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:33.470 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:33.470 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:33.470 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:33.470 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:33.470 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.470 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:07:33.470 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:33.471 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:33.471 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:33.471 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:33.471 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:33.471 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:33.471 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:33.471 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:33.471 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:33.471 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:33.471 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:33.471 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:33.471 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:33.472 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:33.472 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.472 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:33.472 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:33.472 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:33.472 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:33.472 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:33.472 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:33.472 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:33.472 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:33.472 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:33.472 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:33.472 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:33.473 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:33.473 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:33.473 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.473 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:33.473 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:33.473 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:33.473 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:33.473 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:33.473 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:33.473 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:33.473 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:33.474 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:33.474 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:33.474 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:33.474 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:33.474 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:33.474 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:33.474 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:33.474 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:33.474 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:33.474 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:33.474 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:33.474 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:33.475 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:33.475 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:33.475 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:33.475 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:33.475 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:33.475 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:33.475 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:33.475 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:33.475 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.475 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:33.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.475 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:33.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.476 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:33.476 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:33.476 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:33.476 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:33.476 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.477 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.477 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.477 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:33.477 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:33.477 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.477 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.477 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.477 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:33.477 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:33.477 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.478 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.478 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:33.478 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.478 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:33.478 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.478 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.478 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.479 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:33.479 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:33.479 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.479 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.479 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.479 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:33.479 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:33.479 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.479 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.479 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.479 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:33.480 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.480 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.480 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:33.480 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.480 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.480 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.480 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:33.480 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:33.481 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.481 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.481 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.481 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.481 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:33.481 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:33.481 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.481 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.481 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.481 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.481 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:33.481 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.482 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:33.482 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.482 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.482 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.482 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:33.482 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:33.482 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.482 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.482 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.483 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:33.483 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:33.483 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.483 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.483 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.483 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:33.483 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.484 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.484 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:33.484 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.484 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.484 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.484 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:33.484 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:33.484 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.484 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.484 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.484 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:33.485 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:33.485 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.485 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.485 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.485 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.485 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:33.485 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.485 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.485 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.485 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:33.485 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.486 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.486 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.486 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:33.486 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:33.486 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.486 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.486 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.486 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:33.487 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:33.487 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:33.487 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:33.487 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.487 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.487 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:33.488 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:33.488 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.488 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.488 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.488 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:33.488 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:33.488 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.489 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.489 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:33.489 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.489 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.489 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:33.489 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.489 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.489 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.489 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:33.490 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:33.490 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.490 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.490 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.490 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:33.490 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:33.490 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.490 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.490 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.490 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:33.491 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.491 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.491 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.491 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:33.491 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.491 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.491 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.491 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:33.491 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:33.491 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.491 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.492 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.492 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.492 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.492 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:33.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:33.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.492 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:33.492 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:33.492 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:33.492 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.492 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.492 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:33.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.493 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:33.493 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:33.493 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:33.493 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.493 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.493 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:33.493 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8784f6d640 1 -- 172.21.15.5:0/635714504 >> v2:172.21.15.157:6812/631023601 conn(0x7f876003bdc0 msgr2=0x7f876003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8784f6d640 1 --2- 172.21.15.5:0/635714504 >> v2:172.21.15.157:6812/631023601 conn(0x7f876003bdc0 0x7f876003e280 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f87680ab000 tx=0x7f87680a6000 comp rx=0 tx=0).stop 2024-08-18T21:07:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8784f6d640 10 monclient: shutdown 2024-08-18T21:07:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8784f6d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8784f6d640 1 -- 172.21.15.5:0/635714504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780137970 msgr2=0x7f8780071c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8784f6d640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780137970 0x7f8780071c30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f877800c440 tx=0x7f877800c900 comp rx=0 tx=0).stop 2024-08-18T21:07:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f877ed9d640 1 -- 172.21.15.5:0/635714504 reap_dead start 2024-08-18T21:07:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8784f6d640 1 -- 172.21.15.5:0/635714504 shutdown_connections 2024-08-18T21:07:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8784f6d640 1 --2- 172.21.15.5:0/635714504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780137970 0x7f8780071c30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8784f6d640 1 -- 172.21.15.5:0/635714504 >> 172.21.15.5:0/635714504 conn(0x7f87800a8020 msgr2=0x7f8780133730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:33.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8784f6d640 1 -- 172.21.15.5:0/635714504 shutdown_connections 2024-08-18T21:07:33.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.455+0000 7f8784f6d640 1 -- 172.21.15.5:0/635714504 wait complete. 2024-08-18T21:07:33.496 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:33.496 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:07:33.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:07:33.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.607+0000 7fd1ce7df640 10 monclient: get_monmap_and_config 2024-08-18T21:07:33.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.607+0000 7fd1ce7df640 10 monclient: build_initial_monmap 2024-08-18T21:07:33.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.607+0000 7fd1ce7df640 10 monclient: monmap: 2024-08-18T21:07:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:33.611231+0000 2024-08-18T21:07:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:33.611231+0000 2024-08-18T21:07:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:33.612 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:33.612 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:33.612 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:33.612 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:33.612 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.607+0000 7fd1ce7df640 1 Processor -- start 2024-08-18T21:07:33.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.607+0000 7fd1ce7df640 1 -- start start 2024-08-18T21:07:33.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.607+0000 7fd1ce7df640 10 monclient: init 2024-08-18T21:07:33.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ce7df640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:33.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ce7df640 10 monclient: _add_conns ranks=[10,4,3,9,6,5,0,8,1,7,2] 2024-08-18T21:07:33.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ce7df640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd1c80a6ce0 0x7fd1c80a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ce7df640 10 monclient(hunting): picked mon.noname-f con 0x7fd1c80a6ce0 addr v2:172.21.15.157:3300/0 2024-08-18T21:07:33.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ce7df640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd1c80a7600 0x7fd1c8139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ce7df640 10 monclient(hunting): picked mon.noname-c con 0x7fd1c80a7600 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:07:33.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ce7df640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c8139fe0 0x7fd1c813a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ce7df640 10 monclient(hunting): picked mon.noname-g con 0x7fd1c8139fe0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:33.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ce7df640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ce7df640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd1c80a5000 con 0x7fd1c80a6ce0 2024-08-18T21:07:33.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ce7df640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ce7df640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd1c80a4360 con 0x7fd1c8139fe0 2024-08-18T21:07:33.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ce7df640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ce7df640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fd1c80a45d0 con 0x7fd1c80a7600 2024-08-18T21:07:33.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ce7df640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:33.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ce7df640 10 monclient(hunting): authenticate will time out at 1220.624371s 2024-08-18T21:07:33.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd1c80a7600 0x7fd1c8139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd1c80a7600 0x7fd1c8139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:45330/0 (socket says 172.21.15.5:45330) 2024-08-18T21:07:33.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 1 -- 172.21.15.5:0/1336777946 learned_addr learned my addr 172.21.15.5:0/1336777946 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:33.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 10 monclient(hunting): get_auth_request con 0x7fd1c80a7600 auth_method 0 2024-08-18T21:07:33.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c7fff640 1 --2- 172.21.15.5:0/1336777946 >> v2:172.21.15.157:3300/0 conn(0x7fd1c80a6ce0 0x7fd1c80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ccd7c640 1 --2- 172.21.15.5:0/1336777946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c8139fe0 0x7fd1c813a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c7fff640 10 monclient(hunting): get_auth_request con 0x7fd1c80a6ce0 auth_method 0 2024-08-18T21:07:33.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ccd7c640 10 monclient(hunting): get_auth_request con 0x7fd1c8139fe0 auth_method 0 2024-08-18T21:07:33.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ccd7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ccd7c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1ccd7c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 10 monclient(hunting): handle_auth_done global_id 5512 payload 274 2024-08-18T21:07:33.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 1 -- 172.21.15.5:0/1336777946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c8139fe0 msgr2=0x7fd1c813a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:33.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 1 --2- 172.21.15.5:0/1336777946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c8139fe0 0x7fd1c813a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 1 -- 172.21.15.5:0/1336777946 >> v2:172.21.15.157:3300/0 conn(0x7fd1c80a6ce0 msgr2=0x7fd1c80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:33.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 1 --2- 172.21.15.5:0/1336777946 >> v2:172.21.15.157:3300/0 conn(0x7fd1c80a6ce0 0x7fd1c80a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 10 monclient: _finish_hunting 0 2024-08-18T21:07:33.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 1 monclient: found mon.noname-c 2024-08-18T21:07:33.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:33.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:07:33.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.611+0000 7fd1c77fe640 1 -- 172.21.15.5:0/1336777946 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c80a32d0 con 0x7fd1c80a7600 2024-08-18T21:07:33.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c77fe640 1 -- 172.21.15.5:0/1336777946 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd1c80a7600 msgr2=0x7fd1c8139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:33.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c77fe640 1 --2- 172.21.15.5:0/1336777946 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd1c80a7600 0x7fd1c8139aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0009e80 tx=0x7fd1b001c8d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=8e26fb4289da0614 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c6ffd640 1 -- 172.21.15.5:0/1336777946 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd1b00090d0 con 0x7fd1c80a7600 2024-08-18T21:07:33.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:07:33.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c6ffd640 10 monclient: dump: 2024-08-18T21:07:33.621 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.621 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.621 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.621 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.621 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.621 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.621 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.621 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.621 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.621 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.622 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.622 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.622 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.622 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.622 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.622 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:07:33.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:07:33.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:33.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c6ffd640 1 -- 172.21.15.5:0/1336777946 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1b00a5a70 con 0x7fd1c80a7600 2024-08-18T21:07:33.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:33.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c6ffd640 1 -- 172.21.15.5:0/1336777946 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd1b00a5c20 con 0x7fd1c80a7600 2024-08-18T21:07:33.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 5 monclient: authenticate success, global_id 5512 2024-08-18T21:07:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 4 set_mon_vals no callback set 2024-08-18T21:07:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:07:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c6ffd640 10 monclient: dump: 2024-08-18T21:07:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.624 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 10 monclient: shutdown 2024-08-18T21:07:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 -- 172.21.15.5:0/1336777946 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd1c80a7600 msgr2=0x7fd1c8139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 --2- 172.21.15.5:0/1336777946 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd1c80a7600 0x7fd1c8139aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0009e80 tx=0x7fd1b001c8d0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 -- 172.21.15.5:0/1336777946 shutdown_connections 2024-08-18T21:07:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 --2- 172.21.15.5:0/1336777946 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd1c80a7600 0x7fd1c8139aa0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 --2- 172.21.15.5:0/1336777946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c8139fe0 0x7fd1c813a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 --2- 172.21.15.5:0/1336777946 >> v2:172.21.15.157:3300/0 conn(0x7fd1c80a6ce0 0x7fd1c80a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 -- 172.21.15.5:0/1336777946 >> 172.21.15.5:0/1336777946 conn(0x7fd1c80acbc0 msgr2=0x7fd1c80a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 -- 172.21.15.5:0/1336777946 shutdown_connections 2024-08-18T21:07:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 -- 172.21.15.5:0/1336777946 wait complete. 2024-08-18T21:07:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 10 monclient: build_initial_monmap 2024-08-18T21:07:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 10 monclient: monmap: 2024-08-18T21:07:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:33.626 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 Processor -- start 2024-08-18T21:07:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 -- start start 2024-08-18T21:07:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 10 monclient: init 2024-08-18T21:07:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 10 monclient: _add_conns ranks=[2,0,7,4,8,5,3,1,6] 2024-08-18T21:07:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd1c80a6ce0 0x7fd1c8136640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 10 monclient(hunting): picked mon.noname-b con 0x7fd1c80a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c80a7600 0x7fd1c8136b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 10 monclient(hunting): picked mon.noname-a con 0x7fd1c80a7600 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:07:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c8139fe0 0x7fd1c813c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 10 monclient(hunting): picked mon.noname-i con 0x7fd1c8139fe0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:07:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c80a79e0 con 0x7fd1c80a7600 2024-08-18T21:07:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fd1c80a8220 con 0x7fd1c80a6ce0 2024-08-18T21:07:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fd1c813ee80 con 0x7fd1c8139fe0 2024-08-18T21:07:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1ce7df640 10 monclient(hunting): authenticate will time out at 1220.631646s 2024-08-18T21:07:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd1c80a6ce0 0x7fd1c8136640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd1c80a6ce0 0x7fd1c8136640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:35764/0 (socket says 172.21.15.5:35764) 2024-08-18T21:07:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c7fff640 1 -- 172.21.15.5:0/2746387170 learned_addr learned my addr 172.21.15.5:0/2746387170 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c7fff640 10 monclient(hunting): get_auth_request con 0x7fd1c80a6ce0 auth_method 0 2024-08-18T21:07:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c77fe640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c80a7600 0x7fd1c8136b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c77fe640 10 monclient(hunting): get_auth_request con 0x7fd1c80a7600 auth_method 0 2024-08-18T21:07:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.615+0000 7fd1c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1ccd7c640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c8139fe0 0x7fd1c813c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c7fff640 10 monclient(hunting): handle_auth_done global_id 74279 payload 824 2024-08-18T21:07:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c7fff640 1 -- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c8139fe0 msgr2=0x7fd1c813c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c7fff640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c8139fe0 0x7fd1c813c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c7fff640 1 -- 172.21.15.5:0/2746387170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c80a7600 msgr2=0x7fd1c8136b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c7fff640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c80a7600 0x7fd1c8136b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:07:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c7fff640 1 monclient: found mon.noname-b 2024-08-18T21:07:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:07:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c7fff640 1 -- 172.21.15.5:0/2746387170 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c81403a0 con 0x7fd1c80a6ce0 2024-08-18T21:07:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1ccd7c640 10 monclient: get_auth_request con 0x7fd1c8139fe0 auth_method 0 2024-08-18T21:07:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c77fe640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c80a7600 0x7fd1c8136b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:07:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1ccd7c640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c8139fe0 0x7fd1c813c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:07:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c7fff640 1 -- 172.21.15.5:0/2746387170 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd1c80a6ce0 msgr2=0x7fd1c8136640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c7fff640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd1c80a6ce0 0x7fd1c8136640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800d800 tx=0x7fd1b800dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c4ff9640 1 -- 172.21.15.5:0/2746387170 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd1b800bd40 con 0x7fd1c80a6ce0 2024-08-18T21:07:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c4ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:07:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c4ff9640 10 monclient: dump: 2024-08-18T21:07:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.634 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c4ff9640 10 monclient: _finish_auth 0 2024-08-18T21:07:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c4ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:07:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1ce7df640 5 monclient: authenticate success, global_id 74279 2024-08-18T21:07:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1ce7df640 10 monclient: _renew_subs 2024-08-18T21:07:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c4ff9640 1 -- 172.21.15.5:0/2746387170 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1b8019070 con 0x7fd1c80a6ce0 2024-08-18T21:07:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1ce7df640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:07:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1ce7df640 1 -- 172.21.15.5:0/2746387170 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c8140680 con 0x7fd1c80a6ce0 2024-08-18T21:07:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c4ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c4ff9640 1 -- 172.21.15.5:0/2746387170 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd1b80148a0 con 0x7fd1c80a6ce0 2024-08-18T21:07:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:07:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c4ff9640 10 monclient: dump: 2024-08-18T21:07:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.637 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c5ffb640 4 set_mon_vals no callback set 2024-08-18T21:07:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1ce7df640 10 monclient: _renew_subs 2024-08-18T21:07:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1ce7df640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:07:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1ce7df640 1 -- 172.21.15.5:0/2746387170 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c80a1c00 con 0x7fd1c80a6ce0 2024-08-18T21:07:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1ce7df640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1ce7df640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c81370c0 0x7fd1c813d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1ce7df640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1ce7df640 1 -- 172.21.15.5:0/2746387170 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fd1c80a7b60 con 0x7fd1c81370c0 2024-08-18T21:07:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c4ff9640 1 -- 172.21.15.5:0/2746387170 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fd1b8014430 con 0x7fd1c80a6ce0 2024-08-18T21:07:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c4ff9640 1 --2- 172.21.15.5:0/2746387170 >> v2:172.21.15.157:6812/631023601 conn(0x7fd1a803bdc0 0x7fd1a803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c4ff9640 1 -- 172.21.15.5:0/2746387170 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(110..110 src has 22..110) ==== 3898+0+0 (secure 0 0 0) 0x7fd1b800f040 con 0x7fd1c80a6ce0 2024-08-18T21:07:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.619+0000 7fd1c77fe640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c81370c0 0x7fd1c813d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1c77fe640 10 monclient: get_auth_request con 0x7fd1c81370c0 auth_method 0 2024-08-18T21:07:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1ccd7c640 1 --2- 172.21.15.5:0/2746387170 >> v2:172.21.15.157:6812/631023601 conn(0x7fd1a803bdc0 0x7fd1a803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1ccd7c640 10 monclient: get_auth_request con 0x7fd1a803bdc0 auth_method 0 2024-08-18T21:07:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1c77fe640 10 monclient(hunting): handle_auth_done global_id 5317 payload 824 2024-08-18T21:07:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1c77fe640 1 -- 172.21.15.5:0/2746387170 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd1c80a70c0 con 0x7fd1c81370c0 2024-08-18T21:07:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1ccd7c640 1 --2- 172.21.15.5:0/2746387170 >> v2:172.21.15.157:6812/631023601 conn(0x7fd1a803bdc0 0x7fd1a803e280 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80aaa20 tx=0x7fd1c0008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1c77fe640 1 -- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c81370c0 msgr2=0x7fd1c813d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1c77fe640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c81370c0 0x7fd1c813d530 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1c806df00 tx=0x7fd1b0019670 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1c4ff9640 1 -- 172.21.15.5:0/2746387170 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd1b00bd070 con 0x7fd1c81370c0 2024-08-18T21:07:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1c4ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:07:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.623+0000 7fd1c4ff9640 10 monclient: dump: 2024-08-18T21:07:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.640 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.627+0000 7fd1c4ff9640 1 -- 172.21.15.5:0/2746387170 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd1b0004460 con 0x7fd1c81370c0 2024-08-18T21:07:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.627+0000 7fd1c4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.627+0000 7fd1c4ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.627+0000 7fd1c4ff9640 1 -- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c81370c0 msgr2=0x7fd1c813d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.627+0000 7fd1c4ff9640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c81370c0 0x7fd1c813d530 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1c806df00 tx=0x7fd1b0019670 comp rx=0 tx=0).stop 2024-08-18T21:07:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.627+0000 7fd1c4ff9640 1 -- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c81370c0 msgr2=0x7fd1c813d530 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:33.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.627+0000 7fd1c4ff9640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c81370c0 0x7fd1c813d530 secure :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1c806df00 tx=0x7fd1b0019670 comp rx=0 tx=0).stop 2024-08-18T21:07:33.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.631+0000 7fd1ce7df640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:07:33.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.631+0000 7fd1ce7df640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c802d1d0 0x7fd1c802d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.631+0000 7fd1ce7df640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.631+0000 7fd1ce7df640 1 -- 172.21.15.5:0/2746387170 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fd1c8051140 con 0x7fd1c802d1d0 2024-08-18T21:07:33.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.631+0000 7fd1c77fe640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c802d1d0 0x7fd1c802d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:33.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.631+0000 7fd1c77fe640 10 monclient: get_auth_request con 0x7fd1c802d1d0 auth_method 0 2024-08-18T21:07:33.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.631+0000 7fd1c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:33.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.631+0000 7fd1c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:33.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.631+0000 7fd1c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:33.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.631+0000 7fd1c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:33.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.631+0000 7fd1c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:33.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.631+0000 7fd1c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:33.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.631+0000 7fd1c77fe640 10 monclient(hunting): handle_auth_done global_id 5326 payload 824 2024-08-18T21:07:33.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.635+0000 7fd1c77fe640 1 -- 172.21.15.5:0/2746387170 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd1c80a0150 con 0x7fd1c802d1d0 2024-08-18T21:07:33.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.635+0000 7fd1c77fe640 1 -- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c802d1d0 msgr2=0x7fd1c802d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:33.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.635+0000 7fd1c77fe640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c802d1d0 0x7fd1c802d5e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd1b00bc000 tx=0x7fd1b00a7000 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:33.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.635+0000 7fd1c4ff9640 1 -- 172.21.15.5:0/2746387170 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd1b00c2ad0 con 0x7fd1c802d1d0 2024-08-18T21:07:33.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.635+0000 7fd1c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:33.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.635+0000 7fd1c4ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:07:33.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.635+0000 7fd1c4ff9640 10 monclient: dump: 2024-08-18T21:07:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:33.645 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:33.645 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.635+0000 7fd1c4ff9640 1 -- 172.21.15.5:0/2746387170 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7fd1b00c2660 con 0x7fd1c802d1d0 2024-08-18T21:07:33.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.635+0000 7fd1c4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:07:33.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.635+0000 7fd1c4ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:33.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.635+0000 7fd1c4ff9640 1 -- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c802d1d0 msgr2=0x7fd1c802d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.635+0000 7fd1c4ff9640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c802d1d0 0x7fd1c802d5e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd1b00bc000 tx=0x7fd1b00a7000 comp rx=0 tx=0).stop 2024-08-18T21:07:33.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.635+0000 7fd1c4ff9640 1 -- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c802d1d0 msgr2=0x7fd1c802d5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:07:33.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.635+0000 7fd1c4ff9640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd1c802d1d0 0x7fd1c802d5e0 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd1b00bc000 tx=0x7fd1b00a7000 comp rx=0 tx=0).stop 2024-08-18T21:07:33.645 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:07:33.646 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:33.646 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:33.646 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:07:33.646 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 94, 2024-08-18T21:07:33.646 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 262737, 2024-08-18T21:07:33.646 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:07:33.646 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:07:33.646 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:07:33.646 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:07:33.646 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:07:33.646 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:07:33.646 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:07:33.646 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:07:33.647 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:07:33.647 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:07:33.647 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.647 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:07:33.647 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:33.647 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:07:33.647 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:07:33.647 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:33.647 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:33.647 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:33.647 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:33.647 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:33.647 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:33.648 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:33.648 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:33.648 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:33.648 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:33.648 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:33.648 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.648 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:07:33.648 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:07:33.648 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:33.648 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:33.649 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:33.649 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:33.649 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:33.649 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:33.649 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:33.649 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:33.649 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:33.649 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:33.649 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:33.649 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.649 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:07:33.649 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:07:33.650 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:07:33.650 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:07:33.650 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:07:33.650 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:07:33.650 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:33.650 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:07:33.650 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:07:33.650 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:07:33.650 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:07:33.650 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:07:33.650 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:07:33.650 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:07:33.650 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:07:33.650 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:07:33.651 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:07:33.651 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:07:33.651 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:07:33.651 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:07:33.651 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:07:33.651 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:07:33.651 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:07:33.651 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:07:33.651 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:07:33.651 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:07:33.651 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:07:33.651 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:07:33.651 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.651 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:07:33.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.652 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:07:33.652 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.652 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:07:33.652 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:07:33.652 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.652 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.652 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.652 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.652 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:07:33.652 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.652 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.653 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.653 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:07:33.653 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.653 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.653 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.653 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:07:33.653 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:07:33.653 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.653 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.653 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.654 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:07:33.654 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:07:33.654 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.654 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.654 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.654 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.654 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:07:33.654 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.654 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.654 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.654 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:07:33.654 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.654 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.655 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.655 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:07:33.655 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:07:33.655 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.655 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.655 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.655 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.655 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:07:33.655 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:07:33.655 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.655 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.656 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.656 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.656 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:07:33.656 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.656 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.656 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.656 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:07:33.656 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.656 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.656 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.656 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:07:33.656 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:07:33.657 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.657 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.657 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.657 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.657 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:07:33.657 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:07:33.657 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.657 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.657 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.657 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.657 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:07:33.657 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.658 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.658 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:07:33.658 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.658 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.658 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.658 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:07:33.658 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:07:33.658 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.658 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.659 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.659 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:07:33.659 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:07:33.659 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.659 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.659 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.659 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:07:33.659 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.659 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:07:33.660 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.660 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.660 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:07:33.660 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:07:33.660 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.660 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.660 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.660 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:07:33.660 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:07:33.661 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.661 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.661 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.661 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:07:33.661 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.662 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.662 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:07:33.662 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.662 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.662 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.662 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:07:33.662 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:07:33.662 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.662 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.662 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.663 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:07:33.663 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:07:33.663 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.663 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.663 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.663 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:07:33.663 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.663 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.663 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:07:33.663 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.664 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.664 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.664 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:07:33.664 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:07:33.664 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.664 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.664 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.664 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:07:33.664 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:07:33.664 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.664 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.665 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.665 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:07:33.665 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.665 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.665 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:07:33.665 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.665 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.665 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.665 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:07:33.666 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:07:33.666 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.666 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.666 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.666 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:07:33.666 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:07:33.666 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:07:33.666 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:07:33.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.666 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:07:33.666 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:07:33.667 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.667 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:07:33.667 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:07:33.667 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:07:33.667 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.667 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.667 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:07:33.667 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:07:33.667 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:07:33.667 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:07:33.668 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:07:33.668 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.668 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.668 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:07:33.668 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:07:33.668 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.668 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:33.668 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:33.668 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:07:33.668 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.668 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:07:33.668 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:07:33.668 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:07:33.669 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:07:33.669 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:07:33.669 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:07:33.669 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:07:33.669 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:07:33.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:07:33.669 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:07:33.669 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:07:33.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.639+0000 7fd1ce7df640 1 -- 172.21.15.5:0/2746387170 >> v2:172.21.15.157:6812/631023601 conn(0x7fd1a803bdc0 msgr2=0x7fd1a803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.639+0000 7fd1ce7df640 1 --2- 172.21.15.5:0/2746387170 >> v2:172.21.15.157:6812/631023601 conn(0x7fd1a803bdc0 0x7fd1a803e280 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80aaa20 tx=0x7fd1c0008040 comp rx=0 tx=0).stop 2024-08-18T21:07:33.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.639+0000 7fd1ce7df640 10 monclient: shutdown 2024-08-18T21:07:33.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.639+0000 7fd1ce7df640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:33.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.639+0000 7fd1ce7df640 1 -- 172.21.15.5:0/2746387170 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd1c80a6ce0 msgr2=0x7fd1c8136640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:33.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.639+0000 7fd1ce7df640 1 --2- 172.21.15.5:0/2746387170 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd1c80a6ce0 0x7fd1c8136640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800d800 tx=0x7fd1b800dcc0 comp rx=0 tx=0).stop 2024-08-18T21:07:33.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.639+0000 7fd1ccd7c640 1 -- 172.21.15.5:0/2746387170 reap_dead start 2024-08-18T21:07:33.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.639+0000 7fd1ccd7c640 1 -- 172.21.15.5:0/2746387170 reap_dead start 2024-08-18T21:07:33.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.639+0000 7fd1ce7df640 1 -- 172.21.15.5:0/2746387170 shutdown_connections 2024-08-18T21:07:33.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.639+0000 7fd1ce7df640 1 -- 172.21.15.5:0/2746387170 >> 172.21.15.5:0/2746387170 conn(0x7fd1c80acbc0 msgr2=0x7fd1c80aae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:33.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.639+0000 7fd1ce7df640 1 -- 172.21.15.5:0/2746387170 shutdown_connections 2024-08-18T21:07:33.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.639+0000 7fd1ce7df640 1 -- 172.21.15.5:0/2746387170 wait complete. 2024-08-18T21:07:33.672 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:07:33.672 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a', 'g', 'd', 'b'] 2024-08-18T21:07:33.672 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-18T21:07:33.672 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-18T21:07:33.672 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-18T21:07:33.672 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-18T21:07:33.672 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:07:33.682 INFO:tasks.ceph.mon.a:Stopped 2024-08-18T21:07:33.682 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.g 2024-08-18T21:07:33.682 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2024-08-18T21:07:33.682 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-08-18T21:07:33.683 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:07:33.710 INFO:tasks.ceph.mon.g:Stopped 2024-08-18T21:07:33.710 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d 2024-08-18T21:07:33.710 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2024-08-18T21:07:33.710 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-08-18T21:07:33.710 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:07:33.735 INFO:tasks.ceph.mon.d:Stopped 2024-08-18T21:07:33.735 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-08-18T21:07:33.735 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-08-18T21:07:33.735 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-18T21:07:33.735 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:07:33.789 INFO:tasks.ceph.mon.b:Stopped 2024-08-18T21:07:33.789 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 5 2024-08-18T21:07:33.789 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:07:33.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 10 monclient: get_monmap_and_config 2024-08-18T21:07:33.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 10 monclient: build_initial_monmap 2024-08-18T21:07:33.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 10 monclient: monmap: 2024-08-18T21:07:33.946 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:33.946 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:33.946 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:33.946835+0000 2024-08-18T21:07:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:33.946835+0000 2024-08-18T21:07:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:33.948 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:33.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 1 Processor -- start 2024-08-18T21:07:33.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 1 -- start start 2024-08-18T21:07:33.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 10 monclient: init 2024-08-18T21:07:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 10 monclient: _add_conns ranks=[9,3,6,10,0,4,1,5,7,2,8] 2024-08-18T21:07:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8efc0a6bd0 0x7f8efc0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 10 monclient(hunting): picked mon.noname-a con 0x7f8efc0a6bd0 addr v2:172.21.15.5:3300/0 2024-08-18T21:07:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc09f080 0x7f8efc0a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 10 monclient(hunting): picked mon.noname-g con 0x7f8efc09f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8efc139990 0x7f8efc139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 10 monclient(hunting): picked mon.noname-d con 0x7f8efc139990 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8efc09e4c0 con 0x7f8efc0a6bd0 2024-08-18T21:07:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8efc06f930 con 0x7f8efc09f080 2024-08-18T21:07:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:33.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f8efc0a7a30 con 0x7f8efc139990 2024-08-18T21:07:33.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:33.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.943+0000 7f8f0082e640 10 monclient(hunting): authenticate will time out at 1220.959986s 2024-08-18T21:07:33.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.947+0000 7f8efa59c640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7f8efc0a6bd0 msgr2=0x7f8efc0a6fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:33.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.947+0000 7f8efad9d640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8efc139990 msgr2=0x7f8efc139e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:07:33.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.947+0000 7f8efa59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8efc0a6bd0 0x7f8efc0a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:33.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.947+0000 7f8efad9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8efc139990 0x7f8efc139e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:33.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.947+0000 7f8ef9d9b640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc09f080 msgr2=0x7f8efc0a74f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:07:33.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:33.947+0000 7f8ef9d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc09f080 0x7f8efc0a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:34.151+0000 7f8efad9d640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8efc139990 msgr2=0x7f8efc139e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:07:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:34.151+0000 7f8efa59c640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7f8efc0a6bd0 msgr2=0x7f8efc0a6fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:34.151+0000 7f8efad9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8efc139990 0x7f8efc139e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:34.151+0000 7f8efa59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8efc0a6bd0 0x7f8efc0a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:34.151+0000 7f8ef9d9b640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc09f080 msgr2=0x7f8efc0a74f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:07:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:34.151+0000 7f8ef9d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc09f080 0x7f8efc0a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:34.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:34.555+0000 7f8efa59c640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7f8efc0a6bd0 msgr2=0x7f8efc0a6fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:34.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:34.555+0000 7f8efad9d640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8efc139990 msgr2=0x7f8efc139e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:07:34.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:34.555+0000 7f8efa59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8efc0a6bd0 0x7f8efc0a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:34.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:34.555+0000 7f8efad9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8efc139990 0x7f8efc139e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:34.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:34.555+0000 7f8ef9d9b640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc09f080 msgr2=0x7f8efc0a74f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:07:34.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:34.555+0000 7f8ef9d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc09f080 0x7f8efc0a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:35.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:35.359+0000 7f8efad9d640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8efc139990 msgr2=0x7f8efc139e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:07:35.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:35.359+0000 7f8efa59c640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7f8efc0a6bd0 msgr2=0x7f8efc0a6fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:35.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:35.359+0000 7f8efad9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8efc139990 0x7f8efc139e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:35.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:35.359+0000 7f8efa59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8efc0a6bd0 0x7f8efc0a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:35.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:35.359+0000 7f8ef9d9b640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc09f080 msgr2=0x7f8efc0a74f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:07:35.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:35.359+0000 7f8ef9d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc09f080 0x7f8efc0a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:35.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:35.359+0000 7f8ef959a640 1 -- DispatchQueue::entry inject delay of 0.002000 2024-08-18T21:07:36.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.943+0000 7f8ef3fff640 10 monclient(hunting): tick 2024-08-18T21:07:36.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:07:36.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 1 monclient(hunting): continuing hunt 2024-08-18T21:07:36.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:07:36.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8efc139990 msgr2=0x7f8efc139e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:36.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8efc139990 0x7f8efc139e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:36.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc09f080 msgr2=0x7f8efc0a74f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:36.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc09f080 0x7f8efc0a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:36.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7f8efc0a6bd0 msgr2=0x7f8efc0a6fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:36.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8efc0a6bd0 0x7f8efc0a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:36.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 10 monclient: _add_conns ranks=[1,5,10,4,8,7,0,2] 2024-08-18T21:07:36.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f8edc003820 addr v1:172.21.15.157:6789/0 2024-08-18T21:07:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8edc007450 0x7f8edc0098e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 10 monclient(hunting): picked mon.noname-h con 0x7f8edc007450 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:07:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8edc009fa0 0x7f8edc00c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 10 monclient(hunting): picked mon.noname-f con 0x7f8edc009fa0 addr v2:172.21.15.157:3300/0 2024-08-18T21:07:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8efc0a7fb0 con 0x7f8edc003820 2024-08-18T21:07:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f8efc09e4c0 con 0x7f8edc009fa0 2024-08-18T21:07:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f8efc06f930 con 0x7f8edc007450 2024-08-18T21:07:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef3fff640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef9d9b640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8edc007450 0x7f8edc0098e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef9d9b640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8edc007450 0x7f8edc0098e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:35934/0 (socket says 172.21.15.5:35934) 2024-08-18T21:07:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8edc009fa0 0x7f8edc00c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef9d9b640 1 -- 172.21.15.5:0/3413114035 learned_addr learned my addr 172.21.15.5:0/3413114035 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef9d9b640 10 monclient(hunting): get_auth_request con 0x7f8edc007450 auth_method 0 2024-08-18T21:07:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 10 monclient(hunting): get_auth_request con 0x7f8edc009fa0 auth_method 0 2024-08-18T21:07:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 10 monclient(hunting): handle_auth_done global_id 5401 payload 274 2024-08-18T21:07:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 1 -- 172.21.15.5:0/3413114035 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8edc007450 msgr2=0x7f8edc0098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 1 --2- 172.21.15.5:0/3413114035 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8edc007450 0x7f8edc0098e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 1 -- 172.21.15.5:0/3413114035 >> v1:172.21.15.157:6789/0 conn(0x7f8edc003820 legacy=0x7f8edc005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:07:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 10 monclient: _finish_hunting 0 2024-08-18T21:07:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 1 monclient: found mon.noname-f 2024-08-18T21:07:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:07:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8efad9d640 1 -- 172.21.15.5:0/3413114035 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8edc00dc30 con 0x7f8edc009fa0 2024-08-18T21:07:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.947+0000 7f8ef9d9b640 1 --2- 172.21.15.5:0/3413114035 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8edc007450 0x7f8edc0098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:07:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.951+0000 7f8efad9d640 1 -- 172.21.15.5:0/3413114035 reap_dead start 2024-08-18T21:07:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8efad9d640 1 -- 172.21.15.5:0/3413114035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8edc009fa0 msgr2=0x7f8edc00c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8efad9d640 1 --2- 172.21.15.5:0/3413114035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8edc009fa0 0x7f8edc00c460 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4003990 tx=0x7f8ef401cb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d273a3c8824059d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8ef959a640 1 -- 172.21.15.5:0/3413114035 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8ef40a5ce0 con 0x7f8edc009fa0 2024-08-18T21:07:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8ef959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8ef959a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:07:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8ef959a640 10 monclient: dump: 2024-08-18T21:07:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:36.960 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8ef959a640 10 monclient: _finish_auth 0 2024-08-18T21:07:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8ef959a640 10 monclient: _check_auth_tickets 2024-08-18T21:07:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8ef959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8ef959a640 1 -- 172.21.15.5:0/3413114035 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef40a9070 con 0x7f8edc009fa0 2024-08-18T21:07:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8ef959a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8ef959a640 1 -- 172.21.15.5:0/3413114035 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8ef40054e0 con 0x7f8edc009fa0 2024-08-18T21:07:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8ef959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8ef959a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:07:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8ef959a640 10 monclient: dump: 2024-08-18T21:07:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:36.962 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8f0082e640 5 monclient: authenticate success, global_id 5401 2024-08-18T21:07:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8f0082e640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8f0082e640 4 set_mon_vals no callback set 2024-08-18T21:07:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8f0082e640 10 monclient: shutdown 2024-08-18T21:07:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8f0082e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8f0082e640 1 -- 172.21.15.5:0/3413114035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8edc009fa0 msgr2=0x7f8edc00c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8f0082e640 1 --2- 172.21.15.5:0/3413114035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8edc009fa0 0x7f8edc00c460 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4003990 tx=0x7f8ef401cb30 comp rx=0 tx=0).stop 2024-08-18T21:07:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8f0082e640 1 -- 172.21.15.5:0/3413114035 shutdown_connections 2024-08-18T21:07:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8f0082e640 1 --2- 172.21.15.5:0/3413114035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8edc009fa0 0x7f8edc00c460 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8f0082e640 1 -- 172.21.15.5:0/3413114035 >> 172.21.15.5:0/3413114035 conn(0x7f8efc068700 msgr2=0x7f8efc068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.955+0000 7f8f0082e640 1 -- 172.21.15.5:0/3413114035 shutdown_connections 2024-08-18T21:07:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 1 -- 172.21.15.5:0/3413114035 wait complete. 2024-08-18T21:07:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 10 monclient: build_initial_monmap 2024-08-18T21:07:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 10 monclient: monmap: 2024-08-18T21:07:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:36.967 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 1 Processor -- start 2024-08-18T21:07:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 1 -- start start 2024-08-18T21:07:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 10 monclient: init 2024-08-18T21:07:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 10 monclient: _add_conns ranks=[5,3,0,8,7,6,4,2,1] 2024-08-18T21:07:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8edc009fa0 0x7f8efc138500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 10 monclient(hunting): picked mon.noname-h con 0x7f8edc009fa0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:07:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc122aa0 0x7f8efc138a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 10 monclient(hunting): picked mon.noname-g con 0x7f8efc122aa0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8efc13da40 0x7f8efc13de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 10 monclient(hunting): picked mon.noname-a con 0x7f8efc13da40 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:07:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc0a89f0 con 0x7f8efc13da40 2024-08-18T21:07:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8efc0a7ce0 con 0x7f8efc122aa0 2024-08-18T21:07:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f8efc139df0 con 0x7f8edc009fa0 2024-08-18T21:07:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8f0082e640 10 monclient(hunting): authenticate will time out at 1223.974380s 2024-08-18T21:07:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efad9d640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8efc13da40 msgr2=0x7f8efc13de80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8efc13da40 0x7f8efc13de80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8ef9d9b640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc122aa0 msgr2=0x7f8efc138a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:07:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8ef9d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc122aa0 0x7f8efc138a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8edc009fa0 0x7f8efc138500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8edc009fa0 0x7f8efc138500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:35946/0 (socket says 172.21.15.5:35946) 2024-08-18T21:07:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 1 -- 172.21.15.5:0/3850237128 learned_addr learned my addr 172.21.15.5:0/3850237128 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 10 monclient(hunting): get_auth_request con 0x7f8edc009fa0 auth_method 0 2024-08-18T21:07:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:36.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:36.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:36.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:36.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 10 monclient(hunting): handle_auth_done global_id 34817 payload 824 2024-08-18T21:07:36.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 1 -- 172.21.15.5:0/3850237128 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc122aa0 msgr2=0x7f8efc138a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:07:36.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 1 --2- 172.21.15.5:0/3850237128 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc122aa0 0x7f8efc138a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:36.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 1 -- 172.21.15.5:0/3850237128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8efc13da40 msgr2=0x7f8efc13de80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:07:36.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 1 --2- 172.21.15.5:0/3850237128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8efc13da40 0x7f8efc13de80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:36.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 10 monclient: _finish_hunting 0 2024-08-18T21:07:36.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 1 monclient: found mon.noname-h 2024-08-18T21:07:36.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:36.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:07:36.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.959+0000 7f8efa59c640 1 -- 172.21.15.5:0/3850237128 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8efc06e950 con 0x7f8edc009fa0 2024-08-18T21:07:36.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8efa59c640 1 -- 172.21.15.5:0/3850237128 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8edc009fa0 msgr2=0x7f8efc138500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:36.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8efa59c640 1 --2- 172.21.15.5:0/3850237128 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8edc009fa0 0x7f8efc138500 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00bd70 tx=0x7f8eec009e90 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:36.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8ef2ffd640 1 -- 172.21.15.5:0/3850237128 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8eec007ae0 con 0x7f8edc009fa0 2024-08-18T21:07:36.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8ef2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:36.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8ef2ffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:07:36.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8ef2ffd640 10 monclient: dump: 2024-08-18T21:07:36.972 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:36.974 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8ef2ffd640 10 monclient: _finish_auth 0 2024-08-18T21:07:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8ef2ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:07:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8ef2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8ef2ffd640 1 -- 172.21.15.5:0/3850237128 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eec007ce0 con 0x7f8edc009fa0 2024-08-18T21:07:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8ef2ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8ef2ffd640 1 -- 172.21.15.5:0/3850237128 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8eec0158b0 con 0x7f8edc009fa0 2024-08-18T21:07:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8f0082e640 5 monclient: authenticate success, global_id 34817 2024-08-18T21:07:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8f0082e640 10 monclient: _renew_subs 2024-08-18T21:07:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8f0082e640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:07:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8f0082e640 1 -- 172.21.15.5:0/3850237128 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8efc123a00 con 0x7f8edc009fa0 2024-08-18T21:07:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8ef3fff640 4 set_mon_vals no callback set 2024-08-18T21:07:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8ef2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8ef2ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:07:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8ef2ffd640 10 monclient: dump: 2024-08-18T21:07:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:36.976 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8f0082e640 10 monclient: _renew_subs 2024-08-18T21:07:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8f0082e640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:07:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8f0082e640 1 -- 172.21.15.5:0/3850237128 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f8efc1396a0 con 0x7f8edc009fa0 2024-08-18T21:07:36.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8f0082e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:36.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8f0082e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:36.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8f0082e640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:07:36.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8f0082e640 1 -- 172.21.15.5:0/3850237128 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8efc0a6fb0 con 0x7f8edc009fa0 2024-08-18T21:07:36.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.963+0000 7f8ef2ffd640 1 -- 172.21.15.5:0/3850237128 <== mon.5 v2:172.21.15.157:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f8eec015440 con 0x7f8edc009fa0 2024-08-18T21:07:36.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.967+0000 7f8ef2ffd640 1 --2- 172.21.15.5:0/3850237128 >> v2:172.21.15.157:6812/631023601 conn(0x7f8edc03d0a0 0x7f8edc03f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:36.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.967+0000 7f8ef2ffd640 1 -- 172.21.15.5:0/3850237128 <== mon.5 v2:172.21.15.157:3302/0 5 ==== osd_map(110..110 src has 22..110) ==== 3898+0+0 (secure 0 0 0) 0x7f8eec04f4e0 con 0x7f8edc009fa0 2024-08-18T21:07:36.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.967+0000 7f8ef9d9b640 1 --2- 172.21.15.5:0/3850237128 >> v2:172.21.15.157:6812/631023601 conn(0x7f8edc03d0a0 0x7f8edc03f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:36.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.967+0000 7f8ef9d9b640 10 monclient: get_auth_request con 0x7f8edc03d0a0 auth_method 0 2024-08-18T21:07:36.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.967+0000 7f8ef9d9b640 1 --2- 172.21.15.5:0/3850237128 >> v2:172.21.15.157:6812/631023601 conn(0x7f8edc03d0a0 0x7f8edc03f560 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40039c0 tx=0x7f8ee400d040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:36.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.979+0000 7f8ef2ffd640 1 -- 172.21.15.5:0/3850237128 <== mon.5 v2:172.21.15.157:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f8eec012d40 con 0x7f8edc009fa0 2024-08-18T21:07:36.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.979+0000 7f8ef2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:36.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:36.979+0000 7f8ef2ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.211+0000 7f8f0082e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:07:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.211+0000 7f8f0082e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:07:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.211+0000 7f8f0082e640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:07:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.211+0000 7f8f0082e640 1 -- 172.21.15.5:0/3850237128 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8efc0746d0 con 0x7f8edc009fa0 2024-08-18T21:07:37.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.211+0000 7f8ef2ffd640 1 -- 172.21.15.5:0/3850237128 <== mon.5 v2:172.21.15.157:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3172 (secure 0 0 0) 0x7f8eec04d2a0 con 0x7f8edc009fa0 2024-08-18T21:07:37.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.211+0000 7f8ef2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:07:37.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.211+0000 7f8ef2ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:37.215 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":94,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:07:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.215+0000 7f8f0082e640 1 -- 172.21.15.5:0/3850237128 >> v2:172.21.15.157:6812/631023601 conn(0x7f8edc03d0a0 msgr2=0x7f8edc03f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.215+0000 7f8f0082e640 1 --2- 172.21.15.5:0/3850237128 >> v2:172.21.15.157:6812/631023601 conn(0x7f8edc03d0a0 0x7f8edc03f560 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40039c0 tx=0x7f8ee400d040 comp rx=0 tx=0).stop 2024-08-18T21:07:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.215+0000 7f8f0082e640 10 monclient: shutdown 2024-08-18T21:07:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.215+0000 7f8f0082e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.215+0000 7f8f0082e640 1 -- 172.21.15.5:0/3850237128 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8edc009fa0 msgr2=0x7f8efc138500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.215+0000 7f8f0082e640 1 --2- 172.21.15.5:0/3850237128 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8edc009fa0 0x7f8efc138500 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00bd70 tx=0x7f8eec009e90 comp rx=0 tx=0).stop 2024-08-18T21:07:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.215+0000 7f8f0082e640 1 -- 172.21.15.5:0/3850237128 shutdown_connections 2024-08-18T21:07:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.215+0000 7f8f0082e640 1 --2- 172.21.15.5:0/3850237128 >> v2:172.21.15.157:6812/631023601 conn(0x7f8edc03d0a0 0x7f8edc03f560 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.215+0000 7f8f0082e640 1 --2- 172.21.15.5:0/3850237128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8efc13da40 0x7f8efc13de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.215+0000 7f8f0082e640 1 --2- 172.21.15.5:0/3850237128 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8efc122aa0 0x7f8efc138a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.215+0000 7f8f0082e640 1 --2- 172.21.15.5:0/3850237128 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8edc009fa0 0x7f8efc138500 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.215+0000 7f8f0082e640 1 -- 172.21.15.5:0/3850237128 >> 172.21.15.5:0/3850237128 conn(0x7f8efc068700 msgr2=0x7f8efc1405e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.215+0000 7f8f0082e640 1 -- 172.21.15.5:0/3850237128 shutdown_connections 2024-08-18T21:07:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:37.215+0000 7f8f0082e640 1 -- 172.21.15.5:0/3850237128 wait complete. 2024-08-18T21:07:40.234 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:07:40.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 10 monclient: get_monmap_and_config 2024-08-18T21:07:40.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 10 monclient: build_initial_monmap 2024-08-18T21:07:40.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 10 monclient: monmap: 2024-08-18T21:07:40.366 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:40.366 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:40.366 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:40.366515+0000 2024-08-18T21:07:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:40.366515+0000 2024-08-18T21:07:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:40.368 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:40.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 1 Processor -- start 2024-08-18T21:07:40.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 1 -- start start 2024-08-18T21:07:40.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 10 monclient: init 2024-08-18T21:07:40.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:40.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 10 monclient: _add_conns ranks=[6,9,5,7,8,1,0,4,3,10,2] 2024-08-18T21:07:40.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f830c0a6bd0 0x7f830c0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:40.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 10 monclient(hunting): picked mon.noname-d con 0x7f830c0a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:40.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f830c09f080 0x7f830c0a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:40.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 10 monclient(hunting): picked mon.noname-a con 0x7f830c09f080 addr v2:172.21.15.5:3300/0 2024-08-18T21:07:40.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f830c139990 0x7f830c139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:40.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 10 monclient(hunting): picked mon.noname-h con 0x7f830c139990 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:07:40.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:40.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f830c09e4c0 con 0x7f830c09f080 2024-08-18T21:07:40.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:40.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f830c06f930 con 0x7f830c139990 2024-08-18T21:07:40.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:40.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f830c0a7a30 con 0x7f830c0a6bd0 2024-08-18T21:07:40.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:40.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8314260640 10 monclient(hunting): authenticate will time out at 1227.379769s 2024-08-18T21:07:40.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8311ffc640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f830c0a6bd0 msgr2=0x7f830c0a6fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:07:40.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f8311ffc640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f830c0a6bd0 0x7f830c0a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:40.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f83117fb640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7f830c09f080 msgr2=0x7f830c0a74f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:40.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.363+0000 7f83117fb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f830c09f080 0x7f830c0a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:40.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f830c139990 0x7f830c139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:40.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f830c139990 0x7f830c139e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:35954/0 (socket says 172.21.15.5:35954) 2024-08-18T21:07:40.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 1 -- 172.21.15.5:0/3089829443 learned_addr learned my addr 172.21.15.5:0/3089829443 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:40.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 10 monclient(hunting): get_auth_request con 0x7f830c139990 auth_method 0 2024-08-18T21:07:40.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:40.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:40.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:40.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:40.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:40.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:40.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 10 monclient(hunting): handle_auth_done global_id 34826 payload 274 2024-08-18T21:07:40.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 1 -- 172.21.15.5:0/3089829443 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f830c0a6bd0 msgr2=0x7f830c0a6fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:40.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 1 --2- 172.21.15.5:0/3089829443 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f830c0a6bd0 0x7f830c0a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:40.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 1 -- 172.21.15.5:0/3089829443 >> v2:172.21.15.5:3300/0 conn(0x7f830c09f080 msgr2=0x7f830c0a74f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:40.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 1 --2- 172.21.15.5:0/3089829443 >> v2:172.21.15.5:3300/0 conn(0x7f830c09f080 0x7f830c0a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:40.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 10 monclient: _finish_hunting 0 2024-08-18T21:07:40.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 1 monclient: found mon.noname-h 2024-08-18T21:07:40.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:40.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:07:40.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.367+0000 7f83127fd640 1 -- 172.21.15.5:0/3089829443 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830c0a7fb0 con 0x7f830c139990 2024-08-18T21:07:40.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f83127fd640 1 -- 172.21.15.5:0/3089829443 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f830c139990 msgr2=0x7f830c139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:40.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f83127fd640 1 --2- 172.21.15.5:0/3089829443 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f830c139990 0x7f830c139e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8304009870 tx=0x7f830401c460 comp rx=0 tx=0).ready entity=mon.5 client_cookie=3294750216ca8fc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:40.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8310ffa640 1 -- 172.21.15.5:0/3089829443 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f83040b0070 con 0x7f830c139990 2024-08-18T21:07:40.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8310ffa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:40.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8310ffa640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:07:40.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8310ffa640 10 monclient: dump: 2024-08-18T21:07:40.376 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:40.376 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:40.376 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:40.376 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:40.376 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:40.376 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:40.376 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:40.376 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:40.376 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:40.376 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:40.376 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:40.376 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:40.377 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8310ffa640 10 monclient: _finish_auth 0 2024-08-18T21:07:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8310ffa640 10 monclient: _check_auth_tickets 2024-08-18T21:07:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8310ffa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8310ffa640 1 -- 172.21.15.5:0/3089829443 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83040aa810 con 0x7f830c139990 2024-08-18T21:07:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8310ffa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8310ffa640 1 -- 172.21.15.5:0/3089829443 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f83040a93e0 con 0x7f830c139990 2024-08-18T21:07:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8314260640 5 monclient: authenticate success, global_id 34826 2024-08-18T21:07:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8314260640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8314260640 4 set_mon_vals no callback set 2024-08-18T21:07:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8310ffa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8310ffa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:07:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8310ffa640 10 monclient: dump: 2024-08-18T21:07:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:40.379 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8314260640 10 monclient: shutdown 2024-08-18T21:07:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8314260640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8314260640 1 -- 172.21.15.5:0/3089829443 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f830c139990 msgr2=0x7f830c139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8314260640 1 --2- 172.21.15.5:0/3089829443 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f830c139990 0x7f830c139e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8304009870 tx=0x7f830401c460 comp rx=0 tx=0).stop 2024-08-18T21:07:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8314260640 1 -- 172.21.15.5:0/3089829443 shutdown_connections 2024-08-18T21:07:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8314260640 1 --2- 172.21.15.5:0/3089829443 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f830c139990 0x7f830c139e10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8314260640 1 --2- 172.21.15.5:0/3089829443 >> v2:172.21.15.5:3300/0 conn(0x7f830c09f080 0x7f830c0a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8314260640 1 --2- 172.21.15.5:0/3089829443 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f830c0a6bd0 0x7f830c0a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:40.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8314260640 1 -- 172.21.15.5:0/3089829443 >> 172.21.15.5:0/3089829443 conn(0x7f830c068700 msgr2=0x7f830c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:40.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8314260640 1 -- 172.21.15.5:0/3089829443 shutdown_connections 2024-08-18T21:07:40.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.371+0000 7f8314260640 1 -- 172.21.15.5:0/3089829443 wait complete. 2024-08-18T21:07:40.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 10 monclient: build_initial_monmap 2024-08-18T21:07:40.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 10 monclient: monmap: 2024-08-18T21:07:40.385 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:40.385 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:40.385 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:40.385 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:40.385 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:40.385 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:40.385 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:40.385 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:40.386 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:40.386 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:40.386 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:40.386 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:40.386 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:40.386 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:40.386 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:40.386 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:40.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 1 Processor -- start 2024-08-18T21:07:40.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 1 -- start start 2024-08-18T21:07:40.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 10 monclient: init 2024-08-18T21:07:40.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:40.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 10 monclient: _add_conns ranks=[7,6,3,5,4,0,1,8,2] 2024-08-18T21:07:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f830c09f080 0x7f830c138350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 10 monclient(hunting): picked mon.noname-i con 0x7f830c09f080 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:07:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f830c0a6bd0 0x7f830c138890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 10 monclient(hunting): picked mon.noname-d con 0x7f830c0a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f830c139990 0x7f830c13da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 10 monclient(hunting): picked mon.noname-g con 0x7f830c139990 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f830c0a89f0 con 0x7f830c139990 2024-08-18T21:07:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f830c0a7ce0 con 0x7f830c0a6bd0 2024-08-18T21:07:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f830c143610 con 0x7f830c09f080 2024-08-18T21:07:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8314260640 10 monclient(hunting): authenticate will time out at 1227.389479s 2024-08-18T21:07:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f83117fb640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f830c0a6bd0 msgr2=0x7f830c138890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:07:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f83117fb640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f830c0a6bd0 0x7f830c138890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f83127fd640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f830c139990 msgr2=0x7f830c13da90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:07:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f83127fd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f830c139990 0x7f830c13da90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f830c09f080 0x7f830c138350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f830c09f080 0x7f830c138350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:34764/0 (socket says 172.21.15.5:34764) 2024-08-18T21:07:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 1 -- 172.21.15.5:0/3160312578 learned_addr learned my addr 172.21.15.5:0/3160312578 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 10 monclient(hunting): get_auth_request con 0x7f830c09f080 auth_method 0 2024-08-18T21:07:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 10 monclient(hunting): handle_auth_done global_id 5335 payload 824 2024-08-18T21:07:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 1 -- 172.21.15.5:0/3160312578 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f830c0a6bd0 msgr2=0x7f830c138890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:07:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 1 --2- 172.21.15.5:0/3160312578 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f830c0a6bd0 0x7f830c138890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 1 -- 172.21.15.5:0/3160312578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f830c139990 msgr2=0x7f830c13da90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:07:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 1 --2- 172.21.15.5:0/3160312578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f830c139990 0x7f830c13da90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 10 monclient: _finish_hunting 0 2024-08-18T21:07:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 1 monclient: found mon.noname-i 2024-08-18T21:07:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:07:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.375+0000 7f8311ffc640 1 -- 172.21.15.5:0/3160312578 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830c13f890 con 0x7f830c09f080 2024-08-18T21:07:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f8311ffc640 1 -- 172.21.15.5:0/3160312578 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f830c09f080 msgr2=0x7f830c138350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f8311ffc640 1 --2- 172.21.15.5:0/3160312578 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f830c09f080 0x7f830c138350 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f830800b9e0 tx=0x7f830800bea0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82fe7fc640 1 -- 172.21.15.5:0/3160312578 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f830800cbb0 con 0x7f830c09f080 2024-08-18T21:07:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82fe7fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:07:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82fe7fc640 10 monclient: dump: 2024-08-18T21:07:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:40.391 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82fe7fc640 10 monclient: _finish_auth 0 2024-08-18T21:07:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82fe7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:07:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82fe7fc640 1 -- 172.21.15.5:0/3160312578 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8308010070 con 0x7f830c09f080 2024-08-18T21:07:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82fe7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82fe7fc640 1 -- 172.21.15.5:0/3160312578 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f830800cd90 con 0x7f830c09f080 2024-08-18T21:07:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f8314260640 5 monclient: authenticate success, global_id 5335 2024-08-18T21:07:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f8314260640 10 monclient: _renew_subs 2024-08-18T21:07:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f8314260640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:07:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f8314260640 1 -- 172.21.15.5:0/3160312578 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f830c0ab2e0 con 0x7f830c09f080 2024-08-18T21:07:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82fe7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:07:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82ff7fe640 4 set_mon_vals no callback set 2024-08-18T21:07:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82fe7fc640 10 monclient: dump: 2024-08-18T21:07:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:40.394 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f8314260640 10 monclient: _renew_subs 2024-08-18T21:07:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f8314260640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:07:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f8314260640 1 -- 172.21.15.5:0/3160312578 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f830c123ed0 con 0x7f830c09f080 2024-08-18T21:07:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f8314260640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f8314260640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f8314260640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:07:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f8314260640 1 -- 172.21.15.5:0/3160312578 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f830c06e910 con 0x7f830c09f080 2024-08-18T21:07:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82fe7fc640 1 -- 172.21.15.5:0/3160312578 <== mon.7 v2:172.21.15.157:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f830801d3a0 con 0x7f830c09f080 2024-08-18T21:07:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82fe7fc640 1 --2- 172.21.15.5:0/3160312578 >> v2:172.21.15.157:6812/631023601 conn(0x7f82f003bdf0 0x7f82f003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.379+0000 7f82fe7fc640 1 -- 172.21.15.5:0/3160312578 <== mon.7 v2:172.21.15.157:3303/0 5 ==== osd_map(110..110 src has 22..110) ==== 3898+0+0 (secure 0 0 0) 0x7f830804eb70 con 0x7f830c09f080 2024-08-18T21:07:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.383+0000 7f83117fb640 1 --2- 172.21.15.5:0/3160312578 >> v2:172.21.15.157:6812/631023601 conn(0x7f82f003bdf0 0x7f82f003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.383+0000 7f83117fb640 10 monclient: get_auth_request con 0x7f82f003bdf0 auth_method 0 2024-08-18T21:07:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.383+0000 7f83117fb640 1 --2- 172.21.15.5:0/3160312578 >> v2:172.21.15.157:6812/631023601 conn(0x7f82f003bdf0 0x7f82f003e2b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f830c13f100 tx=0x7f8300006cf0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.395+0000 7f82fe7fc640 1 -- 172.21.15.5:0/3160312578 <== mon.7 v2:172.21.15.157:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f8308005a80 con 0x7f830c09f080 2024-08-18T21:07:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.395+0000 7f82fe7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.395+0000 7f82fe7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:40.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.623+0000 7f8314260640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:07:40.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.623+0000 7f8314260640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:07:40.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.623+0000 7f8314260640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:07:40.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.623+0000 7f8314260640 1 -- 172.21.15.5:0/3160312578 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f830c139e10 con 0x7f830c09f080 2024-08-18T21:07:40.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f82fe7fc640 1 -- 172.21.15.5:0/3160312578 <== mon.7 v2:172.21.15.157:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7f830804c930 con 0x7f830c09f080 2024-08-18T21:07:40.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f82fe7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:07:40.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f82fe7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:40.629 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":94,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:07:40.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f8314260640 1 -- 172.21.15.5:0/3160312578 >> v2:172.21.15.157:6812/631023601 conn(0x7f82f003bdf0 msgr2=0x7f82f003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:40.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f8314260640 1 --2- 172.21.15.5:0/3160312578 >> v2:172.21.15.157:6812/631023601 conn(0x7f82f003bdf0 0x7f82f003e2b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f830c13f100 tx=0x7f8300006cf0 comp rx=0 tx=0).stop 2024-08-18T21:07:40.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f8314260640 10 monclient: shutdown 2024-08-18T21:07:40.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f8314260640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:40.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f8314260640 1 -- 172.21.15.5:0/3160312578 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f830c09f080 msgr2=0x7f830c138350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:40.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f8314260640 1 --2- 172.21.15.5:0/3160312578 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f830c09f080 0x7f830c138350 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f830800b9e0 tx=0x7f830800bea0 comp rx=0 tx=0).stop 2024-08-18T21:07:40.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f8314260640 1 -- 172.21.15.5:0/3160312578 shutdown_connections 2024-08-18T21:07:40.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f8314260640 1 --2- 172.21.15.5:0/3160312578 >> v2:172.21.15.157:6812/631023601 conn(0x7f82f003bdf0 0x7f82f003e2b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:40.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f8314260640 1 --2- 172.21.15.5:0/3160312578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f830c139990 0x7f830c13da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:40.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f8314260640 1 --2- 172.21.15.5:0/3160312578 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f830c0a6bd0 0x7f830c138890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:40.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f8314260640 1 --2- 172.21.15.5:0/3160312578 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f830c09f080 0x7f830c138350 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:40.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f8314260640 1 -- 172.21.15.5:0/3160312578 >> 172.21.15.5:0/3160312578 conn(0x7f830c068700 msgr2=0x7f830c0aa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:40.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f8314260640 1 -- 172.21.15.5:0/3160312578 shutdown_connections 2024-08-18T21:07:40.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:40.627+0000 7f8314260640 1 -- 172.21.15.5:0/3160312578 wait complete. 2024-08-18T21:07:43.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:07:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 10 monclient: get_monmap_and_config 2024-08-18T21:07:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 10 monclient: build_initial_monmap 2024-08-18T21:07:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 10 monclient: monmap: 2024-08-18T21:07:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:43.781824+0000 2024-08-18T21:07:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:43.781824+0000 2024-08-18T21:07:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:43.782 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 1 Processor -- start 2024-08-18T21:07:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 1 -- start start 2024-08-18T21:07:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 10 monclient: init 2024-08-18T21:07:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 10 monclient: _add_conns ranks=[9,8,5,2,7,10,0,6,3,4,1] 2024-08-18T21:07:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b1c0a6ce0 0x7f7b1c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 10 monclient(hunting): picked mon.noname-a con 0x7f7b1c0a6ce0 addr v2:172.21.15.5:3300/0 2024-08-18T21:07:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 0x7f7b1c139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 10 monclient(hunting): picked mon.noname-e con 0x7f7b1c0a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:07:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 0x7f7b1c13a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 10 monclient(hunting): picked mon.noname-h con 0x7f7b1c139fe0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:07:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1c0a5000 con 0x7f7b1c0a6ce0 2024-08-18T21:07:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f7b1c0a4360 con 0x7f7b1c139fe0 2024-08-18T21:07:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f7b1c0a45d0 con 0x7f7b1c0a7600 2024-08-18T21:07:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b217fe640 10 monclient(hunting): authenticate will time out at 1230.795042s 2024-08-18T21:07:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1affd640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7f7b1c0a6ce0 msgr2=0x7f7b1c0a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b1c0a6ce0 0x7f7b1c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1a7fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 0x7f7b1c139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1a7fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 0x7f7b1c139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:41524/0 (socket says 172.21.15.5:41524) 2024-08-18T21:07:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 learned_addr learned my addr 172.21.15.5:0/1000021311 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1a7fc640 10 monclient(hunting): get_auth_request con 0x7f7b1c0a7600 auth_method 0 2024-08-18T21:07:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 msgr2=0x7f7b1c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:07:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 msgr2=0x7f7b1c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 0x7f7b1c139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 0x7f7b1c139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 0x7f7b1c13a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request con 0x7f7b1c139fe0 auth_method 0 2024-08-18T21:07:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 msgr2=0x7f7b1c13a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:07:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 msgr2=0x7f7b1c13a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 0x7f7b1c13a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.779+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 0x7f7b1c13a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> v2:172.21.15.5:3300/0 conn(0x7f7b1c0a6ce0 msgr2=0x7f7b1c0a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.5:3300/0 conn(0x7f7b1c0a6ce0 0x7f7b1c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 0x7f7b1c139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1a7fc640 10 monclient(hunting): get_auth_request con 0x7f7b1c0a7600 auth_method 0 2024-08-18T21:07:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 msgr2=0x7f7b1c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 msgr2=0x7f7b1c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 0x7f7b1c139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 0x7f7b1c139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 0x7f7b1c13a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request con 0x7f7b1c139fe0 auth_method 0 2024-08-18T21:07:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 msgr2=0x7f7b1c13a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:07:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 msgr2=0x7f7b1c13a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 0x7f7b1c13a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:43.983+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 0x7f7b1c13a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:44.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> v2:172.21.15.5:3300/0 conn(0x7f7b1c0a6ce0 msgr2=0x7f7b1c0a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:44.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.5:3300/0 conn(0x7f7b1c0a6ce0 0x7f7b1c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:44.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 0x7f7b1c13a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:44.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request con 0x7f7b1c139fe0 auth_method 0 2024-08-18T21:07:44.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:44.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:44.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:44.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 0x7f7b1c139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:44.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1a7fc640 10 monclient(hunting): get_auth_request con 0x7f7b1c0a7600 auth_method 0 2024-08-18T21:07:44.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:44.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:44.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:44.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 msgr2=0x7f7b1c13a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:44.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 msgr2=0x7f7b1c13a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:44.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 0x7f7b1c13a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:44.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 0x7f7b1c13a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:44.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 msgr2=0x7f7b1c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:07:44.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 msgr2=0x7f7b1c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:44.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 0x7f7b1c139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:44.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:44.387+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 0x7f7b1c139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:45.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> v2:172.21.15.5:3300/0 conn(0x7f7b1c0a6ce0 msgr2=0x7f7b1c0a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:45.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.5:3300/0 conn(0x7f7b1c0a6ce0 0x7f7b1c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:45.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 0x7f7b1c139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:45.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1a7fc640 10 monclient(hunting): get_auth_request con 0x7f7b1c0a7600 auth_method 0 2024-08-18T21:07:45.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:45.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:45.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 0x7f7b1c13a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:45.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:45.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request con 0x7f7b1c139fe0 auth_method 0 2024-08-18T21:07:45.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:45.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:45.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:45.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 msgr2=0x7f7b1c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:07:45.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 msgr2=0x7f7b1c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:45.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 0x7f7b1c139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:45.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 msgr2=0x7f7b1c13a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:45.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 0x7f7b1c139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:45.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 msgr2=0x7f7b1c13a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:45.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 0x7f7b1c13a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:45.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:45.191+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 0x7f7b1c13a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 10 monclient(hunting): tick 2024-08-18T21:07:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:07:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 1 monclient(hunting): continuing hunt 2024-08-18T21:07:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:07:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 msgr2=0x7f7b1c139aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b1c0a7600 0x7f7b1c139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 msgr2=0x7f7b1c13a440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7b1c139fe0 0x7f7b1c13a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 >> v2:172.21.15.5:3300/0 conn(0x7f7b1c0a6ce0 msgr2=0x7f7b1c0a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.5:3300/0 conn(0x7f7b1c0a6ce0 0x7f7b1c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 10 monclient: _add_conns ranks=[4,6,7,10,1,0,2,3] 2024-08-18T21:07:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 0x7f7afc005c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 10 monclient(hunting): picked mon.noname-c con 0x7f7afc003810 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:07:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc006260 0x7f7afc0086f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 10 monclient(hunting): picked mon.noname-d con 0x7f7afc006260 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 0x7f7afc00b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 10 monclient(hunting): picked mon.noname-i con 0x7f7afc008de0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:07:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f7b1c0a4360 con 0x7f7afc003810 2024-08-18T21:07:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f7b1c0a45d0 con 0x7f7afc006260 2024-08-18T21:07:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7afc00b9f0 con 0x7f7afc008de0 2024-08-18T21:07:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b18ff9640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc006260 msgr2=0x7f7afc0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:07:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc006260 0x7f7afc0086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 0x7f7afc005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b1affd640 10 monclient(hunting): get_auth_request con 0x7f7afc003810 auth_method 0 2024-08-18T21:07:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b1affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.779+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 0x7f7afc00b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.783+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request con 0x7f7afc008de0 auth_method 0 2024-08-18T21:07:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.783+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.783+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.783+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.783+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 msgr2=0x7f7afc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.783+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 msgr2=0x7f7afc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.783+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 0x7f7afc005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.783+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 0x7f7afc005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.783+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 msgr2=0x7f7afc00b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:07:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.783+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 msgr2=0x7f7afc00b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.783+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 0x7f7afc00b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.783+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 0x7f7afc00b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.983+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc006260 msgr2=0x7f7afc0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:07:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.983+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc006260 0x7f7afc0086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:46.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 0x7f7afc00b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:46.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request con 0x7f7afc008de0 auth_method 0 2024-08-18T21:07:46.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:46.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:46.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:46.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 msgr2=0x7f7afc00b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:46.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 msgr2=0x7f7afc00b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:46.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 0x7f7afc00b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:46.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 0x7f7afc00b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 0x7f7afc005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1affd640 10 monclient(hunting): get_auth_request con 0x7f7afc003810 auth_method 0 2024-08-18T21:07:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 msgr2=0x7f7afc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 msgr2=0x7f7afc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 0x7f7afc005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:46.987+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 0x7f7afc005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.387+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc006260 msgr2=0x7f7afc0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:07:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.387+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc006260 0x7f7afc0086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 0x7f7afc005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1affd640 10 monclient(hunting): get_auth_request con 0x7f7afc003810 auth_method 0 2024-08-18T21:07:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 msgr2=0x7f7afc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 msgr2=0x7f7afc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 0x7f7afc005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 0x7f7afc005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 0x7f7afc00b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request con 0x7f7afc008de0 auth_method 0 2024-08-18T21:07:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 msgr2=0x7f7afc00b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:07:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 msgr2=0x7f7afc00b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 0x7f7afc00b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:47.391+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 0x7f7afc00b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:48.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.191+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc006260 msgr2=0x7f7afc0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:07:48.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.191+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc006260 0x7f7afc0086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:48.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 0x7f7afc005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:48.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1affd640 10 monclient(hunting): get_auth_request con 0x7f7afc003810 auth_method 0 2024-08-18T21:07:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 msgr2=0x7f7afc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 msgr2=0x7f7afc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 0x7f7afc005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 0x7f7afc005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 0x7f7afc00b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request con 0x7f7afc008de0 auth_method 0 2024-08-18T21:07:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 msgr2=0x7f7afc00b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:07:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 msgr2=0x7f7afc00b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 0x7f7afc00b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:48.195+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 0x7f7afc00b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 10 monclient(hunting): tick 2024-08-18T21:07:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:07:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 1 monclient(hunting): continuing hunt 2024-08-18T21:07:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:07:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 msgr2=0x7f7afc00b270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7afc008de0 0x7f7afc00b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc006260 msgr2=0x7f7afc0086f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc006260 0x7f7afc0086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 msgr2=0x7f7afc005c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7afc003810 0x7f7afc005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 reap_dead start 2024-08-18T21:07:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 10 monclient: _add_conns ranks=[10,1,2,0,3] 2024-08-18T21:07:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 0x7f7afc009260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 10 monclient(hunting): picked mon.noname-f con 0x7f7afc0066e0 addr v2:172.21.15.157:3300/0 2024-08-18T21:07:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7afc0097a0 addr v1:172.21.15.157:6789/0 2024-08-18T21:07:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc00b330 0x7f7afc005c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 10 monclient(hunting): picked mon.noname-b con 0x7f7afc00b330 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1c0a32d0 con 0x7f7afc0097a0 2024-08-18T21:07:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1c0a4360 con 0x7f7afc0066e0 2024-08-18T21:07:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.779+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1c0a45d0 con 0x7f7afc00b330 2024-08-18T21:07:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.783+0000 7f7b18ff9640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.783+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc00b330 msgr2=0x7f7afc005c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:07:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.783+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc00b330 0x7f7afc005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.783+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 0x7f7afc009260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.783+0000 7f7b1affd640 10 monclient(hunting): get_auth_request con 0x7f7afc0066e0 auth_method 0 2024-08-18T21:07:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.783+0000 7f7b1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.783+0000 7f7b1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.783+0000 7f7b1affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.783+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 msgr2=0x7f7afc009260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.783+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 msgr2=0x7f7afc009260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.783+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 0x7f7afc009260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.783+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 0x7f7afc009260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.783+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> v1:172.21.15.157:6789/0 conn(0x7f7afc0097a0 legacy=0x7f7afc009c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:49.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.987+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc00b330 msgr2=0x7f7afc005c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:07:49.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.987+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc00b330 0x7f7afc005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:49.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.987+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 0x7f7afc009260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:49.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.987+0000 7f7b1affd640 10 monclient(hunting): get_auth_request con 0x7f7afc0066e0 auth_method 0 2024-08-18T21:07:49.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.987+0000 7f7b1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.987+0000 7f7b1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.987+0000 7f7b1affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.987+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 msgr2=0x7f7afc009260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.987+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 msgr2=0x7f7afc009260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.987+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 0x7f7afc009260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:49.987+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 0x7f7afc009260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:50.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:50.391+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 0x7f7afc009260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:50.391+0000 7f7b1affd640 10 monclient(hunting): get_auth_request con 0x7f7afc0066e0 auth_method 0 2024-08-18T21:07:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:50.391+0000 7f7b1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:50.391+0000 7f7b1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:50.391+0000 7f7b1affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:50.391+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 msgr2=0x7f7afc009260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:50.391+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc00b330 msgr2=0x7f7afc005c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:07:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:50.391+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 msgr2=0x7f7afc009260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:50.391+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 0x7f7afc009260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:50.391+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc00b330 0x7f7afc005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:50.391+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 0x7f7afc009260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:51.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:51.195+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc00b330 msgr2=0x7f7afc005c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:07:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:51.195+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc00b330 0x7f7afc005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:51.195+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 0x7f7afc009260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:51.195+0000 7f7b1affd640 10 monclient(hunting): get_auth_request con 0x7f7afc0066e0 auth_method 0 2024-08-18T21:07:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:51.195+0000 7f7b1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:51.195+0000 7f7b1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:51.195+0000 7f7b1affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:07:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:51.195+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 msgr2=0x7f7afc009260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:07:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:51.195+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 msgr2=0x7f7afc009260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:07:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:51.195+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 0x7f7afc009260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:07:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:51.195+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 0x7f7afc009260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:52.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 10 monclient(hunting): tick 2024-08-18T21:07:52.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:07:52.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 1 monclient(hunting): continuing hunt 2024-08-18T21:07:52.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:07:52.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc00b330 msgr2=0x7f7afc005c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:52.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc00b330 0x7f7afc005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:52.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 msgr2=0x7f7afc009260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.157:3300/0 conn(0x7f7afc0066e0 0x7f7afc009260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 >> v1:172.21.15.157:6789/0 conn(0x7f7afc0097a0 legacy=0x7f7afc009c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 10 monclient: _add_conns ranks=[3,0] 2024-08-18T21:07:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7afc00e1e0 0x7f7afc00e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 10 monclient(hunting): picked mon.noname-g con 0x7f7afc00e1e0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7afc00ec30 addr v1:172.21.15.5:6789/0 2024-08-18T21:07:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7afc00f0a0 con 0x7f7afc00ec30 2024-08-18T21:07:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1c0a4360 con 0x7f7afc00e1e0 2024-08-18T21:07:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b18ff9640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> v1:172.21.15.5:6789/0 conn(0x7f7afc00ec30 legacy=0x7f7afc013330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:07:52.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7afc00e1e0 msgr2=0x7f7afc00e5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:07:52.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.783+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7afc00e1e0 0x7f7afc00e5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.987+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> v1:172.21.15.5:6789/0 conn(0x7f7afc00ec30 legacy=0x7f7afc013330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:07:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.987+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7afc00e1e0 msgr2=0x7f7afc00e5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:07:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:52.987+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7afc00e1e0 0x7f7afc00e5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:53.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:53.391+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> v1:172.21.15.5:6789/0 conn(0x7f7afc00ec30 legacy=0x7f7afc013330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:07:53.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:53.391+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7afc00e1e0 msgr2=0x7f7afc00e5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:07:53.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:53.391+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7afc00e1e0 0x7f7afc00e5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:54.136 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29288]: starting. 2024-08-18T21:07:54.136 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29288]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29286 2024-08-18T21:07:54.136 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29288]: shutting down. 2024-08-18T21:07:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:54.195+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> v1:172.21.15.5:6789/0 conn(0x7f7afc00ec30 legacy=0x7f7afc013330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:07:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:54.195+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7afc00e1e0 msgr2=0x7f7afc00e5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:07:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:54.195+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7afc00e1e0 0x7f7afc00e5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 10 monclient(hunting): tick 2024-08-18T21:07:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:07:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 1 monclient(hunting): continuing hunt 2024-08-18T21:07:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:07:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7afc00e1e0 msgr2=0x7f7afc00e5c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7afc00e1e0 0x7f7afc00e5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 >> v1:172.21.15.5:6789/0 conn(0x7f7afc00ec30 legacy=0x7f7afc013330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 10 monclient: _add_conns ranks=[8,6,9,2,0,4,7,5,3,1,10] 2024-08-18T21:07:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 reap_dead start 2024-08-18T21:07:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7afc014bd0 0x7f7afc014fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 10 monclient(hunting): picked mon.noname-e con 0x7f7afc014bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:07:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc015630 0x7f7afc00e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 10 monclient(hunting): picked mon.noname-d con 0x7f7afc015630 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.5:3300/0 conn(0x7f7afc00e720 0x7f7afc009260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:55.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 10 monclient(hunting): picked mon.noname-a con 0x7f7afc00e720 addr v2:172.21.15.5:3300/0 2024-08-18T21:07:55.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:55.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1c0a4360 con 0x7f7afc00e720 2024-08-18T21:07:55.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:55.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f7b1c0a45d0 con 0x7f7afc015630 2024-08-18T21:07:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 1 -- 172.21.15.5:0/1000021311 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f7afc00b9f0 con 0x7f7afc014bd0 2024-08-18T21:07:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b18ff9640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/1000021311 >> v2:172.21.15.5:3300/0 conn(0x7f7afc00e720 msgr2=0x7f7afc009260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc015630 msgr2=0x7f7afc00e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:07:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.5:3300/0 conn(0x7f7afc00e720 0x7f7afc009260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc015630 0x7f7afc00e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7afc014bd0 0x7f7afc014fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 10 monclient(hunting): get_auth_request con 0x7f7afc014bd0 auth_method 0 2024-08-18T21:07:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 10 monclient(hunting): handle_auth_done global_id 54593 payload 274 2024-08-18T21:07:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc015630 msgr2=0x7f7afc00e1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc015630 0x7f7afc00e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> v2:172.21.15.5:3300/0 conn(0x7f7afc00e720 msgr2=0x7f7afc009260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:07:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.5:3300/0 conn(0x7f7afc00e720 0x7f7afc009260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 10 monclient: _finish_hunting 0 2024-08-18T21:07:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 1 monclient: found mon.noname-e 2024-08-18T21:07:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:07:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.783+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc015c30 con 0x7f7afc014bd0 2024-08-18T21:07:55.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b1affd640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7afc014bd0 msgr2=0x7f7afc014fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:55.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7afc014bd0 0x7f7afc014fb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b04003990 tx=0x7f7b0401ecb0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=38a562a9814bfee6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:55.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b19ffb640 1 -- 172.21.15.5:0/1000021311 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7b040ad070 con 0x7f7afc014bd0 2024-08-18T21:07:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b19ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b19ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:07:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b19ffb640 10 monclient: dump: 2024-08-18T21:07:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:55.804 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:55.804 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:55.804 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:55.804 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:55.804 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:55.805 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:55.805 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:55.805 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:55.805 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:55.805 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:55.805 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:55.806 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:55.806 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:55.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b19ffb640 10 monclient: _finish_auth 0 2024-08-18T21:07:55.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b19ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:07:55.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:55.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b19ffb640 1 -- 172.21.15.5:0/1000021311 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b040a7c70 con 0x7f7afc014bd0 2024-08-18T21:07:55.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b19ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:55.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b19ffb640 1 -- 172.21.15.5:0/1000021311 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7b040a7e20 con 0x7f7afc014bd0 2024-08-18T21:07:55.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b19ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:55.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b19ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:07:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b19ffb640 10 monclient: dump: 2024-08-18T21:07:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:55.809 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:55.809 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:55.809 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:55.809 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:55.809 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:55.809 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:55.810 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:55.810 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:55.810 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:55.810 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:55.810 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:55.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b217fe640 5 monclient: authenticate success, global_id 54593 2024-08-18T21:07:55.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b217fe640 10 monclient: get_monmap_and_config success 2024-08-18T21:07:55.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b217fe640 4 set_mon_vals no callback set 2024-08-18T21:07:55.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b217fe640 10 monclient: shutdown 2024-08-18T21:07:55.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b217fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:55.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b217fe640 1 -- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7afc014bd0 msgr2=0x7f7afc014fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b217fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7afc014bd0 0x7f7afc014fb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b04003990 tx=0x7f7b0401ecb0 comp rx=0 tx=0).stop 2024-08-18T21:07:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b217fe640 1 -- 172.21.15.5:0/1000021311 shutdown_connections 2024-08-18T21:07:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b217fe640 1 --2- 172.21.15.5:0/1000021311 >> v2:172.21.15.5:3300/0 conn(0x7f7afc00e720 0x7f7afc009260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b217fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc015630 0x7f7afc00e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b217fe640 1 --2- 172.21.15.5:0/1000021311 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7afc014bd0 0x7f7afc014fb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:55.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b217fe640 1 -- 172.21.15.5:0/1000021311 >> 172.21.15.5:0/1000021311 conn(0x7f7b1c0acbc0 msgr2=0x7f7b1c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:55.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b217fe640 1 -- 172.21.15.5:0/1000021311 shutdown_connections 2024-08-18T21:07:55.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.791+0000 7f7b217fe640 1 -- 172.21.15.5:0/1000021311 wait complete. 2024-08-18T21:07:55.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 10 monclient: build_initial_monmap 2024-08-18T21:07:55.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 10 monclient: monmap: 2024-08-18T21:07:55.813 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:07:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:07:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:07:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:07:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:07:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:55.816 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:55.816 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:55.816 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:55.816 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:55.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 1 Processor -- start 2024-08-18T21:07:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 1 -- start start 2024-08-18T21:07:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 10 monclient: init 2024-08-18T21:07:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 10 monclient: _add_conns ranks=[6,0,2,3,7,5,8,1,4] 2024-08-18T21:07:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc00e720 0x7f7b1c0a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:55.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 10 monclient(hunting): picked mon.noname-d con 0x7f7afc00e720 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:07:55.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7afc014bd0 0x7f7b1c1d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:55.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 10 monclient(hunting): picked mon.noname-a con 0x7f7afc014bd0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:07:55.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc015630 0x7f7b1c138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:55.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 10 monclient(hunting): picked mon.noname-b con 0x7f7afc015630 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:55.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:55.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c0a79e0 con 0x7f7afc014bd0 2024-08-18T21:07:55.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:55.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1c0a8220 con 0x7f7afc015630 2024-08-18T21:07:55.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:55.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f7b1c125440 con 0x7f7afc00e720 2024-08-18T21:07:55.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:55.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b1affd640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc00e720 msgr2=0x7f7b1c0a1a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:07:55.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b217fe640 10 monclient(hunting): authenticate will time out at 1242.811166s 2024-08-18T21:07:55.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b1affd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc00e720 0x7f7b1c0a1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:55.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b1a7fc640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7afc014bd0 msgr2=0x7f7b1c1d1f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:55.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b1a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7afc014bd0 0x7f7b1c1d1f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:55.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b1b7fe640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc015630 msgr2=0x7f7b1c138040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:07:55.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.795+0000 7f7b1b7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc015630 0x7f7b1c138040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:56.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.999+0000 7f7b1affd640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc00e720 msgr2=0x7f7b1c0a1a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:07:56.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.999+0000 7f7b1affd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc00e720 0x7f7b1c0a1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:56.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.999+0000 7f7b1b7fe640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc015630 msgr2=0x7f7b1c138040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:07:56.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.999+0000 7f7b1b7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc015630 0x7f7b1c138040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:56.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.999+0000 7f7b1a7fc640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7afc014bd0 msgr2=0x7f7b1c1d1f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:56.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:55.999+0000 7f7b1a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7afc014bd0 0x7f7b1c1d1f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:56.212 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:07:56.212 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29326]: starting. 2024-08-18T21:07:56.213 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29326]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29286 2024-08-18T21:07:56.213 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29326]: created object 0... 2024-08-18T21:07:56.213 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29326]: created object 25... 2024-08-18T21:07:56.213 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29326]: created object 49... 2024-08-18T21:07:56.213 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29326]: finishing. 2024-08-18T21:07:56.213 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29326]: shutting down. 2024-08-18T21:07:56.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:56.403+0000 7f7b1affd640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc00e720 msgr2=0x7f7b1c0a1a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:07:56.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:56.403+0000 7f7b1affd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc00e720 0x7f7b1c0a1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:56.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:56.403+0000 7f7b1b7fe640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc015630 msgr2=0x7f7b1c138040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:07:56.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:56.403+0000 7f7b1b7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc015630 0x7f7b1c138040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:56.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:56.403+0000 7f7b1a7fc640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7afc014bd0 msgr2=0x7f7b1c1d1f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:56.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:56.403+0000 7f7b1a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7afc014bd0 0x7f7b1c1d1f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:57.120 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:07:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29328]: starting. 2024-08-18T21:07:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29328]: listing objects. 2024-08-18T21:07:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29328]: listed object 0... 2024-08-18T21:07:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29328]: listed object 25... 2024-08-18T21:07:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29328]: saw 50 objects 2024-08-18T21:07:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29328]: shutting down. 2024-08-18T21:07:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:57.207+0000 7f7b1affd640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc00e720 msgr2=0x7f7b1c0a1a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:07:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:57.207+0000 7f7b1b7fe640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc015630 msgr2=0x7f7b1c138040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:07:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:57.207+0000 7f7b1affd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc00e720 0x7f7b1c0a1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:57.207+0000 7f7b1b7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc015630 0x7f7b1c138040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:57.207+0000 7f7b1a7fc640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7afc014bd0 msgr2=0x7f7b1c1d1f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:57.207+0000 7f7b1a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7afc014bd0 0x7f7b1c1d1f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:07:58.111 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:07:58.111 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29327]: starting. 2024-08-18T21:07:58.111 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29327]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29286 2024-08-18T21:07:58.111 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29327]: shutting down. 2024-08-18T21:07:58.114 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:07:58.114 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:07:58.114 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:07:58.117 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:07:58.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 10 monclient(hunting): tick 2024-08-18T21:07:58.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:07:58.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 1 monclient(hunting): continuing hunt 2024-08-18T21:07:58.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:07:58.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc00e720 msgr2=0x7f7b1c0a1a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:07:58.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7afc00e720 0x7f7b1c0a1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:58.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc015630 msgr2=0x7f7b1c138040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:07:58.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7afc015630 0x7f7b1c138040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:58.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7afc014bd0 msgr2=0x7f7b1c1d1f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:07:58.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7afc014bd0 0x7f7b1c1d1f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:58.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 10 monclient: _add_conns ranks=[8,7,3,1,4,5] 2024-08-18T21:07:58.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b000037f0 0x7f7b00005be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:58.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 10 monclient(hunting): picked mon.noname-e con 0x7f7b000037f0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:07:58.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7b00006140 0x7f7b000085d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:58.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 10 monclient(hunting): picked mon.noname-i con 0x7f7b00006140 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:07:58.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b00008cc0 0x7f7b0000b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:58.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 10 monclient(hunting): picked mon.noname-g con 0x7f7b00008cc0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:58.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:58.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1c0a79e0 con 0x7f7b00008cc0 2024-08-18T21:07:58.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:58.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7b1c0a8220 con 0x7f7b00006140 2024-08-18T21:07:58.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:58.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f7b1c125440 con 0x7f7b000037f0 2024-08-18T21:07:58.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b127fc640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:58.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b1b7fe640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b00008cc0 msgr2=0x7f7b0000b180 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:07:58.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b1affd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b000037f0 0x7f7b00005be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:58.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b1b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b00008cc0 0x7f7b0000b180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:58.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b1affd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b000037f0 0x7f7b00005be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:43164/0 (socket says 172.21.15.5:43164) 2024-08-18T21:07:58.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b1affd640 1 -- 172.21.15.5:0/2982519525 learned_addr learned my addr 172.21.15.5:0/2982519525 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:07:58.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b1affd640 10 monclient(hunting): get_auth_request con 0x7f7b000037f0 auth_method 0 2024-08-18T21:07:58.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:58.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:58.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b1affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:58.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.795+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/2982519525 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7b00006140 0x7f7b000085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:58.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1a7fc640 10 monclient(hunting): get_auth_request con 0x7f7b00006140 auth_method 0 2024-08-18T21:07:58.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:07:58.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:07:58.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:07:58.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:58.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:58.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:58.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:07:58.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:07:58.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:07:58.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1affd640 10 monclient(hunting): handle_auth_done global_id 54602 payload 824 2024-08-18T21:07:58.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1affd640 1 -- 172.21.15.5:0/2982519525 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7b00006140 msgr2=0x7f7b000085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:58.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1affd640 1 --2- 172.21.15.5:0/2982519525 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7b00006140 0x7f7b000085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:58.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1affd640 1 -- 172.21.15.5:0/2982519525 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b00008cc0 msgr2=0x7f7b0000b180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:07:58.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1affd640 1 --2- 172.21.15.5:0/2982519525 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b00008cc0 0x7f7b0000b180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:58.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1affd640 10 monclient: _finish_hunting 0 2024-08-18T21:07:58.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1affd640 1 monclient: found mon.noname-e 2024-08-18T21:07:58.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:07:58.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1affd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:07:58.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1affd640 1 -- 172.21.15.5:0/2982519525 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c0a23f0 con 0x7f7b000037f0 2024-08-18T21:07:58.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1b7fe640 1 -- 172.21.15.5:0/2982519525 reap_dead start 2024-08-18T21:07:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1affd640 1 -- 172.21.15.5:0/2982519525 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b000037f0 msgr2=0x7f7b00005be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:07:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b1affd640 1 --2- 172.21.15.5:0/2982519525 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b000037f0 0x7f7b00005be0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b0401ecf0 tx=0x7f7b04005040 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.799+0000 7f7b137fe640 1 -- 172.21.15.5:0/2982519525 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7b040c0070 con 0x7f7b000037f0 2024-08-18T21:07:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b137fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:07:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b137fe640 10 monclient: dump: 2024-08-18T21:07:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:58.811 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:58.811 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:58.811 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:58.811 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:58.811 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:58.811 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:58.811 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:58.811 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:58.811 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:58.811 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:58.811 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:58.811 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:58.811 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:58.812 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b137fe640 10 monclient: _finish_auth 0 2024-08-18T21:07:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b137fe640 10 monclient: _check_auth_tickets 2024-08-18T21:07:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:07:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b217fe640 5 monclient: authenticate success, global_id 54602 2024-08-18T21:07:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b137fe640 1 -- 172.21.15.5:0/2982519525 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b040a7e20 con 0x7f7b000037f0 2024-08-18T21:07:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b217fe640 10 monclient: _renew_subs 2024-08-18T21:07:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b217fe640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:07:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b217fe640 1 -- 172.21.15.5:0/2982519525 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1c138a60 con 0x7f7b000037f0 2024-08-18T21:07:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b137fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:07:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b137fe640 1 -- 172.21.15.5:0/2982519525 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7b040ad040 con 0x7f7b000037f0 2024-08-18T21:07:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:07:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b137fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:07:58.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b137fe640 10 monclient: dump: 2024-08-18T21:07:58.813 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:07:58.813 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:58.813 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:58.813 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:07:58.813 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:07:58.813 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:58.813 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:07:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:07:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:07:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:07:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:07:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:07:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:07:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:07:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:07:58.815 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b197fa640 4 set_mon_vals no callback set 2024-08-18T21:07:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b217fe640 10 monclient: _renew_subs 2024-08-18T21:07:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b217fe640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:07:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b217fe640 1 -- 172.21.15.5:0/2982519525 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1c1d2de0 con 0x7f7b000037f0 2024-08-18T21:07:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b217fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b217fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b217fe640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:07:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b217fe640 1 -- 172.21.15.5:0/2982519525 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b1c13a3c0 con 0x7f7b000037f0 2024-08-18T21:07:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b137fe640 1 -- 172.21.15.5:0/2982519525 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f7b040c3070 con 0x7f7b000037f0 2024-08-18T21:07:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b137fe640 1 --2- 172.21.15.5:0/2982519525 >> v2:172.21.15.157:6812/631023601 conn(0x7f7afc03d790 0x7f7afc03fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b137fe640 1 -- 172.21.15.5:0/2982519525 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(115..115 src has 22..115) ==== 3506+0+0 (secure 0 0 0) 0x7f7b04014040 con 0x7f7b000037f0 2024-08-18T21:07:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/2982519525 >> v2:172.21.15.157:6812/631023601 conn(0x7f7afc03d790 0x7f7afc03fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:07:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.803+0000 7f7b1a7fc640 10 monclient: get_auth_request con 0x7f7afc03d790 auth_method 0 2024-08-18T21:07:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.807+0000 7f7b1a7fc640 1 --2- 172.21.15.5:0/2982519525 >> v2:172.21.15.157:6812/631023601 conn(0x7f7afc03d790 0x7f7afc03fc50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7b00003740 tx=0x7f7b0c00b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:07:58.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.819+0000 7f7b137fe640 1 -- 172.21.15.5:0/2982519525 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f7b0400f7f0 con 0x7f7b000037f0 2024-08-18T21:07:58.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.819+0000 7f7b137fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:07:58.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:58.819+0000 7f7b137fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:07:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.087+0000 7f7b217fe640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:07:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.087+0000 7f7b217fe640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:07:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.087+0000 7f7b217fe640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:07:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.087+0000 7f7b217fe640 1 -- 172.21.15.5:0/2982519525 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7b1c0abfa0 con 0x7f7b000037f0 2024-08-18T21:07:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.087+0000 7f7b137fe640 1 -- 172.21.15.5:0/2982519525 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3149 (secure 0 0 0) 0x7f7b040a7c40 con 0x7f7b000037f0 2024-08-18T21:07:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.087+0000 7f7b137fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:07:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.087+0000 7f7b137fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:07:59.091 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":100,"quorum":[1,4,5,7,8],"quorum_names":["f","c","h","i","e"],"quorum_leader_name":"f","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:07:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.091+0000 7f7b217fe640 1 -- 172.21.15.5:0/2982519525 >> v2:172.21.15.157:6812/631023601 conn(0x7f7afc03d790 msgr2=0x7f7afc03fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.091+0000 7f7b217fe640 1 --2- 172.21.15.5:0/2982519525 >> v2:172.21.15.157:6812/631023601 conn(0x7f7afc03d790 0x7f7afc03fc50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7b00003740 tx=0x7f7b0c00b040 comp rx=0 tx=0).stop 2024-08-18T21:07:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.091+0000 7f7b217fe640 10 monclient: shutdown 2024-08-18T21:07:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.091+0000 7f7b217fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:07:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.091+0000 7f7b217fe640 1 -- 172.21.15.5:0/2982519525 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b000037f0 msgr2=0x7f7b00005be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:07:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.091+0000 7f7b217fe640 1 --2- 172.21.15.5:0/2982519525 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b000037f0 0x7f7b00005be0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b0401ecf0 tx=0x7f7b04005040 comp rx=0 tx=0).stop 2024-08-18T21:07:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.091+0000 7f7b217fe640 1 -- 172.21.15.5:0/2982519525 shutdown_connections 2024-08-18T21:07:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.091+0000 7f7b217fe640 1 --2- 172.21.15.5:0/2982519525 >> v2:172.21.15.157:6812/631023601 conn(0x7f7afc03d790 0x7f7afc03fc50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.091+0000 7f7b217fe640 1 --2- 172.21.15.5:0/2982519525 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7b000037f0 0x7f7b00005be0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:07:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.091+0000 7f7b217fe640 1 -- 172.21.15.5:0/2982519525 >> 172.21.15.5:0/2982519525 conn(0x7f7b1c0acbc0 msgr2=0x7f7b1c0ab890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:07:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.091+0000 7f7b217fe640 1 -- 172.21.15.5:0/2982519525 shutdown_connections 2024-08-18T21:07:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.091+0000 7f7b217fe640 1 -- 172.21.15.5:0/2982519525 wait complete. 2024-08-18T21:07:59.110 INFO:tasks.mon_thrash.ceph_manager:quorum is size 5 2024-08-18T21:07:59.110 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon c 2024-08-18T21:07:59.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:07:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.227+0000 7f0aa19d0640 10 monclient: get_monmap_and_config 2024-08-18T21:07:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.227+0000 7f0aa19d0640 10 monclient: build_initial_monmap 2024-08-18T21:07:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.227+0000 7f0aa19d0640 10 monclient: monmap: 2024-08-18T21:07:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:07:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:07:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:07:59.232003+0000 2024-08-18T21:07:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:07:59.232003+0000 2024-08-18T21:07:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:07:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:07:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:07:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:07:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:07:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:07:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:07:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:07:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:07:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:07:59.233 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:07:59.233 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:07:59.233 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:07:59.233 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:07:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 1 Processor -- start 2024-08-18T21:07:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 1 -- start start 2024-08-18T21:07:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 10 monclient: init 2024-08-18T21:07:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 10 monclient: _reopen_session rank -1 2024-08-18T21:07:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 10 monclient: _add_conns ranks=[9,2,3,4,8,1,6,5,7,0,10] 2024-08-18T21:07:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a9c0a6ce0 0x7f0a9c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 10 monclient(hunting): picked mon.noname-a con 0x7f0a9c0a6ce0 addr v2:172.21.15.5:3300/0 2024-08-18T21:07:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0a9c0a7600 0x7f0a9c139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 10 monclient(hunting): picked mon.noname-b con 0x7f0a9c0a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:07:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a9c139fe0 0x7f0a9c13a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:07:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 10 monclient(hunting): picked mon.noname-g con 0x7f0a9c139fe0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:07:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0a9c0a5000 con 0x7f0a9c0a6ce0 2024-08-18T21:07:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0a9affd640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7f0a9c0a6ce0 msgr2=0x7f0a9c0a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9c0a4360 con 0x7f0a9c0a7600 2024-08-18T21:07:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:07:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9c0a45d0 con 0x7f0a9c139fe0 2024-08-18T21:07:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 10 monclient(hunting): _renew_subs 2024-08-18T21:07:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0aa19d0640 10 monclient(hunting): authenticate will time out at 1246.245339s 2024-08-18T21:07:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0a9affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a9c0a6ce0 0x7f0a9c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0a9a7fc640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0a9c0a7600 msgr2=0x7f0a9c139aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:07:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0a9a7fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0a9c0a7600 0x7f0a9c139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0a9b7fe640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a9c139fe0 msgr2=0x7f0a9c13a440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:07:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.231+0000 7f0a9b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a9c139fe0 0x7f0a9c13a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:07:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.435+0000 7f0a9b7fe640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a9c139fe0 msgr2=0x7f0a9c13a440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:07:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.435+0000 7f0a9b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a9c139fe0 0x7f0a9c13a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.435+0000 7f0a9affd640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7f0a9c0a6ce0 msgr2=0x7f0a9c0a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.435+0000 7f0a9a7fc640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0a9c0a7600 msgr2=0x7f0a9c139aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:07:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.435+0000 7f0a9affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a9c0a6ce0 0x7f0a9c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.435+0000 7f0a9a7fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0a9c0a7600 0x7f0a9c139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:07:59.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.839+0000 7f0a9b7fe640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a9c139fe0 msgr2=0x7f0a9c13a440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:07:59.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.839+0000 7f0a9b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a9c139fe0 0x7f0a9c13a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:59.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.839+0000 7f0a9a7fc640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0a9c0a7600 msgr2=0x7f0a9c139aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:07:59.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.839+0000 7f0a9affd640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7f0a9c0a6ce0 msgr2=0x7f0a9c0a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:07:59.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.839+0000 7f0a9a7fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0a9c0a7600 0x7f0a9c139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:07:59.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:07:59.839+0000 7f0a9affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a9c0a6ce0 0x7f0a9c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:08:00.189 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29381]: starting. 2024-08-18T21:08:00.190 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29381]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29380 2024-08-18T21:08:00.190 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29381]: created object 0... 2024-08-18T21:08:00.190 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29381]: created object 25... 2024-08-18T21:08:00.190 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29381]: created object 49... 2024-08-18T21:08:00.190 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29381]: finishing. 2024-08-18T21:08:00.190 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29381]: shutting down. 2024-08-18T21:08:00.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:00.643+0000 7f0a9affd640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7f0a9c0a6ce0 msgr2=0x7f0a9c0a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:08:00.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:00.643+0000 7f0a9affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a9c0a6ce0 0x7f0a9c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:08:00.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:00.643+0000 7f0a9a7fc640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0a9c0a7600 msgr2=0x7f0a9c139aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:08:00.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:00.643+0000 7f0a9a7fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0a9c0a7600 0x7f0a9c139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:08:00.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:00.643+0000 7f0a9b7fe640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a9c139fe0 msgr2=0x7f0a9c13a440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:08:00.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:00.643+0000 7f0a9b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a9c139fe0 0x7f0a9c13a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:08:00.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:00.643+0000 7f0a99ffb640 1 -- DispatchQueue::entry inject delay of 0.002000 2024-08-18T21:08:01.458 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29382]: starting. 2024-08-18T21:08:01.459 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29382]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29380 2024-08-18T21:08:01.459 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29382]: shutting down. 2024-08-18T21:08:02.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 10 monclient(hunting): tick 2024-08-18T21:08:02.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:08:02.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 1 monclient(hunting): continuing hunt 2024-08-18T21:08:02.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:08:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a9c139fe0 msgr2=0x7f0a9c13a440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:08:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a9c139fe0 0x7f0a9c13a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0a9c0a7600 msgr2=0x7f0a9c139aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:08:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0a9c0a7600 0x7f0a9c139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7f0a9c0a6ce0 msgr2=0x7f0a9c0a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:08:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a9c0a6ce0 0x7f0a9c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 10 monclient: _add_conns ranks=[6,8,5,4,1,0,10,7] 2024-08-18T21:08:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0a88003850 0x7f0a88005ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 10 monclient(hunting): picked mon.noname-d con 0x7f0a88003850 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0a880062a0 0x7f0a88008730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 10 monclient(hunting): picked mon.noname-e con 0x7f0a880062a0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:08:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0a88008e20 0x7f0a8800b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 10 monclient(hunting): picked mon.noname-h con 0x7f0a88008e20 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f0a9c0a4360 con 0x7f0a88008e20 2024-08-18T21:08:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f0a9c0a45d0 con 0x7f0a88003850 2024-08-18T21:08:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f0a8800ba30 con 0x7f0a880062a0 2024-08-18T21:08:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a98ff9640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9affd640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0a88003850 msgr2=0x7f0a88005ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:08:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9affd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0a88003850 0x7f0a88005ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0a880062a0 0x7f0a88008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0a880062a0 0x7f0a88008730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:43176/0 (socket says 172.21.15.5:43176) 2024-08-18T21:08:02.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 1 -- 172.21.15.5:0/5425935 learned_addr learned my addr 172.21.15.5:0/5425935 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:02.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 10 monclient(hunting): get_auth_request con 0x7f0a880062a0 auth_method 0 2024-08-18T21:08:02.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9b7fe640 1 --2- 172.21.15.5:0/5425935 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0a88008e20 0x7f0a8800b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9b7fe640 10 monclient(hunting): get_auth_request con 0x7f0a88008e20 auth_method 0 2024-08-18T21:08:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 10 monclient(hunting): handle_auth_done global_id 54611 payload 274 2024-08-18T21:08:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 1 -- 172.21.15.5:0/5425935 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0a88003850 msgr2=0x7f0a88005ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:08:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 1 --2- 172.21.15.5:0/5425935 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0a88003850 0x7f0a88005ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 1 -- 172.21.15.5:0/5425935 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0a88008e20 msgr2=0x7f0a8800b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 1 --2- 172.21.15.5:0/5425935 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0a88008e20 0x7f0a8800b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:08:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 1 monclient: found mon.noname-e 2024-08-18T21:08:02.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:02.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:08:02.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9a7fc640 1 -- 172.21.15.5:0/5425935 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9c0a32d0 con 0x7f0a880062a0 2024-08-18T21:08:02.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9b7fe640 1 --2- 172.21.15.5:0/5425935 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0a88008e20 0x7f0a8800b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:08:02.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.231+0000 7f0a9b7fe640 1 -- 172.21.15.5:0/5425935 reap_dead start 2024-08-18T21:08:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0a9a7fc640 1 -- 172.21.15.5:0/5425935 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0a880062a0 msgr2=0x7f0a88008730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0a9a7fc640 1 --2- 172.21.15.5:0/5425935 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0a880062a0 0x7f0a88008730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009df0 tx=0x7f0a9001c890 comp rx=0 tx=0).ready entity=mon.8 client_cookie=e6f4aea0781a5aef server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0a99ffb640 1 -- 172.21.15.5:0/5425935 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a900ab020 con 0x7f0a880062a0 2024-08-18T21:08:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0a99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0a99ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:08:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0a99ffb640 10 monclient: dump: 2024-08-18T21:08:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.245 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0a99ffb640 10 monclient: _finish_auth 0 2024-08-18T21:08:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0a99ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:08:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0a99ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0a99ffb640 1 -- 172.21.15.5:0/5425935 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a90005070 con 0x7f0a880062a0 2024-08-18T21:08:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0aa19d0640 5 monclient: authenticate success, global_id 54611 2024-08-18T21:08:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0aa19d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:08:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0a99ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0aa19d0640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0aa19d0640 4 set_mon_vals no callback set 2024-08-18T21:08:02.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0a99ffb640 1 -- 172.21.15.5:0/5425935 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a90009440 con 0x7f0a880062a0 2024-08-18T21:08:02.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0a99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0a99ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:02.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.239+0000 7f0a99ffb640 10 monclient: dump: 2024-08-18T21:08:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.248 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 10 monclient: shutdown 2024-08-18T21:08:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 1 -- 172.21.15.5:0/5425935 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0a880062a0 msgr2=0x7f0a88008730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 1 --2- 172.21.15.5:0/5425935 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0a880062a0 0x7f0a88008730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009df0 tx=0x7f0a9001c890 comp rx=0 tx=0).stop 2024-08-18T21:08:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 1 -- 172.21.15.5:0/5425935 shutdown_connections 2024-08-18T21:08:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 1 --2- 172.21.15.5:0/5425935 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0a880062a0 0x7f0a88008730 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 1 -- 172.21.15.5:0/5425935 >> 172.21.15.5:0/5425935 conn(0x7f0a9c0acbc0 msgr2=0x7f0a9c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 1 -- 172.21.15.5:0/5425935 shutdown_connections 2024-08-18T21:08:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 1 -- 172.21.15.5:0/5425935 wait complete. 2024-08-18T21:08:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 10 monclient: build_initial_monmap 2024-08-18T21:08:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 10 monclient: monmap: 2024-08-18T21:08:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:02.253 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 1 Processor -- start 2024-08-18T21:08:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 1 -- start start 2024-08-18T21:08:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 10 monclient: init 2024-08-18T21:08:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 10 monclient: _add_conns ranks=[2,4,6,5,0,8,1,3,7] 2024-08-18T21:08:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0a880062a0 0x7f0a9c138c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 10 monclient(hunting): picked mon.noname-b con 0x7f0a880062a0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:08:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c1391c0 0x7f0a9c122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 10 monclient(hunting): picked mon.noname-c con 0x7f0a9c1391c0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0a9c122e70 0x7f0a9c1232f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 10 monclient(hunting): picked mon.noname-d con 0x7f0a9c122e70 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9c0a79e0 con 0x7f0a880062a0 2024-08-18T21:08:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f0a9c0a8220 con 0x7f0a9c1391c0 2024-08-18T21:08:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f0a9c06eae0 con 0x7f0a9c122e70 2024-08-18T21:08:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0aa19d0640 10 monclient(hunting): authenticate will time out at 1249.259038s 2024-08-18T21:08:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9b7fe640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0a9c122e70 msgr2=0x7f0a9c1232f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:08:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9b7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0a9c122e70 0x7f0a9c1232f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9affd640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0a880062a0 msgr2=0x7f0a9c138c80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:08:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c1391c0 0x7f0a9c122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9affd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0a880062a0 0x7f0a9c138c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c1391c0 0x7f0a9c122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:54054/0 (socket says 172.21.15.5:54054) 2024-08-18T21:08:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 1 -- 172.21.15.5:0/3405603474 learned_addr learned my addr 172.21.15.5:0/3405603474 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 10 monclient(hunting): get_auth_request con 0x7f0a9c1391c0 auth_method 0 2024-08-18T21:08:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 10 monclient(hunting): handle_auth_done global_id 5548 payload 824 2024-08-18T21:08:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 1 -- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0a9c122e70 msgr2=0x7f0a9c1232f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:08:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 1 --2- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0a9c122e70 0x7f0a9c1232f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 1 -- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0a880062a0 msgr2=0x7f0a9c138c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:08:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 1 --2- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0a880062a0 0x7f0a9c138c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:08:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 1 monclient: found mon.noname-c 2024-08-18T21:08:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:08:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.243+0000 7f0a9a7fc640 1 -- 172.21.15.5:0/3405603474 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9c126660 con 0x7f0a9c1391c0 2024-08-18T21:08:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.247+0000 7f0a9a7fc640 1 -- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c1391c0 msgr2=0x7f0a9c122930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.247+0000 7f0a9a7fc640 1 --2- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c1391c0 0x7f0a9c122930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0a9001c6c0 tx=0x7f0a90019630 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.247+0000 7f0a83fff640 1 -- 172.21.15.5:0/3405603474 DispatchQueue::entry inject delay of 0.002000 2024-08-18T21:08:02.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a83fff640 1 -- 172.21.15.5:0/3405603474 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a900ab070 con 0x7f0a9c1391c0 2024-08-18T21:08:02.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a83fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:08:02.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a83fff640 10 monclient: dump: 2024-08-18T21:08:02.261 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.261 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.261 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.261 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.261 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.263 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a83fff640 10 monclient: _finish_auth 0 2024-08-18T21:08:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a83fff640 10 monclient: _check_auth_tickets 2024-08-18T21:08:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a83fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a83fff640 1 -- 172.21.15.5:0/3405603474 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a900059f0 con 0x7f0a9c1391c0 2024-08-18T21:08:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a83fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a83fff640 1 -- 172.21.15.5:0/3405603474 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a900a6d60 con 0x7f0a9c1391c0 2024-08-18T21:08:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a83fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:08:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a83fff640 10 monclient: dump: 2024-08-18T21:08:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.264 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a997fa640 4 set_mon_vals no callback set 2024-08-18T21:08:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0aa19d0640 5 monclient: authenticate success, global_id 5548 2024-08-18T21:08:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0aa19d0640 10 monclient: _renew_subs 2024-08-18T21:08:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0aa19d0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:08:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0aa19d0640 1 -- 172.21.15.5:0/3405603474 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9c124300 con 0x7f0a9c1391c0 2024-08-18T21:08:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0aa19d0640 10 monclient: _renew_subs 2024-08-18T21:08:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0aa19d0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:08:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0aa19d0640 1 -- 172.21.15.5:0/3405603474 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a9c125dc0 con 0x7f0a9c1391c0 2024-08-18T21:08:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0aa19d0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0aa19d0640 1 --2- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c126000 0x7f0a9c09da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0aa19d0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0aa19d0640 1 -- 172.21.15.5:0/3405603474 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f0a9c0a8c20 con 0x7f0a9c126000 2024-08-18T21:08:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a9affd640 1 --2- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c126000 0x7f0a9c09da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a9affd640 10 monclient: get_auth_request con 0x7f0a9c126000 auth_method 0 2024-08-18T21:08:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a9affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a9affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a9affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a83fff640 1 -- 172.21.15.5:0/3405603474 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f0a900ae020 con 0x7f0a9c1391c0 2024-08-18T21:08:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a9affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a9affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a9affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a83fff640 1 --2- 172.21.15.5:0/3405603474 >> v2:172.21.15.157:6812/631023601 conn(0x7f0a8803d190 0x7f0a8803f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a9affd640 10 monclient(hunting): handle_auth_done global_id 5557 payload 824 2024-08-18T21:08:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a9affd640 1 -- 172.21.15.5:0/3405603474 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a9c0008e0 con 0x7f0a9c126000 2024-08-18T21:08:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a83fff640 1 -- 172.21.15.5:0/3405603474 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(118..118 src has 22..118) ==== 3506+0+0 (secure 0 0 0) 0x7f0a900e8460 con 0x7f0a9c1391c0 2024-08-18T21:08:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a9b7fe640 1 --2- 172.21.15.5:0/3405603474 >> v2:172.21.15.157:6812/631023601 conn(0x7f0a8803d190 0x7f0a8803f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.251+0000 7f0a9b7fe640 10 monclient: get_auth_request con 0x7f0a8803d190 auth_method 0 2024-08-18T21:08:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.255+0000 7f0a9affd640 1 -- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c126000 msgr2=0x7f0a9c09da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.255+0000 7f0a9affd640 1 --2- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c126000 0x7f0a9c09da30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00bca0 tx=0x7f0a8c009f10 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.255+0000 7f0a83fff640 1 -- 172.21.15.5:0/3405603474 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a8c003df0 con 0x7f0a9c126000 2024-08-18T21:08:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.255+0000 7f0a83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.255+0000 7f0a83fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:08:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.255+0000 7f0a83fff640 10 monclient: dump: 2024-08-18T21:08:02.268 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.268 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.268 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.268 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.268 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.268 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.268 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.268 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.268 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.268 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.269 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.269 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.269 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.269 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.269 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.269 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.255+0000 7f0a83fff640 1 -- 172.21.15.5:0/3405603474 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0a8c010030 con 0x7f0a9c126000 2024-08-18T21:08:02.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.255+0000 7f0a83fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:02.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.255+0000 7f0a83fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:02.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.255+0000 7f0a83fff640 1 -- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c126000 msgr2=0x7f0a9c09da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.255+0000 7f0a83fff640 1 --2- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c126000 0x7f0a9c09da30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00bca0 tx=0x7f0a8c009f10 comp rx=0 tx=0).stop 2024-08-18T21:08:02.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.255+0000 7f0a83fff640 1 -- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c126000 msgr2=0x7f0a9c09da30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:02.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.255+0000 7f0a83fff640 1 --2- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c126000 0x7f0a9c09da30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.255+0000 7f0a9b7fe640 1 --2- 172.21.15.5:0/3405603474 >> v2:172.21.15.157:6812/631023601 conn(0x7f0a8803d190 0x7f0a8803f650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c13a980 tx=0x7f0a94000f50 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.263+0000 7f0aa19d0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.263+0000 7f0aa19d0640 1 --2- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c09df70 0x7f0a9c09e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.263+0000 7f0aa19d0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.263+0000 7f0aa19d0640 1 -- 172.21.15.5:0/3405603474 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f0a9c0a7b60 con 0x7f0a9c09df70 2024-08-18T21:08:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.263+0000 7f0a9affd640 1 --2- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c09df70 0x7f0a9c09e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.263+0000 7f0a9affd640 10 monclient: get_auth_request con 0x7f0a9c09df70 auth_method 0 2024-08-18T21:08:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.263+0000 7f0a9affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.263+0000 7f0a9affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.263+0000 7f0a9affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.263+0000 7f0a9affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.263+0000 7f0a9affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.263+0000 7f0a9affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.263+0000 7f0a9affd640 10 monclient(hunting): handle_auth_done global_id 5566 payload 824 2024-08-18T21:08:02.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.263+0000 7f0a9affd640 1 -- 172.21.15.5:0/3405603474 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0a9c13a420 con 0x7f0a9c09df70 2024-08-18T21:08:02.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0a9affd640 1 -- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c09df70 msgr2=0x7f0a9c09e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:02.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0a9affd640 1 --2- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c09df70 0x7f0a9c09e380 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c013000 tx=0x7f0a8c00e070 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0a83fff640 1 -- 172.21.15.5:0/3405603474 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a8c01ae30 con 0x7f0a9c09df70 2024-08-18T21:08:02.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0a83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0a83fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:08:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0a83fff640 10 monclient: dump: 2024-08-18T21:08:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.275 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0a83fff640 1 -- 172.21.15.5:0/3405603474 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9371 (secure 0 0 0) 0x7f0a8c0060d0 con 0x7f0a9c09df70 2024-08-18T21:08:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0a83fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0a83fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0a83fff640 1 -- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c09df70 msgr2=0x7f0a9c09e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0a83fff640 1 --2- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c09df70 0x7f0a9c09e380 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c013000 tx=0x7f0a8c00e070 comp rx=0 tx=0).stop 2024-08-18T21:08:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0a83fff640 1 -- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c09df70 msgr2=0x7f0a9c09e380 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0a83fff640 1 --2- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c09df70 0x7f0a9c09e380 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.276 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:02.276 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:02.276 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:02.276 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:02.276 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 100, 2024-08-18T21:08:02.276 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 291384, 2024-08-18T21:08:02.276 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:02.276 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:02.276 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:02.276 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:02.276 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:02.277 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:02.277 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.277 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 8, 2024-08-18T21:08:02.277 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:02.277 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:02.277 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:02.277 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:02.277 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:02.277 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:02.278 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:02.278 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:02.278 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:02.278 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:02.278 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:02.278 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:02.278 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:02.278 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:02.278 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.278 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:02.278 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:02.278 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:02.279 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:02.279 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:02.279 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:02.279 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:02.279 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:02.279 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:02.279 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:02.279 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:02.279 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:02.279 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:02.279 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.280 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:02.280 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:02.280 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:02.280 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:02.280 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:02.280 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:02.280 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:02.280 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:02.280 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:02.280 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:02.280 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:02.280 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:02.281 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:02.281 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:02.281 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:02.281 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:02.281 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:02.281 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:02.281 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:02.281 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:02.281 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:02.281 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:02.281 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:02.281 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:02.281 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:02.282 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:02.282 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:02.282 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:02.282 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.282 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:02.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.282 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:02.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.282 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:02.282 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:02.282 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.282 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.282 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.283 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:02.283 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.283 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.283 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.283 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:02.283 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.283 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.283 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.283 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:02.283 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:02.283 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.284 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.284 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.284 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:02.284 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:02.284 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.284 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.284 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:02.284 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.285 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.285 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:02.285 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.285 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.285 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.285 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:02.286 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:02.286 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.286 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.286 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:02.286 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:02.286 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.286 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.286 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.286 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:02.287 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.287 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.287 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:02.287 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.287 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.287 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.287 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:02.287 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:02.287 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.287 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.287 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.288 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:02.288 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:02.288 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.288 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.288 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.288 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:02.288 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.288 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.289 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:02.289 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.289 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.289 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.289 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:02.289 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:02.289 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.289 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.289 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.289 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:02.290 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:02.290 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.290 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.290 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.290 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:02.290 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.290 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.290 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:02.290 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.290 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.291 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.291 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:02.291 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:02.291 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.291 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.291 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.291 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:02.291 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:02.291 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.292 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.292 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.292 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:02.292 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.292 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.292 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:02.292 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.292 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.292 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.293 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:02.293 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:02.293 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.293 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.293 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.293 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:02.293 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:02.293 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.293 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.293 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.293 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:02.294 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.294 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.294 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:02.294 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.294 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.294 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.294 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:02.294 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:02.294 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.295 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.295 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.295 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:02.295 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:02.295 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.295 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.295 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.296 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:02.296 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.296 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.296 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:02.296 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.296 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.296 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.296 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:02.296 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:02.296 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.297 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.297 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.297 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:02.297 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:02.297 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.297 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.297 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.297 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:02.297 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.298 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.298 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:02.298 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.298 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.298 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.298 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:02.298 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:02.298 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.298 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.298 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.298 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.299 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.299 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:02.299 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:02.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.299 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:02.299 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:02.299 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:02.299 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.299 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.299 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:08:02.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.299 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:02.299 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:02.299 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:08:02.300 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.300 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.300 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:02.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.300 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:02.300 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:02.300 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:08:02.300 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.300 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.300 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:02.300 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:02.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0aa19d0640 1 -- 172.21.15.5:0/3405603474 >> v2:172.21.15.157:6812/631023601 conn(0x7f0a8803d190 msgr2=0x7f0a8803f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0aa19d0640 1 --2- 172.21.15.5:0/3405603474 >> v2:172.21.15.157:6812/631023601 conn(0x7f0a8803d190 0x7f0a8803f650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c13a980 tx=0x7f0a94000f50 comp rx=0 tx=0).stop 2024-08-18T21:08:02.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0aa19d0640 10 monclient: shutdown 2024-08-18T21:08:02.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0aa19d0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:02.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0aa19d0640 1 -- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c1391c0 msgr2=0x7f0a9c122930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0aa19d0640 1 --2- 172.21.15.5:0/3405603474 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a9c1391c0 0x7f0a9c122930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0a9001c6c0 tx=0x7f0a90019630 comp rx=0 tx=0).stop 2024-08-18T21:08:02.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0a9b7fe640 1 -- 172.21.15.5:0/3405603474 reap_dead start 2024-08-18T21:08:02.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0a9b7fe640 1 -- 172.21.15.5:0/3405603474 reap_dead start 2024-08-18T21:08:02.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0aa19d0640 1 -- 172.21.15.5:0/3405603474 shutdown_connections 2024-08-18T21:08:02.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0aa19d0640 1 -- 172.21.15.5:0/3405603474 >> 172.21.15.5:0/3405603474 conn(0x7f0a9c0acbc0 msgr2=0x7f0a9c1c5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:02.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0aa19d0640 1 -- 172.21.15.5:0/3405603474 shutdown_connections 2024-08-18T21:08:02.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.267+0000 7f0aa19d0640 1 -- 172.21.15.5:0/3405603474 wait complete. 2024-08-18T21:08:02.304 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:08:02.304 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon e 2024-08-18T21:08:02.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:08:02.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 10 monclient: get_monmap_and_config 2024-08-18T21:08:02.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 10 monclient: build_initial_monmap 2024-08-18T21:08:02.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 10 monclient: monmap: 2024-08-18T21:08:02.434 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:02.434 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.434 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:02.433259+0000 2024-08-18T21:08:02.434 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:02.433259+0000 2024-08-18T21:08:02.434 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:02.434 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.435 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:02.435 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:02.435 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:02.435 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:02.435 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:02.435 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:02.435 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:02.435 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:02.435 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:02.435 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:02.436 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:02.436 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 1 Processor -- start 2024-08-18T21:08:02.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 1 -- start start 2024-08-18T21:08:02.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 10 monclient: init 2024-08-18T21:08:02.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 10 monclient: _add_conns ranks=[3,5,2,4,1,0,7,10,8,6,9] 2024-08-18T21:08:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd580a4240 0x7efd581333a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 10 monclient(hunting): picked mon.noname-g con 0x7efd580a4240 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7efd580a4620 0x7efd58070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 10 monclient(hunting): picked mon.noname-h con 0x7efd580a4620 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7efd580a4a40 0x7efd58071380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 10 monclient(hunting): picked mon.noname-b con 0x7efd580a4a40 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:08:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7efd58072a70 con 0x7efd580a4a40 2024-08-18T21:08:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7efd58073b10 con 0x7efd580a4240 2024-08-18T21:08:02.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7efd58073df0 con 0x7efd580a4620 2024-08-18T21:08:02.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:02.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5f2fb640 10 monclient(hunting): authenticate will time out at 1249.446491s 2024-08-18T21:08:02.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5d898640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7efd580a4a40 msgr2=0x7efd58071380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:08:02.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5d898640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7efd580a4a40 0x7efd58071380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:02.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5d097640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd580a4240 msgr2=0x7efd581333a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:08:02.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5d097640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd580a4240 0x7efd581333a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:02.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7efd580a4620 0x7efd58070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7efd580a4620 0x7efd58070e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:40574/0 (socket says 172.21.15.5:40574) 2024-08-18T21:08:02.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 1 -- 172.21.15.5:0/1534185223 learned_addr learned my addr 172.21.15.5:0/1534185223 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:02.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 10 monclient(hunting): get_auth_request con 0x7efd580a4620 auth_method 0 2024-08-18T21:08:02.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 10 monclient(hunting): handle_auth_done global_id 34889 payload 274 2024-08-18T21:08:02.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 1 -- 172.21.15.5:0/1534185223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd580a4240 msgr2=0x7efd581333a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:08:02.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 1 --2- 172.21.15.5:0/1534185223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd580a4240 0x7efd581333a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 1 -- 172.21.15.5:0/1534185223 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7efd580a4a40 msgr2=0x7efd58071380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:08:02.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 1 --2- 172.21.15.5:0/1534185223 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7efd580a4a40 0x7efd58071380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 10 monclient: _finish_hunting 0 2024-08-18T21:08:02.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 1 monclient: found mon.noname-h 2024-08-18T21:08:02.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:02.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:08:02.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.431+0000 7efd5c896640 1 -- 172.21.15.5:0/1534185223 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd58072cb0 con 0x7efd580a4620 2024-08-18T21:08:02.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5c896640 1 -- 172.21.15.5:0/1534185223 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7efd580a4620 msgr2=0x7efd58070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:02.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5c896640 1 --2- 172.21.15.5:0/1534185223 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7efd580a4620 0x7efd58070e40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efd480098a0 tx=0x7efd4801c480 comp rx=0 tx=0).ready entity=mon.5 client_cookie=e7a82a638450eb05 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd4ffff640 1 -- 172.21.15.5:0/1534185223 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efd480b0070 con 0x7efd580a4620 2024-08-18T21:08:02.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd4ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd4ffff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:08:02.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd4ffff640 10 monclient: dump: 2024-08-18T21:08:02.447 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.447 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.447 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.447 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.447 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.447 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.447 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.447 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.447 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.448 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.448 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.448 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.448 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.448 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.448 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.448 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd4ffff640 10 monclient: _finish_auth 0 2024-08-18T21:08:02.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd4ffff640 10 monclient: _check_auth_tickets 2024-08-18T21:08:02.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd4ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:02.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd4ffff640 1 -- 172.21.15.5:0/1534185223 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd480aa810 con 0x7efd580a4620 2024-08-18T21:08:02.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd4ffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:02.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd4ffff640 1 -- 172.21.15.5:0/1534185223 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efd480a93e0 con 0x7efd580a4620 2024-08-18T21:08:02.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd4ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd4ffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:08:02.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd4ffff640 10 monclient: dump: 2024-08-18T21:08:02.449 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.449 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.449 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.449 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.449 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.450 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.450 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.450 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.450 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.450 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.450 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.450 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.450 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.450 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.450 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.450 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 5 monclient: authenticate success, global_id 34889 2024-08-18T21:08:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 4 set_mon_vals no callback set 2024-08-18T21:08:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 10 monclient: shutdown 2024-08-18T21:08:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 -- 172.21.15.5:0/1534185223 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7efd580a4620 msgr2=0x7efd58070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 --2- 172.21.15.5:0/1534185223 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7efd580a4620 0x7efd58070e40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efd480098a0 tx=0x7efd4801c480 comp rx=0 tx=0).stop 2024-08-18T21:08:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 -- 172.21.15.5:0/1534185223 shutdown_connections 2024-08-18T21:08:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 --2- 172.21.15.5:0/1534185223 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7efd580a4a40 0x7efd58071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 --2- 172.21.15.5:0/1534185223 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7efd580a4620 0x7efd58070e40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 --2- 172.21.15.5:0/1534185223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd580a4240 0x7efd581333a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 -- 172.21.15.5:0/1534185223 >> 172.21.15.5:0/1534185223 conn(0x7efd580a8a90 msgr2=0x7efd580a8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 -- 172.21.15.5:0/1534185223 shutdown_connections 2024-08-18T21:08:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 -- 172.21.15.5:0/1534185223 wait complete. 2024-08-18T21:08:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 10 monclient: build_initial_monmap 2024-08-18T21:08:02.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 10 monclient: monmap: 2024-08-18T21:08:02.452 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:02.452 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:02.452 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:02.452 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:02.452 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:02.452 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.452 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:02.453 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 Processor -- start 2024-08-18T21:08:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 -- start start 2024-08-18T21:08:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 10 monclient: init 2024-08-18T21:08:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 10 monclient: _add_conns ranks=[2,6,5,4,8,0,7,1,3] 2024-08-18T21:08:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7efd580a4240 0x7efd580a0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 10 monclient(hunting): picked mon.noname-b con 0x7efd580a4240 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:08:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7efd580a4620 0x7efd580a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 10 monclient(hunting): picked mon.noname-d con 0x7efd580a4620 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7efd580a4a40 0x7efd580a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 10 monclient(hunting): picked mon.noname-h con 0x7efd580a4a40 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7efd580700c0 con 0x7efd580a4240 2024-08-18T21:08:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7efd5806ff40 con 0x7efd580a4a40 2024-08-18T21:08:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7efd58070240 con 0x7efd580a4620 2024-08-18T21:08:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5d097640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7efd580a4240 msgr2=0x7efd580a0fa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:08:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5f2fb640 10 monclient(hunting): authenticate will time out at 1249.455337s 2024-08-18T21:08:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5c896640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7efd580a4620 msgr2=0x7efd580a14e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:08:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5d097640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7efd580a4240 0x7efd580a0fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5c896640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7efd580a4620 0x7efd580a14e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5d898640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7efd580a4a40 0x7efd580a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5d898640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7efd580a4a40 0x7efd580a1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:40576/0 (socket says 172.21.15.5:40576) 2024-08-18T21:08:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5d898640 1 -- 172.21.15.5:0/2572990293 learned_addr learned my addr 172.21.15.5:0/2572990293 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5d898640 10 monclient(hunting): get_auth_request con 0x7efd580a4a40 auth_method 0 2024-08-18T21:08:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5d898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5d898640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5d898640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5d898640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5d898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.439+0000 7efd5d898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.443+0000 7efd5d898640 10 monclient(hunting): handle_auth_done global_id 34898 payload 824 2024-08-18T21:08:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.443+0000 7efd5d898640 1 -- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7efd580a4620 msgr2=0x7efd580a14e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:08:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.443+0000 7efd5d898640 1 --2- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7efd580a4620 0x7efd580a14e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.443+0000 7efd5d898640 1 -- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7efd580a4240 msgr2=0x7efd580a0fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:08:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.443+0000 7efd5d898640 1 --2- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7efd580a4240 0x7efd580a0fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.443+0000 7efd5d898640 10 monclient: _finish_hunting 0 2024-08-18T21:08:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.443+0000 7efd5d898640 1 monclient: found mon.noname-h 2024-08-18T21:08:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.443+0000 7efd5d898640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.443+0000 7efd5d898640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:08:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.443+0000 7efd5d898640 1 -- 172.21.15.5:0/2572990293 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd580a5a30 con 0x7efd580a4a40 2024-08-18T21:08:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.443+0000 7efd5d898640 1 -- 172.21.15.5:0/2572990293 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7efd580a4a40 msgr2=0x7efd580a1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.443+0000 7efd5d898640 1 --2- 172.21.15.5:0/2572990293 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7efd580a4a40 0x7efd580a1a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efd5000b410 tx=0x7efd5000b8d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd4dffb640 1 -- 172.21.15.5:0/2572990293 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efd50017070 con 0x7efd580a4a40 2024-08-18T21:08:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd4dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd4dffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:08:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd4dffb640 10 monclient: dump: 2024-08-18T21:08:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.464 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.464 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.464 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.464 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.464 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.464 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd4dffb640 10 monclient: _finish_auth 0 2024-08-18T21:08:02.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd4dffb640 10 monclient: _check_auth_tickets 2024-08-18T21:08:02.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd4dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:02.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd4dffb640 1 -- 172.21.15.5:0/2572990293 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd50003db0 con 0x7efd580a4a40 2024-08-18T21:08:02.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd5f2fb640 5 monclient: authenticate success, global_id 34898 2024-08-18T21:08:02.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd5f2fb640 10 monclient: _renew_subs 2024-08-18T21:08:02.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd5f2fb640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:08:02.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd5f2fb640 1 -- 172.21.15.5:0/2572990293 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd58133f80 con 0x7efd580a4a40 2024-08-18T21:08:02.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd4dffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:02.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd4dffb640 1 -- 172.21.15.5:0/2572990293 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efd5000f300 con 0x7efd580a4a40 2024-08-18T21:08:02.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd4dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd4dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:08:02.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd4dffb640 10 monclient: dump: 2024-08-18T21:08:02.466 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.466 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.466 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.466 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.466 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.466 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.466 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.466 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.466 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.466 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.467 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd4f7fe640 4 set_mon_vals no callback set 2024-08-18T21:08:02.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd5f2fb640 10 monclient: _renew_subs 2024-08-18T21:08:02.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd5f2fb640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:08:02.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.455+0000 7efd5f2fb640 1 -- 172.21.15.5:0/2572990293 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7efd58134e60 con 0x7efd580a4a40 2024-08-18T21:08:02.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd5f2fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:02.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd5f2fb640 1 --2- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7efd580a1f60 0x7efd581305e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd5f2fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd5f2fb640 1 -- 172.21.15.5:0/2572990293 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7efd58051140 con 0x7efd580a1f60 2024-08-18T21:08:02.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd5d097640 1 --2- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7efd580a1f60 0x7efd581305e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd5d097640 10 monclient: get_auth_request con 0x7efd580a1f60 auth_method 0 2024-08-18T21:08:02.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd5d097640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd5d097640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd5d097640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd5d097640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd5d097640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd5d097640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd5d097640 10 monclient(hunting): handle_auth_done global_id 54620 payload 824 2024-08-18T21:08:02.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd5d097640 1 -- 172.21.15.5:0/2572990293 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd581333a0 con 0x7efd580a1f60 2024-08-18T21:08:02.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd5d097640 1 -- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7efd580a1f60 msgr2=0x7efd581305e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:02.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd5d097640 1 --2- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7efd580a1f60 0x7efd581305e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd5400bcc0 tx=0x7efd54009f30 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd4dffb640 1 -- 172.21.15.5:0/2572990293 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efd540057d0 con 0x7efd580a1f60 2024-08-18T21:08:02.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd4dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd4dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:02.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd4dffb640 10 monclient: dump: 2024-08-18T21:08:02.473 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.473 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.473 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.473 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.473 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.475 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd4dffb640 1 -- 172.21.15.5:0/2572990293 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efd54005970 con 0x7efd580a1f60 2024-08-18T21:08:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd4dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.459+0000 7efd4dffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.463+0000 7efd4dffb640 1 -- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7efd580a1f60 msgr2=0x7efd581305e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.463+0000 7efd4dffb640 1 --2- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7efd580a1f60 0x7efd581305e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd5400bcc0 tx=0x7efd54009f30 comp rx=0 tx=0).stop 2024-08-18T21:08:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.463+0000 7efd4dffb640 1 -- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7efd580a1f60 msgr2=0x7efd581305e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.463+0000 7efd4dffb640 1 --2- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7efd580a1f60 0x7efd581305e0 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd5400bcc0 tx=0x7efd54009f30 comp rx=0 tx=0).stop 2024-08-18T21:08:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.463+0000 7efd4dffb640 1 -- 172.21.15.5:0/2572990293 <== mon.5 v2:172.21.15.157:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7efd500060d0 con 0x7efd580a4a40 2024-08-18T21:08:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd4dffb640 1 --2- 172.21.15.5:0/2572990293 >> v2:172.21.15.157:6812/631023601 conn(0x7efd3c03bd20 0x7efd3c03e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd4dffb640 1 -- 172.21.15.5:0/2572990293 <== mon.5 v2:172.21.15.157:3302/0 5 ==== osd_map(119..119 src has 22..119) ==== 3898+0+0 (secure 0 0 0) 0x7efd5004d8e0 con 0x7efd580a4a40 2024-08-18T21:08:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5d097640 1 -- 172.21.15.5:0/2572990293 >> v2:172.21.15.157:6812/631023601 conn(0x7efd3c03bd20 msgr2=0x7efd3c03e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-18T21:08:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5d097640 1 -- 172.21.15.5:0/2572990293 >> v2:172.21.15.157:6812/631023601 conn(0x7efd3c03bd20 msgr2=0x7efd3c03e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:08:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5d097640 1 --2- 172.21.15.5:0/2572990293 >> v2:172.21.15.157:6812/631023601 conn(0x7efd3c03bd20 0x7efd3c03e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2024-08-18T21:08:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5d097640 1 --2- 172.21.15.5:0/2572990293 >> v2:172.21.15.157:6812/631023601 conn(0x7efd3c03bd20 0x7efd3c03e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5f2fb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5f2fb640 1 --2- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7efd58130b20 0x7efd58130f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5f2fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5f2fb640 1 -- 172.21.15.5:0/2572990293 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7efd581350a0 con 0x7efd58130b20 2024-08-18T21:08:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5c896640 1 --2- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7efd58130b20 0x7efd58130f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5c896640 10 monclient: get_auth_request con 0x7efd58130b20 auth_method 0 2024-08-18T21:08:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5c896640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5c896640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5c896640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5c896640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5c896640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5c896640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5c896640 10 monclient(hunting): handle_auth_done global_id 54629 payload 824 2024-08-18T21:08:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.467+0000 7efd5c896640 1 -- 172.21.15.5:0/2572990293 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efd5806d960 con 0x7efd58130b20 2024-08-18T21:08:02.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd5c896640 1 -- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7efd58130b20 msgr2=0x7efd58130f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:02.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd5c896640 1 --2- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7efd58130b20 0x7efd58130f30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efd480ad000 tx=0x7efd48019220 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd4dffb640 1 -- 172.21.15.5:0/2572990293 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efd480b0070 con 0x7efd58130b20 2024-08-18T21:08:02.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd4dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd4dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:02.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd4dffb640 10 monclient: dump: 2024-08-18T21:08:02.478 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.480 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd4dffb640 1 -- 172.21.15.5:0/2572990293 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9538 (secure 0 0 0) 0x7efd480b1040 con 0x7efd58130b20 2024-08-18T21:08:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd4dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd4dffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd4dffb640 1 -- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7efd58130b20 msgr2=0x7efd58130f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd4dffb640 1 --2- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7efd58130b20 0x7efd58130f30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efd480ad000 tx=0x7efd48019220 comp rx=0 tx=0).stop 2024-08-18T21:08:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd4dffb640 1 -- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7efd58130b20 msgr2=0x7efd58130f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd4dffb640 1 --2- 172.21.15.5:0/2572990293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7efd58130b20 0x7efd58130f30 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efd480ad000 tx=0x7efd48019220 comp rx=0 tx=0).stop 2024-08-18T21:08:02.480 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 100, 2024-08-18T21:08:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 138592, 2024-08-18T21:08:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 9, 2024-08-18T21:08:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:02.483 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:02.483 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.483 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:02.483 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:02.483 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:02.483 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:02.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:02.483 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:02.483 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:02.483 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:02.483 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:02.483 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:02.483 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:02.483 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:02.484 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:02.484 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.484 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:02.484 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:02.484 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:02.484 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:02.484 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:02.484 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:02.484 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:02.484 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:02.484 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:02.484 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:02.484 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:02.485 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:02.485 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:02.485 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:02.485 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:02.485 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:02.485 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:02.485 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:02.485 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:02.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:02.485 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:02.485 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:02.485 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:02.485 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:02.486 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:02.486 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:02.486 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:02.486 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:02.486 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.486 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:02.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:02.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.486 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:02.486 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:02.486 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.486 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:02.487 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:02.487 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.487 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.487 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:02.488 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:02.488 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.488 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.488 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.488 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:02.488 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:02.488 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.488 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:02.488 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.489 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.489 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:02.489 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.489 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.489 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.489 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:02.489 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:02.489 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.489 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.489 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.490 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:02.490 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:02.490 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.490 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.490 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.490 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:02.490 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.491 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.491 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:02.491 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.491 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.491 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.491 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:02.491 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:02.491 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.491 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.491 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.491 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.491 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:02.492 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:02.492 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.492 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.492 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.492 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:02.492 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.492 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.492 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:02.492 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.492 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.492 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.493 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:02.493 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:02.493 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.493 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.493 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.493 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:02.493 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:02.493 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.493 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.494 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.494 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:02.494 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.494 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.494 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.494 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:02.494 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.494 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.494 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.494 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:02.494 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:02.495 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.495 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.495 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.495 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:02.495 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:02.495 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.495 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.495 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.495 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:02.495 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.496 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.496 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.496 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:02.496 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.496 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.496 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.496 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:02.496 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:02.496 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.496 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.496 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.496 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.497 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:02.497 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:02.497 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:02.497 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:02.497 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.498 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.498 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.498 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:02.498 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:02.498 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.498 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.498 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.498 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:02.498 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:02.498 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.499 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.499 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.499 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:02.499 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.499 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.499 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:02.499 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.499 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.499 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.499 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:02.500 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:02.500 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.500 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.500 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.500 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:02.500 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:02.500 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:02.501 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.501 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.501 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.501 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:02.501 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.501 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.501 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.501 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:02.501 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:02.501 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.501 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.501 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.502 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.502 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.502 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:02.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:02.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.502 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:02.502 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:02.502 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:02.502 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.502 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.502 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:08:02.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.502 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:02.503 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:02.503 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:08:02.503 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.503 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.503 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:02.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.503 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:02.503 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:02.503 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:02.503 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.503 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.503 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:08:02.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.503 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:02.504 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:02.504 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:02.504 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.504 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.504 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:02.504 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd5f2fb640 1 -- 172.21.15.5:0/2572990293 >> v2:172.21.15.157:6812/631023601 conn(0x7efd3c03bd20 msgr2=0x7efd3c03e1e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:08:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd5f2fb640 1 --2- 172.21.15.5:0/2572990293 >> v2:172.21.15.157:6812/631023601 conn(0x7efd3c03bd20 0x7efd3c03e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd5f2fb640 10 monclient: shutdown 2024-08-18T21:08:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd5f2fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd5f2fb640 1 -- 172.21.15.5:0/2572990293 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7efd580a4a40 msgr2=0x7efd580a1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd5f2fb640 1 --2- 172.21.15.5:0/2572990293 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7efd580a4a40 0x7efd580a1a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efd5000b410 tx=0x7efd5000b8d0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd5d898640 1 -- 172.21.15.5:0/2572990293 reap_dead start 2024-08-18T21:08:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd5f2fb640 1 -- 172.21.15.5:0/2572990293 shutdown_connections 2024-08-18T21:08:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd5f2fb640 1 --2- 172.21.15.5:0/2572990293 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7efd580a4a40 0x7efd580a1a20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd5f2fb640 1 -- 172.21.15.5:0/2572990293 >> 172.21.15.5:0/2572990293 conn(0x7efd580a8a90 msgr2=0x7efd5812f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd5f2fb640 1 -- 172.21.15.5:0/2572990293 shutdown_connections 2024-08-18T21:08:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.471+0000 7efd5f2fb640 1 -- 172.21.15.5:0/2572990293 wait complete. 2024-08-18T21:08:02.507 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:08:02.507 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon f 2024-08-18T21:08:02.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:08:02.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.623+0000 7f319ab4a640 10 monclient: get_monmap_and_config 2024-08-18T21:08:02.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.623+0000 7f319ab4a640 10 monclient: build_initial_monmap 2024-08-18T21:08:02.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.623+0000 7f319ab4a640 10 monclient: monmap: 2024-08-18T21:08:02.627 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:02.627 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.627 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:02.627259+0000 2024-08-18T21:08:02.627 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:02.627259+0000 2024-08-18T21:08:02.627 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:02.627 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:02.629 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:02.629 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:02.629 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 1 Processor -- start 2024-08-18T21:08:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 1 -- start start 2024-08-18T21:08:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 10 monclient: init 2024-08-18T21:08:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 10 monclient: _add_conns ranks=[0,4,10,9,7,2,8,3,5,6,1] 2024-08-18T21:08:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f31940a6ce0 addr v1:172.21.15.5:6789/0 2024-08-18T21:08:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31940a77d0 0x7f319413ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 10 monclient(hunting): picked mon.noname-c con 0x7f31940a77d0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f319413f220 0x7f3194141610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 10 monclient(hunting): picked mon.noname-f con 0x7f319413f220 addr v2:172.21.15.157:3300/0 2024-08-18T21:08:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31940a45d0 con 0x7f31940a6ce0 2024-08-18T21:08:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f31940a5000 con 0x7f319413f220 2024-08-18T21:08:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f31940a4360 con 0x7f31940a77d0 2024-08-18T21:08:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f319ab4a640 10 monclient(hunting): authenticate will time out at 1249.640976s 2024-08-18T21:08:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f31988e6640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7f31940a6ce0 legacy=0x7f31940a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:08:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31940a77d0 0x7f319413ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31940a77d0 0x7f319413ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:54082/0 (socket says 172.21.15.5:54082) 2024-08-18T21:08:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 1 -- 172.21.15.5:0/1334271910 learned_addr learned my addr 172.21.15.5:0/1334271910 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:02.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 10 monclient(hunting): get_auth_request con 0x7f31940a77d0 auth_method 0 2024-08-18T21:08:02.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 10 monclient(hunting): handle_auth_done global_id 5575 payload 274 2024-08-18T21:08:02.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 1 -- 172.21.15.5:0/1334271910 >> v2:172.21.15.157:3300/0 conn(0x7f319413f220 msgr2=0x7f3194141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:02.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 1 --2- 172.21.15.5:0/1334271910 >> v2:172.21.15.157:3300/0 conn(0x7f319413f220 0x7f3194141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 1 -- 172.21.15.5:0/1334271910 >> v1:172.21.15.5:6789/0 conn(0x7f31940a6ce0 legacy=0x7f31940a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:08:02.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:08:02.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 1 monclient: found mon.noname-c 2024-08-18T21:08:02.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:02.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:08:02.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.627+0000 7f318bfff640 1 -- 172.21.15.5:0/1334271910 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31940a32d0 con 0x7f31940a77d0 2024-08-18T21:08:02.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f318bfff640 1 -- 172.21.15.5:0/1334271910 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31940a77d0 msgr2=0x7f319413ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:02.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f318bfff640 1 --2- 172.21.15.5:0/1334271910 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31940a77d0 0x7f319413ece0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3184009870 tx=0x7f318401c4b0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=7e9258a6f9acdf59 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f318b7fe640 1 -- 172.21.15.5:0/1334271910 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f31840b0070 con 0x7f31940a77d0 2024-08-18T21:08:02.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f318b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f318b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:08:02.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f318b7fe640 10 monclient: dump: 2024-08-18T21:08:02.641 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.643 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.643 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f318b7fe640 10 monclient: _finish_auth 0 2024-08-18T21:08:02.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f318b7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:08:02.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f318b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:02.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f318b7fe640 1 -- 172.21.15.5:0/1334271910 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31840aa810 con 0x7f31940a77d0 2024-08-18T21:08:02.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f318b7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:02.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f318b7fe640 1 -- 172.21.15.5:0/1334271910 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f31840a93e0 con 0x7f31940a77d0 2024-08-18T21:08:02.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 5 monclient: authenticate success, global_id 5575 2024-08-18T21:08:02.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:02.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 4 set_mon_vals no callback set 2024-08-18T21:08:02.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f318b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f318b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:08:02.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f318b7fe640 10 monclient: dump: 2024-08-18T21:08:02.644 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.644 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.644 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.644 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.644 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.644 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.644 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.644 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.645 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.645 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.645 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.645 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.645 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.645 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.645 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.645 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 10 monclient: shutdown 2024-08-18T21:08:02.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:02.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 1 -- 172.21.15.5:0/1334271910 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31940a77d0 msgr2=0x7f319413ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 1 --2- 172.21.15.5:0/1334271910 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31940a77d0 0x7f319413ece0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3184009870 tx=0x7f318401c4b0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 1 -- 172.21.15.5:0/1334271910 shutdown_connections 2024-08-18T21:08:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 1 --2- 172.21.15.5:0/1334271910 >> v2:172.21.15.157:3300/0 conn(0x7f319413f220 0x7f3194141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 1 --2- 172.21.15.5:0/1334271910 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31940a77d0 0x7f319413ece0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 1 -- 172.21.15.5:0/1334271910 >> 172.21.15.5:0/1334271910 conn(0x7f31940acbc0 msgr2=0x7f31940a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 1 -- 172.21.15.5:0/1334271910 shutdown_connections 2024-08-18T21:08:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 1 -- 172.21.15.5:0/1334271910 wait complete. 2024-08-18T21:08:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 10 monclient: build_initial_monmap 2024-08-18T21:08:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 10 monclient: monmap: 2024-08-18T21:08:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:02.647 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 1 Processor -- start 2024-08-18T21:08:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 1 -- start start 2024-08-18T21:08:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.631+0000 7f319ab4a640 10 monclient: init 2024-08-18T21:08:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 10 monclient: _add_conns ranks=[3,0,4,5,6,8,7,2,1] 2024-08-18T21:08:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31940a6ce0 0x7f31940a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 10 monclient(hunting): picked mon.noname-g con 0x7f31940a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31940a77d0 0x7f319409ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 10 monclient(hunting): picked mon.noname-a con 0x7f31940a77d0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:08:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f319413f220 0x7f3194137af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 10 monclient(hunting): picked mon.noname-c con 0x7f319413f220 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f31940a83a0 con 0x7f31940a77d0 2024-08-18T21:08:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f31940a8220 con 0x7f31940a6ce0 2024-08-18T21:08:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f3194144370 con 0x7f319413f220 2024-08-18T21:08:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 10 monclient(hunting): authenticate will time out at 1249.648394s 2024-08-18T21:08:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f318bfff640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31940a77d0 msgr2=0x7f319409ece0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:08:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f318bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31940a77d0 0x7f319409ece0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f319413f220 0x7f3194137af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31988e6640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31940a6ce0 msgr2=0x7f31940a0dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:08:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31988e6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31940a6ce0 0x7f31940a0dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f319413f220 0x7f3194137af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:54084/0 (socket says 172.21.15.5:54084) 2024-08-18T21:08:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 1 -- 172.21.15.5:0/2399281581 learned_addr learned my addr 172.21.15.5:0/2399281581 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 10 monclient(hunting): get_auth_request con 0x7f319413f220 auth_method 0 2024-08-18T21:08:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 10 monclient(hunting): handle_auth_done global_id 5584 payload 824 2024-08-18T21:08:02.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 1 -- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31940a6ce0 msgr2=0x7f31940a0dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:08:02.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 1 --2- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31940a6ce0 0x7f31940a0dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 1 -- 172.21.15.5:0/2399281581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31940a77d0 msgr2=0x7f319409ece0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:08:02.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 1 --2- 172.21.15.5:0/2399281581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31940a77d0 0x7f319409ece0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 10 monclient: _finish_hunting 0 2024-08-18T21:08:02.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 1 monclient: found mon.noname-c 2024-08-18T21:08:02.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:08:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 1 -- 172.21.15.5:0/2399281581 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31940a0270 con 0x7f319413f220 2024-08-18T21:08:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 1 -- 172.21.15.5:0/2399281581 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f319413f220 msgr2=0x7f3194137af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31990e7640 1 --2- 172.21.15.5:0/2399281581 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f319413f220 0x7f3194137af0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f318c00b9e0 tx=0x7f318c00bea0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31897fa640 1 -- 172.21.15.5:0/2399281581 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f318c019070 con 0x7f319413f220 2024-08-18T21:08:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31897fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:08:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31897fa640 10 monclient: dump: 2024-08-18T21:08:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.652 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.652 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.652 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.652 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.652 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.652 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.652 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.652 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.652 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.652 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.652 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.652 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31897fa640 10 monclient: _finish_auth 0 2024-08-18T21:08:02.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31897fa640 10 monclient: _check_auth_tickets 2024-08-18T21:08:02.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:02.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 5 monclient: authenticate success, global_id 5584 2024-08-18T21:08:02.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31897fa640 1 -- 172.21.15.5:0/2399281581 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318c012340 con 0x7f319413f220 2024-08-18T21:08:02.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31897fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:02.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31897fa640 1 -- 172.21.15.5:0/2399281581 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f318c012960 con 0x7f319413f220 2024-08-18T21:08:02.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31897fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:08:02.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f318affd640 4 set_mon_vals no callback set 2024-08-18T21:08:02.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f31897fa640 10 monclient: dump: 2024-08-18T21:08:02.653 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.653 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.653 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.655 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 10 monclient: _renew_subs 2024-08-18T21:08:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:08:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 1 -- 172.21.15.5:0/2399281581 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3194138790 con 0x7f319413f220 2024-08-18T21:08:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 10 monclient: _renew_subs 2024-08-18T21:08:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:08:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.635+0000 7f319ab4a640 1 -- 172.21.15.5:0/2399281581 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f31940a2010 con 0x7f319413f220 2024-08-18T21:08:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f319ab4a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f319ab4a640 1 --2- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3194138030 0x7f31941d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f319ab4a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f319ab4a640 1 -- 172.21.15.5:0/2399281581 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3194051140 con 0x7f3194138030 2024-08-18T21:08:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f31897fa640 1 -- 172.21.15.5:0/2399281581 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f318c012bc0 con 0x7f319413f220 2024-08-18T21:08:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f31897fa640 1 --2- 172.21.15.5:0/2399281581 >> v2:172.21.15.157:6812/631023601 conn(0x7f318003bdf0 0x7f318003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f31988e6640 1 --2- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3194138030 0x7f31941d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f31897fa640 1 -- 172.21.15.5:0/2399281581 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(119..119 src has 22..119) ==== 3898+0+0 (secure 0 0 0) 0x7f318c04e290 con 0x7f319413f220 2024-08-18T21:08:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f31988e6640 10 monclient: get_auth_request con 0x7f3194138030 auth_method 0 2024-08-18T21:08:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f31988e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f31988e6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f31988e6640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f31988e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f31988e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f31988e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f318bfff640 1 --2- 172.21.15.5:0/2399281581 >> v2:172.21.15.157:6812/631023601 conn(0x7f318003bdf0 0x7f318003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f318bfff640 10 monclient: get_auth_request con 0x7f318003bdf0 auth_method 0 2024-08-18T21:08:02.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f31988e6640 10 monclient(hunting): handle_auth_done global_id 5473 payload 824 2024-08-18T21:08:02.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.639+0000 7f31988e6640 1 -- 172.21.15.5:0/2399281581 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31940aaf70 con 0x7f3194138030 2024-08-18T21:08:02.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.643+0000 7f31988e6640 1 -- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3194138030 msgr2=0x7f31941d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:02.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.643+0000 7f31988e6640 1 --2- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3194138030 0x7f31941d12f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f319000b450 tx=0x7f319000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.643+0000 7f318bfff640 1 --2- 172.21.15.5:0/2399281581 >> v2:172.21.15.157:6812/631023601 conn(0x7f318003bdf0 0x7f318003e2b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f319406df00 tx=0x7f3184008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.643+0000 7f31897fa640 1 -- 172.21.15.5:0/2399281581 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f31900054e0 con 0x7f3194138030 2024-08-18T21:08:02.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.643+0000 7f31897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.643+0000 7f31897fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:08:02.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.643+0000 7f31897fa640 10 monclient: dump: 2024-08-18T21:08:02.659 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.661 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.661 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.661 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.643+0000 7f31897fa640 1 -- 172.21.15.5:0/2399281581 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3190015070 con 0x7f3194138030 2024-08-18T21:08:02.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.643+0000 7f31897fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:02.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.643+0000 7f31897fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:02.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.643+0000 7f31897fa640 1 -- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3194138030 msgr2=0x7f31941d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.643+0000 7f31897fa640 1 --2- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3194138030 0x7f31941d12f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f319000b450 tx=0x7f319000b910 comp rx=0 tx=0).stop 2024-08-18T21:08:02.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.643+0000 7f31897fa640 1 -- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3194138030 msgr2=0x7f31941d12f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:02.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.643+0000 7f31897fa640 1 --2- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3194138030 0x7f31941d12f0 secure :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f319000b450 tx=0x7f319000b910 comp rx=0 tx=0).stop 2024-08-18T21:08:02.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.647+0000 7f319ab4a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.647+0000 7f319ab4a640 1 --2- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31941d1830 0x7f31941d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.647+0000 7f319ab4a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.647+0000 7f319ab4a640 1 -- 172.21.15.5:0/2399281581 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f31941d2180 con 0x7f31941d1830 2024-08-18T21:08:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.651+0000 7f31988e6640 1 --2- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31941d1830 0x7f31941d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.651+0000 7f31988e6640 10 monclient: get_auth_request con 0x7f31941d1830 auth_method 0 2024-08-18T21:08:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.651+0000 7f31988e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.651+0000 7f31988e6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.651+0000 7f31988e6640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.651+0000 7f31988e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.651+0000 7f31988e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.651+0000 7f31988e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.651+0000 7f31988e6640 10 monclient(hunting): handle_auth_done global_id 5482 payload 824 2024-08-18T21:08:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.651+0000 7f31988e6640 1 -- 172.21.15.5:0/2399281581 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f31940a70c0 con 0x7f31941d1830 2024-08-18T21:08:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.651+0000 7f31988e6640 1 -- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31941d1830 msgr2=0x7f31941d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.651+0000 7f31988e6640 1 --2- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31941d1830 0x7f31941d1c40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f319000b450 tx=0x7f31900059e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.651+0000 7f31897fa640 1 -- 172.21.15.5:0/2399281581 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3190010870 con 0x7f31941d1830 2024-08-18T21:08:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.651+0000 7f31897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f31897fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:08:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f31897fa640 10 monclient: dump: 2024-08-18T21:08:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.664 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f31897fa640 1 -- 172.21.15.5:0/2399281581 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9206 (secure 0 0 0) 0x7f3190010400 con 0x7f31941d1830 2024-08-18T21:08:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f31897fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f31897fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f31897fa640 1 -- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31941d1830 msgr2=0x7f31941d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f31897fa640 1 --2- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31941d1830 0x7f31941d1c40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f319000b450 tx=0x7f31900059e0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f31897fa640 1 -- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31941d1830 msgr2=0x7f31941d1c40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:02.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f31897fa640 1 --2- 172.21.15.5:0/2399281581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31941d1830 0x7f31941d1c40 secure :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f319000b450 tx=0x7f31900059e0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.665 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:02.665 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:02.665 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:02.665 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:08:02.665 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 100, 2024-08-18T21:08:02.665 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 291736, 2024-08-18T21:08:02.665 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:02.666 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:02.666 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:02.666 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:02.666 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:02.666 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:02.666 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.666 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 9, 2024-08-18T21:08:02.666 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:02.666 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:02.666 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:02.666 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:02.666 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:02.666 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:02.667 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:02.667 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:02.667 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:02.667 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:02.667 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:02.667 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:02.667 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:02.667 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:02.667 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.667 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:02.667 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:02.667 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:02.667 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:02.667 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:02.668 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:02.668 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:02.668 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:02.668 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:02.668 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:02.668 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:02.668 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:02.668 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:02.668 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.668 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:02.668 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:02.668 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:02.669 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:02.669 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:02.669 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:02.669 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:02.669 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:02.669 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:02.669 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:02.669 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:02.669 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:02.669 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:02.669 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:02.669 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:02.669 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:02.670 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:02.670 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:02.670 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:02.670 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:02.670 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:02.670 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:02.670 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:02.670 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:02.670 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:02.670 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:02.670 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:02.670 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:02.670 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.671 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:02.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.671 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:02.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.671 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:02.671 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:02.671 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.671 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.671 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.671 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:02.671 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.672 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.672 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:02.672 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.672 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.672 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.672 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:02.672 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:02.672 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.672 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.672 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.673 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:02.673 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:02.673 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.673 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.673 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.673 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:02.673 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.673 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.673 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:02.674 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.674 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.674 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.674 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:02.674 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:02.674 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.674 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.674 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.674 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:02.674 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:02.675 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.675 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.675 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.675 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:02.675 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.675 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.675 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:02.675 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.675 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.675 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.676 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:02.676 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:02.676 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.676 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.676 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.676 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:02.676 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:02.676 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.676 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.677 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.677 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:02.677 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.677 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.677 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.677 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:02.677 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.677 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.677 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.678 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:02.678 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:02.678 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.678 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.678 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.678 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:02.678 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:02.678 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.678 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.678 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.679 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:02.679 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.679 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.679 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:02.679 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.679 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.679 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.679 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:02.679 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:02.680 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.680 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.680 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.680 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:02.680 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:02.680 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.680 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.680 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:02.681 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.681 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.681 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:02.681 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.681 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.681 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.681 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:02.681 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:02.681 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.681 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.682 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.682 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:02.682 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:02.682 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.682 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.682 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.682 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:02.682 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.683 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.683 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:02.683 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.683 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.683 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.683 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:02.683 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:02.683 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.683 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.683 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.684 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:02.684 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:02.684 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:02.684 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:02.684 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.684 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.685 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.685 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:02.685 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:02.685 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.685 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.685 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.685 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:02.685 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:02.685 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.685 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:02.686 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:02.686 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.686 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.686 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:02.687 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:02.687 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.687 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.687 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.687 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.687 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.687 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:02.687 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:02.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.687 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:02.687 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:02.687 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:02.687 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.688 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.688 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:02.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.688 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:02.688 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:02.688 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:08:02.688 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.688 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.688 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:02.688 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f319ab4a640 1 -- 172.21.15.5:0/2399281581 >> v2:172.21.15.157:6812/631023601 conn(0x7f318003bdf0 msgr2=0x7f318003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f319ab4a640 1 --2- 172.21.15.5:0/2399281581 >> v2:172.21.15.157:6812/631023601 conn(0x7f318003bdf0 0x7f318003e2b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f319406df00 tx=0x7f3184008040 comp rx=0 tx=0).stop 2024-08-18T21:08:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f319ab4a640 10 monclient: shutdown 2024-08-18T21:08:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f319ab4a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f319ab4a640 1 -- 172.21.15.5:0/2399281581 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f319413f220 msgr2=0x7f3194137af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f319ab4a640 1 --2- 172.21.15.5:0/2399281581 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f319413f220 0x7f3194137af0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f318c00b9e0 tx=0x7f318c00bea0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f31990e7640 1 -- 172.21.15.5:0/2399281581 reap_dead start 2024-08-18T21:08:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f31990e7640 1 -- 172.21.15.5:0/2399281581 reap_dead start 2024-08-18T21:08:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f319ab4a640 1 -- 172.21.15.5:0/2399281581 shutdown_connections 2024-08-18T21:08:02.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f319ab4a640 1 -- 172.21.15.5:0/2399281581 >> 172.21.15.5:0/2399281581 conn(0x7f31940acbc0 msgr2=0x7f319413f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:02.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f319ab4a640 1 -- 172.21.15.5:0/2399281581 shutdown_connections 2024-08-18T21:08:02.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.655+0000 7f319ab4a640 1 -- 172.21.15.5:0/2399281581 wait complete. 2024-08-18T21:08:02.691 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:08:02.691 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon h 2024-08-18T21:08:02.691 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:08:02.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 10 monclient: get_monmap_and_config 2024-08-18T21:08:02.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 10 monclient: build_initial_monmap 2024-08-18T21:08:02.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 10 monclient: monmap: 2024-08-18T21:08:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:02.809201+0000 2024-08-18T21:08:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:02.809201+0000 2024-08-18T21:08:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:02.810 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 1 Processor -- start 2024-08-18T21:08:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 1 -- start start 2024-08-18T21:08:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 10 monclient: init 2024-08-18T21:08:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 10 monclient: _add_conns ranks=[2,5,0,9,8,3,7,4,1,6,10] 2024-08-18T21:08:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdb8413a970 0x7fdb84073c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 10 monclient(hunting): picked mon.noname-b con 0x7fdb8413a970 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:08:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413ad50 0x7fdb8406fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 10 monclient(hunting): picked mon.noname-h con 0x7fdb8413ad50 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdb8413b190 addr v1:172.21.15.5:6789/0 2024-08-18T21:08:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb84072a00 con 0x7fdb8413b190 2024-08-18T21:08:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fdb84071960 con 0x7fdb8413a970 2024-08-18T21:08:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdb84072ce0 con 0x7fdb8413ad50 2024-08-18T21:08:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb8a8fb640 10 monclient(hunting): authenticate will time out at 1249.823106s 2024-08-18T21:08:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb83fff640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdb8413a970 msgr2=0x7fdb84073c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:08:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb88e98640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fdb8413b190 legacy=0x7fdb84070270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:08:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb83fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdb8413a970 0x7fdb84073c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb837fe640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413ad50 0x7fdb8406fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb837fe640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413ad50 0x7fdb8406fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:40590/0 (socket says 172.21.15.5:40590) 2024-08-18T21:08:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb837fe640 1 -- 172.21.15.5:0/4168963830 learned_addr learned my addr 172.21.15.5:0/4168963830 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:02.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb837fe640 10 monclient(hunting): get_auth_request con 0x7fdb8413ad50 auth_method 0 2024-08-18T21:08:02.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb837fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb837fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.807+0000 7fdb837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.811+0000 7fdb837fe640 10 monclient(hunting): handle_auth_done global_id 34907 payload 274 2024-08-18T21:08:02.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.811+0000 7fdb837fe640 1 -- 172.21.15.5:0/4168963830 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdb8413a970 msgr2=0x7fdb84073c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:08:02.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.811+0000 7fdb837fe640 1 --2- 172.21.15.5:0/4168963830 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdb8413a970 0x7fdb84073c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.811+0000 7fdb837fe640 1 -- 172.21.15.5:0/4168963830 >> v1:172.21.15.5:6789/0 conn(0x7fdb8413b190 legacy=0x7fdb84070270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:08:02.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.811+0000 7fdb837fe640 10 monclient: _finish_hunting 0 2024-08-18T21:08:02.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.811+0000 7fdb837fe640 1 monclient: found mon.noname-h 2024-08-18T21:08:02.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.811+0000 7fdb837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:02.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.811+0000 7fdb837fe640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:08:02.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.811+0000 7fdb837fe640 1 -- 172.21.15.5:0/4168963830 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb84072fc0 con 0x7fdb8413ad50 2024-08-18T21:08:02.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb837fe640 1 -- 172.21.15.5:0/4168963830 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413ad50 msgr2=0x7fdb8406fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:02.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb837fe640 1 --2- 172.21.15.5:0/4168963830 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413ad50 0x7fdb8406fd30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdb780098a0 tx=0x7fdb7801c420 comp rx=0 tx=0).ready entity=mon.5 client_cookie=ad45f40262188f26 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb82ffd640 1 -- 172.21.15.5:0/4168963830 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdb780b0070 con 0x7fdb8413ad50 2024-08-18T21:08:02.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb82ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb82ffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:08:02.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb82ffd640 10 monclient: dump: 2024-08-18T21:08:02.839 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.839 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.842 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb82ffd640 10 monclient: _finish_auth 0 2024-08-18T21:08:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb82ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:08:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb82ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb82ffd640 1 -- 172.21.15.5:0/4168963830 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb780aa810 con 0x7fdb8413ad50 2024-08-18T21:08:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb82ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb82ffd640 1 -- 172.21.15.5:0/4168963830 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdb780aae30 con 0x7fdb8413ad50 2024-08-18T21:08:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb82ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb82ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:08:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb82ffd640 10 monclient: dump: 2024-08-18T21:08:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.846 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb8a8fb640 5 monclient: authenticate success, global_id 34907 2024-08-18T21:08:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb8a8fb640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb8a8fb640 4 set_mon_vals no callback set 2024-08-18T21:08:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb8a8fb640 10 monclient: shutdown 2024-08-18T21:08:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb8a8fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb8a8fb640 1 -- 172.21.15.5:0/4168963830 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413ad50 msgr2=0x7fdb8406fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb8a8fb640 1 --2- 172.21.15.5:0/4168963830 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413ad50 0x7fdb8406fd30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdb780098a0 tx=0x7fdb7801c420 comp rx=0 tx=0).stop 2024-08-18T21:08:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb8a8fb640 1 -- 172.21.15.5:0/4168963830 shutdown_connections 2024-08-18T21:08:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb8a8fb640 1 --2- 172.21.15.5:0/4168963830 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413ad50 0x7fdb8406fd30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb8a8fb640 1 --2- 172.21.15.5:0/4168963830 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdb8413a970 0x7fdb84073c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb8a8fb640 1 -- 172.21.15.5:0/4168963830 >> 172.21.15.5:0/4168963830 conn(0x7fdb840a8a90 msgr2=0x7fdb840a8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb8a8fb640 1 -- 172.21.15.5:0/4168963830 shutdown_connections 2024-08-18T21:08:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb8a8fb640 1 -- 172.21.15.5:0/4168963830 wait complete. 2024-08-18T21:08:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb8a8fb640 10 monclient: build_initial_monmap 2024-08-18T21:08:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.815+0000 7fdb8a8fb640 10 monclient: monmap: 2024-08-18T21:08:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:02.848 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:02.849 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 1 Processor -- start 2024-08-18T21:08:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 1 -- start start 2024-08-18T21:08:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 10 monclient: init 2024-08-18T21:08:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 10 monclient: _add_conns ranks=[3,7,1,4,6,0,5,8,2] 2024-08-18T21:08:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb8413a970 0x7fdb84139c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 10 monclient(hunting): picked mon.noname-g con 0x7fdb8413a970 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdb8413ad50 0x7fdb8413e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 10 monclient(hunting): picked mon.noname-i con 0x7fdb8413ad50 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb8413b190 0x7fdb8413ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 10 monclient(hunting): picked mon.noname-f con 0x7fdb8413b190 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:08:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdb84148630 con 0x7fdb8413b190 2024-08-18T21:08:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdb84070b90 con 0x7fdb8413a970 2024-08-18T21:08:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fdb841487b0 con 0x7fdb8413ad50 2024-08-18T21:08:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb8a8fb640 10 monclient(hunting): authenticate will time out at 1249.832773s 2024-08-18T21:08:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb83fff640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb8413a970 msgr2=0x7fdb84139c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:08:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb83fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb8413a970 0x7fdb84139c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb8413b190 0x7fdb8413ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb837fe640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdb8413ad50 0x7fdb8413e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb8413b190 0x7fdb8413ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:44814/0 (socket says 172.21.15.5:44814) 2024-08-18T21:08:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 1 -- 172.21.15.5:0/1827477714 learned_addr learned my addr 172.21.15.5:0/1827477714 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 10 monclient(hunting): get_auth_request con 0x7fdb8413b190 auth_method 0 2024-08-18T21:08:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb837fe640 10 monclient(hunting): get_auth_request con 0x7fdb8413ad50 auth_method 0 2024-08-18T21:08:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb837fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb837fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 10 monclient(hunting): handle_auth_done global_id 5491 payload 824 2024-08-18T21:08:02.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 1 -- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdb8413ad50 msgr2=0x7fdb8413e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 1 --2- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdb8413ad50 0x7fdb8413e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 1 -- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb8413a970 msgr2=0x7fdb84139c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:08:02.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 1 --2- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb8413a970 0x7fdb84139c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 10 monclient: _finish_hunting 0 2024-08-18T21:08:02.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 1 monclient: found mon.noname-f 2024-08-18T21:08:02.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:02.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:08:02.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.819+0000 7fdb88e98640 1 -- 172.21.15.5:0/1827477714 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb84140240 con 0x7fdb8413b190 2024-08-18T21:08:02.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb88e98640 1 -- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb8413b190 msgr2=0x7fdb8413ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb88e98640 1 --2- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb8413b190 0x7fdb8413ed30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00be90 tx=0x7fdb7c00bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb80ff9640 1 -- 172.21.15.5:0/1827477714 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdb7c0158e0 con 0x7fdb8413b190 2024-08-18T21:08:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb80ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb80ff9640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:08:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb80ff9640 10 monclient: dump: 2024-08-18T21:08:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.854 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb80ff9640 10 monclient: _finish_auth 0 2024-08-18T21:08:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb80ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:08:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb80ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb80ff9640 1 -- 172.21.15.5:0/1827477714 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7c010070 con 0x7fdb8413b190 2024-08-18T21:08:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb8a8fb640 5 monclient: authenticate success, global_id 5491 2024-08-18T21:08:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb80ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb80ff9640 1 -- 172.21.15.5:0/1827477714 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdb7c005070 con 0x7fdb8413b190 2024-08-18T21:08:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb8a8fb640 10 monclient: _renew_subs 2024-08-18T21:08:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb8a8fb640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:08:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb8a8fb640 1 -- 172.21.15.5:0/1827477714 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb840a7d90 con 0x7fdb8413b190 2024-08-18T21:08:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb80ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb80ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:08:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb827fc640 4 set_mon_vals no callback set 2024-08-18T21:08:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb80ff9640 10 monclient: dump: 2024-08-18T21:08:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.856 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb8a8fb640 10 monclient: _renew_subs 2024-08-18T21:08:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb8a8fb640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:08:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb8a8fb640 1 -- 172.21.15.5:0/1827477714 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb841425a0 con 0x7fdb8413b190 2024-08-18T21:08:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb8a8fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb8a8fb640 1 --2- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413a1d0 0x7fdb8413f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb8a8fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb8a8fb640 1 -- 172.21.15.5:0/1827477714 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdb84051140 con 0x7fdb8413a1d0 2024-08-18T21:08:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb83fff640 1 --2- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413a1d0 0x7fdb8413f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb83fff640 10 monclient: get_auth_request con 0x7fdb8413a1d0 auth_method 0 2024-08-18T21:08:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb83fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb83fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb83fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb83fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb83fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb83fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb80ff9640 1 -- 172.21.15.5:0/1827477714 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fdb7c015470 con 0x7fdb8413b190 2024-08-18T21:08:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb83fff640 10 monclient(hunting): handle_auth_done global_id 34916 payload 824 2024-08-18T21:08:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb83fff640 1 -- 172.21.15.5:0/1827477714 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb8406b7e0 con 0x7fdb8413a1d0 2024-08-18T21:08:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb80ff9640 1 --2- 172.21.15.5:0/1827477714 >> v2:172.21.15.157:6812/631023601 conn(0x7fdb7003bdf0 0x7fdb7003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb80ff9640 1 -- 172.21.15.5:0/1827477714 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(119..119 src has 22..119) ==== 3898+0+0 (secure 0 0 0) 0x7fdb7c04ebc0 con 0x7fdb8413b190 2024-08-18T21:08:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb837fe640 1 --2- 172.21.15.5:0/1827477714 >> v2:172.21.15.157:6812/631023601 conn(0x7fdb7003bdf0 0x7fdb7003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.823+0000 7fdb837fe640 10 monclient: get_auth_request con 0x7fdb7003bdf0 auth_method 0 2024-08-18T21:08:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.827+0000 7fdb83fff640 1 -- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413a1d0 msgr2=0x7fdb8413f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.827+0000 7fdb83fff640 1 --2- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413a1d0 0x7fdb8413f270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400b450 tx=0x7fdb7400b910 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.827+0000 7fdb80ff9640 1 -- 172.21.15.5:0/1827477714 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdb740054e0 con 0x7fdb8413a1d0 2024-08-18T21:08:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.827+0000 7fdb80ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.827+0000 7fdb80ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:08:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.827+0000 7fdb80ff9640 10 monclient: dump: 2024-08-18T21:08:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.860 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.827+0000 7fdb837fe640 1 --2- 172.21.15.5:0/1827477714 >> v2:172.21.15.157:6812/631023601 conn(0x7fdb7003bdf0 0x7fdb7003e2b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdb780ab000 tx=0x7fdb780a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.827+0000 7fdb80ff9640 1 -- 172.21.15.5:0/1827477714 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdb74015070 con 0x7fdb8413a1d0 2024-08-18T21:08:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.827+0000 7fdb80ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.827+0000 7fdb80ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.827+0000 7fdb80ff9640 1 -- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413a1d0 msgr2=0x7fdb8413f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.827+0000 7fdb80ff9640 1 --2- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413a1d0 0x7fdb8413f270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400b450 tx=0x7fdb7400b910 comp rx=0 tx=0).stop 2024-08-18T21:08:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.827+0000 7fdb80ff9640 1 -- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413a1d0 msgr2=0x7fdb8413f270 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.827+0000 7fdb80ff9640 1 --2- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413a1d0 0x7fdb8413f270 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400b450 tx=0x7fdb7400b910 comp rx=0 tx=0).stop 2024-08-18T21:08:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.835+0000 7fdb8a8fb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.835+0000 7fdb8a8fb640 1 --2- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413f7b0 0x7fdb840a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.835+0000 7fdb8a8fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.835+0000 7fdb8a8fb640 1 -- 172.21.15.5:0/1827477714 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdb8413fb90 con 0x7fdb8413f7b0 2024-08-18T21:08:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.835+0000 7fdb83fff640 1 --2- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413f7b0 0x7fdb840a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.835+0000 7fdb83fff640 10 monclient: get_auth_request con 0x7fdb8413f7b0 auth_method 0 2024-08-18T21:08:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.835+0000 7fdb83fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.835+0000 7fdb83fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.835+0000 7fdb83fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.835+0000 7fdb83fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.835+0000 7fdb83fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.835+0000 7fdb83fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.835+0000 7fdb83fff640 10 monclient(hunting): handle_auth_done global_id 34925 payload 824 2024-08-18T21:08:02.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.835+0000 7fdb83fff640 1 -- 172.21.15.5:0/1827477714 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdb84073c80 con 0x7fdb8413f7b0 2024-08-18T21:08:02.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.835+0000 7fdb83fff640 1 -- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413f7b0 msgr2=0x7fdb840a1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:02.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.835+0000 7fdb83fff640 1 --2- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413f7b0 0x7fdb840a1a80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400b450 tx=0x7fdb740059e0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:02.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb80ff9640 1 -- 172.21.15.5:0/1827477714 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdb74005710 con 0x7fdb8413f7b0 2024-08-18T21:08:02.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb80ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:02.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb80ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:08:02.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb80ff9640 10 monclient: dump: 2024-08-18T21:08:02.863 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:02.863 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:02.863 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.863 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:02.863 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:02.863 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:02.864 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:02.864 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:02.864 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:02.864 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:02.864 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:02.864 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:02.864 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:02.864 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:02.864 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:02.864 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:02.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb80ff9640 1 -- 172.21.15.5:0/1827477714 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9204 (secure 0 0 0) 0x7fdb74005710 con 0x7fdb8413f7b0 2024-08-18T21:08:02.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb80ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:02.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb80ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:02.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb80ff9640 1 -- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413f7b0 msgr2=0x7fdb840a1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb80ff9640 1 --2- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413f7b0 0x7fdb840a1a80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400b450 tx=0x7fdb740059e0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb80ff9640 1 -- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413f7b0 msgr2=0x7fdb840a1a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:02.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb80ff9640 1 --2- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb8413f7b0 0x7fdb840a1a80 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400b450 tx=0x7fdb740059e0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.865 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:02.865 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:02.865 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:02.865 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:02.865 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 100, 2024-08-18T21:08:02.865 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 202633, 2024-08-18T21:08:02.866 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:02.866 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:02.866 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:02.866 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:02.866 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:02.866 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:02.866 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.866 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 9, 2024-08-18T21:08:02.866 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:02.866 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:02.866 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:02.866 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:02.867 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:02.867 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:02.867 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:02.867 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:02.867 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:02.867 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:02.867 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:02.867 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:02.867 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:02.867 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:02.867 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.867 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:02.867 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:02.867 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:02.868 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:02.868 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:02.868 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:02.868 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:02.868 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:02.868 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:02.868 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:02.868 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:02.868 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:02.868 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:02.868 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.868 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:02.869 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:02.869 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:02.869 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:02.869 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:02.869 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:02.869 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:02.869 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:02.869 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:02.869 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:02.869 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:02.869 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:02.869 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:02.869 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:02.869 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:02.870 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:02.870 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:02.870 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:02.870 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:02.870 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:02.870 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:02.870 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:02.870 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:02.870 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:02.870 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:02.870 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:02.870 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:02.870 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:02.871 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.871 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:02.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.871 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:02.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.871 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:02.871 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:02.871 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.871 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.871 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.871 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:02.872 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:02.872 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.872 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.872 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:02.872 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:02.872 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.872 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.873 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.873 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:02.873 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:02.873 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.873 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.873 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.873 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:02.873 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.875 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:02.875 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:02.875 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.875 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:02.875 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.875 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:02.875 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.875 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.876 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.876 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:02.876 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:02.876 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.876 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.876 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.876 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:02.876 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:02.876 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.876 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.877 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:02.877 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.877 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:02.877 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.877 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.877 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:02.878 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:02.878 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.878 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.878 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.878 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:02.878 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:02.878 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.879 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:02.879 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.879 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.879 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:02.879 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.879 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.879 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.879 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:02.879 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:02.879 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.879 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.880 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.880 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:02.880 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:02.880 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:02.880 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.881 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.881 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:02.881 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.881 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.881 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.881 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:02.881 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:02.881 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.881 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.881 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.882 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:02.882 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:02.882 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.882 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.882 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:02.882 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.882 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:02.883 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.883 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.883 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.883 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:02.883 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:02.883 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.883 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.883 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.883 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:02.884 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:02.884 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.884 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.884 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.884 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:02.884 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.884 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.884 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:02.884 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.885 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.885 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.885 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:02.885 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:02.885 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.885 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.885 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.885 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:02.885 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:02.885 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:02.885 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:02.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.886 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:02.886 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:02.886 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.886 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:02.886 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:02.886 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:02.886 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.886 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.887 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:02.887 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:02.887 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:02.887 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:02.887 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:02.887 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.887 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.887 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:02.887 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:02.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.887 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:02.887 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:02.888 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:02.888 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.888 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:02.888 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:02.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:02.888 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:02.888 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:02.888 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:08:02.888 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:02.888 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:02.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:02.888 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:02.889 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:02.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb8a8fb640 1 -- 172.21.15.5:0/1827477714 >> v2:172.21.15.157:6812/631023601 conn(0x7fdb7003bdf0 msgr2=0x7fdb7003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb8a8fb640 1 --2- 172.21.15.5:0/1827477714 >> v2:172.21.15.157:6812/631023601 conn(0x7fdb7003bdf0 0x7fdb7003e2b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdb780ab000 tx=0x7fdb780a6000 comp rx=0 tx=0).stop 2024-08-18T21:08:02.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb8a8fb640 10 monclient: shutdown 2024-08-18T21:08:02.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb8a8fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:02.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb8a8fb640 1 -- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb8413b190 msgr2=0x7fdb8413ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:02.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb8a8fb640 1 --2- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb8413b190 0x7fdb8413ed30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00be90 tx=0x7fdb7c00bf80 comp rx=0 tx=0).stop 2024-08-18T21:08:02.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb88e98640 1 -- 172.21.15.5:0/1827477714 reap_dead start 2024-08-18T21:08:02.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb8a8fb640 1 -- 172.21.15.5:0/1827477714 shutdown_connections 2024-08-18T21:08:02.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb8a8fb640 1 --2- 172.21.15.5:0/1827477714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb8413b190 0x7fdb8413ed30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:02.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb8a8fb640 1 -- 172.21.15.5:0/1827477714 >> 172.21.15.5:0/1827477714 conn(0x7fdb840a8a90 msgr2=0x7fdb840a6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:02.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb8a8fb640 1 -- 172.21.15.5:0/1827477714 shutdown_connections 2024-08-18T21:08:02.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:02.839+0000 7fdb8a8fb640 1 -- 172.21.15.5:0/1827477714 wait complete. 2024-08-18T21:08:02.891 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:08:02.891 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon i 2024-08-18T21:08:02.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:08:03.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 10 monclient: get_monmap_and_config 2024-08-18T21:08:03.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 10 monclient: build_initial_monmap 2024-08-18T21:08:03.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 10 monclient: monmap: 2024-08-18T21:08:03.021 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:03.021 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:03.021 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:03.021578+0000 2024-08-18T21:08:03.021 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:03.021578+0000 2024-08-18T21:08:03.021 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:03.021 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:03.021 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:03.021 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:03.022 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 1 Processor -- start 2024-08-18T21:08:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 1 -- start start 2024-08-18T21:08:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 10 monclient: init 2024-08-18T21:08:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 10 monclient: _add_conns ranks=[6,8,7,10,2,1,3,4,9,5,0] 2024-08-18T21:08:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4f1c0a5a50 0x7f4f1c0a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 10 monclient(hunting): picked mon.noname-d con 0x7f4f1c0a5a50 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4f1c0a6370 0x7f4f1c139bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 10 monclient(hunting): picked mon.noname-e con 0x7f4f1c0a6370 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:08:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c13a130 0x7f4f1c13a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:03.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 10 monclient(hunting): picked mon.noname-i con 0x7f4f1c13a130 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:03.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:03.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f4f1c06df10 con 0x7f4f1c0a5a50 2024-08-18T21:08:03.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:03.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f4f1c06e660 con 0x7f4f1c13a130 2024-08-18T21:08:03.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:03.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f4f1c06e320 con 0x7f4f1c0a6370 2024-08-18T21:08:03.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:03.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f217f7640 10 monclient(hunting): authenticate will time out at 1250.034945s 2024-08-18T21:08:03.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1affd640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4f1c0a5a50 msgr2=0x7f4f1c0a5e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:08:03.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1affd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4f1c0a5a50 0x7f4f1c0a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:03.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4f1c0a6370 0x7f4f1c139bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:03.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4f1c0a6370 0x7f4f1c139bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:43204/0 (socket says 172.21.15.5:43204) 2024-08-18T21:08:03.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 1 -- 172.21.15.5:0/1917240882 learned_addr learned my addr 172.21.15.5:0/1917240882 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:03.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 10 monclient(hunting): get_auth_request con 0x7f4f1c0a6370 auth_method 0 2024-08-18T21:08:03.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:03.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:03.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:03.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:03.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:03.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1b7fe640 1 --2- 172.21.15.5:0/1917240882 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c13a130 0x7f4f1c13a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1b7fe640 10 monclient(hunting): get_auth_request con 0x7f4f1c13a130 auth_method 0 2024-08-18T21:08:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 10 monclient(hunting): handle_auth_done global_id 54638 payload 274 2024-08-18T21:08:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 1 -- 172.21.15.5:0/1917240882 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c13a130 msgr2=0x7f4f1c13a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 1 --2- 172.21.15.5:0/1917240882 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c13a130 0x7f4f1c13a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:03.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 1 -- 172.21.15.5:0/1917240882 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4f1c0a5a50 msgr2=0x7f4f1c0a5e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:08:03.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 1 --2- 172.21.15.5:0/1917240882 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4f1c0a5a50 0x7f4f1c0a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:03.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:08:03.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 1 monclient: found mon.noname-e 2024-08-18T21:08:03.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:03.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:08:03.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.019+0000 7f4f1a7fc640 1 -- 172.21.15.5:0/1917240882 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1c06f670 con 0x7f4f1c0a6370 2024-08-18T21:08:03.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f1a7fc640 1 -- 172.21.15.5:0/1917240882 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4f1c0a6370 msgr2=0x7f4f1c139bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:03.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f1a7fc640 1 --2- 172.21.15.5:0/1917240882 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4f1c0a6370 0x7f4f1c139bf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f100098a0 tx=0x7f4f1001c460 comp rx=0 tx=0).ready entity=mon.8 client_cookie=abcffaa217621641 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:03.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f19ffb640 1 -- 172.21.15.5:0/1917240882 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f100b1070 con 0x7f4f1c0a6370 2024-08-18T21:08:03.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f19ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:03.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f19ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:08:03.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f19ffb640 10 monclient: dump: 2024-08-18T21:08:03.034 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:03.034 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:03.034 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:03.034 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:03.034 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:03.034 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:03.034 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:03.034 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:03.034 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:03.034 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:03.034 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:03.034 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:03.035 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f19ffb640 10 monclient: _finish_auth 0 2024-08-18T21:08:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f19ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:08:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f19ffb640 1 -- 172.21.15.5:0/1917240882 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f100ab810 con 0x7f4f1c0a6370 2024-08-18T21:08:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 5 monclient: authenticate success, global_id 54638 2024-08-18T21:08:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:08:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f19ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f19ffb640 1 -- 172.21.15.5:0/1917240882 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f100abe30 con 0x7f4f1c0a6370 2024-08-18T21:08:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f19ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f19ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f19ffb640 10 monclient: dump: 2024-08-18T21:08:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:03.037 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:03.037 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:03.037 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:03.037 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:03.037 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:03.037 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:03.037 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:03.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:03.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 4 set_mon_vals no callback set 2024-08-18T21:08:03.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 10 monclient: shutdown 2024-08-18T21:08:03.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:03.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 1 -- 172.21.15.5:0/1917240882 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4f1c0a6370 msgr2=0x7f4f1c139bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:03.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 1 --2- 172.21.15.5:0/1917240882 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4f1c0a6370 0x7f4f1c139bf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f100098a0 tx=0x7f4f1001c460 comp rx=0 tx=0).stop 2024-08-18T21:08:03.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 1 -- 172.21.15.5:0/1917240882 shutdown_connections 2024-08-18T21:08:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 1 --2- 172.21.15.5:0/1917240882 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4f1c0a6370 0x7f4f1c139bf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 1 --2- 172.21.15.5:0/1917240882 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c13a130 0x7f4f1c13a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 1 --2- 172.21.15.5:0/1917240882 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4f1c0a5a50 0x7f4f1c0a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 1 -- 172.21.15.5:0/1917240882 >> 172.21.15.5:0/1917240882 conn(0x7f4f1c0aa700 msgr2=0x7f4f1c0a6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 1 -- 172.21.15.5:0/1917240882 shutdown_connections 2024-08-18T21:08:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 1 -- 172.21.15.5:0/1917240882 wait complete. 2024-08-18T21:08:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 10 monclient: build_initial_monmap 2024-08-18T21:08:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 10 monclient: monmap: 2024-08-18T21:08:03.039 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:03.039 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:03.039 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:03.039 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:03.039 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:03.039 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:03.039 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:03.039 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:03.039 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:03.039 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:03.039 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:03.039 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:03.039 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:03.039 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:03.040 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 1 Processor -- start 2024-08-18T21:08:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 1 -- start start 2024-08-18T21:08:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.027+0000 7f4f217f7640 10 monclient: init 2024-08-18T21:08:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f217f7640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f217f7640 10 monclient: _add_conns ranks=[3,5,1,8,4,6,2,7,0] 2024-08-18T21:08:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f217f7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f1c0a5a50 0x7f4f1c124c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f217f7640 10 monclient(hunting): picked mon.noname-g con 0x7f4f1c0a5a50 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f217f7640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4f1c0a6370 0x7f4f1c13be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f217f7640 10 monclient(hunting): picked mon.noname-h con 0x7f4f1c0a6370 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f217f7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f1c13a130 0x7f4f1c13c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f217f7640 10 monclient(hunting): picked mon.noname-f con 0x7f4f1c13a130 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:08:03.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f217f7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:03.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f217f7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1c0a2340 con 0x7f4f1c13a130 2024-08-18T21:08:03.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f217f7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:03.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f217f7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4f1c0a21c0 con 0x7f4f1c0a5a50 2024-08-18T21:08:03.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f217f7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:03.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f217f7640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f4f1c1436d0 con 0x7f4f1c0a6370 2024-08-18T21:08:03.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f217f7640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:03.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f217f7640 10 monclient(hunting): authenticate will time out at 1250.044173s 2024-08-18T21:08:03.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1affd640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f1c0a5a50 msgr2=0x7f4f1c124c80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:08:03.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1affd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f1c0a5a50 0x7f4f1c124c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4f1c0a6370 0x7f4f1c13be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1b7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f1c13a130 0x7f4f1c13c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4f1c0a6370 0x7f4f1c13be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:40626/0 (socket says 172.21.15.5:40626) 2024-08-18T21:08:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 1 -- 172.21.15.5:0/2270837559 learned_addr learned my addr 172.21.15.5:0/2270837559 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 10 monclient(hunting): get_auth_request con 0x7f4f1c0a6370 auth_method 0 2024-08-18T21:08:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1b7fe640 10 monclient(hunting): get_auth_request con 0x7f4f1c13a130 auth_method 0 2024-08-18T21:08:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 10 monclient(hunting): handle_auth_done global_id 34934 payload 824 2024-08-18T21:08:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 1 -- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f1c0a5a50 msgr2=0x7f4f1c124c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:08:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 1 --2- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f1c0a5a50 0x7f4f1c124c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 1 -- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f1c13a130 msgr2=0x7f4f1c13c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 1 --2- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f1c13a130 0x7f4f1c13c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:08:03.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 1 monclient: found mon.noname-h 2024-08-18T21:08:03.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:03.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:08:03.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 1 -- 172.21.15.5:0/2270837559 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1c13ee40 con 0x7f4f1c0a6370 2024-08-18T21:08:03.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1b7fe640 1 --2- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f1c13a130 0x7f4f1c13c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:08:03.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 1 -- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4f1c0a6370 msgr2=0x7f4f1c13be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:03.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f1a7fc640 1 --2- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4f1c0a6370 0x7f4f1c13be90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4f100097c0 tx=0x7f4f10019200 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:03.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.031+0000 7f4f037fe640 1 -- 172.21.15.5:0/2270837559 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f100ba070 con 0x7f4f1c0a6370 2024-08-18T21:08:03.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:03.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f037fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:08:03.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f037fe640 10 monclient: dump: 2024-08-18T21:08:03.049 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:03.049 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:03.049 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:03.049 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:03.049 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:03.049 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:03.049 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:03.049 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:03.050 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f037fe640 10 monclient: _finish_auth 0 2024-08-18T21:08:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f037fe640 10 monclient: _check_auth_tickets 2024-08-18T21:08:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f037fe640 1 -- 172.21.15.5:0/2270837559 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f100abe50 con 0x7f4f1c0a6370 2024-08-18T21:08:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f217f7640 5 monclient: authenticate success, global_id 34934 2024-08-18T21:08:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f217f7640 10 monclient: _renew_subs 2024-08-18T21:08:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f217f7640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:08:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f217f7640 1 -- 172.21.15.5:0/2270837559 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f1c13d950 con 0x7f4f1c0a6370 2024-08-18T21:08:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f037fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f037fe640 1 -- 172.21.15.5:0/2270837559 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f100b1040 con 0x7f4f1c0a6370 2024-08-18T21:08:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f037fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:08:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f037fe640 10 monclient: dump: 2024-08-18T21:08:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:03.052 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f197fa640 4 set_mon_vals no callback set 2024-08-18T21:08:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f217f7640 10 monclient: _renew_subs 2024-08-18T21:08:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f217f7640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:08:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f217f7640 1 -- 172.21.15.5:0/2270837559 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f1c13e740 con 0x7f4f1c0a6370 2024-08-18T21:08:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f217f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f217f7640 1 --2- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c13c910 0x7f4f1c1d1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f217f7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f217f7640 1 -- 172.21.15.5:0/2270837559 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f4f1c13f930 con 0x7f4f1c13c910 2024-08-18T21:08:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f1affd640 1 --2- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c13c910 0x7f4f1c1d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f1affd640 10 monclient: get_auth_request con 0x7f4f1c13c910 auth_method 0 2024-08-18T21:08:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f1affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f037fe640 1 -- 172.21.15.5:0/2270837559 <== mon.5 v2:172.21.15.157:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f4f10004040 con 0x7f4f1c0a6370 2024-08-18T21:08:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f1affd640 10 monclient(hunting): handle_auth_done global_id 5407 payload 824 2024-08-18T21:08:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f1affd640 1 -- 172.21.15.5:0/2270837559 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f1c0a36a0 con 0x7f4f1c13c910 2024-08-18T21:08:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f037fe640 1 --2- 172.21.15.5:0/2270837559 >> v2:172.21.15.157:6812/631023601 conn(0x7f4f0803bdc0 0x7f4f0803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f037fe640 1 -- 172.21.15.5:0/2270837559 <== mon.5 v2:172.21.15.157:3302/0 5 ==== osd_map(119..119 src has 22..119) ==== 3898+0+0 (secure 0 0 0) 0x7f4f100e7910 con 0x7f4f1c0a6370 2024-08-18T21:08:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f1b7fe640 1 --2- 172.21.15.5:0/2270837559 >> v2:172.21.15.157:6812/631023601 conn(0x7f4f0803bdc0 0x7f4f0803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.035+0000 7f4f1b7fe640 10 monclient: get_auth_request con 0x7f4f0803bdc0 auth_method 0 2024-08-18T21:08:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.039+0000 7f4f1affd640 1 -- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c13c910 msgr2=0x7f4f1c1d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.039+0000 7f4f1affd640 1 --2- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c13c910 0x7f4f1c1d1740 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00b450 tx=0x7f4f0c00b910 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.039+0000 7f4f037fe640 1 -- 172.21.15.5:0/2270837559 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f0c0054e0 con 0x7f4f1c13c910 2024-08-18T21:08:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.039+0000 7f4f037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.039+0000 7f4f037fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:08:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.039+0000 7f4f037fe640 10 monclient: dump: 2024-08-18T21:08:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:03.056 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:03.056 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:03.056 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:03.056 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:03.056 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:03.056 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:03.056 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:03.056 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:03.056 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:03.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.039+0000 7f4f1b7fe640 1 --2- 172.21.15.5:0/2270837559 >> v2:172.21.15.157:6812/631023601 conn(0x7f4f0803bdc0 0x7f4f0803e280 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009fd0 tx=0x7f4f1400b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:03.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.039+0000 7f4f037fe640 1 -- 172.21.15.5:0/2270837559 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4f0c015070 con 0x7f4f1c13c910 2024-08-18T21:08:03.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.039+0000 7f4f037fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:03.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.039+0000 7f4f037fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:03.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.039+0000 7f4f037fe640 1 -- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c13c910 msgr2=0x7f4f1c1d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:03.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.039+0000 7f4f037fe640 1 --2- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c13c910 0x7f4f1c1d1740 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00b450 tx=0x7f4f0c00b910 comp rx=0 tx=0).stop 2024-08-18T21:08:03.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.039+0000 7f4f037fe640 1 -- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c13c910 msgr2=0x7f4f1c1d1740 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:03.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.039+0000 7f4f037fe640 1 --2- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c13c910 0x7f4f1c1d1740 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:03.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.043+0000 7f4f217f7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:03.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.043+0000 7f4f217f7640 1 --2- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c1d1c80 0x7f4f1c1d2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:03.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.043+0000 7f4f217f7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:03.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.043+0000 7f4f217f7640 1 -- 172.21.15.5:0/2270837559 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f4f1c1d25d0 con 0x7f4f1c1d1c80 2024-08-18T21:08:03.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.047+0000 7f4f1affd640 1 --2- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c1d1c80 0x7f4f1c1d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:03.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.047+0000 7f4f1affd640 10 monclient: get_auth_request con 0x7f4f1c1d1c80 auth_method 0 2024-08-18T21:08:03.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.047+0000 7f4f1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:03.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.047+0000 7f4f1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:03.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.047+0000 7f4f1affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:03.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.047+0000 7f4f1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:03.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.047+0000 7f4f1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:03.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.047+0000 7f4f1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:03.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.047+0000 7f4f1affd640 10 monclient(hunting): handle_auth_done global_id 5416 payload 824 2024-08-18T21:08:03.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.047+0000 7f4f1affd640 1 -- 172.21.15.5:0/2270837559 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4f1c13ccf0 con 0x7f4f1c1d1c80 2024-08-18T21:08:03.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.047+0000 7f4f1affd640 1 -- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c1d1c80 msgr2=0x7f4f1c1d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:03.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.047+0000 7f4f1affd640 1 --2- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c1d1c80 0x7f4f1c1d2090 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00b450 tx=0x7f4f0c0059e0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:03.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.047+0000 7f4f037fe640 1 -- 172.21.15.5:0/2270837559 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f0c0108f0 con 0x7f4f1c1d1c80 2024-08-18T21:08:03.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.047+0000 7f4f037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:03.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.047+0000 7f4f037fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:08:03.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.047+0000 7f4f037fe640 10 monclient: dump: 2024-08-18T21:08:03.059 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:03.059 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:03.059 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:03.060 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:03.060 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:03.060 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:03.060 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:03.060 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:03.060 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:03.060 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:03.060 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:03.060 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:03.060 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:03.060 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:03.060 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:03.060 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:03.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f037fe640 1 -- 172.21.15.5:0/2270837559 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9204 (secure 0 0 0) 0x7f4f0c010480 con 0x7f4f1c1d1c80 2024-08-18T21:08:03.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f037fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:03.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f037fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:03.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f037fe640 1 -- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c1d1c80 msgr2=0x7f4f1c1d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:03.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f037fe640 1 --2- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c1d1c80 0x7f4f1c1d2090 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00b450 tx=0x7f4f0c0059e0 comp rx=0 tx=0).stop 2024-08-18T21:08:03.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f037fe640 1 -- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c1d1c80 msgr2=0x7f4f1c1d2090 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:03.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f037fe640 1 --2- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4f1c1d1c80 0x7f4f1c1d2090 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00b450 tx=0x7f4f0c0059e0 comp rx=0 tx=0).stop 2024-08-18T21:08:03.061 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:03.061 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:03.061 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:03.062 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:03.062 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 100, 2024-08-18T21:08:03.062 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 292148, 2024-08-18T21:08:03.062 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:03.062 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:03.062 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:03.062 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:03.062 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:03.062 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:03.063 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:03.063 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 9, 2024-08-18T21:08:03.063 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:03.063 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:03.063 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:03.063 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:03.063 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:03.063 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:03.063 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:03.063 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:03.063 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:03.063 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:03.064 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:03.064 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:03.064 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:03.064 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:03.064 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:03.064 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:03.064 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:03.064 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:03.064 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:03.064 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:03.064 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:03.064 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:03.064 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:03.065 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:03.065 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:03.065 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:03.065 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:03.065 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:03.065 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:03.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.065 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:03.065 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:03.065 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:03.065 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:03.065 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:03.065 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:03.066 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:03.066 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:03.066 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:03.066 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:03.066 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:03.066 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:03.066 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:03.066 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:03.066 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:03.066 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:03.066 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:03.066 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:03.066 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:03.067 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:03.067 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:03.067 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:03.067 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:03.067 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:03.067 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:03.067 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:03.067 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:03.067 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:03.067 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:03.067 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:03.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.067 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:03.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.068 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:03.068 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:03.068 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:03.068 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:03.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.068 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:03.068 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:03.068 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.068 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:03.068 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:03.068 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.069 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:03.069 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:03.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.069 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:03.069 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:03.069 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:03.069 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:03.069 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:03.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.070 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:03.070 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:03.070 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:03.070 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:03.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.070 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:03.070 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:03.070 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.070 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:03.070 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:03.071 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.071 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:03.071 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:03.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.071 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:03.071 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:03.071 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:03.071 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:03.071 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:03.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.071 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:03.072 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:03.072 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:03.072 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:03.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.072 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:03.072 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:03.072 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.072 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:03.073 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:03.073 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.073 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:03.073 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:03.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.073 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:03.073 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:03.073 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:03.073 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:03.073 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:03.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.073 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:03.074 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:03.074 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:03.074 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:03.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.074 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:03.074 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:03.074 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.074 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:03.074 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:03.075 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.075 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:03.075 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:03.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.075 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:03.075 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:03.075 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:03.075 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:03.075 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:03.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.075 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:03.075 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:03.076 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:03.076 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:03.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.076 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:03.076 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:03.076 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.076 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:03.076 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:03.076 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.076 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:03.076 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:03.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.077 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:03.077 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:03.077 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:03.077 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:03.077 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:03.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.077 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:03.077 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:03.077 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:03.077 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:03.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.077 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:03.078 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:03.078 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.078 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:03.078 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:03.078 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.078 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:03.078 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:03.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.078 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:03.078 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:03.078 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:03.078 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:03.079 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:03.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.079 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:03.079 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:03.079 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:03.079 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:03.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.079 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:03.079 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:03.079 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.080 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:03.080 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:03.080 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.080 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:03.080 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:03.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.080 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:03.080 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:03.080 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:03.080 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:03.080 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:03.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.081 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:03.081 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:03.081 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:03.081 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:03.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.081 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:03.081 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:03.081 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.081 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:03.081 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:03.082 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.082 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:03.082 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:03.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.082 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:03.082 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:03.082 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:03.082 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:03.082 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:03.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.082 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:03.082 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:03.083 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:03.083 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:03.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.083 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:03.083 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:03.083 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.083 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:03.083 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:03.083 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:03.083 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:03.083 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:03.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.084 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:03.084 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:03.084 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:03.084 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:03.084 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:03.084 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:03.084 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:03.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.084 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:03.084 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:03.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.085 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:03.085 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:03.085 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:03.085 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:03.085 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:03.085 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:03.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:03.085 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:03.085 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:03.085 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:08:03.085 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:03.085 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:03.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:03.086 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:03.086 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:03.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f217f7640 1 -- 172.21.15.5:0/2270837559 >> v2:172.21.15.157:6812/631023601 conn(0x7f4f0803bdc0 msgr2=0x7f4f0803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:03.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f217f7640 1 --2- 172.21.15.5:0/2270837559 >> v2:172.21.15.157:6812/631023601 conn(0x7f4f0803bdc0 0x7f4f0803e280 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009fd0 tx=0x7f4f1400b040 comp rx=0 tx=0).stop 2024-08-18T21:08:03.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f217f7640 10 monclient: shutdown 2024-08-18T21:08:03.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f217f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:03.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f217f7640 1 -- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4f1c0a6370 msgr2=0x7f4f1c13be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:03.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f217f7640 1 --2- 172.21.15.5:0/2270837559 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4f1c0a6370 0x7f4f1c13be90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4f100097c0 tx=0x7f4f10019200 comp rx=0 tx=0).stop 2024-08-18T21:08:03.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f1b7fe640 1 -- 172.21.15.5:0/2270837559 reap_dead start 2024-08-18T21:08:03.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f1b7fe640 1 -- 172.21.15.5:0/2270837559 reap_dead start 2024-08-18T21:08:03.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f217f7640 1 -- 172.21.15.5:0/2270837559 shutdown_connections 2024-08-18T21:08:03.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f217f7640 1 -- 172.21.15.5:0/2270837559 >> 172.21.15.5:0/2270837559 conn(0x7f4f1c0aa700 msgr2=0x7f4f1c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:03.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f217f7640 1 -- 172.21.15.5:0/2270837559 shutdown_connections 2024-08-18T21:08:03.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:03.051+0000 7f4f217f7640 1 -- 172.21.15.5:0/2270837559 wait complete. 2024-08-18T21:08:03.088 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:08:03.088 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-18T21:08:03.882 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:03.882 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29417]: starting. 2024-08-18T21:08:03.882 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29417]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29380 2024-08-18T21:08:03.882 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29417]: created object 0... 2024-08-18T21:08:03.883 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29417]: created object 25... 2024-08-18T21:08:03.883 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29417]: created object 49... 2024-08-18T21:08:03.883 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29417]: finishing. 2024-08-18T21:08:03.883 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29417]: shutting down. 2024-08-18T21:08:04.781 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:04.781 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29419]: starting. 2024-08-18T21:08:04.781 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29419]: listing objects. 2024-08-18T21:08:04.781 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29419]: listed object 0... 2024-08-18T21:08:04.782 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29419]: listed object 25... 2024-08-18T21:08:04.782 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29419]: saw 50 objects 2024-08-18T21:08:04.782 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29419]: shutting down. 2024-08-18T21:08:05.863 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:05.863 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29418]: starting. 2024-08-18T21:08:05.863 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29418]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29380 2024-08-18T21:08:05.863 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29418]: shutting down. 2024-08-18T21:08:05.866 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:05.866 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:05.866 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:08:05.869 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:08:08.513 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29473]: starting. 2024-08-18T21:08:08.514 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29473]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29472 2024-08-18T21:08:08.514 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29473]: created object 0... 2024-08-18T21:08:08.514 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29473]: created object 25... 2024-08-18T21:08:08.514 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29473]: created object 49... 2024-08-18T21:08:08.514 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29473]: finishing. 2024-08-18T21:08:08.514 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29473]: shutting down. 2024-08-18T21:08:09.282 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29474]: starting. 2024-08-18T21:08:09.282 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29474]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29472 2024-08-18T21:08:09.282 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29474]: shutting down. 2024-08-18T21:08:11.530 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:11.530 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29509]: starting. 2024-08-18T21:08:11.530 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29509]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29472 2024-08-18T21:08:11.530 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29509]: created object 0... 2024-08-18T21:08:11.530 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29509]: created object 25... 2024-08-18T21:08:11.530 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29509]: created object 49... 2024-08-18T21:08:11.530 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29509]: finishing. 2024-08-18T21:08:11.530 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29509]: shutting down. 2024-08-18T21:08:11.590 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:11.591 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29511]: starting. 2024-08-18T21:08:11.591 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29511]: listing objects. 2024-08-18T21:08:11.591 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29511]: listed object 0... 2024-08-18T21:08:11.591 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29511]: listed object 25... 2024-08-18T21:08:11.591 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29511]: saw 50 objects 2024-08-18T21:08:11.591 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29511]: shutting down. 2024-08-18T21:08:12.845 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:12.845 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29510]: starting. 2024-08-18T21:08:12.845 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29510]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29472 2024-08-18T21:08:12.845 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29510]: shutting down. 2024-08-18T21:08:12.850 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:12.850 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:12.850 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:08:12.853 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:08:15.179 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29566]: starting. 2024-08-18T21:08:15.180 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29566]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29565 2024-08-18T21:08:15.180 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29566]: created object 0... 2024-08-18T21:08:15.180 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29566]: created object 25... 2024-08-18T21:08:15.180 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29566]: created object 49... 2024-08-18T21:08:15.180 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29566]: finishing. 2024-08-18T21:08:15.180 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29566]: shutting down. 2024-08-18T21:08:16.823 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29567]: starting. 2024-08-18T21:08:16.824 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29567]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29565 2024-08-18T21:08:16.824 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29567]: shutting down. 2024-08-18T21:08:19.571 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:19.571 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29602]: starting. 2024-08-18T21:08:19.571 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29602]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29565 2024-08-18T21:08:19.571 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29602]: created object 0... 2024-08-18T21:08:19.571 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29602]: created object 25... 2024-08-18T21:08:19.571 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29602]: created object 49... 2024-08-18T21:08:19.571 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29602]: finishing. 2024-08-18T21:08:19.571 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29602]: shutting down. 2024-08-18T21:08:20.473 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:20.473 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29604]: starting. 2024-08-18T21:08:20.473 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29604]: listing objects. 2024-08-18T21:08:20.473 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29604]: listed object 0... 2024-08-18T21:08:20.474 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29604]: listed object 25... 2024-08-18T21:08:20.474 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29604]: saw 50 objects 2024-08-18T21:08:20.474 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29604]: shutting down. 2024-08-18T21:08:21.561 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:21.561 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29603]: starting. 2024-08-18T21:08:21.561 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29603]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29565 2024-08-18T21:08:21.561 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29603]: shutting down. 2024-08-18T21:08:21.563 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:21.563 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:21.563 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:08:21.566 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:08:23.089 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-18T21:08:23.089 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-18T21:08:23.089 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-18T21:08:23.092 INFO:tasks.ceph.mon.a:Started 2024-08-18T21:08:23.092 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.g 2024-08-18T21:08:23.092 INFO:tasks.ceph.mon.g:Restarting daemon 2024-08-18T21:08:23.093 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-08-18T21:08:23.095 INFO:tasks.ceph.mon.g:Started 2024-08-18T21:08:23.095 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2024-08-18T21:08:23.095 INFO:tasks.ceph.mon.d:Restarting daemon 2024-08-18T21:08:23.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-08-18T21:08:23.098 INFO:tasks.ceph.mon.d:Started 2024-08-18T21:08:23.098 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-08-18T21:08:23.098 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-18T21:08:23.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-18T21:08:23.100 INFO:tasks.ceph.mon.b:Started 2024-08-18T21:08:23.100 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:08:23.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:08:23.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 10 monclient: get_monmap_and_config 2024-08-18T21:08:23.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 10 monclient: build_initial_monmap 2024-08-18T21:08:23.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 10 monclient: monmap: 2024-08-18T21:08:23.225 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:23.226309+0000 2024-08-18T21:08:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:23.226309+0000 2024-08-18T21:08:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:23.227 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:23.227 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:23.227 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:23.227 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:23.227 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:23.227 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:23.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 1 Processor -- start 2024-08-18T21:08:23.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 1 -- start start 2024-08-18T21:08:23.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 10 monclient: init 2024-08-18T21:08:23.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:23.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 10 monclient: _add_conns ranks=[10,4,7,3,9,8,0,1,5,6,2] 2024-08-18T21:08:23.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdb140a4a40 0x7fdb140a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:23.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 10 monclient(hunting): picked mon.noname-f con 0x7fdb140a4a40 addr v2:172.21.15.157:3300/0 2024-08-18T21:08:23.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdb140a4e20 0x7fdb140a5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:23.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 10 monclient(hunting): picked mon.noname-c con 0x7fdb140a4e20 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:23.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdb14137800 0x7fdb14137c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:23.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 10 monclient(hunting): picked mon.noname-i con 0x7fdb14137800 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:23.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:23.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fdb1406cd90 con 0x7fdb140a4a40 2024-08-18T21:08:23.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:23.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fdb140a0930 con 0x7fdb140a4e20 2024-08-18T21:08:23.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:23.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fdb140a11d0 con 0x7fdb14137800 2024-08-18T21:08:23.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:23.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb195f8640 10 monclient(hunting): authenticate will time out at 1270.239078s 2024-08-18T21:08:23.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdb140a4e20 0x7fdb140a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:23.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb12ffd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdb140a4a40 0x7fdb140a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:23.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb12ffd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdb140a4a40 0x7fdb140a1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:38020/0 (socket says 172.21.15.5:38020) 2024-08-18T21:08:23.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb137fe640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdb14137800 0x7fdb14137c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:23.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb12ffd640 1 -- 172.21.15.5:0/1711268819 learned_addr learned my addr 172.21.15.5:0/1711268819 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:23.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb12ffd640 10 monclient(hunting): get_auth_request con 0x7fdb140a4a40 auth_method 0 2024-08-18T21:08:23.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb12ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:23.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb12ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:23.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb12ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:23.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 10 monclient(hunting): get_auth_request con 0x7fdb140a4e20 auth_method 0 2024-08-18T21:08:23.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:23.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:23.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:23.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb137fe640 10 monclient(hunting): get_auth_request con 0x7fdb14137800 auth_method 0 2024-08-18T21:08:23.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:23.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb137fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:23.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb137fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:23.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:23.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:23.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:23.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:23.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:23.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb12ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb12ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb12ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 10 monclient(hunting): handle_auth_done global_id 5683 payload 274 2024-08-18T21:08:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 1 -- 172.21.15.5:0/1711268819 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdb14137800 msgr2=0x7fdb14137c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 1 --2- 172.21.15.5:0/1711268819 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdb14137800 0x7fdb14137c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 1 -- 172.21.15.5:0/1711268819 >> v2:172.21.15.157:3300/0 conn(0x7fdb140a4a40 msgr2=0x7fdb140a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 1 --2- 172.21.15.5:0/1711268819 >> v2:172.21.15.157:3300/0 conn(0x7fdb140a4a40 0x7fdb140a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 10 monclient: _finish_hunting 0 2024-08-18T21:08:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 1 monclient: found mon.noname-c 2024-08-18T21:08:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:08:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.222+0000 7fdb127fc640 1 -- 172.21.15.5:0/1711268819 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1406cb10 con 0x7fdb140a4e20 2024-08-18T21:08:23.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.226+0000 7fdb127fc640 1 -- 172.21.15.5:0/1711268819 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdb140a4e20 msgr2=0x7fdb140a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:23.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.226+0000 7fdb127fc640 1 --2- 172.21.15.5:0/1711268819 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdb140a4e20 0x7fdb140a5200 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdb080097c0 tx=0x7fdb0801c360 comp rx=0 tx=0).ready entity=mon.4 client_cookie=c71ccceacb329803 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:23.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb11ffb640 1 -- 172.21.15.5:0/1711268819 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdb080b0070 con 0x7fdb140a4e20 2024-08-18T21:08:23.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:23.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb11ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:08:23.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb11ffb640 10 monclient: dump: 2024-08-18T21:08:23.242 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:23.242 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:23.242 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:23.242 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:23.242 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:23.243 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:23.243 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:23.243 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:23.243 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:23.243 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:23.243 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:23.243 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:23.243 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:23.243 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:23.243 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:23.244 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:23.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb11ffb640 10 monclient: _finish_auth 0 2024-08-18T21:08:23.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb11ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:08:23.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb11ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:23.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb11ffb640 1 -- 172.21.15.5:0/1711268819 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb080aa810 con 0x7fdb140a4e20 2024-08-18T21:08:23.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb11ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:23.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb11ffb640 1 -- 172.21.15.5:0/1711268819 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdb080aae30 con 0x7fdb140a4e20 2024-08-18T21:08:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 5 monclient: authenticate success, global_id 5683 2024-08-18T21:08:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 4 set_mon_vals no callback set 2024-08-18T21:08:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb11ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:08:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb11ffb640 10 monclient: dump: 2024-08-18T21:08:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:23.246 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 10 monclient: shutdown 2024-08-18T21:08:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 -- 172.21.15.5:0/1711268819 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdb140a4e20 msgr2=0x7fdb140a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 --2- 172.21.15.5:0/1711268819 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdb140a4e20 0x7fdb140a5200 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdb080097c0 tx=0x7fdb0801c360 comp rx=0 tx=0).stop 2024-08-18T21:08:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 -- 172.21.15.5:0/1711268819 shutdown_connections 2024-08-18T21:08:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 --2- 172.21.15.5:0/1711268819 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdb14137800 0x7fdb14137c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 --2- 172.21.15.5:0/1711268819 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdb140a4e20 0x7fdb140a5200 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 --2- 172.21.15.5:0/1711268819 >> v2:172.21.15.157:3300/0 conn(0x7fdb140a4a40 0x7fdb140a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 -- 172.21.15.5:0/1711268819 >> 172.21.15.5:0/1711268819 conn(0x7fdb14068700 msgr2=0x7fdb14068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 -- 172.21.15.5:0/1711268819 shutdown_connections 2024-08-18T21:08:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 -- 172.21.15.5:0/1711268819 wait complete. 2024-08-18T21:08:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 10 monclient: build_initial_monmap 2024-08-18T21:08:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 10 monclient: monmap: 2024-08-18T21:08:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:23.248 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 Processor -- start 2024-08-18T21:08:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 -- start start 2024-08-18T21:08:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 10 monclient: init 2024-08-18T21:08:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 10 monclient: _add_conns ranks=[7,2,5,4,3,8,1,6,0] 2024-08-18T21:08:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdb140a4a40 0x7fdb14133720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 10 monclient(hunting): picked mon.noname-i con 0x7fdb140a4a40 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdb140a4e20 0x7fdb14133c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 10 monclient(hunting): picked mon.noname-b con 0x7fdb140a4e20 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:08:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb14137800 0x7fdb14071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 10 monclient(hunting): picked mon.noname-h con 0x7fdb14137800 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fdb141413f0 con 0x7fdb140a4e20 2024-08-18T21:08:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdb14141270 con 0x7fdb14137800 2024-08-18T21:08:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fdb14141570 con 0x7fdb140a4a40 2024-08-18T21:08:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb195f8640 10 monclient(hunting): authenticate will time out at 1270.246315s 2024-08-18T21:08:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb127fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdb140a4e20 0x7fdb14133c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb127fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdb140a4e20 0x7fdb14133c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:53158/0 (socket says 172.21.15.5:53158) 2024-08-18T21:08:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb127fc640 1 -- 172.21.15.5:0/1737694518 learned_addr learned my addr 172.21.15.5:0/1737694518 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb127fc640 10 monclient(hunting): get_auth_request con 0x7fdb140a4e20 auth_method 0 2024-08-18T21:08:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb127fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb127fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb127fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb127fc640 1 -- 172.21.15.5:0/1737694518 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdb140a4e20 msgr2=0x7fdb14133c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-18T21:08:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb127fc640 1 -- 172.21.15.5:0/1737694518 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdb140a4e20 msgr2=0x7fdb14133c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:08:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb127fc640 1 --2- 172.21.15.5:0/1737694518 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdb140a4e20 0x7fdb14133c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:08:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb127fc640 1 --2- 172.21.15.5:0/1737694518 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdb140a4e20 0x7fdb14133c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb137fe640 1 --2- 172.21.15.5:0/1737694518 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb14137800 0x7fdb14071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 1 --2- 172.21.15.5:0/1737694518 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdb140a4a40 0x7fdb14133720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 10 monclient(hunting): get_auth_request con 0x7fdb140a4a40 auth_method 0 2024-08-18T21:08:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb137fe640 10 monclient(hunting): get_auth_request con 0x7fdb14137800 auth_method 0 2024-08-18T21:08:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb137fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb137fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 10 monclient(hunting): handle_auth_done global_id 5515 payload 824 2024-08-18T21:08:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 1 -- 172.21.15.5:0/1737694518 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb14137800 msgr2=0x7fdb14071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 1 --2- 172.21.15.5:0/1737694518 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb14137800 0x7fdb14071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 1 -- 172.21.15.5:0/1737694518 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdb140a4e20 msgr2=0x7fdb14133c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:08:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 1 --2- 172.21.15.5:0/1737694518 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdb140a4e20 0x7fdb14133c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:08:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 1 monclient: found mon.noname-i 2024-08-18T21:08:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:08:23.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.230+0000 7fdb12ffd640 1 -- 172.21.15.5:0/1737694518 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb14121100 con 0x7fdb140a4a40 2024-08-18T21:08:23.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdb12ffd640 1 -- 172.21.15.5:0/1737694518 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdb140a4a40 msgr2=0x7fdb14133720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:23.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdb12ffd640 1 --2- 172.21.15.5:0/1737694518 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdb140a4a40 0x7fdb14133720 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400e870 tx=0x7fdb0400ed30 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:23.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdafb7fe640 1 -- 172.21.15.5:0/1737694518 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdb04017070 con 0x7fdb140a4a40 2024-08-18T21:08:23.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdafb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:23.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdafb7fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:08:23.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdafb7fe640 10 monclient: dump: 2024-08-18T21:08:23.253 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:23.253 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:23.253 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:23.253 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:23.255 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdafb7fe640 10 monclient: _finish_auth 0 2024-08-18T21:08:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdafb7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:08:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdafb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdafb7fe640 1 -- 172.21.15.5:0/1737694518 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb04009e50 con 0x7fdb140a4a40 2024-08-18T21:08:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdb195f8640 5 monclient: authenticate success, global_id 5515 2024-08-18T21:08:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdb195f8640 10 monclient: _renew_subs 2024-08-18T21:08:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdb195f8640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:08:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdb195f8640 1 -- 172.21.15.5:0/1737694518 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb14068ae0 con 0x7fdb140a4a40 2024-08-18T21:08:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdafb7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdafb7fe640 1 -- 172.21.15.5:0/1737694518 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdb040138e0 con 0x7fdb140a4a40 2024-08-18T21:08:23.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdafb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:23.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdafb7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:08:23.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdafb7fe640 10 monclient: dump: 2024-08-18T21:08:23.256 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:23.256 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:23.256 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:23.256 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:23.256 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:23.256 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:23.256 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:23.256 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:23.256 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:23.256 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:23.257 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdb195f8640 10 monclient: _renew_subs 2024-08-18T21:08:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdb195f8640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:08:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdb195f8640 1 -- 172.21.15.5:0/1737694518 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb14120e20 con 0x7fdb140a4a40 2024-08-18T21:08:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdb10ff9640 4 set_mon_vals no callback set 2024-08-18T21:08:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdb195f8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdb195f8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdb195f8640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:08:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdb195f8640 1 -- 172.21.15.5:0/1737694518 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb140a5200 con 0x7fdb140a4a40 2024-08-18T21:08:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdafb7fe640 1 -- 172.21.15.5:0/1737694518 <== mon.7 v2:172.21.15.157:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fdb0401a070 con 0x7fdb140a4a40 2024-08-18T21:08:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdafb7fe640 1 --2- 172.21.15.5:0/1737694518 >> v2:172.21.15.157:6812/631023601 conn(0x7fdb0003bdf0 0x7fdb0003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdafb7fe640 1 -- 172.21.15.5:0/1737694518 <== mon.7 v2:172.21.15.157:3303/0 5 ==== osd_map(137..137 src has 22..137) ==== 3898+0+0 (secure 0 0 0) 0x7fdb0400f040 con 0x7fdb140a4a40 2024-08-18T21:08:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdb127fc640 1 --2- 172.21.15.5:0/1737694518 >> v2:172.21.15.157:6812/631023601 conn(0x7fdb0003bdf0 0x7fdb0003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.234+0000 7fdb127fc640 10 monclient: get_auth_request con 0x7fdb0003bdf0 auth_method 0 2024-08-18T21:08:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.238+0000 7fdb127fc640 1 --2- 172.21.15.5:0/1737694518 >> v2:172.21.15.157:6812/631023601 conn(0x7fdb0003bdf0 0x7fdb0003e2b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdb0801cc00 tx=0x7fdb080a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.238+0000 7fdafb7fe640 1 -- 172.21.15.5:0/1737694518 <== mon.7 v2:172.21.15.157:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fdb04011350 con 0x7fdb140a4a40 2024-08-18T21:08:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.238+0000 7fdafb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:23.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.238+0000 7fdafb7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.482+0000 7fdb195f8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:08:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.482+0000 7fdb195f8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:08:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.482+0000 7fdb195f8640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:08:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:23.482+0000 7fdb195f8640 1 -- 172.21.15.5:0/1737694518 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdb1406e260 con 0x7fdb140a4a40 2024-08-18T21:08:26.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:26.230+0000 7fdafa7fc640 10 monclient: tick 2024-08-18T21:08:26.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:26.230+0000 7fdafa7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:08:26.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:26.230+0000 7fdafa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:26.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:26.230+0000 7fdafa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:27.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:27.230+0000 7fdafa7fc640 10 monclient: tick 2024-08-18T21:08:27.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:27.230+0000 7fdafa7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:08:27.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:27.230+0000 7fdafa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:28.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.230+0000 7fdafa7fc640 10 monclient: tick 2024-08-18T21:08:28.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.230+0000 7fdafa7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:08:28.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.230+0000 7fdafa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:28.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.434+0000 7fdafb7fe640 1 -- 172.21.15.5:0/1737694518 <== mon.7 v2:172.21.15.157:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3155 (secure 0 0 0) 0x7fdb0401be20 con 0x7fdb140a4a40 2024-08-18T21:08:28.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.434+0000 7fdafb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:08:28.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.434+0000 7fdafb7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:28.440 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":106,"quorum":[1,4,5,6,7,8],"quorum_names":["f","c","h","d","i","e"],"quorum_leader_name":"f","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:08:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.438+0000 7fdb195f8640 1 -- 172.21.15.5:0/1737694518 >> v2:172.21.15.157:6812/631023601 conn(0x7fdb0003bdf0 msgr2=0x7fdb0003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.438+0000 7fdb195f8640 1 --2- 172.21.15.5:0/1737694518 >> v2:172.21.15.157:6812/631023601 conn(0x7fdb0003bdf0 0x7fdb0003e2b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdb0801cc00 tx=0x7fdb080a6000 comp rx=0 tx=0).stop 2024-08-18T21:08:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.438+0000 7fdb195f8640 10 monclient: shutdown 2024-08-18T21:08:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.438+0000 7fdb195f8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.438+0000 7fdb195f8640 1 -- 172.21.15.5:0/1737694518 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdb140a4a40 msgr2=0x7fdb14133720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.438+0000 7fdb195f8640 1 --2- 172.21.15.5:0/1737694518 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdb140a4a40 0x7fdb14133720 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400e870 tx=0x7fdb0400ed30 comp rx=0 tx=0).stop 2024-08-18T21:08:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.438+0000 7fdb195f8640 1 -- 172.21.15.5:0/1737694518 shutdown_connections 2024-08-18T21:08:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.438+0000 7fdb195f8640 1 --2- 172.21.15.5:0/1737694518 >> v2:172.21.15.157:6812/631023601 conn(0x7fdb0003bdf0 0x7fdb0003e2b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.438+0000 7fdb195f8640 1 --2- 172.21.15.5:0/1737694518 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdb14137800 0x7fdb14071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.438+0000 7fdb195f8640 1 --2- 172.21.15.5:0/1737694518 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdb140a4e20 0x7fdb14133c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.438+0000 7fdb195f8640 1 --2- 172.21.15.5:0/1737694518 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdb140a4a40 0x7fdb14133720 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.438+0000 7fdb195f8640 1 -- 172.21.15.5:0/1737694518 >> 172.21.15.5:0/1737694518 conn(0x7fdb14068700 msgr2=0x7fdb1413d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.438+0000 7fdb195f8640 1 -- 172.21.15.5:0/1737694518 shutdown_connections 2024-08-18T21:08:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:28.442+0000 7fdb195f8640 1 -- 172.21.15.5:0/1737694518 wait complete. 2024-08-18T21:08:28.737 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29657]: starting. 2024-08-18T21:08:28.737 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29657]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29656 2024-08-18T21:08:28.737 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29657]: created object 0... 2024-08-18T21:08:28.737 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29657]: created object 25... 2024-08-18T21:08:28.738 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29657]: created object 49... 2024-08-18T21:08:28.738 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29657]: finishing. 2024-08-18T21:08:28.738 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29657]: shutting down. 2024-08-18T21:08:31.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:08:31.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 10 monclient: get_monmap_and_config 2024-08-18T21:08:31.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 10 monclient: build_initial_monmap 2024-08-18T21:08:31.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 10 monclient: monmap: 2024-08-18T21:08:31.597 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:31.597 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:31.597 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:31.597800+0000 2024-08-18T21:08:31.597 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:31.597800+0000 2024-08-18T21:08:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:31.599 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 1 Processor -- start 2024-08-18T21:08:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 1 -- start start 2024-08-18T21:08:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 10 monclient: init 2024-08-18T21:08:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 10 monclient: _add_conns ranks=[10,0,3,8,5,9,1,4,6,2,7] 2024-08-18T21:08:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 0x7f6c3c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 10 monclient(hunting): picked mon.noname-f con 0x7f6c3c0a6ce0 addr v2:172.21.15.157:3300/0 2024-08-18T21:08:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6c3c0a7600 addr v1:172.21.15.5:6789/0 2024-08-18T21:08:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 0x7f6c3c141f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 10 monclient(hunting): picked mon.noname-g con 0x7f6c3c13a1b0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c3c0a4560 con 0x7f6c3c0a7600 2024-08-18T21:08:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f6c3c0a4310 con 0x7f6c3c0a6ce0 2024-08-18T21:08:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6c3c0a32f0 con 0x7f6c3c13a1b0 2024-08-18T21:08:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c4413c640 10 monclient(hunting): authenticate will time out at 1278.611082s 2024-08-18T21:08:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c416d7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6c3c0a7600 0x7f6c3c139aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39722/0 (socket says 172.21.15.5:39722) 2024-08-18T21:08:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c416d7640 1 -- 172.21.15.5:0/3160239657 learned_addr learned my addr 172.21.15.5:0/3160239657 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:08:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c41ed8640 1 --2- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 0x7f6c3c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c41ed8640 10 monclient(hunting): get_auth_request con 0x7f6c3c0a6ce0 auth_method 0 2024-08-18T21:08:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c41ed8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c41ed8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c41ed8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 0x7f6c3c141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c426d9640 10 monclient(hunting): get_auth_request con 0x7f6c3c13a1b0 auth_method 0 2024-08-18T21:08:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c426d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c426d9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c426d9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c41ed8640 1 -- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 msgr2=0x7f6c3c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:08:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c41ed8640 1 -- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 msgr2=0x7f6c3c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:08:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c41ed8640 1 --2- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 0x7f6c3c0a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:08:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c41ed8640 1 --2- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 0x7f6c3c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c426d9640 1 -- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 msgr2=0x7f6c3c141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:08:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c426d9640 1 -- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 msgr2=0x7f6c3c141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:08:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 0x7f6c3c141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:08:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.594+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 0x7f6c3c141f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.598+0000 7f6c416d7640 1 -- 172.21.15.5:0/3160239657 >> v1:172.21.15.5:6789/0 conn(0x7f6c3c0a7600 legacy=0x7f6c3c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:31.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 0x7f6c3c141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:31.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c426d9640 10 monclient(hunting): get_auth_request con 0x7f6c3c13a1b0 auth_method 0 2024-08-18T21:08:31.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c426d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:31.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c426d9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:31.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c426d9640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:08:31.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c426d9640 1 -- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 msgr2=0x7f6c3c141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:08:31.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c426d9640 1 -- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 msgr2=0x7f6c3c141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:08:31.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 0x7f6c3c141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:08:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 0x7f6c3c141f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:08:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c41ed8640 1 --2- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 0x7f6c3c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c41ed8640 10 monclient(hunting): get_auth_request con 0x7f6c3c0a6ce0 auth_method 0 2024-08-18T21:08:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c41ed8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c41ed8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c41ed8640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:08:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c41ed8640 1 -- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 msgr2=0x7f6c3c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:08:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c41ed8640 1 -- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 msgr2=0x7f6c3c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:08:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c41ed8640 1 --2- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 0x7f6c3c0a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:08:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:31.798+0000 7f6c41ed8640 1 --2- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 0x7f6c3c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:08:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c41ed8640 1 --2- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 0x7f6c3c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c41ed8640 10 monclient(hunting): get_auth_request con 0x7f6c3c0a6ce0 auth_method 0 2024-08-18T21:08:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c41ed8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c41ed8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c41ed8640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:08:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c41ed8640 1 -- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 msgr2=0x7f6c3c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:08:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c41ed8640 1 -- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 msgr2=0x7f6c3c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:08:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c41ed8640 1 --2- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 0x7f6c3c0a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:08:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c41ed8640 1 --2- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 0x7f6c3c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:08:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 0x7f6c3c141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c426d9640 10 monclient(hunting): get_auth_request con 0x7f6c3c13a1b0 auth_method 0 2024-08-18T21:08:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c426d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c426d9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c426d9640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:08:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c426d9640 1 -- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 msgr2=0x7f6c3c141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:08:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c426d9640 1 -- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 msgr2=0x7f6c3c141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:08:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 0x7f6c3c141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:08:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:32.202+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 0x7f6c3c141f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:08:33.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c41ed8640 1 --2- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 0x7f6c3c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:33.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c41ed8640 10 monclient(hunting): get_auth_request con 0x7f6c3c0a6ce0 auth_method 0 2024-08-18T21:08:33.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c41ed8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:33.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c41ed8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:33.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c41ed8640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:08:33.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c41ed8640 1 -- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 msgr2=0x7f6c3c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:08:33.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c41ed8640 1 -- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 msgr2=0x7f6c3c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:08:33.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c41ed8640 1 --2- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 0x7f6c3c0a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:08:33.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c41ed8640 1 --2- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 0x7f6c3c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:08:33.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 0x7f6c3c141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:33.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c426d9640 10 monclient(hunting): get_auth_request con 0x7f6c3c13a1b0 auth_method 0 2024-08-18T21:08:33.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c426d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:33.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c426d9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:33.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c426d9640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:08:33.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c426d9640 1 -- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 msgr2=0x7f6c3c141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:08:33.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c426d9640 1 -- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 msgr2=0x7f6c3c141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:08:33.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 0x7f6c3c141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:08:33.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.006+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 0x7f6c3c141f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:08:33.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.170+0000 7f6c416d7640 1 -- 172.21.15.5:0/3160239657 >> v1:172.21.15.5:6789/0 conn(0x7f6c3c0a7600 legacy=0x7f6c3c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-08-18T21:08:33.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.170+0000 7f6c416d7640 1 -- 172.21.15.5:0/3160239657 >> v1:172.21.15.5:6789/0 conn(0x7f6c3c0a7600 legacy=0x7f6c3c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:08:33.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.170+0000 7f6c416d7640 1 --1- 172.21.15.5:0/3160239657 >> v1:172.21.15.5:6789/0 conn(0x7f6c3c0a7600 0x7f6c3c139aa0 :-1 s=OPENED pgs=70 cs=1 l=1).handle_message read tag failed 2024-08-18T21:08:33.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.170+0000 7f6c416d7640 1 --1- 172.21.15.5:0/3160239657 >> v1:172.21.15.5:6789/0 conn(0x7f6c3c0a7600 0x7f6c3c139aa0 :-1 s=OPENED pgs=70 cs=1 l=1).fault on lossy channel, failing 2024-08-18T21:08:33.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:33.170+0000 7f6c40ed6640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.5:6789/0 2024-08-18T21:08:34.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 10 monclient(hunting): tick 2024-08-18T21:08:34.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:08:34.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 1 monclient(hunting): continuing hunt 2024-08-18T21:08:34.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:08:34.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 1 -- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 msgr2=0x7f6c3c141f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:08:34.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c3c13a1b0 0x7f6c3c141f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:34.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 1 -- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 msgr2=0x7f6c3c0a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:08:34.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 1 --2- 172.21.15.5:0/3160239657 >> v2:172.21.15.157:3300/0 conn(0x7f6c3c0a6ce0 0x7f6c3c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:34.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 1 -- 172.21.15.5:0/3160239657 >> v1:172.21.15.5:6789/0 conn(0x7f6c3c0a7600 legacy=0x7f6c3c139aa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:34.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 10 monclient: _add_conns ranks=[1,5,6,8,9,7,2,4] 2024-08-18T21:08:34.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f6c20003760 addr v1:172.21.15.157:6789/0 2024-08-18T21:08:34.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6c20007370 0x7f6c20009800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:34.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 10 monclient(hunting): picked mon.noname-h con 0x7f6c20007370 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:34.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6c20009f00 0x7f6c2000c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:34.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 10 monclient(hunting): picked mon.noname-d con 0x7f6c20009f00 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:34.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 1 -- 172.21.15.5:0/3160239657 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c3c0a37e0 con 0x7f6c20003760 2024-08-18T21:08:34.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:34.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 1 -- 172.21.15.5:0/3160239657 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f6c3c0a4310 con 0x7f6c20007370 2024-08-18T21:08:34.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:34.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 1 -- 172.21.15.5:0/3160239657 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f6c2000db90 con 0x7f6c20009f00 2024-08-18T21:08:34.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c2f7fe640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:34.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6c20009f00 0x7f6c2000c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:34.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c426d9640 10 monclient(hunting): get_auth_request con 0x7f6c20009f00 auth_method 0 2024-08-18T21:08:34.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c426d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:34.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c426d9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:34.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c426d9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:34.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.594+0000 7f6c416d7640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6c20007370 0x7f6c20009800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:34.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c416d7640 10 monclient(hunting): get_auth_request con 0x7f6c20007370 auth_method 0 2024-08-18T21:08:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c416d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c416d7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c416d7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c426d9640 1 -- 172.21.15.5:0/3160239657 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6c20009f00 msgr2=0x7f6c2000c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:08:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c426d9640 1 -- 172.21.15.5:0/3160239657 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6c20009f00 msgr2=0x7f6c2000c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:08:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6c20009f00 0x7f6c2000c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:08:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6c20009f00 0x7f6c2000c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c416d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c416d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c416d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c416d7640 10 monclient(hunting): handle_auth_done global_id 35006 payload 274 2024-08-18T21:08:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c416d7640 1 -- 172.21.15.5:0/3160239657 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6c20009f00 msgr2=0x7f6c2000c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:08:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c416d7640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6c20009f00 0x7f6c2000c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c416d7640 1 -- 172.21.15.5:0/3160239657 >> v1:172.21.15.157:6789/0 conn(0x7f6c20003760 legacy=0x7f6c20005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:34.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c416d7640 10 monclient: _finish_hunting 0 2024-08-18T21:08:34.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c416d7640 1 monclient: found mon.noname-h 2024-08-18T21:08:34.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c426d9640 1 -- 172.21.15.5:0/3160239657 reap_dead start 2024-08-18T21:08:34.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c416d7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:34.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c416d7640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:08:34.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.598+0000 7f6c416d7640 1 -- 172.21.15.5:0/3160239657 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2000de50 con 0x7f6c20007370 2024-08-18T21:08:34.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c416d7640 1 -- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6c20007370 msgr2=0x7f6c20009800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:34.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c416d7640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6c20007370 0x7f6c20009800 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800c4b0 tx=0x7f6c3801cf30 comp rx=0 tx=0).ready entity=mon.5 client_cookie=d3a716732eccbfd5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:34.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c40ed6640 1 -- 172.21.15.5:0/3160239657 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6c380a5d30 con 0x7f6c20007370 2024-08-18T21:08:34.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c40ed6640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:34.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c40ed6640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:08:34.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c40ed6640 10 monclient: dump: 2024-08-18T21:08:34.610 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:34.610 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:34.610 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:34.610 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:34.610 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:34.610 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:34.610 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:34.610 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:34.610 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:34.610 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:34.610 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:34.611 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c40ed6640 10 monclient: _finish_auth 0 2024-08-18T21:08:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c40ed6640 10 monclient: _check_auth_tickets 2024-08-18T21:08:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c40ed6640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c40ed6640 1 -- 172.21.15.5:0/3160239657 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c380a9070 con 0x7f6c20007370 2024-08-18T21:08:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c40ed6640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c40ed6640 1 -- 172.21.15.5:0/3160239657 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6c38007950 con 0x7f6c20007370 2024-08-18T21:08:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c4413c640 5 monclient: authenticate success, global_id 35006 2024-08-18T21:08:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c4413c640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c4413c640 4 set_mon_vals no callback set 2024-08-18T21:08:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c40ed6640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c40ed6640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:08:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c40ed6640 10 monclient: dump: 2024-08-18T21:08:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:34.613 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:34.613 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:34.613 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:34.613 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:34.613 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c4413c640 10 monclient: shutdown 2024-08-18T21:08:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c4413c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c4413c640 1 -- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6c20007370 msgr2=0x7f6c20009800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c4413c640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6c20007370 0x7f6c20009800 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800c4b0 tx=0x7f6c3801cf30 comp rx=0 tx=0).stop 2024-08-18T21:08:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c4413c640 1 -- 172.21.15.5:0/3160239657 shutdown_connections 2024-08-18T21:08:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c4413c640 1 --2- 172.21.15.5:0/3160239657 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6c20007370 0x7f6c20009800 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c4413c640 1 -- 172.21.15.5:0/3160239657 >> 172.21.15.5:0/3160239657 conn(0x7f6c3c0accd0 msgr2=0x7f6c3c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c4413c640 1 -- 172.21.15.5:0/3160239657 shutdown_connections 2024-08-18T21:08:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.606+0000 7f6c4413c640 1 -- 172.21.15.5:0/3160239657 wait complete. 2024-08-18T21:08:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 10 monclient: build_initial_monmap 2024-08-18T21:08:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 10 monclient: monmap: 2024-08-18T21:08:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:34.618 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 1 Processor -- start 2024-08-18T21:08:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 1 -- start start 2024-08-18T21:08:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 10 monclient: init 2024-08-18T21:08:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 10 monclient: _add_conns ranks=[5,0,2,6,7,3,4,1,8] 2024-08-18T21:08:34.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6c20007370 0x7f6c3c122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:34.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 10 monclient(hunting): picked mon.noname-h con 0x7f6c20007370 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:34.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c3c137c40 0x7f6c3c1380a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:34.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 10 monclient(hunting): picked mon.noname-a con 0x7f6c3c137c40 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:08:34.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6c3c1d1850 0x7f6c3c1d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:34.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 10 monclient(hunting): picked mon.noname-b con 0x7f6c3c1d1850 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:08:34.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:34.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c0a81b0 con 0x7f6c3c137c40 2024-08-18T21:08:34.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:34.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f6c3c06f270 con 0x7f6c3c1d1850 2024-08-18T21:08:34.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:34.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f6c3c0a79e0 con 0x7f6c20007370 2024-08-18T21:08:34.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:34.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c4413c640 10 monclient(hunting): authenticate will time out at 1281.625766s 2024-08-18T21:08:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c416d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c3c137c40 0x7f6c3c1380a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c416d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c3c137c40 0x7f6c3c1380a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51726/0 (socket says 172.21.15.5:51726) 2024-08-18T21:08:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c416d7640 1 -- 172.21.15.5:0/3481470019 learned_addr learned my addr 172.21.15.5:0/3481470019 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c416d7640 10 monclient(hunting): get_auth_request con 0x7f6c3c137c40 auth_method 0 2024-08-18T21:08:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c416d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c416d7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c416d7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3481470019 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6c3c1d1850 0x7f6c3c1d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c426d9640 10 monclient(hunting): get_auth_request con 0x7f6c3c1d1850 auth_method 0 2024-08-18T21:08:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c426d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c426d9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c426d9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 1 --2- 172.21.15.5:0/3481470019 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6c20007370 0x7f6c3c122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c416d7640 1 -- 172.21.15.5:0/3481470019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c3c137c40 msgr2=0x7f6c3c1380a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-18T21:08:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c416d7640 1 -- 172.21.15.5:0/3481470019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c3c137c40 msgr2=0x7f6c3c1380a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:08:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c416d7640 1 --2- 172.21.15.5:0/3481470019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c3c137c40 0x7f6c3c1380a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:08:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 10 monclient(hunting): get_auth_request con 0x7f6c20007370 auth_method 0 2024-08-18T21:08:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c416d7640 1 --2- 172.21.15.5:0/3481470019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c3c137c40 0x7f6c3c1380a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c426d9640 1 -- 172.21.15.5:0/3481470019 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6c3c1d1850 msgr2=0x7f6c3c1d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-18T21:08:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c426d9640 1 -- 172.21.15.5:0/3481470019 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6c3c1d1850 msgr2=0x7f6c3c1d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:08:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3481470019 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6c3c1d1850 0x7f6c3c1d1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:08:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c426d9640 1 --2- 172.21.15.5:0/3481470019 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6c3c1d1850 0x7f6c3c1d1cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 10 monclient(hunting): handle_auth_done global_id 35015 payload 824 2024-08-18T21:08:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 1 -- 172.21.15.5:0/3481470019 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6c3c1d1850 msgr2=0x7f6c3c1d1cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:08:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 1 --2- 172.21.15.5:0/3481470019 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6c3c1d1850 0x7f6c3c1d1cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 1 -- 172.21.15.5:0/3481470019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c3c137c40 msgr2=0x7f6c3c1380a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:08:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 1 --2- 172.21.15.5:0/3481470019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c3c137c40 0x7f6c3c1380a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 10 monclient: _finish_hunting 0 2024-08-18T21:08:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 1 monclient: found mon.noname-h 2024-08-18T21:08:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:08:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.610+0000 7f6c41ed8640 1 -- 172.21.15.5:0/3481470019 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3c0a1bf0 con 0x7f6c20007370 2024-08-18T21:08:34.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c41ed8640 1 -- 172.21.15.5:0/3481470019 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6c20007370 msgr2=0x7f6c3c122930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:34.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c41ed8640 1 --2- 172.21.15.5:0/3481470019 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6c20007370 0x7f6c3c122930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6c20003640 tx=0x7f6c30014df0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:34.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c2e7fc640 1 -- 172.21.15.5:0/3481470019 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6c3001b030 con 0x7f6c20007370 2024-08-18T21:08:34.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:34.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c2e7fc640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:08:34.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c2e7fc640 10 monclient: dump: 2024-08-18T21:08:34.625 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:34.625 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:34.625 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:34.625 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:34.625 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:34.625 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:34.625 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:34.625 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:34.625 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:34.625 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:34.625 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:34.625 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:34.626 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:34.626 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:34.626 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:34.626 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:34.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c2e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:08:34.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c2e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:08:34.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c2e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:34.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c4413c640 5 monclient: authenticate success, global_id 35015 2024-08-18T21:08:34.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c2e7fc640 1 -- 172.21.15.5:0/3481470019 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3000cde0 con 0x7f6c20007370 2024-08-18T21:08:34.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c4413c640 10 monclient: _renew_subs 2024-08-18T21:08:34.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c4413c640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:08:34.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c4413c640 1 -- 172.21.15.5:0/3481470019 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3c1385e0 con 0x7f6c20007370 2024-08-18T21:08:34.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c2e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:34.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c2e7fc640 1 -- 172.21.15.5:0/3481470019 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6c3000f040 con 0x7f6c20007370 2024-08-18T21:08:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c2e7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:08:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c2ffff640 4 set_mon_vals no callback set 2024-08-18T21:08:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c2e7fc640 10 monclient: dump: 2024-08-18T21:08:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:34.628 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c4413c640 10 monclient: _renew_subs 2024-08-18T21:08:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c4413c640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:08:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c4413c640 1 -- 172.21.15.5:0/3481470019 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c3c124d60 con 0x7f6c20007370 2024-08-18T21:08:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c4413c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c4413c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c4413c640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:08:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c4413c640 1 -- 172.21.15.5:0/3481470019 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c3c124fa0 con 0x7f6c20007370 2024-08-18T21:08:34.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c2e7fc640 1 -- 172.21.15.5:0/3481470019 <== mon.5 v2:172.21.15.157:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f6c3000c970 con 0x7f6c20007370 2024-08-18T21:08:34.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.614+0000 7f6c2e7fc640 1 --2- 172.21.15.5:0/3481470019 >> v2:172.21.15.157:6812/631023601 conn(0x7f6c2003d4a0 0x7f6c2003f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:34.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.618+0000 7f6c2e7fc640 1 -- 172.21.15.5:0/3481470019 <== mon.5 v2:172.21.15.157:3302/0 5 ==== osd_map(138..138 src has 22..138) ==== 3898+0+0 (secure 0 0 0) 0x7f6c3001c070 con 0x7f6c20007370 2024-08-18T21:08:34.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.618+0000 7f6c416d7640 1 --2- 172.21.15.5:0/3481470019 >> v2:172.21.15.157:6812/631023601 conn(0x7f6c2003d4a0 0x7f6c2003f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:34.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.618+0000 7f6c416d7640 10 monclient: get_auth_request con 0x7f6c2003d4a0 auth_method 0 2024-08-18T21:08:34.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.618+0000 7f6c416d7640 1 --2- 172.21.15.5:0/3481470019 >> v2:172.21.15.157:6812/631023601 conn(0x7f6c2003d4a0 0x7f6c2003f960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c1d2910 tx=0x7f6c380b1040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:34.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.630+0000 7f6c2e7fc640 1 -- 172.21.15.5:0/3481470019 <== mon.5 v2:172.21.15.157:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f6c30025030 con 0x7f6c20007370 2024-08-18T21:08:34.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.630+0000 7f6c2e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:34.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.630+0000 7f6c2e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.862+0000 7f6c4413c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:08:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.862+0000 7f6c4413c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:08:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.862+0000 7f6c4413c640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:08:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.862+0000 7f6c4413c640 1 -- 172.21.15.5:0/3481470019 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6c3c139aa0 con 0x7f6c20007370 2024-08-18T21:08:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c2e7fc640 1 -- 172.21.15.5:0/3481470019 <== mon.5 v2:172.21.15.157:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3155 (secure 0 0 0) 0x7f6c3001fdd0 con 0x7f6c20007370 2024-08-18T21:08:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c2e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:08:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c2e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:34.872 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":110,"quorum":[1,4,5,6,7,8],"quorum_names":["f","c","h","d","i","e"],"quorum_leader_name":"f","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:08:34.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c4413c640 1 -- 172.21.15.5:0/3481470019 >> v2:172.21.15.157:6812/631023601 conn(0x7f6c2003d4a0 msgr2=0x7f6c2003f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c4413c640 1 --2- 172.21.15.5:0/3481470019 >> v2:172.21.15.157:6812/631023601 conn(0x7f6c2003d4a0 0x7f6c2003f960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c1d2910 tx=0x7f6c380b1040 comp rx=0 tx=0).stop 2024-08-18T21:08:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c4413c640 10 monclient: shutdown 2024-08-18T21:08:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c4413c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c4413c640 1 -- 172.21.15.5:0/3481470019 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6c20007370 msgr2=0x7f6c3c122930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c4413c640 1 --2- 172.21.15.5:0/3481470019 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6c20007370 0x7f6c3c122930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6c20003640 tx=0x7f6c30014df0 comp rx=0 tx=0).stop 2024-08-18T21:08:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c4413c640 1 -- 172.21.15.5:0/3481470019 shutdown_connections 2024-08-18T21:08:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c4413c640 1 --2- 172.21.15.5:0/3481470019 >> v2:172.21.15.157:6812/631023601 conn(0x7f6c2003d4a0 0x7f6c2003f960 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c4413c640 1 --2- 172.21.15.5:0/3481470019 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6c3c1d1850 0x7f6c3c1d1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c4413c640 1 --2- 172.21.15.5:0/3481470019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c3c137c40 0x7f6c3c1380a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c4413c640 1 --2- 172.21.15.5:0/3481470019 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6c20007370 0x7f6c3c122930 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c4413c640 1 -- 172.21.15.5:0/3481470019 >> 172.21.15.5:0/3481470019 conn(0x7f6c3c0accd0 msgr2=0x7f6c3c138f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c4413c640 1 -- 172.21.15.5:0/3481470019 shutdown_connections 2024-08-18T21:08:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:34.866+0000 7f6c4413c640 1 -- 172.21.15.5:0/3481470019 wait complete. 2024-08-18T21:08:37.014 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29658]: starting. 2024-08-18T21:08:37.014 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29658]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29656 2024-08-18T21:08:37.015 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29658]: shutting down. 2024-08-18T21:08:37.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:08:38.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.022+0000 7f720ff61640 10 monclient: get_monmap_and_config 2024-08-18T21:08:38.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.022+0000 7f720ff61640 10 monclient: build_initial_monmap 2024-08-18T21:08:38.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.022+0000 7f720ff61640 10 monclient: monmap: 2024-08-18T21:08:38.025 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:38.025 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.025 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:38.025918+0000 2024-08-18T21:08:38.025 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:38.025918+0000 2024-08-18T21:08:38.025 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:38.026 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.026 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:38.026 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:38.026 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:38.026 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:38.026 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:38.026 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:38.026 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:38.026 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:38.026 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:38.026 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:38.026 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:38.027 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.022+0000 7f720ff61640 1 Processor -- start 2024-08-18T21:08:38.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.022+0000 7f720ff61640 1 -- start start 2024-08-18T21:08:38.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.022+0000 7f720ff61640 10 monclient: init 2024-08-18T21:08:38.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.022+0000 7f720ff61640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:38.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.022+0000 7f720ff61640 10 monclient: _add_conns ranks=[5,10,7,9,2,1,0,8,4,6,3] 2024-08-18T21:08:38.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720ff61640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f72080a4000 0x7f72080a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720ff61640 10 monclient(hunting): picked mon.noname-h con 0x7f72080a4000 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720ff61640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f72080a2800 0x7f72080a4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720ff61640 10 monclient(hunting): picked mon.noname-f con 0x7f72080a2800 addr v2:172.21.15.157:3300/0 2024-08-18T21:08:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720ff61640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f720809b080 0x7f720809b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720ff61640 10 monclient(hunting): picked mon.noname-i con 0x7f720809b080 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720ff61640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720ff61640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f72080689b0 con 0x7f72080a2800 2024-08-18T21:08:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720ff61640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720ff61640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f72080a4e60 con 0x7f72080a4000 2024-08-18T21:08:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720ff61640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720ff61640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f72080a2450 con 0x7f720809b080 2024-08-18T21:08:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720ff61640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720ff61640 10 monclient(hunting): authenticate will time out at 1285.040177s 2024-08-18T21:08:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f72080a2800 0x7f72080a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f72080a2800 0x7f72080a4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:40138/0 (socket says 172.21.15.5:40138) 2024-08-18T21:08:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 1 -- 172.21.15.5:0/415604079 learned_addr learned my addr 172.21.15.5:0/415604079 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 10 monclient(hunting): get_auth_request con 0x7f72080a2800 auth_method 0 2024-08-18T21:08:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720dcfd640 1 --2- 172.21.15.5:0/415604079 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f72080a4000 0x7f72080a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720e4fe640 1 --2- 172.21.15.5:0/415604079 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f720809b080 0x7f720809b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720dcfd640 10 monclient(hunting): get_auth_request con 0x7f72080a4000 auth_method 0 2024-08-18T21:08:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720dcfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720dcfd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720dcfd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720e4fe640 10 monclient(hunting): get_auth_request con 0x7f720809b080 auth_method 0 2024-08-18T21:08:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720e4fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720e4fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720e4fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720dcfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720dcfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720dcfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720e4fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720e4fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720e4fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 10 monclient(hunting): handle_auth_done global_id 5635 payload 274 2024-08-18T21:08:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 1 -- 172.21.15.5:0/415604079 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f720809b080 msgr2=0x7f720809b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 1 --2- 172.21.15.5:0/415604079 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f720809b080 0x7f720809b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 1 -- 172.21.15.5:0/415604079 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f72080a4000 msgr2=0x7f72080a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 1 --2- 172.21.15.5:0/415604079 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f72080a4000 0x7f72080a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 10 monclient: _finish_hunting 0 2024-08-18T21:08:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 1 monclient: found mon.noname-f 2024-08-18T21:08:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:08:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.026+0000 7f720d4fc640 1 -- 172.21.15.5:0/415604079 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72080a5f90 con 0x7f72080a2800 2024-08-18T21:08:38.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.030+0000 7f720d4fc640 1 -- 172.21.15.5:0/415604079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72080a2800 msgr2=0x7f72080a4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:38.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.030+0000 7f720d4fc640 1 --2- 172.21.15.5:0/415604079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72080a2800 0x7f72080a4920 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009870 tx=0x7f71f801c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb532fe5d791eb89 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.038+0000 7f720ccfb640 1 -- 172.21.15.5:0/415604079 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71f80b0070 con 0x7f72080a2800 2024-08-18T21:08:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.038+0000 7f720ccfb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.038+0000 7f720ccfb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:08:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.038+0000 7f720ccfb640 10 monclient: dump: 2024-08-18T21:08:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.044 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.038+0000 7f720ccfb640 10 monclient: _finish_auth 0 2024-08-18T21:08:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.038+0000 7f720ccfb640 10 monclient: _check_auth_tickets 2024-08-18T21:08:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.038+0000 7f720ccfb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.038+0000 7f720ff61640 5 monclient: authenticate success, global_id 5635 2024-08-18T21:08:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.038+0000 7f720ff61640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:08:38.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ccfb640 1 -- 172.21.15.5:0/415604079 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f80aa3a0 con 0x7f72080a2800 2024-08-18T21:08:38.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ccfb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:38.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ccfb640 1 -- 172.21.15.5:0/415604079 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71f80aaa00 con 0x7f72080a2800 2024-08-18T21:08:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ccfb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ccfb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:08:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ccfb640 10 monclient: dump: 2024-08-18T21:08:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.047 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ff61640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ff61640 4 set_mon_vals no callback set 2024-08-18T21:08:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ff61640 10 monclient: shutdown 2024-08-18T21:08:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ff61640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ff61640 1 -- 172.21.15.5:0/415604079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72080a2800 msgr2=0x7f72080a4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ff61640 1 --2- 172.21.15.5:0/415604079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72080a2800 0x7f72080a4920 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009870 tx=0x7f71f801c420 comp rx=0 tx=0).stop 2024-08-18T21:08:38.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ff61640 1 -- 172.21.15.5:0/415604079 shutdown_connections 2024-08-18T21:08:38.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ff61640 1 --2- 172.21.15.5:0/415604079 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f720809b080 0x7f720809b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ff61640 1 --2- 172.21.15.5:0/415604079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72080a2800 0x7f72080a4920 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ff61640 1 --2- 172.21.15.5:0/415604079 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f72080a4000 0x7f72080a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ff61640 1 -- 172.21.15.5:0/415604079 >> 172.21.15.5:0/415604079 conn(0x7f72080a50f0 msgr2=0x7f72080a54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:38.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ff61640 1 -- 172.21.15.5:0/415604079 shutdown_connections 2024-08-18T21:08:38.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.042+0000 7f720ff61640 1 -- 172.21.15.5:0/415604079 wait complete. 2024-08-18T21:08:38.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 10 monclient: build_initial_monmap 2024-08-18T21:08:38.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 10 monclient: monmap: 2024-08-18T21:08:38.051 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:38.051 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:38.051 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:38.051 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:38.052 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:38.052 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.052 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:38.052 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:38.052 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:38.052 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:38.052 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:38.052 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:38.052 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:38.052 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:38.052 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:38.052 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 1 Processor -- start 2024-08-18T21:08:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 1 -- start start 2024-08-18T21:08:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 10 monclient: init 2024-08-18T21:08:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 10 monclient: _add_conns ranks=[6,4,0,8,2,3,1,5,7] 2024-08-18T21:08:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f720809b080 0x7f720813bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 10 monclient(hunting): picked mon.noname-d con 0x7f720809b080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f72080a2800 0x7f720813c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 10 monclient(hunting): picked mon.noname-c con 0x7f72080a2800 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72080a4000 0x7f72080735c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 10 monclient(hunting): picked mon.noname-a con 0x7f72080a4000 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:08:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7208068770 con 0x7f72080a4000 2024-08-18T21:08:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f720809c040 con 0x7f72080a2800 2024-08-18T21:08:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f720809faf0 con 0x7f720809b080 2024-08-18T21:08:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720ff61640 10 monclient(hunting): authenticate will time out at 1285.061314s 2024-08-18T21:08:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72080a4000 0x7f72080735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720d4fc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f72080a2800 0x7f720813c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720dcfd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f720809b080 0x7f720813bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72080a4000 0x7f72080735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51738/0 (socket says 172.21.15.5:51738) 2024-08-18T21:08:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 1 -- 172.21.15.5:0/3928725789 learned_addr learned my addr 172.21.15.5:0/3928725789 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 10 monclient(hunting): get_auth_request con 0x7f72080a4000 auth_method 0 2024-08-18T21:08:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720dcfd640 10 monclient(hunting): get_auth_request con 0x7f720809b080 auth_method 0 2024-08-18T21:08:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720dcfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720dcfd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720dcfd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720d4fc640 10 monclient(hunting): get_auth_request con 0x7f72080a2800 auth_method 0 2024-08-18T21:08:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720d4fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720d4fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720d4fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720dcfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720dcfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720dcfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720d4fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720d4fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720d4fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 10 monclient(hunting): handle_auth_done global_id 84123 payload 824 2024-08-18T21:08:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 1 -- 172.21.15.5:0/3928725789 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f720809b080 msgr2=0x7f720813bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 1 --2- 172.21.15.5:0/3928725789 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f720809b080 0x7f720813bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 1 -- 172.21.15.5:0/3928725789 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f72080a2800 msgr2=0x7f720813c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 1 --2- 172.21.15.5:0/3928725789 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f72080a2800 0x7f720813c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 10 monclient: _finish_hunting 0 2024-08-18T21:08:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 1 monclient: found mon.noname-a 2024-08-18T21:08:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:08:38.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720e4fe640 1 -- 172.21.15.5:0/3928725789 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720813ca20 con 0x7f72080a4000 2024-08-18T21:08:38.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.046+0000 7f720d4fc640 1 --2- 172.21.15.5:0/3928725789 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f72080a2800 0x7f720813c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:08:38.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f720e4fe640 1 -- 172.21.15.5:0/3928725789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72080a4000 msgr2=0x7f72080735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:38.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f720e4fe640 1 --2- 172.21.15.5:0/3928725789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72080a4000 0x7f72080735c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f720000efc0 tx=0x7f720000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fe7fc640 1 -- 172.21.15.5:0/3928725789 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7200018020 con 0x7f72080a4000 2024-08-18T21:08:38.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fe7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:08:38.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fe7fc640 10 monclient: dump: 2024-08-18T21:08:38.059 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.059 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.059 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.059 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.060 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fe7fc640 10 monclient: _finish_auth 0 2024-08-18T21:08:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fe7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:08:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f720ff61640 5 monclient: authenticate success, global_id 84123 2024-08-18T21:08:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fe7fc640 1 -- 172.21.15.5:0/3928725789 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72000148f0 con 0x7f72080a4000 2024-08-18T21:08:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fe7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fe7fc640 1 -- 172.21.15.5:0/3928725789 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f72000133e0 con 0x7f72080a4000 2024-08-18T21:08:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f720ff61640 10 monclient: _renew_subs 2024-08-18T21:08:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f720ff61640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:08:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f720ff61640 1 -- 172.21.15.5:0/3928725789 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7208138840 con 0x7f72080a4000 2024-08-18T21:08:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fffff640 4 set_mon_vals no callback set 2024-08-18T21:08:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:08:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fe7fc640 10 monclient: dump: 2024-08-18T21:08:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.063 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f720ff61640 10 monclient: _renew_subs 2024-08-18T21:08:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f720ff61640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:08:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f720ff61640 1 -- 172.21.15.5:0/3928725789 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72081391c0 con 0x7f72080a4000 2024-08-18T21:08:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f720ff61640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f720ff61640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f720ff61640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:08:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f720ff61640 1 -- 172.21.15.5:0/3928725789 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f720809b4c0 con 0x7f72080a4000 2024-08-18T21:08:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fe7fc640 1 -- 172.21.15.5:0/3928725789 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f720001b020 con 0x7f72080a4000 2024-08-18T21:08:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fe7fc640 1 --2- 172.21.15.5:0/3928725789 >> v2:172.21.15.157:6812/631023601 conn(0x7f71ec03bdc0 0x7f71ec03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f71fe7fc640 1 -- 172.21.15.5:0/3928725789 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 22..140) ==== 3898+0+0 (secure 0 0 0) 0x7f720004f0c0 con 0x7f72080a4000 2024-08-18T21:08:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f720dcfd640 1 --2- 172.21.15.5:0/3928725789 >> v2:172.21.15.157:6812/631023601 conn(0x7f71ec03bdc0 0x7f71ec03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.050+0000 7f720dcfd640 10 monclient: get_auth_request con 0x7f71ec03bdc0 auth_method 0 2024-08-18T21:08:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.054+0000 7f720dcfd640 1 --2- 172.21.15.5:0/3928725789 >> v2:172.21.15.157:6812/631023601 conn(0x7f71ec03bdc0 0x7f71ec03e280 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7204009a40 tx=0x7f7204009190 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.054+0000 7f71fe7fc640 1 -- 172.21.15.5:0/3928725789 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f7200022070 con 0x7f72080a4000 2024-08-18T21:08:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.054+0000 7f71fe7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.054+0000 7f71fe7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:38.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.318+0000 7f720ff61640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:08:38.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.318+0000 7f720ff61640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:08:38.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.318+0000 7f720ff61640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:08:38.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.318+0000 7f720ff61640 1 -- 172.21.15.5:0/3928725789 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7208138260 con 0x7f72080a4000 2024-08-18T21:08:38.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.318+0000 7f71fe7fc640 1 -- 172.21.15.5:0/3928725789 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7f7200010040 con 0x7f72080a4000 2024-08-18T21:08:38.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.318+0000 7f71fe7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:08:38.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.318+0000 7f71fe7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:38.321 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":116,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:08:38.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.322+0000 7f720ff61640 1 -- 172.21.15.5:0/3928725789 >> v2:172.21.15.157:6812/631023601 conn(0x7f71ec03bdc0 msgr2=0x7f71ec03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.322+0000 7f720ff61640 1 --2- 172.21.15.5:0/3928725789 >> v2:172.21.15.157:6812/631023601 conn(0x7f71ec03bdc0 0x7f71ec03e280 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7204009a40 tx=0x7f7204009190 comp rx=0 tx=0).stop 2024-08-18T21:08:38.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.322+0000 7f720ff61640 10 monclient: shutdown 2024-08-18T21:08:38.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.322+0000 7f720ff61640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:38.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.322+0000 7f720ff61640 1 -- 172.21.15.5:0/3928725789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72080a4000 msgr2=0x7f72080735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.322+0000 7f720ff61640 1 --2- 172.21.15.5:0/3928725789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72080a4000 0x7f72080735c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f720000efc0 tx=0x7f720000c490 comp rx=0 tx=0).stop 2024-08-18T21:08:38.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.322+0000 7f720ff61640 1 -- 172.21.15.5:0/3928725789 shutdown_connections 2024-08-18T21:08:38.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.322+0000 7f720ff61640 1 --2- 172.21.15.5:0/3928725789 >> v2:172.21.15.157:6812/631023601 conn(0x7f71ec03bdc0 0x7f71ec03e280 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.322+0000 7f720ff61640 1 --2- 172.21.15.5:0/3928725789 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f72080a2800 0x7f720813c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.322+0000 7f720ff61640 1 --2- 172.21.15.5:0/3928725789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72080a4000 0x7f72080735c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.322+0000 7f720ff61640 1 --2- 172.21.15.5:0/3928725789 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f720809b080 0x7f720813bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.322+0000 7f720ff61640 1 -- 172.21.15.5:0/3928725789 >> 172.21.15.5:0/3928725789 conn(0x7f72080a50f0 msgr2=0x7f720809a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:38.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.322+0000 7f720ff61640 1 -- 172.21.15.5:0/3928725789 shutdown_connections 2024-08-18T21:08:38.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.322+0000 7f720ff61640 1 -- 172.21.15.5:0/3928725789 wait complete. 2024-08-18T21:08:38.341 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:08:38.341 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:08:38.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:08:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.454+0000 7f42d4188640 10 monclient: get_monmap_and_config 2024-08-18T21:08:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.454+0000 7f42d4188640 10 monclient: build_initial_monmap 2024-08-18T21:08:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.454+0000 7f42d4188640 10 monclient: monmap: 2024-08-18T21:08:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:38.460065+0000 2024-08-18T21:08:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:38.460065+0000 2024-08-18T21:08:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:38.463 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d4188640 1 Processor -- start 2024-08-18T21:08:38.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d4188640 1 -- start start 2024-08-18T21:08:38.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d4188640 10 monclient: init 2024-08-18T21:08:38.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d4188640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:38.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d4188640 10 monclient: _add_conns ranks=[5,0,1,8,2,3,7,6,9,4,10] 2024-08-18T21:08:38.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d4188640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f42cc0a5ac0 0x7f42cc0a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d4188640 10 monclient(hunting): picked mon.noname-h con 0x7f42cc0a5ac0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:38.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d4188640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f42cc0a63e0 addr v1:172.21.15.5:6789/0 2024-08-18T21:08:38.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d4188640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f42cc137ff0 addr v1:172.21.15.157:6789/0 2024-08-18T21:08:38.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d4188640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42cc0a2050 con 0x7f42cc0a63e0 2024-08-18T21:08:38.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d4188640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42cc0a3990 con 0x7f42cc137ff0 2024-08-18T21:08:38.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d4188640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d4188640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f42cc0a30f0 con 0x7f42cc0a5ac0 2024-08-18T21:08:38.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d4188640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d4188640 10 monclient(hunting): authenticate will time out at 1285.473628s 2024-08-18T21:08:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1723640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f42cc0a63e0 0x7f42cc1378e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47010/0 (socket says 172.21.15.5:47010) 2024-08-18T21:08:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1723640 1 -- 172.21.15.5:0/1055280388 learned_addr learned my addr 172.21.15.5:0/1055280388 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:08:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1f24640 1 --2- 172.21.15.5:0/1055280388 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f42cc0a5ac0 0x7f42cc0a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1f24640 10 monclient(hunting): get_auth_request con 0x7f42cc0a5ac0 auth_method 0 2024-08-18T21:08:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1f24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1f24640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1f24640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1f24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1f24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1f24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1f24640 10 monclient(hunting): handle_auth_done global_id 35060 payload 274 2024-08-18T21:08:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1f24640 1 -- 172.21.15.5:0/1055280388 >> v1:172.21.15.157:6789/0 conn(0x7f42cc137ff0 legacy=0x7f42cc13fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:38.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1f24640 1 -- 172.21.15.5:0/1055280388 >> v1:172.21.15.5:6789/0 conn(0x7f42cc0a63e0 legacy=0x7f42cc1378e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:38.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1f24640 10 monclient: _finish_hunting 0 2024-08-18T21:08:38.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1f24640 1 monclient: found mon.noname-h 2024-08-18T21:08:38.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1f24640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:38.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1f24640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:08:38.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.458+0000 7f42d1f24640 1 -- 172.21.15.5:0/1055280388 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42cc0a7660 con 0x7f42cc0a5ac0 2024-08-18T21:08:38.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d1f24640 1 -- 172.21.15.5:0/1055280388 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f42cc0a5ac0 msgr2=0x7f42cc0a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:38.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d1f24640 1 --2- 172.21.15.5:0/1055280388 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f42cc0a5ac0 0x7f42cc0a5ea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f42c80097f0 tx=0x7f42c801c3a0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=8b8589912a015192 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d0f22640 1 -- 172.21.15.5:0/1055280388 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f42c80b0070 con 0x7f42cc0a5ac0 2024-08-18T21:08:38.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d0f22640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d0f22640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:08:38.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d0f22640 10 monclient: dump: 2024-08-18T21:08:38.468 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.468 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.468 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.468 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.468 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.469 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d0f22640 10 monclient: _finish_auth 0 2024-08-18T21:08:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d0f22640 10 monclient: _check_auth_tickets 2024-08-18T21:08:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d0f22640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:38.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d0f22640 1 -- 172.21.15.5:0/1055280388 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c80aa810 con 0x7f42cc0a5ac0 2024-08-18T21:08:38.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d4188640 5 monclient: authenticate success, global_id 35060 2024-08-18T21:08:38.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d0f22640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:38.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d4188640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:38.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d0f22640 1 -- 172.21.15.5:0/1055280388 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f42c80a4e60 con 0x7f42cc0a5ac0 2024-08-18T21:08:38.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d4188640 4 set_mon_vals no callback set 2024-08-18T21:08:38.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d0f22640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d0f22640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:08:38.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.462+0000 7f42d0f22640 10 monclient: dump: 2024-08-18T21:08:38.470 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.470 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.471 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.471 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.471 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.471 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.471 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.471 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.471 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.471 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.471 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.471 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.471 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.471 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.471 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.471 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 10 monclient: shutdown 2024-08-18T21:08:38.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:38.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 1 -- 172.21.15.5:0/1055280388 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f42cc0a5ac0 msgr2=0x7f42cc0a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 1 --2- 172.21.15.5:0/1055280388 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f42cc0a5ac0 0x7f42cc0a5ea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f42c80097f0 tx=0x7f42c801c3a0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 1 -- 172.21.15.5:0/1055280388 shutdown_connections 2024-08-18T21:08:38.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 1 --2- 172.21.15.5:0/1055280388 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f42cc0a5ac0 0x7f42cc0a5ea0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 1 -- 172.21.15.5:0/1055280388 >> 172.21.15.5:0/1055280388 conn(0x7f42cc0aa770 msgr2=0x7f42cc0a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:38.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 1 -- 172.21.15.5:0/1055280388 shutdown_connections 2024-08-18T21:08:38.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 1 -- 172.21.15.5:0/1055280388 wait complete. 2024-08-18T21:08:38.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 10 monclient: build_initial_monmap 2024-08-18T21:08:38.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 10 monclient: monmap: 2024-08-18T21:08:38.476 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:38.478 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 1 Processor -- start 2024-08-18T21:08:38.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 1 -- start start 2024-08-18T21:08:38.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 10 monclient: init 2024-08-18T21:08:38.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:38.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 10 monclient: _add_conns ranks=[3,1,5,6,7,2,8,4,0] 2024-08-18T21:08:38.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42cc0a5ac0 0x7f42cc132ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 10 monclient(hunting): picked mon.noname-g con 0x7f42cc0a5ac0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:38.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42cc0a63e0 0x7f42cc132ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 10 monclient(hunting): picked mon.noname-f con 0x7f42cc0a63e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:08:38.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f42cc137ff0 0x7f42cc06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 10 monclient(hunting): picked mon.noname-h con 0x7f42cc137ff0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:38.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc0a1dc0 con 0x7f42cc0a63e0 2024-08-18T21:08:38.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f42cc0a1c40 con 0x7f42cc0a5ac0 2024-08-18T21:08:38.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f42cc143af0 con 0x7f42cc137ff0 2024-08-18T21:08:38.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:38.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d4188640 10 monclient(hunting): authenticate will time out at 1285.482161s 2024-08-18T21:08:38.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1f24640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42cc0a5ac0 0x7f42cc132ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1f24640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42cc0a5ac0 0x7f42cc132ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:43064/0 (socket says 172.21.15.5:43064) 2024-08-18T21:08:38.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1f24640 1 -- 172.21.15.5:0/3786606106 learned_addr learned my addr 172.21.15.5:0/3786606106 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:38.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1f24640 10 monclient(hunting): get_auth_request con 0x7f42cc0a5ac0 auth_method 0 2024-08-18T21:08:38.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1f24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1f24640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1f24640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42cc0a63e0 0x7f42cc132ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 10 monclient(hunting): get_auth_request con 0x7f42cc0a63e0 auth_method 0 2024-08-18T21:08:38.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1f24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1f24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d2725640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f42cc137ff0 0x7f42cc06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1f24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d2725640 10 monclient(hunting): get_auth_request con 0x7f42cc137ff0 auth_method 0 2024-08-18T21:08:38.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d2725640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d2725640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d2725640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d2725640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d2725640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d2725640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 10 monclient(hunting): handle_auth_done global_id 5644 payload 824 2024-08-18T21:08:38.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 1 -- 172.21.15.5:0/3786606106 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f42cc137ff0 msgr2=0x7f42cc06da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f42cc137ff0 0x7f42cc06da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 1 -- 172.21.15.5:0/3786606106 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42cc0a5ac0 msgr2=0x7f42cc132ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42cc0a5ac0 0x7f42cc132ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 10 monclient: _finish_hunting 0 2024-08-18T21:08:38.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 1 monclient: found mon.noname-f 2024-08-18T21:08:38.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:08:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1723640 1 -- 172.21.15.5:0/3786606106 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42cc13d980 con 0x7f42cc0a63e0 2024-08-18T21:08:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.466+0000 7f42d1f24640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42cc0a5ac0 0x7f42cc132ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:08:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d1723640 1 -- 172.21.15.5:0/3786606106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42cc0a63e0 msgr2=0x7f42cc132ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d1723640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42cc0a63e0 0x7f42cc132ff0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00c3e0 tx=0x7f42bc00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42c27fc640 1 -- 172.21.15.5:0/3786606106 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f42bc017070 con 0x7f42cc0a63e0 2024-08-18T21:08:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42c27fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:08:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42c27fc640 10 monclient: dump: 2024-08-18T21:08:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.483 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42c27fc640 10 monclient: _finish_auth 0 2024-08-18T21:08:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42c27fc640 10 monclient: _check_auth_tickets 2024-08-18T21:08:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42c27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42c27fc640 1 -- 172.21.15.5:0/3786606106 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42bc005d00 con 0x7f42cc0a63e0 2024-08-18T21:08:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d4188640 5 monclient: authenticate success, global_id 5644 2024-08-18T21:08:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d4188640 10 monclient: _renew_subs 2024-08-18T21:08:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d4188640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:08:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d4188640 1 -- 172.21.15.5:0/3786606106 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42cc13df00 con 0x7f42cc0a63e0 2024-08-18T21:08:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42c27fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42c27fc640 1 -- 172.21.15.5:0/3786606106 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f42bc007540 con 0x7f42cc0a63e0 2024-08-18T21:08:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42c27fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:08:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42c27fc640 10 monclient: dump: 2024-08-18T21:08:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.486 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42c3fff640 4 set_mon_vals no callback set 2024-08-18T21:08:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d4188640 10 monclient: _renew_subs 2024-08-18T21:08:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d4188640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:08:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d4188640 1 -- 172.21.15.5:0/3786606106 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42cc13dc20 con 0x7f42cc0a63e0 2024-08-18T21:08:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d4188640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d4188640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc06dfa0 0x7f42cc06e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d4188640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d4188640 1 -- 172.21.15.5:0/3786606106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc140960 con 0x7f42cc06dfa0 2024-08-18T21:08:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d1f24640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc06dfa0 0x7f42cc06e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d1f24640 10 monclient: get_auth_request con 0x7f42cc06dfa0 auth_method 0 2024-08-18T21:08:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d1f24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d1f24640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d1f24640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d1f24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d1f24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d1f24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d1f24640 10 monclient(hunting): handle_auth_done global_id 84132 payload 824 2024-08-18T21:08:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42d1f24640 1 -- 172.21.15.5:0/3786606106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42cc140290 con 0x7f42cc06dfa0 2024-08-18T21:08:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.470+0000 7f42c27fc640 1 -- 172.21.15.5:0/3786606106 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f42bc007070 con 0x7f42cc0a63e0 2024-08-18T21:08:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42c27fc640 1 --2- 172.21.15.5:0/3786606106 >> v2:172.21.15.157:6812/631023601 conn(0x7f42b003bdc0 0x7f42b003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42c27fc640 1 -- 172.21.15.5:0/3786606106 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(141..141 src has 22..141) ==== 3898+0+0 (secure 0 0 0) 0x7f42bc04da20 con 0x7f42cc0a63e0 2024-08-18T21:08:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42d2725640 1 --2- 172.21.15.5:0/3786606106 >> v2:172.21.15.157:6812/631023601 conn(0x7f42b003bdc0 0x7f42b003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42d2725640 10 monclient: get_auth_request con 0x7f42b003bdc0 auth_method 0 2024-08-18T21:08:38.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42d1f24640 1 -- 172.21.15.5:0/3786606106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc06dfa0 msgr2=0x7f42cc06e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:38.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42d1f24640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc06dfa0 0x7f42cc06e380 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f42c801c1d0 tx=0x7f42c8019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42c27fc640 1 -- 172.21.15.5:0/3786606106 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f42c80ba070 con 0x7f42cc06dfa0 2024-08-18T21:08:38.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42c27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:08:38.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42c27fc640 10 monclient: dump: 2024-08-18T21:08:38.490 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.491 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.491 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.491 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.491 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.491 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.491 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.491 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.491 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.491 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.491 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.491 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.491 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.491 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.492 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42c27fc640 1 -- 172.21.15.5:0/3786606106 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f42c80aa960 con 0x7f42cc06dfa0 2024-08-18T21:08:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42c27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42c27fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42c27fc640 1 -- 172.21.15.5:0/3786606106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc06dfa0 msgr2=0x7f42cc06e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42c27fc640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc06dfa0 0x7f42cc06e380 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f42c801c1d0 tx=0x7f42c8019140 comp rx=0 tx=0).stop 2024-08-18T21:08:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42c27fc640 1 -- 172.21.15.5:0/3786606106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc06dfa0 msgr2=0x7f42cc06e380 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42c27fc640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc06dfa0 0x7f42cc06e380 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f42c801c1d0 tx=0x7f42c8019140 comp rx=0 tx=0).stop 2024-08-18T21:08:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.474+0000 7f42d2725640 1 --2- 172.21.15.5:0/3786606106 >> v2:172.21.15.157:6812/631023601 conn(0x7f42b003bdc0 0x7f42b003e280 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f42cc13cf40 tx=0x7f42c400d040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42d4188640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42d4188640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc06e8c0 0x7f42cc0730c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42d4188640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42d4188640 1 -- 172.21.15.5:0/3786606106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc051140 con 0x7f42cc06e8c0 2024-08-18T21:08:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42d1f24640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc06e8c0 0x7f42cc0730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42d1f24640 10 monclient: get_auth_request con 0x7f42cc06e8c0 auth_method 0 2024-08-18T21:08:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42d1f24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42d1f24640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42d1f24640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42d1f24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42d1f24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42d1f24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42d1f24640 10 monclient(hunting): handle_auth_done global_id 84141 payload 824 2024-08-18T21:08:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42d1f24640 1 -- 172.21.15.5:0/3786606106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f42cc0a5ea0 con 0x7f42cc06e8c0 2024-08-18T21:08:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42d1f24640 1 -- 172.21.15.5:0/3786606106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc06e8c0 msgr2=0x7f42cc0730c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42d1f24640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc06e8c0 0x7f42cc0730c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f42c801c3e0 tx=0x7f42c80a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42c27fc640 1 -- 172.21.15.5:0/3786606106 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f42c80b0040 con 0x7f42cc06e8c0 2024-08-18T21:08:38.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42c27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:08:38.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42c27fc640 10 monclient: dump: 2024-08-18T21:08:38.494 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.494 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.494 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.494 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.494 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.494 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.494 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.494 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.494 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.495 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.495 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.495 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.495 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.495 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.495 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.495 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42c27fc640 1 -- 172.21.15.5:0/3786606106 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9249 (secure 0 0 0) 0x7f42c80bf450 con 0x7f42cc06e8c0 2024-08-18T21:08:38.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42c27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:38.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42c27fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:38.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42c27fc640 1 -- 172.21.15.5:0/3786606106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc06e8c0 msgr2=0x7f42cc0730c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42c27fc640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc06e8c0 0x7f42cc0730c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f42c801c3e0 tx=0x7f42c80a8000 comp rx=0 tx=0).stop 2024-08-18T21:08:38.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42c27fc640 1 -- 172.21.15.5:0/3786606106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc06e8c0 msgr2=0x7f42cc0730c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:38.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.482+0000 7f42c27fc640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc06e8c0 0x7f42cc0730c0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f42c801c3e0 tx=0x7f42c80a8000 comp rx=0 tx=0).stop 2024-08-18T21:08:38.496 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:38.496 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:38.496 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:38.496 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:08:38.496 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:38.496 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15315, 2024-08-18T21:08:38.496 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:38.496 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:38.496 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:38.497 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:38.497 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:38.497 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:38.497 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:38.497 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:38.497 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:38.497 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:38.497 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:38.497 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:08:38.497 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:38.497 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:38.497 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:38.497 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:38.498 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:38.498 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:38.498 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:38.498 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:38.498 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:38.498 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:38.498 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:38.498 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:38.498 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:38.498 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:38.498 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:38.498 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:38.498 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:38.499 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:38.499 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:38.499 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:38.499 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:38.499 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:38.499 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:38.499 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:38.499 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:38.499 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:38.499 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:38.499 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:38.499 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.499 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:38.500 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:38.500 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:38.500 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:38.500 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:38.500 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:38.500 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:38.500 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:38.500 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:38.500 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:38.500 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:38.500 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:38.500 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:38.500 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:38.500 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:38.501 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:38.501 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:38.501 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:38.501 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:38.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:38.501 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:38.501 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:38.501 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:38.501 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:38.501 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:38.501 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:38.501 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:38.501 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:38.501 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:38.502 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:38.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:38.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.502 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:38.502 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:38.502 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.502 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:38.502 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.503 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.503 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:38.503 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.503 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.503 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.503 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:38.503 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:38.503 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.503 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.503 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.504 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:38.504 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:38.504 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:38.504 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:38.504 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.505 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.505 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.505 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:38.505 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:38.505 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.505 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.505 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.505 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:38.505 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:38.505 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.505 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.506 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.506 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:38.506 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.506 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.506 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:38.506 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.506 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.506 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.506 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:38.507 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:38.507 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.507 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.507 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.507 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:38.507 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:38.507 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.507 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.507 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.507 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:38.507 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.510 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.510 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.510 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:38.510 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:38.510 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.510 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.510 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.510 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.510 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:38.510 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:38.510 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.511 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.511 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.511 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:38.511 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.511 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.511 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:38.511 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.511 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.511 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.511 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:38.512 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:38.512 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.512 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.512 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.512 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.512 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:38.512 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:38.512 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.512 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.512 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.512 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.512 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:38.512 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.513 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.513 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.513 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:38.513 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.513 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.513 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.513 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:38.513 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:38.513 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.513 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.513 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.514 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.514 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:38.514 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:38.514 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.514 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.514 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.514 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.514 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:38.514 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.514 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.514 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.514 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:38.515 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.515 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.515 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.515 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:38.515 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:38.515 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.515 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.515 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.515 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.515 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:38.515 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:38.515 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.516 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.516 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.516 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.516 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:38.516 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.516 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.516 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.516 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.516 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:38.516 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.516 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.516 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:38.518 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:38.518 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.518 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:38.518 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:38.518 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.518 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:38.518 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:38.518 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:38.518 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.518 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.518 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:38.518 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.486+0000 7f42d4188640 1 -- 172.21.15.5:0/3786606106 >> v2:172.21.15.157:6812/631023601 conn(0x7f42b003bdc0 msgr2=0x7f42b003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.486+0000 7f42d4188640 1 --2- 172.21.15.5:0/3786606106 >> v2:172.21.15.157:6812/631023601 conn(0x7f42b003bdc0 0x7f42b003e280 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f42cc13cf40 tx=0x7f42c400d040 comp rx=0 tx=0).stop 2024-08-18T21:08:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.486+0000 7f42d4188640 10 monclient: shutdown 2024-08-18T21:08:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.486+0000 7f42d4188640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.486+0000 7f42d4188640 1 -- 172.21.15.5:0/3786606106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42cc0a63e0 msgr2=0x7f42cc132ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.486+0000 7f42d4188640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42cc0a63e0 0x7f42cc132ff0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00c3e0 tx=0x7f42bc00c8a0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.486+0000 7f42d2725640 1 -- 172.21.15.5:0/3786606106 reap_dead start 2024-08-18T21:08:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.486+0000 7f42d4188640 1 -- 172.21.15.5:0/3786606106 shutdown_connections 2024-08-18T21:08:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.486+0000 7f42d4188640 1 --2- 172.21.15.5:0/3786606106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42cc0a63e0 0x7f42cc132ff0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.486+0000 7f42d4188640 1 -- 172.21.15.5:0/3786606106 >> 172.21.15.5:0/3786606106 conn(0x7f42cc0aa770 msgr2=0x7f42cc09fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:38.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.486+0000 7f42d4188640 1 -- 172.21.15.5:0/3786606106 shutdown_connections 2024-08-18T21:08:38.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.486+0000 7f42d4188640 1 -- 172.21.15.5:0/3786606106 wait complete. 2024-08-18T21:08:38.521 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:38.521 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:08:38.521 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:08:38.579 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:38.579 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29736]: starting. 2024-08-18T21:08:38.579 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29736]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29656 2024-08-18T21:08:38.579 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29736]: created object 0... 2024-08-18T21:08:38.579 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29736]: created object 25... 2024-08-18T21:08:38.579 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29736]: created object 49... 2024-08-18T21:08:38.579 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29736]: finishing. 2024-08-18T21:08:38.580 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29736]: shutting down. 2024-08-18T21:08:38.635 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:38.635 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29738]: starting. 2024-08-18T21:08:38.636 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29738]: listing objects. 2024-08-18T21:08:38.636 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29738]: listed object 0... 2024-08-18T21:08:38.636 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29738]: listed object 25... 2024-08-18T21:08:38.636 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29738]: saw 50 objects 2024-08-18T21:08:38.636 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29738]: shutting down. 2024-08-18T21:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.634+0000 7f638793f640 10 monclient: get_monmap_and_config 2024-08-18T21:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.634+0000 7f638793f640 10 monclient: build_initial_monmap 2024-08-18T21:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 10 monclient: monmap: 2024-08-18T21:08:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:38.640445+0000 2024-08-18T21:08:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:38.640445+0000 2024-08-18T21:08:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:38.641 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 1 Processor -- start 2024-08-18T21:08:38.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 1 -- start start 2024-08-18T21:08:38.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 10 monclient: init 2024-08-18T21:08:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 10 monclient: _add_conns ranks=[6,10,9,3,1,5,4,7,8,0,2] 2024-08-18T21:08:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f63800a5ac0 0x7f63800a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 10 monclient(hunting): picked mon.noname-d con 0x7f63800a5ac0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f63800a0cd0 0x7f63800a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 10 monclient(hunting): picked mon.noname-f con 0x7f63800a0cd0 addr v2:172.21.15.157:3300/0 2024-08-18T21:08:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6380139c60 0x7f638013a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 10 monclient(hunting): picked mon.noname-a con 0x7f6380139c60 addr v2:172.21.15.5:3300/0 2024-08-18T21:08:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f638006e500 con 0x7f6380139c60 2024-08-18T21:08:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f63800a6920 con 0x7f63800a0cd0 2024-08-18T21:08:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f63800a1790 con 0x7f63800a5ac0 2024-08-18T21:08:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f638793f640 10 monclient(hunting): authenticate will time out at 1285.653542s 2024-08-18T21:08:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6380139c60 0x7f638013a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f63856db640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f63800a5ac0 0x7f63800a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6380139c60 0x7f638013a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51754/0 (socket says 172.21.15.5:51754) 2024-08-18T21:08:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f63856db640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f63800a5ac0 0x7f63800a5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:40250/0 (socket says 172.21.15.5:40250) 2024-08-18T21:08:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 1 -- 172.21.15.5:0/1436700739 learned_addr learned my addr 172.21.15.5:0/1436700739 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 10 monclient(hunting): get_auth_request con 0x7f6380139c60 auth_method 0 2024-08-18T21:08:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f63856db640 10 monclient(hunting): get_auth_request con 0x7f63800a5ac0 auth_method 0 2024-08-18T21:08:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f63856db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f63856db640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f63856db640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f63856db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f63856db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f63856db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6384eda640 1 --2- 172.21.15.5:0/1436700739 >> v2:172.21.15.157:3300/0 conn(0x7f63800a0cd0 0x7f63800a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6384eda640 10 monclient(hunting): get_auth_request con 0x7f63800a0cd0 auth_method 0 2024-08-18T21:08:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6384eda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6384eda640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6384eda640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 10 monclient(hunting): handle_auth_done global_id 84150 payload 274 2024-08-18T21:08:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 1 -- 172.21.15.5:0/1436700739 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f63800a5ac0 msgr2=0x7f63800a5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 1 --2- 172.21.15.5:0/1436700739 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f63800a5ac0 0x7f63800a5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 1 -- 172.21.15.5:0/1436700739 >> v2:172.21.15.157:3300/0 conn(0x7f63800a0cd0 msgr2=0x7f63800a63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 1 --2- 172.21.15.5:0/1436700739 >> v2:172.21.15.157:3300/0 conn(0x7f63800a0cd0 0x7f63800a63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 10 monclient: _finish_hunting 0 2024-08-18T21:08:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 1 monclient: found mon.noname-a 2024-08-18T21:08:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:08:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f6385edc640 1 -- 172.21.15.5:0/1436700739 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638006de40 con 0x7f6380139c60 2024-08-18T21:08:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.638+0000 7f63856db640 1 --2- 172.21.15.5:0/1436700739 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f63800a5ac0 0x7f63800a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:08:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f6385edc640 1 -- 172.21.15.5:0/1436700739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6380139c60 msgr2=0x7f638013a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f6385edc640 1 --2- 172.21.15.5:0/1436700739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6380139c60 0x7f638013a0f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f63800a7660 tx=0x7f637801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba9f5aa77da730 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f6377fff640 1 -- 172.21.15.5:0/1436700739 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63780090d0 con 0x7f6380139c60 2024-08-18T21:08:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f6377fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f6377fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:08:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f6377fff640 10 monclient: dump: 2024-08-18T21:08:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.655 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f6377fff640 10 monclient: _finish_auth 0 2024-08-18T21:08:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f6377fff640 10 monclient: _check_auth_tickets 2024-08-18T21:08:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f6377fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 5 monclient: authenticate success, global_id 84150 2024-08-18T21:08:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:08:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f6377fff640 1 -- 172.21.15.5:0/1436700739 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63780a5b70 con 0x7f6380139c60 2024-08-18T21:08:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f6377fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 4 set_mon_vals no callback set 2024-08-18T21:08:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f6377fff640 1 -- 172.21.15.5:0/1436700739 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63780a5d20 con 0x7f6380139c60 2024-08-18T21:08:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f6377fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f6377fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:08:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f6377fff640 10 monclient: dump: 2024-08-18T21:08:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.658 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 10 monclient: shutdown 2024-08-18T21:08:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 1 -- 172.21.15.5:0/1436700739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6380139c60 msgr2=0x7f638013a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 1 --2- 172.21.15.5:0/1436700739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6380139c60 0x7f638013a0f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f63800a7660 tx=0x7f637801c880 comp rx=0 tx=0).stop 2024-08-18T21:08:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 1 -- 172.21.15.5:0/1436700739 shutdown_connections 2024-08-18T21:08:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 1 --2- 172.21.15.5:0/1436700739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6380139c60 0x7f638013a0f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 1 --2- 172.21.15.5:0/1436700739 >> v2:172.21.15.157:3300/0 conn(0x7f63800a0cd0 0x7f63800a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 1 --2- 172.21.15.5:0/1436700739 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f63800a5ac0 0x7f63800a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 1 -- 172.21.15.5:0/1436700739 >> 172.21.15.5:0/1436700739 conn(0x7f63800aa770 msgr2=0x7f63800a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 1 -- 172.21.15.5:0/1436700739 shutdown_connections 2024-08-18T21:08:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 1 -- 172.21.15.5:0/1436700739 wait complete. 2024-08-18T21:08:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 10 monclient: build_initial_monmap 2024-08-18T21:08:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.642+0000 7f638793f640 10 monclient: monmap: 2024-08-18T21:08:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:38.661 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:38.661 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:38.661 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:38.661 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:38.661 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 1 Processor -- start 2024-08-18T21:08:38.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 1 -- start start 2024-08-18T21:08:38.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 10 monclient: init 2024-08-18T21:08:38.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:38.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 10 monclient: _add_conns ranks=[7,4,8,1,2,0,5,6,3] 2024-08-18T21:08:38.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f63800a0cd0 0x7f63801386b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 10 monclient(hunting): picked mon.noname-i con 0x7f63800a0cd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63800a5ac0 0x7f6380138bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 10 monclient(hunting): picked mon.noname-c con 0x7f63800a5ac0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6380139c60 0x7f638013ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 10 monclient(hunting): picked mon.noname-e con 0x7f6380139c60 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:08:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f63800a7870 con 0x7f63800a5ac0 2024-08-18T21:08:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f63800a76f0 con 0x7f63800a0cd0 2024-08-18T21:08:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f638006e160 con 0x7f6380139c60 2024-08-18T21:08:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f638793f640 10 monclient(hunting): authenticate will time out at 1285.660900s 2024-08-18T21:08:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6384eda640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63800a5ac0 0x7f6380138bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6384eda640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63800a5ac0 0x7f6380138bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:54960/0 (socket says 172.21.15.5:54960) 2024-08-18T21:08:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6384eda640 1 -- 172.21.15.5:0/1791600488 learned_addr learned my addr 172.21.15.5:0/1791600488 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6384eda640 10 monclient(hunting): get_auth_request con 0x7f63800a5ac0 auth_method 0 2024-08-18T21:08:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6384eda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6384eda640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6384eda640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6380139c60 0x7f638013ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 10 monclient(hunting): get_auth_request con 0x7f6380139c60 auth_method 0 2024-08-18T21:08:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6384eda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6384eda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6384eda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f63856db640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f63800a0cd0 0x7f63801386b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f63856db640 10 monclient(hunting): get_auth_request con 0x7f63800a0cd0 auth_method 0 2024-08-18T21:08:38.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f63856db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f63856db640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f63856db640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 10 monclient(hunting): handle_auth_done global_id 54728 payload 824 2024-08-18T21:08:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 1 -- 172.21.15.5:0/1791600488 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f63800a0cd0 msgr2=0x7f63801386b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f63800a0cd0 0x7f63801386b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 1 -- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63800a5ac0 msgr2=0x7f6380138bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63800a5ac0 0x7f6380138bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 10 monclient: _finish_hunting 0 2024-08-18T21:08:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 1 monclient: found mon.noname-e 2024-08-18T21:08:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:08:38.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 1 -- 172.21.15.5:0/1791600488 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638013f2b0 con 0x7f6380139c60 2024-08-18T21:08:38.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6384eda640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f63800a5ac0 0x7f6380138bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:08:38.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 1 -- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6380139c60 msgr2=0x7f638013ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:38.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6385edc640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6380139c60 0x7f638013ba70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f63780ae000 tx=0x7f6378019620 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.646+0000 7f6375ffb640 1 -- 172.21.15.5:0/1791600488 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63780bc030 con 0x7f6380139c60 2024-08-18T21:08:38.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:08:38.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 10 monclient: dump: 2024-08-18T21:08:38.667 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.667 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.667 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.667 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.667 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.668 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 10 monclient: _finish_auth 0 2024-08-18T21:08:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:08:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 1 -- 172.21.15.5:0/1791600488 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6378003dc0 con 0x7f6380139c60 2024-08-18T21:08:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f638793f640 5 monclient: authenticate success, global_id 54728 2024-08-18T21:08:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f638793f640 10 monclient: _renew_subs 2024-08-18T21:08:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f638793f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:08:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f638793f640 1 -- 172.21.15.5:0/1791600488 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f638013f590 con 0x7f6380139c60 2024-08-18T21:08:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 1 -- 172.21.15.5:0/1791600488 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63780b7450 con 0x7f6380139c60 2024-08-18T21:08:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f63777fe640 4 set_mon_vals no callback set 2024-08-18T21:08:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 10 monclient: dump: 2024-08-18T21:08:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.671 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f638793f640 10 monclient: _renew_subs 2024-08-18T21:08:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f638793f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:08:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f638793f640 1 -- 172.21.15.5:0/1791600488 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f638013efd0 con 0x7f6380139c60 2024-08-18T21:08:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f638793f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f638793f640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f638013bfb0 0x7f638013c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f638793f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f638793f640 1 -- 172.21.15.5:0/1791600488 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f638013e070 con 0x7f638013bfb0 2024-08-18T21:08:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 1 -- 172.21.15.5:0/1791600488 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f63780bf070 con 0x7f6380139c60 2024-08-18T21:08:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f63856db640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f638013bfb0 0x7f638013c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f63856db640 10 monclient: get_auth_request con 0x7f638013bfb0 auth_method 0 2024-08-18T21:08:38.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f63856db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f63856db640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f63856db640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 1 --2- 172.21.15.5:0/1791600488 >> v2:172.21.15.157:6812/631023601 conn(0x7f636403bdc0 0x7f636403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f63856db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f63856db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f63856db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 1 -- 172.21.15.5:0/1791600488 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(141..141 src has 22..141) ==== 3898+0+0 (secure 0 0 0) 0x7f63780bd070 con 0x7f6380139c60 2024-08-18T21:08:38.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f63856db640 10 monclient(hunting): handle_auth_done global_id 84125 payload 824 2024-08-18T21:08:38.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f63856db640 1 -- 172.21.15.5:0/1791600488 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f638013d9b0 con 0x7f638013bfb0 2024-08-18T21:08:38.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6384eda640 1 --2- 172.21.15.5:0/1791600488 >> v2:172.21.15.157:6812/631023601 conn(0x7f636403bdc0 0x7f636403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6384eda640 10 monclient: get_auth_request con 0x7f636403bdc0 auth_method 0 2024-08-18T21:08:38.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f63856db640 1 -- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f638013bfb0 msgr2=0x7f638013c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:38.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f63856db640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f638013bfb0 0x7f638013c390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f637c011530 tx=0x7f637c0119f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 1 -- 172.21.15.5:0/1791600488 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f637c00fe20 con 0x7f638013bfb0 2024-08-18T21:08:38.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.650+0000 7f6375ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.654+0000 7f6375ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:08:38.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.654+0000 7f6375ffb640 10 monclient: dump: 2024-08-18T21:08:38.675 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.675 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.675 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.675 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.675 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.675 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.675 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.676 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.676 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.676 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.676 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.676 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.676 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.676 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.676 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.676 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.654+0000 7f6375ffb640 1 -- 172.21.15.5:0/1791600488 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f637c00f9b0 con 0x7f638013bfb0 2024-08-18T21:08:38.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.654+0000 7f6375ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:38.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.654+0000 7f6375ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:38.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.654+0000 7f6375ffb640 1 -- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f638013bfb0 msgr2=0x7f638013c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.654+0000 7f6375ffb640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f638013bfb0 0x7f638013c390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f637c011530 tx=0x7f637c0119f0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.654+0000 7f6375ffb640 1 -- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f638013bfb0 msgr2=0x7f638013c390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.654+0000 7f6375ffb640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f638013bfb0 0x7f638013c390 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f637c011530 tx=0x7f637c0119f0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.654+0000 7f6384eda640 1 --2- 172.21.15.5:0/1791600488 >> v2:172.21.15.157:6812/631023601 conn(0x7f636403bdc0 0x7f636403e280 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f637000bf80 tx=0x7f6370008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.658+0000 7f638793f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.658+0000 7f638793f640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f638013c8d0 0x7f63800710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.658+0000 7f638793f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.658+0000 7f638793f640 1 -- 172.21.15.5:0/1791600488 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f6380051140 con 0x7f638013c8d0 2024-08-18T21:08:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.658+0000 7f63856db640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f638013c8d0 0x7f63800710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.658+0000 7f63856db640 10 monclient: get_auth_request con 0x7f638013c8d0 auth_method 0 2024-08-18T21:08:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.658+0000 7f63856db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.658+0000 7f63856db640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.658+0000 7f63856db640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.658+0000 7f63856db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.658+0000 7f63856db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.658+0000 7f63856db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.658+0000 7f63856db640 10 monclient(hunting): handle_auth_done global_id 84134 payload 824 2024-08-18T21:08:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.658+0000 7f63856db640 1 -- 172.21.15.5:0/1791600488 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f638006d010 con 0x7f638013c8d0 2024-08-18T21:08:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f63856db640 1 -- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f638013c8d0 msgr2=0x7f63800710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f63856db640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f638013c8d0 0x7f63800710b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f637c011530 tx=0x7f637c004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f6375ffb640 1 -- 172.21.15.5:0/1791600488 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f637c003620 con 0x7f638013c8d0 2024-08-18T21:08:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f6375ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f6375ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:08:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f6375ffb640 10 monclient: dump: 2024-08-18T21:08:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.680 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f6375ffb640 1 -- 172.21.15.5:0/1791600488 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f637c004240 con 0x7f638013c8d0 2024-08-18T21:08:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f6375ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f6375ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f6375ffb640 1 -- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f638013c8d0 msgr2=0x7f63800710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f6375ffb640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f638013c8d0 0x7f63800710b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f637c011530 tx=0x7f637c004740 comp rx=0 tx=0).stop 2024-08-18T21:08:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f6375ffb640 1 -- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f638013c8d0 msgr2=0x7f63800710b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f6375ffb640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f638013c8d0 0x7f63800710b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.681 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:38.681 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:38.681 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:38.681 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:38.681 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:38.681 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15491, 2024-08-18T21:08:38.681 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:38.681 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:38.682 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:38.682 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:38.682 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:38.682 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:38.682 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:38.682 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:38.682 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:38.682 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:38.682 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:38.682 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:08:38.682 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:38.682 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:38.682 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:38.683 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:38.683 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:38.683 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:38.683 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:38.683 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:38.683 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:38.683 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:38.683 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:38.683 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:38.683 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:38.683 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:38.683 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:38.683 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:38.683 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:38.684 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:38.684 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:38.684 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:38.684 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:38.684 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:38.684 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:38.684 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:38.684 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:38.684 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:38.684 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:38.684 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:38.684 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.704 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.704 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:38.704 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f638793f640 1 -- 172.21.15.5:0/1791600488 >> v2:172.21.15.157:6812/631023601 conn(0x7f636403bdc0 msgr2=0x7f636403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f638793f640 1 --2- 172.21.15.5:0/1791600488 >> v2:172.21.15.157:6812/631023601 conn(0x7f636403bdc0 0x7f636403e280 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f637000bf80 tx=0x7f6370008040 comp rx=0 tx=0).stop 2024-08-18T21:08:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f638793f640 10 monclient: shutdown 2024-08-18T21:08:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f638793f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f638793f640 1 -- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6380139c60 msgr2=0x7f638013ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f638793f640 1 --2- 172.21.15.5:0/1791600488 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6380139c60 0x7f638013ba70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f63780ae000 tx=0x7f6378019620 comp rx=0 tx=0).stop 2024-08-18T21:08:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f6385edc640 1 -- 172.21.15.5:0/1791600488 reap_dead start 2024-08-18T21:08:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f6385edc640 1 -- 172.21.15.5:0/1791600488 reap_dead start 2024-08-18T21:08:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f638793f640 1 -- 172.21.15.5:0/1791600488 shutdown_connections 2024-08-18T21:08:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f638793f640 1 -- 172.21.15.5:0/1791600488 >> 172.21.15.5:0/1791600488 conn(0x7f63800aa770 msgr2=0x7f63800a8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f638793f640 1 -- 172.21.15.5:0/1791600488 shutdown_connections 2024-08-18T21:08:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.662+0000 7f638793f640 1 -- 172.21.15.5:0/1791600488 wait complete. 2024-08-18T21:08:38.706 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:38.706 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:08:38.707 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:08:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 10 monclient: get_monmap_and_config 2024-08-18T21:08:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 10 monclient: build_initial_monmap 2024-08-18T21:08:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 10 monclient: monmap: 2024-08-18T21:08:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:38.833744+0000 2024-08-18T21:08:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:38.833744+0000 2024-08-18T21:08:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:38.834 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 1 Processor -- start 2024-08-18T21:08:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 1 -- start start 2024-08-18T21:08:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 10 monclient: init 2024-08-18T21:08:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 10 monclient: _add_conns ranks=[9,6,1,3,0,4,5,8,7,2,10] 2024-08-18T21:08:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13b809b8c0 0x7f13b8068700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 10 monclient(hunting): picked mon.noname-a con 0x7f13b809b8c0 addr v2:172.21.15.5:3300/0 2024-08-18T21:08:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f13b809bca0 0x7f13b8068c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 10 monclient(hunting): picked mon.noname-d con 0x7f13b809bca0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f13b8069180 addr v1:172.21.15.157:6789/0 2024-08-18T21:08:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13b80a9290 con 0x7f13b8069180 2024-08-18T21:08:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f13b80a1b50 con 0x7f13b809b8c0 2024-08-18T21:08:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f13b80a1e30 con 0x7f13b809bca0 2024-08-18T21:08:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bfd5e640 10 monclient(hunting): authenticate will time out at 1285.847324s 2024-08-18T21:08:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f13b809bca0 0x7f13b8068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f13b809bca0 0x7f13b8068c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:40266/0 (socket says 172.21.15.5:40266) 2024-08-18T21:08:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 1 -- 172.21.15.5:0/2053091108 learned_addr learned my addr 172.21.15.5:0/2053091108 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 10 monclient(hunting): get_auth_request con 0x7f13b809bca0 auth_method 0 2024-08-18T21:08:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bdafa640 1 --2- 172.21.15.5:0/2053091108 >> v2:172.21.15.5:3300/0 conn(0x7f13b809b8c0 0x7f13b8068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bdafa640 10 monclient(hunting): get_auth_request con 0x7f13b809b8c0 auth_method 0 2024-08-18T21:08:38.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bdafa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bdafa640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bdafa640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bdafa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bdafa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bdafa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 10 monclient(hunting): handle_auth_done global_id 84147 payload 274 2024-08-18T21:08:38.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 1 -- 172.21.15.5:0/2053091108 >> v2:172.21.15.5:3300/0 conn(0x7f13b809b8c0 msgr2=0x7f13b8068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:38.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 1 --2- 172.21.15.5:0/2053091108 >> v2:172.21.15.5:3300/0 conn(0x7f13b809b8c0 0x7f13b8068700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 1 -- 172.21.15.5:0/2053091108 >> v1:172.21.15.157:6789/0 conn(0x7f13b8069180 legacy=0x7f13b813d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:38.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 10 monclient: _finish_hunting 0 2024-08-18T21:08:38.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 1 monclient: found mon.noname-d 2024-08-18T21:08:38.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:38.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:08:38.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.830+0000 7f13bd2f9640 1 -- 172.21.15.5:0/2053091108 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b80a2880 con 0x7f13b809bca0 2024-08-18T21:08:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.834+0000 7f13bd2f9640 1 -- 172.21.15.5:0/2053091108 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f13b809bca0 msgr2=0x7f13b8068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.834+0000 7f13bd2f9640 1 --2- 172.21.15.5:0/2053091108 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f13b809bca0 0x7f13b8068c40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009870 tx=0x7f13a801c4b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=bb4b6b06bb945255 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bcaf8640 1 -- 172.21.15.5:0/2053091108 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13a80b0070 con 0x7f13b809bca0 2024-08-18T21:08:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bcaf8640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bcaf8640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:08:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bcaf8640 10 monclient: dump: 2024-08-18T21:08:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.848 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.849 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.849 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.849 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.850 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.850 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.850 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.850 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.850 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.850 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bcaf8640 10 monclient: _finish_auth 0 2024-08-18T21:08:38.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bcaf8640 10 monclient: _check_auth_tickets 2024-08-18T21:08:38.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bcaf8640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:38.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bcaf8640 1 -- 172.21.15.5:0/2053091108 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13a80aa810 con 0x7f13b809bca0 2024-08-18T21:08:38.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bcaf8640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:38.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bcaf8640 1 -- 172.21.15.5:0/2053091108 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13a80a9300 con 0x7f13b809bca0 2024-08-18T21:08:38.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bcaf8640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bcaf8640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:08:38.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bcaf8640 10 monclient: dump: 2024-08-18T21:08:38.851 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.851 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.851 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.851 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.851 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.851 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.851 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.852 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.852 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.852 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.852 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.852 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.852 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.852 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.852 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.852 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 5 monclient: authenticate success, global_id 84147 2024-08-18T21:08:38.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:38.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 4 set_mon_vals no callback set 2024-08-18T21:08:38.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 10 monclient: shutdown 2024-08-18T21:08:38.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:38.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 1 -- 172.21.15.5:0/2053091108 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f13b809bca0 msgr2=0x7f13b8068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 1 --2- 172.21.15.5:0/2053091108 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f13b809bca0 0x7f13b8068c40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009870 tx=0x7f13a801c4b0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 1 -- 172.21.15.5:0/2053091108 shutdown_connections 2024-08-18T21:08:38.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 1 --2- 172.21.15.5:0/2053091108 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f13b809bca0 0x7f13b8068c40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 1 --2- 172.21.15.5:0/2053091108 >> v2:172.21.15.5:3300/0 conn(0x7f13b809b8c0 0x7f13b8068700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 1 -- 172.21.15.5:0/2053091108 >> 172.21.15.5:0/2053091108 conn(0x7f13b80a8480 msgr2=0x7f13b80a8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:38.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 1 -- 172.21.15.5:0/2053091108 shutdown_connections 2024-08-18T21:08:38.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 1 -- 172.21.15.5:0/2053091108 wait complete. 2024-08-18T21:08:38.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 10 monclient: build_initial_monmap 2024-08-18T21:08:38.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 10 monclient: monmap: 2024-08-18T21:08:38.854 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:38.854 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:38.854 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:38.854 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:38.854 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:38.854 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.854 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:38.854 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:38.855 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:38.855 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:38.855 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:38.855 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:38.855 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:38.855 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:38.855 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:38.855 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 1 Processor -- start 2024-08-18T21:08:38.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 1 -- start start 2024-08-18T21:08:38.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 10 monclient: init 2024-08-18T21:08:38.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:38.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 10 monclient: _add_conns ranks=[0,8,4,2,1,7,5,3,6] 2024-08-18T21:08:38.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b8069180 0x7f13b8098910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 10 monclient(hunting): picked mon.noname-a con 0x7f13b8069180 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:08:38.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13b809b8c0 0x7f13b8093880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 10 monclient(hunting): picked mon.noname-e con 0x7f13b809b8c0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:08:38.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b809bca0 0x7f13b8093dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 10 monclient(hunting): picked mon.noname-c con 0x7f13b809bca0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:38.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f13b81417d0 con 0x7f13b8069180 2024-08-18T21:08:38.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f13b809cb50 con 0x7f13b809bca0 2024-08-18T21:08:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f13b8141950 con 0x7f13b809b8c0 2024-08-18T21:08:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bfd5e640 10 monclient(hunting): authenticate will time out at 1285.854513s 2024-08-18T21:08:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b809bca0 0x7f13b8093dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bdafa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b8069180 0x7f13b8098910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bd2f9640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13b809b8c0 0x7f13b8093880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bdafa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b8069180 0x7f13b8098910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51760/0 (socket says 172.21.15.5:51760) 2024-08-18T21:08:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bd2f9640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13b809b8c0 0x7f13b8093880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:45226/0 (socket says 172.21.15.5:45226) 2024-08-18T21:08:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bdafa640 1 -- 172.21.15.5:0/4089259724 learned_addr learned my addr 172.21.15.5:0/4089259724 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b809bca0 0x7f13b8093dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:54974/0 (socket says 172.21.15.5:54974) 2024-08-18T21:08:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 10 monclient(hunting): get_auth_request con 0x7f13b809bca0 auth_method 0 2024-08-18T21:08:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bd2f9640 10 monclient(hunting): get_auth_request con 0x7f13b809b8c0 auth_method 0 2024-08-18T21:08:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bd2f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bd2f9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bd2f9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bdafa640 10 monclient(hunting): get_auth_request con 0x7f13b8069180 auth_method 0 2024-08-18T21:08:38.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bdafa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bdafa640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bdafa640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bd2f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bd2f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bd2f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bdafa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bdafa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13bdafa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 10 monclient(hunting): handle_auth_done global_id 5719 payload 824 2024-08-18T21:08:38.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 1 -- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13b809b8c0 msgr2=0x7f13b8093880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 1 --2- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13b809b8c0 0x7f13b8093880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 1 -- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b8069180 msgr2=0x7f13b8098910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 1 --2- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b8069180 0x7f13b8098910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 10 monclient: _finish_hunting 0 2024-08-18T21:08:38.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 1 monclient: found mon.noname-c 2024-08-18T21:08:38.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:38.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:08:38.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.838+0000 7f13be2fb640 1 -- 172.21.15.5:0/4089259724 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b8095370 con 0x7f13b809bca0 2024-08-18T21:08:38.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13be2fb640 1 -- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b809bca0 msgr2=0x7f13b8093dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:38.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13be2fb640 1 --2- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b809bca0 0x7f13b8093dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f13b000c7b0 tx=0x7f13b000cc70 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13ae7fc640 1 -- 172.21.15.5:0/4089259724 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13b0016020 con 0x7f13b809bca0 2024-08-18T21:08:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13ae7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:08:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13ae7fc640 10 monclient: dump: 2024-08-18T21:08:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.862 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.862 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.862 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.862 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.862 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.862 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.862 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.862 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.862 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13ae7fc640 10 monclient: _finish_auth 0 2024-08-18T21:08:38.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13ae7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:08:38.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13ae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:38.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13ae7fc640 1 -- 172.21.15.5:0/4089259724 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b0012420 con 0x7f13b809bca0 2024-08-18T21:08:38.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bfd5e640 5 monclient: authenticate success, global_id 5719 2024-08-18T21:08:38.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bfd5e640 10 monclient: _renew_subs 2024-08-18T21:08:38.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bfd5e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:08:38.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bfd5e640 1 -- 172.21.15.5:0/4089259724 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b809d7a0 con 0x7f13b809bca0 2024-08-18T21:08:38.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13ae7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:38.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13ae7fc640 1 -- 172.21.15.5:0/4089259724 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13b000ce60 con 0x7f13b809bca0 2024-08-18T21:08:38.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13ae7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:08:38.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13ae7fc640 10 monclient: dump: 2024-08-18T21:08:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.865 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.865 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.865 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.865 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bfd5e640 10 monclient: _renew_subs 2024-08-18T21:08:38.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13affff640 4 set_mon_vals no callback set 2024-08-18T21:08:38.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bfd5e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:08:38.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bfd5e640 1 -- 172.21.15.5:0/4089259724 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b8096e30 con 0x7f13b809bca0 2024-08-18T21:08:38.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bfd5e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:38.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bfd5e640 1 --2- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b8094300 0x7f13b808efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bfd5e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bfd5e640 1 -- 172.21.15.5:0/4089259724 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f13b8051140 con 0x7f13b8094300 2024-08-18T21:08:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bdafa640 1 --2- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b8094300 0x7f13b808efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bdafa640 10 monclient: get_auth_request con 0x7f13b8094300 auth_method 0 2024-08-18T21:08:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bdafa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bdafa640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bdafa640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bdafa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bdafa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bdafa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13ae7fc640 1 -- 172.21.15.5:0/4089259724 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f13b0019020 con 0x7f13b809bca0 2024-08-18T21:08:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bdafa640 10 monclient(hunting): handle_auth_done global_id 5728 payload 824 2024-08-18T21:08:38.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bdafa640 1 -- 172.21.15.5:0/4089259724 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13b80a5380 con 0x7f13b8094300 2024-08-18T21:08:38.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13ae7fc640 1 --2- 172.21.15.5:0/4089259724 >> v2:172.21.15.157:6812/631023601 conn(0x7f139c03bdf0 0x7f139c03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13ae7fc640 1 -- 172.21.15.5:0/4089259724 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(141..141 src has 22..141) ==== 3898+0+0 (secure 0 0 0) 0x7f13b004e7d0 con 0x7f13b809bca0 2024-08-18T21:08:38.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bd2f9640 1 --2- 172.21.15.5:0/4089259724 >> v2:172.21.15.157:6812/631023601 conn(0x7f139c03bdf0 0x7f139c03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.842+0000 7f13bd2f9640 10 monclient: get_auth_request con 0x7f139c03bdf0 auth_method 0 2024-08-18T21:08:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.846+0000 7f13bdafa640 1 -- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b8094300 msgr2=0x7f13b808efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.846+0000 7f13bdafa640 1 --2- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b8094300 0x7f13b808efc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f13b40119c0 tx=0x7f13b4011e80 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.846+0000 7f13ae7fc640 1 -- 172.21.15.5:0/4089259724 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13b4019070 con 0x7f13b8094300 2024-08-18T21:08:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.846+0000 7f13ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.846+0000 7f13ae7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:08:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.846+0000 7f13ae7fc640 10 monclient: dump: 2024-08-18T21:08:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.871 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.871 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.871 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.871 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.871 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.871 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.871 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.871 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.871 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.871 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.871 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.872 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.846+0000 7f13ae7fc640 1 -- 172.21.15.5:0/4089259724 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f13b400f960 con 0x7f13b8094300 2024-08-18T21:08:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.846+0000 7f13ae7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.846+0000 7f13ae7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.846+0000 7f13ae7fc640 1 -- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b8094300 msgr2=0x7f13b808efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.846+0000 7f13ae7fc640 1 --2- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b8094300 0x7f13b808efc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f13b40119c0 tx=0x7f13b4011e80 comp rx=0 tx=0).stop 2024-08-18T21:08:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.846+0000 7f13ae7fc640 1 -- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b8094300 msgr2=0x7f13b808efc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.846+0000 7f13ae7fc640 1 --2- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b8094300 0x7f13b808efc0 secure :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f13b40119c0 tx=0x7f13b4011e80 comp rx=0 tx=0).stop 2024-08-18T21:08:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.846+0000 7f13bd2f9640 1 --2- 172.21.15.5:0/4089259724 >> v2:172.21.15.157:6812/631023601 conn(0x7f139c03bdf0 0x7f139c03e2b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f13a80ab000 tx=0x7f13a80a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bfd5e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bfd5e640 1 --2- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b808f500 0x7f13b808f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bfd5e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bfd5e640 1 -- 172.21.15.5:0/4089259724 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f13b8069fa0 con 0x7f13b808f500 2024-08-18T21:08:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bdafa640 1 --2- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b808f500 0x7f13b808f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bdafa640 10 monclient: get_auth_request con 0x7f13b808f500 auth_method 0 2024-08-18T21:08:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bdafa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bdafa640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bdafa640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bdafa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bdafa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bdafa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bdafa640 10 monclient(hunting): handle_auth_done global_id 5737 payload 824 2024-08-18T21:08:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bdafa640 1 -- 172.21.15.5:0/4089259724 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f13b80946e0 con 0x7f13b808f500 2024-08-18T21:08:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bdafa640 1 -- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b808f500 msgr2=0x7f13b808f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bdafa640 1 --2- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b808f500 0x7f13b808f8e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f13b40119c0 tx=0x7f13b40046d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13ae7fc640 1 -- 172.21.15.5:0/4089259724 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13b4019040 con 0x7f13b808f500 2024-08-18T21:08:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13ae7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:08:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13ae7fc640 10 monclient: dump: 2024-08-18T21:08:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:38.876 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13ae7fc640 1 -- 172.21.15.5:0/4089259724 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f13b401e450 con 0x7f13b808f500 2024-08-18T21:08:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13ae7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13ae7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13ae7fc640 1 -- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b808f500 msgr2=0x7f13b808f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13ae7fc640 1 --2- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b808f500 0x7f13b808f8e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f13b40119c0 tx=0x7f13b40046d0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13ae7fc640 1 -- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b808f500 msgr2=0x7f13b808f8e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13ae7fc640 1 --2- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b808f500 0x7f13b808f8e0 secure :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f13b40119c0 tx=0x7f13b40046d0 comp rx=0 tx=0).stop 2024-08-18T21:08:38.877 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 327972, 2024-08-18T21:08:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:08:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.888 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.888 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:38.888 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.888 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.888 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.888 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:38.888 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:38.888 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.888 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.888 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:08:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:08:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:38.906 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:38.906 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bfd5e640 1 -- 172.21.15.5:0/4089259724 >> v2:172.21.15.157:6812/631023601 conn(0x7f139c03bdf0 msgr2=0x7f139c03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bfd5e640 1 --2- 172.21.15.5:0/4089259724 >> v2:172.21.15.157:6812/631023601 conn(0x7f139c03bdf0 0x7f139c03e2b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f13a80ab000 tx=0x7f13a80a6000 comp rx=0 tx=0).stop 2024-08-18T21:08:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bfd5e640 10 monclient: shutdown 2024-08-18T21:08:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bfd5e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bfd5e640 1 -- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b809bca0 msgr2=0x7f13b8093dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bfd5e640 1 --2- 172.21.15.5:0/4089259724 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13b809bca0 0x7f13b8093dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f13b000c7b0 tx=0x7f13b000cc70 comp rx=0 tx=0).stop 2024-08-18T21:08:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13be2fb640 1 -- 172.21.15.5:0/4089259724 reap_dead start 2024-08-18T21:08:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13be2fb640 1 -- 172.21.15.5:0/4089259724 reap_dead start 2024-08-18T21:08:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bfd5e640 1 -- 172.21.15.5:0/4089259724 shutdown_connections 2024-08-18T21:08:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bfd5e640 1 -- 172.21.15.5:0/4089259724 >> 172.21.15.5:0/4089259724 conn(0x7f13b80a8480 msgr2=0x7f13b80747b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bfd5e640 1 -- 172.21.15.5:0/4089259724 shutdown_connections 2024-08-18T21:08:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:38.854+0000 7f13bfd5e640 1 -- 172.21.15.5:0/4089259724 wait complete. 2024-08-18T21:08:38.908 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:38.909 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:08:38.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:08:39.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 10 monclient: get_monmap_and_config 2024-08-18T21:08:39.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 10 monclient: build_initial_monmap 2024-08-18T21:08:39.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 10 monclient: monmap: 2024-08-18T21:08:39.028 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:39.028 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.028 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:39.028536+0000 2024-08-18T21:08:39.028 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:39.028536+0000 2024-08-18T21:08:39.028 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:39.029 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.029 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:39.029 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:39.029 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:39.029 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:39.029 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:39.029 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:39.029 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:39.029 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:39.029 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:39.029 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:39.029 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:39.030 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 1 Processor -- start 2024-08-18T21:08:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 1 -- start start 2024-08-18T21:08:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 10 monclient: init 2024-08-18T21:08:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 10 monclient: _add_conns ranks=[1,4,7,5,6,10,9,8,0,2,3] 2024-08-18T21:08:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f79fc0a4000 addr v1:172.21.15.157:6789/0 2024-08-18T21:08:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79fc0a43e0 0x7f79fc0a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 10 monclient(hunting): picked mon.noname-c con 0x7f79fc0a43e0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79fc068700 0x7f79fc13e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 10 monclient(hunting): picked mon.noname-i con 0x7f79fc068700 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:39.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79fc0a2870 con 0x7f79fc0a4000 2024-08-18T21:08:39.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f79fc09fbd0 con 0x7f79fc0a43e0 2024-08-18T21:08:39.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f79fc0a5f60 con 0x7f79fc068700 2024-08-18T21:08:39.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:39.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a045ff640 10 monclient(hunting): authenticate will time out at 1286.041812s 2024-08-18T21:08:39.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a01b9a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79fc0a43e0 0x7f79fc0a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a01b9a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79fc0a43e0 0x7f79fc0a47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:55000/0 (socket says 172.21.15.5:55000) 2024-08-18T21:08:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a01b9a640 1 -- 172.21.15.5:0/1078340448 learned_addr learned my addr 172.21.15.5:0/1078340448 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a01b9a640 10 monclient(hunting): get_auth_request con 0x7f79fc0a43e0 auth_method 0 2024-08-18T21:08:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a01b9a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a01b9a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a01b9a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a01b9a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a01b9a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a01b9a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a01b9a640 1 -- 172.21.15.5:0/1078340448 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79fc0a43e0 msgr2=0x7f79fc0a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:08:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a01b9a640 1 -- 172.21.15.5:0/1078340448 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79fc0a43e0 msgr2=0x7f79fc0a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:08:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a01b9a640 1 --2- 172.21.15.5:0/1078340448 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79fc0a43e0 0x7f79fc0a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:08:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a01b9a640 1 --2- 172.21.15.5:0/1078340448 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79fc0a43e0 0x7f79fc0a47c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 1 --2- 172.21.15.5:0/1078340448 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79fc068700 0x7f79fc13e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 10 monclient(hunting): get_auth_request con 0x7f79fc068700 auth_method 0 2024-08-18T21:08:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 10 monclient(hunting): handle_auth_done global_id 5542 payload 274 2024-08-18T21:08:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 1 -- 172.21.15.5:0/1078340448 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79fc0a43e0 msgr2=0x7f79fc0a47c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:08:39.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 1 --2- 172.21.15.5:0/1078340448 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79fc0a43e0 0x7f79fc0a47c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 1 -- 172.21.15.5:0/1078340448 >> v1:172.21.15.157:6789/0 conn(0x7f79fc0a4000 legacy=0x7f79fc0a2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:39.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 10 monclient: _finish_hunting 0 2024-08-18T21:08:39.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 1 monclient: found mon.noname-i 2024-08-18T21:08:39.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:39.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:08:39.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.026+0000 7f7a02b9c640 1 -- 172.21.15.5:0/1078340448 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79fc0a05e0 con 0x7f79fc068700 2024-08-18T21:08:39.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.030+0000 7f7a02b9c640 1 -- 172.21.15.5:0/1078340448 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79fc068700 msgr2=0x7f79fc13e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.030+0000 7f7a02b9c640 1 --2- 172.21.15.5:0/1078340448 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79fc068700 0x7f79fc13e250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f79f80097f0 tx=0x7f79f801c370 comp rx=0 tx=0).ready entity=mon.7 client_cookie=b8796cc9f5c79ace server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.034+0000 7f7a01399640 1 -- 172.21.15.5:0/1078340448 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f79f80b0070 con 0x7f79fc068700 2024-08-18T21:08:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.034+0000 7f7a01399640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.034+0000 7f7a01399640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:08:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.034+0000 7f7a01399640 10 monclient: dump: 2024-08-18T21:08:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.041 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.041 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.041 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.041 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.041 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.034+0000 7f7a01399640 10 monclient: _finish_auth 0 2024-08-18T21:08:39.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.034+0000 7f7a01399640 10 monclient: _check_auth_tickets 2024-08-18T21:08:39.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.034+0000 7f7a01399640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:39.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.034+0000 7f7a045ff640 5 monclient: authenticate success, global_id 5542 2024-08-18T21:08:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.034+0000 7f7a01399640 1 -- 172.21.15.5:0/1078340448 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79f80aa3a0 con 0x7f79fc068700 2024-08-18T21:08:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.034+0000 7f7a01399640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.034+0000 7f7a045ff640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.034+0000 7f7a045ff640 4 set_mon_vals no callback set 2024-08-18T21:08:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.034+0000 7f7a01399640 1 -- 172.21.15.5:0/1078340448 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f79f80aaa00 con 0x7f79fc068700 2024-08-18T21:08:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.034+0000 7f7a01399640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.034+0000 7f7a01399640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:08:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.034+0000 7f7a01399640 10 monclient: dump: 2024-08-18T21:08:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.044 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.044 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.044 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 10 monclient: shutdown 2024-08-18T21:08:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 1 -- 172.21.15.5:0/1078340448 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79fc068700 msgr2=0x7f79fc13e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 1 --2- 172.21.15.5:0/1078340448 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79fc068700 0x7f79fc13e250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f79f80097f0 tx=0x7f79f801c370 comp rx=0 tx=0).stop 2024-08-18T21:08:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 1 -- 172.21.15.5:0/1078340448 shutdown_connections 2024-08-18T21:08:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 1 --2- 172.21.15.5:0/1078340448 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79fc0a43e0 0x7f79fc0a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 1 --2- 172.21.15.5:0/1078340448 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79fc068700 0x7f79fc13e250 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 1 -- 172.21.15.5:0/1078340448 >> 172.21.15.5:0/1078340448 conn(0x7f79fc0a50f0 msgr2=0x7f79fc0a54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 1 -- 172.21.15.5:0/1078340448 shutdown_connections 2024-08-18T21:08:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 1 -- 172.21.15.5:0/1078340448 wait complete. 2024-08-18T21:08:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 10 monclient: build_initial_monmap 2024-08-18T21:08:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 10 monclient: monmap: 2024-08-18T21:08:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:39.053 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 1 Processor -- start 2024-08-18T21:08:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 1 -- start start 2024-08-18T21:08:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 10 monclient: init 2024-08-18T21:08:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 10 monclient: _add_conns ranks=[7,6,3,5,0,1,4,2,8] 2024-08-18T21:08:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79fc068700 0x7f79fc13b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 10 monclient(hunting): picked mon.noname-i con 0x7f79fc068700 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc0a4000 0x7f79fc1d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 10 monclient(hunting): picked mon.noname-d con 0x7f79fc0a4000 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79fc0a43e0 0x7f79fc1d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 10 monclient(hunting): picked mon.noname-g con 0x7f79fc0a43e0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f79fc141130 con 0x7f79fc0a43e0 2024-08-18T21:08:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f79fc140fb0 con 0x7f79fc0a4000 2024-08-18T21:08:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f79fc1412b0 con 0x7f79fc068700 2024-08-18T21:08:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a045ff640 10 monclient(hunting): authenticate will time out at 1286.054548s 2024-08-18T21:08:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc0a4000 0x7f79fc1d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc0a4000 0x7f79fc1d1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:40272/0 (socket says 172.21.15.5:40272) 2024-08-18T21:08:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 1 -- 172.21.15.5:0/4061688629 learned_addr learned my addr 172.21.15.5:0/4061688629 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 10 monclient(hunting): get_auth_request con 0x7f79fc0a4000 auth_method 0 2024-08-18T21:08:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a0239b640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79fc068700 0x7f79fc13b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a0239b640 10 monclient(hunting): get_auth_request con 0x7f79fc068700 auth_method 0 2024-08-18T21:08:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a0239b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a0239b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a0239b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a02b9c640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79fc0a43e0 0x7f79fc1d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a02b9c640 10 monclient(hunting): get_auth_request con 0x7f79fc0a43e0 auth_method 0 2024-08-18T21:08:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a02b9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a02b9c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a02b9c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 10 monclient(hunting): handle_auth_done global_id 84156 payload 824 2024-08-18T21:08:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 1 -- 172.21.15.5:0/4061688629 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79fc068700 msgr2=0x7f79fc13b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f79fc068700 0x7f79fc13b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 1 -- 172.21.15.5:0/4061688629 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79fc0a43e0 msgr2=0x7f79fc1d21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79fc0a43e0 0x7f79fc1d21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 10 monclient: _finish_hunting 0 2024-08-18T21:08:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 1 monclient: found mon.noname-d 2024-08-18T21:08:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:08:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.038+0000 7f7a01b9a640 1 -- 172.21.15.5:0/4061688629 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79fc072a50 con 0x7f79fc0a4000 2024-08-18T21:08:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a01b9a640 1 -- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc0a4000 msgr2=0x7f79fc1d1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a01b9a640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc0a4000 0x7f79fc1d1c70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f79f000e820 tx=0x7f79f000ece0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f79eeffd640 1 -- 172.21.15.5:0/4061688629 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f79f0024070 con 0x7f79fc0a4000 2024-08-18T21:08:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f79eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f79eeffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:08:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f79eeffd640 10 monclient: dump: 2024-08-18T21:08:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.059 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f79eeffd640 10 monclient: _finish_auth 0 2024-08-18T21:08:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f79eeffd640 10 monclient: _check_auth_tickets 2024-08-18T21:08:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f79eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a045ff640 5 monclient: authenticate success, global_id 84156 2024-08-18T21:08:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f79eeffd640 1 -- 172.21.15.5:0/4061688629 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79f000cba0 con 0x7f79fc0a4000 2024-08-18T21:08:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f79eeffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f79eeffd640 1 -- 172.21.15.5:0/4061688629 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f79f000cd50 con 0x7f79fc0a4000 2024-08-18T21:08:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f79eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a00b98640 4 set_mon_vals no callback set 2024-08-18T21:08:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f79eeffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:08:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f79eeffd640 10 monclient: dump: 2024-08-18T21:08:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.062 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a045ff640 10 monclient: _renew_subs 2024-08-18T21:08:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a045ff640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:08:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a045ff640 1 -- 172.21.15.5:0/4061688629 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79fc0a7be0 con 0x7f79fc0a4000 2024-08-18T21:08:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a045ff640 10 monclient: _renew_subs 2024-08-18T21:08:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a045ff640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:08:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a045ff640 1 -- 172.21.15.5:0/4061688629 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f79fc0a7690 con 0x7f79fc0a4000 2024-08-18T21:08:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a045ff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a045ff640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc1ce2a0 0x7f79fc1ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a045ff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a045ff640 1 -- 172.21.15.5:0/4061688629 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f79fc051140 con 0x7f79fc1ce2a0 2024-08-18T21:08:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a0239b640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc1ce2a0 0x7f79fc1ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a0239b640 10 monclient: get_auth_request con 0x7f79fc1ce2a0 auth_method 0 2024-08-18T21:08:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a0239b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a0239b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a0239b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a0239b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f79eeffd640 1 -- 172.21.15.5:0/4061688629 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f79f000c730 con 0x7f79fc0a4000 2024-08-18T21:08:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a0239b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a0239b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a0239b640 10 monclient(hunting): handle_auth_done global_id 84165 payload 824 2024-08-18T21:08:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a0239b640 1 -- 172.21.15.5:0/4061688629 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f79fc13bd40 con 0x7f79fc1ce2a0 2024-08-18T21:08:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f79eeffd640 1 --2- 172.21.15.5:0/4061688629 >> v2:172.21.15.157:6812/631023601 conn(0x7f79e003bdf0 0x7f79e003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f79eeffd640 1 -- 172.21.15.5:0/4061688629 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(141..141 src has 22..141) ==== 3898+0+0 (secure 0 0 0) 0x7f79f000f040 con 0x7f79fc0a4000 2024-08-18T21:08:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.042+0000 7f7a02b9c640 1 --2- 172.21.15.5:0/4061688629 >> v2:172.21.15.157:6812/631023601 conn(0x7f79e003bdf0 0x7f79e003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.046+0000 7f7a02b9c640 10 monclient: get_auth_request con 0x7f79e003bdf0 auth_method 0 2024-08-18T21:08:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.046+0000 7f7a0239b640 1 -- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc1ce2a0 msgr2=0x7f79fc1ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.046+0000 7f7a0239b640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc1ce2a0 0x7f79fc1ce680 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f79f400e7c0 tx=0x7f79f400ec80 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.046+0000 7f79eeffd640 1 -- 172.21.15.5:0/4061688629 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f79f4015430 con 0x7f79fc1ce2a0 2024-08-18T21:08:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.046+0000 7f79eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.046+0000 7f79eeffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:08:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.046+0000 7f79eeffd640 10 monclient: dump: 2024-08-18T21:08:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.066 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.046+0000 7f79eeffd640 1 -- 172.21.15.5:0/4061688629 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f79f400cb50 con 0x7f79fc1ce2a0 2024-08-18T21:08:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.046+0000 7f79eeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.046+0000 7f79eeffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.046+0000 7f79eeffd640 1 -- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc1ce2a0 msgr2=0x7f79fc1ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.046+0000 7f79eeffd640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc1ce2a0 0x7f79fc1ce680 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f79f400e7c0 tx=0x7f79f400ec80 comp rx=0 tx=0).stop 2024-08-18T21:08:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.046+0000 7f79eeffd640 1 -- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc1ce2a0 msgr2=0x7f79fc1ce680 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.046+0000 7f79eeffd640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc1ce2a0 0x7f79fc1ce680 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f79f400e7c0 tx=0x7f79f400ec80 comp rx=0 tx=0).stop 2024-08-18T21:08:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.046+0000 7f7a02b9c640 1 --2- 172.21.15.5:0/4061688629 >> v2:172.21.15.157:6812/631023601 conn(0x7f79e003bdf0 0x7f79e003e2b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f79f80097f0 tx=0x7f79f80a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f7a045ff640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:39.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f7a045ff640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc1cebc0 0x7f79fc09a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f7a045ff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f7a045ff640 1 -- 172.21.15.5:0/4061688629 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f79fc0a47c0 con 0x7f79fc1cebc0 2024-08-18T21:08:39.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f7a0239b640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc1cebc0 0x7f79fc09a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f7a0239b640 10 monclient: get_auth_request con 0x7f79fc1cebc0 auth_method 0 2024-08-18T21:08:39.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f7a0239b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f7a0239b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f7a0239b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f7a0239b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f7a0239b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f7a0239b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f7a0239b640 10 monclient(hunting): handle_auth_done global_id 84174 payload 824 2024-08-18T21:08:39.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f7a0239b640 1 -- 172.21.15.5:0/4061688629 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f79fc072e10 con 0x7f79fc1cebc0 2024-08-18T21:08:39.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f7a0239b640 1 -- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc1cebc0 msgr2=0x7f79fc09a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f7a0239b640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc1cebc0 0x7f79fc09a280 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009010 tx=0x7f79f4003af0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f79eeffd640 1 -- 172.21.15.5:0/4061688629 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f79f401ec70 con 0x7f79fc1cebc0 2024-08-18T21:08:39.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f79eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f79eeffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:08:39.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f79eeffd640 10 monclient: dump: 2024-08-18T21:08:39.071 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.071 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.071 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.073 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f79eeffd640 1 -- 172.21.15.5:0/4061688629 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f79f4007340 con 0x7f79fc1cebc0 2024-08-18T21:08:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f79eeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f79eeffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f79eeffd640 1 -- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc1cebc0 msgr2=0x7f79fc09a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f79eeffd640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc1cebc0 0x7f79fc09a280 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009010 tx=0x7f79f4003af0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f79eeffd640 1 -- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc1cebc0 msgr2=0x7f79fc09a280 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.054+0000 7f79eeffd640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc1cebc0 0x7f79fc09a280 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009010 tx=0x7f79f4003af0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.074 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15883, 2024-08-18T21:08:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:08:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:39.092 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:39.092 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.092 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.092 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:39.095 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:39.095 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.095 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.095 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.095 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:39.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:39.095 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.095 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.096 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.096 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:39.096 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.096 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.096 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:08:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:39.101 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.058+0000 7f7a045ff640 1 -- 172.21.15.5:0/4061688629 >> v2:172.21.15.157:6812/631023601 conn(0x7f79e003bdf0 msgr2=0x7f79e003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.058+0000 7f7a045ff640 1 --2- 172.21.15.5:0/4061688629 >> v2:172.21.15.157:6812/631023601 conn(0x7f79e003bdf0 0x7f79e003e2b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f79f80097f0 tx=0x7f79f80a6000 comp rx=0 tx=0).stop 2024-08-18T21:08:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.058+0000 7f7a045ff640 10 monclient: shutdown 2024-08-18T21:08:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.058+0000 7f7a045ff640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.058+0000 7f7a045ff640 1 -- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc0a4000 msgr2=0x7f79fc1d1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.058+0000 7f7a045ff640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc0a4000 0x7f79fc1d1c70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f79f000e820 tx=0x7f79f000ece0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.058+0000 7f7a02b9c640 1 -- 172.21.15.5:0/4061688629 reap_dead start 2024-08-18T21:08:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.058+0000 7f7a045ff640 1 -- 172.21.15.5:0/4061688629 shutdown_connections 2024-08-18T21:08:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.058+0000 7f7a045ff640 1 --2- 172.21.15.5:0/4061688629 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79fc0a4000 0x7f79fc1d1c70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.058+0000 7f7a045ff640 1 -- 172.21.15.5:0/4061688629 >> 172.21.15.5:0/4061688629 conn(0x7f79fc0a50f0 msgr2=0x7f79fc135800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:39.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.058+0000 7f7a045ff640 1 -- 172.21.15.5:0/4061688629 shutdown_connections 2024-08-18T21:08:39.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.058+0000 7f7a045ff640 1 -- 172.21.15.5:0/4061688629 wait complete. 2024-08-18T21:08:39.104 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:39.104 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:08:39.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:08:39.201 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:39.201 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29737]: starting. 2024-08-18T21:08:39.201 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29737]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29656 2024-08-18T21:08:39.201 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29737]: shutting down. 2024-08-18T21:08:39.203 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:39.204 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:39.204 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:08:39.206 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:08:39.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.226+0000 7f4a0ead1640 10 monclient: get_monmap_and_config 2024-08-18T21:08:39.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.226+0000 7f4a0ead1640 10 monclient: build_initial_monmap 2024-08-18T21:08:39.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.226+0000 7f4a0ead1640 10 monclient: monmap: 2024-08-18T21:08:39.231 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:39.231 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.231 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:39.232157+0000 2024-08-18T21:08:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:39.232157+0000 2024-08-18T21:08:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:39.233 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:39.233 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 1 Processor -- start 2024-08-18T21:08:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 1 -- start start 2024-08-18T21:08:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 10 monclient: init 2024-08-18T21:08:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 10 monclient: _add_conns ranks=[3,10,8,5,1,2,7,4,0,9,6] 2024-08-18T21:08:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a080a6bd0 0x7f4a080a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 10 monclient(hunting): picked mon.noname-g con 0x7f4a080a6bd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4a0809f080 0x7f4a080a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 10 monclient(hunting): picked mon.noname-f con 0x7f4a0809f080 addr v2:172.21.15.157:3300/0 2024-08-18T21:08:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a08139990 0x7f4a08139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 10 monclient(hunting): picked mon.noname-e con 0x7f4a08139990 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:08:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4a0809e4c0 con 0x7f4a0809f080 2024-08-18T21:08:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4a0806f930 con 0x7f4a080a6bd0 2024-08-18T21:08:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f4a080a7a30 con 0x7f4a08139990 2024-08-18T21:08:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0ead1640 10 monclient(hunting): authenticate will time out at 1286.245228s 2024-08-18T21:08:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a08139990 0x7f4a08139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a08139990 0x7f4a08139e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:45240/0 (socket says 172.21.15.5:45240) 2024-08-18T21:08:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 1 -- 172.21.15.5:0/4286883387 learned_addr learned my addr 172.21.15.5:0/4286883387 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 10 monclient(hunting): get_auth_request con 0x7f4a08139990 auth_method 0 2024-08-18T21:08:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a07fff640 1 --2- 172.21.15.5:0/4286883387 >> v2:172.21.15.157:3300/0 conn(0x7f4a0809f080 0x7f4a080a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0c86d640 1 --2- 172.21.15.5:0/4286883387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a080a6bd0 0x7f4a080a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a07fff640 10 monclient(hunting): get_auth_request con 0x7f4a0809f080 auth_method 0 2024-08-18T21:08:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a07fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a07fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a07fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0c86d640 10 monclient(hunting): get_auth_request con 0x7f4a080a6bd0 auth_method 0 2024-08-18T21:08:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0c86d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0c86d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0c86d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 10 monclient(hunting): handle_auth_done global_id 54746 payload 274 2024-08-18T21:08:39.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 1 -- 172.21.15.5:0/4286883387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a080a6bd0 msgr2=0x7f4a080a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:39.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 1 --2- 172.21.15.5:0/4286883387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a080a6bd0 0x7f4a080a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 1 -- 172.21.15.5:0/4286883387 >> v2:172.21.15.157:3300/0 conn(0x7f4a0809f080 msgr2=0x7f4a080a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:39.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 1 --2- 172.21.15.5:0/4286883387 >> v2:172.21.15.157:3300/0 conn(0x7f4a0809f080 0x7f4a080a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 10 monclient: _finish_hunting 0 2024-08-18T21:08:39.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 1 monclient: found mon.noname-e 2024-08-18T21:08:39.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:39.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:08:39.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.230+0000 7f4a0d06e640 1 -- 172.21.15.5:0/4286883387 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a080a7fb0 con 0x7f4a08139990 2024-08-18T21:08:39.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0d06e640 1 -- 172.21.15.5:0/4286883387 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a08139990 msgr2=0x7f4a08139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0d06e640 1 --2- 172.21.15.5:0/4286883387 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a08139990 0x7f4a08139e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009e50 tx=0x7f4a0001c8f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=58b56579775de336 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a077fe640 1 -- 172.21.15.5:0/4286883387 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4a000090d0 con 0x7f4a08139990 2024-08-18T21:08:39.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a077fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:08:39.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a077fe640 10 monclient: dump: 2024-08-18T21:08:39.246 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.246 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.246 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.246 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.246 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.246 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.247 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.247 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.247 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.247 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.247 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.247 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.247 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.247 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.247 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.247 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a077fe640 10 monclient: _finish_auth 0 2024-08-18T21:08:39.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a077fe640 10 monclient: _check_auth_tickets 2024-08-18T21:08:39.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:39.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a077fe640 1 -- 172.21.15.5:0/4286883387 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a000a5a90 con 0x7f4a08139990 2024-08-18T21:08:39.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 5 monclient: authenticate success, global_id 54746 2024-08-18T21:08:39.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:08:39.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a077fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:39.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:39.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a077fe640 1 -- 172.21.15.5:0/4286883387 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4a000a5c40 con 0x7f4a08139990 2024-08-18T21:08:39.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 4 set_mon_vals no callback set 2024-08-18T21:08:39.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a077fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:39.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a077fe640 10 monclient: dump: 2024-08-18T21:08:39.248 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.248 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.248 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.249 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.249 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.249 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.249 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.249 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.249 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.249 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.249 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.249 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.249 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.249 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.249 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.249 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 10 monclient: shutdown 2024-08-18T21:08:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 1 -- 172.21.15.5:0/4286883387 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a08139990 msgr2=0x7f4a08139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 1 --2- 172.21.15.5:0/4286883387 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a08139990 0x7f4a08139e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009e50 tx=0x7f4a0001c8f0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 1 -- 172.21.15.5:0/4286883387 shutdown_connections 2024-08-18T21:08:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 1 --2- 172.21.15.5:0/4286883387 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a08139990 0x7f4a08139e10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 1 --2- 172.21.15.5:0/4286883387 >> v2:172.21.15.157:3300/0 conn(0x7f4a0809f080 0x7f4a080a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 1 --2- 172.21.15.5:0/4286883387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a080a6bd0 0x7f4a080a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 1 -- 172.21.15.5:0/4286883387 >> 172.21.15.5:0/4286883387 conn(0x7f4a08068700 msgr2=0x7f4a08068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 1 -- 172.21.15.5:0/4286883387 shutdown_connections 2024-08-18T21:08:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 1 -- 172.21.15.5:0/4286883387 wait complete. 2024-08-18T21:08:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 10 monclient: build_initial_monmap 2024-08-18T21:08:39.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 10 monclient: monmap: 2024-08-18T21:08:39.251 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:39.251 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:39.251 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:39.251 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:39.251 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:39.251 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.251 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:39.251 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:39.252 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:39.252 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:39.252 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:39.252 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:39.252 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:39.252 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:39.252 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:39.252 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 1 Processor -- start 2024-08-18T21:08:39.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 1 -- start start 2024-08-18T21:08:39.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.234+0000 7f4a0ead1640 10 monclient: init 2024-08-18T21:08:39.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:39.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 10 monclient: _add_conns ranks=[3,8,7,4,1,6,5,2,0] 2024-08-18T21:08:39.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a0809f080 0x7f4a081384f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 10 monclient(hunting): picked mon.noname-g con 0x7f4a0809f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:39.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a080a6bd0 0x7f4a08138a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 10 monclient(hunting): picked mon.noname-e con 0x7f4a080a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:08:39.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4a08139990 0x7f4a0813dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 10 monclient(hunting): picked mon.noname-i con 0x7f4a08139990 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:39.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4a080a89f0 con 0x7f4a0809f080 2024-08-18T21:08:39.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f4a080a7ce0 con 0x7f4a08139990 2024-08-18T21:08:39.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f4a08143610 con 0x7f4a080a6bd0 2024-08-18T21:08:39.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:39.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 10 monclient(hunting): authenticate will time out at 1286.252395s 2024-08-18T21:08:39.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a080a6bd0 0x7f4a08138a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a080a6bd0 0x7f4a08138a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:45254/0 (socket says 172.21.15.5:45254) 2024-08-18T21:08:39.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 1 -- 172.21.15.5:0/3158395354 learned_addr learned my addr 172.21.15.5:0/3158395354 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:39.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 10 monclient(hunting): get_auth_request con 0x7f4a080a6bd0 auth_method 0 2024-08-18T21:08:39.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0c86d640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a0809f080 0x7f4a081384f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 10 monclient(hunting): handle_auth_done global_id 54755 payload 824 2024-08-18T21:08:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0d06e640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4a08139990 0x7f4a0813dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 1 -- 172.21.15.5:0/3158395354 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4a08139990 msgr2=0x7f4a0813dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4a08139990 0x7f4a0813dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 1 -- 172.21.15.5:0/3158395354 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a0809f080 msgr2=0x7f4a081384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a0809f080 0x7f4a081384f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 10 monclient: _finish_hunting 0 2024-08-18T21:08:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 1 monclient: found mon.noname-e 2024-08-18T21:08:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:08:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 1 -- 172.21.15.5:0/3158395354 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a08124310 con 0x7f4a080a6bd0 2024-08-18T21:08:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0c86d640 10 monclient: get_auth_request con 0x7f4a0809f080 auth_method 0 2024-08-18T21:08:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0c86d640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a0809f080 0x7f4a081384f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:08:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 1 -- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a080a6bd0 msgr2=0x7f4a08138a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a07fff640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a080a6bd0 0x7f4a08138a30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00d800 tx=0x7f49fc00dcc0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a057fa640 1 -- 172.21.15.5:0/3158395354 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f49fc018020 con 0x7f4a080a6bd0 2024-08-18T21:08:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a057fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:08:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a057fa640 10 monclient: dump: 2024-08-18T21:08:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.257 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a057fa640 10 monclient: _finish_auth 0 2024-08-18T21:08:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a057fa640 10 monclient: _check_auth_tickets 2024-08-18T21:08:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a057fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a057fa640 1 -- 172.21.15.5:0/3158395354 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49fc009d20 con 0x7f4a080a6bd0 2024-08-18T21:08:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 5 monclient: authenticate success, global_id 54755 2024-08-18T21:08:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 10 monclient: _renew_subs 2024-08-18T21:08:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:08:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 1 -- 172.21.15.5:0/3158395354 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0813fdd0 con 0x7f4a080a6bd0 2024-08-18T21:08:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a057fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a057fa640 1 -- 172.21.15.5:0/3158395354 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f49fc014880 con 0x7f4a080a6bd0 2024-08-18T21:08:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a057fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a057fa640 10 monclient: dump: 2024-08-18T21:08:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.260 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 10 monclient: _renew_subs 2024-08-18T21:08:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a06ffd640 4 set_mon_vals no callback set 2024-08-18T21:08:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:08:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.238+0000 7f4a0ead1640 1 -- 172.21.15.5:0/3158395354 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a08123a70 con 0x7f4a080a6bd0 2024-08-18T21:08:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0ead1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0ead1640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a08122b10 0x7f4a0813e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0ead1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0ead1640 1 -- 172.21.15.5:0/3158395354 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f4a08051140 con 0x7f4a08122b10 2024-08-18T21:08:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0c86d640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a08122b10 0x7f4a0813e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0c86d640 10 monclient: get_auth_request con 0x7f4a08122b10 auth_method 0 2024-08-18T21:08:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0c86d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0c86d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0c86d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0c86d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0c86d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0c86d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a057fa640 1 -- 172.21.15.5:0/3158395354 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f49fc01b020 con 0x7f4a080a6bd0 2024-08-18T21:08:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0c86d640 10 monclient(hunting): handle_auth_done global_id 54764 payload 824 2024-08-18T21:08:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0c86d640 1 -- 172.21.15.5:0/3158395354 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a08123c70 con 0x7f4a08122b10 2024-08-18T21:08:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a057fa640 1 --2- 172.21.15.5:0/3158395354 >> v2:172.21.15.157:6812/631023601 conn(0x7f49f403bdf0 0x7f49f403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a057fa640 1 -- 172.21.15.5:0/3158395354 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(142..142 src has 22..142) ==== 3506+0+0 (secure 0 0 0) 0x7f49fc00f040 con 0x7f4a080a6bd0 2024-08-18T21:08:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0d06e640 1 --2- 172.21.15.5:0/3158395354 >> v2:172.21.15.157:6812/631023601 conn(0x7f49f403bdf0 0x7f49f403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0d06e640 10 monclient: get_auth_request con 0x7f49f403bdf0 auth_method 0 2024-08-18T21:08:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0c86d640 1 -- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a08122b10 msgr2=0x7f4a0813e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0c86d640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a08122b10 0x7f4a0813e220 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49f800e710 tx=0x7f49f800ebd0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a057fa640 1 -- 172.21.15.5:0/3158395354 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f49f800f040 con 0x7f4a08122b10 2024-08-18T21:08:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a057fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a057fa640 10 monclient: dump: 2024-08-18T21:08:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.266 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a057fa640 1 -- 172.21.15.5:0/3158395354 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f49f8004030 con 0x7f4a08122b10 2024-08-18T21:08:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a057fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a057fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a057fa640 1 -- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a08122b10 msgr2=0x7f4a0813e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a057fa640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a08122b10 0x7f4a0813e220 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49f800e710 tx=0x7f49f800ebd0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a057fa640 1 -- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a08122b10 msgr2=0x7f4a0813e220 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a057fa640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a08122b10 0x7f4a0813e220 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49f800e710 tx=0x7f49f800ebd0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.242+0000 7f4a0d06e640 1 --2- 172.21.15.5:0/3158395354 >> v2:172.21.15.157:6812/631023601 conn(0x7f49f403bdf0 0x7f49f403e2b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4a000ab000 tx=0x7f4a000a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.250+0000 7f4a0ead1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.250+0000 7f4a0ead1640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a0813e760 0x7f4a0813eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.250+0000 7f4a0ead1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.250+0000 7f4a0ead1640 1 -- 172.21.15.5:0/3158395354 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f4a08139e10 con 0x7f4a0813e760 2024-08-18T21:08:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.250+0000 7f4a0c86d640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a0813e760 0x7f4a0813eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.250+0000 7f4a0c86d640 10 monclient: get_auth_request con 0x7f4a0813e760 auth_method 0 2024-08-18T21:08:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.250+0000 7f4a0c86d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.250+0000 7f4a0c86d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.250+0000 7f4a0c86d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.250+0000 7f4a0c86d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.250+0000 7f4a0c86d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.250+0000 7f4a0c86d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.250+0000 7f4a0c86d640 10 monclient(hunting): handle_auth_done global_id 54773 payload 824 2024-08-18T21:08:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.250+0000 7f4a0c86d640 1 -- 172.21.15.5:0/3158395354 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4a0813f0b0 con 0x7f4a0813e760 2024-08-18T21:08:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a0c86d640 1 -- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a0813e760 msgr2=0x7f4a0813eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a0c86d640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a0813e760 0x7f4a0813eb70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f49f8008010 tx=0x7f49f8004740 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a057fa640 1 -- 172.21.15.5:0/3158395354 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f49f8003ca0 con 0x7f4a0813e760 2024-08-18T21:08:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a057fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a057fa640 10 monclient: dump: 2024-08-18T21:08:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.269 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a057fa640 1 -- 172.21.15.5:0/3158395354 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f49f8003830 con 0x7f4a0813e760 2024-08-18T21:08:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a057fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a057fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a057fa640 1 -- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a0813e760 msgr2=0x7f4a0813eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a057fa640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a0813e760 0x7f4a0813eb70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f49f8008010 tx=0x7f49f8004740 comp rx=0 tx=0).stop 2024-08-18T21:08:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a057fa640 1 -- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a0813e760 msgr2=0x7f4a0813eb70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a057fa640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a0813e760 0x7f4a0813eb70 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f49f8008010 tx=0x7f49f8004740 comp rx=0 tx=0).stop 2024-08-18T21:08:39.270 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 175375, 2024-08-18T21:08:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:08:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:39.276 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:39.276 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:08:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:08:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:08:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:39.296 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:39.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a0ead1640 1 -- 172.21.15.5:0/3158395354 >> v2:172.21.15.157:6812/631023601 conn(0x7f49f403bdf0 msgr2=0x7f49f403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a0ead1640 1 --2- 172.21.15.5:0/3158395354 >> v2:172.21.15.157:6812/631023601 conn(0x7f49f403bdf0 0x7f49f403e2b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4a000ab000 tx=0x7f4a000a7070 comp rx=0 tx=0).stop 2024-08-18T21:08:39.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a0ead1640 10 monclient: shutdown 2024-08-18T21:08:39.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a0ead1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:39.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a0ead1640 1 -- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a080a6bd0 msgr2=0x7f4a08138a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a0ead1640 1 --2- 172.21.15.5:0/3158395354 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4a080a6bd0 0x7f4a08138a30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00d800 tx=0x7f49fc00dcc0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a0d06e640 1 -- 172.21.15.5:0/3158395354 reap_dead start 2024-08-18T21:08:39.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a0d06e640 1 -- 172.21.15.5:0/3158395354 reap_dead start 2024-08-18T21:08:39.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a0ead1640 1 -- 172.21.15.5:0/3158395354 shutdown_connections 2024-08-18T21:08:39.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a0ead1640 1 -- 172.21.15.5:0/3158395354 >> 172.21.15.5:0/3158395354 conn(0x7f4a08068700 msgr2=0x7f4a080a1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:39.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a0ead1640 1 -- 172.21.15.5:0/3158395354 shutdown_connections 2024-08-18T21:08:39.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.254+0000 7f4a0ead1640 1 -- 172.21.15.5:0/3158395354 wait complete. 2024-08-18T21:08:39.299 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:39.299 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:08:39.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:08:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.414+0000 7ff971872640 10 monclient: get_monmap_and_config 2024-08-18T21:08:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.414+0000 7ff971872640 10 monclient: build_initial_monmap 2024-08-18T21:08:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.414+0000 7ff971872640 10 monclient: monmap: 2024-08-18T21:08:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:39.418991+0000 2024-08-18T21:08:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:39.418991+0000 2024-08-18T21:08:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:39.421 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.414+0000 7ff971872640 1 Processor -- start 2024-08-18T21:08:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.414+0000 7ff971872640 1 -- start start 2024-08-18T21:08:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.414+0000 7ff971872640 10 monclient: init 2024-08-18T21:08:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff971872640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff971872640 10 monclient: _add_conns ranks=[1,9,3,10,7,5,0,6,4,8,2] 2024-08-18T21:08:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff971872640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7ff96c0a6ce0 addr v1:172.21.15.157:6789/0 2024-08-18T21:08:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff971872640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff96c0a77d0 0x7ff96c13ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff971872640 10 monclient(hunting): picked mon.noname-a con 0x7ff96c0a77d0 addr v2:172.21.15.5:3300/0 2024-08-18T21:08:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff971872640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff96c13f220 0x7ff96c141610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff971872640 10 monclient(hunting): picked mon.noname-g con 0x7ff96c13f220 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff971872640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff96c0a45d0 con 0x7ff96c0a6ce0 2024-08-18T21:08:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff971872640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff971872640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff96c0a5000 con 0x7ff96c0a77d0 2024-08-18T21:08:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff971872640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff971872640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff96c0a4360 con 0x7ff96c13f220 2024-08-18T21:08:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff971872640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff971872640 10 monclient(hunting): authenticate will time out at 1286.432574s 2024-08-18T21:08:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff96c0a77d0 0x7ff96c13ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff96c0a77d0 0x7ff96c13ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51772/0 (socket says 172.21.15.5:51772) 2024-08-18T21:08:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 1 -- 172.21.15.5:0/69031593 learned_addr learned my addr 172.21.15.5:0/69031593 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 10 monclient(hunting): get_auth_request con 0x7ff96c0a77d0 auth_method 0 2024-08-18T21:08:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96b7fe640 1 --2- 172.21.15.5:0/69031593 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff96c13f220 0x7ff96c141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96b7fe640 10 monclient(hunting): get_auth_request con 0x7ff96c13f220 auth_method 0 2024-08-18T21:08:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 10 monclient(hunting): handle_auth_done global_id 84177 payload 274 2024-08-18T21:08:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 1 -- 172.21.15.5:0/69031593 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff96c13f220 msgr2=0x7ff96c141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 1 --2- 172.21.15.5:0/69031593 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff96c13f220 0x7ff96c141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 1 -- 172.21.15.5:0/69031593 >> v1:172.21.15.157:6789/0 conn(0x7ff96c0a6ce0 legacy=0x7ff96c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:08:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 1 monclient: found mon.noname-a 2024-08-18T21:08:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:08:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.418+0000 7ff96a7fc640 1 -- 172.21.15.5:0/69031593 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96c0a32d0 con 0x7ff96c0a77d0 2024-08-18T21:08:39.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff96a7fc640 1 -- 172.21.15.5:0/69031593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff96c0a77d0 msgr2=0x7ff96c13ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff96a7fc640 1 --2- 172.21.15.5:0/69031593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff96c0a77d0 0x7ff96c13ece0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff960009870 tx=0x7ff96001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1e034c686089d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff969ffb640 1 -- 172.21.15.5:0/69031593 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff9600b0070 con 0x7ff96c0a77d0 2024-08-18T21:08:39.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff969ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff969ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:08:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff969ffb640 10 monclient: dump: 2024-08-18T21:08:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.435 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff969ffb640 10 monclient: _finish_auth 0 2024-08-18T21:08:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff969ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:08:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff969ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff969ffb640 1 -- 172.21.15.5:0/69031593 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9600aa810 con 0x7ff96c0a77d0 2024-08-18T21:08:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff969ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff969ffb640 1 -- 172.21.15.5:0/69031593 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff9600a9300 con 0x7ff96c0a77d0 2024-08-18T21:08:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff971872640 5 monclient: authenticate success, global_id 84177 2024-08-18T21:08:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff971872640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff971872640 4 set_mon_vals no callback set 2024-08-18T21:08:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff969ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff969ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:08:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff969ffb640 10 monclient: dump: 2024-08-18T21:08:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.437 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff971872640 10 monclient: shutdown 2024-08-18T21:08:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff971872640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff971872640 1 -- 172.21.15.5:0/69031593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff96c0a77d0 msgr2=0x7ff96c13ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff971872640 1 --2- 172.21.15.5:0/69031593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff96c0a77d0 0x7ff96c13ece0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff960009870 tx=0x7ff96001c420 comp rx=0 tx=0).stop 2024-08-18T21:08:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff971872640 1 -- 172.21.15.5:0/69031593 shutdown_connections 2024-08-18T21:08:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff971872640 1 --2- 172.21.15.5:0/69031593 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff96c13f220 0x7ff96c141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff971872640 1 --2- 172.21.15.5:0/69031593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff96c0a77d0 0x7ff96c13ece0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff971872640 1 -- 172.21.15.5:0/69031593 >> 172.21.15.5:0/69031593 conn(0x7ff96c0acbc0 msgr2=0x7ff96c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff971872640 1 -- 172.21.15.5:0/69031593 shutdown_connections 2024-08-18T21:08:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff971872640 1 -- 172.21.15.5:0/69031593 wait complete. 2024-08-18T21:08:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff971872640 10 monclient: build_initial_monmap 2024-08-18T21:08:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.422+0000 7ff971872640 10 monclient: monmap: 2024-08-18T21:08:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:39.439 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 1 Processor -- start 2024-08-18T21:08:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 1 -- start start 2024-08-18T21:08:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 10 monclient: init 2024-08-18T21:08:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 10 monclient: _add_conns ranks=[3,6,7,2,0,1,4,5,8] 2024-08-18T21:08:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff96c0a6ce0 0x7ff96c1d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 10 monclient(hunting): picked mon.noname-g con 0x7ff96c0a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff96c0a77d0 0x7ff96c137b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 10 monclient(hunting): picked mon.noname-d con 0x7ff96c0a77d0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff96c13f220 0x7ff96c09e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 10 monclient(hunting): picked mon.noname-i con 0x7ff96c13f220 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff96c0a83a0 con 0x7ff96c0a6ce0 2024-08-18T21:08:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7ff96c0a8220 con 0x7ff96c0a77d0 2024-08-18T21:08:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7ff96c144370 con 0x7ff96c13f220 2024-08-18T21:08:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff971872640 10 monclient(hunting): authenticate will time out at 1286.440903s 2024-08-18T21:08:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff96c0a77d0 0x7ff96c137b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff96c0a77d0 0x7ff96c137b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:40284/0 (socket says 172.21.15.5:40284) 2024-08-18T21:08:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 1 -- 172.21.15.5:0/3203888613 learned_addr learned my addr 172.21.15.5:0/3203888613 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 10 monclient(hunting): get_auth_request con 0x7ff96c0a77d0 auth_method 0 2024-08-18T21:08:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96b7fe640 1 --2- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff96c13f220 0x7ff96c09e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 10 monclient(hunting): handle_auth_done global_id 84201 payload 824 2024-08-18T21:08:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96affd640 1 --2- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff96c0a6ce0 0x7ff96c1d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 1 -- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff96c13f220 msgr2=0x7ff96c09e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 1 --2- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff96c13f220 0x7ff96c09e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 1 -- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff96c0a6ce0 msgr2=0x7ff96c1d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 1 --2- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff96c0a6ce0 0x7ff96c1d13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:08:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 1 monclient: found mon.noname-d 2024-08-18T21:08:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:08:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 1 -- 172.21.15.5:0/3203888613 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96c1d2300 con 0x7ff96c0a77d0 2024-08-18T21:08:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 1 -- 172.21.15.5:0/3203888613 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff96c0a77d0 msgr2=0x7ff96c137b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff96a7fc640 1 --2- 172.21.15.5:0/3203888613 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff96c0a77d0 0x7ff96c137b80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff96001ccc0 tx=0x7ff9600191c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff953fff640 1 -- 172.21.15.5:0/3203888613 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff9600b0040 con 0x7ff96c0a77d0 2024-08-18T21:08:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff953fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff953fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:08:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff953fff640 10 monclient: dump: 2024-08-18T21:08:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.444 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff953fff640 10 monclient: _finish_auth 0 2024-08-18T21:08:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff953fff640 10 monclient: _check_auth_tickets 2024-08-18T21:08:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff953fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff953fff640 1 -- 172.21.15.5:0/3203888613 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff960004240 con 0x7ff96c0a77d0 2024-08-18T21:08:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff953fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff953fff640 1 -- 172.21.15.5:0/3203888613 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff9600043f0 con 0x7ff96c0a77d0 2024-08-18T21:08:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff953fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff953fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:08:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff953fff640 10 monclient: dump: 2024-08-18T21:08:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.446 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.426+0000 7ff968ff9640 4 set_mon_vals no callback set 2024-08-18T21:08:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff971872640 5 monclient: authenticate success, global_id 84201 2024-08-18T21:08:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff971872640 10 monclient: _renew_subs 2024-08-18T21:08:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff971872640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:08:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff971872640 1 -- 172.21.15.5:0/3203888613 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff96c140de0 con 0x7ff96c0a77d0 2024-08-18T21:08:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff971872640 10 monclient: _renew_subs 2024-08-18T21:08:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff971872640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:08:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff971872640 1 -- 172.21.15.5:0/3203888613 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7ff96c0a2630 con 0x7ff96c0a77d0 2024-08-18T21:08:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff971872640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff971872640 1 --2- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff96c1380c0 0x7ff96c09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff971872640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff971872640 1 -- 172.21.15.5:0/3203888613 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c0a07e0 con 0x7ff96c1380c0 2024-08-18T21:08:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff953fff640 1 -- 172.21.15.5:0/3203888613 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7ff9600bb060 con 0x7ff96c0a77d0 2024-08-18T21:08:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff953fff640 1 --2- 172.21.15.5:0/3203888613 >> v2:172.21.15.157:6812/631023601 conn(0x7ff95803bdf0 0x7ff95803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff96affd640 1 --2- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff96c1380c0 0x7ff96c09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff953fff640 1 -- 172.21.15.5:0/3203888613 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(142..142 src has 22..142) ==== 3506+0+0 (secure 0 0 0) 0x7ff9600e7860 con 0x7ff96c0a77d0 2024-08-18T21:08:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff96affd640 10 monclient: get_auth_request con 0x7ff96c1380c0 auth_method 0 2024-08-18T21:08:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff96affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff96affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff96affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff96affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff96affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff96affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff96b7fe640 1 --2- 172.21.15.5:0/3203888613 >> v2:172.21.15.157:6812/631023601 conn(0x7ff95803bdf0 0x7ff95803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff96b7fe640 10 monclient: get_auth_request con 0x7ff95803bdf0 auth_method 0 2024-08-18T21:08:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff96affd640 10 monclient(hunting): handle_auth_done global_id 5671 payload 824 2024-08-18T21:08:39.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.430+0000 7ff96affd640 1 -- 172.21.15.5:0/3203888613 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff96c0aaf00 con 0x7ff96c1380c0 2024-08-18T21:08:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.434+0000 7ff96affd640 1 -- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff96c1380c0 msgr2=0x7ff96c09ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.434+0000 7ff96affd640 1 --2- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff96c1380c0 0x7ff96c09ed20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00d380 tx=0x7ff95c00d840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.434+0000 7ff96b7fe640 1 --2- 172.21.15.5:0/3203888613 >> v2:172.21.15.157:6812/631023601 conn(0x7ff95803bdf0 0x7ff95803e2b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff96c06f760 tx=0x7ff96400b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.434+0000 7ff953fff640 1 -- 172.21.15.5:0/3203888613 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff95c016020 con 0x7ff96c1380c0 2024-08-18T21:08:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.434+0000 7ff953fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.434+0000 7ff953fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:08:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.434+0000 7ff953fff640 10 monclient: dump: 2024-08-18T21:08:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.453 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.434+0000 7ff953fff640 1 -- 172.21.15.5:0/3203888613 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff95c012810 con 0x7ff96c1380c0 2024-08-18T21:08:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.434+0000 7ff953fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.434+0000 7ff953fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.434+0000 7ff953fff640 1 -- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff96c1380c0 msgr2=0x7ff96c09ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.434+0000 7ff953fff640 1 --2- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff96c1380c0 0x7ff96c09ed20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00d380 tx=0x7ff95c00d840 comp rx=0 tx=0).stop 2024-08-18T21:08:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.434+0000 7ff953fff640 1 -- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff96c1380c0 msgr2=0x7ff96c09ed20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.434+0000 7ff953fff640 1 --2- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff96c1380c0 0x7ff96c09ed20 secure :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00d380 tx=0x7ff95c00d840 comp rx=0 tx=0).stop 2024-08-18T21:08:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.438+0000 7ff971872640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.438+0000 7ff971872640 1 --2- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff96c09f260 0x7ff96c13bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.438+0000 7ff971872640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.438+0000 7ff971872640 1 -- 172.21.15.5:0/3203888613 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c051140 con 0x7ff96c09f260 2024-08-18T21:08:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.442+0000 7ff96affd640 1 --2- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff96c09f260 0x7ff96c13bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.442+0000 7ff96affd640 10 monclient: get_auth_request con 0x7ff96c09f260 auth_method 0 2024-08-18T21:08:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.442+0000 7ff96affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.442+0000 7ff96affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.442+0000 7ff96affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.442+0000 7ff96affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.442+0000 7ff96affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.442+0000 7ff96affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.442+0000 7ff96affd640 10 monclient(hunting): handle_auth_done global_id 5680 payload 824 2024-08-18T21:08:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.442+0000 7ff96affd640 1 -- 172.21.15.5:0/3203888613 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff96c09f670 con 0x7ff96c09f260 2024-08-18T21:08:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.442+0000 7ff96affd640 1 -- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff96c09f260 msgr2=0x7ff96c13bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.442+0000 7ff96affd640 1 --2- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff96c09f260 0x7ff96c13bfd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00d380 tx=0x7ff95c003770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff953fff640 1 -- 172.21.15.5:0/3203888613 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff95c016040 con 0x7ff96c09f260 2024-08-18T21:08:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff953fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff953fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:08:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff953fff640 10 monclient: dump: 2024-08-18T21:08:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.456 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff953fff640 1 -- 172.21.15.5:0/3203888613 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7ff95c01b420 con 0x7ff96c09f260 2024-08-18T21:08:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff953fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff953fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff953fff640 1 -- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff96c09f260 msgr2=0x7ff96c13bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff953fff640 1 --2- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff96c09f260 0x7ff96c13bfd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00d380 tx=0x7ff95c003770 comp rx=0 tx=0).stop 2024-08-18T21:08:39.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff953fff640 1 -- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff96c09f260 msgr2=0x7ff96c13bfd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:39.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff953fff640 1 --2- 172.21.15.5:0/3203888613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff96c09f260 0x7ff96c13bfd0 secure :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00d380 tx=0x7ff95c003770 comp rx=0 tx=0).stop 2024-08-18T21:08:39.457 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 328528, 2024-08-18T21:08:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:08:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:08:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:39.482 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff971872640 1 -- 172.21.15.5:0/3203888613 >> v2:172.21.15.157:6812/631023601 conn(0x7ff95803bdf0 msgr2=0x7ff95803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff971872640 1 --2- 172.21.15.5:0/3203888613 >> v2:172.21.15.157:6812/631023601 conn(0x7ff95803bdf0 0x7ff95803e2b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff96c06f760 tx=0x7ff96400b040 comp rx=0 tx=0).stop 2024-08-18T21:08:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff971872640 10 monclient: shutdown 2024-08-18T21:08:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff971872640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff971872640 1 -- 172.21.15.5:0/3203888613 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff96c0a77d0 msgr2=0x7ff96c137b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff971872640 1 --2- 172.21.15.5:0/3203888613 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff96c0a77d0 0x7ff96c137b80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff96001ccc0 tx=0x7ff9600191c0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff96b7fe640 1 -- 172.21.15.5:0/3203888613 reap_dead start 2024-08-18T21:08:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff96b7fe640 1 -- 172.21.15.5:0/3203888613 reap_dead start 2024-08-18T21:08:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff971872640 1 -- 172.21.15.5:0/3203888613 shutdown_connections 2024-08-18T21:08:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff971872640 1 -- 172.21.15.5:0/3203888613 >> 172.21.15.5:0/3203888613 conn(0x7ff96c0acbc0 msgr2=0x7ff96c140140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff971872640 1 -- 172.21.15.5:0/3203888613 shutdown_connections 2024-08-18T21:08:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.446+0000 7ff971872640 1 -- 172.21.15.5:0/3203888613 wait complete. 2024-08-18T21:08:39.485 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:39.485 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:08:39.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:08:39.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.602+0000 7f71b2ca5640 10 monclient: get_monmap_and_config 2024-08-18T21:08:39.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.602+0000 7f71b2ca5640 10 monclient: build_initial_monmap 2024-08-18T21:08:39.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.602+0000 7f71b2ca5640 10 monclient: monmap: 2024-08-18T21:08:39.606 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:39.607171+0000 2024-08-18T21:08:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:39.607171+0000 2024-08-18T21:08:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:39.608 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:39.608 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:39.608 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:39.608 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:39.608 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:39.608 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:39.608 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:39.608 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:39.608 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.602+0000 7f71b2ca5640 1 Processor -- start 2024-08-18T21:08:39.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.602+0000 7f71b2ca5640 1 -- start start 2024-08-18T21:08:39.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.602+0000 7f71b2ca5640 10 monclient: init 2024-08-18T21:08:39.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b2ca5640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:39.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b2ca5640 10 monclient: _add_conns ranks=[9,2,4,1,0,5,6,10,8,7,3] 2024-08-18T21:08:39.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b2ca5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71ac0a5ac0 0x7f71ac0a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b2ca5640 10 monclient(hunting): picked mon.noname-a con 0x7f71ac0a5ac0 addr v2:172.21.15.5:3300/0 2024-08-18T21:08:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b2ca5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71ac0a0cd0 0x7f71ac0a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b2ca5640 10 monclient(hunting): picked mon.noname-b con 0x7f71ac0a0cd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:08:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b2ca5640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f71ac139c60 0x7f71ac13a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b2ca5640 10 monclient(hunting): picked mon.noname-c con 0x7f71ac139c60 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b2ca5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b2ca5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f71ac06e500 con 0x7f71ac0a5ac0 2024-08-18T21:08:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b2ca5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b2ca5640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f71ac0a6920 con 0x7f71ac0a0cd0 2024-08-18T21:08:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b2ca5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b2ca5640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f71ac0a1790 con 0x7f71ac139c60 2024-08-18T21:08:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b2ca5640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b2ca5640 10 monclient(hunting): authenticate will time out at 1286.620330s 2024-08-18T21:08:39.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71ac0a0cd0 0x7f71ac0a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b1242640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f71ac139c60 0x7f71ac13a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b0a41640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71ac0a5ac0 0x7f71ac0a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71ac0a0cd0 0x7f71ac0a63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59858/0 (socket says 172.21.15.5:59858) 2024-08-18T21:08:39.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b1242640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f71ac139c60 0x7f71ac13a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:55014/0 (socket says 172.21.15.5:55014) 2024-08-18T21:08:39.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 1 -- 172.21.15.5:0/3329224888 learned_addr learned my addr 172.21.15.5:0/3329224888 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:39.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 10 monclient(hunting): get_auth_request con 0x7f71ac0a0cd0 auth_method 0 2024-08-18T21:08:39.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b0a41640 10 monclient(hunting): get_auth_request con 0x7f71ac0a5ac0 auth_method 0 2024-08-18T21:08:39.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b0a41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b0a41640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b0a41640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b1242640 10 monclient(hunting): get_auth_request con 0x7f71ac139c60 auth_method 0 2024-08-18T21:08:39.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b1242640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b1242640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b1242640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b0a41640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b0a41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b0a41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b1242640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b1242640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b1242640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 10 monclient(hunting): handle_auth_done global_id 84170 payload 274 2024-08-18T21:08:39.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 1 -- 172.21.15.5:0/3329224888 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f71ac139c60 msgr2=0x7f71ac13a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:39.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 1 --2- 172.21.15.5:0/3329224888 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f71ac139c60 0x7f71ac13a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 1 -- 172.21.15.5:0/3329224888 >> v2:172.21.15.5:3300/0 conn(0x7f71ac0a5ac0 msgr2=0x7f71ac0a5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:39.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 1 --2- 172.21.15.5:0/3329224888 >> v2:172.21.15.5:3300/0 conn(0x7f71ac0a5ac0 0x7f71ac0a5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 10 monclient: _finish_hunting 0 2024-08-18T21:08:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 1 monclient: found mon.noname-b 2024-08-18T21:08:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:08:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71abfff640 1 -- 172.21.15.5:0/3329224888 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac06de40 con 0x7f71ac0a0cd0 2024-08-18T21:08:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.606+0000 7f71b0a41640 1 --2- 172.21.15.5:0/3329224888 >> v2:172.21.15.5:3300/0 conn(0x7f71ac0a5ac0 0x7f71ac0a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:08:39.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71abfff640 1 -- 172.21.15.5:0/3329224888 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71ac0a0cd0 msgr2=0x7f71ac0a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71abfff640 1 --2- 172.21.15.5:0/3329224888 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71ac0a0cd0 0x7f71ac0a63e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009870 tx=0x7f71a001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2da6284d38cfc09 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71ab7fe640 1 -- 172.21.15.5:0/3329224888 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71a00b0070 con 0x7f71ac0a0cd0 2024-08-18T21:08:39.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71ab7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:08:39.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71ab7fe640 10 monclient: dump: 2024-08-18T21:08:39.626 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.626 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.626 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.626 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.627 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71ab7fe640 10 monclient: _finish_auth 0 2024-08-18T21:08:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71ab7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:08:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 5 monclient: authenticate success, global_id 84170 2024-08-18T21:08:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:08:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71ab7fe640 1 -- 172.21.15.5:0/3329224888 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a00aa810 con 0x7f71ac0a0cd0 2024-08-18T21:08:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71ab7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71ab7fe640 1 -- 172.21.15.5:0/3329224888 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71a00a9300 con 0x7f71ac0a0cd0 2024-08-18T21:08:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 4 set_mon_vals no callback set 2024-08-18T21:08:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71ab7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:08:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71ab7fe640 10 monclient: dump: 2024-08-18T21:08:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.630 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.630 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.630 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.630 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 10 monclient: shutdown 2024-08-18T21:08:39.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:39.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 -- 172.21.15.5:0/3329224888 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71ac0a0cd0 msgr2=0x7f71ac0a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 --2- 172.21.15.5:0/3329224888 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71ac0a0cd0 0x7f71ac0a63e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009870 tx=0x7f71a001c3f0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 -- 172.21.15.5:0/3329224888 shutdown_connections 2024-08-18T21:08:39.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 --2- 172.21.15.5:0/3329224888 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f71ac139c60 0x7f71ac13a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 --2- 172.21.15.5:0/3329224888 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f71ac0a0cd0 0x7f71ac0a63e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 --2- 172.21.15.5:0/3329224888 >> v2:172.21.15.5:3300/0 conn(0x7f71ac0a5ac0 0x7f71ac0a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 -- 172.21.15.5:0/3329224888 >> 172.21.15.5:0/3329224888 conn(0x7f71ac0aa770 msgr2=0x7f71ac0a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:39.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 -- 172.21.15.5:0/3329224888 shutdown_connections 2024-08-18T21:08:39.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 -- 172.21.15.5:0/3329224888 wait complete. 2024-08-18T21:08:39.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 10 monclient: build_initial_monmap 2024-08-18T21:08:39.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 10 monclient: monmap: 2024-08-18T21:08:39.631 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:39.631 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:39.631 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:39.631 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:39.632 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:39.632 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.632 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:39.632 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:39.632 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:39.632 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:39.632 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:39.632 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:39.632 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:39.632 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:39.632 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:39.632 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 Processor -- start 2024-08-18T21:08:39.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 -- start start 2024-08-18T21:08:39.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 10 monclient: init 2024-08-18T21:08:39.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:39.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 10 monclient: _add_conns ranks=[7,3,6,8,0,5,1,2,4] 2024-08-18T21:08:39.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f71ac0a0cd0 0x7f71ac138c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 10 monclient(hunting): picked mon.noname-i con 0x7f71ac0a0cd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:39.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac0a5ac0 0x7f71ac13bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 10 monclient(hunting): picked mon.noname-g con 0x7f71ac0a5ac0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:39.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f71ac139c60 0x7f71ac13c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 10 monclient(hunting): picked mon.noname-d con 0x7f71ac139c60 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:39.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f71ac0a7870 con 0x7f71ac0a5ac0 2024-08-18T21:08:39.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f71ac0a76f0 con 0x7f71ac139c60 2024-08-18T21:08:39.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f71ac06e160 con 0x7f71ac0a0cd0 2024-08-18T21:08:39.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:39.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b2ca5640 10 monclient(hunting): authenticate will time out at 1286.627557s 2024-08-18T21:08:39.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b1242640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f71ac139c60 0x7f71ac13c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b1242640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f71ac139c60 0x7f71ac13c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:40294/0 (socket says 172.21.15.5:40294) 2024-08-18T21:08:39.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b1242640 1 -- 172.21.15.5:0/1767129039 learned_addr learned my addr 172.21.15.5:0/1767129039 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:39.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b1242640 10 monclient(hunting): get_auth_request con 0x7f71ac139c60 auth_method 0 2024-08-18T21:08:39.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b1242640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b1242640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b1242640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b1242640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b1242640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b1242640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b0a41640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f71ac0a0cd0 0x7f71ac138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.610+0000 7f71b1242640 10 monclient(hunting): handle_auth_done global_id 84210 payload 824 2024-08-18T21:08:39.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71abfff640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac0a5ac0 0x7f71ac13bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b1242640 1 -- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f71ac0a0cd0 msgr2=0x7f71ac138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b1242640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f71ac0a0cd0 0x7f71ac138c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b1242640 1 -- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac0a5ac0 msgr2=0x7f71ac13bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b1242640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac0a5ac0 0x7f71ac13bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b1242640 10 monclient: _finish_hunting 0 2024-08-18T21:08:39.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b1242640 1 monclient: found mon.noname-d 2024-08-18T21:08:39.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b1242640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:39.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b1242640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:08:39.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b1242640 1 -- 172.21.15.5:0/1767129039 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac13d630 con 0x7f71ac139c60 2024-08-18T21:08:39.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b0a41640 10 monclient: get_auth_request con 0x7f71ac0a0cd0 auth_method 0 2024-08-18T21:08:39.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b0a41640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f71ac0a0cd0 0x7f71ac138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:08:39.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b1242640 1 -- 172.21.15.5:0/1767129039 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f71ac139c60 msgr2=0x7f71ac13c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b1242640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f71ac139c60 0x7f71ac13c080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71a400efc0 tx=0x7f71a400c490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71a97fa640 1 -- 172.21.15.5:0/1767129039 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71a4018020 con 0x7f71ac139c60 2024-08-18T21:08:39.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71a97fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:08:39.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71a97fa640 10 monclient: dump: 2024-08-18T21:08:39.637 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.637 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.639 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71a97fa640 10 monclient: _finish_auth 0 2024-08-18T21:08:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71a97fa640 10 monclient: _check_auth_tickets 2024-08-18T21:08:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71a97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71a97fa640 1 -- 172.21.15.5:0/1767129039 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a40148f0 con 0x7f71ac139c60 2024-08-18T21:08:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71a97fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71a97fa640 1 -- 172.21.15.5:0/1767129039 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71a40133e0 con 0x7f71ac139c60 2024-08-18T21:08:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b2ca5640 5 monclient: authenticate success, global_id 84210 2024-08-18T21:08:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b2ca5640 10 monclient: _renew_subs 2024-08-18T21:08:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b2ca5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:08:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b2ca5640 1 -- 172.21.15.5:0/1767129039 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ac13f0f0 con 0x7f71ac139c60 2024-08-18T21:08:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71a97fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:08:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71aa7fc640 4 set_mon_vals no callback set 2024-08-18T21:08:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71a97fa640 10 monclient: dump: 2024-08-18T21:08:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.641 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b2ca5640 10 monclient: _renew_subs 2024-08-18T21:08:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b2ca5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:08:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b2ca5640 1 -- 172.21.15.5:0/1767129039 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ac13fdb0 con 0x7f71ac139c60 2024-08-18T21:08:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b2ca5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b2ca5640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac13e190 0x7f71ac13c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b2ca5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b2ca5640 1 -- 172.21.15.5:0/1767129039 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f71ac13f8f0 con 0x7f71ac13e190 2024-08-18T21:08:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b0a41640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac13e190 0x7f71ac13c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b0a41640 10 monclient: get_auth_request con 0x7f71ac13e190 auth_method 0 2024-08-18T21:08:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b0a41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b0a41640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b0a41640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b0a41640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.614+0000 7f71b0a41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.618+0000 7f71b0a41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.618+0000 7f71a97fa640 1 -- 172.21.15.5:0/1767129039 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f71a401b020 con 0x7f71ac139c60 2024-08-18T21:08:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.618+0000 7f71a97fa640 1 --2- 172.21.15.5:0/1767129039 >> v2:172.21.15.157:6812/631023601 conn(0x7f719803bdc0 0x7f719803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.618+0000 7f71a97fa640 1 -- 172.21.15.5:0/1767129039 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(142..142 src has 22..142) ==== 3506+0+0 (secure 0 0 0) 0x7f71a404efe0 con 0x7f71ac139c60 2024-08-18T21:08:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.618+0000 7f71b0a41640 10 monclient(hunting): handle_auth_done global_id 84171 payload 824 2024-08-18T21:08:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.618+0000 7f71b0a41640 1 -- 172.21.15.5:0/1767129039 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71ac13a0d0 con 0x7f71ac13e190 2024-08-18T21:08:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.618+0000 7f71abfff640 1 --2- 172.21.15.5:0/1767129039 >> v2:172.21.15.157:6812/631023601 conn(0x7f719803bdc0 0x7f719803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.618+0000 7f71abfff640 10 monclient: get_auth_request con 0x7f719803bdc0 auth_method 0 2024-08-18T21:08:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.618+0000 7f71b0a41640 1 -- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac13e190 msgr2=0x7f71ac13c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.618+0000 7f71b0a41640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac13e190 0x7f71ac13c5c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f719c010790 tx=0x7f719c010c50 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.618+0000 7f71a97fa640 1 -- 172.21.15.5:0/1767129039 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f719c00f040 con 0x7f71ac13e190 2024-08-18T21:08:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.618+0000 7f71a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.618+0000 7f71a97fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:08:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.618+0000 7f71a97fa640 10 monclient: dump: 2024-08-18T21:08:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.645 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.618+0000 7f71abfff640 1 --2- 172.21.15.5:0/1767129039 >> v2:172.21.15.157:6812/631023601 conn(0x7f719803bdc0 0x7f719803e280 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f71ac071160 tx=0x7f71a00a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.622+0000 7f71a97fa640 1 -- 172.21.15.5:0/1767129039 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f719c01c400 con 0x7f71ac13e190 2024-08-18T21:08:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.622+0000 7f71a97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.622+0000 7f71a97fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.622+0000 7f71a97fa640 1 -- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac13e190 msgr2=0x7f71ac13c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.622+0000 7f71a97fa640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac13e190 0x7f71ac13c5c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f719c010790 tx=0x7f719c010c50 comp rx=0 tx=0).stop 2024-08-18T21:08:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.622+0000 7f71a97fa640 1 -- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac13e190 msgr2=0x7f71ac13c5c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.622+0000 7f71a97fa640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac13e190 0x7f71ac13c5c0 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f719c010790 tx=0x7f719c010c50 comp rx=0 tx=0).stop 2024-08-18T21:08:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.626+0000 7f71b2ca5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.626+0000 7f71b2ca5640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac139190 0x7f71ac13cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.626+0000 7f71b2ca5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.626+0000 7f71b2ca5640 1 -- 172.21.15.5:0/1767129039 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f71ac051140 con 0x7f71ac139190 2024-08-18T21:08:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.626+0000 7f71b0a41640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac139190 0x7f71ac13cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.626+0000 7f71b0a41640 10 monclient: get_auth_request con 0x7f71ac139190 auth_method 0 2024-08-18T21:08:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.626+0000 7f71b0a41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.626+0000 7f71b0a41640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.626+0000 7f71b0a41640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.626+0000 7f71b0a41640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.626+0000 7f71b0a41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.626+0000 7f71b0a41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.626+0000 7f71b0a41640 10 monclient(hunting): handle_auth_done global_id 84180 payload 824 2024-08-18T21:08:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.626+0000 7f71b0a41640 1 -- 172.21.15.5:0/1767129039 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f71ac06d010 con 0x7f71ac139190 2024-08-18T21:08:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71b0a41640 1 -- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac139190 msgr2=0x7f71ac13cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71b0a41640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac139190 0x7f71ac13cb00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f719c010790 tx=0x7f719c0046d0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71a97fa640 1 -- 172.21.15.5:0/1767129039 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f719c004490 con 0x7f71ac139190 2024-08-18T21:08:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71a97fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:08:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71a97fa640 10 monclient: dump: 2024-08-18T21:08:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.649 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71a97fa640 1 -- 172.21.15.5:0/1767129039 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f719c000e50 con 0x7f71ac139190 2024-08-18T21:08:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71a97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71a97fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71a97fa640 1 -- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac139190 msgr2=0x7f71ac13cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71a97fa640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac139190 0x7f71ac13cb00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f719c010790 tx=0x7f719c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71a97fa640 1 -- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac139190 msgr2=0x7f71ac13cb00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71a97fa640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71ac139190 0x7f71ac13cb00 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f719c010790 tx=0x7f719c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.650 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:39.650 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 16455, 2024-08-18T21:08:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:08:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:39.676 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71b2ca5640 1 -- 172.21.15.5:0/1767129039 >> v2:172.21.15.157:6812/631023601 conn(0x7f719803bdc0 msgr2=0x7f719803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71b2ca5640 1 --2- 172.21.15.5:0/1767129039 >> v2:172.21.15.157:6812/631023601 conn(0x7f719803bdc0 0x7f719803e280 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f71ac071160 tx=0x7f71a00a6000 comp rx=0 tx=0).stop 2024-08-18T21:08:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71b2ca5640 10 monclient: shutdown 2024-08-18T21:08:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71b2ca5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71b2ca5640 1 -- 172.21.15.5:0/1767129039 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f71ac139c60 msgr2=0x7f71ac13c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71b2ca5640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f71ac139c60 0x7f71ac13c080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71a400efc0 tx=0x7f71a400c490 comp rx=0 tx=0).stop 2024-08-18T21:08:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71b1242640 1 -- 172.21.15.5:0/1767129039 reap_dead start 2024-08-18T21:08:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71b2ca5640 1 -- 172.21.15.5:0/1767129039 shutdown_connections 2024-08-18T21:08:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71b2ca5640 1 --2- 172.21.15.5:0/1767129039 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f71ac139c60 0x7f71ac13c080 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71b2ca5640 1 -- 172.21.15.5:0/1767129039 >> 172.21.15.5:0/1767129039 conn(0x7f71ac0aa770 msgr2=0x7f71ac0a8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71b2ca5640 1 -- 172.21.15.5:0/1767129039 shutdown_connections 2024-08-18T21:08:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.630+0000 7f71b2ca5640 1 -- 172.21.15.5:0/1767129039 wait complete. 2024-08-18T21:08:39.679 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:39.679 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:08:39.679 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:08:39.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 10 monclient: get_monmap_and_config 2024-08-18T21:08:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 10 monclient: build_initial_monmap 2024-08-18T21:08:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 10 monclient: monmap: 2024-08-18T21:08:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:39.797826+0000 2024-08-18T21:08:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:39.797826+0000 2024-08-18T21:08:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:39.799 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 1 Processor -- start 2024-08-18T21:08:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 1 -- start start 2024-08-18T21:08:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 10 monclient: init 2024-08-18T21:08:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 10 monclient: _add_conns ranks=[10,8,0,7,3,4,2,1,5,9,6] 2024-08-18T21:08:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9d280a6b60 0x7f9d2809eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 10 monclient(hunting): picked mon.noname-f con 0x7f9d280a6b60 addr v2:172.21.15.157:3300/0 2024-08-18T21:08:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d280a6f40 0x7f9d280a7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 10 monclient(hunting): picked mon.noname-e con 0x7f9d280a6f40 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:08:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9d28139920 addr v1:172.21.15.5:6789/0 2024-08-18T21:08:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d2809e150 con 0x7f9d28139920 2024-08-18T21:08:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f9d2809e4c0 con 0x7f9d280a6b60 2024-08-18T21:08:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f9d280a9a10 con 0x7f9d280a6f40 2024-08-18T21:08:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2fccc640 10 monclient(hunting): authenticate will time out at 1286.810989s 2024-08-18T21:08:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d280a6f40 0x7f9d280a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d280a6f40 0x7f9d280a7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:45282/0 (socket says 172.21.15.5:45282) 2024-08-18T21:08:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 1 -- 172.21.15.5:0/2042306212 learned_addr learned my addr 172.21.15.5:0/2042306212 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 10 monclient(hunting): get_auth_request con 0x7f9d280a6f40 auth_method 0 2024-08-18T21:08:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2e269640 1 --1- 172.21.15.5:0/2042306212 >> v1:172.21.15.5:6789/0 conn(0x7f9d28139920 0x7f9d28139d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47024/0 (socket says 172.21.15.5:47024) 2024-08-18T21:08:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2da68640 1 --2- 172.21.15.5:0/2042306212 >> v2:172.21.15.157:3300/0 conn(0x7f9d280a6b60 0x7f9d2809eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2da68640 10 monclient(hunting): get_auth_request con 0x7f9d280a6b60 auth_method 0 2024-08-18T21:08:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2da68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2da68640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2da68640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 10 monclient(hunting): handle_auth_done global_id 54800 payload 274 2024-08-18T21:08:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 1 -- 172.21.15.5:0/2042306212 >> v2:172.21.15.157:3300/0 conn(0x7f9d280a6b60 msgr2=0x7f9d2809eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 1 --2- 172.21.15.5:0/2042306212 >> v2:172.21.15.157:3300/0 conn(0x7f9d280a6b60 0x7f9d2809eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 1 -- 172.21.15.5:0/2042306212 >> v1:172.21.15.5:6789/0 conn(0x7f9d28139920 legacy=0x7f9d28139d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 10 monclient: _finish_hunting 0 2024-08-18T21:08:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 1 monclient: found mon.noname-e 2024-08-18T21:08:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:08:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2d267640 1 -- 172.21.15.5:0/2042306212 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2809de70 con 0x7f9d280a6f40 2024-08-18T21:08:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.794+0000 7f9d2da68640 1 --2- 172.21.15.5:0/2042306212 >> v2:172.21.15.157:3300/0 conn(0x7f9d280a6b60 0x7f9d2809eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:08:39.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.798+0000 7f9d2d267640 1 -- 172.21.15.5:0/2042306212 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d280a6f40 msgr2=0x7f9d280a7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.798+0000 7f9d2d267640 1 --2- 172.21.15.5:0/2042306212 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d280a6f40 0x7f9d280a7320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009870 tx=0x7f9d1801c1e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=db1a864068614161 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.798+0000 7f9d2ca66640 1 -- 172.21.15.5:0/2042306212 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9d180b0070 con 0x7f9d280a6f40 2024-08-18T21:08:39.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2ca66640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2ca66640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:08:39.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2ca66640 10 monclient: dump: 2024-08-18T21:08:39.810 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.810 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.812 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2ca66640 10 monclient: _finish_auth 0 2024-08-18T21:08:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2ca66640 10 monclient: _check_auth_tickets 2024-08-18T21:08:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2ca66640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2ca66640 1 -- 172.21.15.5:0/2042306212 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d180aa810 con 0x7f9d280a6f40 2024-08-18T21:08:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 5 monclient: authenticate success, global_id 54800 2024-08-18T21:08:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:08:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2ca66640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2ca66640 1 -- 172.21.15.5:0/2042306212 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9d180aae30 con 0x7f9d280a6f40 2024-08-18T21:08:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 4 set_mon_vals no callback set 2024-08-18T21:08:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2ca66640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2ca66640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2ca66640 10 monclient: dump: 2024-08-18T21:08:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.814 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 10 monclient: shutdown 2024-08-18T21:08:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 1 -- 172.21.15.5:0/2042306212 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d280a6f40 msgr2=0x7f9d280a7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 1 --2- 172.21.15.5:0/2042306212 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d280a6f40 0x7f9d280a7320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009870 tx=0x7f9d1801c1e0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 1 -- 172.21.15.5:0/2042306212 shutdown_connections 2024-08-18T21:08:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 1 --2- 172.21.15.5:0/2042306212 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d280a6f40 0x7f9d280a7320 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 1 --2- 172.21.15.5:0/2042306212 >> v2:172.21.15.157:3300/0 conn(0x7f9d280a6b60 0x7f9d2809eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 1 -- 172.21.15.5:0/2042306212 >> 172.21.15.5:0/2042306212 conn(0x7f9d280ac950 msgr2=0x7f9d280a8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 1 -- 172.21.15.5:0/2042306212 shutdown_connections 2024-08-18T21:08:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 1 -- 172.21.15.5:0/2042306212 wait complete. 2024-08-18T21:08:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 10 monclient: build_initial_monmap 2024-08-18T21:08:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 10 monclient: monmap: 2024-08-18T21:08:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:39.816 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 1 Processor -- start 2024-08-18T21:08:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 1 -- start start 2024-08-18T21:08:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 10 monclient: init 2024-08-18T21:08:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 10 monclient: _add_conns ranks=[8,2,4,0,5,3,7,1,6] 2024-08-18T21:08:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d280a6b60 0x7f9d281d1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 10 monclient(hunting): picked mon.noname-e con 0x7f9d280a6b60 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:08:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9d280a6f40 0x7f9d28138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 10 monclient(hunting): picked mon.noname-b con 0x7f9d280a6f40 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:08:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9d28139920 0x7f9d2813e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 10 monclient(hunting): picked mon.noname-c con 0x7f9d28139920 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f9d28144590 con 0x7f9d280a6f40 2024-08-18T21:08:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f9d28144410 con 0x7f9d28139920 2024-08-18T21:08:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f9d28144710 con 0x7f9d280a6b60 2024-08-18T21:08:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2fccc640 10 monclient(hunting): authenticate will time out at 1286.818154s 2024-08-18T21:08:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d280a6b60 0x7f9d281d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d280a6b60 0x7f9d281d1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:45288/0 (socket says 172.21.15.5:45288) 2024-08-18T21:08:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 1 -- 172.21.15.5:0/4120270140 learned_addr learned my addr 172.21.15.5:0/4120270140 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 10 monclient(hunting): get_auth_request con 0x7f9d280a6b60 auth_method 0 2024-08-18T21:08:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2e269640 1 --2- 172.21.15.5:0/4120270140 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9d28139920 0x7f9d2813e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2e269640 10 monclient(hunting): get_auth_request con 0x7f9d28139920 auth_method 0 2024-08-18T21:08:39.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2e269640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2e269640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2e269640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2d267640 1 --2- 172.21.15.5:0/4120270140 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9d280a6f40 0x7f9d28138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2d267640 10 monclient(hunting): get_auth_request con 0x7f9d280a6f40 auth_method 0 2024-08-18T21:08:39.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2d267640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2d267640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2d267640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2e269640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2e269640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2e269640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2d267640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2d267640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2d267640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 10 monclient(hunting): handle_auth_done global_id 54809 payload 824 2024-08-18T21:08:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 1 -- 172.21.15.5:0/4120270140 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9d28139920 msgr2=0x7f9d2813e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 1 --2- 172.21.15.5:0/4120270140 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9d28139920 0x7f9d2813e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 1 -- 172.21.15.5:0/4120270140 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9d280a6f40 msgr2=0x7f9d28138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 1 --2- 172.21.15.5:0/4120270140 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9d280a6f40 0x7f9d28138ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 10 monclient: _finish_hunting 0 2024-08-18T21:08:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 1 monclient: found mon.noname-e 2024-08-18T21:08:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:08:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.802+0000 7f9d2da68640 1 -- 172.21.15.5:0/4120270140 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d280a5920 con 0x7f9d280a6b60 2024-08-18T21:08:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2da68640 1 -- 172.21.15.5:0/4120270140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d280a6b60 msgr2=0x7f9d281d1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2da68640 1 --2- 172.21.15.5:0/4120270140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d280a6b60 0x7f9d281d1800 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400e840 tx=0x7f9d2400ed00 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1e7fc640 1 -- 172.21.15.5:0/4120270140 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9d24017070 con 0x7f9d280a6b60 2024-08-18T21:08:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1e7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:08:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1e7fc640 10 monclient: dump: 2024-08-18T21:08:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.825 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:08:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:08:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2fccc640 5 monclient: authenticate success, global_id 54809 2024-08-18T21:08:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1e7fc640 1 -- 172.21.15.5:0/4120270140 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d2400cd50 con 0x7f9d280a6b60 2024-08-18T21:08:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1e7fc640 1 -- 172.21.15.5:0/4120270140 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9d2400f040 con 0x7f9d280a6b60 2024-08-18T21:08:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2fccc640 10 monclient: _renew_subs 2024-08-18T21:08:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2fccc640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:08:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2fccc640 1 -- 172.21.15.5:0/4120270140 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d280ab750 con 0x7f9d280a6b60 2024-08-18T21:08:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1ffff640 4 set_mon_vals no callback set 2024-08-18T21:08:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1e7fc640 10 monclient: dump: 2024-08-18T21:08:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.827 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2fccc640 10 monclient: _renew_subs 2024-08-18T21:08:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2fccc640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:08:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2fccc640 1 -- 172.21.15.5:0/4120270140 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d28140fa0 con 0x7f9d280a6b60 2024-08-18T21:08:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2fccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2fccc640 1 --2- 172.21.15.5:0/4120270140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d28138ff0 0x7f9d2813ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2fccc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2fccc640 1 -- 172.21.15.5:0/4120270140 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f9d28051140 con 0x7f9d28138ff0 2024-08-18T21:08:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1e7fc640 1 -- 172.21.15.5:0/4120270140 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f9d2401a070 con 0x7f9d280a6b60 2024-08-18T21:08:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1e7fc640 1 --2- 172.21.15.5:0/4120270140 >> v2:172.21.15.157:6812/631023601 conn(0x7f9d0c03bdc0 0x7f9d0c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d1e7fc640 1 -- 172.21.15.5:0/4120270140 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(142..142 src has 22..142) ==== 3506+0+0 (secure 0 0 0) 0x7f9d2404e200 con 0x7f9d280a6b60 2024-08-18T21:08:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2d267640 1 --2- 172.21.15.5:0/4120270140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d28138ff0 0x7f9d2813ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2d267640 10 monclient: get_auth_request con 0x7f9d28138ff0 auth_method 0 2024-08-18T21:08:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2d267640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2d267640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2d267640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2e269640 1 --2- 172.21.15.5:0/4120270140 >> v2:172.21.15.157:6812/631023601 conn(0x7f9d0c03bdc0 0x7f9d0c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2d267640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2d267640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2d267640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2e269640 10 monclient: get_auth_request con 0x7f9d0c03bdc0 auth_method 0 2024-08-18T21:08:39.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2d267640 10 monclient(hunting): handle_auth_done global_id 35087 payload 824 2024-08-18T21:08:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.806+0000 7f9d2d267640 1 -- 172.21.15.5:0/4120270140 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d2809eb30 con 0x7f9d28138ff0 2024-08-18T21:08:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.810+0000 7f9d2e269640 1 --2- 172.21.15.5:0/4120270140 >> v2:172.21.15.157:6812/631023601 conn(0x7f9d0c03bdc0 0x7f9d0c03e280 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009f60 tx=0x7f9d20009610 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.810+0000 7f9d2d267640 1 -- 172.21.15.5:0/4120270140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d28138ff0 msgr2=0x7f9d2813ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.810+0000 7f9d2d267640 1 --2- 172.21.15.5:0/4120270140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d28138ff0 0x7f9d2813ee90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9d280a98b0 tx=0x7f9d18018fe0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.810+0000 7f9d1e7fc640 1 -- 172.21.15.5:0/4120270140 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9d180b0070 con 0x7f9d28138ff0 2024-08-18T21:08:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.810+0000 7f9d1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.810+0000 7f9d1e7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:08:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.810+0000 7f9d1e7fc640 10 monclient: dump: 2024-08-18T21:08:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.834 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.810+0000 7f9d1e7fc640 1 -- 172.21.15.5:0/4120270140 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9d180b1040 con 0x7f9d28138ff0 2024-08-18T21:08:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.810+0000 7f9d1e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.810+0000 7f9d1e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.810+0000 7f9d1e7fc640 1 -- 172.21.15.5:0/4120270140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d28138ff0 msgr2=0x7f9d2813ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.810+0000 7f9d1e7fc640 1 --2- 172.21.15.5:0/4120270140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d28138ff0 0x7f9d2813ee90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9d280a98b0 tx=0x7f9d18018fe0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.810+0000 7f9d1e7fc640 1 -- 172.21.15.5:0/4120270140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d28138ff0 msgr2=0x7f9d2813ee90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.810+0000 7f9d1e7fc640 1 --2- 172.21.15.5:0/4120270140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d28138ff0 0x7f9d2813ee90 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9d280a98b0 tx=0x7f9d18018fe0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.818+0000 7f9d2fccc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.818+0000 7f9d2fccc640 1 --2- 172.21.15.5:0/4120270140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d2813f3d0 0x7f9d2813a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.818+0000 7f9d2fccc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.818+0000 7f9d2fccc640 1 -- 172.21.15.5:0/4120270140 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f9d28122d50 con 0x7f9d2813f3d0 2024-08-18T21:08:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.818+0000 7f9d2d267640 1 --2- 172.21.15.5:0/4120270140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d2813f3d0 0x7f9d2813a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.818+0000 7f9d2d267640 10 monclient: get_auth_request con 0x7f9d2813f3d0 auth_method 0 2024-08-18T21:08:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.818+0000 7f9d2d267640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.818+0000 7f9d2d267640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.818+0000 7f9d2d267640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.818+0000 7f9d2d267640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.818+0000 7f9d2d267640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.818+0000 7f9d2d267640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.818+0000 7f9d2d267640 10 monclient(hunting): handle_auth_done global_id 35096 payload 824 2024-08-18T21:08:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.818+0000 7f9d2d267640 1 -- 172.21.15.5:0/4120270140 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9d2813f7b0 con 0x7f9d2813f3d0 2024-08-18T21:08:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d2d267640 1 -- 172.21.15.5:0/4120270140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d2813f3d0 msgr2=0x7f9d2813a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d2d267640 1 --2- 172.21.15.5:0/4120270140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d2813f3d0 0x7f9d2813a910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9d1801ca80 tx=0x7f9d180a8000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d1e7fc640 1 -- 172.21.15.5:0/4120270140 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9d180aba80 con 0x7f9d2813f3d0 2024-08-18T21:08:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d1e7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:08:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d1e7fc640 10 monclient: dump: 2024-08-18T21:08:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.837 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d1e7fc640 1 -- 172.21.15.5:0/4120270140 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f9d180ab610 con 0x7f9d2813f3d0 2024-08-18T21:08:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d1e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d1e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d1e7fc640 1 -- 172.21.15.5:0/4120270140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d2813f3d0 msgr2=0x7f9d2813a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d1e7fc640 1 --2- 172.21.15.5:0/4120270140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d2813f3d0 0x7f9d2813a910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9d1801ca80 tx=0x7f9d180a8000 comp rx=0 tx=0).stop 2024-08-18T21:08:39.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d1e7fc640 1 -- 172.21.15.5:0/4120270140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d2813f3d0 msgr2=0x7f9d2813a910 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:39.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d1e7fc640 1 --2- 172.21.15.5:0/4120270140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d2813f3d0 0x7f9d2813a910 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.838 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 239616, 2024-08-18T21:08:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:08:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:08:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:08:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:39.863 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:39.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:39.863 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:39.863 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:39.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d2fccc640 1 -- 172.21.15.5:0/4120270140 >> v2:172.21.15.157:6812/631023601 conn(0x7f9d0c03bdc0 msgr2=0x7f9d0c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d2fccc640 1 --2- 172.21.15.5:0/4120270140 >> v2:172.21.15.157:6812/631023601 conn(0x7f9d0c03bdc0 0x7f9d0c03e280 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009f60 tx=0x7f9d20009610 comp rx=0 tx=0).stop 2024-08-18T21:08:39.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d2fccc640 10 monclient: shutdown 2024-08-18T21:08:39.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d2fccc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:39.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d2fccc640 1 -- 172.21.15.5:0/4120270140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d280a6b60 msgr2=0x7f9d281d1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:39.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d2fccc640 1 --2- 172.21.15.5:0/4120270140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d280a6b60 0x7f9d281d1800 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400e840 tx=0x7f9d2400ed00 comp rx=0 tx=0).stop 2024-08-18T21:08:39.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d2e269640 1 -- 172.21.15.5:0/4120270140 reap_dead start 2024-08-18T21:08:39.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d2e269640 1 -- 172.21.15.5:0/4120270140 reap_dead start 2024-08-18T21:08:39.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d2fccc640 1 -- 172.21.15.5:0/4120270140 shutdown_connections 2024-08-18T21:08:39.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d2fccc640 1 -- 172.21.15.5:0/4120270140 >> 172.21.15.5:0/4120270140 conn(0x7f9d280ac950 msgr2=0x7f9d280a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:39.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d2fccc640 1 -- 172.21.15.5:0/4120270140 shutdown_connections 2024-08-18T21:08:39.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.822+0000 7f9d2fccc640 1 -- 172.21.15.5:0/4120270140 wait complete. 2024-08-18T21:08:39.865 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:39.866 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:08:39.866 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:08:39.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 10 monclient: get_monmap_and_config 2024-08-18T21:08:39.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 10 monclient: build_initial_monmap 2024-08-18T21:08:39.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 10 monclient: monmap: 2024-08-18T21:08:39.984 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:39.984 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.984 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:39.984722+0000 2024-08-18T21:08:39.984 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:39.984722+0000 2024-08-18T21:08:39.984 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:39.984 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.985 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:39.985 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:39.985 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:39.985 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:39.985 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:39.985 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:39.985 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:39.985 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:39.985 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:39.985 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:39.985 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:39.985 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 1 Processor -- start 2024-08-18T21:08:39.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 1 -- start start 2024-08-18T21:08:39.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 10 monclient: init 2024-08-18T21:08:39.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:39.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 10 monclient: _add_conns ranks=[10,7,3,6,5,9,0,4,1,8,2] 2024-08-18T21:08:39.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7c980a6ce0 0x7f7c980a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 10 monclient(hunting): picked mon.noname-f con 0x7f7c980a6ce0 addr v2:172.21.15.157:3300/0 2024-08-18T21:08:39.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c980a7600 0x7f7c98139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 10 monclient(hunting): picked mon.noname-i con 0x7f7c980a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:39.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c98139fe0 0x7f7c9813a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:39.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 10 monclient(hunting): picked mon.noname-g con 0x7f7c98139fe0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:39.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7c980a5000 con 0x7f7c980a6ce0 2024-08-18T21:08:39.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7c980a4360 con 0x7f7c98139fe0 2024-08-18T21:08:39.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:39.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7c980a45d0 con 0x7f7c980a7600 2024-08-18T21:08:39.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:39.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9fea2640 10 monclient(hunting): authenticate will time out at 1286.997959s 2024-08-18T21:08:39.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7c980a6ce0 0x7f7c980a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7c980a6ce0 0x7f7c980a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:40214/0 (socket says 172.21.15.5:40214) 2024-08-18T21:08:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 1 -- 172.21.15.5:0/1427274327 learned_addr learned my addr 172.21.15.5:0/1427274327 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 10 monclient(hunting): get_auth_request con 0x7f7c980a6ce0 auth_method 0 2024-08-18T21:08:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9e43f640 1 --2- 172.21.15.5:0/1427274327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c98139fe0 0x7f7c9813a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9d43d640 1 --2- 172.21.15.5:0/1427274327 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c980a7600 0x7f7c98139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9e43f640 10 monclient(hunting): get_auth_request con 0x7f7c98139fe0 auth_method 0 2024-08-18T21:08:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9e43f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9e43f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9e43f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9d43d640 10 monclient(hunting): get_auth_request con 0x7f7c980a7600 auth_method 0 2024-08-18T21:08:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9d43d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9d43d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9d43d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9e43f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9e43f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9e43f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9d43d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9d43d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9d43d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 10 monclient(hunting): handle_auth_done global_id 5698 payload 274 2024-08-18T21:08:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 1 -- 172.21.15.5:0/1427274327 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c980a7600 msgr2=0x7f7c98139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:39.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 1 --2- 172.21.15.5:0/1427274327 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c980a7600 0x7f7c98139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 1 -- 172.21.15.5:0/1427274327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c98139fe0 msgr2=0x7f7c9813a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:39.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 1 --2- 172.21.15.5:0/1427274327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c98139fe0 0x7f7c9813a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:39.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 10 monclient: _finish_hunting 0 2024-08-18T21:08:39.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 1 monclient: found mon.noname-f 2024-08-18T21:08:39.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:39.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:08:39.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.982+0000 7f7c9dc3e640 1 -- 172.21.15.5:0/1427274327 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c980a32d0 con 0x7f7c980a6ce0 2024-08-18T21:08:39.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9dc3e640 1 -- 172.21.15.5:0/1427274327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c980a6ce0 msgr2=0x7f7c980a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:39.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9dc3e640 1 --2- 172.21.15.5:0/1427274327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c980a6ce0 0x7f7c980a70c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009870 tx=0x7f7c9401c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc04a8ff5bd6fa1e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9cc3c640 1 -- 172.21.15.5:0/1427274327 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7c940b0070 con 0x7f7c980a6ce0 2024-08-18T21:08:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9cc3c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9cc3c640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:08:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9cc3c640 10 monclient: dump: 2024-08-18T21:08:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.997 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9cc3c640 10 monclient: _finish_auth 0 2024-08-18T21:08:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9cc3c640 10 monclient: _check_auth_tickets 2024-08-18T21:08:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9cc3c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9cc3c640 1 -- 172.21.15.5:0/1427274327 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c940aa810 con 0x7f7c980a6ce0 2024-08-18T21:08:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9cc3c640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9cc3c640 1 -- 172.21.15.5:0/1427274327 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7c940a9300 con 0x7f7c980a6ce0 2024-08-18T21:08:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9fea2640 5 monclient: authenticate success, global_id 5698 2024-08-18T21:08:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9fea2640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9fea2640 4 set_mon_vals no callback set 2024-08-18T21:08:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9cc3c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9cc3c640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:08:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.986+0000 7f7c9cc3c640 10 monclient: dump: 2024-08-18T21:08:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:39.999 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 10 monclient: shutdown 2024-08-18T21:08:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 -- 172.21.15.5:0/1427274327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c980a6ce0 msgr2=0x7f7c980a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 --2- 172.21.15.5:0/1427274327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c980a6ce0 0x7f7c980a70c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009870 tx=0x7f7c9401c420 comp rx=0 tx=0).stop 2024-08-18T21:08:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 -- 172.21.15.5:0/1427274327 shutdown_connections 2024-08-18T21:08:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 --2- 172.21.15.5:0/1427274327 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c980a7600 0x7f7c98139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 --2- 172.21.15.5:0/1427274327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c98139fe0 0x7f7c9813a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 --2- 172.21.15.5:0/1427274327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c980a6ce0 0x7f7c980a70c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 -- 172.21.15.5:0/1427274327 >> 172.21.15.5:0/1427274327 conn(0x7f7c980acbc0 msgr2=0x7f7c980a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 -- 172.21.15.5:0/1427274327 shutdown_connections 2024-08-18T21:08:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 -- 172.21.15.5:0/1427274327 wait complete. 2024-08-18T21:08:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 10 monclient: build_initial_monmap 2024-08-18T21:08:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 10 monclient: monmap: 2024-08-18T21:08:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:40.001 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 Processor -- start 2024-08-18T21:08:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 -- start start 2024-08-18T21:08:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 10 monclient: init 2024-08-18T21:08:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 10 monclient: _add_conns ranks=[7,0,6,8,5,3,1,2,4] 2024-08-18T21:08:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c980a6ce0 0x7f7c981364d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 10 monclient(hunting): picked mon.noname-i con 0x7f7c980a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c980a7600 0x7f7c98136a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 10 monclient(hunting): picked mon.noname-a con 0x7f7c980a7600 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:08:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7c98139fe0 0x7f7c9813c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 10 monclient(hunting): picked mon.noname-d con 0x7f7c98139fe0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7c980a79e0 con 0x7f7c980a7600 2024-08-18T21:08:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:40.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f7c980a8220 con 0x7f7c98139fe0 2024-08-18T21:08:40.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:40.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7c9813edf0 con 0x7f7c980a6ce0 2024-08-18T21:08:40.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:40.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9fea2640 10 monclient(hunting): authenticate will time out at 1287.006443s 2024-08-18T21:08:40.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7c98139fe0 0x7f7c9813c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:40.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9d43d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c980a7600 0x7f7c98136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:40.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7c98139fe0 0x7f7c9813c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:40308/0 (socket says 172.21.15.5:40308) 2024-08-18T21:08:40.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 1 -- 172.21.15.5:0/3352795063 learned_addr learned my addr 172.21.15.5:0/3352795063 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:40.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 10 monclient(hunting): get_auth_request con 0x7f7c98139fe0 auth_method 0 2024-08-18T21:08:40.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:40.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:40.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9d43d640 10 monclient(hunting): get_auth_request con 0x7f7c980a7600 auth_method 0 2024-08-18T21:08:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9d43d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9d43d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9d43d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9d43d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9d43d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9dc3e640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c980a6ce0 0x7f7c981364d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9d43d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9dc3e640 10 monclient(hunting): get_auth_request con 0x7f7c980a6ce0 auth_method 0 2024-08-18T21:08:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9dc3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9dc3e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9dc3e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 10 monclient(hunting): handle_auth_done global_id 84219 payload 824 2024-08-18T21:08:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 1 -- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c980a6ce0 msgr2=0x7f7c981364d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c980a6ce0 0x7f7c981364d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 1 -- 172.21.15.5:0/3352795063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c980a7600 msgr2=0x7f7c98136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c980a7600 0x7f7c98136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 10 monclient: _finish_hunting 0 2024-08-18T21:08:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 1 monclient: found mon.noname-d 2024-08-18T21:08:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:08:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9e43f640 1 -- 172.21.15.5:0/3352795063 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c98140030 con 0x7f7c98139fe0 2024-08-18T21:08:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.990+0000 7f7c9dc3e640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c980a6ce0 0x7f7c981364d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:08:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9e43f640 1 -- 172.21.15.5:0/3352795063 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7c98139fe0 msgr2=0x7f7c9813c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9e43f640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7c98139fe0 0x7f7c9813c890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000efc0 tx=0x7f7c9000c490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c8e7fc640 1 -- 172.21.15.5:0/3352795063 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7c90018020 con 0x7f7c98139fe0 2024-08-18T21:08:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c8e7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:08:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c8e7fc640 10 monclient: dump: 2024-08-18T21:08:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:40.012 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c8e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:08:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c8e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:08:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c8e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9fea2640 5 monclient: authenticate success, global_id 84219 2024-08-18T21:08:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c8e7fc640 1 -- 172.21.15.5:0/3352795063 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c900148f0 con 0x7f7c98139fe0 2024-08-18T21:08:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c8e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9fea2640 10 monclient: _renew_subs 2024-08-18T21:08:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c8e7fc640 1 -- 172.21.15.5:0/3352795063 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7c900133e0 con 0x7f7c98139fe0 2024-08-18T21:08:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9fea2640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:08:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9fea2640 1 -- 172.21.15.5:0/3352795063 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c98140310 con 0x7f7c98139fe0 2024-08-18T21:08:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c8e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:08:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c8f7fe640 4 set_mon_vals no callback set 2024-08-18T21:08:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c8e7fc640 10 monclient: dump: 2024-08-18T21:08:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:40.014 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:40.014 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:40.014 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:40.014 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:40.014 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:40.014 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:40.014 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:40.014 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:40.014 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:40.014 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:40.015 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9fea2640 10 monclient: _renew_subs 2024-08-18T21:08:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9fea2640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:08:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9fea2640 1 -- 172.21.15.5:0/3352795063 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c9813fd50 con 0x7f7c98139fe0 2024-08-18T21:08:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9fea2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9fea2640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c9813cdd0 0x7f7c9813d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9fea2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9fea2640 1 -- 172.21.15.5:0/3352795063 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7c98051140 con 0x7f7c9813cdd0 2024-08-18T21:08:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9e43f640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7c98139fe0 0x7f7c9813c890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000efc0 tx=0x7f7c9000c490 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7f7c9001b020 mgrmap(e 5) 2024-08-18T21:08:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c8e7fc640 1 -- 172.21.15.5:0/3352795063 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f7c9001b020 con 0x7f7c98139fe0 2024-08-18T21:08:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9dc3e640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c9813cdd0 0x7f7c9813d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9dc3e640 10 monclient: get_auth_request con 0x7f7c9813cdd0 auth_method 0 2024-08-18T21:08:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9dc3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9dc3e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9dc3e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c8e7fc640 1 --2- 172.21.15.5:0/3352795063 >> v2:172.21.15.157:6812/631023601 conn(0x7f7c7c03bdc0 0x7f7c7c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9dc3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9dc3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9dc3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9d43d640 1 --2- 172.21.15.5:0/3352795063 >> v2:172.21.15.157:6812/631023601 conn(0x7f7c7c03bdc0 0x7f7c7c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9d43d640 10 monclient: get_auth_request con 0x7f7c7c03bdc0 auth_method 0 2024-08-18T21:08:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9dc3e640 10 monclient(hunting): handle_auth_done global_id 5596 payload 824 2024-08-18T21:08:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.994+0000 7f7c9dc3e640 1 -- 172.21.15.5:0/3352795063 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c9813e730 con 0x7f7c9813cdd0 2024-08-18T21:08:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.998+0000 7f7c9dc3e640 1 -- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c9813cdd0 msgr2=0x7f7c9813d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.998+0000 7f7c9dc3e640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c9813cdd0 0x7f7c9813d1b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7c940ad000 tx=0x7f7c940191c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.998+0000 7f7c8e7fc640 1 -- 172.21.15.5:0/3352795063 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7c940b0040 con 0x7f7c9813cdd0 2024-08-18T21:08:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.998+0000 7f7c8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.998+0000 7f7c8e7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:08:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.998+0000 7f7c8e7fc640 10 monclient: dump: 2024-08-18T21:08:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:40.018 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.998+0000 7f7c9d43d640 1 --2- 172.21.15.5:0/3352795063 >> v2:172.21.15.157:6812/631023601 conn(0x7f7c7c03bdc0 0x7f7c7c03e280 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009b60 tx=0x7f7c88009190 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.998+0000 7f7c8e7fc640 1 -- 172.21.15.5:0/3352795063 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7c94003ae0 con 0x7f7c9813cdd0 2024-08-18T21:08:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.998+0000 7f7c8e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.998+0000 7f7c8e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.998+0000 7f7c8e7fc640 1 -- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c9813cdd0 msgr2=0x7f7c9813d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.998+0000 7f7c8e7fc640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c9813cdd0 0x7f7c9813d1b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7c940ad000 tx=0x7f7c940191c0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.998+0000 7f7c8e7fc640 1 -- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c9813cdd0 msgr2=0x7f7c9813d1b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:39.998+0000 7f7c8e7fc640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c9813cdd0 0x7f7c9813d1b0 secure :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7c940ad000 tx=0x7f7c940191c0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.006+0000 7f7c9fea2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.006+0000 7f7c9fea2640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c9813d6f0 0x7f7c9809ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.006+0000 7f7c9fea2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.006+0000 7f7c9fea2640 1 -- 172.21.15.5:0/3352795063 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7c98069fa0 con 0x7f7c9813d6f0 2024-08-18T21:08:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.006+0000 7f7c9dc3e640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c9813d6f0 0x7f7c9809ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.006+0000 7f7c9dc3e640 10 monclient: get_auth_request con 0x7f7c9813d6f0 auth_method 0 2024-08-18T21:08:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.006+0000 7f7c9dc3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.006+0000 7f7c9dc3e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.006+0000 7f7c9dc3e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.006+0000 7f7c9dc3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.006+0000 7f7c9dc3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.006+0000 7f7c9dc3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.006+0000 7f7c9dc3e640 10 monclient(hunting): handle_auth_done global_id 5605 payload 824 2024-08-18T21:08:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.006+0000 7f7c9dc3e640 1 -- 172.21.15.5:0/3352795063 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7c980a7b60 con 0x7f7c9813d6f0 2024-08-18T21:08:40.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c9dc3e640 1 -- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c9813d6f0 msgr2=0x7f7c9809ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:40.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c9dc3e640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c9813d6f0 0x7f7c9809ebf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7c9401aad0 tx=0x7f7c940a8000 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:40.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c8e7fc640 1 -- 172.21.15.5:0/3352795063 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7c940b0040 con 0x7f7c9813d6f0 2024-08-18T21:08:40.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:40.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c8e7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:08:40.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c8e7fc640 10 monclient: dump: 2024-08-18T21:08:40.022 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:40.022 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:40.022 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:40.022 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:40.022 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:40.022 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:40.022 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:40.022 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:40.022 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:40.023 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c8e7fc640 1 -- 172.21.15.5:0/3352795063 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9582 (secure 0 0 0) 0x7f7c940044e0 con 0x7f7c9813d6f0 2024-08-18T21:08:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c8e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c8e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c8e7fc640 1 -- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c9813d6f0 msgr2=0x7f7c9809ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:40.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c8e7fc640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c9813d6f0 0x7f7c9809ebf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7c9401aad0 tx=0x7f7c940a8000 comp rx=0 tx=0).stop 2024-08-18T21:08:40.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c8e7fc640 1 -- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c9813d6f0 msgr2=0x7f7c9809ebf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:40.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c8e7fc640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7c9813d6f0 0x7f7c9809ebf0 secure :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7c9401aad0 tx=0x7f7c940a8000 comp rx=0 tx=0).stop 2024-08-18T21:08:40.024 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 329108, 2024-08-18T21:08:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:08:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:08:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:08:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:08:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:40.049 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c9fea2640 1 -- 172.21.15.5:0/3352795063 >> v2:172.21.15.157:6812/631023601 conn(0x7f7c7c03bdc0 msgr2=0x7f7c7c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c9fea2640 1 --2- 172.21.15.5:0/3352795063 >> v2:172.21.15.157:6812/631023601 conn(0x7f7c7c03bdc0 0x7f7c7c03e280 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009b60 tx=0x7f7c88009190 comp rx=0 tx=0).stop 2024-08-18T21:08:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c9fea2640 10 monclient: shutdown 2024-08-18T21:08:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c9fea2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c9fea2640 1 -- 172.21.15.5:0/3352795063 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7c98139fe0 msgr2=0x7f7c9813c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c9fea2640 1 --2- 172.21.15.5:0/3352795063 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7c98139fe0 0x7f7c9813c890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000efc0 tx=0x7f7c9000c490 comp rx=0 tx=0).stop 2024-08-18T21:08:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c9e43f640 1 -- 172.21.15.5:0/3352795063 reap_dead start 2024-08-18T21:08:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c9e43f640 1 -- 172.21.15.5:0/3352795063 reap_dead start 2024-08-18T21:08:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c8e7fc640 1 -- 172.21.15.5:0/3352795063 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(142..142 src has 22..142) ==== 3506+0+0 (unknown 0 0 0) 0x7f7c9004eea0 con 0x7f7c98139fe0 2024-08-18T21:08:40.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c9fea2640 1 -- 172.21.15.5:0/3352795063 shutdown_connections 2024-08-18T21:08:40.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c9fea2640 1 -- 172.21.15.5:0/3352795063 >> 172.21.15.5:0/3352795063 conn(0x7f7c980acbc0 msgr2=0x7f7c980a5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:40.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c9fea2640 1 -- 172.21.15.5:0/3352795063 shutdown_connections 2024-08-18T21:08:40.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.010+0000 7f7c9fea2640 1 -- 172.21.15.5:0/3352795063 wait complete. 2024-08-18T21:08:40.052 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:40.052 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-18T21:08:40.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-18T21:08:40.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.162+0000 7f53f7655640 10 monclient: get_monmap_and_config 2024-08-18T21:08:40.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.162+0000 7f53f7655640 10 monclient: build_initial_monmap 2024-08-18T21:08:40.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.162+0000 7f53f7655640 10 monclient: monmap: 2024-08-18T21:08:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:40.167990+0000 2024-08-18T21:08:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:40.167990+0000 2024-08-18T21:08:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:40.169 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 1 Processor -- start 2024-08-18T21:08:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 1 -- start start 2024-08-18T21:08:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 10 monclient: init 2024-08-18T21:08:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 10 monclient: _add_conns ranks=[6,7,8,5,4,9,2,3,0,1,10] 2024-08-18T21:08:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f53f00a6ce0 0x7f53f00a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 10 monclient(hunting): picked mon.noname-d con 0x7f53f00a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f53f00a7600 0x7f53f0139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 10 monclient(hunting): picked mon.noname-i con 0x7f53f00a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f53f0139fe0 0x7f53f013a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 10 monclient(hunting): picked mon.noname-e con 0x7f53f0139fe0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:08:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f53f00a5000 con 0x7f53f00a6ce0 2024-08-18T21:08:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f53f00a4360 con 0x7f53f00a7600 2024-08-18T21:08:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f53f00a45d0 con 0x7f53f0139fe0 2024-08-18T21:08:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f7655640 10 monclient(hunting): authenticate will time out at 1287.181269s 2024-08-18T21:08:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f53f0139fe0 0x7f53f013a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f53f0139fe0 0x7f53f013a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:45304/0 (socket says 172.21.15.5:45304) 2024-08-18T21:08:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 1 -- 172.21.15.5:0/3423735586 learned_addr learned my addr 172.21.15.5:0/3423735586 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 10 monclient(hunting): get_auth_request con 0x7f53f0139fe0 auth_method 0 2024-08-18T21:08:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f53f1640 1 --2- 172.21.15.5:0/3423735586 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f53f00a6ce0 0x7f53f00a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f53f1640 10 monclient(hunting): get_auth_request con 0x7f53f00a6ce0 auth_method 0 2024-08-18T21:08:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f53f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f53f1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f53f1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f53f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f53f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:40.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f53f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:40.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 10 monclient(hunting): handle_auth_done global_id 54818 payload 274 2024-08-18T21:08:40.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 1 -- 172.21.15.5:0/3423735586 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f53f00a7600 msgr2=0x7f53f0139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:40.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f4bf0640 1 --2- 172.21.15.5:0/3423735586 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f53f00a7600 0x7f53f0139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:40.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 1 --2- 172.21.15.5:0/3423735586 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f53f00a7600 0x7f53f0139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 1 -- 172.21.15.5:0/3423735586 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f53f00a6ce0 msgr2=0x7f53f00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:40.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 1 --2- 172.21.15.5:0/3423735586 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f53f00a6ce0 0x7f53f00a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 10 monclient: _finish_hunting 0 2024-08-18T21:08:40.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 1 monclient: found mon.noname-e 2024-08-18T21:08:40.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:40.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:08:40.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f5bf2640 1 -- 172.21.15.5:0/3423735586 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f00a32d0 con 0x7f53f0139fe0 2024-08-18T21:08:40.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f4bf0640 10 monclient: get_auth_request con 0x7f53f00a7600 auth_method 0 2024-08-18T21:08:40.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f53f1640 1 --2- 172.21.15.5:0/3423735586 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f53f00a6ce0 0x7f53f00a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:08:40.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.166+0000 7f53f4bf0640 1 --2- 172.21.15.5:0/3423735586 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f53f00a7600 0x7f53f0139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:08:40.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53f5bf2640 1 -- 172.21.15.5:0/3423735586 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f53f0139fe0 msgr2=0x7f53f013a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:40.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53f5bf2640 1 --2- 172.21.15.5:0/3423735586 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f53f0139fe0 0x7f53f013a440 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009eb0 tx=0x7f53e801c8f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=c7a66317dad10892 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:40.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53e7fff640 1 -- 172.21.15.5:0/3423735586 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f53e80090d0 con 0x7f53f0139fe0 2024-08-18T21:08:40.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:40.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53e7fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:08:40.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53e7fff640 10 monclient: dump: 2024-08-18T21:08:40.179 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:40.179 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:40.181 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53e7fff640 10 monclient: _finish_auth 0 2024-08-18T21:08:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53e7fff640 10 monclient: _check_auth_tickets 2024-08-18T21:08:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53e7fff640 1 -- 172.21.15.5:0/3423735586 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e80a5a30 con 0x7f53f0139fe0 2024-08-18T21:08:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53f7655640 5 monclient: authenticate success, global_id 54818 2024-08-18T21:08:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53f7655640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:08:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53e7fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53f7655640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53f7655640 4 set_mon_vals no callback set 2024-08-18T21:08:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53e7fff640 1 -- 172.21.15.5:0/3423735586 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f53e80a5be0 con 0x7f53f0139fe0 2024-08-18T21:08:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53e7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53e7fff640 10 monclient: dump: 2024-08-18T21:08:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:40.183 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53f7655640 10 monclient: shutdown 2024-08-18T21:08:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53f7655640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53f7655640 1 -- 172.21.15.5:0/3423735586 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f53f0139fe0 msgr2=0x7f53f013a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53f7655640 1 --2- 172.21.15.5:0/3423735586 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f53f0139fe0 0x7f53f013a440 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009eb0 tx=0x7f53e801c8f0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53f7655640 1 -- 172.21.15.5:0/3423735586 shutdown_connections 2024-08-18T21:08:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53f7655640 1 --2- 172.21.15.5:0/3423735586 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f53f0139fe0 0x7f53f013a440 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53f7655640 1 --2- 172.21.15.5:0/3423735586 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f53f00a7600 0x7f53f0139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53f7655640 1 --2- 172.21.15.5:0/3423735586 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f53f00a6ce0 0x7f53f00a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53f7655640 1 -- 172.21.15.5:0/3423735586 >> 172.21.15.5:0/3423735586 conn(0x7f53f00acbc0 msgr2=0x7f53f00a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.170+0000 7f53f7655640 1 -- 172.21.15.5:0/3423735586 shutdown_connections 2024-08-18T21:08:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 1 -- 172.21.15.5:0/3423735586 wait complete. 2024-08-18T21:08:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 10 monclient: build_initial_monmap 2024-08-18T21:08:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 10 monclient: monmap: 2024-08-18T21:08:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:40.185 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 1 Processor -- start 2024-08-18T21:08:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 1 -- start start 2024-08-18T21:08:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 10 monclient: init 2024-08-18T21:08:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 10 monclient: _add_conns ranks=[2,3,5,6,1,7,0,4,8] 2024-08-18T21:08:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f53f00a6ce0 0x7f53f01d1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 10 monclient(hunting): picked mon.noname-b con 0x7f53f00a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:08:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53f00a7600 0x7f53f013ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 10 monclient(hunting): picked mon.noname-g con 0x7f53f00a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f53f0139fe0 0x7f53f0140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 10 monclient(hunting): picked mon.noname-h con 0x7f53f0139fe0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f53f00a79e0 con 0x7f53f00a6ce0 2024-08-18T21:08:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f53f00a8220 con 0x7f53f00a7600 2024-08-18T21:08:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f53f013a4e0 con 0x7f53f0139fe0 2024-08-18T21:08:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f7655640 10 monclient(hunting): authenticate will time out at 1287.189684s 2024-08-18T21:08:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f53f00a6ce0 0x7f53f01d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f53f00a6ce0 0x7f53f01d1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59880/0 (socket says 172.21.15.5:59880) 2024-08-18T21:08:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 1 -- 172.21.15.5:0/2750698154 learned_addr learned my addr 172.21.15.5:0/2750698154 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 10 monclient(hunting): get_auth_request con 0x7f53f00a6ce0 auth_method 0 2024-08-18T21:08:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f5bf2640 1 --2- 172.21.15.5:0/2750698154 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f53f0139fe0 0x7f53f0140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f4bf0640 1 --2- 172.21.15.5:0/2750698154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53f00a7600 0x7f53f013ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f5bf2640 10 monclient(hunting): get_auth_request con 0x7f53f0139fe0 auth_method 0 2024-08-18T21:08:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f5bf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f5bf2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f5bf2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 10 monclient(hunting): handle_auth_done global_id 84188 payload 824 2024-08-18T21:08:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 1 -- 172.21.15.5:0/2750698154 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f53f0139fe0 msgr2=0x7f53f0140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 1 --2- 172.21.15.5:0/2750698154 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f53f0139fe0 0x7f53f0140450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 1 -- 172.21.15.5:0/2750698154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53f00a7600 msgr2=0x7f53f013ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 1 --2- 172.21.15.5:0/2750698154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53f00a7600 0x7f53f013ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 10 monclient: _finish_hunting 0 2024-08-18T21:08:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 1 monclient: found mon.noname-b 2024-08-18T21:08:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:08:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f53f1640 1 -- 172.21.15.5:0/2750698154 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f013e9e0 con 0x7f53f00a6ce0 2024-08-18T21:08:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f4bf0640 10 monclient: get_auth_request con 0x7f53f00a7600 auth_method 0 2024-08-18T21:08:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.174+0000 7f53f4bf0640 1 --2- 172.21.15.5:0/2750698154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53f00a7600 0x7f53f013ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:08:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53f53f1640 1 -- 172.21.15.5:0/2750698154 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f53f00a6ce0 msgr2=0x7f53f01d1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53f53f1640 1 --2- 172.21.15.5:0/2750698154 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f53f00a6ce0 0x7f53f01d1800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00ebe0 tx=0x7f53ec00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e5ffb640 1 -- 172.21.15.5:0/2750698154 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f53ec017070 con 0x7f53f00a6ce0 2024-08-18T21:08:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:08:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e5ffb640 10 monclient: dump: 2024-08-18T21:08:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:40.192 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e5ffb640 10 monclient: _finish_auth 0 2024-08-18T21:08:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e5ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:08:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e5ffb640 1 -- 172.21.15.5:0/2750698154 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ec00cde0 con 0x7f53f00a6ce0 2024-08-18T21:08:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53f7655640 5 monclient: authenticate success, global_id 84188 2024-08-18T21:08:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53f7655640 10 monclient: _renew_subs 2024-08-18T21:08:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53f7655640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:08:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53f7655640 1 -- 172.21.15.5:0/2750698154 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f013c680 con 0x7f53f00a6ce0 2024-08-18T21:08:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e5ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e5ffb640 1 -- 172.21.15.5:0/2750698154 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f53ec013d50 con 0x7f53f00a6ce0 2024-08-18T21:08:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:08:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e77fe640 4 set_mon_vals no callback set 2024-08-18T21:08:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e5ffb640 10 monclient: dump: 2024-08-18T21:08:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:40.195 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53f7655640 10 monclient: _renew_subs 2024-08-18T21:08:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53f7655640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:08:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53f7655640 1 -- 172.21.15.5:0/2750698154 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f013e420 con 0x7f53f00a6ce0 2024-08-18T21:08:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53f7655640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53f7655640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53f7655640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:08:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e5ffb640 1 -- 172.21.15.5:0/2750698154 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f53ec01a070 con 0x7f53f00a6ce0 2024-08-18T21:08:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53f7655640 1 -- 172.21.15.5:0/2750698154 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f0139d00 con 0x7f53f00a6ce0 2024-08-18T21:08:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e5ffb640 1 --2- 172.21.15.5:0/2750698154 >> v2:172.21.15.157:6812/631023601 conn(0x7f53d403bdc0 0x7f53d403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53e5ffb640 1 -- 172.21.15.5:0/2750698154 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(142..142 src has 22..142) ==== 3506+0+0 (secure 0 0 0) 0x7f53ec00f040 con 0x7f53f00a6ce0 2024-08-18T21:08:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53f4bf0640 1 --2- 172.21.15.5:0/2750698154 >> v2:172.21.15.157:6812/631023601 conn(0x7f53d403bdc0 0x7f53d403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.178+0000 7f53f4bf0640 10 monclient: get_auth_request con 0x7f53d403bdc0 auth_method 0 2024-08-18T21:08:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.182+0000 7f53f4bf0640 1 --2- 172.21.15.5:0/2750698154 >> v2:172.21.15.157:6812/631023601 conn(0x7f53d403bdc0 0x7f53d403e280 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f53e0006fd0 tx=0x7f53e0008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.182+0000 7f53e5ffb640 1 -- 172.21.15.5:0/2750698154 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f53f0139d00 con 0x7f53f00a6ce0 2024-08-18T21:08:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.182+0000 7f53e5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.182+0000 7f53e5ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.422+0000 7f53f7655640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-18T21:08:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.422+0000 7f53f7655640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-18T21:08:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.422+0000 7f53f7655640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:08:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.422+0000 7f53f7655640 1 -- 172.21.15.5:0/2750698154 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f53f00aa480 con 0x7f53f00a6ce0 2024-08-18T21:08:40.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.434+0000 7f53e5ffb640 1 -- 172.21.15.5:0/2750698154 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f53f00aa480 con 0x7f53f00a6ce0 2024-08-18T21:08:40.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.434+0000 7f53e5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-18T21:08:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.434+0000 7f53e5ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:40.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f53f7655640 1 -- 172.21.15.5:0/2750698154 >> v2:172.21.15.157:6812/631023601 conn(0x7f53d403bdc0 msgr2=0x7f53d403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:40.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f53f7655640 1 --2- 172.21.15.5:0/2750698154 >> v2:172.21.15.157:6812/631023601 conn(0x7f53d403bdc0 0x7f53d403e280 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f53e0006fd0 tx=0x7f53e0008040 comp rx=0 tx=0).stop 2024-08-18T21:08:40.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f53f7655640 10 monclient: shutdown 2024-08-18T21:08:40.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f53f7655640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:40.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f53f7655640 1 -- 172.21.15.5:0/2750698154 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f53f00a6ce0 msgr2=0x7f53f01d1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:40.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f53f7655640 1 --2- 172.21.15.5:0/2750698154 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f53f00a6ce0 0x7f53f01d1800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00ebe0 tx=0x7f53ec00c520 comp rx=0 tx=0).stop 2024-08-18T21:08:40.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f53f7655640 1 -- 172.21.15.5:0/2750698154 shutdown_connections 2024-08-18T21:08:40.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f53f7655640 1 --2- 172.21.15.5:0/2750698154 >> v2:172.21.15.157:6812/631023601 conn(0x7f53d403bdc0 0x7f53d403e280 secure :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f53e0006fd0 tx=0x7f53e0008040 comp rx=0 tx=0).stop 2024-08-18T21:08:40.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f53f7655640 1 --2- 172.21.15.5:0/2750698154 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f53f0139fe0 0x7f53f0140450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f53f7655640 1 --2- 172.21.15.5:0/2750698154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53f00a7600 0x7f53f013ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f53f7655640 1 --2- 172.21.15.5:0/2750698154 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f53f00a6ce0 0x7f53f01d1800 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:40.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f53f7655640 1 -- 172.21.15.5:0/2750698154 >> 172.21.15.5:0/2750698154 conn(0x7f53f00acbc0 msgr2=0x7f53f0138440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:40.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f53f7655640 1 -- 172.21.15.5:0/2750698154 shutdown_connections 2024-08-18T21:08:40.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f53f7655640 1 -- 172.21.15.5:0/2750698154 wait complete. 2024-08-18T21:08:40.452 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:40.452 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=1,health=11,kv=8,logm=65} crc {auth=2861040377,config=1228700967,health=4209370878,kv=2616826899,logm=1131320714}) 2024-08-18T21:08:40.453 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=14,config=2,health=12,kv=9,logm=63} crc {auth=378367569,config=1618278320,health=641734612,kv=672252078,logm=3730744428}) 2024-08-18T21:08:40.453 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:40.453 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=1,health=11,kv=8,logm=65} crc {auth=2861040377,config=1228700967,health=4209370878,kv=2616826899,logm=1131320714}) 2024-08-18T21:08:40.453 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=15,config=2,health=11,kv=10,logm=62} crc {auth=2861040377,config=1618278320,health=2496408270,kv=3664197221,logm=1432582864}) 2024-08-18T21:08:40.453 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:40.453 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=1,health=11,kv=8,logm=65} crc {auth=2861040377,config=1228700967,health=4209370878,kv=2616826899,logm=1131320714}) 2024-08-18T21:08:40.453 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=14,config=2,health=12,kv=10,logm=62} crc {auth=3603456873,config=1618278320,health=641734612,kv=3664197221,logm=1791375962}) 2024-08-18T21:08:40.453 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:40.453 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=1,health=11,kv=8,logm=65} crc {auth=2861040377,config=1228700967,health=4209370878,kv=2616826899,logm=1131320714}) 2024-08-18T21:08:40.453 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=15,config=2,health=11,kv=10,logm=62} crc {auth=2861040377,config=1618278320,health=2496408270,kv=3664197221,logm=3000324486}) 2024-08-18T21:08:40.453 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:40.453 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=1,health=11,kv=8,logm=65} crc {auth=2861040377,config=1228700967,health=4209370878,kv=2616826899,logm=1131320714}) 2024-08-18T21:08:40.453 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=14,config=2,health=11,kv=9,logm=64} crc {auth=3941315719,config=1618278320,health=3869719742,kv=3664197221,logm=1764107762}) 2024-08-18T21:08:40.454 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:40.454 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=1,health=11,kv=8,logm=65} crc {auth=2861040377,config=1228700967,health=4209370878,kv=2616826899,logm=1131320714}) 2024-08-18T21:08:40.454 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=15,config=2,health=10,kv=10,logm=63} crc {auth=2861040377,config=1618278320,health=4051220650,kv=3664197221,logm=2129558703}) 2024-08-18T21:08:40.454 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:40.454 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=1,health=11,kv=8,logm=65} crc {auth=2861040377,config=1228700967,health=4209370878,kv=2616826899,logm=1131320714}) 2024-08-18T21:08:40.454 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=14,config=2,health=10,kv=10,logm=64} crc {auth=2222879078,config=1618278320,health=3842293808,kv=3664197221,logm=2460551324}) 2024-08-18T21:08:40.454 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:40.454 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=1,health=11,kv=8,logm=65} crc {auth=2861040377,config=1228700967,health=4209370878,kv=2616826899,logm=1131320714}) 2024-08-18T21:08:40.454 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.446+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=14,config=2,health=11,kv=10,logm=63} crc {auth=945924906,config=1618278320,health=4209370878,kv=1515633572,logm=765351523}) 2024-08-18T21:08:40.470 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-18T21:08:40.512 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:40.512 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3533634803}) 2024-08-18T21:08:40.512 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3611085304}) 2024-08-18T21:08:40.513 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:40.513 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3533634803}) 2024-08-18T21:08:40.513 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=359830229}) 2024-08-18T21:08:40.513 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:40.513 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3533634803}) 2024-08-18T21:08:40.513 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1652822412}) 2024-08-18T21:08:40.513 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:40.513 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3533634803}) 2024-08-18T21:08:40.513 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3187517982}) 2024-08-18T21:08:40.513 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:40.513 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3533634803}) 2024-08-18T21:08:40.513 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1428359793}) 2024-08-18T21:08:40.514 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:40.514 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3533634803}) 2024-08-18T21:08:40.514 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=161539472}) 2024-08-18T21:08:40.514 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:40.514 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3533634803}) 2024-08-18T21:08:40.514 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=789258999}) 2024-08-18T21:08:40.514 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:40.514 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3533634803}) 2024-08-18T21:08:40.514 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:40.506+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=611669547}) 2024-08-18T21:08:41.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2536046292}) 2024-08-18T21:08:41.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3516623378}) 2024-08-18T21:08:41.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2536046292}) 2024-08-18T21:08:41.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2754078678}) 2024-08-18T21:08:41.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2536046292}) 2024-08-18T21:08:41.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2239307017}) 2024-08-18T21:08:41.335 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2536046292}) 2024-08-18T21:08:41.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=801734328}) 2024-08-18T21:08:41.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2536046292}) 2024-08-18T21:08:41.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2284008378}) 2024-08-18T21:08:41.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2536046292}) 2024-08-18T21:08:41.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1282362078}) 2024-08-18T21:08:41.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2536046292}) 2024-08-18T21:08:41.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2337431819}) 2024-08-18T21:08:41.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2536046292}) 2024-08-18T21:08:41.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.330+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=262665250}) 2024-08-18T21:08:41.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.334+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.334+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3263326769}) 2024-08-18T21:08:41.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.334+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3251898258}) 2024-08-18T21:08:41.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.334+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.334+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3263326769}) 2024-08-18T21:08:41.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.334+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1396318404}) 2024-08-18T21:08:41.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.334+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.334+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3263326769}) 2024-08-18T21:08:41.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.334+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3514615551}) 2024-08-18T21:08:41.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.334+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.334+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3263326769}) 2024-08-18T21:08:41.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.334+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3241128103}) 2024-08-18T21:08:41.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.334+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.334+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3263326769}) 2024-08-18T21:08:41.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.334+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1304025605}) 2024-08-18T21:08:41.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.334+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.338+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3263326769}) 2024-08-18T21:08:41.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.338+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3955473135}) 2024-08-18T21:08:41.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.338+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.338+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3263326769}) 2024-08-18T21:08:41.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.338+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=220399827}) 2024-08-18T21:08:41.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.338+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.338+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3263326769}) 2024-08-18T21:08:41.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.338+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1209388751}) 2024-08-18T21:08:41.345 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.345 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=151120272}) 2024-08-18T21:08:41.345 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3332131332}) 2024-08-18T21:08:41.345 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.345 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=151120272}) 2024-08-18T21:08:41.345 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4138575566}) 2024-08-18T21:08:41.345 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=151120272}) 2024-08-18T21:08:41.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1105720792}) 2024-08-18T21:08:41.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=151120272}) 2024-08-18T21:08:41.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3768093872}) 2024-08-18T21:08:41.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=151120272}) 2024-08-18T21:08:41.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2494509536}) 2024-08-18T21:08:41.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=151120272}) 2024-08-18T21:08:41.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2079779573}) 2024-08-18T21:08:41.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=151120272}) 2024-08-18T21:08:41.346 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3813329066}) 2024-08-18T21:08:41.347 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.347 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=151120272}) 2024-08-18T21:08:41.347 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.342+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1677905222}) 2024-08-18T21:08:41.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1114681704}) 2024-08-18T21:08:41.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=300731313}) 2024-08-18T21:08:41.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1114681704}) 2024-08-18T21:08:41.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2798988612}) 2024-08-18T21:08:41.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1114681704}) 2024-08-18T21:08:41.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3050229406}) 2024-08-18T21:08:41.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1114681704}) 2024-08-18T21:08:41.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3631476349}) 2024-08-18T21:08:41.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1114681704}) 2024-08-18T21:08:41.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=676668845}) 2024-08-18T21:08:41.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1114681704}) 2024-08-18T21:08:41.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1527840668}) 2024-08-18T21:08:41.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1114681704}) 2024-08-18T21:08:41.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=628371201}) 2024-08-18T21:08:41.351 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.352 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1114681704}) 2024-08-18T21:08:41.352 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.346+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1506835706}) 2024-08-18T21:08:41.354 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.355 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=462650553}) 2024-08-18T21:08:41.355 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1673833466}) 2024-08-18T21:08:41.355 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.355 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=462650553}) 2024-08-18T21:08:41.355 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1881035905}) 2024-08-18T21:08:41.355 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.355 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=462650553}) 2024-08-18T21:08:41.355 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2746905515}) 2024-08-18T21:08:41.355 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.355 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=462650553}) 2024-08-18T21:08:41.355 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4276269527}) 2024-08-18T21:08:41.355 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.355 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=462650553}) 2024-08-18T21:08:41.355 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3972268388}) 2024-08-18T21:08:41.356 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.356 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=462650553}) 2024-08-18T21:08:41.356 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2391637259}) 2024-08-18T21:08:41.356 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.356 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=462650553}) 2024-08-18T21:08:41.356 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3973896393}) 2024-08-18T21:08:41.356 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.356 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=462650553}) 2024-08-18T21:08:41.356 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.350+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2919834029}) 2024-08-18T21:08:41.359 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.359 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=506537026}) 2024-08-18T21:08:41.359 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1310978941}) 2024-08-18T21:08:41.359 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.359 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=506537026}) 2024-08-18T21:08:41.360 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2715045152}) 2024-08-18T21:08:41.360 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.360 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=506537026}) 2024-08-18T21:08:41.360 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=750220708}) 2024-08-18T21:08:41.360 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.360 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=506537026}) 2024-08-18T21:08:41.360 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3304504370}) 2024-08-18T21:08:41.360 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.360 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=506537026}) 2024-08-18T21:08:41.360 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=360127928}) 2024-08-18T21:08:41.360 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.360 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=506537026}) 2024-08-18T21:08:41.360 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=993802033}) 2024-08-18T21:08:41.361 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.361 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=506537026}) 2024-08-18T21:08:41.361 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1509897187}) 2024-08-18T21:08:41.361 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.361 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=506537026}) 2024-08-18T21:08:41.361 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.354+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3244591144}) 2024-08-18T21:08:41.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=604243281}) 2024-08-18T21:08:41.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2521251900}) 2024-08-18T21:08:41.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=604243281}) 2024-08-18T21:08:41.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=626500342}) 2024-08-18T21:08:41.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=604243281}) 2024-08-18T21:08:41.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1862503684}) 2024-08-18T21:08:41.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=604243281}) 2024-08-18T21:08:41.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=794053861}) 2024-08-18T21:08:41.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=604243281}) 2024-08-18T21:08:41.365 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1119858371}) 2024-08-18T21:08:41.365 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.365 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=604243281}) 2024-08-18T21:08:41.365 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1071994102}) 2024-08-18T21:08:41.365 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.365 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=604243281}) 2024-08-18T21:08:41.365 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2114580337}) 2024-08-18T21:08:41.365 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.365 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=604243281}) 2024-08-18T21:08:41.365 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.358+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1292246061}) 2024-08-18T21:08:41.436 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.430+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.436 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.430+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=36098629}) 2024-08-18T21:08:41.436 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.430+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=393400365}) 2024-08-18T21:08:41.436 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.430+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.436 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.430+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=36098629}) 2024-08-18T21:08:41.436 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.430+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4060959661}) 2024-08-18T21:08:41.437 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.430+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.437 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.430+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=36098629}) 2024-08-18T21:08:41.437 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.430+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3989225432}) 2024-08-18T21:08:41.437 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.430+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.437 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.430+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=36098629}) 2024-08-18T21:08:41.437 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.434+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1293120418}) 2024-08-18T21:08:41.437 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.434+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.437 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.434+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=36098629}) 2024-08-18T21:08:41.437 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.434+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2367142254}) 2024-08-18T21:08:41.437 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.434+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.437 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.434+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=36098629}) 2024-08-18T21:08:41.437 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.434+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2276545822}) 2024-08-18T21:08:41.437 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.434+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.438 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.434+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=36098629}) 2024-08-18T21:08:41.438 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.434+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1993298350}) 2024-08-18T21:08:41.438 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.434+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.438 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.434+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=36098629}) 2024-08-18T21:08:41.438 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.434+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1198398696}) 2024-08-18T21:08:41.467 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.467 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3961503959}) 2024-08-18T21:08:41.467 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=327811555}) 2024-08-18T21:08:41.467 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.467 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3961503959}) 2024-08-18T21:08:41.467 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=876273487}) 2024-08-18T21:08:41.468 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.468 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3961503959}) 2024-08-18T21:08:41.468 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1618965029}) 2024-08-18T21:08:41.468 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.468 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3961503959}) 2024-08-18T21:08:41.468 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=8870223}) 2024-08-18T21:08:41.468 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.468 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3961503959}) 2024-08-18T21:08:41.468 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3105508412}) 2024-08-18T21:08:41.468 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.468 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3961503959}) 2024-08-18T21:08:41.468 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=199096816}) 2024-08-18T21:08:41.468 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.468 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3961503959}) 2024-08-18T21:08:41.469 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1242661458}) 2024-08-18T21:08:41.469 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.469 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3961503959}) 2024-08-18T21:08:41.469 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.462+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=655107288}) 2024-08-18T21:08:41.470 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:08:41.470 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:08:41.485 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.485 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3602607894}) 2024-08-18T21:08:41.486 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3395055867}) 2024-08-18T21:08:41.486 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.486 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3602607894}) 2024-08-18T21:08:41.486 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=726004703}) 2024-08-18T21:08:41.486 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.486 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3602607894}) 2024-08-18T21:08:41.486 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1688882089}) 2024-08-18T21:08:41.486 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.486 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3602607894}) 2024-08-18T21:08:41.486 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1772873659}) 2024-08-18T21:08:41.486 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.486 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3602607894}) 2024-08-18T21:08:41.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3162900997}) 2024-08-18T21:08:41.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3602607894}) 2024-08-18T21:08:41.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2809607468}) 2024-08-18T21:08:41.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3602607894}) 2024-08-18T21:08:41.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3946055940}) 2024-08-18T21:08:41.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3602607894}) 2024-08-18T21:08:41.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.482+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1970350282}) 2024-08-18T21:08:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.606+0000 7f4bfdfeb640 10 monclient: get_monmap_and_config 2024-08-18T21:08:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.606+0000 7f4bfdfeb640 10 monclient: build_initial_monmap 2024-08-18T21:08:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.606+0000 7f4bfdfeb640 10 monclient: monmap: 2024-08-18T21:08:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:41.611411+0000 2024-08-18T21:08:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:41.611411+0000 2024-08-18T21:08:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:41.612 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bfdfeb640 1 Processor -- start 2024-08-18T21:08:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bfdfeb640 1 -- start start 2024-08-18T21:08:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bfdfeb640 10 monclient: init 2024-08-18T21:08:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bfdfeb640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bfdfeb640 10 monclient: _add_conns ranks=[0,1,3,6,10,4,9,8,5,2,7] 2024-08-18T21:08:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bfdfeb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4bf8134460 addr v1:172.21.15.5:6789/0 2024-08-18T21:08:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bfdfeb640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f4bf8133fa0 addr v1:172.21.15.157:6789/0 2024-08-18T21:08:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bfdfeb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bf813df20 0x7f4bf8140310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bfdfeb640 10 monclient(hunting): picked mon.noname-g con 0x7f4bf813df20 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bfdfeb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bf809e320 con 0x7f4bf8134460 2024-08-18T21:08:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bfdfeb640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bf809e600 con 0x7f4bf8133fa0 2024-08-18T21:08:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bfdfeb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bfdfeb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4bf809e8e0 con 0x7f4bf813df20 2024-08-18T21:08:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bfdfeb640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bfdfeb640 10 monclient(hunting): authenticate will time out at 1288.625245s 2024-08-18T21:08:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4bf8134460 0x7f4bf8134840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47036/0 (socket says 172.21.15.5:47036) 2024-08-18T21:08:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf77fe640 1 -- 172.21.15.5:0/2548538941 learned_addr learned my addr 172.21.15.5:0/2548538941 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:08:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf7fff640 1 --2- 172.21.15.5:0/2548538941 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bf813df20 0x7f4bf8140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf7fff640 10 monclient(hunting): get_auth_request con 0x7f4bf813df20 auth_method 0 2024-08-18T21:08:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf7fff640 10 monclient(hunting): handle_auth_done global_id 84198 payload 274 2024-08-18T21:08:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf7fff640 1 -- 172.21.15.5:0/2548538941 >> v1:172.21.15.157:6789/0 conn(0x7f4bf8133fa0 legacy=0x7f4bf813c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf7fff640 1 -- 172.21.15.5:0/2548538941 >> v1:172.21.15.5:6789/0 conn(0x7f4bf8134460 legacy=0x7f4bf8134840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:08:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf7fff640 1 monclient: found mon.noname-g 2024-08-18T21:08:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf7fff640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:08:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.610+0000 7f4bf7fff640 1 -- 172.21.15.5:0/2548538941 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf809ebc0 con 0x7f4bf813df20 2024-08-18T21:08:41.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bf7fff640 1 -- 172.21.15.5:0/2548538941 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bf813df20 msgr2=0x7f4bf8140310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:41.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bf7fff640 1 --2- 172.21.15.5:0/2548538941 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bf813df20 0x7f4bf8140310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009dc0 tx=0x7f4bf001c850 comp rx=0 tx=0).ready entity=mon.3 client_cookie=c65fc66ada3b3641 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:41.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bf67fc640 1 -- 172.21.15.5:0/2548538941 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4bf00b2070 con 0x7f4bf813df20 2024-08-18T21:08:41.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bf67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:41.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bf67fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:08:41.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bf67fc640 10 monclient: dump: 2024-08-18T21:08:41.620 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:41.620 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:41.620 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:41.620 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:41.620 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:41.620 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:41.621 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bf67fc640 10 monclient: _finish_auth 0 2024-08-18T21:08:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bf67fc640 10 monclient: _check_auth_tickets 2024-08-18T21:08:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bf67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bf67fc640 1 -- 172.21.15.5:0/2548538941 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf00a5a90 con 0x7f4bf813df20 2024-08-18T21:08:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bf67fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bfdfeb640 5 monclient: authenticate success, global_id 84198 2024-08-18T21:08:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bfdfeb640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bfdfeb640 4 set_mon_vals no callback set 2024-08-18T21:08:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bf67fc640 1 -- 172.21.15.5:0/2548538941 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4bf809dd40 con 0x7f4bf813df20 2024-08-18T21:08:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bf67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bf67fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:08:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bf67fc640 10 monclient: dump: 2024-08-18T21:08:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:41.623 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bfdfeb640 10 monclient: shutdown 2024-08-18T21:08:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bfdfeb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bfdfeb640 1 -- 172.21.15.5:0/2548538941 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bf813df20 msgr2=0x7f4bf8140310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bfdfeb640 1 --2- 172.21.15.5:0/2548538941 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bf813df20 0x7f4bf8140310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009dc0 tx=0x7f4bf001c850 comp rx=0 tx=0).stop 2024-08-18T21:08:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bfdfeb640 1 -- 172.21.15.5:0/2548538941 shutdown_connections 2024-08-18T21:08:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bfdfeb640 1 --2- 172.21.15.5:0/2548538941 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bf813df20 0x7f4bf8140310 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.614+0000 7f4bfdfeb640 1 -- 172.21.15.5:0/2548538941 >> 172.21.15.5:0/2548538941 conn(0x7f4bf80a8a90 msgr2=0x7f4bf80a8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 1 -- 172.21.15.5:0/2548538941 shutdown_connections 2024-08-18T21:08:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 1 -- 172.21.15.5:0/2548538941 wait complete. 2024-08-18T21:08:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 10 monclient: build_initial_monmap 2024-08-18T21:08:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 10 monclient: monmap: 2024-08-18T21:08:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:41.625 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 1 Processor -- start 2024-08-18T21:08:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 1 -- start start 2024-08-18T21:08:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 10 monclient: init 2024-08-18T21:08:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 10 monclient: _add_conns ranks=[7,4,6,3,1,8,0,5,2] 2024-08-18T21:08:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4bf8133fa0 0x7f4bf81d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 10 monclient(hunting): picked mon.noname-i con 0x7f4bf8133fa0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4bf8134460 0x7f4bf813c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 10 monclient(hunting): picked mon.noname-c con 0x7f4bf8134460 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4bf813df20 0x7f4bf813c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 10 monclient(hunting): picked mon.noname-d con 0x7f4bf813df20 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f4bf8143810 con 0x7f4bf8134460 2024-08-18T21:08:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f4bf8143690 con 0x7f4bf813df20 2024-08-18T21:08:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f4bf8143990 con 0x7f4bf8133fa0 2024-08-18T21:08:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bfdfeb640 10 monclient(hunting): authenticate will time out at 1288.633773s 2024-08-18T21:08:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf6ffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4bf8134460 0x7f4bf813c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4bf813df20 0x7f4bf813c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf6ffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4bf8134460 0x7f4bf813c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:55030/0 (socket says 172.21.15.5:55030) 2024-08-18T21:08:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf6ffd640 1 -- 172.21.15.5:0/755176633 learned_addr learned my addr 172.21.15.5:0/755176633 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 10 monclient(hunting): get_auth_request con 0x7f4bf813df20 auth_method 0 2024-08-18T21:08:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf6ffd640 10 monclient(hunting): get_auth_request con 0x7f4bf8134460 auth_method 0 2024-08-18T21:08:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf77fe640 1 --2- 172.21.15.5:0/755176633 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4bf8133fa0 0x7f4bf81d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf77fe640 10 monclient(hunting): get_auth_request con 0x7f4bf8133fa0 auth_method 0 2024-08-18T21:08:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 10 monclient(hunting): handle_auth_done global_id 84237 payload 824 2024-08-18T21:08:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 1 -- 172.21.15.5:0/755176633 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4bf8133fa0 msgr2=0x7f4bf81d1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 1 --2- 172.21.15.5:0/755176633 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4bf8133fa0 0x7f4bf81d1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 1 -- 172.21.15.5:0/755176633 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4bf8134460 msgr2=0x7f4bf813c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 1 --2- 172.21.15.5:0/755176633 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4bf8134460 0x7f4bf813c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:08:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 1 monclient: found mon.noname-d 2024-08-18T21:08:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:08:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf7fff640 1 -- 172.21.15.5:0/755176633 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf80a80a0 con 0x7f4bf813df20 2024-08-18T21:08:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.618+0000 7f4bf6ffd640 1 --2- 172.21.15.5:0/755176633 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4bf8134460 0x7f4bf813c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:08:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bf7fff640 1 -- 172.21.15.5:0/755176633 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4bf813df20 msgr2=0x7f4bf813c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bf7fff640 1 --2- 172.21.15.5:0/755176633 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4bf813df20 0x7f4bf813c710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00ac000 tx=0x7f4bf00195f0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bdffff640 1 -- 172.21.15.5:0/755176633 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4bf00b2050 con 0x7f4bf813df20 2024-08-18T21:08:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bdffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bdffff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:08:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bdffff640 10 monclient: dump: 2024-08-18T21:08:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:41.634 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bdffff640 10 monclient: _finish_auth 0 2024-08-18T21:08:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bdffff640 10 monclient: _check_auth_tickets 2024-08-18T21:08:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bdffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bdffff640 1 -- 172.21.15.5:0/755176633 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf00be070 con 0x7f4bf813df20 2024-08-18T21:08:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bdffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bdffff640 1 -- 172.21.15.5:0/755176633 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4bf0003bb0 con 0x7f4bf813df20 2024-08-18T21:08:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bdffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bdffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:08:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bdffff640 10 monclient: dump: 2024-08-18T21:08:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:41.636 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bf5ffb640 4 set_mon_vals no callback set 2024-08-18T21:08:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bfdfeb640 5 monclient: authenticate success, global_id 84237 2024-08-18T21:08:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bfdfeb640 10 monclient: _renew_subs 2024-08-18T21:08:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bfdfeb640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:08:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bfdfeb640 1 -- 172.21.15.5:0/755176633 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf8140390 con 0x7f4bf813df20 2024-08-18T21:08:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bfdfeb640 10 monclient: _renew_subs 2024-08-18T21:08:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bfdfeb640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:08:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bfdfeb640 1 -- 172.21.15.5:0/755176633 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf80724c0 con 0x7f4bf813df20 2024-08-18T21:08:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bdffff640 1 -- 172.21.15.5:0/755176633 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f4bf0004040 con 0x7f4bf813df20 2024-08-18T21:08:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bfdfeb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bfdfeb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bfdfeb640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:08:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bfdfeb640 1 -- 172.21.15.5:0/755176633 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bf8134840 con 0x7f4bf813df20 2024-08-18T21:08:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bdffff640 1 --2- 172.21.15.5:0/755176633 >> v2:172.21.15.157:6812/631023601 conn(0x7f4be403bdf0 0x7f4be403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bdffff640 1 -- 172.21.15.5:0/755176633 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(144..144 src has 22..144) ==== 3898+0+0 (secure 0 0 0) 0x7f4bf00e9630 con 0x7f4bf813df20 2024-08-18T21:08:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bf77fe640 1 --2- 172.21.15.5:0/755176633 >> v2:172.21.15.157:6812/631023601 conn(0x7f4be403bdf0 0x7f4be403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.622+0000 7f4bf77fe640 10 monclient: get_auth_request con 0x7f4be403bdf0 auth_method 0 2024-08-18T21:08:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.626+0000 7f4bf77fe640 1 --2- 172.21.15.5:0/755176633 >> v2:172.21.15.157:6812/631023601 conn(0x7f4be403bdf0 0x7f4be403e2b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4be8007fd0 tx=0x7f4be8009040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.626+0000 7f4bdffff640 1 -- 172.21.15.5:0/755176633 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f4bf0016560 con 0x7f4bf813df20 2024-08-18T21:08:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.626+0000 7f4bdffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.626+0000 7f4bdffff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:41.672 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29789]: starting. 2024-08-18T21:08:41.672 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29789]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29788 2024-08-18T21:08:41.673 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29789]: created object 0... 2024-08-18T21:08:41.673 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29789]: created object 25... 2024-08-18T21:08:41.673 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29789]: created object 49... 2024-08-18T21:08:41.673 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29789]: finishing. 2024-08-18T21:08:41.673 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29789]: shutting down. 2024-08-18T21:08:41.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.866+0000 7f4bfdfeb640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:08:41.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.866+0000 7f4bfdfeb640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:08:41.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.866+0000 7f4bfdfeb640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:08:41.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.866+0000 7f4bfdfeb640 1 -- 172.21.15.5:0/755176633 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4bf81394a0 con 0x7f4bf813df20 2024-08-18T21:08:41.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.866+0000 7f4bdffff640 1 -- 172.21.15.5:0/755176633 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7f4bf00e83a0 con 0x7f4bf813df20 2024-08-18T21:08:41.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.866+0000 7f4bdffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:08:41.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.866+0000 7f4bdffff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:41.871 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":116,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:08:41.872 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.873 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1006909268}) 2024-08-18T21:08:41.873 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2688527786}) 2024-08-18T21:08:41.873 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.873 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1006909268}) 2024-08-18T21:08:41.873 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1738458935}) 2024-08-18T21:08:41.873 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.873 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1006909268}) 2024-08-18T21:08:41.873 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1628966326}) 2024-08-18T21:08:41.873 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.873 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1006909268}) 2024-08-18T21:08:41.873 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4064672644}) 2024-08-18T21:08:41.873 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.873 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1006909268}) 2024-08-18T21:08:41.874 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=707091439}) 2024-08-18T21:08:41.874 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.874 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1006909268}) 2024-08-18T21:08:41.874 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=805031226}) 2024-08-18T21:08:41.874 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.874 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1006909268}) 2024-08-18T21:08:41.874 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=249970091}) 2024-08-18T21:08:41.874 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:41.874 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1006909268}) 2024-08-18T21:08:41.874 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2344893769}) 2024-08-18T21:08:41.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f4bfdfeb640 1 -- 172.21.15.5:0/755176633 >> v2:172.21.15.157:6812/631023601 conn(0x7f4be403bdf0 msgr2=0x7f4be403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:41.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f4bfdfeb640 1 --2- 172.21.15.5:0/755176633 >> v2:172.21.15.157:6812/631023601 conn(0x7f4be403bdf0 0x7f4be403e2b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4be8007fd0 tx=0x7f4be8009040 comp rx=0 tx=0).stop 2024-08-18T21:08:41.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f4bfdfeb640 10 monclient: shutdown 2024-08-18T21:08:41.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f4bfdfeb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:41.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f4bfdfeb640 1 -- 172.21.15.5:0/755176633 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4bf813df20 msgr2=0x7f4bf813c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:41.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f4bfdfeb640 1 --2- 172.21.15.5:0/755176633 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4bf813df20 0x7f4bf813c710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00ac000 tx=0x7f4bf00195f0 comp rx=0 tx=0).stop 2024-08-18T21:08:41.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f4bfdfeb640 1 -- 172.21.15.5:0/755176633 shutdown_connections 2024-08-18T21:08:41.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f4bfdfeb640 1 --2- 172.21.15.5:0/755176633 >> v2:172.21.15.157:6812/631023601 conn(0x7f4be403bdf0 0x7f4be403e2b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:41.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f4bfdfeb640 1 --2- 172.21.15.5:0/755176633 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4bf8134460 0x7f4bf813c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:41.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f4bfdfeb640 1 --2- 172.21.15.5:0/755176633 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4bf813df20 0x7f4bf813c710 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:41.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f4bfdfeb640 1 --2- 172.21.15.5:0/755176633 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4bf8133fa0 0x7f4bf81d1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:41.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f4bfdfeb640 1 -- 172.21.15.5:0/755176633 >> 172.21.15.5:0/755176633 conn(0x7f4bf80a8a90 msgr2=0x7f4bf80a6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:41.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f4bfdfeb640 1 -- 172.21.15.5:0/755176633 shutdown_connections 2024-08-18T21:08:41.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:41.870+0000 7f4bfdfeb640 1 -- 172.21.15.5:0/755176633 wait complete. 2024-08-18T21:08:41.891 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:08:41.892 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-18T21:08:41.892 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:08:41.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:08:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 10 monclient: get_monmap_and_config 2024-08-18T21:08:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 10 monclient: build_initial_monmap 2024-08-18T21:08:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 10 monclient: monmap: 2024-08-18T21:08:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:42.066700+0000 2024-08-18T21:08:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:42.066700+0000 2024-08-18T21:08:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:42.067 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.067 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:42.067 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:42.067 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:42.067 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:42.067 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:42.067 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:42.067 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:42.067 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:42.067 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:42.067 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:42.067 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:42.067 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 1 Processor -- start 2024-08-18T21:08:42.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 1 -- start start 2024-08-18T21:08:42.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 10 monclient: init 2024-08-18T21:08:42.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 10 monclient: _add_conns ranks=[6,5,3,2,4,8,1,0,7,10,9] 2024-08-18T21:08:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98300a6ce0 0x7f98300a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 10 monclient(hunting): picked mon.noname-d con 0x7f98300a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f98300a7600 0x7f9830139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 10 monclient(hunting): picked mon.noname-h con 0x7f98300a7600 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9830139fe0 0x7f983013a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 10 monclient(hunting): picked mon.noname-g con 0x7f9830139fe0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f98300a5000 con 0x7f9830139fe0 2024-08-18T21:08:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f98300a4360 con 0x7f98300a7600 2024-08-18T21:08:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f98300a45d0 con 0x7f98300a6ce0 2024-08-18T21:08:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.062+0000 7f98361cf640 10 monclient(hunting): authenticate will time out at 1289.079903s 2024-08-18T21:08:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98300a6ce0 0x7f98300a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98300a6ce0 0x7f98300a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:40330/0 (socket says 172.21.15.5:40330) 2024-08-18T21:08:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 1 -- 172.21.15.5:0/1496779576 learned_addr learned my addr 172.21.15.5:0/1496779576 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 10 monclient(hunting): get_auth_request con 0x7f98300a6ce0 auth_method 0 2024-08-18T21:08:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982ffff640 1 --2- 172.21.15.5:0/1496779576 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9830139fe0 0x7f983013a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982effd640 1 --2- 172.21.15.5:0/1496779576 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f98300a7600 0x7f9830139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982ffff640 10 monclient(hunting): get_auth_request con 0x7f9830139fe0 auth_method 0 2024-08-18T21:08:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982effd640 10 monclient(hunting): get_auth_request con 0x7f98300a7600 auth_method 0 2024-08-18T21:08:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 10 monclient(hunting): handle_auth_done global_id 84246 payload 274 2024-08-18T21:08:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 1 -- 172.21.15.5:0/1496779576 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f98300a7600 msgr2=0x7f9830139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 1 --2- 172.21.15.5:0/1496779576 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f98300a7600 0x7f9830139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 1 -- 172.21.15.5:0/1496779576 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9830139fe0 msgr2=0x7f983013a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 1 --2- 172.21.15.5:0/1496779576 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9830139fe0 0x7f983013a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:08:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 1 monclient: found mon.noname-d 2024-08-18T21:08:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:08:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.066+0000 7f982f7fe640 1 -- 172.21.15.5:0/1496779576 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98300a32d0 con 0x7f98300a6ce0 2024-08-18T21:08:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f982f7fe640 1 -- 172.21.15.5:0/1496779576 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98300a6ce0 msgr2=0x7f98300a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f982f7fe640 1 --2- 172.21.15.5:0/1496779576 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98300a6ce0 0x7f98300a70c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f98180098d0 tx=0x7f981801c440 comp rx=0 tx=0).ready entity=mon.6 client_cookie=7038a10eeacaf6b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f982e7fc640 1 -- 172.21.15.5:0/1496779576 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f98180b0070 con 0x7f98300a6ce0 2024-08-18T21:08:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f982e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f982e7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:08:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f982e7fc640 10 monclient: dump: 2024-08-18T21:08:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.077 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.078 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.078 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f982e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:08:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f982e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:08:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f982e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f982e7fc640 1 -- 172.21.15.5:0/1496779576 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98180aa810 con 0x7f98300a6ce0 2024-08-18T21:08:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 5 monclient: authenticate success, global_id 84246 2024-08-18T21:08:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:08:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f982e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f982e7fc640 1 -- 172.21.15.5:0/1496779576 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f98180a9300 con 0x7f98300a6ce0 2024-08-18T21:08:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f982e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f982e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:08:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f982e7fc640 10 monclient: dump: 2024-08-18T21:08:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.080 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.081 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 4 set_mon_vals no callback set 2024-08-18T21:08:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 10 monclient: shutdown 2024-08-18T21:08:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 -- 172.21.15.5:0/1496779576 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98300a6ce0 msgr2=0x7f98300a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 --2- 172.21.15.5:0/1496779576 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98300a6ce0 0x7f98300a70c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f98180098d0 tx=0x7f981801c440 comp rx=0 tx=0).stop 2024-08-18T21:08:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 -- 172.21.15.5:0/1496779576 shutdown_connections 2024-08-18T21:08:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 --2- 172.21.15.5:0/1496779576 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9830139fe0 0x7f983013a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 --2- 172.21.15.5:0/1496779576 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f98300a7600 0x7f9830139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 --2- 172.21.15.5:0/1496779576 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98300a6ce0 0x7f98300a70c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 -- 172.21.15.5:0/1496779576 >> 172.21.15.5:0/1496779576 conn(0x7f98300acbc0 msgr2=0x7f98300a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 -- 172.21.15.5:0/1496779576 shutdown_connections 2024-08-18T21:08:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 -- 172.21.15.5:0/1496779576 wait complete. 2024-08-18T21:08:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 10 monclient: build_initial_monmap 2024-08-18T21:08:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 10 monclient: monmap: 2024-08-18T21:08:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:42.083 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 Processor -- start 2024-08-18T21:08:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 -- start start 2024-08-18T21:08:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 10 monclient: init 2024-08-18T21:08:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 10 monclient: _add_conns ranks=[7,6,1,5,8,0,4,2,3] 2024-08-18T21:08:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f98300a6ce0 0x7f9830134e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 10 monclient(hunting): picked mon.noname-i con 0x7f98300a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98300a7600 0x7f98301353b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 10 monclient(hunting): picked mon.noname-d con 0x7f98300a7600 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9830139fe0 0x7f983013aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 10 monclient(hunting): picked mon.noname-f con 0x7f9830139fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:08:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f98300a79e0 con 0x7f9830139fe0 2024-08-18T21:08:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f98300a8220 con 0x7f98300a7600 2024-08-18T21:08:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f983013dbb0 con 0x7f98300a6ce0 2024-08-18T21:08:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.070+0000 7f98361cf640 10 monclient(hunting): authenticate will time out at 1289.087923s 2024-08-18T21:08:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98300a7600 0x7f98301353b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98300a7600 0x7f98301353b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:40340/0 (socket says 172.21.15.5:40340) 2024-08-18T21:08:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 1 -- 172.21.15.5:0/429390896 learned_addr learned my addr 172.21.15.5:0/429390896 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 10 monclient(hunting): get_auth_request con 0x7f98300a7600 auth_method 0 2024-08-18T21:08:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982f7fe640 1 --2- 172.21.15.5:0/429390896 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f98300a6ce0 0x7f9830134e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982f7fe640 10 monclient(hunting): get_auth_request con 0x7f98300a6ce0 auth_method 0 2024-08-18T21:08:42.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982ffff640 1 --2- 172.21.15.5:0/429390896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9830139fe0 0x7f983013aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982ffff640 10 monclient(hunting): get_auth_request con 0x7f9830139fe0 auth_method 0 2024-08-18T21:08:42.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 10 monclient(hunting): handle_auth_done global_id 84255 payload 824 2024-08-18T21:08:42.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 1 -- 172.21.15.5:0/429390896 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f98300a6ce0 msgr2=0x7f9830134e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 1 --2- 172.21.15.5:0/429390896 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f98300a6ce0 0x7f9830134e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 1 -- 172.21.15.5:0/429390896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9830139fe0 msgr2=0x7f983013aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 1 --2- 172.21.15.5:0/429390896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9830139fe0 0x7f983013aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 10 monclient: _finish_hunting 0 2024-08-18T21:08:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 1 monclient: found mon.noname-d 2024-08-18T21:08:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:08:42.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 1 -- 172.21.15.5:0/429390896 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98300a7280 con 0x7f98300a7600 2024-08-18T21:08:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 1 -- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98300a7600 msgr2=0x7f98301353b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982effd640 1 --2- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98300a7600 0x7f98301353b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9820007f20 tx=0x7f982000e570 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f9827fff640 1 -- 172.21.15.5:0/429390896 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9820013a00 con 0x7f98300a7600 2024-08-18T21:08:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f9827fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f9827fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:08:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f9827fff640 10 monclient: dump: 2024-08-18T21:08:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.092 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.092 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.092 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.092 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.092 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.092 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.092 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.092 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.092 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.092 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.092 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.092 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.093 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f9827fff640 10 monclient: _finish_auth 0 2024-08-18T21:08:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f9827fff640 10 monclient: _check_auth_tickets 2024-08-18T21:08:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f9827fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f9827fff640 1 -- 172.21.15.5:0/429390896 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9820019070 con 0x7f98300a7600 2024-08-18T21:08:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f98361cf640 5 monclient: authenticate success, global_id 84255 2024-08-18T21:08:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f98361cf640 10 monclient: _renew_subs 2024-08-18T21:08:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f98361cf640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:08:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f98361cf640 1 -- 172.21.15.5:0/429390896 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98300aa3e0 con 0x7f98300a7600 2024-08-18T21:08:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f9827fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f9827fff640 1 -- 172.21.15.5:0/429390896 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9820013c00 con 0x7f98300a7600 2024-08-18T21:08:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f9827fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f9827fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:08:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f982dffb640 4 set_mon_vals no callback set 2024-08-18T21:08:42.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f9827fff640 10 monclient: dump: 2024-08-18T21:08:42.094 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.094 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.094 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.094 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.094 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.094 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.094 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.094 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.094 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.094 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.094 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.094 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.095 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.095 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.095 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.095 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f98361cf640 10 monclient: _renew_subs 2024-08-18T21:08:42.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f98361cf640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:08:42.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f98361cf640 1 -- 172.21.15.5:0/429390896 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f983013ce80 con 0x7f98300a7600 2024-08-18T21:08:42.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f98361cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:42.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f98361cf640 1 --2- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f983013aff0 0x7f983013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f98361cf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f98361cf640 1 -- 172.21.15.5:0/429390896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f98300a7b60 con 0x7f983013aff0 2024-08-18T21:08:42.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.074+0000 7f9827fff640 1 -- 172.21.15.5:0/429390896 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f9820013590 con 0x7f98300a7600 2024-08-18T21:08:42.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f982f7fe640 1 --2- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f983013aff0 0x7f983013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f982f7fe640 10 monclient: get_auth_request con 0x7f983013aff0 auth_method 0 2024-08-18T21:08:42.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f982f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f982f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f982f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f982f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f982f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f982f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f9827fff640 1 --2- 172.21.15.5:0/429390896 >> v2:172.21.15.157:6812/631023601 conn(0x7f981003bdf0 0x7f981003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f982f7fe640 10 monclient(hunting): handle_auth_done global_id 84204 payload 824 2024-08-18T21:08:42.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f982f7fe640 1 -- 172.21.15.5:0/429390896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98300008e0 con 0x7f983013aff0 2024-08-18T21:08:42.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f9827fff640 1 -- 172.21.15.5:0/429390896 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(144..144 src has 22..144) ==== 3898+0+0 (secure 0 0 0) 0x7f982004edf0 con 0x7f98300a7600 2024-08-18T21:08:42.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f982ffff640 1 --2- 172.21.15.5:0/429390896 >> v2:172.21.15.157:6812/631023601 conn(0x7f981003bdf0 0x7f981003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f982ffff640 10 monclient: get_auth_request con 0x7f981003bdf0 auth_method 0 2024-08-18T21:08:42.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f982f7fe640 1 -- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f983013aff0 msgr2=0x7f983013b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f982f7fe640 1 --2- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f983013aff0 0x7f983013b3d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f98180ad000 tx=0x7f98180191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f9827fff640 1 -- 172.21.15.5:0/429390896 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f98180b9020 con 0x7f983013aff0 2024-08-18T21:08:42.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f9827fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f9827fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:08:42.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f9827fff640 10 monclient: dump: 2024-08-18T21:08:42.097 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.097 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.097 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.097 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.097 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.097 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.097 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.098 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.098 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.098 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.098 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.098 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.098 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.098 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.098 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.098 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f9827fff640 1 -- 172.21.15.5:0/429390896 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f98180b1040 con 0x7f983013aff0 2024-08-18T21:08:42.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f9827fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:42.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f9827fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:42.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f9827fff640 1 -- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f983013aff0 msgr2=0x7f983013b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f9827fff640 1 --2- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f983013aff0 0x7f983013b3d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f98180ad000 tx=0x7f98180191e0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f9827fff640 1 -- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f983013aff0 msgr2=0x7f983013b3d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:42.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f9827fff640 1 --2- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f983013aff0 0x7f983013b3d0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f98180ad000 tx=0x7f98180191e0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.078+0000 7f982ffff640 1 --2- 172.21.15.5:0/429390896 >> v2:172.21.15.157:6812/631023601 conn(0x7f981003bdf0 0x7f981003e2b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f983013ce10 tx=0x7f9828008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.086+0000 7f98361cf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:42.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.086+0000 7f98361cf640 1 --2- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f983013b910 0x7f983009da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.086+0000 7f98361cf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.086+0000 7f98361cf640 1 -- 172.21.15.5:0/429390896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9830051140 con 0x7f983013b910 2024-08-18T21:08:42.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.086+0000 7f982f7fe640 1 --2- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f983013b910 0x7f983009da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.086+0000 7f982f7fe640 10 monclient: get_auth_request con 0x7f983013b910 auth_method 0 2024-08-18T21:08:42.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.086+0000 7f982f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.086+0000 7f982f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.086+0000 7f982f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.086+0000 7f982f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.086+0000 7f982f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.086+0000 7f982f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.086+0000 7f982f7fe640 10 monclient(hunting): handle_auth_done global_id 84213 payload 824 2024-08-18T21:08:42.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.086+0000 7f982f7fe640 1 -- 172.21.15.5:0/429390896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9830139a60 con 0x7f983013b910 2024-08-18T21:08:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f982f7fe640 1 -- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f983013b910 msgr2=0x7f983009da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f982f7fe640 1 --2- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f983013b910 0x7f983009da30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f981801c480 tx=0x7f98180a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f9827fff640 1 -- 172.21.15.5:0/429390896 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f98180b9040 con 0x7f983013b910 2024-08-18T21:08:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f9827fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f9827fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:08:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f9827fff640 10 monclient: dump: 2024-08-18T21:08:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.102 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.102 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.102 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.102 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.102 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.102 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.102 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.102 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.102 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.103 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.103 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.103 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.103 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.103 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f9827fff640 1 -- 172.21.15.5:0/429390896 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9249 (secure 0 0 0) 0x7f98180c0280 con 0x7f983013b910 2024-08-18T21:08:42.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f9827fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:42.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f9827fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:42.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f9827fff640 1 -- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f983013b910 msgr2=0x7f983009da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f9827fff640 1 --2- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f983013b910 0x7f983009da30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f981801c480 tx=0x7f98180a8000 comp rx=0 tx=0).stop 2024-08-18T21:08:42.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f9827fff640 1 -- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f983013b910 msgr2=0x7f983009da30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:42.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f9827fff640 1 --2- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f983013b910 0x7f983009da30 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f981801c480 tx=0x7f98180a8000 comp rx=0 tx=0).stop 2024-08-18T21:08:42.104 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:08:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 18923, 2024-08-18T21:08:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:08:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:42.106 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:42.108 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:42.109 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:42.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.113 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.114 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:42.115 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:42.115 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.115 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.115 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.115 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:42.115 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.115 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.115 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:42.115 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.115 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.115 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.116 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:42.116 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:42.116 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.116 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.116 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.116 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:42.116 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:42.116 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.116 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.117 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:42.117 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.117 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:42.117 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.117 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.117 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.117 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:42.117 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:42.117 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.118 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.118 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.118 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:42.118 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:42.118 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.118 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.118 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.118 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:42.118 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.119 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.119 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:42.119 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.119 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.119 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.119 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:42.119 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:42.119 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.119 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.119 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.120 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:42.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:42.120 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.120 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.120 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.120 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:42.120 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.120 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.120 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:42.120 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.121 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.121 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.121 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:42.121 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:42.121 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.121 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.121 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.121 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:42.121 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:42.121 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.122 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.122 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:42.122 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.122 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:42.122 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.122 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.122 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.123 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:42.123 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:42.123 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.123 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.123 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.123 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:42.123 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:42.123 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.123 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.123 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.124 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:42.124 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.124 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.124 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:42.124 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.124 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.124 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.124 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:42.124 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:42.124 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.124 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.125 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.125 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:42.125 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:42.125 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.125 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.125 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:42.125 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.126 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.126 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:42.126 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.126 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.126 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.126 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:42.126 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:42.126 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.126 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.126 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.126 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.126 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.127 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:42.127 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:42.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.127 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:42.127 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:42.127 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:42.127 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.127 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.127 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:42.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.127 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:42.127 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:42.127 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:42.127 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.128 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.128 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:42.128 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f98361cf640 1 -- 172.21.15.5:0/429390896 >> v2:172.21.15.157:6812/631023601 conn(0x7f981003bdf0 msgr2=0x7f981003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f98361cf640 1 --2- 172.21.15.5:0/429390896 >> v2:172.21.15.157:6812/631023601 conn(0x7f981003bdf0 0x7f981003e2b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f983013ce10 tx=0x7f9828008040 comp rx=0 tx=0).stop 2024-08-18T21:08:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f98361cf640 10 monclient: shutdown 2024-08-18T21:08:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f98361cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f98361cf640 1 -- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98300a7600 msgr2=0x7f98301353b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f98361cf640 1 --2- 172.21.15.5:0/429390896 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f98300a7600 0x7f98301353b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9820007f20 tx=0x7f982000e570 comp rx=0 tx=0).stop 2024-08-18T21:08:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f982ffff640 1 -- 172.21.15.5:0/429390896 reap_dead start 2024-08-18T21:08:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f982ffff640 1 -- 172.21.15.5:0/429390896 reap_dead start 2024-08-18T21:08:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f98361cf640 1 -- 172.21.15.5:0/429390896 shutdown_connections 2024-08-18T21:08:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f98361cf640 1 -- 172.21.15.5:0/429390896 >> 172.21.15.5:0/429390896 conn(0x7f98300acbc0 msgr2=0x7f9830138810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f98361cf640 1 -- 172.21.15.5:0/429390896 shutdown_connections 2024-08-18T21:08:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.090+0000 7f98361cf640 1 -- 172.21.15.5:0/429390896 wait complete. 2024-08-18T21:08:42.130 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:42.130 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:08:42.131 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:08:42.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.218+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.218+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=209755775}) 2024-08-18T21:08:42.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.218+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4287446900}) 2024-08-18T21:08:42.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.218+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.218+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=209755775}) 2024-08-18T21:08:42.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.218+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3682672326}) 2024-08-18T21:08:42.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.218+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=209755775}) 2024-08-18T21:08:42.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1231035758}) 2024-08-18T21:08:42.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=209755775}) 2024-08-18T21:08:42.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2534577385}) 2024-08-18T21:08:42.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=209755775}) 2024-08-18T21:08:42.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2645201100}) 2024-08-18T21:08:42.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=209755775}) 2024-08-18T21:08:42.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3501359219}) 2024-08-18T21:08:42.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=209755775}) 2024-08-18T21:08:42.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2364738971}) 2024-08-18T21:08:42.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=209755775}) 2024-08-18T21:08:42.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.222+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1140416622}) 2024-08-18T21:08:42.230 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.230 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3429190814}) 2024-08-18T21:08:42.230 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=758306584}) 2024-08-18T21:08:42.230 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.230 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3429190814}) 2024-08-18T21:08:42.230 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4036969650}) 2024-08-18T21:08:42.230 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.230 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3429190814}) 2024-08-18T21:08:42.231 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3678036234}) 2024-08-18T21:08:42.231 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.231 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3429190814}) 2024-08-18T21:08:42.231 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1453687446}) 2024-08-18T21:08:42.231 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.231 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3429190814}) 2024-08-18T21:08:42.231 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=250279815}) 2024-08-18T21:08:42.231 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.231 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3429190814}) 2024-08-18T21:08:42.231 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2090170073}) 2024-08-18T21:08:42.231 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.231 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3429190814}) 2024-08-18T21:08:42.231 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2152198823}) 2024-08-18T21:08:42.232 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.232 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3429190814}) 2024-08-18T21:08:42.232 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.226+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1486345087}) 2024-08-18T21:08:42.235 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.235 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2565668629}) 2024-08-18T21:08:42.235 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1505976872}) 2024-08-18T21:08:42.235 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.235 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2565668629}) 2024-08-18T21:08:42.235 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3670518774}) 2024-08-18T21:08:42.235 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.235 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2565668629}) 2024-08-18T21:08:42.235 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1742632231}) 2024-08-18T21:08:42.236 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.236 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2565668629}) 2024-08-18T21:08:42.236 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2688206874}) 2024-08-18T21:08:42.236 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.236 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2565668629}) 2024-08-18T21:08:42.236 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=368669614}) 2024-08-18T21:08:42.236 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.236 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2565668629}) 2024-08-18T21:08:42.236 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2378811993}) 2024-08-18T21:08:42.236 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.236 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2565668629}) 2024-08-18T21:08:42.236 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2043424399}) 2024-08-18T21:08:42.236 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.237 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2565668629}) 2024-08-18T21:08:42.237 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.230+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3126132285}) 2024-08-18T21:08:42.239 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.239 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2560587789}) 2024-08-18T21:08:42.239 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=922395150}) 2024-08-18T21:08:42.240 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.240 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2560587789}) 2024-08-18T21:08:42.240 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3365400372}) 2024-08-18T21:08:42.240 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.240 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2560587789}) 2024-08-18T21:08:42.240 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3929805149}) 2024-08-18T21:08:42.240 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.240 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2560587789}) 2024-08-18T21:08:42.240 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2320151171}) 2024-08-18T21:08:42.240 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.240 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2560587789}) 2024-08-18T21:08:42.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3061073896}) 2024-08-18T21:08:42.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2560587789}) 2024-08-18T21:08:42.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=975813633}) 2024-08-18T21:08:42.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2560587789}) 2024-08-18T21:08:42.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1466527245}) 2024-08-18T21:08:42.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2560587789}) 2024-08-18T21:08:42.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.234+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1388317838}) 2024-08-18T21:08:42.244 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.244 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1917171017}) 2024-08-18T21:08:42.244 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1294593579}) 2024-08-18T21:08:42.244 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.244 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1917171017}) 2024-08-18T21:08:42.244 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2372880592}) 2024-08-18T21:08:42.244 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.244 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1917171017}) 2024-08-18T21:08:42.244 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=711903925}) 2024-08-18T21:08:42.244 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1917171017}) 2024-08-18T21:08:42.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3426836298}) 2024-08-18T21:08:42.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1917171017}) 2024-08-18T21:08:42.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3284592784}) 2024-08-18T21:08:42.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1917171017}) 2024-08-18T21:08:42.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3563128208}) 2024-08-18T21:08:42.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1917171017}) 2024-08-18T21:08:42.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3303568957}) 2024-08-18T21:08:42.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1917171017}) 2024-08-18T21:08:42.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.238+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3600274598}) 2024-08-18T21:08:42.248 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.248 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1179909768}) 2024-08-18T21:08:42.248 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=102954155}) 2024-08-18T21:08:42.248 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.248 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1179909768}) 2024-08-18T21:08:42.248 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3458370109}) 2024-08-18T21:08:42.248 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1179909768}) 2024-08-18T21:08:42.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=961296584}) 2024-08-18T21:08:42.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1179909768}) 2024-08-18T21:08:42.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=655997806}) 2024-08-18T21:08:42.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1179909768}) 2024-08-18T21:08:42.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=942324915}) 2024-08-18T21:08:42.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1179909768}) 2024-08-18T21:08:42.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1609138890}) 2024-08-18T21:08:42.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1179909768}) 2024-08-18T21:08:42.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1731409005}) 2024-08-18T21:08:42.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1179909768}) 2024-08-18T21:08:42.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.242+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4099691374}) 2024-08-18T21:08:42.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=671431643}) 2024-08-18T21:08:42.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2760303355}) 2024-08-18T21:08:42.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=671431643}) 2024-08-18T21:08:42.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=304791671}) 2024-08-18T21:08:42.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=671431643}) 2024-08-18T21:08:42.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3260334959}) 2024-08-18T21:08:42.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=671431643}) 2024-08-18T21:08:42.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1004771121}) 2024-08-18T21:08:42.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=671431643}) 2024-08-18T21:08:42.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1241647339}) 2024-08-18T21:08:42.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=671431643}) 2024-08-18T21:08:42.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1580897256}) 2024-08-18T21:08:42.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=671431643}) 2024-08-18T21:08:42.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.246+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=516485084}) 2024-08-18T21:08:42.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.250+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.250+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=671431643}) 2024-08-18T21:08:42.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.250+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2818573008}) 2024-08-18T21:08:42.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.250+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.250+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2943031153}) 2024-08-18T21:08:42.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.250+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1696548477}) 2024-08-18T21:08:42.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.250+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.250+0000 7f99bdf17640 10 monclient: get_monmap_and_config 2024-08-18T21:08:42.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.250+0000 7f99bdf17640 10 monclient: build_initial_monmap 2024-08-18T21:08:42.256 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.250+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2943031153}) 2024-08-18T21:08:42.256 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.250+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2829328057}) 2024-08-18T21:08:42.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.250+0000 7f99bdf17640 10 monclient: monmap: 2024-08-18T21:08:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:42.256308+0000 2024-08-18T21:08:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:42.256308+0000 2024-08-18T21:08:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:42.258 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:42.258 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:42.258 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:42.258 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:42.258 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.250+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2943031153}) 2024-08-18T21:08:42.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3443478202}) 2024-08-18T21:08:42.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2943031153}) 2024-08-18T21:08:42.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1546830840}) 2024-08-18T21:08:42.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2943031153}) 2024-08-18T21:08:42.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2092213992}) 2024-08-18T21:08:42.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2943031153}) 2024-08-18T21:08:42.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4134697714}) 2024-08-18T21:08:42.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2943031153}) 2024-08-18T21:08:42.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2169526173}) 2024-08-18T21:08:42.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2943031153}) 2024-08-18T21:08:42.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2173674895}) 2024-08-18T21:08:42.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 1 Processor -- start 2024-08-18T21:08:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 1 -- start start 2024-08-18T21:08:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 10 monclient: init 2024-08-18T21:08:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 10 monclient: _add_conns ranks=[4,8,5,1,0,2,7,10,6,9,3] 2024-08-18T21:08:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f99b80a4000 0x7f99b80a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 10 monclient(hunting): picked mon.noname-c con 0x7f99b80a4000 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f99b80a2800 0x7f99b80a4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 10 monclient(hunting): picked mon.noname-e con 0x7f99b80a2800 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:08:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f99b809b080 0x7f99b809b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 10 monclient(hunting): picked mon.noname-h con 0x7f99b809b080 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f99b80689b0 con 0x7f99b80a4000 2024-08-18T21:08:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f99b80a4e60 con 0x7f99b809b080 2024-08-18T21:08:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f99b80a2450 con 0x7f99b80a2800 2024-08-18T21:08:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99bdf17640 10 monclient(hunting): authenticate will time out at 1289.270321s 2024-08-18T21:08:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f99b80a4000 0x7f99b80a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f99b80a4000 0x7f99b80a43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:55038/0 (socket says 172.21.15.5:55038) 2024-08-18T21:08:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 1 -- 172.21.15.5:0/505390746 learned_addr learned my addr 172.21.15.5:0/505390746 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 10 monclient(hunting): get_auth_request con 0x7f99b80a4000 auth_method 0 2024-08-18T21:08:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b6ffd640 1 --2- 172.21.15.5:0/505390746 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f99b80a2800 0x7f99b80a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b6ffd640 10 monclient(hunting): get_auth_request con 0x7f99b80a2800 auth_method 0 2024-08-18T21:08:42.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b7fff640 1 --2- 172.21.15.5:0/505390746 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f99b809b080 0x7f99b809b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 10 monclient(hunting): handle_auth_done global_id 5791 payload 274 2024-08-18T21:08:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 1 -- 172.21.15.5:0/505390746 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f99b80a2800 msgr2=0x7f99b80a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 1 --2- 172.21.15.5:0/505390746 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f99b80a2800 0x7f99b80a4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 1 -- 172.21.15.5:0/505390746 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f99b809b080 msgr2=0x7f99b809b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 1 --2- 172.21.15.5:0/505390746 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f99b809b080 0x7f99b809b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 10 monclient: _finish_hunting 0 2024-08-18T21:08:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 1 monclient: found mon.noname-c 2024-08-18T21:08:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:08:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b77fe640 1 -- 172.21.15.5:0/505390746 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b80a5f90 con 0x7f99b80a4000 2024-08-18T21:08:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b7fff640 10 monclient: get_auth_request con 0x7f99b809b080 auth_method 0 2024-08-18T21:08:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.254+0000 7f99b7fff640 1 --2- 172.21.15.5:0/505390746 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f99b809b080 0x7f99b809b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:08:42.270 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.270 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4294912377}) 2024-08-18T21:08:42.271 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3676958760}) 2024-08-18T21:08:42.271 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.271 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4294912377}) 2024-08-18T21:08:42.271 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1054523849}) 2024-08-18T21:08:42.271 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.271 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4294912377}) 2024-08-18T21:08:42.271 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2337565752}) 2024-08-18T21:08:42.271 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.271 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4294912377}) 2024-08-18T21:08:42.271 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3478285689}) 2024-08-18T21:08:42.271 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.271 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4294912377}) 2024-08-18T21:08:42.271 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=638969973}) 2024-08-18T21:08:42.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4294912377}) 2024-08-18T21:08:42.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4018567849}) 2024-08-18T21:08:42.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4294912377}) 2024-08-18T21:08:42.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3783423107}) 2024-08-18T21:08:42.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4294912377}) 2024-08-18T21:08:42.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1097793830}) 2024-08-18T21:08:42.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2518863742}) 2024-08-18T21:08:42.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3359522585}) 2024-08-18T21:08:42.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2518863742}) 2024-08-18T21:08:42.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=995357742}) 2024-08-18T21:08:42.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2518863742}) 2024-08-18T21:08:42.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4277955630}) 2024-08-18T21:08:42.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2518863742}) 2024-08-18T21:08:42.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3385439341}) 2024-08-18T21:08:42.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2518863742}) 2024-08-18T21:08:42.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2954908840}) 2024-08-18T21:08:42.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2518863742}) 2024-08-18T21:08:42.274 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3126880928}) 2024-08-18T21:08:42.274 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.274 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2518863742}) 2024-08-18T21:08:42.274 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2219949007}) 2024-08-18T21:08:42.274 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.274 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2518863742}) 2024-08-18T21:08:42.274 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.258+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3308004396}) 2024-08-18T21:08:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99b77fe640 1 -- 172.21.15.5:0/505390746 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f99b80a4000 msgr2=0x7f99b80a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99b77fe640 1 --2- 172.21.15.5:0/505390746 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f99b80a4000 0x7f99b80a43e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f99a80098d0 tx=0x7f99a801c430 comp rx=0 tx=0).ready entity=mon.4 client_cookie=ecfb7bcab10e2d41 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99b67fc640 1 -- 172.21.15.5:0/505390746 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f99a80b0070 con 0x7f99b80a4000 2024-08-18T21:08:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99b67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99b67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:08:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99b67fc640 10 monclient: dump: 2024-08-18T21:08:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.277 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99b67fc640 10 monclient: _finish_auth 0 2024-08-18T21:08:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99b67fc640 10 monclient: _check_auth_tickets 2024-08-18T21:08:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99b67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99b67fc640 1 -- 172.21.15.5:0/505390746 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a80aa810 con 0x7f99b80a4000 2024-08-18T21:08:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 5 monclient: authenticate success, global_id 5791 2024-08-18T21:08:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99b67fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 4 set_mon_vals no callback set 2024-08-18T21:08:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99b67fc640 1 -- 172.21.15.5:0/505390746 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f99a80a9300 con 0x7f99b80a4000 2024-08-18T21:08:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99b67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99b67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:08:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99b67fc640 10 monclient: dump: 2024-08-18T21:08:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.280 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 10 monclient: shutdown 2024-08-18T21:08:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 1 -- 172.21.15.5:0/505390746 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f99b80a4000 msgr2=0x7f99b80a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 1 --2- 172.21.15.5:0/505390746 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f99b80a4000 0x7f99b80a43e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f99a80098d0 tx=0x7f99a801c430 comp rx=0 tx=0).stop 2024-08-18T21:08:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 1 -- 172.21.15.5:0/505390746 shutdown_connections 2024-08-18T21:08:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 1 --2- 172.21.15.5:0/505390746 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f99b80a2800 0x7f99b80a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 1 --2- 172.21.15.5:0/505390746 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f99b809b080 0x7f99b809b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 1 --2- 172.21.15.5:0/505390746 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f99b80a4000 0x7f99b80a43e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 1 -- 172.21.15.5:0/505390746 >> 172.21.15.5:0/505390746 conn(0x7f99b80a50f0 msgr2=0x7f99b80a54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 1 -- 172.21.15.5:0/505390746 shutdown_connections 2024-08-18T21:08:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 1 -- 172.21.15.5:0/505390746 wait complete. 2024-08-18T21:08:42.281 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.281 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3881925381}) 2024-08-18T21:08:42.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3431726118}) 2024-08-18T21:08:42.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3881925381}) 2024-08-18T21:08:42.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4054169802}) 2024-08-18T21:08:42.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3881925381}) 2024-08-18T21:08:42.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4060571448}) 2024-08-18T21:08:42.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3881925381}) 2024-08-18T21:08:42.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2442039502}) 2024-08-18T21:08:42.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3881925381}) 2024-08-18T21:08:42.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3614703344}) 2024-08-18T21:08:42.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3881925381}) 2024-08-18T21:08:42.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3095194655}) 2024-08-18T21:08:42.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3881925381}) 2024-08-18T21:08:42.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=719582934}) 2024-08-18T21:08:42.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3881925381}) 2024-08-18T21:08:42.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=67581302}) 2024-08-18T21:08:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 10 monclient: build_initial_monmap 2024-08-18T21:08:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 10 monclient: monmap: 2024-08-18T21:08:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:42.285 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 1 Processor -- start 2024-08-18T21:08:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 1 -- start start 2024-08-18T21:08:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f99bdf17640 10 monclient: init 2024-08-18T21:08:42.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.262+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059975551}) 2024-08-18T21:08:42.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4006155554}) 2024-08-18T21:08:42.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99bdf17640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:42.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059975551}) 2024-08-18T21:08:42.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1237843638}) 2024-08-18T21:08:42.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99bdf17640 10 monclient: _add_conns ranks=[6,5,0,1,2,7,3,4,8] 2024-08-18T21:08:42.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99bdf17640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f99b809b080 0x7f99b81cf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99bdf17640 10 monclient(hunting): picked mon.noname-d con 0x7f99b809b080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:42.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.288 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059975551}) 2024-08-18T21:08:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99bdf17640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f99b80a2800 0x7f99b8136bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99bdf17640 10 monclient(hunting): picked mon.noname-h con 0x7f99b80a2800 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99bdf17640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b80a4000 0x7f99b8137110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99bdf17640 10 monclient(hunting): picked mon.noname-a con 0x7f99b80a4000 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:08:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99bdf17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99bdf17640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f99b809fe80 con 0x7f99b80a4000 2024-08-18T21:08:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99bdf17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99bdf17640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f99b809fd00 con 0x7f99b80a2800 2024-08-18T21:08:42.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99bdf17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99bdf17640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f99b80a0000 con 0x7f99b809b080 2024-08-18T21:08:42.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99bdf17640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:42.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99bdf17640 10 monclient(hunting): authenticate will time out at 1289.280145s 2024-08-18T21:08:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4009105960}) 2024-08-18T21:08:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059975551}) 2024-08-18T21:08:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=732965309}) 2024-08-18T21:08:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059975551}) 2024-08-18T21:08:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3232464340}) 2024-08-18T21:08:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.291 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059975551}) 2024-08-18T21:08:42.291 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3631677481}) 2024-08-18T21:08:42.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b80a4000 0x7f99b8137110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b77fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f99b809b080 0x7f99b81cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b77fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f99b809b080 0x7f99b81cf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:40346/0 (socket says 172.21.15.5:40346) 2024-08-18T21:08:42.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b77fe640 1 -- 172.21.15.5:0/1924701816 learned_addr learned my addr 172.21.15.5:0/1924701816 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:42.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b80a4000 0x7f99b8137110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51826/0 (socket says 172.21.15.5:51826) 2024-08-18T21:08:42.292 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.292 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059975551}) 2024-08-18T21:08:42.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b77fe640 10 monclient(hunting): get_auth_request con 0x7f99b809b080 auth_method 0 2024-08-18T21:08:42.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 10 monclient(hunting): get_auth_request con 0x7f99b80a4000 auth_method 0 2024-08-18T21:08:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b6ffd640 1 --2- 172.21.15.5:0/1924701816 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f99b80a2800 0x7f99b8136bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2572819701}) 2024-08-18T21:08:42.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059975551}) 2024-08-18T21:08:42.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2063044307}) 2024-08-18T21:08:42.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b6ffd640 10 monclient(hunting): get_auth_request con 0x7f99b80a2800 auth_method 0 2024-08-18T21:08:42.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 10 monclient(hunting): handle_auth_done global_id 84222 payload 824 2024-08-18T21:08:42.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 1 -- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f99b809b080 msgr2=0x7f99b81cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 1 --2- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f99b809b080 0x7f99b81cf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 1 -- 172.21.15.5:0/1924701816 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f99b80a2800 msgr2=0x7f99b8136bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 1 --2- 172.21.15.5:0/1924701816 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f99b80a2800 0x7f99b8136bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:08:42.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 1 monclient: found mon.noname-a 2024-08-18T21:08:42.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:42.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:08:42.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 1 -- 172.21.15.5:0/1924701816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b81cf580 con 0x7f99b80a4000 2024-08-18T21:08:42.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 1 -- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b80a4000 msgr2=0x7f99b8137110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f99b7fff640 1 --2- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b80a4000 0x7f99b8137110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f99b0007fd0 tx=0x7f99b000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1415826860}) 2024-08-18T21:08:42.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1234052475}) 2024-08-18T21:08:42.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1415826860}) 2024-08-18T21:08:42.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1584384465}) 2024-08-18T21:08:42.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1415826860}) 2024-08-18T21:08:42.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3079388386}) 2024-08-18T21:08:42.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1415826860}) 2024-08-18T21:08:42.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1587087091}) 2024-08-18T21:08:42.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1415826860}) 2024-08-18T21:08:42.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1313890619}) 2024-08-18T21:08:42.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.301 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1415826860}) 2024-08-18T21:08:42.301 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2792324209}) 2024-08-18T21:08:42.301 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.301 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1415826860}) 2024-08-18T21:08:42.301 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2500627597}) 2024-08-18T21:08:42.301 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.301 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1415826860}) 2024-08-18T21:08:42.301 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.266+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2449448235}) 2024-08-18T21:08:42.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f999ffff640 1 -- 172.21.15.5:0/1924701816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f99b000dab0 con 0x7f99b80a4000 2024-08-18T21:08:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f999ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f999ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:08:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f999ffff640 10 monclient: dump: 2024-08-18T21:08:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.304 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f999ffff640 10 monclient: _finish_auth 0 2024-08-18T21:08:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f999ffff640 10 monclient: _check_auth_tickets 2024-08-18T21:08:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f999ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99bdf17640 5 monclient: authenticate success, global_id 84222 2024-08-18T21:08:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f999ffff640 1 -- 172.21.15.5:0/1924701816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b000dc70 con 0x7f99b80a4000 2024-08-18T21:08:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f999ffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f999ffff640 1 -- 172.21.15.5:0/1924701816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f99b000de20 con 0x7f99b80a4000 2024-08-18T21:08:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f999ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f999ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:08:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99b5ffb640 4 set_mon_vals no callback set 2024-08-18T21:08:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f999ffff640 10 monclient: dump: 2024-08-18T21:08:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.306 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99bdf17640 10 monclient: _renew_subs 2024-08-18T21:08:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99bdf17640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:08:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99bdf17640 1 -- 172.21.15.5:0/1924701816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b8077360 con 0x7f99b80a4000 2024-08-18T21:08:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99bdf17640 10 monclient: _renew_subs 2024-08-18T21:08:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99bdf17640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:08:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99bdf17640 1 -- 172.21.15.5:0/1924701816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b813c5d0 con 0x7f99b80a4000 2024-08-18T21:08:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99bdf17640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99bdf17640 1 --2- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f99b813a8b0 0x7f99b8139810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99bdf17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99bdf17640 1 -- 172.21.15.5:0/1924701816 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f99b813ca00 con 0x7f99b813a8b0 2024-08-18T21:08:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f999ffff640 1 -- 172.21.15.5:0/1924701816 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f99b001c020 con 0x7f99b80a4000 2024-08-18T21:08:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99b77fe640 1 --2- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f99b813a8b0 0x7f99b8139810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99b77fe640 10 monclient: get_auth_request con 0x7f99b813a8b0 auth_method 0 2024-08-18T21:08:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99b77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.270+0000 7f99b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.308 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.308 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=20,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=33} crc {logm=2559773492,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3314245335,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2357119157,osd_snap=723727393,osdmap=3015488029}) 2024-08-18T21:08:42.308 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=21,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=34} crc {logm=1199314648,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3761148079,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2357119157,osd_snap=723727393,osdmap=151983829}) 2024-08-18T21:08:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f99b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f99b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f99b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.309 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.309 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=20,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=33} crc {logm=2559773492,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3314245335,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2357119157,osd_snap=723727393,osdmap=3015488029}) 2024-08-18T21:08:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f999ffff640 1 --2- 172.21.15.5:0/1924701816 >> v2:172.21.15.157:6812/631023601 conn(0x7f99a403bdc0 0x7f99a403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.310 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=19,mdsmap=2,mgr=7,mgrstat=14,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=39} crc {logm=794747438,mdsmap=485591938,mgr=3549253758,mgrstat=3314245335,mon_config_key=2147202552,monmap=3438368439,osd_metadata=553867591,osd_pg_creating=2357119157,osd_snap=723727393,osdmap=2098834242}) 2024-08-18T21:08:42.310 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.310 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=20,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=33} crc {logm=2559773492,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3314245335,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2357119157,osd_snap=723727393,osdmap=3015488029}) 2024-08-18T21:08:42.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f999ffff640 1 -- 172.21.15.5:0/1924701816 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(144..144 src has 22..144) ==== 3898+0+0 (secure 0 0 0) 0x7f99b004ed80 con 0x7f99b80a4000 2024-08-18T21:08:42.311 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=22,mdsmap=3,mgr=7,mgr_command_descs=1,mgrstat=14,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=33} crc {logm=3695605706,mdsmap=4274512535,mgr=2612373358,mgr_command_descs=3328876062,mgrstat=3620196411,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2357119157,osd_snap=723727393,osdmap=1210091978}) 2024-08-18T21:08:42.311 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.311 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=20,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=33} crc {logm=2559773492,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3314245335,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2357119157,osd_snap=723727393,osdmap=3015488029}) 2024-08-18T21:08:42.311 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=21,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=33} crc {logm=2394523977,mdsmap=4274512535,mgr=2612373358,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3314245335,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2357119157,osd_snap=723727393,osdmap=1608097558}) 2024-08-18T21:08:42.311 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f99b77fe640 10 monclient(hunting): handle_auth_done global_id 84197 payload 824 2024-08-18T21:08:42.312 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=20,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=33} crc {logm=2559773492,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3314245335,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2357119157,osd_snap=723727393,osdmap=3015488029}) 2024-08-18T21:08:42.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f99b77fe640 1 -- 172.21.15.5:0/1924701816 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99b813b390 con 0x7f99b813a8b0 2024-08-18T21:08:42.313 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=21,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=36} crc {logm=2137879954,mdsmap=4274512535,mgr=3078743303,mgr_command_descs=3328876063,mgr_metadata=2208114464,mgrstat=2198571878,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2357119157,osd_snap=723727393,osdmap=1419342632}) 2024-08-18T21:08:42.313 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.313 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=20,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=33} crc {logm=2559773492,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3314245335,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2357119157,osd_snap=723727393,osdmap=3015488029}) 2024-08-18T21:08:42.313 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=21,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8,monmap=2,osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=39} crc {logm=3367275239,mdsmap=485591938,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=153533965,mon_config_key=2147202552,monmap=3140514009,osd_metadata=2074593030,osd_pg_creating=2357119157,osd_snap=723727393,osdmap=1380829399}) 2024-08-18T21:08:42.313 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.313 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=20,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=33} crc {logm=2559773492,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3314245335,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2357119157,osd_snap=723727393,osdmap=3015488029}) 2024-08-18T21:08:42.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f99b6ffd640 1 --2- 172.21.15.5:0/1924701816 >> v2:172.21.15.157:6812/631023601 conn(0x7f99a403bdc0 0x7f99a403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.314 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=22,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=35} crc {logm=3695605706,mdsmap=4274512535,mgr=4111398058,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3041983608,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2357119157,osd_snap=723727393,osdmap=1218103487}) 2024-08-18T21:08:42.314 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f99b6ffd640 10 monclient: get_auth_request con 0x7f99a403bdc0 auth_method 0 2024-08-18T21:08:42.315 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=20,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=33} crc {logm=2559773492,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3314245335,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2357119157,osd_snap=723727393,osdmap=3015488029}) 2024-08-18T21:08:42.315 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=21,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=33} crc {logm=3645167053,mdsmap=4274512535,mgr=2612373358,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3314245335,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2357119157,osd_snap=723727393,osdmap=2511371418}) 2024-08-18T21:08:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f99b77fe640 1 -- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f99b813a8b0 msgr2=0x7f99b8139810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f99b77fe640 1 --2- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f99b813a8b0 0x7f99b8139810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99a801c260 tx=0x7f99a80191d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f999ffff640 1 -- 172.21.15.5:0/1924701816 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f99a80ba070 con 0x7f99b813a8b0 2024-08-18T21:08:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f999ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f999ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:08:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f999ffff640 10 monclient: dump: 2024-08-18T21:08:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.317 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f999ffff640 1 -- 172.21.15.5:0/1924701816 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f99a80b1040 con 0x7f99b813a8b0 2024-08-18T21:08:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f999ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f999ffff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:42.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f999ffff640 1 -- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f99b813a8b0 msgr2=0x7f99b8139810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f999ffff640 1 --2- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f99b813a8b0 0x7f99b8139810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99a801c260 tx=0x7f99a80191d0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f999ffff640 1 -- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f99b813a8b0 msgr2=0x7f99b8139810 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:42.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f999ffff640 1 --2- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f99b813a8b0 0x7f99b8139810 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99a801c260 tx=0x7f99a80191d0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f99b6ffd640 1 --2- 172.21.15.5:0/1924701816 >> v2:172.21.15.157:6812/631023601 conn(0x7f99a403bdc0 0x7f99a403e280 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f99b813aea0 tx=0x7f99ac008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.320 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.274+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.320 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=488729478}) 2024-08-18T21:08:42.320 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=844956156}) 2024-08-18T21:08:42.321 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.321 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=488729478}) 2024-08-18T21:08:42.321 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1914155003}) 2024-08-18T21:08:42.321 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.321 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=488729478}) 2024-08-18T21:08:42.321 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=1136543016}) 2024-08-18T21:08:42.321 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.321 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=488729478}) 2024-08-18T21:08:42.321 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=487238140}) 2024-08-18T21:08:42.321 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.321 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=488729478}) 2024-08-18T21:08:42.321 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=1425474956}) 2024-08-18T21:08:42.321 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=488729478}) 2024-08-18T21:08:42.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=312785072}) 2024-08-18T21:08:42.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=488729478}) 2024-08-18T21:08:42.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2157260106}) 2024-08-18T21:08:42.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=488729478}) 2024-08-18T21:08:42.322 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.278+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=2542802629}) 2024-08-18T21:08:42.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f99bdf17640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:42.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f99bdf17640 1 --2- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f99b802d1d0 0x7f99b802d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f99bdf17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f99bdf17640 1 -- 172.21.15.5:0/1924701816 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f99b8051140 con 0x7f99b802d1d0 2024-08-18T21:08:42.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f99b77fe640 1 --2- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f99b802d1d0 0x7f99b802d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f99b77fe640 10 monclient: get_auth_request con 0x7f99b802d1d0 auth_method 0 2024-08-18T21:08:42.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f99b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f99b77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f99b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f99b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f99b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f99b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f99b77fe640 10 monclient(hunting): handle_auth_done global_id 84206 payload 824 2024-08-18T21:08:42.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f99b77fe640 1 -- 172.21.15.5:0/1924701816 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f99b8073730 con 0x7f99b802d1d0 2024-08-18T21:08:42.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f99b77fe640 1 -- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f99b802d1d0 msgr2=0x7f99b802d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f99b77fe640 1 --2- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f99b802d1d0 0x7f99b802d5e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f99a801c470 tx=0x7f99a80a8000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f999ffff640 1 -- 172.21.15.5:0/1924701816 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f99a80b0070 con 0x7f99b802d1d0 2024-08-18T21:08:42.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f999ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f999ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:08:42.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f999ffff640 10 monclient: dump: 2024-08-18T21:08:42.325 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.326 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.326 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.326 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.326 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.326 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.326 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.326 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.326 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.326 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.326 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.326 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.326 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.327 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.327 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.327 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f999ffff640 1 -- 172.21.15.5:0/1924701816 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f99a80c93f0 con 0x7f99b802d1d0 2024-08-18T21:08:42.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f999ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:42.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f999ffff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:42.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f999ffff640 1 -- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f99b802d1d0 msgr2=0x7f99b802d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f999ffff640 1 --2- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f99b802d1d0 0x7f99b802d5e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f99a801c470 tx=0x7f99a80a8000 comp rx=0 tx=0).stop 2024-08-18T21:08:42.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f999ffff640 1 -- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f99b802d1d0 msgr2=0x7f99b802d5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:42.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.286+0000 7f999ffff640 1 --2- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f99b802d1d0 0x7f99b802d5e0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f99a801c470 tx=0x7f99a80a8000 comp rx=0 tx=0).stop 2024-08-18T21:08:42.327 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:42.328 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:42.328 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:42.328 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:42.328 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:42.328 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 19115, 2024-08-18T21:08:42.328 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:42.328 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:42.328 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:42.328 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:42.328 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:42.328 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:42.329 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:42.329 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:42.329 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:42.329 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:42.329 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.329 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:08:42.329 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:42.329 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:42.329 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:42.329 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:42.329 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:42.329 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:42.329 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:42.329 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:42.330 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:42.330 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:42.330 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:42.330 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:42.330 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:42.330 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:42.330 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.330 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:42.330 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:42.330 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:42.331 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:42.331 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:42.331 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:42.331 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:42.331 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:42.331 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:42.331 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:42.331 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:42.331 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:42.331 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:42.331 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.331 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:42.331 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:42.332 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:42.332 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:42.332 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:42.332 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:42.332 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:42.332 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:42.332 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:42.332 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:42.332 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:42.332 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:42.332 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:42.332 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:42.332 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:42.333 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:42.333 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:42.333 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:42.333 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:42.333 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:42.333 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:42.333 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:42.333 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:42.333 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:42.333 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:42.333 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:42.333 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:42.333 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:42.333 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.334 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:42.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.334 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:42.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.334 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:42.334 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:42.334 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.334 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.334 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.334 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:42.334 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.335 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.335 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:42.335 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.335 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.335 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.335 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:42.335 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:42.335 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.335 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.335 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.336 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:42.336 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:42.336 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.336 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.336 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.336 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:42.336 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.336 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.337 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:42.337 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.337 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.337 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.337 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:42.337 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:42.337 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.337 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.337 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.337 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:42.337 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:42.338 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.338 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.338 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.338 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:42.338 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.338 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.338 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:42.338 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.338 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.338 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.339 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:42.339 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:42.339 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.339 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.339 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.339 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:42.339 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:42.339 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.339 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.340 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.340 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:42.340 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.341 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.341 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:42.341 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.342 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.342 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.342 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:42.342 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:42.342 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.342 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.342 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.342 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:42.342 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:42.342 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.343 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.343 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.343 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:42.343 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.343 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.343 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:42.343 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.343 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.343 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.344 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:42.344 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:42.344 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.344 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.344 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.344 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:42.344 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:42.344 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.344 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.344 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.344 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:42.345 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.345 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.345 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:42.345 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.345 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.345 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.345 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:42.345 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:42.345 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.345 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.346 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.346 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:42.346 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:42.346 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.346 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.346 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.346 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:42.346 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.347 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.347 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:42.347 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.347 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.347 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.347 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:42.347 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:42.347 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.347 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.347 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.348 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:42.348 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:42.348 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.348 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.348 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.348 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:42.348 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.348 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.348 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:42.348 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.348 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.349 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.349 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:42.349 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:42.349 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.349 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.349 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.349 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:42.349 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:42.349 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.350 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.350 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.350 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:42.350 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.350 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.350 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:42.350 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.350 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.350 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.351 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:42.351 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:42.351 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.351 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.351 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.351 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.351 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.351 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:42.351 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:42.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.351 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:42.351 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:42.351 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:42.352 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.352 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.352 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:42.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.352 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:42.352 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:42.352 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:42.352 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.352 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.352 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:42.352 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:42.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f99bdf17640 1 -- 172.21.15.5:0/1924701816 >> v2:172.21.15.157:6812/631023601 conn(0x7f99a403bdc0 msgr2=0x7f99a403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f99bdf17640 1 --2- 172.21.15.5:0/1924701816 >> v2:172.21.15.157:6812/631023601 conn(0x7f99a403bdc0 0x7f99a403e280 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f99b813aea0 tx=0x7f99ac008040 comp rx=0 tx=0).stop 2024-08-18T21:08:42.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f99bdf17640 10 monclient: shutdown 2024-08-18T21:08:42.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f99bdf17640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:42.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f99bdf17640 1 -- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b80a4000 msgr2=0x7f99b8137110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f99b7fff640 1 -- 172.21.15.5:0/1924701816 reap_dead start 2024-08-18T21:08:42.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f99bdf17640 1 --2- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b80a4000 0x7f99b8137110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f99b0007fd0 tx=0x7f99b000a710 comp rx=0 tx=0).stop 2024-08-18T21:08:42.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f99bdf17640 1 -- 172.21.15.5:0/1924701816 shutdown_connections 2024-08-18T21:08:42.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f99bdf17640 1 --2- 172.21.15.5:0/1924701816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b80a4000 0x7f99b8137110 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f99bdf17640 1 -- 172.21.15.5:0/1924701816 >> 172.21.15.5:0/1924701816 conn(0x7f99b80a50f0 msgr2=0x7f99b813ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:42.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f99bdf17640 1 -- 172.21.15.5:0/1924701816 shutdown_connections 2024-08-18T21:08:42.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f99bdf17640 1 -- 172.21.15.5:0/1924701816 wait complete. 2024-08-18T21:08:42.356 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.356 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=59} crc {osdmap=1897268120}) 2024-08-18T21:08:42.356 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=59} crc {osdmap=2433062420}) 2024-08-18T21:08:42.357 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.357 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=59} crc {osdmap=1897268120}) 2024-08-18T21:08:42.357 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=58} crc {osdmap=2185357105}) 2024-08-18T21:08:42.357 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.357 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=59} crc {osdmap=1897268120}) 2024-08-18T21:08:42.357 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=59} crc {osdmap=3316889896}) 2024-08-18T21:08:42.357 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.357 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=59} crc {osdmap=1897268120}) 2024-08-18T21:08:42.357 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=58} crc {osdmap=4152817937}) 2024-08-18T21:08:42.357 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.357 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=59} crc {osdmap=1897268120}) 2024-08-18T21:08:42.357 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=59} crc {osdmap=3147617505}) 2024-08-18T21:08:42.357 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.357 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=59} crc {osdmap=1897268120}) 2024-08-18T21:08:42.358 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=59} crc {osdmap=4266562410}) 2024-08-18T21:08:42.358 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.358 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=59} crc {osdmap=1897268120}) 2024-08-18T21:08:42.358 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=58} crc {osdmap=3869278794}) 2024-08-18T21:08:42.358 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:08:42.358 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=59} crc {osdmap=1897268120}) 2024-08-18T21:08:42.358 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:08:42.290+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=58} crc {osdmap=445016839}) 2024-08-18T21:08:42.359 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:42.359 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:08:42.359 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:08:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.478+0000 7f4ef49bd640 10 monclient: get_monmap_and_config 2024-08-18T21:08:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.478+0000 7f4ef49bd640 10 monclient: build_initial_monmap 2024-08-18T21:08:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.478+0000 7f4ef49bd640 10 monclient: monmap: 2024-08-18T21:08:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:42.483967+0000 2024-08-18T21:08:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:42.483967+0000 2024-08-18T21:08:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:42.485 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 1 Processor -- start 2024-08-18T21:08:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 1 -- start start 2024-08-18T21:08:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 10 monclient: init 2024-08-18T21:08:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 10 monclient: _add_conns ranks=[6,8,7,3,4,2,9,10,5,0,1] 2024-08-18T21:08:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4ef00a4000 0x7f4ef00a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 10 monclient(hunting): picked mon.noname-d con 0x7f4ef00a4000 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4ef00a2800 0x7f4ef00a4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 10 monclient(hunting): picked mon.noname-e con 0x7f4ef00a2800 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:08:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4ef009b080 0x7f4ef009b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 10 monclient(hunting): picked mon.noname-i con 0x7f4ef009b080 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f4ef00689b0 con 0x7f4ef00a4000 2024-08-18T21:08:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f4ef00a4e60 con 0x7f4ef009b080 2024-08-18T21:08:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f4ef00a2450 con 0x7f4ef00a2800 2024-08-18T21:08:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ef49bd640 10 monclient(hunting): authenticate will time out at 1289.496896s 2024-08-18T21:08:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4ef00a4000 0x7f4ef00a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ee7fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4ef00a2800 0x7f4ef00a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4ef00a4000 0x7f4ef00a43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:40360/0 (socket says 172.21.15.5:40360) 2024-08-18T21:08:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 1 -- 172.21.15.5:0/3581683815 learned_addr learned my addr 172.21.15.5:0/3581683815 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 10 monclient(hunting): get_auth_request con 0x7f4ef00a4000 auth_method 0 2024-08-18T21:08:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ee7fff640 10 monclient(hunting): get_auth_request con 0x7f4ef00a2800 auth_method 0 2024-08-18T21:08:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ee7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ee7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ee7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ee7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ee7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ee7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eeed9d640 1 --2- 172.21.15.5:0/3581683815 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4ef009b080 0x7f4ef009b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 10 monclient(hunting): handle_auth_done global_id 84273 payload 274 2024-08-18T21:08:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 1 -- 172.21.15.5:0/3581683815 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4ef00a2800 msgr2=0x7f4ef00a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 1 --2- 172.21.15.5:0/3581683815 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4ef00a2800 0x7f4ef00a4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 1 -- 172.21.15.5:0/3581683815 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4ef009b080 msgr2=0x7f4ef009b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 1 --2- 172.21.15.5:0/3581683815 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4ef009b080 0x7f4ef009b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 10 monclient: _finish_hunting 0 2024-08-18T21:08:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 1 monclient: found mon.noname-d 2024-08-18T21:08:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:08:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eee59c640 1 -- 172.21.15.5:0/3581683815 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef00a5f90 con 0x7f4ef00a4000 2024-08-18T21:08:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eeed9d640 10 monclient: get_auth_request con 0x7f4ef009b080 auth_method 0 2024-08-18T21:08:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4eeed9d640 1 --2- 172.21.15.5:0/3581683815 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4ef009b080 0x7f4ef009b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:08:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.482+0000 7f4ee7fff640 1 --2- 172.21.15.5:0/3581683815 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4ef00a2800 0x7f4ef00a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:08:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4eee59c640 1 -- 172.21.15.5:0/3581683815 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4ef00a4000 msgr2=0x7f4ef00a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4eee59c640 1 --2- 172.21.15.5:0/3581683815 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4ef00a4000 0x7f4ef00a43e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000b980 tx=0x7f4ee001c8b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=aea732848b312824 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4eedd9b640 1 -- 172.21.15.5:0/3581683815 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4ee00ac070 con 0x7f4ef00a4000 2024-08-18T21:08:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4eedd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4eedd9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:08:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4eedd9b640 10 monclient: dump: 2024-08-18T21:08:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.494 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4eedd9b640 10 monclient: _finish_auth 0 2024-08-18T21:08:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4eedd9b640 10 monclient: _check_auth_tickets 2024-08-18T21:08:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4eedd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4eedd9b640 1 -- 172.21.15.5:0/3581683815 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee00a6910 con 0x7f4ef00a4000 2024-08-18T21:08:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4eedd9b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4eedd9b640 1 -- 172.21.15.5:0/3581683815 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4ee00a7480 con 0x7f4ef00a4000 2024-08-18T21:08:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4ef49bd640 5 monclient: authenticate success, global_id 84273 2024-08-18T21:08:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4ef49bd640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4ef49bd640 4 set_mon_vals no callback set 2024-08-18T21:08:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4eedd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4eedd9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:08:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4eedd9b640 10 monclient: dump: 2024-08-18T21:08:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.496 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4ef49bd640 10 monclient: shutdown 2024-08-18T21:08:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4ef49bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4ef49bd640 1 -- 172.21.15.5:0/3581683815 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4ef00a4000 msgr2=0x7f4ef00a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4ef49bd640 1 --2- 172.21.15.5:0/3581683815 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4ef00a4000 0x7f4ef00a43e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000b980 tx=0x7f4ee001c8b0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4ef49bd640 1 -- 172.21.15.5:0/3581683815 shutdown_connections 2024-08-18T21:08:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4ef49bd640 1 --2- 172.21.15.5:0/3581683815 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4ef00a2800 0x7f4ef00a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4ef49bd640 1 --2- 172.21.15.5:0/3581683815 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4ef009b080 0x7f4ef009b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4ef49bd640 1 --2- 172.21.15.5:0/3581683815 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4ef00a4000 0x7f4ef00a43e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4ef49bd640 1 -- 172.21.15.5:0/3581683815 >> 172.21.15.5:0/3581683815 conn(0x7f4ef00a50f0 msgr2=0x7f4ef00a54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4ef49bd640 1 -- 172.21.15.5:0/3581683815 shutdown_connections 2024-08-18T21:08:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.486+0000 7f4ef49bd640 1 -- 172.21.15.5:0/3581683815 wait complete. 2024-08-18T21:08:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 10 monclient: build_initial_monmap 2024-08-18T21:08:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 10 monclient: monmap: 2024-08-18T21:08:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:42.499 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:42.499 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:42.499 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:42.499 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 1 Processor -- start 2024-08-18T21:08:42.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 1 -- start start 2024-08-18T21:08:42.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 10 monclient: init 2024-08-18T21:08:42.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:42.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 10 monclient: _add_conns ranks=[1,3,6,8,2,5,4,0,7] 2024-08-18T21:08:42.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ef009b080 0x7f4ef0136d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 10 monclient(hunting): picked mon.noname-f con 0x7f4ef009b080 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:08:42.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ef00a2800 0x7f4ef01ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 10 monclient(hunting): picked mon.noname-g con 0x7f4ef00a2800 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:42.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4ef00a4000 0x7f4ef01cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 10 monclient(hunting): picked mon.noname-d con 0x7f4ef00a4000 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:42.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef009fe80 con 0x7f4ef009b080 2024-08-18T21:08:42.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef009fd00 con 0x7f4ef00a2800 2024-08-18T21:08:42.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f4ef00a0000 con 0x7f4ef00a4000 2024-08-18T21:08:42.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:42.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ef49bd640 10 monclient(hunting): authenticate will time out at 1289.506183s 2024-08-18T21:08:42.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4ef00a4000 0x7f4ef01cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4ef00a4000 0x7f4ef01cd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:40372/0 (socket says 172.21.15.5:40372) 2024-08-18T21:08:42.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 1 -- 172.21.15.5:0/4271276703 learned_addr learned my addr 172.21.15.5:0/4271276703 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:42.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 10 monclient(hunting): get_auth_request con 0x7f4ef00a4000 auth_method 0 2024-08-18T21:08:42.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ee7fff640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ef00a2800 0x7f4ef01ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eee59c640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ef009b080 0x7f4ef0136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ee7fff640 10 monclient(hunting): get_auth_request con 0x7f4ef00a2800 auth_method 0 2024-08-18T21:08:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ee7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ee7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4ee7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eee59c640 10 monclient(hunting): get_auth_request con 0x7f4ef009b080 auth_method 0 2024-08-18T21:08:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eee59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eee59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eee59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 10 monclient(hunting): handle_auth_done global_id 84282 payload 824 2024-08-18T21:08:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 1 -- 172.21.15.5:0/4271276703 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ef00a2800 msgr2=0x7f4ef01ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ef00a2800 0x7f4ef01ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 1 -- 172.21.15.5:0/4271276703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ef009b080 msgr2=0x7f4ef0136d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ef009b080 0x7f4ef0136d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 10 monclient: _finish_hunting 0 2024-08-18T21:08:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 1 monclient: found mon.noname-d 2024-08-18T21:08:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:08:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.490+0000 7f4eeed9d640 1 -- 172.21.15.5:0/4271276703 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef0077250 con 0x7f4ef00a4000 2024-08-18T21:08:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.494+0000 7f4eeed9d640 1 -- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4ef00a4000 msgr2=0x7f4ef01cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.494+0000 7f4eeed9d640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4ef00a4000 0x7f4ef01cd4b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800cea0 tx=0x7f4ee800cf90 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee6ffd640 1 -- 172.21.15.5:0/4271276703 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4ee800dcc0 con 0x7f4ef00a4000 2024-08-18T21:08:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee6ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:08:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee6ffd640 10 monclient: dump: 2024-08-18T21:08:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.509 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.509 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:08:42.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:08:42.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:42.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee6ffd640 1 -- 172.21.15.5:0/4271276703 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee8015440 con 0x7f4ef00a4000 2024-08-18T21:08:42.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:42.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee6ffd640 1 -- 172.21.15.5:0/4271276703 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4ee8015a60 con 0x7f4ef00a4000 2024-08-18T21:08:42.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:08:42.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee6ffd640 10 monclient: dump: 2024-08-18T21:08:42.510 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.510 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.510 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.510 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.510 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.510 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.510 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.510 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.510 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.510 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.510 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.510 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.511 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.511 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.511 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.511 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4eed59a640 4 set_mon_vals no callback set 2024-08-18T21:08:42.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ef49bd640 5 monclient: authenticate success, global_id 84282 2024-08-18T21:08:42.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ef49bd640 10 monclient: _renew_subs 2024-08-18T21:08:42.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ef49bd640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:08:42.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ef49bd640 1 -- 172.21.15.5:0/4271276703 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef012d7e0 con 0x7f4ef00a4000 2024-08-18T21:08:42.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ef49bd640 10 monclient: _renew_subs 2024-08-18T21:08:42.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ef49bd640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:08:42.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ef49bd640 1 -- 172.21.15.5:0/4271276703 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef0077780 con 0x7f4ef00a4000 2024-08-18T21:08:42.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ef49bd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:42.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ef49bd640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4ef013c440 0x7f4ef01ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ef49bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ef49bd640 1 -- 172.21.15.5:0/4271276703 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f4ef0064590 con 0x7f4ef013c440 2024-08-18T21:08:42.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4eee59c640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4ef013c440 0x7f4ef01ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4eee59c640 10 monclient: get_auth_request con 0x7f4ef013c440 auth_method 0 2024-08-18T21:08:42.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4eee59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4eee59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4eee59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee6ffd640 1 -- 172.21.15.5:0/4271276703 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f4ee801c020 con 0x7f4ef00a4000 2024-08-18T21:08:42.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4eee59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4eee59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4eee59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4eee59c640 10 monclient(hunting): handle_auth_done global_id 5800 payload 824 2024-08-18T21:08:42.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4eee59c640 1 -- 172.21.15.5:0/4271276703 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ef013a980 con 0x7f4ef013c440 2024-08-18T21:08:42.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee6ffd640 1 --2- 172.21.15.5:0/4271276703 >> v2:172.21.15.157:6812/631023601 conn(0x7f4ed003bdc0 0x7f4ed003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee6ffd640 1 -- 172.21.15.5:0/4271276703 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(145..145 src has 22..145) ==== 3506+0+0 (secure 0 0 0) 0x7f4ee804ed40 con 0x7f4ef00a4000 2024-08-18T21:08:42.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee7fff640 1 --2- 172.21.15.5:0/4271276703 >> v2:172.21.15.157:6812/631023601 conn(0x7f4ed003bdc0 0x7f4ed003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.498+0000 7f4ee7fff640 10 monclient: get_auth_request con 0x7f4ed003bdc0 auth_method 0 2024-08-18T21:08:42.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.502+0000 7f4eee59c640 1 -- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4ef013c440 msgr2=0x7f4ef01ca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.502+0000 7f4eee59c640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4ef013c440 0x7f4ef01ca1b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00ae000 tx=0x7f4ee0019650 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.502+0000 7f4ee6ffd640 1 -- 172.21.15.5:0/4271276703 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4ee00c0070 con 0x7f4ef013c440 2024-08-18T21:08:42.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.502+0000 7f4ee6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.502+0000 7f4ee6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:08:42.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.502+0000 7f4ee6ffd640 10 monclient: dump: 2024-08-18T21:08:42.516 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.516 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.516 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.516 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.517 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.517 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.517 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.517 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.517 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.517 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.517 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.517 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.517 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.517 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.517 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.517 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.502+0000 7f4ee6ffd640 1 -- 172.21.15.5:0/4271276703 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4ee0003b20 con 0x7f4ef013c440 2024-08-18T21:08:42.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.502+0000 7f4ee6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:42.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.502+0000 7f4ee6ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:42.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.502+0000 7f4ee6ffd640 1 -- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4ef013c440 msgr2=0x7f4ef01ca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.502+0000 7f4ee6ffd640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4ef013c440 0x7f4ef01ca1b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00ae000 tx=0x7f4ee0019650 comp rx=0 tx=0).stop 2024-08-18T21:08:42.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.502+0000 7f4ee6ffd640 1 -- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4ef013c440 msgr2=0x7f4ef01ca1b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:42.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.502+0000 7f4ee6ffd640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4ef013c440 0x7f4ef01ca1b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.502+0000 7f4ee7fff640 1 --2- 172.21.15.5:0/4271276703 >> v2:172.21.15.157:6812/631023601 conn(0x7f4ed003bdc0 0x7f4ed003e280 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800da20 tx=0x7f4ed800f040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.506+0000 7f4ef49bd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:42.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.506+0000 7f4ef49bd640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4ef01372b0 0x7f4ef002d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ef49bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ef49bd640 1 -- 172.21.15.5:0/4271276703 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f4ef0051140 con 0x7f4ef01372b0 2024-08-18T21:08:42.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4eee59c640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4ef01372b0 0x7f4ef002d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4eee59c640 10 monclient: get_auth_request con 0x7f4ef01372b0 auth_method 0 2024-08-18T21:08:42.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4eee59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4eee59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4eee59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4eee59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4eee59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4eee59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4eee59c640 10 monclient(hunting): handle_auth_done global_id 5809 payload 824 2024-08-18T21:08:42.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4eee59c640 1 -- 172.21.15.5:0/4271276703 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4ef009b460 con 0x7f4ef01372b0 2024-08-18T21:08:42.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4eee59c640 1 -- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4ef01372b0 msgr2=0x7f4ef002d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4eee59c640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4ef01372b0 0x7f4ef002d1d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0000c10 tx=0x7f4ee00a9000 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ee6ffd640 1 -- 172.21.15.5:0/4271276703 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4ee00c0040 con 0x7f4ef01372b0 2024-08-18T21:08:42.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ee6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ee6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:08:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ee6ffd640 10 monclient: dump: 2024-08-18T21:08:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.521 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ee6ffd640 1 -- 172.21.15.5:0/4271276703 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f4ee00c6070 con 0x7f4ef01372b0 2024-08-18T21:08:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ee6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ee6ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ee6ffd640 1 -- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4ef01372b0 msgr2=0x7f4ef002d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ee6ffd640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4ef01372b0 0x7f4ef002d1d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0000c10 tx=0x7f4ee00a9000 comp rx=0 tx=0).stop 2024-08-18T21:08:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ee6ffd640 1 -- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4ef01372b0 msgr2=0x7f4ef002d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ee6ffd640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4ef01372b0 0x7f4ef002d1d0 secure :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0000c10 tx=0x7f4ee00a9000 comp rx=0 tx=0).stop 2024-08-18T21:08:42.521 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:42.522 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:42.522 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:42.522 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:42.522 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:42.522 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 331628, 2024-08-18T21:08:42.522 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:42.522 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:42.522 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:42.522 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:42.522 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:42.522 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:42.522 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:42.523 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:42.523 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:42.523 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:42.523 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.523 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:08:42.523 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:42.523 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:42.523 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:42.523 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:42.523 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:42.523 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:42.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:42.523 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:42.523 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:42.524 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:42.524 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:42.524 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:42.524 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:42.524 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:42.524 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.524 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:42.524 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:42.524 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:42.524 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:42.524 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:42.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:42.524 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:42.525 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:42.525 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:42.525 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:42.525 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:42.525 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:42.525 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:42.525 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.525 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:42.525 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:42.525 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:42.525 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:42.525 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:42.526 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:42.526 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:42.526 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:42.526 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:42.526 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:42.526 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:42.526 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:42.526 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:42.526 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:42.526 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:42.526 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:42.526 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:42.526 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:42.526 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:42.527 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:42.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:42.527 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:42.527 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:42.527 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:42.527 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:42.527 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:42.527 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:42.527 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:42.527 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.527 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:42.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.527 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:42.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.528 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:42.528 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:42.528 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.528 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.528 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.528 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:42.528 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.528 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.528 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:42.528 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.529 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.529 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.529 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:42.529 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:42.529 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.529 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.529 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.529 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.529 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:42.529 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:42.529 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.529 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.530 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.530 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.530 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:42.530 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.530 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.530 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.530 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:42.530 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.530 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.530 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.530 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:42.531 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:42.531 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.531 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.531 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.531 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:42.531 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:42.531 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.531 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.531 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.531 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:42.531 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.532 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.532 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.532 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:42.532 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.532 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.532 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.532 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:42.532 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:42.532 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.532 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.532 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.533 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.533 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:42.533 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:42.533 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.533 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.533 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.533 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:42.533 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.533 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.533 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:42.534 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.534 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.534 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.534 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:42.534 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:42.534 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.534 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.534 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.534 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:42.534 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:42.535 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.535 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.535 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.535 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.535 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:42.535 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.535 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.535 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.535 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:42.535 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.535 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.535 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.536 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:42.536 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:42.536 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.536 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.536 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.536 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:42.536 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:42.536 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.536 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.536 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.536 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.536 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:42.537 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.537 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.537 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.537 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:42.537 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.537 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.537 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.537 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:42.537 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:42.537 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.537 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.537 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.538 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:42.538 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:42.538 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.538 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.538 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.538 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:42.538 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.539 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.539 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:42.539 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.539 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.539 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.539 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:42.539 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:42.539 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.539 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.540 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:42.540 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:42.540 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.540 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.540 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.540 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:42.540 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.541 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.541 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:42.541 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.541 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.541 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.541 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:42.541 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:42.541 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.541 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.541 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.541 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:42.542 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:42.542 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.542 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.542 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.542 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.542 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:42.542 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.542 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.542 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.542 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:42.542 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.543 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.543 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.543 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:42.543 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:42.543 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.545 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.545 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.546 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.546 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.546 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:42.546 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:42.546 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.546 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:42.546 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:42.546 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:42.546 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.546 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.546 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:08:42.546 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.547 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:42.547 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:42.547 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:42.547 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.547 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.547 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:42.547 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.547 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:42.547 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:42.547 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:42.547 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.547 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.547 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:42.548 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:42.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ef49bd640 1 -- 172.21.15.5:0/4271276703 >> v2:172.21.15.157:6812/631023601 conn(0x7f4ed003bdc0 msgr2=0x7f4ed003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ef49bd640 1 --2- 172.21.15.5:0/4271276703 >> v2:172.21.15.157:6812/631023601 conn(0x7f4ed003bdc0 0x7f4ed003e280 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800da20 tx=0x7f4ed800f040 comp rx=0 tx=0).stop 2024-08-18T21:08:42.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ef49bd640 10 monclient: shutdown 2024-08-18T21:08:42.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ef49bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:42.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ef49bd640 1 -- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4ef00a4000 msgr2=0x7f4ef01cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ef49bd640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4ef00a4000 0x7f4ef01cd4b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800cea0 tx=0x7f4ee800cf90 comp rx=0 tx=0).stop 2024-08-18T21:08:42.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4eeed9d640 1 -- 172.21.15.5:0/4271276703 reap_dead start 2024-08-18T21:08:42.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ef49bd640 1 -- 172.21.15.5:0/4271276703 shutdown_connections 2024-08-18T21:08:42.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ef49bd640 1 --2- 172.21.15.5:0/4271276703 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4ef00a4000 0x7f4ef01cd4b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ef49bd640 1 -- 172.21.15.5:0/4271276703 >> 172.21.15.5:0/4271276703 conn(0x7f4ef00a50f0 msgr2=0x7f4ef013d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:42.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ef49bd640 1 -- 172.21.15.5:0/4271276703 shutdown_connections 2024-08-18T21:08:42.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.510+0000 7f4ef49bd640 1 -- 172.21.15.5:0/4271276703 wait complete. 2024-08-18T21:08:42.550 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:42.550 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:08:42.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:08:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 10 monclient: get_monmap_and_config 2024-08-18T21:08:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 10 monclient: build_initial_monmap 2024-08-18T21:08:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 10 monclient: monmap: 2024-08-18T21:08:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:42.665584+0000 2024-08-18T21:08:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:42.665584+0000 2024-08-18T21:08:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:42.666 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 1 Processor -- start 2024-08-18T21:08:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 1 -- start start 2024-08-18T21:08:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 10 monclient: init 2024-08-18T21:08:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 10 monclient: _add_conns ranks=[0,2,3,7,1,9,10,6,5,4,8] 2024-08-18T21:08:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f92e40a4000 addr v1:172.21.15.5:6789/0 2024-08-18T21:08:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f92e40a4af0 0x7f92e413cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 10 monclient(hunting): picked mon.noname-b con 0x7f92e40a4af0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:08:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92e413d0e0 0x7f92e413f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 10 monclient(hunting): picked mon.noname-g con 0x7f92e413d0e0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e40a5f60 con 0x7f92e40a4000 2024-08-18T21:08:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f92e40a1f90 con 0x7f92e40a4af0 2024-08-18T21:08:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f92e4068c10 con 0x7f92e413d0e0 2024-08-18T21:08:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ebe67640 10 monclient(hunting): authenticate will time out at 1289.679099s 2024-08-18T21:08:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9c03640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f92e40a4000 0x7f92e40a43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47042/0 (socket says 172.21.15.5:47042) 2024-08-18T21:08:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9c03640 1 -- 172.21.15.5:0/1037835496 learned_addr learned my addr 172.21.15.5:0/1037835496 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:08:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 1 --2- 172.21.15.5:0/1037835496 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f92e40a4af0 0x7f92e413cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 10 monclient(hunting): get_auth_request con 0x7f92e40a4af0 auth_method 0 2024-08-18T21:08:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ea404640 1 --2- 172.21.15.5:0/1037835496 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92e413d0e0 0x7f92e413f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ea404640 10 monclient(hunting): get_auth_request con 0x7f92e413d0e0 auth_method 0 2024-08-18T21:08:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ea404640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ea404640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92ea404640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 10 monclient(hunting): handle_auth_done global_id 84215 payload 274 2024-08-18T21:08:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 1 -- 172.21.15.5:0/1037835496 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92e413d0e0 msgr2=0x7f92e413f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 1 --2- 172.21.15.5:0/1037835496 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92e413d0e0 0x7f92e413f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 1 -- 172.21.15.5:0/1037835496 >> v1:172.21.15.5:6789/0 conn(0x7f92e40a4000 legacy=0x7f92e40a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 10 monclient: _finish_hunting 0 2024-08-18T21:08:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 1 monclient: found mon.noname-b 2024-08-18T21:08:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:08:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.662+0000 7f92e9402640 1 -- 172.21.15.5:0/1037835496 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e40a0300 con 0x7f92e40a4af0 2024-08-18T21:08:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e9402640 1 -- 172.21.15.5:0/1037835496 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f92e40a4af0 msgr2=0x7f92e413cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e9402640 1 --2- 172.21.15.5:0/1037835496 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f92e40a4af0 0x7f92e413cba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f92e00097f0 tx=0x7f92e001c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=799fa99a5bf2db29 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e8c01640 1 -- 172.21.15.5:0/1037835496 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f92e00b0070 con 0x7f92e40a4af0 2024-08-18T21:08:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e8c01640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e8c01640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:08:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e8c01640 10 monclient: dump: 2024-08-18T21:08:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.675 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e8c01640 10 monclient: _finish_auth 0 2024-08-18T21:08:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e8c01640 10 monclient: _check_auth_tickets 2024-08-18T21:08:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e8c01640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e8c01640 1 -- 172.21.15.5:0/1037835496 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e00aa810 con 0x7f92e40a4af0 2024-08-18T21:08:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e8c01640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 5 monclient: authenticate success, global_id 84215 2024-08-18T21:08:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e8c01640 1 -- 172.21.15.5:0/1037835496 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f92e00aae30 con 0x7f92e40a4af0 2024-08-18T21:08:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e8c01640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e8c01640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:08:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e8c01640 10 monclient: dump: 2024-08-18T21:08:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.677 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 4 set_mon_vals no callback set 2024-08-18T21:08:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 10 monclient: shutdown 2024-08-18T21:08:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 1 -- 172.21.15.5:0/1037835496 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f92e40a4af0 msgr2=0x7f92e413cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 1 --2- 172.21.15.5:0/1037835496 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f92e40a4af0 0x7f92e413cba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f92e00097f0 tx=0x7f92e001c3a0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 1 -- 172.21.15.5:0/1037835496 shutdown_connections 2024-08-18T21:08:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 1 --2- 172.21.15.5:0/1037835496 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92e413d0e0 0x7f92e413f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 1 --2- 172.21.15.5:0/1037835496 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f92e40a4af0 0x7f92e413cba0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 1 -- 172.21.15.5:0/1037835496 >> 172.21.15.5:0/1037835496 conn(0x7f92e40a50f0 msgr2=0x7f92e40a54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 1 -- 172.21.15.5:0/1037835496 shutdown_connections 2024-08-18T21:08:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 1 -- 172.21.15.5:0/1037835496 wait complete. 2024-08-18T21:08:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 10 monclient: build_initial_monmap 2024-08-18T21:08:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 10 monclient: monmap: 2024-08-18T21:08:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:42.680 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 1 Processor -- start 2024-08-18T21:08:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 1 -- start start 2024-08-18T21:08:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 10 monclient: init 2024-08-18T21:08:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 10 monclient: _add_conns ranks=[4,7,6,3,2,8,5,0,1] 2024-08-18T21:08:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92e40a4000 0x7f92e40733a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 10 monclient(hunting): picked mon.noname-c con 0x7f92e40a4000 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f92e40a4af0 0x7f92e40738e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 10 monclient(hunting): picked mon.noname-i con 0x7f92e40a4af0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e413d0e0 0x7f92e4073e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 10 monclient(hunting): picked mon.noname-d con 0x7f92e413d0e0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f92e40a0980 con 0x7f92e40a4000 2024-08-18T21:08:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f92e40a0800 con 0x7f92e413d0e0 2024-08-18T21:08:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f92e4142230 con 0x7f92e40a4af0 2024-08-18T21:08:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92ebe67640 10 monclient(hunting): authenticate will time out at 1289.687859s 2024-08-18T21:08:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e9c03640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92e40a4000 0x7f92e40733a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e9c03640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92e40a4000 0x7f92e40733a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:55058/0 (socket says 172.21.15.5:55058) 2024-08-18T21:08:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e9c03640 1 -- 172.21.15.5:0/1732783491 learned_addr learned my addr 172.21.15.5:0/1732783491 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e9c03640 10 monclient(hunting): get_auth_request con 0x7f92e40a4000 auth_method 0 2024-08-18T21:08:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e9c03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e9c03640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.670+0000 7f92e9c03640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ea404640 1 --2- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e413d0e0 0x7f92e4073e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9c03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9c03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9c03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ea404640 10 monclient(hunting): get_auth_request con 0x7f92e413d0e0 auth_method 0 2024-08-18T21:08:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ea404640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ea404640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ea404640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ea404640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ea404640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ea404640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9402640 1 --2- 172.21.15.5:0/1732783491 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f92e40a4af0 0x7f92e40738e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9402640 10 monclient(hunting): get_auth_request con 0x7f92e40a4af0 auth_method 0 2024-08-18T21:08:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9402640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9402640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9402640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9c03640 10 monclient(hunting): handle_auth_done global_id 5818 payload 824 2024-08-18T21:08:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9c03640 1 -- 172.21.15.5:0/1732783491 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f92e40a4af0 msgr2=0x7f92e40738e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9c03640 1 --2- 172.21.15.5:0/1732783491 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f92e40a4af0 0x7f92e40738e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9c03640 1 -- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e413d0e0 msgr2=0x7f92e4073e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9c03640 1 --2- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e413d0e0 0x7f92e4073e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9c03640 10 monclient: _finish_hunting 0 2024-08-18T21:08:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9c03640 1 monclient: found mon.noname-c 2024-08-18T21:08:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9c03640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9c03640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:08:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9c03640 1 -- 172.21.15.5:0/1732783491 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e413cc70 con 0x7f92e40a4000 2024-08-18T21:08:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9c03640 1 -- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92e40a4000 msgr2=0x7f92e40733a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9c03640 1 --2- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92e40a4000 0x7f92e40733a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92d400c470 tx=0x7f92d400c930 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92da7fc640 1 -- 172.21.15.5:0/1732783491 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f92d4005d00 con 0x7f92e40a4000 2024-08-18T21:08:42.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92da7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92da7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:08:42.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92da7fc640 10 monclient: dump: 2024-08-18T21:08:42.689 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.689 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.689 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.689 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.689 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.689 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.689 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.689 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.690 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92da7fc640 10 monclient: _finish_auth 0 2024-08-18T21:08:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92da7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:08:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92da7fc640 1 -- 172.21.15.5:0/1732783491 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d40074e0 con 0x7f92e40a4000 2024-08-18T21:08:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92da7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92da7fc640 1 -- 172.21.15.5:0/1732783491 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f92d40076d0 con 0x7f92e40a4000 2024-08-18T21:08:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ebe67640 5 monclient: authenticate success, global_id 5818 2024-08-18T21:08:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ebe67640 10 monclient: _renew_subs 2024-08-18T21:08:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ebe67640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:08:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ebe67640 1 -- 172.21.15.5:0/1732783491 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e40a3d70 con 0x7f92e40a4000 2024-08-18T21:08:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92da7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92db7fe640 4 set_mon_vals no callback set 2024-08-18T21:08:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92da7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:08:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92da7fc640 10 monclient: dump: 2024-08-18T21:08:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.692 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ebe67640 10 monclient: _renew_subs 2024-08-18T21:08:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ebe67640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:08:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ebe67640 1 -- 172.21.15.5:0/1732783491 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e412edf0 con 0x7f92e40a4000 2024-08-18T21:08:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ebe67640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ebe67640 1 --2- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e41cf5c0 0x7f92e41cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ebe67640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92ebe67640 1 -- 172.21.15.5:0/1732783491 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f92e4051140 con 0x7f92e41cf5c0 2024-08-18T21:08:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9402640 1 --2- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e41cf5c0 0x7f92e41cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9402640 10 monclient: get_auth_request con 0x7f92e41cf5c0 auth_method 0 2024-08-18T21:08:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9402640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9402640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9402640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9402640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9402640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.674+0000 7f92e9402640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92da7fc640 1 -- 172.21.15.5:0/1732783491 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f92d4007070 con 0x7f92e40a4000 2024-08-18T21:08:42.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92e9402640 10 monclient(hunting): handle_auth_done global_id 84300 payload 824 2024-08-18T21:08:42.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92e9402640 1 -- 172.21.15.5:0/1732783491 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92e40a73e0 con 0x7f92e41cf5c0 2024-08-18T21:08:42.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92da7fc640 1 --2- 172.21.15.5:0/1732783491 >> v2:172.21.15.157:6812/631023601 conn(0x7f92c803bdc0 0x7f92c803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92da7fc640 1 -- 172.21.15.5:0/1732783491 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(145..145 src has 22..145) ==== 3506+0+0 (secure 0 0 0) 0x7f92d404e220 con 0x7f92e40a4000 2024-08-18T21:08:42.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92ea404640 1 --2- 172.21.15.5:0/1732783491 >> v2:172.21.15.157:6812/631023601 conn(0x7f92c803bdc0 0x7f92c803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92ea404640 10 monclient: get_auth_request con 0x7f92c803bdc0 auth_method 0 2024-08-18T21:08:42.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92e9402640 1 -- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e41cf5c0 msgr2=0x7f92e41cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92e9402640 1 --2- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e41cf5c0 0x7f92e41cf9a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f92e00ab000 tx=0x7f92e0019140 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92da7fc640 1 -- 172.21.15.5:0/1732783491 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f92e00b0040 con 0x7f92e41cf5c0 2024-08-18T21:08:42.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92da7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92da7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:08:42.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92da7fc640 10 monclient: dump: 2024-08-18T21:08:42.694 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.695 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.695 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.695 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.695 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.695 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.695 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.695 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.695 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.695 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.695 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.695 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.695 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.695 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.696 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.696 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92da7fc640 1 -- 172.21.15.5:0/1732783491 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f92e00039d0 con 0x7f92e41cf5c0 2024-08-18T21:08:42.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92da7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:42.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92da7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:42.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92da7fc640 1 -- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e41cf5c0 msgr2=0x7f92e41cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92da7fc640 1 --2- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e41cf5c0 0x7f92e41cf9a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f92e00ab000 tx=0x7f92e0019140 comp rx=0 tx=0).stop 2024-08-18T21:08:42.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92da7fc640 1 -- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e41cf5c0 msgr2=0x7f92e41cf9a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:42.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92da7fc640 1 --2- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e41cf5c0 0x7f92e41cf9a0 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f92e00ab000 tx=0x7f92e0019140 comp rx=0 tx=0).stop 2024-08-18T21:08:42.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.678+0000 7f92ea404640 1 --2- 172.21.15.5:0/1732783491 >> v2:172.21.15.157:6812/631023601 conn(0x7f92c803bdc0 0x7f92c803e280 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f92e41385c0 tx=0x7f92dc009780 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.686+0000 7f92ebe67640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:42.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.686+0000 7f92ebe67640 1 --2- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e41cfee0 0x7f92e413b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.686+0000 7f92ebe67640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.686+0000 7f92ebe67640 1 -- 172.21.15.5:0/1732783491 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f92e40a43e0 con 0x7f92e41cfee0 2024-08-18T21:08:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.686+0000 7f92e9402640 1 --2- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e41cfee0 0x7f92e413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.686+0000 7f92e9402640 10 monclient: get_auth_request con 0x7f92e41cfee0 auth_method 0 2024-08-18T21:08:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.686+0000 7f92e9402640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.686+0000 7f92e9402640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.686+0000 7f92e9402640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.686+0000 7f92e9402640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.686+0000 7f92e9402640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.686+0000 7f92e9402640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.686+0000 7f92e9402640 10 monclient(hunting): handle_auth_done global_id 84309 payload 824 2024-08-18T21:08:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.686+0000 7f92e9402640 1 -- 172.21.15.5:0/1732783491 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f92e406d960 con 0x7f92e41cfee0 2024-08-18T21:08:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92e9402640 1 -- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e41cfee0 msgr2=0x7f92e413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92e9402640 1 --2- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e41cfee0 0x7f92e413b990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f92e00097c0 tx=0x7f92e00a8000 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92da7fc640 1 -- 172.21.15.5:0/1732783491 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f92e00b0070 con 0x7f92e41cfee0 2024-08-18T21:08:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92da7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92da7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:08:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92da7fc640 10 monclient: dump: 2024-08-18T21:08:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.701 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92da7fc640 1 -- 172.21.15.5:0/1732783491 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f92e00b6480 con 0x7f92e41cfee0 2024-08-18T21:08:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92da7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92da7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92da7fc640 1 -- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e41cfee0 msgr2=0x7f92e413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92da7fc640 1 --2- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e41cfee0 0x7f92e413b990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f92e00097c0 tx=0x7f92e00a8000 comp rx=0 tx=0).stop 2024-08-18T21:08:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92da7fc640 1 -- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e41cfee0 msgr2=0x7f92e413b990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92da7fc640 1 --2- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f92e41cfee0 0x7f92e413b990 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f92e00097c0 tx=0x7f92e00a8000 comp rx=0 tx=0).stop 2024-08-18T21:08:42.702 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:42.702 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:42.702 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:42.702 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:42.702 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:42.702 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 19519, 2024-08-18T21:08:42.702 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:42.702 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:42.702 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:42.702 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:42.703 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:42.703 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:42.703 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:42.703 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:42.703 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:42.703 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:42.703 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.703 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:08:42.703 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:42.703 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:42.703 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:42.703 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:42.703 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:42.703 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:42.704 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:42.704 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:42.704 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:42.704 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:42.704 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:42.704 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:42.704 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:42.704 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:42.704 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.704 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:42.704 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:42.704 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:42.704 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:42.705 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:42.705 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:42.705 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:42.705 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:42.705 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:42.705 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:42.705 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:42.705 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:42.705 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:42.705 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.705 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:42.705 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:42.705 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:42.706 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:42.706 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:42.706 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:42.706 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:42.706 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:42.706 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:42.706 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:42.706 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:42.706 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:42.706 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:42.706 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:42.706 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:42.707 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:42.707 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:42.707 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:42.707 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:42.707 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:42.707 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:42.707 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:42.707 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:42.707 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:42.707 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:42.707 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:42.707 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:42.707 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:42.708 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.708 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:42.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.708 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:42.708 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.708 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:42.708 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:42.708 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.708 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.708 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.708 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.708 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:42.708 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.709 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.709 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:42.709 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.709 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.709 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.709 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:42.709 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:42.709 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.709 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.709 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.710 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:42.710 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:42.710 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.710 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.710 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.710 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:42.710 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.710 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.711 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:42.711 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.711 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.711 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.711 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:42.711 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:42.711 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.711 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.711 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.711 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:42.711 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:42.712 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.712 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.712 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.712 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:42.712 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.712 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.712 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:42.712 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.712 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.712 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.713 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:42.713 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:42.713 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.713 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.713 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.713 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:42.713 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:42.713 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.713 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.714 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.714 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:42.714 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.714 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.714 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.714 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:42.714 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.714 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.714 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.714 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:42.714 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:42.714 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.715 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.715 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.715 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:42.715 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:42.715 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.715 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.715 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.715 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:42.715 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.716 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.716 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:42.716 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.716 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.716 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.716 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:42.716 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:42.716 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.716 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.716 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.717 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:42.717 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:42.717 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.717 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.717 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.717 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:42.717 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.717 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.718 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:42.718 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.718 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.718 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.718 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:42.718 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:42.718 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.718 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.718 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.718 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:42.719 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:42.719 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.719 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.719 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:42.719 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.719 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:42.719 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.719 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.720 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.720 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:42.720 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:42.720 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.720 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.720 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.720 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:42.720 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:42.720 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:42.725 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92ebe67640 1 -- 172.21.15.5:0/1732783491 >> v2:172.21.15.157:6812/631023601 conn(0x7f92c803bdc0 msgr2=0x7f92c803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92ebe67640 1 --2- 172.21.15.5:0/1732783491 >> v2:172.21.15.157:6812/631023601 conn(0x7f92c803bdc0 0x7f92c803e280 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f92e41385c0 tx=0x7f92dc009780 comp rx=0 tx=0).stop 2024-08-18T21:08:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92ebe67640 10 monclient: shutdown 2024-08-18T21:08:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92ebe67640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92ebe67640 1 -- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92e40a4000 msgr2=0x7f92e40733a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92ebe67640 1 --2- 172.21.15.5:0/1732783491 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92e40a4000 0x7f92e40733a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92d400c470 tx=0x7f92d400c930 comp rx=0 tx=0).stop 2024-08-18T21:08:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92ea404640 1 -- 172.21.15.5:0/1732783491 reap_dead start 2024-08-18T21:08:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92ea404640 1 -- 172.21.15.5:0/1732783491 reap_dead start 2024-08-18T21:08:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92ebe67640 1 -- 172.21.15.5:0/1732783491 shutdown_connections 2024-08-18T21:08:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92ebe67640 1 -- 172.21.15.5:0/1732783491 >> 172.21.15.5:0/1732783491 conn(0x7f92e40a50f0 msgr2=0x7f92e413da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92ebe67640 1 -- 172.21.15.5:0/1732783491 shutdown_connections 2024-08-18T21:08:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.690+0000 7f92ebe67640 1 -- 172.21.15.5:0/1732783491 wait complete. 2024-08-18T21:08:42.728 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:42.728 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:08:42.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:08:42.833 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29790]: starting. 2024-08-18T21:08:42.833 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29790]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29788 2024-08-18T21:08:42.833 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29790]: shutting down. 2024-08-18T21:08:42.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 10 monclient: get_monmap_and_config 2024-08-18T21:08:42.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 10 monclient: build_initial_monmap 2024-08-18T21:08:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 10 monclient: monmap: 2024-08-18T21:08:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:42.849505+0000 2024-08-18T21:08:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:42.849505+0000 2024-08-18T21:08:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:42.850 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 1 Processor -- start 2024-08-18T21:08:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 1 -- start start 2024-08-18T21:08:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 10 monclient: init 2024-08-18T21:08:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 10 monclient: _add_conns ranks=[0,4,5,3,2,9,6,10,7,1,8] 2024-08-18T21:08:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9b0c0a5c60 addr v1:172.21.15.5:6789/0 2024-08-18T21:08:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9b0c0748e0 0x7f9b0c13cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 10 monclient(hunting): picked mon.noname-c con 0x7f9b0c0748e0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9b0c0a6750 0x7f9b0c13f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 10 monclient(hunting): picked mon.noname-h con 0x7f9b0c0a6750 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b0a59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9b0c0a5c60 0x7f9b0c0a6040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47052/0 (socket says 172.21.15.5:47052) 2024-08-18T21:08:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b0a59c640 1 -- 172.21.15.5:0/256450793 learned_addr learned my addr 172.21.15.5:0/256450793 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:08:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 1 --2- 172.21.15.5:0/256450793 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9b0c0748e0 0x7f9b0c13cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b0ad9d640 1 --2- 172.21.15.5:0/256450793 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9b0c0a6750 0x7f9b0c13f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 1 -- 172.21.15.5:0/256450793 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b0c0a2020 con 0x7f9b0c0a5c60 2024-08-18T21:08:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 1 -- 172.21.15.5:0/256450793 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f9b0c0a3c70 con 0x7f9b0c0748e0 2024-08-18T21:08:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 1 -- 172.21.15.5:0/256450793 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f9b0c0a22a0 con 0x7f9b0c0a6750 2024-08-18T21:08:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b1096a640 10 monclient(hunting): authenticate will time out at 1289.863401s 2024-08-18T21:08:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 10 monclient(hunting): get_auth_request con 0x7f9b0c0748e0 auth_method 0 2024-08-18T21:08:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b0ad9d640 10 monclient(hunting): get_auth_request con 0x7f9b0c0a6750 auth_method 0 2024-08-18T21:08:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b0ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b0ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b0ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b0ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b0ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b0ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_done global_id 5827 payload 274 2024-08-18T21:08:42.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 1 -- 172.21.15.5:0/256450793 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9b0c0a6750 msgr2=0x7f9b0c13f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:42.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 1 --2- 172.21.15.5:0/256450793 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9b0c0a6750 0x7f9b0c13f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 1 -- 172.21.15.5:0/256450793 >> v1:172.21.15.5:6789/0 conn(0x7f9b0c0a5c60 legacy=0x7f9b0c0a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:42.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:08:42.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 1 monclient: found mon.noname-c 2024-08-18T21:08:42.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:42.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:08:42.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.846+0000 7f9b09d9b640 1 -- 172.21.15.5:0/256450793 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c0a3340 con 0x7f9b0c0748e0 2024-08-18T21:08:42.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b09d9b640 1 -- 172.21.15.5:0/256450793 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9b0c0748e0 msgr2=0x7f9b0c13cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b09d9b640 1 --2- 172.21.15.5:0/256450793 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9b0c0748e0 0x7f9b0c13cc50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9b000097f0 tx=0x7f9b0001c3a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=10977f71d2027fa0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0959a640 1 -- 172.21.15.5:0/256450793 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9b000b0070 con 0x7f9b0c0748e0 2024-08-18T21:08:42.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0959a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:08:42.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0959a640 10 monclient: dump: 2024-08-18T21:08:42.860 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.860 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.860 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.861 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0959a640 10 monclient: _finish_auth 0 2024-08-18T21:08:42.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0959a640 10 monclient: _check_auth_tickets 2024-08-18T21:08:42.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:42.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 5 monclient: authenticate success, global_id 5827 2024-08-18T21:08:42.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:08:42.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0959a640 1 -- 172.21.15.5:0/256450793 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b000aa810 con 0x7f9b0c0748e0 2024-08-18T21:08:42.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0959a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:42.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:42.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 4 set_mon_vals no callback set 2024-08-18T21:08:42.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0959a640 1 -- 172.21.15.5:0/256450793 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9b000a4e60 con 0x7f9b0c0748e0 2024-08-18T21:08:42.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0959a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:08:42.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0959a640 10 monclient: dump: 2024-08-18T21:08:42.863 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.863 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.863 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.863 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.863 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.863 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.863 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.863 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.863 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.863 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.863 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.863 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.863 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.864 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.864 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.864 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 10 monclient: shutdown 2024-08-18T21:08:42.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:42.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 1 -- 172.21.15.5:0/256450793 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9b0c0748e0 msgr2=0x7f9b0c13cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 1 --2- 172.21.15.5:0/256450793 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9b0c0748e0 0x7f9b0c13cc50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9b000097f0 tx=0x7f9b0001c3a0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 1 -- 172.21.15.5:0/256450793 shutdown_connections 2024-08-18T21:08:42.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 1 --2- 172.21.15.5:0/256450793 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9b0c0a6750 0x7f9b0c13f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 1 --2- 172.21.15.5:0/256450793 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9b0c0748e0 0x7f9b0c13cc50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 1 -- 172.21.15.5:0/256450793 >> 172.21.15.5:0/256450793 conn(0x7f9b0c0aaa00 msgr2=0x7f9b0c0a6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:42.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 1 -- 172.21.15.5:0/256450793 shutdown_connections 2024-08-18T21:08:42.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 1 -- 172.21.15.5:0/256450793 wait complete. 2024-08-18T21:08:42.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 10 monclient: build_initial_monmap 2024-08-18T21:08:42.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 10 monclient: monmap: 2024-08-18T21:08:42.865 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:42.865 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:42.865 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:42.865 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:42.865 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:42.865 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.865 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:42.865 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:42.865 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:42.865 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:42.865 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:42.865 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:42.865 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:42.866 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:42.866 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:42.866 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 1 Processor -- start 2024-08-18T21:08:42.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 1 -- start start 2024-08-18T21:08:42.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 10 monclient: init 2024-08-18T21:08:42.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:42.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 10 monclient: _add_conns ranks=[8,0,4,7,1,3,5,6,2] 2024-08-18T21:08:42.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c0748e0 0x7f9b0c13dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 10 monclient(hunting): picked mon.noname-e con 0x7f9b0c0748e0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:08:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b0c0a5c60 0x7f9b0c13e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 10 monclient(hunting): picked mon.noname-a con 0x7f9b0c0a5c60 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:08:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9b0c0a6750 0x7f9b0c06c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 10 monclient(hunting): picked mon.noname-c con 0x7f9b0c0a6750 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c142290 con 0x7f9b0c0a5c60 2024-08-18T21:08:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f9b0c142110 con 0x7f9b0c0a6750 2024-08-18T21:08:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f9b0c142410 con 0x7f9b0c0748e0 2024-08-18T21:08:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b1096a640 10 monclient(hunting): authenticate will time out at 1289.870768s 2024-08-18T21:08:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c0748e0 0x7f9b0c13dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c0748e0 0x7f9b0c13dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:45340/0 (socket says 172.21.15.5:45340) 2024-08-18T21:08:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 1 -- 172.21.15.5:0/3255335140 learned_addr learned my addr 172.21.15.5:0/3255335140 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 10 monclient(hunting): get_auth_request con 0x7f9b0c0748e0 auth_method 0 2024-08-18T21:08:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0ad9d640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9b0c0a6750 0x7f9b0c06c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0ad9d640 10 monclient(hunting): get_auth_request con 0x7f9b0c0a6750 auth_method 0 2024-08-18T21:08:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b09d9b640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b0c0a5c60 0x7f9b0c13e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b09d9b640 10 monclient(hunting): get_auth_request con 0x7f9b0c0a5c60 auth_method 0 2024-08-18T21:08:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b09d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b09d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b09d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 10 monclient(hunting): handle_auth_done global_id 54845 payload 824 2024-08-18T21:08:42.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 1 -- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9b0c0a6750 msgr2=0x7f9b0c06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9b0c0a6750 0x7f9b0c06c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 1 -- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b0c0a5c60 msgr2=0x7f9b0c13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:42.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b0c0a5c60 0x7f9b0c13e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:42.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 10 monclient: _finish_hunting 0 2024-08-18T21:08:42.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 1 monclient: found mon.noname-e 2024-08-18T21:08:42.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:42.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:08:42.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b0a59c640 1 -- 172.21.15.5:0/3255335140 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c073d50 con 0x7f9b0c0748e0 2024-08-18T21:08:42.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.854+0000 7f9b09d9b640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b0c0a5c60 0x7f9b0c13e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:08:42.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b0a59c640 1 -- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c0748e0 msgr2=0x7f9b0c13dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:42.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b0a59c640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c0748e0 0x7f9b0c13dca0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00c470 tx=0x7f9afc00c930 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:42.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9afaffd640 1 -- 172.21.15.5:0/3255335140 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9afc005d00 con 0x7f9b0c0748e0 2024-08-18T21:08:42.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9afaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9afaffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:08:42.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9afaffd640 10 monclient: dump: 2024-08-18T21:08:42.873 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.874 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.874 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.874 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.874 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.874 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.874 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.874 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.874 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.874 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.874 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.874 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.875 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.875 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.875 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.875 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9afaffd640 10 monclient: _finish_auth 0 2024-08-18T21:08:42.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9afaffd640 10 monclient: _check_auth_tickets 2024-08-18T21:08:42.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9afaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:42.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9afaffd640 1 -- 172.21.15.5:0/3255335140 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc0074e0 con 0x7f9b0c0748e0 2024-08-18T21:08:42.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9afaffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:42.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9afaffd640 1 -- 172.21.15.5:0/3255335140 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9afc0076d0 con 0x7f9b0c0748e0 2024-08-18T21:08:42.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9afaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:42.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9afaffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:42.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9afaffd640 10 monclient: dump: 2024-08-18T21:08:42.876 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:42.876 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:42.876 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.876 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:42.876 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:42.876 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:42.876 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:42.876 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:42.876 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:42.876 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:42.876 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:42.876 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:42.876 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:42.876 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:42.877 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:42.877 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:42.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b08d99640 4 set_mon_vals no callback set 2024-08-18T21:08:42.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b1096a640 5 monclient: authenticate success, global_id 54845 2024-08-18T21:08:42.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b1096a640 10 monclient: _renew_subs 2024-08-18T21:08:42.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b1096a640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:08:42.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b1096a640 1 -- 172.21.15.5:0/3255335140 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b0c06e3f0 con 0x7f9b0c0748e0 2024-08-18T21:08:42.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b1096a640 10 monclient: _renew_subs 2024-08-18T21:08:42.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b1096a640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:08:42.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b1096a640 1 -- 172.21.15.5:0/3255335140 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b0c128e70 con 0x7f9b0c0748e0 2024-08-18T21:08:42.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b1096a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:42.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b1096a640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06ce90 0x7f9b0c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b1096a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:42.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b1096a640 1 -- 172.21.15.5:0/3255335140 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f9b0c051140 con 0x7f9b0c06ce90 2024-08-18T21:08:42.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b09d9b640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06ce90 0x7f9b0c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b09d9b640 10 monclient: get_auth_request con 0x7f9b0c06ce90 auth_method 0 2024-08-18T21:08:42.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b09d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:42.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b09d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:42.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b09d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:42.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9afaffd640 1 -- 172.21.15.5:0/3255335140 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f9afc007070 con 0x7f9b0c0748e0 2024-08-18T21:08:42.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:42.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:42.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:42.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b09d9b640 1 -- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06ce90 msgr2=0x7f9b0c06d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-18T21:08:42.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b09d9b640 1 -- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06ce90 msgr2=0x7f9b0c06d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:08:42.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b09d9b640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06ce90 0x7f9b0c06d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:08:42.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9b09d9b640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06ce90 0x7f9b0c06d270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:08:42.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9afaffd640 1 --2- 172.21.15.5:0/3255335140 >> v2:172.21.15.157:6812/631023601 conn(0x7f9aec03bdc0 0x7f9aec03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:42.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.858+0000 7f9afaffd640 1 -- 172.21.15.5:0/3255335140 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(145..145 src has 22..145) ==== 3506+0+0 (secure 0 0 0) 0x7f9afc04e220 con 0x7f9b0c0748e0 2024-08-18T21:08:42.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.862+0000 7f9b0ad9d640 1 --2- 172.21.15.5:0/3255335140 >> v2:172.21.15.157:6812/631023601 conn(0x7f9aec03bdc0 0x7f9aec03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:42.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.862+0000 7f9b0ad9d640 10 monclient: get_auth_request con 0x7f9aec03bdc0 auth_method 0 2024-08-18T21:08:42.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:42.866+0000 7f9b0ad9d640 1 --2- 172.21.15.5:0/3255335140 >> v2:172.21.15.157:6812/631023601 conn(0x7f9aec03bdc0 0x7f9aec03e280 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9b04011340 tx=0x7f9b0400b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.062+0000 7f9b09d9b640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06ce90 0x7f9b0c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.062+0000 7f9b09d9b640 10 monclient: get_auth_request con 0x7f9b0c06ce90 auth_method 0 2024-08-18T21:08:43.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.062+0000 7f9b09d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.062+0000 7f9b09d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.062+0000 7f9b09d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:08:43.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.062+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.062+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.062+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.062+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_done global_id 54863 payload 824 2024-08-18T21:08:43.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.062+0000 7f9b09d9b640 1 -- 172.21.15.5:0/3255335140 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b0c13f170 con 0x7f9b0c06ce90 2024-08-18T21:08:43.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.066+0000 7f9b09d9b640 1 -- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06ce90 msgr2=0x7f9b0c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.066+0000 7f9b09d9b640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06ce90 0x7f9b0c06d270 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0a3060 tx=0x7f9b00019140 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.066+0000 7f9afaffd640 1 -- 172.21.15.5:0/3255335140 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9b000b0040 con 0x7f9b0c06ce90 2024-08-18T21:08:43.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.066+0000 7f9afaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.066+0000 7f9afaffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:43.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.066+0000 7f9afaffd640 10 monclient: dump: 2024-08-18T21:08:43.070 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.070 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.070 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.070 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.070 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.070 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.070 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.070 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.070 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.070 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.070 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.071 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.066+0000 7f9afaffd640 1 -- 172.21.15.5:0/3255335140 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9b000ba070 con 0x7f9b0c06ce90 2024-08-18T21:08:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.066+0000 7f9afaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.066+0000 7f9afaffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.066+0000 7f9afaffd640 1 -- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06ce90 msgr2=0x7f9b0c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.066+0000 7f9afaffd640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06ce90 0x7f9b0c06d270 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0a3060 tx=0x7f9b00019140 comp rx=0 tx=0).stop 2024-08-18T21:08:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.066+0000 7f9afaffd640 1 -- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06ce90 msgr2=0x7f9b0c06d270 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.066+0000 7f9afaffd640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06ce90 0x7f9b0c06d270 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0a3060 tx=0x7f9b00019140 comp rx=0 tx=0).stop 2024-08-18T21:08:43.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.074+0000 7f9b1096a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:43.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.074+0000 7f9b1096a640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06d7b0 0x7f9b0c1208a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.074+0000 7f9b1096a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.074+0000 7f9b1096a640 1 -- 172.21.15.5:0/3255335140 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f9b0c13ecc0 con 0x7f9b0c06d7b0 2024-08-18T21:08:43.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.074+0000 7f9b09d9b640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06d7b0 0x7f9b0c1208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.074+0000 7f9b09d9b640 10 monclient: get_auth_request con 0x7f9b0c06d7b0 auth_method 0 2024-08-18T21:08:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.074+0000 7f9b09d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.074+0000 7f9b09d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.074+0000 7f9b09d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.074+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.074+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.074+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.074+0000 7f9b09d9b640 10 monclient(hunting): handle_auth_done global_id 54872 payload 824 2024-08-18T21:08:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.074+0000 7f9b09d9b640 1 -- 172.21.15.5:0/3255335140 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9b0c0a6040 con 0x7f9b0c06d7b0 2024-08-18T21:08:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9b09d9b640 1 -- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06d7b0 msgr2=0x7f9b0c1208a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9b09d9b640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06d7b0 0x7f9b0c1208a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009710 tx=0x7f9b00009190 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9afaffd640 1 -- 172.21.15.5:0/3255335140 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9b000b0040 con 0x7f9b0c06d7b0 2024-08-18T21:08:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9afaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9afaffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9afaffd640 10 monclient: dump: 2024-08-18T21:08:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.082 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.082 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.082 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.082 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.082 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.082 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9afaffd640 1 -- 172.21.15.5:0/3255335140 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f9b00003a40 con 0x7f9b0c06d7b0 2024-08-18T21:08:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9afaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9afaffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9afaffd640 1 -- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06d7b0 msgr2=0x7f9b0c1208a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9afaffd640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06d7b0 0x7f9b0c1208a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009710 tx=0x7f9b00009190 comp rx=0 tx=0).stop 2024-08-18T21:08:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9afaffd640 1 -- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06d7b0 msgr2=0x7f9b0c1208a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9afaffd640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c06d7b0 0x7f9b0c1208a0 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009710 tx=0x7f9b00009190 comp rx=0 tx=0).stop 2024-08-18T21:08:43.083 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 179199, 2024-08-18T21:08:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:08:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:08:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:08:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:43.107 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:43.107 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:08:43.107 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.107 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.107 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:43.107 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:43.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9b1096a640 1 -- 172.21.15.5:0/3255335140 >> v2:172.21.15.157:6812/631023601 conn(0x7f9aec03bdc0 msgr2=0x7f9aec03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9b1096a640 1 --2- 172.21.15.5:0/3255335140 >> v2:172.21.15.157:6812/631023601 conn(0x7f9aec03bdc0 0x7f9aec03e280 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9b04011340 tx=0x7f9b0400b040 comp rx=0 tx=0).stop 2024-08-18T21:08:43.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9b1096a640 10 monclient: shutdown 2024-08-18T21:08:43.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9b1096a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:43.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9b1096a640 1 -- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c0748e0 msgr2=0x7f9b0c13dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9b1096a640 1 --2- 172.21.15.5:0/3255335140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b0c0748e0 0x7f9b0c13dca0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00c470 tx=0x7f9afc00c930 comp rx=0 tx=0).stop 2024-08-18T21:08:43.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9b0ad9d640 1 -- 172.21.15.5:0/3255335140 reap_dead start 2024-08-18T21:08:43.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9b0ad9d640 1 -- 172.21.15.5:0/3255335140 reap_dead start 2024-08-18T21:08:43.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9b1096a640 1 -- 172.21.15.5:0/3255335140 shutdown_connections 2024-08-18T21:08:43.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9b1096a640 1 -- 172.21.15.5:0/3255335140 >> 172.21.15.5:0/3255335140 conn(0x7f9b0c0aaa00 msgr2=0x7f9b0c0a8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:43.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9b1096a640 1 -- 172.21.15.5:0/3255335140 shutdown_connections 2024-08-18T21:08:43.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.078+0000 7f9b1096a640 1 -- 172.21.15.5:0/3255335140 wait complete. 2024-08-18T21:08:43.110 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:43.110 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:08:43.110 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:08:43.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.242+0000 7f5f84d71640 10 monclient: get_monmap_and_config 2024-08-18T21:08:43.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.242+0000 7f5f84d71640 10 monclient: build_initial_monmap 2024-08-18T21:08:43.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.242+0000 7f5f84d71640 10 monclient: monmap: 2024-08-18T21:08:43.246 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:43.246 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.247 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:43.246307+0000 2024-08-18T21:08:43.247 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:43.246307+0000 2024-08-18T21:08:43.247 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:43.247 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.247 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:43.247 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:43.247 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:43.248 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:43.248 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:43.248 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:43.248 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:43.248 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:43.248 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:43.249 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:43.249 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:43.249 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.242+0000 7f5f84d71640 1 Processor -- start 2024-08-18T21:08:43.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.242+0000 7f5f84d71640 1 -- start start 2024-08-18T21:08:43.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.242+0000 7f5f84d71640 10 monclient: init 2024-08-18T21:08:43.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f84d71640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:43.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f84d71640 10 monclient: _add_conns ranks=[2,9,5,3,1,8,0,4,10,7,6] 2024-08-18T21:08:43.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f84d71640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f80139d00 0x7f5f8013a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f84d71640 10 monclient(hunting): picked mon.noname-b con 0x7f5f80139d00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:08:43.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f84d71640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f800a4b40 0x7f5f8006c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f84d71640 10 monclient(hunting): picked mon.noname-a con 0x7f5f800a4b40 addr v2:172.21.15.5:3300/0 2024-08-18T21:08:43.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f84d71640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f800a4f80 0x7f5f8006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f84d71640 10 monclient(hunting): picked mon.noname-h con 0x7f5f800a4f80 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:43.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f84d71640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f84d71640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5f8009e7f0 con 0x7f5f800a4b40 2024-08-18T21:08:43.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f84d71640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f84d71640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f5f8009e230 con 0x7f5f80139d00 2024-08-18T21:08:43.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f84d71640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f84d71640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f5f8009e510 con 0x7f5f800a4f80 2024-08-18T21:08:43.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f84d71640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:43.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f84d71640 10 monclient(hunting): authenticate will time out at 1290.260177s 2024-08-18T21:08:43.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f80139d00 0x7f5f8013a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f77fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f800a4b40 0x7f5f8006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f80139d00 0x7f5f8013a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59920/0 (socket says 172.21.15.5:59920) 2024-08-18T21:08:43.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 1 -- 172.21.15.5:0/2961423862 learned_addr learned my addr 172.21.15.5:0/2961423862 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:43.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 10 monclient(hunting): get_auth_request con 0x7f5f80139d00 auth_method 0 2024-08-18T21:08:43.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f77fff640 10 monclient(hunting): get_auth_request con 0x7f5f800a4b40 auth_method 0 2024-08-18T21:08:43.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f77fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f77fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7ed9d640 1 --2- 172.21.15.5:0/2961423862 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f800a4f80 0x7f5f8006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7ed9d640 10 monclient(hunting): get_auth_request con 0x7f5f800a4f80 auth_method 0 2024-08-18T21:08:43.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 10 monclient(hunting): handle_auth_done global_id 84251 payload 274 2024-08-18T21:08:43.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 1 -- 172.21.15.5:0/2961423862 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f800a4f80 msgr2=0x7f5f8006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:43.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 1 --2- 172.21.15.5:0/2961423862 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f800a4f80 0x7f5f8006ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 1 -- 172.21.15.5:0/2961423862 >> v2:172.21.15.5:3300/0 conn(0x7f5f800a4b40 msgr2=0x7f5f8006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:43.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 1 --2- 172.21.15.5:0/2961423862 >> v2:172.21.15.5:3300/0 conn(0x7f5f800a4b40 0x7f5f8006c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 10 monclient: _finish_hunting 0 2024-08-18T21:08:43.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 1 monclient: found mon.noname-b 2024-08-18T21:08:43.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:43.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:08:43.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f7e59c640 1 -- 172.21.15.5:0/2961423862 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f8009f000 con 0x7f5f80139d00 2024-08-18T21:08:43.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.246+0000 7f5f77fff640 1 --2- 172.21.15.5:0/2961423862 >> v2:172.21.15.5:3300/0 conn(0x7f5f800a4b40 0x7f5f8006c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:08:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7e59c640 1 -- 172.21.15.5:0/2961423862 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f80139d00 msgr2=0x7f5f8013a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7e59c640 1 --2- 172.21.15.5:0/2961423862 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f80139d00 0x7f5f8013a0e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009870 tx=0x7f5f7001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c15f2b179892d222 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7dd9b640 1 -- 172.21.15.5:0/2961423862 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f700b0070 con 0x7f5f80139d00 2024-08-18T21:08:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7dd9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:08:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7dd9b640 10 monclient: dump: 2024-08-18T21:08:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.270 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7dd9b640 10 monclient: _finish_auth 0 2024-08-18T21:08:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7dd9b640 10 monclient: _check_auth_tickets 2024-08-18T21:08:43.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:43.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 5 monclient: authenticate success, global_id 84251 2024-08-18T21:08:43.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:08:43.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7dd9b640 1 -- 172.21.15.5:0/2961423862 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f700aa810 con 0x7f5f80139d00 2024-08-18T21:08:43.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7dd9b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:43.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:43.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7dd9b640 1 -- 172.21.15.5:0/2961423862 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f700aae30 con 0x7f5f80139d00 2024-08-18T21:08:43.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 4 set_mon_vals no callback set 2024-08-18T21:08:43.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7dd9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:08:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7dd9b640 10 monclient: dump: 2024-08-18T21:08:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.273 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.273 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.273 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.273 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.273 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.273 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.274 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.274 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.274 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.274 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.274 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.274 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 10 monclient: shutdown 2024-08-18T21:08:43.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:43.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 -- 172.21.15.5:0/2961423862 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f80139d00 msgr2=0x7f5f8013a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 --2- 172.21.15.5:0/2961423862 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f80139d00 0x7f5f8013a0e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009870 tx=0x7f5f7001c420 comp rx=0 tx=0).stop 2024-08-18T21:08:43.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 -- 172.21.15.5:0/2961423862 shutdown_connections 2024-08-18T21:08:43.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 --2- 172.21.15.5:0/2961423862 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f800a4f80 0x7f5f8006ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 --2- 172.21.15.5:0/2961423862 >> v2:172.21.15.5:3300/0 conn(0x7f5f800a4b40 0x7f5f8006c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 --2- 172.21.15.5:0/2961423862 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f80139d00 0x7f5f8013a0e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 -- 172.21.15.5:0/2961423862 >> 172.21.15.5:0/2961423862 conn(0x7f5f800688d0 msgr2=0x7f5f80068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 -- 172.21.15.5:0/2961423862 shutdown_connections 2024-08-18T21:08:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 -- 172.21.15.5:0/2961423862 wait complete. 2024-08-18T21:08:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 10 monclient: build_initial_monmap 2024-08-18T21:08:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 10 monclient: monmap: 2024-08-18T21:08:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:43.277 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:43.277 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:43.277 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:43.277 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:43.277 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:43.277 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:43.277 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 Processor -- start 2024-08-18T21:08:43.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 -- start start 2024-08-18T21:08:43.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 10 monclient: init 2024-08-18T21:08:43.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:43.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 10 monclient: _add_conns ranks=[5,1,2,3,0,4,6,8,7] 2024-08-18T21:08:43.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f800a4b40 0x7f5f80132840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 10 monclient(hunting): picked mon.noname-h con 0x7f5f800a4b40 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:43.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f800a4f80 0x7f5f80132d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 10 monclient(hunting): picked mon.noname-f con 0x7f5f800a4f80 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:08:43.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f80139d00 0x7f5f801332c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 10 monclient(hunting): picked mon.noname-b con 0x7f5f80139d00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:08:43.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5f80143580 con 0x7f5f800a4f80 2024-08-18T21:08:43.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f5f8006d7e0 con 0x7f5f80139d00 2024-08-18T21:08:43.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f5f80143700 con 0x7f5f800a4b40 2024-08-18T21:08:43.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:43.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f84d71640 10 monclient(hunting): authenticate will time out at 1290.267412s 2024-08-18T21:08:43.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f80139d00 0x7f5f801332c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f80139d00 0x7f5f801332c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59936/0 (socket says 172.21.15.5:59936) 2024-08-18T21:08:43.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 1 -- 172.21.15.5:0/2819397920 learned_addr learned my addr 172.21.15.5:0/2819397920 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:43.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 10 monclient(hunting): get_auth_request con 0x7f5f80139d00 auth_method 0 2024-08-18T21:08:43.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7e59c640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f800a4b40 0x7f5f80132840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f77fff640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f800a4f80 0x7f5f80132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7e59c640 10 monclient(hunting): get_auth_request con 0x7f5f800a4b40 auth_method 0 2024-08-18T21:08:43.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7e59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f77fff640 10 monclient(hunting): get_auth_request con 0x7f5f800a4f80 auth_method 0 2024-08-18T21:08:43.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f77fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f77fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 10 monclient(hunting): handle_auth_done global_id 84260 payload 824 2024-08-18T21:08:43.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 1 -- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f800a4b40 msgr2=0x7f5f80132840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f800a4b40 0x7f5f80132840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 1 -- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f800a4f80 msgr2=0x7f5f80132d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f800a4f80 0x7f5f80132d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 10 monclient: _finish_hunting 0 2024-08-18T21:08:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 1 monclient: found mon.noname-b 2024-08-18T21:08:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:08:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.250+0000 7f5f7ed9d640 1 -- 172.21.15.5:0/2819397920 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f8013f1d0 con 0x7f5f80139d00 2024-08-18T21:08:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f7ed9d640 1 -- 172.21.15.5:0/2819397920 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f80139d00 msgr2=0x7f5f801332c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f7ed9d640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f80139d00 0x7f5f801332c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f78007e30 tx=0x7f5f7800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f76ffd640 1 -- 172.21.15.5:0/2819397920 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f78013a00 con 0x7f5f80139d00 2024-08-18T21:08:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f76ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:08:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f76ffd640 10 monclient: dump: 2024-08-18T21:08:43.282 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.282 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.282 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.282 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.282 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.282 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.282 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.282 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.282 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.282 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.282 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.282 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.282 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.283 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f76ffd640 10 monclient: _finish_auth 0 2024-08-18T21:08:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f76ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:08:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f76ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f76ffd640 1 -- 172.21.15.5:0/2819397920 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f78019070 con 0x7f5f80139d00 2024-08-18T21:08:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f76ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f76ffd640 1 -- 172.21.15.5:0/2819397920 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f78013be0 con 0x7f5f80139d00 2024-08-18T21:08:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f76ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:08:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f76ffd640 10 monclient: dump: 2024-08-18T21:08:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.285 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f84d71640 5 monclient: authenticate success, global_id 84260 2024-08-18T21:08:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f84d71640 10 monclient: _renew_subs 2024-08-18T21:08:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f7cd99640 4 set_mon_vals no callback set 2024-08-18T21:08:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f84d71640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:08:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f84d71640 1 -- 172.21.15.5:0/2819397920 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f801406b0 con 0x7f5f80139d00 2024-08-18T21:08:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f84d71640 10 monclient: _renew_subs 2024-08-18T21:08:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f84d71640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:08:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f84d71640 1 -- 172.21.15.5:0/2819397920 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f8013ce70 con 0x7f5f80139d00 2024-08-18T21:08:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f84d71640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f84d71640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f8013f980 0x7f5f8013b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f84d71640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f84d71640 1 -- 172.21.15.5:0/2819397920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5f80051140 con 0x7f5f8013f980 2024-08-18T21:08:43.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f76ffd640 1 -- 172.21.15.5:0/2819397920 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f5f78013590 con 0x7f5f80139d00 2024-08-18T21:08:43.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f7e59c640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f8013f980 0x7f5f8013b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f76ffd640 1 --2- 172.21.15.5:0/2819397920 >> v2:172.21.15.157:6812/631023601 conn(0x7f5f6003bdc0 0x7f5f6003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f7e59c640 10 monclient: get_auth_request con 0x7f5f8013f980 auth_method 0 2024-08-18T21:08:43.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f7e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f7e59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f7e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f76ffd640 1 -- 172.21.15.5:0/2819397920 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(145..145 src has 22..145) ==== 3506+0+0 (secure 0 0 0) 0x7f5f7804ee40 con 0x7f5f80139d00 2024-08-18T21:08:43.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f7e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f7e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.254+0000 7f5f7e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.258+0000 7f5f77fff640 1 --2- 172.21.15.5:0/2819397920 >> v2:172.21.15.157:6812/631023601 conn(0x7f5f6003bdc0 0x7f5f6003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.258+0000 7f5f77fff640 10 monclient: get_auth_request con 0x7f5f6003bdc0 auth_method 0 2024-08-18T21:08:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.258+0000 7f5f7e59c640 10 monclient(hunting): handle_auth_done global_id 5761 payload 824 2024-08-18T21:08:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.258+0000 7f5f7e59c640 1 -- 172.21.15.5:0/2819397920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f80138910 con 0x7f5f8013f980 2024-08-18T21:08:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.258+0000 7f5f7e59c640 1 -- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f8013f980 msgr2=0x7f5f8013b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.258+0000 7f5f7e59c640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f8013f980 0x7f5f8013b380 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f8009ef70 tx=0x7f5f700191c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.258+0000 7f5f77fff640 1 --2- 172.21.15.5:0/2819397920 >> v2:172.21.15.157:6812/631023601 conn(0x7f5f6003bdc0 0x7f5f6003e280 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009580 tx=0x7f5f68008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.258+0000 7f5f76ffd640 1 -- 172.21.15.5:0/2819397920 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f700ba070 con 0x7f5f8013f980 2024-08-18T21:08:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.258+0000 7f5f76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.258+0000 7f5f76ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:08:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.258+0000 7f5f76ffd640 10 monclient: dump: 2024-08-18T21:08:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.292 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.262+0000 7f5f76ffd640 1 -- 172.21.15.5:0/2819397920 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5f70003a60 con 0x7f5f8013f980 2024-08-18T21:08:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.262+0000 7f5f76ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.262+0000 7f5f76ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.262+0000 7f5f76ffd640 1 -- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f8013f980 msgr2=0x7f5f8013b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.262+0000 7f5f76ffd640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f8013f980 0x7f5f8013b380 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f8009ef70 tx=0x7f5f700191c0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.262+0000 7f5f76ffd640 1 -- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f8013f980 msgr2=0x7f5f8013b380 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.262+0000 7f5f76ffd640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f8013f980 0x7f5f8013b380 secure :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f8009ef70 tx=0x7f5f700191c0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.266+0000 7f5f84d71640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.266+0000 7f5f84d71640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f8013b8c0 0x7f5f8013bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.266+0000 7f5f84d71640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.266+0000 7f5f84d71640 1 -- 172.21.15.5:0/2819397920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8006b7e0 con 0x7f5f8013b8c0 2024-08-18T21:08:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.266+0000 7f5f7e59c640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f8013b8c0 0x7f5f8013bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.266+0000 7f5f7e59c640 10 monclient: get_auth_request con 0x7f5f8013b8c0 auth_method 0 2024-08-18T21:08:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.266+0000 7f5f7e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.266+0000 7f5f7e59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.266+0000 7f5f7e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.266+0000 7f5f7e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.266+0000 7f5f7e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.266+0000 7f5f7e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.266+0000 7f5f7e59c640 10 monclient(hunting): handle_auth_done global_id 5770 payload 824 2024-08-18T21:08:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.266+0000 7f5f7e59c640 1 -- 172.21.15.5:0/2819397920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5f8013c210 con 0x7f5f8013b8c0 2024-08-18T21:08:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f7e59c640 1 -- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f8013b8c0 msgr2=0x7f5f8013bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f7e59c640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f8013b8c0 0x7f5f8013bcd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009870 tx=0x7f5f700a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f76ffd640 1 -- 172.21.15.5:0/2819397920 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f700b0040 con 0x7f5f8013b8c0 2024-08-18T21:08:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f76ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:08:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f76ffd640 10 monclient: dump: 2024-08-18T21:08:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.297 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.297 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.297 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.297 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.297 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.297 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f76ffd640 1 -- 172.21.15.5:0/2819397920 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7f5f700c1270 con 0x7f5f8013b8c0 2024-08-18T21:08:43.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f76ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:43.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f76ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:43.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f76ffd640 1 -- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f8013b8c0 msgr2=0x7f5f8013bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f76ffd640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f8013b8c0 0x7f5f8013bcd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009870 tx=0x7f5f700a8000 comp rx=0 tx=0).stop 2024-08-18T21:08:43.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f76ffd640 1 -- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f8013b8c0 msgr2=0x7f5f8013bcd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:43.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f76ffd640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f8013b8c0 0x7f5f8013bcd0 secure :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009870 tx=0x7f5f700a8000 comp rx=0 tx=0).stop 2024-08-18T21:08:43.298 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:43.298 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:43.298 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:43.298 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:43.298 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:43.298 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 332352, 2024-08-18T21:08:43.298 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:43.298 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:43.298 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:43.298 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:43.299 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:43.299 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:43.299 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:43.299 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:43.299 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:43.299 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:43.299 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.299 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:08:43.299 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:43.299 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:43.299 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:43.299 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:43.299 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:43.299 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:43.300 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:43.300 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:43.300 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:43.300 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:43.300 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:43.300 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:43.300 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:43.300 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:43.300 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.300 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:43.300 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:43.300 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:43.300 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:43.300 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:43.301 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:43.301 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:43.301 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:43.301 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:43.301 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:43.301 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:43.301 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:43.301 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:43.301 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.301 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:43.301 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:43.301 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:43.301 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:43.302 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:43.302 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:43.302 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:43.302 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:43.302 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:43.302 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:43.302 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:43.302 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:43.302 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:43.302 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:43.302 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:43.302 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:43.302 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:43.303 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:43.303 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:43.303 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:43.303 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:43.303 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:43.303 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:43.303 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:43.303 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:43.303 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:43.303 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:43.303 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:43.303 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.303 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:43.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.304 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:43.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.304 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:43.304 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:43.304 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:43.304 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:43.305 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.305 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.305 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:43.305 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:43.305 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.305 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.305 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.305 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:43.305 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:43.305 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:43.306 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:43.306 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.306 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.306 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:43.307 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:43.307 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.307 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.307 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.307 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:43.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:43.307 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:43.308 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.308 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:43.308 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.308 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.308 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:43.308 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:43.308 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.309 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.309 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.309 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:43.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:43.309 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:43.309 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:43.310 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.310 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.310 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:43.310 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:43.310 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.310 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.310 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.310 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:43.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:43.311 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:43.311 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:43.311 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.311 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.312 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:43.312 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:43.312 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.312 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.312 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.312 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:43.312 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:43.312 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:43.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:43.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.313 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:43.313 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:43.313 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.314 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.314 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.314 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:43.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:43.314 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.314 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:43.314 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:43.315 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.315 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.315 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:43.315 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:43.315 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.315 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.315 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.316 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:43.316 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:43.316 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:43.316 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:43.316 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.316 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.317 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.317 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:43.317 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:43.317 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.317 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.317 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.317 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:43.317 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:43.317 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.317 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.318 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:43.318 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.318 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:43.318 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.318 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.318 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.318 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:43.318 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:43.318 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.319 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.319 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.319 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.319 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.319 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:43.319 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:43.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.319 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:43.319 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:43.319 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:43.319 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.319 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.319 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:43.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.320 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:43.320 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:43.320 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:08:43.320 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.320 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.320 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:43.320 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:43.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f84d71640 1 -- 172.21.15.5:0/2819397920 >> v2:172.21.15.157:6812/631023601 conn(0x7f5f6003bdc0 msgr2=0x7f5f6003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f84d71640 1 --2- 172.21.15.5:0/2819397920 >> v2:172.21.15.157:6812/631023601 conn(0x7f5f6003bdc0 0x7f5f6003e280 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009580 tx=0x7f5f68008040 comp rx=0 tx=0).stop 2024-08-18T21:08:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f84d71640 10 monclient: shutdown 2024-08-18T21:08:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f84d71640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f84d71640 1 -- 172.21.15.5:0/2819397920 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f80139d00 msgr2=0x7f5f801332c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f84d71640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f80139d00 0x7f5f801332c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f78007e30 tx=0x7f5f7800e4b0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f7ed9d640 1 -- 172.21.15.5:0/2819397920 reap_dead start 2024-08-18T21:08:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f84d71640 1 -- 172.21.15.5:0/2819397920 shutdown_connections 2024-08-18T21:08:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f84d71640 1 --2- 172.21.15.5:0/2819397920 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f80139d00 0x7f5f801332c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f84d71640 1 -- 172.21.15.5:0/2819397920 >> 172.21.15.5:0/2819397920 conn(0x7f5f800688d0 msgr2=0x7f5f800a03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f84d71640 1 -- 172.21.15.5:0/2819397920 shutdown_connections 2024-08-18T21:08:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.270+0000 7f5f84d71640 1 -- 172.21.15.5:0/2819397920 wait complete. 2024-08-18T21:08:43.323 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:43.323 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:08:43.323 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:08:43.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 10 monclient: get_monmap_and_config 2024-08-18T21:08:43.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 10 monclient: build_initial_monmap 2024-08-18T21:08:43.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 10 monclient: monmap: 2024-08-18T21:08:43.441 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:43.441 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.441 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:43.441659+0000 2024-08-18T21:08:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:43.441659+0000 2024-08-18T21:08:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:43.443 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 1 Processor -- start 2024-08-18T21:08:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 1 -- start start 2024-08-18T21:08:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 10 monclient: init 2024-08-18T21:08:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 10 monclient: _add_conns ranks=[5,2,8,3,0,9,6,1,10,4,7] 2024-08-18T21:08:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff760137a70 0x7ff7600a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 10 monclient(hunting): picked mon.noname-h con 0x7ff760137a70 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff7600a4c10 0x7ff760137e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 10 monclient(hunting): picked mon.noname-b con 0x7ff7600a4c10 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:08:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff76006c950 0x7ff76006cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 10 monclient(hunting): picked mon.noname-e con 0x7ff76006c950 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:08:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7ff7600a03e0 con 0x7ff7600a4c10 2024-08-18T21:08:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7ff76009fe40 con 0x7ff760137a70 2024-08-18T21:08:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff7600a08e0 con 0x7ff76006c950 2024-08-18T21:08:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff767818640 10 monclient(hunting): authenticate will time out at 1290.455270s 2024-08-18T21:08:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff76006c950 0x7ff76006cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff76006c950 0x7ff76006cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:45366/0 (socket says 172.21.15.5:45366) 2024-08-18T21:08:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 1 -- 172.21.15.5:0/3397003678 learned_addr learned my addr 172.21.15.5:0/3397003678 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 10 monclient(hunting): get_auth_request con 0x7ff76006c950 auth_method 0 2024-08-18T21:08:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff764db3640 1 --2- 172.21.15.5:0/3397003678 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff7600a4c10 0x7ff760137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff764db3640 10 monclient(hunting): get_auth_request con 0x7ff7600a4c10 auth_method 0 2024-08-18T21:08:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff764db3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff764db3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff764db3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff7655b4640 1 --2- 172.21.15.5:0/3397003678 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff760137a70 0x7ff7600a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff7655b4640 10 monclient(hunting): get_auth_request con 0x7ff760137a70 auth_method 0 2024-08-18T21:08:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff7655b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff7655b4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff7655b4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff764db3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff764db3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff764db3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 10 monclient(hunting): handle_auth_done global_id 54881 payload 274 2024-08-18T21:08:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 1 -- 172.21.15.5:0/3397003678 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff760137a70 msgr2=0x7ff7600a1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 1 --2- 172.21.15.5:0/3397003678 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff760137a70 0x7ff7600a1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 1 -- 172.21.15.5:0/3397003678 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff7600a4c10 msgr2=0x7ff760137e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 1 --2- 172.21.15.5:0/3397003678 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff7600a4c10 0x7ff760137e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 10 monclient: _finish_hunting 0 2024-08-18T21:08:43.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 1 monclient: found mon.noname-e 2024-08-18T21:08:43.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:43.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:08:43.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff765db5640 1 -- 172.21.15.5:0/3397003678 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7600a0bc0 con 0x7ff76006c950 2024-08-18T21:08:43.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.438+0000 7ff7655b4640 1 --2- 172.21.15.5:0/3397003678 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff760137a70 0x7ff7600a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:08:43.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff765db5640 1 -- 172.21.15.5:0/3397003678 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff76006c950 msgr2=0x7ff76006cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff765db5640 1 --2- 172.21.15.5:0/3397003678 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff76006c950 0x7ff76006cd90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff7500098a0 tx=0x7ff75001c440 comp rx=0 tx=0).ready entity=mon.8 client_cookie=bf4109f810e9dcb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff75ffff640 1 -- 172.21.15.5:0/3397003678 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff7500b0070 con 0x7ff76006c950 2024-08-18T21:08:43.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff75ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff75ffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:08:43.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff75ffff640 10 monclient: dump: 2024-08-18T21:08:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.454 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff75ffff640 10 monclient: _finish_auth 0 2024-08-18T21:08:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff75ffff640 10 monclient: _check_auth_tickets 2024-08-18T21:08:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff75ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff75ffff640 1 -- 172.21.15.5:0/3397003678 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7500aa810 con 0x7ff76006c950 2024-08-18T21:08:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff75ffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 5 monclient: authenticate success, global_id 54881 2024-08-18T21:08:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff75ffff640 1 -- 172.21.15.5:0/3397003678 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff7500a9300 con 0x7ff76006c950 2024-08-18T21:08:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff75ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff75ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff75ffff640 10 monclient: dump: 2024-08-18T21:08:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.456 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 4 set_mon_vals no callback set 2024-08-18T21:08:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 10 monclient: shutdown 2024-08-18T21:08:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 -- 172.21.15.5:0/3397003678 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff76006c950 msgr2=0x7ff76006cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 --2- 172.21.15.5:0/3397003678 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff76006c950 0x7ff76006cd90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff7500098a0 tx=0x7ff75001c440 comp rx=0 tx=0).stop 2024-08-18T21:08:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 -- 172.21.15.5:0/3397003678 shutdown_connections 2024-08-18T21:08:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 --2- 172.21.15.5:0/3397003678 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff76006c950 0x7ff76006cd90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 --2- 172.21.15.5:0/3397003678 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff7600a4c10 0x7ff760137e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 --2- 172.21.15.5:0/3397003678 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff760137a70 0x7ff7600a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 -- 172.21.15.5:0/3397003678 >> 172.21.15.5:0/3397003678 conn(0x7ff7600688d0 msgr2=0x7ff760068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 -- 172.21.15.5:0/3397003678 shutdown_connections 2024-08-18T21:08:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 -- 172.21.15.5:0/3397003678 wait complete. 2024-08-18T21:08:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 10 monclient: build_initial_monmap 2024-08-18T21:08:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 10 monclient: monmap: 2024-08-18T21:08:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:43.458 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 Processor -- start 2024-08-18T21:08:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 -- start start 2024-08-18T21:08:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 10 monclient: init 2024-08-18T21:08:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 10 monclient: _add_conns ranks=[4,6,3,5,0,1,8,2,7] 2024-08-18T21:08:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff76006c950 0x7ff760139710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 10 monclient(hunting): picked mon.noname-c con 0x7ff76006c950 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff7600a4c10 0x7ff760139c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 10 monclient(hunting): picked mon.noname-d con 0x7ff7600a4c10 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff760137a70 0x7ff76013a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 10 monclient(hunting): picked mon.noname-g con 0x7ff760137a70 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff7601414b0 con 0x7ff760137a70 2024-08-18T21:08:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff760141330 con 0x7ff76006c950 2024-08-18T21:08:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7ff760141630 con 0x7ff7600a4c10 2024-08-18T21:08:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff767818640 10 monclient(hunting): authenticate will time out at 1290.462992s 2024-08-18T21:08:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff76006c950 0x7ff760139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff76006c950 0x7ff760139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:55084/0 (socket says 172.21.15.5:55084) 2024-08-18T21:08:43.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff764db3640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff7600a4c10 0x7ff760139c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 1 -- 172.21.15.5:0/1268049620 learned_addr learned my addr 172.21.15.5:0/1268049620 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:43.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 10 monclient(hunting): get_auth_request con 0x7ff76006c950 auth_method 0 2024-08-18T21:08:43.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff764db3640 10 monclient(hunting): get_auth_request con 0x7ff7600a4c10 auth_method 0 2024-08-18T21:08:43.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff764db3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff764db3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff764db3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff764db3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff764db3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff764db3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 10 monclient(hunting): handle_auth_done global_id 5854 payload 824 2024-08-18T21:08:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff765db5640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff760137a70 0x7ff76013a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 1 -- 172.21.15.5:0/1268049620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff7600a4c10 msgr2=0x7ff760139c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff7600a4c10 0x7ff760139c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 1 -- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff760137a70 msgr2=0x7ff76013a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff760137a70 0x7ff76013a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 10 monclient: _finish_hunting 0 2024-08-18T21:08:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 1 monclient: found mon.noname-c 2024-08-18T21:08:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:08:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff7655b4640 1 -- 172.21.15.5:0/1268049620 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff760068f40 con 0x7ff76006c950 2024-08-18T21:08:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff765db5640 10 monclient: get_auth_request con 0x7ff760137a70 auth_method 0 2024-08-18T21:08:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff764db3640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff7600a4c10 0x7ff760139c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:08:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.446+0000 7ff765db5640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff760137a70 0x7ff76013a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:08:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff7655b4640 1 -- 172.21.15.5:0/1268049620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff76006c950 msgr2=0x7ff760139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff7655b4640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff76006c950 0x7ff760139710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff758009fd0 tx=0x7ff75800d560 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75dffb640 1 -- 172.21.15.5:0/1268049620 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff75801a070 con 0x7ff76006c950 2024-08-18T21:08:43.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:08:43.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75dffb640 10 monclient: dump: 2024-08-18T21:08:43.466 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.466 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.466 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.466 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.466 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.466 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.466 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.467 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75dffb640 10 monclient: _finish_auth 0 2024-08-18T21:08:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75dffb640 10 monclient: _check_auth_tickets 2024-08-18T21:08:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff767818640 5 monclient: authenticate success, global_id 5854 2024-08-18T21:08:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff767818640 10 monclient: _renew_subs 2024-08-18T21:08:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75dffb640 1 -- 172.21.15.5:0/1268049620 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff758003e10 con 0x7ff76006c950 2024-08-18T21:08:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff767818640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:08:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff767818640 1 -- 172.21.15.5:0/1268049620 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7600a1d80 con 0x7ff76006c950 2024-08-18T21:08:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75dffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75dffb640 1 -- 172.21.15.5:0/1268049620 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff7580044a0 con 0x7ff76006c950 2024-08-18T21:08:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75f7fe640 4 set_mon_vals no callback set 2024-08-18T21:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75dffb640 10 monclient: dump: 2024-08-18T21:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff767818640 10 monclient: _renew_subs 2024-08-18T21:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff767818640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff767818640 1 -- 172.21.15.5:0/1268049620 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76013bb60 con 0x7ff76006c950 2024-08-18T21:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff767818640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff767818640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff76013db10 0x7ff760132660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff767818640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75dffb640 1 -- 172.21.15.5:0/1268049620 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7ff758004680 con 0x7ff76006c950 2024-08-18T21:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff767818640 1 -- 172.21.15.5:0/1268049620 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff760051140 con 0x7ff76013db10 2024-08-18T21:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75dffb640 1 --2- 172.21.15.5:0/1268049620 >> v2:172.21.15.157:6812/631023601 conn(0x7ff74c03bdc0 0x7ff74c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff75dffb640 1 -- 172.21.15.5:0/1268049620 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(145..145 src has 22..145) ==== 3506+0+0 (secure 0 0 0) 0x7ff75804e6d0 con 0x7ff76006c950 2024-08-18T21:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff764db3640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff76013db10 0x7ff760132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff764db3640 10 monclient: get_auth_request con 0x7ff76013db10 auth_method 0 2024-08-18T21:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff764db3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff764db3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff764db3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff764db3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff764db3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff764db3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff765db5640 1 --2- 172.21.15.5:0/1268049620 >> v2:172.21.15.157:6812/631023601 conn(0x7ff74c03bdc0 0x7ff74c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff765db5640 10 monclient: get_auth_request con 0x7ff74c03bdc0 auth_method 0 2024-08-18T21:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff764db3640 10 monclient(hunting): handle_auth_done global_id 84252 payload 824 2024-08-18T21:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.450+0000 7ff764db3640 1 -- 172.21.15.5:0/1268049620 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff760133700 con 0x7ff76013db10 2024-08-18T21:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.454+0000 7ff764db3640 1 -- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff76013db10 msgr2=0x7ff760132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.454+0000 7ff764db3640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff76013db10 0x7ff760132660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff76013b670 tx=0x7ff75400f610 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.454+0000 7ff765db5640 1 --2- 172.21.15.5:0/1268049620 >> v2:172.21.15.157:6812/631023601 conn(0x7ff74c03bdc0 0x7ff74c03e280 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff750009870 tx=0x7ff7500a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.454+0000 7ff75dffb640 1 -- 172.21.15.5:0/1268049620 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff7540044a0 con 0x7ff76013db10 2024-08-18T21:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.454+0000 7ff75dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.454+0000 7ff75dffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.454+0000 7ff75dffb640 10 monclient: dump: 2024-08-18T21:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.474 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.454+0000 7ff75dffb640 1 -- 172.21.15.5:0/1268049620 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff75400fe40 con 0x7ff76013db10 2024-08-18T21:08:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.454+0000 7ff75dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.454+0000 7ff75dffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.454+0000 7ff75dffb640 1 -- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff76013db10 msgr2=0x7ff760132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.454+0000 7ff75dffb640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff76013db10 0x7ff760132660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff76013b670 tx=0x7ff75400f610 comp rx=0 tx=0).stop 2024-08-18T21:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.454+0000 7ff75dffb640 1 -- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff76013db10 msgr2=0x7ff760132660 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.454+0000 7ff75dffb640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff76013db10 0x7ff760132660 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.462+0000 7ff767818640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.462+0000 7ff767818640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff760132ba0 0x7ff760132fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.462+0000 7ff767818640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.462+0000 7ff767818640 1 -- 172.21.15.5:0/1268049620 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff7601334f0 con 0x7ff760132ba0 2024-08-18T21:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.462+0000 7ff764db3640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff760132ba0 0x7ff760132fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.462+0000 7ff764db3640 10 monclient: get_auth_request con 0x7ff760132ba0 auth_method 0 2024-08-18T21:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.462+0000 7ff764db3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.462+0000 7ff764db3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.462+0000 7ff764db3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.462+0000 7ff764db3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.462+0000 7ff764db3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.462+0000 7ff764db3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.462+0000 7ff764db3640 10 monclient(hunting): handle_auth_done global_id 84261 payload 824 2024-08-18T21:08:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.462+0000 7ff764db3640 1 -- 172.21.15.5:0/1268049620 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff76013cf30 con 0x7ff760132ba0 2024-08-18T21:08:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff764db3640 1 -- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff760132ba0 msgr2=0x7ff760132fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff764db3640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff760132ba0 0x7ff760132fb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff754009fd0 tx=0x7ff7540046d0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff75dffb640 1 -- 172.21.15.5:0/1268049620 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff75401d3f0 con 0x7ff760132ba0 2024-08-18T21:08:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff75dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff75dffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:08:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff75dffb640 10 monclient: dump: 2024-08-18T21:08:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.479 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff75dffb640 1 -- 172.21.15.5:0/1268049620 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7ff754003a40 con 0x7ff760132ba0 2024-08-18T21:08:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff75dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff75dffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff75dffb640 1 -- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff760132ba0 msgr2=0x7ff760132fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff75dffb640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff760132ba0 0x7ff760132fb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff754009fd0 tx=0x7ff7540046d0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff75dffb640 1 -- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff760132ba0 msgr2=0x7ff760132fb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff75dffb640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff760132ba0 0x7ff760132fb0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff754009fd0 tx=0x7ff7540046d0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.481 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:43.481 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:43.481 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:43.481 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:43.481 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:43.481 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 20291, 2024-08-18T21:08:43.481 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:43.481 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:43.481 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:43.481 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:43.482 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:43.482 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:43.482 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:43.482 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:43.482 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:43.482 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:43.482 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.482 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:08:43.482 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:43.484 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.484 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:43.484 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:43.484 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:43.484 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:43.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:43.484 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:43.484 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:43.484 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:43.484 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:43.484 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:43.484 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:43.484 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:43.485 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:43.485 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.485 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:43.485 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:43.485 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:43.485 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:43.485 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:43.485 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:43.485 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:43.485 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:43.486 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:43.486 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:43.486 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:43.486 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:43.486 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:43.486 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:43.486 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:43.486 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:43.486 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:43.486 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:43.486 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:43.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:43.486 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:43.487 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:43.487 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:43.487 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:43.487 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:43.487 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:43.487 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:43.487 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:43.487 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.487 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:43.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.487 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:43.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.487 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:43.487 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:43.488 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.488 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:43.488 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.488 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:43.488 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.488 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.488 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.489 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:43.489 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:43.489 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.489 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.489 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.489 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:43.489 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:43.490 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.490 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.490 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.490 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:43.490 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.490 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.490 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:43.491 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.491 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.491 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.491 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:43.491 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:43.491 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.491 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.491 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.491 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.492 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:43.492 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:43.492 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.492 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.492 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.492 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:43.492 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.492 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.493 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:43.493 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.493 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.493 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.493 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:43.493 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:43.493 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.493 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.493 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.494 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.494 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:43.494 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:43.494 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.494 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.494 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.494 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.494 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:43.494 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.494 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.495 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.495 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:43.495 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.495 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.495 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.495 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:43.495 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:43.495 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.495 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.495 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.496 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.496 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:43.496 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:43.496 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.496 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.496 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.496 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.496 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:43.496 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.496 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:43.497 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.497 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.497 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:43.497 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:43.497 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.497 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.497 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.498 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:43.498 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:43.498 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.498 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.498 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.498 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:43.498 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.499 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.499 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:43.499 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.499 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.499 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.499 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:43.499 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:43.499 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.500 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.500 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.500 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:43.500 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:43.500 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:43.501 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.501 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.501 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.501 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:43.501 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.501 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.501 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.501 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:43.501 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:43.501 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.501 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.502 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.502 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:43.502 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:43.502 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.502 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:43.502 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.503 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.503 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:43.503 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.503 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.503 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.503 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:43.503 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:43.503 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.504 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.504 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.504 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:43.504 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:43.504 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:43.504 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.505 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.505 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:43.505 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.505 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.505 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.505 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:43.505 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:43.505 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.505 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.506 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.506 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.506 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.506 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:43.506 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:43.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.506 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:43.506 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:43.506 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:43.507 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.507 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.507 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:43.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.507 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:43.507 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:43.507 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:08:43.507 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.507 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.507 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:43.507 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:43.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff767818640 1 -- 172.21.15.5:0/1268049620 >> v2:172.21.15.157:6812/631023601 conn(0x7ff74c03bdc0 msgr2=0x7ff74c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff767818640 1 --2- 172.21.15.5:0/1268049620 >> v2:172.21.15.157:6812/631023601 conn(0x7ff74c03bdc0 0x7ff74c03e280 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff750009870 tx=0x7ff7500a6000 comp rx=0 tx=0).stop 2024-08-18T21:08:43.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff767818640 10 monclient: shutdown 2024-08-18T21:08:43.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff767818640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:43.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff767818640 1 -- 172.21.15.5:0/1268049620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff76006c950 msgr2=0x7ff760139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff767818640 1 --2- 172.21.15.5:0/1268049620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff76006c950 0x7ff760139710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff758009fd0 tx=0x7ff75800d560 comp rx=0 tx=0).stop 2024-08-18T21:08:43.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff765db5640 1 -- 172.21.15.5:0/1268049620 reap_dead start 2024-08-18T21:08:43.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff765db5640 1 -- 172.21.15.5:0/1268049620 reap_dead start 2024-08-18T21:08:43.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff767818640 1 -- 172.21.15.5:0/1268049620 shutdown_connections 2024-08-18T21:08:43.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff767818640 1 -- 172.21.15.5:0/1268049620 >> 172.21.15.5:0/1268049620 conn(0x7ff7600688d0 msgr2=0x7ff760133910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:43.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff767818640 1 -- 172.21.15.5:0/1268049620 shutdown_connections 2024-08-18T21:08:43.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.466+0000 7ff767818640 1 -- 172.21.15.5:0/1268049620 wait complete. 2024-08-18T21:08:43.511 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:43.511 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:08:43.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:08:43.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 10 monclient: get_monmap_and_config 2024-08-18T21:08:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 10 monclient: build_initial_monmap 2024-08-18T21:08:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 10 monclient: monmap: 2024-08-18T21:08:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:43.636557+0000 2024-08-18T21:08:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:43.636557+0000 2024-08-18T21:08:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:43.637 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 1 Processor -- start 2024-08-18T21:08:43.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 1 -- start start 2024-08-18T21:08:43.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 10 monclient: init 2024-08-18T21:08:43.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 10 monclient: _add_conns ranks=[4,5,8,2,9,0,6,3,1,10,7] 2024-08-18T21:08:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe3740a5ac0 0x7fe3740a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 10 monclient(hunting): picked mon.noname-c con 0x7fe3740a5ac0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:08:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe3740a63e0 0x7fe3741378e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 10 monclient(hunting): picked mon.noname-h con 0x7fe3740a63e0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:08:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe374137e20 0x7fe374138260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 10 monclient(hunting): picked mon.noname-e con 0x7fe374137e20 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:08:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fe3740a2050 con 0x7fe3740a5ac0 2024-08-18T21:08:43.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe3740a3990 con 0x7fe3740a63e0 2024-08-18T21:08:43.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fe3740a30f0 con 0x7fe374137e20 2024-08-18T21:08:43.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:43.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37a26f640 10 monclient(hunting): authenticate will time out at 1290.649688s 2024-08-18T21:08:43.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe3740a5ac0 0x7fe3740a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe3740a5ac0 0x7fe3740a5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:55096/0 (socket says 172.21.15.5:55096) 2024-08-18T21:08:43.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 1 -- 172.21.15.5:0/3902090181 learned_addr learned my addr 172.21.15.5:0/3902090181 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:43.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 10 monclient(hunting): get_auth_request con 0x7fe3740a5ac0 auth_method 0 2024-08-18T21:08:43.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37880c640 1 --2- 172.21.15.5:0/3902090181 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe374137e20 0x7fe374138260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37880c640 10 monclient(hunting): get_auth_request con 0x7fe374137e20 auth_method 0 2024-08-18T21:08:43.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37880c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37880c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37880c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37880c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37880c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe3737fe640 1 --2- 172.21.15.5:0/3902090181 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe3740a63e0 0x7fe3741378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37880c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe3737fe640 10 monclient(hunting): get_auth_request con 0x7fe3740a63e0 auth_method 0 2024-08-18T21:08:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe3737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe3737fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe3737fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 10 monclient(hunting): handle_auth_done global_id 5863 payload 274 2024-08-18T21:08:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 1 -- 172.21.15.5:0/3902090181 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe374137e20 msgr2=0x7fe374138260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 1 --2- 172.21.15.5:0/3902090181 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe374137e20 0x7fe374138260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 1 -- 172.21.15.5:0/3902090181 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe3740a63e0 msgr2=0x7fe3741378e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 1 --2- 172.21.15.5:0/3902090181 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe3740a63e0 0x7fe3741378e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 10 monclient: _finish_hunting 0 2024-08-18T21:08:43.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 1 monclient: found mon.noname-c 2024-08-18T21:08:43.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:43.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:08:43.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe373fff640 1 -- 172.21.15.5:0/3902090181 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3740a7660 con 0x7fe3740a5ac0 2024-08-18T21:08:43.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.634+0000 7fe37880c640 1 --2- 172.21.15.5:0/3902090181 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe374137e20 0x7fe374138260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:08:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe373fff640 1 -- 172.21.15.5:0/3902090181 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe3740a5ac0 msgr2=0x7fe3740a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe373fff640 1 --2- 172.21.15.5:0/3902090181 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe3740a5ac0 0x7fe3740a5ea0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe364009e80 tx=0x7fe36401c910 comp rx=0 tx=0).ready entity=mon.4 client_cookie=8857f111e9ca3c9a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe372ffd640 1 -- 172.21.15.5:0/3902090181 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe3640090d0 con 0x7fe3740a5ac0 2024-08-18T21:08:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe372ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe372ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:08:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe372ffd640 10 monclient: dump: 2024-08-18T21:08:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.657 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe372ffd640 10 monclient: _finish_auth 0 2024-08-18T21:08:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe372ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:08:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe372ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe372ffd640 1 -- 172.21.15.5:0/3902090181 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3640a6970 con 0x7fe3740a5ac0 2024-08-18T21:08:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe37a26f640 5 monclient: authenticate success, global_id 5863 2024-08-18T21:08:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe37a26f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:08:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe372ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe37a26f640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe37a26f640 4 set_mon_vals no callback set 2024-08-18T21:08:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe372ffd640 1 -- 172.21.15.5:0/3902090181 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe3640af480 con 0x7fe3740a5ac0 2024-08-18T21:08:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe372ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe372ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:08:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe372ffd640 10 monclient: dump: 2024-08-18T21:08:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.659 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe37a26f640 10 monclient: shutdown 2024-08-18T21:08:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe37a26f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe37a26f640 1 -- 172.21.15.5:0/3902090181 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe3740a5ac0 msgr2=0x7fe3740a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe37a26f640 1 --2- 172.21.15.5:0/3902090181 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe3740a5ac0 0x7fe3740a5ea0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe364009e80 tx=0x7fe36401c910 comp rx=0 tx=0).stop 2024-08-18T21:08:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe37a26f640 1 -- 172.21.15.5:0/3902090181 shutdown_connections 2024-08-18T21:08:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe37a26f640 1 --2- 172.21.15.5:0/3902090181 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe374137e20 0x7fe374138260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe37a26f640 1 --2- 172.21.15.5:0/3902090181 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe3740a63e0 0x7fe3741378e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe37a26f640 1 --2- 172.21.15.5:0/3902090181 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe3740a5ac0 0x7fe3740a5ea0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe37a26f640 1 -- 172.21.15.5:0/3902090181 >> 172.21.15.5:0/3902090181 conn(0x7fe3740aa770 msgr2=0x7fe3740a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe37a26f640 1 -- 172.21.15.5:0/3902090181 shutdown_connections 2024-08-18T21:08:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.638+0000 7fe37a26f640 1 -- 172.21.15.5:0/3902090181 wait complete. 2024-08-18T21:08:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 10 monclient: build_initial_monmap 2024-08-18T21:08:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 10 monclient: monmap: 2024-08-18T21:08:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:43.661 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:43.661 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:43.661 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:43.661 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.661 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:43.661 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:43.661 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:43.661 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:43.661 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:43.661 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:43.661 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:43.661 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:43.662 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:43.662 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 1 Processor -- start 2024-08-18T21:08:43.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 1 -- start start 2024-08-18T21:08:43.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 10 monclient: init 2024-08-18T21:08:43.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:43.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 10 monclient: _add_conns ranks=[8,1,3,7,6,4,2,5,0] 2024-08-18T21:08:43.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe3740a5ac0 0x7fe3741335e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 10 monclient(hunting): picked mon.noname-e con 0x7fe3740a5ac0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:08:43.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3740a63e0 0x7fe374133b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 10 monclient(hunting): picked mon.noname-f con 0x7fe3740a63e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:08:43.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe374137e20 0x7fe37409da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 10 monclient(hunting): picked mon.noname-g con 0x7fe374137e20 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:08:43.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe3740a1dc0 con 0x7fe3740a63e0 2024-08-18T21:08:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe3740a1c40 con 0x7fe374137e20 2024-08-18T21:08:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fe3741417d0 con 0x7fe3740a5ac0 2024-08-18T21:08:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37a26f640 10 monclient(hunting): authenticate will time out at 1290.657473s 2024-08-18T21:08:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe3740a5ac0 0x7fe3741335e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe3740a5ac0 0x7fe3741335e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:45388/0 (socket says 172.21.15.5:45388) 2024-08-18T21:08:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 1 -- 172.21.15.5:0/2918205591 learned_addr learned my addr 172.21.15.5:0/2918205591 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 10 monclient(hunting): get_auth_request con 0x7fe3740a5ac0 auth_method 0 2024-08-18T21:08:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37880c640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe374137e20 0x7fe37409da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37880c640 10 monclient(hunting): get_auth_request con 0x7fe374137e20 auth_method 0 2024-08-18T21:08:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37880c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37880c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe37880c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe3737fe640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3740a63e0 0x7fe374133b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 10 monclient(hunting): handle_auth_done global_id 54899 payload 824 2024-08-18T21:08:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 1 -- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe374137e20 msgr2=0x7fe37409da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe374137e20 0x7fe37409da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 1 -- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3740a63e0 msgr2=0x7fe374133b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3740a63e0 0x7fe374133b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 10 monclient: _finish_hunting 0 2024-08-18T21:08:43.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 1 monclient: found mon.noname-e 2024-08-18T21:08:43.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:43.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:08:43.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe373fff640 1 -- 172.21.15.5:0/2918205591 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe374120ea0 con 0x7fe3740a5ac0 2024-08-18T21:08:43.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe3737fe640 10 monclient: get_auth_request con 0x7fe3740a63e0 auth_method 0 2024-08-18T21:08:43.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.642+0000 7fe3737fe640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3740a63e0 0x7fe374133b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:08:43.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe373fff640 1 -- 172.21.15.5:0/2918205591 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe3740a5ac0 msgr2=0x7fe3741335e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe373fff640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe3740a5ac0 0x7fe3741335e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe36401c740 tx=0x7fe3640196b0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe370ff9640 1 -- 172.21.15.5:0/2918205591 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe3640039a0 con 0x7fe3740a5ac0 2024-08-18T21:08:43.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe370ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe370ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:08:43.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe370ff9640 10 monclient: dump: 2024-08-18T21:08:43.667 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.667 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.667 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.668 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.668 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.668 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.668 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.668 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.668 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.668 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.668 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.668 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.668 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.668 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.668 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.668 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe370ff9640 10 monclient: _finish_auth 0 2024-08-18T21:08:43.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe370ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:08:43.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe370ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:43.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe370ff9640 1 -- 172.21.15.5:0/2918205591 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe364003b80 con 0x7fe3740a5ac0 2024-08-18T21:08:43.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe370ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:43.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe370ff9640 1 -- 172.21.15.5:0/2918205591 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe364003d30 con 0x7fe3740a5ac0 2024-08-18T21:08:43.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe37a26f640 5 monclient: authenticate success, global_id 54899 2024-08-18T21:08:43.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe37a26f640 10 monclient: _renew_subs 2024-08-18T21:08:43.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe37a26f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:08:43.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe37a26f640 1 -- 172.21.15.5:0/2918205591 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe374121180 con 0x7fe3740a5ac0 2024-08-18T21:08:43.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe3727fc640 4 set_mon_vals no callback set 2024-08-18T21:08:43.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe370ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe370ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:43.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe370ff9640 10 monclient: dump: 2024-08-18T21:08:43.670 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.670 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.670 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.670 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.670 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.670 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.670 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.670 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.671 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe37a26f640 10 monclient: _renew_subs 2024-08-18T21:08:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe37a26f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:08:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe37a26f640 1 -- 172.21.15.5:0/2918205591 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3740a7000 con 0x7fe3740a5ac0 2024-08-18T21:08:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe37a26f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe37a26f640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe37409df70 0x7fe37409e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe37a26f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe37a26f640 1 -- 172.21.15.5:0/2918205591 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe37409fee0 con 0x7fe37409df70 2024-08-18T21:08:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe370ff9640 1 -- 172.21.15.5:0/2918205591 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe3640a6920 con 0x7fe3740a5ac0 2024-08-18T21:08:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe370ff9640 1 --2- 172.21.15.5:0/2918205591 >> v2:172.21.15.157:6812/631023601 conn(0x7fe35403bdc0 0x7fe35403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe3737fe640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe37409df70 0x7fe37409e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe370ff9640 1 -- 172.21.15.5:0/2918205591 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(146..146 src has 22..146) ==== 3898+0+0 (secure 0 0 0) 0x7fe3640b6070 con 0x7fe3740a5ac0 2024-08-18T21:08:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe3737fe640 10 monclient: get_auth_request con 0x7fe37409df70 auth_method 0 2024-08-18T21:08:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe3737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe3737fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe3737fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe3737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe3737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe3737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe37880c640 1 --2- 172.21.15.5:0/2918205591 >> v2:172.21.15.157:6812/631023601 conn(0x7fe35403bdc0 0x7fe35403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe37880c640 10 monclient: get_auth_request con 0x7fe35403bdc0 auth_method 0 2024-08-18T21:08:43.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe3737fe640 10 monclient(hunting): handle_auth_done global_id 35177 payload 824 2024-08-18T21:08:43.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.646+0000 7fe3737fe640 1 -- 172.21.15.5:0/2918205591 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3740a6bb0 con 0x7fe37409df70 2024-08-18T21:08:43.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.650+0000 7fe3737fe640 1 -- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe37409df70 msgr2=0x7fe37409e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.650+0000 7fe3737fe640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe37409df70 0x7fe37409e350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe3740a6b80 tx=0x7fe36c00eba0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.650+0000 7fe370ff9640 1 -- 172.21.15.5:0/2918205591 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe36c017070 con 0x7fe37409df70 2024-08-18T21:08:43.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.650+0000 7fe370ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.650+0000 7fe37880c640 1 --2- 172.21.15.5:0/2918205591 >> v2:172.21.15.157:6812/631023601 conn(0x7fe35403bdc0 0x7fe35403e280 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe3740a7b20 tx=0x7fe35c008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.650+0000 7fe370ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:08:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.650+0000 7fe370ff9640 10 monclient: dump: 2024-08-18T21:08:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.674 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.675 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.650+0000 7fe370ff9640 1 -- 172.21.15.5:0/2918205591 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe36c00c740 con 0x7fe37409df70 2024-08-18T21:08:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.650+0000 7fe370ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.650+0000 7fe370ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.650+0000 7fe370ff9640 1 -- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe37409df70 msgr2=0x7fe37409e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.650+0000 7fe370ff9640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe37409df70 0x7fe37409e350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe3740a6b80 tx=0x7fe36c00eba0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.650+0000 7fe370ff9640 1 -- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe37409df70 msgr2=0x7fe37409e350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.650+0000 7fe370ff9640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe37409df70 0x7fe37409e350 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe3740a6b80 tx=0x7fe36c00eba0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.658+0000 7fe37a26f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.658+0000 7fe37a26f640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe374134940 0x7fe37413d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.658+0000 7fe37a26f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.658+0000 7fe37a26f640 1 -- 172.21.15.5:0/2918205591 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe374051140 con 0x7fe374134940 2024-08-18T21:08:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.658+0000 7fe3737fe640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe374134940 0x7fe37413d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.658+0000 7fe3737fe640 10 monclient: get_auth_request con 0x7fe374134940 auth_method 0 2024-08-18T21:08:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.658+0000 7fe3737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.658+0000 7fe3737fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.658+0000 7fe3737fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.658+0000 7fe3737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.658+0000 7fe3737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.658+0000 7fe3737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.658+0000 7fe3737fe640 10 monclient(hunting): handle_auth_done global_id 35186 payload 824 2024-08-18T21:08:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.658+0000 7fe3737fe640 1 -- 172.21.15.5:0/2918205591 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe3741378e0 con 0x7fe374134940 2024-08-18T21:08:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.658+0000 7fe3737fe640 1 -- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe374134940 msgr2=0x7fe37413d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.658+0000 7fe3737fe640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe374134940 0x7fe37413d4b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe3740a6b80 tx=0x7fe36c004740 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe370ff9640 1 -- 172.21.15.5:0/2918205591 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe36c00f040 con 0x7fe374134940 2024-08-18T21:08:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe370ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe370ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:08:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe370ff9640 10 monclient: dump: 2024-08-18T21:08:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.680 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe370ff9640 1 -- 172.21.15.5:0/2918205591 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7fe36c013410 con 0x7fe374134940 2024-08-18T21:08:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe370ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe370ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe370ff9640 1 -- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe374134940 msgr2=0x7fe37413d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe370ff9640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe374134940 0x7fe37413d4b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe3740a6b80 tx=0x7fe36c004740 comp rx=0 tx=0).stop 2024-08-18T21:08:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe370ff9640 1 -- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe374134940 msgr2=0x7fe37413d4b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe370ff9640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe374134940 0x7fe37413d4b0 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe3740a6b80 tx=0x7fe36c004740 comp rx=0 tx=0).stop 2024-08-18T21:08:43.681 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:43.681 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:43.681 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:43.681 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:43.681 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:43.681 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 243456, 2024-08-18T21:08:43.682 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:43.682 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:43.682 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:43.682 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:43.682 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:43.682 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:43.682 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:43.682 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:43.682 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:43.682 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:43.682 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.682 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:08:43.683 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:43.683 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:43.683 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:43.683 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:43.683 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:43.683 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:43.683 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:43.683 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:43.683 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:43.684 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:43.684 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:43.684 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:43.684 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:43.684 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:43.684 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.684 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:43.684 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:43.684 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:43.684 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:43.684 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:43.685 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:43.685 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:43.685 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:43.685 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:43.685 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:43.685 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:43.685 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:43.685 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:43.685 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.685 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:43.685 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:43.685 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:43.686 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:43.686 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:43.686 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:43.686 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:43.686 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:43.686 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:43.686 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:43.686 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:43.686 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:43.686 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:43.686 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:43.686 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:43.686 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:43.687 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:43.687 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:43.687 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:43.687 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:43.687 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:43.687 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:43.687 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:43.687 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:43.687 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:43.687 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:43.687 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:43.687 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:43.687 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.688 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:43.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.688 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:43.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.688 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:43.688 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:43.688 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.688 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.690 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.690 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.690 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:43.690 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:43.690 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.690 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:43.690 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:43.691 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.691 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.691 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:43.691 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:43.691 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.691 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.691 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.692 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:43.692 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:43.692 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:43.692 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.693 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:43.693 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.693 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.693 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:43.693 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:43.693 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.694 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.694 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.694 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:43.694 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:43.694 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:43.694 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:43.697 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.697 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.697 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:43.697 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:43.697 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.697 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.697 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.697 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:43.697 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:43.698 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.698 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:43.698 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.698 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:43.698 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.699 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.699 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:43.699 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:43.699 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.699 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.699 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.699 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:43.699 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:43.699 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.700 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.700 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:43.700 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.700 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.700 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:43.700 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.700 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.700 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.701 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:43.701 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:43.701 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.701 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.701 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.701 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:43.702 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:43.702 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.702 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.702 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.702 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:43.702 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.702 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.702 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:43.702 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.702 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.702 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.703 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:43.703 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:43.703 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.703 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.703 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.703 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:43.703 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:43.703 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.703 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.704 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.704 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:43.704 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.704 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.704 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:43.704 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.704 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.704 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.704 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:43.704 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:43.705 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.705 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.705 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.705 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.705 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.705 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:43.705 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:43.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.705 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:43.705 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:43.705 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:43.706 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.706 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.706 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:08:43.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.706 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:43.706 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:43.706 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:43.706 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.706 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.706 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:43.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.706 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:43.706 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:43.707 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:43.707 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.707 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.707 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:43.707 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe37a26f640 1 -- 172.21.15.5:0/2918205591 >> v2:172.21.15.157:6812/631023601 conn(0x7fe35403bdc0 msgr2=0x7fe35403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe37a26f640 1 --2- 172.21.15.5:0/2918205591 >> v2:172.21.15.157:6812/631023601 conn(0x7fe35403bdc0 0x7fe35403e280 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe3740a7b20 tx=0x7fe35c008040 comp rx=0 tx=0).stop 2024-08-18T21:08:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe37a26f640 10 monclient: shutdown 2024-08-18T21:08:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe37a26f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe37a26f640 1 -- 172.21.15.5:0/2918205591 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe3740a5ac0 msgr2=0x7fe3741335e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe37a26f640 1 --2- 172.21.15.5:0/2918205591 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe3740a5ac0 0x7fe3741335e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe36401c740 tx=0x7fe3640196b0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe37880c640 1 -- 172.21.15.5:0/2918205591 reap_dead start 2024-08-18T21:08:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe37880c640 1 -- 172.21.15.5:0/2918205591 reap_dead start 2024-08-18T21:08:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe37a26f640 1 -- 172.21.15.5:0/2918205591 shutdown_connections 2024-08-18T21:08:43.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe37a26f640 1 -- 172.21.15.5:0/2918205591 >> 172.21.15.5:0/2918205591 conn(0x7fe3740aa770 msgr2=0x7fe3740a9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:43.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe37a26f640 1 -- 172.21.15.5:0/2918205591 shutdown_connections 2024-08-18T21:08:43.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.662+0000 7fe37a26f640 1 -- 172.21.15.5:0/2918205591 wait complete. 2024-08-18T21:08:43.711 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:43.711 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:08:43.712 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:08:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 10 monclient: get_monmap_and_config 2024-08-18T21:08:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 10 monclient: build_initial_monmap 2024-08-18T21:08:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 10 monclient: monmap: 2024-08-18T21:08:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:08:43.833306+0000 2024-08-18T21:08:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:08:43.833306+0000 2024-08-18T21:08:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:08:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:08:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:08:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:08:43.834 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 1 Processor -- start 2024-08-18T21:08:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 1 -- start start 2024-08-18T21:08:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 10 monclient: init 2024-08-18T21:08:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 10 monclient: _add_conns ranks=[7,0,8,4,3,9,1,6,10,5,2] 2024-08-18T21:08:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc0a6de0 0x7fdacc0a71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 10 monclient(hunting): picked mon.noname-i con 0x7fdacc0a6de0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdacc09eb30 addr v1:172.21.15.5:6789/0 2024-08-18T21:08:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdacc0a7700 0x7fdacc13a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 10 monclient(hunting): picked mon.noname-e con 0x7fdacc0a7700 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:08:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdacc06f790 con 0x7fdacc09eb30 2024-08-18T21:08:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fdacc09e430 con 0x7fdacc0a6de0 2024-08-18T21:08:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fdacc09de70 con 0x7fdacc0a7700 2024-08-18T21:08:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad3eac640 10 monclient(hunting): authenticate will time out at 1290.846416s 2024-08-18T21:08:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdacc0a7700 0x7fdacc13a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdacc0a7700 0x7fdacc13a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:45402/0 (socket says 172.21.15.5:45402) 2024-08-18T21:08:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 1 -- 172.21.15.5:0/182064048 learned_addr learned my addr 172.21.15.5:0/182064048 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 10 monclient(hunting): get_auth_request con 0x7fdacc0a7700 auth_method 0 2024-08-18T21:08:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad1c48640 1 --2- 172.21.15.5:0/182064048 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc0a6de0 0x7fdacc0a71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad1c48640 10 monclient(hunting): get_auth_request con 0x7fdacc0a6de0 auth_method 0 2024-08-18T21:08:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad1c48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad1c48640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad1c48640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 10 monclient(hunting): handle_auth_done global_id 54908 payload 274 2024-08-18T21:08:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 1 -- 172.21.15.5:0/182064048 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc0a6de0 msgr2=0x7fdacc0a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 1 --2- 172.21.15.5:0/182064048 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc0a6de0 0x7fdacc0a71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 1 -- 172.21.15.5:0/182064048 >> v1:172.21.15.5:6789/0 conn(0x7fdacc09eb30 legacy=0x7fdacc139ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:08:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 10 monclient: _finish_hunting 0 2024-08-18T21:08:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 1 monclient: found mon.noname-e 2024-08-18T21:08:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:08:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.830+0000 7fdad2449640 1 -- 172.21.15.5:0/182064048 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdacc09e150 con 0x7fdacc0a7700 2024-08-18T21:08:43.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad2449640 1 -- 172.21.15.5:0/182064048 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdacc0a7700 msgr2=0x7fdacc13a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad2449640 1 --2- 172.21.15.5:0/182064048 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdacc0a7700 0x7fdacc13a2b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009e80 tx=0x7fdac401c910 comp rx=0 tx=0).ready entity=mon.8 client_cookie=954686a7bd4d493a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad0c46640 1 -- 172.21.15.5:0/182064048 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdac40090d0 con 0x7fdacc0a7700 2024-08-18T21:08:43.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad0c46640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad0c46640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:08:43.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad0c46640 10 monclient: dump: 2024-08-18T21:08:43.843 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.843 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.845 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad0c46640 10 monclient: _finish_auth 0 2024-08-18T21:08:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad0c46640 10 monclient: _check_auth_tickets 2024-08-18T21:08:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad0c46640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad0c46640 1 -- 172.21.15.5:0/182064048 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdac40a5b40 con 0x7fdacc0a7700 2024-08-18T21:08:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad3eac640 5 monclient: authenticate success, global_id 54908 2024-08-18T21:08:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad3eac640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:08:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad0c46640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad0c46640 1 -- 172.21.15.5:0/182064048 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdac40a5cf0 con 0x7fdacc0a7700 2024-08-18T21:08:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad0c46640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad0c46640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:08:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad0c46640 10 monclient: dump: 2024-08-18T21:08:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.847 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad3eac640 10 monclient: get_monmap_and_config success 2024-08-18T21:08:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.834+0000 7fdad3eac640 4 set_mon_vals no callback set 2024-08-18T21:08:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 10 monclient: shutdown 2024-08-18T21:08:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 1 -- 172.21.15.5:0/182064048 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdacc0a7700 msgr2=0x7fdacc13a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 1 --2- 172.21.15.5:0/182064048 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdacc0a7700 0x7fdacc13a2b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009e80 tx=0x7fdac401c910 comp rx=0 tx=0).stop 2024-08-18T21:08:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 1 -- 172.21.15.5:0/182064048 shutdown_connections 2024-08-18T21:08:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 1 --2- 172.21.15.5:0/182064048 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdacc0a7700 0x7fdacc13a2b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 1 --2- 172.21.15.5:0/182064048 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc0a6de0 0x7fdacc0a71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 1 -- 172.21.15.5:0/182064048 >> 172.21.15.5:0/182064048 conn(0x7fdacc0ace00 msgr2=0x7fdacc0a8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 1 -- 172.21.15.5:0/182064048 shutdown_connections 2024-08-18T21:08:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 1 -- 172.21.15.5:0/182064048 wait complete. 2024-08-18T21:08:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 10 monclient: build_initial_monmap 2024-08-18T21:08:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 10 monclient: monmap: 2024-08-18T21:08:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:08:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:08:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:08:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:08:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:08:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:08:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:08:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:08:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:08:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:08:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:08:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:08:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:08:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:08:43.849 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 1 Processor -- start 2024-08-18T21:08:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 1 -- start start 2024-08-18T21:08:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 10 monclient: init 2024-08-18T21:08:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 10 monclient: _reopen_session rank -1 2024-08-18T21:08:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 10 monclient: _add_conns ranks=[2,7,6,8,3,5,0,4,1] 2024-08-18T21:08:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdacc09eb30 0x7fdacc1d1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 10 monclient(hunting): picked mon.noname-b con 0x7fdacc09eb30 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:08:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc0a6de0 0x7fdacc1d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 10 monclient(hunting): picked mon.noname-i con 0x7fdacc0a6de0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:08:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdacc0a7700 0x7fdacc13f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 10 monclient(hunting): picked mon.noname-d con 0x7fdacc0a7700 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:08:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fdacc13a7f0 con 0x7fdacc09eb30 2024-08-18T21:08:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fdacc0a8680 con 0x7fdacc0a7700 2024-08-18T21:08:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fdacc13a970 con 0x7fdacc0a6de0 2024-08-18T21:08:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 10 monclient(hunting): _renew_subs 2024-08-18T21:08:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad3eac640 10 monclient(hunting): authenticate will time out at 1290.854207s 2024-08-18T21:08:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdacc09eb30 0x7fdacc1d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad2449640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdacc0a7700 0x7fdacc13f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdacc09eb30 0x7fdacc1d1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59954/0 (socket says 172.21.15.5:59954) 2024-08-18T21:08:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad2449640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdacc0a7700 0x7fdacc13f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:40430/0 (socket says 172.21.15.5:40430) 2024-08-18T21:08:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 1 -- 172.21.15.5:0/1774471774 learned_addr learned my addr 172.21.15.5:0/1774471774 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:08:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 10 monclient(hunting): get_auth_request con 0x7fdacc09eb30 auth_method 0 2024-08-18T21:08:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad2449640 10 monclient(hunting): get_auth_request con 0x7fdacc0a7700 auth_method 0 2024-08-18T21:08:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad2449640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad2449640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad2449640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad2449640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad2449640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad2449640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1447640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc0a6de0 0x7fdacc1d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1447640 10 monclient(hunting): get_auth_request con 0x7fdacc0a6de0 auth_method 0 2024-08-18T21:08:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1447640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1447640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1447640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 10 monclient(hunting): handle_auth_done global_id 84278 payload 824 2024-08-18T21:08:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 1 -- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc0a6de0 msgr2=0x7fdacc1d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc0a6de0 0x7fdacc1d1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 1 -- 172.21.15.5:0/1774471774 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdacc0a7700 msgr2=0x7fdacc13f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdacc0a7700 0x7fdacc13f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 10 monclient: _finish_hunting 0 2024-08-18T21:08:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 1 monclient: found mon.noname-b 2024-08-18T21:08:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:08:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:08:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1c48640 1 -- 172.21.15.5:0/1774471774 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdacc141290 con 0x7fdacc09eb30 2024-08-18T21:08:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad2449640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdacc0a7700 0x7fdacc13f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:08:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.838+0000 7fdad1447640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc0a6de0 0x7fdacc1d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:08:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad1c48640 1 -- 172.21.15.5:0/1774471774 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdacc09eb30 msgr2=0x7fdacc1d1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad1c48640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdacc09eb30 0x7fdacc1d1490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdac000d800 tx=0x7fdac000dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabe7fc640 1 -- 172.21.15.5:0/1774471774 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdac0018020 con 0x7fdacc09eb30 2024-08-18T21:08:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabe7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:08:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabe7fc640 10 monclient: dump: 2024-08-18T21:08:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.866 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabe7fc640 10 monclient: _finish_auth 0 2024-08-18T21:08:43.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabe7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:08:43.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:08:43.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabe7fc640 1 -- 172.21.15.5:0/1774471774 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdac0009d20 con 0x7fdacc09eb30 2024-08-18T21:08:43.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad3eac640 5 monclient: authenticate success, global_id 84278 2024-08-18T21:08:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad3eac640 10 monclient: _renew_subs 2024-08-18T21:08:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad3eac640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:08:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad3eac640 1 -- 172.21.15.5:0/1774471774 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdacc0a38e0 con 0x7fdacc09eb30 2024-08-18T21:08:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabe7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:08:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabe7fc640 1 -- 172.21.15.5:0/1774471774 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdac0014880 con 0x7fdacc09eb30 2024-08-18T21:08:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:08:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabf7fe640 4 set_mon_vals no callback set 2024-08-18T21:08:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabe7fc640 10 monclient: dump: 2024-08-18T21:08:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.871 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad3eac640 10 monclient: _renew_subs 2024-08-18T21:08:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad3eac640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:08:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad3eac640 1 -- 172.21.15.5:0/1774471774 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdacc123f90 con 0x7fdacc09eb30 2024-08-18T21:08:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad3eac640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad3eac640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc1d21a0 0x7fdacc13fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad3eac640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad3eac640 1 -- 172.21.15.5:0/1774471774 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fdacc051140 con 0x7fdacc1d21a0 2024-08-18T21:08:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabe7fc640 1 -- 172.21.15.5:0/1774471774 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fdac001b020 con 0x7fdacc09eb30 2024-08-18T21:08:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad1447640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc1d21a0 0x7fdacc13fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad1447640 10 monclient: get_auth_request con 0x7fdacc1d21a0 auth_method 0 2024-08-18T21:08:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad1447640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad1447640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad1447640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabe7fc640 1 --2- 172.21.15.5:0/1774471774 >> v2:172.21.15.157:6812/631023601 conn(0x7fdab003bdf0 0x7fdab003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad1447640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad1447640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad1447640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdabe7fc640 1 -- 172.21.15.5:0/1774471774 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(146..146 src has 22..146) ==== 3898+0+0 (secure 0 0 0) 0x7fdac000f040 con 0x7fdacc09eb30 2024-08-18T21:08:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad2449640 1 --2- 172.21.15.5:0/1774471774 >> v2:172.21.15.157:6812/631023601 conn(0x7fdab003bdf0 0x7fdab003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad1447640 10 monclient(hunting): handle_auth_done global_id 5677 payload 824 2024-08-18T21:08:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad1447640 1 -- 172.21.15.5:0/1774471774 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdacc06e680 con 0x7fdacc1d21a0 2024-08-18T21:08:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.842+0000 7fdad2449640 10 monclient: get_auth_request con 0x7fdab003bdf0 auth_method 0 2024-08-18T21:08:43.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.846+0000 7fdad1447640 1 -- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc1d21a0 msgr2=0x7fdacc13fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.846+0000 7fdad1447640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc1d21a0 0x7fdacc13fe60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdacc13a7c0 tx=0x7fdac800e960 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.846+0000 7fdad2449640 1 --2- 172.21.15.5:0/1774471774 >> v2:172.21.15.157:6812/631023601 conn(0x7fdab003bdf0 0x7fdab003e2b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdac40ab000 tx=0x7fdac40a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.846+0000 7fdabe7fc640 1 -- 172.21.15.5:0/1774471774 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdac8013c70 con 0x7fdacc1d21a0 2024-08-18T21:08:43.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.846+0000 7fdabe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.846+0000 7fdabe7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:08:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.846+0000 7fdabe7fc640 10 monclient: dump: 2024-08-18T21:08:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.878 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.846+0000 7fdabe7fc640 1 -- 172.21.15.5:0/1774471774 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdac8013800 con 0x7fdacc1d21a0 2024-08-18T21:08:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.846+0000 7fdabe7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:08:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.846+0000 7fdabe7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:08:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.846+0000 7fdabe7fc640 1 -- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc1d21a0 msgr2=0x7fdacc13fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.846+0000 7fdabe7fc640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc1d21a0 0x7fdacc13fe60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdacc13a7c0 tx=0x7fdac800e960 comp rx=0 tx=0).stop 2024-08-18T21:08:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.846+0000 7fdabe7fc640 1 -- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc1d21a0 msgr2=0x7fdacc13fe60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.846+0000 7fdabe7fc640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc1d21a0 0x7fdacc13fe60 secure :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdacc13a7c0 tx=0x7fdac800e960 comp rx=0 tx=0).stop 2024-08-18T21:08:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.854+0000 7fdad3eac640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:08:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.854+0000 7fdad3eac640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc1403a0 0x7fdacc13adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:08:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.854+0000 7fdad3eac640 10 monclient(hunting): start opening mon connection 2024-08-18T21:08:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.854+0000 7fdad3eac640 1 -- 172.21.15.5:0/1774471774 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fdacc1407b0 con 0x7fdacc1403a0 2024-08-18T21:08:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.854+0000 7fdad1447640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc1403a0 0x7fdacc13adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:08:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.854+0000 7fdad1447640 10 monclient: get_auth_request con 0x7fdacc1403a0 auth_method 0 2024-08-18T21:08:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.854+0000 7fdad1447640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:08:43.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.854+0000 7fdad1447640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:08:43.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.854+0000 7fdad1447640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:08:43.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.854+0000 7fdad1447640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:08:43.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.854+0000 7fdad1447640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:08:43.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.854+0000 7fdad1447640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:08:43.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.854+0000 7fdad1447640 10 monclient(hunting): handle_auth_done global_id 5686 payload 824 2024-08-18T21:08:43.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.854+0000 7fdad1447640 1 -- 172.21.15.5:0/1774471774 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdacc123b60 con 0x7fdacc1403a0 2024-08-18T21:08:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdad1447640 1 -- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc1403a0 msgr2=0x7fdacc13adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:08:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdad1447640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc1403a0 0x7fdacc13adc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdacc13a7c0 tx=0x7fdac8003770 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:08:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdabe7fc640 1 -- 172.21.15.5:0/1774471774 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdac8006c00 con 0x7fdacc1403a0 2024-08-18T21:08:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdabe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:08:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdabe7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:08:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdabe7fc640 10 monclient: dump: 2024-08-18T21:08:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:08:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:08:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:08:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:08:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:08:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:08:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:08:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:08:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:08:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:08:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:08:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:08:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:08:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:08:43.883 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:08:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdabe7fc640 1 -- 172.21.15.5:0/1774471774 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9582 (secure 0 0 0) 0x7fdac8006c00 con 0x7fdacc1403a0 2024-08-18T21:08:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdabe7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:08:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdabe7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:08:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdabe7fc640 1 -- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc1403a0 msgr2=0x7fdacc13adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdabe7fc640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc1403a0 0x7fdacc13adc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdacc13a7c0 tx=0x7fdac8003770 comp rx=0 tx=0).stop 2024-08-18T21:08:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdabe7fc640 1 -- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc1403a0 msgr2=0x7fdacc13adc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:08:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdabe7fc640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdacc1403a0 0x7fdacc13adc0 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdacc13a7c0 tx=0x7fdac8003770 comp rx=0 tx=0).stop 2024-08-18T21:08:43.884 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:08:43.884 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:43.885 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:43.885 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:08:43.885 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 116, 2024-08-18T21:08:43.885 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 332955, 2024-08-18T21:08:43.885 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:08:43.885 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:08:43.885 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:08:43.885 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:08:43.885 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:08:43.885 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:08:43.885 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:08:43.885 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:08:43.885 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:08:43.885 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:08:43.886 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.886 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 8, 2024-08-18T21:08:43.886 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:43.886 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:08:43.886 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:08:43.886 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:43.886 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:43.886 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:43.886 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:43.886 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:43.886 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:43.886 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:43.887 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:43.887 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:43.887 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:43.887 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:43.887 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.887 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:08:43.887 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:08:43.887 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:43.887 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:43.887 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:43.887 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:43.887 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:43.887 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:43.887 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:43.888 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:43.888 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:43.888 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:43.888 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:43.888 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.888 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:08:43.888 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:08:43.889 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:08:43.889 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:08:43.889 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:08:43.889 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:08:43.889 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:43.889 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:08:43.889 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:08:43.889 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:08:43.889 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:08:43.889 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:08:43.889 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:08:43.890 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:08:43.890 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:08:43.890 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:08:43.890 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:08:43.890 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:08:43.890 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:08:43.890 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:08:43.890 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:08:43.890 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:08:43.890 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:08:43.890 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:08:43.890 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:08:43.891 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:08:43.891 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:08:43.891 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:08:43.891 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.891 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:08:43.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.891 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:08:43.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.891 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:08:43.891 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:08:43.891 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.891 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.892 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.892 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:08:43.892 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.892 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.892 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:08:43.892 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.892 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.892 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.893 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:08:43.893 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:08:43.893 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.893 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.893 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.893 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:08:43.894 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:08:43.894 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.894 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.894 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.894 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:08:43.895 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.895 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.895 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.895 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:08:43.895 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.895 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.895 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.895 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:08:43.896 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:08:43.896 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.896 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.896 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.896 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.897 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:08:43.897 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:08:43.897 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.897 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.897 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.897 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:08:43.897 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.897 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.898 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:08:43.898 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.898 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.898 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.898 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:08:43.898 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:08:43.898 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.898 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.898 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.899 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:08:43.899 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:08:43.899 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.899 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.899 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.899 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:08:43.900 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.900 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.900 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:08:43.900 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.900 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.900 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.900 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:08:43.900 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:08:43.900 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.900 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.900 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.901 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:08:43.901 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:08:43.901 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.901 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.901 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.901 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:08:43.901 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.901 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.902 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:08:43.902 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.902 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.902 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.902 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:08:43.902 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:08:43.902 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.902 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.902 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.902 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:08:43.903 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:08:43.903 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.903 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.903 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.903 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:08:43.903 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.903 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.903 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:08:43.903 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.903 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.903 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.904 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:08:43.904 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:08:43.904 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.904 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.904 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.904 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:08:43.904 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:08:43.904 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.905 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.905 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.905 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:08:43.905 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.905 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.905 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:08:43.905 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.905 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.906 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.906 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:08:43.906 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:08:43.906 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.906 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.906 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.906 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:08:43.906 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:08:43.907 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.907 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.907 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.907 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:08:43.907 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.907 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.907 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:08:43.907 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.907 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.907 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.908 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:08:43.908 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:08:43.908 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.908 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.908 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.908 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:08:43.908 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:08:43.908 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:08:43.908 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:08:43.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.908 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:08:43.909 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:08:43.909 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.909 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:08:43.909 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:08:43.909 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:08:43.910 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.910 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.910 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:08:43.910 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:08:43.910 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:08:43.911 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:08:43.911 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:08:43.911 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.911 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.911 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:08:43.911 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:08:43.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.911 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:43.912 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:43.912 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:43.912 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.912 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.912 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:08:43.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.912 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:43.912 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:43.912 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:43.913 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.913 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.913 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:08:43.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.913 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:43.913 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:43.913 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:08:43.913 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.913 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:08:43.913 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:08:43.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:08:43.913 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:08:43.913 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:08:43.914 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:08:43.914 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:08:43.914 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:08:43.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:08:43.914 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:08:43.914 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:08:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdad3eac640 1 -- 172.21.15.5:0/1774471774 >> v2:172.21.15.157:6812/631023601 conn(0x7fdab003bdf0 msgr2=0x7fdab003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdad3eac640 1 --2- 172.21.15.5:0/1774471774 >> v2:172.21.15.157:6812/631023601 conn(0x7fdab003bdf0 0x7fdab003e2b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdac40ab000 tx=0x7fdac40a7070 comp rx=0 tx=0).stop 2024-08-18T21:08:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdad3eac640 10 monclient: shutdown 2024-08-18T21:08:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdad3eac640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:08:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdad3eac640 1 -- 172.21.15.5:0/1774471774 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdacc09eb30 msgr2=0x7fdacc1d1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:08:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdad3eac640 1 --2- 172.21.15.5:0/1774471774 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdacc09eb30 0x7fdacc1d1490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdac000d800 tx=0x7fdac000dcc0 comp rx=0 tx=0).stop 2024-08-18T21:08:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdad2449640 1 -- 172.21.15.5:0/1774471774 reap_dead start 2024-08-18T21:08:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdad2449640 1 -- 172.21.15.5:0/1774471774 reap_dead start 2024-08-18T21:08:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdad3eac640 1 -- 172.21.15.5:0/1774471774 shutdown_connections 2024-08-18T21:08:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdad3eac640 1 -- 172.21.15.5:0/1774471774 >> 172.21.15.5:0/1774471774 conn(0x7fdacc0ace00 msgr2=0x7fdacc0a5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:08:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdad3eac640 1 -- 172.21.15.5:0/1774471774 shutdown_connections 2024-08-18T21:08:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:08:43.858+0000 7fdad3eac640 1 -- 172.21.15.5:0/1774471774 wait complete. 2024-08-18T21:08:43.916 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:08:43.917 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['h'] 2024-08-18T21:08:43.917 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a', 'b'] 2024-08-18T21:08:43.917 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.h 2024-08-18T21:08:43.917 INFO:tasks.mon_thrash.mon_thrasher:killing mon.h 2024-08-18T21:08:43.917 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2024-08-18T21:08:43.917 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:08:43.939 INFO:tasks.ceph.mon.h:Stopped 2024-08-18T21:08:43.939 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-18T21:08:43.939 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-18T21:08:43.940 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-08-18T21:08:43.940 INFO:tasks.ceph.mon.b:Sent signal 19 2024-08-18T21:08:43.940 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs to unfreeze mons 2024-08-18T21:08:59.219 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:59.219 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29823]: starting. 2024-08-18T21:08:59.220 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29823]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29788 2024-08-18T21:08:59.220 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29823]: created object 0... 2024-08-18T21:08:59.220 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29823]: created object 25... 2024-08-18T21:08:59.220 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29823]: created object 49... 2024-08-18T21:08:59.220 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29823]: finishing. 2024-08-18T21:08:59.220 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29823]: shutting down. 2024-08-18T21:08:59.276 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:08:59.276 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29825]: starting. 2024-08-18T21:08:59.276 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29825]: listing objects. 2024-08-18T21:08:59.276 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29825]: listed object 0... 2024-08-18T21:08:59.276 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29825]: listed object 25... 2024-08-18T21:08:59.276 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29825]: saw 50 objects 2024-08-18T21:08:59.276 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29825]: shutting down. 2024-08-18T21:09:00.010 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:00.011 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29824]: starting. 2024-08-18T21:09:00.011 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29824]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29788 2024-08-18T21:09:00.011 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29824]: shutting down. 2024-08-18T21:09:00.012 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:00.013 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:00.013 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:09:00.015 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:09:02.210 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29876]: starting. 2024-08-18T21:09:02.210 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29876]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29875 2024-08-18T21:09:02.211 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29876]: created object 0... 2024-08-18T21:09:02.211 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29876]: created object 25... 2024-08-18T21:09:02.211 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29876]: created object 49... 2024-08-18T21:09:02.211 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29876]: finishing. 2024-08-18T21:09:02.211 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29876]: shutting down. 2024-08-18T21:09:02.995 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29877]: starting. 2024-08-18T21:09:02.995 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29877]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29875 2024-08-18T21:09:02.996 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29877]: shutting down. 2024-08-18T21:09:03.940 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-18T21:09:03.941 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-18T21:09:03.941 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-08-18T21:09:03.941 INFO:tasks.ceph.mon.b:Sent signal 18 2024-08-18T21:09:03.941 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-08-18T21:09:03.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:09:04.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 10 monclient: get_monmap_and_config 2024-08-18T21:09:04.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 10 monclient: build_initial_monmap 2024-08-18T21:09:04.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 10 monclient: monmap: 2024-08-18T21:09:04.072 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:04.073170+0000 2024-08-18T21:09:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:04.073170+0000 2024-08-18T21:09:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:04.074 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:04.074 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:04.074 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:04.074 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:04.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 1 Processor -- start 2024-08-18T21:09:04.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 1 -- start start 2024-08-18T21:09:04.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 10 monclient: init 2024-08-18T21:09:04.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:04.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 10 monclient: _add_conns ranks=[8,2,1,4,6,9,10,5,3,7,0] 2024-08-18T21:09:04.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 0x7f04000a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:04.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 10 monclient(hunting): picked mon.noname-e con 0x7f04000a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:04.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 0x7f0400139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:04.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 10 monclient(hunting): picked mon.noname-b con 0x7f04000a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:04.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f0400139fe0 addr v1:172.21.15.157:6789/0 2024-08-18T21:09:04.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04000a45d0 con 0x7f0400139fe0 2024-08-18T21:09:04.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:04.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f04000a5000 con 0x7f04000a7600 2024-08-18T21:09:04.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:04.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f04000a32d0 con 0x7f04000a6ce0 2024-08-18T21:09:04.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:04.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f040624e640 10 monclient(hunting): authenticate will time out at 1311.086614s 2024-08-18T21:09:04.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03ff7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 0x7f04000a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:04.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03feffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 0x7f0400139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:04.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03ff7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 0x7f04000a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:58214/0 (socket says 172.21.15.5:58214) 2024-08-18T21:09:04.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03feffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 0x7f0400139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:36558/0 (socket says 172.21.15.5:36558) 2024-08-18T21:09:04.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 learned_addr learned my addr 172.21.15.5:0/2875530032 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:04.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request con 0x7f04000a6ce0 auth_method 0 2024-08-18T21:09:04.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:04.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03ff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:04.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03ff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:04.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03feffd640 10 monclient(hunting): get_auth_request con 0x7f04000a7600 auth_method 0 2024-08-18T21:09:04.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03feffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:04.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03feffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:04.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03feffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:04.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 msgr2=0x7f04000a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:09:04.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 msgr2=0x7f04000a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:09:04.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 0x7f04000a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:04.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03feffd640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 msgr2=0x7f0400139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:09:04.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03feffd640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 msgr2=0x7f0400139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:09:04.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03feffd640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 0x7f0400139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:04.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 0x7f04000a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:09:04.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.070+0000 7f03feffd640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 0x7f0400139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:09:04.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.074+0000 7f03fffff640 1 -- 172.21.15.5:0/2875530032 >> v1:172.21.15.157:6789/0 conn(0x7f0400139fe0 legacy=0x7f0400140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 0x7f04000a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request con 0x7f04000a6ce0 auth_method 0 2024-08-18T21:09:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03ff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03feffd640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 0x7f0400139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03ff7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:09:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03feffd640 10 monclient(hunting): get_auth_request con 0x7f04000a7600 auth_method 0 2024-08-18T21:09:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03feffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03feffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03feffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:09:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 msgr2=0x7f04000a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:09:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 msgr2=0x7f04000a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:09:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 0x7f04000a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03feffd640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 msgr2=0x7f0400139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:09:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03feffd640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 msgr2=0x7f0400139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:09:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 0x7f04000a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:09:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03feffd640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 0x7f0400139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.274+0000 7f03feffd640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 0x7f0400139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:09:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 0x7f04000a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03feffd640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 0x7f0400139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request con 0x7f04000a6ce0 auth_method 0 2024-08-18T21:09:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03ff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03ff7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:09:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03feffd640 10 monclient(hunting): get_auth_request con 0x7f04000a7600 auth_method 0 2024-08-18T21:09:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03feffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03feffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03feffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:09:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 msgr2=0x7f04000a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:09:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03feffd640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 msgr2=0x7f0400139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:09:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 msgr2=0x7f04000a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:09:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03feffd640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 msgr2=0x7f0400139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:09:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 0x7f04000a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03feffd640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 0x7f0400139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 0x7f04000a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:09:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:04.678+0000 7f03feffd640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 0x7f0400139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:09:05.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03feffd640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 0x7f0400139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:05.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 0x7f04000a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03feffd640 10 monclient(hunting): get_auth_request con 0x7f04000a7600 auth_method 0 2024-08-18T21:09:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03feffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03feffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03feffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:09:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request con 0x7f04000a6ce0 auth_method 0 2024-08-18T21:09:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03ff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03ff7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:09:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03feffd640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 msgr2=0x7f0400139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:09:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03feffd640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 msgr2=0x7f0400139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:09:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03feffd640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 0x7f0400139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 msgr2=0x7f04000a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:09:05.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 msgr2=0x7f04000a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:09:05.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 0x7f04000a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:05.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03feffd640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 0x7f0400139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:09:05.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:05.482+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 0x7f04000a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:09:07.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 10 monclient(hunting): tick 2024-08-18T21:09:07.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:09:07.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 1 monclient(hunting): continuing hunt 2024-08-18T21:09:07.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:09:07.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 msgr2=0x7f04000a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:09:07.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04000a6ce0 0x7f04000a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:07.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 msgr2=0x7f0400139aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:09:07.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04000a7600 0x7f0400139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:07.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 1 -- 172.21.15.5:0/2875530032 >> v1:172.21.15.157:6789/0 conn(0x7f0400139fe0 legacy=0x7f0400140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:07.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 10 monclient: _add_conns ranks=[6,5,9,10,7,0,4,3] 2024-08-18T21:09:07.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 0x7f03ec005ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:07.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 10 monclient(hunting): picked mon.noname-d con 0x7f03ec0038b0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:07.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f03ec006310 0x7f03ec0087a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:07.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 10 monclient(hunting): picked mon.noname-h con 0x7f03ec006310 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:07.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 0x7f03ec00b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:07.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 10 monclient(hunting): picked mon.noname-a con 0x7f03ec008e70 addr v2:172.21.15.5:3300/0 2024-08-18T21:09:07.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:07.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 1 -- 172.21.15.5:0/2875530032 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f04000a32d0 con 0x7f03ec008e70 2024-08-18T21:09:07.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:07.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 1 -- 172.21.15.5:0/2875530032 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f03ec00ba00 con 0x7f03ec006310 2024-08-18T21:09:07.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:07.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 1 -- 172.21.15.5:0/2875530032 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f03ec00bc00 con 0x7f03ec0038b0 2024-08-18T21:09:07.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fd7fa640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:07.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03feffd640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f03ec006310 msgr2=0x7f03ec0087a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3302/0 2024-08-18T21:09:07.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03feffd640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f03ec006310 0x7f03ec0087a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:09:07.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 0x7f03ec005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:07.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request con 0x7f03ec0038b0 auth_method 0 2024-08-18T21:09:07.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:07.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03ff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:07.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03ff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:07.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fffff640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 0x7f03ec00b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:07.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fffff640 10 monclient(hunting): get_auth_request con 0x7f03ec008e70 auth_method 0 2024-08-18T21:09:07.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:07.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:07.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:07.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 msgr2=0x7f03ec005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:09:07.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 msgr2=0x7f03ec005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:09:07.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 0x7f03ec005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:07.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fffff640 1 -- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 msgr2=0x7f03ec00b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:09:07.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fffff640 1 -- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 msgr2=0x7f03ec00b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:09:07.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fffff640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 0x7f03ec00b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:07.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 0x7f03ec005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:09:07.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.070+0000 7f03fffff640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 0x7f03ec00b330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:09:07.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 0x7f03ec005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:07.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03fffff640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 0x7f03ec00b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request con 0x7f03ec0038b0 auth_method 0 2024-08-18T21:09:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03ff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03ff7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:09:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03fffff640 10 monclient(hunting): get_auth_request con 0x7f03ec008e70 auth_method 0 2024-08-18T21:09:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03fffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03fffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:09:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03fffff640 1 -- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 msgr2=0x7f03ec00b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:09:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03fffff640 1 -- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 msgr2=0x7f03ec00b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:09:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03fffff640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 0x7f03ec00b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 msgr2=0x7f03ec005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:09:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 msgr2=0x7f03ec005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:09:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 0x7f03ec005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03fffff640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 0x7f03ec00b330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:09:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 0x7f03ec005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:09:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03feffd640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f03ec006310 msgr2=0x7f03ec0087a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3302/0 2024-08-18T21:09:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.274+0000 7f03feffd640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f03ec006310 0x7f03ec0087a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:09:07.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03feffd640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f03ec006310 msgr2=0x7f03ec0087a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3302/0 2024-08-18T21:09:07.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03feffd640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f03ec006310 0x7f03ec0087a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:09:07.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 0x7f03ec005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:07.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03fffff640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 0x7f03ec00b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:07.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request con 0x7f03ec0038b0 auth_method 0 2024-08-18T21:09:07.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03ff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03ff7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:09:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03fffff640 10 monclient(hunting): get_auth_request con 0x7f03ec008e70 auth_method 0 2024-08-18T21:09:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03fffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03fffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:09:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 msgr2=0x7f03ec005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:09:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 msgr2=0x7f03ec005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:09:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 0x7f03ec005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03fffff640 1 -- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 msgr2=0x7f03ec00b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:09:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03fffff640 1 -- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 msgr2=0x7f03ec00b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:09:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03fffff640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 0x7f03ec00b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 0x7f03ec005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:09:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:07.678+0000 7f03fffff640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 0x7f03ec00b330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:09:08.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03feffd640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f03ec006310 msgr2=0x7f03ec0087a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3302/0 2024-08-18T21:09:08.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03feffd640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f03ec006310 0x7f03ec0087a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:09:08.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 0x7f03ec005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:08.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03fffff640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 0x7f03ec00b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:08.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request con 0x7f03ec0038b0 auth_method 0 2024-08-18T21:09:08.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:08.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03ff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:08.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03ff7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:09:08.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03fffff640 10 monclient(hunting): get_auth_request con 0x7f03ec008e70 auth_method 0 2024-08-18T21:09:08.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:08.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03fffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:08.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03fffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:09:08.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03fffff640 1 -- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 msgr2=0x7f03ec00b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:09:08.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 msgr2=0x7f03ec005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:09:08.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03fffff640 1 -- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 msgr2=0x7f03ec00b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:09:08.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 msgr2=0x7f03ec005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:09:08.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03fffff640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 0x7f03ec00b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:08.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 0x7f03ec005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:08.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 0x7f03ec005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:09:08.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:08.482+0000 7f03fffff640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 0x7f03ec00b330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:09:10.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 10 monclient(hunting): tick 2024-08-18T21:09:10.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:09:10.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 1 monclient(hunting): continuing hunt 2024-08-18T21:09:10.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:09:10.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 msgr2=0x7f03ec005ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:09:10.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f03ec0038b0 0x7f03ec005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f03ec006310 msgr2=0x7f03ec0087a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:09:10.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f03ec006310 0x7f03ec0087a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 1 -- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 msgr2=0x7f03ec00b330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:09:10.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.5:3300/0 conn(0x7f03ec008e70 0x7f03ec00b330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fffff640 1 -- 172.21.15.5:0/2875530032 reap_dead start 2024-08-18T21:09:10.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 10 monclient: _add_conns ranks=[7,0,10,3,4] 2024-08-18T21:09:10.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fffff640 1 -- 172.21.15.5:0/2875530032 reap_dead start 2024-08-18T21:09:10.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f03ec003cd0 0x7f03ec006790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 10 monclient(hunting): picked mon.noname-i con 0x7f03ec003cd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:10.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f03ec006cd0 addr v1:172.21.15.5:6789/0 2024-08-18T21:09:10.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.157:3300/0 conn(0x7f03ec008810 0x7f03ec00e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 10 monclient(hunting): picked mon.noname-f con 0x7f03ec008810 addr v2:172.21.15.157:3300/0 2024-08-18T21:09:10.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 1 -- 172.21.15.5:0/2875530032 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04000a8900 con 0x7f03ec006cd0 2024-08-18T21:09:10.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 1 -- 172.21.15.5:0/2875530032 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f04000a32d0 con 0x7f03ec008810 2024-08-18T21:09:10.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 1 -- 172.21.15.5:0/2875530032 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f03ec00ba00 con 0x7f03ec003cd0 2024-08-18T21:09:10.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.070+0000 7f03fd7fa640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03fffff640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.157:3300/0 conn(0x7f03ec008810 0x7f03ec00e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f03ec003cd0 0x7f03ec006790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03fffff640 10 monclient(hunting): get_auth_request con 0x7f03ec008810 auth_method 0 2024-08-18T21:09:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03fffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03fffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request con 0x7f03ec003cd0 auth_method 0 2024-08-18T21:09:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 10 monclient(hunting): handle_auth_done global_id 5713 payload 274 2024-08-18T21:09:10.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> v2:172.21.15.157:3300/0 conn(0x7f03ec008810 msgr2=0x7f03ec00e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:10.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.157:3300/0 conn(0x7f03ec008810 0x7f03ec00e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> v1:172.21.15.5:6789/0 conn(0x7f03ec006cd0 legacy=0x7f03ec0070f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:10.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:09:10.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 1 monclient: found mon.noname-i 2024-08-18T21:09:10.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:10.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:09:10.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.074+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec00b3b0 con 0x7f03ec003cd0 2024-08-18T21:09:10.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f03ff7fe640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f03ec003cd0 msgr2=0x7f03ec006790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:10.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f03ec003cd0 0x7f03ec006790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009100 tx=0x7f03f001ddd0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=2b372c84b9bb5b6d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f03fe7fc640 1 -- 172.21.15.5:0/2875530032 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f03f000f040 con 0x7f03ec003cd0 2024-08-18T21:09:10.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f03fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f03fe7fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:09:10.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f03fe7fc640 10 monclient: dump: 2024-08-18T21:09:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.088 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f03fe7fc640 10 monclient: _finish_auth 0 2024-08-18T21:09:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f03fe7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:09:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f03fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f03fe7fc640 1 -- 172.21.15.5:0/2875530032 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f0004030 con 0x7f03ec003cd0 2024-08-18T21:09:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f03fe7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f040624e640 5 monclient: authenticate success, global_id 5713 2024-08-18T21:09:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f03fe7fc640 1 -- 172.21.15.5:0/2875530032 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f03f0003620 con 0x7f03ec003cd0 2024-08-18T21:09:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f03fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f03fe7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:09:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f03fe7fc640 10 monclient: dump: 2024-08-18T21:09:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.090 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.090 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f040624e640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:10.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f040624e640 4 set_mon_vals no callback set 2024-08-18T21:09:10.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f040624e640 10 monclient: shutdown 2024-08-18T21:09:10.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f040624e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:10.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f040624e640 1 -- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f03ec003cd0 msgr2=0x7f03ec006790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f040624e640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f03ec003cd0 0x7f03ec006790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009100 tx=0x7f03f001ddd0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f040624e640 1 -- 172.21.15.5:0/2875530032 shutdown_connections 2024-08-18T21:09:10.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f040624e640 1 --2- 172.21.15.5:0/2875530032 >> v2:172.21.15.157:3300/0 conn(0x7f03ec008810 0x7f03ec00e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f040624e640 1 --2- 172.21.15.5:0/2875530032 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f03ec003cd0 0x7f03ec006790 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f040624e640 1 -- 172.21.15.5:0/2875530032 >> 172.21.15.5:0/2875530032 conn(0x7f04000acbc0 msgr2=0x7f04000a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f040624e640 1 -- 172.21.15.5:0/2875530032 shutdown_connections 2024-08-18T21:09:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.082+0000 7f040624e640 1 -- 172.21.15.5:0/2875530032 wait complete. 2024-08-18T21:09:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 10 monclient: build_initial_monmap 2024-08-18T21:09:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 10 monclient: monmap: 2024-08-18T21:09:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:10.096 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:10.096 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:10.096 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:10.096 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:10.096 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:10.096 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:10.096 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 1 Processor -- start 2024-08-18T21:09:10.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 1 -- start start 2024-08-18T21:09:10.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 10 monclient: init 2024-08-18T21:09:10.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:10.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 10 monclient: _add_conns ranks=[0,8,7,3,1,4,2,6,5] 2024-08-18T21:09:10.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03ec003cd0 0x7f04001d1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 10 monclient(hunting): picked mon.noname-a con 0x7f03ec003cd0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:09:10.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f03ec006cd0 0x7f0400138c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 10 monclient(hunting): picked mon.noname-e con 0x7f03ec006cd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:10.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f03ec008810 0x7f04001391b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 10 monclient(hunting): picked mon.noname-i con 0x7f03ec008810 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:10.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f04000a79e0 con 0x7f03ec003cd0 2024-08-18T21:09:10.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f04000a8220 con 0x7f03ec008810 2024-08-18T21:09:10.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f04000a2340 con 0x7f03ec006cd0 2024-08-18T21:09:10.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:10.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f040624e640 10 monclient(hunting): authenticate will time out at 1317.101899s 2024-08-18T21:09:10.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f03ec006cd0 0x7f0400138c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03ff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03ec003cd0 0x7f04001d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f03ec006cd0 0x7f0400138c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:58240/0 (socket says 172.21.15.5:58240) 2024-08-18T21:09:10.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 1 -- 172.21.15.5:0/2193905710 learned_addr learned my addr 172.21.15.5:0/2193905710 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 10 monclient(hunting): get_auth_request con 0x7f03ec006cd0 auth_method 0 2024-08-18T21:09:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request con 0x7f03ec003cd0 auth_method 0 2024-08-18T21:09:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03ff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03ff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03fffff640 1 --2- 172.21.15.5:0/2193905710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f03ec008810 0x7f04001391b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03fffff640 10 monclient(hunting): get_auth_request con 0x7f03ec008810 auth_method 0 2024-08-18T21:09:10.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03fffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03fffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 10 monclient(hunting): handle_auth_done global_id 54944 payload 824 2024-08-18T21:09:10.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 1 -- 172.21.15.5:0/2193905710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f03ec008810 msgr2=0x7f04001391b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 1 --2- 172.21.15.5:0/2193905710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f03ec008810 0x7f04001391b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 1 -- 172.21.15.5:0/2193905710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03ec003cd0 msgr2=0x7f04001d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 1 --2- 172.21.15.5:0/2193905710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03ec003cd0 0x7f04001d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 10 monclient: _finish_hunting 0 2024-08-18T21:09:10.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 1 monclient: found mon.noname-e 2024-08-18T21:09:10.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:10.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:09:10.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.086+0000 7f03feffd640 1 -- 172.21.15.5:0/2193905710 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04000a1dc0 con 0x7f03ec006cd0 2024-08-18T21:09:10.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03feffd640 1 -- 172.21.15.5:0/2193905710 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f03ec006cd0 msgr2=0x7f0400138c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:10.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03feffd640 1 --2- 172.21.15.5:0/2193905710 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f03ec006cd0 0x7f0400138c70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f03f4000eb0 tx=0x7f03f4013d20 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03e7fff640 1 -- 172.21.15.5:0/2193905710 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f03f401a070 con 0x7f03ec006cd0 2024-08-18T21:09:10.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03e7fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:09:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03e7fff640 10 monclient: dump: 2024-08-18T21:09:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.108 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.108 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.108 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.108 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03e7fff640 10 monclient: _finish_auth 0 2024-08-18T21:09:10.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03e7fff640 10 monclient: _check_auth_tickets 2024-08-18T21:09:10.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:10.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03e7fff640 1 -- 172.21.15.5:0/2193905710 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f4013e50 con 0x7f03ec006cd0 2024-08-18T21:09:10.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03e7fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:10.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03e7fff640 1 -- 172.21.15.5:0/2193905710 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f03f400f040 con 0x7f03ec006cd0 2024-08-18T21:09:10.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f040624e640 5 monclient: authenticate success, global_id 54944 2024-08-18T21:09:10.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f040624e640 10 monclient: _renew_subs 2024-08-18T21:09:10.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f040624e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:10.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f040624e640 1 -- 172.21.15.5:0/2193905710 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04001242d0 con 0x7f03ec006cd0 2024-08-18T21:09:10.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03e7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:10.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03e7fff640 10 monclient: dump: 2024-08-18T21:09:10.111 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.111 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.111 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.111 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.111 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.111 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.112 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.112 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.112 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.112 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.112 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.112 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.113 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.113 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.113 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.113 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03fdffb640 4 set_mon_vals no callback set 2024-08-18T21:09:10.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f040624e640 10 monclient: _renew_subs 2024-08-18T21:09:10.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f040624e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:10.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f040624e640 1 -- 172.21.15.5:0/2193905710 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f0400126630 con 0x7f03ec006cd0 2024-08-18T21:09:10.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f040624e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:10.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f040624e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:10.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f040624e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:10.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f040624e640 1 -- 172.21.15.5:0/2193905710 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f040013a3c0 con 0x7f03ec006cd0 2024-08-18T21:09:10.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03e7fff640 1 -- 172.21.15.5:0/2193905710 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f03f401d070 con 0x7f03ec006cd0 2024-08-18T21:09:10.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03e7fff640 1 --2- 172.21.15.5:0/2193905710 >> v2:172.21.15.157:6812/631023601 conn(0x7f03ec03e290 0x7f03ec040750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.090+0000 7f03e7fff640 1 -- 172.21.15.5:0/2193905710 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(152..152 src has 22..152) ==== 3898+0+0 (secure 0 0 0) 0x7f03f404ef30 con 0x7f03ec006cd0 2024-08-18T21:09:10.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.094+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2193905710 >> v2:172.21.15.157:6812/631023601 conn(0x7f03ec03e290 0x7f03ec040750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.094+0000 7f03ff7fe640 10 monclient: get_auth_request con 0x7f03ec03e290 auth_method 0 2024-08-18T21:09:10.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.094+0000 7f03ff7fe640 1 --2- 172.21.15.5:0/2193905710 >> v2:172.21.15.157:6812/631023601 conn(0x7f03ec03e290 0x7f03ec040750 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f03f00ac000 tx=0x7f03f00a8070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.098+0000 7f03e7fff640 1 -- 172.21.15.5:0/2193905710 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f04000a1dc0 con 0x7f03ec006cd0 2024-08-18T21:09:10.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.098+0000 7f03e7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:10.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.098+0000 7f03e7fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:10.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.338+0000 7f040624e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:09:10.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.338+0000 7f040624e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:09:10.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.338+0000 7f040624e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:10.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.338+0000 7f040624e640 1 -- 172.21.15.5:0/2193905710 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0400069580 con 0x7f03ec006cd0 2024-08-18T21:09:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f03e7fff640 1 -- 172.21.15.5:0/2193905710 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3167 (secure 0 0 0) 0x7f03f40283e0 con 0x7f03ec006cd0 2024-08-18T21:09:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f03e7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:09:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f03e7fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:10.345 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":126,"quorum":[0,1,2,3,4,6,7,8],"quorum_names":["a","f","b","g","c","d","i","e"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:09:10.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f040624e640 1 -- 172.21.15.5:0/2193905710 >> v2:172.21.15.157:6812/631023601 conn(0x7f03ec03e290 msgr2=0x7f03ec040750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f040624e640 1 --2- 172.21.15.5:0/2193905710 >> v2:172.21.15.157:6812/631023601 conn(0x7f03ec03e290 0x7f03ec040750 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f03f00ac000 tx=0x7f03f00a8070 comp rx=0 tx=0).stop 2024-08-18T21:09:10.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f040624e640 10 monclient: shutdown 2024-08-18T21:09:10.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f040624e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:10.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f040624e640 1 -- 172.21.15.5:0/2193905710 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f03ec006cd0 msgr2=0x7f0400138c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f040624e640 1 --2- 172.21.15.5:0/2193905710 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f03ec006cd0 0x7f0400138c70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f03f4000eb0 tx=0x7f03f4013d20 comp rx=0 tx=0).stop 2024-08-18T21:09:10.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f040624e640 1 -- 172.21.15.5:0/2193905710 shutdown_connections 2024-08-18T21:09:10.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f040624e640 1 --2- 172.21.15.5:0/2193905710 >> v2:172.21.15.157:6812/631023601 conn(0x7f03ec03e290 0x7f03ec040750 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f040624e640 1 --2- 172.21.15.5:0/2193905710 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f03ec006cd0 0x7f0400138c70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f040624e640 1 --2- 172.21.15.5:0/2193905710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f03ec008810 0x7f04001391b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f040624e640 1 --2- 172.21.15.5:0/2193905710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03ec003cd0 0x7f04001d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f040624e640 1 -- 172.21.15.5:0/2193905710 >> 172.21.15.5:0/2193905710 conn(0x7f04000acbc0 msgr2=0x7f04000aac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:10.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f040624e640 1 -- 172.21.15.5:0/2193905710 shutdown_connections 2024-08-18T21:09:10.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.342+0000 7f040624e640 1 -- 172.21.15.5:0/2193905710 wait complete. 2024-08-18T21:09:10.364 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-08-18T21:09:10.364 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-08-18T21:09:10.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:09:10.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 10 monclient: get_monmap_and_config 2024-08-18T21:09:10.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 10 monclient: build_initial_monmap 2024-08-18T21:09:10.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 10 monclient: monmap: 2024-08-18T21:09:10.500 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:10.500 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.500 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:10.500644+0000 2024-08-18T21:09:10.500 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:10.500644+0000 2024-08-18T21:09:10.500 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:10.500 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.500 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:10.500 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:10.501 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:10.501 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:10.501 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:10.501 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:10.501 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:10.501 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:10.501 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:10.501 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:10.501 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:10.501 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 1 Processor -- start 2024-08-18T21:09:10.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 1 -- start start 2024-08-18T21:09:10.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 10 monclient: init 2024-08-18T21:09:10.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:10.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 10 monclient: _add_conns ranks=[0,4,7,2,6,8,5,1,10,3,9] 2024-08-18T21:09:10.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f13000a59e0 addr v1:172.21.15.5:6789/0 2024-08-18T21:09:10.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13000a64d0 0x7f130013cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 10 monclient(hunting): picked mon.noname-c con 0x7f13000a64d0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:10.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f130013cff0 0x7f130013f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 10 monclient(hunting): picked mon.noname-i con 0x7f130013cff0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:10.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13000a38b0 con 0x7f13000a59e0 2024-08-18T21:09:10.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f13000a0f40 con 0x7f13000a64d0 2024-08-18T21:09:10.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f13000a3010 con 0x7f130013cff0 2024-08-18T21:09:10.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:10.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f13057b6640 10 monclient(hunting): authenticate will time out at 1317.513788s 2024-08-18T21:09:10.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13000a64d0 0x7f130013cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13000a64d0 0x7f130013cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:47000/0 (socket says 172.21.15.5:47000) 2024-08-18T21:09:10.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 1 -- 172.21.15.5:0/4076853830 learned_addr learned my addr 172.21.15.5:0/4076853830 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:10.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 10 monclient(hunting): get_auth_request con 0x7f13000a64d0 auth_method 0 2024-08-18T21:09:10.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12feffd640 1 --1- 172.21.15.5:0/4076853830 >> v1:172.21.15.5:6789/0 conn(0x7f13000a59e0 0x7f13000a5dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37828/0 (socket says 172.21.15.5:37828) 2024-08-18T21:09:10.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12ff7fe640 1 --2- 172.21.15.5:0/4076853830 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f130013cff0 0x7f130013f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12ff7fe640 10 monclient(hunting): get_auth_request con 0x7f130013cff0 auth_method 0 2024-08-18T21:09:10.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12ff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12ff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 10 monclient(hunting): handle_auth_done global_id 5899 payload 274 2024-08-18T21:09:10.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 1 -- 172.21.15.5:0/4076853830 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f130013cff0 msgr2=0x7f130013f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:10.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 1 --2- 172.21.15.5:0/4076853830 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f130013cff0 0x7f130013f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 1 -- 172.21.15.5:0/4076853830 >> v1:172.21.15.5:6789/0 conn(0x7f13000a59e0 legacy=0x7f13000a5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:10.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:10.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 1 monclient: found mon.noname-c 2024-08-18T21:09:10.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:10.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:09:10.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.498+0000 7f12f7fff640 1 -- 172.21.15.5:0/4076853830 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13000a35d0 con 0x7f13000a64d0 2024-08-18T21:09:10.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f12f7fff640 1 -- 172.21.15.5:0/4076853830 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13000a64d0 msgr2=0x7f130013cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f12f7fff640 1 --2- 172.21.15.5:0/4076853830 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13000a64d0 0x7f130013cab0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f12e80098a0 tx=0x7f12e801c3a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=c00920df2e78f2ee server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f12fe7fc640 1 -- 172.21.15.5:0/4076853830 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12e80b2070 con 0x7f13000a64d0 2024-08-18T21:09:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f12fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f12fe7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:09:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f12fe7fc640 10 monclient: dump: 2024-08-18T21:09:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.532 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f12fe7fc640 10 monclient: _finish_auth 0 2024-08-18T21:09:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f12fe7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:09:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f12fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f13057b6640 5 monclient: authenticate success, global_id 5899 2024-08-18T21:09:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f13057b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f12fe7fc640 1 -- 172.21.15.5:0/4076853830 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e80ab7f0 con 0x7f13000a64d0 2024-08-18T21:09:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f12fe7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f13057b6640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f12fe7fc640 1 -- 172.21.15.5:0/4076853830 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12e80abe10 con 0x7f13000a64d0 2024-08-18T21:09:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f13057b6640 4 set_mon_vals no callback set 2024-08-18T21:09:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f12fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f12fe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.502+0000 7f12fe7fc640 10 monclient: dump: 2024-08-18T21:09:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.536 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.536 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.536 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.536 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.536 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.536 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.537 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.537 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.537 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.537 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.537 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.538 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 10 monclient: shutdown 2024-08-18T21:09:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 1 -- 172.21.15.5:0/4076853830 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13000a64d0 msgr2=0x7f130013cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 1 --2- 172.21.15.5:0/4076853830 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13000a64d0 0x7f130013cab0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f12e80098a0 tx=0x7f12e801c3a0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 1 -- 172.21.15.5:0/4076853830 shutdown_connections 2024-08-18T21:09:10.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 1 --2- 172.21.15.5:0/4076853830 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f130013cff0 0x7f130013f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 1 --2- 172.21.15.5:0/4076853830 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f13000a64d0 0x7f130013cab0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 1 -- 172.21.15.5:0/4076853830 >> 172.21.15.5:0/4076853830 conn(0x7f13000aa5d0 msgr2=0x7f13000a6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:10.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 1 -- 172.21.15.5:0/4076853830 shutdown_connections 2024-08-18T21:09:10.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 1 -- 172.21.15.5:0/4076853830 wait complete. 2024-08-18T21:09:10.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 10 monclient: build_initial_monmap 2024-08-18T21:09:10.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 10 monclient: monmap: 2024-08-18T21:09:10.540 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:10.540 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:10.540 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:10.541 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:10.541 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:10.541 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.541 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:10.541 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:10.541 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:10.543 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 1 Processor -- start 2024-08-18T21:09:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 1 -- start start 2024-08-18T21:09:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 10 monclient: init 2024-08-18T21:09:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 10 monclient: _add_conns ranks=[1,7,2,0,3,4,5,8,6] 2024-08-18T21:09:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13000a59e0 0x7f1300134760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 10 monclient(hunting): picked mon.noname-f con 0x7f13000a59e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:09:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13000a64d0 0x7f1300134ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 10 monclient(hunting): picked mon.noname-i con 0x7f13000a64d0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f130013cff0 0x7f13001351e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 10 monclient(hunting): picked mon.noname-b con 0x7f130013cff0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:10.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f13000a1d50 con 0x7f13000a59e0 2024-08-18T21:09:10.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f13000a1bd0 con 0x7f130013cff0 2024-08-18T21:09:10.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f1300142140 con 0x7f13000a64d0 2024-08-18T21:09:10.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:10.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f13057b6640 10 monclient(hunting): authenticate will time out at 1317.522002s 2024-08-18T21:09:10.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f130013cff0 0x7f13001351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f130013cff0 0x7f13001351e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:36606/0 (socket says 172.21.15.5:36606) 2024-08-18T21:09:10.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 1 -- 172.21.15.5:0/2601144784 learned_addr learned my addr 172.21.15.5:0/2601144784 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 10 monclient(hunting): get_auth_request con 0x7f130013cff0 auth_method 0 2024-08-18T21:09:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12feffd640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13000a59e0 0x7f1300134760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12f7fff640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13000a64d0 0x7f1300134ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12feffd640 10 monclient(hunting): get_auth_request con 0x7f13000a59e0 auth_method 0 2024-08-18T21:09:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12feffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12feffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12feffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12f7fff640 10 monclient(hunting): get_auth_request con 0x7f13000a64d0 auth_method 0 2024-08-18T21:09:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12f7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12f7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12f7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 10 monclient(hunting): handle_auth_done global_id 84287 payload 824 2024-08-18T21:09:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 1 -- 172.21.15.5:0/2601144784 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13000a64d0 msgr2=0x7f1300134ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13000a64d0 0x7f1300134ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 1 -- 172.21.15.5:0/2601144784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13000a59e0 msgr2=0x7f1300134760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13000a59e0 0x7f1300134760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:09:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 1 monclient: found mon.noname-b 2024-08-18T21:09:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:09:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12ff7fe640 1 -- 172.21.15.5:0/2601144784 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1300139420 con 0x7f130013cff0 2024-08-18T21:09:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.506+0000 7f12feffd640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13000a59e0 0x7f1300134760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:09:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12ff7fe640 1 -- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f130013cff0 msgr2=0x7f13001351e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12ff7fe640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f130013cff0 0x7f13001351e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009cb0 tx=0x7f12f800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f77fe640 1 -- 172.21.15.5:0/2601144784 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12f8018020 con 0x7f130013cff0 2024-08-18T21:09:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:09:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f77fe640 10 monclient: dump: 2024-08-18T21:09:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.551 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f77fe640 10 monclient: _finish_auth 0 2024-08-18T21:09:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f77fe640 10 monclient: _check_auth_tickets 2024-08-18T21:09:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f13057b6640 5 monclient: authenticate success, global_id 84287 2024-08-18T21:09:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f77fe640 1 -- 172.21.15.5:0/2601144784 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f80148f0 con 0x7f130013cff0 2024-08-18T21:09:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f13057b6640 10 monclient: _renew_subs 2024-08-18T21:09:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f13057b6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f13057b6640 1 -- 172.21.15.5:0/2601144784 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f130013aee0 con 0x7f130013cff0 2024-08-18T21:09:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f77fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f77fe640 1 -- 172.21.15.5:0/2601144784 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12f80133e0 con 0x7f130013cff0 2024-08-18T21:09:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12fdffb640 4 set_mon_vals no callback set 2024-08-18T21:09:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f77fe640 10 monclient: dump: 2024-08-18T21:09:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.553 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f13057b6640 10 monclient: _renew_subs 2024-08-18T21:09:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f13057b6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f13057b6640 1 -- 172.21.15.5:0/2601144784 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1300139f80 con 0x7f130013cff0 2024-08-18T21:09:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f13057b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f13057b6640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130013bf00 0x7f1300137b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f13057b6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f13057b6640 1 -- 172.21.15.5:0/2601144784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1300051140 con 0x7f130013bf00 2024-08-18T21:09:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12feffd640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130013bf00 0x7f1300137b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12feffd640 10 monclient: get_auth_request con 0x7f130013bf00 auth_method 0 2024-08-18T21:09:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12feffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12feffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12feffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12feffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12feffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12feffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f77fe640 1 -- 172.21.15.5:0/2601144784 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f12f801b020 con 0x7f130013cff0 2024-08-18T21:09:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12feffd640 10 monclient(hunting): handle_auth_done global_id 84267 payload 824 2024-08-18T21:09:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12feffd640 1 -- 172.21.15.5:0/2601144784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f130013a1b0 con 0x7f130013bf00 2024-08-18T21:09:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f77fe640 1 --2- 172.21.15.5:0/2601144784 >> v2:172.21.15.157:6812/631023601 conn(0x7f12e003bdc0 0x7f12e003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f77fe640 1 -- 172.21.15.5:0/2601144784 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(153..153 src has 22..153) ==== 3898+0+0 (secure 0 0 0) 0x7f12f804f440 con 0x7f130013cff0 2024-08-18T21:09:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f7fff640 1 --2- 172.21.15.5:0/2601144784 >> v2:172.21.15.157:6812/631023601 conn(0x7f12e003bdc0 0x7f12e003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.510+0000 7f12f7fff640 10 monclient: get_auth_request con 0x7f12e003bdc0 auth_method 0 2024-08-18T21:09:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.514+0000 7f12feffd640 1 -- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130013bf00 msgr2=0x7f1300137b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.514+0000 7f12feffd640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130013bf00 0x7f1300137b00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f12f000e520 tx=0x7f12f000e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.514+0000 7f12f77fe640 1 -- 172.21.15.5:0/2601144784 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12f00074f0 con 0x7f130013bf00 2024-08-18T21:09:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.514+0000 7f12f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.514+0000 7f12f77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:09:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.514+0000 7f12f77fe640 10 monclient: dump: 2024-08-18T21:09:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.557 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.514+0000 7f12f77fe640 1 -- 172.21.15.5:0/2601144784 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f12f0018070 con 0x7f130013bf00 2024-08-18T21:09:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.514+0000 7f12f77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.514+0000 7f12f77fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.514+0000 7f12f77fe640 1 -- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130013bf00 msgr2=0x7f1300137b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.514+0000 7f12f77fe640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130013bf00 0x7f1300137b00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f12f000e520 tx=0x7f12f000e9e0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.514+0000 7f12f77fe640 1 -- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130013bf00 msgr2=0x7f1300137b00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.514+0000 7f12f77fe640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130013bf00 0x7f1300137b00 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f12f000e520 tx=0x7f12f000e9e0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.514+0000 7f12f7fff640 1 --2- 172.21.15.5:0/2601144784 >> v2:172.21.15.157:6812/631023601 conn(0x7f12e003bdc0 0x7f12e003e280 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f13000a1190 tx=0x7f12e8008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f13057b6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f13057b6640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1300138040 0x7f1300138450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f13057b6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f13057b6640 1 -- 172.21.15.5:0/2601144784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f13000a5420 con 0x7f1300138040 2024-08-18T21:09:10.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12feffd640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1300138040 0x7f1300138450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12feffd640 10 monclient: get_auth_request con 0x7f1300138040 auth_method 0 2024-08-18T21:09:10.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12feffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12feffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12feffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12feffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12feffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12feffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12feffd640 10 monclient(hunting): handle_auth_done global_id 84276 payload 824 2024-08-18T21:09:10.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12feffd640 1 -- 172.21.15.5:0/2601144784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1300138990 con 0x7f1300138040 2024-08-18T21:09:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12feffd640 1 -- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1300138040 msgr2=0x7f1300138450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12feffd640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1300138040 0x7f1300138450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f12f0004cf0 tx=0x7f12f0004940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12f77fe640 1 -- 172.21.15.5:0/2601144784 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12f001de40 con 0x7f1300138040 2024-08-18T21:09:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12f77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:09:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12f77fe640 10 monclient: dump: 2024-08-18T21:09:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.560 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.560 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.560 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.560 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.560 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.560 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.560 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.560 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.560 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.560 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12f77fe640 1 -- 172.21.15.5:0/2601144784 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9238 (secure 0 0 0) 0x7f12f0005e00 con 0x7f1300138040 2024-08-18T21:09:10.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12f77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12f77fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12f77fe640 1 -- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1300138040 msgr2=0x7f1300138450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12f77fe640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1300138040 0x7f1300138450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f12f0004cf0 tx=0x7f12f0004940 comp rx=0 tx=0).stop 2024-08-18T21:09:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12f77fe640 1 -- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1300138040 msgr2=0x7f1300138450 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12f77fe640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1300138040 0x7f1300138450 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f12f0004cf0 tx=0x7f12f0004940 comp rx=0 tx=0).stop 2024-08-18T21:09:10.561 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:10.561 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:10.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:10.562 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:09:10.562 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 126, 2024-08-18T21:09:10.562 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 47355, 2024-08-18T21:09:10.562 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:10.562 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:10.562 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:10.562 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:10.562 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:10.562 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:10.562 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:10.562 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:10.563 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:10.563 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:10.563 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:09:10.563 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:10.563 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:10.563 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:10.563 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:10.563 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:10.563 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:10.563 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:10.563 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:10.563 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:10.563 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:10.564 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:10.564 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:10.564 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:10.564 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:10.564 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:10.564 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:10.564 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:10.564 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:10.564 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:10.564 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:10.564 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:10.564 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:10.564 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:10.565 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:10.565 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:10.565 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:10.565 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:10.565 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:10.565 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.565 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:10.565 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:10.565 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:10.565 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:10.565 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:10.565 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:10.566 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:10.566 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:10.566 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:10.566 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:10.566 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:10.566 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:10.566 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:10.566 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:10.566 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:10.566 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:10.566 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:10.566 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:10.566 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:10.570 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:10.570 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:10.570 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:10.570 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:10.570 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:10.570 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:10.570 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:10.570 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:10.570 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:10.570 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:10.571 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:10.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.571 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:10.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.571 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:10.571 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:10.571 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.571 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:10.571 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.572 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.572 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:10.572 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.572 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.572 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.572 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:10.572 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:10.572 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.572 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.572 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.573 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:10.573 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:10.573 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.573 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.573 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.573 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:10.573 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.574 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:10.574 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.574 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.574 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:10.574 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:10.574 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.574 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.574 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.575 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:10.575 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:10.575 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.575 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.575 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:10.575 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:10.576 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.576 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.576 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:10.576 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:10.576 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.576 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.576 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.576 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:10.577 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:10.577 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:10.577 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:10.577 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.578 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.578 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.578 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:10.578 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:10.578 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.578 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.578 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.578 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:10.579 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:10.579 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.579 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.579 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.579 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:10.579 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.579 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.579 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:10.579 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.580 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.580 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.580 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:10.580 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:10.580 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.580 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.580 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.580 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:10.581 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:10.581 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.581 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:10.581 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:10.582 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.582 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.582 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:10.582 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:10.582 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.582 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.583 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.583 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:10.583 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:10.583 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.583 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:10.583 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.584 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:10.584 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.584 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:10.584 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:10.584 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.584 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.584 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.585 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:10.585 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:10.585 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.585 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.585 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.585 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:10.585 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.585 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.585 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:10.586 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.586 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.586 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.586 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:10.586 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:10.586 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.586 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.586 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.586 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:10.586 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:10.587 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.587 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.587 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.587 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.587 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:10.587 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.587 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.587 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.587 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:10.587 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.588 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.588 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.588 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:10.588 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:10.588 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.588 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.588 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.588 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.588 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.588 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:10.588 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:10.588 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.589 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:10.589 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:10.589 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:10.589 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.589 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:10.589 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:10.589 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.589 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:10.589 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:10.589 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:10.589 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.589 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.590 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:10.590 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:10.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f13057b6640 1 -- 172.21.15.5:0/2601144784 >> v2:172.21.15.157:6812/631023601 conn(0x7f12e003bdc0 msgr2=0x7f12e003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f13057b6640 1 --2- 172.21.15.5:0/2601144784 >> v2:172.21.15.157:6812/631023601 conn(0x7f12e003bdc0 0x7f12e003e280 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f13000a1190 tx=0x7f12e8008040 comp rx=0 tx=0).stop 2024-08-18T21:09:10.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f13057b6640 10 monclient: shutdown 2024-08-18T21:09:10.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f13057b6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:10.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f13057b6640 1 -- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f130013cff0 msgr2=0x7f13001351e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f13057b6640 1 --2- 172.21.15.5:0/2601144784 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f130013cff0 0x7f13001351e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009cb0 tx=0x7f12f800c490 comp rx=0 tx=0).stop 2024-08-18T21:09:10.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12ff7fe640 1 -- 172.21.15.5:0/2601144784 reap_dead start 2024-08-18T21:09:10.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f12ff7fe640 1 -- 172.21.15.5:0/2601144784 reap_dead start 2024-08-18T21:09:10.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f13057b6640 1 -- 172.21.15.5:0/2601144784 shutdown_connections 2024-08-18T21:09:10.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.522+0000 7f13057b6640 1 -- 172.21.15.5:0/2601144784 >> 172.21.15.5:0/2601144784 conn(0x7f13000aa5d0 msgr2=0x7f130009fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:10.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.526+0000 7f13057b6640 1 -- 172.21.15.5:0/2601144784 shutdown_connections 2024-08-18T21:09:10.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.526+0000 7f13057b6640 1 -- 172.21.15.5:0/2601144784 wait complete. 2024-08-18T21:09:10.592 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-18T21:09:10.593 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon b 2024-08-18T21:09:10.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:09:10.605 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:10.605 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29912]: starting. 2024-08-18T21:09:10.605 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29912]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29875 2024-08-18T21:09:10.605 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29912]: created object 0... 2024-08-18T21:09:10.605 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29912]: created object 25... 2024-08-18T21:09:10.605 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29912]: created object 49... 2024-08-18T21:09:10.605 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29912]: finishing. 2024-08-18T21:09:10.605 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[29912]: shutting down. 2024-08-18T21:09:10.654 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:10.654 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29914]: starting. 2024-08-18T21:09:10.654 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29914]: listing objects. 2024-08-18T21:09:10.654 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29914]: listed object 0... 2024-08-18T21:09:10.655 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29914]: listed object 25... 2024-08-18T21:09:10.655 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29914]: saw 50 objects 2024-08-18T21:09:10.655 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[29914]: shutting down. 2024-08-18T21:09:10.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 10 monclient: get_monmap_and_config 2024-08-18T21:09:10.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 10 monclient: build_initial_monmap 2024-08-18T21:09:10.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 10 monclient: monmap: 2024-08-18T21:09:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:10.713269+0000 2024-08-18T21:09:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:10.713269+0000 2024-08-18T21:09:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:10.714 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 1 Processor -- start 2024-08-18T21:09:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 1 -- start start 2024-08-18T21:09:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 10 monclient: init 2024-08-18T21:09:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 10 monclient: _add_conns ranks=[1,5,9,8,10,0,7,6,4,3,2] 2024-08-18T21:09:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f4900068700 addr v1:172.21.15.157:6789/0 2024-08-18T21:09:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f49000691f0 0x7f4900073530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 10 monclient(hunting): picked mon.noname-h con 0x7f49000691f0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f490013ed00 0x7f49001410f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 10 monclient(hunting): picked mon.noname-a con 0x7f490013ed00 addr v2:172.21.15.5:3300/0 2024-08-18T21:09:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f490009efb0 con 0x7f4900068700 2024-08-18T21:09:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f49000a1af0 con 0x7f490013ed00 2024-08-18T21:09:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f490009de70 con 0x7f49000691f0 2024-08-18T21:09:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f4905cf3640 10 monclient(hunting): authenticate will time out at 1317.726482s 2024-08-18T21:09:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48feffd640 1 -- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f49000691f0 msgr2=0x7f4900073530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3302/0 2024-08-18T21:09:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48feffd640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f49000691f0 0x7f4900073530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:09:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f490013ed00 0x7f49001410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f490013ed00 0x7f49001410f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46256/0 (socket says 172.21.15.5:46256) 2024-08-18T21:09:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 1 -- 172.21.15.5:0/2971449325 learned_addr learned my addr 172.21.15.5:0/2971449325 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 10 monclient(hunting): get_auth_request con 0x7f490013ed00 auth_method 0 2024-08-18T21:09:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 10 monclient(hunting): handle_auth_done global_id 84285 payload 274 2024-08-18T21:09:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 1 -- 172.21.15.5:0/2971449325 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f49000691f0 msgr2=0x7f4900073530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:09:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 1 --2- 172.21.15.5:0/2971449325 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f49000691f0 0x7f4900073530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 1 -- 172.21.15.5:0/2971449325 >> v1:172.21.15.157:6789/0 conn(0x7f4900068700 legacy=0x7f4900068ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 1 monclient: found mon.noname-a 2024-08-18T21:09:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:09:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.710+0000 7f48fffff640 1 -- 172.21.15.5:0/2971449325 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490009e150 con 0x7f490013ed00 2024-08-18T21:09:10.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f48fffff640 1 -- 172.21.15.5:0/2971449325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f490013ed00 msgr2=0x7f49001410f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:10.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f48fffff640 1 --2- 172.21.15.5:0/2971449325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f490013ed00 0x7f49001410f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009e50 tx=0x7f48f801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c959606cf2faf3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f48fe7fc640 1 -- 172.21.15.5:0/2971449325 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f48f80090d0 con 0x7f490013ed00 2024-08-18T21:09:10.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f48fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f48fe7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:09:10.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f48fe7fc640 10 monclient: dump: 2024-08-18T21:09:10.724 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.724 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.724 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.724 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.724 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.724 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.724 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.724 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.724 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.724 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.725 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f48fe7fc640 10 monclient: _finish_auth 0 2024-08-18T21:09:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f48fe7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:09:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f48fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f4905cf3640 5 monclient: authenticate success, global_id 84285 2024-08-18T21:09:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f4905cf3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f48fe7fc640 1 -- 172.21.15.5:0/2971449325 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f80a5ad0 con 0x7f490013ed00 2024-08-18T21:09:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f48fe7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f4905cf3640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f4905cf3640 4 set_mon_vals no callback set 2024-08-18T21:09:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f48fe7fc640 1 -- 172.21.15.5:0/2971449325 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f48f80a5c80 con 0x7f490013ed00 2024-08-18T21:09:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f48fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f48fe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:09:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.714+0000 7f48fe7fc640 10 monclient: dump: 2024-08-18T21:09:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.727 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 10 monclient: shutdown 2024-08-18T21:09:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 1 -- 172.21.15.5:0/2971449325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f490013ed00 msgr2=0x7f49001410f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 1 --2- 172.21.15.5:0/2971449325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f490013ed00 0x7f49001410f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009e50 tx=0x7f48f801c910 comp rx=0 tx=0).stop 2024-08-18T21:09:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 1 -- 172.21.15.5:0/2971449325 shutdown_connections 2024-08-18T21:09:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 1 --2- 172.21.15.5:0/2971449325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f490013ed00 0x7f49001410f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 1 --2- 172.21.15.5:0/2971449325 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f49000691f0 0x7f4900073530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 1 -- 172.21.15.5:0/2971449325 >> 172.21.15.5:0/2971449325 conn(0x7f49000a8020 msgr2=0x7f49000a8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 1 -- 172.21.15.5:0/2971449325 shutdown_connections 2024-08-18T21:09:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 1 -- 172.21.15.5:0/2971449325 wait complete. 2024-08-18T21:09:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 10 monclient: build_initial_monmap 2024-08-18T21:09:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 10 monclient: monmap: 2024-08-18T21:09:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:10.729 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 1 Processor -- start 2024-08-18T21:09:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 1 -- start start 2024-08-18T21:09:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 10 monclient: init 2024-08-18T21:09:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 10 monclient: _add_conns ranks=[6,4,2,3,0,8,5,1,7] 2024-08-18T21:09:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4900068700 0x7f490011fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 10 monclient(hunting): picked mon.noname-d con 0x7f4900068700 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f49000691f0 0x7f4900136990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 10 monclient(hunting): picked mon.noname-c con 0x7f49000691f0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f490013ed00 0x7f490011e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 10 monclient(hunting): picked mon.noname-b con 0x7f490013ed00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f49001441e0 con 0x7f490013ed00 2024-08-18T21:09:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f4900144060 con 0x7f49000691f0 2024-08-18T21:09:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f4900144360 con 0x7f4900068700 2024-08-18T21:09:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f4905cf3640 10 monclient(hunting): authenticate will time out at 1317.733714s 2024-08-18T21:09:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48ff7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4900068700 0x7f490011fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48feffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f49000691f0 0x7f4900136990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48ff7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4900068700 0x7f490011fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54790/0 (socket says 172.21.15.5:54790) 2024-08-18T21:09:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48ff7fe640 1 -- 172.21.15.5:0/673454622 learned_addr learned my addr 172.21.15.5:0/673454622 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48ff7fe640 10 monclient(hunting): get_auth_request con 0x7f4900068700 auth_method 0 2024-08-18T21:09:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48ff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48ff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f490013ed00 0x7f490011e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48feffd640 10 monclient(hunting): get_auth_request con 0x7f49000691f0 auth_method 0 2024-08-18T21:09:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48feffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48feffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48feffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 10 monclient(hunting): get_auth_request con 0x7f490013ed00 auth_method 0 2024-08-18T21:09:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48feffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48feffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48feffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 10 monclient(hunting): handle_auth_done global_id 84296 payload 824 2024-08-18T21:09:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 1 -- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4900068700 msgr2=0x7f490011fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4900068700 0x7f490011fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 1 -- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f49000691f0 msgr2=0x7f4900136990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f49000691f0 0x7f4900136990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 1 monclient: found mon.noname-b 2024-08-18T21:09:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:10.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:09:10.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48fffff640 1 -- 172.21.15.5:0/673454622 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49000a5270 con 0x7f490013ed00 2024-08-18T21:09:10.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48ff7fe640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4900068700 0x7f490011fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:10.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.718+0000 7f48feffd640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f49000691f0 0x7f4900136990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:10.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48fffff640 1 -- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f490013ed00 msgr2=0x7f490011e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:10.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48fffff640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f490013ed00 0x7f490011e670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f48f80ae000 tx=0x7f48f80196b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48e7fff640 1 -- 172.21.15.5:0/673454622 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f48f80bb020 con 0x7f490013ed00 2024-08-18T21:09:10.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48e7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:09:10.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48e7fff640 10 monclient: dump: 2024-08-18T21:09:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.740 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48e7fff640 10 monclient: _finish_auth 0 2024-08-18T21:09:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48e7fff640 10 monclient: _check_auth_tickets 2024-08-18T21:09:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48e7fff640 1 -- 172.21.15.5:0/673454622 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f80044b0 con 0x7f490013ed00 2024-08-18T21:09:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48e7fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48e7fff640 1 -- 172.21.15.5:0/673454622 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f48f8004660 con 0x7f490013ed00 2024-08-18T21:09:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48e7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48e7fff640 10 monclient: dump: 2024-08-18T21:09:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.742 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48fd7fa640 4 set_mon_vals no callback set 2024-08-18T21:09:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f4905cf3640 5 monclient: authenticate success, global_id 84296 2024-08-18T21:09:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f4905cf3640 10 monclient: _renew_subs 2024-08-18T21:09:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f4905cf3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f4905cf3640 1 -- 172.21.15.5:0/673454622 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49001d2210 con 0x7f490013ed00 2024-08-18T21:09:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f4905cf3640 10 monclient: _renew_subs 2024-08-18T21:09:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f4905cf3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f4905cf3640 1 -- 172.21.15.5:0/673454622 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4900120d60 con 0x7f490013ed00 2024-08-18T21:09:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f4905cf3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f4905cf3640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4900136ed0 0x7f490011ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f4905cf3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f4905cf3640 1 -- 172.21.15.5:0/673454622 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f4900051140 con 0x7f4900136ed0 2024-08-18T21:09:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48e7fff640 1 -- 172.21.15.5:0/673454622 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f48f80be020 con 0x7f490013ed00 2024-08-18T21:09:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48ff7fe640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4900136ed0 0x7f490011ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48ff7fe640 10 monclient: get_auth_request con 0x7f4900136ed0 auth_method 0 2024-08-18T21:09:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48ff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48ff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48e7fff640 1 --2- 172.21.15.5:0/673454622 >> v2:172.21.15.157:6812/631023601 conn(0x7f48ec03bdf0 0x7f48ec03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48ff7fe640 10 monclient(hunting): handle_auth_done global_id 84305 payload 824 2024-08-18T21:09:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48ff7fe640 1 -- 172.21.15.5:0/673454622 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4900073530 con 0x7f4900136ed0 2024-08-18T21:09:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48e7fff640 1 -- 172.21.15.5:0/673454622 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(153..153 src has 22..153) ==== 3898+0+0 (secure 0 0 0) 0x7f48f80e9740 con 0x7f490013ed00 2024-08-18T21:09:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48feffd640 1 --2- 172.21.15.5:0/673454622 >> v2:172.21.15.157:6812/631023601 conn(0x7f48ec03bdf0 0x7f48ec03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.722+0000 7f48feffd640 10 monclient: get_auth_request con 0x7f48ec03bdf0 auth_method 0 2024-08-18T21:09:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.726+0000 7f48ff7fe640 1 -- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4900136ed0 msgr2=0x7f490011ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.726+0000 7f48ff7fe640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4900136ed0 0x7f490011ebb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f48f000fb10 tx=0x7f48f00045a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.726+0000 7f48e7fff640 1 -- 172.21.15.5:0/673454622 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f48f0018030 con 0x7f4900136ed0 2024-08-18T21:09:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.726+0000 7f48e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.726+0000 7f48e7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.726+0000 7f48e7fff640 10 monclient: dump: 2024-08-18T21:09:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.745 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.726+0000 7f48e7fff640 1 -- 172.21.15.5:0/673454622 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f48f000de50 con 0x7f4900136ed0 2024-08-18T21:09:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.726+0000 7f48e7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.726+0000 7f48e7fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.726+0000 7f48e7fff640 1 -- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4900136ed0 msgr2=0x7f490011ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.726+0000 7f48e7fff640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4900136ed0 0x7f490011ebb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f48f000fb10 tx=0x7f48f00045a0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.726+0000 7f48e7fff640 1 -- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4900136ed0 msgr2=0x7f490011ebb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.726+0000 7f48e7fff640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4900136ed0 0x7f490011ebb0 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f48f000fb10 tx=0x7f48f00045a0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.726+0000 7f48feffd640 1 --2- 172.21.15.5:0/673454622 >> v2:172.21.15.157:6812/631023601 conn(0x7f48ec03bdf0 0x7f48ec03e2b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f48f4006e50 tx=0x7f48f4006da0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.730+0000 7f4905cf3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.730+0000 7f4905cf3640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f49001d1350 0x7f490011f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.730+0000 7f4905cf3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.730+0000 7f4905cf3640 1 -- 172.21.15.5:0/673454622 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f4900120f30 con 0x7f49001d1350 2024-08-18T21:09:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.730+0000 7f48ff7fe640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f49001d1350 0x7f490011f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.730+0000 7f48ff7fe640 10 monclient: get_auth_request con 0x7f49001d1350 auth_method 0 2024-08-18T21:09:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.730+0000 7f48ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.730+0000 7f48ff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.730+0000 7f48ff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.730+0000 7f48ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.730+0000 7f48ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.730+0000 7f48ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.730+0000 7f48ff7fe640 10 monclient(hunting): handle_auth_done global_id 84314 payload 824 2024-08-18T21:09:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.730+0000 7f48ff7fe640 1 -- 172.21.15.5:0/673454622 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f490013e640 con 0x7f49001d1350 2024-08-18T21:09:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f48ff7fe640 1 -- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f49001d1350 msgr2=0x7f490011f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f48ff7fe640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f49001d1350 0x7f490011f0f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f48f0018000 tx=0x7f48f0007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f48e7fff640 1 -- 172.21.15.5:0/673454622 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f48f0004a10 con 0x7f49001d1350 2024-08-18T21:09:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f48e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f48e7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f48e7fff640 10 monclient: dump: 2024-08-18T21:09:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.749 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f48e7fff640 1 -- 172.21.15.5:0/673454622 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9236 (secure 0 0 0) 0x7f48f00045a0 con 0x7f49001d1350 2024-08-18T21:09:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f48e7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f48e7fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f48e7fff640 1 -- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f49001d1350 msgr2=0x7f490011f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f48e7fff640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f49001d1350 0x7f490011f0f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f48f0018000 tx=0x7f48f0007f90 comp rx=0 tx=0).stop 2024-08-18T21:09:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f48e7fff640 1 -- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f49001d1350 msgr2=0x7f490011f0f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f48e7fff640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f49001d1350 0x7f490011f0f0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f48f0018000 tx=0x7f48f0007f90 comp rx=0 tx=0).stop 2024-08-18T21:09:10.749 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:10.750 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:10.750 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:10.750 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:10.750 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 126, 2024-08-18T21:09:10.750 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 47563, 2024-08-18T21:09:10.750 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:10.750 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:10.750 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:10.750 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:10.750 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:10.750 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:10.750 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:10.751 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:10.751 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:10.751 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:10.751 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:09:10.751 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:10.751 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:10.751 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:10.751 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:10.751 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:10.751 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:10.751 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:10.751 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:10.751 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:10.752 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:10.752 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:10.752 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:10.752 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:10.752 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:10.752 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:10.752 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:10.752 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:10.752 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:10.752 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:10.752 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:10.752 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:10.753 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:10.753 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:10.753 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:10.753 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:10.753 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:10.753 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:10.753 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:10.753 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.753 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:10.753 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:10.753 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:10.753 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:10.753 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:10.754 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:10.754 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:10.754 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:10.754 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:10.754 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:10.754 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:10.754 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:10.754 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:10.754 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:10.754 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:10.754 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:10.754 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:10.755 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:10.755 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:10.755 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:10.755 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:10.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:10.755 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:10.755 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:10.755 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:10.755 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:10.755 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:10.755 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:10.755 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:10.755 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:10.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.756 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:10.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.756 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:10.756 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:10.756 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.756 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:10.756 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:10.757 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.757 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.757 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:10.757 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:10.757 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.757 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.757 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.757 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:10.758 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:10.758 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:10.758 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:10.758 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.759 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.759 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:10.759 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:10.759 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.759 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.759 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.759 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:10.759 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:10.759 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:10.760 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:10.760 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.760 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.761 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:10.761 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:10.761 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.761 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.761 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.761 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:10.761 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:10.761 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.761 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.761 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.762 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:10.762 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.762 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.762 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:10.762 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.762 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.762 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.762 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:10.762 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:10.763 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.763 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.763 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.763 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.763 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.763 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:10.763 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:10.763 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.763 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.763 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.763 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.763 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:10.763 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.764 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.764 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:10.764 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.764 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.764 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.764 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:10.764 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:10.764 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.764 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.764 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.765 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:10.765 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:10.765 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.765 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.765 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.765 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:10.765 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.765 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.766 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:10.766 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.766 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.766 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.766 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:10.766 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:10.766 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.766 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.766 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.766 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:10.767 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:10.767 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.767 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.767 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.767 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:10.767 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.767 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.767 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:10.767 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.767 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.768 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.768 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:10.768 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:10.768 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.768 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.768 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.768 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:10.768 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:10.768 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.768 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.769 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.769 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:10.769 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.769 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.769 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:10.769 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.769 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.769 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.769 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:10.769 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:10.769 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.770 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.770 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.770 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:10.770 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:10.770 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.770 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.775 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.775 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:10.775 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.775 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.775 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:10.775 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.775 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.776 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.776 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:10.776 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:10.776 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.776 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.776 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.776 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.776 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.776 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:10.776 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:10.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.777 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:10.777 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:10.777 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:10.777 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.777 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:10.777 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:10.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.777 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:10.777 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:10.777 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:09:10.777 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.778 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.778 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:10.778 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:10.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f4905cf3640 1 -- 172.21.15.5:0/673454622 >> v2:172.21.15.157:6812/631023601 conn(0x7f48ec03bdf0 msgr2=0x7f48ec03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f4905cf3640 1 --2- 172.21.15.5:0/673454622 >> v2:172.21.15.157:6812/631023601 conn(0x7f48ec03bdf0 0x7f48ec03e2b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f48f4006e50 tx=0x7f48f4006da0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f4905cf3640 10 monclient: shutdown 2024-08-18T21:09:10.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f4905cf3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:10.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f4905cf3640 1 -- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f490013ed00 msgr2=0x7f490011e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f4905cf3640 1 --2- 172.21.15.5:0/673454622 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f490013ed00 0x7f490011e670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f48f80ae000 tx=0x7f48f80196b0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f48fffff640 1 -- 172.21.15.5:0/673454622 reap_dead start 2024-08-18T21:09:10.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f48fffff640 1 -- 172.21.15.5:0/673454622 reap_dead start 2024-08-18T21:09:10.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f4905cf3640 1 -- 172.21.15.5:0/673454622 shutdown_connections 2024-08-18T21:09:10.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f4905cf3640 1 -- 172.21.15.5:0/673454622 >> 172.21.15.5:0/673454622 conn(0x7f49000a8020 msgr2=0x7f49000a0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:10.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f4905cf3640 1 -- 172.21.15.5:0/673454622 shutdown_connections 2024-08-18T21:09:10.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.734+0000 7f4905cf3640 1 -- 172.21.15.5:0/673454622 wait complete. 2024-08-18T21:09:10.781 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-18T21:09:10.781 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-08-18T21:09:10.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:09:10.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 10 monclient: get_monmap_and_config 2024-08-18T21:09:10.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 10 monclient: build_initial_monmap 2024-08-18T21:09:10.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 10 monclient: monmap: 2024-08-18T21:09:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:10.901373+0000 2024-08-18T21:09:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:10.901373+0000 2024-08-18T21:09:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:10.902 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 1 Processor -- start 2024-08-18T21:09:10.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 1 -- start start 2024-08-18T21:09:10.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 10 monclient: init 2024-08-18T21:09:10.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:10.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 10 monclient: _add_conns ranks=[0,6,7,4,10,5,9,1,3,8,2] 2024-08-18T21:09:10.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdbf00a6ce0 addr v1:172.21.15.5:6789/0 2024-08-18T21:09:10.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf00a77d0 0x7fdbf013ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 10 monclient(hunting): picked mon.noname-d con 0x7fdbf00a77d0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:10.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbf013f220 0x7fdbf0141610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 10 monclient(hunting): picked mon.noname-i con 0x7fdbf013f220 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:10.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbf00a45d0 con 0x7fdbf00a6ce0 2024-08-18T21:09:10.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fdbf00a5000 con 0x7fdbf00a77d0 2024-08-18T21:09:10.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fdbf00a4360 con 0x7fdbf013f220 2024-08-18T21:09:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf65cb640 10 monclient(hunting): authenticate will time out at 1317.914882s 2024-08-18T21:09:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbeffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdbf00a6ce0 0x7fdbf00a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37836/0 (socket says 172.21.15.5:37836) 2024-08-18T21:09:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbeffff640 1 -- 172.21.15.5:0/453201355 learned_addr learned my addr 172.21.15.5:0/453201355 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:09:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 1 --2- 172.21.15.5:0/453201355 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf00a77d0 0x7fdbf013ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 10 monclient(hunting): get_auth_request con 0x7fdbf00a77d0 auth_method 0 2024-08-18T21:09:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf4b68640 1 --2- 172.21.15.5:0/453201355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbf013f220 0x7fdbf0141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf4b68640 10 monclient(hunting): get_auth_request con 0x7fdbf013f220 auth_method 0 2024-08-18T21:09:10.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf4b68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf4b68640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf4b68640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 10 monclient(hunting): handle_auth_done global_id 84426 payload 274 2024-08-18T21:09:10.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 1 -- 172.21.15.5:0/453201355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbf013f220 msgr2=0x7fdbf0141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:10.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 1 --2- 172.21.15.5:0/453201355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbf013f220 0x7fdbf0141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 1 -- 172.21.15.5:0/453201355 >> v1:172.21.15.5:6789/0 conn(0x7fdbf00a6ce0 legacy=0x7fdbf00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:10.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:09:10.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 1 monclient: found mon.noname-d 2024-08-18T21:09:10.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:10.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:09:10.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbef7fe640 1 -- 172.21.15.5:0/453201355 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf00a32d0 con 0x7fdbf00a77d0 2024-08-18T21:09:10.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.898+0000 7fdbf4b68640 1 --2- 172.21.15.5:0/453201355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbf013f220 0x7fdbf0141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:09:10.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.902+0000 7fdbef7fe640 1 -- 172.21.15.5:0/453201355 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf00a77d0 msgr2=0x7fdbf013ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:10.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.902+0000 7fdbef7fe640 1 --2- 172.21.15.5:0/453201355 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf00a77d0 0x7fdbf013ece0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009820 tx=0x7fdbe001c380 comp rx=0 tx=0).ready entity=mon.6 client_cookie=fa6d3e7cca91da25 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeeffd640 1 -- 172.21.15.5:0/453201355 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbe00b0070 con 0x7fdbf00a77d0 2024-08-18T21:09:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeeffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:09:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeeffd640 10 monclient: dump: 2024-08-18T21:09:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.916 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeeffd640 10 monclient: _finish_auth 0 2024-08-18T21:09:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeeffd640 10 monclient: _check_auth_tickets 2024-08-18T21:09:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeeffd640 1 -- 172.21.15.5:0/453201355 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe00aa810 con 0x7fdbf00a77d0 2024-08-18T21:09:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeeffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeeffd640 1 -- 172.21.15.5:0/453201355 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbe00aae30 con 0x7fdbf00a77d0 2024-08-18T21:09:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 5 monclient: authenticate success, global_id 84426 2024-08-18T21:09:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 4 set_mon_vals no callback set 2024-08-18T21:09:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeeffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:09:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeeffd640 10 monclient: dump: 2024-08-18T21:09:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.918 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 10 monclient: shutdown 2024-08-18T21:09:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 1 -- 172.21.15.5:0/453201355 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf00a77d0 msgr2=0x7fdbf013ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 1 --2- 172.21.15.5:0/453201355 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf00a77d0 0x7fdbf013ece0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009820 tx=0x7fdbe001c380 comp rx=0 tx=0).stop 2024-08-18T21:09:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 1 -- 172.21.15.5:0/453201355 shutdown_connections 2024-08-18T21:09:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 1 --2- 172.21.15.5:0/453201355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbf013f220 0x7fdbf0141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 1 --2- 172.21.15.5:0/453201355 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbf00a77d0 0x7fdbf013ece0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 1 -- 172.21.15.5:0/453201355 >> 172.21.15.5:0/453201355 conn(0x7fdbf00acbc0 msgr2=0x7fdbf00a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 1 -- 172.21.15.5:0/453201355 shutdown_connections 2024-08-18T21:09:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 1 -- 172.21.15.5:0/453201355 wait complete. 2024-08-18T21:09:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 10 monclient: build_initial_monmap 2024-08-18T21:09:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 10 monclient: monmap: 2024-08-18T21:09:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:10.920 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 1 Processor -- start 2024-08-18T21:09:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 1 -- start start 2024-08-18T21:09:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 10 monclient: init 2024-08-18T21:09:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 10 monclient: _add_conns ranks=[0,1,4,8,6,5,2,7,3] 2024-08-18T21:09:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf00a6ce0 0x7fdbf01d1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 10 monclient(hunting): picked mon.noname-a con 0x7fdbf00a6ce0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:09:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbf00a77d0 0x7fdbf00a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 10 monclient(hunting): picked mon.noname-f con 0x7fdbf00a77d0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:09:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013f220 0x7fdbf00a2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 10 monclient(hunting): picked mon.noname-c con 0x7fdbf013f220 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf00a83a0 con 0x7fdbf00a6ce0 2024-08-18T21:09:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf00a8220 con 0x7fdbf00a77d0 2024-08-18T21:09:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fdbf0144370 con 0x7fdbf013f220 2024-08-18T21:09:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf65cb640 10 monclient(hunting): authenticate will time out at 1317.922368s 2024-08-18T21:09:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf00a6ce0 0x7fdbf01d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf00a6ce0 0x7fdbf01d1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46266/0 (socket says 172.21.15.5:46266) 2024-08-18T21:09:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf4b68640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013f220 0x7fdbf00a2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 1 -- 172.21.15.5:0/88329117 learned_addr learned my addr 172.21.15.5:0/88329117 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 10 monclient(hunting): get_auth_request con 0x7fdbf00a6ce0 auth_method 0 2024-08-18T21:09:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf4b68640 10 monclient(hunting): get_auth_request con 0x7fdbf013f220 auth_method 0 2024-08-18T21:09:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf4b68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf4b68640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf4b68640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf4b68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf4b68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf4b68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbef7fe640 1 --2- 172.21.15.5:0/88329117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbf00a77d0 0x7fdbf00a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbef7fe640 10 monclient(hunting): get_auth_request con 0x7fdbf00a77d0 auth_method 0 2024-08-18T21:09:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 10 monclient(hunting): handle_auth_done global_id 84294 payload 824 2024-08-18T21:09:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 1 -- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013f220 msgr2=0x7fdbf00a2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 1 --2- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013f220 0x7fdbf00a2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 1 -- 172.21.15.5:0/88329117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbf00a77d0 msgr2=0x7fdbf00a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 1 --2- 172.21.15.5:0/88329117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbf00a77d0 0x7fdbf00a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 1 monclient: found mon.noname-a 2024-08-18T21:09:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:09:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbeffff640 1 -- 172.21.15.5:0/88329117 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf013eb30 con 0x7fdbf00a6ce0 2024-08-18T21:09:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.906+0000 7fdbf4b68640 1 --2- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013f220 0x7fdbf00a2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbeffff640 1 -- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf00a6ce0 msgr2=0x7fdbf01d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbeffff640 1 --2- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf00a6ce0 0x7fdbf01d1720 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800c470 tx=0x7fdbd800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbecff9640 1 -- 172.21.15.5:0/88329117 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbd8005d00 con 0x7fdbf00a6ce0 2024-08-18T21:09:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbecff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:09:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbecff9640 10 monclient: dump: 2024-08-18T21:09:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.926 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbecff9640 10 monclient: _finish_auth 0 2024-08-18T21:09:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbecff9640 10 monclient: _check_auth_tickets 2024-08-18T21:09:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbecff9640 1 -- 172.21.15.5:0/88329117 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd80074e0 con 0x7fdbf00a6ce0 2024-08-18T21:09:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbecff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbecff9640 1 -- 172.21.15.5:0/88329117 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbd8007690 con 0x7fdbf00a6ce0 2024-08-18T21:09:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbecff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:09:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbecff9640 10 monclient: dump: 2024-08-18T21:09:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.928 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbf65cb640 5 monclient: authenticate success, global_id 84294 2024-08-18T21:09:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbee7fc640 4 set_mon_vals no callback set 2024-08-18T21:09:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbf65cb640 10 monclient: _renew_subs 2024-08-18T21:09:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbf65cb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:09:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbf65cb640 1 -- 172.21.15.5:0/88329117 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf0140e40 con 0x7fdbf00a6ce0 2024-08-18T21:09:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbf65cb640 10 monclient: _renew_subs 2024-08-18T21:09:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbf65cb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:09:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbf65cb640 1 -- 172.21.15.5:0/88329117 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf00a26b0 con 0x7fdbf00a6ce0 2024-08-18T21:09:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbf65cb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbf65cb640 1 --2- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013d120 0x7fdbf013d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbf65cb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbf65cb640 1 -- 172.21.15.5:0/88329117 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fdbf0051140 con 0x7fdbf013d120 2024-08-18T21:09:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbecff9640 1 -- 172.21.15.5:0/88329117 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fdbd8007070 con 0x7fdbf00a6ce0 2024-08-18T21:09:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbef7fe640 1 --2- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013d120 0x7fdbf013d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbef7fe640 10 monclient: get_auth_request con 0x7fdbf013d120 auth_method 0 2024-08-18T21:09:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbecff9640 1 --2- 172.21.15.5:0/88329117 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbd003bdf0 0x7fdbd003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbef7fe640 10 monclient(hunting): handle_auth_done global_id 5926 payload 824 2024-08-18T21:09:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbef7fe640 1 -- 172.21.15.5:0/88329117 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdbf00a7570 con 0x7fdbf013d120 2024-08-18T21:09:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbecff9640 1 -- 172.21.15.5:0/88329117 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 22..153) ==== 3898+0+0 (secure 0 0 0) 0x7fdbd804e390 con 0x7fdbf00a6ce0 2024-08-18T21:09:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbf4b68640 1 --2- 172.21.15.5:0/88329117 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbd003bdf0 0x7fdbd003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.910+0000 7fdbf4b68640 10 monclient: get_auth_request con 0x7fdbd003bdf0 auth_method 0 2024-08-18T21:09:10.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.914+0000 7fdbef7fe640 1 -- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013d120 msgr2=0x7fdbf013d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:10.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.914+0000 7fdbef7fe640 1 --2- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013d120 0x7fdbf013d500 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdbf006df00 tx=0x7fdbe0019120 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.914+0000 7fdbecff9640 1 -- 172.21.15.5:0/88329117 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbe00ba020 con 0x7fdbf013d120 2024-08-18T21:09:10.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.914+0000 7fdbecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.914+0000 7fdbecff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:10.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.914+0000 7fdbecff9640 10 monclient: dump: 2024-08-18T21:09:10.933 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.933 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.933 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.933 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.933 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.934 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.914+0000 7fdbecff9640 1 -- 172.21.15.5:0/88329117 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdbe0003be0 con 0x7fdbf013d120 2024-08-18T21:09:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.914+0000 7fdbecff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.914+0000 7fdbecff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.914+0000 7fdbecff9640 1 -- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013d120 msgr2=0x7fdbf013d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.914+0000 7fdbecff9640 1 --2- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013d120 0x7fdbf013d500 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdbf006df00 tx=0x7fdbe0019120 comp rx=0 tx=0).stop 2024-08-18T21:09:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.914+0000 7fdbecff9640 1 -- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013d120 msgr2=0x7fdbf013d500 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.914+0000 7fdbecff9640 1 --2- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013d120 0x7fdbf013d500 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.914+0000 7fdbf4b68640 1 --2- 172.21.15.5:0/88329117 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbd003bdf0 0x7fdbd003e2b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdbf013eef0 tx=0x7fdbe80097b0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.918+0000 7fdbf65cb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.918+0000 7fdbf65cb640 1 --2- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013da40 0x7fdbf013f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.918+0000 7fdbf65cb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.918+0000 7fdbf65cb640 1 -- 172.21.15.5:0/88329117 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fdbf0069fa0 con 0x7fdbf013da40 2024-08-18T21:09:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.918+0000 7fdbef7fe640 1 --2- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013da40 0x7fdbf013f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.918+0000 7fdbef7fe640 10 monclient: get_auth_request con 0x7fdbf013da40 auth_method 0 2024-08-18T21:09:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.918+0000 7fdbef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.918+0000 7fdbef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.918+0000 7fdbef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbef7fe640 10 monclient(hunting): handle_auth_done global_id 5935 payload 824 2024-08-18T21:09:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbef7fe640 1 -- 172.21.15.5:0/88329117 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdbf009f2c0 con 0x7fdbf013da40 2024-08-18T21:09:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbef7fe640 1 -- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013da40 msgr2=0x7fdbf013f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbef7fe640 1 --2- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013da40 0x7fdbf013f600 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdbe001c3c0 tx=0x7fdbe00a8000 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbecff9640 1 -- 172.21.15.5:0/88329117 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbe00ba040 con 0x7fdbf013da40 2024-08-18T21:09:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbecff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbecff9640 10 monclient: dump: 2024-08-18T21:09:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:10.938 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbecff9640 1 -- 172.21.15.5:0/88329117 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9404 (secure 0 0 0) 0x7fdbe00c2e50 con 0x7fdbf013da40 2024-08-18T21:09:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbecff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbecff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbecff9640 1 -- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013da40 msgr2=0x7fdbf013f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbecff9640 1 --2- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013da40 0x7fdbf013f600 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdbe001c3c0 tx=0x7fdbe00a8000 comp rx=0 tx=0).stop 2024-08-18T21:09:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbecff9640 1 -- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013da40 msgr2=0x7fdbf013f600 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbecff9640 1 --2- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013da40 0x7fdbf013f600 secure :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdbe001c3c0 tx=0x7fdbe00a8000 comp rx=0 tx=0).stop 2024-08-18T21:09:10.939 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:10.939 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:10.939 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:10.939 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:10.939 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 126, 2024-08-18T21:09:10.939 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 360039, 2024-08-18T21:09:10.939 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:10.939 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:10.939 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:10.939 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:10.939 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:10.940 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:10.940 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:10.940 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:10.940 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:10.940 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:10.940 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:09:10.940 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:10.940 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:10.940 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:10.940 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:10.940 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:10.940 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:10.940 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:10.941 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:10.941 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:10.941 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:10.941 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:10.941 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:10.941 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:10.941 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:10.941 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:10.941 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:10.941 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:10.941 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:10.941 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:10.941 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:10.942 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:10.942 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:10.942 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:10.942 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:10.942 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:10.942 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:10.942 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:10.942 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:10.942 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.942 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:10.942 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:10.942 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:10.943 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:10.943 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:10.943 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:10.943 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:10.943 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:10.943 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:10.943 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:10.943 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:10.943 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:10.943 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:10.943 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:10.943 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:10.943 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:10.944 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:10.944 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:10.944 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:10.944 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:10.944 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:10.944 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:10.944 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:10.944 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:10.944 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:10.944 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:10.944 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:10.944 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:10.944 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:10.945 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:10.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.945 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:10.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.945 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:10.945 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:10.945 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.945 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.945 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:10.945 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.946 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:10.946 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.946 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.946 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.946 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:10.946 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:10.946 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.946 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.946 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.947 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:10.947 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:10.947 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.947 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.947 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.947 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:10.947 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.947 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.947 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:10.947 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.948 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.948 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.948 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:10.948 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:10.948 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.948 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.948 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.948 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:10.948 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:10.949 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.949 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.949 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.949 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:10.949 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.949 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.949 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:10.949 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.950 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.950 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.950 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:10.950 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:10.950 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.950 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.950 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.950 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.950 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:10.950 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:10.950 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.951 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.951 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.951 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:10.951 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.951 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.951 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:10.951 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.951 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.951 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.952 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:10.952 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:10.952 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.952 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.952 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.952 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.952 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:10.952 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:10.952 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.952 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.952 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.952 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.953 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:10.953 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.953 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.953 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.953 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:10.953 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.953 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.953 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.953 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:10.953 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:10.954 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.954 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.954 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.954 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.954 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:10.954 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:10.954 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.954 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.954 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.954 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.954 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:10.955 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.955 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.955 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.955 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:10.955 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.955 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.955 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.955 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:10.955 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:10.955 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.956 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.956 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.956 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.956 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:10.956 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:10.956 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.956 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.956 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.956 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.956 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:10.956 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.957 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.957 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.957 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:10.957 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.957 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.957 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.957 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:10.957 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:10.957 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.957 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.957 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.958 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:10.958 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:10.958 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.958 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.958 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.958 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:10.958 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.959 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.959 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:10.959 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.959 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.959 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.959 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:10.959 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:10.959 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.959 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.959 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.960 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.960 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:10.960 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:10.960 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:10.960 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:10.960 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:10.960 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:10.960 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.960 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.960 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:10.960 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:10.961 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:10.961 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.961 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.961 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:10.961 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:10.961 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:10.961 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:10.961 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:10.961 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.961 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.961 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:10.962 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:10.962 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.962 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:10.962 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:10.962 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:10.962 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.962 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:10.962 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:09:10.962 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.962 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:10.962 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:10.962 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:10.962 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.963 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:10.963 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:10.963 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:10.963 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:10.963 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:10.963 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:10.963 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:10.963 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:10.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:10.963 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:10.963 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbf65cb640 1 -- 172.21.15.5:0/88329117 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbd003bdf0 msgr2=0x7fdbd003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbf65cb640 1 --2- 172.21.15.5:0/88329117 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbd003bdf0 0x7fdbd003e2b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdbf013eef0 tx=0x7fdbe80097b0 comp rx=0 tx=0).stop 2024-08-18T21:09:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbf65cb640 10 monclient: shutdown 2024-08-18T21:09:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbf65cb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbf65cb640 1 -- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf00a6ce0 msgr2=0x7fdbf01d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbf65cb640 1 --2- 172.21.15.5:0/88329117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf00a6ce0 0x7fdbf01d1720 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800c470 tx=0x7fdbd800c930 comp rx=0 tx=0).stop 2024-08-18T21:09:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbf4b68640 1 -- 172.21.15.5:0/88329117 reap_dead start 2024-08-18T21:09:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbf4b68640 1 -- 172.21.15.5:0/88329117 reap_dead start 2024-08-18T21:09:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbf65cb640 1 -- 172.21.15.5:0/88329117 shutdown_connections 2024-08-18T21:09:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbf65cb640 1 -- 172.21.15.5:0/88329117 >> 172.21.15.5:0/88329117 conn(0x7fdbf00acbc0 msgr2=0x7fdbf00ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbf65cb640 1 -- 172.21.15.5:0/88329117 shutdown_connections 2024-08-18T21:09:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:10.922+0000 7fdbf65cb640 1 -- 172.21.15.5:0/88329117 wait complete. 2024-08-18T21:09:10.966 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-18T21:09:10.966 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon d 2024-08-18T21:09:10.966 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:09:11.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.078+0000 7f6957673640 10 monclient: get_monmap_and_config 2024-08-18T21:09:11.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.078+0000 7f6957673640 10 monclient: build_initial_monmap 2024-08-18T21:09:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.078+0000 7f6957673640 10 monclient: monmap: 2024-08-18T21:09:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:11.084285+0000 2024-08-18T21:09:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:11.084285+0000 2024-08-18T21:09:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:11.085 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 1 Processor -- start 2024-08-18T21:09:11.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 1 -- start start 2024-08-18T21:09:11.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 10 monclient: init 2024-08-18T21:09:11.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:11.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 10 monclient: _add_conns ranks=[4,6,1,3,2,7,10,5,8,9,0] 2024-08-18T21:09:11.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69500a6ce0 0x7f69500a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 10 monclient(hunting): picked mon.noname-c con 0x7f69500a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:11.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f69500a7600 0x7f6950139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 10 monclient(hunting): picked mon.noname-d con 0x7f69500a7600 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:11.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f6950139fe0 addr v1:172.21.15.157:6789/0 2024-08-18T21:09:11.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69500a45d0 con 0x7f6950139fe0 2024-08-18T21:09:11.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f69500a5000 con 0x7f69500a6ce0 2024-08-18T21:09:11.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f69500a32d0 con 0x7f69500a7600 2024-08-18T21:09:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6957673640 10 monclient(hunting): authenticate will time out at 1318.097468s 2024-08-18T21:09:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f69500a7600 0x7f6950139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f69500a7600 0x7f6950139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54810/0 (socket says 172.21.15.5:54810) 2024-08-18T21:09:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f695540f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69500a6ce0 0x7f69500a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 1 -- 172.21.15.5:0/312723466 learned_addr learned my addr 172.21.15.5:0/312723466 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 10 monclient(hunting): get_auth_request con 0x7f69500a7600 auth_method 0 2024-08-18T21:09:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f695540f640 10 monclient(hunting): get_auth_request con 0x7f69500a6ce0 auth_method 0 2024-08-18T21:09:11.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f695540f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f695540f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f695540f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f695540f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f695540f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f695540f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 10 monclient(hunting): handle_auth_done global_id 84435 payload 274 2024-08-18T21:09:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 1 -- 172.21.15.5:0/312723466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69500a6ce0 msgr2=0x7f69500a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 1 --2- 172.21.15.5:0/312723466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69500a6ce0 0x7f69500a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 1 -- 172.21.15.5:0/312723466 >> v1:172.21.15.157:6789/0 conn(0x7f6950139fe0 legacy=0x7f6950140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 10 monclient: _finish_hunting 0 2024-08-18T21:09:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 1 monclient: found mon.noname-d 2024-08-18T21:09:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:09:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f6954c0e640 1 -- 172.21.15.5:0/312723466 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69500a8900 con 0x7f69500a7600 2024-08-18T21:09:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.082+0000 7f695540f640 1 --2- 172.21.15.5:0/312723466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69500a6ce0 0x7f69500a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:11.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6954c0e640 1 -- 172.21.15.5:0/312723466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f69500a7600 msgr2=0x7f6950139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6954c0e640 1 --2- 172.21.15.5:0/312723466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f69500a7600 0x7f6950139aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6944009e80 tx=0x7f694401c910 comp rx=0 tx=0).ready entity=mon.6 client_cookie=893e77982343b242 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6943fff640 1 -- 172.21.15.5:0/312723466 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f69440090d0 con 0x7f69500a7600 2024-08-18T21:09:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6943fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6943fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:09:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6943fff640 10 monclient: dump: 2024-08-18T21:09:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.099 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6943fff640 10 monclient: _finish_auth 0 2024-08-18T21:09:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6943fff640 10 monclient: _check_auth_tickets 2024-08-18T21:09:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6943fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6957673640 5 monclient: authenticate success, global_id 84435 2024-08-18T21:09:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6943fff640 1 -- 172.21.15.5:0/312723466 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69440a5b60 con 0x7f69500a7600 2024-08-18T21:09:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6957673640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6943fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6943fff640 1 -- 172.21.15.5:0/312723466 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f69440a5d10 con 0x7f69500a7600 2024-08-18T21:09:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6957673640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6957673640 4 set_mon_vals no callback set 2024-08-18T21:09:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6943fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6943fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:09:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6943fff640 10 monclient: dump: 2024-08-18T21:09:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.101 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.101 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.101 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.101 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.101 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.101 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.101 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.101 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.101 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6957673640 10 monclient: shutdown 2024-08-18T21:09:11.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6957673640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:11.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6957673640 1 -- 172.21.15.5:0/312723466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f69500a7600 msgr2=0x7f6950139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6957673640 1 --2- 172.21.15.5:0/312723466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f69500a7600 0x7f6950139aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6944009e80 tx=0x7f694401c910 comp rx=0 tx=0).stop 2024-08-18T21:09:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6957673640 1 -- 172.21.15.5:0/312723466 shutdown_connections 2024-08-18T21:09:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6957673640 1 --2- 172.21.15.5:0/312723466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f69500a7600 0x7f6950139aa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6957673640 1 --2- 172.21.15.5:0/312723466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f69500a6ce0 0x7f69500a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6957673640 1 -- 172.21.15.5:0/312723466 >> 172.21.15.5:0/312723466 conn(0x7f69500acbc0 msgr2=0x7f69500a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6957673640 1 -- 172.21.15.5:0/312723466 shutdown_connections 2024-08-18T21:09:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6957673640 1 -- 172.21.15.5:0/312723466 wait complete. 2024-08-18T21:09:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.086+0000 7f6957673640 10 monclient: build_initial_monmap 2024-08-18T21:09:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 10 monclient: monmap: 2024-08-18T21:09:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:11.103 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:11.106 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.106 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:11.106 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:11.107 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 1 Processor -- start 2024-08-18T21:09:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 1 -- start start 2024-08-18T21:09:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 10 monclient: init 2024-08-18T21:09:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 10 monclient: _add_conns ranks=[3,2,6,0,4,7,1,5,8] 2024-08-18T21:09:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69500a6ce0 0x7f6950138810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 10 monclient(hunting): picked mon.noname-g con 0x7f69500a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:09:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69500a7600 0x7f6950138d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 10 monclient(hunting): picked mon.noname-b con 0x7f69500a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6950139fe0 0x7f695013ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 10 monclient(hunting): picked mon.noname-d con 0x7f6950139fe0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f69500a79e0 con 0x7f69500a7600 2024-08-18T21:09:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f69500a9810 con 0x7f69500a6ce0 2024-08-18T21:09:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f6950123780 con 0x7f6950139fe0 2024-08-18T21:09:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 10 monclient(hunting): authenticate will time out at 1318.104902s 2024-08-18T21:09:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6954c0e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69500a7600 0x7f6950138d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6950139fe0 0x7f695013ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6950139fe0 0x7f695013ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54822/0 (socket says 172.21.15.5:54822) 2024-08-18T21:09:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6954c0e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69500a7600 0x7f6950138d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:36646/0 (socket says 172.21.15.5:36646) 2024-08-18T21:09:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 1 -- 172.21.15.5:0/3808920615 learned_addr learned my addr 172.21.15.5:0/3808920615 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 10 monclient(hunting): get_auth_request con 0x7f6950139fe0 auth_method 0 2024-08-18T21:09:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6954c0e640 10 monclient(hunting): get_auth_request con 0x7f69500a7600 auth_method 0 2024-08-18T21:09:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6954c0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6954c0e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6954c0e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6954c0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6954c0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6954c0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f695540f640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69500a6ce0 0x7f6950138810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 10 monclient(hunting): handle_auth_done global_id 84444 payload 824 2024-08-18T21:09:11.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 1 -- 172.21.15.5:0/3808920615 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69500a6ce0 msgr2=0x7f6950138810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69500a6ce0 0x7f6950138810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 1 -- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69500a7600 msgr2=0x7f6950138d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69500a7600 0x7f6950138d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 10 monclient: _finish_hunting 0 2024-08-18T21:09:11.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 1 monclient: found mon.noname-d 2024-08-18T21:09:11.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:11.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:09:11.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 1 -- 172.21.15.5:0/3808920615 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69501231c0 con 0x7f6950139fe0 2024-08-18T21:09:11.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f695540f640 10 monclient: get_auth_request con 0x7f69500a6ce0 auth_method 0 2024-08-18T21:09:11.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f695540f640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69500a6ce0 0x7f6950138810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:09:11.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6954c0e640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f69500a7600 0x7f6950138d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:11.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 1 -- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6950139fe0 msgr2=0x7f695013ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6955c10640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6950139fe0 0x7f695013ec20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f694800b440 tx=0x7f694800b900 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6941ffb640 1 -- 172.21.15.5:0/3808920615 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6948015020 con 0x7f6950139fe0 2024-08-18T21:09:11.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6941ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6941ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:09:11.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6941ffb640 10 monclient: dump: 2024-08-18T21:09:11.112 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.112 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.112 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.112 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.112 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.112 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.112 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.112 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.112 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.112 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.112 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.112 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.113 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.113 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.113 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.113 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6941ffb640 10 monclient: _finish_auth 0 2024-08-18T21:09:11.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6941ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:09:11.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6941ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:11.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6941ffb640 1 -- 172.21.15.5:0/3808920615 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6948011cb0 con 0x7f6950139fe0 2024-08-18T21:09:11.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6941ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:11.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6941ffb640 1 -- 172.21.15.5:0/3808920615 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6948011e60 con 0x7f6950139fe0 2024-08-18T21:09:11.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 5 monclient: authenticate success, global_id 84444 2024-08-18T21:09:11.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 10 monclient: _renew_subs 2024-08-18T21:09:11.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:09:11.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6957673640 1 -- 172.21.15.5:0/3808920615 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69501234a0 con 0x7f6950139fe0 2024-08-18T21:09:11.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6942ffd640 4 set_mon_vals no callback set 2024-08-18T21:09:11.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6941ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.090+0000 7f6941ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:09:11.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6941ffb640 10 monclient: dump: 2024-08-18T21:09:11.114 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.114 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.114 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.114 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.114 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.114 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.114 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.114 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.115 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.115 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.115 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.115 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.115 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.115 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.115 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.115 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6957673640 10 monclient: _renew_subs 2024-08-18T21:09:11.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6957673640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:09:11.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6957673640 1 -- 172.21.15.5:0/3808920615 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f6950142160 con 0x7f6950139fe0 2024-08-18T21:09:11.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6957673640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:11.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6957673640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f695013f160 0x7f695013f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6957673640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6957673640 1 -- 172.21.15.5:0/3808920615 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f69500a7b60 con 0x7f695013f160 2024-08-18T21:09:11.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f695540f640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f695013f160 0x7f695013f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f695540f640 10 monclient: get_auth_request con 0x7f695013f160 auth_method 0 2024-08-18T21:09:11.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f695540f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f695540f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f695540f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6941ffb640 1 -- 172.21.15.5:0/3808920615 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f6948018020 con 0x7f6950139fe0 2024-08-18T21:09:11.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f695540f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f695540f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f695540f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f695540f640 10 monclient(hunting): handle_auth_done global_id 84453 payload 824 2024-08-18T21:09:11.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f695540f640 1 -- 172.21.15.5:0/3808920615 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69500aab00 con 0x7f695013f160 2024-08-18T21:09:11.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6941ffb640 1 --2- 172.21.15.5:0/3808920615 >> v2:172.21.15.157:6812/631023601 conn(0x7f693403bdc0 0x7f693403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6941ffb640 1 -- 172.21.15.5:0/3808920615 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(153..153 src has 22..153) ==== 3898+0+0 (secure 0 0 0) 0x7f694804dc00 con 0x7f6950139fe0 2024-08-18T21:09:11.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6954c0e640 1 --2- 172.21.15.5:0/3808920615 >> v2:172.21.15.157:6812/631023601 conn(0x7f693403bdc0 0x7f693403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6954c0e640 10 monclient: get_auth_request con 0x7f693403bdc0 auth_method 0 2024-08-18T21:09:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f695540f640 1 -- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f695013f160 msgr2=0x7f695013f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f695540f640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f695013f160 0x7f695013f540 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f694c010790 tx=0x7f694c010c50 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6941ffb640 1 -- 172.21.15.5:0/3808920615 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f694c00f040 con 0x7f695013f160 2024-08-18T21:09:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6941ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6941ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:09:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6941ffb640 10 monclient: dump: 2024-08-18T21:09:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.124 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.124 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6941ffb640 1 -- 172.21.15.5:0/3808920615 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f694c01c400 con 0x7f695013f160 2024-08-18T21:09:11.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6941ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:11.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6941ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:11.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6941ffb640 1 -- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f695013f160 msgr2=0x7f695013f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6941ffb640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f695013f160 0x7f695013f540 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f694c010790 tx=0x7f694c010c50 comp rx=0 tx=0).stop 2024-08-18T21:09:11.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6941ffb640 1 -- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f695013f160 msgr2=0x7f695013f540 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:11.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.094+0000 7f6941ffb640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f695013f160 0x7f695013f540 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.098+0000 7f6954c0e640 1 --2- 172.21.15.5:0/3808920615 >> v2:172.21.15.157:6812/631023601 conn(0x7f693403bdc0 0x7f693403e280 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f69500a81b0 tx=0x7f69440a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.102+0000 7f6957673640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.102+0000 7f6957673640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f695013fa80 0x7f695013aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.102+0000 7f6957673640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.102+0000 7f6957673640 1 -- 172.21.15.5:0/3808920615 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f6950051140 con 0x7f695013fa80 2024-08-18T21:09:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.102+0000 7f695540f640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f695013fa80 0x7f695013aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.102+0000 7f695540f640 10 monclient: get_auth_request con 0x7f695013fa80 auth_method 0 2024-08-18T21:09:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.102+0000 7f695540f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.102+0000 7f695540f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.102+0000 7f695540f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.102+0000 7f695540f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.102+0000 7f695540f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.102+0000 7f695540f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.102+0000 7f695540f640 10 monclient(hunting): handle_auth_done global_id 84462 payload 824 2024-08-18T21:09:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.102+0000 7f695540f640 1 -- 172.21.15.5:0/3808920615 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f69500aae20 con 0x7f695013fa80 2024-08-18T21:09:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f695540f640 1 -- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f695013fa80 msgr2=0x7f695013aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f695540f640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f695013fa80 0x7f695013aab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f694c010790 tx=0x7f694c0046d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6941ffb640 1 -- 172.21.15.5:0/3808920615 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f694c004490 con 0x7f695013fa80 2024-08-18T21:09:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6941ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6941ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:09:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6941ffb640 10 monclient: dump: 2024-08-18T21:09:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.128 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6941ffb640 1 -- 172.21.15.5:0/3808920615 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9236 (secure 0 0 0) 0x7f694c025070 con 0x7f695013fa80 2024-08-18T21:09:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6941ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6941ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6941ffb640 1 -- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f695013fa80 msgr2=0x7f695013aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6941ffb640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f695013fa80 0x7f695013aab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f694c010790 tx=0x7f694c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6941ffb640 1 -- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f695013fa80 msgr2=0x7f695013aab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:11.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6941ffb640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f695013fa80 0x7f695013aab0 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f694c010790 tx=0x7f694c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.129 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 126, 2024-08-18T21:09:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 47935, 2024-08-18T21:09:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:09:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:09:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:11.154 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6957673640 1 -- 172.21.15.5:0/3808920615 >> v2:172.21.15.157:6812/631023601 conn(0x7f693403bdc0 msgr2=0x7f693403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6957673640 1 --2- 172.21.15.5:0/3808920615 >> v2:172.21.15.157:6812/631023601 conn(0x7f693403bdc0 0x7f693403e280 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f69500a81b0 tx=0x7f69440a7070 comp rx=0 tx=0).stop 2024-08-18T21:09:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6957673640 10 monclient: shutdown 2024-08-18T21:09:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6957673640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6957673640 1 -- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6950139fe0 msgr2=0x7f695013ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6957673640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6950139fe0 0x7f695013ec20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f694800b440 tx=0x7f694800b900 comp rx=0 tx=0).stop 2024-08-18T21:09:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6955c10640 1 -- 172.21.15.5:0/3808920615 reap_dead start 2024-08-18T21:09:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6957673640 1 -- 172.21.15.5:0/3808920615 shutdown_connections 2024-08-18T21:09:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6957673640 1 --2- 172.21.15.5:0/3808920615 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6950139fe0 0x7f695013ec20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6957673640 1 -- 172.21.15.5:0/3808920615 >> 172.21.15.5:0/3808920615 conn(0x7f69500acbc0 msgr2=0x7f695009de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6957673640 1 -- 172.21.15.5:0/3808920615 shutdown_connections 2024-08-18T21:09:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.106+0000 7f6957673640 1 -- 172.21.15.5:0/3808920615 wait complete. 2024-08-18T21:09:11.156 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-18T21:09:11.156 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon e 2024-08-18T21:09:11.157 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:09:11.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.266+0000 7f617cc41640 10 monclient: get_monmap_and_config 2024-08-18T21:09:11.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.266+0000 7f617cc41640 10 monclient: build_initial_monmap 2024-08-18T21:09:11.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.266+0000 7f617cc41640 10 monclient: monmap: 2024-08-18T21:09:11.271 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:11.271 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:11.271652+0000 2024-08-18T21:09:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:11.271652+0000 2024-08-18T21:09:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:11.273 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 1 Processor -- start 2024-08-18T21:09:11.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 1 -- start start 2024-08-18T21:09:11.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 10 monclient: init 2024-08-18T21:09:11.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:11.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 10 monclient: _add_conns ranks=[9,5,1,8,6,10,3,0,2,7,4] 2024-08-18T21:09:11.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f617809da30 0x7f61780a0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 10 monclient(hunting): picked mon.noname-a con 0x7f617809da30 addr v2:172.21.15.5:3300/0 2024-08-18T21:09:11.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f617809de10 0x7f617809e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 10 monclient(hunting): picked mon.noname-h con 0x7f617809de10 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:11.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f61781367f0 addr v1:172.21.15.157:6789/0 2024-08-18T21:09:11.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f617809fbc0 con 0x7f61781367f0 2024-08-18T21:09:11.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f61780a3220 con 0x7f617809da30 2024-08-18T21:09:11.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f617809f600 con 0x7f617809de10 2024-08-18T21:09:11.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:11.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617cc41640 10 monclient(hunting): authenticate will time out at 1318.284873s 2024-08-18T21:09:11.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f617809da30 0x7f61780a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f616dd9b640 1 -- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f617809de10 msgr2=0x7f617809e1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3302/0 2024-08-18T21:09:11.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f617809da30 0x7f61780a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46282/0 (socket says 172.21.15.5:46282) 2024-08-18T21:09:11.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f616dd9b640 1 --2- 172.21.15.5:0/3160433018 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f617809de10 0x7f617809e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:09:11.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 1 -- 172.21.15.5:0/3160433018 learned_addr learned my addr 172.21.15.5:0/3160433018 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:11.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 10 monclient(hunting): get_auth_request con 0x7f617809da30 auth_method 0 2024-08-18T21:09:11.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 10 monclient(hunting): handle_auth_done global_id 84303 payload 274 2024-08-18T21:09:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 1 -- 172.21.15.5:0/3160433018 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f617809de10 msgr2=0x7f617809e1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:09:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 1 --2- 172.21.15.5:0/3160433018 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f617809de10 0x7f617809e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 1 -- 172.21.15.5:0/3160433018 >> v1:172.21.15.157:6789/0 conn(0x7f61781367f0 legacy=0x7f6178136ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 10 monclient: _finish_hunting 0 2024-08-18T21:09:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 1 monclient: found mon.noname-a 2024-08-18T21:09:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:11.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:09:11.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.270+0000 7f617659c640 1 -- 172.21.15.5:0/3160433018 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f617809f8e0 con 0x7f617809da30 2024-08-18T21:09:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f617659c640 1 -- 172.21.15.5:0/3160433018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f617809da30 msgr2=0x7f61780a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f617659c640 1 --2- 172.21.15.5:0/3160433018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f617809da30 0x7f61780a0600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6168009870 tx=0x7f616801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2deb64483a5c8736 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f6175d9b640 1 -- 172.21.15.5:0/3160433018 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f61680b1070 con 0x7f617809da30 2024-08-18T21:09:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f6175d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f6175d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:09:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f6175d9b640 10 monclient: dump: 2024-08-18T21:09:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.289 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f6175d9b640 10 monclient: _finish_auth 0 2024-08-18T21:09:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f6175d9b640 10 monclient: _check_auth_tickets 2024-08-18T21:09:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f6175d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f6175d9b640 1 -- 172.21.15.5:0/3160433018 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61680a8050 con 0x7f617809da30 2024-08-18T21:09:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f6175d9b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f6175d9b640 1 -- 172.21.15.5:0/3160433018 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f61680abcc0 con 0x7f617809da30 2024-08-18T21:09:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f6175d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f6175d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:09:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f6175d9b640 10 monclient: dump: 2024-08-18T21:09:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.291 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f617cc41640 5 monclient: authenticate success, global_id 84303 2024-08-18T21:09:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f617cc41640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f617cc41640 4 set_mon_vals no callback set 2024-08-18T21:09:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f617cc41640 10 monclient: shutdown 2024-08-18T21:09:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f617cc41640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f617cc41640 1 -- 172.21.15.5:0/3160433018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f617809da30 msgr2=0x7f61780a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f617cc41640 1 --2- 172.21.15.5:0/3160433018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f617809da30 0x7f61780a0600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6168009870 tx=0x7f616801c440 comp rx=0 tx=0).stop 2024-08-18T21:09:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f617cc41640 1 -- 172.21.15.5:0/3160433018 shutdown_connections 2024-08-18T21:09:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f617cc41640 1 --2- 172.21.15.5:0/3160433018 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f617809de10 0x7f617809e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f617cc41640 1 --2- 172.21.15.5:0/3160433018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f617809da30 0x7f61780a0600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f617cc41640 1 -- 172.21.15.5:0/3160433018 >> 172.21.15.5:0/3160433018 conn(0x7f61780688d0 msgr2=0x7f6178068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f617cc41640 1 -- 172.21.15.5:0/3160433018 shutdown_connections 2024-08-18T21:09:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.274+0000 7f617cc41640 1 -- 172.21.15.5:0/3160433018 wait complete. 2024-08-18T21:09:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 10 monclient: build_initial_monmap 2024-08-18T21:09:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 10 monclient: monmap: 2024-08-18T21:09:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:11.294 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 1 Processor -- start 2024-08-18T21:09:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 1 -- start start 2024-08-18T21:09:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 10 monclient: init 2024-08-18T21:09:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 10 monclient: _add_conns ranks=[4,8,2,0,6,3,5,1,7] 2024-08-18T21:09:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f617809da30 0x7f61781d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 10 monclient(hunting): picked mon.noname-c con 0x7f617809da30 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f617809de10 0x7f61781d2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 10 monclient(hunting): picked mon.noname-e con 0x7f617809de10 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61781367f0 0x7f61781d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 10 monclient(hunting): picked mon.noname-b con 0x7f61781367f0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f617809e730 con 0x7f61781367f0 2024-08-18T21:09:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f617813f470 con 0x7f617809da30 2024-08-18T21:09:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f61781203a0 con 0x7f617809de10 2024-08-18T21:09:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617cc41640 10 monclient(hunting): authenticate will time out at 1318.292954s 2024-08-18T21:09:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61781367f0 0x7f61781d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f616dd9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f617809de10 0x7f61781d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61781367f0 0x7f61781d26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:36662/0 (socket says 172.21.15.5:36662) 2024-08-18T21:09:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 1 -- 172.21.15.5:0/1614963748 learned_addr learned my addr 172.21.15.5:0/1614963748 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 10 monclient(hunting): get_auth_request con 0x7f61781367f0 auth_method 0 2024-08-18T21:09:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617659c640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f617809da30 0x7f61781d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f616dd9b640 10 monclient(hunting): get_auth_request con 0x7f617809de10 auth_method 0 2024-08-18T21:09:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f616dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f616dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f616dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617659c640 10 monclient(hunting): get_auth_request con 0x7f617809da30 auth_method 0 2024-08-18T21:09:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f616dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f616dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f616dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 10 monclient(hunting): handle_auth_done global_id 84332 payload 824 2024-08-18T21:09:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 1 -- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f617809de10 msgr2=0x7f61781d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f617809de10 0x7f61781d2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 1 -- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f617809da30 msgr2=0x7f61781d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f617809da30 0x7f61781d1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 10 monclient: _finish_hunting 0 2024-08-18T21:09:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 1 monclient: found mon.noname-b 2024-08-18T21:09:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:09:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 1 -- 172.21.15.5:0/1614963748 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f617811fdd0 con 0x7f61781367f0 2024-08-18T21:09:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f617659c640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f617809da30 0x7f61781d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 1 -- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61781367f0 msgr2=0x7f61781d26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f6176d9d640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61781367f0 0x7f61781d26b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f617000b9a0 tx=0x7f617000be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.278+0000 7f616f7fe640 1 -- 172.21.15.5:0/1614963748 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6170019070 con 0x7f61781367f0 2024-08-18T21:09:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:09:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 10 monclient: dump: 2024-08-18T21:09:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.301 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.301 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.301 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.301 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 10 monclient: _finish_auth 0 2024-08-18T21:09:11.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:09:11.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:11.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617cc41640 5 monclient: authenticate success, global_id 84332 2024-08-18T21:09:11.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 1 -- 172.21.15.5:0/1614963748 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617000cbb0 con 0x7f61781367f0 2024-08-18T21:09:11.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617cc41640 10 monclient: _renew_subs 2024-08-18T21:09:11.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617cc41640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617cc41640 1 -- 172.21.15.5:0/1614963748 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6178068cb0 con 0x7f61781367f0 2024-08-18T21:09:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 1 -- 172.21.15.5:0/1614963748 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f617000cd60 con 0x7f61781367f0 2024-08-18T21:09:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f6174d99640 4 set_mon_vals no callback set 2024-08-18T21:09:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 10 monclient: dump: 2024-08-18T21:09:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.303 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617cc41640 10 monclient: _renew_subs 2024-08-18T21:09:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617cc41640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617cc41640 1 -- 172.21.15.5:0/1614963748 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6178073580 con 0x7f61781367f0 2024-08-18T21:09:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617cc41640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617cc41640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f617813fc70 0x7f6178140050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617cc41640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617cc41640 1 -- 172.21.15.5:0/1614963748 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f617809e8b0 con 0x7f617813fc70 2024-08-18T21:09:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617659c640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f617813fc70 0x7f6178140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617659c640 10 monclient: get_auth_request con 0x7f617813fc70 auth_method 0 2024-08-18T21:09:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 1 -- 172.21.15.5:0/1614963748 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f6170006d10 con 0x7f61781367f0 2024-08-18T21:09:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 1 --2- 172.21.15.5:0/1614963748 >> v2:172.21.15.157:6812/631023601 conn(0x7f615803bdc0 0x7f615803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617659c640 10 monclient(hunting): handle_auth_done global_id 54962 payload 824 2024-08-18T21:09:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617659c640 1 -- 172.21.15.5:0/1614963748 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f617813f870 con 0x7f617813fc70 2024-08-18T21:09:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 1 -- 172.21.15.5:0/1614963748 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(153..153 src has 22..153) ==== 3898+0+0 (secure 0 0 0) 0x7f617004dfa0 con 0x7f61781367f0 2024-08-18T21:09:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616dd9b640 1 --2- 172.21.15.5:0/1614963748 >> v2:172.21.15.157:6812/631023601 conn(0x7f615803bdc0 0x7f615803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616dd9b640 10 monclient: get_auth_request con 0x7f615803bdc0 auth_method 0 2024-08-18T21:09:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617659c640 1 -- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f617813fc70 msgr2=0x7f6178140050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f617659c640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f617813fc70 0x7f6178140050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f61780a0bd0 tx=0x7f61680191e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 1 -- 172.21.15.5:0/1614963748 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f61680b1070 con 0x7f617813fc70 2024-08-18T21:09:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 10 monclient: dump: 2024-08-18T21:09:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.307 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 1 -- 172.21.15.5:0/1614963748 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f61680a8050 con 0x7f617813fc70 2024-08-18T21:09:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:11.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:11.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 1 -- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f617813fc70 msgr2=0x7f6178140050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.282+0000 7f616f7fe640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f617813fc70 0x7f6178140050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f61780a0bd0 tx=0x7f61680191e0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.286+0000 7f616f7fe640 1 -- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f617813fc70 msgr2=0x7f6178140050 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:11.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.286+0000 7f616f7fe640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f617813fc70 0x7f6178140050 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f61780a0bd0 tx=0x7f61680191e0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.286+0000 7f616dd9b640 1 --2- 172.21.15.5:0/1614963748 >> v2:172.21.15.157:6812/631023601 conn(0x7f615803bdc0 0x7f615803e280 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f61600093d0 tx=0x7f6160009360 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.290+0000 7f617cc41640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.290+0000 7f617cc41640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6178140590 0x7f6178071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.290+0000 7f617cc41640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.290+0000 7f617cc41640 1 -- 172.21.15.5:0/1614963748 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f6178051140 con 0x7f6178140590 2024-08-18T21:09:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.290+0000 7f617659c640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6178140590 0x7f6178071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.290+0000 7f617659c640 10 monclient: get_auth_request con 0x7f6178140590 auth_method 0 2024-08-18T21:09:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.290+0000 7f617659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.290+0000 7f617659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.290+0000 7f617659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.290+0000 7f617659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.290+0000 7f617659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.290+0000 7f617659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.290+0000 7f617659c640 10 monclient(hunting): handle_auth_done global_id 54971 payload 824 2024-08-18T21:09:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.290+0000 7f617659c640 1 -- 172.21.15.5:0/1614963748 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6178073ea0 con 0x7f6178140590 2024-08-18T21:09:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f617659c640 1 -- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6178140590 msgr2=0x7f6178071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f617659c640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6178140590 0x7f6178071a10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f616801aaf0 tx=0x7f61680a9000 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f616f7fe640 1 -- 172.21.15.5:0/1614963748 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f61680c8430 con 0x7f6178140590 2024-08-18T21:09:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f616f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f616f7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f616f7fe640 10 monclient: dump: 2024-08-18T21:09:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.312 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f616f7fe640 1 -- 172.21.15.5:0/1614963748 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9404 (secure 0 0 0) 0x7f61680b2040 con 0x7f6178140590 2024-08-18T21:09:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f616f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f616f7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f616f7fe640 1 -- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6178140590 msgr2=0x7f6178071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f616f7fe640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6178140590 0x7f6178071a10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f616801aaf0 tx=0x7f61680a9000 comp rx=0 tx=0).stop 2024-08-18T21:09:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f616f7fe640 1 -- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6178140590 msgr2=0x7f6178071a10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f616f7fe640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6178140590 0x7f6178071a10 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f616801aaf0 tx=0x7f61680a9000 comp rx=0 tx=0).stop 2024-08-18T21:09:11.313 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 126, 2024-08-18T21:09:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 207415, 2024-08-18T21:09:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:09:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:09:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:09:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:09:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.339 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:11.339 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f617cc41640 1 -- 172.21.15.5:0/1614963748 >> v2:172.21.15.157:6812/631023601 conn(0x7f615803bdc0 msgr2=0x7f615803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f617cc41640 1 --2- 172.21.15.5:0/1614963748 >> v2:172.21.15.157:6812/631023601 conn(0x7f615803bdc0 0x7f615803e280 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f61600093d0 tx=0x7f6160009360 comp rx=0 tx=0).stop 2024-08-18T21:09:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f617cc41640 10 monclient: shutdown 2024-08-18T21:09:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f617cc41640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f617cc41640 1 -- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61781367f0 msgr2=0x7f61781d26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f6176d9d640 1 -- 172.21.15.5:0/1614963748 reap_dead start 2024-08-18T21:09:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f617cc41640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61781367f0 0x7f61781d26b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f617000b9a0 tx=0x7f617000be60 comp rx=0 tx=0).stop 2024-08-18T21:09:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f617cc41640 1 -- 172.21.15.5:0/1614963748 shutdown_connections 2024-08-18T21:09:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f617cc41640 1 --2- 172.21.15.5:0/1614963748 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f61781367f0 0x7f61781d26b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f617cc41640 1 -- 172.21.15.5:0/1614963748 >> 172.21.15.5:0/1614963748 conn(0x7f61780688d0 msgr2=0x7f61780a27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f617cc41640 1 -- 172.21.15.5:0/1614963748 shutdown_connections 2024-08-18T21:09:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.294+0000 7f617cc41640 1 -- 172.21.15.5:0/1614963748 wait complete. 2024-08-18T21:09:11.341 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-18T21:09:11.341 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-08-18T21:09:11.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:09:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 10 monclient: get_monmap_and_config 2024-08-18T21:09:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 10 monclient: build_initial_monmap 2024-08-18T21:09:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 10 monclient: monmap: 2024-08-18T21:09:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:11.452574+0000 2024-08-18T21:09:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:11.452574+0000 2024-08-18T21:09:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:11.454 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 1 Processor -- start 2024-08-18T21:09:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 1 -- start start 2024-08-18T21:09:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 10 monclient: init 2024-08-18T21:09:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 10 monclient: _add_conns ranks=[10,6,4,3,0,7,8,1,5,9,2] 2024-08-18T21:09:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f61b009da30 0x7f61b009de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 10 monclient(hunting): picked mon.noname-f con 0x7f61b009da30 addr v2:172.21.15.157:3300/0 2024-08-18T21:09:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61b00a03e0 0x7f61b009e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 10 monclient(hunting): picked mon.noname-d con 0x7f61b00a03e0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61b00a3110 0x7f61b01366a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 10 monclient(hunting): picked mon.noname-c con 0x7f61b00a3110 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f61b009e890 con 0x7f61b009da30 2024-08-18T21:09:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f61b009f7c0 con 0x7f61b00a3110 2024-08-18T21:09:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f61b009f4e0 con 0x7f61b00a03e0 2024-08-18T21:09:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b6cfa640 10 monclient(hunting): authenticate will time out at 1318.465872s 2024-08-18T21:09:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61b00a03e0 0x7f61b009e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61b00a03e0 0x7f61b009e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54840/0 (socket says 172.21.15.5:54840) 2024-08-18T21:09:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 1 -- 172.21.15.5:0/3171623001 learned_addr learned my addr 172.21.15.5:0/3171623001 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 10 monclient(hunting): get_auth_request con 0x7f61b00a03e0 auth_method 0 2024-08-18T21:09:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b5297640 1 --2- 172.21.15.5:0/3171623001 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61b00a3110 0x7f61b01366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b5297640 10 monclient(hunting): get_auth_request con 0x7f61b00a3110 auth_method 0 2024-08-18T21:09:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b5297640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b5297640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b5297640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b4a96640 1 --2- 172.21.15.5:0/3171623001 >> v2:172.21.15.157:3300/0 conn(0x7f61b009da30 0x7f61b009de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b5297640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b5297640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b5297640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b4a96640 10 monclient(hunting): get_auth_request con 0x7f61b009da30 auth_method 0 2024-08-18T21:09:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b4a96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b4a96640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b4a96640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 10 monclient(hunting): handle_auth_done global_id 84471 payload 274 2024-08-18T21:09:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 1 -- 172.21.15.5:0/3171623001 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61b00a3110 msgr2=0x7f61b01366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 1 --2- 172.21.15.5:0/3171623001 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61b00a3110 0x7f61b01366a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 1 -- 172.21.15.5:0/3171623001 >> v2:172.21.15.157:3300/0 conn(0x7f61b009da30 msgr2=0x7f61b009de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 1 --2- 172.21.15.5:0/3171623001 >> v2:172.21.15.157:3300/0 conn(0x7f61b009da30 0x7f61b009de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 1 monclient: found mon.noname-d 2024-08-18T21:09:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:09:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61affff640 1 -- 172.21.15.5:0/3171623001 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b009faa0 con 0x7f61b00a03e0 2024-08-18T21:09:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.450+0000 7f61b4a96640 1 --2- 172.21.15.5:0/3171623001 >> v2:172.21.15.157:3300/0 conn(0x7f61b009da30 0x7f61b009de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:09:11.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61affff640 1 -- 172.21.15.5:0/3171623001 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61b00a03e0 msgr2=0x7f61b009e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61affff640 1 --2- 172.21.15.5:0/3171623001 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61b00a03e0 0x7f61b009e350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009870 tx=0x7f61a401cb90 comp rx=0 tx=0).ready entity=mon.6 client_cookie=9b2daa9cb984131a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61af7fe640 1 -- 172.21.15.5:0/3171623001 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f61a40b0070 con 0x7f61b00a03e0 2024-08-18T21:09:11.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61af7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61af7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:09:11.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61af7fe640 10 monclient: dump: 2024-08-18T21:09:11.467 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.467 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.467 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.467 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.468 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61af7fe640 10 monclient: _finish_auth 0 2024-08-18T21:09:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61af7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:09:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61af7fe640 1 -- 172.21.15.5:0/3171623001 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a40aa810 con 0x7f61b00a03e0 2024-08-18T21:09:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61af7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61af7fe640 1 -- 172.21.15.5:0/3171623001 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f61a40aae30 con 0x7f61b00a03e0 2024-08-18T21:09:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61af7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61af7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:09:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61af7fe640 10 monclient: dump: 2024-08-18T21:09:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.470 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61b6cfa640 5 monclient: authenticate success, global_id 84471 2024-08-18T21:09:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61b6cfa640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61b6cfa640 4 set_mon_vals no callback set 2024-08-18T21:09:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61b6cfa640 10 monclient: shutdown 2024-08-18T21:09:11.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61b6cfa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:11.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61b6cfa640 1 -- 172.21.15.5:0/3171623001 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61b00a03e0 msgr2=0x7f61b009e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61b6cfa640 1 --2- 172.21.15.5:0/3171623001 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61b00a03e0 0x7f61b009e350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009870 tx=0x7f61a401cb90 comp rx=0 tx=0).stop 2024-08-18T21:09:11.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61b6cfa640 1 -- 172.21.15.5:0/3171623001 shutdown_connections 2024-08-18T21:09:11.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61b6cfa640 1 --2- 172.21.15.5:0/3171623001 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f61b00a3110 0x7f61b01366a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61b6cfa640 1 --2- 172.21.15.5:0/3171623001 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61b00a03e0 0x7f61b009e350 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61b6cfa640 1 --2- 172.21.15.5:0/3171623001 >> v2:172.21.15.157:3300/0 conn(0x7f61b009da30 0x7f61b009de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61b6cfa640 1 -- 172.21.15.5:0/3171623001 >> 172.21.15.5:0/3171623001 conn(0x7f61b00688d0 msgr2=0x7f61b0068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:11.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61b6cfa640 1 -- 172.21.15.5:0/3171623001 shutdown_connections 2024-08-18T21:09:11.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.454+0000 7f61b6cfa640 1 -- 172.21.15.5:0/3171623001 wait complete. 2024-08-18T21:09:11.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 10 monclient: build_initial_monmap 2024-08-18T21:09:11.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 10 monclient: monmap: 2024-08-18T21:09:11.471 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:11.472 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 1 Processor -- start 2024-08-18T21:09:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 1 -- start start 2024-08-18T21:09:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 10 monclient: init 2024-08-18T21:09:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 10 monclient: _add_conns ranks=[6,5,3,0,7,1,4,2,8] 2024-08-18T21:09:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61b009da30 0x7f61b01d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 10 monclient(hunting): picked mon.noname-d con 0x7f61b009da30 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f61b00a3110 0x7f61b01d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 10 monclient(hunting): picked mon.noname-h con 0x7f61b00a3110 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61b01d2350 0x7f61b013d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 10 monclient(hunting): picked mon.noname-g con 0x7f61b01d2350 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:09:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f61b006cce0 con 0x7f61b01d2350 2024-08-18T21:09:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f61b006cb60 con 0x7f61b00a3110 2024-08-18T21:09:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f61b006ce60 con 0x7f61b009da30 2024-08-18T21:09:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b6cfa640 10 monclient(hunting): authenticate will time out at 1318.473629s 2024-08-18T21:09:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61b009da30 0x7f61b01d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61b009da30 0x7f61b01d18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54844/0 (socket says 172.21.15.5:54844) 2024-08-18T21:09:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 1 -- 172.21.15.5:0/2234612531 learned_addr learned my addr 172.21.15.5:0/2234612531 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 10 monclient(hunting): get_auth_request con 0x7f61b009da30 auth_method 0 2024-08-18T21:09:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61affff640 1 -- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f61b00a3110 msgr2=0x7f61b01d1e10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3302/0 2024-08-18T21:09:11.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61affff640 1 --2- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f61b00a3110 0x7f61b01d1e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:09:11.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 10 monclient(hunting): handle_auth_done global_id 84480 payload 824 2024-08-18T21:09:11.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 1 -- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f61b00a3110 msgr2=0x7f61b01d1e10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:09:11.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 1 --2- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f61b00a3110 0x7f61b01d1e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 1 -- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61b01d2350 msgr2=0x7f61b013d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 1 --2- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61b01d2350 0x7f61b013d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 10 monclient: _finish_hunting 0 2024-08-18T21:09:11.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 1 monclient: found mon.noname-d 2024-08-18T21:09:11.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:09:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.458+0000 7f61b4a96640 1 -- 172.21.15.5:0/2234612531 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b00a8a50 con 0x7f61b009da30 2024-08-18T21:09:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61b4a96640 1 -- 172.21.15.5:0/2234612531 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61b009da30 msgr2=0x7f61b01d18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61b4a96640 1 --2- 172.21.15.5:0/2234612531 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61b009da30 0x7f61b01d18d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f61a800d100 tx=0x7f61a800d5c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ad7fa640 1 -- 172.21.15.5:0/2234612531 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f61a801a070 con 0x7f61b009da30 2024-08-18T21:09:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ad7fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:09:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ad7fa640 10 monclient: dump: 2024-08-18T21:09:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.477 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ad7fa640 10 monclient: _finish_auth 0 2024-08-18T21:09:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ad7fa640 10 monclient: _check_auth_tickets 2024-08-18T21:09:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61b6cfa640 5 monclient: authenticate success, global_id 84480 2024-08-18T21:09:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ad7fa640 1 -- 172.21.15.5:0/2234612531 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a8003e10 con 0x7f61b009da30 2024-08-18T21:09:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61b6cfa640 10 monclient: _renew_subs 2024-08-18T21:09:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61b6cfa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:09:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61b6cfa640 1 -- 172.21.15.5:0/2234612531 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b013c560 con 0x7f61b009da30 2024-08-18T21:09:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ad7fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ad7fa640 1 -- 172.21.15.5:0/2234612531 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f61a80044a0 con 0x7f61b009da30 2024-08-18T21:09:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ad7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:09:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ae7fc640 4 set_mon_vals no callback set 2024-08-18T21:09:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ad7fa640 10 monclient: dump: 2024-08-18T21:09:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.479 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61b6cfa640 10 monclient: _renew_subs 2024-08-18T21:09:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61b6cfa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:09:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61b6cfa640 1 -- 172.21.15.5:0/2234612531 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b00a14d0 con 0x7f61b009da30 2024-08-18T21:09:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61b6cfa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61b6cfa640 1 --2- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b00a03e0 0x7f61b013df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61b6cfa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61b6cfa640 1 -- 172.21.15.5:0/2234612531 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f61b0051140 con 0x7f61b00a03e0 2024-08-18T21:09:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ad7fa640 1 -- 172.21.15.5:0/2234612531 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f61a8004680 con 0x7f61b009da30 2024-08-18T21:09:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61affff640 1 --2- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b00a03e0 0x7f61b013df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61affff640 10 monclient: get_auth_request con 0x7f61b00a03e0 auth_method 0 2024-08-18T21:09:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61affff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61affff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ad7fa640 1 --2- 172.21.15.5:0/2234612531 >> v2:172.21.15.157:6812/631023601 conn(0x7f619c03bdc0 0x7f619c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61ad7fa640 1 -- 172.21.15.5:0/2234612531 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(153..153 src has 22..153) ==== 3898+0+0 (secure 0 0 0) 0x7f61a804ea20 con 0x7f61b009da30 2024-08-18T21:09:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61b5297640 1 --2- 172.21.15.5:0/2234612531 >> v2:172.21.15.157:6812/631023601 conn(0x7f619c03bdc0 0x7f619c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61b5297640 10 monclient: get_auth_request con 0x7f619c03bdc0 auth_method 0 2024-08-18T21:09:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61affff640 10 monclient(hunting): handle_auth_done global_id 5842 payload 824 2024-08-18T21:09:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.462+0000 7f61affff640 1 -- 172.21.15.5:0/2234612531 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f61b006dbf0 con 0x7f61b00a03e0 2024-08-18T21:09:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.466+0000 7f61affff640 1 -- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b00a03e0 msgr2=0x7f61b013df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.466+0000 7f61affff640 1 --2- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b00a03e0 0x7f61b013df20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f61b0070010 tx=0x7f61a401a970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.466+0000 7f61b5297640 1 --2- 172.21.15.5:0/2234612531 >> v2:172.21.15.157:6812/631023601 conn(0x7f619c03bdc0 0x7f619c03e280 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f61a00099c0 tx=0x7f61a0009480 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.466+0000 7f61ad7fa640 1 -- 172.21.15.5:0/2234612531 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f61a40b0040 con 0x7f61b00a03e0 2024-08-18T21:09:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.466+0000 7f61ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.466+0000 7f61ad7fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:09:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.466+0000 7f61ad7fa640 10 monclient: dump: 2024-08-18T21:09:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.485 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.466+0000 7f61ad7fa640 1 -- 172.21.15.5:0/2234612531 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f61a40bb070 con 0x7f61b00a03e0 2024-08-18T21:09:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.466+0000 7f61ad7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.466+0000 7f61ad7fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.466+0000 7f61ad7fa640 1 -- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b00a03e0 msgr2=0x7f61b013df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.466+0000 7f61ad7fa640 1 --2- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b00a03e0 0x7f61b013df20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f61b0070010 tx=0x7f61a401a970 comp rx=0 tx=0).stop 2024-08-18T21:09:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.466+0000 7f61ad7fa640 1 -- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b00a03e0 msgr2=0x7f61b013df20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.466+0000 7f61ad7fa640 1 --2- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b00a03e0 0x7f61b013df20 secure :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f61b0070010 tx=0x7f61a401a970 comp rx=0 tx=0).stop 2024-08-18T21:09:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.474+0000 7f61b6cfa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.474+0000 7f61b6cfa640 1 --2- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b013e460 0x7f61b01376b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.474+0000 7f61b6cfa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.474+0000 7f61b6cfa640 1 -- 172.21.15.5:0/2234612531 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f61b013e870 con 0x7f61b013e460 2024-08-18T21:09:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.474+0000 7f61affff640 1 --2- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b013e460 0x7f61b01376b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.474+0000 7f61affff640 10 monclient: get_auth_request con 0x7f61b013e460 auth_method 0 2024-08-18T21:09:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.474+0000 7f61affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.474+0000 7f61affff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.474+0000 7f61affff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.474+0000 7f61affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.474+0000 7f61affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.474+0000 7f61affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.474+0000 7f61affff640 10 monclient(hunting): handle_auth_done global_id 5851 payload 824 2024-08-18T21:09:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.474+0000 7f61affff640 1 -- 172.21.15.5:0/2234612531 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f61b00a0fa0 con 0x7f61b013e460 2024-08-18T21:09:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.474+0000 7f61affff640 1 -- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b013e460 msgr2=0x7f61b01376b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.474+0000 7f61affff640 1 --2- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b013e460 0x7f61b01376b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f61a401c9d0 tx=0x7f61a4018ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61ad7fa640 1 -- 172.21.15.5:0/2234612531 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f61a40b0040 con 0x7f61b013e460 2024-08-18T21:09:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61ad7fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:09:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61ad7fa640 10 monclient: dump: 2024-08-18T21:09:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.489 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61ad7fa640 1 -- 172.21.15.5:0/2234612531 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9404 (secure 0 0 0) 0x7f61a40c0250 con 0x7f61b013e460 2024-08-18T21:09:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61ad7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61ad7fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61ad7fa640 1 -- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b013e460 msgr2=0x7f61b01376b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61ad7fa640 1 --2- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b013e460 0x7f61b01376b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f61a401c9d0 tx=0x7f61a4018ed0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61ad7fa640 1 -- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b013e460 msgr2=0x7f61b01376b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61ad7fa640 1 --2- 172.21.15.5:0/2234612531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b013e460 0x7f61b01376b0 secure :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f61a401c9d0 tx=0x7f61a4018ed0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.490 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:11.490 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:11.490 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:11.490 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:11.490 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 126, 2024-08-18T21:09:11.490 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 360559, 2024-08-18T21:09:11.490 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:11.490 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:11.490 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:11.490 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:11.490 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:11.491 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:11.491 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:11.491 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:11.491 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:11.491 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.491 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:09:11.491 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:11.491 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:11.491 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:11.491 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:11.491 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:11.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:11.491 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:11.491 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:11.492 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:11.492 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:11.492 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:11.492 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:11.492 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:11.492 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:11.492 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.492 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:11.492 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:11.492 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:11.492 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:11.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:11.493 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:11.493 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:11.493 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:11.493 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:11.493 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:11.493 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:11.493 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:11.493 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:11.493 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.493 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:11.493 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:11.493 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:11.493 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:11.494 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:11.494 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:11.494 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:11.494 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:11.494 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:11.494 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:11.494 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:11.494 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:11.494 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:11.494 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:11.494 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:11.494 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:11.494 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:11.495 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:11.495 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:11.495 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:11.495 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:11.495 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:11.495 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:11.495 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:11.495 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:11.495 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:11.495 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:11.495 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:11.495 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.495 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:11.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.496 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:11.496 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.496 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:11.496 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:11.496 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.496 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.496 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.496 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.496 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:11.496 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:11.497 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.497 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.497 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:11.497 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:11.497 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.497 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.497 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.498 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:11.498 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:11.498 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.498 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.498 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.498 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:11.498 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.498 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.498 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:11.499 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.499 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.499 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.499 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:11.499 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:11.499 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.499 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.499 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.499 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:11.500 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:11.500 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:11.500 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:11.500 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.500 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.501 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.501 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:11.501 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:11.501 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.501 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.501 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.501 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.501 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:11.501 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:11.501 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.501 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:11.504 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.504 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.504 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:11.504 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:11.504 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.504 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.504 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.505 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:11.505 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:11.505 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.505 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.505 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.505 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:11.505 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.505 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.506 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:11.506 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.506 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.506 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.506 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:11.506 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:11.506 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.506 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.506 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.507 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:11.507 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:11.507 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.507 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.507 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.507 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:11.507 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.507 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.507 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.510 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:11.510 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:11.510 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.510 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.510 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.510 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.510 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:11.510 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:11.510 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.510 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.510 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.510 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.511 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:11.511 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.511 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.511 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:11.511 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.511 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.511 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.511 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:11.511 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:11.511 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.512 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.512 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.512 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.512 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.512 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:11.512 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:11.512 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.512 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:11.512 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:11.512 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:11.512 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.512 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:09:11.513 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.513 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:11.513 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:11.513 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:11.513 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.513 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.513 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:11.513 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.513 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:11.513 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:11.513 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:09:11.513 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.513 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.514 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:11.514 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61b6cfa640 1 -- 172.21.15.5:0/2234612531 >> v2:172.21.15.157:6812/631023601 conn(0x7f619c03bdc0 msgr2=0x7f619c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61b6cfa640 1 --2- 172.21.15.5:0/2234612531 >> v2:172.21.15.157:6812/631023601 conn(0x7f619c03bdc0 0x7f619c03e280 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f61a00099c0 tx=0x7f61a0009480 comp rx=0 tx=0).stop 2024-08-18T21:09:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61b6cfa640 10 monclient: shutdown 2024-08-18T21:09:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61b6cfa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61b6cfa640 1 -- 172.21.15.5:0/2234612531 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61b009da30 msgr2=0x7f61b01d18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61b6cfa640 1 --2- 172.21.15.5:0/2234612531 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f61b009da30 0x7f61b01d18d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f61a800d100 tx=0x7f61a800d5c0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61b5297640 1 -- 172.21.15.5:0/2234612531 reap_dead start 2024-08-18T21:09:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61b5297640 1 -- 172.21.15.5:0/2234612531 reap_dead start 2024-08-18T21:09:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61b6cfa640 1 -- 172.21.15.5:0/2234612531 shutdown_connections 2024-08-18T21:09:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61b6cfa640 1 -- 172.21.15.5:0/2234612531 >> 172.21.15.5:0/2234612531 conn(0x7f61b00688d0 msgr2=0x7f61b0073940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61b6cfa640 1 -- 172.21.15.5:0/2234612531 shutdown_connections 2024-08-18T21:09:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.478+0000 7f61b6cfa640 1 -- 172.21.15.5:0/2234612531 wait complete. 2024-08-18T21:09:11.516 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-18T21:09:11.517 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon g 2024-08-18T21:09:11.517 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:09:11.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.626+0000 7febc9bf4640 10 monclient: get_monmap_and_config 2024-08-18T21:09:11.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.626+0000 7febc9bf4640 10 monclient: build_initial_monmap 2024-08-18T21:09:11.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.626+0000 7febc9bf4640 10 monclient: monmap: 2024-08-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:11.630903+0000 2024-08-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:11.630903+0000 2024-08-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:11.632 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.626+0000 7febc9bf4640 1 Processor -- start 2024-08-18T21:09:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.626+0000 7febc9bf4640 1 -- start start 2024-08-18T21:09:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.626+0000 7febc9bf4640 10 monclient: init 2024-08-18T21:09:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc9bf4640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc9bf4640 10 monclient: _add_conns ranks=[0,10,2,3,1,7,8,4,9,5,6] 2024-08-18T21:09:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc9bf4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7febc4136a80 addr v1:172.21.15.5:6789/0 2024-08-18T21:09:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc9bf4640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7febc409eba0 0x7febc413eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc9bf4640 10 monclient(hunting): picked mon.noname-f con 0x7febc409eba0 addr v2:172.21.15.157:3300/0 2024-08-18T21:09:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc9bf4640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7febc413f0a0 0x7febc4141490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc9bf4640 10 monclient(hunting): picked mon.noname-b con 0x7febc413f0a0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc9bf4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febc409f000 con 0x7febc4136a80 2024-08-18T21:09:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc9bf4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc9bf4640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7febc409e530 con 0x7febc409eba0 2024-08-18T21:09:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc9bf4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc9bf4640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7febc409e780 con 0x7febc413f0a0 2024-08-18T21:09:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc9bf4640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc9bf4640 10 monclient(hunting): authenticate will time out at 1318.644392s 2024-08-18T21:09:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7febc413f0a0 0x7febc4141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc37fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7febc4136a80 0x7febc4136e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37840/0 (socket says 172.21.15.5:37840) 2024-08-18T21:09:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc37fe640 1 -- 172.21.15.5:0/1920774642 learned_addr learned my addr 172.21.15.5:0/1920774642 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:09:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 10 monclient(hunting): get_auth_request con 0x7febc413f0a0 auth_method 0 2024-08-18T21:09:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 10 monclient(hunting): handle_auth_done global_id 84341 payload 274 2024-08-18T21:09:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 1 -- 172.21.15.5:0/1920774642 >> v2:172.21.15.157:3300/0 conn(0x7febc409eba0 msgr2=0x7febc413eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 1 --2- 172.21.15.5:0/1920774642 >> v2:172.21.15.157:3300/0 conn(0x7febc409eba0 0x7febc413eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 1 -- 172.21.15.5:0/1920774642 >> v1:172.21.15.5:6789/0 conn(0x7febc4136a80 legacy=0x7febc4136e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 1 monclient: found mon.noname-b 2024-08-18T21:09:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:09:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.630+0000 7febc3fff640 1 -- 172.21.15.5:0/1920774642 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc4069940 con 0x7febc413f0a0 2024-08-18T21:09:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc3fff640 1 -- 172.21.15.5:0/1920774642 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7febc413f0a0 msgr2=0x7febc4141490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc3fff640 1 --2- 172.21.15.5:0/1920774642 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7febc413f0a0 0x7febc4141490 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7febbc009d90 tx=0x7febbc01c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42cc0d53b9cedfc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc27fc640 1 -- 172.21.15.5:0/1920774642 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7febbc0ac070 con 0x7febc413f0a0 2024-08-18T21:09:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:09:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc27fc640 10 monclient: dump: 2024-08-18T21:09:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.640 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc27fc640 10 monclient: _finish_auth 0 2024-08-18T21:09:11.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc27fc640 10 monclient: _check_auth_tickets 2024-08-18T21:09:11.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:11.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc27fc640 1 -- 172.21.15.5:0/1920774642 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febbc0a69d0 con 0x7febc413f0a0 2024-08-18T21:09:11.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc27fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:11.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 5 monclient: authenticate success, global_id 84341 2024-08-18T21:09:11.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc27fc640 1 -- 172.21.15.5:0/1920774642 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7febbc0a6c00 con 0x7febc413f0a0 2024-08-18T21:09:11.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:11.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 4 set_mon_vals no callback set 2024-08-18T21:09:11.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:11.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc27fc640 10 monclient: dump: 2024-08-18T21:09:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.642 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 10 monclient: shutdown 2024-08-18T21:09:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 1 -- 172.21.15.5:0/1920774642 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7febc413f0a0 msgr2=0x7febc4141490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 1 --2- 172.21.15.5:0/1920774642 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7febc413f0a0 0x7febc4141490 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7febbc009d90 tx=0x7febbc01c830 comp rx=0 tx=0).stop 2024-08-18T21:09:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 1 -- 172.21.15.5:0/1920774642 shutdown_connections 2024-08-18T21:09:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 1 --2- 172.21.15.5:0/1920774642 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7febc413f0a0 0x7febc4141490 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 1 --2- 172.21.15.5:0/1920774642 >> v2:172.21.15.157:3300/0 conn(0x7febc409eba0 0x7febc413eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 1 -- 172.21.15.5:0/1920774642 >> 172.21.15.5:0/1920774642 conn(0x7febc40688d0 msgr2=0x7febc4068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 1 -- 172.21.15.5:0/1920774642 shutdown_connections 2024-08-18T21:09:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 1 -- 172.21.15.5:0/1920774642 wait complete. 2024-08-18T21:09:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 10 monclient: build_initial_monmap 2024-08-18T21:09:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 10 monclient: monmap: 2024-08-18T21:09:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:11.644 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 1 Processor -- start 2024-08-18T21:09:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 1 -- start start 2024-08-18T21:09:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 10 monclient: init 2024-08-18T21:09:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 10 monclient: _add_conns ranks=[3,2,7,5,0,6,1,8,4] 2024-08-18T21:09:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc409eba0 0x7febc413d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 10 monclient(hunting): picked mon.noname-g con 0x7febc409eba0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:09:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7febc4136a80 0x7febc41d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 10 monclient(hunting): picked mon.noname-b con 0x7febc4136a80 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7febc413f0a0 0x7febc413b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.634+0000 7febc9bf4640 10 monclient(hunting): picked mon.noname-i con 0x7febc413f0a0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7febc4144400 con 0x7febc4136a80 2024-08-18T21:09:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7febc409f680 con 0x7febc409eba0 2024-08-18T21:09:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7febc4144580 con 0x7febc413f0a0 2024-08-18T21:09:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 10 monclient(hunting): authenticate will time out at 1318.652026s 2024-08-18T21:09:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7febc4136a80 0x7febc41d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7febc4136a80 0x7febc41d1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:36676/0 (socket says 172.21.15.5:36676) 2024-08-18T21:09:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 1 -- 172.21.15.5:0/1929255875 learned_addr learned my addr 172.21.15.5:0/1929255875 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 10 monclient(hunting): get_auth_request con 0x7febc4136a80 auth_method 0 2024-08-18T21:09:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc37fe640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc409eba0 0x7febc413d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc37fe640 10 monclient(hunting): get_auth_request con 0x7febc409eba0 auth_method 0 2024-08-18T21:09:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 10 monclient(hunting): handle_auth_done global_id 84350 payload 824 2024-08-18T21:09:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc3fff640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7febc413f0a0 0x7febc413b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 1 -- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7febc413f0a0 msgr2=0x7febc413b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7febc413f0a0 0x7febc413b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 1 -- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc409eba0 msgr2=0x7febc413d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc409eba0 0x7febc413d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:09:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 1 monclient: found mon.noname-b 2024-08-18T21:09:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:09:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 1 -- 172.21.15.5:0/1929255875 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc4068d20 con 0x7febc4136a80 2024-08-18T21:09:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 1 -- 172.21.15.5:0/1929255875 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7febc4136a80 msgr2=0x7febc41d1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc2ffd640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7febc4136a80 0x7febc41d1b70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7febb800b550 tx=0x7febb800ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febabfff640 1 -- 172.21.15.5:0/1929255875 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7febb8014070 con 0x7febc4136a80 2024-08-18T21:09:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febabfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febabfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:09:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febabfff640 10 monclient: dump: 2024-08-18T21:09:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.654 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febabfff640 10 monclient: _finish_auth 0 2024-08-18T21:09:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febabfff640 10 monclient: _check_auth_tickets 2024-08-18T21:09:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febabfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febabfff640 1 -- 172.21.15.5:0/1929255875 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb8010c90 con 0x7febc4136a80 2024-08-18T21:09:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febabfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febabfff640 1 -- 172.21.15.5:0/1929255875 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7febb8010e40 con 0x7febc4136a80 2024-08-18T21:09:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febabfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febabfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febabfff640 10 monclient: dump: 2024-08-18T21:09:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.656 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 5 monclient: authenticate success, global_id 84350 2024-08-18T21:09:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc17fa640 4 set_mon_vals no callback set 2024-08-18T21:09:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 10 monclient: _renew_subs 2024-08-18T21:09:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 1 -- 172.21.15.5:0/1929255875 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc411f8b0 con 0x7febc4136a80 2024-08-18T21:09:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 10 monclient: _renew_subs 2024-08-18T21:09:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 1 -- 172.21.15.5:0/1929255875 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7febc41c9410 con 0x7febc4136a80 2024-08-18T21:09:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc41d20b0 0x7febc413b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.638+0000 7febc9bf4640 1 -- 172.21.15.5:0/1929255875 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7febc4069150 con 0x7febc41d20b0 2024-08-18T21:09:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febabfff640 1 -- 172.21.15.5:0/1929255875 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7febb8017070 con 0x7febc4136a80 2024-08-18T21:09:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febc37fe640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc41d20b0 0x7febc413b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febc37fe640 10 monclient: get_auth_request con 0x7febc41d20b0 auth_method 0 2024-08-18T21:09:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febc37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febc37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febc37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febabfff640 1 --2- 172.21.15.5:0/1929255875 >> v2:172.21.15.157:6812/631023601 conn(0x7febb003bdc0 0x7febb003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febc37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febc37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febc37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febabfff640 1 -- 172.21.15.5:0/1929255875 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(153..153 src has 22..153) ==== 3898+0+0 (secure 0 0 0) 0x7febb800d040 con 0x7febc4136a80 2024-08-18T21:09:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febc3fff640 1 --2- 172.21.15.5:0/1929255875 >> v2:172.21.15.157:6812/631023601 conn(0x7febb003bdc0 0x7febb003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febc37fe640 10 monclient(hunting): handle_auth_done global_id 84306 payload 824 2024-08-18T21:09:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febc37fe640 1 -- 172.21.15.5:0/1929255875 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7febc413e2e0 con 0x7febc41d20b0 2024-08-18T21:09:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febc3fff640 10 monclient: get_auth_request con 0x7febb003bdc0 auth_method 0 2024-08-18T21:09:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febc37fe640 1 -- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc41d20b0 msgr2=0x7febc413b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febc37fe640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc41d20b0 0x7febc413b960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7febb400e500 tx=0x7febb400e9c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febabfff640 1 -- 172.21.15.5:0/1929255875 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7febb4004e40 con 0x7febc41d20b0 2024-08-18T21:09:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febabfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febc3fff640 1 --2- 172.21.15.5:0/1929255875 >> v2:172.21.15.157:6812/631023601 conn(0x7febb003bdc0 0x7febb003e280 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7febbc0ae000 tx=0x7febbc0a7000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febabfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:09:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.642+0000 7febabfff640 10 monclient: dump: 2024-08-18T21:09:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.660 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.646+0000 7febabfff640 1 -- 172.21.15.5:0/1929255875 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7febb4018070 con 0x7febc41d20b0 2024-08-18T21:09:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.646+0000 7febabfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.646+0000 7febabfff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.646+0000 7febabfff640 1 -- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc41d20b0 msgr2=0x7febc413b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.646+0000 7febabfff640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc41d20b0 0x7febc413b960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7febb400e500 tx=0x7febb400e9c0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.646+0000 7febabfff640 1 -- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc41d20b0 msgr2=0x7febc413b960 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.646+0000 7febabfff640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc41d20b0 0x7febc413b960 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7febb400e500 tx=0x7febb400e9c0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.650+0000 7febc9bf4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.650+0000 7febc9bf4640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc413bea0 0x7febc4137670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.650+0000 7febc9bf4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.650+0000 7febc9bf4640 1 -- 172.21.15.5:0/1929255875 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7febc413c2b0 con 0x7febc413bea0 2024-08-18T21:09:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.654+0000 7febc37fe640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc413bea0 0x7febc4137670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.654+0000 7febc37fe640 10 monclient: get_auth_request con 0x7febc413bea0 auth_method 0 2024-08-18T21:09:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.654+0000 7febc37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.654+0000 7febc37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.654+0000 7febc37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.654+0000 7febc37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.654+0000 7febc37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.654+0000 7febc37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.654+0000 7febc37fe640 10 monclient(hunting): handle_auth_done global_id 84315 payload 824 2024-08-18T21:09:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.654+0000 7febc37fe640 1 -- 172.21.15.5:0/1929255875 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7febc406dbf0 con 0x7febc413bea0 2024-08-18T21:09:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.654+0000 7febc37fe640 1 -- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc413bea0 msgr2=0x7febc4137670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.654+0000 7febc37fe640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc413bea0 0x7febc4137670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7febb4017000 tx=0x7febb4004950 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.654+0000 7febabfff640 1 -- 172.21.15.5:0/1929255875 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7febb4006750 con 0x7febc413bea0 2024-08-18T21:09:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.654+0000 7febabfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.654+0000 7febabfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:09:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.654+0000 7febabfff640 10 monclient: dump: 2024-08-18T21:09:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.665 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febabfff640 1 -- 172.21.15.5:0/1929255875 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9236 (secure 0 0 0) 0x7febb40062e0 con 0x7febc413bea0 2024-08-18T21:09:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febabfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febabfff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febabfff640 1 -- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc413bea0 msgr2=0x7febc4137670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febabfff640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc413bea0 0x7febc4137670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7febb4017000 tx=0x7febb4004950 comp rx=0 tx=0).stop 2024-08-18T21:09:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febabfff640 1 -- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc413bea0 msgr2=0x7febc4137670 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febabfff640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febc413bea0 0x7febc4137670 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7febb4017000 tx=0x7febb4004950 comp rx=0 tx=0).stop 2024-08-18T21:09:11.666 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:11.666 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:11.666 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:11.666 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:11.666 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 126, 2024-08-18T21:09:11.666 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 48483, 2024-08-18T21:09:11.666 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:11.666 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:11.666 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:11.666 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:11.667 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:11.667 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:11.667 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:11.667 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:11.667 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:11.667 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.667 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:09:11.667 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:11.667 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:11.667 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:11.667 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:11.667 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:11.668 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:11.668 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:11.668 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:11.668 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:11.668 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:11.668 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:11.668 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:11.668 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:11.668 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:11.668 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.668 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:11.668 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:11.668 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:11.669 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:11.669 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:11.669 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:11.669 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:11.669 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:11.669 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:11.669 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:11.669 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:11.669 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:11.669 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:11.669 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.669 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:11.670 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:11.670 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:11.670 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:11.670 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:11.670 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:11.670 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:11.670 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:11.670 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:11.670 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:11.670 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:11.670 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:11.670 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:11.670 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:11.671 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:11.671 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:11.671 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:11.671 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:11.671 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:11.671 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:11.671 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:11.671 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:11.671 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:11.671 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:11.671 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:11.671 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:11.671 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:11.672 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:11.672 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.672 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:11.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.672 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:11.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.672 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:11.672 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:11.672 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.672 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.672 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.672 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:11.673 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.673 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.673 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:11.673 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.673 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.673 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.673 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:11.673 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:11.673 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.673 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.673 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.674 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:11.674 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:11.674 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.674 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.674 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.674 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:11.674 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.674 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.675 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:11.675 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.675 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.675 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.675 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:11.675 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:11.675 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.675 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.675 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.675 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:11.676 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:11.676 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.676 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.676 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.676 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:11.676 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.676 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.676 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:11.676 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.677 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.677 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.677 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:11.677 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:11.677 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.677 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.677 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.677 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.677 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:11.677 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:11.678 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.678 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.678 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.678 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:11.678 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.678 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.678 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:11.678 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.678 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.678 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.679 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:11.679 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:11.679 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.679 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.679 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.679 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:11.679 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:11.679 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.679 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.680 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:11.680 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.680 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:11.680 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.680 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.680 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.680 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:11.680 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:11.680 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.681 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.681 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.681 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:11.681 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:11.681 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.681 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.682 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.682 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:11.682 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.682 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.682 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:11.682 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.682 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.683 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.683 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:11.683 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:11.683 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.683 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.683 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.683 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:11.683 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:11.684 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:11.684 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:11.684 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.684 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.684 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.685 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:11.685 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:11.685 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.685 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.685 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.685 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:11.685 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:11.685 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.685 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.685 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:11.686 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:11.686 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.686 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.686 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:11.686 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:11.687 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.687 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.687 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.687 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:11.687 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:11.687 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.687 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:11.687 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.688 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:11.688 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.688 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.688 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:11.688 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:11.688 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.688 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.688 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.689 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.689 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:11.689 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:11.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.689 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:11.689 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:11.689 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:11.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.689 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.689 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:11.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.689 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:11.690 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:11.690 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:11.690 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.690 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.690 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:11.690 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:11.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febc9bf4640 1 -- 172.21.15.5:0/1929255875 >> v2:172.21.15.157:6812/631023601 conn(0x7febb003bdc0 msgr2=0x7febb003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febc9bf4640 1 --2- 172.21.15.5:0/1929255875 >> v2:172.21.15.157:6812/631023601 conn(0x7febb003bdc0 0x7febb003e280 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7febbc0ae000 tx=0x7febbc0a7000 comp rx=0 tx=0).stop 2024-08-18T21:09:11.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febc9bf4640 10 monclient: shutdown 2024-08-18T21:09:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febc9bf4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febc9bf4640 1 -- 172.21.15.5:0/1929255875 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7febc4136a80 msgr2=0x7febc41d1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febc9bf4640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7febc4136a80 0x7febc41d1b70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7febb800b550 tx=0x7febb800ba10 comp rx=0 tx=0).stop 2024-08-18T21:09:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febc3fff640 1 -- 172.21.15.5:0/1929255875 reap_dead start 2024-08-18T21:09:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febc9bf4640 1 -- 172.21.15.5:0/1929255875 shutdown_connections 2024-08-18T21:09:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febc9bf4640 1 --2- 172.21.15.5:0/1929255875 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7febc4136a80 0x7febc41d1b70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febc9bf4640 1 -- 172.21.15.5:0/1929255875 >> 172.21.15.5:0/1929255875 conn(0x7febc40688d0 msgr2=0x7febc40a22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febc9bf4640 1 -- 172.21.15.5:0/1929255875 shutdown_connections 2024-08-18T21:09:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.658+0000 7febc9bf4640 1 -- 172.21.15.5:0/1929255875 wait complete. 2024-08-18T21:09:11.692 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-18T21:09:11.693 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-08-18T21:09:11.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:09:11.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.806+0000 7fd55a3a6640 10 monclient: get_monmap_and_config 2024-08-18T21:09:11.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.806+0000 7fd55a3a6640 10 monclient: build_initial_monmap 2024-08-18T21:09:11.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.806+0000 7fd55a3a6640 10 monclient: monmap: 2024-08-18T21:09:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:11.811321+0000 2024-08-18T21:09:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:11.811321+0000 2024-08-18T21:09:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:11.812 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 1 Processor -- start 2024-08-18T21:09:11.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 1 -- start start 2024-08-18T21:09:11.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 10 monclient: init 2024-08-18T21:09:11.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:11.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 10 monclient: _add_conns ranks=[3,8,0,6,2,4,5,7,1,9,10] 2024-08-18T21:09:11.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd554139dc0 0x7fd55413a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 10 monclient(hunting): picked mon.noname-g con 0x7fd554139dc0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:09:11.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd55409f110 0x7fd55406c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 10 monclient(hunting): picked mon.noname-e con 0x7fd55409f110 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd55406ce90 addr v1:172.21.15.5:6789/0 2024-08-18T21:09:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd55409deb0 con 0x7fd55406ce90 2024-08-18T21:09:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd5540a4f90 con 0x7fd554139dc0 2024-08-18T21:09:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fd55409daa0 con 0x7fd55409f110 2024-08-18T21:09:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd55a3a6640 10 monclient(hunting): authenticate will time out at 1318.824951s 2024-08-18T21:09:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd55409f110 0x7fd55406c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd558943640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd55406ce90 0x7fd554140a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37844/0 (socket says 172.21.15.5:37844) 2024-08-18T21:09:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd55409f110 0x7fd55406c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:58278/0 (socket says 172.21.15.5:58278) 2024-08-18T21:09:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd558943640 1 -- 172.21.15.5:0/1111187615 learned_addr learned my addr 172.21.15.5:0/1111187615 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:09:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 10 monclient(hunting): get_auth_request con 0x7fd55409f110 auth_method 0 2024-08-18T21:09:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd553fff640 1 --2- 172.21.15.5:0/1111187615 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd554139dc0 0x7fd55413a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd553fff640 10 monclient(hunting): get_auth_request con 0x7fd554139dc0 auth_method 0 2024-08-18T21:09:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd553fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd553fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd553fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 10 monclient(hunting): handle_auth_done global_id 54980 payload 274 2024-08-18T21:09:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 1 -- 172.21.15.5:0/1111187615 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd554139dc0 msgr2=0x7fd55413a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 1 --2- 172.21.15.5:0/1111187615 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd554139dc0 0x7fd55413a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 1 -- 172.21.15.5:0/1111187615 >> v1:172.21.15.5:6789/0 conn(0x7fd55406ce90 legacy=0x7fd554140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 10 monclient: _finish_hunting 0 2024-08-18T21:09:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 1 monclient: found mon.noname-e 2024-08-18T21:09:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:09:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.810+0000 7fd5537fe640 1 -- 172.21.15.5:0/1111187615 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55409e190 con 0x7fd55409f110 2024-08-18T21:09:11.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd5537fe640 1 -- 172.21.15.5:0/1111187615 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd55409f110 msgr2=0x7fd55406c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd5537fe640 1 --2- 172.21.15.5:0/1111187615 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd55409f110 0x7fd55406c950 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd5480097f0 tx=0x7fd54801c370 comp rx=0 tx=0).ready entity=mon.8 client_cookie=efef4245ca16c27c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd552ffd640 1 -- 172.21.15.5:0/1111187615 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd5480b0070 con 0x7fd55409f110 2024-08-18T21:09:11.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd552ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd552ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:09:11.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd552ffd640 10 monclient: dump: 2024-08-18T21:09:11.823 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.823 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.823 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.823 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.823 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.823 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.823 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.823 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.823 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.823 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.823 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.824 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.824 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.824 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.824 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.824 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd552ffd640 10 monclient: _finish_auth 0 2024-08-18T21:09:11.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd552ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:09:11.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd552ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:11.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd552ffd640 1 -- 172.21.15.5:0/1111187615 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5480aa810 con 0x7fd55409f110 2024-08-18T21:09:11.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 5 monclient: authenticate success, global_id 54980 2024-08-18T21:09:11.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:11.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd552ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:11.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:11.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd552ffd640 1 -- 172.21.15.5:0/1111187615 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd5480a9300 con 0x7fd55409f110 2024-08-18T21:09:11.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 4 set_mon_vals no callback set 2024-08-18T21:09:11.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd552ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd552ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:11.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd552ffd640 10 monclient: dump: 2024-08-18T21:09:11.825 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.825 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.825 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.825 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.825 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.825 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.825 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.825 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.826 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.826 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.826 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.826 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.826 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.826 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.826 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.826 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 10 monclient: shutdown 2024-08-18T21:09:11.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:11.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 1 -- 172.21.15.5:0/1111187615 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd55409f110 msgr2=0x7fd55406c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 1 --2- 172.21.15.5:0/1111187615 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd55409f110 0x7fd55406c950 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd5480097f0 tx=0x7fd54801c370 comp rx=0 tx=0).stop 2024-08-18T21:09:11.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 1 -- 172.21.15.5:0/1111187615 shutdown_connections 2024-08-18T21:09:11.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 1 --2- 172.21.15.5:0/1111187615 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd55409f110 0x7fd55406c950 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 1 --2- 172.21.15.5:0/1111187615 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd554139dc0 0x7fd55413a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 1 -- 172.21.15.5:0/1111187615 >> 172.21.15.5:0/1111187615 conn(0x7fd5540688d0 msgr2=0x7fd554068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:11.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 1 -- 172.21.15.5:0/1111187615 shutdown_connections 2024-08-18T21:09:11.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 1 -- 172.21.15.5:0/1111187615 wait complete. 2024-08-18T21:09:11.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 10 monclient: build_initial_monmap 2024-08-18T21:09:11.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 10 monclient: monmap: 2024-08-18T21:09:11.827 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:11.827 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:11.827 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:11.827 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:11.827 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:11.827 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.827 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:11.828 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:11.828 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:11.828 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:11.828 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:11.828 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:11.828 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:11.828 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:11.828 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:11.828 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 1 Processor -- start 2024-08-18T21:09:11.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 1 -- start start 2024-08-18T21:09:11.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 10 monclient: init 2024-08-18T21:09:11.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:11.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 10 monclient: _add_conns ranks=[0,8,1,4,7,3,5,2,6] 2024-08-18T21:09:11.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55406ce90 0x7fd55411f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 10 monclient(hunting): picked mon.noname-a con 0x7fd55406ce90 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:09:11.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd55409f110 0x7fd5541d1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 10 monclient(hunting): picked mon.noname-e con 0x7fd55409f110 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:11.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd554139dc0 0x7fd5541d2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 10 monclient(hunting): picked mon.noname-f con 0x7fd554139dc0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:09:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd554144980 con 0x7fd55406ce90 2024-08-18T21:09:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd5540a4be0 con 0x7fd554139dc0 2024-08-18T21:09:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fd554144b00 con 0x7fd55409f110 2024-08-18T21:09:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd55a3a6640 10 monclient(hunting): authenticate will time out at 1318.831873s 2024-08-18T21:09:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd553fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55406ce90 0x7fd55411f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd5537fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd55409f110 0x7fd5541d1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.814+0000 7fd553fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55406ce90 0x7fd55411f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46304/0 (socket says 172.21.15.5:46304) 2024-08-18T21:09:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd553fff640 1 -- 172.21.15.5:0/3306152006 learned_addr learned my addr 172.21.15.5:0/3306152006 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd553fff640 10 monclient(hunting): get_auth_request con 0x7fd55406ce90 auth_method 0 2024-08-18T21:09:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd553fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd553fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd553fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 10 monclient(hunting): get_auth_request con 0x7fd55409f110 auth_method 0 2024-08-18T21:09:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd553fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd553fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd553fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 10 monclient(hunting): handle_auth_done global_id 54989 payload 824 2024-08-18T21:09:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 1 -- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd554139dc0 msgr2=0x7fd5541d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 1 --2- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd554139dc0 0x7fd5541d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 1 -- 172.21.15.5:0/3306152006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55406ce90 msgr2=0x7fd55411f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 1 --2- 172.21.15.5:0/3306152006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55406ce90 0x7fd55411f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 10 monclient: _finish_hunting 0 2024-08-18T21:09:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 1 monclient: found mon.noname-e 2024-08-18T21:09:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:09:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 1 -- 172.21.15.5:0/3306152006 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd554120c90 con 0x7fd55409f110 2024-08-18T21:09:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 1 -- 172.21.15.5:0/3306152006 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd55409f110 msgr2=0x7fd5541d1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5537fe640 1 --2- 172.21.15.5:0/3306152006 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd55409f110 0x7fd5541d1ed0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd5480ab000 tx=0x7fd548019110 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd550ff9640 1 -- 172.21.15.5:0/3306152006 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd5480b8020 con 0x7fd55409f110 2024-08-18T21:09:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd550ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd550ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:09:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd550ff9640 10 monclient: dump: 2024-08-18T21:09:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.834 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd550ff9640 10 monclient: _finish_auth 0 2024-08-18T21:09:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd550ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:09:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd550ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd55a3a6640 5 monclient: authenticate success, global_id 54989 2024-08-18T21:09:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd550ff9640 1 -- 172.21.15.5:0/3306152006 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5480044b0 con 0x7fd55409f110 2024-08-18T21:09:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd550ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd550ff9640 1 -- 172.21.15.5:0/3306152006 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd5480b0040 con 0x7fd55409f110 2024-08-18T21:09:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd550ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd550ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd5527fc640 4 set_mon_vals no callback set 2024-08-18T21:09:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd550ff9640 10 monclient: dump: 2024-08-18T21:09:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.836 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd55a3a6640 10 monclient: _renew_subs 2024-08-18T21:09:11.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd55a3a6640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:11.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd55a3a6640 1 -- 172.21.15.5:0/3306152006 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd554120f70 con 0x7fd55409f110 2024-08-18T21:09:11.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd55a3a6640 10 monclient: _renew_subs 2024-08-18T21:09:11.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd55a3a6640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:11.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.818+0000 7fd55a3a6640 1 -- 172.21.15.5:0/3306152006 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5540a4110 con 0x7fd55409f110 2024-08-18T21:09:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd550ff9640 1 -- 172.21.15.5:0/3306152006 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fd5480bb070 con 0x7fd55409f110 2024-08-18T21:09:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd55a3a6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd55a3a6640 1 --2- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd55413f630 0x7fd55402d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd55a3a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd55a3a6640 1 -- 172.21.15.5:0/3306152006 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fd5541c9990 con 0x7fd55413f630 2024-08-18T21:09:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd550ff9640 1 --2- 172.21.15.5:0/3306152006 >> v2:172.21.15.157:6812/631023601 conn(0x7fd54003bdc0 0x7fd54003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd550ff9640 1 -- 172.21.15.5:0/3306152006 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(153..153 src has 22..153) ==== 3898+0+0 (secure 0 0 0) 0x7fd5480e76b0 con 0x7fd55409f110 2024-08-18T21:09:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd553fff640 1 --2- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd55413f630 0x7fd55402d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd553fff640 10 monclient: get_auth_request con 0x7fd55413f630 auth_method 0 2024-08-18T21:09:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd553fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd553fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd553fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd558943640 1 --2- 172.21.15.5:0/3306152006 >> v2:172.21.15.157:6812/631023601 conn(0x7fd54003bdc0 0x7fd54003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd558943640 10 monclient: get_auth_request con 0x7fd54003bdc0 auth_method 0 2024-08-18T21:09:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd553fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd553fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd553fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd553fff640 10 monclient(hunting): handle_auth_done global_id 5758 payload 824 2024-08-18T21:09:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd553fff640 1 -- 172.21.15.5:0/3306152006 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd55411f530 con 0x7fd55413f630 2024-08-18T21:09:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd553fff640 1 -- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd55413f630 msgr2=0x7fd55402d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd553fff640 1 --2- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd55413f630 0x7fd55402d1d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd5440107b0 tx=0x7fd544010c70 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd558943640 1 --2- 172.21.15.5:0/3306152006 >> v2:172.21.15.157:6812/631023601 conn(0x7fd54003bdc0 0x7fd54003e280 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0059a0 tx=0x7fd54c004fc0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd550ff9640 1 -- 172.21.15.5:0/3306152006 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd544018070 con 0x7fd55413f630 2024-08-18T21:09:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd550ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd550ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:09:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.822+0000 7fd550ff9640 10 monclient: dump: 2024-08-18T21:09:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.844 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.826+0000 7fd550ff9640 1 -- 172.21.15.5:0/3306152006 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd54400ec40 con 0x7fd55413f630 2024-08-18T21:09:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.826+0000 7fd550ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.826+0000 7fd550ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.826+0000 7fd550ff9640 1 -- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd55413f630 msgr2=0x7fd55402d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.826+0000 7fd550ff9640 1 --2- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd55413f630 0x7fd55402d1d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd5440107b0 tx=0x7fd544010c70 comp rx=0 tx=0).stop 2024-08-18T21:09:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.826+0000 7fd550ff9640 1 -- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd55413f630 msgr2=0x7fd55402d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.826+0000 7fd550ff9640 1 --2- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd55413f630 0x7fd55402d1d0 secure :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd5440107b0 tx=0x7fd544010c70 comp rx=0 tx=0).stop 2024-08-18T21:09:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.830+0000 7fd55a3a6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.830+0000 7fd55a3a6640 1 --2- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd55413fa10 0x7fd55402d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.830+0000 7fd55a3a6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.830+0000 7fd55a3a6640 1 -- 172.21.15.5:0/3306152006 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fd554051140 con 0x7fd55413fa10 2024-08-18T21:09:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.830+0000 7fd553fff640 1 --2- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd55413fa10 0x7fd55402d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.830+0000 7fd553fff640 10 monclient: get_auth_request con 0x7fd55413fa10 auth_method 0 2024-08-18T21:09:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.830+0000 7fd553fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.830+0000 7fd553fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.830+0000 7fd553fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.830+0000 7fd553fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.830+0000 7fd553fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:11.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.830+0000 7fd553fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:11.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.830+0000 7fd553fff640 10 monclient(hunting): handle_auth_done global_id 5767 payload 824 2024-08-18T21:09:11.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.830+0000 7fd553fff640 1 -- 172.21.15.5:0/3306152006 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd55406dbf0 con 0x7fd55413fa10 2024-08-18T21:09:11.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.834+0000 7fd553fff640 1 -- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd55413fa10 msgr2=0x7fd55402d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:11.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.834+0000 7fd553fff640 1 --2- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd55413fa10 0x7fd55402d710 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd5440107b0 tx=0x7fd5440046d0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:11.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.834+0000 7fd550ff9640 1 -- 172.21.15.5:0/3306152006 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd544014ab0 con 0x7fd55413fa10 2024-08-18T21:09:11.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.834+0000 7fd550ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:11.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.834+0000 7fd550ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:09:11.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.834+0000 7fd550ff9640 10 monclient: dump: 2024-08-18T21:09:11.847 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:11.847 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:11.847 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.847 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:11.847 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:11.847 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:11.848 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:11.848 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:11.848 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:11.848 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:11.848 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:11.848 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:11.848 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:11.848 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:11.848 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:11.848 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:11.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.834+0000 7fd550ff9640 1 -- 172.21.15.5:0/3306152006 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9571 (secure 0 0 0) 0x7fd544014640 con 0x7fd55413fa10 2024-08-18T21:09:11.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.834+0000 7fd550ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:11.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.834+0000 7fd550ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:11.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.834+0000 7fd550ff9640 1 -- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd55413fa10 msgr2=0x7fd55402d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.834+0000 7fd550ff9640 1 --2- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd55413fa10 0x7fd55402d710 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd5440107b0 tx=0x7fd5440046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.834+0000 7fd550ff9640 1 -- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd55413fa10 msgr2=0x7fd55402d710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:11.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.834+0000 7fd550ff9640 1 --2- 172.21.15.5:0/3306152006 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd55413fa10 0x7fd55402d710 secure :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd5440107b0 tx=0x7fd5440046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.849 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:11.849 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:11.849 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:11.849 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:11.849 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 126, 2024-08-18T21:09:11.850 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 360931, 2024-08-18T21:09:11.850 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:11.850 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:11.850 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:11.850 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:11.850 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:11.850 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:11.850 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:11.850 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:11.850 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:11.850 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.850 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:09:11.850 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:11.851 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:11.851 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:11.851 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:11.851 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:11.851 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:11.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:11.851 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:11.851 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:11.852 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:11.852 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:11.852 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:11.852 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:11.852 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:11.852 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.852 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:11.852 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:11.852 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:11.852 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:11.852 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:11.852 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:11.852 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:11.853 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:11.853 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:11.853 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:11.853 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:11.853 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:11.853 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:11.853 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.853 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:11.853 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:11.853 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:11.853 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:11.853 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:11.853 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:11.855 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:11.855 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:11.855 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:11.855 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:11.855 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:11.855 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:11.855 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:11.855 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:11.855 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:11.855 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.855 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:11.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.855 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:11.856 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.856 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:11.856 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:11.856 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.856 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.856 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.856 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.856 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:11.856 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.856 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.856 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.856 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:11.857 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.857 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.857 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.857 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:11.857 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:11.857 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.857 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.857 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.857 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.857 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:11.857 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:11.858 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.858 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.858 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.858 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.858 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:11.858 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.858 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.858 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.858 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:11.858 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.858 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.859 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.859 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:11.859 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:11.859 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.859 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.859 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.859 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:11.859 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:11.859 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.859 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.860 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.860 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.860 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:11.860 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.860 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.860 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.860 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:11.860 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.860 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.860 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.860 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:11.861 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:11.861 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.861 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.861 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.861 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:11.861 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:11.861 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.861 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.861 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.861 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:11.861 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.862 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.862 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.862 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:11.862 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.862 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.862 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.862 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:11.862 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:11.862 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.862 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.862 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.863 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:11.863 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:11.863 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.863 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.863 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.863 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:11.863 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.863 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.863 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:11.864 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.864 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.864 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.864 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:11.864 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:11.864 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.864 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.864 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.864 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:11.864 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:11.865 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.865 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.865 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.865 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.865 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:11.865 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.865 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.865 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.865 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:11.865 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.865 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.865 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.866 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:11.866 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:11.866 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.866 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.866 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.866 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.866 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:11.866 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:11.866 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.866 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.866 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.866 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.866 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:11.867 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.867 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.867 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:11.867 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.867 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.867 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.867 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:11.867 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:11.867 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.867 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.868 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.868 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:11.868 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:11.868 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.868 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.868 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.868 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:11.868 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.869 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.869 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:11.869 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.869 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.869 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.869 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:11.869 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:11.869 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.869 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.869 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.869 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:11.870 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:11.870 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:11.870 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:11.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.870 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:11.870 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:11.870 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.870 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:11.870 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:11.870 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:11.870 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.871 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.871 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:11.871 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:11.871 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:11.871 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:11.871 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:11.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.871 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.871 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:11.871 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:11.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.871 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:11.872 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:11.872 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:11.872 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.872 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.872 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:09:11.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.872 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:11.872 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:11.872 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:11.872 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.872 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.872 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:11.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.872 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:11.873 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:11.873 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:09:11.873 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.873 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:11.873 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:09:11.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:11.873 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:11.873 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:11.873 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:11.873 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:11.873 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:11.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:11.873 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:11.874 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:11.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.838+0000 7fd55a3a6640 1 -- 172.21.15.5:0/3306152006 >> v2:172.21.15.157:6812/631023601 conn(0x7fd54003bdc0 msgr2=0x7fd54003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.838+0000 7fd55a3a6640 1 --2- 172.21.15.5:0/3306152006 >> v2:172.21.15.157:6812/631023601 conn(0x7fd54003bdc0 0x7fd54003e280 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0059a0 tx=0x7fd54c004fc0 comp rx=0 tx=0).stop 2024-08-18T21:09:11.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.838+0000 7fd55a3a6640 10 monclient: shutdown 2024-08-18T21:09:11.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.838+0000 7fd55a3a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:11.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.838+0000 7fd55a3a6640 1 -- 172.21.15.5:0/3306152006 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd55409f110 msgr2=0x7fd5541d1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:11.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.838+0000 7fd55a3a6640 1 --2- 172.21.15.5:0/3306152006 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd55409f110 0x7fd5541d1ed0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd5480ab000 tx=0x7fd548019110 comp rx=0 tx=0).stop 2024-08-18T21:09:11.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.838+0000 7fd558943640 1 -- 172.21.15.5:0/3306152006 reap_dead start 2024-08-18T21:09:11.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.838+0000 7fd558943640 1 -- 172.21.15.5:0/3306152006 reap_dead start 2024-08-18T21:09:11.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.838+0000 7fd55a3a6640 1 -- 172.21.15.5:0/3306152006 shutdown_connections 2024-08-18T21:09:11.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.838+0000 7fd55a3a6640 1 -- 172.21.15.5:0/3306152006 >> 172.21.15.5:0/3306152006 conn(0x7fd5540688d0 msgr2=0x7fd5540a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:11.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.838+0000 7fd55a3a6640 1 -- 172.21.15.5:0/3306152006 shutdown_connections 2024-08-18T21:09:11.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:11.838+0000 7fd55a3a6640 1 -- 172.21.15.5:0/3306152006 wait complete. 2024-08-18T21:09:11.878 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-18T21:09:11.878 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-18T21:09:11.966 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:11.966 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29913]: starting. 2024-08-18T21:09:11.966 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29913]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29875 2024-08-18T21:09:11.967 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[29913]: shutting down. 2024-08-18T21:09:11.970 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:11.970 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:11.970 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:09:11.973 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:09:14.209 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29967]: starting. 2024-08-18T21:09:14.209 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29967]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29966 2024-08-18T21:09:14.209 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29967]: created object 0... 2024-08-18T21:09:14.209 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29967]: created object 25... 2024-08-18T21:09:14.209 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29967]: created object 49... 2024-08-18T21:09:14.209 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29967]: finishing. 2024-08-18T21:09:14.209 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[29967]: shutting down. 2024-08-18T21:09:15.783 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29968]: starting. 2024-08-18T21:09:15.784 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29968]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29966 2024-08-18T21:09:15.784 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[29968]: shutting down. 2024-08-18T21:09:19.150 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:19.150 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30001]: starting. 2024-08-18T21:09:19.150 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30001]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-29966 2024-08-18T21:09:19.151 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30001]: created object 0... 2024-08-18T21:09:19.151 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30001]: created object 25... 2024-08-18T21:09:19.151 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30001]: created object 49... 2024-08-18T21:09:19.151 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30001]: finishing. 2024-08-18T21:09:19.151 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30001]: shutting down. 2024-08-18T21:09:19.416 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:19.416 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30003]: starting. 2024-08-18T21:09:19.416 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30003]: listing objects. 2024-08-18T21:09:19.416 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30003]: listed object 0... 2024-08-18T21:09:19.417 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30003]: listed object 25... 2024-08-18T21:09:19.417 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30003]: saw 50 objects 2024-08-18T21:09:19.417 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30003]: shutting down. 2024-08-18T21:09:19.970 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:19.970 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30002]: starting. 2024-08-18T21:09:19.970 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30002]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-29966 2024-08-18T21:09:19.970 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30002]: shutting down. 2024-08-18T21:09:19.973 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:19.973 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:19.973 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:09:19.976 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:09:22.416 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30054]: starting. 2024-08-18T21:09:22.416 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30054]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30053 2024-08-18T21:09:22.416 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30054]: created object 0... 2024-08-18T21:09:22.416 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30054]: created object 25... 2024-08-18T21:09:22.416 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30054]: created object 49... 2024-08-18T21:09:22.416 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30054]: finishing. 2024-08-18T21:09:22.416 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30054]: shutting down. 2024-08-18T21:09:23.005 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30055]: starting. 2024-08-18T21:09:23.005 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30055]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30053 2024-08-18T21:09:23.005 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30055]: shutting down. 2024-08-18T21:09:26.250 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:26.251 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30088]: starting. 2024-08-18T21:09:26.251 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30088]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30053 2024-08-18T21:09:26.251 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30088]: created object 0... 2024-08-18T21:09:26.251 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30088]: created object 25... 2024-08-18T21:09:26.251 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30088]: created object 49... 2024-08-18T21:09:26.251 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30088]: finishing. 2024-08-18T21:09:26.251 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30088]: shutting down. 2024-08-18T21:09:26.311 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:26.312 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30090]: starting. 2024-08-18T21:09:26.312 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30090]: listing objects. 2024-08-18T21:09:26.312 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30090]: listed object 0... 2024-08-18T21:09:26.312 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30090]: listed object 25... 2024-08-18T21:09:26.312 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30090]: saw 50 objects 2024-08-18T21:09:26.312 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30090]: shutting down. 2024-08-18T21:09:27.352 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:27.352 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30089]: starting. 2024-08-18T21:09:27.352 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30089]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30053 2024-08-18T21:09:27.352 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30089]: shutting down. 2024-08-18T21:09:27.355 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:27.355 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:27.355 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:09:27.358 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:09:29.590 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30141]: starting. 2024-08-18T21:09:29.590 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30141]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30140 2024-08-18T21:09:29.590 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30141]: created object 0... 2024-08-18T21:09:29.590 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30141]: created object 25... 2024-08-18T21:09:29.590 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30141]: created object 49... 2024-08-18T21:09:29.591 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30141]: finishing. 2024-08-18T21:09:29.591 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30141]: shutting down. 2024-08-18T21:09:30.395 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30142]: starting. 2024-08-18T21:09:30.395 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30142]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30140 2024-08-18T21:09:30.395 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30142]: shutting down. 2024-08-18T21:09:31.879 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.h 2024-08-18T21:09:31.879 INFO:tasks.ceph.mon.h:Restarting daemon 2024-08-18T21:09:31.879 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2024-08-18T21:09:31.882 INFO:tasks.ceph.mon.h:Started 2024-08-18T21:09:31.882 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-18T21:09:31.883 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-18T21:09:31.883 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-08-18T21:09:31.883 INFO:tasks.ceph.mon.b:Sent signal 19 2024-08-18T21:09:31.883 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs to unfreeze mons 2024-08-18T21:09:38.183 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:38.183 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30175]: starting. 2024-08-18T21:09:38.183 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30175]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30140 2024-08-18T21:09:38.183 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30175]: created object 0... 2024-08-18T21:09:38.183 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30175]: created object 25... 2024-08-18T21:09:38.183 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30175]: created object 49... 2024-08-18T21:09:38.183 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30175]: finishing. 2024-08-18T21:09:38.183 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30175]: shutting down. 2024-08-18T21:09:38.240 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:38.240 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30177]: starting. 2024-08-18T21:09:38.240 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30177]: listing objects. 2024-08-18T21:09:38.240 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30177]: listed object 0... 2024-08-18T21:09:38.240 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30177]: listed object 25... 2024-08-18T21:09:38.240 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30177]: saw 50 objects 2024-08-18T21:09:38.240 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30177]: shutting down. 2024-08-18T21:09:44.444 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:44.444 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30176]: starting. 2024-08-18T21:09:44.445 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30176]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30140 2024-08-18T21:09:44.445 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30176]: shutting down. 2024-08-18T21:09:44.447 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:44.447 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:44.447 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:09:44.450 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:09:50.946 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30271]: starting. 2024-08-18T21:09:50.946 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30271]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30270 2024-08-18T21:09:50.946 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30271]: created object 0... 2024-08-18T21:09:50.946 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30271]: created object 25... 2024-08-18T21:09:50.946 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30271]: created object 49... 2024-08-18T21:09:50.946 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30271]: finishing. 2024-08-18T21:09:50.947 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30271]: shutting down. 2024-08-18T21:09:51.008 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30272]: starting. 2024-08-18T21:09:51.008 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30272]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30270 2024-08-18T21:09:51.008 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30272]: shutting down. 2024-08-18T21:09:51.884 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-18T21:09:51.884 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-18T21:09:51.884 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-08-18T21:09:51.885 INFO:tasks.ceph.mon.b:Sent signal 18 2024-08-18T21:09:51.885 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:09:51.885 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:09:52.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 10 monclient: get_monmap_and_config 2024-08-18T21:09:52.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 10 monclient: build_initial_monmap 2024-08-18T21:09:52.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 10 monclient: monmap: 2024-08-18T21:09:52.039 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:52.039 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.039 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:52.040483+0000 2024-08-18T21:09:52.039 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:52.040483+0000 2024-08-18T21:09:52.040 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:52.040 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.040 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:52.040 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:52.040 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:52.040 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:52.040 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:52.040 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:52.040 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:52.040 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:52.040 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:52.040 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:52.040 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:52.040 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 1 Processor -- start 2024-08-18T21:09:52.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 1 -- start start 2024-08-18T21:09:52.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 10 monclient: init 2024-08-18T21:09:52.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:52.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 10 monclient: _add_conns ranks=[4,2,5,9,10,0,3,6,7,1,8] 2024-08-18T21:09:52.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c280a4a40 0x7f3c280a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 10 monclient(hunting): picked mon.noname-c con 0x7f3c280a4a40 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:52.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c280a4e20 0x7f3c280a5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 10 monclient(hunting): picked mon.noname-b con 0x7f3c280a4e20 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:52.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3c28137800 0x7f3c28137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 10 monclient(hunting): picked mon.noname-h con 0x7f3c28137800 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:52.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f3c2806cd90 con 0x7f3c280a4e20 2024-08-18T21:09:52.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f3c280a0930 con 0x7f3c280a4a40 2024-08-18T21:09:52.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f3c280a11d0 con 0x7f3c28137800 2024-08-18T21:09:52.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:52.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2e56a640 10 monclient(hunting): authenticate will time out at 1359.053450s 2024-08-18T21:09:52.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c277fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c280a4e20 0x7f3c280a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c280a4a40 0x7f3c280a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c277fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c280a4e20 0x7f3c280a5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:60404/0 (socket says 172.21.15.5:60404) 2024-08-18T21:09:52.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c277fe640 1 -- 172.21.15.5:0/1677435838 learned_addr learned my addr 172.21.15.5:0/1677435838 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:52.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 1 --2- 172.21.15.5:0/1677435838 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c280a4a40 0x7f3c280a1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:50830/0 (socket says 172.21.15.5:50830) 2024-08-18T21:09:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c277fe640 10 monclient(hunting): get_auth_request con 0x7f3c280a4e20 auth_method 0 2024-08-18T21:09:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c277fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c277fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 10 monclient(hunting): get_auth_request con 0x7f3c280a4a40 auth_method 0 2024-08-18T21:09:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2cb07640 1 --2- 172.21.15.5:0/1677435838 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3c28137800 0x7f3c28137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2cb07640 10 monclient(hunting): get_auth_request con 0x7f3c28137800 auth_method 0 2024-08-18T21:09:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2cb07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2cb07640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c2cb07640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 10 monclient(hunting): handle_auth_done global_id 6070 payload 274 2024-08-18T21:09:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 1 -- 172.21.15.5:0/1677435838 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3c28137800 msgr2=0x7f3c28137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 1 --2- 172.21.15.5:0/1677435838 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3c28137800 0x7f3c28137c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 1 -- 172.21.15.5:0/1677435838 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c280a4e20 msgr2=0x7f3c280a5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 1 --2- 172.21.15.5:0/1677435838 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c280a4e20 0x7f3c280a5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 1 monclient: found mon.noname-c 2024-08-18T21:09:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:52.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:09:52.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c27fff640 1 -- 172.21.15.5:0/1677435838 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2806cb10 con 0x7f3c280a4a40 2024-08-18T21:09:52.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.037+0000 7f3c277fe640 1 --2- 172.21.15.5:0/1677435838 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c280a4e20 0x7f3c280a5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c27fff640 1 -- 172.21.15.5:0/1677435838 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c280a4a40 msgr2=0x7f3c280a1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c27fff640 1 --2- 172.21.15.5:0/1677435838 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c280a4a40 0x7f3c280a1bb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0097f0 tx=0x7f3c1c01c3a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=46e796d8012371c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c26ffd640 1 -- 172.21.15.5:0/1677435838 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3c1c0b0070 con 0x7f3c280a4a40 2024-08-18T21:09:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c26ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c26ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:09:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c26ffd640 10 monclient: dump: 2024-08-18T21:09:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.056 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c26ffd640 10 monclient: _finish_auth 0 2024-08-18T21:09:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c26ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:09:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c26ffd640 1 -- 172.21.15.5:0/1677435838 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1c0aa810 con 0x7f3c280a4a40 2024-08-18T21:09:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 5 monclient: authenticate success, global_id 6070 2024-08-18T21:09:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c26ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c26ffd640 1 -- 172.21.15.5:0/1677435838 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3c1c0a9300 con 0x7f3c280a4a40 2024-08-18T21:09:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 4 set_mon_vals no callback set 2024-08-18T21:09:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c26ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c26ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c26ffd640 10 monclient: dump: 2024-08-18T21:09:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.058 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 10 monclient: shutdown 2024-08-18T21:09:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 1 -- 172.21.15.5:0/1677435838 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c280a4a40 msgr2=0x7f3c280a1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 1 --2- 172.21.15.5:0/1677435838 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c280a4a40 0x7f3c280a1bb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0097f0 tx=0x7f3c1c01c3a0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 1 -- 172.21.15.5:0/1677435838 shutdown_connections 2024-08-18T21:09:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 1 --2- 172.21.15.5:0/1677435838 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c280a4e20 0x7f3c280a5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 1 --2- 172.21.15.5:0/1677435838 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3c28137800 0x7f3c28137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 1 --2- 172.21.15.5:0/1677435838 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3c280a4a40 0x7f3c280a1bb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 1 -- 172.21.15.5:0/1677435838 >> 172.21.15.5:0/1677435838 conn(0x7f3c28068700 msgr2=0x7f3c28068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 1 -- 172.21.15.5:0/1677435838 shutdown_connections 2024-08-18T21:09:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 1 -- 172.21.15.5:0/1677435838 wait complete. 2024-08-18T21:09:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 10 monclient: build_initial_monmap 2024-08-18T21:09:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.041+0000 7f3c2e56a640 10 monclient: monmap: 2024-08-18T21:09:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:52.060 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 1 Processor -- start 2024-08-18T21:09:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 1 -- start start 2024-08-18T21:09:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 10 monclient: init 2024-08-18T21:09:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 10 monclient: _add_conns ranks=[8,6,7,1,5,4,2,3,0] 2024-08-18T21:09:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3c280a4a40 0x7f3c28134820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 10 monclient(hunting): picked mon.noname-e con 0x7f3c280a4a40 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3c280a4e20 0x7f3c2813a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 10 monclient(hunting): picked mon.noname-d con 0x7f3c280a4e20 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3c28137800 0x7f3c2813ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 10 monclient(hunting): picked mon.noname-i con 0x7f3c28137800 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f3c281413f0 con 0x7f3c280a4e20 2024-08-18T21:09:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f3c28141270 con 0x7f3c28137800 2024-08-18T21:09:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f3c28141570 con 0x7f3c280a4a40 2024-08-18T21:09:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 10 monclient(hunting): authenticate will time out at 1359.060773s 2024-08-18T21:09:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3c280a4a40 0x7f3c28134820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3c280a4a40 0x7f3c28134820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47234/0 (socket says 172.21.15.5:47234) 2024-08-18T21:09:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 1 -- 172.21.15.5:0/2839563763 learned_addr learned my addr 172.21.15.5:0/2839563763 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 10 monclient(hunting): get_auth_request con 0x7f3c280a4a40 auth_method 0 2024-08-18T21:09:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c277fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3c280a4e20 0x7f3c2813a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c277fe640 10 monclient(hunting): get_auth_request con 0x7f3c280a4e20 auth_method 0 2024-08-18T21:09:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c277fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c277fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2cb07640 1 --2- 172.21.15.5:0/2839563763 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3c28137800 0x7f3c2813ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 10 monclient(hunting): handle_auth_done global_id 55097 payload 824 2024-08-18T21:09:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 1 -- 172.21.15.5:0/2839563763 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3c28137800 msgr2=0x7f3c2813ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 1 --2- 172.21.15.5:0/2839563763 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3c28137800 0x7f3c2813ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 1 -- 172.21.15.5:0/2839563763 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3c280a4e20 msgr2=0x7f3c2813a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 1 --2- 172.21.15.5:0/2839563763 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3c280a4e20 0x7f3c2813a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 1 monclient: found mon.noname-e 2024-08-18T21:09:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:09:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 1 -- 172.21.15.5:0/2839563763 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2811fe90 con 0x7f3c280a4a40 2024-08-18T21:09:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 1 -- 172.21.15.5:0/2839563763 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3c280a4a40 msgr2=0x7f3c28134820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c27fff640 1 --2- 172.21.15.5:0/2839563763 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3c280a4a40 0x7f3c28134820 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c01c1d0 tx=0x7f3c1c019140 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c24ff9640 1 -- 172.21.15.5:0/2839563763 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3c1c0b0040 con 0x7f3c280a4a40 2024-08-18T21:09:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c24ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c24ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:09:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c24ff9640 10 monclient: dump: 2024-08-18T21:09:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.066 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c24ff9640 10 monclient: _finish_auth 0 2024-08-18T21:09:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c24ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:09:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c24ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c24ff9640 1 -- 172.21.15.5:0/2839563763 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1c0b9070 con 0x7f3c280a4a40 2024-08-18T21:09:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c24ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c24ff9640 1 -- 172.21.15.5:0/2839563763 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3c1c0044b0 con 0x7f3c280a4a40 2024-08-18T21:09:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 5 monclient: authenticate success, global_id 55097 2024-08-18T21:09:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 10 monclient: _renew_subs 2024-08-18T21:09:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 1 -- 172.21.15.5:0/2839563763 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2813ca90 con 0x7f3c280a4a40 2024-08-18T21:09:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c267fc640 4 set_mon_vals no callback set 2024-08-18T21:09:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c24ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c24ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c24ff9640 10 monclient: dump: 2024-08-18T21:09:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.072 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 10 monclient: _renew_subs 2024-08-18T21:09:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.045+0000 7f3c2e56a640 1 -- 172.21.15.5:0/2839563763 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c28068cc0 con 0x7f3c280a4a40 2024-08-18T21:09:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.049+0000 7f3c2e56a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.049+0000 7f3c2e56a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.049+0000 7f3c2e56a640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.049+0000 7f3c2e56a640 1 -- 172.21.15.5:0/2839563763 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c280a5200 con 0x7f3c280a4a40 2024-08-18T21:09:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.049+0000 7f3c24ff9640 1 -- 172.21.15.5:0/2839563763 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f3c1c004040 con 0x7f3c280a4a40 2024-08-18T21:09:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.049+0000 7f3c24ff9640 1 --2- 172.21.15.5:0/2839563763 >> v2:172.21.15.157:6812/631023601 conn(0x7f3c1403be20 0x7f3c1403e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.049+0000 7f3c24ff9640 1 -- 172.21.15.5:0/2839563763 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(176..176 src has 22..176) ==== 3898+0+0 (secure 0 0 0) 0x7f3c1c0e8190 con 0x7f3c280a4a40 2024-08-18T21:09:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.049+0000 7f3c277fe640 1 --2- 172.21.15.5:0/2839563763 >> v2:172.21.15.157:6812/631023601 conn(0x7f3c1403be20 0x7f3c1403e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.049+0000 7f3c277fe640 10 monclient: get_auth_request con 0x7f3c1403be20 auth_method 0 2024-08-18T21:09:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.053+0000 7f3c277fe640 1 --2- 172.21.15.5:0/2839563763 >> v2:172.21.15.157:6812/631023601 conn(0x7f3c1403be20 0x7f3c1403e2e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3c2813be20 tx=0x7f3c18009240 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.053+0000 7f3c24ff9640 1 -- 172.21.15.5:0/2839563763 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f3c1c0160b0 con 0x7f3c280a4a40 2024-08-18T21:09:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.053+0000 7f3c24ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.053+0000 7f3c24ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:52.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.289+0000 7f3c2e56a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:09:52.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.289+0000 7f3c2e56a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:09:52.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.289+0000 7f3c2e56a640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:52.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.289+0000 7f3c2e56a640 1 -- 172.21.15.5:0/2839563763 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3c281200d0 con 0x7f3c280a4a40 2024-08-18T21:09:52.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c24ff9640 1 -- 172.21.15.5:0/2839563763 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7f3c1c003de0 con 0x7f3c280a4a40 2024-08-18T21:09:52.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c24ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:09:52.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c24ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:52.295 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":146,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:09:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c2e56a640 1 -- 172.21.15.5:0/2839563763 >> v2:172.21.15.157:6812/631023601 conn(0x7f3c1403be20 msgr2=0x7f3c1403e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c2e56a640 1 --2- 172.21.15.5:0/2839563763 >> v2:172.21.15.157:6812/631023601 conn(0x7f3c1403be20 0x7f3c1403e2e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3c2813be20 tx=0x7f3c18009240 comp rx=0 tx=0).stop 2024-08-18T21:09:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c2e56a640 10 monclient: shutdown 2024-08-18T21:09:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c2e56a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c2e56a640 1 -- 172.21.15.5:0/2839563763 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3c280a4a40 msgr2=0x7f3c28134820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c2e56a640 1 --2- 172.21.15.5:0/2839563763 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3c280a4a40 0x7f3c28134820 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c01c1d0 tx=0x7f3c1c019140 comp rx=0 tx=0).stop 2024-08-18T21:09:52.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c2e56a640 1 -- 172.21.15.5:0/2839563763 shutdown_connections 2024-08-18T21:09:52.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c2e56a640 1 --2- 172.21.15.5:0/2839563763 >> v2:172.21.15.157:6812/631023601 conn(0x7f3c1403be20 0x7f3c1403e2e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c2e56a640 1 --2- 172.21.15.5:0/2839563763 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3c28137800 0x7f3c2813ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c2e56a640 1 --2- 172.21.15.5:0/2839563763 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3c280a4e20 0x7f3c2813a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c2e56a640 1 --2- 172.21.15.5:0/2839563763 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3c280a4a40 0x7f3c28134820 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c2e56a640 1 -- 172.21.15.5:0/2839563763 >> 172.21.15.5:0/2839563763 conn(0x7f3c28068700 msgr2=0x7f3c2813dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:52.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c2e56a640 1 -- 172.21.15.5:0/2839563763 shutdown_connections 2024-08-18T21:09:52.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.293+0000 7f3c2e56a640 1 -- 172.21.15.5:0/2839563763 wait complete. 2024-08-18T21:09:52.314 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:09:52.314 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:09:52.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:09:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.437+0000 7eff49399640 10 monclient: get_monmap_and_config 2024-08-18T21:09:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.437+0000 7eff49399640 10 monclient: build_initial_monmap 2024-08-18T21:09:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.437+0000 7eff49399640 10 monclient: monmap: 2024-08-18T21:09:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:52.443126+0000 2024-08-18T21:09:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:52.443126+0000 2024-08-18T21:09:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:52.443 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 1 Processor -- start 2024-08-18T21:09:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 1 -- start start 2024-08-18T21:09:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 10 monclient: init 2024-08-18T21:09:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 10 monclient: _add_conns ranks=[8,10,2,6,9,0,5,3,1,7,4] 2024-08-18T21:09:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7eff440a6ce0 0x7eff440a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 10 monclient(hunting): picked mon.noname-e con 0x7eff440a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7eff440a7600 0x7eff44139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 10 monclient(hunting): picked mon.noname-f con 0x7eff440a7600 addr v2:172.21.15.157:3300/0 2024-08-18T21:09:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff44139fe0 0x7eff4413a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 10 monclient(hunting): picked mon.noname-b con 0x7eff44139fe0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7eff440a5000 con 0x7eff440a7600 2024-08-18T21:09:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7eff440a4360 con 0x7eff44139fe0 2024-08-18T21:09:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7eff440a45d0 con 0x7eff440a6ce0 2024-08-18T21:09:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff49399640 10 monclient(hunting): authenticate will time out at 1359.457086s 2024-08-18T21:09:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff437fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff44139fe0 0x7eff4413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7eff440a6ce0 0x7eff440a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff437fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff44139fe0 0x7eff4413a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:60414/0 (socket says 172.21.15.5:60414) 2024-08-18T21:09:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff437fe640 1 -- 172.21.15.5:0/2077689470 learned_addr learned my addr 172.21.15.5:0/2077689470 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7eff440a6ce0 0x7eff440a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47248/0 (socket says 172.21.15.5:47248) 2024-08-18T21:09:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff437fe640 10 monclient(hunting): get_auth_request con 0x7eff44139fe0 auth_method 0 2024-08-18T21:09:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff437fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff437fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 10 monclient(hunting): get_auth_request con 0x7eff440a6ce0 auth_method 0 2024-08-18T21:09:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff3bfff640 1 --2- 172.21.15.5:0/2077689470 >> v2:172.21.15.157:3300/0 conn(0x7eff440a7600 0x7eff44139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 10 monclient(hunting): handle_auth_done global_id 55106 payload 274 2024-08-18T21:09:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 1 -- 172.21.15.5:0/2077689470 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff44139fe0 msgr2=0x7eff4413a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 1 --2- 172.21.15.5:0/2077689470 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff44139fe0 0x7eff4413a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 1 -- 172.21.15.5:0/2077689470 >> v2:172.21.15.157:3300/0 conn(0x7eff440a7600 msgr2=0x7eff44139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 1 --2- 172.21.15.5:0/2077689470 >> v2:172.21.15.157:3300/0 conn(0x7eff440a7600 0x7eff44139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:09:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 1 monclient: found mon.noname-e 2024-08-18T21:09:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:09:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff42ffd640 1 -- 172.21.15.5:0/2077689470 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff440a32d0 con 0x7eff440a6ce0 2024-08-18T21:09:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff437fe640 1 --2- 172.21.15.5:0/2077689470 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff44139fe0 0x7eff4413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff3bfff640 10 monclient: get_auth_request con 0x7eff440a7600 auth_method 0 2024-08-18T21:09:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.441+0000 7eff3bfff640 1 --2- 172.21.15.5:0/2077689470 >> v2:172.21.15.157:3300/0 conn(0x7eff440a7600 0x7eff44139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:09:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff42ffd640 1 -- 172.21.15.5:0/2077689470 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7eff440a6ce0 msgr2=0x7eff440a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff42ffd640 1 --2- 172.21.15.5:0/2077689470 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7eff440a6ce0 0x7eff440a70c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7eff340097f0 tx=0x7eff3401c360 comp rx=0 tx=0).ready entity=mon.8 client_cookie=51451a44da6c40e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff427fc640 1 -- 172.21.15.5:0/2077689470 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7eff340b0070 con 0x7eff440a6ce0 2024-08-18T21:09:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff427fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:09:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff427fc640 10 monclient: dump: 2024-08-18T21:09:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.454 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.454 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.454 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.454 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.454 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.454 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.454 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.454 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.454 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.454 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.454 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff427fc640 10 monclient: _finish_auth 0 2024-08-18T21:09:52.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff427fc640 10 monclient: _check_auth_tickets 2024-08-18T21:09:52.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:52.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff427fc640 1 -- 172.21.15.5:0/2077689470 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff340aa810 con 0x7eff440a6ce0 2024-08-18T21:09:52.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 5 monclient: authenticate success, global_id 55106 2024-08-18T21:09:52.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:52.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff427fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:52.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:52.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff427fc640 1 -- 172.21.15.5:0/2077689470 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7eff340a4e60 con 0x7eff440a6ce0 2024-08-18T21:09:52.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 4 set_mon_vals no callback set 2024-08-18T21:09:52.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff427fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:52.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff427fc640 10 monclient: dump: 2024-08-18T21:09:52.455 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.455 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.455 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.456 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 10 monclient: shutdown 2024-08-18T21:09:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 1 -- 172.21.15.5:0/2077689470 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7eff440a6ce0 msgr2=0x7eff440a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 1 --2- 172.21.15.5:0/2077689470 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7eff440a6ce0 0x7eff440a70c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7eff340097f0 tx=0x7eff3401c360 comp rx=0 tx=0).stop 2024-08-18T21:09:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 1 -- 172.21.15.5:0/2077689470 shutdown_connections 2024-08-18T21:09:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 1 --2- 172.21.15.5:0/2077689470 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff44139fe0 0x7eff4413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 1 --2- 172.21.15.5:0/2077689470 >> v2:172.21.15.157:3300/0 conn(0x7eff440a7600 0x7eff44139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 1 --2- 172.21.15.5:0/2077689470 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7eff440a6ce0 0x7eff440a70c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 1 -- 172.21.15.5:0/2077689470 >> 172.21.15.5:0/2077689470 conn(0x7eff440acbc0 msgr2=0x7eff440a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 1 -- 172.21.15.5:0/2077689470 shutdown_connections 2024-08-18T21:09:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 1 -- 172.21.15.5:0/2077689470 wait complete. 2024-08-18T21:09:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 10 monclient: build_initial_monmap 2024-08-18T21:09:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.445+0000 7eff49399640 10 monclient: monmap: 2024-08-18T21:09:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:52.459 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 1 Processor -- start 2024-08-18T21:09:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 1 -- start start 2024-08-18T21:09:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 10 monclient: init 2024-08-18T21:09:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 10 monclient: _add_conns ranks=[7,2,4,1,8,6,5,3,0] 2024-08-18T21:09:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7eff440a6ce0 0x7eff441366a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 10 monclient(hunting): picked mon.noname-i con 0x7eff440a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff440a7600 0x7eff44136be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 10 monclient(hunting): picked mon.noname-b con 0x7eff440a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7eff44139fe0 0x7eff4413c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 10 monclient(hunting): picked mon.noname-c con 0x7eff44139fe0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7eff440a79e0 con 0x7eff440a7600 2024-08-18T21:09:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7eff440a8220 con 0x7eff44139fe0 2024-08-18T21:09:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7eff4413ef20 con 0x7eff440a6ce0 2024-08-18T21:09:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff49399640 10 monclient(hunting): authenticate will time out at 1359.464906s 2024-08-18T21:09:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff437fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7eff44139fe0 0x7eff4413c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff440a7600 0x7eff44136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff437fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7eff44139fe0 0x7eff4413c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:50832/0 (socket says 172.21.15.5:50832) 2024-08-18T21:09:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff437fe640 1 -- 172.21.15.5:0/1909901485 learned_addr learned my addr 172.21.15.5:0/1909901485 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff437fe640 10 monclient(hunting): get_auth_request con 0x7eff44139fe0 auth_method 0 2024-08-18T21:09:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff437fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff437fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 10 monclient(hunting): get_auth_request con 0x7eff440a7600 auth_method 0 2024-08-18T21:09:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff42ffd640 1 --2- 172.21.15.5:0/1909901485 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7eff440a6ce0 0x7eff441366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff42ffd640 10 monclient(hunting): get_auth_request con 0x7eff440a6ce0 auth_method 0 2024-08-18T21:09:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff42ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff42ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff42ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 10 monclient(hunting): handle_auth_done global_id 84440 payload 824 2024-08-18T21:09:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 1 -- 172.21.15.5:0/1909901485 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7eff440a6ce0 msgr2=0x7eff441366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 1 --2- 172.21.15.5:0/1909901485 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7eff440a6ce0 0x7eff441366a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 1 -- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7eff44139fe0 msgr2=0x7eff4413c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 1 --2- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7eff44139fe0 0x7eff4413c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 1 monclient: found mon.noname-b 2024-08-18T21:09:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:09:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 1 -- 172.21.15.5:0/1909901485 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff440a1f30 con 0x7eff440a7600 2024-08-18T21:09:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff437fe640 1 --2- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7eff44139fe0 0x7eff4413c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:52.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 1 -- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff440a7600 msgr2=0x7eff44136be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:52.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3bfff640 1 --2- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff440a7600 0x7eff44136be0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00c7f0 tx=0x7eff2c00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.449+0000 7eff3b7fe640 1 -- 172.21.15.5:0/1909901485 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7eff2c015070 con 0x7eff440a7600 2024-08-18T21:09:52.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:09:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 10 monclient: dump: 2024-08-18T21:09:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.468 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 10 monclient: _finish_auth 0 2024-08-18T21:09:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:09:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 1 -- 172.21.15.5:0/1909901485 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff2c007ca0 con 0x7eff440a7600 2024-08-18T21:09:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff49399640 5 monclient: authenticate success, global_id 84440 2024-08-18T21:09:52.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff49399640 10 monclient: _renew_subs 2024-08-18T21:09:52.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff49399640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:52.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff49399640 1 -- 172.21.15.5:0/1909901485 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff44140440 con 0x7eff440a7600 2024-08-18T21:09:52.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:52.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 1 -- 172.21.15.5:0/1909901485 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7eff2c007e50 con 0x7eff440a7600 2024-08-18T21:09:52.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:52.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 10 monclient: dump: 2024-08-18T21:09:52.471 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.472 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.472 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.472 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.472 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.472 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.472 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.472 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.472 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.472 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.472 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.473 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff41ffb640 4 set_mon_vals no callback set 2024-08-18T21:09:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff49399640 10 monclient: _renew_subs 2024-08-18T21:09:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff49399640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff49399640 1 -- 172.21.15.5:0/1909901485 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7eff440aac20 con 0x7eff440a7600 2024-08-18T21:09:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff49399640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff49399640 1 --2- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff4413d650 0x7eff4402d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff49399640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff49399640 1 -- 172.21.15.5:0/1909901485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7eff440a7b60 con 0x7eff4413d650 2024-08-18T21:09:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff42ffd640 1 --2- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff4413d650 0x7eff4402d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff42ffd640 10 monclient: get_auth_request con 0x7eff4413d650 auth_method 0 2024-08-18T21:09:52.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff42ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff42ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff42ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 1 -- 172.21.15.5:0/1909901485 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7eff2c007830 con 0x7eff440a7600 2024-08-18T21:09:52.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff42ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff42ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff42ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 1 --2- 172.21.15.5:0/1909901485 >> v2:172.21.15.157:6812/631023601 conn(0x7eff2403bf60 0x7eff2403e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff42ffd640 10 monclient(hunting): handle_auth_done global_id 84375 payload 824 2024-08-18T21:09:52.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff42ffd640 1 -- 172.21.15.5:0/1909901485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff44140220 con 0x7eff4413d650 2024-08-18T21:09:52.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 1 -- 172.21.15.5:0/1909901485 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(176..176 src has 22..176) ==== 3898+0+0 (secure 0 0 0) 0x7eff2c04e410 con 0x7eff440a7600 2024-08-18T21:09:52.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff437fe640 1 --2- 172.21.15.5:0/1909901485 >> v2:172.21.15.157:6812/631023601 conn(0x7eff2403bf60 0x7eff2403e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff437fe640 10 monclient: get_auth_request con 0x7eff2403bf60 auth_method 0 2024-08-18T21:09:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff42ffd640 1 -- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff4413d650 msgr2=0x7eff4402d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff42ffd640 1 --2- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff4413d650 0x7eff4402d1d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7eff340ad000 tx=0x7eff34019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 1 -- 172.21.15.5:0/1909901485 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7eff340b9070 con 0x7eff4413d650 2024-08-18T21:09:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:09:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.453+0000 7eff3b7fe640 10 monclient: dump: 2024-08-18T21:09:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.480 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.457+0000 7eff3b7fe640 1 -- 172.21.15.5:0/1909901485 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7eff34003a40 con 0x7eff4413d650 2024-08-18T21:09:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.457+0000 7eff3b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.457+0000 7eff3b7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.457+0000 7eff3b7fe640 1 -- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff4413d650 msgr2=0x7eff4402d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.457+0000 7eff3b7fe640 1 --2- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff4413d650 0x7eff4402d1d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7eff340ad000 tx=0x7eff34019100 comp rx=0 tx=0).stop 2024-08-18T21:09:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.457+0000 7eff3b7fe640 1 -- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff4413d650 msgr2=0x7eff4402d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.457+0000 7eff3b7fe640 1 --2- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff4413d650 0x7eff4402d1d0 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7eff340ad000 tx=0x7eff34019100 comp rx=0 tx=0).stop 2024-08-18T21:09:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.457+0000 7eff437fe640 1 --2- 172.21.15.5:0/1909901485 >> v2:172.21.15.157:6812/631023601 conn(0x7eff2403bf60 0x7eff2403e420 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7eff4413fdb0 tx=0x7eff3c00b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.461+0000 7eff49399640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.461+0000 7eff49399640 1 --2- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff4413da30 0x7eff4402d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.461+0000 7eff49399640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.461+0000 7eff49399640 1 -- 172.21.15.5:0/1909901485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7eff44051140 con 0x7eff4413da30 2024-08-18T21:09:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.461+0000 7eff42ffd640 1 --2- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff4413da30 0x7eff4402d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.461+0000 7eff42ffd640 10 monclient: get_auth_request con 0x7eff4413da30 auth_method 0 2024-08-18T21:09:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.461+0000 7eff42ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.461+0000 7eff42ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.461+0000 7eff42ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.461+0000 7eff42ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.461+0000 7eff42ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.461+0000 7eff42ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.461+0000 7eff42ffd640 10 monclient(hunting): handle_auth_done global_id 84384 payload 824 2024-08-18T21:09:52.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.461+0000 7eff42ffd640 1 -- 172.21.15.5:0/1909901485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7eff4409f580 con 0x7eff4413da30 2024-08-18T21:09:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff42ffd640 1 -- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff4413da30 msgr2=0x7eff4402d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff42ffd640 1 --2- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff4413da30 0x7eff4402d710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7eff3401c3a0 tx=0x7eff340a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff3b7fe640 1 -- 172.21.15.5:0/1909901485 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7eff340b9040 con 0x7eff4413da30 2024-08-18T21:09:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff3b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:09:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff3b7fe640 10 monclient: dump: 2024-08-18T21:09:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.485 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff3b7fe640 1 -- 172.21.15.5:0/1909901485 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9249 (secure 0 0 0) 0x7eff340b5dd0 con 0x7eff4413da30 2024-08-18T21:09:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff3b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff3b7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff3b7fe640 1 -- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff4413da30 msgr2=0x7eff4402d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff3b7fe640 1 --2- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff4413da30 0x7eff4402d710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7eff3401c3a0 tx=0x7eff340a8000 comp rx=0 tx=0).stop 2024-08-18T21:09:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff3b7fe640 1 -- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff4413da30 msgr2=0x7eff4402d710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff3b7fe640 1 --2- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff4413da30 0x7eff4402d710 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7eff3401c3a0 tx=0x7eff340a8000 comp rx=0 tx=0).stop 2024-08-18T21:09:52.486 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:09:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 89298, 2024-08-18T21:09:52.486 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:09:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:52.487 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:52.488 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:52.489 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:52.490 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:52.491 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:52.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:52.492 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:52.492 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:52.492 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:52.492 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:52.492 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:52.492 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:52.492 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:52.492 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:52.492 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:52.492 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:52.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:52.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.493 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:52.493 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:52.493 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.493 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.493 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.493 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:52.493 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.493 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.494 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:52.494 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.494 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.494 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.494 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:52.494 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:52.494 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.494 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.494 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.494 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.494 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:52.495 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:52.495 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.495 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.495 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.495 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:52.495 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.495 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.495 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:52.496 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.496 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.496 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.496 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:52.496 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:52.496 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.496 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.496 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.497 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:52.497 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:52.497 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:52.497 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:52.498 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.498 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.498 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.498 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:52.498 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:52.498 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.498 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.498 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.498 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:52.498 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:52.499 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.499 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.499 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.499 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:52.499 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.499 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.499 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:52.499 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.499 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.499 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:52.500 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:52.500 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.500 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.500 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.500 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:52.500 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:52.500 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.501 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.501 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:52.501 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.501 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.501 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.501 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:52.501 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.501 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.501 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.501 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:52.502 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:52.502 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.502 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.502 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.502 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:52.502 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:52.502 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.502 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:52.503 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.503 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.503 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:52.503 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.503 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.503 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.503 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:52.503 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:52.503 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.503 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.504 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.504 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:52.504 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:52.504 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:52.504 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.505 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.505 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:52.505 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.505 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.505 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.505 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:52.505 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:52.505 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.505 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.505 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.506 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:52.506 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:52.506 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.506 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.506 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.506 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:52.506 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.506 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.506 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:52.507 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.507 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.507 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.507 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:52.507 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:52.507 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.507 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.507 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.507 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:52.507 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:52.508 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.508 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.508 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.508 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.508 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:52.508 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.508 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.508 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.508 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:52.508 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.508 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.509 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.509 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:52.509 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:52.509 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.509 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.509 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.509 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.509 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.509 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:52.509 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:52.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.509 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:52.510 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:52.510 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:52.510 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.510 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:52.510 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:52.510 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.510 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:52.510 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:52.510 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:52.510 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.511 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.511 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:52.511 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:52.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff49399640 1 -- 172.21.15.5:0/1909901485 >> v2:172.21.15.157:6812/631023601 conn(0x7eff2403bf60 msgr2=0x7eff2403e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff49399640 1 --2- 172.21.15.5:0/1909901485 >> v2:172.21.15.157:6812/631023601 conn(0x7eff2403bf60 0x7eff2403e420 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7eff4413fdb0 tx=0x7eff3c00b040 comp rx=0 tx=0).stop 2024-08-18T21:09:52.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff49399640 10 monclient: shutdown 2024-08-18T21:09:52.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff49399640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:52.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff49399640 1 -- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff440a7600 msgr2=0x7eff44136be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff49399640 1 --2- 172.21.15.5:0/1909901485 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7eff440a7600 0x7eff44136be0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00c7f0 tx=0x7eff2c00cbf0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff437fe640 1 -- 172.21.15.5:0/1909901485 reap_dead start 2024-08-18T21:09:52.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff437fe640 1 -- 172.21.15.5:0/1909901485 reap_dead start 2024-08-18T21:09:52.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff49399640 1 -- 172.21.15.5:0/1909901485 shutdown_connections 2024-08-18T21:09:52.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff49399640 1 -- 172.21.15.5:0/1909901485 >> 172.21.15.5:0/1909901485 conn(0x7eff440acbc0 msgr2=0x7eff440aae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:52.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff49399640 1 -- 172.21.15.5:0/1909901485 shutdown_connections 2024-08-18T21:09:52.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.465+0000 7eff49399640 1 -- 172.21.15.5:0/1909901485 wait complete. 2024-08-18T21:09:52.514 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:52.514 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:09:52.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:09:52.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 10 monclient: get_monmap_and_config 2024-08-18T21:09:52.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 10 monclient: build_initial_monmap 2024-08-18T21:09:52.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 10 monclient: monmap: 2024-08-18T21:09:52.636 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:52.636 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.636 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:52.637388+0000 2024-08-18T21:09:52.636 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:52.637388+0000 2024-08-18T21:09:52.636 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:52.636 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.636 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:52.637 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:52.637 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:52.637 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:52.637 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:52.637 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:52.637 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:52.637 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:52.637 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:52.637 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:52.637 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:52.637 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 1 Processor -- start 2024-08-18T21:09:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 1 -- start start 2024-08-18T21:09:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 10 monclient: init 2024-08-18T21:09:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 10 monclient: _add_conns ranks=[5,9,6,1,8,2,0,7,10,3,4] 2024-08-18T21:09:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd5180a6bd0 0x7fd5180a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 10 monclient(hunting): picked mon.noname-h con 0x7fd5180a6bd0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd51809f080 0x7fd5180a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 10 monclient(hunting): picked mon.noname-a con 0x7fd51809f080 addr v2:172.21.15.5:3300/0 2024-08-18T21:09:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd518139990 0x7fd518139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 10 monclient(hunting): picked mon.noname-d con 0x7fd518139990 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd51809e4c0 con 0x7fd51809f080 2024-08-18T21:09:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fd51806f930 con 0x7fd5180a6bd0 2024-08-18T21:09:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fd5180a7a30 con 0x7fd518139990 2024-08-18T21:09:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd51d9c7640 10 monclient(hunting): authenticate will time out at 1359.650512s 2024-08-18T21:09:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5177fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd518139990 0x7fd518139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd51809f080 0x7fd5180a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5177fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd518139990 0x7fd518139e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:44200/0 (socket says 172.21.15.5:44200) 2024-08-18T21:09:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5177fe640 1 -- 172.21.15.5:0/892481281 learned_addr learned my addr 172.21.15.5:0/892481281 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5177fe640 10 monclient(hunting): get_auth_request con 0x7fd518139990 auth_method 0 2024-08-18T21:09:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5177fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5177fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5177fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 10 monclient(hunting): get_auth_request con 0x7fd51809f080 auth_method 0 2024-08-18T21:09:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd516ffd640 1 --2- 172.21.15.5:0/892481281 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd5180a6bd0 0x7fd5180a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5177fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5177fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5177fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd516ffd640 10 monclient(hunting): get_auth_request con 0x7fd5180a6bd0 auth_method 0 2024-08-18T21:09:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd516ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd516ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd516ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 10 monclient(hunting): handle_auth_done global_id 84393 payload 274 2024-08-18T21:09:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 1 -- 172.21.15.5:0/892481281 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd518139990 msgr2=0x7fd518139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 1 --2- 172.21.15.5:0/892481281 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd518139990 0x7fd518139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 1 -- 172.21.15.5:0/892481281 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd5180a6bd0 msgr2=0x7fd5180a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 1 --2- 172.21.15.5:0/892481281 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd5180a6bd0 0x7fd5180a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 10 monclient: _finish_hunting 0 2024-08-18T21:09:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 1 monclient: found mon.noname-a 2024-08-18T21:09:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:09:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5167fc640 1 -- 172.21.15.5:0/892481281 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5180a7fb0 con 0x7fd51809f080 2024-08-18T21:09:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd5177fe640 1 --2- 172.21.15.5:0/892481281 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd518139990 0x7fd518139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.633+0000 7fd516ffd640 1 --2- 172.21.15.5:0/892481281 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd5180a6bd0 0x7fd5180a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:09:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.637+0000 7fd5167fc640 1 -- 172.21.15.5:0/892481281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd51809f080 msgr2=0x7fd5180a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.637+0000 7fd5167fc640 1 --2- 172.21.15.5:0/892481281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd51809f080 0x7fd5180a74f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0097c0 tx=0x7fd50c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f907db3f025196 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.637+0000 7fd515ffb640 1 -- 172.21.15.5:0/892481281 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd50c0b0070 con 0x7fd51809f080 2024-08-18T21:09:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd515ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd515ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:09:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd515ffb640 10 monclient: dump: 2024-08-18T21:09:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.649 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd515ffb640 10 monclient: _finish_auth 0 2024-08-18T21:09:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd515ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:09:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd515ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd515ffb640 1 -- 172.21.15.5:0/892481281 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50c0aa810 con 0x7fd51809f080 2024-08-18T21:09:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 5 monclient: authenticate success, global_id 84393 2024-08-18T21:09:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd515ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd515ffb640 1 -- 172.21.15.5:0/892481281 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd50c0a4e60 con 0x7fd51809f080 2024-08-18T21:09:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd515ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 4 set_mon_vals no callback set 2024-08-18T21:09:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd515ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:09:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd515ffb640 10 monclient: dump: 2024-08-18T21:09:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.652 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 10 monclient: shutdown 2024-08-18T21:09:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 -- 172.21.15.5:0/892481281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd51809f080 msgr2=0x7fd5180a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 --2- 172.21.15.5:0/892481281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd51809f080 0x7fd5180a74f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0097c0 tx=0x7fd50c01c360 comp rx=0 tx=0).stop 2024-08-18T21:09:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 -- 172.21.15.5:0/892481281 shutdown_connections 2024-08-18T21:09:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 --2- 172.21.15.5:0/892481281 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd518139990 0x7fd518139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 --2- 172.21.15.5:0/892481281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd51809f080 0x7fd5180a74f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 --2- 172.21.15.5:0/892481281 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd5180a6bd0 0x7fd5180a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 -- 172.21.15.5:0/892481281 >> 172.21.15.5:0/892481281 conn(0x7fd518068700 msgr2=0x7fd518068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 -- 172.21.15.5:0/892481281 shutdown_connections 2024-08-18T21:09:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 -- 172.21.15.5:0/892481281 wait complete. 2024-08-18T21:09:52.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 10 monclient: build_initial_monmap 2024-08-18T21:09:52.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 10 monclient: monmap: 2024-08-18T21:09:52.653 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:52.653 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:52.653 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:52.655 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 Processor -- start 2024-08-18T21:09:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 -- start start 2024-08-18T21:09:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 10 monclient: init 2024-08-18T21:09:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 10 monclient: _add_conns ranks=[1,2,0,6,8,7,4,3,5] 2024-08-18T21:09:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5180a6bd0 0x7fd518122c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 10 monclient(hunting): picked mon.noname-f con 0x7fd5180a6bd0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:09:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd518139990 0x7fd51813e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 10 monclient(hunting): picked mon.noname-b con 0x7fd518139990 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd518138ac0 0x7fd518138f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 10 monclient(hunting): picked mon.noname-a con 0x7fd518138ac0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:09:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd5180a89f0 con 0x7fd518138ac0 2024-08-18T21:09:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd5180a7ce0 con 0x7fd5180a6bd0 2024-08-18T21:09:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fd518143610 con 0x7fd518139990 2024-08-18T21:09:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd51d9c7640 10 monclient(hunting): authenticate will time out at 1359.658618s 2024-08-18T21:09:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd518139990 0x7fd51813e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd518138ac0 0x7fd518138f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd518139990 0x7fd51813e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:60446/0 (socket says 172.21.15.5:60446) 2024-08-18T21:09:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 1 -- 172.21.15.5:0/2801535180 learned_addr learned my addr 172.21.15.5:0/2801535180 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 10 monclient(hunting): get_auth_request con 0x7fd518139990 auth_method 0 2024-08-18T21:09:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5177fe640 10 monclient(hunting): get_auth_request con 0x7fd518138ac0 auth_method 0 2024-08-18T21:09:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5177fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5177fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5177fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd516ffd640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5180a6bd0 0x7fd518122c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd516ffd640 10 monclient(hunting): get_auth_request con 0x7fd5180a6bd0 auth_method 0 2024-08-18T21:09:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd516ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd516ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd516ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5177fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5177fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5177fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 10 monclient(hunting): handle_auth_done global_id 84449 payload 824 2024-08-18T21:09:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 1 -- 172.21.15.5:0/2801535180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5180a6bd0 msgr2=0x7fd518122c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5180a6bd0 0x7fd518122c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 1 -- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd518138ac0 msgr2=0x7fd518138f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd518138ac0 0x7fd518138f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 10 monclient: _finish_hunting 0 2024-08-18T21:09:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 1 monclient: found mon.noname-b 2024-08-18T21:09:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:09:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5167fc640 1 -- 172.21.15.5:0/2801535180 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51813ff30 con 0x7fd518139990 2024-08-18T21:09:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd516ffd640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5180a6bd0 0x7fd518122c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:09:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.641+0000 7fd5177fe640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd518138ac0 0x7fd518138f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:52.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd5167fc640 1 -- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd518139990 msgr2=0x7fd51813e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:52.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd5167fc640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd518139990 0x7fd51813e1c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0ae040 tx=0x7fd50c019100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd4fffff640 1 -- 172.21.15.5:0/2801535180 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd50c0b0040 con 0x7fd518139990 2024-08-18T21:09:52.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd4fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd4fffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:09:52.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd4fffff640 10 monclient: dump: 2024-08-18T21:09:52.664 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.664 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.664 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.664 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.664 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.664 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.664 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.664 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.665 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd4fffff640 10 monclient: _finish_auth 0 2024-08-18T21:09:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd4fffff640 10 monclient: _check_auth_tickets 2024-08-18T21:09:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd4fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd4fffff640 1 -- 172.21.15.5:0/2801535180 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50c0b9070 con 0x7fd518139990 2024-08-18T21:09:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd4fffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd4fffff640 1 -- 172.21.15.5:0/2801535180 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd50c0044b0 con 0x7fd518139990 2024-08-18T21:09:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd4fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd4fffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd4fffff640 10 monclient: dump: 2024-08-18T21:09:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.667 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.667 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.667 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.667 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.667 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.667 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd51d9c7640 5 monclient: authenticate success, global_id 84449 2024-08-18T21:09:52.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd514ff9640 4 set_mon_vals no callback set 2024-08-18T21:09:52.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd51d9c7640 10 monclient: _renew_subs 2024-08-18T21:09:52.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd51d9c7640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:52.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd51d9c7640 1 -- 172.21.15.5:0/2801535180 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5180ab7c0 con 0x7fd518139990 2024-08-18T21:09:52.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd51d9c7640 10 monclient: _renew_subs 2024-08-18T21:09:52.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd51d9c7640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd51d9c7640 1 -- 172.21.15.5:0/2801535180 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd51813f7c0 con 0x7fd518139990 2024-08-18T21:09:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd51d9c7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd51d9c7640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd5181d16a0 0x7fd5181d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd51d9c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd51d9c7640 1 -- 172.21.15.5:0/2801535180 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fd518051140 con 0x7fd5181d16a0 2024-08-18T21:09:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd516ffd640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd5181d16a0 0x7fd5181d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd516ffd640 10 monclient: get_auth_request con 0x7fd5181d16a0 auth_method 0 2024-08-18T21:09:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd516ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd516ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd516ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd516ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd516ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd516ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd4fffff640 1 -- 172.21.15.5:0/2801535180 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fd50c0aacd0 con 0x7fd518139990 2024-08-18T21:09:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd516ffd640 10 monclient(hunting): handle_auth_done global_id 84458 payload 824 2024-08-18T21:09:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd516ffd640 1 -- 172.21.15.5:0/2801535180 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5181240e0 con 0x7fd5181d16a0 2024-08-18T21:09:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd4fffff640 1 --2- 172.21.15.5:0/2801535180 >> v2:172.21.15.157:6812/631023601 conn(0x7fd50403bdc0 0x7fd50403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd4fffff640 1 -- 172.21.15.5:0/2801535180 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(176..176 src has 22..176) ==== 3898+0+0 (secure 0 0 0) 0x7fd50c0e8000 con 0x7fd518139990 2024-08-18T21:09:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd5177fe640 1 --2- 172.21.15.5:0/2801535180 >> v2:172.21.15.157:6812/631023601 conn(0x7fd50403bdc0 0x7fd50403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.645+0000 7fd5177fe640 10 monclient: get_auth_request con 0x7fd50403bdc0 auth_method 0 2024-08-18T21:09:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.649+0000 7fd516ffd640 1 -- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd5181d16a0 msgr2=0x7fd5181d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.649+0000 7fd516ffd640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd5181d16a0 0x7fd5181d1a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd508010790 tx=0x7fd508010c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.649+0000 7fd4fffff640 1 -- 172.21.15.5:0/2801535180 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd50801a020 con 0x7fd5181d16a0 2024-08-18T21:09:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.649+0000 7fd4fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.649+0000 7fd4fffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.649+0000 7fd4fffff640 10 monclient: dump: 2024-08-18T21:09:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.671 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.649+0000 7fd4fffff640 1 -- 172.21.15.5:0/2801535180 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd50800ebe0 con 0x7fd5181d16a0 2024-08-18T21:09:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.649+0000 7fd4fffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.649+0000 7fd4fffff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.649+0000 7fd4fffff640 1 -- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd5181d16a0 msgr2=0x7fd5181d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.649+0000 7fd4fffff640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd5181d16a0 0x7fd5181d1a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd508010790 tx=0x7fd508010c50 comp rx=0 tx=0).stop 2024-08-18T21:09:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.649+0000 7fd4fffff640 1 -- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd5181d16a0 msgr2=0x7fd5181d1a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.649+0000 7fd4fffff640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd5181d16a0 0x7fd5181d1a80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.649+0000 7fd5177fe640 1 --2- 172.21.15.5:0/2801535180 >> v2:172.21.15.157:6812/631023601 conn(0x7fd50403bdc0 0x7fd50403e280 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd5100072e0 tx=0x7fd51000b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd51d9c7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd51d9c7640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd5181d1fc0 0x7fd5180a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd51d9c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd51d9c7640 1 -- 172.21.15.5:0/2801535180 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fd518139e10 con 0x7fd5181d1fc0 2024-08-18T21:09:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd516ffd640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd5181d1fc0 0x7fd5180a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd516ffd640 10 monclient: get_auth_request con 0x7fd5181d1fc0 auth_method 0 2024-08-18T21:09:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd516ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd516ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd516ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd516ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd516ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd516ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd516ffd640 10 monclient(hunting): handle_auth_done global_id 84467 payload 824 2024-08-18T21:09:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd516ffd640 1 -- 172.21.15.5:0/2801535180 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd518123ca0 con 0x7fd5181d1fc0 2024-08-18T21:09:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd516ffd640 1 -- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd5181d1fc0 msgr2=0x7fd5180a4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd516ffd640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd5181d1fc0 0x7fd5180a4740 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd508010790 tx=0x7fd5080046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd4fffff640 1 -- 172.21.15.5:0/2801535180 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd50801a040 con 0x7fd5181d1fc0 2024-08-18T21:09:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd4fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd4fffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd4fffff640 10 monclient: dump: 2024-08-18T21:09:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.675 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.675 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd4fffff640 1 -- 172.21.15.5:0/2801535180 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7fd508015c80 con 0x7fd5181d1fc0 2024-08-18T21:09:52.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd4fffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:52.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd4fffff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:52.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd4fffff640 1 -- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd5181d1fc0 msgr2=0x7fd5180a4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd4fffff640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd5181d1fc0 0x7fd5180a4740 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd508010790 tx=0x7fd5080046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd4fffff640 1 -- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd5181d1fc0 msgr2=0x7fd5180a4740 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:52.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.657+0000 7fd4fffff640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd5181d1fc0 0x7fd5180a4740 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd508010790 tx=0x7fd5080046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.675 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 89486, 2024-08-18T21:09:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:09:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:52.681 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:52.681 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:09:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:52.700 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:52.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.661+0000 7fd51d9c7640 1 -- 172.21.15.5:0/2801535180 >> v2:172.21.15.157:6812/631023601 conn(0x7fd50403bdc0 msgr2=0x7fd50403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.661+0000 7fd51d9c7640 1 --2- 172.21.15.5:0/2801535180 >> v2:172.21.15.157:6812/631023601 conn(0x7fd50403bdc0 0x7fd50403e280 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd5100072e0 tx=0x7fd51000b040 comp rx=0 tx=0).stop 2024-08-18T21:09:52.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.661+0000 7fd51d9c7640 10 monclient: shutdown 2024-08-18T21:09:52.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.661+0000 7fd51d9c7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:52.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.661+0000 7fd51d9c7640 1 -- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd518139990 msgr2=0x7fd51813e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.661+0000 7fd51d9c7640 1 --2- 172.21.15.5:0/2801535180 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd518139990 0x7fd51813e1c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0ae040 tx=0x7fd50c019100 comp rx=0 tx=0).stop 2024-08-18T21:09:52.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.661+0000 7fd5177fe640 1 -- 172.21.15.5:0/2801535180 reap_dead start 2024-08-18T21:09:52.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.661+0000 7fd5177fe640 1 -- 172.21.15.5:0/2801535180 reap_dead start 2024-08-18T21:09:52.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.661+0000 7fd51d9c7640 1 -- 172.21.15.5:0/2801535180 shutdown_connections 2024-08-18T21:09:52.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.661+0000 7fd51d9c7640 1 -- 172.21.15.5:0/2801535180 >> 172.21.15.5:0/2801535180 conn(0x7fd518068700 msgr2=0x7fd5180a3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:52.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.661+0000 7fd51d9c7640 1 -- 172.21.15.5:0/2801535180 shutdown_connections 2024-08-18T21:09:52.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.661+0000 7fd51d9c7640 1 -- 172.21.15.5:0/2801535180 wait complete. 2024-08-18T21:09:52.703 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:52.703 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:09:52.704 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:09:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.817+0000 7f50267bd640 10 monclient: get_monmap_and_config 2024-08-18T21:09:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.817+0000 7f50267bd640 10 monclient: build_initial_monmap 2024-08-18T21:09:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.817+0000 7f50267bd640 10 monclient: monmap: 2024-08-18T21:09:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:52.824341+0000 2024-08-18T21:09:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:52.824341+0000 2024-08-18T21:09:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:52.823 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:52.824 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:52.824 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 1 Processor -- start 2024-08-18T21:09:52.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 1 -- start start 2024-08-18T21:09:52.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 10 monclient: init 2024-08-18T21:09:52.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:52.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 10 monclient: _add_conns ranks=[7,5,3,8,1,10,9,2,0,6,4] 2024-08-18T21:09:52.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f502009e730 0x7f502009eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 10 monclient(hunting): picked mon.noname-i con 0x7f502009e730 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:52.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5020068bc0 0x7f50201397e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 10 monclient(hunting): picked mon.noname-h con 0x7f5020068bc0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:52.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5020068fc0 0x7f5020139d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 10 monclient(hunting): picked mon.noname-g con 0x7f5020068fc0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:09:52.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5020069880 con 0x7f5020068fc0 2024-08-18T21:09:52.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f502009ca10 con 0x7f5020068bc0 2024-08-18T21:09:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f502009f050 con 0x7f502009e730 2024-08-18T21:09:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f50267bd640 10 monclient(hunting): authenticate will time out at 1359.837683s 2024-08-18T21:09:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5020068bc0 0x7f50201397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5020068bc0 0x7f50201397e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:39376/0 (socket says 172.21.15.5:39376) 2024-08-18T21:09:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f5024d5a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5020068fc0 0x7f5020139d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501ffff640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f502009e730 0x7f502009eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 1 -- 172.21.15.5:0/640185403 learned_addr learned my addr 172.21.15.5:0/640185403 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 10 monclient(hunting): get_auth_request con 0x7f5020068bc0 auth_method 0 2024-08-18T21:09:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f5024d5a640 10 monclient(hunting): get_auth_request con 0x7f5020068fc0 auth_method 0 2024-08-18T21:09:52.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f5024d5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f5024d5a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f5024d5a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501ffff640 10 monclient(hunting): get_auth_request con 0x7f502009e730 auth_method 0 2024-08-18T21:09:52.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f5024d5a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f5024d5a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f5024d5a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 10 monclient(hunting): handle_auth_done global_id 94127 payload 274 2024-08-18T21:09:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 1 -- 172.21.15.5:0/640185403 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f502009e730 msgr2=0x7f502009eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 1 --2- 172.21.15.5:0/640185403 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f502009e730 0x7f502009eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 1 -- 172.21.15.5:0/640185403 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5020068fc0 msgr2=0x7f5020139d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 1 --2- 172.21.15.5:0/640185403 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5020068fc0 0x7f5020139d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:09:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 1 monclient: found mon.noname-h 2024-08-18T21:09:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:09:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.821+0000 7f501f7fe640 1 -- 172.21.15.5:0/640185403 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502009cfd0 con 0x7f5020068bc0 2024-08-18T21:09:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.825+0000 7f501f7fe640 1 -- 172.21.15.5:0/640185403 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5020068bc0 msgr2=0x7f50201397e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.825+0000 7f501f7fe640 1 --2- 172.21.15.5:0/640185403 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5020068bc0 0x7f50201397e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f50140098a0 tx=0x7f501401c4d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=efbc33771ac08d71 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f501effd640 1 -- 172.21.15.5:0/640185403 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f50140b0070 con 0x7f5020068bc0 2024-08-18T21:09:52.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f501effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f501effd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:09:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f501effd640 10 monclient: dump: 2024-08-18T21:09:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.833 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.834 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f501effd640 10 monclient: _finish_auth 0 2024-08-18T21:09:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f501effd640 10 monclient: _check_auth_tickets 2024-08-18T21:09:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f501effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f501effd640 1 -- 172.21.15.5:0/640185403 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50140aa810 con 0x7f5020068bc0 2024-08-18T21:09:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f501effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f501effd640 1 -- 172.21.15.5:0/640185403 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f50140aae30 con 0x7f5020068bc0 2024-08-18T21:09:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 5 monclient: authenticate success, global_id 94127 2024-08-18T21:09:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:52.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 4 set_mon_vals no callback set 2024-08-18T21:09:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f501effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f501effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:09:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f501effd640 10 monclient: dump: 2024-08-18T21:09:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.836 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.836 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.836 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.836 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.836 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.836 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.836 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 10 monclient: shutdown 2024-08-18T21:09:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 1 -- 172.21.15.5:0/640185403 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5020068bc0 msgr2=0x7f50201397e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 1 --2- 172.21.15.5:0/640185403 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5020068bc0 0x7f50201397e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f50140098a0 tx=0x7f501401c4d0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 1 -- 172.21.15.5:0/640185403 shutdown_connections 2024-08-18T21:09:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 1 --2- 172.21.15.5:0/640185403 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5020068fc0 0x7f5020139d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 1 --2- 172.21.15.5:0/640185403 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5020068bc0 0x7f50201397e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 1 --2- 172.21.15.5:0/640185403 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f502009e730 0x7f502009eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 1 -- 172.21.15.5:0/640185403 >> 172.21.15.5:0/640185403 conn(0x7f50200a8480 msgr2=0x7f50200a8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 1 -- 172.21.15.5:0/640185403 shutdown_connections 2024-08-18T21:09:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 1 -- 172.21.15.5:0/640185403 wait complete. 2024-08-18T21:09:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 10 monclient: build_initial_monmap 2024-08-18T21:09:52.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 10 monclient: monmap: 2024-08-18T21:09:52.842 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:52.842 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:52.842 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:52.842 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:52.842 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:52.842 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.842 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:52.842 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:52.843 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 1 Processor -- start 2024-08-18T21:09:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 1 -- start start 2024-08-18T21:09:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 10 monclient: init 2024-08-18T21:09:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 10 monclient: _add_conns ranks=[4,5,1,6,8,2,3,0,7] 2024-08-18T21:09:52.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.829+0000 7f50267bd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5020068bc0 0x7f50201d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 10 monclient(hunting): picked mon.noname-c con 0x7f5020068bc0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:52.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5020068fc0 0x7f50200990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 10 monclient(hunting): picked mon.noname-h con 0x7f5020068fc0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:52.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f502009e730 0x7f5020099600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 10 monclient(hunting): picked mon.noname-f con 0x7f502009e730 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:09:52.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f50201436c0 con 0x7f502009e730 2024-08-18T21:09:52.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f5020143540 con 0x7f5020068bc0 2024-08-18T21:09:52.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f5020143840 con 0x7f5020068fc0 2024-08-18T21:09:52.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 10 monclient(hunting): authenticate will time out at 1359.848078s 2024-08-18T21:09:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5020068bc0 0x7f50201d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5020068bc0 0x7f50201d1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:50840/0 (socket says 172.21.15.5:50840) 2024-08-18T21:09:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 1 -- 172.21.15.5:0/401926363 learned_addr learned my addr 172.21.15.5:0/401926363 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 10 monclient(hunting): get_auth_request con 0x7f5020068bc0 auth_method 0 2024-08-18T21:09:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501f7fe640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5020068fc0 0x7f50200990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f5024d5a640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f502009e730 0x7f5020099600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501f7fe640 10 monclient(hunting): get_auth_request con 0x7f5020068fc0 auth_method 0 2024-08-18T21:09:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 10 monclient(hunting): handle_auth_done global_id 6088 payload 824 2024-08-18T21:09:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 1 -- 172.21.15.5:0/401926363 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5020068fc0 msgr2=0x7f50200990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5020068fc0 0x7f50200990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 1 -- 172.21.15.5:0/401926363 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f502009e730 msgr2=0x7f5020099600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f502009e730 0x7f5020099600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 1 monclient: found mon.noname-c 2024-08-18T21:09:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:09:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 1 -- 172.21.15.5:0/401926363 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50200a2330 con 0x7f5020068bc0 2024-08-18T21:09:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f5024d5a640 10 monclient: get_auth_request con 0x7f502009e730 auth_method 0 2024-08-18T21:09:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f5024d5a640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f502009e730 0x7f5020099600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:09:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 1 -- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5020068bc0 msgr2=0x7f50201d1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501ffff640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5020068bc0 0x7f50201d1a30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f501000e870 tx=0x7f501000ec70 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501cff9640 1 -- 172.21.15.5:0/401926363 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5010017070 con 0x7f5020068bc0 2024-08-18T21:09:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:09:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501cff9640 10 monclient: dump: 2024-08-18T21:09:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.848 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.848 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.848 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.848 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.848 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.848 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.848 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.848 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.848 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.848 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.848 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501cff9640 10 monclient: _finish_auth 0 2024-08-18T21:09:52.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501cff9640 10 monclient: _check_auth_tickets 2024-08-18T21:09:52.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501cff9640 1 -- 172.21.15.5:0/401926363 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5010013470 con 0x7f5020068bc0 2024-08-18T21:09:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501cff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501cff9640 1 -- 172.21.15.5:0/401926363 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5010013a90 con 0x7f5020068bc0 2024-08-18T21:09:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 5 monclient: authenticate success, global_id 6088 2024-08-18T21:09:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 10 monclient: _renew_subs 2024-08-18T21:09:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:09:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 1 -- 172.21.15.5:0/401926363 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50201401f0 con 0x7f5020068bc0 2024-08-18T21:09:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501dffb640 4 set_mon_vals no callback set 2024-08-18T21:09:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f501cff9640 10 monclient: dump: 2024-08-18T21:09:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.851 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.851 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.851 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.851 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.851 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.851 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 10 monclient: _renew_subs 2024-08-18T21:09:52.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:09:52.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 1 -- 172.21.15.5:0/401926363 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f5020099b40 con 0x7f5020068bc0 2024-08-18T21:09:52.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:52.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5020090380 0x7f502013ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.833+0000 7f50267bd640 1 -- 172.21.15.5:0/401926363 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f5020051140 con 0x7f5020090380 2024-08-18T21:09:52.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501f7fe640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5020090380 0x7f502013ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501f7fe640 10 monclient: get_auth_request con 0x7f5020090380 auth_method 0 2024-08-18T21:09:52.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501cff9640 1 -- 172.21.15.5:0/401926363 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f501001a070 con 0x7f5020068bc0 2024-08-18T21:09:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501f7fe640 10 monclient(hunting): handle_auth_done global_id 6097 payload 824 2024-08-18T21:09:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501f7fe640 1 -- 172.21.15.5:0/401926363 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f502008f480 con 0x7f5020090380 2024-08-18T21:09:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501cff9640 1 --2- 172.21.15.5:0/401926363 >> v2:172.21.15.157:6812/631023601 conn(0x7f500c03bdc0 0x7f500c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501cff9640 1 -- 172.21.15.5:0/401926363 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(176..176 src has 22..176) ==== 3898+0+0 (secure 0 0 0) 0x7f501000f040 con 0x7f5020068bc0 2024-08-18T21:09:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f5024d5a640 1 --2- 172.21.15.5:0/401926363 >> v2:172.21.15.157:6812/631023601 conn(0x7f500c03bdc0 0x7f500c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f5024d5a640 10 monclient: get_auth_request con 0x7f500c03bdc0 auth_method 0 2024-08-18T21:09:52.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501f7fe640 1 -- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5020090380 msgr2=0x7f502013ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:52.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501f7fe640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5020090380 0x7f502013ecd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5014009870 tx=0x7f5014019270 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501cff9640 1 -- 172.21.15.5:0/401926363 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f50140b0070 con 0x7f5020090380 2024-08-18T21:09:52.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:52.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501cff9640 10 monclient: dump: 2024-08-18T21:09:52.857 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.857 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.857 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.857 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.857 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.857 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.857 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.857 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.857 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.858 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501cff9640 1 -- 172.21.15.5:0/401926363 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f50140bb070 con 0x7f5020090380 2024-08-18T21:09:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501cff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501cff9640 1 -- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5020090380 msgr2=0x7f502013ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501cff9640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5020090380 0x7f502013ecd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5014009870 tx=0x7f5014019270 comp rx=0 tx=0).stop 2024-08-18T21:09:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501cff9640 1 -- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5020090380 msgr2=0x7f502013ecd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f501cff9640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5020090380 0x7f502013ecd0 secure :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5014009870 tx=0x7f5014019270 comp rx=0 tx=0).stop 2024-08-18T21:09:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.837+0000 7f5024d5a640 1 --2- 172.21.15.5:0/401926363 >> v2:172.21.15.157:6812/631023601 conn(0x7f500c03bdc0 0x7f500c03e280 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f502006f6b0 tx=0x7f501800b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.845+0000 7f50267bd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.845+0000 7f50267bd640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f502013f210 0x7f502013f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.845+0000 7f50267bd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.845+0000 7f50267bd640 1 -- 172.21.15.5:0/401926363 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f502013fb60 con 0x7f502013f210 2024-08-18T21:09:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.845+0000 7f501f7fe640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f502013f210 0x7f502013f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.845+0000 7f501f7fe640 10 monclient: get_auth_request con 0x7f502013f210 auth_method 0 2024-08-18T21:09:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.845+0000 7f501f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.845+0000 7f501f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.845+0000 7f501f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.845+0000 7f501f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.845+0000 7f501f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.845+0000 7f501f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.845+0000 7f501f7fe640 10 monclient(hunting): handle_auth_done global_id 6106 payload 824 2024-08-18T21:09:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.845+0000 7f501f7fe640 1 -- 172.21.15.5:0/401926363 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5020090760 con 0x7f502013f210 2024-08-18T21:09:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f501f7fe640 1 -- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f502013f210 msgr2=0x7f502013f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f501f7fe640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f502013f210 0x7f502013f620 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f501401c300 tx=0x7f50140a8000 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f501cff9640 1 -- 172.21.15.5:0/401926363 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5014003e60 con 0x7f502013f210 2024-08-18T21:09:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f501cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f501cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f501cff9640 10 monclient: dump: 2024-08-18T21:09:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:52.861 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f501cff9640 1 -- 172.21.15.5:0/401926363 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f50140b1040 con 0x7f502013f210 2024-08-18T21:09:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f501cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:52.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f501cff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:52.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f501cff9640 1 -- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f502013f210 msgr2=0x7f502013f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f501cff9640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f502013f210 0x7f502013f620 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f501401c300 tx=0x7f50140a8000 comp rx=0 tx=0).stop 2024-08-18T21:09:52.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f501cff9640 1 -- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f502013f210 msgr2=0x7f502013f620 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:52.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f501cff9640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f502013f210 0x7f502013f620 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f501401c300 tx=0x7f50140a8000 comp rx=0 tx=0).stop 2024-08-18T21:09:52.862 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:52.862 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:52.862 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:52.863 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:52.863 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:52.863 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 401967, 2024-08-18T21:09:52.863 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:52.863 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:52.863 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:52.863 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:52.863 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:52.863 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:52.863 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:52.864 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:52.864 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:52.864 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:52.864 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:52.864 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:09:52.864 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:52.864 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:52.864 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:52.864 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:52.864 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:52.864 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:52.864 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:52.867 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:52.867 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:52.867 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:52.867 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:52.867 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:52.867 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:52.867 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:52.867 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:52.867 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:52.867 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:52.867 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:52.867 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:52.867 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:52.867 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:52.868 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:52.868 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:52.868 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:52.868 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:52.868 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:52.868 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:52.868 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:52.868 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:52.868 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:52.868 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:52.868 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:52.868 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:52.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.869 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:52.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.869 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:52.869 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:52.869 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.869 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.869 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.869 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:52.869 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.870 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.870 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:52.870 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.870 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.870 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.870 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:52.870 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:52.871 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.871 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.871 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.871 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:52.871 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:52.871 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.871 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.871 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.871 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:52.871 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:52.872 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.872 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.872 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:52.872 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:52.872 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.872 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.872 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.873 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:52.873 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:52.873 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.873 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.873 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.873 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:52.873 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.873 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.873 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:52.874 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.874 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.874 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.874 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:52.874 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:52.874 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.874 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.874 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.874 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:52.875 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:52.875 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.875 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:52.875 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.875 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:52.876 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.876 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.876 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:52.877 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:52.877 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.877 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.877 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.877 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:52.877 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:52.877 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:52.878 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:52.878 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.878 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.878 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:52.878 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:52.879 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.879 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.879 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.879 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:52.879 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:52.879 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.879 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:52.880 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:52.880 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.880 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.880 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:52.880 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:52.881 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.881 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.881 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.881 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:52.881 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:52.881 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.881 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.881 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.881 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:52.881 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.882 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:52.882 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.882 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.882 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.882 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:52.882 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:52.882 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.883 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.883 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.883 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:52.883 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:52.883 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.883 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.883 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.883 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:52.883 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.884 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.884 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:52.884 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.884 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.884 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.884 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:52.884 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:52.884 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.891 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.891 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.892 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:52.892 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:52.892 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:52.892 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:52.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.892 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:52.892 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:52.892 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.892 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:52.892 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:52.893 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:52.893 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.893 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.893 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:52.893 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:52.893 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:52.893 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:52.893 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:52.893 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.893 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.894 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:52.894 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:52.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.894 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:52.894 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:52.894 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:52.894 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.894 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:52.894 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:09:52.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.894 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:52.894 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:52.895 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:52.895 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.895 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:52.895 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:52.895 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:52.895 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:52.895 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:52.895 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:09:52.895 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:52.895 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:52.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:52.895 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:52.895 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f50267bd640 1 -- 172.21.15.5:0/401926363 >> v2:172.21.15.157:6812/631023601 conn(0x7f500c03bdc0 msgr2=0x7f500c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f50267bd640 1 --2- 172.21.15.5:0/401926363 >> v2:172.21.15.157:6812/631023601 conn(0x7f500c03bdc0 0x7f500c03e280 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f502006f6b0 tx=0x7f501800b040 comp rx=0 tx=0).stop 2024-08-18T21:09:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f50267bd640 10 monclient: shutdown 2024-08-18T21:09:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f50267bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f50267bd640 1 -- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5020068bc0 msgr2=0x7f50201d1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:52.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f50267bd640 1 --2- 172.21.15.5:0/401926363 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5020068bc0 0x7f50201d1a30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f501000e870 tx=0x7f501000ec70 comp rx=0 tx=0).stop 2024-08-18T21:09:52.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f5024d5a640 1 -- 172.21.15.5:0/401926363 reap_dead start 2024-08-18T21:09:52.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f5024d5a640 1 -- 172.21.15.5:0/401926363 reap_dead start 2024-08-18T21:09:52.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f50267bd640 1 -- 172.21.15.5:0/401926363 shutdown_connections 2024-08-18T21:09:52.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f50267bd640 1 -- 172.21.15.5:0/401926363 >> 172.21.15.5:0/401926363 conn(0x7f50200a8480 msgr2=0x7f50200a0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:52.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f50267bd640 1 -- 172.21.15.5:0/401926363 shutdown_connections 2024-08-18T21:09:52.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:52.849+0000 7f50267bd640 1 -- 172.21.15.5:0/401926363 wait complete. 2024-08-18T21:09:52.900 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:52.900 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:09:52.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:09:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.029+0000 7f5cefe22640 10 monclient: get_monmap_and_config 2024-08-18T21:09:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.029+0000 7f5cefe22640 10 monclient: build_initial_monmap 2024-08-18T21:09:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.029+0000 7f5cefe22640 10 monclient: monmap: 2024-08-18T21:09:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:53.034707+0000 2024-08-18T21:09:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:53.034707+0000 2024-08-18T21:09:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:53.037 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:53.037 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 1 Processor -- start 2024-08-18T21:09:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 1 -- start start 2024-08-18T21:09:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 10 monclient: init 2024-08-18T21:09:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 10 monclient: _add_conns ranks=[10,4,7,6,9,3,1,2,8,5,0] 2024-08-18T21:09:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5ce80a6bd0 0x7f5ce80a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 10 monclient(hunting): picked mon.noname-f con 0x7f5ce80a6bd0 addr v2:172.21.15.157:3300/0 2024-08-18T21:09:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5ce809f080 0x7f5ce80a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 10 monclient(hunting): picked mon.noname-c con 0x7f5ce809f080 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5ce8139990 0x7f5ce8139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 10 monclient(hunting): picked mon.noname-i con 0x7f5ce8139990 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5ce809e4c0 con 0x7f5ce80a6bd0 2024-08-18T21:09:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f5ce806f930 con 0x7f5ce809f080 2024-08-18T21:09:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f5ce80a7a30 con 0x7f5ce8139990 2024-08-18T21:09:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cefe22640 10 monclient(hunting): authenticate will time out at 1360.053522s 2024-08-18T21:09:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5ce809f080 0x7f5ce80a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5ce809f080 0x7f5ce80a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:50864/0 (socket says 172.21.15.5:50864) 2024-08-18T21:09:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 1 -- 172.21.15.5:0/2173319818 learned_addr learned my addr 172.21.15.5:0/2173319818 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 10 monclient(hunting): get_auth_request con 0x7f5ce809f080 auth_method 0 2024-08-18T21:09:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cee3bf640 1 --2- 172.21.15.5:0/2173319818 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5ce8139990 0x7f5ce8139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cee3bf640 10 monclient(hunting): get_auth_request con 0x7f5ce8139990 auth_method 0 2024-08-18T21:09:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cee3bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cee3bf640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5cee3bf640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 10 monclient(hunting): handle_auth_done global_id 6115 payload 274 2024-08-18T21:09:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 1 -- 172.21.15.5:0/2173319818 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5ce8139990 msgr2=0x7f5ce8139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 1 --2- 172.21.15.5:0/2173319818 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5ce8139990 0x7f5ce8139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 1 -- 172.21.15.5:0/2173319818 >> v2:172.21.15.157:3300/0 conn(0x7f5ce80a6bd0 msgr2=0x7f5ce80a6fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T21:09:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 1 --2- 172.21.15.5:0/2173319818 >> v2:172.21.15.157:3300/0 conn(0x7f5ce80a6bd0 0x7f5ce80a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 10 monclient: _finish_hunting 0 2024-08-18T21:09:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 1 monclient: found mon.noname-c 2024-08-18T21:09:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:09:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.037+0000 7f5ced3bd640 1 -- 172.21.15.5:0/2173319818 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce80a7fb0 con 0x7f5ce809f080 2024-08-18T21:09:53.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5ced3bd640 1 -- 172.21.15.5:0/2173319818 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5ce809f080 msgr2=0x7f5ce80a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:53.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5ced3bd640 1 --2- 172.21.15.5:0/2173319818 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5ce809f080 0x7f5ce80a74f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009870 tx=0x7f5cd801c440 comp rx=0 tx=0).ready entity=mon.4 client_cookie=2820a4544d8728bd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5cecbbc640 1 -- 172.21.15.5:0/2173319818 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5cd80b0070 con 0x7f5ce809f080 2024-08-18T21:09:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5cecbbc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5cecbbc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:09:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5cecbbc640 10 monclient: dump: 2024-08-18T21:09:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.048 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5cecbbc640 10 monclient: _finish_auth 0 2024-08-18T21:09:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5cecbbc640 10 monclient: _check_auth_tickets 2024-08-18T21:09:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5cecbbc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5cecbbc640 1 -- 172.21.15.5:0/2173319818 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cd80aa810 con 0x7f5ce809f080 2024-08-18T21:09:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5cecbbc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5cecbbc640 1 -- 172.21.15.5:0/2173319818 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5cd80a9300 con 0x7f5ce809f080 2024-08-18T21:09:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5cefe22640 5 monclient: authenticate success, global_id 6115 2024-08-18T21:09:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5cefe22640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5cefe22640 4 set_mon_vals no callback set 2024-08-18T21:09:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5cecbbc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5cecbbc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.041+0000 7f5cecbbc640 10 monclient: dump: 2024-08-18T21:09:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.051 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.051 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.051 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.051 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.051 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 10 monclient: shutdown 2024-08-18T21:09:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 -- 172.21.15.5:0/2173319818 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5ce809f080 msgr2=0x7f5ce80a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 --2- 172.21.15.5:0/2173319818 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5ce809f080 0x7f5ce80a74f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009870 tx=0x7f5cd801c440 comp rx=0 tx=0).stop 2024-08-18T21:09:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 -- 172.21.15.5:0/2173319818 shutdown_connections 2024-08-18T21:09:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 --2- 172.21.15.5:0/2173319818 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5ce8139990 0x7f5ce8139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 --2- 172.21.15.5:0/2173319818 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5ce809f080 0x7f5ce80a74f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 --2- 172.21.15.5:0/2173319818 >> v2:172.21.15.157:3300/0 conn(0x7f5ce80a6bd0 0x7f5ce80a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 -- 172.21.15.5:0/2173319818 >> 172.21.15.5:0/2173319818 conn(0x7f5ce8068700 msgr2=0x7f5ce8068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 -- 172.21.15.5:0/2173319818 shutdown_connections 2024-08-18T21:09:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 -- 172.21.15.5:0/2173319818 wait complete. 2024-08-18T21:09:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 10 monclient: build_initial_monmap 2024-08-18T21:09:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 10 monclient: monmap: 2024-08-18T21:09:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:53.060 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 Processor -- start 2024-08-18T21:09:53.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 -- start start 2024-08-18T21:09:53.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 10 monclient: init 2024-08-18T21:09:53.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:53.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 10 monclient: _add_conns ranks=[4,8,7,0,5,3,6,2,1] 2024-08-18T21:09:53.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5ce809f080 0x7f5ce81d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 10 monclient(hunting): picked mon.noname-c con 0x7f5ce809f080 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:53.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5ce80a6bd0 0x7f5ce8136980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 10 monclient(hunting): picked mon.noname-e con 0x7f5ce80a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:53.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5ce8139990 0x7f5ce813bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 10 monclient(hunting): picked mon.noname-i con 0x7f5ce8139990 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:53.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f5ce80a89f0 con 0x7f5ce809f080 2024-08-18T21:09:53.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f5ce80a7ce0 con 0x7f5ce8139990 2024-08-18T21:09:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f5ce8143610 con 0x7f5ce80a6bd0 2024-08-18T21:09:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cefe22640 10 monclient(hunting): authenticate will time out at 1360.062092s 2024-08-18T21:09:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5ce809f080 0x7f5ce81d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5ced3bd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5ce80a6bd0 0x7f5ce8136980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5ce809f080 0x7f5ce81d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:50880/0 (socket says 172.21.15.5:50880) 2024-08-18T21:09:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 1 -- 172.21.15.5:0/50473864 learned_addr learned my addr 172.21.15.5:0/50473864 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 10 monclient(hunting): get_auth_request con 0x7f5ce809f080 auth_method 0 2024-08-18T21:09:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5ced3bd640 10 monclient(hunting): get_auth_request con 0x7f5ce80a6bd0 auth_method 0 2024-08-18T21:09:53.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5ced3bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5ced3bd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5ced3bd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5ced3bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5ced3bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5ced3bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cee3bf640 1 --2- 172.21.15.5:0/50473864 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5ce8139990 0x7f5ce813bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cee3bf640 10 monclient(hunting): get_auth_request con 0x7f5ce8139990 auth_method 0 2024-08-18T21:09:53.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cee3bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cee3bf640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cee3bf640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 10 monclient(hunting): handle_auth_done global_id 6124 payload 824 2024-08-18T21:09:53.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 1 -- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5ce80a6bd0 msgr2=0x7f5ce8136980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 1 --2- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5ce80a6bd0 0x7f5ce8136980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 1 -- 172.21.15.5:0/50473864 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5ce8139990 msgr2=0x7f5ce813bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 1 --2- 172.21.15.5:0/50473864 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5ce8139990 0x7f5ce813bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 10 monclient: _finish_hunting 0 2024-08-18T21:09:53.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 1 monclient: found mon.noname-c 2024-08-18T21:09:53.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:09:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5cedbbe640 1 -- 172.21.15.5:0/50473864 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce8137720 con 0x7f5ce809f080 2024-08-18T21:09:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.045+0000 7f5ced3bd640 1 --2- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5ce80a6bd0 0x7f5ce8136980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cedbbe640 1 -- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5ce809f080 msgr2=0x7f5ce81d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cedbbe640 1 --2- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5ce809f080 0x7f5ce81d15a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400b4d0 tx=0x7f5ce400b990 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cde7fc640 1 -- 172.21.15.5:0/50473864 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5ce4014070 con 0x7f5ce809f080 2024-08-18T21:09:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cde7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cde7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:09:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cde7fc640 10 monclient: dump: 2024-08-18T21:09:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.067 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cde7fc640 10 monclient: _finish_auth 0 2024-08-18T21:09:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cde7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:09:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cde7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cefe22640 5 monclient: authenticate success, global_id 6124 2024-08-18T21:09:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cde7fc640 1 -- 172.21.15.5:0/50473864 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce4010cf0 con 0x7f5ce809f080 2024-08-18T21:09:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cefe22640 10 monclient: _renew_subs 2024-08-18T21:09:53.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cefe22640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:09:53.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cefe22640 1 -- 172.21.15.5:0/50473864 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce80ab000 con 0x7f5ce809f080 2024-08-18T21:09:53.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cde7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:53.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cde7fc640 1 -- 172.21.15.5:0/50473864 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5ce400f830 con 0x7f5ce809f080 2024-08-18T21:09:53.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cde7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cde7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:53.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cdffff640 4 set_mon_vals no callback set 2024-08-18T21:09:53.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cde7fc640 10 monclient: dump: 2024-08-18T21:09:53.068 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.068 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.068 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.068 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.068 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.069 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.069 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.069 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.069 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.069 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.069 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.069 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.069 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.069 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.069 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.069 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cefe22640 10 monclient: _renew_subs 2024-08-18T21:09:53.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cefe22640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:09:53.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cefe22640 1 -- 172.21.15.5:0/50473864 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce813e100 con 0x7f5ce809f080 2024-08-18T21:09:53.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cefe22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:53.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cefe22640 1 --2- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5ce8136ec0 0x7f5ce813c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cefe22640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cefe22640 1 -- 172.21.15.5:0/50473864 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f5ce81d2500 con 0x7f5ce8136ec0 2024-08-18T21:09:53.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cde7fc640 1 -- 172.21.15.5:0/50473864 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f5ce4017070 con 0x7f5ce809f080 2024-08-18T21:09:53.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5ced3bd640 1 --2- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5ce8136ec0 0x7f5ce813c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5ced3bd640 10 monclient: get_auth_request con 0x7f5ce8136ec0 auth_method 0 2024-08-18T21:09:53.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5ced3bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5ced3bd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5ced3bd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5ced3bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5ced3bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5ced3bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5ced3bd640 10 monclient(hunting): handle_auth_done global_id 84597 payload 824 2024-08-18T21:09:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cde7fc640 1 --2- 172.21.15.5:0/50473864 >> v2:172.21.15.157:6812/631023601 conn(0x7f5ccc03bdc0 0x7f5ccc03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5ced3bd640 1 -- 172.21.15.5:0/50473864 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ce80ab550 con 0x7f5ce8136ec0 2024-08-18T21:09:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cde7fc640 1 -- 172.21.15.5:0/50473864 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(177..177 src has 22..177) ==== 3898+0+0 (secure 0 0 0) 0x7f5ce404e380 con 0x7f5ce809f080 2024-08-18T21:09:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cee3bf640 1 --2- 172.21.15.5:0/50473864 >> v2:172.21.15.157:6812/631023601 conn(0x7f5ccc03bdc0 0x7f5ccc03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.049+0000 7f5cee3bf640 10 monclient: get_auth_request con 0x7f5ccc03bdc0 auth_method 0 2024-08-18T21:09:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.053+0000 7f5ced3bd640 1 -- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5ce8136ec0 msgr2=0x7f5ce813c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.053+0000 7f5ced3bd640 1 --2- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5ce8136ec0 0x7f5ce813c120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80ad000 tx=0x7f5cd80191e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.053+0000 7f5cde7fc640 1 -- 172.21.15.5:0/50473864 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5cd80ba020 con 0x7f5ce8136ec0 2024-08-18T21:09:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.053+0000 7f5cde7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.053+0000 7f5cde7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:09:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.053+0000 7f5cde7fc640 10 monclient: dump: 2024-08-18T21:09:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.074 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.053+0000 7f5cde7fc640 1 -- 172.21.15.5:0/50473864 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5cd80aaa20 con 0x7f5ce8136ec0 2024-08-18T21:09:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.053+0000 7f5cde7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.053+0000 7f5cde7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.053+0000 7f5cde7fc640 1 -- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5ce8136ec0 msgr2=0x7f5ce813c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.053+0000 7f5cde7fc640 1 --2- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5ce8136ec0 0x7f5ce813c120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80ad000 tx=0x7f5cd80191e0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.053+0000 7f5cde7fc640 1 -- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5ce8136ec0 msgr2=0x7f5ce813c120 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.053+0000 7f5cde7fc640 1 --2- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5ce8136ec0 0x7f5ce813c120 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.053+0000 7f5cee3bf640 1 --2- 172.21.15.5:0/50473864 >> v2:172.21.15.157:6812/631023601 conn(0x7f5ccc03bdc0 0x7f5ccc03e280 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0009ee0 tx=0x7f5ce000b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.057+0000 7f5cefe22640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.057+0000 7f5cefe22640 1 --2- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5ce813c660 0x7f5ce80a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.057+0000 7f5cefe22640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.057+0000 7f5cefe22640 1 -- 172.21.15.5:0/50473864 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f5ce8051140 con 0x7f5ce813c660 2024-08-18T21:09:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.057+0000 7f5ced3bd640 1 --2- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5ce813c660 0x7f5ce80a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.057+0000 7f5ced3bd640 10 monclient: get_auth_request con 0x7f5ce813c660 auth_method 0 2024-08-18T21:09:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.057+0000 7f5ced3bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.057+0000 7f5ced3bd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.057+0000 7f5ced3bd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.057+0000 7f5ced3bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.057+0000 7f5ced3bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.057+0000 7f5ced3bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.057+0000 7f5ced3bd640 10 monclient(hunting): handle_auth_done global_id 84606 payload 824 2024-08-18T21:09:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.057+0000 7f5ced3bd640 1 -- 172.21.15.5:0/50473864 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5ce813ca70 con 0x7f5ce813c660 2024-08-18T21:09:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5ced3bd640 1 -- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5ce813c660 msgr2=0x7f5ce80a4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5ced3bd640 1 --2- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5ce813c660 0x7f5ce80a4260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009870 tx=0x7f5cd80a8000 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cde7fc640 1 -- 172.21.15.5:0/50473864 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5cd80ba040 con 0x7f5ce813c660 2024-08-18T21:09:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cde7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cde7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:09:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cde7fc640 10 monclient: dump: 2024-08-18T21:09:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.079 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.079 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.079 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.079 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.079 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.079 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.079 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.079 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.079 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.079 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.079 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.079 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.079 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cde7fc640 1 -- 172.21.15.5:0/50473864 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f5cd80c1280 con 0x7f5ce813c660 2024-08-18T21:09:53.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cde7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:53.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cde7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:53.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cde7fc640 1 -- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5ce813c660 msgr2=0x7f5ce80a4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cde7fc640 1 --2- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5ce813c660 0x7f5ce80a4260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009870 tx=0x7f5cd80a8000 comp rx=0 tx=0).stop 2024-08-18T21:09:53.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cde7fc640 1 -- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5ce813c660 msgr2=0x7f5ce80a4260 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:53.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cde7fc640 1 --2- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5ce813c660 0x7f5ce80a4260 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009870 tx=0x7f5cd80a8000 comp rx=0 tx=0).stop 2024-08-18T21:09:53.081 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:53.081 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:53.081 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 89890, 2024-08-18T21:09:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:53.082 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:53.083 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.083 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:09:53.083 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:53.083 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:53.083 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:53.083 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:53.083 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:53.083 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:53.083 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:53.083 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:53.083 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:53.083 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:53.083 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:53.084 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:53.084 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:53.084 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:53.084 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.084 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:53.084 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:53.084 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:53.084 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:53.084 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:53.084 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:53.084 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:53.084 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:53.084 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:53.085 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:53.085 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:53.085 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:53.085 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:53.085 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.085 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:53.085 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:53.085 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:53.085 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:53.085 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:53.085 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:53.085 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:53.086 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:53.086 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:53.086 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:53.086 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:53.086 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:53.089 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:53.090 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:53.090 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:53.090 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:53.090 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:53.090 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:53.090 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:53.090 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:53.090 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:53.090 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:53.090 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:53.090 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:53.090 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:53.091 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:53.091 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:53.091 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:53.091 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.091 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:53.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.091 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:53.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.092 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:53.092 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:53.092 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:53.092 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:53.093 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.093 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.093 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.093 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:53.093 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:53.093 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.093 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.093 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.093 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:53.094 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:53.094 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:53.094 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:53.094 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.094 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.095 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.095 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:53.095 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:53.095 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.095 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.095 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.095 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:53.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:53.095 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.095 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.096 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.096 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:53.096 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.096 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.096 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:53.096 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.096 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.096 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.096 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:53.097 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:53.097 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.097 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.097 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.097 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:53.097 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:53.097 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.097 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.097 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.097 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:53.098 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:53.098 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.098 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.098 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:53.098 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:53.098 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.098 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.098 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.099 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:53.099 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:53.099 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:53.099 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.100 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:53.100 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.100 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.100 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.100 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:53.100 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:53.100 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.100 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.100 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.100 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:53.100 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:53.101 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.101 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.101 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:53.101 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.101 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:53.101 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.102 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.102 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.102 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:53.102 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:53.102 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.102 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.102 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.103 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:53.103 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:53.103 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.103 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.103 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.103 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:53.103 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.103 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.103 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:53.103 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.103 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.104 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.104 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:53.104 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:53.104 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.104 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.104 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.104 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:53.104 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:53.104 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.104 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.105 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:53.105 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.105 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:53.105 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.105 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.105 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.105 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:53.105 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:53.106 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.106 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.106 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.106 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:53.106 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:53.106 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.106 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.106 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.107 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:53.107 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.107 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.107 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:53.107 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.107 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.107 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.107 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:53.107 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:53.107 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.107 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.108 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.108 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.108 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.108 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:53.108 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:53.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.108 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:53.108 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:53.108 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:53.108 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.108 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.108 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:09:53.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.109 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:53.109 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:53.109 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:53.109 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.109 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.109 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:53.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.109 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:53.109 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:53.109 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:09:53.109 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.109 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.110 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:53.110 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:53.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cefe22640 1 -- 172.21.15.5:0/50473864 >> v2:172.21.15.157:6812/631023601 conn(0x7f5ccc03bdc0 msgr2=0x7f5ccc03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cefe22640 1 --2- 172.21.15.5:0/50473864 >> v2:172.21.15.157:6812/631023601 conn(0x7f5ccc03bdc0 0x7f5ccc03e280 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0009ee0 tx=0x7f5ce000b040 comp rx=0 tx=0).stop 2024-08-18T21:09:53.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cefe22640 10 monclient: shutdown 2024-08-18T21:09:53.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cefe22640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:53.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cefe22640 1 -- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5ce809f080 msgr2=0x7f5ce81d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cefe22640 1 --2- 172.21.15.5:0/50473864 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5ce809f080 0x7f5ce81d15a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400b4d0 tx=0x7f5ce400b990 comp rx=0 tx=0).stop 2024-08-18T21:09:53.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cee3bf640 1 -- 172.21.15.5:0/50473864 reap_dead start 2024-08-18T21:09:53.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cee3bf640 1 -- 172.21.15.5:0/50473864 reap_dead start 2024-08-18T21:09:53.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cefe22640 1 -- 172.21.15.5:0/50473864 shutdown_connections 2024-08-18T21:09:53.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cefe22640 1 -- 172.21.15.5:0/50473864 >> 172.21.15.5:0/50473864 conn(0x7f5ce8068700 msgr2=0x7f5ce80abaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:53.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cefe22640 1 -- 172.21.15.5:0/50473864 shutdown_connections 2024-08-18T21:09:53.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.061+0000 7f5cefe22640 1 -- 172.21.15.5:0/50473864 wait complete. 2024-08-18T21:09:53.113 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:53.113 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:09:53.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:09:53.193 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:53.193 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30309]: starting. 2024-08-18T21:09:53.193 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30309]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30270 2024-08-18T21:09:53.193 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30309]: created object 0... 2024-08-18T21:09:53.193 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30309]: created object 25... 2024-08-18T21:09:53.193 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30309]: created object 49... 2024-08-18T21:09:53.193 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30309]: finishing. 2024-08-18T21:09:53.193 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30309]: shutting down. 2024-08-18T21:09:53.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.225+0000 7fdd18cba640 10 monclient: get_monmap_and_config 2024-08-18T21:09:53.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.225+0000 7fdd18cba640 10 monclient: build_initial_monmap 2024-08-18T21:09:53.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.225+0000 7fdd18cba640 10 monclient: monmap: 2024-08-18T21:09:53.231 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:53.231 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.231 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:53.231530+0000 2024-08-18T21:09:53.231 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:53.231530+0000 2024-08-18T21:09:53.231 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:53.231 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.231 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:53.231 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:53.231 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:53.231 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:53.231 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:53.232 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.225+0000 7fdd18cba640 1 Processor -- start 2024-08-18T21:09:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.225+0000 7fdd18cba640 1 -- start start 2024-08-18T21:09:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.225+0000 7fdd18cba640 10 monclient: init 2024-08-18T21:09:53.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd18cba640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:53.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd18cba640 10 monclient: _add_conns ranks=[4,10,8,6,7,9,1,2,3,0,5] 2024-08-18T21:09:53.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd18cba640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdd140a5a50 0x7fdd14137800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd18cba640 10 monclient(hunting): picked mon.noname-c con 0x7fdd140a5a50 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:53.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd18cba640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdd14137d40 0x7fdd14138120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd18cba640 10 monclient(hunting): picked mon.noname-f con 0x7fdd14137d40 addr v2:172.21.15.157:3300/0 2024-08-18T21:09:53.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd18cba640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd140a1540 0x7fdd140a1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd18cba640 10 monclient(hunting): picked mon.noname-e con 0x7fdd140a1540 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:53.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd18cba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd18cba640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fdd140a5e30 con 0x7fdd14137d40 2024-08-18T21:09:53.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd18cba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd18cba640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fdd140a3740 con 0x7fdd140a5a50 2024-08-18T21:09:53.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd18cba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd18cba640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fdd140a67a0 con 0x7fdd140a1540 2024-08-18T21:09:53.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd18cba640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:53.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd18cba640 10 monclient(hunting): authenticate will time out at 1360.244335s 2024-08-18T21:09:53.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdd140a5a50 0x7fdd14137800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd12d9d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd140a1540 0x7fdd140a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd12d9d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd140a1540 0x7fdd140a1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47280/0 (socket says 172.21.15.5:47280) 2024-08-18T21:09:53.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd12d9d640 1 -- 172.21.15.5:0/2247313547 learned_addr learned my addr 172.21.15.5:0/2247313547 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:53.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 10 monclient(hunting): get_auth_request con 0x7fdd140a5a50 auth_method 0 2024-08-18T21:09:53.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd12d9d640 10 monclient(hunting): get_auth_request con 0x7fdd140a1540 auth_method 0 2024-08-18T21:09:53.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd12d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd12d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd12d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd12d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd12d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd12d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd09d9b640 1 --2- 172.21.15.5:0/2247313547 >> v2:172.21.15.157:3300/0 conn(0x7fdd14137d40 0x7fdd14138120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd09d9b640 10 monclient(hunting): get_auth_request con 0x7fdd14137d40 auth_method 0 2024-08-18T21:09:53.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd09d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd09d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd09d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 10 monclient(hunting): handle_auth_done global_id 6133 payload 274 2024-08-18T21:09:53.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 1 -- 172.21.15.5:0/2247313547 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd140a1540 msgr2=0x7fdd140a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:53.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 1 --2- 172.21.15.5:0/2247313547 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd140a1540 0x7fdd140a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 1 -- 172.21.15.5:0/2247313547 >> v2:172.21.15.157:3300/0 conn(0x7fdd14137d40 msgr2=0x7fdd14138120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:53.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 1 --2- 172.21.15.5:0/2247313547 >> v2:172.21.15.157:3300/0 conn(0x7fdd14137d40 0x7fdd14138120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 10 monclient: _finish_hunting 0 2024-08-18T21:09:53.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 1 monclient: found mon.noname-c 2024-08-18T21:09:53.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:53.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:09:53.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd1259c640 1 -- 172.21.15.5:0/2247313547 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd140a2660 con 0x7fdd140a5a50 2024-08-18T21:09:53.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.229+0000 7fdd12d9d640 1 --2- 172.21.15.5:0/2247313547 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd140a1540 0x7fdd140a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:53.246 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:53.247 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30311]: starting. 2024-08-18T21:09:53.247 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30311]: listing objects. 2024-08-18T21:09:53.247 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30311]: listed object 0... 2024-08-18T21:09:53.247 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30311]: listed object 25... 2024-08-18T21:09:53.247 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30311]: saw 50 objects 2024-08-18T21:09:53.247 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30311]: shutting down. 2024-08-18T21:09:53.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd1259c640 1 -- 172.21.15.5:0/2247313547 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdd140a5a50 msgr2=0x7fdd14137800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:53.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd1259c640 1 --2- 172.21.15.5:0/2247313547 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdd140a5a50 0x7fdd14137800 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdd040097f0 tx=0x7fdd0401c360 comp rx=0 tx=0).ready entity=mon.4 client_cookie=cb260f3f32d10614 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd11d9b640 1 -- 172.21.15.5:0/2247313547 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd040b0070 con 0x7fdd140a5a50 2024-08-18T21:09:53.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd11d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd11d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:09:53.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd11d9b640 10 monclient: dump: 2024-08-18T21:09:53.249 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.249 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.249 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.249 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.249 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.249 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.249 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.249 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.250 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.250 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.250 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.250 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.250 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.250 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.250 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.250 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd11d9b640 10 monclient: _finish_auth 0 2024-08-18T21:09:53.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd11d9b640 10 monclient: _check_auth_tickets 2024-08-18T21:09:53.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd11d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:53.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 5 monclient: authenticate success, global_id 6133 2024-08-18T21:09:53.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd11d9b640 1 -- 172.21.15.5:0/2247313547 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd040aa810 con 0x7fdd140a5a50 2024-08-18T21:09:53.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:53.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd11d9b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:53.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:53.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 4 set_mon_vals no callback set 2024-08-18T21:09:53.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd11d9b640 1 -- 172.21.15.5:0/2247313547 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd040a4e60 con 0x7fdd140a5a50 2024-08-18T21:09:53.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd11d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd11d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:53.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd11d9b640 10 monclient: dump: 2024-08-18T21:09:53.251 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.251 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.251 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.251 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.251 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.251 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.252 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.252 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.252 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.252 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.252 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.252 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.252 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.252 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.252 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.252 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 10 monclient: shutdown 2024-08-18T21:09:53.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:53.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 -- 172.21.15.5:0/2247313547 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdd140a5a50 msgr2=0x7fdd14137800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 --2- 172.21.15.5:0/2247313547 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdd140a5a50 0x7fdd14137800 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdd040097f0 tx=0x7fdd0401c360 comp rx=0 tx=0).stop 2024-08-18T21:09:53.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 -- 172.21.15.5:0/2247313547 shutdown_connections 2024-08-18T21:09:53.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 --2- 172.21.15.5:0/2247313547 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd140a1540 0x7fdd140a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 --2- 172.21.15.5:0/2247313547 >> v2:172.21.15.157:3300/0 conn(0x7fdd14137d40 0x7fdd14138120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 --2- 172.21.15.5:0/2247313547 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdd140a5a50 0x7fdd14137800 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 -- 172.21.15.5:0/2247313547 >> 172.21.15.5:0/2247313547 conn(0x7fdd140688d0 msgr2=0x7fdd14068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:53.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 -- 172.21.15.5:0/2247313547 shutdown_connections 2024-08-18T21:09:53.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 -- 172.21.15.5:0/2247313547 wait complete. 2024-08-18T21:09:53.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 10 monclient: build_initial_monmap 2024-08-18T21:09:53.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 10 monclient: monmap: 2024-08-18T21:09:53.253 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:53.253 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:53.253 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:53.253 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:53.254 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:53.254 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.254 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:53.254 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:53.254 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:53.254 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:53.254 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:53.254 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:53.254 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:53.254 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:53.254 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:53.254 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 Processor -- start 2024-08-18T21:09:53.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 -- start start 2024-08-18T21:09:53.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 10 monclient: init 2024-08-18T21:09:53.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:53.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 10 monclient: _add_conns ranks=[6,0,3,7,4,8,5,2,1] 2024-08-18T21:09:53.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdd140a1540 0x7fdd141d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 10 monclient(hunting): picked mon.noname-d con 0x7fdd140a1540 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:53.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd140a5a50 0x7fdd141d1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 10 monclient(hunting): picked mon.noname-a con 0x7fdd140a5a50 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:09:53.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd14137d40 0x7fdd141d2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 10 monclient(hunting): picked mon.noname-g con 0x7fdd14137d40 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:09:53.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdd140a23f0 con 0x7fdd140a5a50 2024-08-18T21:09:53.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdd140a2270 con 0x7fdd14137d40 2024-08-18T21:09:53.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fdd14141480 con 0x7fdd140a1540 2024-08-18T21:09:53.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:53.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd18cba640 10 monclient(hunting): authenticate will time out at 1360.251792s 2024-08-18T21:09:53.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd1259c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdd140a1540 0x7fdd141d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd09d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd140a5a50 0x7fdd141d1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd1259c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdd140a1540 0x7fdd141d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:44236/0 (socket says 172.21.15.5:44236) 2024-08-18T21:09:53.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd1259c640 1 -- 172.21.15.5:0/2572996215 learned_addr learned my addr 172.21.15.5:0/2572996215 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:53.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd1259c640 10 monclient(hunting): get_auth_request con 0x7fdd140a1540 auth_method 0 2024-08-18T21:09:53.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd1259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd1259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd1259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd09d9b640 10 monclient(hunting): get_auth_request con 0x7fdd140a5a50 auth_method 0 2024-08-18T21:09:53.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd09d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd09d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.233+0000 7fdd09d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd1259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd1259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd1259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd09d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd09d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd09d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd12d9d640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd14137d40 0x7fdd141d2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd12d9d640 10 monclient(hunting): get_auth_request con 0x7fdd14137d40 auth_method 0 2024-08-18T21:09:53.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd12d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd12d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd12d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd1259c640 10 monclient(hunting): handle_auth_done global_id 84615 payload 824 2024-08-18T21:09:53.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd1259c640 1 -- 172.21.15.5:0/2572996215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd14137d40 msgr2=0x7fdd141d2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd1259c640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd14137d40 0x7fdd141d2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd1259c640 1 -- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd140a5a50 msgr2=0x7fdd141d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd1259c640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd140a5a50 0x7fdd141d1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd1259c640 10 monclient: _finish_hunting 0 2024-08-18T21:09:53.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd1259c640 1 monclient: found mon.noname-d 2024-08-18T21:09:53.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd1259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:53.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd1259c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:09:53.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd1259c640 1 -- 172.21.15.5:0/2572996215 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1406f250 con 0x7fdd140a1540 2024-08-18T21:09:53.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd09d9b640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd140a5a50 0x7fdd141d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:53.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd1259c640 1 -- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdd140a1540 msgr2=0x7fdd141d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:53.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd1259c640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdd140a1540 0x7fdd141d15a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009710 tx=0x7fdd04019100 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd0b7fe640 1 -- 172.21.15.5:0/2572996215 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd040b0040 con 0x7fdd140a1540 2024-08-18T21:09:53.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd0b7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:09:53.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd0b7fe640 10 monclient: dump: 2024-08-18T21:09:53.259 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.259 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.259 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.260 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.260 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.260 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.260 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.260 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.260 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.260 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.260 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.260 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.260 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.260 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.260 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.260 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd0b7fe640 10 monclient: _finish_auth 0 2024-08-18T21:09:53.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd0b7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:09:53.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd0b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:53.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd0b7fe640 1 -- 172.21.15.5:0/2572996215 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd040b9070 con 0x7fdd140a1540 2024-08-18T21:09:53.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd0b7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:53.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd0b7fe640 1 -- 172.21.15.5:0/2572996215 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd040044b0 con 0x7fdd140a1540 2024-08-18T21:09:53.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd0b7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:09:53.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd0b7fe640 10 monclient: dump: 2024-08-18T21:09:53.261 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.261 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.261 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.261 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.261 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.262 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd1159a640 4 set_mon_vals no callback set 2024-08-18T21:09:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd18cba640 5 monclient: authenticate success, global_id 84615 2024-08-18T21:09:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd18cba640 10 monclient: _renew_subs 2024-08-18T21:09:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd18cba640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:09:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd18cba640 1 -- 172.21.15.5:0/2572996215 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd1406f530 con 0x7fdd140a1540 2024-08-18T21:09:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd18cba640 10 monclient: _renew_subs 2024-08-18T21:09:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd18cba640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:09:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd18cba640 1 -- 172.21.15.5:0/2572996215 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd14073fd0 con 0x7fdd140a1540 2024-08-18T21:09:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd18cba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd18cba640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413bb80 0x7fdd1413bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd18cba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd18cba640 1 -- 172.21.15.5:0/2572996215 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fdd1406dd30 con 0x7fdd1413bb80 2024-08-18T21:09:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd0b7fe640 1 -- 172.21.15.5:0/2572996215 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fdd04004040 con 0x7fdd140a1540 2024-08-18T21:09:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd09d9b640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413bb80 0x7fdd1413bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd09d9b640 10 monclient: get_auth_request con 0x7fdd1413bb80 auth_method 0 2024-08-18T21:09:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd09d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd09d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.237+0000 7fdd09d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd09d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd09d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd09d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd0b7fe640 1 --2- 172.21.15.5:0/2572996215 >> v2:172.21.15.157:6812/631023601 conn(0x7fdcf403bdb0 0x7fdcf403e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd09d9b640 10 monclient(hunting): handle_auth_done global_id 55133 payload 824 2024-08-18T21:09:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd09d9b640 1 -- 172.21.15.5:0/2572996215 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd1413dda0 con 0x7fdd1413bb80 2024-08-18T21:09:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd0b7fe640 1 -- 172.21.15.5:0/2572996215 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(177..177 src has 22..177) ==== 3898+0+0 (secure 0 0 0) 0x7fdd040e7bd0 con 0x7fdd140a1540 2024-08-18T21:09:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd12d9d640 1 --2- 172.21.15.5:0/2572996215 >> v2:172.21.15.157:6812/631023601 conn(0x7fdcf403bdb0 0x7fdcf403e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd12d9d640 10 monclient: get_auth_request con 0x7fdcf403bdb0 auth_method 0 2024-08-18T21:09:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd09d9b640 1 -- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413bb80 msgr2=0x7fdd1413bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd09d9b640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413bb80 0x7fdd1413bf60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc010b60 tx=0x7fdcfc00e5a0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd0b7fe640 1 -- 172.21.15.5:0/2572996215 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdcfc018020 con 0x7fdd1413bb80 2024-08-18T21:09:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd0b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd0b7fe640 10 monclient: dump: 2024-08-18T21:09:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.267 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.267 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.267 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.267 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.267 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.267 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd0b7fe640 1 -- 172.21.15.5:0/2572996215 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdcfc010e60 con 0x7fdd1413bb80 2024-08-18T21:09:53.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd0b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:53.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd0b7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:53.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd0b7fe640 1 -- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413bb80 msgr2=0x7fdd1413bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd0b7fe640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413bb80 0x7fdd1413bf60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc010b60 tx=0x7fdcfc00e5a0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd0b7fe640 1 -- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413bb80 msgr2=0x7fdd1413bf60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd0b7fe640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413bb80 0x7fdd1413bf60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.241+0000 7fdd12d9d640 1 --2- 172.21.15.5:0/2572996215 >> v2:172.21.15.157:6812/631023601 conn(0x7fdcf403bdb0 0x7fdcf403e270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009ce0 tx=0x7fdd0c00b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd18cba640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd18cba640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413c4a0 0x7fdd14071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd18cba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd18cba640 1 -- 172.21.15.5:0/2572996215 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fdd14051140 con 0x7fdd1413c4a0 2024-08-18T21:09:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd09d9b640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413c4a0 0x7fdd14071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd09d9b640 10 monclient: get_auth_request con 0x7fdd1413c4a0 auth_method 0 2024-08-18T21:09:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd09d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd09d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd09d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd09d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd09d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd09d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd09d9b640 10 monclient(hunting): handle_auth_done global_id 55142 payload 824 2024-08-18T21:09:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd09d9b640 1 -- 172.21.15.5:0/2572996215 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdd14137800 con 0x7fdd1413c4a0 2024-08-18T21:09:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd09d9b640 1 -- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413c4a0 msgr2=0x7fdd14071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-18T21:09:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd09d9b640 1 -- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413c4a0 msgr2=0x7fdd14071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:09:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd09d9b640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413c4a0 0x7fdd14071e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc010b60 tx=0x7fdcfc0046d0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.249+0000 7fdd09d9b640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413c4a0 0x7fdd14071e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:09:53.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.453+0000 7fdd09d9b640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413c4a0 0x7fdd14071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.453+0000 7fdd09d9b640 10 monclient: get_auth_request con 0x7fdd1413c4a0 auth_method 0 2024-08-18T21:09:53.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.453+0000 7fdd09d9b640 10 monclient: get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.453+0000 7fdd09d9b640 10 monclient: _init_auth method 2 2024-08-18T21:09:53.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.453+0000 7fdd09d9b640 10 monclient: _init_auth already have auth, reseting 2024-08-18T21:09:53.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.453+0000 7fdd09d9b640 10 monclient: handle_auth_reply_more payload 9 2024-08-18T21:09:53.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.453+0000 7fdd09d9b640 10 monclient: handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.453+0000 7fdd09d9b640 10 monclient: handle_auth_reply_more responding with 132 bytes 2024-08-18T21:09:53.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.453+0000 7fdd09d9b640 10 monclient: handle_auth_done global_id 55142 payload 293 2024-08-18T21:09:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.453+0000 7fdd09d9b640 1 -- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413c4a0 msgr2=0x7fdd14071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.453+0000 7fdd09d9b640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413c4a0 0x7fdd14071e40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc006df0 tx=0x7fdcfc014000 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd0b7fe640 1 -- 172.21.15.5:0/2572996215 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdcfc018040 con 0x7fdd1413c4a0 2024-08-18T21:09:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd0b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd0b7fe640 10 monclient: dump: 2024-08-18T21:09:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.461 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.461 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.461 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.461 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.461 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.461 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd0b7fe640 1 -- 172.21.15.5:0/2572996215 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7fdcfc003d70 con 0x7fdd1413c4a0 2024-08-18T21:09:53.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd0b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:53.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd0b7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:53.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd0b7fe640 1 -- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413c4a0 msgr2=0x7fdd14071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd0b7fe640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413c4a0 0x7fdd14071e40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc006df0 tx=0x7fdcfc014000 comp rx=0 tx=0).stop 2024-08-18T21:09:53.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd0b7fe640 1 -- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413c4a0 msgr2=0x7fdd14071e40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:53.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd0b7fe640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd1413c4a0 0x7fdd14071e40 secure :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc006df0 tx=0x7fdcfc014000 comp rx=0 tx=0).stop 2024-08-18T21:09:53.463 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:53.463 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:53.463 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:53.463 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:53.463 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:53.463 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 249578, 2024-08-18T21:09:53.463 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:53.463 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:53.463 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:53.464 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:53.464 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:53.464 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:53.464 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:53.464 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:53.464 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:53.464 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:53.464 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.464 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:09:53.464 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:53.464 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:53.464 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:53.464 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:53.464 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:53.465 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:53.465 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:53.465 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:53.465 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:53.465 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:53.465 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:53.465 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:53.465 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:53.465 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:53.465 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.465 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:53.465 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:53.465 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:53.466 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:53.466 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:53.466 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:53.466 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:53.466 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:53.466 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:53.466 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:53.466 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:53.466 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:53.466 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:53.466 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.466 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:53.467 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:53.467 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:53.467 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:53.467 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:53.467 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:53.467 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:53.467 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:53.469 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:53.469 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:53.469 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:53.469 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:53.469 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:53.469 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:53.469 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:53.469 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:53.470 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:53.470 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:53.470 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:53.470 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:53.470 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:53.470 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:53.470 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:53.470 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:53.470 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:53.470 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:53.470 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:53.470 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:53.471 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.471 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:53.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.471 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:53.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.471 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:53.471 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:53.471 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.471 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.471 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.471 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:53.471 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.472 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.472 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.472 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:53.472 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.472 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.472 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.472 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:53.472 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.485 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.485 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:53.485 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:53.485 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.485 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.486 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.486 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:53.486 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:53.486 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.486 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.486 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.486 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:53.486 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:53.487 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.487 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.487 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:53.487 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:53.487 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.487 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.487 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.488 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:53.488 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:53.488 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.488 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:53.488 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.488 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:53.488 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.488 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.489 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.489 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:53.489 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:53.489 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.489 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.489 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.489 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.489 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.489 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:53.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:53.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.490 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:53.490 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:53.490 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:53.490 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.490 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.490 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:09:53.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.490 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:53.490 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:53.490 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:09:53.490 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.490 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.490 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:53.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.491 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:53.491 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:53.491 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:53.491 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.491 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.491 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:53.491 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd18cba640 1 -- 172.21.15.5:0/2572996215 >> v2:172.21.15.157:6812/631023601 conn(0x7fdcf403bdb0 msgr2=0x7fdcf403e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd18cba640 1 --2- 172.21.15.5:0/2572996215 >> v2:172.21.15.157:6812/631023601 conn(0x7fdcf403bdb0 0x7fdcf403e270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009ce0 tx=0x7fdd0c00b040 comp rx=0 tx=0).stop 2024-08-18T21:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd18cba640 10 monclient: shutdown 2024-08-18T21:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd18cba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd12d9d640 1 -- 172.21.15.5:0/2572996215 reap_dead start 2024-08-18T21:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd18cba640 1 -- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdd140a1540 msgr2=0x7fdd141d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd18cba640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdd140a1540 0x7fdd141d15a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009710 tx=0x7fdd04019100 comp rx=0 tx=0).stop 2024-08-18T21:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd18cba640 1 -- 172.21.15.5:0/2572996215 shutdown_connections 2024-08-18T21:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd18cba640 1 --2- 172.21.15.5:0/2572996215 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdd140a1540 0x7fdd141d15a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd18cba640 1 -- 172.21.15.5:0/2572996215 >> 172.21.15.5:0/2572996215 conn(0x7fdd140688d0 msgr2=0x7fdd140714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd18cba640 1 -- 172.21.15.5:0/2572996215 shutdown_connections 2024-08-18T21:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.457+0000 7fdd18cba640 1 -- 172.21.15.5:0/2572996215 wait complete. 2024-08-18T21:09:53.494 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:53.494 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:09:53.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:09:53.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 10 monclient: get_monmap_and_config 2024-08-18T21:09:53.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 10 monclient: build_initial_monmap 2024-08-18T21:09:53.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 10 monclient: monmap: 2024-08-18T21:09:53.627 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:53.627 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.627 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:53.628649+0000 2024-08-18T21:09:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:53.628649+0000 2024-08-18T21:09:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:53.629 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 1 Processor -- start 2024-08-18T21:09:53.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 1 -- start start 2024-08-18T21:09:53.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 10 monclient: init 2024-08-18T21:09:53.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:53.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 10 monclient: _add_conns ranks=[10,5,9,0,7,4,8,2,3,1,6] 2024-08-18T21:09:53.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4e7c0a6bd0 0x7f4e7c0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 10 monclient(hunting): picked mon.noname-f con 0x7f4e7c0a6bd0 addr v2:172.21.15.157:3300/0 2024-08-18T21:09:53.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4e7c09f080 0x7f4e7c0a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 10 monclient(hunting): picked mon.noname-h con 0x7f4e7c09f080 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e7c139990 0x7f4e7c139e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 10 monclient(hunting): picked mon.noname-a con 0x7f4e7c139990 addr v2:172.21.15.5:3300/0 2024-08-18T21:09:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4e7c09e4c0 con 0x7f4e7c139990 2024-08-18T21:09:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4e7c06f930 con 0x7f4e7c0a6bd0 2024-08-18T21:09:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f4e7c0a7a30 con 0x7f4e7c09f080 2024-08-18T21:09:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e81dd9640 10 monclient(hunting): authenticate will time out at 1360.641842s 2024-08-18T21:09:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e7c139990 0x7f4e7c139e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e7c139990 0x7f4e7c139e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33746/0 (socket says 172.21.15.5:33746) 2024-08-18T21:09:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 1 -- 172.21.15.5:0/3992611529 learned_addr learned my addr 172.21.15.5:0/3992611529 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 10 monclient(hunting): get_auth_request con 0x7f4e7c139990 auth_method 0 2024-08-18T21:09:53.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7b7fe640 1 --2- 172.21.15.5:0/3992611529 >> v2:172.21.15.157:3300/0 conn(0x7f4e7c0a6bd0 0x7f4e7c0a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7b7fe640 10 monclient(hunting): get_auth_request con 0x7f4e7c0a6bd0 auth_method 0 2024-08-18T21:09:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7affd640 1 --2- 172.21.15.5:0/3992611529 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4e7c09f080 0x7f4e7c0a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7affd640 10 monclient(hunting): get_auth_request con 0x7f4e7c09f080 auth_method 0 2024-08-18T21:09:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 10 monclient(hunting): handle_auth_done global_id 84420 payload 274 2024-08-18T21:09:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 1 -- 172.21.15.5:0/3992611529 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4e7c09f080 msgr2=0x7f4e7c0a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 1 --2- 172.21.15.5:0/3992611529 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4e7c09f080 0x7f4e7c0a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 1 -- 172.21.15.5:0/3992611529 >> v2:172.21.15.157:3300/0 conn(0x7f4e7c0a6bd0 msgr2=0x7f4e7c0a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 1 --2- 172.21.15.5:0/3992611529 >> v2:172.21.15.157:3300/0 conn(0x7f4e7c0a6bd0 0x7f4e7c0a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 1 monclient: found mon.noname-a 2024-08-18T21:09:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:09:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7bfff640 1 -- 172.21.15.5:0/3992611529 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c0a7fb0 con 0x7f4e7c139990 2024-08-18T21:09:53.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.625+0000 7f4e7b7fe640 1 --2- 172.21.15.5:0/3992611529 >> v2:172.21.15.157:3300/0 conn(0x7f4e7c0a6bd0 0x7f4e7c0a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:09:53.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e7bfff640 1 -- 172.21.15.5:0/3992611529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e7c139990 msgr2=0x7f4e7c139e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:53.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e7bfff640 1 --2- 172.21.15.5:0/3992611529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e7c139990 0x7f4e7c139e40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c09db50 tx=0x7f4e6c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82b44fac0d1e031 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e7a7fc640 1 -- 172.21.15.5:0/3992611529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e6c0b0070 con 0x7f4e7c139990 2024-08-18T21:09:53.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e7a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:09:53.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e7a7fc640 10 monclient: dump: 2024-08-18T21:09:53.642 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.642 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.644 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e7a7fc640 10 monclient: _finish_auth 0 2024-08-18T21:09:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e7a7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:09:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e7a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e7a7fc640 1 -- 172.21.15.5:0/3992611529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6c0aa810 con 0x7f4e7c139990 2024-08-18T21:09:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e7a7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e7a7fc640 1 -- 172.21.15.5:0/3992611529 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e6c0a9300 con 0x7f4e7c139990 2024-08-18T21:09:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e7a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:09:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e7a7fc640 10 monclient: dump: 2024-08-18T21:09:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.646 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.646 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.646 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e81dd9640 5 monclient: authenticate success, global_id 84420 2024-08-18T21:09:53.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e81dd9640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:53.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e81dd9640 4 set_mon_vals no callback set 2024-08-18T21:09:53.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e81dd9640 10 monclient: shutdown 2024-08-18T21:09:53.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e81dd9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:53.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e81dd9640 1 -- 172.21.15.5:0/3992611529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e7c139990 msgr2=0x7f4e7c139e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e81dd9640 1 --2- 172.21.15.5:0/3992611529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e7c139990 0x7f4e7c139e40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c09db50 tx=0x7f4e6c01c3e0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e81dd9640 1 -- 172.21.15.5:0/3992611529 shutdown_connections 2024-08-18T21:09:53.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e81dd9640 1 --2- 172.21.15.5:0/3992611529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e7c139990 0x7f4e7c139e40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e81dd9640 1 --2- 172.21.15.5:0/3992611529 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4e7c09f080 0x7f4e7c0a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e81dd9640 1 --2- 172.21.15.5:0/3992611529 >> v2:172.21.15.157:3300/0 conn(0x7f4e7c0a6bd0 0x7f4e7c0a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e81dd9640 1 -- 172.21.15.5:0/3992611529 >> 172.21.15.5:0/3992611529 conn(0x7f4e7c068700 msgr2=0x7f4e7c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:53.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e81dd9640 1 -- 172.21.15.5:0/3992611529 shutdown_connections 2024-08-18T21:09:53.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.629+0000 7f4e81dd9640 1 -- 172.21.15.5:0/3992611529 wait complete. 2024-08-18T21:09:53.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 10 monclient: build_initial_monmap 2024-08-18T21:09:53.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 10 monclient: monmap: 2024-08-18T21:09:53.647 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:53.647 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:53.647 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:53.647 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:53.648 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 1 Processor -- start 2024-08-18T21:09:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 1 -- start start 2024-08-18T21:09:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 10 monclient: init 2024-08-18T21:09:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 10 monclient: _add_conns ranks=[3,4,8,2,7,6,1,0,5] 2024-08-18T21:09:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e7c09f080 0x7f4e7c1d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 10 monclient(hunting): picked mon.noname-g con 0x7f4e7c09f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:09:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e7c0a6bd0 0x7f4e7c1389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 10 monclient(hunting): picked mon.noname-c con 0x7f4e7c0a6bd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4e7c139990 0x7f4e7c138f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 10 monclient(hunting): picked mon.noname-e con 0x7f4e7c139990 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7c0a89f0 con 0x7f4e7c09f080 2024-08-18T21:09:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f4e7c0a7ce0 con 0x7f4e7c0a6bd0 2024-08-18T21:09:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f4e7c143610 con 0x7f4e7c139990 2024-08-18T21:09:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e81dd9640 10 monclient(hunting): authenticate will time out at 1360.649266s 2024-08-18T21:09:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4e7c139990 0x7f4e7c138f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4e7c139990 0x7f4e7c138f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:47322/0 (socket says 172.21.15.5:47322) 2024-08-18T21:09:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7affd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e7c0a6bd0 0x7f4e7c1389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 1 -- 172.21.15.5:0/3752143485 learned_addr learned my addr 172.21.15.5:0/3752143485 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 10 monclient(hunting): get_auth_request con 0x7f4e7c139990 auth_method 0 2024-08-18T21:09:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7affd640 10 monclient(hunting): get_auth_request con 0x7f4e7c0a6bd0 auth_method 0 2024-08-18T21:09:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 10 monclient(hunting): handle_auth_done global_id 55151 payload 824 2024-08-18T21:09:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 1 -- 172.21.15.5:0/3752143485 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e7c0a6bd0 msgr2=0x7f4e7c1389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 1 --2- 172.21.15.5:0/3752143485 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e7c0a6bd0 0x7f4e7c1389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 1 -- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e7c09f080 msgr2=0x7f4e7c1d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7b7fe640 1 --2- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e7c09f080 0x7f4e7c1d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 1 --2- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e7c09f080 0x7f4e7c1d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 1 monclient: found mon.noname-e 2024-08-18T21:09:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:09:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7bfff640 1 -- 172.21.15.5:0/3752143485 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c124380 con 0x7f4e7c139990 2024-08-18T21:09:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7b7fe640 10 monclient: get_auth_request con 0x7f4e7c09f080 auth_method 0 2024-08-18T21:09:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.633+0000 7f4e7b7fe640 1 --2- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e7c09f080 0x7f4e7c1d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:09:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e7bfff640 1 -- 172.21.15.5:0/3752143485 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4e7c139990 msgr2=0x7f4e7c138f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e7bfff640 1 --2- 172.21.15.5:0/3752143485 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4e7c139990 0x7f4e7c138f00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c01aa90 tx=0x7f4e6c019180 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e63fff640 1 -- 172.21.15.5:0/3752143485 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e6c0b9070 con 0x7f4e7c139990 2024-08-18T21:09:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e63fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:09:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e63fff640 10 monclient: dump: 2024-08-18T21:09:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.654 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e63fff640 10 monclient: _finish_auth 0 2024-08-18T21:09:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e63fff640 10 monclient: _check_auth_tickets 2024-08-18T21:09:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:53.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e63fff640 1 -- 172.21.15.5:0/3752143485 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6c0044b0 con 0x7f4e7c139990 2024-08-18T21:09:53.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e81dd9640 5 monclient: authenticate success, global_id 55151 2024-08-18T21:09:53.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e81dd9640 10 monclient: _renew_subs 2024-08-18T21:09:53.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e81dd9640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:53.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e81dd9640 1 -- 172.21.15.5:0/3752143485 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7c122d00 con 0x7f4e7c139990 2024-08-18T21:09:53.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e63fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:53.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e63fff640 1 -- 172.21.15.5:0/3752143485 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e6c0b0040 con 0x7f4e7c139990 2024-08-18T21:09:53.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e63fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e63fff640 10 monclient: dump: 2024-08-18T21:09:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.657 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e81dd9640 10 monclient: _renew_subs 2024-08-18T21:09:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e797fa640 4 set_mon_vals no callback set 2024-08-18T21:09:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e81dd9640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e81dd9640 1 -- 172.21.15.5:0/3752143485 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e7c0a6360 con 0x7f4e7c139990 2024-08-18T21:09:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e81dd9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e81dd9640 1 --2- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e7c13eab0 0x7f4e7c13ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e81dd9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e81dd9640 1 -- 172.21.15.5:0/3752143485 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c0a7890 con 0x7f4e7c13eab0 2024-08-18T21:09:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e63fff640 1 -- 172.21.15.5:0/3752143485 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f4e6c004040 con 0x7f4e7c139990 2024-08-18T21:09:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e7b7fe640 1 --2- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e7c13eab0 0x7f4e7c13ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e63fff640 1 --2- 172.21.15.5:0/3752143485 >> v2:172.21.15.157:6812/631023601 conn(0x7f4e6803bdb0 0x7f4e6803e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e63fff640 1 -- 172.21.15.5:0/3752143485 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(177..177 src has 22..177) ==== 3898+0+0 (secure 0 0 0) 0x7f4e6c0e75e0 con 0x7f4e7c139990 2024-08-18T21:09:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e7b7fe640 10 monclient: get_auth_request con 0x7f4e7c13eab0 auth_method 0 2024-08-18T21:09:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e7b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e7b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e7b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e7b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e7b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e7affd640 1 --2- 172.21.15.5:0/3752143485 >> v2:172.21.15.157:6812/631023601 conn(0x7f4e6803bdb0 0x7f4e6803e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e7affd640 10 monclient: get_auth_request con 0x7f4e6803bdb0 auth_method 0 2024-08-18T21:09:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e7b7fe640 10 monclient(hunting): handle_auth_done global_id 6004 payload 824 2024-08-18T21:09:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.637+0000 7f4e7b7fe640 1 -- 172.21.15.5:0/3752143485 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e7c139780 con 0x7f4e7c13eab0 2024-08-18T21:09:53.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.641+0000 7f4e7b7fe640 1 -- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e7c13eab0 msgr2=0x7f4e7c13ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:53.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.641+0000 7f4e7b7fe640 1 --2- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e7c13eab0 0x7f4e7c13ee90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4e74007e20 tx=0x7f4e7400e510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.641+0000 7f4e7affd640 1 --2- 172.21.15.5:0/3752143485 >> v2:172.21.15.157:6812/631023601 conn(0x7f4e6803bdb0 0x7f4e6803e270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4e70007a60 tx=0x7f4e70008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.641+0000 7f4e63fff640 1 -- 172.21.15.5:0/3752143485 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e74013a40 con 0x7f4e7c13eab0 2024-08-18T21:09:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.641+0000 7f4e63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.641+0000 7f4e63fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:09:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.641+0000 7f4e63fff640 10 monclient: dump: 2024-08-18T21:09:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.663 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.663 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.663 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.663 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.663 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.663 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.663 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.663 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.663 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.641+0000 7f4e63fff640 1 -- 172.21.15.5:0/3752143485 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4e7401a070 con 0x7f4e7c13eab0 2024-08-18T21:09:53.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.641+0000 7f4e63fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:53.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.641+0000 7f4e63fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:53.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.641+0000 7f4e63fff640 1 -- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e7c13eab0 msgr2=0x7f4e7c13ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.641+0000 7f4e63fff640 1 --2- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e7c13eab0 0x7f4e7c13ee90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4e74007e20 tx=0x7f4e7400e510 comp rx=0 tx=0).stop 2024-08-18T21:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.641+0000 7f4e63fff640 1 -- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e7c13eab0 msgr2=0x7f4e7c13ee90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.641+0000 7f4e63fff640 1 --2- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e7c13eab0 0x7f4e7c13ee90 secure :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4e74007e20 tx=0x7f4e7400e510 comp rx=0 tx=0).stop 2024-08-18T21:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.645+0000 7f4e81dd9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.645+0000 7f4e81dd9640 1 --2- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e7c13f3d0 0x7f4e7c13abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.645+0000 7f4e81dd9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.645+0000 7f4e81dd9640 1 -- 172.21.15.5:0/3752143485 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c051140 con 0x7f4e7c13f3d0 2024-08-18T21:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.649+0000 7f4e7b7fe640 1 --2- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e7c13f3d0 0x7f4e7c13abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.649+0000 7f4e7b7fe640 10 monclient: get_auth_request con 0x7f4e7c13f3d0 auth_method 0 2024-08-18T21:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.649+0000 7f4e7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.649+0000 7f4e7b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.649+0000 7f4e7b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.649+0000 7f4e7b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.649+0000 7f4e7b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.649+0000 7f4e7b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.649+0000 7f4e7b7fe640 10 monclient(hunting): handle_auth_done global_id 6013 payload 824 2024-08-18T21:09:53.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.649+0000 7f4e7b7fe640 1 -- 172.21.15.5:0/3752143485 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4e7c075a80 con 0x7f4e7c13f3d0 2024-08-18T21:09:53.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.649+0000 7f4e7b7fe640 1 -- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e7c13f3d0 msgr2=0x7f4e7c13abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:53.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.649+0000 7f4e7b7fe640 1 --2- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e7c13f3d0 0x7f4e7c13abb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4e74019000 tx=0x7f4e74004a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.649+0000 7f4e63fff640 1 -- 172.21.15.5:0/3752143485 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e740044b0 con 0x7f4e7c13f3d0 2024-08-18T21:09:53.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.649+0000 7f4e63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.649+0000 7f4e63fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:09:53.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.649+0000 7f4e63fff640 10 monclient: dump: 2024-08-18T21:09:53.666 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.666 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.666 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.666 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.666 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.666 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.666 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.666 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.666 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.666 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.666 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.666 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.667 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.667 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.667 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.667 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e63fff640 1 -- 172.21.15.5:0/3752143485 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f4e740135d0 con 0x7f4e7c13f3d0 2024-08-18T21:09:53.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e63fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:53.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e63fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:53.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e63fff640 1 -- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e7c13f3d0 msgr2=0x7f4e7c13abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e63fff640 1 --2- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e7c13f3d0 0x7f4e7c13abb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4e74019000 tx=0x7f4e74004a50 comp rx=0 tx=0).stop 2024-08-18T21:09:53.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e63fff640 1 -- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e7c13f3d0 msgr2=0x7f4e7c13abb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:53.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e63fff640 1 --2- 172.21.15.5:0/3752143485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e7c13f3d0 0x7f4e7c13abb0 secure :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4e74019000 tx=0x7f4e74004a50 comp rx=0 tx=0).stop 2024-08-18T21:09:53.668 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:53.668 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:53.668 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:53.668 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:53.668 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:53.668 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 402734, 2024-08-18T21:09:53.668 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:53.668 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:53.668 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:53.668 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:53.668 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:53.669 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:53.669 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:53.669 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:53.669 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:53.669 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:53.669 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.669 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:09:53.669 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:53.669 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:53.669 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:53.669 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:53.669 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:53.669 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:53.670 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:53.670 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:53.670 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:53.670 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:53.670 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:53.670 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:53.670 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:53.670 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:53.670 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.670 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:53.670 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:53.670 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:53.670 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:53.670 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:53.671 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:53.671 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:53.671 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:53.671 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:53.671 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:53.671 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:53.671 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:53.671 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:53.671 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.671 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:53.671 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:53.671 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:53.671 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:53.672 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:53.672 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:53.672 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:53.672 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:53.672 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:53.672 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:53.672 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:53.672 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:53.672 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:53.672 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:53.672 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:53.672 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:53.672 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:53.672 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:53.673 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:53.673 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:53.673 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:53.673 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:53.673 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:53.673 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:53.673 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:53.673 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:53.673 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:53.673 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:53.673 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.673 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:53.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.674 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:53.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.674 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:53.674 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:53.674 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.674 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.674 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.674 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:53.674 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.674 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.674 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:53.675 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.675 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.675 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.675 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:53.675 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:53.675 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.675 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.675 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.676 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:53.676 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:53.676 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.676 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.676 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.676 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:53.676 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.676 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.677 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:53.677 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.677 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.677 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.677 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:53.677 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:53.677 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.677 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.677 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.678 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:53.678 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:53.678 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.678 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.678 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.678 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:53.678 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.678 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.679 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:53.679 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.679 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.679 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.679 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:53.679 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:53.679 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.679 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.679 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.679 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:53.679 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:53.680 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.680 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.680 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:53.680 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.680 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:53.680 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.680 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.680 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.681 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:53.681 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:53.681 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.681 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.681 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.681 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:53.681 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:53.681 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.681 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.681 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.681 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:53.682 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.683 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.683 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:53.683 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.683 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.683 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.683 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:53.683 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:53.683 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.684 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.684 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.684 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:53.684 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:53.684 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:53.684 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.685 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.685 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:53.685 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.685 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.685 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.685 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:53.685 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:53.685 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.685 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.685 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.686 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:53.686 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:53.686 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:53.686 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:53.686 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.686 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.687 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:53.687 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:53.687 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.687 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.687 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.687 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:53.687 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:53.687 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.688 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:53.688 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.688 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:53.688 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.688 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.688 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:53.688 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:53.689 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.689 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.689 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.689 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:53.689 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:53.689 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:53.689 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.690 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:53.690 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.690 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.690 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:53.690 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:53.690 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.690 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.690 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.690 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.691 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.691 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:53.691 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:53.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.691 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:53.691 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:53.691 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:53.691 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.691 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.691 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:09:53.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.691 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:53.691 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:53.692 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:53.692 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.692 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.692 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:53.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.692 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:53.692 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:53.692 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:09:53.692 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.692 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.692 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:53.692 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:53.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e81dd9640 1 -- 172.21.15.5:0/3752143485 >> v2:172.21.15.157:6812/631023601 conn(0x7f4e6803bdb0 msgr2=0x7f4e6803e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e81dd9640 1 --2- 172.21.15.5:0/3752143485 >> v2:172.21.15.157:6812/631023601 conn(0x7f4e6803bdb0 0x7f4e6803e270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4e70007a60 tx=0x7f4e70008040 comp rx=0 tx=0).stop 2024-08-18T21:09:53.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e81dd9640 10 monclient: shutdown 2024-08-18T21:09:53.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e81dd9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:53.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e81dd9640 1 -- 172.21.15.5:0/3752143485 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4e7c139990 msgr2=0x7f4e7c138f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e81dd9640 1 --2- 172.21.15.5:0/3752143485 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4e7c139990 0x7f4e7c138f00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c01aa90 tx=0x7f4e6c019180 comp rx=0 tx=0).stop 2024-08-18T21:09:53.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e7bfff640 1 -- 172.21.15.5:0/3752143485 reap_dead start 2024-08-18T21:09:53.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e7bfff640 1 -- 172.21.15.5:0/3752143485 reap_dead start 2024-08-18T21:09:53.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e81dd9640 1 -- 172.21.15.5:0/3752143485 shutdown_connections 2024-08-18T21:09:53.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e81dd9640 1 -- 172.21.15.5:0/3752143485 >> 172.21.15.5:0/3752143485 conn(0x7f4e7c068700 msgr2=0x7f4e7c0aa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:53.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e81dd9640 1 -- 172.21.15.5:0/3752143485 shutdown_connections 2024-08-18T21:09:53.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.653+0000 7f4e81dd9640 1 -- 172.21.15.5:0/3752143485 wait complete. 2024-08-18T21:09:53.695 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:53.695 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:09:53.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:09:53.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.809+0000 7fd85ea68640 10 monclient: get_monmap_and_config 2024-08-18T21:09:53.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.809+0000 7fd85ea68640 10 monclient: build_initial_monmap 2024-08-18T21:09:53.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.809+0000 7fd85ea68640 10 monclient: monmap: 2024-08-18T21:09:53.815 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:53.815 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.815 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:53.816227+0000 2024-08-18T21:09:53.815 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:53.816227+0000 2024-08-18T21:09:53.815 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:53.815 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.815 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:53.815 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:53.816 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 1 Processor -- start 2024-08-18T21:09:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 1 -- start start 2024-08-18T21:09:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 10 monclient: init 2024-08-18T21:09:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 10 monclient: _add_conns ranks=[2,5,4,0,8,7,1,9,10,6,3] 2024-08-18T21:09:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd858139d00 0x7fd85813a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 10 monclient(hunting): picked mon.noname-b con 0x7fd858139d00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8580a4b40 0x7fd85806c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 10 monclient(hunting): picked mon.noname-h con 0x7fd8580a4b40 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd8580a4f80 0x7fd85806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 10 monclient(hunting): picked mon.noname-c con 0x7fd8580a4f80 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fd85809e7f0 con 0x7fd858139d00 2024-08-18T21:09:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fd85809e230 con 0x7fd8580a4f80 2024-08-18T21:09:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fd85809e510 con 0x7fd8580a4b40 2024-08-18T21:09:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85ea68640 10 monclient(hunting): authenticate will time out at 1360.829530s 2024-08-18T21:09:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85c804640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd858139d00 0x7fd85813a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd8580a4f80 0x7fd85806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85c804640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd858139d00 0x7fd85813a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:60486/0 (socket says 172.21.15.5:60486) 2024-08-18T21:09:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85c804640 1 -- 172.21.15.5:0/191359172 learned_addr learned my addr 172.21.15.5:0/191359172 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85c804640 10 monclient(hunting): get_auth_request con 0x7fd858139d00 auth_method 0 2024-08-18T21:09:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd8580a4f80 0x7fd85806ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:50914/0 (socket says 172.21.15.5:50914) 2024-08-18T21:09:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85c804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85c804640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85c804640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 10 monclient(hunting): get_auth_request con 0x7fd8580a4f80 auth_method 0 2024-08-18T21:09:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85c804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85c804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85c804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 10 monclient(hunting): handle_auth_done global_id 6151 payload 274 2024-08-18T21:09:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd857fff640 1 --2- 172.21.15.5:0/191359172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8580a4b40 0x7fd85806c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 1 -- 172.21.15.5:0/191359172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8580a4b40 msgr2=0x7fd85806c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 1 --2- 172.21.15.5:0/191359172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8580a4b40 0x7fd85806c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 1 -- 172.21.15.5:0/191359172 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd858139d00 msgr2=0x7fd85813a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:53.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 1 --2- 172.21.15.5:0/191359172 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd858139d00 0x7fd85813a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 10 monclient: _finish_hunting 0 2024-08-18T21:09:53.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 1 monclient: found mon.noname-c 2024-08-18T21:09:53.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:53.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:09:53.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85d005640 1 -- 172.21.15.5:0/191359172 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85809f000 con 0x7fd8580a4f80 2024-08-18T21:09:53.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd85c804640 1 --2- 172.21.15.5:0/191359172 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd858139d00 0x7fd85813a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:53.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd857fff640 10 monclient: get_auth_request con 0x7fd8580a4b40 auth_method 0 2024-08-18T21:09:53.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.813+0000 7fd857fff640 1 --2- 172.21.15.5:0/191359172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8580a4b40 0x7fd85806c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:09:53.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85d005640 1 -- 172.21.15.5:0/191359172 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd8580a4f80 msgr2=0x7fd85806ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85d005640 1 --2- 172.21.15.5:0/191359172 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd8580a4f80 0x7fd85806ce90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd8500097f0 tx=0x7fd85001c3a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=55ec169fa5d38756 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd8577fe640 1 -- 172.21.15.5:0/191359172 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd8500b0070 con 0x7fd8580a4f80 2024-08-18T21:09:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd8577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd8577fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:09:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd8577fe640 10 monclient: dump: 2024-08-18T21:09:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.829 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd8577fe640 10 monclient: _finish_auth 0 2024-08-18T21:09:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd8577fe640 10 monclient: _check_auth_tickets 2024-08-18T21:09:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd8577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd8577fe640 1 -- 172.21.15.5:0/191359172 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8500aa810 con 0x7fd8580a4f80 2024-08-18T21:09:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd8577fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd8577fe640 1 -- 172.21.15.5:0/191359172 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd8500aae30 con 0x7fd8580a4f80 2024-08-18T21:09:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd8577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd8577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd8577fe640 10 monclient: dump: 2024-08-18T21:09:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.831 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.831 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.831 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.831 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.831 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.831 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.831 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85ea68640 5 monclient: authenticate success, global_id 6151 2024-08-18T21:09:53.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85ea68640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:53.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85ea68640 4 set_mon_vals no callback set 2024-08-18T21:09:53.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85ea68640 10 monclient: shutdown 2024-08-18T21:09:53.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85ea68640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85ea68640 1 -- 172.21.15.5:0/191359172 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd8580a4f80 msgr2=0x7fd85806ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85ea68640 1 --2- 172.21.15.5:0/191359172 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd8580a4f80 0x7fd85806ce90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd8500097f0 tx=0x7fd85001c3a0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85ea68640 1 -- 172.21.15.5:0/191359172 shutdown_connections 2024-08-18T21:09:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85ea68640 1 --2- 172.21.15.5:0/191359172 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd8580a4f80 0x7fd85806ce90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85ea68640 1 --2- 172.21.15.5:0/191359172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8580a4b40 0x7fd85806c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85ea68640 1 --2- 172.21.15.5:0/191359172 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd858139d00 0x7fd85813a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85ea68640 1 -- 172.21.15.5:0/191359172 >> 172.21.15.5:0/191359172 conn(0x7fd8580688d0 msgr2=0x7fd858068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85ea68640 1 -- 172.21.15.5:0/191359172 shutdown_connections 2024-08-18T21:09:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85ea68640 1 -- 172.21.15.5:0/191359172 wait complete. 2024-08-18T21:09:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.817+0000 7fd85ea68640 10 monclient: build_initial_monmap 2024-08-18T21:09:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 10 monclient: monmap: 2024-08-18T21:09:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:53.833 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:53.833 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:53.833 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.833 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:53.833 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:53.833 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:53.833 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:53.833 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:53.833 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:53.833 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:53.833 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:53.833 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:53.833 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 1 Processor -- start 2024-08-18T21:09:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 1 -- start start 2024-08-18T21:09:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 10 monclient: init 2024-08-18T21:09:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 10 monclient: _add_conns ranks=[1,5,3,6,4,2,8,7,0] 2024-08-18T21:09:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8580a4b40 0x7fd85813f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 10 monclient(hunting): picked mon.noname-f con 0x7fd8580a4b40 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:09:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8580a4f80 0x7fd8581d1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 10 monclient(hunting): picked mon.noname-h con 0x7fd8580a4f80 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd858139d00 0x7fd8581d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 10 monclient(hunting): picked mon.noname-g con 0x7fd858139d00 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:09:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd858143580 con 0x7fd8580a4b40 2024-08-18T21:09:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd85806d7e0 con 0x7fd858139d00 2024-08-18T21:09:53.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fd858143700 con 0x7fd8580a4f80 2024-08-18T21:09:53.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:53.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85ea68640 10 monclient(hunting): authenticate will time out at 1360.836943s 2024-08-18T21:09:53.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85c804640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8580a4b40 0x7fd85813f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8580a4f80 0x7fd8581d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8580a4f80 0x7fd8581d1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:39420/0 (socket says 172.21.15.5:39420) 2024-08-18T21:09:53.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85d005640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd858139d00 0x7fd8581d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85c804640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8580a4b40 0x7fd85813f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:60132/0 (socket says 172.21.15.5:60132) 2024-08-18T21:09:53.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 1 -- 172.21.15.5:0/2653345490 learned_addr learned my addr 172.21.15.5:0/2653345490 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:53.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 10 monclient(hunting): get_auth_request con 0x7fd8580a4f80 auth_method 0 2024-08-18T21:09:53.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85c804640 10 monclient(hunting): get_auth_request con 0x7fd8580a4b40 auth_method 0 2024-08-18T21:09:53.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85c804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85c804640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85c804640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85d005640 10 monclient(hunting): get_auth_request con 0x7fd858139d00 auth_method 0 2024-08-18T21:09:53.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85d005640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85d005640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85d005640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85c804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85c804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85c804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85d005640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85d005640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd85d005640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 10 monclient(hunting): handle_auth_done global_id 94154 payload 824 2024-08-18T21:09:53.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 1 -- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd858139d00 msgr2=0x7fd8581d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 1 --2- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd858139d00 0x7fd8581d1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 1 -- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8580a4b40 msgr2=0x7fd85813f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 1 --2- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8580a4b40 0x7fd85813f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:53.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 1 monclient: found mon.noname-h 2024-08-18T21:09:53.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:53.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:09:53.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.821+0000 7fd857fff640 1 -- 172.21.15.5:0/2653345490 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85813efe0 con 0x7fd8580a4f80 2024-08-18T21:09:53.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd857fff640 1 -- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8580a4f80 msgr2=0x7fd8581d1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd857fff640 1 --2- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8580a4f80 0x7fd8581d1620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c7f0 tx=0x7fd84c00ccb0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd8557fa640 1 -- 172.21.15.5:0/2653345490 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd84c004030 con 0x7fd8580a4f80 2024-08-18T21:09:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd8557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd8557fa640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:09:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd8557fa640 10 monclient: dump: 2024-08-18T21:09:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.840 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.840 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.840 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.840 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.840 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.840 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.840 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd8557fa640 10 monclient: _finish_auth 0 2024-08-18T21:09:53.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd8557fa640 10 monclient: _check_auth_tickets 2024-08-18T21:09:53.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd8557fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:53.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd8557fa640 1 -- 172.21.15.5:0/2653345490 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd84c004230 con 0x7fd8580a4f80 2024-08-18T21:09:53.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd8557fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:53.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd8557fa640 1 -- 172.21.15.5:0/2653345490 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd84c0043e0 con 0x7fd8580a4f80 2024-08-18T21:09:53.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85ea68640 5 monclient: authenticate success, global_id 94154 2024-08-18T21:09:53.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85ea68640 10 monclient: _renew_subs 2024-08-18T21:09:53.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85ea68640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:09:53.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85ea68640 1 -- 172.21.15.5:0/2653345490 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85813d7e0 con 0x7fd8580a4f80 2024-08-18T21:09:53.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd8557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd8557fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:09:53.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd8557fa640 10 monclient: dump: 2024-08-18T21:09:53.841 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.841 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.841 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.841 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.841 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.841 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.841 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.842 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.842 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.842 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.842 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.842 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.842 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.842 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.842 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.842 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd856ffd640 4 set_mon_vals no callback set 2024-08-18T21:09:53.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85ea68640 10 monclient: _renew_subs 2024-08-18T21:09:53.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85ea68640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:09:53.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85ea68640 1 -- 172.21.15.5:0/2653345490 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8581404c0 con 0x7fd8580a4f80 2024-08-18T21:09:53.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85ea68640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:53.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85ea68640 1 --2- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd85813e740 0x7fd8581d20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85ea68640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85ea68640 1 -- 172.21.15.5:0/2653345490 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd858051140 con 0x7fd85813e740 2024-08-18T21:09:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85c804640 1 --2- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd85813e740 0x7fd8581d20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85c804640 10 monclient: get_auth_request con 0x7fd85813e740 auth_method 0 2024-08-18T21:09:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85c804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85c804640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85c804640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85c804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85c804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85c804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd8557fa640 1 -- 172.21.15.5:0/2653345490 <== mon.5 v2:172.21.15.157:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fd84c007a40 con 0x7fd8580a4f80 2024-08-18T21:09:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85c804640 10 monclient(hunting): handle_auth_done global_id 84450 payload 824 2024-08-18T21:09:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85c804640 1 -- 172.21.15.5:0/2653345490 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd85813a0e0 con 0x7fd85813e740 2024-08-18T21:09:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd8557fa640 1 --2- 172.21.15.5:0/2653345490 >> v2:172.21.15.157:6812/631023601 conn(0x7fd84403bdc0 0x7fd84403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd8557fa640 1 -- 172.21.15.5:0/2653345490 <== mon.5 v2:172.21.15.157:3302/0 5 ==== osd_map(177..177 src has 22..177) ==== 3898+0+0 (secure 0 0 0) 0x7fd84c04e770 con 0x7fd8580a4f80 2024-08-18T21:09:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85d005640 1 --2- 172.21.15.5:0/2653345490 >> v2:172.21.15.157:6812/631023601 conn(0x7fd84403bdc0 0x7fd84403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.825+0000 7fd85d005640 10 monclient: get_auth_request con 0x7fd84403bdc0 auth_method 0 2024-08-18T21:09:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.829+0000 7fd85c804640 1 -- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd85813e740 msgr2=0x7fd8581d20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.829+0000 7fd85c804640 1 --2- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd85813e740 0x7fd8581d20a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd848009dc0 tx=0x7fd84800f580 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.829+0000 7fd8557fa640 1 -- 172.21.15.5:0/2653345490 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd848019070 con 0x7fd85813e740 2024-08-18T21:09:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.829+0000 7fd8557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.829+0000 7fd8557fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:09:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.829+0000 7fd8557fa640 10 monclient: dump: 2024-08-18T21:09:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.849 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.849 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.849 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.849 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.849 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.849 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.849 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.849 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.849 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.849 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.849 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.849 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.849 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.829+0000 7fd85d005640 1 --2- 172.21.15.5:0/2653345490 >> v2:172.21.15.157:6812/631023601 conn(0x7fd84403bdc0 0x7fd84403e280 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd8500ab000 tx=0x7fd8500a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.829+0000 7fd8557fa640 1 -- 172.21.15.5:0/2653345490 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd84800fe90 con 0x7fd85813e740 2024-08-18T21:09:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.829+0000 7fd8557fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.829+0000 7fd8557fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.829+0000 7fd8557fa640 1 -- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd85813e740 msgr2=0x7fd8581d20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.829+0000 7fd8557fa640 1 --2- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd85813e740 0x7fd8581d20a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd848009dc0 tx=0x7fd84800f580 comp rx=0 tx=0).stop 2024-08-18T21:09:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.829+0000 7fd8557fa640 1 -- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd85813e740 msgr2=0x7fd8581d20a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.829+0000 7fd8557fa640 1 --2- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd85813e740 0x7fd8581d20a0 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd848009dc0 tx=0x7fd84800f580 comp rx=0 tx=0).stop 2024-08-18T21:09:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.837+0000 7fd85ea68640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.837+0000 7fd85ea68640 1 --2- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd85813b1d0 0x7fd85813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.837+0000 7fd85ea68640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.837+0000 7fd85ea68640 1 -- 172.21.15.5:0/2653345490 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd85806e1f0 con 0x7fd85813b1d0 2024-08-18T21:09:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.837+0000 7fd85c804640 1 --2- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd85813b1d0 0x7fd85813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.837+0000 7fd85c804640 10 monclient: get_auth_request con 0x7fd85813b1d0 auth_method 0 2024-08-18T21:09:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.837+0000 7fd85c804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.837+0000 7fd85c804640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.837+0000 7fd85c804640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.837+0000 7fd85c804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.837+0000 7fd85c804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.837+0000 7fd85c804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.837+0000 7fd85c804640 10 monclient(hunting): handle_auth_done global_id 84459 payload 824 2024-08-18T21:09:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.837+0000 7fd85c804640 1 -- 172.21.15.5:0/2653345490 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd8581dc890 con 0x7fd85813b1d0 2024-08-18T21:09:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd85c804640 1 -- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd85813b1d0 msgr2=0x7fd85813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd85c804640 1 --2- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd85813b1d0 0x7fd85813b5e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd848009fd0 tx=0x7fd848004a50 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd8557fa640 1 -- 172.21.15.5:0/2653345490 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd84801e8c0 con 0x7fd85813b1d0 2024-08-18T21:09:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd8557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd8557fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:09:53.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd8557fa640 10 monclient: dump: 2024-08-18T21:09:53.852 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:53.852 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:53.852 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.852 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:53.852 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:53.852 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:53.852 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:53.852 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:53.852 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:53.853 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:53.853 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:53.853 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:53.853 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:53.853 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:53.853 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:53.853 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:53.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd8557fa640 1 -- 172.21.15.5:0/2653345490 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7fd84801fe50 con 0x7fd85813b1d0 2024-08-18T21:09:53.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd8557fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:53.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd8557fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:53.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd8557fa640 1 -- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd85813b1d0 msgr2=0x7fd85813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd8557fa640 1 --2- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd85813b1d0 0x7fd85813b5e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd848009fd0 tx=0x7fd848004a50 comp rx=0 tx=0).stop 2024-08-18T21:09:53.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd8557fa640 1 -- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd85813b1d0 msgr2=0x7fd85813b5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:53.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd8557fa640 1 --2- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd85813b1d0 0x7fd85813b5e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.854 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:53.854 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:53.854 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:53.854 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:53.854 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:53.854 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 90666, 2024-08-18T21:09:53.854 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:53.854 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:53.855 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:53.855 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:53.855 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:53.855 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:53.855 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:53.855 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:53.855 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:53.855 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:53.855 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.856 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:09:53.856 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:53.856 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:53.856 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:53.856 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:53.856 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:53.856 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:53.856 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:53.856 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:53.856 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:53.857 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:53.857 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:53.857 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:53.857 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:53.857 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:53.857 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.857 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:53.857 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:53.857 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:53.858 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:53.858 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:53.858 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:53.858 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:53.858 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:53.858 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:53.858 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:53.858 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:53.858 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:53.858 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:53.858 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.858 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:53.858 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:53.859 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:53.859 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:53.859 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:53.859 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:53.859 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:53.859 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:53.859 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:53.859 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:53.859 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:53.859 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:53.859 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:53.859 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:53.859 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:53.860 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:53.860 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:53.860 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:53.860 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:53.860 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:53.860 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:53.860 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:53.860 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:53.860 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:53.860 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:53.860 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:53.860 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:53.860 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:53.860 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.861 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:53.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.861 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:53.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.861 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:53.861 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:53.861 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.861 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.861 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.861 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:53.861 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.862 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.862 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.862 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:53.862 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.862 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.862 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.862 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:53.862 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:53.862 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.862 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.862 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.863 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:53.863 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:53.863 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.863 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.863 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.863 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:53.863 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.863 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.863 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:53.863 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.864 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.864 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.864 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:53.864 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:53.864 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.864 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.864 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.864 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:53.864 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:53.864 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.865 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.865 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.865 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.865 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:53.865 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.865 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.865 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.865 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:53.865 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.865 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.865 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.865 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:53.866 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:53.866 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.866 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.866 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.866 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.866 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:53.866 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:53.866 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.866 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.867 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.867 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:53.867 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.867 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.867 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:53.867 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.867 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.867 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.868 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:53.868 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:53.868 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.868 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.868 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.868 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:53.868 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:53.868 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.868 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.868 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.869 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:53.869 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.869 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.869 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:53.869 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.869 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.869 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.869 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:53.869 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:53.869 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.870 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.870 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.870 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:53.870 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:53.870 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.870 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.870 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.870 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:53.870 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.871 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.871 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:53.871 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.871 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.871 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:53.871 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:53.871 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.871 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.871 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.872 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:53.872 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:53.872 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:53.872 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:53.872 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.873 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.873 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.873 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:53.873 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:53.873 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.873 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.873 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.873 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:53.873 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:53.873 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.873 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.874 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:53.874 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.874 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:53.874 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.874 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.874 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.874 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:53.874 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:53.875 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.875 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.875 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.875 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:53.875 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:53.875 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:53.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:53.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.875 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:53.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:53.876 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.877 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:53.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:53.877 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:53.877 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.877 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:53.878 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:53.878 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:53.878 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:53.878 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:53.879 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.879 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.879 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:53.879 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:53.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.880 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:53.880 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:53.880 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:53.880 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.880 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:53.881 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:53.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:53.881 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:53.881 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:53.881 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:53.881 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:53.882 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:53.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:53.882 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:53.882 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:53.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd85ea68640 1 -- 172.21.15.5:0/2653345490 >> v2:172.21.15.157:6812/631023601 conn(0x7fd84403bdc0 msgr2=0x7fd84403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd85ea68640 1 --2- 172.21.15.5:0/2653345490 >> v2:172.21.15.157:6812/631023601 conn(0x7fd84403bdc0 0x7fd84403e280 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd8500ab000 tx=0x7fd8500a6000 comp rx=0 tx=0).stop 2024-08-18T21:09:53.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd85ea68640 10 monclient: shutdown 2024-08-18T21:09:53.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd85ea68640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:53.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd85ea68640 1 -- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8580a4f80 msgr2=0x7fd8581d1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:53.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd85ea68640 1 --2- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8580a4f80 0x7fd8581d1620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c7f0 tx=0x7fd84c00ccb0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd85d005640 1 -- 172.21.15.5:0/2653345490 reap_dead start 2024-08-18T21:09:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd85ea68640 1 -- 172.21.15.5:0/2653345490 shutdown_connections 2024-08-18T21:09:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd85ea68640 1 --2- 172.21.15.5:0/2653345490 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8580a4f80 0x7fd8581d1620 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd85ea68640 1 -- 172.21.15.5:0/2653345490 >> 172.21.15.5:0/2653345490 conn(0x7fd8580688d0 msgr2=0x7fd8580a03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd85ea68640 1 -- 172.21.15.5:0/2653345490 shutdown_connections 2024-08-18T21:09:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:53.841+0000 7fd85ea68640 1 -- 172.21.15.5:0/2653345490 wait complete. 2024-08-18T21:09:53.887 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:53.887 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:09:53.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:09:54.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 10 monclient: get_monmap_and_config 2024-08-18T21:09:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 10 monclient: build_initial_monmap 2024-08-18T21:09:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 10 monclient: monmap: 2024-08-18T21:09:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:54.017498+0000 2024-08-18T21:09:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:54.017498+0000 2024-08-18T21:09:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:54.022 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 1 Processor -- start 2024-08-18T21:09:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 1 -- start start 2024-08-18T21:09:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 10 monclient: init 2024-08-18T21:09:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 10 monclient: _add_conns ranks=[10,9,8,7,4,2,1,3,5,0,6] 2024-08-18T21:09:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1d34137920 0x7f1d34137d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 10 monclient(hunting): picked mon.noname-f con 0x7f1d34137920 addr v2:172.21.15.157:3300/0 2024-08-18T21:09:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d34073f80 0x7f1d340a4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 10 monclient(hunting): picked mon.noname-a con 0x7f1d34073f80 addr v2:172.21.15.5:3300/0 2024-08-18T21:09:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1d340a4750 0x7f1d340a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 10 monclient(hunting): picked mon.noname-e con 0x7f1d340a4750 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1d340a2f60 con 0x7f1d34073f80 2024-08-18T21:09:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1d340700a0 con 0x7f1d34137920 2024-08-18T21:09:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f1d3406f9c0 con 0x7f1d340a4750 2024-08-18T21:09:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d38b88640 10 monclient(hunting): authenticate will time out at 1361.031280s 2024-08-18T21:09:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1d340a4750 0x7f1d340a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d2bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d34073f80 0x7f1d340a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1d340a4750 0x7f1d340a4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:34304/0 (socket says 172.21.15.5:34304) 2024-08-18T21:09:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 1 -- 172.21.15.5:0/1781593857 learned_addr learned my addr 172.21.15.5:0/1781593857 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 10 monclient(hunting): get_auth_request con 0x7f1d340a4750 auth_method 0 2024-08-18T21:09:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d2bfff640 10 monclient(hunting): get_auth_request con 0x7f1d34073f80 auth_method 0 2024-08-18T21:09:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d2bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d2bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d2bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d2bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d3259c640 1 --2- 172.21.15.5:0/1781593857 >> v2:172.21.15.157:3300/0 conn(0x7f1d34137920 0x7f1d34137d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d3259c640 10 monclient(hunting): get_auth_request con 0x7f1d34137920 auth_method 0 2024-08-18T21:09:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d3259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d3259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d3259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 10 monclient(hunting): handle_auth_done global_id 55160 payload 274 2024-08-18T21:09:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 1 -- 172.21.15.5:0/1781593857 >> v2:172.21.15.157:3300/0 conn(0x7f1d34137920 msgr2=0x7f1d34137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 1 --2- 172.21.15.5:0/1781593857 >> v2:172.21.15.157:3300/0 conn(0x7f1d34137920 0x7f1d34137d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 1 -- 172.21.15.5:0/1781593857 >> v2:172.21.15.5:3300/0 conn(0x7f1d34073f80 msgr2=0x7f1d340a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 1 --2- 172.21.15.5:0/1781593857 >> v2:172.21.15.5:3300/0 conn(0x7f1d34073f80 0x7f1d340a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 10 monclient: _finish_hunting 0 2024-08-18T21:09:54.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 1 monclient: found mon.noname-e 2024-08-18T21:09:54.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:54.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:09:54.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d32d9d640 1 -- 172.21.15.5:0/1781593857 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d34072cd0 con 0x7f1d340a4750 2024-08-18T21:09:54.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.013+0000 7f1d2bfff640 1 --2- 172.21.15.5:0/1781593857 >> v2:172.21.15.5:3300/0 conn(0x7f1d34073f80 0x7f1d340a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:54.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d32d9d640 1 -- 172.21.15.5:0/1781593857 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1d340a4750 msgr2=0x7f1d340a4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:54.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d32d9d640 1 --2- 172.21.15.5:0/1781593857 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1d340a4750 0x7f1d340a4bc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009e50 tx=0x7f1d2c01c8b0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=ec0d06c1663cbcb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d31d9b640 1 -- 172.21.15.5:0/1781593857 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1d2c0090d0 con 0x7f1d340a4750 2024-08-18T21:09:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d31d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d31d9b640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:09:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d31d9b640 10 monclient: dump: 2024-08-18T21:09:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:54.036 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d31d9b640 10 monclient: _finish_auth 0 2024-08-18T21:09:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d31d9b640 10 monclient: _check_auth_tickets 2024-08-18T21:09:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d31d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d31d9b640 1 -- 172.21.15.5:0/1781593857 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d2c0a5ab0 con 0x7f1d340a4750 2024-08-18T21:09:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d31d9b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d31d9b640 1 -- 172.21.15.5:0/1781593857 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1d2c0a5c60 con 0x7f1d340a4750 2024-08-18T21:09:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 5 monclient: authenticate success, global_id 55160 2024-08-18T21:09:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 4 set_mon_vals no callback set 2024-08-18T21:09:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d31d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d31d9b640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d31d9b640 10 monclient: dump: 2024-08-18T21:09:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:54.038 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 10 monclient: shutdown 2024-08-18T21:09:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 -- 172.21.15.5:0/1781593857 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1d340a4750 msgr2=0x7f1d340a4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 --2- 172.21.15.5:0/1781593857 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1d340a4750 0x7f1d340a4bc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009e50 tx=0x7f1d2c01c8b0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 -- 172.21.15.5:0/1781593857 shutdown_connections 2024-08-18T21:09:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 --2- 172.21.15.5:0/1781593857 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1d340a4750 0x7f1d340a4bc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 --2- 172.21.15.5:0/1781593857 >> v2:172.21.15.5:3300/0 conn(0x7f1d34073f80 0x7f1d340a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 --2- 172.21.15.5:0/1781593857 >> v2:172.21.15.157:3300/0 conn(0x7f1d34137920 0x7f1d34137d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 -- 172.21.15.5:0/1781593857 >> 172.21.15.5:0/1781593857 conn(0x7f1d340a8e00 msgr2=0x7f1d340a5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 -- 172.21.15.5:0/1781593857 shutdown_connections 2024-08-18T21:09:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 -- 172.21.15.5:0/1781593857 wait complete. 2024-08-18T21:09:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 10 monclient: build_initial_monmap 2024-08-18T21:09:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 10 monclient: monmap: 2024-08-18T21:09:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:54.040 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 Processor -- start 2024-08-18T21:09:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 -- start start 2024-08-18T21:09:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 10 monclient: init 2024-08-18T21:09:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 10 monclient: _add_conns ranks=[7,8,2,0,6,5,1,3,4] 2024-08-18T21:09:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1d34073f80 0x7f1d34131800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 10 monclient(hunting): picked mon.noname-i con 0x7f1d34073f80 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1d340a4750 0x7f1d34131d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 10 monclient(hunting): picked mon.noname-e con 0x7f1d340a4750 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1d34137920 0x7f1d3413b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 10 monclient(hunting): picked mon.noname-b con 0x7f1d34137920 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f1d34141140 con 0x7f1d34137920 2024-08-18T21:09:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f1d34140fc0 con 0x7f1d34073f80 2024-08-18T21:09:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f1d341412c0 con 0x7f1d340a4750 2024-08-18T21:09:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d38b88640 10 monclient(hunting): authenticate will time out at 1361.038610s 2024-08-18T21:09:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1d340a4750 0x7f1d34131d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d32d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1d34137920 0x7f1d3413b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1d340a4750 0x7f1d34131d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:34308/0 (socket says 172.21.15.5:34308) 2024-08-18T21:09:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 1 -- 172.21.15.5:0/2158429640 learned_addr learned my addr 172.21.15.5:0/2158429640 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 10 monclient(hunting): get_auth_request con 0x7f1d340a4750 auth_method 0 2024-08-18T21:09:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d32d9d640 10 monclient(hunting): get_auth_request con 0x7f1d34137920 auth_method 0 2024-08-18T21:09:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d32d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d32d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d32d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d32d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d32d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d32d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d3259c640 1 --2- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1d34073f80 0x7f1d34131800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d3259c640 10 monclient(hunting): get_auth_request con 0x7f1d34073f80 auth_method 0 2024-08-18T21:09:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d3259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d3259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d3259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 10 monclient(hunting): handle_auth_done global_id 55169 payload 824 2024-08-18T21:09:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 1 -- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1d34073f80 msgr2=0x7f1d34131800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 1 --2- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1d34073f80 0x7f1d34131800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 1 -- 172.21.15.5:0/2158429640 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1d34137920 msgr2=0x7f1d3413b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 1 --2- 172.21.15.5:0/2158429640 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1d34137920 0x7f1d3413b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 1 monclient: found mon.noname-e 2024-08-18T21:09:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:09:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d2bfff640 1 -- 172.21.15.5:0/2158429640 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3411f790 con 0x7f1d340a4750 2024-08-18T21:09:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.021+0000 7f1d32d9d640 1 --2- 172.21.15.5:0/2158429640 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1d34137920 0x7f1d3413b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2bfff640 1 -- 172.21.15.5:0/2158429640 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1d340a4750 msgr2=0x7f1d34131d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2bfff640 1 --2- 172.21.15.5:0/2158429640 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1d340a4750 0x7f1d34131d40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400e9b0 tx=0x7f1d2400ee70 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2affd640 1 -- 172.21.15.5:0/2158429640 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1d24017070 con 0x7f1d340a4750 2024-08-18T21:09:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:09:54.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2affd640 10 monclient: dump: 2024-08-18T21:09:54.045 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:54.045 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.045 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.045 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.045 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:54.045 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.045 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:54.045 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:54.045 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:54.045 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:54.045 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:54.045 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:54.046 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:54.046 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:54.046 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:54.046 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2affd640 10 monclient: _finish_auth 0 2024-08-18T21:09:54.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2affd640 10 monclient: _check_auth_tickets 2024-08-18T21:09:54.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:54.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2affd640 1 -- 172.21.15.5:0/2158429640 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d2400cc10 con 0x7f1d340a4750 2024-08-18T21:09:54.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d38b88640 5 monclient: authenticate success, global_id 55169 2024-08-18T21:09:54.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d38b88640 10 monclient: _renew_subs 2024-08-18T21:09:54.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d38b88640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:54.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d38b88640 1 -- 172.21.15.5:0/2158429640 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d340a4220 con 0x7f1d340a4750 2024-08-18T21:09:54.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2affd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:54.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2affd640 1 -- 172.21.15.5:0/2158429640 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1d2400cdc0 con 0x7f1d340a4750 2024-08-18T21:09:54.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:54.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:54.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2affd640 10 monclient: dump: 2024-08-18T21:09:54.047 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:54.047 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.047 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.047 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.047 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:54.047 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.047 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:54.047 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:54.047 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:54.047 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:54.048 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:54.048 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:54.048 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:54.048 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:54.048 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:54.048 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d38b88640 10 monclient: _renew_subs 2024-08-18T21:09:54.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d3159a640 4 set_mon_vals no callback set 2024-08-18T21:09:54.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d38b88640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:54.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d38b88640 1 -- 172.21.15.5:0/2158429640 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d3411f4b0 con 0x7f1d340a4750 2024-08-18T21:09:54.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d38b88640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d38b88640 1 --2- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1d341351b0 0x7f1d34135590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d38b88640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d38b88640 1 -- 172.21.15.5:0/2158429640 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f1d34051140 con 0x7f1d341351b0 2024-08-18T21:09:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d3259c640 1 --2- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1d341351b0 0x7f1d34135590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d3259c640 10 monclient: get_auth_request con 0x7f1d341351b0 auth_method 0 2024-08-18T21:09:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d3259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d3259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d3259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d3259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d3259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d3259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2affd640 1 -- 172.21.15.5:0/2158429640 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f1d2401a070 con 0x7f1d340a4750 2024-08-18T21:09:54.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d3259c640 10 monclient(hunting): handle_auth_done global_id 94163 payload 824 2024-08-18T21:09:54.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d3259c640 1 -- 172.21.15.5:0/2158429640 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d340a4bc0 con 0x7f1d341351b0 2024-08-18T21:09:54.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2affd640 1 --2- 172.21.15.5:0/2158429640 >> v2:172.21.15.157:6812/631023601 conn(0x7f1d1403bdc0 0x7f1d1403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.025+0000 7f1d2affd640 1 -- 172.21.15.5:0/2158429640 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(177..177 src has 22..177) ==== 3898+0+0 (secure 0 0 0) 0x7f1d2400f040 con 0x7f1d340a4750 2024-08-18T21:09:54.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.029+0000 7f1d32d9d640 1 --2- 172.21.15.5:0/2158429640 >> v2:172.21.15.157:6812/631023601 conn(0x7f1d1403bdc0 0x7f1d1403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.029+0000 7f1d32d9d640 10 monclient: get_auth_request con 0x7f1d1403bdc0 auth_method 0 2024-08-18T21:09:54.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.029+0000 7f1d3259c640 1 -- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1d341351b0 msgr2=0x7f1d34135590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:54.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.029+0000 7f1d3259c640 1 --2- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1d341351b0 0x7f1d34135590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c00f440 tx=0x7f1d1c00f900 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:54.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.029+0000 7f1d2affd640 1 -- 172.21.15.5:0/2158429640 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1d1c019020 con 0x7f1d341351b0 2024-08-18T21:09:54.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.029+0000 7f1d2affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:54.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.029+0000 7f1d2affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:09:54.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.029+0000 7f1d2affd640 10 monclient: dump: 2024-08-18T21:09:54.051 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:54.053 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.029+0000 7f1d32d9d640 1 --2- 172.21.15.5:0/2158429640 >> v2:172.21.15.157:6812/631023601 conn(0x7f1d1403bdc0 0x7f1d1403e280 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0ab000 tx=0x7f1d2c0a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.029+0000 7f1d2affd640 1 -- 172.21.15.5:0/2158429640 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1d1c014880 con 0x7f1d341351b0 2024-08-18T21:09:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.029+0000 7f1d2affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.029+0000 7f1d2affd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.029+0000 7f1d2affd640 1 -- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1d341351b0 msgr2=0x7f1d34135590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.029+0000 7f1d2affd640 1 --2- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1d341351b0 0x7f1d34135590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c00f440 tx=0x7f1d1c00f900 comp rx=0 tx=0).stop 2024-08-18T21:09:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.029+0000 7f1d2affd640 1 -- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1d341351b0 msgr2=0x7f1d34135590 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.029+0000 7f1d2affd640 1 --2- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1d341351b0 0x7f1d34135590 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c00f440 tx=0x7f1d1c00f900 comp rx=0 tx=0).stop 2024-08-18T21:09:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.037+0000 7f1d38b88640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.037+0000 7f1d38b88640 1 --2- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1d34135ad0 0x7f1d3413b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.037+0000 7f1d38b88640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.037+0000 7f1d38b88640 1 -- 172.21.15.5:0/2158429640 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f1d34132740 con 0x7f1d34135ad0 2024-08-18T21:09:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.037+0000 7f1d3259c640 1 --2- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1d34135ad0 0x7f1d3413b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.037+0000 7f1d3259c640 10 monclient: get_auth_request con 0x7f1d34135ad0 auth_method 0 2024-08-18T21:09:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.037+0000 7f1d3259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.037+0000 7f1d3259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.037+0000 7f1d3259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.037+0000 7f1d3259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.037+0000 7f1d3259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.037+0000 7f1d3259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.037+0000 7f1d3259c640 10 monclient(hunting): handle_auth_done global_id 94172 payload 824 2024-08-18T21:09:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.037+0000 7f1d3259c640 1 -- 172.21.15.5:0/2158429640 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1d34132ed0 con 0x7f1d34135ad0 2024-08-18T21:09:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d3259c640 1 -- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1d34135ad0 msgr2=0x7f1d3413b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d3259c640 1 --2- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1d34135ad0 0x7f1d3413b5b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c01a000 tx=0x7f1d1c0046d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d2affd640 1 -- 172.21.15.5:0/2158429640 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1d1c019040 con 0x7f1d34135ad0 2024-08-18T21:09:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d2affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d2affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:09:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d2affd640 10 monclient: dump: 2024-08-18T21:09:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:54.057 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d2affd640 1 -- 172.21.15.5:0/2158429640 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f1d1c01e630 con 0x7f1d34135ad0 2024-08-18T21:09:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d2affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d2affd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d2affd640 1 -- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1d34135ad0 msgr2=0x7f1d3413b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d2affd640 1 --2- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1d34135ad0 0x7f1d3413b5b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c01a000 tx=0x7f1d1c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d2affd640 1 -- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1d34135ad0 msgr2=0x7f1d3413b5b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d2affd640 1 --2- 172.21.15.5:0/2158429640 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1d34135ad0 0x7f1d3413b5b0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c01a000 tx=0x7f1d1c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.058 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:54.058 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:54.058 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:54.058 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:54.059 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:54.059 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 22079, 2024-08-18T21:09:54.059 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:54.059 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:54.059 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:54.059 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:54.060 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:54.063 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:54.063 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:54.063 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:54.063 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:54.063 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:54.064 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:54.064 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:09:54.064 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:54.064 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:54.064 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:54.064 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:54.065 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:54.065 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:54.065 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:54.065 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:54.065 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:54.065 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:54.066 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:54.066 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:54.066 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:54.066 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:54.067 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:54.067 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:54.067 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:54.067 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:54.067 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:54.067 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:54.068 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:54.068 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:54.068 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:54.068 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:54.068 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:54.068 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:54.068 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:54.069 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:54.069 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.071 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:54.071 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:54.071 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:54.071 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:54.071 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:54.071 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:54.072 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:54.072 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:54.072 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:54.072 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:54.072 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:54.072 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:54.073 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:54.073 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:54.073 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:54.073 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:54.073 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:54.073 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:54.074 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:54.074 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:54.074 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:54.074 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:54.074 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:54.075 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:54.075 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:54.075 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:54.075 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:54.075 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:54.076 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:54.076 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:54.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.076 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:54.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.076 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:54.077 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:54.077 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.077 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.077 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.077 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:54.078 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.079 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.079 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:54.079 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.079 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.079 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.080 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:54.080 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:54.080 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.081 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.081 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.082 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:54.082 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:54.082 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.082 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.082 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:54.082 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.082 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:54.083 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.083 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.083 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.083 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:54.083 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:54.083 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.083 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.083 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.083 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:54.083 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:54.083 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.084 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.084 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:54.084 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.084 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:54.084 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.084 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.084 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.085 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:54.085 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:54.085 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.085 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.085 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.085 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:54.086 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:54.086 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.086 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.087 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.087 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:54.087 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.087 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.087 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:54.087 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.087 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.087 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.087 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:54.087 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:54.087 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.088 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.088 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.088 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:54.088 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:54.088 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.088 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.088 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:54.088 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.089 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.089 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:54.089 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.089 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.089 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.089 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:54.089 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:54.089 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.089 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.089 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.090 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:54.090 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:54.090 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:54.090 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:54.090 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.090 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.091 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.091 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:54.091 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:54.091 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.091 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.091 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.091 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:54.091 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:54.091 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.091 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:54.092 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:54.092 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.092 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.092 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:54.092 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:54.092 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.093 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.093 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.093 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:54.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:54.093 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.093 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.093 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.093 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:54.093 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:54.094 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.094 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.094 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:54.094 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:54.094 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.094 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.094 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.095 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:54.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:54.095 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.095 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.095 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:54.095 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.095 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:54.095 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.096 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.096 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.096 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:54.096 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:54.096 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.096 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.096 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.096 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.096 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.096 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:54.096 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:54.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.097 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:54.097 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:54.097 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:54.097 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.097 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:54.097 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:54.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.097 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:54.097 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:54.097 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:54.097 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.097 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.097 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:54.098 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:54.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d38b88640 1 -- 172.21.15.5:0/2158429640 >> v2:172.21.15.157:6812/631023601 conn(0x7f1d1403bdc0 msgr2=0x7f1d1403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d38b88640 1 --2- 172.21.15.5:0/2158429640 >> v2:172.21.15.157:6812/631023601 conn(0x7f1d1403bdc0 0x7f1d1403e280 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0ab000 tx=0x7f1d2c0a7070 comp rx=0 tx=0).stop 2024-08-18T21:09:54.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d38b88640 10 monclient: shutdown 2024-08-18T21:09:54.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d38b88640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:54.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d38b88640 1 -- 172.21.15.5:0/2158429640 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1d340a4750 msgr2=0x7f1d34131d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d38b88640 1 --2- 172.21.15.5:0/2158429640 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1d340a4750 0x7f1d34131d40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400e9b0 tx=0x7f1d2400ee70 comp rx=0 tx=0).stop 2024-08-18T21:09:54.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d32d9d640 1 -- 172.21.15.5:0/2158429640 reap_dead start 2024-08-18T21:09:54.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d32d9d640 1 -- 172.21.15.5:0/2158429640 reap_dead start 2024-08-18T21:09:54.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d38b88640 1 -- 172.21.15.5:0/2158429640 shutdown_connections 2024-08-18T21:09:54.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d38b88640 1 -- 172.21.15.5:0/2158429640 >> 172.21.15.5:0/2158429640 conn(0x7f1d340a8e00 msgr2=0x7f1d34071780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:54.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d38b88640 1 -- 172.21.15.5:0/2158429640 shutdown_connections 2024-08-18T21:09:54.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.041+0000 7f1d38b88640 1 -- 172.21.15.5:0/2158429640 wait complete. 2024-08-18T21:09:54.100 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:54.100 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:09:54.100 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:09:54.124 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:54.124 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30310]: starting. 2024-08-18T21:09:54.125 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30310]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30270 2024-08-18T21:09:54.125 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30310]: shutting down. 2024-08-18T21:09:54.132 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:54.132 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:09:54.132 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:09:54.134 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:09:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 10 monclient: get_monmap_and_config 2024-08-18T21:09:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 10 monclient: build_initial_monmap 2024-08-18T21:09:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 10 monclient: monmap: 2024-08-18T21:09:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:54.225136+0000 2024-08-18T21:09:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:54.225136+0000 2024-08-18T21:09:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:54.225 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 1 Processor -- start 2024-08-18T21:09:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 1 -- start start 2024-08-18T21:09:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 10 monclient: init 2024-08-18T21:09:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 10 monclient: _add_conns ranks=[6,10,4,9,2,0,7,3,5,8,1] 2024-08-18T21:09:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8fc80a6ce0 0x7f8fc80a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 10 monclient(hunting): picked mon.noname-d con 0x7f8fc80a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8fc80a7600 0x7f8fc8139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 10 monclient(hunting): picked mon.noname-f con 0x7f8fc80a7600 addr v2:172.21.15.157:3300/0 2024-08-18T21:09:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8fc8139fe0 0x7f8fc813a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 10 monclient(hunting): picked mon.noname-c con 0x7f8fc8139fe0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f8fc80a5000 con 0x7f8fc80a7600 2024-08-18T21:09:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f8fc80a4360 con 0x7f8fc8139fe0 2024-08-18T21:09:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f8fc80a45d0 con 0x7f8fc80a6ce0 2024-08-18T21:09:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fce207640 10 monclient(hunting): authenticate will time out at 1361.238432s 2024-08-18T21:09:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc77fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8fc80a6ce0 0x7f8fc80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8fc8139fe0 0x7f8fc813a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8fc8139fe0 0x7f8fc813a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:43010/0 (socket says 172.21.15.5:43010) 2024-08-18T21:09:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 1 -- 172.21.15.5:0/462386297 learned_addr learned my addr 172.21.15.5:0/462386297 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc77fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8fc80a6ce0 0x7f8fc80a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54390/0 (socket says 172.21.15.5:54390) 2024-08-18T21:09:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 10 monclient(hunting): get_auth_request con 0x7f8fc8139fe0 auth_method 0 2024-08-18T21:09:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc77fe640 10 monclient(hunting): get_auth_request con 0x7f8fc80a6ce0 auth_method 0 2024-08-18T21:09:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc6ffd640 1 --2- 172.21.15.5:0/462386297 >> v2:172.21.15.157:3300/0 conn(0x7f8fc80a7600 0x7f8fc8139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc6ffd640 10 monclient(hunting): get_auth_request con 0x7f8fc80a7600 auth_method 0 2024-08-18T21:09:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 10 monclient(hunting): handle_auth_done global_id 6178 payload 274 2024-08-18T21:09:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 1 -- 172.21.15.5:0/462386297 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8fc80a6ce0 msgr2=0x7f8fc80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 1 --2- 172.21.15.5:0/462386297 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8fc80a6ce0 0x7f8fc80a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 1 -- 172.21.15.5:0/462386297 >> v2:172.21.15.157:3300/0 conn(0x7f8fc80a7600 msgr2=0x7f8fc8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 1 --2- 172.21.15.5:0/462386297 >> v2:172.21.15.157:3300/0 conn(0x7f8fc80a7600 0x7f8fc8139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 1 monclient: found mon.noname-c 2024-08-18T21:09:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:09:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc7fff640 1 -- 172.21.15.5:0/462386297 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc80a32d0 con 0x7f8fc8139fe0 2024-08-18T21:09:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc77fe640 1 --2- 172.21.15.5:0/462386297 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8fc80a6ce0 0x7f8fc80a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.221+0000 7f8fc6ffd640 1 --2- 172.21.15.5:0/462386297 >> v2:172.21.15.157:3300/0 conn(0x7f8fc80a7600 0x7f8fc8139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:09:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 1 -- 172.21.15.5:0/462386297 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8fc8139fe0 msgr2=0x7f8fc813a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 1 --2- 172.21.15.5:0/462386297 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8fc8139fe0 0x7f8fc813a440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009e80 tx=0x7f8fc001c8d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=8baa950aa995cf57 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc67fc640 1 -- 172.21.15.5:0/462386297 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fc00090d0 con 0x7f8fc8139fe0 2024-08-18T21:09:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:09:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc67fc640 10 monclient: dump: 2024-08-18T21:09:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:54.236 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc67fc640 10 monclient: _finish_auth 0 2024-08-18T21:09:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc67fc640 10 monclient: _check_auth_tickets 2024-08-18T21:09:54.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:54.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc67fc640 1 -- 172.21.15.5:0/462386297 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc00a5a70 con 0x7f8fc8139fe0 2024-08-18T21:09:54.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 5 monclient: authenticate success, global_id 6178 2024-08-18T21:09:54.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:54.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc67fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:54.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc67fc640 1 -- 172.21.15.5:0/462386297 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fc00a5c20 con 0x7f8fc8139fe0 2024-08-18T21:09:54.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:54.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:54.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc67fc640 10 monclient: dump: 2024-08-18T21:09:54.237 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:54.237 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.237 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.237 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.237 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:54.238 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.238 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:54.238 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:54.238 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:54.238 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:54.238 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:54.238 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:54.238 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:54.238 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:54.238 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:54.238 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:54.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 4 set_mon_vals no callback set 2024-08-18T21:09:54.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 10 monclient: shutdown 2024-08-18T21:09:54.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:54.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 -- 172.21.15.5:0/462386297 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8fc8139fe0 msgr2=0x7f8fc813a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 --2- 172.21.15.5:0/462386297 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8fc8139fe0 0x7f8fc813a440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009e80 tx=0x7f8fc001c8d0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 -- 172.21.15.5:0/462386297 shutdown_connections 2024-08-18T21:09:54.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 --2- 172.21.15.5:0/462386297 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8fc8139fe0 0x7f8fc813a440 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 --2- 172.21.15.5:0/462386297 >> v2:172.21.15.157:3300/0 conn(0x7f8fc80a7600 0x7f8fc8139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 --2- 172.21.15.5:0/462386297 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8fc80a6ce0 0x7f8fc80a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 -- 172.21.15.5:0/462386297 >> 172.21.15.5:0/462386297 conn(0x7f8fc80acbc0 msgr2=0x7f8fc80a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:54.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 -- 172.21.15.5:0/462386297 shutdown_connections 2024-08-18T21:09:54.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 -- 172.21.15.5:0/462386297 wait complete. 2024-08-18T21:09:54.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 10 monclient: build_initial_monmap 2024-08-18T21:09:54.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 10 monclient: monmap: 2024-08-18T21:09:54.239 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:54.240 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:54.240 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:54.240 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:54.240 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:54.240 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.240 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:54.240 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:54.240 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:54.240 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:54.240 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:54.245 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:54.245 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:54.245 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:54.245 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:54.245 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 Processor -- start 2024-08-18T21:09:54.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 -- start start 2024-08-18T21:09:54.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 10 monclient: init 2024-08-18T21:09:54.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:54.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 10 monclient: _add_conns ranks=[1,5,6,0,4,3,8,7,2] 2024-08-18T21:09:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fc80a6ce0 0x7f8fc81d15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 10 monclient(hunting): picked mon.noname-f con 0x7f8fc80a6ce0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:09:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8fc80a7600 0x7f8fc813fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 10 monclient(hunting): picked mon.noname-h con 0x7f8fc80a7600 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8fc8139fe0 0x7f8fc81400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 10 monclient(hunting): picked mon.noname-d con 0x7f8fc8139fe0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc80a79e0 con 0x7f8fc80a6ce0 2024-08-18T21:09:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f8fc80a8220 con 0x7f8fc80a7600 2024-08-18T21:09:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f8fc813e630 con 0x7f8fc8139fe0 2024-08-18T21:09:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fce207640 10 monclient(hunting): authenticate will time out at 1361.246519s 2024-08-18T21:09:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8fc8139fe0 0x7f8fc81400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8fc8139fe0 0x7f8fc81400a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54404/0 (socket says 172.21.15.5:54404) 2024-08-18T21:09:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 1 -- 172.21.15.5:0/1313389795 learned_addr learned my addr 172.21.15.5:0/1313389795 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 10 monclient(hunting): get_auth_request con 0x7f8fc8139fe0 auth_method 0 2024-08-18T21:09:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc6ffd640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8fc80a7600 0x7f8fc813fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc77fe640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fc80a6ce0 0x7f8fc81d15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc6ffd640 10 monclient(hunting): get_auth_request con 0x7f8fc80a7600 auth_method 0 2024-08-18T21:09:54.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc77fe640 10 monclient(hunting): get_auth_request con 0x7f8fc80a6ce0 auth_method 0 2024-08-18T21:09:54.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:54.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:54.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:54.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 10 monclient(hunting): handle_auth_done global_id 84642 payload 824 2024-08-18T21:09:54.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 1 -- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8fc80a7600 msgr2=0x7f8fc813fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8fc80a7600 0x7f8fc813fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 1 -- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fc80a6ce0 msgr2=0x7f8fc81d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fc80a6ce0 0x7f8fc81d15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:54.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 1 monclient: found mon.noname-d 2024-08-18T21:09:54.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:54.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:09:54.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc7fff640 1 -- 172.21.15.5:0/1313389795 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc80abeb0 con 0x7f8fc8139fe0 2024-08-18T21:09:54.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.229+0000 7f8fc77fe640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fc80a6ce0 0x7f8fc81d15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:09:54.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fc7fff640 1 -- 172.21.15.5:0/1313389795 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8fc8139fe0 msgr2=0x7f8fc81400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:54.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fc7fff640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8fc8139fe0 0x7f8fc81400a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009040 tx=0x7f8fc0019670 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:54.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8faffff640 1 -- 172.21.15.5:0/1313389795 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fc00bc020 con 0x7f8fc8139fe0 2024-08-18T21:09:54.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8faffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:54.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8faffff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:09:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8faffff640 10 monclient: dump: 2024-08-18T21:09:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:54.256 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8faffff640 10 monclient: _finish_auth 0 2024-08-18T21:09:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8faffff640 10 monclient: _check_auth_tickets 2024-08-18T21:09:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8faffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8faffff640 1 -- 172.21.15.5:0/1313389795 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc00044b0 con 0x7f8fc8139fe0 2024-08-18T21:09:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8faffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8faffff640 1 -- 172.21.15.5:0/1313389795 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fc0004660 con 0x7f8fc8139fe0 2024-08-18T21:09:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8faffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8faffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:09:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8faffff640 10 monclient: dump: 2024-08-18T21:09:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:54.258 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fc5ffb640 4 set_mon_vals no callback set 2024-08-18T21:09:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fce207640 5 monclient: authenticate success, global_id 84642 2024-08-18T21:09:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fce207640 10 monclient: _renew_subs 2024-08-18T21:09:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fce207640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:09:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fce207640 1 -- 172.21.15.5:0/1313389795 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc813c2d0 con 0x7f8fc8139fe0 2024-08-18T21:09:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fce207640 10 monclient: _renew_subs 2024-08-18T21:09:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fce207640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:09:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fce207640 1 -- 172.21.15.5:0/1313389795 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc813e070 con 0x7f8fc8139fe0 2024-08-18T21:09:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fce207640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fce207640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8fc813b200 0x7f8fc802d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fce207640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fce207640 1 -- 172.21.15.5:0/1313389795 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f8fc80a7b60 con 0x7f8fc813b200 2024-08-18T21:09:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8faffff640 1 -- 172.21.15.5:0/1313389795 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f8fc00bf020 con 0x7f8fc8139fe0 2024-08-18T21:09:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fc77fe640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8fc813b200 0x7f8fc802d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fc77fe640 10 monclient: get_auth_request con 0x7f8fc813b200 auth_method 0 2024-08-18T21:09:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fc77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fc77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fc77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fc77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:54.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fc77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:54.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fc77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:54.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8faffff640 1 --2- 172.21.15.5:0/1313389795 >> v2:172.21.15.157:6812/631023601 conn(0x7f8fb403bdf0 0x7f8fb403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8faffff640 1 -- 172.21.15.5:0/1313389795 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(178..178 src has 22..178) ==== 3506+0+0 (secure 0 0 0) 0x7f8fc00b3040 con 0x7f8fc8139fe0 2024-08-18T21:09:54.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fc77fe640 10 monclient(hunting): handle_auth_done global_id 5902 payload 824 2024-08-18T21:09:54.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fc77fe640 1 -- 172.21.15.5:0/1313389795 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fc81405e0 con 0x7f8fc813b200 2024-08-18T21:09:54.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fc6ffd640 1 --2- 172.21.15.5:0/1313389795 >> v2:172.21.15.157:6812/631023601 conn(0x7f8fb403bdf0 0x7f8fb403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.233+0000 7f8fc6ffd640 10 monclient: get_auth_request con 0x7f8fb403bdf0 auth_method 0 2024-08-18T21:09:54.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8fc6ffd640 1 -- 172.21.15.5:0/1313389795 >> v2:172.21.15.157:6812/631023601 conn(0x7f8fb403bdf0 msgr2=0x7f8fb403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-18T21:09:54.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8fc6ffd640 1 -- 172.21.15.5:0/1313389795 >> v2:172.21.15.157:6812/631023601 conn(0x7f8fb403bdf0 msgr2=0x7f8fb403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:09:54.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8fc6ffd640 1 --2- 172.21.15.5:0/1313389795 >> v2:172.21.15.157:6812/631023601 conn(0x7f8fb403bdf0 0x7f8fb403e2b0 secure :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f8fc80a29d0 tx=0x7f8fbc008040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:09:54.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8fc6ffd640 1 --2- 172.21.15.5:0/1313389795 >> v2:172.21.15.157:6812/631023601 conn(0x7f8fb403bdf0 0x7f8fb403e2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:09:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8fc77fe640 1 -- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8fc813b200 msgr2=0x7f8fc802d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8fc77fe640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8fc813b200 0x7f8fc802d1d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8011600 tx=0x7f8fb8011ac0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8faffff640 1 -- 172.21.15.5:0/1313389795 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fb8015460 con 0x7f8fc813b200 2024-08-18T21:09:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8faffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8faffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:09:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8faffff640 10 monclient: dump: 2024-08-18T21:09:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:54.264 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8faffff640 1 -- 172.21.15.5:0/1313389795 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8fb800fa80 con 0x7f8fc813b200 2024-08-18T21:09:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8faffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8faffff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8faffff640 1 -- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8fc813b200 msgr2=0x7f8fc802d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8faffff640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8fc813b200 0x7f8fc802d1d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8011600 tx=0x7f8fb8011ac0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8faffff640 1 -- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8fc813b200 msgr2=0x7f8fc802d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.237+0000 7f8faffff640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8fc813b200 0x7f8fc802d1d0 secure :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8011600 tx=0x7f8fb8011ac0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8fce207640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:54.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8fce207640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8fc813b5e0 0x7f8fc802d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8fce207640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8fce207640 1 -- 172.21.15.5:0/1313389795 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f8fc8051140 con 0x7f8fc813b5e0 2024-08-18T21:09:54.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8fc77fe640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8fc813b5e0 0x7f8fc802d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8fc77fe640 10 monclient: get_auth_request con 0x7f8fc813b5e0 auth_method 0 2024-08-18T21:09:54.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8fc77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8fc77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8fc77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8fc77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:54.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8fc77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:54.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8fc77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:54.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8fc77fe640 10 monclient(hunting): handle_auth_done global_id 5911 payload 824 2024-08-18T21:09:54.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8fc77fe640 1 -- 172.21.15.5:0/1313389795 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8fc813e240 con 0x7f8fc813b5e0 2024-08-18T21:09:54.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8fc77fe640 1 -- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8fc813b5e0 msgr2=0x7f8fc802d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:54.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8fc77fe640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8fc813b5e0 0x7f8fc802d710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8011600 tx=0x7f8fb80046d0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:54.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8faffff640 1 -- 172.21.15.5:0/1313389795 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fb8004470 con 0x7f8fc813b5e0 2024-08-18T21:09:54.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8faffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:54.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8faffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:09:54.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.245+0000 7f8faffff640 10 monclient: dump: 2024-08-18T21:09:54.268 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:54.268 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.268 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.268 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.269 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:54.269 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.269 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:54.269 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:54.269 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:54.269 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:54.269 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:54.269 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:54.269 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:54.269 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:54.269 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:54.269 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8faffff640 1 -- 172.21.15.5:0/1313389795 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9582 (secure 0 0 0) 0x7f8fb8004470 con 0x7f8fc813b5e0 2024-08-18T21:09:54.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8faffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:54.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8faffff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:54.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8faffff640 1 -- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8fc813b5e0 msgr2=0x7f8fc802d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8faffff640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8fc813b5e0 0x7f8fc802d710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8011600 tx=0x7f8fb80046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8faffff640 1 -- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8fc813b5e0 msgr2=0x7f8fc802d710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:54.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8faffff640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8fc813b5e0 0x7f8fc802d710 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.270 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:54.270 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:54.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:54.271 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:54.271 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:54.271 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 403346, 2024-08-18T21:09:54.271 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:54.271 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:54.271 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:54.272 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:54.272 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:54.272 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:54.272 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:54.272 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:54.272 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:54.272 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:54.272 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:54.272 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:09:54.273 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:54.273 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:54.273 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:54.273 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:54.273 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:54.274 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:54.274 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:54.274 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:54.274 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:54.274 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:54.275 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:54.275 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:54.275 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:54.275 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:54.275 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:54.275 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:54.275 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:54.276 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:54.276 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:54.276 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:54.276 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:54.276 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:54.276 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:54.276 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:54.276 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:54.276 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:54.276 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:54.276 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:54.276 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.277 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:54.277 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:54.277 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:54.277 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:54.277 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:54.277 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:54.277 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:54.277 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:54.277 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:54.277 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:54.277 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:54.277 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:54.277 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:54.277 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:54.279 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:54.279 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:54.279 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:54.279 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:54.279 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:54.279 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:54.279 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:54.279 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:54.279 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:54.280 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:54.280 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:54.280 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:54.280 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:54.280 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:54.280 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:54.280 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:54.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.280 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:54.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:54.280 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:54.280 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.280 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.281 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.281 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:54.282 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.282 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.282 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.288 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.290 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:54.292 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.293 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.293 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:54.293 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.293 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.293 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.293 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:54.293 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:54.293 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.294 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.294 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.294 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:54.294 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:54.294 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.294 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.294 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.294 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:54.294 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.295 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.295 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:54.295 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.295 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.295 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.295 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:54.295 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:54.295 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.295 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.295 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:54.296 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:54.296 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.296 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.296 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.296 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:54.296 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.296 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.297 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:54.297 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.297 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.297 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.297 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:54.297 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:54.297 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.297 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.297 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.298 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:54.298 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:54.298 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.298 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.298 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.298 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:54.298 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.298 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.299 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:54.299 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.299 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.299 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.299 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:54.300 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:54.300 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.300 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.300 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.300 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:54.300 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:54.300 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.300 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.300 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.300 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:54.301 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.301 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.301 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:54.301 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.301 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.301 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.301 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:54.301 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:54.301 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.301 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.301 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.302 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:54.302 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:54.302 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:54.302 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:54.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.302 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:54.302 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:54.302 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.303 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:54.303 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:54.303 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:54.303 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.303 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.303 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:54.303 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:54.303 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:54.303 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:54.303 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:54.303 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.303 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.304 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:54.304 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:54.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.304 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:54.304 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:54.304 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:54.304 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.304 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:54.304 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:09:54.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.304 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:54.304 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:54.304 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:54.304 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.305 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:54.305 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:54.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.305 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:54.305 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:54.305 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:09:54.305 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.305 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:54.305 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:09:54.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:54.305 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:54.305 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:54.305 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:54.305 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:54.306 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:54.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:54.306 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:54.306 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8fce207640 1 -- 172.21.15.5:0/1313389795 >> v2:172.21.15.157:6812/631023601 conn(0x7f8fb403bdf0 msgr2=0x7f8fb403e2b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:09:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8fce207640 1 --2- 172.21.15.5:0/1313389795 >> v2:172.21.15.157:6812/631023601 conn(0x7f8fb403bdf0 0x7f8fb403e2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8fce207640 10 monclient: shutdown 2024-08-18T21:09:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8fce207640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8fce207640 1 -- 172.21.15.5:0/1313389795 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8fc8139fe0 msgr2=0x7f8fc81400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8fce207640 1 --2- 172.21.15.5:0/1313389795 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8fc8139fe0 0x7f8fc81400a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009040 tx=0x7f8fc0019670 comp rx=0 tx=0).stop 2024-08-18T21:09:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8fc7fff640 1 -- 172.21.15.5:0/1313389795 reap_dead start 2024-08-18T21:09:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8fc7fff640 1 -- 172.21.15.5:0/1313389795 reap_dead start 2024-08-18T21:09:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8fce207640 1 -- 172.21.15.5:0/1313389795 shutdown_connections 2024-08-18T21:09:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8fce207640 1 -- 172.21.15.5:0/1313389795 >> 172.21.15.5:0/1313389795 conn(0x7f8fc80acbc0 msgr2=0x7f8fc81384d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8fce207640 1 -- 172.21.15.5:0/1313389795 shutdown_connections 2024-08-18T21:09:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.249+0000 7f8fce207640 1 -- 172.21.15.5:0/1313389795 wait complete. 2024-08-18T21:09:54.308 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:54.309 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-18T21:09:54.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-18T21:09:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.421+0000 7f2ad3f24640 10 monclient: get_monmap_and_config 2024-08-18T21:09:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.421+0000 7f2ad3f24640 10 monclient: build_initial_monmap 2024-08-18T21:09:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.421+0000 7f2ad3f24640 10 monclient: monmap: 2024-08-18T21:09:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:54.426921+0000 2024-08-18T21:09:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:54.426921+0000 2024-08-18T21:09:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:54.427 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.421+0000 7f2ad3f24640 1 Processor -- start 2024-08-18T21:09:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.421+0000 7f2ad3f24640 1 -- start start 2024-08-18T21:09:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.421+0000 7f2ad3f24640 10 monclient: init 2024-08-18T21:09:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.421+0000 7f2ad3f24640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:54.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.421+0000 7f2ad3f24640 10 monclient: _add_conns ranks=[4,2,0,7,8,9,1,5,10,3,6] 2024-08-18T21:09:54.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.421+0000 7f2ad3f24640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2acc0a6ce0 0x7f2acc0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad3f24640 10 monclient(hunting): picked mon.noname-c con 0x7f2acc0a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:54.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad3f24640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2acc0a7600 0x7f2acc139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad3f24640 10 monclient(hunting): picked mon.noname-b con 0x7f2acc0a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:54.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad3f24640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2acc139fe0 addr v1:172.21.15.5:6789/0 2024-08-18T21:09:54.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad3f24640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2acc0a45d0 con 0x7f2acc139fe0 2024-08-18T21:09:54.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad3f24640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad3f24640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f2acc0a5000 con 0x7f2acc0a7600 2024-08-18T21:09:54.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad3f24640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad3f24640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f2acc0a32d0 con 0x7f2acc0a6ce0 2024-08-18T21:09:54.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad3f24640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad3f24640 10 monclient(hunting): authenticate will time out at 1361.440087s 2024-08-18T21:09:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2acc0a6ce0 0x7f2acc0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2acc0a6ce0 0x7f2acc0a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:43024/0 (socket says 172.21.15.5:43024) 2024-08-18T21:09:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 1 -- 172.21.15.5:0/541030496 learned_addr learned my addr 172.21.15.5:0/541030496 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 10 monclient(hunting): get_auth_request con 0x7f2acc0a6ce0 auth_method 0 2024-08-18T21:09:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad14bf640 1 --2- 172.21.15.5:0/541030496 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2acc0a7600 0x7f2acc139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad14bf640 10 monclient(hunting): get_auth_request con 0x7f2acc0a7600 auth_method 0 2024-08-18T21:09:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad14bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad14bf640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad14bf640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad14bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad14bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad14bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 10 monclient(hunting): handle_auth_done global_id 6187 payload 274 2024-08-18T21:09:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 1 -- 172.21.15.5:0/541030496 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2acc0a7600 msgr2=0x7f2acc139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 1 --2- 172.21.15.5:0/541030496 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2acc0a7600 0x7f2acc139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 1 -- 172.21.15.5:0/541030496 >> v1:172.21.15.5:6789/0 conn(0x7f2acc139fe0 legacy=0x7f2acc140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 10 monclient: _finish_hunting 0 2024-08-18T21:09:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 1 monclient: found mon.noname-c 2024-08-18T21:09:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:09:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.425+0000 7f2ad1cc0640 1 -- 172.21.15.5:0/541030496 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2acc0a8900 con 0x7f2acc0a6ce0 2024-08-18T21:09:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad1cc0640 1 -- 172.21.15.5:0/541030496 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2acc0a6ce0 msgr2=0x7f2acc0a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad1cc0640 1 --2- 172.21.15.5:0/541030496 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2acc0a6ce0 0x7f2acc0a70c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0098a0 tx=0x7f2abc01c440 comp rx=0 tx=0).ready entity=mon.4 client_cookie=efb21375e972ca1d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad0cbe640 1 -- 172.21.15.5:0/541030496 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2abc0b2070 con 0x7f2acc0a6ce0 2024-08-18T21:09:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad0cbe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad0cbe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:09:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad0cbe640 10 monclient: dump: 2024-08-18T21:09:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:54.440 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad0cbe640 10 monclient: _finish_auth 0 2024-08-18T21:09:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad0cbe640 10 monclient: _check_auth_tickets 2024-08-18T21:09:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad0cbe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad0cbe640 1 -- 172.21.15.5:0/541030496 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2abc0a9070 con 0x7f2acc0a6ce0 2024-08-18T21:09:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 5 monclient: authenticate success, global_id 6187 2024-08-18T21:09:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad0cbe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad0cbe640 1 -- 172.21.15.5:0/541030496 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2abc0abc40 con 0x7f2acc0a6ce0 2024-08-18T21:09:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad0cbe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 4 set_mon_vals no callback set 2024-08-18T21:09:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad0cbe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad0cbe640 10 monclient: dump: 2024-08-18T21:09:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:54.442 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 10 monclient: shutdown 2024-08-18T21:09:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 1 -- 172.21.15.5:0/541030496 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2acc0a6ce0 msgr2=0x7f2acc0a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 1 --2- 172.21.15.5:0/541030496 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2acc0a6ce0 0x7f2acc0a70c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0098a0 tx=0x7f2abc01c440 comp rx=0 tx=0).stop 2024-08-18T21:09:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 1 -- 172.21.15.5:0/541030496 shutdown_connections 2024-08-18T21:09:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 1 --2- 172.21.15.5:0/541030496 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2acc0a7600 0x7f2acc139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 1 --2- 172.21.15.5:0/541030496 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2acc0a6ce0 0x7f2acc0a70c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 1 -- 172.21.15.5:0/541030496 >> 172.21.15.5:0/541030496 conn(0x7f2acc0acbc0 msgr2=0x7f2acc0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 1 -- 172.21.15.5:0/541030496 shutdown_connections 2024-08-18T21:09:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 1 -- 172.21.15.5:0/541030496 wait complete. 2024-08-18T21:09:54.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 10 monclient: build_initial_monmap 2024-08-18T21:09:54.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 10 monclient: monmap: 2024-08-18T21:09:54.444 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:54.444 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:54.444 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:54.444 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:54.444 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:54.444 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.444 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:54.444 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:54.444 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:54.445 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:54.445 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:54.445 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:54.445 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:54.445 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:54.445 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:54.445 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 1 Processor -- start 2024-08-18T21:09:54.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 1 -- start start 2024-08-18T21:09:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 10 monclient: init 2024-08-18T21:09:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 10 monclient: _add_conns ranks=[1,8,5,0,6,4,7,3,2] 2024-08-18T21:09:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2acc0a6ce0 0x7f2acc13b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 10 monclient(hunting): picked mon.noname-f con 0x7f2acc0a6ce0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:09:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2acc0a7600 0x7f2acc13b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 10 monclient(hunting): picked mon.noname-e con 0x7f2acc0a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2acc139fe0 0x7f2acc13be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 10 monclient(hunting): picked mon.noname-h con 0x7f2acc139fe0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc0a79e0 con 0x7f2acc0a6ce0 2024-08-18T21:09:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f2acc0a9810 con 0x7f2acc139fe0 2024-08-18T21:09:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f2acc1420b0 con 0x7f2acc0a7600 2024-08-18T21:09:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad3f24640 10 monclient(hunting): authenticate will time out at 1361.447193s 2024-08-18T21:09:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2acc0a7600 0x7f2acc13b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2acc0a7600 0x7f2acc13b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:34310/0 (socket says 172.21.15.5:34310) 2024-08-18T21:09:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 1 -- 172.21.15.5:0/1436546580 learned_addr learned my addr 172.21.15.5:0/1436546580 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 10 monclient(hunting): get_auth_request con 0x7f2acc0a7600 auth_method 0 2024-08-18T21:09:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad24c1640 1 --2- 172.21.15.5:0/1436546580 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2acc139fe0 0x7f2acc13be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad1cc0640 1 --2- 172.21.15.5:0/1436546580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2acc0a6ce0 0x7f2acc13b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad24c1640 10 monclient(hunting): get_auth_request con 0x7f2acc139fe0 auth_method 0 2024-08-18T21:09:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad24c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad24c1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad24c1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 10 monclient(hunting): handle_auth_done global_id 55196 payload 824 2024-08-18T21:09:54.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 1 -- 172.21.15.5:0/1436546580 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2acc139fe0 msgr2=0x7f2acc13be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 1 --2- 172.21.15.5:0/1436546580 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2acc139fe0 0x7f2acc13be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 1 -- 172.21.15.5:0/1436546580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2acc0a6ce0 msgr2=0x7f2acc13b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 1 --2- 172.21.15.5:0/1436546580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2acc0a6ce0 0x7f2acc13b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 10 monclient: _finish_hunting 0 2024-08-18T21:09:54.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 1 monclient: found mon.noname-e 2024-08-18T21:09:54.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:54.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:09:54.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad14bf640 1 -- 172.21.15.5:0/1436546580 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2acc13ef20 con 0x7f2acc0a7600 2024-08-18T21:09:54.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad1cc0640 10 monclient: get_auth_request con 0x7f2acc0a6ce0 auth_method 0 2024-08-18T21:09:54.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.429+0000 7f2ad1cc0640 1 --2- 172.21.15.5:0/1436546580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2acc0a6ce0 0x7f2acc13b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:09:54.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ad14bf640 1 -- 172.21.15.5:0/1436546580 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2acc0a7600 msgr2=0x7f2acc13b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:54.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ad14bf640 1 --2- 172.21.15.5:0/1436546580 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2acc0a7600 0x7f2acc13b920 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800e930 tx=0x7f2ac800edf0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:54.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac27fc640 1 -- 172.21.15.5:0/1436546580 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2ac8017070 con 0x7f2acc0a7600 2024-08-18T21:09:54.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:54.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac27fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:09:54.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac27fc640 10 monclient: dump: 2024-08-18T21:09:54.450 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:54.450 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.450 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.450 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.451 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:54.451 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.451 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:54.451 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:54.451 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:54.451 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:54.452 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:54.452 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:54.452 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:54.452 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:54.452 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:54.452 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac27fc640 10 monclient: _finish_auth 0 2024-08-18T21:09:54.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac27fc640 10 monclient: _check_auth_tickets 2024-08-18T21:09:54.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:54.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac27fc640 1 -- 172.21.15.5:0/1436546580 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac800cc10 con 0x7f2acc0a7600 2024-08-18T21:09:54.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ad3f24640 5 monclient: authenticate success, global_id 55196 2024-08-18T21:09:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ad3f24640 10 monclient: _renew_subs 2024-08-18T21:09:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ad3f24640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ad3f24640 1 -- 172.21.15.5:0/1436546580 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2acc13f200 con 0x7f2acc0a7600 2024-08-18T21:09:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac27fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac27fc640 1 -- 172.21.15.5:0/1436546580 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2ac800cdc0 con 0x7f2acc0a7600 2024-08-18T21:09:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac27fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac27fc640 10 monclient: dump: 2024-08-18T21:09:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:54.455 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac3fff640 4 set_mon_vals no callback set 2024-08-18T21:09:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ad3f24640 10 monclient: _renew_subs 2024-08-18T21:09:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ad3f24640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ad3f24640 1 -- 172.21.15.5:0/1436546580 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f2acc13e390 con 0x7f2acc0a7600 2024-08-18T21:09:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ad3f24640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ad3f24640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:54.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ad3f24640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:54.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ad3f24640 1 -- 172.21.15.5:0/1436546580 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2acc0a8220 con 0x7f2acc0a7600 2024-08-18T21:09:54.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac27fc640 1 -- 172.21.15.5:0/1436546580 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f2ac801a070 con 0x7f2acc0a7600 2024-08-18T21:09:54.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac27fc640 1 --2- 172.21.15.5:0/1436546580 >> v2:172.21.15.157:6812/631023601 conn(0x7f2ab003bdc0 0x7f2ab003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:54.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ac27fc640 1 -- 172.21.15.5:0/1436546580 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(178..178 src has 22..178) ==== 3506+0+0 (secure 0 0 0) 0x7f2ac800f040 con 0x7f2acc0a7600 2024-08-18T21:09:54.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ad1cc0640 1 --2- 172.21.15.5:0/1436546580 >> v2:172.21.15.157:6812/631023601 conn(0x7f2ab003bdc0 0x7f2ab003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:54.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.433+0000 7f2ad1cc0640 10 monclient: get_auth_request con 0x7f2ab003bdc0 auth_method 0 2024-08-18T21:09:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.437+0000 7f2ad1cc0640 1 --2- 172.21.15.5:0/1436546580 >> v2:172.21.15.157:6812/631023601 conn(0x7f2ab003bdc0 0x7f2ab003e280 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0a81b0 tx=0x7f2abc0a7000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.441+0000 7f2ac27fc640 1 -- 172.21.15.5:0/1436546580 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f2ac8021070 con 0x7f2acc0a7600 2024-08-18T21:09:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.441+0000 7f2ac27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.441+0000 7f2ac27fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:54.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.677+0000 7f2ad3f24640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-18T21:09:54.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.677+0000 7f2ad3f24640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-18T21:09:54.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.677+0000 7f2ad3f24640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:09:54.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.677+0000 7f2ad3f24640 1 -- 172.21.15.5:0/1436546580 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f2acc069580 con 0x7f2acc0a7600 2024-08-18T21:09:54.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.681+0000 7f2ac27fc640 1 -- 172.21.15.5:0/1436546580 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f2ac8005dd0 con 0x7f2acc0a7600 2024-08-18T21:09:54.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.681+0000 7f2ac27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-18T21:09:54.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.681+0000 7f2ac27fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:54.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=12,kv=10,logm=60} crc {auth=506602835,config=1618278320,health=2559732477,kv=3664197221,logm=1996816765}) 2024-08-18T21:09:54.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=16,config=2,health=12,kv=10,logm=60} crc {auth=506602835,config=1618278320,health=2559732477,kv=3664197221,logm=4266718227}) 2024-08-18T21:09:54.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=12,kv=10,logm=60} crc {auth=506602835,config=1618278320,health=2559732477,kv=3664197221,logm=1996816765}) 2024-08-18T21:09:54.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=16,config=2,health=11,kv=10,logm=61} crc {auth=506602835,config=1618278320,health=1541836427,kv=3664197221,logm=753151488}) 2024-08-18T21:09:54.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=12,kv=10,logm=60} crc {auth=506602835,config=1618278320,health=2559732477,kv=3664197221,logm=1996816765}) 2024-08-18T21:09:54.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=15,config=2,health=11,kv=10,logm=62} crc {auth=487124845,config=1618278320,health=1541836427,kv=3664197221,logm=3807522876}) 2024-08-18T21:09:54.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=12,kv=10,logm=60} crc {auth=506602835,config=1618278320,health=2559732477,kv=3664197221,logm=1996816765}) 2024-08-18T21:09:54.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=15,config=2,health=12,kv=9,logm=62} crc {auth=2134880978,config=1618278320,health=2559732477,kv=1763992103,logm=3417687233}) 2024-08-18T21:09:54.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=12,kv=10,logm=60} crc {auth=506602835,config=1618278320,health=2559732477,kv=3664197221,logm=1996816765}) 2024-08-18T21:09:54.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=15,config=2,health=11,kv=10,logm=62} crc {auth=459885164,config=1618278321,health=1019575768,kv=3664197221,logm=700479198}) 2024-08-18T21:09:54.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=12,kv=10,logm=60} crc {auth=506602835,config=1618278320,health=2559732477,kv=3664197221,logm=1996816765}) 2024-08-18T21:09:54.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=15,config=2,health=12,kv=10,logm=61} crc {auth=1706969385,config=1618278320,health=2559732477,kv=450215431,logm=90837552}) 2024-08-18T21:09:54.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=12,kv=10,logm=60} crc {auth=506602835,config=1618278320,health=2559732477,kv=3664197221,logm=1996816765}) 2024-08-18T21:09:54.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=15,config=2,health=10,kv=10,logm=63} crc {auth=3600973277,config=1618278320,health=3410572226,kv=3664197221,logm=1296009616}) 2024-08-18T21:09:54.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=12,kv=10,logm=60} crc {auth=506602835,config=1618278320,health=2559732477,kv=3664197221,logm=1996816765}) 2024-08-18T21:09:54.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=14,config=2,health=10,kv=9,logm=65} crc {auth=2728760262,config=1618278320,health=2834134868,kv=1842565136,logm=1541660261}) 2024-08-18T21:09:54.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f2ad3f24640 1 -- 172.21.15.5:0/1436546580 >> v2:172.21.15.157:6812/631023601 conn(0x7f2ab003bdc0 msgr2=0x7f2ab003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f2ad3f24640 1 --2- 172.21.15.5:0/1436546580 >> v2:172.21.15.157:6812/631023601 conn(0x7f2ab003bdc0 0x7f2ab003e280 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0a81b0 tx=0x7f2abc0a7000 comp rx=0 tx=0).stop 2024-08-18T21:09:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f2ad3f24640 10 monclient: shutdown 2024-08-18T21:09:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f2ad3f24640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f2ad3f24640 1 -- 172.21.15.5:0/1436546580 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2acc0a7600 msgr2=0x7f2acc13b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f2ad3f24640 1 --2- 172.21.15.5:0/1436546580 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2acc0a7600 0x7f2acc13b920 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800e930 tx=0x7f2ac800edf0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f2ad3f24640 1 -- 172.21.15.5:0/1436546580 shutdown_connections 2024-08-18T21:09:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f2ad3f24640 1 --2- 172.21.15.5:0/1436546580 >> v2:172.21.15.157:6812/631023601 conn(0x7f2ab003bdc0 0x7f2ab003e280 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f2ad3f24640 1 --2- 172.21.15.5:0/1436546580 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2acc139fe0 0x7f2acc13be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f2ad3f24640 1 --2- 172.21.15.5:0/1436546580 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2acc0a7600 0x7f2acc13b920 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f2ad3f24640 1 --2- 172.21.15.5:0/1436546580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2acc0a6ce0 0x7f2acc13b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f2ad3f24640 1 -- 172.21.15.5:0/1436546580 >> 172.21.15.5:0/1436546580 conn(0x7f2acc0acbc0 msgr2=0x7f2acc138c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f2ad3f24640 1 -- 172.21.15.5:0/1436546580 shutdown_connections 2024-08-18T21:09:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:54.685+0000 7f2ad3f24640 1 -- 172.21.15.5:0/1436546580 wait complete. 2024-08-18T21:09:54.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1202041599}) 2024-08-18T21:09:54.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1592335982}) 2024-08-18T21:09:54.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1202041599}) 2024-08-18T21:09:54.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1126062339}) 2024-08-18T21:09:54.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1202041599}) 2024-08-18T21:09:54.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2633522566}) 2024-08-18T21:09:54.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1202041599}) 2024-08-18T21:09:54.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2834168949}) 2024-08-18T21:09:54.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1202041599}) 2024-08-18T21:09:54.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=572851237}) 2024-08-18T21:09:54.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1202041599}) 2024-08-18T21:09:54.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=357467743}) 2024-08-18T21:09:54.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1202041599}) 2024-08-18T21:09:54.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1907963448}) 2024-08-18T21:09:54.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1202041599}) 2024-08-18T21:09:54.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.697+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4167456546}) 2024-08-18T21:09:54.740 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-18T21:09:54.895 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.889+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.895 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.889+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033259562}) 2024-08-18T21:09:54.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.889+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1791639456}) 2024-08-18T21:09:54.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.889+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.889+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033259562}) 2024-08-18T21:09:54.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.889+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1274689709}) 2024-08-18T21:09:54.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.889+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.889+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033259562}) 2024-08-18T21:09:54.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.889+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1463209537}) 2024-08-18T21:09:54.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.889+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033259562}) 2024-08-18T21:09:54.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1875703552}) 2024-08-18T21:09:54.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033259562}) 2024-08-18T21:09:54.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=33682988}) 2024-08-18T21:09:54.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033259562}) 2024-08-18T21:09:54.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=922143492}) 2024-08-18T21:09:54.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033259562}) 2024-08-18T21:09:54.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1555202307}) 2024-08-18T21:09:54.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033259562}) 2024-08-18T21:09:54.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2551641921}) 2024-08-18T21:09:54.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3223365048}) 2024-08-18T21:09:54.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2620256491}) 2024-08-18T21:09:54.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3223365048}) 2024-08-18T21:09:54.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1182186966}) 2024-08-18T21:09:54.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3223365048}) 2024-08-18T21:09:54.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=593398659}) 2024-08-18T21:09:54.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3223365048}) 2024-08-18T21:09:54.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2807137562}) 2024-08-18T21:09:54.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3223365048}) 2024-08-18T21:09:54.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=833344205}) 2024-08-18T21:09:54.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3223365048}) 2024-08-18T21:09:54.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1389073477}) 2024-08-18T21:09:54.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3223365048}) 2024-08-18T21:09:54.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=892617319}) 2024-08-18T21:09:54.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:54.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3223365048}) 2024-08-18T21:09:54.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:54.897+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4215324703}) 2024-08-18T21:09:55.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2632544931}) 2024-08-18T21:09:55.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3105917953}) 2024-08-18T21:09:55.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2632544931}) 2024-08-18T21:09:55.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3796440301}) 2024-08-18T21:09:55.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2632544931}) 2024-08-18T21:09:55.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2151970353}) 2024-08-18T21:09:55.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2632544931}) 2024-08-18T21:09:55.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1217699076}) 2024-08-18T21:09:55.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2632544931}) 2024-08-18T21:09:55.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3770595729}) 2024-08-18T21:09:55.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2632544931}) 2024-08-18T21:09:55.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1202755263}) 2024-08-18T21:09:55.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2632544931}) 2024-08-18T21:09:55.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1424206921}) 2024-08-18T21:09:55.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2632544931}) 2024-08-18T21:09:55.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.125+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1647707517}) 2024-08-18T21:09:55.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30370739}) 2024-08-18T21:09:55.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2060229674}) 2024-08-18T21:09:55.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30370739}) 2024-08-18T21:09:55.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2147467614}) 2024-08-18T21:09:55.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30370739}) 2024-08-18T21:09:55.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=289143911}) 2024-08-18T21:09:55.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30370739}) 2024-08-18T21:09:55.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=926145521}) 2024-08-18T21:09:55.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30370739}) 2024-08-18T21:09:55.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=80272557}) 2024-08-18T21:09:55.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30370739}) 2024-08-18T21:09:55.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1099176276}) 2024-08-18T21:09:55.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30370739}) 2024-08-18T21:09:55.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3361198899}) 2024-08-18T21:09:55.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.155 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30370739}) 2024-08-18T21:09:55.155 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=509653012}) 2024-08-18T21:09:55.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=841282468}) 2024-08-18T21:09:55.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3920373287}) 2024-08-18T21:09:55.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=841282468}) 2024-08-18T21:09:55.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=630187213}) 2024-08-18T21:09:55.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=841282468}) 2024-08-18T21:09:55.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3926518000}) 2024-08-18T21:09:55.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=841282468}) 2024-08-18T21:09:55.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2239359103}) 2024-08-18T21:09:55.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=841282468}) 2024-08-18T21:09:55.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2254325217}) 2024-08-18T21:09:55.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=841282468}) 2024-08-18T21:09:55.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3891197684}) 2024-08-18T21:09:55.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=841282468}) 2024-08-18T21:09:55.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=99250557}) 2024-08-18T21:09:55.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=841282468}) 2024-08-18T21:09:55.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.165+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2839899977}) 2024-08-18T21:09:55.204 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.204 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3089472532}) 2024-08-18T21:09:55.204 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1653154966}) 2024-08-18T21:09:55.204 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.204 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3089472532}) 2024-08-18T21:09:55.204 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3836488959}) 2024-08-18T21:09:55.204 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.204 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3089472532}) 2024-08-18T21:09:55.204 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3862082118}) 2024-08-18T21:09:55.204 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.205 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3089472532}) 2024-08-18T21:09:55.205 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3878306429}) 2024-08-18T21:09:55.205 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.205 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3089472532}) 2024-08-18T21:09:55.205 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1062795554}) 2024-08-18T21:09:55.205 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.205 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3089472532}) 2024-08-18T21:09:55.205 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2569874270}) 2024-08-18T21:09:55.205 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.205 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3089472532}) 2024-08-18T21:09:55.205 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1900295638}) 2024-08-18T21:09:55.205 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.205 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3089472532}) 2024-08-18T21:09:55.205 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.197+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=859650375}) 2024-08-18T21:09:55.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2525195169}) 2024-08-18T21:09:55.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2494433478}) 2024-08-18T21:09:55.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2525195169}) 2024-08-18T21:09:55.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3086545580}) 2024-08-18T21:09:55.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2525195169}) 2024-08-18T21:09:55.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1791982568}) 2024-08-18T21:09:55.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2525195169}) 2024-08-18T21:09:55.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2523606179}) 2024-08-18T21:09:55.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2525195169}) 2024-08-18T21:09:55.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2873714776}) 2024-08-18T21:09:55.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2525195169}) 2024-08-18T21:09:55.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3921342332}) 2024-08-18T21:09:55.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2525195169}) 2024-08-18T21:09:55.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=886004287}) 2024-08-18T21:09:55.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2525195169}) 2024-08-18T21:09:55.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=295432475}) 2024-08-18T21:09:55.716 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.709+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.716 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.709+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674178662}) 2024-08-18T21:09:55.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.709+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2470032643}) 2024-08-18T21:09:55.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.709+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.709+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674178662}) 2024-08-18T21:09:55.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.709+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1032610351}) 2024-08-18T21:09:55.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.709+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.709+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674178662}) 2024-08-18T21:09:55.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.709+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1808294928}) 2024-08-18T21:09:55.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.713+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.713+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674178662}) 2024-08-18T21:09:55.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.713+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3562899158}) 2024-08-18T21:09:55.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.713+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.713+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674178662}) 2024-08-18T21:09:55.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.713+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2426743778}) 2024-08-18T21:09:55.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.713+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.713+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674178662}) 2024-08-18T21:09:55.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.713+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2985664034}) 2024-08-18T21:09:55.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.713+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.713+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674178662}) 2024-08-18T21:09:55.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.713+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1249470763}) 2024-08-18T21:09:55.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.713+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.713+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674178662}) 2024-08-18T21:09:55.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.713+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3098522857}) 2024-08-18T21:09:55.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1835629346}) 2024-08-18T21:09:55.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3413709862}) 2024-08-18T21:09:55.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1835629346}) 2024-08-18T21:09:55.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2659964225}) 2024-08-18T21:09:55.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1835629346}) 2024-08-18T21:09:55.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2661731851}) 2024-08-18T21:09:55.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1835629346}) 2024-08-18T21:09:55.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2186857972}) 2024-08-18T21:09:55.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1835629346}) 2024-08-18T21:09:55.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3090723885}) 2024-08-18T21:09:55.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1835629346}) 2024-08-18T21:09:55.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=208432661}) 2024-08-18T21:09:55.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1835629346}) 2024-08-18T21:09:55.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1200437483}) 2024-08-18T21:09:55.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1835629346}) 2024-08-18T21:09:55.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.717+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=294691293}) 2024-08-18T21:09:55.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=633108112}) 2024-08-18T21:09:55.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1256416646}) 2024-08-18T21:09:55.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=633108112}) 2024-08-18T21:09:55.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2715762985}) 2024-08-18T21:09:55.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=633108112}) 2024-08-18T21:09:55.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2314011526}) 2024-08-18T21:09:55.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=633108112}) 2024-08-18T21:09:55.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1538100754}) 2024-08-18T21:09:55.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=633108112}) 2024-08-18T21:09:55.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2074103281}) 2024-08-18T21:09:55.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=633108112}) 2024-08-18T21:09:55.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=562979904}) 2024-08-18T21:09:55.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=633108112}) 2024-08-18T21:09:55.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1338923470}) 2024-08-18T21:09:55.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=633108112}) 2024-08-18T21:09:55.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.721+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2771059819}) 2024-08-18T21:09:55.728 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.729 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2688482511}) 2024-08-18T21:09:55.729 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2526941179}) 2024-08-18T21:09:55.729 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.729 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2688482511}) 2024-08-18T21:09:55.729 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1158930353}) 2024-08-18T21:09:55.729 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.729 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2688482511}) 2024-08-18T21:09:55.729 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2980927394}) 2024-08-18T21:09:55.729 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.729 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2688482511}) 2024-08-18T21:09:55.729 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4064664840}) 2024-08-18T21:09:55.729 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.729 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2688482511}) 2024-08-18T21:09:55.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1863727458}) 2024-08-18T21:09:55.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2688482511}) 2024-08-18T21:09:55.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3173281786}) 2024-08-18T21:09:55.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2688482511}) 2024-08-18T21:09:55.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3625901975}) 2024-08-18T21:09:55.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2688482511}) 2024-08-18T21:09:55.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.725+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2232141982}) 2024-08-18T21:09:55.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.734 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3229758963}) 2024-08-18T21:09:55.734 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2107944754}) 2024-08-18T21:09:55.734 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.734 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3229758963}) 2024-08-18T21:09:55.734 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2557659580}) 2024-08-18T21:09:55.734 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.734 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3229758963}) 2024-08-18T21:09:55.734 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2256566010}) 2024-08-18T21:09:55.734 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.734 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3229758963}) 2024-08-18T21:09:55.734 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=13628883}) 2024-08-18T21:09:55.734 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3229758963}) 2024-08-18T21:09:55.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3018855584}) 2024-08-18T21:09:55.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3229758963}) 2024-08-18T21:09:55.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3659404236}) 2024-08-18T21:09:55.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3229758963}) 2024-08-18T21:09:55.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2979731684}) 2024-08-18T21:09:55.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3229758963}) 2024-08-18T21:09:55.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.729+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2825078763}) 2024-08-18T21:09:55.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761161435}) 2024-08-18T21:09:55.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1018655521}) 2024-08-18T21:09:55.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761161435}) 2024-08-18T21:09:55.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3807137296}) 2024-08-18T21:09:55.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761161435}) 2024-08-18T21:09:55.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3543213518}) 2024-08-18T21:09:55.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761161435}) 2024-08-18T21:09:55.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1154932168}) 2024-08-18T21:09:55.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761161435}) 2024-08-18T21:09:55.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=724306617}) 2024-08-18T21:09:55.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761161435}) 2024-08-18T21:09:55.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4199821455}) 2024-08-18T21:09:55.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761161435}) 2024-08-18T21:09:55.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=697162979}) 2024-08-18T21:09:55.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761161435}) 2024-08-18T21:09:55.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.733+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1089560935}) 2024-08-18T21:09:55.743 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:09:55.744 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:09:55.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 10 monclient: get_monmap_and_config 2024-08-18T21:09:55.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 10 monclient: build_initial_monmap 2024-08-18T21:09:55.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 10 monclient: monmap: 2024-08-18T21:09:55.876 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:55.877 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:55.877 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:55.877810+0000 2024-08-18T21:09:55.877 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:55.877810+0000 2024-08-18T21:09:55.877 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:55.877 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:55.877 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:55.877 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:55.877 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:55.877 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:55.877 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:55.878 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 1 Processor -- start 2024-08-18T21:09:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 1 -- start start 2024-08-18T21:09:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 10 monclient: init 2024-08-18T21:09:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 10 monclient: _add_conns ranks=[4,8,6,10,2,7,9,3,0,5,1] 2024-08-18T21:09:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0c2c0a6ce0 0x7f0c2c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 10 monclient(hunting): picked mon.noname-c con 0x7f0c2c0a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0c2c0a7600 0x7f0c2c139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 10 monclient(hunting): picked mon.noname-e con 0x7f0c2c0a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0c2c139fe0 0x7f0c2c13a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 10 monclient(hunting): picked mon.noname-d con 0x7f0c2c139fe0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f0c2c0a5000 con 0x7f0c2c0a6ce0 2024-08-18T21:09:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f0c2c0a4360 con 0x7f0c2c139fe0 2024-08-18T21:09:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f0c2c0a45d0 con 0x7f0c2c0a7600 2024-08-18T21:09:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c31773640 10 monclient(hunting): authenticate will time out at 1362.891008s 2024-08-18T21:09:55.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2a7fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0c2c0a7600 0x7f0c2c139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:55.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0c2c0a6ce0 0x7f0c2c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:55.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2b7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0c2c139fe0 0x7f0c2c13a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:55.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2a7fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0c2c0a7600 0x7f0c2c139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:34318/0 (socket says 172.21.15.5:34318) 2024-08-18T21:09:55.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2a7fc640 1 -- 172.21.15.5:0/3763669761 learned_addr learned my addr 172.21.15.5:0/3763669761 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:55.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2a7fc640 10 monclient(hunting): get_auth_request con 0x7f0c2c0a7600 auth_method 0 2024-08-18T21:09:55.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2b7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0c2c139fe0 0x7f0c2c13a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54408/0 (socket says 172.21.15.5:54408) 2024-08-18T21:09:55.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:55.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:55.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:55.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 10 monclient(hunting): get_auth_request con 0x7f0c2c0a6ce0 auth_method 0 2024-08-18T21:09:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2b7fe640 10 monclient(hunting): get_auth_request con 0x7f0c2c139fe0 auth_method 0 2024-08-18T21:09:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 10 monclient(hunting): handle_auth_done global_id 6196 payload 274 2024-08-18T21:09:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 1 -- 172.21.15.5:0/3763669761 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0c2c0a7600 msgr2=0x7f0c2c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 1 --2- 172.21.15.5:0/3763669761 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0c2c0a7600 0x7f0c2c139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 1 -- 172.21.15.5:0/3763669761 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0c2c139fe0 msgr2=0x7f0c2c13a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 1 --2- 172.21.15.5:0/3763669761 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0c2c139fe0 0x7f0c2c13a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 10 monclient: _finish_hunting 0 2024-08-18T21:09:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 1 monclient: found mon.noname-c 2024-08-18T21:09:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:09:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2affd640 1 -- 172.21.15.5:0/3763669761 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c0a32d0 con 0x7f0c2c0a6ce0 2024-08-18T21:09:55.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2a7fc640 1 --2- 172.21.15.5:0/3763669761 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0c2c0a7600 0x7f0c2c139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:55.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.873+0000 7f0c2b7fe640 1 --2- 172.21.15.5:0/3763669761 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0c2c139fe0 0x7f0c2c13a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:55.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.877+0000 7f0c2affd640 1 -- 172.21.15.5:0/3763669761 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0c2c0a6ce0 msgr2=0x7f0c2c0a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.877+0000 7f0c2affd640 1 --2- 172.21.15.5:0/3763669761 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0c2c0a6ce0 0x7f0c2c0a70c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009820 tx=0x7f0c1401c380 comp rx=0 tx=0).ready entity=mon.4 client_cookie=c5abec2d9d90e8e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c29ffb640 1 -- 172.21.15.5:0/3763669761 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0c140b0070 con 0x7f0c2c0a6ce0 2024-08-18T21:09:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c29ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c29ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:09:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c29ffb640 10 monclient: dump: 2024-08-18T21:09:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:55.892 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c29ffb640 10 monclient: _finish_auth 0 2024-08-18T21:09:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c29ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:09:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c29ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c29ffb640 1 -- 172.21.15.5:0/3763669761 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c140aa810 con 0x7f0c2c0a6ce0 2024-08-18T21:09:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 5 monclient: authenticate success, global_id 6196 2024-08-18T21:09:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c29ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c29ffb640 1 -- 172.21.15.5:0/3763669761 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0c140aae30 con 0x7f0c2c0a6ce0 2024-08-18T21:09:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c29ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 4 set_mon_vals no callback set 2024-08-18T21:09:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c29ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c29ffb640 10 monclient: dump: 2024-08-18T21:09:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:55.895 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 10 monclient: shutdown 2024-08-18T21:09:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 -- 172.21.15.5:0/3763669761 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0c2c0a6ce0 msgr2=0x7f0c2c0a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 --2- 172.21.15.5:0/3763669761 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0c2c0a6ce0 0x7f0c2c0a70c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009820 tx=0x7f0c1401c380 comp rx=0 tx=0).stop 2024-08-18T21:09:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 -- 172.21.15.5:0/3763669761 shutdown_connections 2024-08-18T21:09:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 --2- 172.21.15.5:0/3763669761 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0c2c139fe0 0x7f0c2c13a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:55.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 --2- 172.21.15.5:0/3763669761 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0c2c0a7600 0x7f0c2c139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:55.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 --2- 172.21.15.5:0/3763669761 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0c2c0a6ce0 0x7f0c2c0a70c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:55.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 -- 172.21.15.5:0/3763669761 >> 172.21.15.5:0/3763669761 conn(0x7f0c2c0acbc0 msgr2=0x7f0c2c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:55.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 -- 172.21.15.5:0/3763669761 shutdown_connections 2024-08-18T21:09:55.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 -- 172.21.15.5:0/3763669761 wait complete. 2024-08-18T21:09:55.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 10 monclient: build_initial_monmap 2024-08-18T21:09:55.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 10 monclient: monmap: 2024-08-18T21:09:55.896 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:55.896 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:55.896 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:55.896 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:55.896 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:55.897 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:55.897 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:55.897 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:55.897 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:55.897 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:55.897 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:55.897 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:55.897 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:55.897 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:55.898 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:55.898 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:55.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 Processor -- start 2024-08-18T21:09:55.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 -- start start 2024-08-18T21:09:55.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 10 monclient: init 2024-08-18T21:09:55.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:55.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 10 monclient: _add_conns ranks=[7,0,1,5,2,4,3,6,8] 2024-08-18T21:09:55.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0c2c0a6ce0 0x7f0c2c1d1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:55.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 10 monclient(hunting): picked mon.noname-i con 0x7f0c2c0a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:55.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c2c0a7600 0x7f0c2c13fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:55.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 10 monclient(hunting): picked mon.noname-a con 0x7f0c2c0a7600 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:09:55.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c2c139fe0 0x7f0c2c140200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:55.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 10 monclient(hunting): picked mon.noname-f con 0x7f0c2c139fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:09:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c0a79e0 con 0x7f0c2c0a7600 2024-08-18T21:09:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c0a8220 con 0x7f0c2c139fe0 2024-08-18T21:09:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f0c2c0a71c0 con 0x7f0c2c0a6ce0 2024-08-18T21:09:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c31773640 10 monclient(hunting): authenticate will time out at 1362.898356s 2024-08-18T21:09:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c2c0a7600 0x7f0c2c13fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c2c0a7600 0x7f0c2c13fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57622/0 (socket says 172.21.15.5:57622) 2024-08-18T21:09:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 1 -- 172.21.15.5:0/754338270 learned_addr learned my addr 172.21.15.5:0/754338270 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 10 monclient(hunting): get_auth_request con 0x7f0c2c0a7600 auth_method 0 2024-08-18T21:09:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 10 monclient(hunting): handle_auth_done global_id 84447 payload 824 2024-08-18T21:09:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2b7fe640 1 --2- 172.21.15.5:0/754338270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c2c139fe0 0x7f0c2c140200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2affd640 1 --2- 172.21.15.5:0/754338270 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0c2c0a6ce0 0x7f0c2c1d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 1 -- 172.21.15.5:0/754338270 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0c2c0a6ce0 msgr2=0x7f0c2c1d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 1 --2- 172.21.15.5:0/754338270 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0c2c0a6ce0 0x7f0c2c1d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 1 -- 172.21.15.5:0/754338270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c2c139fe0 msgr2=0x7f0c2c140200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 1 --2- 172.21.15.5:0/754338270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c2c139fe0 0x7f0c2c140200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:09:55.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 1 monclient: found mon.noname-a 2024-08-18T21:09:55.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:55.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:09:55.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2a7fc640 1 -- 172.21.15.5:0/754338270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c140740 con 0x7f0c2c0a7600 2024-08-18T21:09:55.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2b7fe640 10 monclient: get_auth_request con 0x7f0c2c139fe0 auth_method 0 2024-08-18T21:09:55.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.881+0000 7f0c2b7fe640 1 --2- 172.21.15.5:0/754338270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c2c139fe0 0x7f0c2c140200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:09:55.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c2a7fc640 1 -- 172.21.15.5:0/754338270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c2c0a7600 msgr2=0x7f0c2c13fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:55.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c2a7fc640 1 --2- 172.21.15.5:0/754338270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c2c0a7600 0x7f0c2c13fcc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009f20 tx=0x7f0c1c00c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:55.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c237fe640 1 -- 172.21.15.5:0/754338270 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0c1c0148f0 con 0x7f0c2c0a7600 2024-08-18T21:09:55.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:55.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c237fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:09:55.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c237fe640 10 monclient: dump: 2024-08-18T21:09:55.902 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:55.902 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:55.902 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:55.902 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:55.903 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c237fe640 10 monclient: _finish_auth 0 2024-08-18T21:09:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c237fe640 10 monclient: _check_auth_tickets 2024-08-18T21:09:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c237fe640 1 -- 172.21.15.5:0/754338270 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c019070 con 0x7f0c2c0a7600 2024-08-18T21:09:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c237fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c237fe640 1 -- 172.21.15.5:0/754338270 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0c1c0073f0 con 0x7f0c2c0a7600 2024-08-18T21:09:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:09:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c237fe640 10 monclient: dump: 2024-08-18T21:09:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:55.905 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:55.905 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:55.905 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:55.905 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:55.905 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:55.905 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:55.905 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:55.905 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:55.905 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:55.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c297fa640 4 set_mon_vals no callback set 2024-08-18T21:09:55.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c31773640 5 monclient: authenticate success, global_id 84447 2024-08-18T21:09:55.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c31773640 10 monclient: _renew_subs 2024-08-18T21:09:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c31773640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:09:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c31773640 1 -- 172.21.15.5:0/754338270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2c13c430 con 0x7f0c2c0a7600 2024-08-18T21:09:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c31773640 10 monclient: _renew_subs 2024-08-18T21:09:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c31773640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:09:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c31773640 1 -- 172.21.15.5:0/754338270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2c13e1d0 con 0x7f0c2c0a7600 2024-08-18T21:09:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c237fe640 1 -- 172.21.15.5:0/754338270 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f0c1c012050 con 0x7f0c2c0a7600 2024-08-18T21:09:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c31773640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c31773640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c31773640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:09:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c31773640 1 -- 172.21.15.5:0/754338270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2c13e4e0 con 0x7f0c2c0a7600 2024-08-18T21:09:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c237fe640 1 --2- 172.21.15.5:0/754338270 >> v2:172.21.15.157:6812/631023601 conn(0x7f0c0c03bdf0 0x7f0c0c03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c237fe640 1 -- 172.21.15.5:0/754338270 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 22..179) ==== 3898+0+0 (secure 0 0 0) 0x7f0c1c04e9b0 con 0x7f0c2c0a7600 2024-08-18T21:09:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c2affd640 1 --2- 172.21.15.5:0/754338270 >> v2:172.21.15.157:6812/631023601 conn(0x7f0c0c03bdf0 0x7f0c0c03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.885+0000 7f0c2affd640 10 monclient: get_auth_request con 0x7f0c0c03bdf0 auth_method 0 2024-08-18T21:09:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.889+0000 7f0c2affd640 1 --2- 172.21.15.5:0/754338270 >> v2:172.21.15.157:6812/631023601 conn(0x7f0c0c03bdf0 0x7f0c0c03e2b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0c140ab000 tx=0x7f0c140a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f0c237fe640 1 -- 172.21.15.5:0/754338270 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f0c1c022060 con 0x7f0c2c0a7600 2024-08-18T21:09:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f0c237fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:55.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f0c237fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:55.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2689528566}) 2024-08-18T21:09:55.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1284243554}) 2024-08-18T21:09:55.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2689528566}) 2024-08-18T21:09:55.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=809535512}) 2024-08-18T21:09:55.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2689528566}) 2024-08-18T21:09:55.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1508780600}) 2024-08-18T21:09:55.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2689528566}) 2024-08-18T21:09:55.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2002026787}) 2024-08-18T21:09:55.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2689528566}) 2024-08-18T21:09:55.911 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2112477816}) 2024-08-18T21:09:55.911 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.911 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2689528566}) 2024-08-18T21:09:55.911 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=150899351}) 2024-08-18T21:09:55.911 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.911 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2689528566}) 2024-08-18T21:09:55.911 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=619148827}) 2024-08-18T21:09:55.911 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:55.911 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2689528566}) 2024-08-18T21:09:55.911 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:55.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1103480270}) 2024-08-18T21:09:56.111 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.111 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=447293708}) 2024-08-18T21:09:56.111 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=159820791}) 2024-08-18T21:09:56.112 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.112 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=447293708}) 2024-08-18T21:09:56.112 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=768581192}) 2024-08-18T21:09:56.112 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.112 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=447293708}) 2024-08-18T21:09:56.112 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=351811855}) 2024-08-18T21:09:56.112 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.112 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=447293708}) 2024-08-18T21:09:56.112 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=528728046}) 2024-08-18T21:09:56.112 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=447293708}) 2024-08-18T21:09:56.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1120612511}) 2024-08-18T21:09:56.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=447293708}) 2024-08-18T21:09:56.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=739186058}) 2024-08-18T21:09:56.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=447293708}) 2024-08-18T21:09:56.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4083076830}) 2024-08-18T21:09:56.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=447293708}) 2024-08-18T21:09:56.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.105+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4174910492}) 2024-08-18T21:09:56.116 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.116 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1972309594}) 2024-08-18T21:09:56.116 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2386753089}) 2024-08-18T21:09:56.116 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.116 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1972309594}) 2024-08-18T21:09:56.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2929523902}) 2024-08-18T21:09:56.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1972309594}) 2024-08-18T21:09:56.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1085304734}) 2024-08-18T21:09:56.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1972309594}) 2024-08-18T21:09:56.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3408936032}) 2024-08-18T21:09:56.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1972309594}) 2024-08-18T21:09:56.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3890226717}) 2024-08-18T21:09:56.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1972309594}) 2024-08-18T21:09:56.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2601318650}) 2024-08-18T21:09:56.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1972309594}) 2024-08-18T21:09:56.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1047082380}) 2024-08-18T21:09:56.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1972309594}) 2024-08-18T21:09:56.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.109+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2903928110}) 2024-08-18T21:09:56.130 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.130 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=823917081}) 2024-08-18T21:09:56.130 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1593185858}) 2024-08-18T21:09:56.130 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.130 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=823917081}) 2024-08-18T21:09:56.131 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=262363643}) 2024-08-18T21:09:56.131 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.131 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=823917081}) 2024-08-18T21:09:56.131 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4232250574}) 2024-08-18T21:09:56.131 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.131 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=823917081}) 2024-08-18T21:09:56.131 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3394144475}) 2024-08-18T21:09:56.131 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.131 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=823917081}) 2024-08-18T21:09:56.131 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=385539058}) 2024-08-18T21:09:56.131 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.131 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=823917081}) 2024-08-18T21:09:56.131 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3666993568}) 2024-08-18T21:09:56.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=823917081}) 2024-08-18T21:09:56.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3937035012}) 2024-08-18T21:09:56.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=823917081}) 2024-08-18T21:09:56.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1251457162}) 2024-08-18T21:09:56.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=468897094}) 2024-08-18T21:09:56.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4092504621}) 2024-08-18T21:09:56.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=468897094}) 2024-08-18T21:09:56.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3756533188}) 2024-08-18T21:09:56.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=468897094}) 2024-08-18T21:09:56.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2229364387}) 2024-08-18T21:09:56.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=468897094}) 2024-08-18T21:09:56.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=434834472}) 2024-08-18T21:09:56.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=468897094}) 2024-08-18T21:09:56.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2689594668}) 2024-08-18T21:09:56.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=468897094}) 2024-08-18T21:09:56.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3202215792}) 2024-08-18T21:09:56.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=468897094}) 2024-08-18T21:09:56.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2878685452}) 2024-08-18T21:09:56.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=468897094}) 2024-08-18T21:09:56.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.117+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2271238416}) 2024-08-18T21:09:56.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.133+0000 7f0c31773640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:09:56.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.133+0000 7f0c31773640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:09:56.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.133+0000 7f0c31773640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:09:56.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.133+0000 7f0c31773640 1 -- 172.21.15.5:0/754338270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0c2c139aa0 con 0x7f0c2c0a7600 2024-08-18T21:09:56.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.137+0000 7f0c237fe640 1 -- 172.21.15.5:0/754338270 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7f0c1c010040 con 0x7f0c2c0a7600 2024-08-18T21:09:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.137+0000 7f0c237fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:09:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.137+0000 7f0c237fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:56.143 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":146,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:09:56.145 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.146 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712111484}) 2024-08-18T21:09:56.146 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1617695896}) 2024-08-18T21:09:56.146 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.146 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712111484}) 2024-08-18T21:09:56.146 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=337919590}) 2024-08-18T21:09:56.146 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.146 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712111484}) 2024-08-18T21:09:56.146 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1154000744}) 2024-08-18T21:09:56.147 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.147 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712111484}) 2024-08-18T21:09:56.148 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3291978316}) 2024-08-18T21:09:56.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712111484}) 2024-08-18T21:09:56.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3680658146}) 2024-08-18T21:09:56.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712111484}) 2024-08-18T21:09:56.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3450460335}) 2024-08-18T21:09:56.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712111484}) 2024-08-18T21:09:56.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1553511669}) 2024-08-18T21:09:56.150 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.150 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712111484}) 2024-08-18T21:09:56.150 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=629819936}) 2024-08-18T21:09:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f0c31773640 1 -- 172.21.15.5:0/754338270 >> v2:172.21.15.157:6812/631023601 conn(0x7f0c0c03bdf0 msgr2=0x7f0c0c03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f0c31773640 1 --2- 172.21.15.5:0/754338270 >> v2:172.21.15.157:6812/631023601 conn(0x7f0c0c03bdf0 0x7f0c0c03e2b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0c140ab000 tx=0x7f0c140a6000 comp rx=0 tx=0).stop 2024-08-18T21:09:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f0c31773640 10 monclient: shutdown 2024-08-18T21:09:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f0c31773640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f0c31773640 1 -- 172.21.15.5:0/754338270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c2c0a7600 msgr2=0x7f0c2c13fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f0c31773640 1 --2- 172.21.15.5:0/754338270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c2c0a7600 0x7f0c2c13fcc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009f20 tx=0x7f0c1c00c550 comp rx=0 tx=0).stop 2024-08-18T21:09:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f0c31773640 1 -- 172.21.15.5:0/754338270 shutdown_connections 2024-08-18T21:09:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f0c31773640 1 --2- 172.21.15.5:0/754338270 >> v2:172.21.15.157:6812/631023601 conn(0x7f0c0c03bdf0 0x7f0c0c03e2b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f0c31773640 1 --2- 172.21.15.5:0/754338270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c2c139fe0 0x7f0c2c140200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f0c31773640 1 --2- 172.21.15.5:0/754338270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c2c0a7600 0x7f0c2c13fcc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f0c31773640 1 --2- 172.21.15.5:0/754338270 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0c2c0a6ce0 0x7f0c2c1d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f0c31773640 1 -- 172.21.15.5:0/754338270 >> 172.21.15.5:0/754338270 conn(0x7f0c2c0acbc0 msgr2=0x7f0c2c138730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f0c31773640 1 -- 172.21.15.5:0/754338270 shutdown_connections 2024-08-18T21:09:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.141+0000 7f0c31773640 1 -- 172.21.15.5:0/754338270 wait complete. 2024-08-18T21:09:56.170 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:09:56.170 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-18T21:09:56.170 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:09:56.170 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:09:56.173 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.173 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=23003750}) 2024-08-18T21:09:56.173 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2552837141}) 2024-08-18T21:09:56.173 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.173 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=23003750}) 2024-08-18T21:09:56.173 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=830952174}) 2024-08-18T21:09:56.173 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.173 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=23003750}) 2024-08-18T21:09:56.173 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4216386790}) 2024-08-18T21:09:56.173 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=23003750}) 2024-08-18T21:09:56.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2688231975}) 2024-08-18T21:09:56.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=23003750}) 2024-08-18T21:09:56.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2469120207}) 2024-08-18T21:09:56.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.174 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=23003750}) 2024-08-18T21:09:56.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2036458043}) 2024-08-18T21:09:56.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=23003750}) 2024-08-18T21:09:56.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1176881713}) 2024-08-18T21:09:56.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=23003750}) 2024-08-18T21:09:56.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=540976258}) 2024-08-18T21:09:56.191 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.191 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2858633642}) 2024-08-18T21:09:56.191 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2617302935}) 2024-08-18T21:09:56.192 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.192 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2858633642}) 2024-08-18T21:09:56.192 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=201892755}) 2024-08-18T21:09:56.192 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.192 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2858633642}) 2024-08-18T21:09:56.192 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=616705962}) 2024-08-18T21:09:56.192 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.192 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2858633642}) 2024-08-18T21:09:56.192 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3881615459}) 2024-08-18T21:09:56.192 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.192 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2858633642}) 2024-08-18T21:09:56.192 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3614326575}) 2024-08-18T21:09:56.192 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.193 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2858633642}) 2024-08-18T21:09:56.193 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2891909785}) 2024-08-18T21:09:56.193 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.193 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2858633642}) 2024-08-18T21:09:56.193 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2500370508}) 2024-08-18T21:09:56.193 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.193 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2858633642}) 2024-08-18T21:09:56.193 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2926021866}) 2024-08-18T21:09:56.207 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=950435755}) 2024-08-18T21:09:56.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1504780878}) 2024-08-18T21:09:56.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=950435755}) 2024-08-18T21:09:56.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2302266772}) 2024-08-18T21:09:56.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=950435755}) 2024-08-18T21:09:56.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1167935913}) 2024-08-18T21:09:56.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=950435755}) 2024-08-18T21:09:56.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4253941454}) 2024-08-18T21:09:56.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=950435755}) 2024-08-18T21:09:56.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2853499633}) 2024-08-18T21:09:56.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=950435755}) 2024-08-18T21:09:56.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1963012479}) 2024-08-18T21:09:56.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=950435755}) 2024-08-18T21:09:56.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3074078809}) 2024-08-18T21:09:56.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=950435755}) 2024-08-18T21:09:56.209 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=321455591}) 2024-08-18T21:09:56.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 10 monclient: get_monmap_and_config 2024-08-18T21:09:56.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 10 monclient: build_initial_monmap 2024-08-18T21:09:56.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 10 monclient: monmap: 2024-08-18T21:09:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:56.309997+0000 2024-08-18T21:09:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:56.309997+0000 2024-08-18T21:09:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:56.310 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:56.310 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:56.310 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:56.310 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:56.310 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 1 Processor -- start 2024-08-18T21:09:56.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 1 -- start start 2024-08-18T21:09:56.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 10 monclient: init 2024-08-18T21:09:56.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:56.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 10 monclient: _add_conns ranks=[6,8,3,7,9,10,4,5,1,0,2] 2024-08-18T21:09:56.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f25e406c950 0x7f25e409ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 10 monclient(hunting): picked mon.noname-d con 0x7f25e406c950 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25e406cd30 0x7f25e406d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 10 monclient(hunting): picked mon.noname-e con 0x7f25e406cd30 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25e4139c60 0x7f25e413a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 10 monclient(hunting): picked mon.noname-g con 0x7f25e4139c60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:09:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f25e4068ee0 con 0x7f25e4139c60 2024-08-18T21:09:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f25e409dde0 con 0x7f25e406c950 2024-08-18T21:09:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f25e409e310 con 0x7f25e406cd30 2024-08-18T21:09:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25eab9e640 10 monclient(hunting): authenticate will time out at 1363.322848s 2024-08-18T21:09:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e893a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f25e406c950 0x7f25e409ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e893a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f25e406c950 0x7f25e409ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54422/0 (socket says 172.21.15.5:54422) 2024-08-18T21:09:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25e406cd30 0x7f25e406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e893a640 1 -- 172.21.15.5:0/273862317 learned_addr learned my addr 172.21.15.5:0/273862317 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e893a640 10 monclient(hunting): get_auth_request con 0x7f25e406c950 auth_method 0 2024-08-18T21:09:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e893a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e893a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e893a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 10 monclient(hunting): get_auth_request con 0x7f25e406cd30 auth_method 0 2024-08-18T21:09:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e893a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e893a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e893a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e913b640 1 --2- 172.21.15.5:0/273862317 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25e4139c60 0x7f25e413a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e913b640 10 monclient(hunting): get_auth_request con 0x7f25e4139c60 auth_method 0 2024-08-18T21:09:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e913b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e913b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e913b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 10 monclient(hunting): handle_auth_done global_id 55214 payload 274 2024-08-18T21:09:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 1 -- 172.21.15.5:0/273862317 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f25e406c950 msgr2=0x7f25e409ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 1 --2- 172.21.15.5:0/273862317 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f25e406c950 0x7f25e409ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 1 -- 172.21.15.5:0/273862317 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25e4139c60 msgr2=0x7f25e413a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 1 --2- 172.21.15.5:0/273862317 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25e4139c60 0x7f25e413a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 1 monclient: found mon.noname-e 2024-08-18T21:09:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:09:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e3fff640 1 -- 172.21.15.5:0/273862317 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e406e520 con 0x7f25e406cd30 2024-08-18T21:09:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.305+0000 7f25e893a640 1 --2- 172.21.15.5:0/273862317 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f25e406c950 0x7f25e409ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:56.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25e3fff640 1 -- 172.21.15.5:0/273862317 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25e406cd30 msgr2=0x7f25e406d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:56.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25e3fff640 1 --2- 172.21.15.5:0/273862317 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25e406cd30 0x7f25e406d130 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009820 tx=0x7f25d801c380 comp rx=0 tx=0).ready entity=mon.8 client_cookie=cdc44c8beded2806 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25e37fe640 1 -- 172.21.15.5:0/273862317 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f25d80b0070 con 0x7f25e406cd30 2024-08-18T21:09:56.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25e37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25e37fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:09:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25e37fe640 10 monclient: dump: 2024-08-18T21:09:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.324 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25e37fe640 10 monclient: _finish_auth 0 2024-08-18T21:09:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25e37fe640 10 monclient: _check_auth_tickets 2024-08-18T21:09:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25e37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25eab9e640 5 monclient: authenticate success, global_id 55214 2024-08-18T21:09:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25e37fe640 1 -- 172.21.15.5:0/273862317 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d80aa810 con 0x7f25e406cd30 2024-08-18T21:09:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25eab9e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25e37fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25eab9e640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25eab9e640 4 set_mon_vals no callback set 2024-08-18T21:09:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25e37fe640 1 -- 172.21.15.5:0/273862317 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f25d80a9300 con 0x7f25e406cd30 2024-08-18T21:09:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25e37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25e37fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.309+0000 7f25e37fe640 10 monclient: dump: 2024-08-18T21:09:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.326 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 10 monclient: shutdown 2024-08-18T21:09:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 -- 172.21.15.5:0/273862317 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25e406cd30 msgr2=0x7f25e406d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 --2- 172.21.15.5:0/273862317 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25e406cd30 0x7f25e406d130 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009820 tx=0x7f25d801c380 comp rx=0 tx=0).stop 2024-08-18T21:09:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 -- 172.21.15.5:0/273862317 shutdown_connections 2024-08-18T21:09:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 --2- 172.21.15.5:0/273862317 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25e4139c60 0x7f25e413a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 --2- 172.21.15.5:0/273862317 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25e406cd30 0x7f25e406d130 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 --2- 172.21.15.5:0/273862317 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f25e406c950 0x7f25e409ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 -- 172.21.15.5:0/273862317 >> 172.21.15.5:0/273862317 conn(0x7f25e40a90a0 msgr2=0x7f25e40a9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 -- 172.21.15.5:0/273862317 shutdown_connections 2024-08-18T21:09:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 -- 172.21.15.5:0/273862317 wait complete. 2024-08-18T21:09:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 10 monclient: build_initial_monmap 2024-08-18T21:09:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 10 monclient: monmap: 2024-08-18T21:09:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:56.328 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 Processor -- start 2024-08-18T21:09:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 -- start start 2024-08-18T21:09:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 10 monclient: init 2024-08-18T21:09:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 10 monclient: _add_conns ranks=[3,2,1,6,7,8,0,4,5] 2024-08-18T21:09:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25e406c950 0x7f25e41d1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 10 monclient(hunting): picked mon.noname-g con 0x7f25e406c950 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:09:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25e406cd30 0x7f25e4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 10 monclient(hunting): picked mon.noname-b con 0x7f25e406cd30 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25e4139c60 0x7f25e4139170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 10 monclient(hunting): picked mon.noname-f con 0x7f25e4139c60 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:09:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f25e406d7f0 con 0x7f25e4139c60 2024-08-18T21:09:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f25e406d670 con 0x7f25e406cd30 2024-08-18T21:09:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f25e41436d0 con 0x7f25e406c950 2024-08-18T21:09:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25eab9e640 10 monclient(hunting): authenticate will time out at 1363.330298s 2024-08-18T21:09:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25e406cd30 0x7f25e4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25e406cd30 0x7f25e4138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:51066/0 (socket says 172.21.15.5:51066) 2024-08-18T21:09:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 1 -- 172.21.15.5:0/968502540 learned_addr learned my addr 172.21.15.5:0/968502540 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 10 monclient(hunting): get_auth_request con 0x7f25e406cd30 auth_method 0 2024-08-18T21:09:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e913b640 1 --2- 172.21.15.5:0/968502540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25e4139c60 0x7f25e4139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e913b640 10 monclient(hunting): get_auth_request con 0x7f25e4139c60 auth_method 0 2024-08-18T21:09:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e913b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e913b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e913b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 10 monclient(hunting): handle_auth_done global_id 84512 payload 824 2024-08-18T21:09:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e893a640 1 --2- 172.21.15.5:0/968502540 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25e406c950 0x7f25e41d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 1 -- 172.21.15.5:0/968502540 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25e406c950 msgr2=0x7f25e41d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 1 --2- 172.21.15.5:0/968502540 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25e406c950 0x7f25e41d1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 1 -- 172.21.15.5:0/968502540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25e4139c60 msgr2=0x7f25e4139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 1 --2- 172.21.15.5:0/968502540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25e4139c60 0x7f25e4139170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 1 monclient: found mon.noname-b 2024-08-18T21:09:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:09:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.313+0000 7f25e3fff640 1 -- 172.21.15.5:0/968502540 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e4124030 con 0x7f25e406cd30 2024-08-18T21:09:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e3fff640 1 -- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25e406cd30 msgr2=0x7f25e4138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e3fff640 1 --2- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25e406cd30 0x7f25e4138c30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f25d80ae040 tx=0x7f25d8019120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e17fa640 1 -- 172.21.15.5:0/968502540 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f25d80b0040 con 0x7f25e406cd30 2024-08-18T21:09:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e17fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:09:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e17fa640 10 monclient: dump: 2024-08-18T21:09:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.333 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e17fa640 10 monclient: _finish_auth 0 2024-08-18T21:09:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e17fa640 10 monclient: _check_auth_tickets 2024-08-18T21:09:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e17fa640 1 -- 172.21.15.5:0/968502540 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d80b9070 con 0x7f25e406cd30 2024-08-18T21:09:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25eab9e640 5 monclient: authenticate success, global_id 84512 2024-08-18T21:09:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25eab9e640 10 monclient: _renew_subs 2024-08-18T21:09:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25eab9e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25eab9e640 1 -- 172.21.15.5:0/968502540 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e413ef30 con 0x7f25e406cd30 2024-08-18T21:09:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e17fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e17fa640 1 -- 172.21.15.5:0/968502540 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f25d80044b0 con 0x7f25e406cd30 2024-08-18T21:09:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e17fa640 10 monclient: dump: 2024-08-18T21:09:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.335 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e2ffd640 4 set_mon_vals no callback set 2024-08-18T21:09:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25eab9e640 10 monclient: _renew_subs 2024-08-18T21:09:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25eab9e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25eab9e640 1 -- 172.21.15.5:0/968502540 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e413fed0 con 0x7f25e406cd30 2024-08-18T21:09:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25eab9e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25eab9e640 1 --2- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e413cc00 0x7f25e413cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25eab9e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25eab9e640 1 -- 172.21.15.5:0/968502540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f25e4051140 con 0x7f25e413cc00 2024-08-18T21:09:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e17fa640 1 -- 172.21.15.5:0/968502540 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f25d8004040 con 0x7f25e406cd30 2024-08-18T21:09:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e893a640 1 --2- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e413cc00 0x7f25e413cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e893a640 10 monclient: get_auth_request con 0x7f25e413cc00 auth_method 0 2024-08-18T21:09:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e893a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e893a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e893a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e893a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e893a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e893a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e17fa640 1 --2- 172.21.15.5:0/968502540 >> v2:172.21.15.157:6812/631023601 conn(0x7f25d003bdc0 0x7f25d003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e17fa640 1 -- 172.21.15.5:0/968502540 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(180..180 src has 22..180) ==== 3898+0+0 (secure 0 0 0) 0x7f25d80e8360 con 0x7f25e406cd30 2024-08-18T21:09:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e893a640 10 monclient(hunting): handle_auth_done global_id 84456 payload 824 2024-08-18T21:09:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e893a640 1 -- 172.21.15.5:0/968502540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25e413ed30 con 0x7f25e413cc00 2024-08-18T21:09:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e913b640 1 --2- 172.21.15.5:0/968502540 >> v2:172.21.15.157:6812/631023601 conn(0x7f25d003bdc0 0x7f25d003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.317+0000 7f25e913b640 10 monclient: get_auth_request con 0x7f25d003bdc0 auth_method 0 2024-08-18T21:09:56.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.321+0000 7f25e893a640 1 -- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e413cc00 msgr2=0x7f25e413cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:56.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.321+0000 7f25e893a640 1 --2- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e413cc00 0x7f25e413cfe0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f25d40107c0 tx=0x7f25d4010bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.321+0000 7f25e17fa640 1 -- 172.21.15.5:0/968502540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f25d400f040 con 0x7f25e413cc00 2024-08-18T21:09:56.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.321+0000 7f25e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.321+0000 7f25e17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:09:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.321+0000 7f25e17fa640 10 monclient: dump: 2024-08-18T21:09:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.343 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.321+0000 7f25e17fa640 1 -- 172.21.15.5:0/968502540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f25d401c400 con 0x7f25e413cc00 2024-08-18T21:09:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.321+0000 7f25e17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.321+0000 7f25e17fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.321+0000 7f25e17fa640 1 -- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e413cc00 msgr2=0x7f25e413cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.321+0000 7f25e17fa640 1 --2- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e413cc00 0x7f25e413cfe0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f25d40107c0 tx=0x7f25d4010bc0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.321+0000 7f25e17fa640 1 -- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e413cc00 msgr2=0x7f25e413cfe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.321+0000 7f25e17fa640 1 --2- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e413cc00 0x7f25e413cfe0 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f25d40107c0 tx=0x7f25d4010bc0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.321+0000 7f25e913b640 1 --2- 172.21.15.5:0/968502540 >> v2:172.21.15.157:6812/631023601 conn(0x7f25d003bdc0 0x7f25d003e280 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f25e4123bb0 tx=0x7f25dc00b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25eab9e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25eab9e640 1 --2- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e413d520 0x7f25e4072970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25eab9e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25eab9e640 1 -- 172.21.15.5:0/968502540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f25e4069f50 con 0x7f25e413d520 2024-08-18T21:09:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e893a640 1 --2- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e413d520 0x7f25e4072970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e893a640 10 monclient: get_auth_request con 0x7f25e413d520 auth_method 0 2024-08-18T21:09:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e893a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e893a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e893a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e893a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e893a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e893a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e893a640 10 monclient(hunting): handle_auth_done global_id 84465 payload 824 2024-08-18T21:09:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e893a640 1 -- 172.21.15.5:0/968502540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f25e406d130 con 0x7f25e413d520 2024-08-18T21:09:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e893a640 1 -- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e413d520 msgr2=0x7f25e4072970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e893a640 1 --2- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e413d520 0x7f25e4072970 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f25d40107c0 tx=0x7f25d40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e17fa640 1 -- 172.21.15.5:0/968502540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f25d40219e0 con 0x7f25e413d520 2024-08-18T21:09:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:09:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e17fa640 10 monclient: dump: 2024-08-18T21:09:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.346 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e17fa640 1 -- 172.21.15.5:0/968502540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9249 (secure 0 0 0) 0x7f25d4029400 con 0x7f25e413d520 2024-08-18T21:09:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e17fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e17fa640 1 -- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e413d520 msgr2=0x7f25e4072970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e17fa640 1 --2- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e413d520 0x7f25e4072970 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f25d40107c0 tx=0x7f25d40046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e17fa640 1 -- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e413d520 msgr2=0x7f25e4072970 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:56.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e17fa640 1 --2- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e413d520 0x7f25e4072970 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f25d40107c0 tx=0x7f25d40046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.347 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:56.347 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:56.347 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:56.347 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:09:56.347 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:56.347 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 93162, 2024-08-18T21:09:56.348 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:56.348 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:56.348 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:56.348 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:56.348 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:56.348 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:56.348 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:56.348 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:56.348 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:56.348 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:56.348 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:56.348 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:09:56.348 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:56.349 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:56.349 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:56.349 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:56.349 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:56.349 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:56.349 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:56.349 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:56.349 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:56.349 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:56.349 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:56.349 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:56.349 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:56.349 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:56.349 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:56.350 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:56.350 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:56.350 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:56.350 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:56.350 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:56.350 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:56.350 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:56.350 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:56.350 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:56.350 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:56.350 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:56.351 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:56.351 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:56.351 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.351 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:56.351 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:56.351 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:56.351 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:56.351 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:56.351 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:56.351 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:56.351 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:56.351 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:56.351 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:56.352 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:56.352 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:56.352 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:56.352 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:56.352 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:56.352 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:56.352 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:56.352 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:56.352 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:56.352 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:56.352 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:56.352 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:56.352 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:56.352 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:56.353 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:56.353 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:56.353 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:56.353 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:56.353 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:56.353 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:56.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.353 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:56.353 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.353 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:56.354 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:56.354 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.354 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.354 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.354 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:56.354 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.354 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.354 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:56.354 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.354 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.355 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.355 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:56.355 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:56.355 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.355 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.355 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.355 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:56.355 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:56.355 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.355 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.356 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.356 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:56.356 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.356 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.356 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.356 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:56.356 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.356 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.356 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.356 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:56.356 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:56.357 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.357 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.357 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.357 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.357 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:56.357 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:56.357 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.357 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.357 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.357 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.357 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:56.357 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.358 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.358 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.358 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:56.358 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.358 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.358 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.358 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:56.358 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:56.359 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.359 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.359 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.359 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.359 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:56.359 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:56.362 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.362 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.362 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.362 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:56.362 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.362 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.362 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:56.362 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.363 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.363 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.363 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:56.363 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:56.363 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.363 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.363 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.363 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:56.363 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:56.363 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.363 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.364 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.364 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:56.364 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.364 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.364 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:56.364 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.364 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.364 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.364 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:56.365 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:56.365 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.365 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.365 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.365 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:56.365 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:56.365 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.365 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.365 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.365 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:56.365 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.366 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.366 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.366 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:56.366 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.366 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.367 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.367 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:56.367 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:56.367 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.367 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.367 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.367 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.367 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:56.367 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:56.367 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.367 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.368 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.368 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:56.368 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.369 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.369 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.369 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:56.369 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.369 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.369 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.369 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:56.369 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:56.369 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.370 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.370 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.370 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:56.370 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:56.370 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.370 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.370 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.370 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:56.370 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.371 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.371 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.371 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:56.371 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.371 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.371 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.371 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:56.371 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:56.372 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.372 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.372 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.372 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:56.372 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:56.372 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.372 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.372 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.373 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:56.373 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.373 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.373 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:56.373 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.373 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.373 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.373 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:56.374 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:56.374 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.374 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.374 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.374 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.374 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.374 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:56.374 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:56.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.374 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:56.374 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:56.374 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.376 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:56.376 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:56.377 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30364]: starting. 2024-08-18T21:09:56.377 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30364]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30363 2024-08-18T21:09:56.377 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30364]: created object 0... 2024-08-18T21:09:56.377 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30364]: created object 25... 2024-08-18T21:09:56.377 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30364]: created object 49... 2024-08-18T21:09:56.377 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30364]: finishing. 2024-08-18T21:09:56.377 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30364]: shutting down. 2024-08-18T21:09:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25eab9e640 1 -- 172.21.15.5:0/968502540 >> v2:172.21.15.157:6812/631023601 conn(0x7f25d003bdc0 msgr2=0x7f25d003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25eab9e640 1 --2- 172.21.15.5:0/968502540 >> v2:172.21.15.157:6812/631023601 conn(0x7f25d003bdc0 0x7f25d003e280 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f25e4123bb0 tx=0x7f25dc00b040 comp rx=0 tx=0).stop 2024-08-18T21:09:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25eab9e640 10 monclient: shutdown 2024-08-18T21:09:56.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25eab9e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:56.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25eab9e640 1 -- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25e406cd30 msgr2=0x7f25e4138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25eab9e640 1 --2- 172.21.15.5:0/968502540 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25e406cd30 0x7f25e4138c30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f25d80ae040 tx=0x7f25d8019120 comp rx=0 tx=0).stop 2024-08-18T21:09:56.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e913b640 1 -- 172.21.15.5:0/968502540 reap_dead start 2024-08-18T21:09:56.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25e913b640 1 -- 172.21.15.5:0/968502540 reap_dead start 2024-08-18T21:09:56.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25eab9e640 1 -- 172.21.15.5:0/968502540 shutdown_connections 2024-08-18T21:09:56.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.329+0000 7f25eab9e640 1 -- 172.21.15.5:0/968502540 >> 172.21.15.5:0/968502540 conn(0x7f25e40a90a0 msgr2=0x7f25e409f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:56.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.333+0000 7f25eab9e640 1 -- 172.21.15.5:0/968502540 shutdown_connections 2024-08-18T21:09:56.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.333+0000 7f25eab9e640 1 -- 172.21.15.5:0/968502540 wait complete. 2024-08-18T21:09:56.380 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:56.380 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:09:56.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:09:56.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=435771477}) 2024-08-18T21:09:56.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=267008635}) 2024-08-18T21:09:56.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=435771477}) 2024-08-18T21:09:56.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1396673183}) 2024-08-18T21:09:56.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=435771477}) 2024-08-18T21:09:56.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2545811578}) 2024-08-18T21:09:56.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=435771477}) 2024-08-18T21:09:56.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=308002517}) 2024-08-18T21:09:56.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=435771477}) 2024-08-18T21:09:56.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3593884127}) 2024-08-18T21:09:56.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=435771477}) 2024-08-18T21:09:56.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1329799325}) 2024-08-18T21:09:56.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=435771477}) 2024-08-18T21:09:56.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2358410711}) 2024-08-18T21:09:56.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=435771477}) 2024-08-18T21:09:56.542 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.537+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=876852650}) 2024-08-18T21:09:56.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 10 monclient: get_monmap_and_config 2024-08-18T21:09:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 10 monclient: build_initial_monmap 2024-08-18T21:09:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 10 monclient: monmap: 2024-08-18T21:09:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:56.549054+0000 2024-08-18T21:09:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:56.549054+0000 2024-08-18T21:09:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:56.549 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:56.549 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:56.549 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:56.549 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:56.549 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:56.549 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:56.549 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:56.549 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 1 Processor -- start 2024-08-18T21:09:56.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 1 -- start start 2024-08-18T21:09:56.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 10 monclient: init 2024-08-18T21:09:56.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:56.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 10 monclient: _add_conns ranks=[0,8,1,3,9,2,6,4,7,10,5] 2024-08-18T21:09:56.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb4540a4000 addr v1:172.21.15.5:6789/0 2024-08-18T21:09:56.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb4540a2800 0x7fb45413bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 10 monclient(hunting): picked mon.noname-e con 0x7fb4540a2800 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:56.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fb4540a4af0 addr v1:172.21.15.157:6789/0 2024-08-18T21:09:56.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4540a2450 con 0x7fb4540a4000 2024-08-18T21:09:56.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4540a5f90 con 0x7fb4540a4af0 2024-08-18T21:09:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fb45409c090 con 0x7fb4540a2800 2024-08-18T21:09:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb45a81b640 10 monclient(hunting): authenticate will time out at 1363.563109s 2024-08-18T21:09:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb453fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb4540a4000 0x7fb4540a43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54836/0 (socket says 172.21.15.5:54836) 2024-08-18T21:09:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb453fff640 1 -- 172.21.15.5:0/269626144 learned_addr learned my addr 172.21.15.5:0/269626144 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:09:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb44bfff640 1 --2- 172.21.15.5:0/269626144 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb4540a2800 0x7fb45413bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb44bfff640 10 monclient(hunting): get_auth_request con 0x7fb4540a2800 auth_method 0 2024-08-18T21:09:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb44bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb44bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb44bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb44bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb44bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb44bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb44bfff640 10 monclient(hunting): handle_auth_done global_id 55223 payload 274 2024-08-18T21:09:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb44bfff640 1 -- 172.21.15.5:0/269626144 >> v1:172.21.15.157:6789/0 conn(0x7fb4540a4af0 legacy=0x7fb45413e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb44bfff640 1 -- 172.21.15.5:0/269626144 >> v1:172.21.15.5:6789/0 conn(0x7fb4540a4000 legacy=0x7fb4540a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb44bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb44bfff640 1 monclient: found mon.noname-e 2024-08-18T21:09:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb44bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:56.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb44bfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:09:56.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.545+0000 7fb44bfff640 1 -- 172.21.15.5:0/269626144 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45409f5e0 con 0x7fb4540a2800 2024-08-18T21:09:56.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.549+0000 7fb44bfff640 1 -- 172.21.15.5:0/269626144 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb4540a2800 msgr2=0x7fb45413bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:56.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.549+0000 7fb44bfff640 1 --2- 172.21.15.5:0/269626144 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb4540a2800 0x7fb45413bb90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb444009820 tx=0x7fb44401c380 comp rx=0 tx=0).ready entity=mon.8 client_cookie=165c762ac7328205 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb4537fe640 1 -- 172.21.15.5:0/269626144 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb4440b0070 con 0x7fb4540a2800 2024-08-18T21:09:56.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb4537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb4537fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:09:56.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb4537fe640 10 monclient: dump: 2024-08-18T21:09:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.558 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.558 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.558 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.558 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.558 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.558 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb4537fe640 10 monclient: _finish_auth 0 2024-08-18T21:09:56.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb4537fe640 10 monclient: _check_auth_tickets 2024-08-18T21:09:56.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb4537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:56.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 5 monclient: authenticate success, global_id 55223 2024-08-18T21:09:56.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:56.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb4537fe640 1 -- 172.21.15.5:0/269626144 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4440aa810 con 0x7fb4540a2800 2024-08-18T21:09:56.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb4537fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:56.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:56.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 4 set_mon_vals no callback set 2024-08-18T21:09:56.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb4537fe640 1 -- 172.21.15.5:0/269626144 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb4440aae30 con 0x7fb4540a2800 2024-08-18T21:09:56.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb4537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb4537fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:56.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb4537fe640 10 monclient: dump: 2024-08-18T21:09:56.559 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.559 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.559 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.559 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.559 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.559 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.560 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.560 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.560 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.560 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.560 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.560 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.560 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.560 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.560 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.560 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 10 monclient: shutdown 2024-08-18T21:09:56.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 1 -- 172.21.15.5:0/269626144 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb4540a2800 msgr2=0x7fb45413bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 1 --2- 172.21.15.5:0/269626144 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb4540a2800 0x7fb45413bb90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb444009820 tx=0x7fb44401c380 comp rx=0 tx=0).stop 2024-08-18T21:09:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 1 -- 172.21.15.5:0/269626144 shutdown_connections 2024-08-18T21:09:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 1 --2- 172.21.15.5:0/269626144 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb4540a2800 0x7fb45413bb90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 1 -- 172.21.15.5:0/269626144 >> 172.21.15.5:0/269626144 conn(0x7fb4540a50f0 msgr2=0x7fb4540a54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 1 -- 172.21.15.5:0/269626144 shutdown_connections 2024-08-18T21:09:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 1 -- 172.21.15.5:0/269626144 wait complete. 2024-08-18T21:09:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 10 monclient: build_initial_monmap 2024-08-18T21:09:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 10 monclient: monmap: 2024-08-18T21:09:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:56.566 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:56.566 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:56.566 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:56.566 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:56.567 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 1 Processor -- start 2024-08-18T21:09:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 1 -- start start 2024-08-18T21:09:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 10 monclient: init 2024-08-18T21:09:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 10 monclient: _add_conns ranks=[1,2,0,7,3,6,8,4,5] 2024-08-18T21:09:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4540a2800 0x7fb454136ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 10 monclient(hunting): picked mon.noname-f con 0x7fb4540a2800 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:09:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb4540a4000 0x7fb4541371e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 10 monclient(hunting): picked mon.noname-b con 0x7fb4540a4000 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4540a4af0 0x7fb45413be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 10 monclient(hunting): picked mon.noname-a con 0x7fb4540a4af0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:09:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb454142640 con 0x7fb4540a4af0 2024-08-18T21:09:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb454068770 con 0x7fb4540a2800 2024-08-18T21:09:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fb4541427c0 con 0x7fb4540a4000 2024-08-18T21:09:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb45a81b640 10 monclient(hunting): authenticate will time out at 1363.570448s 2024-08-18T21:09:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb4540a4000 0x7fb4541371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb4540a4000 0x7fb4541371e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:51082/0 (socket says 172.21.15.5:51082) 2024-08-18T21:09:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 1 -- 172.21.15.5:0/2405368891 learned_addr learned my addr 172.21.15.5:0/2405368891 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 10 monclient(hunting): get_auth_request con 0x7fb4540a4000 auth_method 0 2024-08-18T21:09:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb458db8640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4540a4af0 0x7fb45413be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb458db8640 10 monclient(hunting): get_auth_request con 0x7fb4540a4af0 auth_method 0 2024-08-18T21:09:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb458db8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb458db8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb458db8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb458db8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb458db8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb458db8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb453fff640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4540a2800 0x7fb454136ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 10 monclient(hunting): handle_auth_done global_id 84521 payload 824 2024-08-18T21:09:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 1 -- 172.21.15.5:0/2405368891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4540a2800 msgr2=0x7fb454136ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4540a2800 0x7fb454136ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 1 -- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4540a4af0 msgr2=0x7fb45413be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4540a4af0 0x7fb45413be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 1 monclient: found mon.noname-b 2024-08-18T21:09:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:09:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb44bfff640 1 -- 172.21.15.5:0/2405368891 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45413d890 con 0x7fb4540a4000 2024-08-18T21:09:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb453fff640 10 monclient: get_auth_request con 0x7fb4540a2800 auth_method 0 2024-08-18T21:09:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.553+0000 7fb453fff640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4540a2800 0x7fb454136ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:09:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb44bfff640 1 -- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb4540a4000 msgr2=0x7fb4541371e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb44bfff640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb4540a4000 0x7fb4541371e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb44401c1b0 tx=0x7fb444019120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb4517fa640 1 -- 172.21.15.5:0/2405368891 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb4440b0040 con 0x7fb4540a4000 2024-08-18T21:09:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb4517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb4517fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:09:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb4517fa640 10 monclient: dump: 2024-08-18T21:09:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.579 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb4517fa640 10 monclient: _finish_auth 0 2024-08-18T21:09:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb4517fa640 10 monclient: _check_auth_tickets 2024-08-18T21:09:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb4517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb4517fa640 1 -- 172.21.15.5:0/2405368891 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4440b9070 con 0x7fb4540a4000 2024-08-18T21:09:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb45a81b640 5 monclient: authenticate success, global_id 84521 2024-08-18T21:09:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb45a81b640 10 monclient: _renew_subs 2024-08-18T21:09:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb45a81b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb45a81b640 1 -- 172.21.15.5:0/2405368891 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb45413e3f0 con 0x7fb4540a4000 2024-08-18T21:09:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb4517fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb4517fa640 1 -- 172.21.15.5:0/2405368891 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb4440044b0 con 0x7fb4540a4000 2024-08-18T21:09:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb4517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb4517fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb452ffd640 4 set_mon_vals no callback set 2024-08-18T21:09:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb4517fa640 10 monclient: dump: 2024-08-18T21:09:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.582 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb45a81b640 10 monclient: _renew_subs 2024-08-18T21:09:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb45a81b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb45a81b640 1 -- 172.21.15.5:0/2405368891 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb45412de80 con 0x7fb4540a4000 2024-08-18T21:09:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb45a81b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb45a81b640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb4541cfd10 0x7fb45402d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb45a81b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb45a81b640 1 -- 172.21.15.5:0/2405368891 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fb454051140 con 0x7fb4541cfd10 2024-08-18T21:09:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb453fff640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb4541cfd10 0x7fb45402d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb453fff640 10 monclient: get_auth_request con 0x7fb4541cfd10 auth_method 0 2024-08-18T21:09:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb453fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb453fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb453fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb4517fa640 1 -- 172.21.15.5:0/2405368891 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fb4440b3070 con 0x7fb4540a4000 2024-08-18T21:09:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb453fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb453fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb453fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb453fff640 10 monclient(hunting): handle_auth_done global_id 84530 payload 824 2024-08-18T21:09:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb453fff640 1 -- 172.21.15.5:0/2405368891 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb4540a43e0 con 0x7fb4541cfd10 2024-08-18T21:09:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb4517fa640 1 --2- 172.21.15.5:0/2405368891 >> v2:172.21.15.157:6812/631023601 conn(0x7fb43403bdc0 0x7fb43403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb4517fa640 1 -- 172.21.15.5:0/2405368891 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(180..180 src has 22..180) ==== 3898+0+0 (secure 0 0 0) 0x7fb4440e8130 con 0x7fb4540a4000 2024-08-18T21:09:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb458db8640 1 --2- 172.21.15.5:0/2405368891 >> v2:172.21.15.157:6812/631023601 conn(0x7fb43403bdc0 0x7fb43403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.557+0000 7fb458db8640 10 monclient: get_auth_request con 0x7fb43403bdc0 auth_method 0 2024-08-18T21:09:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.561+0000 7fb453fff640 1 -- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb4541cfd10 msgr2=0x7fb45402d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.561+0000 7fb453fff640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb4541cfd10 0x7fb45402d1d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00d4c0 tx=0x7fb43c00d980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.561+0000 7fb4517fa640 1 -- 172.21.15.5:0/2405368891 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb43c005d00 con 0x7fb4541cfd10 2024-08-18T21:09:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.561+0000 7fb4517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.561+0000 7fb4517fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.561+0000 7fb4517fa640 10 monclient: dump: 2024-08-18T21:09:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.585 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.561+0000 7fb4517fa640 1 -- 172.21.15.5:0/2405368891 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb43c017070 con 0x7fb4541cfd10 2024-08-18T21:09:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.561+0000 7fb4517fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.561+0000 7fb4517fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.561+0000 7fb4517fa640 1 -- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb4541cfd10 msgr2=0x7fb45402d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.561+0000 7fb4517fa640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb4541cfd10 0x7fb45402d1d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00d4c0 tx=0x7fb43c00d980 comp rx=0 tx=0).stop 2024-08-18T21:09:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.561+0000 7fb4517fa640 1 -- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb4541cfd10 msgr2=0x7fb45402d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.561+0000 7fb4517fa640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb4541cfd10 0x7fb45402d1d0 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00d4c0 tx=0x7fb43c00d980 comp rx=0 tx=0).stop 2024-08-18T21:09:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.561+0000 7fb458db8640 1 --2- 172.21.15.5:0/2405368891 >> v2:172.21.15.157:6812/631023601 conn(0x7fb43403bdc0 0x7fb43403e280 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009fa0 tx=0x7fb44c00d040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.565+0000 7fb45a81b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.565+0000 7fb45a81b640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb45402d710 0x7fb45402db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.565+0000 7fb45a81b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.565+0000 7fb45a81b640 1 -- 172.21.15.5:0/2405368891 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fb4540a8360 con 0x7fb45402d710 2024-08-18T21:09:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb453fff640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb45402d710 0x7fb45402db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb453fff640 10 monclient: get_auth_request con 0x7fb45402d710 auth_method 0 2024-08-18T21:09:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb453fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb453fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb453fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb453fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb453fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb453fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb453fff640 10 monclient(hunting): handle_auth_done global_id 84539 payload 824 2024-08-18T21:09:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb453fff640 1 -- 172.21.15.5:0/2405368891 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb454139070 con 0x7fb45402d710 2024-08-18T21:09:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb453fff640 1 -- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb45402d710 msgr2=0x7fb45402db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb453fff640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb45402d710 0x7fb45402db20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00d4c0 tx=0x7fb43c004950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb4517fa640 1 -- 172.21.15.5:0/2405368891 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb43c007710 con 0x7fb45402d710 2024-08-18T21:09:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb4517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb4517fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb4517fa640 10 monclient: dump: 2024-08-18T21:09:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.588 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb4517fa640 1 -- 172.21.15.5:0/2405368891 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7fb43c007710 con 0x7fb45402d710 2024-08-18T21:09:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb4517fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb4517fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb4517fa640 1 -- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb45402d710 msgr2=0x7fb45402db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb4517fa640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb45402d710 0x7fb45402db20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00d4c0 tx=0x7fb43c004950 comp rx=0 tx=0).stop 2024-08-18T21:09:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb4517fa640 1 -- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb45402d710 msgr2=0x7fb45402db20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb4517fa640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb45402d710 0x7fb45402db20 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00d4c0 tx=0x7fb43c004950 comp rx=0 tx=0).stop 2024-08-18T21:09:56.589 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 93398, 2024-08-18T21:09:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:56.591 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:56.591 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:56.591 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:56.591 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:09:56.591 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:56.591 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:56.591 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:56.591 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:56.591 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:56.591 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:56.591 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:56.591 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:56.591 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:56.591 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:56.592 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:56.592 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:56.592 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:56.592 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:56.592 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:56.592 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:56.592 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:56.592 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:56.592 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:56.592 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:56.592 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:56.592 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:56.592 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:56.592 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:56.593 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:56.593 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:56.593 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:56.593 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:56.593 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.593 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:56.593 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:56.593 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:56.594 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:56.594 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:56.594 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:56.594 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:56.594 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:56.594 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:56.594 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:56.594 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:56.594 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:56.594 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:56.594 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:56.594 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:56.594 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:56.595 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:56.595 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:56.595 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:56.595 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:56.595 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:56.595 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:56.595 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:56.595 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:56.595 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:56.595 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:56.595 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:56.595 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:56.595 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:56.596 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:56.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.596 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:56.596 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.596 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:56.596 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:56.596 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.596 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.596 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.596 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.596 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:56.596 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:56.599 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.599 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.599 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.599 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.599 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:56.599 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:56.599 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.599 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.599 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.599 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.599 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.599 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:56.599 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:56.599 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.600 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.600 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.600 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.600 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:56.600 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.600 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.600 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.600 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:56.600 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.600 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.600 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.601 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:56.601 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:56.601 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.601 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.601 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.601 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.601 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:56.601 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:56.601 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.601 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.601 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.601 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.602 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:56.602 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.602 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.602 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.602 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:56.602 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.602 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.602 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.602 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:56.602 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:56.602 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.603 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.603 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.603 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.603 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.603 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:56.603 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:56.603 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.603 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.603 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.603 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.603 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:56.603 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.603 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.604 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.604 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.604 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:56.604 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.604 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.604 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.604 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:56.604 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:56.604 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.604 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.604 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.604 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.605 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:56.605 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:56.605 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.605 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.605 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.605 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.605 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:56.605 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.605 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.605 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.605 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:56.605 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.606 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.606 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.606 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:56.606 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:56.606 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.606 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.606 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.606 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.606 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:56.606 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:56.606 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.607 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.607 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.607 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.607 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:56.607 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.607 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.607 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.607 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:56.607 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.607 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.607 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.608 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:56.608 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:56.608 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.608 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.608 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.608 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.608 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:56.608 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:56.608 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.608 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.608 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.608 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.608 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:56.609 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.609 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.609 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.609 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:56.609 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.609 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.609 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.609 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:56.609 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:56.609 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.609 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.609 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.610 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.610 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:56.610 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:56.610 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.610 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.610 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.610 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.610 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:56.610 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.610 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.610 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.611 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:56.611 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.611 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.611 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.611 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:56.611 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:56.611 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.611 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.611 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.611 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.611 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.612 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:56.612 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:56.612 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.612 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:56.612 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:56.612 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:56.612 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.612 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:56.612 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:56.612 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.612 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:56.612 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:56.612 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:09:56.612 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.613 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.613 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:56.613 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:56.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb45a81b640 1 -- 172.21.15.5:0/2405368891 >> v2:172.21.15.157:6812/631023601 conn(0x7fb43403bdc0 msgr2=0x7fb43403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb45a81b640 1 --2- 172.21.15.5:0/2405368891 >> v2:172.21.15.157:6812/631023601 conn(0x7fb43403bdc0 0x7fb43403e280 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009fa0 tx=0x7fb44c00d040 comp rx=0 tx=0).stop 2024-08-18T21:09:56.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb45a81b640 10 monclient: shutdown 2024-08-18T21:09:56.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb45a81b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:56.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb45a81b640 1 -- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb4540a4000 msgr2=0x7fb4541371e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb45a81b640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb4540a4000 0x7fb4541371e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb44401c1b0 tx=0x7fb444019120 comp rx=0 tx=0).stop 2024-08-18T21:09:56.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb458db8640 1 -- 172.21.15.5:0/2405368891 reap_dead start 2024-08-18T21:09:56.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb45a81b640 1 -- 172.21.15.5:0/2405368891 shutdown_connections 2024-08-18T21:09:56.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb45a81b640 1 --2- 172.21.15.5:0/2405368891 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb4540a4000 0x7fb4541371e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb45a81b640 1 -- 172.21.15.5:0/2405368891 >> 172.21.15.5:0/2405368891 conn(0x7fb4540a50f0 msgr2=0x7fb454074230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:56.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb45a81b640 1 -- 172.21.15.5:0/2405368891 shutdown_connections 2024-08-18T21:09:56.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.569+0000 7fb45a81b640 1 -- 172.21.15.5:0/2405368891 wait complete. 2024-08-18T21:09:56.615 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:56.616 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:09:56.616 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:09:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 10 monclient: get_monmap_and_config 2024-08-18T21:09:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 10 monclient: build_initial_monmap 2024-08-18T21:09:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 10 monclient: monmap: 2024-08-18T21:09:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:56.744695+0000 2024-08-18T21:09:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:56.744695+0000 2024-08-18T21:09:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:56.745 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 1 Processor -- start 2024-08-18T21:09:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 1 -- start start 2024-08-18T21:09:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 10 monclient: init 2024-08-18T21:09:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 10 monclient: _add_conns ranks=[8,10,2,3,1,7,6,9,4,5,0] 2024-08-18T21:09:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6f00a6bd0 0x7ff6f00a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 10 monclient(hunting): picked mon.noname-e con 0x7ff6f00a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff6f009f080 0x7ff6f00a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 10 monclient(hunting): picked mon.noname-f con 0x7ff6f009f080 addr v2:172.21.15.157:3300/0 2024-08-18T21:09:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff6f0139990 0x7ff6f0139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 10 monclient(hunting): picked mon.noname-b con 0x7ff6f0139990 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff6f009e4c0 con 0x7ff6f009f080 2024-08-18T21:09:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f006f930 con 0x7ff6f0139990 2024-08-18T21:09:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff6f00a7a30 con 0x7ff6f00a6bd0 2024-08-18T21:09:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f6a80640 10 monclient(hunting): authenticate will time out at 1363.757841s 2024-08-18T21:09:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff6f0139990 0x7ff6f0139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f481c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6f00a6bd0 0x7ff6f00a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff6f0139990 0x7ff6f0139e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:51120/0 (socket says 172.21.15.5:51120) 2024-08-18T21:09:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 1 -- 172.21.15.5:0/1053607870 learned_addr learned my addr 172.21.15.5:0/1053607870 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 10 monclient(hunting): get_auth_request con 0x7ff6f0139990 auth_method 0 2024-08-18T21:09:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f481c640 10 monclient(hunting): get_auth_request con 0x7ff6f00a6bd0 auth_method 0 2024-08-18T21:09:56.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f481c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f481c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f481c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f481c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f481c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f481c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6effff640 1 --2- 172.21.15.5:0/1053607870 >> v2:172.21.15.157:3300/0 conn(0x7ff6f009f080 0x7ff6f00a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 10 monclient(hunting): handle_auth_done global_id 84548 payload 274 2024-08-18T21:09:56.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 1 -- 172.21.15.5:0/1053607870 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6f00a6bd0 msgr2=0x7ff6f00a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:56.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 1 --2- 172.21.15.5:0/1053607870 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6f00a6bd0 0x7ff6f00a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 1 -- 172.21.15.5:0/1053607870 >> v2:172.21.15.157:3300/0 conn(0x7ff6f009f080 msgr2=0x7ff6f00a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:56.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 1 --2- 172.21.15.5:0/1053607870 >> v2:172.21.15.157:3300/0 conn(0x7ff6f009f080 0x7ff6f00a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 10 monclient: _finish_hunting 0 2024-08-18T21:09:56.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 1 monclient: found mon.noname-b 2024-08-18T21:09:56.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:56.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:09:56.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6f501d640 1 -- 172.21.15.5:0/1053607870 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f00a7fb0 con 0x7ff6f0139990 2024-08-18T21:09:56.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6effff640 10 monclient: get_auth_request con 0x7ff6f009f080 auth_method 0 2024-08-18T21:09:56.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.741+0000 7ff6effff640 1 --2- 172.21.15.5:0/1053607870 >> v2:172.21.15.157:3300/0 conn(0x7ff6f009f080 0x7ff6f00a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:09:56.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f501d640 1 -- 172.21.15.5:0/1053607870 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff6f0139990 msgr2=0x7ff6f0139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:56.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f501d640 1 --2- 172.21.15.5:0/1053607870 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff6f0139990 0x7ff6f0139e10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009e50 tx=0x7ff6e801c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11edee866fd61a6c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6ef7fe640 1 -- 172.21.15.5:0/1053607870 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff6e80090d0 con 0x7ff6f0139990 2024-08-18T21:09:56.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6ef7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:09:56.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6ef7fe640 10 monclient: dump: 2024-08-18T21:09:56.757 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.757 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.757 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.757 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.757 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.758 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6ef7fe640 10 monclient: _finish_auth 0 2024-08-18T21:09:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6ef7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:09:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6ef7fe640 1 -- 172.21.15.5:0/1053607870 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e80a5a90 con 0x7ff6f0139990 2024-08-18T21:09:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f6a80640 5 monclient: authenticate success, global_id 84548 2024-08-18T21:09:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f6a80640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6ef7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f6a80640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6ef7fe640 1 -- 172.21.15.5:0/1053607870 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff6e80a5c40 con 0x7ff6f0139990 2024-08-18T21:09:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f6a80640 4 set_mon_vals no callback set 2024-08-18T21:09:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6ef7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6ef7fe640 10 monclient: dump: 2024-08-18T21:09:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.760 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f6a80640 10 monclient: shutdown 2024-08-18T21:09:56.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f6a80640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:56.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f6a80640 1 -- 172.21.15.5:0/1053607870 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff6f0139990 msgr2=0x7ff6f0139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f6a80640 1 --2- 172.21.15.5:0/1053607870 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff6f0139990 0x7ff6f0139e10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009e50 tx=0x7ff6e801c8f0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f6a80640 1 -- 172.21.15.5:0/1053607870 shutdown_connections 2024-08-18T21:09:56.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f6a80640 1 --2- 172.21.15.5:0/1053607870 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff6f0139990 0x7ff6f0139e10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f6a80640 1 --2- 172.21.15.5:0/1053607870 >> v2:172.21.15.157:3300/0 conn(0x7ff6f009f080 0x7ff6f00a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f6a80640 1 --2- 172.21.15.5:0/1053607870 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6f00a6bd0 0x7ff6f00a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f6a80640 1 -- 172.21.15.5:0/1053607870 >> 172.21.15.5:0/1053607870 conn(0x7ff6f0068700 msgr2=0x7ff6f0068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:56.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f6a80640 1 -- 172.21.15.5:0/1053607870 shutdown_connections 2024-08-18T21:09:56.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.745+0000 7ff6f6a80640 1 -- 172.21.15.5:0/1053607870 wait complete. 2024-08-18T21:09:56.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 10 monclient: build_initial_monmap 2024-08-18T21:09:56.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 10 monclient: monmap: 2024-08-18T21:09:56.762 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:56.762 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:56.762 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:56.762 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:56.762 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:56.762 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.762 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:56.762 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:56.762 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:56.762 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:56.762 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:56.762 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:56.762 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:56.763 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:56.763 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:56.763 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 1 Processor -- start 2024-08-18T21:09:56.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 1 -- start start 2024-08-18T21:09:56.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 10 monclient: init 2024-08-18T21:09:56.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:56.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 10 monclient: _add_conns ranks=[4,6,5,8,1,7,2,0,3] 2024-08-18T21:09:56.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f009f080 0x7ff6f01383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 10 monclient(hunting): picked mon.noname-c con 0x7ff6f009f080 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:56.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff6f00a6bd0 0x7ff6f01388f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 10 monclient(hunting): picked mon.noname-d con 0x7ff6f00a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:56.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff6f0139990 0x7ff6f013d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 10 monclient(hunting): picked mon.noname-h con 0x7ff6f0139990 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff6f00a89f0 con 0x7ff6f009f080 2024-08-18T21:09:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7ff6f00a7ce0 con 0x7ff6f0139990 2024-08-18T21:09:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7ff6f0143610 con 0x7ff6f00a6bd0 2024-08-18T21:09:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f6a80640 10 monclient(hunting): authenticate will time out at 1363.765049s 2024-08-18T21:09:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6effff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff6f00a6bd0 0x7ff6f01388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f009f080 0x7ff6f01383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6effff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff6f00a6bd0 0x7ff6f01388f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54432/0 (socket says 172.21.15.5:54432) 2024-08-18T21:09:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6effff640 1 -- 172.21.15.5:0/1170251351 learned_addr learned my addr 172.21.15.5:0/1170251351 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 10 monclient(hunting): get_auth_request con 0x7ff6f009f080 auth_method 0 2024-08-18T21:09:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6effff640 10 monclient(hunting): get_auth_request con 0x7ff6f00a6bd0 auth_method 0 2024-08-18T21:09:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6effff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6effff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f501d640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff6f0139990 0x7ff6f013d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 10 monclient(hunting): handle_auth_done global_id 6205 payload 824 2024-08-18T21:09:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 1 -- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff6f00a6bd0 msgr2=0x7ff6f01388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff6f00a6bd0 0x7ff6f01388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 1 -- 172.21.15.5:0/1170251351 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff6f0139990 msgr2=0x7ff6f013d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff6f0139990 0x7ff6f013d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 10 monclient: _finish_hunting 0 2024-08-18T21:09:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 1 monclient: found mon.noname-c 2024-08-18T21:09:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:09:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 1 -- 172.21.15.5:0/1170251351 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f0123ed0 con 0x7ff6f009f080 2024-08-18T21:09:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f501d640 10 monclient: get_auth_request con 0x7ff6f0139990 auth_method 0 2024-08-18T21:09:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f501d640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff6f0139990 0x7ff6f013d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:09:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6effff640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff6f00a6bd0 0x7ff6f01388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 1 -- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f009f080 msgr2=0x7ff6f01383b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.749+0000 7ff6f481c640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f009f080 0x7ff6f01383b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000e8a0 tx=0x7ff6e000ed60 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 1 -- 172.21.15.5:0/1170251351 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff6e0017070 con 0x7ff6f009f080 2024-08-18T21:09:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:09:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 10 monclient: dump: 2024-08-18T21:09:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.768 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 10 monclient: _finish_auth 0 2024-08-18T21:09:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 10 monclient: _check_auth_tickets 2024-08-18T21:09:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 1 -- 172.21.15.5:0/1170251351 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e0013470 con 0x7ff6f009f080 2024-08-18T21:09:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6f6a80640 5 monclient: authenticate success, global_id 6205 2024-08-18T21:09:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6f6a80640 10 monclient: _renew_subs 2024-08-18T21:09:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6f6a80640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:09:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6f6a80640 1 -- 172.21.15.5:0/1170251351 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f013fb10 con 0x7ff6f009f080 2024-08-18T21:09:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 1 -- 172.21.15.5:0/1170251351 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff6e0013a90 con 0x7ff6f009f080 2024-08-18T21:09:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 10 monclient: dump: 2024-08-18T21:09:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.770 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6f6a80640 10 monclient: _renew_subs 2024-08-18T21:09:56.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6f6a80640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:09:56.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6f6a80640 1 -- 172.21.15.5:0/1170251351 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f01241b0 con 0x7ff6f009f080 2024-08-18T21:09:56.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6eeffd640 4 set_mon_vals no callback set 2024-08-18T21:09:56.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6f6a80640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:56.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6f6a80640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f013de30 0x7ff6f013e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6f6a80640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6f6a80640 1 -- 172.21.15.5:0/1170251351 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff6f0051140 con 0x7ff6f013de30 2024-08-18T21:09:56.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6effff640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f013de30 0x7ff6f013e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6effff640 10 monclient: get_auth_request con 0x7ff6f013de30 auth_method 0 2024-08-18T21:09:56.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6effff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6effff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 1 -- 172.21.15.5:0/1170251351 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7ff6e001a070 con 0x7ff6f009f080 2024-08-18T21:09:56.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6effff640 10 monclient(hunting): handle_auth_done global_id 6214 payload 824 2024-08-18T21:09:56.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6effff640 1 -- 172.21.15.5:0/1170251351 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6f00ab4a0 con 0x7ff6f013de30 2024-08-18T21:09:56.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 1 --2- 172.21.15.5:0/1170251351 >> v2:172.21.15.157:6812/631023601 conn(0x7ff6dc03bdc0 0x7ff6dc03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 1 -- 172.21.15.5:0/1170251351 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(180..180 src has 22..180) ==== 3898+0+0 (secure 0 0 0) 0x7ff6e000f040 con 0x7ff6f009f080 2024-08-18T21:09:56.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6f501d640 1 --2- 172.21.15.5:0/1170251351 >> v2:172.21.15.157:6812/631023601 conn(0x7ff6dc03bdc0 0x7ff6dc03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6f501d640 10 monclient: get_auth_request con 0x7ff6dc03bdc0 auth_method 0 2024-08-18T21:09:56.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6effff640 1 -- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f013de30 msgr2=0x7ff6f013e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:56.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6effff640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f013de30 0x7ff6f013e210 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0139960 tx=0x7ff6e400d590 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 1 -- 172.21.15.5:0/1170251351 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff6e400dea0 con 0x7ff6f013de30 2024-08-18T21:09:56.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:56.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.753+0000 7ff6ed7fa640 10 monclient: dump: 2024-08-18T21:09:56.779 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.779 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.779 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.779 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.779 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.779 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.779 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.779 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.780 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.780 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.780 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.780 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.780 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.780 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.780 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.780 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.757+0000 7ff6ed7fa640 1 -- 172.21.15.5:0/1170251351 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff6e4013650 con 0x7ff6f013de30 2024-08-18T21:09:56.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.757+0000 7ff6ed7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:56.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.757+0000 7ff6ed7fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:56.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.757+0000 7ff6ed7fa640 1 -- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f013de30 msgr2=0x7ff6f013e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.757+0000 7ff6ed7fa640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f013de30 0x7ff6f013e210 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0139960 tx=0x7ff6e400d590 comp rx=0 tx=0).stop 2024-08-18T21:09:56.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.757+0000 7ff6ed7fa640 1 -- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f013de30 msgr2=0x7ff6f013e210 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:56.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.757+0000 7ff6ed7fa640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f013de30 0x7ff6f013e210 secure :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0139960 tx=0x7ff6e400d590 comp rx=0 tx=0).stop 2024-08-18T21:09:56.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.757+0000 7ff6f501d640 1 --2- 172.21.15.5:0/1170251351 >> v2:172.21.15.157:6812/631023601 conn(0x7ff6dc03bdc0 0x7ff6dc03e280 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80ab000 tx=0x7ff6e80a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.761+0000 7ff6f6a80640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:56.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.761+0000 7ff6f6a80640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f013e750 0x7ff6f00a4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.761+0000 7ff6f6a80640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.761+0000 7ff6f6a80640 1 -- 172.21.15.5:0/1170251351 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff6f00aafe0 con 0x7ff6f013e750 2024-08-18T21:09:56.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.761+0000 7ff6effff640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f013e750 0x7ff6f00a4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.761+0000 7ff6effff640 10 monclient: get_auth_request con 0x7ff6f013e750 auth_method 0 2024-08-18T21:09:56.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.761+0000 7ff6effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.761+0000 7ff6effff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.761+0000 7ff6effff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.761+0000 7ff6effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.761+0000 7ff6effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.761+0000 7ff6effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.761+0000 7ff6effff640 10 monclient(hunting): handle_auth_done global_id 6223 payload 824 2024-08-18T21:09:56.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.761+0000 7ff6effff640 1 -- 172.21.15.5:0/1170251351 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff6f0139e10 con 0x7ff6f013e750 2024-08-18T21:09:56.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6effff640 1 -- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f013e750 msgr2=0x7ff6f00a4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:56.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6effff640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f013e750 0x7ff6f00a4040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0139960 tx=0x7ff6e4004740 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6ed7fa640 1 -- 172.21.15.5:0/1170251351 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff6e4013c20 con 0x7ff6f013e750 2024-08-18T21:09:56.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6ed7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:56.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6ed7fa640 10 monclient: dump: 2024-08-18T21:09:56.782 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.782 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.782 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.782 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.783 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.783 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.783 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.783 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.783 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.783 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.783 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.783 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.784 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6ed7fa640 1 -- 172.21.15.5:0/1170251351 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7ff6e4013c20 con 0x7ff6f013e750 2024-08-18T21:09:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6ed7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6ed7fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6ed7fa640 1 -- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f013e750 msgr2=0x7ff6f00a4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6ed7fa640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f013e750 0x7ff6f00a4040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0139960 tx=0x7ff6e4004740 comp rx=0 tx=0).stop 2024-08-18T21:09:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6ed7fa640 1 -- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f013e750 msgr2=0x7ff6f00a4040 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6ed7fa640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f013e750 0x7ff6f00a4040 secure :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0139960 tx=0x7ff6e4004740 comp rx=0 tx=0).stop 2024-08-18T21:09:56.785 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:56.785 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:56.785 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:56.785 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:56.785 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:56.785 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 405883, 2024-08-18T21:09:56.785 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:56.785 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:56.785 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:56.785 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:56.786 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:56.786 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:56.786 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:56.786 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:56.786 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:56.786 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:56.786 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:56.786 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:09:56.786 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:56.786 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:56.786 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:56.786 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:56.787 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:56.787 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:56.787 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:56.787 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:56.787 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:56.787 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:56.787 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:56.787 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:56.787 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:56.787 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:56.787 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:56.787 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:56.787 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:56.788 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:56.788 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:56.788 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:56.788 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:56.788 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:56.788 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:56.788 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:56.788 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:56.788 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:56.788 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:56.788 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:56.788 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.789 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:56.789 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:56.789 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:56.789 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:56.789 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:56.789 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:56.789 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:56.789 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:56.789 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:56.789 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:56.789 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:56.789 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:56.789 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:56.789 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:56.790 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:56.790 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:56.790 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:56.790 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:56.790 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:56.791 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:56.791 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:56.792 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:56.792 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:56.792 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:56.792 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:56.792 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:56.792 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:56.793 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:56.793 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:56.793 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:56.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.793 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:56.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.793 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:56.793 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:56.794 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.794 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.794 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.794 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:56.794 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.794 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.794 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:56.794 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.794 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.795 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.795 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:56.795 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:56.795 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.795 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.795 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.795 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:56.795 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:56.795 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.795 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.797 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:56.797 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:56.797 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.797 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.797 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.798 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:56.798 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:56.798 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.798 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.798 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.798 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:56.798 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.798 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.798 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:56.799 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.799 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.799 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.799 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:56.799 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:56.799 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.799 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.799 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.799 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:56.799 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:56.800 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.800 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.800 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.800 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:56.800 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.800 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.800 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:56.800 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.800 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.800 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.801 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:56.801 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:56.801 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.801 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.801 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.801 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:56.801 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:56.801 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.801 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.801 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.802 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:56.802 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.802 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.802 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:56.802 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.802 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.802 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.802 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:56.802 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.806 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.806 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:56.806 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.806 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.806 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.806 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:56.806 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:56.806 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.806 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.806 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.806 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.807 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:56.807 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:56.807 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.807 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.807 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.807 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.807 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:56.807 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.807 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.807 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.807 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:56.807 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.807 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.808 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.808 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:56.808 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:56.808 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.808 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.808 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.808 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.808 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:56.808 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:56.808 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.808 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.809 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.809 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:56.809 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.809 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.809 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:56.809 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.809 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.809 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.809 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:56.809 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:56.810 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.810 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.810 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.810 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.810 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.810 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:56.810 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:56.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.810 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:56.810 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:56.810 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:56.811 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.811 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:56.811 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:09:56.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.811 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:56.811 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:56.811 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:56.811 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.811 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:56.812 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:56.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.812 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:56.812 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:56.812 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:09:56.812 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.812 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.812 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:56.812 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:56.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6f6a80640 1 -- 172.21.15.5:0/1170251351 >> v2:172.21.15.157:6812/631023601 conn(0x7ff6dc03bdc0 msgr2=0x7ff6dc03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6f6a80640 1 --2- 172.21.15.5:0/1170251351 >> v2:172.21.15.157:6812/631023601 conn(0x7ff6dc03bdc0 0x7ff6dc03e280 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80ab000 tx=0x7ff6e80a7070 comp rx=0 tx=0).stop 2024-08-18T21:09:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6f6a80640 10 monclient: shutdown 2024-08-18T21:09:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6f6a80640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6f6a80640 1 -- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f009f080 msgr2=0x7ff6f01383b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6f6a80640 1 --2- 172.21.15.5:0/1170251351 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff6f009f080 0x7ff6f01383b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000e8a0 tx=0x7ff6e000ed60 comp rx=0 tx=0).stop 2024-08-18T21:09:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6f501d640 1 -- 172.21.15.5:0/1170251351 reap_dead start 2024-08-18T21:09:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6f501d640 1 -- 172.21.15.5:0/1170251351 reap_dead start 2024-08-18T21:09:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6f6a80640 1 -- 172.21.15.5:0/1170251351 shutdown_connections 2024-08-18T21:09:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6f6a80640 1 -- 172.21.15.5:0/1170251351 >> 172.21.15.5:0/1170251351 conn(0x7ff6f0068700 msgr2=0x7ff6f00ab9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6f6a80640 1 -- 172.21.15.5:0/1170251351 shutdown_connections 2024-08-18T21:09:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.765+0000 7ff6f6a80640 1 -- 172.21.15.5:0/1170251351 wait complete. 2024-08-18T21:09:56.815 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:56.815 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:09:56.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:09:56.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2469523473}) 2024-08-18T21:09:56.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3350170620}) 2024-08-18T21:09:56.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2469523473}) 2024-08-18T21:09:56.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2839575682}) 2024-08-18T21:09:56.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2469523473}) 2024-08-18T21:09:56.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3785406775}) 2024-08-18T21:09:56.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2469523473}) 2024-08-18T21:09:56.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3257985872}) 2024-08-18T21:09:56.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2469523473}) 2024-08-18T21:09:56.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3349494113}) 2024-08-18T21:09:56.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2469523473}) 2024-08-18T21:09:56.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4108853577}) 2024-08-18T21:09:56.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2469523473}) 2024-08-18T21:09:56.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1678221011}) 2024-08-18T21:09:56.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2469523473}) 2024-08-18T21:09:56.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.893+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3392354459}) 2024-08-18T21:09:56.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=900876034}) 2024-08-18T21:09:56.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3712863852}) 2024-08-18T21:09:56.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=900876034}) 2024-08-18T21:09:56.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3582616231}) 2024-08-18T21:09:56.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=900876034}) 2024-08-18T21:09:56.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2404255852}) 2024-08-18T21:09:56.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=900876034}) 2024-08-18T21:09:56.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3806718834}) 2024-08-18T21:09:56.911 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.911 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=900876034}) 2024-08-18T21:09:56.911 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3692964719}) 2024-08-18T21:09:56.911 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.911 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=900876034}) 2024-08-18T21:09:56.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2605278904}) 2024-08-18T21:09:56.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=900876034}) 2024-08-18T21:09:56.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=776387787}) 2024-08-18T21:09:56.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:56.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=900876034}) 2024-08-18T21:09:56.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:56.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3878047929}) 2024-08-18T21:09:56.917 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30365]: starting. 2024-08-18T21:09:56.917 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30365]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30363 2024-08-18T21:09:56.918 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30365]: shutting down. 2024-08-18T21:09:56.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 10 monclient: get_monmap_and_config 2024-08-18T21:09:56.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 10 monclient: build_initial_monmap 2024-08-18T21:09:56.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 10 monclient: monmap: 2024-08-18T21:09:56.948 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:56.949925+0000 2024-08-18T21:09:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:56.949925+0000 2024-08-18T21:09:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:56.950 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:56.950 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:56.950 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 1 Processor -- start 2024-08-18T21:09:56.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 1 -- start start 2024-08-18T21:09:56.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 10 monclient: init 2024-08-18T21:09:56.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:56.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 10 monclient: _add_conns ranks=[6,10,1,2,5,7,4,3,9,8,0] 2024-08-18T21:09:56.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca0136a80 0x7f7ca00a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 10 monclient(hunting): picked mon.noname-d con 0x7f7ca0136a80 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:56.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7ca009e040 0x7f7ca0136e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 10 monclient(hunting): picked mon.noname-f con 0x7f7ca009e040 addr v2:172.21.15.157:3300/0 2024-08-18T21:09:56.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7ca00a4880 addr v1:172.21.15.157:6789/0 2024-08-18T21:09:56.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca00a1110 con 0x7f7ca00a4880 2024-08-18T21:09:56.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7ca009fbf0 con 0x7f7ca009e040 2024-08-18T21:09:56.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f7ca009e500 con 0x7f7ca0136a80 2024-08-18T21:09:56.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:56.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7ca5d78640 10 monclient(hunting): authenticate will time out at 1363.963400s 2024-08-18T21:09:56.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca0136a80 0x7f7ca00a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca0136a80 0x7f7ca00a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54440/0 (socket says 172.21.15.5:54440) 2024-08-18T21:09:56.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 1 -- 172.21.15.5:0/1150814027 learned_addr learned my addr 172.21.15.5:0/1150814027 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:56.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 10 monclient(hunting): get_auth_request con 0x7f7ca0136a80 auth_method 0 2024-08-18T21:09:56.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c97fff640 1 --2- 172.21.15.5:0/1150814027 >> v2:172.21.15.157:3300/0 conn(0x7f7ca009e040 0x7f7ca0136e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c97fff640 10 monclient(hunting): get_auth_request con 0x7f7ca009e040 auth_method 0 2024-08-18T21:09:56.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c97fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c97fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c97fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c97fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c97fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c97fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 10 monclient(hunting): handle_auth_done global_id 84705 payload 274 2024-08-18T21:09:56.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 1 -- 172.21.15.5:0/1150814027 >> v2:172.21.15.157:3300/0 conn(0x7f7ca009e040 msgr2=0x7f7ca0136e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:56.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 1 --2- 172.21.15.5:0/1150814027 >> v2:172.21.15.157:3300/0 conn(0x7f7ca009e040 0x7f7ca0136e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 1 -- 172.21.15.5:0/1150814027 >> v1:172.21.15.157:6789/0 conn(0x7f7ca00a4880 legacy=0x7f7ca00a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:56.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:09:56.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 1 monclient: found mon.noname-d 2024-08-18T21:09:56.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:56.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:09:56.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.945+0000 7f7c9f7fe640 1 -- 172.21.15.5:0/1150814027 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca009f5a0 con 0x7f7ca0136a80 2024-08-18T21:09:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 1 -- 172.21.15.5:0/1150814027 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca0136a80 msgr2=0x7f7ca00a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 1 --2- 172.21.15.5:0/1150814027 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca0136a80 0x7f7ca00a0bd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009870 tx=0x7f7c9001c100 comp rx=0 tx=0).ready entity=mon.6 client_cookie=3bdc4d808957e958 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9effd640 1 -- 172.21.15.5:0/1150814027 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7c900b1070 con 0x7f7ca0136a80 2024-08-18T21:09:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:09:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9effd640 10 monclient: dump: 2024-08-18T21:09:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.961 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9effd640 10 monclient: _finish_auth 0 2024-08-18T21:09:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9effd640 10 monclient: _check_auth_tickets 2024-08-18T21:09:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 5 monclient: authenticate success, global_id 84705 2024-08-18T21:09:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9effd640 1 -- 172.21.15.5:0/1150814027 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c900a4b30 con 0x7f7ca0136a80 2024-08-18T21:09:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 4 set_mon_vals no callback set 2024-08-18T21:09:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9effd640 1 -- 172.21.15.5:0/1150814027 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7c900a4ce0 con 0x7f7ca0136a80 2024-08-18T21:09:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:09:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9effd640 10 monclient: dump: 2024-08-18T21:09:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.964 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 10 monclient: shutdown 2024-08-18T21:09:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 1 -- 172.21.15.5:0/1150814027 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca0136a80 msgr2=0x7f7ca00a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 1 --2- 172.21.15.5:0/1150814027 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca0136a80 0x7f7ca00a0bd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009870 tx=0x7f7c9001c100 comp rx=0 tx=0).stop 2024-08-18T21:09:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 1 -- 172.21.15.5:0/1150814027 shutdown_connections 2024-08-18T21:09:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 1 --2- 172.21.15.5:0/1150814027 >> v2:172.21.15.157:3300/0 conn(0x7f7ca009e040 0x7f7ca0136e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 1 --2- 172.21.15.5:0/1150814027 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca0136a80 0x7f7ca00a0bd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 1 -- 172.21.15.5:0/1150814027 >> 172.21.15.5:0/1150814027 conn(0x7f7ca00a6490 msgr2=0x7f7ca0068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 1 -- 172.21.15.5:0/1150814027 shutdown_connections 2024-08-18T21:09:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 1 -- 172.21.15.5:0/1150814027 wait complete. 2024-08-18T21:09:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 10 monclient: build_initial_monmap 2024-08-18T21:09:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 10 monclient: monmap: 2024-08-18T21:09:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:56.966 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 1 Processor -- start 2024-08-18T21:09:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 1 -- start start 2024-08-18T21:09:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 10 monclient: init 2024-08-18T21:09:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 10 monclient: _add_conns ranks=[4,7,3,5,0,2,8,1,6] 2024-08-18T21:09:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7ca009e040 0x7f7ca01d1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 10 monclient(hunting): picked mon.noname-c con 0x7f7ca009e040 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7ca00a4880 0x7f7ca01d23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 10 monclient(hunting): picked mon.noname-i con 0x7f7ca00a4880 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ca0136a80 0x7f7ca01d2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 10 monclient(hunting): picked mon.noname-g con 0x7f7ca0136a80 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:09:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca0141c60 con 0x7f7ca0136a80 2024-08-18T21:09:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f7ca0141ae0 con 0x7f7ca009e040 2024-08-18T21:09:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7ca0141de0 con 0x7f7ca00a4880 2024-08-18T21:09:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7ca5d78640 10 monclient(hunting): authenticate will time out at 1363.971183s 2024-08-18T21:09:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7ca009e040 0x7f7ca01d1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7ca009e040 0x7f7ca01d1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:43064/0 (socket says 172.21.15.5:43064) 2024-08-18T21:09:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 1 -- 172.21.15.5:0/3940695810 learned_addr learned my addr 172.21.15.5:0/3940695810 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 10 monclient(hunting): get_auth_request con 0x7f7ca009e040 auth_method 0 2024-08-18T21:09:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 10 monclient(hunting): handle_auth_done global_id 6241 payload 824 2024-08-18T21:09:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 1 -- 172.21.15.5:0/3940695810 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7ca00a4880 msgr2=0x7f7ca01d23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 1 --2- 172.21.15.5:0/3940695810 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7ca00a4880 0x7f7ca01d23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 1 -- 172.21.15.5:0/3940695810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ca0136a80 msgr2=0x7f7ca01d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 1 --2- 172.21.15.5:0/3940695810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ca0136a80 0x7f7ca01d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:09:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 1 monclient: found mon.noname-c 2024-08-18T21:09:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:09:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.953+0000 7f7c9f7fe640 1 -- 172.21.15.5:0/3940695810 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca00726f0 con 0x7f7ca009e040 2024-08-18T21:09:56.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9f7fe640 1 -- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7ca009e040 msgr2=0x7f7ca01d1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:56.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9f7fe640 1 --2- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7ca009e040 0x7f7ca01d1e90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c900097c0 tx=0x7f7c900191c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9cff9640 1 -- 172.21.15.5:0/3940695810 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7c900b1050 con 0x7f7ca009e040 2024-08-18T21:09:56.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:09:56.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9cff9640 10 monclient: dump: 2024-08-18T21:09:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.974 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9cff9640 10 monclient: _finish_auth 0 2024-08-18T21:09:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9cff9640 10 monclient: _check_auth_tickets 2024-08-18T21:09:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9cff9640 1 -- 172.21.15.5:0/3940695810 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c900bd070 con 0x7f7ca009e040 2024-08-18T21:09:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9cff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9cff9640 1 -- 172.21.15.5:0/3940695810 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7c900b8450 con 0x7f7ca009e040 2024-08-18T21:09:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9cff9640 10 monclient: dump: 2024-08-18T21:09:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.975 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.975 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.975 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.975 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.975 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.975 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.975 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.975 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.977 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.978 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.978 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.978 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.978 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.978 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.978 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9dffb640 4 set_mon_vals no callback set 2024-08-18T21:09:56.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7ca5d78640 5 monclient: authenticate success, global_id 6241 2024-08-18T21:09:56.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7ca5d78640 10 monclient: _renew_subs 2024-08-18T21:09:56.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7ca5d78640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:09:56.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7ca5d78640 1 -- 172.21.15.5:0/3940695810 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca00722c0 con 0x7f7ca009e040 2024-08-18T21:09:56.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7ca5d78640 10 monclient: _renew_subs 2024-08-18T21:09:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7ca5d78640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:09:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7ca5d78640 1 -- 172.21.15.5:0/3940695810 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca0135470 con 0x7f7ca009e040 2024-08-18T21:09:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7ca5d78640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7ca5d78640 1 --2- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca01305d0 0x7f7ca01309b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7ca5d78640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7ca5d78640 1 -- 172.21.15.5:0/3940695810 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f7ca01350f0 con 0x7f7ca01305d0 2024-08-18T21:09:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9cff9640 1 -- 172.21.15.5:0/3940695810 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f7c90003620 con 0x7f7ca009e040 2024-08-18T21:09:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c97fff640 1 --2- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca01305d0 0x7f7ca01309b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c97fff640 10 monclient: get_auth_request con 0x7f7ca01305d0 auth_method 0 2024-08-18T21:09:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c97fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c97fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c97fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c97fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c97fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c97fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9cff9640 1 --2- 172.21.15.5:0/3940695810 >> v2:172.21.15.157:6812/631023601 conn(0x7f7c8003bdc0 0x7f7c8003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c97fff640 10 monclient(hunting): handle_auth_done global_id 84714 payload 824 2024-08-18T21:09:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9cff9640 1 -- 172.21.15.5:0/3940695810 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(181..181 src has 22..181) ==== 3506+0+0 (secure 0 0 0) 0x7f7c900e8710 con 0x7f7ca009e040 2024-08-18T21:09:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c97fff640 1 -- 172.21.15.5:0/3940695810 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ca0136e60 con 0x7f7ca01305d0 2024-08-18T21:09:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9ffff640 1 --2- 172.21.15.5:0/3940695810 >> v2:172.21.15.157:6812/631023601 conn(0x7f7c8003bdc0 0x7f7c8003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.957+0000 7f7c9ffff640 10 monclient: get_auth_request con 0x7f7c8003bdc0 auth_method 0 2024-08-18T21:09:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.961+0000 7f7c97fff640 1 -- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca01305d0 msgr2=0x7f7ca01309b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.961+0000 7f7c97fff640 1 --2- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca01305d0 0x7f7ca01309b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ca013d5a0 tx=0x7f7c8800ec70 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.961+0000 7f7c9cff9640 1 -- 172.21.15.5:0/3940695810 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7c88017070 con 0x7f7ca01305d0 2024-08-18T21:09:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.961+0000 7f7c9cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.961+0000 7f7c9cff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:09:56.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.961+0000 7f7c9cff9640 10 monclient: dump: 2024-08-18T21:09:56.981 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.981 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.981 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.981 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.981 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.981 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.981 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.981 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.981 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.981 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.981 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.981 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.981 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.982 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.961+0000 7f7c9ffff640 1 --2- 172.21.15.5:0/3940695810 >> v2:172.21.15.157:6812/631023601 conn(0x7f7c8003bdc0 0x7f7c8003e280 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0133a00 tx=0x7f7c98007d40 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.961+0000 7f7c9cff9640 1 -- 172.21.15.5:0/3940695810 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7c8800cb10 con 0x7f7ca01305d0 2024-08-18T21:09:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.961+0000 7f7c9cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.961+0000 7f7c9cff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.961+0000 7f7c9cff9640 1 -- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca01305d0 msgr2=0x7f7ca01309b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.961+0000 7f7c9cff9640 1 --2- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca01305d0 0x7f7ca01309b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ca013d5a0 tx=0x7f7c8800ec70 comp rx=0 tx=0).stop 2024-08-18T21:09:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.961+0000 7f7c9cff9640 1 -- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca01305d0 msgr2=0x7f7ca01309b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.961+0000 7f7c9cff9640 1 --2- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca01305d0 0x7f7ca01309b0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ca013d5a0 tx=0x7f7c8800ec70 comp rx=0 tx=0).stop 2024-08-18T21:09:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7ca5d78640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7ca5d78640 1 --2- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca0130ef0 0x7f7ca0070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:56.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7ca5d78640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:56.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7ca5d78640 1 -- 172.21.15.5:0/3940695810 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f7ca0051140 con 0x7f7ca0130ef0 2024-08-18T21:09:56.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c97fff640 1 --2- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca0130ef0 0x7f7ca0070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:56.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c97fff640 10 monclient: get_auth_request con 0x7f7ca0130ef0 auth_method 0 2024-08-18T21:09:56.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c97fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:56.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c97fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:56.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c97fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:56.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c97fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:56.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c97fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:56.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c97fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:56.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c97fff640 10 monclient(hunting): handle_auth_done global_id 84723 payload 824 2024-08-18T21:09:56.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c97fff640 1 -- 172.21.15.5:0/3940695810 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7ca006e060 con 0x7f7ca0130ef0 2024-08-18T21:09:56.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c97fff640 1 -- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca0130ef0 msgr2=0x7f7ca0070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:56.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c97fff640 1 --2- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca0130ef0 0x7f7ca0070090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7ca006dc30 tx=0x7f7c880046d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:56.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c9cff9640 1 -- 172.21.15.5:0/3940695810 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7c88017070 con 0x7f7ca0130ef0 2024-08-18T21:09:56.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c9cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:56.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c9cff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:09:56.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c9cff9640 10 monclient: dump: 2024-08-18T21:09:56.985 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:56.985 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:56.985 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.985 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:56.985 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:56.985 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:56.985 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:56.985 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:56.986 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:56.986 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:56.986 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:56.986 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:56.986 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:56.986 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:56.986 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:56.986 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:56.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c9cff9640 1 -- 172.21.15.5:0/3940695810 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f7c88006600 con 0x7f7ca0130ef0 2024-08-18T21:09:56.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c9cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:56.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c9cff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:56.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c9cff9640 1 -- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca0130ef0 msgr2=0x7f7ca0070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:56.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c9cff9640 1 --2- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca0130ef0 0x7f7ca0070090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7ca006dc30 tx=0x7f7c880046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c9cff9640 1 -- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca0130ef0 msgr2=0x7f7ca0070090 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:56.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.969+0000 7f7c9cff9640 1 --2- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7ca0130ef0 0x7f7ca0070090 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7ca006dc30 tx=0x7f7c880046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:56.987 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:56.987 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:56.987 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:56.987 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:56.987 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:56.987 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 93798, 2024-08-18T21:09:56.987 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:56.987 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:56.987 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:56.988 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:56.988 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:56.988 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:56.988 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:56.988 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:56.988 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:56.988 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:56.988 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:56.988 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:09:56.988 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:56.988 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:56.988 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:56.988 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:56.989 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:56.989 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:56.989 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:56.989 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:56.989 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:56.989 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:56.989 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:56.989 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:56.989 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:56.989 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:56.989 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:56.990 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:56.990 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:56.990 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:56.990 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:56.990 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:56.990 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:56.990 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:56.990 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:56.990 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:56.990 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:56.990 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:56.990 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:56.991 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:56.991 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.991 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:56.991 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:56.991 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:56.991 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:56.991 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:56.991 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:56.991 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:56.991 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:56.991 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:56.991 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:56.991 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:56.992 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:56.992 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:56.992 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:56.992 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:56.992 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:56.992 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:56.992 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:56.992 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:56.992 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:56.992 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:56.992 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:56.992 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:56.992 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:56.993 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:56.993 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:56.993 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:56.993 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:56.993 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:56.993 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:56.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.993 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:56.993 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.993 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:56.993 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:56.993 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.994 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.994 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.994 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:56.994 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.994 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.994 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:56.994 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.994 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.994 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.995 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:56.995 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:56.995 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.995 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.995 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.995 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.995 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:56.995 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:56.995 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.996 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.996 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.996 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.996 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:56.996 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.996 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.996 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.996 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:56.996 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.996 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.996 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.997 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:56.997 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:56.997 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.997 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.997 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.997 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:56.997 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:56.997 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.997 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.997 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.997 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:56.998 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.998 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:56.998 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:56.998 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.998 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:56.998 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:56.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.998 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:56.998 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:56.998 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:56.999 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:56.999 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:56.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.999 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:56.999 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:56.999 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:56.999 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:56.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:56.999 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:56.999 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:56.999 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:56.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:56.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.000 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:57.000 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.000 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.000 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.000 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:57.000 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:57.000 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.000 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.000 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.000 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:57.001 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:57.001 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.001 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:57.001 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.001 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:57.001 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.001 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.001 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:57.002 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:57.002 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.002 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.002 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.002 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:57.002 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:57.002 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.003 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.003 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:57.003 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.003 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.003 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:57.003 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.003 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.003 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:57.004 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:57.004 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.004 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.004 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.006 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.006 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.006 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:57.006 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:57.006 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.006 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.006 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.006 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:57.007 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:57.007 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.007 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.007 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.007 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:57.007 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.007 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.007 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:57.007 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.007 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.008 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.008 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:57.008 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:57.008 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.008 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.008 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.008 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:57.008 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:57.008 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.008 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.009 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:57.009 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.009 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:57.009 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.009 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.009 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.009 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:57.009 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:57.009 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.010 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.010 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.010 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.010 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.010 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:57.010 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:57.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.010 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:57.010 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:57.010 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:57.010 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.010 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.010 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:09:57.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.011 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:57.011 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:57.011 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:57.011 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.011 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.011 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:57.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.011 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:57.011 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:57.011 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:57.011 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.011 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.012 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:57.012 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:57.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.973+0000 7f7ca5d78640 1 -- 172.21.15.5:0/3940695810 >> v2:172.21.15.157:6812/631023601 conn(0x7f7c8003bdc0 msgr2=0x7f7c8003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.973+0000 7f7ca5d78640 1 --2- 172.21.15.5:0/3940695810 >> v2:172.21.15.157:6812/631023601 conn(0x7f7c8003bdc0 0x7f7c8003e280 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0133a00 tx=0x7f7c98007d40 comp rx=0 tx=0).stop 2024-08-18T21:09:57.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.973+0000 7f7ca5d78640 10 monclient: shutdown 2024-08-18T21:09:57.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.973+0000 7f7ca5d78640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:57.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.973+0000 7f7ca5d78640 1 -- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7ca009e040 msgr2=0x7f7ca01d1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.973+0000 7f7ca5d78640 1 --2- 172.21.15.5:0/3940695810 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7ca009e040 0x7f7ca01d1e90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c900097c0 tx=0x7f7c900191c0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.973+0000 7f7c9ffff640 1 -- 172.21.15.5:0/3940695810 reap_dead start 2024-08-18T21:09:57.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.973+0000 7f7c9ffff640 1 -- 172.21.15.5:0/3940695810 reap_dead start 2024-08-18T21:09:57.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.973+0000 7f7ca5d78640 1 -- 172.21.15.5:0/3940695810 shutdown_connections 2024-08-18T21:09:57.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.973+0000 7f7ca5d78640 1 -- 172.21.15.5:0/3940695810 >> 172.21.15.5:0/3940695810 conn(0x7f7ca00a6490 msgr2=0x7f7ca01316c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:57.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.973+0000 7f7ca5d78640 1 -- 172.21.15.5:0/3940695810 shutdown_connections 2024-08-18T21:09:57.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:56.973+0000 7f7ca5d78640 1 -- 172.21.15.5:0/3940695810 wait complete. 2024-08-18T21:09:57.015 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:57.015 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:09:57.015 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:09:57.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 10 monclient: get_monmap_and_config 2024-08-18T21:09:57.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 10 monclient: build_initial_monmap 2024-08-18T21:09:57.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 10 monclient: monmap: 2024-08-18T21:09:57.132 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:57.132 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.132 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:57.133198+0000 2024-08-18T21:09:57.132 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:57.133198+0000 2024-08-18T21:09:57.132 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:57.132 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.132 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:57.132 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:57.132 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:57.132 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:57.133 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:57.133 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:57.133 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:57.133 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:57.133 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:57.133 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:57.133 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:57.133 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 1 Processor -- start 2024-08-18T21:09:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 1 -- start start 2024-08-18T21:09:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 10 monclient: init 2024-08-18T21:09:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 10 monclient: _add_conns ranks=[8,5,7,4,3,1,2,9,0,10,6] 2024-08-18T21:09:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f88138cd0 0x7f3f8809efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 10 monclient(hunting): picked mon.noname-e con 0x7f3f88138cd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3f880a4f50 0x7f3f881390b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 10 monclient(hunting): picked mon.noname-h con 0x7f3f880a4f50 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3f8806c950 0x7f3f8806cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 10 monclient(hunting): picked mon.noname-i con 0x7f3f8806c950 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f3f88069a40 con 0x7f3f880a4f50 2024-08-18T21:09:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f3f8809df50 con 0x7f3f8806c950 2024-08-18T21:09:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f3f8809e510 con 0x7f3f88138cd0 2024-08-18T21:09:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8cf32640 10 monclient(hunting): authenticate will time out at 1364.146454s 2024-08-18T21:09:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f88138cd0 0x7f3f8809efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f88138cd0 0x7f3f8809efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:34348/0 (socket says 172.21.15.5:34348) 2024-08-18T21:09:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 1 -- 172.21.15.5:0/3924703774 learned_addr learned my addr 172.21.15.5:0/3924703774 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 10 monclient(hunting): get_auth_request con 0x7f3f88138cd0 auth_method 0 2024-08-18T21:09:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f85d9b640 1 --2- 172.21.15.5:0/3924703774 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3f880a4f50 0x7f3f881390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f86d9d640 1 --2- 172.21.15.5:0/3924703774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3f8806c950 0x7f3f8806cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f85d9b640 10 monclient(hunting): get_auth_request con 0x7f3f880a4f50 auth_method 0 2024-08-18T21:09:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f85d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f85d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f85d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f86d9d640 10 monclient(hunting): get_auth_request con 0x7f3f8806c950 auth_method 0 2024-08-18T21:09:57.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f86d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f86d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f86d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f86d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f86d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f86d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f85d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f85d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f85d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 10 monclient(hunting): handle_auth_done global_id 55250 payload 274 2024-08-18T21:09:57.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 1 -- 172.21.15.5:0/3924703774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3f8806c950 msgr2=0x7f3f8806cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:57.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 1 --2- 172.21.15.5:0/3924703774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3f8806c950 0x7f3f8806cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 1 -- 172.21.15.5:0/3924703774 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3f880a4f50 msgr2=0x7f3f881390b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:57.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 1 --2- 172.21.15.5:0/3924703774 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3f880a4f50 0x7f3f881390b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 10 monclient: _finish_hunting 0 2024-08-18T21:09:57.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 1 monclient: found mon.noname-e 2024-08-18T21:09:57.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:57.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:09:57.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.129+0000 7f3f8659c640 1 -- 172.21.15.5:0/3924703774 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8809e230 con 0x7f3f88138cd0 2024-08-18T21:09:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 1 -- 172.21.15.5:0/3924703774 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f88138cd0 msgr2=0x7f3f8809efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 1 --2- 172.21.15.5:0/3924703774 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f88138cd0 0x7f3f8809efd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3f800098a0 tx=0x7f3f8001c120 comp rx=0 tx=0).ready entity=mon.8 client_cookie=741b14d9eb81545b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8559a640 1 -- 172.21.15.5:0/3924703774 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f800b1070 con 0x7f3f88138cd0 2024-08-18T21:09:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8559a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:09:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8559a640 10 monclient: dump: 2024-08-18T21:09:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.148 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8559a640 10 monclient: _finish_auth 0 2024-08-18T21:09:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8559a640 10 monclient: _check_auth_tickets 2024-08-18T21:09:57.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:57.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8559a640 1 -- 172.21.15.5:0/3924703774 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f800a4af0 con 0x7f3f88138cd0 2024-08-18T21:09:57.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 5 monclient: authenticate success, global_id 55250 2024-08-18T21:09:57.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:57.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8559a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:57.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:57.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8559a640 1 -- 172.21.15.5:0/3924703774 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f800a4ca0 con 0x7f3f88138cd0 2024-08-18T21:09:57.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 4 set_mon_vals no callback set 2024-08-18T21:09:57.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8559a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:57.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8559a640 10 monclient: dump: 2024-08-18T21:09:57.149 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.150 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.150 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.150 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.150 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.150 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.150 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.150 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.150 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.150 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.150 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.150 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.150 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.151 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 10 monclient: shutdown 2024-08-18T21:09:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 -- 172.21.15.5:0/3924703774 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f88138cd0 msgr2=0x7f3f8809efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 --2- 172.21.15.5:0/3924703774 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f88138cd0 0x7f3f8809efd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3f800098a0 tx=0x7f3f8001c120 comp rx=0 tx=0).stop 2024-08-18T21:09:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 -- 172.21.15.5:0/3924703774 shutdown_connections 2024-08-18T21:09:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 --2- 172.21.15.5:0/3924703774 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3f8806c950 0x7f3f8806cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 --2- 172.21.15.5:0/3924703774 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3f880a4f50 0x7f3f881390b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 --2- 172.21.15.5:0/3924703774 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f88138cd0 0x7f3f8809efd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 -- 172.21.15.5:0/3924703774 >> 172.21.15.5:0/3924703774 conn(0x7f3f880688d0 msgr2=0x7f3f88068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 -- 172.21.15.5:0/3924703774 shutdown_connections 2024-08-18T21:09:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 -- 172.21.15.5:0/3924703774 wait complete. 2024-08-18T21:09:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 10 monclient: build_initial_monmap 2024-08-18T21:09:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 10 monclient: monmap: 2024-08-18T21:09:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:57.153 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 Processor -- start 2024-08-18T21:09:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 -- start start 2024-08-18T21:09:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 10 monclient: init 2024-08-18T21:09:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 10 monclient: _add_conns ranks=[6,5,3,1,4,7,8,2,0] 2024-08-18T21:09:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3f8806c950 0x7f3f88131b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 10 monclient(hunting): picked mon.noname-d con 0x7f3f8806c950 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3f880a4f50 0x7f3f881320a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 10 monclient(hunting): picked mon.noname-h con 0x7f3f880a4f50 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f88138cd0 0x7f3f8813a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 10 monclient(hunting): picked mon.noname-g con 0x7f3f88138cd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:09:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3f88144000 con 0x7f3f88138cd0 2024-08-18T21:09:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f3f88143e80 con 0x7f3f880a4f50 2024-08-18T21:09:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f3f88144180 con 0x7f3f8806c950 2024-08-18T21:09:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8cf32640 10 monclient(hunting): authenticate will time out at 1364.155162s 2024-08-18T21:09:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3f8806c950 0x7f3f88131b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3f8806c950 0x7f3f88131b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54460/0 (socket says 172.21.15.5:54460) 2024-08-18T21:09:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 1 -- 172.21.15.5:0/3729734193 learned_addr learned my addr 172.21.15.5:0/3729734193 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 10 monclient(hunting): get_auth_request con 0x7f3f8806c950 auth_method 0 2024-08-18T21:09:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f85d9b640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3f880a4f50 0x7f3f881320a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f86d9d640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f88138cd0 0x7f3f8813a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f85d9b640 10 monclient(hunting): get_auth_request con 0x7f3f880a4f50 auth_method 0 2024-08-18T21:09:57.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f85d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f85d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f85d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 10 monclient(hunting): handle_auth_done global_id 84732 payload 824 2024-08-18T21:09:57.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 1 -- 172.21.15.5:0/3729734193 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3f880a4f50 msgr2=0x7f3f881320a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3f880a4f50 0x7f3f881320a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 1 -- 172.21.15.5:0/3729734193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f88138cd0 msgr2=0x7f3f8813a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f88138cd0 0x7f3f8813a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 10 monclient: _finish_hunting 0 2024-08-18T21:09:57.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 1 monclient: found mon.noname-d 2024-08-18T21:09:57.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:57.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:09:57.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f8659c640 1 -- 172.21.15.5:0/3729734193 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f88077710 con 0x7f3f8806c950 2024-08-18T21:09:57.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f86d9d640 10 monclient: get_auth_request con 0x7f3f88138cd0 auth_method 0 2024-08-18T21:09:57.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.137+0000 7f3f86d9d640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f88138cd0 0x7f3f8813a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:09:57.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f8659c640 1 -- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3f8806c950 msgr2=0x7f3f88131b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:57.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f8659c640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3f8806c950 0x7f3f88131b60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f800097c0 tx=0x7f3f800191e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f7effd640 1 -- 172.21.15.5:0/3729734193 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f800b1050 con 0x7f3f8806c950 2024-08-18T21:09:57.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f7effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f7effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:09:57.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f7effd640 10 monclient: dump: 2024-08-18T21:09:57.158 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.158 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.158 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.158 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.158 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.158 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.158 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.159 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.159 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.159 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.159 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.159 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.159 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.159 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.159 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.159 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f7effd640 10 monclient: _finish_auth 0 2024-08-18T21:09:57.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f7effd640 10 monclient: _check_auth_tickets 2024-08-18T21:09:57.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f7effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:57.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f8cf32640 5 monclient: authenticate success, global_id 84732 2024-08-18T21:09:57.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f7effd640 1 -- 172.21.15.5:0/3729734193 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f800bd070 con 0x7f3f8806c950 2024-08-18T21:09:57.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f8cf32640 10 monclient: _renew_subs 2024-08-18T21:09:57.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f8cf32640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:09:57.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f8cf32640 1 -- 172.21.15.5:0/3729734193 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f8813c000 con 0x7f3f8806c950 2024-08-18T21:09:57.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f7effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:57.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f7effd640 1 -- 172.21.15.5:0/3729734193 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f80004460 con 0x7f3f8806c950 2024-08-18T21:09:57.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f7effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f7effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:09:57.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f84d99640 4 set_mon_vals no callback set 2024-08-18T21:09:57.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f7effd640 10 monclient: dump: 2024-08-18T21:09:57.160 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.160 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.161 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.161 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.161 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.161 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.161 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.161 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.161 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.161 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.161 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.161 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.161 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.161 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.161 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.162 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f8cf32640 10 monclient: _renew_subs 2024-08-18T21:09:57.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f8cf32640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:09:57.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f8cf32640 1 -- 172.21.15.5:0/3729734193 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f8813dda0 con 0x7f3f8806c950 2024-08-18T21:09:57.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f8cf32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:57.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f8cf32640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f8813cb60 0x7f3f8813ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f8cf32640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f8cf32640 1 -- 172.21.15.5:0/3729734193 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f3f8813df70 con 0x7f3f8813cb60 2024-08-18T21:09:57.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f85d9b640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f8813cb60 0x7f3f8813ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f85d9b640 10 monclient: get_auth_request con 0x7f3f8813cb60 auth_method 0 2024-08-18T21:09:57.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f85d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f85d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f85d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f85d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f85d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f85d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f7effd640 1 -- 172.21.15.5:0/3729734193 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f3f80003620 con 0x7f3f8806c950 2024-08-18T21:09:57.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f85d9b640 10 monclient(hunting): handle_auth_done global_id 55259 payload 824 2024-08-18T21:09:57.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f85d9b640 1 -- 172.21.15.5:0/3729734193 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f880746e0 con 0x7f3f8813cb60 2024-08-18T21:09:57.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f7effd640 1 --2- 172.21.15.5:0/3729734193 >> v2:172.21.15.157:6812/631023601 conn(0x7f3f6803bdc0 0x7f3f6803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.141+0000 7f3f7effd640 1 -- 172.21.15.5:0/3729734193 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(181..181 src has 22..181) ==== 3506+0+0 (secure 0 0 0) 0x7f3f800e84c0 con 0x7f3f8806c950 2024-08-18T21:09:57.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.145+0000 7f3f86d9d640 1 --2- 172.21.15.5:0/3729734193 >> v2:172.21.15.157:6812/631023601 conn(0x7f3f6803bdc0 0x7f3f6803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.145+0000 7f3f86d9d640 10 monclient: get_auth_request con 0x7f3f6803bdc0 auth_method 0 2024-08-18T21:09:57.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.145+0000 7f3f85d9b640 1 -- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f8813cb60 msgr2=0x7f3f8813ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.145+0000 7f3f85d9b640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f8813cb60 0x7f3f8813ae20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3f70009fd0 tx=0x7f3f700115a0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.145+0000 7f3f7effd640 1 -- 172.21.15.5:0/3729734193 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f7001a020 con 0x7f3f8813cb60 2024-08-18T21:09:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.145+0000 7f3f7effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.145+0000 7f3f7effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.145+0000 7f3f7effd640 10 monclient: dump: 2024-08-18T21:09:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.166 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.145+0000 7f3f7effd640 1 -- 172.21.15.5:0/3729734193 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3f70016890 con 0x7f3f8813cb60 2024-08-18T21:09:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.145+0000 7f3f7effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.145+0000 7f3f7effd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.145+0000 7f3f7effd640 1 -- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f8813cb60 msgr2=0x7f3f8813ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.145+0000 7f3f7effd640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f8813cb60 0x7f3f8813ae20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3f70009fd0 tx=0x7f3f700115a0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.145+0000 7f3f7effd640 1 -- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f8813cb60 msgr2=0x7f3f8813ae20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:57.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.145+0000 7f3f7effd640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f8813cb60 0x7f3f8813ae20 secure :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3f70009fd0 tx=0x7f3f700115a0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.145+0000 7f3f86d9d640 1 --2- 172.21.15.5:0/3729734193 >> v2:172.21.15.157:6812/631023601 conn(0x7f3f6803bdc0 0x7f3f6803e280 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3f881367c0 tx=0x7f3f78008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2157184207}) 2024-08-18T21:09:57.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=637024318}) 2024-08-18T21:09:57.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2157184207}) 2024-08-18T21:09:57.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2751379871}) 2024-08-18T21:09:57.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2157184207}) 2024-08-18T21:09:57.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1763030688}) 2024-08-18T21:09:57.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2157184207}) 2024-08-18T21:09:57.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2395916849}) 2024-08-18T21:09:57.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2157184207}) 2024-08-18T21:09:57.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=524308246}) 2024-08-18T21:09:57.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2157184207}) 2024-08-18T21:09:57.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=736828504}) 2024-08-18T21:09:57.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2157184207}) 2024-08-18T21:09:57.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2561177604}) 2024-08-18T21:09:57.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.171 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2157184207}) 2024-08-18T21:09:57.171 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3933388979}) 2024-08-18T21:09:57.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.157+0000 7f3f8cf32640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:57.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.157+0000 7f3f8cf32640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f8813b360 0x7f3f8813b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.157+0000 7f3f8cf32640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.157+0000 7f3f8cf32640 1 -- 172.21.15.5:0/3729734193 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f3f88051140 con 0x7f3f8813b360 2024-08-18T21:09:57.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.157+0000 7f3f85d9b640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f8813b360 0x7f3f8813b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.157+0000 7f3f85d9b640 10 monclient: get_auth_request con 0x7f3f8813b360 auth_method 0 2024-08-18T21:09:57.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.157+0000 7f3f85d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.157+0000 7f3f85d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.157+0000 7f3f85d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.157+0000 7f3f85d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.157+0000 7f3f85d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.157+0000 7f3f85d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.157+0000 7f3f85d9b640 10 monclient(hunting): handle_auth_done global_id 55268 payload 824 2024-08-18T21:09:57.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.157+0000 7f3f85d9b640 1 -- 172.21.15.5:0/3729734193 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3f8813bcb0 con 0x7f3f8813b360 2024-08-18T21:09:57.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1439546290}) 2024-08-18T21:09:57.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1913982467}) 2024-08-18T21:09:57.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1439546290}) 2024-08-18T21:09:57.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1856702163}) 2024-08-18T21:09:57.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1439546290}) 2024-08-18T21:09:57.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1642484820}) 2024-08-18T21:09:57.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.175 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1439546290}) 2024-08-18T21:09:57.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2723134055}) 2024-08-18T21:09:57.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1439546290}) 2024-08-18T21:09:57.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3195539768}) 2024-08-18T21:09:57.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1439546290}) 2024-08-18T21:09:57.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3142997964}) 2024-08-18T21:09:57.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1439546290}) 2024-08-18T21:09:57.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1594572883}) 2024-08-18T21:09:57.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1439546290}) 2024-08-18T21:09:57.176 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2093203109}) 2024-08-18T21:09:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f85d9b640 1 -- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f8813b360 msgr2=0x7f3f8813b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f85d9b640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f8813b360 0x7f3f8813b770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000b010 tx=0x7f3f70004a50 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f7effd640 1 -- 172.21.15.5:0/3729734193 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f7001a040 con 0x7f3f8813b360 2024-08-18T21:09:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f7effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f7effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f7effd640 10 monclient: dump: 2024-08-18T21:09:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.183 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.183 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.183 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.183 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.183 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.183 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f7effd640 1 -- 172.21.15.5:0/3729734193 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f3f70021a70 con 0x7f3f8813b360 2024-08-18T21:09:57.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f7effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:57.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f7effd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:57.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f7effd640 1 -- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f8813b360 msgr2=0x7f3f8813b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f7effd640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f8813b360 0x7f3f8813b770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000b010 tx=0x7f3f70004a50 comp rx=0 tx=0).stop 2024-08-18T21:09:57.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f7effd640 1 -- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f8813b360 msgr2=0x7f3f8813b770 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:57.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f7effd640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3f8813b360 0x7f3f8813b770 secure :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000b010 tx=0x7f3f70004a50 comp rx=0 tx=0).stop 2024-08-18T21:09:57.184 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:57.184 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:57.184 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:57.184 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:57.184 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:57.184 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 253282, 2024-08-18T21:09:57.185 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:57.185 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:57.185 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:57.185 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:57.185 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:57.185 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:57.185 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:57.185 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:57.185 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:57.185 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:57.185 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.185 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:09:57.185 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:57.185 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:57.186 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:57.186 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:57.186 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:57.186 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:57.186 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:57.186 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:57.186 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:57.186 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:57.186 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:57.186 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:57.186 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:57.186 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:57.186 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.187 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:57.187 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:57.187 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:57.187 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:57.187 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:57.187 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:57.187 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:57.187 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:57.187 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:57.187 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:57.187 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:57.187 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:57.187 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:57.187 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.188 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:57.188 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:57.188 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:57.188 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:57.188 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:57.188 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:57.188 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:57.188 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:57.188 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:57.188 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:57.188 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:57.188 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:57.189 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:57.189 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:57.189 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:57.189 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:57.189 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:57.189 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:57.189 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:57.189 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:57.189 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:57.189 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:57.189 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:57.189 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:57.189 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:57.189 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:57.190 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:57.190 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:57.190 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.190 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:57.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.190 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:57.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.190 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:57.190 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:57.190 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:57.191 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:57.191 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.191 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.191 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:57.191 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:57.191 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.191 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.192 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.192 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:57.192 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:57.192 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:57.193 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:57.193 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.193 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.193 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:57.194 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:57.194 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.194 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.194 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.194 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:57.194 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:57.194 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:57.195 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.196 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.196 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:57.196 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.196 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.196 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.197 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:57.197 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:57.197 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.197 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.197 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.197 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:57.197 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:57.197 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.197 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.197 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.198 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:57.198 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.198 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.198 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:57.198 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.198 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.198 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.198 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:57.198 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:57.198 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.198 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.199 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.199 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:57.199 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:57.199 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.199 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.199 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.199 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:57.199 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.200 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:57.200 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.200 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.200 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.200 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:57.200 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:57.200 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.200 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.200 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.200 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:57.201 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:57.201 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.201 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.201 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.201 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.201 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:57.201 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.201 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.202 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.202 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:57.202 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.202 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.202 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.202 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:57.202 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:57.202 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.203 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.203 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.203 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:57.203 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:57.203 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.203 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.203 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.203 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:57.203 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.204 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.204 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.204 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:57.204 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.204 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.204 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.204 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:57.204 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:57.204 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.204 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.204 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.204 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.205 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:57.205 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:57.205 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:57.205 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:57.205 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.206 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.206 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.206 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:57.206 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:57.206 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.206 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.206 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.206 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:57.206 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:57.206 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:57.207 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:57.207 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.207 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.207 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:57.208 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:57.208 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.208 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.208 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.208 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.208 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.209 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:57.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:57.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.209 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:57.209 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:57.209 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:57.209 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.209 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.210 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:09:57.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.210 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:57.210 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:57.210 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:09:57.210 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.210 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.210 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:57.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.213 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:57.213 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:57.213 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:57.213 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.213 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.214 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:57.214 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f8cf32640 1 -- 172.21.15.5:0/3729734193 >> v2:172.21.15.157:6812/631023601 conn(0x7f3f6803bdc0 msgr2=0x7f3f6803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f8cf32640 1 --2- 172.21.15.5:0/3729734193 >> v2:172.21.15.157:6812/631023601 conn(0x7f3f6803bdc0 0x7f3f6803e280 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3f881367c0 tx=0x7f3f78008040 comp rx=0 tx=0).stop 2024-08-18T21:09:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f8cf32640 10 monclient: shutdown 2024-08-18T21:09:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f8cf32640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f8cf32640 1 -- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3f8806c950 msgr2=0x7f3f88131b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f8cf32640 1 --2- 172.21.15.5:0/3729734193 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3f8806c950 0x7f3f88131b60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f800097c0 tx=0x7f3f800191e0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f86d9d640 1 -- 172.21.15.5:0/3729734193 reap_dead start 2024-08-18T21:09:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f86d9d640 1 -- 172.21.15.5:0/3729734193 reap_dead start 2024-08-18T21:09:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f8cf32640 1 -- 172.21.15.5:0/3729734193 shutdown_connections 2024-08-18T21:09:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f8cf32640 1 -- 172.21.15.5:0/3729734193 >> 172.21.15.5:0/3729734193 conn(0x7f3f880688d0 msgr2=0x7f3f880a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f8cf32640 1 -- 172.21.15.5:0/3729734193 shutdown_connections 2024-08-18T21:09:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.161+0000 7f3f8cf32640 1 -- 172.21.15.5:0/3729734193 wait complete. 2024-08-18T21:09:57.221 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.221 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688084943}) 2024-08-18T21:09:57.221 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3807824891}) 2024-08-18T21:09:57.221 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.221 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688084943}) 2024-08-18T21:09:57.222 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=221011169}) 2024-08-18T21:09:57.222 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.222 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688084943}) 2024-08-18T21:09:57.222 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1000248491}) 2024-08-18T21:09:57.222 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.222 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688084943}) 2024-08-18T21:09:57.222 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=251325777}) 2024-08-18T21:09:57.222 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.222 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688084943}) 2024-08-18T21:09:57.222 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4205683108}) 2024-08-18T21:09:57.222 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.222 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688084943}) 2024-08-18T21:09:57.222 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2593539128}) 2024-08-18T21:09:57.223 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.223 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688084943}) 2024-08-18T21:09:57.223 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1932799862}) 2024-08-18T21:09:57.223 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.223 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688084943}) 2024-08-18T21:09:57.223 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.169+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2239098193}) 2024-08-18T21:09:57.223 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.223 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3313744666}) 2024-08-18T21:09:57.223 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=775906362}) 2024-08-18T21:09:57.223 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.223 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3313744666}) 2024-08-18T21:09:57.223 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1411273685}) 2024-08-18T21:09:57.223 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.224 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3313744666}) 2024-08-18T21:09:57.224 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1286688322}) 2024-08-18T21:09:57.224 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.224 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3313744666}) 2024-08-18T21:09:57.224 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=400147455}) 2024-08-18T21:09:57.224 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.224 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3313744666}) 2024-08-18T21:09:57.224 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1906149023}) 2024-08-18T21:09:57.224 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.224 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3313744666}) 2024-08-18T21:09:57.224 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2800280933}) 2024-08-18T21:09:57.224 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.224 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3313744666}) 2024-08-18T21:09:57.224 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=855562422}) 2024-08-18T21:09:57.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3313744666}) 2024-08-18T21:09:57.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.173+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=594918491}) 2024-08-18T21:09:57.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=909880683}) 2024-08-18T21:09:57.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=761457015}) 2024-08-18T21:09:57.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=909880683}) 2024-08-18T21:09:57.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1747621324}) 2024-08-18T21:09:57.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=909880683}) 2024-08-18T21:09:57.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=444636864}) 2024-08-18T21:09:57.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=909880683}) 2024-08-18T21:09:57.225 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1875088468}) 2024-08-18T21:09:57.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=909880683}) 2024-08-18T21:09:57.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3105158844}) 2024-08-18T21:09:57.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=909880683}) 2024-08-18T21:09:57.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3770895891}) 2024-08-18T21:09:57.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=909880683}) 2024-08-18T21:09:57.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3902821262}) 2024-08-18T21:09:57.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=909880683}) 2024-08-18T21:09:57.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.177+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1326472754}) 2024-08-18T21:09:57.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4192997254}) 2024-08-18T21:09:57.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1774230337}) 2024-08-18T21:09:57.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4192997254}) 2024-08-18T21:09:57.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3243831473}) 2024-08-18T21:09:57.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4192997254}) 2024-08-18T21:09:57.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1361134029}) 2024-08-18T21:09:57.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4192997254}) 2024-08-18T21:09:57.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2537261342}) 2024-08-18T21:09:57.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.228 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4192997254}) 2024-08-18T21:09:57.228 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1148661586}) 2024-08-18T21:09:57.228 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.228 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4192997254}) 2024-08-18T21:09:57.228 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3427188183}) 2024-08-18T21:09:57.228 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.228 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4192997254}) 2024-08-18T21:09:57.228 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3851505862}) 2024-08-18T21:09:57.228 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.228 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4192997254}) 2024-08-18T21:09:57.228 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=269331127}) 2024-08-18T21:09:57.229 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:57.230 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:09:57.230 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:09:57.248 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.248 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4092169958}) 2024-08-18T21:09:57.248 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=525775563}) 2024-08-18T21:09:57.248 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.248 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4092169958}) 2024-08-18T21:09:57.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1391093463}) 2024-08-18T21:09:57.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4092169958}) 2024-08-18T21:09:57.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=265847891}) 2024-08-18T21:09:57.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4092169958}) 2024-08-18T21:09:57.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1325851056}) 2024-08-18T21:09:57.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4092169958}) 2024-08-18T21:09:57.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2915163780}) 2024-08-18T21:09:57.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4092169958}) 2024-08-18T21:09:57.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2089044044}) 2024-08-18T21:09:57.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4092169958}) 2024-08-18T21:09:57.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1434185242}) 2024-08-18T21:09:57.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4092169958}) 2024-08-18T21:09:57.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.181+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2118260983}) 2024-08-18T21:09:57.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4119211631}) 2024-08-18T21:09:57.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2031064171}) 2024-08-18T21:09:57.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4119211631}) 2024-08-18T21:09:57.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=469288351}) 2024-08-18T21:09:57.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4119211631}) 2024-08-18T21:09:57.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3607962820}) 2024-08-18T21:09:57.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4119211631}) 2024-08-18T21:09:57.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1578815226}) 2024-08-18T21:09:57.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4119211631}) 2024-08-18T21:09:57.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2529588906}) 2024-08-18T21:09:57.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4119211631}) 2024-08-18T21:09:57.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3352848682}) 2024-08-18T21:09:57.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4119211631}) 2024-08-18T21:09:57.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3157195123}) 2024-08-18T21:09:57.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4119211631}) 2024-08-18T21:09:57.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2059207269}) 2024-08-18T21:09:57.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2257084095}) 2024-08-18T21:09:57.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2447280326}) 2024-08-18T21:09:57.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2257084095}) 2024-08-18T21:09:57.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3364810018}) 2024-08-18T21:09:57.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2257084095}) 2024-08-18T21:09:57.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3395722950}) 2024-08-18T21:09:57.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.252 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2257084095}) 2024-08-18T21:09:57.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1563007690}) 2024-08-18T21:09:57.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2257084095}) 2024-08-18T21:09:57.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=626460246}) 2024-08-18T21:09:57.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2257084095}) 2024-08-18T21:09:57.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1378522468}) 2024-08-18T21:09:57.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2257084095}) 2024-08-18T21:09:57.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4291810910}) 2024-08-18T21:09:57.253 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2257084095}) 2024-08-18T21:09:57.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.185+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3575822389}) 2024-08-18T21:09:57.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2493071338}) 2024-08-18T21:09:57.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1551116773}) 2024-08-18T21:09:57.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2493071338}) 2024-08-18T21:09:57.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2964054355}) 2024-08-18T21:09:57.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2493071338}) 2024-08-18T21:09:57.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=996141761}) 2024-08-18T21:09:57.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2493071338}) 2024-08-18T21:09:57.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=480306554}) 2024-08-18T21:09:57.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2493071338}) 2024-08-18T21:09:57.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4087895816}) 2024-08-18T21:09:57.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2493071338}) 2024-08-18T21:09:57.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1871426247}) 2024-08-18T21:09:57.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2493071338}) 2024-08-18T21:09:57.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=434045151}) 2024-08-18T21:09:57.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2493071338}) 2024-08-18T21:09:57.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3704749441}) 2024-08-18T21:09:57.256 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.256 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3372848587}) 2024-08-18T21:09:57.256 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2800879399}) 2024-08-18T21:09:57.256 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.256 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3372848587}) 2024-08-18T21:09:57.256 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4145911050}) 2024-08-18T21:09:57.256 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.256 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3372848587}) 2024-08-18T21:09:57.257 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=64187332}) 2024-08-18T21:09:57.257 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.257 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3372848587}) 2024-08-18T21:09:57.257 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4166449987}) 2024-08-18T21:09:57.257 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.257 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3372848587}) 2024-08-18T21:09:57.257 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=438461622}) 2024-08-18T21:09:57.257 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.257 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3372848587}) 2024-08-18T21:09:57.257 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3488877799}) 2024-08-18T21:09:57.257 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.257 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3372848587}) 2024-08-18T21:09:57.258 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4282052718}) 2024-08-18T21:09:57.258 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.258 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3372848587}) 2024-08-18T21:09:57.258 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.189+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2842855028}) 2024-08-18T21:09:57.258 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.258 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=699736292}) 2024-08-18T21:09:57.258 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=616222744}) 2024-08-18T21:09:57.258 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.258 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=699736292}) 2024-08-18T21:09:57.258 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=267686144}) 2024-08-18T21:09:57.258 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.258 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=699736292}) 2024-08-18T21:09:57.259 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3996343656}) 2024-08-18T21:09:57.259 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.259 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=699736292}) 2024-08-18T21:09:57.259 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1726665787}) 2024-08-18T21:09:57.259 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.259 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=699736292}) 2024-08-18T21:09:57.259 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1288680951}) 2024-08-18T21:09:57.259 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.259 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=699736292}) 2024-08-18T21:09:57.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=7211784}) 2024-08-18T21:09:57.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=699736292}) 2024-08-18T21:09:57.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1145667233}) 2024-08-18T21:09:57.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=699736292}) 2024-08-18T21:09:57.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2479208120}) 2024-08-18T21:09:57.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674507244}) 2024-08-18T21:09:57.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2147392952}) 2024-08-18T21:09:57.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674507244}) 2024-08-18T21:09:57.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3603309558}) 2024-08-18T21:09:57.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674507244}) 2024-08-18T21:09:57.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1221783629}) 2024-08-18T21:09:57.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674507244}) 2024-08-18T21:09:57.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2308504258}) 2024-08-18T21:09:57.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674507244}) 2024-08-18T21:09:57.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3571772690}) 2024-08-18T21:09:57.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674507244}) 2024-08-18T21:09:57.261 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1593244157}) 2024-08-18T21:09:57.262 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.262 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674507244}) 2024-08-18T21:09:57.262 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2296181972}) 2024-08-18T21:09:57.262 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.262 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2674507244}) 2024-08-18T21:09:57.262 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.193+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1486527703}) 2024-08-18T21:09:57.262 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.262 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=5,osd_snap=2,osdmap=55} crc {logm=972761756,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3216776173,mon_config_key=2147202552,monmap=3438368439,osd_metadata=515261042,osd_snap=723727393,osdmap=662428715}) 2024-08-18T21:09:57.262 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=6,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=3,osd_metadata=5,osd_snap=2,osdmap=53} crc {logm=2249702280,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=4132439939,mon_config_key=2147202552,monmap=3438368439,osd_metadata=553867591,osd_snap=723727393,osdmap=565127009}) 2024-08-18T21:09:57.262 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.262 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=5,osd_snap=2,osdmap=55} crc {logm=972761756,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3216776173,mon_config_key=2147202552,monmap=3438368439,osd_metadata=515261042,osd_snap=723727393,osdmap=662428715}) 2024-08-18T21:09:57.263 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=6,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=53} crc {logm=2249702280,mdsmap=4274512535,mgr=695303193,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3722740122,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2782145127,osd_snap=723727393,osdmap=3274867803}) 2024-08-18T21:09:57.263 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.263 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=5,osd_snap=2,osdmap=55} crc {logm=972761756,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3216776173,mon_config_key=2147202552,monmap=3438368439,osd_metadata=515261042,osd_snap=723727393,osdmap=662428715}) 2024-08-18T21:09:57.263 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=5,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=53} crc {logm=398068423,mdsmap=4274512535,mgr=1059420282,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=4132439939,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=2782145127,osd_snap=723727393,osdmap=3209582891}) 2024-08-18T21:09:57.263 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.263 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=5,osd_snap=2,osdmap=55} crc {logm=972761756,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3216776173,mon_config_key=2147202552,monmap=3438368439,osd_metadata=515261042,osd_snap=723727393,osdmap=662428715}) 2024-08-18T21:09:57.263 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=6,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=54} crc {logm=2249702280,mdsmap=4274512535,mgr=1059420282,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=4132439939,mon_config_key=2147202552,monmap=3140514009,osd_metadata=2816397922,osd_pg_creating=2782145127,osd_snap=2941457380,osdmap=505948902}) 2024-08-18T21:09:57.263 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.263 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=5,osd_snap=2,osdmap=55} crc {logm=972761756,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3216776173,mon_config_key=2147202552,monmap=3438368439,osd_metadata=515261042,osd_snap=723727393,osdmap=662428715}) 2024-08-18T21:09:57.263 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=6,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=7,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=53} crc {logm=2249702280,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=452512297,mon_config_key=1282707525,monmap=3438368439,osd_metadata=3189483617,osd_pg_creating=2782145127,osd_snap=723727393,osdmap=3963970484}) 2024-08-18T21:09:57.263 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.264 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=5,osd_snap=2,osdmap=55} crc {logm=972761756,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3216776173,mon_config_key=2147202552,monmap=3438368439,osd_metadata=515261042,osd_snap=723727393,osdmap=662428715}) 2024-08-18T21:09:57.264 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=6,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=7,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=54} crc {logm=2249702280,mdsmap=485591938,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=4132439939,mon_config_key=4097785744,monmap=3438368439,osd_metadata=1462106993,osd_pg_creating=2782145127,osd_snap=723727393,osdmap=500799487}) 2024-08-18T21:09:57.264 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.264 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=5,osd_snap=2,osdmap=55} crc {logm=972761756,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3216776173,mon_config_key=2147202552,monmap=3438368439,osd_metadata=515261042,osd_snap=723727393,osdmap=662428715}) 2024-08-18T21:09:57.264 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=6,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=1,osdmap=53} crc {logm=2249702280,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=4132439939,mon_config_key=2147202552,monmap=2244815760,osd_metadata=515261042,osd_pg_creating=2782145127,osd_snap=2941457380,osdmap=3871661290}) 2024-08-18T21:09:57.264 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.264 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=5,osd_snap=2,osdmap=55} crc {logm=972761756,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3216776173,mon_config_key=2147202552,monmap=3438368439,osd_metadata=515261042,osd_snap=723727393,osdmap=662428715}) 2024-08-18T21:09:57.264 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.201+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=6,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=7,monmap=3,osd_metadata=6,osd_snap=2,osdmap=53} crc {logm=2249702280,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=4132439939,mon_config_key=2309266927,monmap=3438368439,osd_metadata=2816397922,osd_snap=723727393,osdmap=1364722285}) 2024-08-18T21:09:57.264 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.264 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2208757564}) 2024-08-18T21:09:57.264 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1352289661}) 2024-08-18T21:09:57.265 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.265 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2208757564}) 2024-08-18T21:09:57.265 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1597834247}) 2024-08-18T21:09:57.265 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.265 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2208757564}) 2024-08-18T21:09:57.265 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3773397961}) 2024-08-18T21:09:57.265 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.265 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2208757564}) 2024-08-18T21:09:57.265 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=2091717888}) 2024-08-18T21:09:57.265 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.265 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2208757564}) 2024-08-18T21:09:57.265 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=4141116300}) 2024-08-18T21:09:57.265 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.266 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2208757564}) 2024-08-18T21:09:57.266 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=2796642886}) 2024-08-18T21:09:57.266 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.266 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2208757564}) 2024-08-18T21:09:57.266 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3998797192}) 2024-08-18T21:09:57.266 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.266 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2208757564}) 2024-08-18T21:09:57.266 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.205+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=992601835}) 2024-08-18T21:09:57.266 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.221+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.266 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.221+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2277911845}) 2024-08-18T21:09:57.266 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.221+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=89} crc {osdmap=401078562}) 2024-08-18T21:09:57.266 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.221+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.266 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.221+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2277911845}) 2024-08-18T21:09:57.267 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.221+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=91} crc {osdmap=1476928499}) 2024-08-18T21:09:57.267 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.267 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2277911845}) 2024-08-18T21:09:57.267 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=95} crc {osdmap=2954553756}) 2024-08-18T21:09:57.267 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.267 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2277911845}) 2024-08-18T21:09:57.267 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=87} crc {osdmap=245777362}) 2024-08-18T21:09:57.267 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.267 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2277911845}) 2024-08-18T21:09:57.267 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=86} crc {osdmap=30424746}) 2024-08-18T21:09:57.267 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.267 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2277911845}) 2024-08-18T21:09:57.268 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=94} crc {osdmap=2943176045}) 2024-08-18T21:09:57.268 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.268 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2277911845}) 2024-08-18T21:09:57.268 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=88} crc {osdmap=3847231742}) 2024-08-18T21:09:57.268 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:09:57.268 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2277911845}) 2024-08-18T21:09:57.268 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:09:57.225+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=90} crc {osdmap=3263242842}) 2024-08-18T21:09:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 10 monclient: get_monmap_and_config 2024-08-18T21:09:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 10 monclient: build_initial_monmap 2024-08-18T21:09:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 10 monclient: monmap: 2024-08-18T21:09:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:57.433963+0000 2024-08-18T21:09:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:57.433963+0000 2024-08-18T21:09:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:57.434 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 1 Processor -- start 2024-08-18T21:09:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 1 -- start start 2024-08-18T21:09:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 10 monclient: init 2024-08-18T21:09:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 10 monclient: _add_conns ranks=[8,1,0,9,6,4,3,5,7,10,2] 2024-08-18T21:09:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f59e80a6ce0 0x7f59e80a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 10 monclient(hunting): picked mon.noname-e con 0x7f59e80a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f59e80a7600 addr v1:172.21.15.157:6789/0 2024-08-18T21:09:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f59e813a1b0 addr v1:172.21.15.5:6789/0 2024-08-18T21:09:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e80a45d0 con 0x7f59e813a1b0 2024-08-18T21:09:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e80a32d0 con 0x7f59e80a7600 2024-08-18T21:09:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f59e80a5000 con 0x7f59e80a6ce0 2024-08-18T21:09:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ee3a8640 10 monclient(hunting): authenticate will time out at 1364.447327s 2024-08-18T21:09:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59e7fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f59e80a6ce0 0x7f59e80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ec945640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f59e813a1b0 0x7f59e8141d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54844/0 (socket says 172.21.15.5:54844) 2024-08-18T21:09:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59ec945640 1 -- 172.21.15.5:0/4229665109 learned_addr learned my addr 172.21.15.5:0/4229665109 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:09:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59e7fff640 10 monclient(hunting): get_auth_request con 0x7f59e80a6ce0 auth_method 0 2024-08-18T21:09:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59e7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59e7fff640 10 monclient(hunting): handle_auth_done global_id 55277 payload 274 2024-08-18T21:09:57.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59e7fff640 1 -- 172.21.15.5:0/4229665109 >> v1:172.21.15.157:6789/0 conn(0x7f59e80a7600 legacy=0x7f59e8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:57.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59e7fff640 1 -- 172.21.15.5:0/4229665109 >> v1:172.21.15.5:6789/0 conn(0x7f59e813a1b0 legacy=0x7f59e8141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:57.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59e7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:09:57.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59e7fff640 1 monclient: found mon.noname-e 2024-08-18T21:09:57.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59e7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:57.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59e7fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:09:57.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.429+0000 7f59e7fff640 1 -- 172.21.15.5:0/4229665109 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e80a8900 con 0x7f59e80a6ce0 2024-08-18T21:09:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e7fff640 1 -- 172.21.15.5:0/4229665109 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f59e80a6ce0 msgr2=0x7f59e80a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e7fff640 1 --2- 172.21.15.5:0/4229665109 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f59e80a6ce0 0x7f59e80a70c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f59d80097f0 tx=0x7f59d801c3a0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=f522417d636df45c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e6ffd640 1 -- 172.21.15.5:0/4229665109 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f59d80b0070 con 0x7f59e80a6ce0 2024-08-18T21:09:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e6ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:09:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e6ffd640 10 monclient: dump: 2024-08-18T21:09:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.440 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:09:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:09:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e6ffd640 1 -- 172.21.15.5:0/4229665109 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d80aa810 con 0x7f59e80a6ce0 2024-08-18T21:09:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e6ffd640 1 -- 172.21.15.5:0/4229665109 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f59d80aae30 con 0x7f59e80a6ce0 2024-08-18T21:09:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 5 monclient: authenticate success, global_id 55277 2024-08-18T21:09:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 4 set_mon_vals no callback set 2024-08-18T21:09:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e6ffd640 10 monclient: dump: 2024-08-18T21:09:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.442 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 10 monclient: shutdown 2024-08-18T21:09:57.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:57.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 1 -- 172.21.15.5:0/4229665109 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f59e80a6ce0 msgr2=0x7f59e80a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 1 --2- 172.21.15.5:0/4229665109 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f59e80a6ce0 0x7f59e80a70c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f59d80097f0 tx=0x7f59d801c3a0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 1 -- 172.21.15.5:0/4229665109 shutdown_connections 2024-08-18T21:09:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 1 --2- 172.21.15.5:0/4229665109 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f59e80a6ce0 0x7f59e80a70c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 1 -- 172.21.15.5:0/4229665109 >> 172.21.15.5:0/4229665109 conn(0x7f59e80acbc0 msgr2=0x7f59e80a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 1 -- 172.21.15.5:0/4229665109 shutdown_connections 2024-08-18T21:09:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 1 -- 172.21.15.5:0/4229665109 wait complete. 2024-08-18T21:09:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 10 monclient: build_initial_monmap 2024-08-18T21:09:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 10 monclient: monmap: 2024-08-18T21:09:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:57.449 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 1 Processor -- start 2024-08-18T21:09:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 1 -- start start 2024-08-18T21:09:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 10 monclient: init 2024-08-18T21:09:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 10 monclient: _add_conns ranks=[1,2,0,8,4,5,3,7,6] 2024-08-18T21:09:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e80a6ce0 0x7f59e8134ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 10 monclient(hunting): picked mon.noname-f con 0x7f59e80a6ce0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:09:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f59e80a7600 0x7f59e8135220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 10 monclient(hunting): picked mon.noname-b con 0x7f59e80a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e813a1b0 0x7f59e813aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 10 monclient(hunting): picked mon.noname-a con 0x7f59e813a1b0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:09:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f59e80a79e0 con 0x7f59e813a1b0 2024-08-18T21:09:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f59e80a8220 con 0x7f59e80a6ce0 2024-08-18T21:09:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f59e80a2810 con 0x7f59e80a7600 2024-08-18T21:09:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ee3a8640 10 monclient(hunting): authenticate will time out at 1364.454529s 2024-08-18T21:09:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e813a1b0 0x7f59e813aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e77fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f59e80a7600 0x7f59e8135220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e813a1b0 0x7f59e813aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57668/0 (socket says 172.21.15.5:57668) 2024-08-18T21:09:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 1 -- 172.21.15.5:0/1226644697 learned_addr learned my addr 172.21.15.5:0/1226644697 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 10 monclient(hunting): get_auth_request con 0x7f59e813a1b0 auth_method 0 2024-08-18T21:09:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e77fe640 10 monclient(hunting): get_auth_request con 0x7f59e80a7600 auth_method 0 2024-08-18T21:09:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e7fff640 1 --2- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e80a6ce0 0x7f59e8134ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e7fff640 10 monclient(hunting): get_auth_request con 0x7f59e80a6ce0 auth_method 0 2024-08-18T21:09:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 10 monclient(hunting): handle_auth_done global_id 84492 payload 824 2024-08-18T21:09:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 1 -- 172.21.15.5:0/1226644697 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f59e80a7600 msgr2=0x7f59e8135220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 1 --2- 172.21.15.5:0/1226644697 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f59e80a7600 0x7f59e8135220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 1 -- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e80a6ce0 msgr2=0x7f59e8134ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 1 --2- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e80a6ce0 0x7f59e8134ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 10 monclient: _finish_hunting 0 2024-08-18T21:09:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 1 monclient: found mon.noname-a 2024-08-18T21:09:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:09:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59ec945640 1 -- 172.21.15.5:0/1226644697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e813e3a0 con 0x7f59e813a1b0 2024-08-18T21:09:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.437+0000 7f59e77fe640 1 --2- 172.21.15.5:0/1226644697 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f59e80a7600 0x7f59e8135220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59ec945640 1 -- 172.21.15.5:0/1226644697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e813a1b0 msgr2=0x7f59e813aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:57.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59ec945640 1 --2- 172.21.15.5:0/1226644697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e813a1b0 0x7f59e813aa70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f59e000b970 tx=0x7f59e000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e4ff9640 1 -- 172.21.15.5:0/1226644697 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f59e0019070 con 0x7f59e813a1b0 2024-08-18T21:09:57.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:09:57.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e4ff9640 10 monclient: dump: 2024-08-18T21:09:57.454 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.454 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.454 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.454 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.454 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.454 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.454 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.454 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.454 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.455 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e4ff9640 10 monclient: _finish_auth 0 2024-08-18T21:09:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e4ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:09:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e4ff9640 1 -- 172.21.15.5:0/1226644697 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e0012340 con 0x7f59e813a1b0 2024-08-18T21:09:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59ee3a8640 5 monclient: authenticate success, global_id 84492 2024-08-18T21:09:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59ee3a8640 10 monclient: _renew_subs 2024-08-18T21:09:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59ee3a8640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:09:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59ee3a8640 1 -- 172.21.15.5:0/1226644697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e8142df0 con 0x7f59e813a1b0 2024-08-18T21:09:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e4ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e4ff9640 1 -- 172.21.15.5:0/1226644697 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f59e0012960 con 0x7f59e813a1b0 2024-08-18T21:09:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:09:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e4ff9640 10 monclient: dump: 2024-08-18T21:09:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.457 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59ee3a8640 10 monclient: _renew_subs 2024-08-18T21:09:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e67fc640 4 set_mon_vals no callback set 2024-08-18T21:09:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59ee3a8640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:09:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59ee3a8640 1 -- 172.21.15.5:0/1226644697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e813e0c0 con 0x7f59e813a1b0 2024-08-18T21:09:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59ee3a8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:57.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59ee3a8640 1 --2- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e813afb0 0x7f59e813b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59ee3a8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59ee3a8640 1 -- 172.21.15.5:0/1226644697 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f59e80a7b60 con 0x7f59e813afb0 2024-08-18T21:09:57.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e4ff9640 1 -- 172.21.15.5:0/1226644697 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f59e0012c00 con 0x7f59e813a1b0 2024-08-18T21:09:57.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e7fff640 1 --2- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e813afb0 0x7f59e813b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e7fff640 10 monclient: get_auth_request con 0x7f59e813afb0 auth_method 0 2024-08-18T21:09:57.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e4ff9640 1 --2- 172.21.15.5:0/1226644697 >> v2:172.21.15.157:6812/631023601 conn(0x7f59d403be20 0x7f59d403e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e4ff9640 1 -- 172.21.15.5:0/1226644697 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(181..181 src has 22..181) ==== 3506+0+0 (secure 0 0 0) 0x7f59e004e130 con 0x7f59e813a1b0 2024-08-18T21:09:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e77fe640 1 --2- 172.21.15.5:0/1226644697 >> v2:172.21.15.157:6812/631023601 conn(0x7f59d403be20 0x7f59d403e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e77fe640 10 monclient: get_auth_request con 0x7f59d403be20 auth_method 0 2024-08-18T21:09:57.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e7fff640 10 monclient(hunting): handle_auth_done global_id 6103 payload 824 2024-08-18T21:09:57.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.441+0000 7f59e7fff640 1 -- 172.21.15.5:0/1226644697 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59e8143020 con 0x7f59e813afb0 2024-08-18T21:09:57.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.445+0000 7f59e7fff640 1 -- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e813afb0 msgr2=0x7f59e813b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:57.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.445+0000 7f59e7fff640 1 --2- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e813afb0 0x7f59e813b390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f59e80a7ef0 tx=0x7f59d8019140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.445+0000 7f59e77fe640 1 --2- 172.21.15.5:0/1226644697 >> v2:172.21.15.157:6812/631023601 conn(0x7f59d403be20 0x7f59d403e2e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f59e813c6b0 tx=0x7f59dc007e40 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.445+0000 7f59e4ff9640 1 -- 172.21.15.5:0/1226644697 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f59d80b0040 con 0x7f59e813afb0 2024-08-18T21:09:57.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.445+0000 7f59e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.445+0000 7f59e4ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:09:57.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.445+0000 7f59e4ff9640 10 monclient: dump: 2024-08-18T21:09:57.462 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.462 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.462 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.462 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.462 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.463 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.445+0000 7f59e4ff9640 1 -- 172.21.15.5:0/1226644697 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f59d80bb070 con 0x7f59e813afb0 2024-08-18T21:09:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.445+0000 7f59e4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:57.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.445+0000 7f59e4ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:57.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.445+0000 7f59e4ff9640 1 -- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e813afb0 msgr2=0x7f59e813b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.445+0000 7f59e4ff9640 1 --2- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e813afb0 0x7f59e813b390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f59e80a7ef0 tx=0x7f59d8019140 comp rx=0 tx=0).stop 2024-08-18T21:09:57.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.445+0000 7f59e4ff9640 1 -- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e813afb0 msgr2=0x7f59e813b390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:57.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.445+0000 7f59e4ff9640 1 --2- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e813afb0 0x7f59e813b390 secure :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f59e80a7ef0 tx=0x7f59d8019140 comp rx=0 tx=0).stop 2024-08-18T21:09:57.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.453+0000 7f59ee3a8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:57.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.453+0000 7f59ee3a8640 1 --2- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e813b8d0 0x7f59e8135c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.453+0000 7f59ee3a8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.453+0000 7f59ee3a8640 1 -- 172.21.15.5:0/1226644697 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f59e8051140 con 0x7f59e813b8d0 2024-08-18T21:09:57.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.453+0000 7f59e7fff640 1 --2- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e813b8d0 0x7f59e8135c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.453+0000 7f59e7fff640 10 monclient: get_auth_request con 0x7f59e813b8d0 auth_method 0 2024-08-18T21:09:57.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.453+0000 7f59e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.453+0000 7f59e7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.453+0000 7f59e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.453+0000 7f59e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.453+0000 7f59e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.453+0000 7f59e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.453+0000 7f59e7fff640 10 monclient(hunting): handle_auth_done global_id 6112 payload 824 2024-08-18T21:09:57.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.453+0000 7f59e7fff640 1 -- 172.21.15.5:0/1226644697 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f59e80a70c0 con 0x7f59e813b8d0 2024-08-18T21:09:57.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59e7fff640 1 -- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e813b8d0 msgr2=0x7f59e8135c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:57.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59e7fff640 1 --2- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e813b8d0 0x7f59e8135c70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f59d801c3e0 tx=0x7f59d80a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59e4ff9640 1 -- 172.21.15.5:0/1226644697 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f59d80b0030 con 0x7f59e813b8d0 2024-08-18T21:09:57.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59e4ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:09:57.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59e4ff9640 10 monclient: dump: 2024-08-18T21:09:57.465 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.465 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.466 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.466 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.466 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.466 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.466 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.466 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.466 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.466 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.466 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.466 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.466 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.466 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.466 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.467 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59e4ff9640 1 -- 172.21.15.5:0/1226644697 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f59d80b6690 con 0x7f59e813b8d0 2024-08-18T21:09:57.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59e4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:57.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59e4ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:57.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59e4ff9640 1 -- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e813b8d0 msgr2=0x7f59e8135c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59e4ff9640 1 --2- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e813b8d0 0x7f59e8135c70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f59d801c3e0 tx=0x7f59d80a8000 comp rx=0 tx=0).stop 2024-08-18T21:09:57.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59e4ff9640 1 -- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e813b8d0 msgr2=0x7f59e8135c70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:57.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59e4ff9640 1 --2- 172.21.15.5:0/1226644697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59e813b8d0 0x7f59e8135c70 secure :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f59d801c3e0 tx=0x7f59d80a8000 comp rx=0 tx=0).stop 2024-08-18T21:09:57.467 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 406538, 2024-08-18T21:09:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:57.469 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:57.469 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:57.469 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:57.469 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.469 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:09:57.469 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:57.469 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:57.469 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:57.469 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:57.469 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:57.469 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:57.469 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:57.469 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:57.469 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:57.470 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:57.470 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:57.470 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:57.470 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:57.470 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:57.470 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.470 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:57.470 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:57.470 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:57.470 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:57.470 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:57.470 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:57.470 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:57.471 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:57.471 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:57.471 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:57.471 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:57.471 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:57.471 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:57.471 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.471 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:57.471 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:57.471 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:57.471 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:57.471 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:57.471 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:57.472 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:57.472 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:57.472 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:57.472 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:57.472 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:57.472 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:57.472 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:57.472 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:57.472 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:57.472 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:57.472 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:57.472 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:57.472 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:57.472 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:57.473 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:57.473 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:57.473 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:57.473 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:57.473 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:57.473 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:57.473 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:57.473 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:57.473 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.473 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:57.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.473 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:57.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.473 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:57.474 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:57.474 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.474 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.474 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.474 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:57.474 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.474 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.474 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:57.474 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.474 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.475 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.475 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:57.475 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:57.475 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.475 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.475 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.475 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:57.475 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:57.475 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.475 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:57.476 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:57.476 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.476 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.476 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:57.476 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:57.476 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.477 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.477 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.477 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:57.477 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:57.477 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.477 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.477 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.477 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:57.477 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.478 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:57.478 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.478 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.478 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.478 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:57.478 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:57.478 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.478 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.478 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.479 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:57.479 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:57.479 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.479 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.479 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.479 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:57.479 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.479 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.479 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:57.479 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.480 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.480 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.480 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:57.480 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:57.480 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.480 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.480 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.480 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:57.480 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:57.480 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.480 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.481 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.481 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.481 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:57.481 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.481 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.481 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.481 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:57.481 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.481 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.481 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.481 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:57.481 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:57.482 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.482 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.482 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.482 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:57.482 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:57.482 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.482 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.482 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:57.482 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.483 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.483 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:57.483 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.483 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.483 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.483 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:57.483 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:57.483 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.483 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.483 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.484 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:57.484 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:57.484 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.484 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.484 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.484 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:57.484 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.484 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.484 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:57.484 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.485 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.485 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.485 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:57.485 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:57.485 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.485 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.485 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.485 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.485 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:57.485 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:57.485 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.486 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.486 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.486 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:57.486 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.486 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.486 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:57.487 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.487 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.487 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:57.487 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:57.487 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.487 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.487 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.487 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:57.487 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:57.488 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.488 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:57.488 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.488 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:57.488 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.488 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.488 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.489 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:57.489 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:57.489 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.489 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.489 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.489 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.489 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.489 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:57.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:57.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.489 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:57.489 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:57.490 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:57.490 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.490 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.490 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:09:57.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.490 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:57.490 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:57.490 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:57.490 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.490 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.490 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:57.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.490 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:57.491 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:57.491 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:09:57.491 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.491 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.491 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:57.491 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59ee3a8640 1 -- 172.21.15.5:0/1226644697 >> v2:172.21.15.157:6812/631023601 conn(0x7f59d403be20 msgr2=0x7f59d403e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59ee3a8640 1 --2- 172.21.15.5:0/1226644697 >> v2:172.21.15.157:6812/631023601 conn(0x7f59d403be20 0x7f59d403e2e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f59e813c6b0 tx=0x7f59dc007e40 comp rx=0 tx=0).stop 2024-08-18T21:09:57.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59ee3a8640 10 monclient: shutdown 2024-08-18T21:09:57.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59ee3a8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:57.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59ee3a8640 1 -- 172.21.15.5:0/1226644697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e813a1b0 msgr2=0x7f59e813aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59ee3a8640 1 --2- 172.21.15.5:0/1226644697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e813a1b0 0x7f59e813aa70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f59e000b970 tx=0x7f59e000be30 comp rx=0 tx=0).stop 2024-08-18T21:09:57.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59ec945640 1 -- 172.21.15.5:0/1226644697 reap_dead start 2024-08-18T21:09:57.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59ec945640 1 -- 172.21.15.5:0/1226644697 reap_dead start 2024-08-18T21:09:57.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59ee3a8640 1 -- 172.21.15.5:0/1226644697 shutdown_connections 2024-08-18T21:09:57.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59ee3a8640 1 -- 172.21.15.5:0/1226644697 >> 172.21.15.5:0/1226644697 conn(0x7f59e80acbc0 msgr2=0x7f59e80aaaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:57.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59ee3a8640 1 -- 172.21.15.5:0/1226644697 shutdown_connections 2024-08-18T21:09:57.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.457+0000 7f59ee3a8640 1 -- 172.21.15.5:0/1226644697 wait complete. 2024-08-18T21:09:57.494 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:57.494 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:09:57.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:09:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 10 monclient: get_monmap_and_config 2024-08-18T21:09:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 10 monclient: build_initial_monmap 2024-08-18T21:09:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 10 monclient: monmap: 2024-08-18T21:09:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:57.616483+0000 2024-08-18T21:09:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:57.616483+0000 2024-08-18T21:09:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:57.617 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:57.617 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 1 Processor -- start 2024-08-18T21:09:57.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 1 -- start start 2024-08-18T21:09:57.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 10 monclient: init 2024-08-18T21:09:57.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:57.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 10 monclient: _add_conns ranks=[0,4,7,10,5,9,2,1,8,6,3] 2024-08-18T21:09:57.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f67140a6ce0 addr v1:172.21.15.5:6789/0 2024-08-18T21:09:57.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f67140a77d0 0x7f671413ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 10 monclient(hunting): picked mon.noname-c con 0x7f67140a77d0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:57.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f671413f220 0x7f6714141610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 10 monclient(hunting): picked mon.noname-i con 0x7f671413f220 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:57.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67140a45d0 con 0x7f67140a6ce0 2024-08-18T21:09:57.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f67140a5000 con 0x7f67140a77d0 2024-08-18T21:09:57.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f67140a4360 con 0x7f671413f220 2024-08-18T21:09:57.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:57.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67194bc640 10 monclient(hunting): authenticate will time out at 1364.629691s 2024-08-18T21:09:57.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f67140a77d0 0x7f671413ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f6712ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f67140a6ce0 0x7f67140a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54858/0 (socket says 172.21.15.5:54858) 2024-08-18T21:09:57.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f6712ffd640 1 -- 172.21.15.5:0/471534260 learned_addr learned my addr 172.21.15.5:0/471534260 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:09:57.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 10 monclient(hunting): get_auth_request con 0x7f67140a77d0 auth_method 0 2024-08-18T21:09:57.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67137fe640 1 --2- 172.21.15.5:0/471534260 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f671413f220 0x7f6714141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67137fe640 10 monclient(hunting): get_auth_request con 0x7f671413f220 auth_method 0 2024-08-18T21:09:57.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67137fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67137fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 10 monclient(hunting): handle_auth_done global_id 6250 payload 274 2024-08-18T21:09:57.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 1 -- 172.21.15.5:0/471534260 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f671413f220 msgr2=0x7f6714141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:57.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 1 --2- 172.21.15.5:0/471534260 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f671413f220 0x7f6714141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 1 -- 172.21.15.5:0/471534260 >> v1:172.21.15.5:6789/0 conn(0x7f67140a6ce0 legacy=0x7f67140a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:57.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 10 monclient: _finish_hunting 0 2024-08-18T21:09:57.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 1 monclient: found mon.noname-c 2024-08-18T21:09:57.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:57.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:09:57.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.613+0000 7f67127fc640 1 -- 172.21.15.5:0/471534260 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67140a32d0 con 0x7f67140a77d0 2024-08-18T21:09:57.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67127fc640 1 -- 172.21.15.5:0/471534260 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f67140a77d0 msgr2=0x7f671413ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:57.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67127fc640 1 --2- 172.21.15.5:0/471534260 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f67140a77d0 0x7f671413ece0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6708009820 tx=0x7f670801c380 comp rx=0 tx=0).ready entity=mon.4 client_cookie=4c68e84ac5329a02 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f6711ffb640 1 -- 172.21.15.5:0/471534260 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f67080b0070 con 0x7f67140a77d0 2024-08-18T21:09:57.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f6711ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f6711ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:09:57.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f6711ffb640 10 monclient: dump: 2024-08-18T21:09:57.629 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.631 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f6711ffb640 10 monclient: _finish_auth 0 2024-08-18T21:09:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f6711ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:09:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f6711ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67194bc640 5 monclient: authenticate success, global_id 6250 2024-08-18T21:09:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f6711ffb640 1 -- 172.21.15.5:0/471534260 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67080aa810 con 0x7f67140a77d0 2024-08-18T21:09:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67194bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f6711ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67194bc640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67194bc640 4 set_mon_vals no callback set 2024-08-18T21:09:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f6711ffb640 1 -- 172.21.15.5:0/471534260 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f67080aae30 con 0x7f67140a77d0 2024-08-18T21:09:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f6711ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f6711ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f6711ffb640 10 monclient: dump: 2024-08-18T21:09:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.633 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67194bc640 10 monclient: shutdown 2024-08-18T21:09:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67194bc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67194bc640 1 -- 172.21.15.5:0/471534260 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f67140a77d0 msgr2=0x7f671413ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67194bc640 1 --2- 172.21.15.5:0/471534260 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f67140a77d0 0x7f671413ece0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6708009820 tx=0x7f670801c380 comp rx=0 tx=0).stop 2024-08-18T21:09:57.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67194bc640 1 -- 172.21.15.5:0/471534260 shutdown_connections 2024-08-18T21:09:57.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67194bc640 1 --2- 172.21.15.5:0/471534260 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f671413f220 0x7f6714141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67194bc640 1 --2- 172.21.15.5:0/471534260 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f67140a77d0 0x7f671413ece0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67194bc640 1 -- 172.21.15.5:0/471534260 >> 172.21.15.5:0/471534260 conn(0x7f67140acbc0 msgr2=0x7f67140a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:57.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67194bc640 1 -- 172.21.15.5:0/471534260 shutdown_connections 2024-08-18T21:09:57.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67194bc640 1 -- 172.21.15.5:0/471534260 wait complete. 2024-08-18T21:09:57.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.617+0000 7f67194bc640 10 monclient: build_initial_monmap 2024-08-18T21:09:57.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 10 monclient: monmap: 2024-08-18T21:09:57.634 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:57.634 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:57.634 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:57.634 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:57.635 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:57.635 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.635 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:57.635 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:57.635 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:57.635 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:57.635 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:57.635 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:57.635 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:57.635 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:57.635 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:57.635 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 1 Processor -- start 2024-08-18T21:09:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 1 -- start start 2024-08-18T21:09:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 10 monclient: init 2024-08-18T21:09:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 10 monclient: _add_conns ranks=[3,6,4,7,2,8,0,1,5] 2024-08-18T21:09:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67140a6ce0 0x7f67140a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 10 monclient(hunting): picked mon.noname-g con 0x7f67140a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:09:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f67140a77d0 0x7f67140a21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 10 monclient(hunting): picked mon.noname-d con 0x7f67140a77d0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:09:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f671413f220 0x7f671413d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 10 monclient(hunting): picked mon.noname-c con 0x7f671413f220 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f67140a83a0 con 0x7f67140a6ce0 2024-08-18T21:09:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f67140a8220 con 0x7f671413f220 2024-08-18T21:09:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f6714144370 con 0x7f67140a77d0 2024-08-18T21:09:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67194bc640 10 monclient(hunting): authenticate will time out at 1364.637058s 2024-08-18T21:09:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67137fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f671413f220 0x7f671413d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f67140a77d0 0x7f67140a21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f67140a77d0 0x7f67140a21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54464/0 (socket says 172.21.15.5:54464) 2024-08-18T21:09:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 1 -- 172.21.15.5:0/1974964779 learned_addr learned my addr 172.21.15.5:0/1974964779 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 10 monclient(hunting): get_auth_request con 0x7f67140a77d0 auth_method 0 2024-08-18T21:09:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67137fe640 10 monclient(hunting): get_auth_request con 0x7f671413f220 auth_method 0 2024-08-18T21:09:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67137fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67137fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f6712ffd640 1 --2- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67140a6ce0 0x7f67140a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f6712ffd640 10 monclient(hunting): get_auth_request con 0x7f67140a6ce0 auth_method 0 2024-08-18T21:09:57.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f6712ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f6712ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f6712ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 10 monclient(hunting): handle_auth_done global_id 84741 payload 824 2024-08-18T21:09:57.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 1 -- 172.21.15.5:0/1974964779 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f671413f220 msgr2=0x7f671413d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 1 --2- 172.21.15.5:0/1974964779 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f671413f220 0x7f671413d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 1 -- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67140a6ce0 msgr2=0x7f67140a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 1 --2- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67140a6ce0 0x7f67140a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 10 monclient: _finish_hunting 0 2024-08-18T21:09:57.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 1 monclient: found mon.noname-d 2024-08-18T21:09:57.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:57.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:09:57.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 1 -- 172.21.15.5:0/1974964779 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6714140e40 con 0x7f67140a77d0 2024-08-18T21:09:57.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67137fe640 1 --2- 172.21.15.5:0/1974964779 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f671413f220 0x7f671413d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:57.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 1 -- 172.21.15.5:0/1974964779 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f67140a77d0 msgr2=0x7f67140a21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:57.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.621+0000 7f67127fc640 1 --2- 172.21.15.5:0/1974964779 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f67140a77d0 0x7f67140a21e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6708009710 tx=0x7f6708019120 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f66fb7fe640 1 -- 172.21.15.5:0/1974964779 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f67080b0040 con 0x7f67140a77d0 2024-08-18T21:09:57.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f66fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f66fb7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:09:57.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f66fb7fe640 10 monclient: dump: 2024-08-18T21:09:57.641 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.641 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.641 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.641 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.641 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.641 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.641 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.641 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.642 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f66fb7fe640 10 monclient: _finish_auth 0 2024-08-18T21:09:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f66fb7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:09:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f66fb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f66fb7fe640 1 -- 172.21.15.5:0/1974964779 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67080b9070 con 0x7f67140a77d0 2024-08-18T21:09:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f67194bc640 5 monclient: authenticate success, global_id 84741 2024-08-18T21:09:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f67194bc640 10 monclient: _renew_subs 2024-08-18T21:09:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f67194bc640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:09:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f67194bc640 1 -- 172.21.15.5:0/1974964779 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f671409f480 con 0x7f67140a77d0 2024-08-18T21:09:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f66fb7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f66fb7fe640 1 -- 172.21.15.5:0/1974964779 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6708004250 con 0x7f67140a77d0 2024-08-18T21:09:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f66fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f66fb7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:09:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f66fb7fe640 10 monclient: dump: 2024-08-18T21:09:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.645 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f67194bc640 10 monclient: _renew_subs 2024-08-18T21:09:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f67194bc640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:09:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f67194bc640 1 -- 172.21.15.5:0/1974964779 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f67140aaf80 con 0x7f67140a77d0 2024-08-18T21:09:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f67117fa640 4 set_mon_vals no callback set 2024-08-18T21:09:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f67194bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f67194bc640 1 --2- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67141d1760 0x7f671413d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f67194bc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f67194bc640 1 -- 172.21.15.5:0/1974964779 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6714051140 con 0x7f67141d1760 2024-08-18T21:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f66fb7fe640 1 -- 172.21.15.5:0/1974964779 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f67080b3070 con 0x7f67140a77d0 2024-08-18T21:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f66fb7fe640 1 --2- 172.21.15.5:0/1974964779 >> v2:172.21.15.157:6812/631023601 conn(0x7f670003bdf0 0x7f670003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f6712ffd640 1 --2- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67141d1760 0x7f671413d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f66fb7fe640 1 -- 172.21.15.5:0/1974964779 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(181..181 src has 22..181) ==== 3506+0+0 (secure 0 0 0) 0x7f67080e81f0 con 0x7f67140a77d0 2024-08-18T21:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f6712ffd640 10 monclient: get_auth_request con 0x7f67141d1760 auth_method 0 2024-08-18T21:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f6712ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f6712ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f6712ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f6712ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f6712ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f6712ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f67137fe640 1 --2- 172.21.15.5:0/1974964779 >> v2:172.21.15.157:6812/631023601 conn(0x7f670003bdf0 0x7f670003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f67137fe640 10 monclient: get_auth_request con 0x7f670003bdf0 auth_method 0 2024-08-18T21:09:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f6712ffd640 10 monclient(hunting): handle_auth_done global_id 84495 payload 824 2024-08-18T21:09:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.625+0000 7f6712ffd640 1 -- 172.21.15.5:0/1974964779 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f67140a70c0 con 0x7f67141d1760 2024-08-18T21:09:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.629+0000 7f6712ffd640 1 -- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67141d1760 msgr2=0x7f671413d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.629+0000 7f6712ffd640 1 --2- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67141d1760 0x7f671413d670 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f670400e500 tx=0x7f670400e9c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.629+0000 7f67137fe640 1 --2- 172.21.15.5:0/1974964779 >> v2:172.21.15.157:6812/631023601 conn(0x7f670003bdf0 0x7f670003e2b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f670c007720 tx=0x7f670c009780 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.629+0000 7f66fb7fe640 1 -- 172.21.15.5:0/1974964779 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6704004e40 con 0x7f67141d1760 2024-08-18T21:09:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.629+0000 7f66fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.629+0000 7f66fb7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:09:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.629+0000 7f66fb7fe640 10 monclient: dump: 2024-08-18T21:09:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.651 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.651 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.651 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.651 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.651 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.651 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.651 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.651 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.629+0000 7f66fb7fe640 1 -- 172.21.15.5:0/1974964779 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6704018070 con 0x7f67141d1760 2024-08-18T21:09:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.629+0000 7f66fb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.629+0000 7f66fb7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.629+0000 7f66fb7fe640 1 -- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67141d1760 msgr2=0x7f671413d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.629+0000 7f66fb7fe640 1 --2- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67141d1760 0x7f671413d670 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f670400e500 tx=0x7f670400e9c0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.629+0000 7f66fb7fe640 1 -- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67141d1760 msgr2=0x7f671413d670 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.629+0000 7f66fb7fe640 1 --2- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67141d1760 0x7f671413d670 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f670400e500 tx=0x7f670400e9c0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.637+0000 7f67194bc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.637+0000 7f67194bc640 1 --2- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f671413dbb0 0x7f671413f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.637+0000 7f67194bc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.637+0000 7f67194bc640 1 -- 172.21.15.5:0/1974964779 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f671413dfc0 con 0x7f671413dbb0 2024-08-18T21:09:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.637+0000 7f6712ffd640 1 --2- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f671413dbb0 0x7f671413f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.637+0000 7f6712ffd640 10 monclient: get_auth_request con 0x7f671413dbb0 auth_method 0 2024-08-18T21:09:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.637+0000 7f6712ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.637+0000 7f6712ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.637+0000 7f6712ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.637+0000 7f6712ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.637+0000 7f6712ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.637+0000 7f6712ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.637+0000 7f6712ffd640 10 monclient(hunting): handle_auth_done global_id 84504 payload 824 2024-08-18T21:09:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.637+0000 7f6712ffd640 1 -- 172.21.15.5:0/1974964779 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f671413ebf0 con 0x7f671413dbb0 2024-08-18T21:09:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.637+0000 7f6712ffd640 1 -- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f671413dbb0 msgr2=0x7f671413f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.637+0000 7f6712ffd640 1 --2- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f671413dbb0 0x7f671413f600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6704017000 tx=0x7f6704004950 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f66fb7fe640 1 -- 172.21.15.5:0/1974964779 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6704028440 con 0x7f671413dbb0 2024-08-18T21:09:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f66fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f66fb7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:09:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f66fb7fe640 10 monclient: dump: 2024-08-18T21:09:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.655 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f66fb7fe640 1 -- 172.21.15.5:0/1974964779 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f67040064f0 con 0x7f671413dbb0 2024-08-18T21:09:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f66fb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f66fb7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f66fb7fe640 1 -- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f671413dbb0 msgr2=0x7f671413f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f66fb7fe640 1 --2- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f671413dbb0 0x7f671413f600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6704017000 tx=0x7f6704004950 comp rx=0 tx=0).stop 2024-08-18T21:09:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f66fb7fe640 1 -- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f671413dbb0 msgr2=0x7f671413f600 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f66fb7fe640 1 --2- 172.21.15.5:0/1974964779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f671413dbb0 0x7f671413f600 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6704017000 tx=0x7f6704004950 comp rx=0 tx=0).stop 2024-08-18T21:09:57.656 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:57.656 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:57.656 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:57.656 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:57.656 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:57.656 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 94466, 2024-08-18T21:09:57.656 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:57.656 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:57.656 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:57.656 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:57.656 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:57.656 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:57.656 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:57.657 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:57.657 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:57.657 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:57.657 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.657 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:09:57.657 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:57.657 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:57.657 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:57.657 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:57.657 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:57.657 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:57.657 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:57.657 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:57.658 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:57.658 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:57.658 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:57.658 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:57.658 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:57.658 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:57.658 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.658 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:57.658 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:57.659 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:57.659 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:57.659 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:57.659 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:57.659 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:57.659 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:57.659 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:57.659 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:57.659 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:57.659 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:57.659 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:57.659 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.660 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:57.660 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:57.660 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:57.660 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:57.660 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:57.660 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:57.660 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:57.660 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:57.660 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:57.660 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:57.660 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:57.660 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:57.661 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:57.661 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:57.661 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:57.661 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:57.661 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:57.661 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:57.661 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:57.661 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:57.661 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:57.661 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:57.661 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:57.661 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:57.661 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:57.662 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:57.662 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:57.662 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:57.662 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.662 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:57.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.662 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:57.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.662 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:57.662 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:57.663 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.663 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.663 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.663 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:57.663 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.664 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.664 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:57.664 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.664 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.664 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.664 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:57.664 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:57.664 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.664 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.664 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.665 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:57.665 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:57.665 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.665 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.665 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.665 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:57.665 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.665 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.665 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:57.665 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.665 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.666 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.666 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:57.666 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:57.666 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.666 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.666 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.666 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:57.666 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:57.666 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.667 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.667 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.667 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:57.667 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.667 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.667 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:57.667 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.667 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.667 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.667 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:57.667 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:57.668 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.668 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.668 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.668 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.668 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:57.668 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:57.668 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.668 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.668 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.668 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.668 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:57.668 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.669 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.669 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.669 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:57.669 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.669 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.669 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.669 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:57.669 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:57.669 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.669 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.670 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.670 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.670 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:57.670 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:57.670 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.670 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.670 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.670 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.670 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.672 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.672 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:57.672 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:57.672 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.672 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.672 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.672 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:57.672 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.673 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.673 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:57.673 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.673 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.673 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.673 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:57.673 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:57.673 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.673 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.673 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.673 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:57.674 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:57.674 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.674 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.674 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.674 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:57.674 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.674 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.674 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:57.674 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.674 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.675 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.675 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:57.675 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:57.675 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.675 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.675 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.675 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:57.675 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:57.675 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.675 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.676 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.676 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:57.676 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.676 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.676 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:57.676 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.676 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.676 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.677 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:57.677 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:57.677 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.677 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.677 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.677 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.677 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:57.677 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:57.677 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.677 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.677 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.678 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.678 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:57.678 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.678 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.678 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:57.678 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.678 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.678 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.678 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:57.678 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:57.679 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.679 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.679 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.679 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.679 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.679 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:57.679 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:57.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.679 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:57.680 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:57.680 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:57.680 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.680 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.680 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:57.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.680 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:57.680 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:57.680 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:57.680 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.680 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.680 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:57.680 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:57.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f67194bc640 1 -- 172.21.15.5:0/1974964779 >> v2:172.21.15.157:6812/631023601 conn(0x7f670003bdf0 msgr2=0x7f670003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f67194bc640 1 --2- 172.21.15.5:0/1974964779 >> v2:172.21.15.157:6812/631023601 conn(0x7f670003bdf0 0x7f670003e2b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f670c007720 tx=0x7f670c009780 comp rx=0 tx=0).stop 2024-08-18T21:09:57.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f67194bc640 10 monclient: shutdown 2024-08-18T21:09:57.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f67194bc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:57.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f67194bc640 1 -- 172.21.15.5:0/1974964779 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f67140a77d0 msgr2=0x7f67140a21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f67194bc640 1 --2- 172.21.15.5:0/1974964779 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f67140a77d0 0x7f67140a21e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6708009710 tx=0x7f6708019120 comp rx=0 tx=0).stop 2024-08-18T21:09:57.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f67137fe640 1 -- 172.21.15.5:0/1974964779 reap_dead start 2024-08-18T21:09:57.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f67137fe640 1 -- 172.21.15.5:0/1974964779 reap_dead start 2024-08-18T21:09:57.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f67194bc640 1 -- 172.21.15.5:0/1974964779 shutdown_connections 2024-08-18T21:09:57.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f67194bc640 1 -- 172.21.15.5:0/1974964779 >> 172.21.15.5:0/1974964779 conn(0x7f67140acbc0 msgr2=0x7f67140ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:57.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f67194bc640 1 -- 172.21.15.5:0/1974964779 shutdown_connections 2024-08-18T21:09:57.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.641+0000 7f67194bc640 1 -- 172.21.15.5:0/1974964779 wait complete. 2024-08-18T21:09:57.683 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:57.683 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:09:57.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:09:57.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 10 monclient: get_monmap_and_config 2024-08-18T21:09:57.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 10 monclient: build_initial_monmap 2024-08-18T21:09:57.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 10 monclient: monmap: 2024-08-18T21:09:57.800 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:57.800 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:57.801817+0000 2024-08-18T21:09:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:57.801817+0000 2024-08-18T21:09:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:57.802 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:57.802 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:57.802 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 1 Processor -- start 2024-08-18T21:09:57.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 1 -- start start 2024-08-18T21:09:57.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 10 monclient: init 2024-08-18T21:09:57.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:57.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 10 monclient: _add_conns ranks=[5,4,7,8,9,2,3,1,6,0,10] 2024-08-18T21:09:57.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4790137a70 0x7f47900a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 10 monclient(hunting): picked mon.noname-h con 0x7f4790137a70 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:57.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47900a4c10 0x7f4790137e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 10 monclient(hunting): picked mon.noname-c con 0x7f47900a4c10 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:57.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f479006c950 0x7f479006cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 10 monclient(hunting): picked mon.noname-i con 0x7f479006c950 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:09:57.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f47900a03e0 con 0x7f47900a4c10 2024-08-18T21:09:57.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f479009fe40 con 0x7f4790137a70 2024-08-18T21:09:57.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f47900a08e0 con 0x7f479006c950 2024-08-18T21:09:57.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:57.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479798f640 10 monclient(hunting): authenticate will time out at 1364.815048s 2024-08-18T21:09:57.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47900a4c10 0x7f4790137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47900a4c10 0x7f4790137e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:43100/0 (socket says 172.21.15.5:43100) 2024-08-18T21:09:57.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 1 -- 172.21.15.5:0/737150956 learned_addr learned my addr 172.21.15.5:0/737150956 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:57.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 10 monclient(hunting): get_auth_request con 0x7f47900a4c10 auth_method 0 2024-08-18T21:09:57.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4795f2c640 1 --2- 172.21.15.5:0/737150956 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f479006c950 0x7f479006cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479572b640 1 --2- 172.21.15.5:0/737150956 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4790137a70 0x7f47900a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479572b640 10 monclient(hunting): get_auth_request con 0x7f4790137a70 auth_method 0 2024-08-18T21:09:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479572b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479572b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f479572b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 10 monclient(hunting): handle_auth_done global_id 6268 payload 274 2024-08-18T21:09:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 1 -- 172.21.15.5:0/737150956 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f479006c950 msgr2=0x7f479006cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 1 --2- 172.21.15.5:0/737150956 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f479006c950 0x7f479006cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 1 -- 172.21.15.5:0/737150956 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4790137a70 msgr2=0x7f47900a1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 1 --2- 172.21.15.5:0/737150956 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4790137a70 0x7f47900a1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 10 monclient: _finish_hunting 0 2024-08-18T21:09:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 1 monclient: found mon.noname-c 2024-08-18T21:09:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:09:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4794f2a640 1 -- 172.21.15.5:0/737150956 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47900a0bc0 con 0x7f47900a4c10 2024-08-18T21:09:57.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4795f2c640 10 monclient: get_auth_request con 0x7f479006c950 auth_method 0 2024-08-18T21:09:57.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.797+0000 7f4795f2c640 1 --2- 172.21.15.5:0/737150956 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f479006c950 0x7f479006cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:09:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 1 -- 172.21.15.5:0/737150956 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47900a4c10 msgr2=0x7f4790137e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 1 --2- 172.21.15.5:0/737150956 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47900a4c10 0x7f4790137e50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f47840098a0 tx=0x7f478401c440 comp rx=0 tx=0).ready entity=mon.4 client_cookie=fcc5776a9d341b59 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f478ffff640 1 -- 172.21.15.5:0/737150956 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47840b0070 con 0x7f47900a4c10 2024-08-18T21:09:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f478ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f478ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:09:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f478ffff640 10 monclient: dump: 2024-08-18T21:09:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.813 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f478ffff640 10 monclient: _finish_auth 0 2024-08-18T21:09:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f478ffff640 10 monclient: _check_auth_tickets 2024-08-18T21:09:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f478ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f478ffff640 1 -- 172.21.15.5:0/737150956 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47840aa810 con 0x7f47900a4c10 2024-08-18T21:09:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f478ffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f478ffff640 1 -- 172.21.15.5:0/737150956 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47840aae30 con 0x7f47900a4c10 2024-08-18T21:09:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 5 monclient: authenticate success, global_id 6268 2024-08-18T21:09:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 4 set_mon_vals no callback set 2024-08-18T21:09:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f478ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f478ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:09:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f478ffff640 10 monclient: dump: 2024-08-18T21:09:57.814 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.814 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.814 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.814 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.814 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.814 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.814 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.814 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.814 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.814 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.814 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.814 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.814 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.815 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 10 monclient: shutdown 2024-08-18T21:09:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 -- 172.21.15.5:0/737150956 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47900a4c10 msgr2=0x7f4790137e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 --2- 172.21.15.5:0/737150956 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47900a4c10 0x7f4790137e50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f47840098a0 tx=0x7f478401c440 comp rx=0 tx=0).stop 2024-08-18T21:09:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 -- 172.21.15.5:0/737150956 shutdown_connections 2024-08-18T21:09:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 --2- 172.21.15.5:0/737150956 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f479006c950 0x7f479006cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 --2- 172.21.15.5:0/737150956 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47900a4c10 0x7f4790137e50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 --2- 172.21.15.5:0/737150956 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4790137a70 0x7f47900a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 -- 172.21.15.5:0/737150956 >> 172.21.15.5:0/737150956 conn(0x7f47900688d0 msgr2=0x7f4790068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 -- 172.21.15.5:0/737150956 shutdown_connections 2024-08-18T21:09:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 -- 172.21.15.5:0/737150956 wait complete. 2024-08-18T21:09:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 10 monclient: build_initial_monmap 2024-08-18T21:09:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 10 monclient: monmap: 2024-08-18T21:09:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:57.817 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 Processor -- start 2024-08-18T21:09:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 -- start start 2024-08-18T21:09:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 10 monclient: init 2024-08-18T21:09:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 10 monclient: _add_conns ranks=[4,0,1,5,6,7,3,8,2] 2024-08-18T21:09:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f479006c950 0x7f4790136630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 10 monclient(hunting): picked mon.noname-c con 0x7f479006c950 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:09:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47900a4c10 0x7f4790136b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 10 monclient(hunting): picked mon.noname-a con 0x7f47900a4c10 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:09:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4790137a70 0x7f4790120370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 10 monclient(hunting): picked mon.noname-f con 0x7f4790137a70 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:09:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f47901414b0 con 0x7f47900a4c10 2024-08-18T21:09:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4790141330 con 0x7f4790137a70 2024-08-18T21:09:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f4790141630 con 0x7f479006c950 2024-08-18T21:09:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479798f640 10 monclient(hunting): authenticate will time out at 1364.822844s 2024-08-18T21:09:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479572b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f479006c950 0x7f4790136630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47900a4c10 0x7f4790136b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47900a4c10 0x7f4790136b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57672/0 (socket says 172.21.15.5:57672) 2024-08-18T21:09:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479572b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f479006c950 0x7f4790136630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:43106/0 (socket says 172.21.15.5:43106) 2024-08-18T21:09:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 1 -- 172.21.15.5:0/2798382119 learned_addr learned my addr 172.21.15.5:0/2798382119 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 10 monclient(hunting): get_auth_request con 0x7f47900a4c10 auth_method 0 2024-08-18T21:09:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479572b640 10 monclient(hunting): get_auth_request con 0x7f479006c950 auth_method 0 2024-08-18T21:09:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479572b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479572b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479572b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4795f2c640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4790137a70 0x7f4790120370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479572b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479572b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479572b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4795f2c640 10 monclient(hunting): get_auth_request con 0x7f4790137a70 auth_method 0 2024-08-18T21:09:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4795f2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4795f2c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4795f2c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4795f2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4795f2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4795f2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 10 monclient(hunting): handle_auth_done global_id 84501 payload 824 2024-08-18T21:09:57.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 1 -- 172.21.15.5:0/2798382119 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f479006c950 msgr2=0x7f4790136630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f479006c950 0x7f4790136630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 1 -- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4790137a70 msgr2=0x7f4790120370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4790137a70 0x7f4790120370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 10 monclient: _finish_hunting 0 2024-08-18T21:09:57.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 1 monclient: found mon.noname-a 2024-08-18T21:09:57.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:57.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:09:57.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f4794f2a640 1 -- 172.21.15.5:0/2798382119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47901374f0 con 0x7f47900a4c10 2024-08-18T21:09:57.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.805+0000 7f479572b640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f479006c950 0x7f4790136630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:09:57.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f4794f2a640 1 -- 172.21.15.5:0/2798382119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47900a4c10 msgr2=0x7f4790136b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:57.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f4794f2a640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47900a4c10 0x7f4790136b70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f47840097c0 tx=0x7f47840191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f478dffb640 1 -- 172.21.15.5:0/2798382119 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47840ba070 con 0x7f47900a4c10 2024-08-18T21:09:57.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f478dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f478dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:09:57.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f478dffb640 10 monclient: dump: 2024-08-18T21:09:57.826 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.827 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.827 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.827 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.827 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.827 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.827 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.827 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.827 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.827 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.827 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.828 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.828 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.828 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.829 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.829 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f478dffb640 10 monclient: _finish_auth 0 2024-08-18T21:09:57.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f478dffb640 10 monclient: _check_auth_tickets 2024-08-18T21:09:57.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f478dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:57.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f478dffb640 1 -- 172.21.15.5:0/2798382119 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47840b1040 con 0x7f47900a4c10 2024-08-18T21:09:57.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479798f640 5 monclient: authenticate success, global_id 84501 2024-08-18T21:09:57.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479798f640 10 monclient: _renew_subs 2024-08-18T21:09:57.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479798f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:09:57.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479798f640 1 -- 172.21.15.5:0/2798382119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4790069070 con 0x7f47900a4c10 2024-08-18T21:09:57.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f478dffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:57.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f478dffb640 1 -- 172.21.15.5:0/2798382119 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47840b0070 con 0x7f47900a4c10 2024-08-18T21:09:57.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f478dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f478dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:09:57.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f478dffb640 10 monclient: dump: 2024-08-18T21:09:57.830 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.830 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.830 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.830 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.830 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.830 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.830 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.830 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.830 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.830 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.830 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.831 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.831 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.831 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.831 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.831 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f478f7fe640 4 set_mon_vals no callback set 2024-08-18T21:09:57.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479798f640 10 monclient: _renew_subs 2024-08-18T21:09:57.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479798f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:09:57.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479798f640 1 -- 172.21.15.5:0/2798382119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47901227f0 con 0x7f47900a4c10 2024-08-18T21:09:57.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479798f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:57.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479798f640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47901208b0 0x7f4790120c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479798f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479798f640 1 -- 172.21.15.5:0/2798382119 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f4790051140 con 0x7f47901208b0 2024-08-18T21:09:57.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f4794f2a640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47900a4c10 0x7f4790136b70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f47840097c0 tx=0x7f47840191e0 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7f47840e7810 osd_map(181..181 src has 22..181) 2024-08-18T21:09:57.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f478dffb640 1 -- 172.21.15.5:0/2798382119 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f4784004250 con 0x7f47900a4c10 2024-08-18T21:09:57.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479572b640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47901208b0 0x7f4790120c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479572b640 10 monclient: get_auth_request con 0x7f47901208b0 auth_method 0 2024-08-18T21:09:57.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479572b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479572b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479572b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f478dffb640 1 --2- 172.21.15.5:0/2798382119 >> v2:172.21.15.157:6812/631023601 conn(0x7f477c03bdc0 0x7f477c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479572b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479572b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479572b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f4795f2c640 1 --2- 172.21.15.5:0/2798382119 >> v2:172.21.15.157:6812/631023601 conn(0x7f477c03bdc0 0x7f477c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f4795f2c640 10 monclient: get_auth_request con 0x7f477c03bdc0 auth_method 0 2024-08-18T21:09:57.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479572b640 10 monclient(hunting): handle_auth_done global_id 94280 payload 824 2024-08-18T21:09:57.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.809+0000 7f479572b640 1 -- 172.21.15.5:0/2798382119 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f479006dbf0 con 0x7f47901208b0 2024-08-18T21:09:57.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.813+0000 7f479572b640 1 -- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47901208b0 msgr2=0x7f4790120c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:57.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.813+0000 7f479572b640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47901208b0 0x7f4790120c90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4780010b90 tx=0x7f478000e5a0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.813+0000 7f478dffb640 1 -- 172.21.15.5:0/2798382119 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4780018070 con 0x7f47901208b0 2024-08-18T21:09:57.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.813+0000 7f478dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.813+0000 7f478dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:09:57.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.813+0000 7f4795f2c640 1 --2- 172.21.15.5:0/2798382119 >> v2:172.21.15.157:6812/631023601 conn(0x7f477c03bdc0 0x7f477c03e280 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4790121a50 tx=0x7f47880077a0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.813+0000 7f478dffb640 10 monclient: dump: 2024-08-18T21:09:57.833 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.833 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.833 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.833 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.833 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.834 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.834 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.834 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.834 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.834 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.834 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.834 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.834 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.834 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.834 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.834 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.813+0000 7f478dffb640 1 -- 172.21.15.5:0/2798382119 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4780010e90 con 0x7f47901208b0 2024-08-18T21:09:57.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.813+0000 7f478dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:57.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.813+0000 7f478dffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:57.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.813+0000 7f478dffb640 1 -- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47901208b0 msgr2=0x7f4790120c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.813+0000 7f478dffb640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47901208b0 0x7f4790120c90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4780010b90 tx=0x7f478000e5a0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.813+0000 7f478dffb640 1 -- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47901208b0 msgr2=0x7f4790120c90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:57.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.813+0000 7f478dffb640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47901208b0 0x7f4790120c90 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4780010b90 tx=0x7f478000e5a0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.821+0000 7f479798f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:57.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.821+0000 7f479798f640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47901211d0 0x7f479006ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:57.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.821+0000 7f479798f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:57.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.821+0000 7f479798f640 1 -- 172.21.15.5:0/2798382119 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f4790068cb0 con 0x7f47901211d0 2024-08-18T21:09:57.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.821+0000 7f479572b640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47901211d0 0x7f479006ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:57.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.821+0000 7f479572b640 10 monclient: get_auth_request con 0x7f47901211d0 auth_method 0 2024-08-18T21:09:57.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.821+0000 7f479572b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:57.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.821+0000 7f479572b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:57.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.821+0000 7f479572b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:57.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.821+0000 7f479572b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:57.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.821+0000 7f479572b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:57.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.821+0000 7f479572b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:57.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.821+0000 7f479572b640 10 monclient(hunting): handle_auth_done global_id 94289 payload 824 2024-08-18T21:09:57.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.821+0000 7f479572b640 1 -- 172.21.15.5:0/2798382119 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4790137e50 con 0x7f47901211d0 2024-08-18T21:09:57.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f479572b640 1 -- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47901211d0 msgr2=0x7f479006ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:57.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f479572b640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47901211d0 0x7f479006ff60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4780010b90 tx=0x7f47800046d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:57.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f478dffb640 1 -- 172.21.15.5:0/2798382119 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f478002b020 con 0x7f47901211d0 2024-08-18T21:09:57.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f478dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:57.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f478dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:09:57.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f478dffb640 10 monclient: dump: 2024-08-18T21:09:57.838 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:57.838 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.838 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.838 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:57.838 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:57.838 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.838 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:57.838 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:57.838 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:57.838 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:57.838 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:57.838 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:57.838 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:57.839 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:57.839 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:57.839 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:57.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f478dffb640 1 -- 172.21.15.5:0/2798382119 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f478001d950 con 0x7f47901211d0 2024-08-18T21:09:57.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f478dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:57.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f478dffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:57.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f478dffb640 1 -- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47901211d0 msgr2=0x7f479006ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f478dffb640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47901211d0 0x7f479006ff60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4780010b90 tx=0x7f47800046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f478dffb640 1 -- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47901211d0 msgr2=0x7f479006ff60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:57.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f478dffb640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47901211d0 0x7f479006ff60 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4780010b90 tx=0x7f47800046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.840 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:57.840 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:57.840 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:57.840 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:57.840 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:57.840 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 25863, 2024-08-18T21:09:57.840 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:57.840 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:57.840 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:57.840 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:57.840 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:57.840 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:57.840 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:57.841 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:57.841 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:57.841 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:57.841 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.841 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:09:57.841 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:57.841 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:57.841 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:57.841 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:57.841 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:57.841 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:57.841 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:57.841 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:57.841 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:57.842 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:57.842 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:57.842 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:57.842 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:57.842 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:57.842 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.842 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:57.842 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:57.842 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:57.842 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:57.842 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:57.842 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:57.842 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:57.843 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:57.843 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:57.843 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:57.843 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:57.843 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:57.843 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:57.843 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.843 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:57.844 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:57.844 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:57.844 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:57.844 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:57.844 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:57.844 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:57.844 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:57.844 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:57.844 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:57.845 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:57.845 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:57.845 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:57.845 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:57.845 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:57.845 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:57.845 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:57.845 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:57.845 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:57.845 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:57.845 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:57.845 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:57.845 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:57.846 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:57.846 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:57.846 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:57.846 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:57.846 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:57.846 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.846 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:57.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.847 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:57.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.847 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:57.847 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:57.847 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.847 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.847 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.847 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:57.848 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.848 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.848 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.848 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:57.848 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.848 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.848 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.848 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:57.848 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:57.848 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.848 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.848 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.849 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.849 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:57.849 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:57.849 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.849 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.849 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.849 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.849 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:57.849 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.849 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.849 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.849 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:57.850 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.850 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.850 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.850 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:57.850 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:57.850 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.850 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.850 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.850 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.850 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:57.850 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:57.851 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.851 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.851 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.851 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.851 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:57.851 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.851 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.851 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.851 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:57.851 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.851 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.851 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.852 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:57.852 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:57.852 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.852 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.852 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.852 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:57.852 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:57.852 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.852 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.852 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.852 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:57.853 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.853 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.853 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.853 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:57.853 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.853 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.853 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.853 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:57.853 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:57.853 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.853 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.853 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.854 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.854 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:57.854 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:57.854 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.854 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.854 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.854 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.854 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:57.854 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.854 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.855 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.855 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:57.855 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.855 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.855 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.855 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:57.855 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:57.855 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.855 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.855 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.855 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.855 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:57.856 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:57.856 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.856 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.856 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.856 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.856 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:57.856 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.856 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.856 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.856 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:57.856 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.856 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.856 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.857 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:57.857 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:57.857 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.857 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.857 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.857 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.857 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:57.857 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:57.857 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.857 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.857 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.857 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.858 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:57.858 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.858 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.858 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.858 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:57.858 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.858 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.858 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.858 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:57.858 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:57.858 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.858 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.859 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.859 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:57.859 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:57.859 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.859 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.859 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.859 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:57.859 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.859 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.860 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:57.860 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.860 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.860 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.860 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:57.860 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:57.860 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.860 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.861 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.861 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:57.861 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:57.861 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:57.861 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:57.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.861 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:57.861 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:57.861 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.862 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:57.862 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:57.862 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:57.862 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.862 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.862 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:57.862 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:57.862 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:57.862 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:57.862 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:57.862 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.862 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.863 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:57.863 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:57.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.863 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:57.863 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:57.863 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:57.863 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.863 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:57.863 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:57.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:57.863 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:57.863 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:57.863 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:09:57.863 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:57.864 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:57.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:57.864 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:57.864 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f479798f640 1 -- 172.21.15.5:0/2798382119 >> v2:172.21.15.157:6812/631023601 conn(0x7f477c03bdc0 msgr2=0x7f477c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f479798f640 1 --2- 172.21.15.5:0/2798382119 >> v2:172.21.15.157:6812/631023601 conn(0x7f477c03bdc0 0x7f477c03e280 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4790121a50 tx=0x7f47880077a0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f479798f640 10 monclient: shutdown 2024-08-18T21:09:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f479798f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f479798f640 1 -- 172.21.15.5:0/2798382119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47900a4c10 msgr2=0x7f4790136b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:57.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f479798f640 1 --2- 172.21.15.5:0/2798382119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47900a4c10 0x7f4790136b70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f47840097c0 tx=0x7f47840191e0 comp rx=0 tx=0).stop 2024-08-18T21:09:57.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f4795f2c640 1 -- 172.21.15.5:0/2798382119 reap_dead start 2024-08-18T21:09:57.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f478dffb640 1 -- 172.21.15.5:0/2798382119 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(181..181 src has 22..181) ==== 3506+0+0 (unknown 0 0 0) 0x7f47840e7810 con 0x7f47900a4c10 2024-08-18T21:09:57.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f4795f2c640 1 -- 172.21.15.5:0/2798382119 reap_dead start 2024-08-18T21:09:57.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f479798f640 1 -- 172.21.15.5:0/2798382119 shutdown_connections 2024-08-18T21:09:57.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f479798f640 1 -- 172.21.15.5:0/2798382119 >> 172.21.15.5:0/2798382119 conn(0x7f47900688d0 msgr2=0x7f47900a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:57.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f479798f640 1 -- 172.21.15.5:0/2798382119 shutdown_connections 2024-08-18T21:09:57.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.825+0000 7f479798f640 1 -- 172.21.15.5:0/2798382119 wait complete. 2024-08-18T21:09:57.866 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:57.867 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:09:57.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:09:57.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 10 monclient: get_monmap_and_config 2024-08-18T21:09:57.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 10 monclient: build_initial_monmap 2024-08-18T21:09:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 10 monclient: monmap: 2024-08-18T21:09:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:57.997062+0000 2024-08-18T21:09:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:57.997062+0000 2024-08-18T21:09:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:57.997 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:58.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 1 Processor -- start 2024-08-18T21:09:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 1 -- start start 2024-08-18T21:09:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 10 monclient: init 2024-08-18T21:09:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 10 monclient: _add_conns ranks=[10,8,0,6,5,4,7,3,2,9,1] 2024-08-18T21:09:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f66740a6ce0 0x7f66740a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 10 monclient(hunting): picked mon.noname-f con 0x7f66740a6ce0 addr v2:172.21.15.157:3300/0 2024-08-18T21:09:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f66740a7600 0x7f6674139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 10 monclient(hunting): picked mon.noname-e con 0x7f66740a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:09:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6674139fe0 addr v1:172.21.15.5:6789/0 2024-08-18T21:09:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66740a4560 con 0x7f6674139fe0 2024-08-18T21:09:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:58.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f66740a4310 con 0x7f66740a6ce0 2024-08-18T21:09:58.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:58.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f66740a32f0 con 0x7f66740a7600 2024-08-18T21:09:58.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:58.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f667a42c640 10 monclient(hunting): authenticate will time out at 1365.010452s 2024-08-18T21:09:58.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66789c9640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6674139fe0 0x7f6674140f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54870/0 (socket says 172.21.15.5:54870) 2024-08-18T21:09:58.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f66740a7600 0x7f6674139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:58.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66789c9640 1 -- 172.21.15.5:0/2221305001 learned_addr learned my addr 172.21.15.5:0/2221305001 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:09:58.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 10 monclient(hunting): get_auth_request con 0x7f66740a7600 auth_method 0 2024-08-18T21:09:58.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:58.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:58.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:58.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:58.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f6673fff640 1 --2- 172.21.15.5:0/2221305001 >> v2:172.21.15.157:3300/0 conn(0x7f66740a6ce0 0x7f66740a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f6673fff640 10 monclient(hunting): get_auth_request con 0x7f66740a6ce0 auth_method 0 2024-08-18T21:09:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f6673fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f6673fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f6673fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 10 monclient(hunting): handle_auth_done global_id 55286 payload 274 2024-08-18T21:09:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 1 -- 172.21.15.5:0/2221305001 >> v2:172.21.15.157:3300/0 conn(0x7f66740a6ce0 msgr2=0x7f66740a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 1 --2- 172.21.15.5:0/2221305001 >> v2:172.21.15.157:3300/0 conn(0x7f66740a6ce0 0x7f66740a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 1 -- 172.21.15.5:0/2221305001 >> v1:172.21.15.5:6789/0 conn(0x7f6674139fe0 legacy=0x7f6674140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 10 monclient: _finish_hunting 0 2024-08-18T21:09:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 1 monclient: found mon.noname-e 2024-08-18T21:09:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:09:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.993+0000 7f66737fe640 1 -- 172.21.15.5:0/2221305001 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66740a37e0 con 0x7f66740a7600 2024-08-18T21:09:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f66737fe640 1 -- 172.21.15.5:0/2221305001 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f66740a7600 msgr2=0x7f6674139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f66737fe640 1 --2- 172.21.15.5:0/2221305001 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f66740a7600 0x7f6674139aa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f665c009d90 tx=0x7f665c01c830 comp rx=0 tx=0).ready entity=mon.8 client_cookie=347f1cefb88de686 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f6672ffd640 1 -- 172.21.15.5:0/2221305001 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f665c0b2070 con 0x7f66740a7600 2024-08-18T21:09:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f6672ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f6672ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:09:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f6672ffd640 10 monclient: dump: 2024-08-18T21:09:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:58.011 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:58.011 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:58.011 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:58.011 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:58.011 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:58.011 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:58.011 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:58.011 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:58.011 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:58.011 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:58.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f6672ffd640 10 monclient: _finish_auth 0 2024-08-18T21:09:58.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f6672ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:09:58.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f6672ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:58.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f6672ffd640 1 -- 172.21.15.5:0/2221305001 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665c0a5b00 con 0x7f66740a7600 2024-08-18T21:09:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f667a42c640 5 monclient: authenticate success, global_id 55286 2024-08-18T21:09:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f667a42c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:09:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f6672ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f6672ffd640 1 -- 172.21.15.5:0/2221305001 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f665c0a5cb0 con 0x7f66740a7600 2024-08-18T21:09:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f6672ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f6672ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:09:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f6672ffd640 10 monclient: dump: 2024-08-18T21:09:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:58.013 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f667a42c640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:57.997+0000 7f667a42c640 4 set_mon_vals no callback set 2024-08-18T21:09:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 10 monclient: shutdown 2024-08-18T21:09:58.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:58.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 1 -- 172.21.15.5:0/2221305001 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f66740a7600 msgr2=0x7f6674139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:58.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 1 --2- 172.21.15.5:0/2221305001 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f66740a7600 0x7f6674139aa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f665c009d90 tx=0x7f665c01c830 comp rx=0 tx=0).stop 2024-08-18T21:09:58.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 1 -- 172.21.15.5:0/2221305001 shutdown_connections 2024-08-18T21:09:58.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 1 --2- 172.21.15.5:0/2221305001 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f66740a7600 0x7f6674139aa0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 1 --2- 172.21.15.5:0/2221305001 >> v2:172.21.15.157:3300/0 conn(0x7f66740a6ce0 0x7f66740a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 1 -- 172.21.15.5:0/2221305001 >> 172.21.15.5:0/2221305001 conn(0x7f66740accd0 msgr2=0x7f66740a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:58.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 1 -- 172.21.15.5:0/2221305001 shutdown_connections 2024-08-18T21:09:58.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 1 -- 172.21.15.5:0/2221305001 wait complete. 2024-08-18T21:09:58.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 10 monclient: build_initial_monmap 2024-08-18T21:09:58.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 10 monclient: monmap: 2024-08-18T21:09:58.014 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:58.016 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 1 Processor -- start 2024-08-18T21:09:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 1 -- start start 2024-08-18T21:09:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 10 monclient: init 2024-08-18T21:09:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 10 monclient: _add_conns ranks=[1,2,3,4,0,5,7,8,6] 2024-08-18T21:09:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66740a6ce0 0x7f667413acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 10 monclient(hunting): picked mon.noname-f con 0x7f66740a6ce0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:09:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f66740a7600 0x7f667413b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 10 monclient(hunting): picked mon.noname-b con 0x7f66740a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6674139fe0 0x7f667413b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 10 monclient(hunting): picked mon.noname-g con 0x7f6674139fe0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:09:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f667406f270 con 0x7f66740a6ce0 2024-08-18T21:09:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f66740a6730 con 0x7f66740a7600 2024-08-18T21:09:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f66740a81b0 con 0x7f6674139fe0 2024-08-18T21:09:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f667a42c640 10 monclient(hunting): authenticate will time out at 1365.017799s 2024-08-18T21:09:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f66740a7600 0x7f667413b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f66740a7600 0x7f667413b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:51156/0 (socket says 172.21.15.5:51156) 2024-08-18T21:09:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 1 -- 172.21.15.5:0/897627514 learned_addr learned my addr 172.21.15.5:0/897627514 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 10 monclient(hunting): get_auth_request con 0x7f66740a7600 auth_method 0 2024-08-18T21:09:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f6673fff640 1 --2- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66740a6ce0 0x7f667413acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66789c9640 1 --2- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6674139fe0 0x7f667413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66789c9640 10 monclient(hunting): get_auth_request con 0x7f6674139fe0 auth_method 0 2024-08-18T21:09:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66789c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66789c9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66789c9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f6673fff640 10 monclient(hunting): get_auth_request con 0x7f66740a6ce0 auth_method 0 2024-08-18T21:09:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f6673fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f6673fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f6673fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 10 monclient(hunting): handle_auth_done global_id 84584 payload 824 2024-08-18T21:09:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 1 -- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6674139fe0 msgr2=0x7f667413b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 1 --2- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6674139fe0 0x7f667413b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 1 -- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66740a6ce0 msgr2=0x7f667413acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 1 --2- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66740a6ce0 0x7f667413acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 10 monclient: _finish_hunting 0 2024-08-18T21:09:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 1 monclient: found mon.noname-b 2024-08-18T21:09:58.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:58.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:09:58.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.001+0000 7f66737fe640 1 -- 172.21.15.5:0/897627514 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66740aa150 con 0x7f66740a7600 2024-08-18T21:09:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f66737fe640 1 -- 172.21.15.5:0/897627514 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f66740a7600 msgr2=0x7f667413b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f66737fe640 1 --2- 172.21.15.5:0/897627514 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f66740a7600 0x7f667413b200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f665c009d60 tx=0x7f665c0195d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6670ff9640 1 -- 172.21.15.5:0/897627514 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f665c0b2050 con 0x7f66740a7600 2024-08-18T21:09:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6670ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6670ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:09:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6670ff9640 10 monclient: dump: 2024-08-18T21:09:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:58.027 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6670ff9640 10 monclient: _finish_auth 0 2024-08-18T21:09:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6670ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:09:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6670ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6670ff9640 1 -- 172.21.15.5:0/897627514 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665c0b3040 con 0x7f66740a7600 2024-08-18T21:09:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f667a42c640 5 monclient: authenticate success, global_id 84584 2024-08-18T21:09:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f667a42c640 10 monclient: _renew_subs 2024-08-18T21:09:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f667a42c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f667a42c640 1 -- 172.21.15.5:0/897627514 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f667413d630 con 0x7f66740a7600 2024-08-18T21:09:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6670ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6670ff9640 1 -- 172.21.15.5:0/897627514 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f665c0ad440 con 0x7f66740a7600 2024-08-18T21:09:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6670ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6670ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6670ff9640 10 monclient: dump: 2024-08-18T21:09:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:58.029 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:58.029 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:58.029 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:58.029 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:58.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f667a42c640 10 monclient: _renew_subs 2024-08-18T21:09:58.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f667a42c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:58.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6671ffb640 4 set_mon_vals no callback set 2024-08-18T21:09:58.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f667a42c640 1 -- 172.21.15.5:0/897627514 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f667413d910 con 0x7f66740a7600 2024-08-18T21:09:58.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f667a42c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:58.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f667a42c640 1 --2- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f66741d1bd0 0x7f66741d1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:58.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f667a42c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:58.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f667a42c640 1 -- 172.21.15.5:0/897627514 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f6674051140 con 0x7f66741d1bd0 2024-08-18T21:09:58.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6673fff640 1 --2- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f66741d1bd0 0x7f66741d1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:58.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6670ff9640 1 -- 172.21.15.5:0/897627514 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f665c0c0030 con 0x7f66740a7600 2024-08-18T21:09:58.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6673fff640 10 monclient: get_auth_request con 0x7f66741d1bd0 auth_method 0 2024-08-18T21:09:58.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6673fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:58.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6673fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:58.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6673fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:58.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6673fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:58.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6673fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:58.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6670ff9640 1 --2- 172.21.15.5:0/897627514 >> v2:172.21.15.157:6812/631023601 conn(0x7f665403bdc0 0x7f665403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:58.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6673fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6670ff9640 1 -- 172.21.15.5:0/897627514 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(181..181 src has 22..181) ==== 3506+0+0 (secure 0 0 0) 0x7f665c0be020 con 0x7f66740a7600 2024-08-18T21:09:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6673fff640 10 monclient(hunting): handle_auth_done global_id 5965 payload 824 2024-08-18T21:09:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f6673fff640 1 -- 172.21.15.5:0/897627514 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66740a79e0 con 0x7f66741d1bd0 2024-08-18T21:09:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f66789c9640 1 --2- 172.21.15.5:0/897627514 >> v2:172.21.15.157:6812/631023601 conn(0x7f665403bdc0 0x7f665403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.005+0000 7f66789c9640 10 monclient: get_auth_request con 0x7f665403bdc0 auth_method 0 2024-08-18T21:09:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.009+0000 7f6673fff640 1 -- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f66741d1bd0 msgr2=0x7f66741d1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.009+0000 7f6673fff640 1 --2- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f66741d1bd0 0x7f66741d1fb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f666400f4b0 tx=0x7f666400f970 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.009+0000 7f66789c9640 1 --2- 172.21.15.5:0/897627514 >> v2:172.21.15.157:6812/631023601 conn(0x7f665403bdc0 0x7f665403e280 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f666c00b7b0 tx=0x7f666c008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.009+0000 7f6670ff9640 1 -- 172.21.15.5:0/897627514 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6664019020 con 0x7f66741d1bd0 2024-08-18T21:09:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.009+0000 7f6670ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.009+0000 7f6670ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:09:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.009+0000 7f6670ff9640 10 monclient: dump: 2024-08-18T21:09:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:58.033 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.009+0000 7f6670ff9640 1 -- 172.21.15.5:0/897627514 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6664014880 con 0x7f66741d1bd0 2024-08-18T21:09:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.009+0000 7f6670ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.009+0000 7f6670ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.009+0000 7f6670ff9640 1 -- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f66741d1bd0 msgr2=0x7f66741d1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.009+0000 7f6670ff9640 1 --2- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f66741d1bd0 0x7f66741d1fb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f666400f4b0 tx=0x7f666400f970 comp rx=0 tx=0).stop 2024-08-18T21:09:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.009+0000 7f6670ff9640 1 -- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f66741d1bd0 msgr2=0x7f66741d1fb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.009+0000 7f6670ff9640 1 --2- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f66741d1bd0 0x7f66741d1fb0 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f666400f4b0 tx=0x7f666400f970 comp rx=0 tx=0).stop 2024-08-18T21:09:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.017+0000 7f667a42c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:09:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.017+0000 7f667a42c640 1 --2- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f66741d24f0 0x7f66740a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.017+0000 7f667a42c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.017+0000 7f667a42c640 1 -- 172.21.15.5:0/897627514 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f6674141840 con 0x7f66741d24f0 2024-08-18T21:09:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.017+0000 7f6673fff640 1 --2- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f66741d24f0 0x7f66740a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.017+0000 7f6673fff640 10 monclient: get_auth_request con 0x7f66741d24f0 auth_method 0 2024-08-18T21:09:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.017+0000 7f6673fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.017+0000 7f6673fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.017+0000 7f6673fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.017+0000 7f6673fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.017+0000 7f6673fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.017+0000 7f6673fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.017+0000 7f6673fff640 10 monclient(hunting): handle_auth_done global_id 5974 payload 824 2024-08-18T21:09:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.017+0000 7f6673fff640 1 -- 172.21.15.5:0/897627514 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f667413c110 con 0x7f66741d24f0 2024-08-18T21:09:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.017+0000 7f6673fff640 1 -- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f66741d24f0 msgr2=0x7f66740a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.017+0000 7f6673fff640 1 --2- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f66741d24f0 0x7f66740a03d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f666400f4b0 tx=0x7f66640046d0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f6670ff9640 1 -- 172.21.15.5:0/897627514 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6664019040 con 0x7f66741d24f0 2024-08-18T21:09:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f6670ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f6670ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:09:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f6670ff9640 10 monclient: dump: 2024-08-18T21:09:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:58.036 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f6670ff9640 1 -- 172.21.15.5:0/897627514 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9582 (secure 0 0 0) 0x7f6664004030 con 0x7f66741d24f0 2024-08-18T21:09:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f6670ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:09:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f6670ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f6670ff9640 1 -- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f66741d24f0 msgr2=0x7f66740a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f6670ff9640 1 --2- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f66741d24f0 0x7f66740a03d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f666400f4b0 tx=0x7f66640046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f6670ff9640 1 -- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f66741d24f0 msgr2=0x7f66740a03d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:09:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f6670ff9640 1 --2- 172.21.15.5:0/897627514 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f66741d24f0 0x7f66740a03d0 secure :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f666400f4b0 tx=0x7f66640046d0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.037 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:09:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:09:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 146, 2024-08-18T21:09:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 407118, 2024-08-18T21:09:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:09:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:09:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:09:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:09:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:09:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:09:58.038 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:09:58.038 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:09:58.038 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:09:58.038 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:09:58.038 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:58.038 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:09:58.038 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:58.038 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:09:58.038 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:09:58.038 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:58.038 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:58.038 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:58.038 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:58.039 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:58.039 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:58.039 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:58.039 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:58.039 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:58.039 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:58.039 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:58.039 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:58.039 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:09:58.039 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:09:58.039 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:58.039 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:58.039 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:58.039 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:58.040 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:58.040 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:58.040 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:58.040 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:58.040 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:58.040 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:58.040 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:58.040 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:58.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.040 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:09:58.040 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:09:58.040 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:09:58.040 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:09:58.040 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:09:58.041 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:09:58.041 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:58.041 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:09:58.041 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:09:58.041 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:09:58.041 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:09:58.041 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:09:58.041 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:09:58.041 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:09:58.041 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:09:58.041 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:09:58.041 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:09:58.041 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:09:58.041 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:09:58.042 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:09:58.042 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:09:58.042 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:09:58.042 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:09:58.042 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:09:58.042 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:09:58.042 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:09:58.042 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:09:58.042 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:09:58.042 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:58.042 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:09:58.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.042 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:09:58.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.043 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:09:58.043 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:09:58.043 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:58.043 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:58.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.043 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:58.043 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:09:58.043 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.043 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:58.043 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:09:58.044 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.044 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:58.044 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:58.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.044 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:09:58.044 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:09:58.044 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:58.044 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:58.045 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:58.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.045 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:09:58.045 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:09:58.045 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:58.045 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:58.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.046 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:58.046 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:09:58.046 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.046 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:58.046 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:09:58.046 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.046 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:58.046 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:58.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.046 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:09:58.046 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:09:58.047 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:58.047 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:58.047 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:58.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.047 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:09:58.047 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:09:58.047 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:58.047 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:58.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.047 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:58.047 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:09:58.047 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.048 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:58.048 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:09:58.048 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.048 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:58.048 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:58.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.048 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:09:58.048 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:09:58.048 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:58.049 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:58.049 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:58.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.049 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.049 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:09:58.049 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:09:58.049 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:58.049 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:58.049 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.049 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:58.049 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:09:58.050 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.050 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:58.050 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:09:58.050 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.050 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:58.050 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:58.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.050 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:09:58.051 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:09:58.051 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:58.051 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:58.051 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:58.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.051 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:09:58.051 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:09:58.051 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:58.051 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:58.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.052 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:58.052 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:09:58.052 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.052 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:58.052 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:09:58.052 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.052 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:58.052 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:58.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.052 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:09:58.052 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:09:58.053 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:58.053 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:58.053 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:58.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.053 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:09:58.053 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:09:58.053 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:58.053 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:58.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.053 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:58.053 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:09:58.053 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.054 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:58.054 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:09:58.054 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.054 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:58.054 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:58.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.054 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:09:58.054 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:09:58.054 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:58.055 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:58.055 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:58.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.055 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:09:58.055 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:09:58.055 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:58.055 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:58.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.055 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:58.055 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:09:58.055 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.056 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:58.056 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:09:58.056 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.056 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:58.056 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:58.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.056 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:09:58.056 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:09:58.056 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:58.056 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:58.056 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:58.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.057 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:09:58.057 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:09:58.057 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:58.057 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:58.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.057 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:58.057 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:09:58.057 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.057 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:58.057 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:09:58.057 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:09:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:09:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:09:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:09:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:09:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:09:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:09:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:09:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:09:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:09:58.060 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:09:58.060 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:58.060 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:58.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.060 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:09:58.060 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:09:58.060 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:09:58.060 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:09:58.060 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:09:58.060 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:58.060 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:58.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.060 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:09:58.060 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:09:58.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.061 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:58.061 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:58.061 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:58.061 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:58.061 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:58.061 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:09:58.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.061 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:58.061 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:58.061 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:58.061 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:58.061 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:58.062 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:09:58.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.062 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:58.062 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:58.062 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:09:58.062 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:58.062 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:09:58.062 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:09:58.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:09:58.062 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:09:58.062 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:09:58.062 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:09:58.062 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:09:58.062 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:09:58.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:09:58.063 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:09:58.063 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:09:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f667a42c640 1 -- 172.21.15.5:0/897627514 >> v2:172.21.15.157:6812/631023601 conn(0x7f665403bdc0 msgr2=0x7f665403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f667a42c640 1 --2- 172.21.15.5:0/897627514 >> v2:172.21.15.157:6812/631023601 conn(0x7f665403bdc0 0x7f665403e280 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f666c00b7b0 tx=0x7f666c008040 comp rx=0 tx=0).stop 2024-08-18T21:09:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f667a42c640 10 monclient: shutdown 2024-08-18T21:09:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f667a42c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f667a42c640 1 -- 172.21.15.5:0/897627514 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f66740a7600 msgr2=0x7f667413b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f667a42c640 1 --2- 172.21.15.5:0/897627514 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f66740a7600 0x7f667413b200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f665c009d60 tx=0x7f665c0195d0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f66789c9640 1 -- 172.21.15.5:0/897627514 reap_dead start 2024-08-18T21:09:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f66789c9640 1 -- 172.21.15.5:0/897627514 reap_dead start 2024-08-18T21:09:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f667a42c640 1 -- 172.21.15.5:0/897627514 shutdown_connections 2024-08-18T21:09:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f667a42c640 1 -- 172.21.15.5:0/897627514 >> 172.21.15.5:0/897627514 conn(0x7f66740accd0 msgr2=0x7f667409da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f667a42c640 1 -- 172.21.15.5:0/897627514 shutdown_connections 2024-08-18T21:09:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.021+0000 7f667a42c640 1 -- 172.21.15.5:0/897627514 wait complete. 2024-08-18T21:09:58.065 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:09:58.066 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['f'] 2024-08-18T21:09:58.066 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-18T21:09:58.066 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.f 2024-08-18T21:09:58.066 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2024-08-18T21:09:58.066 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-08-18T21:09:58.066 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:09:58.092 INFO:tasks.ceph.mon.f:Stopped 2024-08-18T21:09:58.092 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-08-18T21:09:58.093 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:09:58.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 10 monclient: get_monmap_and_config 2024-08-18T21:09:58.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 10 monclient: build_initial_monmap 2024-08-18T21:09:58.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 10 monclient: monmap: 2024-08-18T21:09:58.209 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:58.209 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:58.209 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:09:58.209852+0000 2024-08-18T21:09:58.209 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:09:58.209852+0000 2024-08-18T21:09:58.209 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:58.209 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:58.209 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:09:58.209 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:09:58.209 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:58.209 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:58.210 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:58.210 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:58.210 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:58.210 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:58.210 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:58.210 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:09:58.210 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:09:58.210 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:58.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 1 Processor -- start 2024-08-18T21:09:58.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 1 -- start start 2024-08-18T21:09:58.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 10 monclient: init 2024-08-18T21:09:58.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 10 monclient: _add_conns ranks=[3,0,5,2,7,8,10,9,4,6,1] 2024-08-18T21:09:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59180a6ce0 0x7f59180a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 10 monclient(hunting): picked mon.noname-g con 0x7f59180a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:09:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f59180a7600 addr v1:172.21.15.5:6789/0 2024-08-18T21:09:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f591813a1b0 0x7f5918141d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 10 monclient(hunting): picked mon.noname-h con 0x7f591813a1b0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:09:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59180a45d0 con 0x7f59180a7600 2024-08-18T21:09:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f59180a5000 con 0x7f59180a6ce0 2024-08-18T21:09:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f59180a32d0 con 0x7f591813a1b0 2024-08-18T21:09:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f591d649640 10 monclient(hunting): authenticate will time out at 1365.223523s 2024-08-18T21:09:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f59167fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f59180a7600 0x7f5918139aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54872/0 (socket says 172.21.15.5:54872) 2024-08-18T21:09:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f59167fc640 1 -- 172.21.15.5:0/951629853 learned_addr learned my addr 172.21.15.5:0/951629853 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:09:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f59177fe640 1 --2- 172.21.15.5:0/951629853 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f591813a1b0 0x7f5918141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.205+0000 7f5916ffd640 1 --2- 172.21.15.5:0/951629853 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59180a6ce0 0x7f59180a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f59177fe640 10 monclient(hunting): get_auth_request con 0x7f591813a1b0 auth_method 0 2024-08-18T21:09:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f59177fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f59177fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f59177fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f5916ffd640 10 monclient(hunting): get_auth_request con 0x7f59180a6ce0 auth_method 0 2024-08-18T21:09:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f5916ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f5916ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f5916ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f59177fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f59177fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f59177fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f5916ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f5916ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f5916ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f59177fe640 10 monclient(hunting): handle_auth_done global_id 94298 payload 274 2024-08-18T21:09:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f59177fe640 1 -- 172.21.15.5:0/951629853 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59180a6ce0 msgr2=0x7f59180a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f59177fe640 1 --2- 172.21.15.5:0/951629853 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59180a6ce0 0x7f59180a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f59177fe640 1 -- 172.21.15.5:0/951629853 >> v1:172.21.15.5:6789/0 conn(0x7f59180a7600 legacy=0x7f5918139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:09:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f59177fe640 10 monclient: _finish_hunting 0 2024-08-18T21:09:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f59177fe640 1 monclient: found mon.noname-h 2024-08-18T21:09:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f59177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f59177fe640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:09:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.209+0000 7f59177fe640 1 -- 172.21.15.5:0/951629853 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59180a8900 con 0x7f591813a1b0 2024-08-18T21:09:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f59177fe640 1 -- 172.21.15.5:0/951629853 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f591813a1b0 msgr2=0x7f5918141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f59177fe640 1 --2- 172.21.15.5:0/951629853 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f591813a1b0 0x7f5918141d00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f59100097f0 tx=0x7f591001c3a0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=83e942397e52e3f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f5915ffb640 1 -- 172.21.15.5:0/951629853 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f59100b0070 con 0x7f591813a1b0 2024-08-18T21:09:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f5915ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f5915ffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:09:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f5915ffb640 10 monclient: dump: 2024-08-18T21:09:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:58.222 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f5915ffb640 10 monclient: _finish_auth 0 2024-08-18T21:09:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f5915ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:09:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f5915ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f5915ffb640 1 -- 172.21.15.5:0/951629853 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59100aa810 con 0x7f591813a1b0 2024-08-18T21:09:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f5915ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f5915ffb640 1 -- 172.21.15.5:0/951629853 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f59100a9300 con 0x7f591813a1b0 2024-08-18T21:09:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f591d649640 5 monclient: authenticate success, global_id 94298 2024-08-18T21:09:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f591d649640 10 monclient: get_monmap_and_config success 2024-08-18T21:09:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f591d649640 4 set_mon_vals no callback set 2024-08-18T21:09:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f5915ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f5915ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:09:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.213+0000 7f5915ffb640 10 monclient: dump: 2024-08-18T21:09:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:58.224 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:58.224 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:58.224 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:58.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 10 monclient: shutdown 2024-08-18T21:09:58.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:58.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 1 -- 172.21.15.5:0/951629853 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f591813a1b0 msgr2=0x7f5918141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:58.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 1 --2- 172.21.15.5:0/951629853 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f591813a1b0 0x7f5918141d00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f59100097f0 tx=0x7f591001c3a0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 1 -- 172.21.15.5:0/951629853 shutdown_connections 2024-08-18T21:09:58.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 1 --2- 172.21.15.5:0/951629853 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f591813a1b0 0x7f5918141d00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 1 --2- 172.21.15.5:0/951629853 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59180a6ce0 0x7f59180a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 1 -- 172.21.15.5:0/951629853 >> 172.21.15.5:0/951629853 conn(0x7f59180acbc0 msgr2=0x7f59180a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 1 -- 172.21.15.5:0/951629853 shutdown_connections 2024-08-18T21:09:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 1 -- 172.21.15.5:0/951629853 wait complete. 2024-08-18T21:09:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 10 monclient: build_initial_monmap 2024-08-18T21:09:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 10 monclient: monmap: 2024-08-18T21:09:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:09:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:09:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:09:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:09:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:09:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:09:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:09:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:09:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:09:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:09:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:09:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:09:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:09:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:09:58.230 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 1 Processor -- start 2024-08-18T21:09:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 1 -- start start 2024-08-18T21:09:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 10 monclient: init 2024-08-18T21:09:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 10 monclient: _reopen_session rank -1 2024-08-18T21:09:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 10 monclient: _add_conns ranks=[1,3,2,0,7,4,5,8,6] 2024-08-18T21:09:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59180a6ce0 0x7f5918132cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 10 monclient(hunting): picked mon.noname-f con 0x7f59180a6ce0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:09:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59180a7600 0x7f5918133230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 10 monclient(hunting): picked mon.noname-g con 0x7f59180a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:09:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f591813a1b0 0x7f591809f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 10 monclient(hunting): picked mon.noname-b con 0x7f591813a1b0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:09:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f59180a79e0 con 0x7f59180a6ce0 2024-08-18T21:09:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f59180a8220 con 0x7f591813a1b0 2024-08-18T21:09:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 10 monclient(hunting): start opening mon connection 2024-08-18T21:09:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f591813c440 con 0x7f59180a7600 2024-08-18T21:09:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 10 monclient(hunting): _renew_subs 2024-08-18T21:09:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f591d649640 10 monclient(hunting): authenticate will time out at 1365.234186s 2024-08-18T21:09:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f5916ffd640 1 -- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59180a6ce0 msgr2=0x7f5918132cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:09:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f5916ffd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59180a6ce0 0x7f5918132cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:09:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f591813a1b0 0x7f591809f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f591813a1b0 0x7f591809f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:51170/0 (socket says 172.21.15.5:51170) 2024-08-18T21:09:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 1 -- 172.21.15.5:0/2523865514 learned_addr learned my addr 172.21.15.5:0/2523865514 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:09:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 10 monclient(hunting): get_auth_request con 0x7f591813a1b0 auth_method 0 2024-08-18T21:09:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:09:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:09:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:09:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59167fc640 1 --2- 172.21.15.5:0/2523865514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59180a7600 0x7f5918133230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59167fc640 10 monclient(hunting): get_auth_request con 0x7f59180a7600 auth_method 0 2024-08-18T21:09:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59167fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:09:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59167fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:09:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59167fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:09:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 10 monclient(hunting): handle_auth_done global_id 84593 payload 824 2024-08-18T21:09:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 1 -- 172.21.15.5:0/2523865514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59180a7600 msgr2=0x7f5918133230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 1 --2- 172.21.15.5:0/2523865514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59180a7600 0x7f5918133230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 1 -- 172.21.15.5:0/2523865514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59180a6ce0 msgr2=0x7f5918132cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:09:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 1 --2- 172.21.15.5:0/2523865514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59180a6ce0 0x7f5918132cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 10 monclient: _finish_hunting 0 2024-08-18T21:09:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 1 monclient: found mon.noname-b 2024-08-18T21:09:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:09:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:09:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.217+0000 7f59177fe640 1 -- 172.21.15.5:0/2523865514 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591813be80 con 0x7f591813a1b0 2024-08-18T21:09:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f59177fe640 1 -- 172.21.15.5:0/2523865514 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f591813a1b0 msgr2=0x7f591809f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:09:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f59177fe640 1 --2- 172.21.15.5:0/2523865514 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f591813a1b0 0x7f591809f890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f59100ae040 tx=0x7f5910019140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f590f7fe640 1 -- 172.21.15.5:0/2523865514 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f59100b0070 con 0x7f591813a1b0 2024-08-18T21:09:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f590f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f590f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:09:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f590f7fe640 10 monclient: dump: 2024-08-18T21:09:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:58.236 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f590f7fe640 10 monclient: _finish_auth 0 2024-08-18T21:09:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f590f7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:09:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f590f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:09:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f591d649640 5 monclient: authenticate success, global_id 84593 2024-08-18T21:09:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f590f7fe640 1 -- 172.21.15.5:0/2523865514 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59100ba070 con 0x7f591813a1b0 2024-08-18T21:09:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f590f7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:09:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f590f7fe640 1 -- 172.21.15.5:0/2523865514 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5910004250 con 0x7f591813a1b0 2024-08-18T21:09:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f591d649640 10 monclient: _renew_subs 2024-08-18T21:09:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f591d649640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f591d649640 1 -- 172.21.15.5:0/2523865514 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59180a2590 con 0x7f591813a1b0 2024-08-18T21:09:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f59157fa640 4 set_mon_vals no callback set 2024-08-18T21:09:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f590f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:09:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f590f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:09:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f590f7fe640 10 monclient: dump: 2024-08-18T21:09:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:09:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:09:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:09:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:09:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:09:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:09:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:09:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:09:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:09:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:09:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:09:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:09:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:09:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:09:58.238 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:09:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f591d649640 10 monclient: _renew_subs 2024-08-18T21:09:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f591d649640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f591d649640 1 -- 172.21.15.5:0/2523865514 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f59180a2120 con 0x7f591813a1b0 2024-08-18T21:09:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f591d649640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f591d649640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f591d649640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f591d649640 1 -- 172.21.15.5:0/2523865514 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59180a70c0 con 0x7f591813a1b0 2024-08-18T21:09:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f590f7fe640 1 -- 172.21.15.5:0/2523865514 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f5910003620 con 0x7f591813a1b0 2024-08-18T21:09:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f590f7fe640 1 --2- 172.21.15.5:0/2523865514 >> v2:172.21.15.157:6812/631023601 conn(0x7f58f803bdc0 0x7f58f803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:09:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f590f7fe640 1 -- 172.21.15.5:0/2523865514 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(181..181 src has 22..181) ==== 3506+0+0 (secure 0 0 0) 0x7f59100e85a0 con 0x7f591813a1b0 2024-08-18T21:09:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f5916ffd640 1 --2- 172.21.15.5:0/2523865514 >> v2:172.21.15.157:6812/631023601 conn(0x7f58f803bdc0 0x7f58f803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:09:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.221+0000 7f5916ffd640 10 monclient: get_auth_request con 0x7f58f803bdc0 auth_method 0 2024-08-18T21:09:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.225+0000 7f5916ffd640 1 --2- 172.21.15.5:0/2523865514 >> v2:172.21.15.157:6812/631023601 conn(0x7f58f803bdc0 0x7f58f803e280 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5900009b10 tx=0x7f590000b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:09:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.225+0000 7f590f7fe640 1 -- 172.21.15.5:0/2523865514 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f59100160b0 con 0x7f591813a1b0 2024-08-18T21:09:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.225+0000 7f590f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:09:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.225+0000 7f590f7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:09:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.469+0000 7f591d649640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:09:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.469+0000 7f591d649640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:09:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.469+0000 7f591d649640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:09:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.469+0000 7f591d649640 1 -- 172.21.15.5:0/2523865514 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f59180a19e0 con 0x7f591813a1b0 2024-08-18T21:09:58.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.469+0000 7f590f7fe640 1 -- 172.21.15.5:0/2523865514 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7f59100aa7e0 con 0x7f591813a1b0 2024-08-18T21:09:58.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.469+0000 7f590f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:09:58.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.469+0000 7f590f7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:09:58.473 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":146,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:09:58.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.473+0000 7f591d649640 1 -- 172.21.15.5:0/2523865514 >> v2:172.21.15.157:6812/631023601 conn(0x7f58f803bdc0 msgr2=0x7f58f803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:58.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.473+0000 7f591d649640 1 --2- 172.21.15.5:0/2523865514 >> v2:172.21.15.157:6812/631023601 conn(0x7f58f803bdc0 0x7f58f803e280 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5900009b10 tx=0x7f590000b040 comp rx=0 tx=0).stop 2024-08-18T21:09:58.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.473+0000 7f591d649640 10 monclient: shutdown 2024-08-18T21:09:58.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.473+0000 7f591d649640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:09:58.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.473+0000 7f591d649640 1 -- 172.21.15.5:0/2523865514 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f591813a1b0 msgr2=0x7f591809f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:09:58.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.473+0000 7f591d649640 1 --2- 172.21.15.5:0/2523865514 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f591813a1b0 0x7f591809f890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f59100ae040 tx=0x7f5910019140 comp rx=0 tx=0).stop 2024-08-18T21:09:58.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.473+0000 7f591d649640 1 -- 172.21.15.5:0/2523865514 shutdown_connections 2024-08-18T21:09:58.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.473+0000 7f591d649640 1 --2- 172.21.15.5:0/2523865514 >> v2:172.21.15.157:6812/631023601 conn(0x7f58f803bdc0 0x7f58f803e280 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.473+0000 7f591d649640 1 --2- 172.21.15.5:0/2523865514 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f591813a1b0 0x7f591809f890 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.473+0000 7f591d649640 1 --2- 172.21.15.5:0/2523865514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59180a7600 0x7f5918133230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.473+0000 7f591d649640 1 --2- 172.21.15.5:0/2523865514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59180a6ce0 0x7f5918132cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:09:58.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.473+0000 7f591d649640 1 -- 172.21.15.5:0/2523865514 >> 172.21.15.5:0/2523865514 conn(0x7f59180acbc0 msgr2=0x7f591809da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:09:58.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.473+0000 7f591d649640 1 -- 172.21.15.5:0/2523865514 shutdown_connections 2024-08-18T21:09:58.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:09:58.473+0000 7f591d649640 1 -- 172.21.15.5:0/2523865514 wait complete. 2024-08-18T21:10:01.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:10:01.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.621+0000 7fec50f0f640 10 monclient: get_monmap_and_config 2024-08-18T21:10:01.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.621+0000 7fec50f0f640 10 monclient: build_initial_monmap 2024-08-18T21:10:01.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.621+0000 7fec50f0f640 10 monclient: monmap: 2024-08-18T21:10:01.625 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:01.625 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:01.626895+0000 2024-08-18T21:10:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:01.626895+0000 2024-08-18T21:10:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:01.627 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.621+0000 7fec50f0f640 1 Processor -- start 2024-08-18T21:10:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.621+0000 7fec50f0f640 1 -- start start 2024-08-18T21:10:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.621+0000 7fec50f0f640 10 monclient: init 2024-08-18T21:10:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec50f0f640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec50f0f640 10 monclient: _add_conns ranks=[3,9,0,2,10,1,5,7,8,4,6] 2024-08-18T21:10:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec50f0f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec4c0a6ce0 0x7fec4c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec50f0f640 10 monclient(hunting): picked mon.noname-g con 0x7fec4c0a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec50f0f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec4c0a7600 0x7fec4c139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec50f0f640 10 monclient(hunting): picked mon.noname-a con 0x7fec4c0a7600 addr v2:172.21.15.5:3300/0 2024-08-18T21:10:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec50f0f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fec4c139fe0 addr v1:172.21.15.5:6789/0 2024-08-18T21:10:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec50f0f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec4c0a45d0 con 0x7fec4c139fe0 2024-08-18T21:10:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec50f0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec50f0f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fec4c0a5000 con 0x7fec4c0a7600 2024-08-18T21:10:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec50f0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec50f0f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fec4c0a4360 con 0x7fec4c0a6ce0 2024-08-18T21:10:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec50f0f640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec50f0f640 10 monclient(hunting): authenticate will time out at 1368.640370s 2024-08-18T21:10:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec4c0a7600 0x7fec4c139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec4ad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fec4c139fe0 0x7fec4c140cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54878/0 (socket says 172.21.15.5:54878) 2024-08-18T21:10:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec4ad9d640 1 -- 172.21.15.5:0/2836772461 learned_addr learned my addr 172.21.15.5:0/2836772461 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:10:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 10 monclient(hunting): get_auth_request con 0x7fec4c0a7600 auth_method 0 2024-08-18T21:10:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec4a59c640 1 --2- 172.21.15.5:0/2836772461 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec4c0a6ce0 0x7fec4c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec4a59c640 10 monclient(hunting): get_auth_request con 0x7fec4c0a6ce0 auth_method 0 2024-08-18T21:10:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec4a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec4a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec4a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 10 monclient(hunting): handle_auth_done global_id 84510 payload 274 2024-08-18T21:10:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 1 -- 172.21.15.5:0/2836772461 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec4c0a6ce0 msgr2=0x7fec4c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 1 --2- 172.21.15.5:0/2836772461 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec4c0a6ce0 0x7fec4c0a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 1 -- 172.21.15.5:0/2836772461 >> v1:172.21.15.5:6789/0 conn(0x7fec4c139fe0 legacy=0x7fec4c140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:10:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 1 monclient: found mon.noname-a 2024-08-18T21:10:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:10:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.625+0000 7fec49d9b640 1 -- 172.21.15.5:0/2836772461 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c0a8900 con 0x7fec4c0a7600 2024-08-18T21:10:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec49d9b640 1 -- 172.21.15.5:0/2836772461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c0a7600 msgr2=0x7fec4c139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec49d9b640 1 --2- 172.21.15.5:0/2836772461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c0a7600 0x7fec4c139aa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0097c0 tx=0x7fec3c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a9b31ca7b7bbab server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec4959a640 1 -- 172.21.15.5:0/2836772461 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec3c0b0070 con 0x7fec4c0a7600 2024-08-18T21:10:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec4959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec4959a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:10:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec4959a640 10 monclient: dump: 2024-08-18T21:10:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:01.636 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec4959a640 10 monclient: _finish_auth 0 2024-08-18T21:10:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec4959a640 10 monclient: _check_auth_tickets 2024-08-18T21:10:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec4959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec4959a640 1 -- 172.21.15.5:0/2836772461 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3c0aa810 con 0x7fec4c0a7600 2024-08-18T21:10:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec4959a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec4959a640 1 -- 172.21.15.5:0/2836772461 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec3c0a9300 con 0x7fec4c0a7600 2024-08-18T21:10:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec4959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec4959a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec4959a640 10 monclient: dump: 2024-08-18T21:10:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:01.638 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec50f0f640 5 monclient: authenticate success, global_id 84510 2024-08-18T21:10:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec50f0f640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec50f0f640 4 set_mon_vals no callback set 2024-08-18T21:10:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec50f0f640 10 monclient: shutdown 2024-08-18T21:10:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec50f0f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec50f0f640 1 -- 172.21.15.5:0/2836772461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c0a7600 msgr2=0x7fec4c139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec50f0f640 1 --2- 172.21.15.5:0/2836772461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c0a7600 0x7fec4c139aa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0097c0 tx=0x7fec3c01c360 comp rx=0 tx=0).stop 2024-08-18T21:10:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec50f0f640 1 -- 172.21.15.5:0/2836772461 shutdown_connections 2024-08-18T21:10:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec50f0f640 1 --2- 172.21.15.5:0/2836772461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c0a7600 0x7fec4c139aa0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec50f0f640 1 --2- 172.21.15.5:0/2836772461 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec4c0a6ce0 0x7fec4c0a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec50f0f640 1 -- 172.21.15.5:0/2836772461 >> 172.21.15.5:0/2836772461 conn(0x7fec4c0acbc0 msgr2=0x7fec4c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec50f0f640 1 -- 172.21.15.5:0/2836772461 shutdown_connections 2024-08-18T21:10:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec50f0f640 1 -- 172.21.15.5:0/2836772461 wait complete. 2024-08-18T21:10:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec50f0f640 10 monclient: build_initial_monmap 2024-08-18T21:10:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec50f0f640 10 monclient: monmap: 2024-08-18T21:10:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:01.640 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.629+0000 7fec50f0f640 1 Processor -- start 2024-08-18T21:10:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 1 -- start start 2024-08-18T21:10:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 10 monclient: init 2024-08-18T21:10:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 10 monclient: _add_conns ranks=[2,5,4,1,6,0,8,7,3] 2024-08-18T21:10:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fec4c0a6ce0 0x7fec4c1383f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 10 monclient(hunting): picked mon.noname-b con 0x7fec4c0a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fec4c0a7600 0x7fec4c138930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 10 monclient(hunting): picked mon.noname-h con 0x7fec4c0a7600 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fec4c139fe0 0x7fec4c13e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 10 monclient(hunting): picked mon.noname-c con 0x7fec4c139fe0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fec4c0a79e0 con 0x7fec4c0a6ce0 2024-08-18T21:10:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fec4c0a9810 con 0x7fec4c139fe0 2024-08-18T21:10:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fec4c0a22a0 con 0x7fec4c0a7600 2024-08-18T21:10:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 10 monclient(hunting): authenticate will time out at 1368.648547s 2024-08-18T21:10:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4a59c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fec4c0a6ce0 0x7fec4c1383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fec4c139fe0 0x7fec4c13e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4a59c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fec4c0a6ce0 0x7fec4c1383f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:51186/0 (socket says 172.21.15.5:51186) 2024-08-18T21:10:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4a59c640 1 -- 172.21.15.5:0/1834531717 learned_addr learned my addr 172.21.15.5:0/1834531717 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4a59c640 10 monclient(hunting): get_auth_request con 0x7fec4c0a6ce0 auth_method 0 2024-08-18T21:10:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 10 monclient(hunting): get_auth_request con 0x7fec4c139fe0 auth_method 0 2024-08-18T21:10:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec49d9b640 1 --2- 172.21.15.5:0/1834531717 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fec4c0a7600 0x7fec4c138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec49d9b640 10 monclient(hunting): get_auth_request con 0x7fec4c0a7600 auth_method 0 2024-08-18T21:10:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec49d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec49d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec49d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 10 monclient(hunting): handle_auth_done global_id 6286 payload 824 2024-08-18T21:10:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 1 -- 172.21.15.5:0/1834531717 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fec4c0a7600 msgr2=0x7fec4c138930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 1 --2- 172.21.15.5:0/1834531717 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fec4c0a7600 0x7fec4c138930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 1 -- 172.21.15.5:0/1834531717 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fec4c0a6ce0 msgr2=0x7fec4c1383f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 1 --2- 172.21.15.5:0/1834531717 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fec4c0a6ce0 0x7fec4c1383f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 10 monclient: _finish_hunting 0 2024-08-18T21:10:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 1 monclient: found mon.noname-c 2024-08-18T21:10:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:10:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 1 -- 172.21.15.5:0/1834531717 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c1235b0 con 0x7fec4c139fe0 2024-08-18T21:10:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4a59c640 1 --2- 172.21.15.5:0/1834531717 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fec4c0a6ce0 0x7fec4c1383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 1 -- 172.21.15.5:0/1834531717 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fec4c139fe0 msgr2=0x7fec4c13e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec4ad9d640 1 --2- 172.21.15.5:0/1834531717 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fec4c139fe0 0x7fec4c13e9d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fec4400b440 tx=0x7fec4400b900 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec42ffd640 1 -- 172.21.15.5:0/1834531717 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec44015020 con 0x7fec4c139fe0 2024-08-18T21:10:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec42ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec42ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:10:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec42ffd640 10 monclient: dump: 2024-08-18T21:10:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:01.651 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:01.651 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:01.651 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:01.651 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:01.651 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:01.651 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:01.651 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:01.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec42ffd640 10 monclient: _finish_auth 0 2024-08-18T21:10:01.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec42ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:10:01.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec42ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:01.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec42ffd640 1 -- 172.21.15.5:0/1834531717 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec44011cb0 con 0x7fec4c139fe0 2024-08-18T21:10:01.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec42ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:01.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec42ffd640 1 -- 172.21.15.5:0/1834531717 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec44011e60 con 0x7fec4c139fe0 2024-08-18T21:10:01.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 5 monclient: authenticate success, global_id 6286 2024-08-18T21:10:01.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 10 monclient: _renew_subs 2024-08-18T21:10:01.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:10:01.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 1 -- 172.21.15.5:0/1834531717 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec4c141700 con 0x7fec4c139fe0 2024-08-18T21:10:01.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec43fff640 4 set_mon_vals no callback set 2024-08-18T21:10:01.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec42ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:01.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec42ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:01.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec42ffd640 10 monclient: dump: 2024-08-18T21:10:01.653 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:01.653 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:01.653 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:01.654 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:01.654 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:01.654 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:01.654 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:01.654 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:01.654 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:01.654 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:01.654 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:01.654 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:01.654 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:01.655 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 10 monclient: _renew_subs 2024-08-18T21:10:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:10:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.633+0000 7fec50f0f640 1 -- 172.21.15.5:0/1834531717 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fec4c1232d0 con 0x7fec4c139fe0 2024-08-18T21:10:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.637+0000 7fec50f0f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.637+0000 7fec50f0f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.637+0000 7fec50f0f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:10:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.637+0000 7fec50f0f640 1 -- 172.21.15.5:0/1834531717 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec4c0a8220 con 0x7fec4c139fe0 2024-08-18T21:10:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.637+0000 7fec42ffd640 1 -- 172.21.15.5:0/1834531717 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fec44018020 con 0x7fec4c139fe0 2024-08-18T21:10:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.637+0000 7fec42ffd640 1 --2- 172.21.15.5:0/1834531717 >> v2:172.21.15.157:6812/631023601 conn(0x7fec2c03bdc0 0x7fec2c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.637+0000 7fec42ffd640 1 -- 172.21.15.5:0/1834531717 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(182..182 src has 22..182) ==== 3898+0+0 (secure 0 0 0) 0x7fec4404ded0 con 0x7fec4c139fe0 2024-08-18T21:10:01.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.637+0000 7fec4a59c640 1 --2- 172.21.15.5:0/1834531717 >> v2:172.21.15.157:6812/631023601 conn(0x7fec2c03bdc0 0x7fec2c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:01.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.637+0000 7fec4a59c640 10 monclient: get_auth_request con 0x7fec2c03bdc0 auth_method 0 2024-08-18T21:10:01.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.641+0000 7fec4a59c640 1 --2- 172.21.15.5:0/1834531717 >> v2:172.21.15.157:6812/631023601 conn(0x7fec2c03bdc0 0x7fec2c03e280 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fec34003fd0 tx=0x7fec34009970 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:01.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.641+0000 7fec42ffd640 1 -- 172.21.15.5:0/1834531717 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fec4401f070 con 0x7fec4c139fe0 2024-08-18T21:10:01.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.641+0000 7fec42ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:01.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.641+0000 7fec42ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.881+0000 7fec50f0f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:10:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.881+0000 7fec50f0f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:10:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.881+0000 7fec50f0f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:10:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.881+0000 7fec50f0f640 1 -- 172.21.15.5:0/1834531717 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fec4c069580 con 0x7fec4c139fe0 2024-08-18T21:10:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.881+0000 7fec42ffd640 1 -- 172.21.15.5:0/1834531717 <== mon.4 v2:172.21.15.5:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7fec4400f2e0 con 0x7fec4c139fe0 2024-08-18T21:10:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.881+0000 7fec42ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:10:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.881+0000 7fec42ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:01.886 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":146,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:10:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.885+0000 7fec50f0f640 1 -- 172.21.15.5:0/1834531717 >> v2:172.21.15.157:6812/631023601 conn(0x7fec2c03bdc0 msgr2=0x7fec2c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.885+0000 7fec50f0f640 1 --2- 172.21.15.5:0/1834531717 >> v2:172.21.15.157:6812/631023601 conn(0x7fec2c03bdc0 0x7fec2c03e280 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fec34003fd0 tx=0x7fec34009970 comp rx=0 tx=0).stop 2024-08-18T21:10:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.885+0000 7fec50f0f640 10 monclient: shutdown 2024-08-18T21:10:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.885+0000 7fec50f0f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.885+0000 7fec50f0f640 1 -- 172.21.15.5:0/1834531717 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fec4c139fe0 msgr2=0x7fec4c13e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.885+0000 7fec50f0f640 1 --2- 172.21.15.5:0/1834531717 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fec4c139fe0 0x7fec4c13e9d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fec4400b440 tx=0x7fec4400b900 comp rx=0 tx=0).stop 2024-08-18T21:10:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.885+0000 7fec50f0f640 1 -- 172.21.15.5:0/1834531717 shutdown_connections 2024-08-18T21:10:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.885+0000 7fec50f0f640 1 --2- 172.21.15.5:0/1834531717 >> v2:172.21.15.157:6812/631023601 conn(0x7fec2c03bdc0 0x7fec2c03e280 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.885+0000 7fec50f0f640 1 --2- 172.21.15.5:0/1834531717 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fec4c139fe0 0x7fec4c13e9d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.885+0000 7fec50f0f640 1 --2- 172.21.15.5:0/1834531717 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fec4c0a7600 0x7fec4c138930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.885+0000 7fec50f0f640 1 --2- 172.21.15.5:0/1834531717 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fec4c0a6ce0 0x7fec4c1383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.885+0000 7fec50f0f640 1 -- 172.21.15.5:0/1834531717 >> 172.21.15.5:0/1834531717 conn(0x7fec4c0acbc0 msgr2=0x7fec4c0a59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.885+0000 7fec50f0f640 1 -- 172.21.15.5:0/1834531717 shutdown_connections 2024-08-18T21:10:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:01.885+0000 7fec50f0f640 1 -- 172.21.15.5:0/1834531717 wait complete. 2024-08-18T21:10:04.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:10:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.037+0000 7f0865c17640 10 monclient: get_monmap_and_config 2024-08-18T21:10:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.037+0000 7f0865c17640 10 monclient: build_initial_monmap 2024-08-18T21:10:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.037+0000 7f0865c17640 10 monclient: monmap: 2024-08-18T21:10:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:05.042623+0000 2024-08-18T21:10:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:05.042623+0000 2024-08-18T21:10:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:05.043 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:05.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.037+0000 7f0865c17640 1 Processor -- start 2024-08-18T21:10:05.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.037+0000 7f0865c17640 1 -- start start 2024-08-18T21:10:05.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.037+0000 7f0865c17640 10 monclient: init 2024-08-18T21:10:05.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f0865c17640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:05.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f0865c17640 10 monclient: _add_conns ranks=[9,6,8,4,5,10,1,3,0,7,2] 2024-08-18T21:10:05.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f0865c17640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08600a6bd0 0x7f08600a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:05.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f0865c17640 10 monclient(hunting): picked mon.noname-a con 0x7f08600a6bd0 addr v2:172.21.15.5:3300/0 2024-08-18T21:10:05.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f0865c17640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f086009f080 0x7f08600a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:05.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f0865c17640 10 monclient(hunting): picked mon.noname-d con 0x7f086009f080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:05.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f0865c17640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0860139990 0x7f0860139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:05.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f0865c17640 10 monclient(hunting): picked mon.noname-e con 0x7f0860139990 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:05.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f0865c17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:05.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f0865c17640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f086009e4c0 con 0x7f08600a6bd0 2024-08-18T21:10:05.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f0865c17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:05.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f0865c17640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f086006f930 con 0x7f086009f080 2024-08-18T21:10:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f0865c17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f0865c17640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f08600a7a30 con 0x7f0860139990 2024-08-18T21:10:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f0865c17640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f0865c17640 10 monclient(hunting): authenticate will time out at 1372.056617s 2024-08-18T21:10:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085effd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f086009f080 0x7f08600a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08600a6bd0 0x7f08600a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085ffff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0860139990 0x7f0860139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085effd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f086009f080 0x7f08600a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:51220/0 (socket says 172.21.15.5:51220) 2024-08-18T21:10:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085effd640 1 -- 172.21.15.5:0/1925522045 learned_addr learned my addr 172.21.15.5:0/1925522045 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085effd640 10 monclient(hunting): get_auth_request con 0x7f086009f080 auth_method 0 2024-08-18T21:10:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 10 monclient(hunting): get_auth_request con 0x7f08600a6bd0 auth_method 0 2024-08-18T21:10:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085ffff640 10 monclient(hunting): get_auth_request con 0x7f0860139990 auth_method 0 2024-08-18T21:10:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 10 monclient(hunting): handle_auth_done global_id 84519 payload 274 2024-08-18T21:10:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 1 -- 172.21.15.5:0/1925522045 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0860139990 msgr2=0x7f0860139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 1 --2- 172.21.15.5:0/1925522045 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0860139990 0x7f0860139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 1 -- 172.21.15.5:0/1925522045 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f086009f080 msgr2=0x7f08600a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 1 --2- 172.21.15.5:0/1925522045 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f086009f080 0x7f08600a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:10:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 1 monclient: found mon.noname-a 2024-08-18T21:10:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:10:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085f7fe640 1 -- 172.21.15.5:0/1925522045 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08600a7fb0 con 0x7f08600a6bd0 2024-08-18T21:10:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.041+0000 7f085ffff640 1 --2- 172.21.15.5:0/1925522045 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0860139990 0x7f0860139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f085f7fe640 1 -- 172.21.15.5:0/1925522045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08600a6bd0 msgr2=0x7f08600a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f085f7fe640 1 --2- 172.21.15.5:0/1925522045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08600a6bd0 0x7f08600a6fb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f08500097c0 tx=0x7f085001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1c2324661f2ab8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f085e7fc640 1 -- 172.21.15.5:0/1925522045 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f08500b0070 con 0x7f08600a6bd0 2024-08-18T21:10:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f085e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f085e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:10:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f085e7fc640 10 monclient: dump: 2024-08-18T21:10:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:05.057 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f085e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:10:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f085e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:10:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f085e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f085e7fc640 1 -- 172.21.15.5:0/1925522045 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08500aa810 con 0x7f08600a6bd0 2024-08-18T21:10:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 5 monclient: authenticate success, global_id 84519 2024-08-18T21:10:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:10:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f085e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f085e7fc640 1 -- 172.21.15.5:0/1925522045 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f08500a4e60 con 0x7f08600a6bd0 2024-08-18T21:10:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f085e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 4 set_mon_vals no callback set 2024-08-18T21:10:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f085e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f085e7fc640 10 monclient: dump: 2024-08-18T21:10:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:05.060 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 10 monclient: shutdown 2024-08-18T21:10:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 1 -- 172.21.15.5:0/1925522045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08600a6bd0 msgr2=0x7f08600a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 1 --2- 172.21.15.5:0/1925522045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08600a6bd0 0x7f08600a6fb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f08500097c0 tx=0x7f085001c360 comp rx=0 tx=0).stop 2024-08-18T21:10:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 1 -- 172.21.15.5:0/1925522045 shutdown_connections 2024-08-18T21:10:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 1 --2- 172.21.15.5:0/1925522045 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0860139990 0x7f0860139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 1 --2- 172.21.15.5:0/1925522045 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f086009f080 0x7f08600a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 1 --2- 172.21.15.5:0/1925522045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08600a6bd0 0x7f08600a6fb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 1 -- 172.21.15.5:0/1925522045 >> 172.21.15.5:0/1925522045 conn(0x7f0860068700 msgr2=0x7f0860068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 1 -- 172.21.15.5:0/1925522045 shutdown_connections 2024-08-18T21:10:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 1 -- 172.21.15.5:0/1925522045 wait complete. 2024-08-18T21:10:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 10 monclient: build_initial_monmap 2024-08-18T21:10:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 10 monclient: monmap: 2024-08-18T21:10:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:05.062 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 1 Processor -- start 2024-08-18T21:10:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 1 -- start start 2024-08-18T21:10:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.045+0000 7f0865c17640 10 monclient: init 2024-08-18T21:10:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 10 monclient: _add_conns ranks=[0,1,3,8,6,7,5,4,2] 2024-08-18T21:10:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086009f080 0x7f08601383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 10 monclient(hunting): picked mon.noname-a con 0x7f086009f080 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:10:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08600a6bd0 0x7f0860138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 10 monclient(hunting): picked mon.noname-f con 0x7f08600a6bd0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:10:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0860139990 0x7f086013d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 10 monclient(hunting): picked mon.noname-g con 0x7f0860139990 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f08600a89f0 con 0x7f086009f080 2024-08-18T21:10:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f08600a7ce0 con 0x7f08600a6bd0 2024-08-18T21:10:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0860143610 con 0x7f0860139990 2024-08-18T21:10:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 10 monclient(hunting): authenticate will time out at 1372.064154s 2024-08-18T21:10:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086009f080 0x7f08601383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086009f080 0x7f08601383e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34626/0 (socket says 172.21.15.5:34626) 2024-08-18T21:10:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 1 -- 172.21.15.5:0/350486966 learned_addr learned my addr 172.21.15.5:0/350486966 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 10 monclient(hunting): get_auth_request con 0x7f086009f080 auth_method 0 2024-08-18T21:10:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085effd640 1 -- 172.21.15.5:0/350486966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08600a6bd0 msgr2=0x7f0860138920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:10:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085effd640 1 --2- 172.21.15.5:0/350486966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08600a6bd0 0x7f0860138920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 10 monclient(hunting): handle_auth_done global_id 84528 payload 824 2024-08-18T21:10:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 1 -- 172.21.15.5:0/350486966 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0860139990 msgr2=0x7f086013d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 1 --2- 172.21.15.5:0/350486966 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0860139990 0x7f086013d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 1 -- 172.21.15.5:0/350486966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08600a6bd0 msgr2=0x7f0860138920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:10:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 1 --2- 172.21.15.5:0/350486966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08600a6bd0 0x7f0860138920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:10:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 1 monclient: found mon.noname-a 2024-08-18T21:10:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:10:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 1 -- 172.21.15.5:0/350486966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0860123bf0 con 0x7f086009f080 2024-08-18T21:10:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 1 -- 172.21.15.5:0/350486966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086009f080 msgr2=0x7f08601383e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085f7fe640 1 --2- 172.21.15.5:0/350486966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086009f080 0x7f08601383e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f08500ae040 tx=0x7f0850019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0847fff640 1 -- 172.21.15.5:0/350486966 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f08500b0040 con 0x7f086009f080 2024-08-18T21:10:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0847fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0847fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:10:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0847fff640 10 monclient: dump: 2024-08-18T21:10:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:05.067 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0847fff640 10 monclient: _finish_auth 0 2024-08-18T21:10:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0847fff640 10 monclient: _check_auth_tickets 2024-08-18T21:10:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0847fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0847fff640 1 -- 172.21.15.5:0/350486966 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08500b9070 con 0x7f086009f080 2024-08-18T21:10:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 5 monclient: authenticate success, global_id 84528 2024-08-18T21:10:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 10 monclient: _renew_subs 2024-08-18T21:10:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:10:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 1 -- 172.21.15.5:0/350486966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0860123ed0 con 0x7f086009f080 2024-08-18T21:10:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0847fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0847fff640 1 -- 172.21.15.5:0/350486966 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f08500044b0 con 0x7f086009f080 2024-08-18T21:10:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0847fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0847fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f085dffb640 4 set_mon_vals no callback set 2024-08-18T21:10:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0847fff640 10 monclient: dump: 2024-08-18T21:10:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:05.069 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 10 monclient: _renew_subs 2024-08-18T21:10:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:10:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.049+0000 7f0865c17640 1 -- 172.21.15.5:0/350486966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08600ab610 con 0x7f086009f080 2024-08-18T21:10:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.053+0000 7f0847fff640 1 -- 172.21.15.5:0/350486966 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f08500aabd0 con 0x7f086009f080 2024-08-18T21:10:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.053+0000 7f0865c17640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.053+0000 7f0865c17640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.053+0000 7f0865c17640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:10:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.053+0000 7f0865c17640 1 -- 172.21.15.5:0/350486966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0860139e10 con 0x7f086009f080 2024-08-18T21:10:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.053+0000 7f0847fff640 1 --2- 172.21.15.5:0/350486966 >> v2:172.21.15.157:6812/631023601 conn(0x7f084c03bdc0 0x7f084c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.053+0000 7f0847fff640 1 -- 172.21.15.5:0/350486966 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(182..182 src has 22..182) ==== 3898+0+0 (secure 0 0 0) 0x7f08500e8030 con 0x7f086009f080 2024-08-18T21:10:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.053+0000 7f085effd640 1 --2- 172.21.15.5:0/350486966 >> v2:172.21.15.157:6812/631023601 conn(0x7f084c03bdc0 0x7f084c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.053+0000 7f085effd640 10 monclient: get_auth_request con 0x7f084c03bdc0 auth_method 0 2024-08-18T21:10:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.053+0000 7f085effd640 1 --2- 172.21.15.5:0/350486966 >> v2:172.21.15.157:6812/631023601 conn(0x7f084c03bdc0 0x7f084c03e280 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0854006c30 tx=0x7f0854009240 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.057+0000 7f0847fff640 1 -- 172.21.15.5:0/350486966 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f0850016070 con 0x7f086009f080 2024-08-18T21:10:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.057+0000 7f0847fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.057+0000 7f0847fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:05.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.289+0000 7f0865c17640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:10:05.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.289+0000 7f0865c17640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:10:05.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.289+0000 7f0865c17640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:10:05.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.289+0000 7f0865c17640 1 -- 172.21.15.5:0/350486966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f08601229b0 con 0x7f086009f080 2024-08-18T21:10:05.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.289+0000 7f0847fff640 1 -- 172.21.15.5:0/350486966 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3174 (secure 0 0 0) 0x7f08500e6da0 con 0x7f086009f080 2024-08-18T21:10:05.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.289+0000 7f0847fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:10:05.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.289+0000 7f0847fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:05.295 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":146,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:10:05.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.293+0000 7f0865c17640 1 -- 172.21.15.5:0/350486966 >> v2:172.21.15.157:6812/631023601 conn(0x7f084c03bdc0 msgr2=0x7f084c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:05.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.293+0000 7f0865c17640 1 --2- 172.21.15.5:0/350486966 >> v2:172.21.15.157:6812/631023601 conn(0x7f084c03bdc0 0x7f084c03e280 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0854006c30 tx=0x7f0854009240 comp rx=0 tx=0).stop 2024-08-18T21:10:05.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.293+0000 7f0865c17640 10 monclient: shutdown 2024-08-18T21:10:05.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.293+0000 7f0865c17640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:05.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.293+0000 7f0865c17640 1 -- 172.21.15.5:0/350486966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086009f080 msgr2=0x7f08601383e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:05.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.293+0000 7f0865c17640 1 --2- 172.21.15.5:0/350486966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086009f080 0x7f08601383e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f08500ae040 tx=0x7f0850019100 comp rx=0 tx=0).stop 2024-08-18T21:10:05.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.293+0000 7f0865c17640 1 -- 172.21.15.5:0/350486966 shutdown_connections 2024-08-18T21:10:05.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.293+0000 7f0865c17640 1 --2- 172.21.15.5:0/350486966 >> v2:172.21.15.157:6812/631023601 conn(0x7f084c03bdc0 0x7f084c03e280 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:05.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.293+0000 7f0865c17640 1 --2- 172.21.15.5:0/350486966 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0860139990 0x7f086013d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:05.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.293+0000 7f0865c17640 1 --2- 172.21.15.5:0/350486966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08600a6bd0 0x7f0860138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:05.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.293+0000 7f0865c17640 1 --2- 172.21.15.5:0/350486966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086009f080 0x7f08601383e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:05.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.293+0000 7f0865c17640 1 -- 172.21.15.5:0/350486966 >> 172.21.15.5:0/350486966 conn(0x7f0860068700 msgr2=0x7f08600a9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:05.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.293+0000 7f0865c17640 1 -- 172.21.15.5:0/350486966 shutdown_connections 2024-08-18T21:10:05.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:05.293+0000 7f0865c17640 1 -- 172.21.15.5:0/350486966 wait complete. 2024-08-18T21:10:08.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:10:08.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 10 monclient: get_monmap_and_config 2024-08-18T21:10:08.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 10 monclient: build_initial_monmap 2024-08-18T21:10:08.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 10 monclient: monmap: 2024-08-18T21:10:08.449 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:08.449 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:08.449 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:08.450044+0000 2024-08-18T21:10:08.449 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:08.450044+0000 2024-08-18T21:10:08.449 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:08.449 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:08.449 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:08.449 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:08.449 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:08.449 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:08.449 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:08.449 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:08.450 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:08.450 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:08.450 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:08.450 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:08.450 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:08.450 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:08.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 1 Processor -- start 2024-08-18T21:10:08.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 1 -- start start 2024-08-18T21:10:08.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 10 monclient: init 2024-08-18T21:10:08.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:08.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 10 monclient: _add_conns ranks=[2,1,4,3,8,9,10,6,7,0,5] 2024-08-18T21:10:08.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 0x7f46e809dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:08.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 10 monclient(hunting): picked mon.noname-b con 0x7f46e809b5d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:08.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f46e809b9b0 addr v1:172.21.15.157:6789/0 2024-08-18T21:10:08.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 0x7f46e80a4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:08.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 10 monclient(hunting): picked mon.noname-c con 0x7f46e809bdb0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:08.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e809c800 con 0x7f46e809b9b0 2024-08-18T21:10:08.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:08.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f46e809cae0 con 0x7f46e809b5d0 2024-08-18T21:10:08.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:08.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f46e809cdc0 con 0x7f46e809bdb0 2024-08-18T21:10:08.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:08.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46ed7a4640 10 monclient(hunting): authenticate will time out at 1375.463678s 2024-08-18T21:10:08.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46e77fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 0x7f46e80a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:08.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46e67fc640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7f46e809b9b0 legacy=0x7f46e80a4000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:10:08.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46e6ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 0x7f46e809dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:08.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46e77fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 0x7f46e80a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:54682/0 (socket says 172.21.15.5:54682) 2024-08-18T21:10:08.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46e6ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 0x7f46e809dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:36896/0 (socket says 172.21.15.5:36896) 2024-08-18T21:10:08.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46e77fe640 1 -- 172.21.15.5:0/3179466454 learned_addr learned my addr 172.21.15.5:0/3179466454 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:08.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46e77fe640 10 monclient(hunting): get_auth_request con 0x7f46e809bdb0 auth_method 0 2024-08-18T21:10:08.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:08.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46e77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:08.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:08.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request con 0x7f46e809b5d0 auth_method 0 2024-08-18T21:10:08.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:08.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46e6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:08.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.445+0000 7f46e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:08.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.449+0000 7f46e6ffd640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 msgr2=0x7f46e809dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:08.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.449+0000 7f46e6ffd640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 msgr2=0x7f46e809dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:08.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.449+0000 7f46e77fe640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 msgr2=0x7f46e80a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:10:08.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.449+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 0x7f46e809dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:08.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.449+0000 7f46e77fe640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 msgr2=0x7f46e80a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:08.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.449+0000 7f46e77fe640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 0x7f46e80a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:08.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.449+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 0x7f46e809dad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:08.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.449+0000 7f46e77fe640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 0x7f46e80a4710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:08.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.649+0000 7f46e67fc640 1 -- 172.21.15.5:0/3179466454 >> v1:172.21.15.157:6789/0 conn(0x7f46e809b9b0 legacy=0x7f46e80a4000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:10:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 0x7f46e809dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e77fe640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 0x7f46e80a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request con 0x7f46e809b5d0 auth_method 0 2024-08-18T21:10:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e77fe640 10 monclient(hunting): get_auth_request con 0x7f46e809bdb0 auth_method 0 2024-08-18T21:10:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e6ffd640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 msgr2=0x7f46e809dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e6ffd640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 msgr2=0x7f46e809dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 0x7f46e809dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e77fe640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 msgr2=0x7f46e80a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:10:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e77fe640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 msgr2=0x7f46e80a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e77fe640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 0x7f46e80a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 0x7f46e809dad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:10:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:08.653+0000 7f46e77fe640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 0x7f46e80a4710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:10:09.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.053+0000 7f46e67fc640 1 -- 172.21.15.5:0/3179466454 >> v1:172.21.15.157:6789/0 conn(0x7f46e809b9b0 legacy=0x7f46e80a4000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:10:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e77fe640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 0x7f46e80a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e77fe640 10 monclient(hunting): get_auth_request con 0x7f46e809bdb0 auth_method 0 2024-08-18T21:10:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 0x7f46e809dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request con 0x7f46e809b5d0 auth_method 0 2024-08-18T21:10:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e77fe640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 msgr2=0x7f46e80a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:10:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e77fe640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 msgr2=0x7f46e80a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e77fe640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 0x7f46e80a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e77fe640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 0x7f46e80a4710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:10:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e6ffd640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 msgr2=0x7f46e809dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e6ffd640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 msgr2=0x7f46e809dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 0x7f46e809dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.057+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 0x7f46e809dad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:10:09.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.857+0000 7f46e67fc640 1 -- 172.21.15.5:0/3179466454 >> v1:172.21.15.157:6789/0 conn(0x7f46e809b9b0 legacy=0x7f46e80a4000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:10:09.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e77fe640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 0x7f46e80a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:09.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 0x7f46e809dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:09.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request con 0x7f46e809b5d0 auth_method 0 2024-08-18T21:10:09.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:09.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:09.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:09.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e77fe640 10 monclient(hunting): get_auth_request con 0x7f46e809bdb0 auth_method 0 2024-08-18T21:10:09.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:09.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:09.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:09.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e6ffd640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 msgr2=0x7f46e809dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:10:09.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e6ffd640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 msgr2=0x7f46e809dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:09.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e77fe640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 msgr2=0x7f46e80a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:09.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 0x7f46e809dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:09.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e77fe640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 msgr2=0x7f46e80a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:09.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e77fe640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 0x7f46e80a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:09.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e77fe640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 0x7f46e80a4710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:10:09.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:09.861+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 0x7f46e809dad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:10:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 10 monclient(hunting): tick 2024-08-18T21:10:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:10:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 1 monclient(hunting): continuing hunt 2024-08-18T21:10:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:10:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 msgr2=0x7f46e80a4710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46e809bdb0 0x7f46e80a4710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 msgr2=0x7f46e809dad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46e809b5d0 0x7f46e809dad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 1 -- 172.21.15.5:0/3179466454 >> v1:172.21.15.157:6789/0 conn(0x7f46e809b9b0 legacy=0x7f46e80a4000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 10 monclient: _add_conns ranks=[7,8,0,9,5,6,10,3] 2024-08-18T21:10:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 0x7f46c8005c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 10 monclient(hunting): picked mon.noname-i con 0x7f46c8003830 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 0x7f46c80086f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 10 monclient(hunting): picked mon.noname-e con 0x7f46c8006280 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f46c8008d70 addr v1:172.21.15.5:6789/0 2024-08-18T21:10:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 1 -- 172.21.15.5:0/3179466454 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e809d0a0 con 0x7f46c8008d70 2024-08-18T21:10:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 1 -- 172.21.15.5:0/3179466454 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f46e809cae0 con 0x7f46c8003830 2024-08-18T21:10:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 1 -- 172.21.15.5:0/3179466454 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f46e809cdc0 con 0x7f46c8006280 2024-08-18T21:10:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.445+0000 7f46e4ff9640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e67fc640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 0x7f46c80086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e67fc640 10 monclient(hunting): get_auth_request con 0x7f46c8006280 auth_method 0 2024-08-18T21:10:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e67fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 0x7f46c8005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e67fc640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 msgr2=0x7f46c80086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:10:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request con 0x7f46c8003830 auth_method 0 2024-08-18T21:10:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e67fc640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 msgr2=0x7f46c80086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:11.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e67fc640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 0x7f46c80086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:11.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e67fc640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 0x7f46c80086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:11.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e6ffd640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 msgr2=0x7f46c8005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:11.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e6ffd640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 msgr2=0x7f46c8005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:11.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 0x7f46c8005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:11.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 0x7f46c8005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:11.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.449+0000 7f46e77fe640 1 -- 172.21.15.5:0/3179466454 >> v1:172.21.15.5:6789/0 conn(0x7f46c8008d70 legacy=0x7f46c800b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e67fc640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 0x7f46c80086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e67fc640 10 monclient(hunting): get_auth_request con 0x7f46c8006280 auth_method 0 2024-08-18T21:10:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e67fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e67fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 0x7f46c8005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request con 0x7f46c8003830 auth_method 0 2024-08-18T21:10:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e67fc640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 msgr2=0x7f46c80086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e67fc640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 msgr2=0x7f46c80086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e67fc640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 0x7f46c80086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e67fc640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 0x7f46c80086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:10:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e6ffd640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 msgr2=0x7f46c8005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:10:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e6ffd640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 msgr2=0x7f46c8005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 0x7f46c8005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:11.653+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 0x7f46c8005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:10:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e67fc640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 0x7f46c80086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e67fc640 10 monclient(hunting): get_auth_request con 0x7f46c8006280 auth_method 0 2024-08-18T21:10:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e67fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e67fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e67fc640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 msgr2=0x7f46c80086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e67fc640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 msgr2=0x7f46c80086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 0x7f46c8005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e67fc640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 0x7f46c80086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request con 0x7f46c8003830 auth_method 0 2024-08-18T21:10:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e67fc640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 0x7f46c80086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:10:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e6ffd640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 msgr2=0x7f46c8005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:10:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e6ffd640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 msgr2=0x7f46c8005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 0x7f46c8005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.057+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 0x7f46c8005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:10:12.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e67fc640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 0x7f46c80086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:12.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e67fc640 10 monclient(hunting): get_auth_request con 0x7f46c8006280 auth_method 0 2024-08-18T21:10:12.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:12.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e67fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:12.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e67fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:12.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e67fc640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 msgr2=0x7f46c80086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:12.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e67fc640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 msgr2=0x7f46c80086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:12.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e67fc640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 0x7f46c80086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:12.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e67fc640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 0x7f46c80086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:10:12.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 0x7f46c8005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:12.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request con 0x7f46c8003830 auth_method 0 2024-08-18T21:10:12.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:12.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:12.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:12.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e6ffd640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 msgr2=0x7f46c8005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:10:12.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e6ffd640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 msgr2=0x7f46c8005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:12.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 0x7f46c8005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:12.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:12.861+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 0x7f46c8005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:10:13.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.573+0000 7f46e5ffb640 1 -- 172.21.15.5:0/3179466454 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2980507835 0 0) 0x7f46e809d0a0 con 0x7f46c8008d70 2024-08-18T21:10:13.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient(hunting): _negotiate 2024-08-18T21:10:13.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:13.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:13.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient(hunting): my global_id is 84537 2024-08-18T21:10:13.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 -- 172.21.15.5:0/3179466454 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46d4003530 con 0x7f46c8008d70 2024-08-18T21:10:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 -- 172.21.15.5:0/3179466454 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1695981877 0 0) 0x7f46d4003530 con 0x7f46c8008d70 2024-08-18T21:10:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 msgr2=0x7f46c80086f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f46c8006280 0x7f46c80086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 msgr2=0x7f46c8005c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46c8003830 0x7f46c8005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient: _finish_hunting 0 2024-08-18T21:10:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 monclient: found mon.noname-a-legacy 2024-08-18T21:10:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.5:6789/0 2024-08-18T21:10:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 -- 172.21.15.5:0/3179466454 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e809c800 con 0x7f46c8008d70 2024-08-18T21:10:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient: _finish_auth 0 2024-08-18T21:10:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:10:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e77fe640 1 -- 172.21.15.5:0/3179466454 reap_dead start 2024-08-18T21:10:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 -- 172.21.15.5:0/3179466454 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 4141550541 0 0) 0x7f46e0009cf0 con 0x7f46c8008d70 2024-08-18T21:10:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-08-18T21:10:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient: dump: 2024-08-18T21:10:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:13.585 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] but i'm connected to v1:172.21.15.5:6789/0, reconnecting 2024-08-18T21:10:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 -- 172.21.15.5:0/3179466454 >> v1:172.21.15.5:6789/0 conn(0x7f46c8008d70 legacy=0x7f46c800b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient: _add_conns ranks=[5,2,3,8,7,1,0,4,6] 2024-08-18T21:10:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f46d4004210 0x7f46d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient(hunting): picked mon.h con 0x7f46d4004210 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46d4004e20 0x7f46d40052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient(hunting): picked mon.b con 0x7f46d4004e20 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46d4009c00 0x7f46d400c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient(hunting): picked mon.g con 0x7f46d4009c00 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 -- 172.21.15.5:0/3179466454 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f46e809cae0 con 0x7f46d4004e20 2024-08-18T21:10:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 -- 172.21.15.5:0/3179466454 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f46e809cdc0 con 0x7f46d4009c00 2024-08-18T21:10:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 1 -- 172.21.15.5:0/3179466454 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f46d400c9a0 con 0x7f46d4004210 2024-08-18T21:10:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e5ffb640 10 monclient(hunting): _finish_auth 0 2024-08-18T21:10:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e67fc640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46d4004e20 0x7f46d40052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e67fc640 10 monclient(hunting): get_auth_request con 0x7f46d4004e20 auth_method 0 2024-08-18T21:10:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e67fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e67fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f46d4004210 0x7f46d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e67fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:10:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e77fe640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46d4009c00 0x7f46d400c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.577+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request con 0x7f46d4004210 auth_method 0 2024-08-18T21:10:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e77fe640 10 monclient(hunting): get_auth_request con 0x7f46d4009c00 auth_method 0 2024-08-18T21:10:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e67fc640 10 monclient(hunting): handle_auth_done global_id 84537 payload 293 2024-08-18T21:10:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e67fc640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f46d4004210 msgr2=0x7f46d4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e67fc640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f46d4004210 0x7f46d4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e67fc640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46d4009c00 msgr2=0x7f46d400c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e67fc640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46d4009c00 0x7f46d400c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e67fc640 10 monclient: _finish_hunting 0 2024-08-18T21:10:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e67fc640 1 monclient: found mon.b 2024-08-18T21:10:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e67fc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:10:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e67fc640 1 -- 172.21.15.5:0/3179466454 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d4003530 con 0x7f46d4004e20 2024-08-18T21:10:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e67fc640 10 monclient: _finish_auth 0 2024-08-18T21:10:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e67fc640 10 monclient: _check_auth_tickets 2024-08-18T21:10:13.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:13.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46ed7a4640 5 monclient: authenticate success, global_id 84537 2024-08-18T21:10:13.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46ed7a4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:10:13.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f46d4004210 0x7f46d4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:10:13.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.581+0000 7f46e77fe640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46d4009c00 0x7f46d400c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:10:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46e67fc640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46d4004e20 msgr2=0x7f46d40052a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46e67fc640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46d4004e20 0x7f46d40052a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009ed0 tx=0x7f46d001d4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cba50a0c51e2112 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46e5ffb640 1 -- 172.21.15.5:0/3179466454 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f46d00b3070 con 0x7f46d4004e20 2024-08-18T21:10:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46e5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46e5ffb640 10 monclient: dump: 2024-08-18T21:10:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:13.593 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46e5ffb640 1 -- 172.21.15.5:0/3179466454 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d00ac780 con 0x7f46d4004e20 2024-08-18T21:10:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46e5ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46e5ffb640 1 -- 172.21.15.5:0/3179466454 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f46d0009ad0 con 0x7f46d4004e20 2024-08-18T21:10:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46ed7a4640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46ed7a4640 4 set_mon_vals no callback set 2024-08-18T21:10:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46e5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46e5ffb640 10 monclient: dump: 2024-08-18T21:10:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:13.595 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46ed7a4640 10 monclient: shutdown 2024-08-18T21:10:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46ed7a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46ed7a4640 1 -- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46d4004e20 msgr2=0x7f46d40052a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46ed7a4640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46d4004e20 0x7f46d40052a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009ed0 tx=0x7f46d001d4b0 comp rx=0 tx=0).stop 2024-08-18T21:10:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46ed7a4640 1 -- 172.21.15.5:0/3179466454 shutdown_connections 2024-08-18T21:10:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46ed7a4640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46d4009c00 0x7f46d400c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46ed7a4640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f46d4004e20 0x7f46d40052a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46ed7a4640 1 --2- 172.21.15.5:0/3179466454 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f46d4004210 0x7f46d4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.585+0000 7f46ed7a4640 1 -- 172.21.15.5:0/3179466454 >> 172.21.15.5:0/3179466454 conn(0x7f46e80a50f0 msgr2=0x7f46e80a54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 1 -- 172.21.15.5:0/3179466454 shutdown_connections 2024-08-18T21:10:13.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 1 -- 172.21.15.5:0/3179466454 wait complete. 2024-08-18T21:10:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 10 monclient: build_initial_monmap 2024-08-18T21:10:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 10 monclient: monmap: 2024-08-18T21:10:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:13.603 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 1 Processor -- start 2024-08-18T21:10:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 1 -- start start 2024-08-18T21:10:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 10 monclient: init 2024-08-18T21:10:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 10 monclient: _add_conns ranks=[6,5,3,4,7,1,2,8,0] 2024-08-18T21:10:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f46c8008d70 0x7f46e81d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 10 monclient(hunting): picked mon.noname-d con 0x7f46c8008d70 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f46d4004210 0x7f46e81d1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 10 monclient(hunting): picked mon.noname-h con 0x7f46d4004210 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46d4004e20 0x7f46e81d2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 10 monclient(hunting): picked mon.noname-g con 0x7f46d4004e20 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f46e80a4ba0 con 0x7f46d4004e20 2024-08-18T21:10:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f46e80a4a20 con 0x7f46d4004210 2024-08-18T21:10:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f46e80a4d20 con 0x7f46c8008d70 2024-08-18T21:10:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.589+0000 7f46ed7a4640 10 monclient(hunting): authenticate will time out at 1380.607986s 2024-08-18T21:10:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f46c8008d70 0x7f46e81d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f46c8008d70 0x7f46e81d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:51222/0 (socket says 172.21.15.5:51222) 2024-08-18T21:10:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 1 -- 172.21.15.5:0/104990396 learned_addr learned my addr 172.21.15.5:0/104990396 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request con 0x7f46c8008d70 auth_method 0 2024-08-18T21:10:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e67fc640 1 --2- 172.21.15.5:0/104990396 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f46d4004210 0x7f46e81d1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e67fc640 10 monclient(hunting): get_auth_request con 0x7f46d4004210 auth_method 0 2024-08-18T21:10:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e67fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e77fe640 1 --2- 172.21.15.5:0/104990396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46d4004e20 0x7f46e81d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 10 monclient(hunting): handle_auth_done global_id 84759 payload 824 2024-08-18T21:10:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 1 -- 172.21.15.5:0/104990396 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f46d4004210 msgr2=0x7f46e81d1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/104990396 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f46d4004210 0x7f46e81d1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 1 -- 172.21.15.5:0/104990396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46d4004e20 msgr2=0x7f46e81d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:13.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/104990396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46d4004e20 0x7f46e81d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:13.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:10:13.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 1 monclient: found mon.noname-d 2024-08-18T21:10:13.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:13.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:10:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 1 -- 172.21.15.5:0/104990396 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e8095bb0 con 0x7f46c8008d70 2024-08-18T21:10:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e77fe640 10 monclient: get_auth_request con 0x7f46d4004e20 auth_method 0 2024-08-18T21:10:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e77fe640 1 --2- 172.21.15.5:0/104990396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46d4004e20 0x7f46e81d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:10:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e67fc640 1 --2- 172.21.15.5:0/104990396 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f46d4004210 0x7f46e81d1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:10:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 1 -- 172.21.15.5:0/104990396 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f46c8008d70 msgr2=0x7f46e81d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e6ffd640 1 --2- 172.21.15.5:0/104990396 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f46c8008d70 0x7f46e81d1aa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f46d8017a80 tx=0x7f46d8017e80 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46df7fe640 1 -- 172.21.15.5:0/104990396 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f46d8028070 con 0x7f46c8008d70 2024-08-18T21:10:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46df7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:10:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46df7fe640 10 monclient: dump: 2024-08-18T21:10:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:13.610 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46df7fe640 10 monclient: _finish_auth 0 2024-08-18T21:10:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46df7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:10:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46df7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46df7fe640 1 -- 172.21.15.5:0/104990396 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d8018450 con 0x7f46c8008d70 2024-08-18T21:10:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46df7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46df7fe640 1 -- 172.21.15.5:0/104990396 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f46d800f040 con 0x7f46c8008d70 2024-08-18T21:10:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46ed7a4640 5 monclient: authenticate success, global_id 84759 2024-08-18T21:10:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46df7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46df7fe640 10 monclient: dump: 2024-08-18T21:10:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:13.612 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46ed7a4640 10 monclient: _renew_subs 2024-08-18T21:10:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46e57fa640 4 set_mon_vals no callback set 2024-08-18T21:10:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46ed7a4640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46ed7a4640 1 -- 172.21.15.5:0/104990396 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e8097790 con 0x7f46c8008d70 2024-08-18T21:10:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46ed7a4640 10 monclient: _renew_subs 2024-08-18T21:10:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46ed7a4640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.593+0000 7f46ed7a4640 1 -- 172.21.15.5:0/104990396 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e80971d0 con 0x7f46c8008d70 2024-08-18T21:10:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.597+0000 7f46ed7a4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.597+0000 7f46ed7a4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.597+0000 7f46ed7a4640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.597+0000 7f46ed7a4640 1 -- 172.21.15.5:0/104990396 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e813ca80 con 0x7f46c8008d70 2024-08-18T21:10:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.597+0000 7f46df7fe640 1 -- 172.21.15.5:0/104990396 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f46d8016a70 con 0x7f46c8008d70 2024-08-18T21:10:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.597+0000 7f46df7fe640 1 --2- 172.21.15.5:0/104990396 >> v2:172.21.15.157:6812/631023601 conn(0x7f46c803cec0 0x7f46c803f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.597+0000 7f46df7fe640 1 -- 172.21.15.5:0/104990396 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(182..182 src has 22..182) ==== 3898+0+0 (secure 0 0 0) 0x7f46d804f4a0 con 0x7f46c8008d70 2024-08-18T21:10:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.597+0000 7f46e67fc640 1 --2- 172.21.15.5:0/104990396 >> v2:172.21.15.157:6812/631023601 conn(0x7f46c803cec0 0x7f46c803f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.597+0000 7f46e67fc640 10 monclient: get_auth_request con 0x7f46c803cec0 auth_method 0 2024-08-18T21:10:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.597+0000 7f46e67fc640 1 -- 172.21.15.5:0/104990396 >> v2:172.21.15.157:6812/631023601 conn(0x7f46c803cec0 msgr2=0x7f46c803f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-18T21:10:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.597+0000 7f46e67fc640 1 -- 172.21.15.5:0/104990396 >> v2:172.21.15.157:6812/631023601 conn(0x7f46c803cec0 msgr2=0x7f46c803f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:10:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.597+0000 7f46e67fc640 1 --2- 172.21.15.5:0/104990396 >> v2:172.21.15.157:6812/631023601 conn(0x7f46c803cec0 0x7f46c803f380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f46d00ad000 tx=0x7f46d0005d40 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.597+0000 7f46e67fc640 1 --2- 172.21.15.5:0/104990396 >> v2:172.21.15.157:6812/631023601 conn(0x7f46c803cec0 0x7f46c803f380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.601+0000 7f46df7fe640 1 -- 172.21.15.5:0/104990396 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f46d8020070 con 0x7f46c8008d70 2024-08-18T21:10:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.601+0000 7f46df7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.601+0000 7f46df7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:13.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.801+0000 7f46e67fc640 1 --2- 172.21.15.5:0/104990396 >> v2:172.21.15.157:6812/631023601 conn(0x7f46c803cec0 0x7f46c803f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:13.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.801+0000 7f46e67fc640 10 monclient: get_auth_request con 0x7f46c803cec0 auth_method 0 2024-08-18T21:10:13.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.805+0000 7f46e67fc640 1 --2- 172.21.15.5:0/104990396 >> v2:172.21.15.157:6812/631023601 conn(0x7f46c803cec0 0x7f46c803f380 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009ed0 tx=0x7f46d00ba040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.837+0000 7f46ed7a4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:10:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:10:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 1 -- 172.21.15.5:0/104990396 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f46e8095ff0 con 0x7f46c8008d70 2024-08-18T21:10:13.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46df7fe640 1 -- 172.21.15.5:0/104990396 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3167 (secure 0 0 0) 0x7f46d804f260 con 0x7f46c8008d70 2024-08-18T21:10:13.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46df7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:10:13.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46df7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:13.844 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":150,"quorum":[0,2,3,4,5,6,7,8],"quorum_names":["a","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:10:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 1 -- 172.21.15.5:0/104990396 >> v2:172.21.15.157:6812/631023601 conn(0x7f46c803cec0 msgr2=0x7f46c803f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 1 --2- 172.21.15.5:0/104990396 >> v2:172.21.15.157:6812/631023601 conn(0x7f46c803cec0 0x7f46c803f380 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009ed0 tx=0x7f46d00ba040 comp rx=0 tx=0).stop 2024-08-18T21:10:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 10 monclient: shutdown 2024-08-18T21:10:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 1 -- 172.21.15.5:0/104990396 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f46c8008d70 msgr2=0x7f46e81d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 1 --2- 172.21.15.5:0/104990396 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f46c8008d70 0x7f46e81d1aa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f46d8017a80 tx=0x7f46d8017e80 comp rx=0 tx=0).stop 2024-08-18T21:10:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 1 -- 172.21.15.5:0/104990396 shutdown_connections 2024-08-18T21:10:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 1 --2- 172.21.15.5:0/104990396 >> v2:172.21.15.157:6812/631023601 conn(0x7f46c803cec0 0x7f46c803f380 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:13.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 1 --2- 172.21.15.5:0/104990396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46d4004e20 0x7f46e81d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:13.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 1 --2- 172.21.15.5:0/104990396 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f46d4004210 0x7f46e81d1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:13.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 1 --2- 172.21.15.5:0/104990396 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f46c8008d70 0x7f46e81d1aa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:13.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 1 -- 172.21.15.5:0/104990396 >> 172.21.15.5:0/104990396 conn(0x7f46e80a50f0 msgr2=0x7f46e80a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:13.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 1 -- 172.21.15.5:0/104990396 shutdown_connections 2024-08-18T21:10:13.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.841+0000 7f46ed7a4640 1 -- 172.21.15.5:0/104990396 wait complete. 2024-08-18T21:10:13.864 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-08-18T21:10:13.864 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-08-18T21:10:13.864 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:10:13.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 10 monclient: get_monmap_and_config 2024-08-18T21:10:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 10 monclient: build_initial_monmap 2024-08-18T21:10:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 10 monclient: monmap: 2024-08-18T21:10:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:13.993506+0000 2024-08-18T21:10:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:13.993506+0000 2024-08-18T21:10:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:13.993 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 1 Processor -- start 2024-08-18T21:10:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 1 -- start start 2024-08-18T21:10:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 10 monclient: init 2024-08-18T21:10:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 10 monclient: _add_conns ranks=[0,8,4,2,10,5,6,7,3,1,9] 2024-08-18T21:10:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff4480a6bd0 addr v1:172.21.15.5:6789/0 2024-08-18T21:10:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff44809f080 0x7ff44813ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 10 monclient(hunting): picked mon.noname-e con 0x7ff44809f080 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4480a76c0 0x7ff448141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 10 monclient(hunting): picked mon.noname-c con 0x7ff4480a76c0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4480a7fb0 con 0x7ff4480a6bd0 2024-08-18T21:10:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff44809e4c0 con 0x7ff4480a76c0 2024-08-18T21:10:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff44806f930 con 0x7ff44809f080 2024-08-18T21:10:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44f68a640 10 monclient(hunting): authenticate will time out at 1381.006705s 2024-08-18T21:10:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44d426640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff4480a6bd0 0x7ff4480a6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36516/0 (socket says 172.21.15.5:36516) 2024-08-18T21:10:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44d426640 1 -- 172.21.15.5:0/1489912340 learned_addr learned my addr 172.21.15.5:0/1489912340 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:10:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44cc25640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff44809f080 0x7ff44813ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 1 --2- 172.21.15.5:0/1489912340 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4480a76c0 0x7ff448141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44cc25640 10 monclient(hunting): get_auth_request con 0x7ff44809f080 auth_method 0 2024-08-18T21:10:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44cc25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44cc25640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44cc25640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 10 monclient(hunting): get_auth_request con 0x7ff4480a76c0 auth_method 0 2024-08-18T21:10:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44cc25640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44cc25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44cc25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 10 monclient(hunting): handle_auth_done global_id 6295 payload 274 2024-08-18T21:10:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 1 -- 172.21.15.5:0/1489912340 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff44809f080 msgr2=0x7ff44813ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 1 --2- 172.21.15.5:0/1489912340 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff44809f080 0x7ff44813ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 1 -- 172.21.15.5:0/1489912340 >> v1:172.21.15.5:6789/0 conn(0x7ff4480a6bd0 legacy=0x7ff4480a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 10 monclient: _finish_hunting 0 2024-08-18T21:10:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 1 monclient: found mon.noname-c 2024-08-18T21:10:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:10:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.989+0000 7ff44dc27640 1 -- 172.21.15.5:0/1489912340 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff44809de70 con 0x7ff4480a76c0 2024-08-18T21:10:14.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.993+0000 7ff44dc27640 1 -- 172.21.15.5:0/1489912340 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4480a76c0 msgr2=0x7ff448141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.993+0000 7ff44dc27640 1 --2- 172.21.15.5:0/1489912340 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4480a76c0 0x7ff448141330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff4400097f0 tx=0x7ff44001c430 comp rx=0 tx=0).ready entity=mon.4 client_cookie=2b5858863cd6d87e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff43ffff640 1 -- 172.21.15.5:0/1489912340 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4400b0070 con 0x7ff4480a76c0 2024-08-18T21:10:14.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff43ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff43ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:10:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff43ffff640 10 monclient: dump: 2024-08-18T21:10:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.005 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff43ffff640 10 monclient: _finish_auth 0 2024-08-18T21:10:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff43ffff640 10 monclient: _check_auth_tickets 2024-08-18T21:10:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff43ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff43ffff640 1 -- 172.21.15.5:0/1489912340 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4400aa810 con 0x7ff4480a76c0 2024-08-18T21:10:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff43ffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff43ffff640 1 -- 172.21.15.5:0/1489912340 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4400aae30 con 0x7ff4480a76c0 2024-08-18T21:10:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 5 monclient: authenticate success, global_id 6295 2024-08-18T21:10:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 4 set_mon_vals no callback set 2024-08-18T21:10:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff43ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff43ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff43ffff640 10 monclient: dump: 2024-08-18T21:10:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.007 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 10 monclient: shutdown 2024-08-18T21:10:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 1 -- 172.21.15.5:0/1489912340 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4480a76c0 msgr2=0x7ff448141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 1 --2- 172.21.15.5:0/1489912340 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4480a76c0 0x7ff448141330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff4400097f0 tx=0x7ff44001c430 comp rx=0 tx=0).stop 2024-08-18T21:10:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 1 -- 172.21.15.5:0/1489912340 shutdown_connections 2024-08-18T21:10:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 1 --2- 172.21.15.5:0/1489912340 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff44809f080 0x7ff44813ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 1 --2- 172.21.15.5:0/1489912340 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4480a76c0 0x7ff448141330 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 1 -- 172.21.15.5:0/1489912340 >> 172.21.15.5:0/1489912340 conn(0x7ff448068700 msgr2=0x7ff448068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 1 -- 172.21.15.5:0/1489912340 shutdown_connections 2024-08-18T21:10:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 1 -- 172.21.15.5:0/1489912340 wait complete. 2024-08-18T21:10:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 10 monclient: build_initial_monmap 2024-08-18T21:10:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 10 monclient: monmap: 2024-08-18T21:10:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:14.009 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 1 Processor -- start 2024-08-18T21:10:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 1 -- start start 2024-08-18T21:10:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 10 monclient: init 2024-08-18T21:10:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 10 monclient: _add_conns ranks=[3,5,0,1,4,6,7,8,2] 2024-08-18T21:10:14.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff44809f080 0x7ff448128e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 10 monclient(hunting): picked mon.noname-g con 0x7ff44809f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:14.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff4480a6bd0 0x7ff44813fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 10 monclient(hunting): picked mon.noname-h con 0x7ff4480a6bd0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:14.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4480a76c0 0x7ff448126880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 10 monclient(hunting): picked mon.noname-a con 0x7ff4480a76c0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:10:14.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff448144210 con 0x7ff4480a76c0 2024-08-18T21:10:14.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff448144090 con 0x7ff44809f080 2024-08-18T21:10:14.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7ff448144390 con 0x7ff4480a6bd0 2024-08-18T21:10:14.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44f68a640 10 monclient(hunting): authenticate will time out at 1381.014962s 2024-08-18T21:10:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4480a76c0 0x7ff448126880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4480a76c0 0x7ff448126880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40248/0 (socket says 172.21.15.5:40248) 2024-08-18T21:10:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 1 -- 172.21.15.5:0/808725221 learned_addr learned my addr 172.21.15.5:0/808725221 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 10 monclient(hunting): get_auth_request con 0x7ff4480a76c0 auth_method 0 2024-08-18T21:10:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44cc25640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff4480a6bd0 0x7ff44813fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44d426640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff44809f080 0x7ff448128e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 10 monclient(hunting): handle_auth_done global_id 84546 payload 824 2024-08-18T21:10:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 1 -- 172.21.15.5:0/808725221 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff4480a6bd0 msgr2=0x7ff44813fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff4480a6bd0 0x7ff44813fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 1 -- 172.21.15.5:0/808725221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff44809f080 msgr2=0x7ff448128e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff44809f080 0x7ff448128e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 10 monclient: _finish_hunting 0 2024-08-18T21:10:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 1 monclient: found mon.noname-a 2024-08-18T21:10:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:10:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:13.997+0000 7ff44dc27640 1 -- 172.21.15.5:0/808725221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4480abab0 con 0x7ff4480a76c0 2024-08-18T21:10:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44dc27640 1 -- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4480a76c0 msgr2=0x7ff448126880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44dc27640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4480a76c0 0x7ff448126880 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff44001c260 tx=0x7ff4400191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43dffb640 1 -- 172.21.15.5:0/808725221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4400b9020 con 0x7ff4480a76c0 2024-08-18T21:10:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:10:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43dffb640 10 monclient: dump: 2024-08-18T21:10:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.018 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43dffb640 10 monclient: _finish_auth 0 2024-08-18T21:10:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43dffb640 10 monclient: _check_auth_tickets 2024-08-18T21:10:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43dffb640 1 -- 172.21.15.5:0/808725221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4400044b0 con 0x7ff4480a76c0 2024-08-18T21:10:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43dffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43dffb640 1 -- 172.21.15.5:0/808725221 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4400b0040 con 0x7ff4480a76c0 2024-08-18T21:10:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43f7fe640 4 set_mon_vals no callback set 2024-08-18T21:10:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43dffb640 10 monclient: dump: 2024-08-18T21:10:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.020 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44f68a640 5 monclient: authenticate success, global_id 84546 2024-08-18T21:10:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44f68a640 10 monclient: _renew_subs 2024-08-18T21:10:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44f68a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:10:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44f68a640 1 -- 172.21.15.5:0/808725221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4481d20c0 con 0x7ff4480a76c0 2024-08-18T21:10:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44f68a640 10 monclient: _renew_subs 2024-08-18T21:10:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44f68a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:10:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44f68a640 1 -- 172.21.15.5:0/808725221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff44812a690 con 0x7ff4480a76c0 2024-08-18T21:10:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44f68a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44f68a640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448129f10 0x7ff448126dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44f68a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44f68a640 1 -- 172.21.15.5:0/808725221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff4481c9220 con 0x7ff448129f10 2024-08-18T21:10:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44d426640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448129f10 0x7ff448126dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43dffb640 1 -- 172.21.15.5:0/808725221 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7ff4400bc020 con 0x7ff4480a76c0 2024-08-18T21:10:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44d426640 10 monclient: get_auth_request con 0x7ff448129f10 auth_method 0 2024-08-18T21:10:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44d426640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44d426640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44d426640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44d426640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44d426640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44d426640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43dffb640 1 --2- 172.21.15.5:0/808725221 >> v2:172.21.15.157:6812/631023601 conn(0x7ff43403bdc0 0x7ff43403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44d426640 10 monclient(hunting): handle_auth_done global_id 84555 payload 824 2024-08-18T21:10:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44d426640 1 -- 172.21.15.5:0/808725221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4480a6fb0 con 0x7ff448129f10 2024-08-18T21:10:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff43dffb640 1 -- 172.21.15.5:0/808725221 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(182..182 src has 22..182) ==== 3898+0+0 (secure 0 0 0) 0x7ff4400e8480 con 0x7ff4480a76c0 2024-08-18T21:10:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44cc25640 1 --2- 172.21.15.5:0/808725221 >> v2:172.21.15.157:6812/631023601 conn(0x7ff43403bdc0 0x7ff43403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.001+0000 7ff44cc25640 10 monclient: get_auth_request con 0x7ff43403bdc0 auth_method 0 2024-08-18T21:10:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44d426640 1 -- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448129f10 msgr2=0x7ff448126dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44d426640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448129f10 0x7ff448126dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff43800db00 tx=0x7ff43800b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44d426640 1 -- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448129f10 msgr2=0x7ff448126dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-18T21:10:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44d426640 1 -- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448129f10 msgr2=0x7ff448126dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:10:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44d426640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448129f10 0x7ff448126dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff43800db00 tx=0x7ff43800b0d0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44d426640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448129f10 0x7ff448126dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff43800db00 tx=0x7ff43800b0d0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff43dffb640 1 -- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448129f10 msgr2=0x7ff448126dc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff43dffb640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448129f10 0x7ff448126dc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff43dffb640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff434041f00 0x7ff434044320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff43dffb640 1 -- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448129f10 msgr2=0x7ff448126dc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff43dffb640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448129f10 0x7ff448126dc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff43dffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff43dffb640 1 -- 172.21.15.5:0/808725221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff434044960 con 0x7ff434041f00 2024-08-18T21:10:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44d426640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff434041f00 0x7ff434044320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44d426640 10 monclient: get_auth_request con 0x7ff434041f00 auth_method 0 2024-08-18T21:10:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44d426640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44d426640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44d426640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44d426640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44d426640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44d426640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44d426640 10 monclient(hunting): handle_auth_done global_id 84564 payload 824 2024-08-18T21:10:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44d426640 1 -- 172.21.15.5:0/808725221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4400a6ea0 con 0x7ff434041f00 2024-08-18T21:10:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.005+0000 7ff44cc25640 1 --2- 172.21.15.5:0/808725221 >> v2:172.21.15.157:6812/631023601 conn(0x7ff43403bdc0 0x7ff43403e280 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff4440099b0 tx=0x7ff444008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.009+0000 7ff44d426640 1 -- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff434041f00 msgr2=0x7ff434044320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.009+0000 7ff44d426640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff434041f00 0x7ff434044320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff43800dad0 tx=0x7ff438004cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.009+0000 7ff43dffb640 1 -- 172.21.15.5:0/808725221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff43802b070 con 0x7ff434041f00 2024-08-18T21:10:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.009+0000 7ff43dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.009+0000 7ff43dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.009+0000 7ff43dffb640 10 monclient: dump: 2024-08-18T21:10:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.027 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.009+0000 7ff43dffb640 1 -- 172.21.15.5:0/808725221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff438017070 con 0x7ff434041f00 2024-08-18T21:10:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.009+0000 7ff43dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.009+0000 7ff43dffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.009+0000 7ff43dffb640 1 -- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff434041f00 msgr2=0x7ff434044320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.009+0000 7ff43dffb640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff434041f00 0x7ff434044320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff43800dad0 tx=0x7ff438004cd0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.009+0000 7ff43dffb640 1 -- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff434041f00 msgr2=0x7ff434044320 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.009+0000 7ff43dffb640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff434041f00 0x7ff434044320 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff43800dad0 tx=0x7ff438004cd0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.013+0000 7ff44f68a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.013+0000 7ff44f68a640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448127300 0x7ff448122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.013+0000 7ff44f68a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.013+0000 7ff44f68a640 1 -- 172.21.15.5:0/808725221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff4480a5fd0 con 0x7ff448127300 2024-08-18T21:10:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.013+0000 7ff44d426640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448127300 0x7ff448122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.013+0000 7ff44d426640 10 monclient: get_auth_request con 0x7ff448127300 auth_method 0 2024-08-18T21:10:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.013+0000 7ff44d426640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.013+0000 7ff44d426640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.013+0000 7ff44d426640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.013+0000 7ff44d426640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.013+0000 7ff44d426640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.013+0000 7ff44d426640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.013+0000 7ff44d426640 10 monclient(hunting): handle_auth_done global_id 84573 payload 824 2024-08-18T21:10:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.013+0000 7ff44d426640 1 -- 172.21.15.5:0/808725221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff448127710 con 0x7ff448127300 2024-08-18T21:10:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff44d426640 1 -- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448127300 msgr2=0x7ff448122820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff44d426640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448127300 0x7ff448122820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff438016000 tx=0x7ff438017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff43dffb640 1 -- 172.21.15.5:0/808725221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff43802b040 con 0x7ff448127300 2024-08-18T21:10:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff43dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff43dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff43dffb640 10 monclient: dump: 2024-08-18T21:10:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.031 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff43dffb640 1 -- 172.21.15.5:0/808725221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9239 (secure 0 0 0) 0x7ff43802d620 con 0x7ff448127300 2024-08-18T21:10:14.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff43dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:14.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff43dffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:14.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff43dffb640 1 -- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448127300 msgr2=0x7ff448122820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff43dffb640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448127300 0x7ff448122820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff438016000 tx=0x7ff438017000 comp rx=0 tx=0).stop 2024-08-18T21:10:14.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff43dffb640 1 -- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448127300 msgr2=0x7ff448122820 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:14.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff43dffb640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff448127300 0x7ff448122820 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff438016000 tx=0x7ff438017000 comp rx=0 tx=0).stop 2024-08-18T21:10:14.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff44dc27640 1 -- 172.21.15.5:0/808725221 reap_dead start 2024-08-18T21:10:14.035 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:14.035 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:14.036 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:14.036 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:10:14.036 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 150, 2024-08-18T21:10:14.036 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 110850, 2024-08-18T21:10:14.036 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:14.036 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:14.036 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:14.036 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:14.036 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:14.036 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:14.036 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:14.036 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:14.036 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:14.037 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.037 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:10:14.037 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:14.037 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:14.037 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:14.037 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.037 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.037 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.037 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.037 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.038 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.038 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.038 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.038 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.038 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.038 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.038 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.038 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:14.038 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:14.038 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.038 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.038 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.038 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.039 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.039 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.039 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.039 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.039 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.039 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.039 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.039 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.039 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:14.039 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:14.039 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:14.039 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:14.039 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:14.040 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:14.040 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:14.040 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:14.040 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:14.040 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:14.040 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:14.040 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:14.040 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:14.040 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:14.040 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:14.040 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:14.040 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:14.040 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.040 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.041 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.041 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.041 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.041 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.041 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.041 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.041 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.041 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.041 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.041 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.041 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:14.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.041 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:14.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.042 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:14.042 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:14.042 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.042 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.042 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.042 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.042 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:14.042 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.043 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.043 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:14.043 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.043 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.043 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.043 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:14.043 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:14.043 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.043 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.043 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.044 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:14.044 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:14.044 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.044 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.044 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.044 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:14.044 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.044 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.044 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:14.044 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.044 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.045 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.045 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:14.045 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:14.045 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.045 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.045 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.046 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:14.046 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:14.046 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.046 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.046 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.046 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:14.046 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.046 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.047 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:14.047 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.047 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.047 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.047 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:14.047 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:14.047 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.047 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.047 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.047 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:14.047 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:14.048 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.048 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.048 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.048 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:14.048 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.048 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.048 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:14.048 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.048 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.048 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.049 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:14.049 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:14.049 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.049 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.049 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.049 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.049 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:14.049 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:14.049 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.049 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.049 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.049 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.049 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:14.049 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.050 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.050 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:14.050 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.050 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.050 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.050 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:14.050 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:14.050 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.050 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.050 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.051 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:14.051 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:14.051 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.051 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.051 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.051 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:14.051 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.051 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.051 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:14.051 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.052 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.052 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.052 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:14.052 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:14.052 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.052 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.052 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.052 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:14.052 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:14.052 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.052 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.053 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.053 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:14.053 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.053 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.053 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:14.053 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.053 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.053 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.053 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:14.053 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:14.054 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.054 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.054 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.054 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:14.054 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:14.054 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.054 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.054 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.054 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:14.054 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.055 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.055 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:14.055 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.055 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.055 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.056 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:14.056 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:14.056 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.056 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.056 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.056 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:14.056 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:14.056 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.056 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.056 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.056 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:14.057 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.057 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.057 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:14.057 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.057 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.057 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.057 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:14.057 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:14.057 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.057 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.057 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.058 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.058 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.058 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:14.058 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:14.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.058 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:14.058 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:14.058 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:14.058 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.058 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.058 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:14.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.058 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:14.059 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:14.059 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:10:14.059 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.059 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.059 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:14.059 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff44f68a640 1 -- 172.21.15.5:0/808725221 >> v2:172.21.15.157:6812/631023601 conn(0x7ff43403bdc0 msgr2=0x7ff43403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff44f68a640 1 --2- 172.21.15.5:0/808725221 >> v2:172.21.15.157:6812/631023601 conn(0x7ff43403bdc0 0x7ff43403e280 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff4440099b0 tx=0x7ff444008040 comp rx=0 tx=0).stop 2024-08-18T21:10:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff44f68a640 10 monclient: shutdown 2024-08-18T21:10:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff44f68a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff44f68a640 1 -- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4480a76c0 msgr2=0x7ff448126880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff44f68a640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4480a76c0 0x7ff448126880 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff44001c260 tx=0x7ff4400191d0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff44f68a640 1 -- 172.21.15.5:0/808725221 shutdown_connections 2024-08-18T21:10:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff44f68a640 1 --2- 172.21.15.5:0/808725221 >> v2:172.21.15.157:6812/631023601 conn(0x7ff43403bdc0 0x7ff43403e280 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff44f68a640 1 --2- 172.21.15.5:0/808725221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4480a76c0 0x7ff448126880 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff44f68a640 1 -- 172.21.15.5:0/808725221 >> 172.21.15.5:0/808725221 conn(0x7ff448068700 msgr2=0x7ff4480a20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff44f68a640 1 -- 172.21.15.5:0/808725221 shutdown_connections 2024-08-18T21:10:14.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.017+0000 7ff44f68a640 1 -- 172.21.15.5:0/808725221 wait complete. 2024-08-18T21:10:14.062 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-18T21:10:14.062 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon b 2024-08-18T21:10:14.062 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:10:14.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 10 monclient: get_monmap_and_config 2024-08-18T21:10:14.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 10 monclient: build_initial_monmap 2024-08-18T21:10:14.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 10 monclient: monmap: 2024-08-18T21:10:14.188 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:14.188 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.188 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:14.189654+0000 2024-08-18T21:10:14.188 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:14.189654+0000 2024-08-18T21:10:14.188 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:14.189 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.189 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:14.189 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:14.189 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:14.189 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:14.189 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:14.189 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:14.189 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:14.189 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:14.189 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:14.189 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:14.189 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:14.189 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 1 Processor -- start 2024-08-18T21:10:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 1 -- start start 2024-08-18T21:10:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 10 monclient: init 2024-08-18T21:10:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 10 monclient: _add_conns ranks=[5,6,4,3,0,9,1,8,10,2,7] 2024-08-18T21:10:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2b900a1ff0 0x7f2b90137430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 10 monclient(hunting): picked mon.noname-h con 0x7f2b900a1ff0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b90137970 0x7f2b90137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 10 monclient(hunting): picked mon.noname-d con 0x7f2b90137970 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b90133eb0 0x7f2b90134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 10 monclient(hunting): picked mon.noname-c con 0x7f2b90133eb0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f2b9009dd50 con 0x7f2b90133eb0 2024-08-18T21:10:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f2b900a23d0 con 0x7f2b900a1ff0 2024-08-18T21:10:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f2b9009e970 con 0x7f2b90137970 2024-08-18T21:10:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b95ac9640 10 monclient(hunting): authenticate will time out at 1381.202918s 2024-08-18T21:10:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b90133eb0 0x7f2b90134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8effd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b90137970 0x7f2b90137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b90133eb0 0x7f2b90134330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:45078/0 (socket says 172.21.15.5:45078) 2024-08-18T21:10:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 1 -- 172.21.15.5:0/3901916386 learned_addr learned my addr 172.21.15.5:0/3901916386 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:14.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 10 monclient(hunting): get_auth_request con 0x7f2b90133eb0 auth_method 0 2024-08-18T21:10:14.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8effd640 10 monclient(hunting): get_auth_request con 0x7f2b90137970 auth_method 0 2024-08-18T21:10:14.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8f7fe640 1 --2- 172.21.15.5:0/3901916386 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2b900a1ff0 0x7f2b90137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8f7fe640 10 monclient(hunting): get_auth_request con 0x7f2b900a1ff0 auth_method 0 2024-08-18T21:10:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 10 monclient(hunting): handle_auth_done global_id 6304 payload 274 2024-08-18T21:10:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 1 -- 172.21.15.5:0/3901916386 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b90137970 msgr2=0x7f2b90137dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 1 --2- 172.21.15.5:0/3901916386 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b90137970 0x7f2b90137dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 1 -- 172.21.15.5:0/3901916386 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2b900a1ff0 msgr2=0x7f2b90137430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 1 --2- 172.21.15.5:0/3901916386 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2b900a1ff0 0x7f2b90137430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 10 monclient: _finish_hunting 0 2024-08-18T21:10:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 1 monclient: found mon.noname-c 2024-08-18T21:10:14.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:14.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:10:14.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8ffff640 1 -- 172.21.15.5:0/3901916386 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9009ec50 con 0x7f2b90133eb0 2024-08-18T21:10:14.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.185+0000 7f2b8effd640 1 --2- 172.21.15.5:0/3901916386 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b90137970 0x7f2b90137dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:14.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.189+0000 7f2b8ffff640 1 -- 172.21.15.5:0/3901916386 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b90133eb0 msgr2=0x7f2b90134330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.189+0000 7f2b8ffff640 1 --2- 172.21.15.5:0/3901916386 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b90133eb0 0x7f2b90134330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2b880098a0 tx=0x7f2b8801c440 comp rx=0 tx=0).ready entity=mon.4 client_cookie=6623de51e123a912 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.189+0000 7f2b8e7fc640 1 -- 172.21.15.5:0/3901916386 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2b880b0070 con 0x7f2b90133eb0 2024-08-18T21:10:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.189+0000 7f2b8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:10:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8e7fc640 10 monclient: dump: 2024-08-18T21:10:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.203 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:10:14.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:10:14.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:14.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8e7fc640 1 -- 172.21.15.5:0/3901916386 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b880aa810 con 0x7f2b90133eb0 2024-08-18T21:10:14.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 5 monclient: authenticate success, global_id 6304 2024-08-18T21:10:14.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:10:14.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:14.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:14.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8e7fc640 1 -- 172.21.15.5:0/3901916386 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2b880aae30 con 0x7f2b90133eb0 2024-08-18T21:10:14.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 4 set_mon_vals no callback set 2024-08-18T21:10:14.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:14.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8e7fc640 10 monclient: dump: 2024-08-18T21:10:14.206 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.206 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.206 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.206 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.206 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.206 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.206 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.207 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.207 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.207 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.207 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.207 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.207 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.207 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.207 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.207 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 10 monclient: shutdown 2024-08-18T21:10:14.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:14.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 -- 172.21.15.5:0/3901916386 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b90133eb0 msgr2=0x7f2b90134330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 --2- 172.21.15.5:0/3901916386 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b90133eb0 0x7f2b90134330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2b880098a0 tx=0x7f2b8801c440 comp rx=0 tx=0).stop 2024-08-18T21:10:14.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 -- 172.21.15.5:0/3901916386 shutdown_connections 2024-08-18T21:10:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 --2- 172.21.15.5:0/3901916386 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b90137970 0x7f2b90137dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 --2- 172.21.15.5:0/3901916386 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b90133eb0 0x7f2b90134330 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 --2- 172.21.15.5:0/3901916386 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f2b900a1ff0 0x7f2b90137430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 -- 172.21.15.5:0/3901916386 >> 172.21.15.5:0/3901916386 conn(0x7f2b900a8020 msgr2=0x7f2b900a8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 -- 172.21.15.5:0/3901916386 shutdown_connections 2024-08-18T21:10:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 -- 172.21.15.5:0/3901916386 wait complete. 2024-08-18T21:10:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 10 monclient: build_initial_monmap 2024-08-18T21:10:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 10 monclient: monmap: 2024-08-18T21:10:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:14.209 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 Processor -- start 2024-08-18T21:10:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 -- start start 2024-08-18T21:10:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 10 monclient: init 2024-08-18T21:10:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:14.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 10 monclient: _add_conns ranks=[4,8,6,0,7,1,5,3,2] 2024-08-18T21:10:14.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b900a1ff0 0x7f2b901d1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 10 monclient(hunting): picked mon.noname-c con 0x7f2b900a1ff0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:14.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2b90133eb0 0x7f2b90130a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 10 monclient(hunting): picked mon.noname-e con 0x7f2b90133eb0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:14.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b90137970 0x7f2b9013a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 10 monclient(hunting): picked mon.noname-d con 0x7f2b90137970 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:14.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f2b90141370 con 0x7f2b900a1ff0 2024-08-18T21:10:14.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f2b901411f0 con 0x7f2b90137970 2024-08-18T21:10:14.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f2b901414f0 con 0x7f2b90133eb0 2024-08-18T21:10:14.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:14.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b95ac9640 10 monclient(hunting): authenticate will time out at 1381.210361s 2024-08-18T21:10:14.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b90137970 0x7f2b9013a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8f7fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b900a1ff0 0x7f2b901d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8effd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2b90133eb0 0x7f2b90130a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8f7fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b900a1ff0 0x7f2b901d1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:45088/0 (socket says 172.21.15.5:45088) 2024-08-18T21:10:14.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b90137970 0x7f2b9013a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:58450/0 (socket says 172.21.15.5:58450) 2024-08-18T21:10:14.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8f7fe640 1 -- 172.21.15.5:0/1620907070 learned_addr learned my addr 172.21.15.5:0/1620907070 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:14.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8f7fe640 10 monclient(hunting): get_auth_request con 0x7f2b900a1ff0 auth_method 0 2024-08-18T21:10:14.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 10 monclient(hunting): get_auth_request con 0x7f2b90137970 auth_method 0 2024-08-18T21:10:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8effd640 10 monclient(hunting): get_auth_request con 0x7f2b90133eb0 auth_method 0 2024-08-18T21:10:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 10 monclient(hunting): handle_auth_done global_id 84777 payload 824 2024-08-18T21:10:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 1 -- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2b90133eb0 msgr2=0x7f2b90130a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 1 --2- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2b90133eb0 0x7f2b90130a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 1 -- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b900a1ff0 msgr2=0x7f2b901d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 1 --2- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b900a1ff0 0x7f2b901d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 10 monclient: _finish_hunting 0 2024-08-18T21:10:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 1 monclient: found mon.noname-d 2024-08-18T21:10:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:10:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8ffff640 1 -- 172.21.15.5:0/1620907070 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b90137760 con 0x7f2b90137970 2024-08-18T21:10:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.193+0000 7f2b8f7fe640 1 --2- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2b900a1ff0 0x7f2b901d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:14.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b8ffff640 1 -- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b90137970 msgr2=0x7f2b9013a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b8ffff640 1 --2- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b90137970 0x7f2b9013a670 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2b880ad000 tx=0x7f2b880191e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b87fff640 1 -- 172.21.15.5:0/1620907070 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2b880ba070 con 0x7f2b90137970 2024-08-18T21:10:14.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b87fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:10:14.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b87fff640 10 monclient: dump: 2024-08-18T21:10:14.214 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.214 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.214 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.214 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.214 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.214 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.214 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.215 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b87fff640 10 monclient: _finish_auth 0 2024-08-18T21:10:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b87fff640 10 monclient: _check_auth_tickets 2024-08-18T21:10:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b87fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b95ac9640 5 monclient: authenticate success, global_id 84777 2024-08-18T21:10:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b95ac9640 10 monclient: _renew_subs 2024-08-18T21:10:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b87fff640 1 -- 172.21.15.5:0/1620907070 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b880b1040 con 0x7f2b90137970 2024-08-18T21:10:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b95ac9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b95ac9640 1 -- 172.21.15.5:0/1620907070 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b9013e010 con 0x7f2b90137970 2024-08-18T21:10:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b87fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b87fff640 1 -- 172.21.15.5:0/1620907070 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2b880b0070 con 0x7f2b90137970 2024-08-18T21:10:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b87fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b8dffb640 4 set_mon_vals no callback set 2024-08-18T21:10:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b87fff640 10 monclient: dump: 2024-08-18T21:10:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.218 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b95ac9640 10 monclient: _renew_subs 2024-08-18T21:10:14.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b95ac9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:14.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b95ac9640 1 -- 172.21.15.5:0/1620907070 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b90137230 con 0x7f2b90137970 2024-08-18T21:10:14.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b95ac9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:14.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b95ac9640 1 --2- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b90130fb0 0x7f2b9013abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b95ac9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b95ac9640 1 -- 172.21.15.5:0/1620907070 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f2b90051140 con 0x7f2b90130fb0 2024-08-18T21:10:14.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b8f7fe640 1 --2- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b90130fb0 0x7f2b9013abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b8f7fe640 10 monclient: get_auth_request con 0x7f2b90130fb0 auth_method 0 2024-08-18T21:10:14.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b8f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b8f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b8f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b8f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b8f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b8f7fe640 10 monclient(hunting): handle_auth_done global_id 84611 payload 824 2024-08-18T21:10:14.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b8f7fe640 1 -- 172.21.15.5:0/1620907070 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b90134330 con 0x7f2b90130fb0 2024-08-18T21:10:14.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b87fff640 1 -- 172.21.15.5:0/1620907070 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f2b88004040 con 0x7f2b90137970 2024-08-18T21:10:14.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b87fff640 1 --2- 172.21.15.5:0/1620907070 >> v2:172.21.15.157:6812/631023601 conn(0x7f2b7003bdc0 0x7f2b7003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b87fff640 1 -- 172.21.15.5:0/1620907070 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(182..182 src has 22..182) ==== 3898+0+0 (secure 0 0 0) 0x7f2b880e77b0 con 0x7f2b90137970 2024-08-18T21:10:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b8effd640 1 --2- 172.21.15.5:0/1620907070 >> v2:172.21.15.157:6812/631023601 conn(0x7f2b7003bdc0 0x7f2b7003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.197+0000 7f2b8effd640 10 monclient: get_auth_request con 0x7f2b7003bdc0 auth_method 0 2024-08-18T21:10:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.201+0000 7f2b8f7fe640 1 -- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b90130fb0 msgr2=0x7f2b9013abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.201+0000 7f2b8f7fe640 1 --2- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b90130fb0 0x7f2b9013abb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b78010cb0 tx=0x7f2b7800e5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.201+0000 7f2b87fff640 1 -- 172.21.15.5:0/1620907070 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2b780044a0 con 0x7f2b90130fb0 2024-08-18T21:10:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.201+0000 7f2b87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.201+0000 7f2b87fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.201+0000 7f2b87fff640 10 monclient: dump: 2024-08-18T21:10:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.223 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.223 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.223 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.223 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.223 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.223 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.223 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.223 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.223 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.223 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.223 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.223 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.223 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.224 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.201+0000 7f2b87fff640 1 -- 172.21.15.5:0/1620907070 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2b78004030 con 0x7f2b90130fb0 2024-08-18T21:10:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.201+0000 7f2b87fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.201+0000 7f2b87fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.201+0000 7f2b87fff640 1 -- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b90130fb0 msgr2=0x7f2b9013abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.201+0000 7f2b87fff640 1 --2- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b90130fb0 0x7f2b9013abb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b78010cb0 tx=0x7f2b7800e5a0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.201+0000 7f2b87fff640 1 -- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b90130fb0 msgr2=0x7f2b9013abb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.201+0000 7f2b87fff640 1 --2- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b90130fb0 0x7f2b9013abb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.201+0000 7f2b8effd640 1 --2- 172.21.15.5:0/1620907070 >> v2:172.21.15.157:6812/631023601 conn(0x7f2b7003bdc0 0x7f2b7003e280 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009bd0 tx=0x7f2b8000b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.205+0000 7f2b95ac9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.205+0000 7f2b95ac9640 1 --2- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b9013dbe0 0x7f2b9013b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.205+0000 7f2b95ac9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.205+0000 7f2b95ac9640 1 -- 172.21.15.5:0/1620907070 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f2b901313e0 con 0x7f2b9013dbe0 2024-08-18T21:10:14.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.205+0000 7f2b8f7fe640 1 --2- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b9013dbe0 0x7f2b9013b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b8f7fe640 10 monclient: get_auth_request con 0x7f2b9013dbe0 auth_method 0 2024-08-18T21:10:14.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b8f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b8f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b8f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b8f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b8f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b8f7fe640 10 monclient(hunting): handle_auth_done global_id 84620 payload 824 2024-08-18T21:10:14.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b8f7fe640 1 -- 172.21.15.5:0/1620907070 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2b9006d150 con 0x7f2b9013dbe0 2024-08-18T21:10:14.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b8f7fe640 1 -- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b9013dbe0 msgr2=0x7f2b9013b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b8f7fe640 1 --2- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b9013dbe0 0x7f2b9013b0f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2b78010cb0 tx=0x7f2b780046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b87fff640 1 -- 172.21.15.5:0/1620907070 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2b7802a020 con 0x7f2b9013dbe0 2024-08-18T21:10:14.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b87fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:14.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b87fff640 10 monclient: dump: 2024-08-18T21:10:14.228 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.228 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.229 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.229 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.229 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.229 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.229 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.229 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.229 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.229 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.229 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.230 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.230 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.230 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.230 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.230 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b87fff640 1 -- 172.21.15.5:0/1620907070 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9237 (secure 0 0 0) 0x7f2b78003830 con 0x7f2b9013dbe0 2024-08-18T21:10:14.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b87fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:14.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b87fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:14.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b87fff640 1 -- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b9013dbe0 msgr2=0x7f2b9013b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b87fff640 1 --2- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b9013dbe0 0x7f2b9013b0f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2b78010cb0 tx=0x7f2b780046d0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b87fff640 1 -- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b9013dbe0 msgr2=0x7f2b9013b0f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:14.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b87fff640 1 --2- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b9013dbe0 0x7f2b9013b0f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.231 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:14.231 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:14.231 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:14.232 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:14.232 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 150, 2024-08-18T21:10:14.232 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 111038, 2024-08-18T21:10:14.232 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:14.232 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:14.232 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:14.232 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:14.232 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:14.232 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:14.233 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:14.233 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:14.234 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:14.234 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.234 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:10:14.234 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:14.234 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:14.234 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:14.235 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.235 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.235 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.235 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.235 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.235 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.235 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.235 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.236 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.236 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.236 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.236 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.236 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:14.236 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:14.236 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.236 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.237 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.237 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.237 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.237 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.237 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.237 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.237 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.237 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.238 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.238 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.238 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:14.238 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:14.238 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:14.238 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:14.238 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:14.238 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.241 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:14.241 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.241 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:14.241 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:14.241 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.241 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.241 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.241 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.242 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:14.242 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.242 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.242 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.242 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:14.242 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.242 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.242 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.242 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:14.244 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.244 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.244 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:14.245 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.245 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.245 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.245 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:14.245 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:14.245 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.245 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.245 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.246 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:14.246 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:14.246 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.246 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.246 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.246 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:14.246 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.247 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.247 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:14.247 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.247 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.247 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.248 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:14.248 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:14.248 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.248 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.248 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.248 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:14.248 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.250 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.250 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:14.250 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:14.250 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.250 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.250 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.250 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:14.252 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.252 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.252 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.252 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:14.252 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:14.252 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.252 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.252 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.253 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:14.253 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:14.253 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.253 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.254 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:14.254 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.256 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:14.256 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:14.256 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.256 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.257 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:14.257 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.257 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:14.257 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.257 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.257 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.258 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:14.258 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:14.258 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.258 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.258 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.258 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:14.258 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:14.259 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.259 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.259 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.259 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:14.259 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.261 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.261 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:14.261 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:14.261 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.261 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.262 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:14.262 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.262 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:14.262 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.262 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.262 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.263 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:14.263 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:14.263 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.263 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.263 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.263 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.263 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.263 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:14.263 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:14.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.264 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:14.264 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:14.264 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:14.264 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.264 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.264 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:14.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.264 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:14.264 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:14.264 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:14.264 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.265 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.265 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:14.265 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b95ac9640 1 -- 172.21.15.5:0/1620907070 >> v2:172.21.15.157:6812/631023601 conn(0x7f2b7003bdc0 msgr2=0x7f2b7003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b95ac9640 1 --2- 172.21.15.5:0/1620907070 >> v2:172.21.15.157:6812/631023601 conn(0x7f2b7003bdc0 0x7f2b7003e280 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009bd0 tx=0x7f2b8000b040 comp rx=0 tx=0).stop 2024-08-18T21:10:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b95ac9640 10 monclient: shutdown 2024-08-18T21:10:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b95ac9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b95ac9640 1 -- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b90137970 msgr2=0x7f2b9013a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b95ac9640 1 --2- 172.21.15.5:0/1620907070 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2b90137970 0x7f2b9013a670 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2b880ad000 tx=0x7f2b880191e0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.209+0000 7f2b8ffff640 1 -- 172.21.15.5:0/1620907070 reap_dead start 2024-08-18T21:10:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.213+0000 7f2b8ffff640 1 -- 172.21.15.5:0/1620907070 reap_dead start 2024-08-18T21:10:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.213+0000 7f2b95ac9640 1 -- 172.21.15.5:0/1620907070 shutdown_connections 2024-08-18T21:10:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.213+0000 7f2b95ac9640 1 -- 172.21.15.5:0/1620907070 >> 172.21.15.5:0/1620907070 conn(0x7f2b900a8020 msgr2=0x7f2b900738f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.213+0000 7f2b95ac9640 1 -- 172.21.15.5:0/1620907070 shutdown_connections 2024-08-18T21:10:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.213+0000 7f2b95ac9640 1 -- 172.21.15.5:0/1620907070 wait complete. 2024-08-18T21:10:14.268 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-18T21:10:14.268 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-08-18T21:10:14.269 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:10:14.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.385+0000 7f9dcc1ff640 10 monclient: get_monmap_and_config 2024-08-18T21:10:14.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.385+0000 7f9dcc1ff640 10 monclient: build_initial_monmap 2024-08-18T21:10:14.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.385+0000 7f9dcc1ff640 10 monclient: monmap: 2024-08-18T21:10:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:14.391043+0000 2024-08-18T21:10:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:14.391043+0000 2024-08-18T21:10:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:14.391 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.385+0000 7f9dcc1ff640 1 Processor -- start 2024-08-18T21:10:14.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.385+0000 7f9dcc1ff640 1 -- start start 2024-08-18T21:10:14.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.385+0000 7f9dcc1ff640 10 monclient: init 2024-08-18T21:10:14.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.385+0000 7f9dcc1ff640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:14.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.385+0000 7f9dcc1ff640 10 monclient: _add_conns ranks=[0,5,10,4,1,6,3,9,2,8,7] 2024-08-18T21:10:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dcc1ff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9dc40a6bd0 addr v1:172.21.15.5:6789/0 2024-08-18T21:10:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dcc1ff640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9dc409f080 0x7f9dc413ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dcc1ff640 10 monclient(hunting): picked mon.noname-h con 0x7f9dc409f080 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dcc1ff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9dc40a76c0 0x7f9dc4141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dcc1ff640 10 monclient(hunting): picked mon.noname-f con 0x7f9dc40a76c0 addr v2:172.21.15.157:3300/0 2024-08-18T21:10:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dcc1ff640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dc40a7fb0 con 0x7f9dc40a6bd0 2024-08-18T21:10:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dcc1ff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dcc1ff640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f9dc409e4c0 con 0x7f9dc40a76c0 2024-08-18T21:10:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dcc1ff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dcc1ff640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f9dc406f930 con 0x7f9dc409f080 2024-08-18T21:10:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dcc1ff640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dcc1ff640 10 monclient(hunting): authenticate will time out at 1381.404169s 2024-08-18T21:10:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dca79c640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7f9dc40a76c0 msgr2=0x7f9dc4141330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:10:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc9f9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9dc40a6bd0 0x7f9dc40a6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56412/0 (socket says 172.21.15.5:56412) 2024-08-18T21:10:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc9f9b640 1 -- 172.21.15.5:0/1329887308 learned_addr learned my addr 172.21.15.5:0/1329887308 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:10:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dca79c640 1 --2- 172.21.15.5:0/1329887308 >> v2:172.21.15.157:3300/0 conn(0x7f9dc40a76c0 0x7f9dc4141330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 1 --2- 172.21.15.5:0/1329887308 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9dc409f080 0x7f9dc413ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 10 monclient(hunting): get_auth_request con 0x7f9dc409f080 auth_method 0 2024-08-18T21:10:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 10 monclient(hunting): handle_auth_done global_id 94334 payload 274 2024-08-18T21:10:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 1 -- 172.21.15.5:0/1329887308 >> v2:172.21.15.157:3300/0 conn(0x7f9dc40a76c0 msgr2=0x7f9dc4141330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 1 --2- 172.21.15.5:0/1329887308 >> v2:172.21.15.157:3300/0 conn(0x7f9dc40a76c0 0x7f9dc4141330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 1 -- 172.21.15.5:0/1329887308 >> v1:172.21.15.5:6789/0 conn(0x7f9dc40a6bd0 legacy=0x7f9dc40a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 10 monclient: _finish_hunting 0 2024-08-18T21:10:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 1 monclient: found mon.noname-h 2024-08-18T21:10:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:10:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.389+0000 7f9dc979a640 1 -- 172.21.15.5:0/1329887308 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc409de70 con 0x7f9dc409f080 2024-08-18T21:10:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dc979a640 1 -- 172.21.15.5:0/1329887308 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9dc409f080 msgr2=0x7f9dc413ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dc979a640 1 --2- 172.21.15.5:0/1329887308 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9dc409f080 0x7f9dc413ede0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00097c0 tx=0x7f9dc001c380 comp rx=0 tx=0).ready entity=mon.5 client_cookie=b888c5f7d4d9ec2a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dc8f99640 1 -- 172.21.15.5:0/1329887308 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9dc00b0070 con 0x7f9dc409f080 2024-08-18T21:10:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dc8f99640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dc8f99640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:10:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dc8f99640 10 monclient: dump: 2024-08-18T21:10:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.403 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dc8f99640 10 monclient: _finish_auth 0 2024-08-18T21:10:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dc8f99640 10 monclient: _check_auth_tickets 2024-08-18T21:10:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dc8f99640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dc8f99640 1 -- 172.21.15.5:0/1329887308 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc00aa810 con 0x7f9dc409f080 2024-08-18T21:10:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dcc1ff640 5 monclient: authenticate success, global_id 94334 2024-08-18T21:10:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dcc1ff640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:10:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dc8f99640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dcc1ff640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dc8f99640 1 -- 172.21.15.5:0/1329887308 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9dc00aae30 con 0x7f9dc409f080 2024-08-18T21:10:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dcc1ff640 4 set_mon_vals no callback set 2024-08-18T21:10:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dc8f99640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dc8f99640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:10:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dc8f99640 10 monclient: dump: 2024-08-18T21:10:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.406 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dcc1ff640 10 monclient: shutdown 2024-08-18T21:10:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dcc1ff640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dcc1ff640 1 -- 172.21.15.5:0/1329887308 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9dc409f080 msgr2=0x7f9dc413ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dcc1ff640 1 --2- 172.21.15.5:0/1329887308 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9dc409f080 0x7f9dc413ede0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00097c0 tx=0x7f9dc001c380 comp rx=0 tx=0).stop 2024-08-18T21:10:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dcc1ff640 1 -- 172.21.15.5:0/1329887308 shutdown_connections 2024-08-18T21:10:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dcc1ff640 1 --2- 172.21.15.5:0/1329887308 >> v2:172.21.15.157:3300/0 conn(0x7f9dc40a76c0 0x7f9dc4141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dcc1ff640 1 --2- 172.21.15.5:0/1329887308 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9dc409f080 0x7f9dc413ede0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dcc1ff640 1 -- 172.21.15.5:0/1329887308 >> 172.21.15.5:0/1329887308 conn(0x7f9dc4068700 msgr2=0x7f9dc4068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dcc1ff640 1 -- 172.21.15.5:0/1329887308 shutdown_connections 2024-08-18T21:10:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dcc1ff640 1 -- 172.21.15.5:0/1329887308 wait complete. 2024-08-18T21:10:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dcc1ff640 10 monclient: build_initial_monmap 2024-08-18T21:10:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.393+0000 7f9dcc1ff640 10 monclient: monmap: 2024-08-18T21:10:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:14.408 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 1 Processor -- start 2024-08-18T21:10:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 1 -- start start 2024-08-18T21:10:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 10 monclient: init 2024-08-18T21:10:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 10 monclient: _add_conns ranks=[6,4,7,2,0,5,3,1,8] 2024-08-18T21:10:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9dc409f080 0x7f9dc4126ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 10 monclient(hunting): picked mon.noname-d con 0x7f9dc409f080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc40a6bd0 0x7f9dc4129040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 10 monclient(hunting): picked mon.noname-c con 0x7f9dc40a6bd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9dc40a76c0 0x7f9dc413feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 10 monclient(hunting): picked mon.noname-i con 0x7f9dc40a76c0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f9dc4144210 con 0x7f9dc40a6bd0 2024-08-18T21:10:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f9dc4144090 con 0x7f9dc409f080 2024-08-18T21:10:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f9dc4144390 con 0x7f9dc40a76c0 2024-08-18T21:10:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 10 monclient(hunting): authenticate will time out at 1381.412772s 2024-08-18T21:10:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc9f9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9dc409f080 0x7f9dc4126ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc40a6bd0 0x7f9dc4129040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc9f9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9dc409f080 0x7f9dc4126ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:58458/0 (socket says 172.21.15.5:58458) 2024-08-18T21:10:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc9f9b640 1 -- 172.21.15.5:0/2766758164 learned_addr learned my addr 172.21.15.5:0/2766758164 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 10 monclient(hunting): get_auth_request con 0x7f9dc40a6bd0 auth_method 0 2024-08-18T21:10:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc9f9b640 10 monclient(hunting): get_auth_request con 0x7f9dc409f080 auth_method 0 2024-08-18T21:10:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc9f9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc9f9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc9f9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc9f9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc9f9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc9f9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 10 monclient(hunting): handle_auth_done global_id 6322 payload 824 2024-08-18T21:10:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dca79c640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9dc40a76c0 0x7f9dc413feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 1 -- 172.21.15.5:0/2766758164 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9dc40a76c0 msgr2=0x7f9dc413feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9dc40a76c0 0x7f9dc413feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 1 -- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9dc409f080 msgr2=0x7f9dc4126ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9dc409f080 0x7f9dc4126ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 10 monclient: _finish_hunting 0 2024-08-18T21:10:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 1 monclient: found mon.noname-c 2024-08-18T21:10:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:10:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 1 -- 172.21.15.5:0/2766758164 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc4140b50 con 0x7f9dc40a6bd0 2024-08-18T21:10:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dca79c640 10 monclient: get_auth_request con 0x7f9dc40a76c0 auth_method 0 2024-08-18T21:10:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dca79c640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9dc40a76c0 0x7f9dc413feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:10:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 1 -- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc40a6bd0 msgr2=0x7f9dc4129040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dc979a640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc40a6bd0 0x7f9dc4129040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00ad000 tx=0x7f9dc0019120 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dba7fc640 1 -- 172.21.15.5:0/2766758164 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9dc00b8020 con 0x7f9dc40a6bd0 2024-08-18T21:10:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dba7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:10:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dba7fc640 10 monclient: dump: 2024-08-18T21:10:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.419 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dba7fc640 10 monclient: _finish_auth 0 2024-08-18T21:10:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dba7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:10:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dba7fc640 1 -- 172.21.15.5:0/2766758164 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc00044b0 con 0x7f9dc40a6bd0 2024-08-18T21:10:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dba7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dba7fc640 1 -- 172.21.15.5:0/2766758164 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9dc00b0040 con 0x7f9dc40a6bd0 2024-08-18T21:10:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 5 monclient: authenticate success, global_id 6322 2024-08-18T21:10:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 10 monclient: _renew_subs 2024-08-18T21:10:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:10:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 1 -- 172.21.15.5:0/2766758164 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc40a33c0 con 0x7f9dc40a6bd0 2024-08-18T21:10:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dba7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dba7fc640 10 monclient: dump: 2024-08-18T21:10:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.421 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dbb7fe640 4 set_mon_vals no callback set 2024-08-18T21:10:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 10 monclient: _renew_subs 2024-08-18T21:10:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:10:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.397+0000 7f9dcc1ff640 1 -- 172.21.15.5:0/2766758164 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc4129fa0 con 0x7f9dc40a6bd0 2024-08-18T21:10:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dcc1ff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dcc1ff640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc41403f0 0x7f9dc41d1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dcc1ff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dcc1ff640 1 -- 172.21.15.5:0/2766758164 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f9dc4051140 con 0x7f9dc41403f0 2024-08-18T21:10:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dc9f9b640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc41403f0 0x7f9dc41d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dc9f9b640 10 monclient: get_auth_request con 0x7f9dc41403f0 auth_method 0 2024-08-18T21:10:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dc9f9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dc9f9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dc9f9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dc9f9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dc9f9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dc9f9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dba7fc640 1 -- 172.21.15.5:0/2766758164 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f9dc00bb070 con 0x7f9dc40a6bd0 2024-08-18T21:10:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dc9f9b640 10 monclient(hunting): handle_auth_done global_id 6331 payload 824 2024-08-18T21:10:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dc9f9b640 1 -- 172.21.15.5:0/2766758164 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9dc412a3a0 con 0x7f9dc41403f0 2024-08-18T21:10:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dba7fc640 1 --2- 172.21.15.5:0/2766758164 >> v2:172.21.15.157:6812/631023601 conn(0x7f9da803bdb0 0x7f9da803e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dba7fc640 1 -- 172.21.15.5:0/2766758164 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(182..182 src has 22..182) ==== 3898+0+0 (secure 0 0 0) 0x7f9dc00e7970 con 0x7f9dc40a6bd0 2024-08-18T21:10:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dca79c640 1 --2- 172.21.15.5:0/2766758164 >> v2:172.21.15.157:6812/631023601 conn(0x7f9da803bdb0 0x7f9da803e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dca79c640 10 monclient: get_auth_request con 0x7f9da803bdb0 auth_method 0 2024-08-18T21:10:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dc9f9b640 1 -- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc41403f0 msgr2=0x7f9dc41d1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dc9f9b640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc41403f0 0x7f9dc41d1380 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9db400eaa0 tx=0x7f9db400ef60 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dba7fc640 1 -- 172.21.15.5:0/2766758164 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9db400cc40 con 0x7f9dc41403f0 2024-08-18T21:10:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dba7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dba7fc640 10 monclient: dump: 2024-08-18T21:10:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.425 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dba7fc640 1 -- 172.21.15.5:0/2766758164 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9db4019070 con 0x7f9dc41403f0 2024-08-18T21:10:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dba7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dba7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dba7fc640 1 -- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc41403f0 msgr2=0x7f9dc41d1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dba7fc640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc41403f0 0x7f9dc41d1380 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9db400eaa0 tx=0x7f9db400ef60 comp rx=0 tx=0).stop 2024-08-18T21:10:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dba7fc640 1 -- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc41403f0 msgr2=0x7f9dc41d1380 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:14.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.401+0000 7f9dba7fc640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc41403f0 0x7f9dc41d1380 secure :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9db400eaa0 tx=0x7f9db400ef60 comp rx=0 tx=0).stop 2024-08-18T21:10:14.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.405+0000 7f9dca79c640 1 --2- 172.21.15.5:0/2766758164 >> v2:172.21.15.157:6812/631023601 conn(0x7f9da803bdb0 0x7f9da803e270 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc003cc0 tx=0x7f9dbc0072e0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.409+0000 7f9dcc1ff640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:14.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.409+0000 7f9dcc1ff640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc41d18c0 0x7f9dc41d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.409+0000 7f9dcc1ff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.409+0000 7f9dcc1ff640 1 -- 172.21.15.5:0/2766758164 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f9dc41d21e0 con 0x7f9dc41d18c0 2024-08-18T21:10:14.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.409+0000 7f9dc9f9b640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc41d18c0 0x7f9dc41d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.409+0000 7f9dc9f9b640 10 monclient: get_auth_request con 0x7f9dc41d18c0 auth_method 0 2024-08-18T21:10:14.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.409+0000 7f9dc9f9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.409+0000 7f9dc9f9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.409+0000 7f9dc9f9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.409+0000 7f9dc9f9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.409+0000 7f9dc9f9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.409+0000 7f9dc9f9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.409+0000 7f9dc9f9b640 10 monclient(hunting): handle_auth_done global_id 6340 payload 824 2024-08-18T21:10:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.409+0000 7f9dc9f9b640 1 -- 172.21.15.5:0/2766758164 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9dc40a6fb0 con 0x7f9dc41d18c0 2024-08-18T21:10:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dc9f9b640 1 -- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc41d18c0 msgr2=0x7f9dc41d1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dc9f9b640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc41d18c0 0x7f9dc41d1ca0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9db4018000 tx=0x7f9db4004950 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dba7fc640 1 -- 172.21.15.5:0/2766758164 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9db40148f0 con 0x7f9dc41d18c0 2024-08-18T21:10:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dba7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dba7fc640 10 monclient: dump: 2024-08-18T21:10:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.428 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dba7fc640 1 -- 172.21.15.5:0/2766758164 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9404 (secure 0 0 0) 0x7f9db4014480 con 0x7f9dc41d18c0 2024-08-18T21:10:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dba7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dba7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dba7fc640 1 -- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc41d18c0 msgr2=0x7f9dc41d1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dba7fc640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc41d18c0 0x7f9dc41d1ca0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9db4018000 tx=0x7f9db4004950 comp rx=0 tx=0).stop 2024-08-18T21:10:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dba7fc640 1 -- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc41d18c0 msgr2=0x7f9dc41d1ca0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dba7fc640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc41d18c0 0x7f9dc41d1ca0 secure :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9db4018000 tx=0x7f9db4004950 comp rx=0 tx=0).stop 2024-08-18T21:10:14.429 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:14.429 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:14.430 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:14.430 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:14.430 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 150, 2024-08-18T21:10:14.430 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 423531, 2024-08-18T21:10:14.430 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:14.430 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:14.430 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:14.430 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:14.430 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:14.430 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:14.430 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:14.430 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:14.431 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:14.431 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.431 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:10:14.431 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:14.431 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:14.431 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:14.431 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.431 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.431 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.431 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.431 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.431 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.431 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.432 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.432 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.432 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.432 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.432 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.432 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:14.432 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:14.432 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.432 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.432 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.432 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.432 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.433 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.433 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.433 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.433 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.433 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.433 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.433 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.433 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:14.433 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:14.433 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:14.433 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:14.433 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:14.434 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:14.434 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:14.434 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:14.434 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:14.434 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:14.434 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:14.434 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:14.434 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:14.434 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:14.434 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:14.434 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:14.434 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:14.434 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.435 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.435 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.435 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.435 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.435 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.435 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.435 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.435 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.435 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.435 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.435 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.435 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:14.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.436 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:14.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.436 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:14.436 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:14.436 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.436 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.436 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.436 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:14.436 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.437 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.437 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:14.437 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.437 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.437 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.437 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:14.437 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:14.437 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.437 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.437 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.437 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.438 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:14.438 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:14.438 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.438 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.438 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.438 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:14.438 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.438 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.438 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:14.438 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.439 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.439 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.439 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:14.439 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:14.439 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.439 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.439 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.439 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.439 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:14.439 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:14.439 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.440 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.440 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:14.440 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.440 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:14.440 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.440 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.440 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.441 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:14.441 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:14.441 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.441 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.441 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.441 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:14.441 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:14.441 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.441 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.441 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.442 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:14.442 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.442 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.442 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:14.442 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.442 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.442 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.442 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:14.442 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:14.442 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.443 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.443 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.443 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:14.443 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:14.443 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.443 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.443 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:14.443 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.444 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.444 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:14.444 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.444 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.444 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.444 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:14.444 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:14.444 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.444 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.444 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.445 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:14.445 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:14.445 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.445 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.445 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:14.445 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.445 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:14.445 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.445 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.446 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.446 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:14.446 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:14.446 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.446 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.446 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.446 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:14.446 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:14.446 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.446 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.447 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.447 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:14.447 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.447 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.447 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:14.447 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.447 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.447 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:14.447 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:14.448 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.448 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.448 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.448 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:14.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:14.448 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.448 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.448 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:14.448 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.449 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.449 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:14.449 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.449 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.449 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.449 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:14.449 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:14.449 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.449 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.449 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.450 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:14.450 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:14.450 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:14.450 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:14.451 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.451 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.451 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.451 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:14.451 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:14.451 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.451 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.451 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.451 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.451 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.451 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:14.452 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:14.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.452 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:14.452 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:14.452 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:14.452 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.452 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.452 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:10:14.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.452 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:14.452 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:14.452 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:10:14.452 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.452 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.453 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:14.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.453 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:14.453 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:14.453 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:10:14.453 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.453 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.453 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:14.453 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dcc1ff640 1 -- 172.21.15.5:0/2766758164 >> v2:172.21.15.157:6812/631023601 conn(0x7f9da803bdb0 msgr2=0x7f9da803e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dcc1ff640 1 --2- 172.21.15.5:0/2766758164 >> v2:172.21.15.157:6812/631023601 conn(0x7f9da803bdb0 0x7f9da803e270 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc003cc0 tx=0x7f9dbc0072e0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dcc1ff640 10 monclient: shutdown 2024-08-18T21:10:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dcc1ff640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dcc1ff640 1 -- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc40a6bd0 msgr2=0x7f9dc4129040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dcc1ff640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc40a6bd0 0x7f9dc4129040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00ad000 tx=0x7f9dc0019120 comp rx=0 tx=0).stop 2024-08-18T21:10:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dca79c640 1 -- 172.21.15.5:0/2766758164 reap_dead start 2024-08-18T21:10:14.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dcc1ff640 1 -- 172.21.15.5:0/2766758164 shutdown_connections 2024-08-18T21:10:14.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dcc1ff640 1 --2- 172.21.15.5:0/2766758164 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9dc40a6bd0 0x7f9dc4129040 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dcc1ff640 1 -- 172.21.15.5:0/2766758164 >> 172.21.15.5:0/2766758164 conn(0x7f9dc4068700 msgr2=0x7f9dc40a5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:14.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dcc1ff640 1 -- 172.21.15.5:0/2766758164 shutdown_connections 2024-08-18T21:10:14.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.413+0000 7f9dcc1ff640 1 -- 172.21.15.5:0/2766758164 wait complete. 2024-08-18T21:10:14.456 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-18T21:10:14.456 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon d 2024-08-18T21:10:14.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:10:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 10 monclient: get_monmap_and_config 2024-08-18T21:10:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 10 monclient: build_initial_monmap 2024-08-18T21:10:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 10 monclient: monmap: 2024-08-18T21:10:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:14.589401+0000 2024-08-18T21:10:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:14.589401+0000 2024-08-18T21:10:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:14.590 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 1 Processor -- start 2024-08-18T21:10:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 1 -- start start 2024-08-18T21:10:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 10 monclient: init 2024-08-18T21:10:14.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:14.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 10 monclient: _add_conns ranks=[1,0,8,5,10,2,7,4,9,6,3] 2024-08-18T21:10:14.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f91e00a6bd0 addr v1:172.21.15.157:6789/0 2024-08-18T21:10:14.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f91e009f080 addr v1:172.21.15.5:6789/0 2024-08-18T21:10:14.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f91e00a76c0 0x7f91e0142510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 10 monclient(hunting): picked mon.noname-e con 0x7f91e00a76c0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:14.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e00a7fb0 con 0x7f91e009f080 2024-08-18T21:10:14.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e009de70 con 0x7f91e00a6bd0 2024-08-18T21:10:14.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f91e009e4c0 con 0x7f91e00a76c0 2024-08-18T21:10:14.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:14.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e6730640 10 monclient(hunting): authenticate will time out at 1381.602201s 2024-08-18T21:10:14.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91d7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f91e009f080 0x7f91e013ede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56424/0 (socket says 172.21.15.5:56424) 2024-08-18T21:10:14.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91d7fff640 1 -- 172.21.15.5:0/1253386741 learned_addr learned my addr 172.21.15.5:0/1253386741 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:10:14.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91dffff640 1 -- 172.21.15.5:0/1253386741 >> v1:172.21.15.157:6789/0 conn(0x7f91e00a6bd0 legacy=0x7f91e00a6fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:10:14.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e4ccd640 1 --2- 172.21.15.5:0/1253386741 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f91e00a76c0 0x7f91e0142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91df7fe640 1 -- 172.21.15.5:0/1253386741 DispatchQueue::entry inject delay of 0.002000 2024-08-18T21:10:14.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e4ccd640 10 monclient(hunting): get_auth_request con 0x7f91e00a76c0 auth_method 0 2024-08-18T21:10:14.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e4ccd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e4ccd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e4ccd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e4ccd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e4ccd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e4ccd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e4ccd640 10 monclient(hunting): handle_auth_done global_id 55322 payload 274 2024-08-18T21:10:14.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e4ccd640 1 -- 172.21.15.5:0/1253386741 >> v1:172.21.15.157:6789/0 conn(0x7f91e00a6bd0 legacy=0x7f91e00a6fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:14.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e4ccd640 1 -- 172.21.15.5:0/1253386741 >> v1:172.21.15.5:6789/0 conn(0x7f91e009f080 legacy=0x7f91e013ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:14.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e4ccd640 10 monclient: _finish_hunting 0 2024-08-18T21:10:14.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e4ccd640 1 monclient: found mon.noname-e 2024-08-18T21:10:14.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e4ccd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:14.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e4ccd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:10:14.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.585+0000 7f91e4ccd640 1 -- 172.21.15.5:0/1253386741 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e006f280 con 0x7f91e00a76c0 2024-08-18T21:10:14.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91e4ccd640 1 -- 172.21.15.5:0/1253386741 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f91e00a76c0 msgr2=0x7f91e0142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91e4ccd640 1 --2- 172.21.15.5:0/1253386741 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f91e00a76c0 0x7f91e0142510 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009dc0 tx=0x7f91d801c7f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=5dd543ed41699200 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91df7fe640 1 -- 172.21.15.5:0/1253386741 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91d80ac070 con 0x7f91e00a76c0 2024-08-18T21:10:14.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91df7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:10:14.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91df7fe640 10 monclient: dump: 2024-08-18T21:10:14.599 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.599 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.599 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.599 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.599 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.599 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.599 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.599 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.599 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.599 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.599 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.600 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.600 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.600 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.600 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.600 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91df7fe640 10 monclient: _finish_auth 0 2024-08-18T21:10:14.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91df7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:10:14.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91df7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91df7fe640 1 -- 172.21.15.5:0/1253386741 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d80a6970 con 0x7f91e00a76c0 2024-08-18T21:10:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91df7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91df7fe640 1 -- 172.21.15.5:0/1253386741 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91d80a7400 con 0x7f91e00a76c0 2024-08-18T21:10:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91e6730640 5 monclient: authenticate success, global_id 55322 2024-08-18T21:10:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91e6730640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91e6730640 4 set_mon_vals no callback set 2024-08-18T21:10:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91df7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:10:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91df7fe640 10 monclient: dump: 2024-08-18T21:10:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.602 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.602 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.602 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.602 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.602 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.602 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.602 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.602 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.602 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.602 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.602 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.602 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91e6730640 10 monclient: shutdown 2024-08-18T21:10:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91e6730640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91e6730640 1 -- 172.21.15.5:0/1253386741 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f91e00a76c0 msgr2=0x7f91e0142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91e6730640 1 --2- 172.21.15.5:0/1253386741 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f91e00a76c0 0x7f91e0142510 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009dc0 tx=0x7f91d801c7f0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91e6730640 1 -- 172.21.15.5:0/1253386741 shutdown_connections 2024-08-18T21:10:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91e6730640 1 --2- 172.21.15.5:0/1253386741 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f91e00a76c0 0x7f91e0142510 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91e6730640 1 -- 172.21.15.5:0/1253386741 >> 172.21.15.5:0/1253386741 conn(0x7f91e0068700 msgr2=0x7f91e0068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91e6730640 1 -- 172.21.15.5:0/1253386741 shutdown_connections 2024-08-18T21:10:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.589+0000 7f91e6730640 1 -- 172.21.15.5:0/1253386741 wait complete. 2024-08-18T21:10:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 10 monclient: build_initial_monmap 2024-08-18T21:10:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 10 monclient: monmap: 2024-08-18T21:10:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:14.604 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:14.604 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:14.604 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:14.604 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:14.604 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.604 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:14.604 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:14.604 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:14.604 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:14.604 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:14.605 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:14.605 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:14.605 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:14.605 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:14.605 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 1 Processor -- start 2024-08-18T21:10:14.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 1 -- start start 2024-08-18T21:10:14.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 10 monclient: init 2024-08-18T21:10:14.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:14.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 10 monclient: _add_conns ranks=[2,6,4,3,0,1,5,7,8] 2024-08-18T21:10:14.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f91e009f080 0x7f91e0128e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 10 monclient(hunting): picked mon.noname-b con 0x7f91e009f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:14.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e00a6bd0 0x7f91e0140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 10 monclient(hunting): picked mon.noname-d con 0x7f91e00a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:14.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f91e00a76c0 0x7f91e0126800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 10 monclient(hunting): picked mon.noname-c con 0x7f91e00a76c0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:14.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f91e0145a10 con 0x7f91e009f080 2024-08-18T21:10:14.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f91e0145890 con 0x7f91e00a76c0 2024-08-18T21:10:14.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f91e0145b90 con 0x7f91e00a6bd0 2024-08-18T21:10:14.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:14.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e6730640 10 monclient(hunting): authenticate will time out at 1381.609487s 2024-08-18T21:10:14.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f91e009f080 0x7f91e0128e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e4ccd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f91e00a76c0 0x7f91e0126800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f91e009f080 0x7f91e0128e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33142/0 (socket says 172.21.15.5:33142) 2024-08-18T21:10:14.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 1 -- 172.21.15.5:0/1529511822 learned_addr learned my addr 172.21.15.5:0/1529511822 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:14.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 10 monclient(hunting): get_auth_request con 0x7f91e009f080 auth_method 0 2024-08-18T21:10:14.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e4ccd640 10 monclient(hunting): get_auth_request con 0x7f91e00a76c0 auth_method 0 2024-08-18T21:10:14.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e4ccd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e4ccd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e4ccd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91d7fff640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e00a6bd0 0x7f91e0140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91d7fff640 10 monclient(hunting): get_auth_request con 0x7f91e00a6bd0 auth_method 0 2024-08-18T21:10:14.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91d7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e4ccd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e4ccd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e4ccd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 10 monclient(hunting): handle_auth_done global_id 84629 payload 824 2024-08-18T21:10:14.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 1 -- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e00a6bd0 msgr2=0x7f91e0140cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e00a6bd0 0x7f91e0140cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 1 -- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f91e00a76c0 msgr2=0x7f91e0126800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f91e00a76c0 0x7f91e0126800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 10 monclient: _finish_hunting 0 2024-08-18T21:10:14.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 1 monclient: found mon.noname-b 2024-08-18T21:10:14.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:14.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:10:14.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91dffff640 1 -- 172.21.15.5:0/1529511822 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e01297e0 con 0x7f91e009f080 2024-08-18T21:10:14.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91e4ccd640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f91e00a76c0 0x7f91e0126800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:14.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.593+0000 7f91d7fff640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e00a6bd0 0x7f91e0140cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:14.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dffff640 1 -- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f91e009f080 msgr2=0x7f91e0128e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dffff640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f91e009f080 0x7f91e0128e50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f91d000b4e0 tx=0x7f91d000b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dd7fa640 1 -- 172.21.15.5:0/1529511822 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91d00092f0 con 0x7f91e009f080 2024-08-18T21:10:14.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dd7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:10:14.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dd7fa640 10 monclient: dump: 2024-08-18T21:10:14.615 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.615 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.615 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.615 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.615 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.616 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dd7fa640 10 monclient: _finish_auth 0 2024-08-18T21:10:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dd7fa640 10 monclient: _check_auth_tickets 2024-08-18T21:10:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dd7fa640 1 -- 172.21.15.5:0/1529511822 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d0015070 con 0x7f91e009f080 2024-08-18T21:10:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dd7fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dd7fa640 1 -- 172.21.15.5:0/1529511822 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91d0003d90 con 0x7f91e009f080 2024-08-18T21:10:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dd7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dd7fa640 10 monclient: dump: 2024-08-18T21:10:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.618 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91de7fc640 4 set_mon_vals no callback set 2024-08-18T21:10:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91e6730640 5 monclient: authenticate success, global_id 84629 2024-08-18T21:10:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91e6730640 10 monclient: _renew_subs 2024-08-18T21:10:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91e6730640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:10:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91e6730640 1 -- 172.21.15.5:0/1529511822 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e012a650 con 0x7f91e009f080 2024-08-18T21:10:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91e6730640 10 monclient: _renew_subs 2024-08-18T21:10:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91e6730640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:10:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91e6730640 1 -- 172.21.15.5:0/1529511822 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e00abaa0 con 0x7f91e009f080 2024-08-18T21:10:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91e6730640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91e6730640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e0126d40 0x7f91e0127120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91e6730640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91e6730640 1 -- 172.21.15.5:0/1529511822 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f91e0051140 con 0x7f91e0126d40 2024-08-18T21:10:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91d7fff640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e0126d40 0x7f91e0127120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91d7fff640 10 monclient: get_auth_request con 0x7f91e0126d40 auth_method 0 2024-08-18T21:10:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91d7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dd7fa640 1 -- 172.21.15.5:0/1529511822 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f91d0005070 con 0x7f91e009f080 2024-08-18T21:10:14.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91d7fff640 10 monclient(hunting): handle_auth_done global_id 84804 payload 824 2024-08-18T21:10:14.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dd7fa640 1 --2- 172.21.15.5:0/1529511822 >> v2:172.21.15.157:6812/631023601 conn(0x7f91c003bdc0 0x7f91c003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91d7fff640 1 -- 172.21.15.5:0/1529511822 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91e0127660 con 0x7f91e0126d40 2024-08-18T21:10:14.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91dd7fa640 1 -- 172.21.15.5:0/1529511822 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(183..183 src has 22..183) ==== 3898+0+0 (secure 0 0 0) 0x7f91d004e3d0 con 0x7f91e009f080 2024-08-18T21:10:14.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91e4ccd640 1 --2- 172.21.15.5:0/1529511822 >> v2:172.21.15.157:6812/631023601 conn(0x7f91c003bdc0 0x7f91c003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.597+0000 7f91e4ccd640 10 monclient: get_auth_request con 0x7f91c003bdc0 auth_method 0 2024-08-18T21:10:14.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.601+0000 7f91d7fff640 1 -- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e0126d40 msgr2=0x7f91e0127120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.601+0000 7f91d7fff640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e0126d40 0x7f91e0127120 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f91c8007270 tx=0x7f91c8007730 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.601+0000 7f91dd7fa640 1 -- 172.21.15.5:0/1529511822 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91c8005d30 con 0x7f91e0126d40 2024-08-18T21:10:14.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.601+0000 7f91dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.601+0000 7f91dd7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:14.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.601+0000 7f91dd7fa640 10 monclient: dump: 2024-08-18T21:10:14.621 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.621 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.621 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.621 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.621 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.621 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.621 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.621 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.622 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.622 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.622 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.622 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.622 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.622 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.622 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.622 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.601+0000 7f91dd7fa640 1 -- 172.21.15.5:0/1529511822 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f91c800fce0 con 0x7f91e0126d40 2024-08-18T21:10:14.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.601+0000 7f91dd7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:14.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.601+0000 7f91dd7fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:14.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.601+0000 7f91dd7fa640 1 -- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e0126d40 msgr2=0x7f91e0127120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.601+0000 7f91dd7fa640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e0126d40 0x7f91e0127120 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f91c8007270 tx=0x7f91c8007730 comp rx=0 tx=0).stop 2024-08-18T21:10:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.601+0000 7f91dd7fa640 1 -- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e0126d40 msgr2=0x7f91e0127120 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.601+0000 7f91dd7fa640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e0126d40 0x7f91e0127120 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f91c8007270 tx=0x7f91c8007730 comp rx=0 tx=0).stop 2024-08-18T21:10:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.601+0000 7f91e4ccd640 1 --2- 172.21.15.5:0/1529511822 >> v2:172.21.15.157:6812/631023601 conn(0x7f91c003bdc0 0x7f91c003e280 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f91d80ae000 tx=0x7f91d80a7000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.605+0000 7f91e6730640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.605+0000 7f91e6730640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e0122820 0x7f91e0122c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.605+0000 7f91e6730640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.605+0000 7f91e6730640 1 -- 172.21.15.5:0/1529511822 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f91e00a6fb0 con 0x7f91e0122820 2024-08-18T21:10:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.605+0000 7f91d7fff640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e0122820 0x7f91e0122c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.605+0000 7f91d7fff640 10 monclient: get_auth_request con 0x7f91e0122820 auth_method 0 2024-08-18T21:10:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.605+0000 7f91d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.605+0000 7f91d7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.605+0000 7f91d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.605+0000 7f91d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.605+0000 7f91d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.605+0000 7f91d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.605+0000 7f91d7fff640 10 monclient(hunting): handle_auth_done global_id 84813 payload 824 2024-08-18T21:10:14.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.605+0000 7f91d7fff640 1 -- 172.21.15.5:0/1529511822 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f91e00746d0 con 0x7f91e0122820 2024-08-18T21:10:14.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91d7fff640 1 -- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e0122820 msgr2=0x7f91e0122c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91d7fff640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e0122820 0x7f91e0122c00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f91c8007270 tx=0x7f91c8004950 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91dd7fa640 1 -- 172.21.15.5:0/1529511822 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91c801ee40 con 0x7f91e0122820 2024-08-18T21:10:14.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91dd7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:14.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91dd7fa640 10 monclient: dump: 2024-08-18T21:10:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.626 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91dd7fa640 1 -- 172.21.15.5:0/1529511822 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9404 (secure 0 0 0) 0x7f91c8006240 con 0x7f91e0122820 2024-08-18T21:10:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91dd7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91dd7fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91dd7fa640 1 -- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e0122820 msgr2=0x7f91e0122c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91dd7fa640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e0122820 0x7f91e0122c00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f91c8007270 tx=0x7f91c8004950 comp rx=0 tx=0).stop 2024-08-18T21:10:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91dd7fa640 1 -- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e0122820 msgr2=0x7f91e0122c00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91dd7fa640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f91e0122820 0x7f91e0122c00 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f91c8007270 tx=0x7f91c8004950 comp rx=0 tx=0).stop 2024-08-18T21:10:14.627 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:14.627 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:14.627 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:14.627 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:14.627 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 150, 2024-08-18T21:10:14.627 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 111438, 2024-08-18T21:10:14.627 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:14.627 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:14.627 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:14.627 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:14.627 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:14.628 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:14.628 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:14.628 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:14.628 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:14.628 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.628 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:10:14.628 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:14.628 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:14.628 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:14.628 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.628 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.628 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.628 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.628 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.629 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.629 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.629 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.629 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.629 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.629 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.629 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.629 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:14.629 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:14.629 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.629 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.629 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.630 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.630 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.630 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.630 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.630 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.630 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.630 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.630 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.630 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.631 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:14.631 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:14.631 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:14.631 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:14.631 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:14.631 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:14.631 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:14.631 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:14.631 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:14.631 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:14.631 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:14.632 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:14.632 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:14.632 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:14.632 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:14.632 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:14.632 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:14.632 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.632 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.632 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.632 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.632 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.632 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.633 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.633 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.633 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.633 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.633 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.633 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.633 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:14.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.633 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:14.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.633 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:14.633 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:14.633 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.634 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.634 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.634 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:14.634 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.634 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.634 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:14.634 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.634 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.634 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.635 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:14.635 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:14.635 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.635 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.635 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.635 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:14.635 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:14.635 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.635 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.635 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.635 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:14.636 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.636 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.636 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:14.636 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.636 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.636 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.636 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:14.636 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:14.636 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.636 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.637 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.637 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:14.637 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:14.637 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.637 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.637 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.637 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:14.638 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.638 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.638 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:14.638 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.638 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.638 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.639 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:14.639 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:14.639 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.639 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.639 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.639 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:14.639 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:14.639 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.639 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.639 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.640 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:14.640 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.640 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.640 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:14.640 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.640 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.640 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.640 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:14.640 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:14.640 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.640 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.641 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.641 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:14.641 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:14.641 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.641 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.641 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.641 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:14.641 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.641 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.642 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:14.642 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.642 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.642 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.642 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:14.642 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:14.642 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.642 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.642 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.642 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:14.643 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:14.643 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.643 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.643 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.643 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.643 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:14.643 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.643 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.643 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.643 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:14.643 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.643 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.644 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.644 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:14.644 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:14.644 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.644 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.644 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.644 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:14.644 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:14.644 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.644 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.645 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.645 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:14.645 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.645 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.645 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.645 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:14.645 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.645 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.645 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.645 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:14.645 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:14.645 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.645 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.646 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.646 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:14.646 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:14.646 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.646 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.646 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.646 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:14.646 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.647 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.647 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:14.647 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.647 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.647 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.647 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:14.647 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:14.647 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.647 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.647 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.647 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.647 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:14.648 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:14.648 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.648 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.648 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.648 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:14.648 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.648 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.648 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:14.648 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.648 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.649 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.649 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:14.649 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:14.649 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.649 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.649 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.649 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.649 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.649 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:14.649 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:14.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.649 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:14.650 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:14.650 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:14.650 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.650 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.650 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:10:14.650 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.650 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:14.650 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:14.650 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:14.650 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.650 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.650 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:14.650 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.651 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:14.651 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:14.651 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:14.651 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.651 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.651 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:14.651 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91e6730640 1 -- 172.21.15.5:0/1529511822 >> v2:172.21.15.157:6812/631023601 conn(0x7f91c003bdc0 msgr2=0x7f91c003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91e6730640 1 --2- 172.21.15.5:0/1529511822 >> v2:172.21.15.157:6812/631023601 conn(0x7f91c003bdc0 0x7f91c003e280 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f91d80ae000 tx=0x7f91d80a7000 comp rx=0 tx=0).stop 2024-08-18T21:10:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91e6730640 10 monclient: shutdown 2024-08-18T21:10:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91e6730640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91e6730640 1 -- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f91e009f080 msgr2=0x7f91e0128e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91e6730640 1 --2- 172.21.15.5:0/1529511822 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f91e009f080 0x7f91e0128e50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f91d000b4e0 tx=0x7f91d000b9a0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91e4ccd640 1 -- 172.21.15.5:0/1529511822 reap_dead start 2024-08-18T21:10:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91e4ccd640 1 -- 172.21.15.5:0/1529511822 reap_dead start 2024-08-18T21:10:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91e6730640 1 -- 172.21.15.5:0/1529511822 shutdown_connections 2024-08-18T21:10:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91e6730640 1 -- 172.21.15.5:0/1529511822 >> 172.21.15.5:0/1529511822 conn(0x7f91e0068700 msgr2=0x7f91e00a20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91e6730640 1 -- 172.21.15.5:0/1529511822 shutdown_connections 2024-08-18T21:10:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.609+0000 7f91e6730640 1 -- 172.21.15.5:0/1529511822 wait complete. 2024-08-18T21:10:14.654 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-18T21:10:14.654 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon e 2024-08-18T21:10:14.654 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:10:14.736 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:14.736 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30398]: starting. 2024-08-18T21:10:14.736 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30398]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30363 2024-08-18T21:10:14.736 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30398]: created object 0... 2024-08-18T21:10:14.736 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30398]: created object 25... 2024-08-18T21:10:14.737 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30398]: created object 49... 2024-08-18T21:10:14.737 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30398]: finishing. 2024-08-18T21:10:14.737 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30398]: shutting down. 2024-08-18T21:10:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 10 monclient: get_monmap_and_config 2024-08-18T21:10:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 10 monclient: build_initial_monmap 2024-08-18T21:10:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 10 monclient: monmap: 2024-08-18T21:10:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:14.776673+0000 2024-08-18T21:10:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:14.776673+0000 2024-08-18T21:10:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:14.776 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:14.776 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:14.776 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:14.776 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:14.776 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:14.776 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:14.776 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:14.776 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:14.776 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:14.776 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:14.776 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 1 Processor -- start 2024-08-18T21:10:14.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 1 -- start start 2024-08-18T21:10:14.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 10 monclient: init 2024-08-18T21:10:14.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:14.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 10 monclient: _add_conns ranks=[9,1,5,8,4,10,3,7,2,0,6] 2024-08-18T21:10:14.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff0940a6bd0 0x7ff0940a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 10 monclient(hunting): picked mon.noname-a con 0x7ff0940a6bd0 addr v2:172.21.15.5:3300/0 2024-08-18T21:10:14.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7ff09409f080 addr v1:172.21.15.157:6789/0 2024-08-18T21:10:14.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff0940a74f0 0x7ff09413a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 10 monclient(hunting): picked mon.noname-h con 0x7ff0940a74f0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:14.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0940a7fb0 con 0x7ff09409f080 2024-08-18T21:10:14.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff09409e4c0 con 0x7ff0940a6bd0 2024-08-18T21:10:14.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7ff09406f930 con 0x7ff0940a74f0 2024-08-18T21:10:14.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:14.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09baed640 10 monclient(hunting): authenticate will time out at 1381.789513s 2024-08-18T21:10:14.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff0940a6bd0 0x7ff0940a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff0940a6bd0 0x7ff0940a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40264/0 (socket says 172.21.15.5:40264) 2024-08-18T21:10:14.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 1 -- 172.21.15.5:0/101378106 learned_addr learned my addr 172.21.15.5:0/101378106 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:14.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 10 monclient(hunting): get_auth_request con 0x7ff0940a6bd0 auth_method 0 2024-08-18T21:10:14.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099088640 1 -- 172.21.15.5:0/101378106 >> v1:172.21.15.157:6789/0 conn(0x7ff09409f080 legacy=0x7ff094139990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:10:14.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09a08a640 1 --2- 172.21.15.5:0/101378106 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff0940a74f0 0x7ff09413a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 10 monclient(hunting): handle_auth_done global_id 84582 payload 274 2024-08-18T21:10:14.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 1 -- 172.21.15.5:0/101378106 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff0940a74f0 msgr2=0x7ff09413a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:14.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 1 --2- 172.21.15.5:0/101378106 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff0940a74f0 0x7ff09413a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 1 -- 172.21.15.5:0/101378106 >> v1:172.21.15.157:6789/0 conn(0x7ff09409f080 legacy=0x7ff094139990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:14.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 10 monclient: _finish_hunting 0 2024-08-18T21:10:14.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 1 monclient: found mon.noname-a 2024-08-18T21:10:14.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:14.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:10:14.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff099889640 1 -- 172.21.15.5:0/101378106 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09409de70 con 0x7ff0940a6bd0 2024-08-18T21:10:14.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09a08a640 10 monclient: get_auth_request con 0x7ff0940a74f0 auth_method 0 2024-08-18T21:10:14.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.773+0000 7ff09a08a640 1 --2- 172.21.15.5:0/101378106 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff0940a74f0 0x7ff09413a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:10:14.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff099889640 1 -- 172.21.15.5:0/101378106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0940a6bd0 msgr2=0x7ff0940a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff099889640 1 --2- 172.21.15.5:0/101378106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0940a6bd0 0x7ff0940a6fb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009e50 tx=0x7ff08c01d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3eb6804d85f639 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff098887640 1 -- 172.21.15.5:0/101378106 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff08c0091b0 con 0x7ff0940a6bd0 2024-08-18T21:10:14.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff098887640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff098887640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:10:14.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff098887640 10 monclient: dump: 2024-08-18T21:10:14.786 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.786 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.786 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.786 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.786 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.786 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.786 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.786 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.786 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.786 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.786 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.787 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff098887640 10 monclient: _finish_auth 0 2024-08-18T21:10:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff098887640 10 monclient: _check_auth_tickets 2024-08-18T21:10:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff098887640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff098887640 1 -- 172.21.15.5:0/101378106 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08c0a5ab0 con 0x7ff0940a6bd0 2024-08-18T21:10:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff098887640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff098887640 1 -- 172.21.15.5:0/101378106 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff08c0a5c60 con 0x7ff0940a6bd0 2024-08-18T21:10:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff09baed640 5 monclient: authenticate success, global_id 84582 2024-08-18T21:10:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff09baed640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff09baed640 4 set_mon_vals no callback set 2024-08-18T21:10:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff098887640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff098887640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff098887640 10 monclient: dump: 2024-08-18T21:10:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.789 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff09baed640 10 monclient: shutdown 2024-08-18T21:10:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff09baed640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff09baed640 1 -- 172.21.15.5:0/101378106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0940a6bd0 msgr2=0x7ff0940a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff09baed640 1 --2- 172.21.15.5:0/101378106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0940a6bd0 0x7ff0940a6fb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009e50 tx=0x7ff08c01d350 comp rx=0 tx=0).stop 2024-08-18T21:10:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff09baed640 1 -- 172.21.15.5:0/101378106 shutdown_connections 2024-08-18T21:10:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff09baed640 1 --2- 172.21.15.5:0/101378106 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff0940a74f0 0x7ff09413a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff09baed640 1 --2- 172.21.15.5:0/101378106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0940a6bd0 0x7ff0940a6fb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff09baed640 1 -- 172.21.15.5:0/101378106 >> 172.21.15.5:0/101378106 conn(0x7ff094068700 msgr2=0x7ff094068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff09baed640 1 -- 172.21.15.5:0/101378106 shutdown_connections 2024-08-18T21:10:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff09baed640 1 -- 172.21.15.5:0/101378106 wait complete. 2024-08-18T21:10:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff09baed640 10 monclient: build_initial_monmap 2024-08-18T21:10:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.777+0000 7ff09baed640 10 monclient: monmap: 2024-08-18T21:10:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:14.791 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 1 Processor -- start 2024-08-18T21:10:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 1 -- start start 2024-08-18T21:10:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 10 monclient: init 2024-08-18T21:10:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 10 monclient: _add_conns ranks=[5,1,4,2,7,8,6,0,3] 2024-08-18T21:10:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff09409f080 0x7ff0941388d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 10 monclient(hunting): picked mon.noname-h con 0x7ff09409f080 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:14.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0940a6bd0 0x7ff094138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 10 monclient(hunting): picked mon.noname-f con 0x7ff0940a6bd0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:10:14.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff0940a74f0 0x7ff094139350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 10 monclient(hunting): picked mon.noname-c con 0x7ff0940a74f0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:14.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff09413a5e0 con 0x7ff0940a6bd0 2024-08-18T21:10:14.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff0940a89f0 con 0x7ff0940a74f0 2024-08-18T21:10:14.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7ff09413a760 con 0x7ff09409f080 2024-08-18T21:10:14.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:14.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 10 monclient(hunting): authenticate will time out at 1381.796865s 2024-08-18T21:10:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff099088640 1 -- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0940a6bd0 msgr2=0x7ff094138e10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:10:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff0940a74f0 0x7ff094139350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff099088640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0940a6bd0 0x7ff094138e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff0940a74f0 0x7ff094139350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:45118/0 (socket says 172.21.15.5:45118) 2024-08-18T21:10:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 1 -- 172.21.15.5:0/2137245019 learned_addr learned my addr 172.21.15.5:0/2137245019 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 10 monclient(hunting): get_auth_request con 0x7ff0940a74f0 auth_method 0 2024-08-18T21:10:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff099889640 1 --2- 172.21.15.5:0/2137245019 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff09409f080 0x7ff0941388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff099889640 10 monclient(hunting): get_auth_request con 0x7ff09409f080 auth_method 0 2024-08-18T21:10:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff099889640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff099889640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff099889640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 10 monclient(hunting): handle_auth_done global_id 6358 payload 824 2024-08-18T21:10:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 1 -- 172.21.15.5:0/2137245019 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff09409f080 msgr2=0x7ff0941388d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 1 --2- 172.21.15.5:0/2137245019 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff09409f080 0x7ff0941388d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 1 -- 172.21.15.5:0/2137245019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0940a6bd0 msgr2=0x7ff094138e10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:10:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 1 --2- 172.21.15.5:0/2137245019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0940a6bd0 0x7ff094138e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 10 monclient: _finish_hunting 0 2024-08-18T21:10:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 1 monclient: found mon.noname-c 2024-08-18T21:10:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:10:14.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 1 -- 172.21.15.5:0/2137245019 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff094140310 con 0x7ff0940a74f0 2024-08-18T21:10:14.795 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:14.795 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30400]: starting. 2024-08-18T21:10:14.795 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30400]: listing objects. 2024-08-18T21:10:14.795 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30400]: listed object 0... 2024-08-18T21:10:14.796 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30400]: listed object 25... 2024-08-18T21:10:14.796 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30400]: saw 50 objects 2024-08-18T21:10:14.796 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30400]: shutting down. 2024-08-18T21:10:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 1 -- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff0940a74f0 msgr2=0x7ff094139350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09a08a640 1 --2- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff0940a74f0 0x7ff094139350 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff08400c820 tx=0x7ff08400cce0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff0927fc640 1 -- 172.21.15.5:0/2137245019 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff084015070 con 0x7ff0940a74f0 2024-08-18T21:10:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff0927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff0927fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:10:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff0927fc640 10 monclient: dump: 2024-08-18T21:10:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.801 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff0927fc640 10 monclient: _finish_auth 0 2024-08-18T21:10:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff0927fc640 10 monclient: _check_auth_tickets 2024-08-18T21:10:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff0927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff0927fc640 1 -- 172.21.15.5:0/2137245019 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08400ce10 con 0x7ff0940a74f0 2024-08-18T21:10:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff0927fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff0927fc640 1 -- 172.21.15.5:0/2137245019 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff084011860 con 0x7ff0940a74f0 2024-08-18T21:10:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff0927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff0927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff0927fc640 10 monclient: dump: 2024-08-18T21:10:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.803 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 5 monclient: authenticate success, global_id 6358 2024-08-18T21:10:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff093fff640 4 set_mon_vals no callback set 2024-08-18T21:10:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 10 monclient: _renew_subs 2024-08-18T21:10:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:10:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.781+0000 7ff09baed640 1 -- 172.21.15.5:0/2137245019 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09413fe70 con 0x7ff0940a74f0 2024-08-18T21:10:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff09baed640 10 monclient: _renew_subs 2024-08-18T21:10:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff09baed640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:10:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff09baed640 1 -- 172.21.15.5:0/2137245019 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0941409d0 con 0x7ff0940a74f0 2024-08-18T21:10:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff09baed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff09baed640 1 --2- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff09413abb0 0x7ff09413af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff09baed640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff0927fc640 1 -- 172.21.15.5:0/2137245019 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7ff084018070 con 0x7ff0940a74f0 2024-08-18T21:10:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff09baed640 1 -- 172.21.15.5:0/2137245019 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff094051140 con 0x7ff09413abb0 2024-08-18T21:10:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff099889640 1 --2- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff09413abb0 0x7ff09413af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff099889640 10 monclient: get_auth_request con 0x7ff09413abb0 auth_method 0 2024-08-18T21:10:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff099889640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff099889640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff099889640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff099889640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff099889640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff099889640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff0927fc640 1 --2- 172.21.15.5:0/2137245019 >> v2:172.21.15.157:6812/631023601 conn(0x7ff08003bdc0 0x7ff08003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff0927fc640 1 -- 172.21.15.5:0/2137245019 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(183..183 src has 22..183) ==== 3898+0+0 (secure 0 0 0) 0x7ff08404e5d0 con 0x7ff0940a74f0 2024-08-18T21:10:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff099889640 10 monclient(hunting): handle_auth_done global_id 55331 payload 824 2024-08-18T21:10:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff099889640 1 -- 172.21.15.5:0/2137245019 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff094122d70 con 0x7ff09413abb0 2024-08-18T21:10:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff099088640 1 --2- 172.21.15.5:0/2137245019 >> v2:172.21.15.157:6812/631023601 conn(0x7ff08003bdc0 0x7ff08003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff099088640 10 monclient: get_auth_request con 0x7ff08003bdc0 auth_method 0 2024-08-18T21:10:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff099889640 1 -- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff09413abb0 msgr2=0x7ff09413af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff099889640 1 --2- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff09413abb0 0x7ff09413af90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff0940a6890 tx=0x7ff08c019690 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff0927fc640 1 -- 172.21.15.5:0/2137245019 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff08c0bc070 con 0x7ff09413abb0 2024-08-18T21:10:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff0927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff0927fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:10:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.785+0000 7ff0927fc640 10 monclient: dump: 2024-08-18T21:10:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.807 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.789+0000 7ff0927fc640 1 -- 172.21.15.5:0/2137245019 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff08c0a5a60 con 0x7ff09413abb0 2024-08-18T21:10:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.789+0000 7ff0927fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.789+0000 7ff0927fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.789+0000 7ff0927fc640 1 -- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff09413abb0 msgr2=0x7ff09413af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.789+0000 7ff0927fc640 1 --2- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff09413abb0 0x7ff09413af90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff0940a6890 tx=0x7ff08c019690 comp rx=0 tx=0).stop 2024-08-18T21:10:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.789+0000 7ff0927fc640 1 -- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff09413abb0 msgr2=0x7ff09413af90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.789+0000 7ff0927fc640 1 --2- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff09413abb0 0x7ff09413af90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.789+0000 7ff099088640 1 --2- 172.21.15.5:0/2137245019 >> v2:172.21.15.157:6812/631023601 conn(0x7ff08003bdc0 0x7ff08003e280 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff09413a390 tx=0x7ff088006cf0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.793+0000 7ff09baed640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.793+0000 7ff09baed640 1 --2- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff09413b4d0 0x7ff09413e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.793+0000 7ff09baed640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.793+0000 7ff09baed640 1 -- 172.21.15.5:0/2137245019 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff0940a6fb0 con 0x7ff09413b4d0 2024-08-18T21:10:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.793+0000 7ff099889640 1 --2- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff09413b4d0 0x7ff09413e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.793+0000 7ff099889640 10 monclient: get_auth_request con 0x7ff09413b4d0 auth_method 0 2024-08-18T21:10:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.793+0000 7ff099889640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.793+0000 7ff099889640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.793+0000 7ff099889640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.793+0000 7ff099889640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.793+0000 7ff099889640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.793+0000 7ff099889640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.793+0000 7ff099889640 10 monclient(hunting): handle_auth_done global_id 55340 payload 824 2024-08-18T21:10:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.793+0000 7ff099889640 1 -- 172.21.15.5:0/2137245019 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff0941235c0 con 0x7ff09413b4d0 2024-08-18T21:10:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff099889640 1 -- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff09413b4d0 msgr2=0x7ff09413e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff099889640 1 --2- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff09413b4d0 0x7ff09413e380 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff08c01d390 tx=0x7ff08c0a7070 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff0927fc640 1 -- 172.21.15.5:0/2137245019 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff08c0b88b0 con 0x7ff09413b4d0 2024-08-18T21:10:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff0927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff0927fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:10:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff0927fc640 10 monclient: dump: 2024-08-18T21:10:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.810 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff0927fc640 1 -- 172.21.15.5:0/2137245019 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9404 (secure 0 0 0) 0x7ff08c0b8440 con 0x7ff09413b4d0 2024-08-18T21:10:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff0927fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff0927fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff0927fc640 1 -- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff09413b4d0 msgr2=0x7ff09413e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff0927fc640 1 --2- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff09413b4d0 0x7ff09413e380 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff08c01d390 tx=0x7ff08c0a7070 comp rx=0 tx=0).stop 2024-08-18T21:10:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff0927fc640 1 -- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff09413b4d0 msgr2=0x7ff09413e380 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff0927fc640 1 --2- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff09413b4d0 0x7ff09413e380 secure :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff08c01d390 tx=0x7ff08c0a7070 comp rx=0 tx=0).stop 2024-08-18T21:10:14.811 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:14.811 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:14.811 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:14.811 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:14.811 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 150, 2024-08-18T21:10:14.812 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 270918, 2024-08-18T21:10:14.812 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:14.812 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:14.812 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:14.812 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:14.812 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:14.812 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:14.812 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:14.812 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:14.812 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:14.812 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.812 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:10:14.812 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:14.812 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:14.813 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:14.813 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.813 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.813 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.813 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.813 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.813 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.813 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.813 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.813 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.813 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.813 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.813 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.814 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:14.814 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:14.814 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.814 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.814 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.814 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.814 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.814 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.814 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.814 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.814 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.814 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.814 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.814 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.815 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:14.815 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:14.815 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:14.815 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:14.815 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:14.815 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:14.815 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:14.815 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:14.815 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:14.815 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:14.815 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:14.815 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:14.816 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:14.816 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:14.816 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:14.816 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:14.816 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:14.816 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.816 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.816 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.816 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.816 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.816 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.816 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.816 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.816 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.817 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.817 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.817 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.817 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:14.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.817 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:14.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.817 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:14.817 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:14.817 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.817 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.817 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.817 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:14.818 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.818 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.818 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:14.818 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.818 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.818 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.818 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:14.818 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:14.818 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.818 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.819 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.819 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:14.819 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:14.819 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.819 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.819 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.819 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:14.819 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.819 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.820 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:14.820 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.820 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.820 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.820 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:14.820 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:14.820 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.820 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.820 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.820 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:14.821 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:14.821 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.821 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:14.821 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.821 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:14.821 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.821 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.821 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.822 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:14.822 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:14.822 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.822 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.822 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.822 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:14.822 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:14.822 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.822 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.822 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.823 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:14.823 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.823 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.823 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:14.823 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.823 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.823 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.823 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:14.823 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:14.823 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.824 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.824 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.824 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:14.824 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:14.824 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.824 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.824 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.824 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:14.824 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.825 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.825 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:14.825 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.825 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.825 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.825 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:14.825 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:14.825 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.825 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.825 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.825 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:14.826 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:14.826 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.826 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.826 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.826 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:14.826 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.826 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.826 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:14.826 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.826 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.827 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.827 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:14.827 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:14.827 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.827 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.827 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.827 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:14.827 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:14.827 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.827 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.828 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.828 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:14.828 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.828 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.828 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:14.828 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.828 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.828 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.828 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:14.828 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:14.828 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.829 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.829 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.829 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:14.829 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:14.829 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.829 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.829 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.829 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:14.829 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.830 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.830 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:14.830 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.830 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.830 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.830 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:14.830 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:14.830 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.830 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.831 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.831 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:14.831 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:14.831 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:14.831 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:14.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.831 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:14.831 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:14.831 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.832 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:14.832 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:14.832 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:14.832 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.832 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.832 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:14.832 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:14.832 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:14.832 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:14.832 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:14.832 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.832 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.833 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:14.833 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:14.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.833 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:14.833 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:14.833 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:14.833 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.833 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.833 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:10:14.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.833 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:14.833 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:14.833 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:10:14.834 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.834 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.834 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:14.834 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:14.834 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:14.834 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:14.834 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:14.834 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:14.834 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.834 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:14.834 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff09baed640 1 -- 172.21.15.5:0/2137245019 >> v2:172.21.15.157:6812/631023601 conn(0x7ff08003bdc0 msgr2=0x7ff08003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff09baed640 1 --2- 172.21.15.5:0/2137245019 >> v2:172.21.15.157:6812/631023601 conn(0x7ff08003bdc0 0x7ff08003e280 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff09413a390 tx=0x7ff088006cf0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff09baed640 10 monclient: shutdown 2024-08-18T21:10:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff09baed640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff09baed640 1 -- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff0940a74f0 msgr2=0x7ff094139350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff09baed640 1 --2- 172.21.15.5:0/2137245019 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff0940a74f0 0x7ff094139350 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff08400c820 tx=0x7ff08400cce0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff09a08a640 1 -- 172.21.15.5:0/2137245019 reap_dead start 2024-08-18T21:10:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff09a08a640 1 -- 172.21.15.5:0/2137245019 reap_dead start 2024-08-18T21:10:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff09baed640 1 -- 172.21.15.5:0/2137245019 shutdown_connections 2024-08-18T21:10:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff09baed640 1 -- 172.21.15.5:0/2137245019 >> 172.21.15.5:0/2137245019 conn(0x7ff094068700 msgr2=0x7ff0941414f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff09baed640 1 -- 172.21.15.5:0/2137245019 shutdown_connections 2024-08-18T21:10:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.797+0000 7ff09baed640 1 -- 172.21.15.5:0/2137245019 wait complete. 2024-08-18T21:10:14.837 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-18T21:10:14.837 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon g 2024-08-18T21:10:14.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:10:14.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 10 monclient: get_monmap_and_config 2024-08-18T21:10:14.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 10 monclient: build_initial_monmap 2024-08-18T21:10:14.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 10 monclient: monmap: 2024-08-18T21:10:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:14.957158+0000 2024-08-18T21:10:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:14.957158+0000 2024-08-18T21:10:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:14.957 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 1 Processor -- start 2024-08-18T21:10:14.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 1 -- start start 2024-08-18T21:10:14.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 10 monclient: init 2024-08-18T21:10:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 10 monclient: _add_conns ranks=[0,4,3,5,2,10,6,9,7,1,8] 2024-08-18T21:10:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f07b80a6ce0 addr v1:172.21.15.5:6789/0 2024-08-18T21:10:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07b80a77d0 0x7f07b813ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 10 monclient(hunting): picked mon.noname-c con 0x7f07b80a77d0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b813f220 0x7f07b8141610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 10 monclient(hunting): picked mon.noname-g con 0x7f07b813f220 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07b80a45d0 con 0x7f07b80a6ce0 2024-08-18T21:10:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f07b80a5000 con 0x7f07b813f220 2024-08-18T21:10:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f07b80a4360 con 0x7f07b80a77d0 2024-08-18T21:10:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bfba8640 10 monclient(hunting): authenticate will time out at 1381.970336s 2024-08-18T21:10:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd944640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f07b80a6ce0 0x7f07b80a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56432/0 (socket says 172.21.15.5:56432) 2024-08-18T21:10:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd944640 1 -- 172.21.15.5:0/2234423629 learned_addr learned my addr 172.21.15.5:0/2234423629 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:10:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 1 --2- 172.21.15.5:0/2234423629 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07b80a77d0 0x7f07b813ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 10 monclient(hunting): get_auth_request con 0x7f07b80a77d0 auth_method 0 2024-08-18T21:10:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07be145640 1 --2- 172.21.15.5:0/2234423629 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b813f220 0x7f07b8141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07be145640 10 monclient(hunting): get_auth_request con 0x7f07b813f220 auth_method 0 2024-08-18T21:10:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07be145640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07be145640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07be145640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 10 monclient(hunting): handle_auth_done global_id 6367 payload 274 2024-08-18T21:10:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 1 -- 172.21.15.5:0/2234423629 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b813f220 msgr2=0x7f07b8141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 1 --2- 172.21.15.5:0/2234423629 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b813f220 0x7f07b8141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 1 -- 172.21.15.5:0/2234423629 >> v1:172.21.15.5:6789/0 conn(0x7f07b80a6ce0 legacy=0x7f07b80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 10 monclient: _finish_hunting 0 2024-08-18T21:10:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 1 monclient: found mon.noname-c 2024-08-18T21:10:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:10:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07bd143640 1 -- 172.21.15.5:0/2234423629 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b80a32d0 con 0x7f07b80a77d0 2024-08-18T21:10:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.953+0000 7f07be145640 1 --2- 172.21.15.5:0/2234423629 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b813f220 0x7f07b8141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:10:14.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bd143640 1 -- 172.21.15.5:0/2234423629 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07b80a77d0 msgr2=0x7f07b813ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bd143640 1 --2- 172.21.15.5:0/2234423629 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07b80a77d0 0x7f07b813ece0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009dc0 tx=0x7f07b401c850 comp rx=0 tx=0).ready entity=mon.4 client_cookie=8efe1a8ddd0cb544 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bc942640 1 -- 172.21.15.5:0/2234423629 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07b40b2070 con 0x7f07b80a77d0 2024-08-18T21:10:14.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bc942640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bc942640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:10:14.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bc942640 10 monclient: dump: 2024-08-18T21:10:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.970 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bc942640 10 monclient: _finish_auth 0 2024-08-18T21:10:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bc942640 10 monclient: _check_auth_tickets 2024-08-18T21:10:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bc942640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 5 monclient: authenticate success, global_id 6367 2024-08-18T21:10:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bc942640 1 -- 172.21.15.5:0/2234423629 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b40a5990 con 0x7f07b80a77d0 2024-08-18T21:10:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:10:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bc942640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 4 set_mon_vals no callback set 2024-08-18T21:10:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bc942640 1 -- 172.21.15.5:0/2234423629 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07b40ab340 con 0x7f07b80a77d0 2024-08-18T21:10:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bc942640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bc942640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bc942640 10 monclient: dump: 2024-08-18T21:10:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.972 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 10 monclient: shutdown 2024-08-18T21:10:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 1 -- 172.21.15.5:0/2234423629 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07b80a77d0 msgr2=0x7f07b813ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 1 --2- 172.21.15.5:0/2234423629 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07b80a77d0 0x7f07b813ece0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009dc0 tx=0x7f07b401c850 comp rx=0 tx=0).stop 2024-08-18T21:10:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 1 -- 172.21.15.5:0/2234423629 shutdown_connections 2024-08-18T21:10:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 1 --2- 172.21.15.5:0/2234423629 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b813f220 0x7f07b8141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 1 --2- 172.21.15.5:0/2234423629 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f07b80a77d0 0x7f07b813ece0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 1 -- 172.21.15.5:0/2234423629 >> 172.21.15.5:0/2234423629 conn(0x7f07b80acbc0 msgr2=0x7f07b80a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 1 -- 172.21.15.5:0/2234423629 shutdown_connections 2024-08-18T21:10:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 1 -- 172.21.15.5:0/2234423629 wait complete. 2024-08-18T21:10:14.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 10 monclient: build_initial_monmap 2024-08-18T21:10:14.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 10 monclient: monmap: 2024-08-18T21:10:14.973 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:14.973 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:14.973 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:14.973 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:14.973 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:14.973 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.973 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:14.973 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:14.973 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:14.973 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:14.973 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:14.973 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:14.974 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:14.974 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:14.974 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:14.974 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 1 Processor -- start 2024-08-18T21:10:14.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 1 -- start start 2024-08-18T21:10:14.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.961+0000 7f07bfba8640 10 monclient: init 2024-08-18T21:10:14.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:14.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 10 monclient: _add_conns ranks=[8,1,3,0,5,4,6,2,7] 2024-08-18T21:10:14.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f07b80a6ce0 0x7f07b81d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 10 monclient(hunting): picked mon.noname-e con 0x7f07b80a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:14.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07b80a77d0 0x7f07b8137c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 10 monclient(hunting): picked mon.noname-f con 0x7f07b80a77d0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:10:14.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b813f220 0x7f07b809e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 10 monclient(hunting): picked mon.noname-g con 0x7f07b813f220 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f07b80a83a0 con 0x7f07b80a77d0 2024-08-18T21:10:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f07b80a8220 con 0x7f07b813f220 2024-08-18T21:10:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f07b8144370 con 0x7f07b80a6ce0 2024-08-18T21:10:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 10 monclient(hunting): authenticate will time out at 1381.980226s 2024-08-18T21:10:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd143640 1 -- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07b80a77d0 msgr2=0x7f07b8137c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:10:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f07b80a6ce0 0x7f07b81d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd143640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07b80a77d0 0x7f07b8137c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f07b80a6ce0 0x7f07b81d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:36472/0 (socket says 172.21.15.5:36472) 2024-08-18T21:10:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 1 -- 172.21.15.5:0/1228494648 learned_addr learned my addr 172.21.15.5:0/1228494648 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 10 monclient(hunting): get_auth_request con 0x7f07b80a6ce0 auth_method 0 2024-08-18T21:10:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07be145640 1 --2- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b813f220 0x7f07b809e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07be145640 10 monclient(hunting): get_auth_request con 0x7f07b813f220 auth_method 0 2024-08-18T21:10:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07be145640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07be145640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07be145640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 10 monclient(hunting): handle_auth_done global_id 55349 payload 824 2024-08-18T21:10:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 1 -- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b813f220 msgr2=0x7f07b809e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 1 --2- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b813f220 0x7f07b809e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 1 -- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07b80a77d0 msgr2=0x7f07b8137c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:10:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 1 --2- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07b80a77d0 0x7f07b8137c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 10 monclient: _finish_hunting 0 2024-08-18T21:10:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 1 monclient: found mon.noname-e 2024-08-18T21:10:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:10:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 1 -- 172.21.15.5:0/1228494648 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b80a23e0 con 0x7f07b80a6ce0 2024-08-18T21:10:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07be145640 1 --2- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b813f220 0x7f07b809e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:10:14.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 1 -- 172.21.15.5:0/1228494648 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f07b80a6ce0 msgr2=0x7f07b81d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bd944640 1 --2- 172.21.15.5:0/1228494648 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f07b80a6ce0 0x7f07b81d12f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f07ac00c470 tx=0x7f07ac00c930 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07aa7fc640 1 -- 172.21.15.5:0/1228494648 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07ac005d00 con 0x7f07b80a6ce0 2024-08-18T21:10:14.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07aa7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:10:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07aa7fc640 10 monclient: dump: 2024-08-18T21:10:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.982 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07aa7fc640 10 monclient: _finish_auth 0 2024-08-18T21:10:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07aa7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:10:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07aa7fc640 1 -- 172.21.15.5:0/1228494648 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ac0074e0 con 0x7f07b80a6ce0 2024-08-18T21:10:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07aa7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07aa7fc640 1 -- 172.21.15.5:0/1228494648 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07ac007690 con 0x7f07b80a6ce0 2024-08-18T21:10:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 5 monclient: authenticate success, global_id 55349 2024-08-18T21:10:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 10 monclient: _renew_subs 2024-08-18T21:10:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:10:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 1 -- 172.21.15.5:0/1228494648 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b80a26c0 con 0x7f07b80a6ce0 2024-08-18T21:10:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07ab7fe640 4 set_mon_vals no callback set 2024-08-18T21:10:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07aa7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:10:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07aa7fc640 10 monclient: dump: 2024-08-18T21:10:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.984 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.985 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 10 monclient: _renew_subs 2024-08-18T21:10:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:10:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.965+0000 7f07bfba8640 1 -- 172.21.15.5:0/1228494648 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b8140e20 con 0x7f07b80a6ce0 2024-08-18T21:10:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07bfba8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07bfba8640 1 --2- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b8138170 0x7f07b809ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07bfba8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07bfba8640 1 -- 172.21.15.5:0/1228494648 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f07b8051140 con 0x7f07b8138170 2024-08-18T21:10:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07bd143640 1 --2- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b8138170 0x7f07b809ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07aa7fc640 1 -- 172.21.15.5:0/1228494648 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f07ac007070 con 0x7f07b80a6ce0 2024-08-18T21:10:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07bd143640 10 monclient: get_auth_request con 0x7f07b8138170 auth_method 0 2024-08-18T21:10:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07bd143640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07bd143640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07bd143640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07aa7fc640 1 --2- 172.21.15.5:0/1228494648 >> v2:172.21.15.157:6812/631023601 conn(0x7f079c03bdf0 0x7f079c03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07bd143640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07bd143640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07bd143640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07aa7fc640 1 -- 172.21.15.5:0/1228494648 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(183..183 src has 22..183) ==== 3898+0+0 (secure 0 0 0) 0x7f07ac04e3c0 con 0x7f07b80a6ce0 2024-08-18T21:10:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07bd143640 10 monclient(hunting): handle_auth_done global_id 84567 payload 824 2024-08-18T21:10:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07be145640 1 --2- 172.21.15.5:0/1228494648 >> v2:172.21.15.157:6812/631023601 conn(0x7f079c03bdf0 0x7f079c03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07bd143640 1 -- 172.21.15.5:0/1228494648 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07b80aaf40 con 0x7f07b8138170 2024-08-18T21:10:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07be145640 10 monclient: get_auth_request con 0x7f079c03bdf0 auth_method 0 2024-08-18T21:10:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07bd143640 1 -- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b8138170 msgr2=0x7f07b809ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.969+0000 7f07bd143640 1 --2- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b8138170 0x7f07b809ee90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f07b806df00 tx=0x7f07b40195f0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.973+0000 7f07be145640 1 --2- 172.21.15.5:0/1228494648 >> v2:172.21.15.157:6812/631023601 conn(0x7f079c03bdf0 0x7f079c03e2b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f07b000b970 tx=0x7f07b0008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.973+0000 7f07aa7fc640 1 -- 172.21.15.5:0/1228494648 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07b40bc020 con 0x7f07b8138170 2024-08-18T21:10:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.973+0000 7f07aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.973+0000 7f07aa7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:10:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.973+0000 7f07aa7fc640 10 monclient: dump: 2024-08-18T21:10:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.989 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.989 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.973+0000 7f07aa7fc640 1 -- 172.21.15.5:0/1228494648 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f07b4004480 con 0x7f07b8138170 2024-08-18T21:10:14.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.973+0000 7f07aa7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:14.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.973+0000 7f07aa7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:14.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.973+0000 7f07aa7fc640 1 -- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b8138170 msgr2=0x7f07b809ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.973+0000 7f07aa7fc640 1 --2- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b8138170 0x7f07b809ee90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f07b806df00 tx=0x7f07b40195f0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.973+0000 7f07aa7fc640 1 -- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b8138170 msgr2=0x7f07b809ee90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:14.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.973+0000 7f07aa7fc640 1 --2- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b8138170 0x7f07b809ee90 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f07b806df00 tx=0x7f07b40195f0 comp rx=0 tx=0).stop 2024-08-18T21:10:14.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.977+0000 7f07bfba8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:14.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.977+0000 7f07bfba8640 1 --2- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b809f3d0 0x7f07b813c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:14.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.977+0000 7f07bfba8640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:14.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.977+0000 7f07bfba8640 1 -- 172.21.15.5:0/1228494648 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f07b8069fa0 con 0x7f07b809f3d0 2024-08-18T21:10:14.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.981+0000 7f07bd143640 1 --2- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b809f3d0 0x7f07b813c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:14.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.981+0000 7f07bd143640 10 monclient: get_auth_request con 0x7f07b809f3d0 auth_method 0 2024-08-18T21:10:14.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.981+0000 7f07bd143640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:14.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.981+0000 7f07bd143640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:14.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.981+0000 7f07bd143640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:14.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.981+0000 7f07bd143640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:14.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.981+0000 7f07bd143640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:14.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.981+0000 7f07bd143640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:14.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.981+0000 7f07bd143640 10 monclient(hunting): handle_auth_done global_id 84576 payload 824 2024-08-18T21:10:14.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.981+0000 7f07bd143640 1 -- 172.21.15.5:0/1228494648 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f07b809f7e0 con 0x7f07b809f3d0 2024-08-18T21:10:14.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.981+0000 7f07bd143640 1 -- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b809f3d0 msgr2=0x7f07b813c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:14.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.981+0000 7f07bd143640 1 --2- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b809f3d0 0x7f07b813c340 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07b4000f90 tx=0x7f07b4009750 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:14.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.981+0000 7f07aa7fc640 1 -- 172.21.15.5:0/1228494648 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07b40bc050 con 0x7f07b809f3d0 2024-08-18T21:10:14.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.981+0000 7f07aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:14.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.981+0000 7f07aa7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:10:14.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.981+0000 7f07aa7fc640 10 monclient: dump: 2024-08-18T21:10:14.992 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:14.992 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:14.992 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.992 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:14.993 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:14.993 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:14.993 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:14.993 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:14.993 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:14.993 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:14.993 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:14.993 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:14.993 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:14.993 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:14.993 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:14.993 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:14.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07aa7fc640 1 -- 172.21.15.5:0/1228494648 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9237 (secure 0 0 0) 0x7f07b40ab520 con 0x7f07b809f3d0 2024-08-18T21:10:14.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07aa7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:14.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07aa7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:14.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07aa7fc640 1 -- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b809f3d0 msgr2=0x7f07b813c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:14.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07aa7fc640 1 --2- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b809f3d0 0x7f07b813c340 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07b4000f90 tx=0x7f07b4009750 comp rx=0 tx=0).stop 2024-08-18T21:10:14.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07aa7fc640 1 -- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b809f3d0 msgr2=0x7f07b813c340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:14.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07aa7fc640 1 --2- 172.21.15.5:0/1228494648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07b809f3d0 0x7f07b813c340 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07b4000f90 tx=0x7f07b4009750 comp rx=0 tx=0).stop 2024-08-18T21:10:14.994 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:14.994 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:14.994 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:14.994 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:14.994 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 150, 2024-08-18T21:10:14.995 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 111806, 2024-08-18T21:10:14.995 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:14.995 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:14.995 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:14.995 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:14.995 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:14.995 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:14.995 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:14.995 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:14.995 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:14.995 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.995 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:10:14.995 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:14.996 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:14.996 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:14.996 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.996 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.996 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.996 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.996 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.996 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.996 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.996 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.996 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.996 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.996 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.996 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:14.997 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:14.997 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:14.997 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.997 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.997 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.997 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.997 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.997 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.997 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.997 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:14.997 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:14.997 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:14.997 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:14.998 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:14.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:14.998 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:14.998 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:14.998 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:14.998 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:14.998 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:14.998 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:14.998 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:14.998 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:14.998 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:14.998 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:14.998 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:14.998 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:14.999 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:14.999 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:14.999 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:14.999 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:14.999 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:14.999 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:14.999 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:14.999 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:14.999 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:14.999 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:14.999 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:14.999 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:14.999 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:15.000 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:15.000 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:15.000 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:15.000 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:15.000 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:15.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.000 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:15.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.000 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:15.000 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:15.000 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.000 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.008 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.008 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:15.008 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.008 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.008 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.008 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:15.008 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:15.008 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.008 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.008 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.008 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:15.009 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:15.009 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.009 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.009 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:15.009 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.009 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:15.009 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.009 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.010 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.010 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:15.010 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:15.010 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.010 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.010 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.010 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:15.010 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:15.010 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.010 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.011 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.011 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:15.011 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.011 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.011 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:15.011 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.011 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.011 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.011 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:15.011 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:15.011 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.012 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.012 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.012 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.012 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:15.012 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:15.012 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.012 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.012 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.012 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.012 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:15.012 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.013 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.013 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:15.013 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.013 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.013 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.013 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:15.013 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:15.013 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.013 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.013 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.014 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:15.014 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:15.014 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.014 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.014 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.014 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.014 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:15.014 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.014 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.014 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.014 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:15.014 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.015 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.015 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.015 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:15.015 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:15.015 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.015 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.015 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.015 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.015 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.015 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:15.015 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:15.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.016 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:15.016 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:15.016 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:15.016 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.016 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:15.016 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:15.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.016 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:15.016 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:15.016 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:10:15.016 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.016 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.016 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:15.017 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07bfba8640 1 -- 172.21.15.5:0/1228494648 >> v2:172.21.15.157:6812/631023601 conn(0x7f079c03bdf0 msgr2=0x7f079c03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07bfba8640 1 --2- 172.21.15.5:0/1228494648 >> v2:172.21.15.157:6812/631023601 conn(0x7f079c03bdf0 0x7f079c03e2b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f07b000b970 tx=0x7f07b0008040 comp rx=0 tx=0).stop 2024-08-18T21:10:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07bfba8640 10 monclient: shutdown 2024-08-18T21:10:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07bfba8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07bfba8640 1 -- 172.21.15.5:0/1228494648 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f07b80a6ce0 msgr2=0x7f07b81d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07bfba8640 1 --2- 172.21.15.5:0/1228494648 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f07b80a6ce0 0x7f07b81d12f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f07ac00c470 tx=0x7f07ac00c930 comp rx=0 tx=0).stop 2024-08-18T21:10:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07be145640 1 -- 172.21.15.5:0/1228494648 reap_dead start 2024-08-18T21:10:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07be145640 1 -- 172.21.15.5:0/1228494648 reap_dead start 2024-08-18T21:10:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07bfba8640 1 -- 172.21.15.5:0/1228494648 shutdown_connections 2024-08-18T21:10:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07bfba8640 1 -- 172.21.15.5:0/1228494648 >> 172.21.15.5:0/1228494648 conn(0x7f07b80acbc0 msgr2=0x7f07b813f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07bfba8640 1 -- 172.21.15.5:0/1228494648 shutdown_connections 2024-08-18T21:10:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:14.985+0000 7f07bfba8640 1 -- 172.21.15.5:0/1228494648 wait complete. 2024-08-18T21:10:15.019 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-18T21:10:15.019 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-08-18T21:10:15.020 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:10:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 10 monclient: get_monmap_and_config 2024-08-18T21:10:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 10 monclient: build_initial_monmap 2024-08-18T21:10:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 10 monclient: monmap: 2024-08-18T21:10:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:15.137812+0000 2024-08-18T21:10:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:15.137812+0000 2024-08-18T21:10:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:15.138 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 1 Processor -- start 2024-08-18T21:10:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 1 -- start start 2024-08-18T21:10:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 10 monclient: init 2024-08-18T21:10:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 10 monclient: _add_conns ranks=[5,3,8,0,7,6,4,2,10,1,9] 2024-08-18T21:10:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc09da30 0x7f97bc09de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 10 monclient(hunting): picked mon.noname-h con 0x7f97bc09da30 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97bc0a03e0 0x7f97bc09e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 10 monclient(hunting): picked mon.noname-g con 0x7f97bc0a03e0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f97bc0a3110 0x7f97bc1366a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 10 monclient(hunting): picked mon.noname-e con 0x7f97bc0a3110 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f97bc09e890 con 0x7f97bc0a03e0 2024-08-18T21:10:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f97bc09f7c0 con 0x7f97bc09da30 2024-08-18T21:10:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f97bc09f4e0 con 0x7f97bc0a3110 2024-08-18T21:10:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c293d640 10 monclient(hunting): authenticate will time out at 1382.151655s 2024-08-18T21:10:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c0eda640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f97bc0a3110 0x7f97bc1366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c0eda640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f97bc0a3110 0x7f97bc1366a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:36474/0 (socket says 172.21.15.5:36474) 2024-08-18T21:10:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c0eda640 1 -- 172.21.15.5:0/3086276873 learned_addr learned my addr 172.21.15.5:0/3086276873 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c0eda640 10 monclient(hunting): get_auth_request con 0x7f97bc0a3110 auth_method 0 2024-08-18T21:10:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c0eda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c0eda640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c0eda640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c0eda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.133+0000 7f97c0eda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97c0eda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97b37fe640 1 --2- 172.21.15.5:0/3086276873 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97bc0a03e0 0x7f97bc09e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97bbfff640 1 --2- 172.21.15.5:0/3086276873 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc09da30 0x7f97bc09de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97b37fe640 10 monclient(hunting): get_auth_request con 0x7f97bc0a03e0 auth_method 0 2024-08-18T21:10:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97b37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97b37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97bbfff640 10 monclient(hunting): get_auth_request con 0x7f97bc09da30 auth_method 0 2024-08-18T21:10:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97c0eda640 10 monclient(hunting): handle_auth_done global_id 55358 payload 274 2024-08-18T21:10:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97c0eda640 1 -- 172.21.15.5:0/3086276873 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc09da30 msgr2=0x7f97bc09de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97c0eda640 1 --2- 172.21.15.5:0/3086276873 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc09da30 0x7f97bc09de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97c0eda640 1 -- 172.21.15.5:0/3086276873 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97bc0a03e0 msgr2=0x7f97bc09e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97c0eda640 1 --2- 172.21.15.5:0/3086276873 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97bc0a03e0 0x7f97bc09e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97c0eda640 10 monclient: _finish_hunting 0 2024-08-18T21:10:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97c0eda640 1 monclient: found mon.noname-e 2024-08-18T21:10:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97c0eda640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97c0eda640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:10:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.137+0000 7f97c0eda640 1 -- 172.21.15.5:0/3086276873 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97bc09faa0 con 0x7f97bc0a3110 2024-08-18T21:10:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c0eda640 1 -- 172.21.15.5:0/3086276873 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f97bc0a3110 msgr2=0x7f97bc1366a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c0eda640 1 --2- 172.21.15.5:0/3086276873 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f97bc0a3110 0x7f97bc1366a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f97b400d180 tx=0x7f97b401f280 comp rx=0 tx=0).ready entity=mon.8 client_cookie=365b80c9895b11cd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97bb7fe640 1 -- 172.21.15.5:0/3086276873 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97b40a7630 con 0x7f97bc0a3110 2024-08-18T21:10:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97bb7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:10:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97bb7fe640 10 monclient: dump: 2024-08-18T21:10:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:15.147 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97bb7fe640 10 monclient: _finish_auth 0 2024-08-18T21:10:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97bb7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:10:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97bb7fe640 1 -- 172.21.15.5:0/3086276873 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b40a77f0 con 0x7f97bc0a3110 2024-08-18T21:10:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97bb7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97bb7fe640 1 -- 172.21.15.5:0/3086276873 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97b40a7e10 con 0x7f97bc0a3110 2024-08-18T21:10:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 5 monclient: authenticate success, global_id 55358 2024-08-18T21:10:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 4 set_mon_vals no callback set 2024-08-18T21:10:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97bb7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:10:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97bb7fe640 10 monclient: dump: 2024-08-18T21:10:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:15.149 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 10 monclient: shutdown 2024-08-18T21:10:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 -- 172.21.15.5:0/3086276873 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f97bc0a3110 msgr2=0x7f97bc1366a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 --2- 172.21.15.5:0/3086276873 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f97bc0a3110 0x7f97bc1366a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f97b400d180 tx=0x7f97b401f280 comp rx=0 tx=0).stop 2024-08-18T21:10:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 -- 172.21.15.5:0/3086276873 shutdown_connections 2024-08-18T21:10:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 --2- 172.21.15.5:0/3086276873 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f97bc0a3110 0x7f97bc1366a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 --2- 172.21.15.5:0/3086276873 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97bc0a03e0 0x7f97bc09e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 --2- 172.21.15.5:0/3086276873 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc09da30 0x7f97bc09de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 -- 172.21.15.5:0/3086276873 >> 172.21.15.5:0/3086276873 conn(0x7f97bc0688d0 msgr2=0x7f97bc068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 -- 172.21.15.5:0/3086276873 shutdown_connections 2024-08-18T21:10:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 -- 172.21.15.5:0/3086276873 wait complete. 2024-08-18T21:10:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 10 monclient: build_initial_monmap 2024-08-18T21:10:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 10 monclient: monmap: 2024-08-18T21:10:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:15.151 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:15.151 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:15.151 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:15.151 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:15.151 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:15.151 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:15.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 Processor -- start 2024-08-18T21:10:15.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 -- start start 2024-08-18T21:10:15.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 10 monclient: init 2024-08-18T21:10:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 10 monclient: _add_conns ranks=[7,2,3,4,1,6,8,0,5] 2024-08-18T21:10:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f97bc09da30 0x7f97bc1d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 10 monclient(hunting): picked mon.noname-i con 0x7f97bc09da30 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97bc0a3110 0x7f97bc1d2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 10 monclient(hunting): picked mon.noname-b con 0x7f97bc0a3110 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97bc071740 0x7f97bc071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 10 monclient(hunting): picked mon.noname-g con 0x7f97bc071740 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f97bc06cd20 con 0x7f97bc0a3110 2024-08-18T21:10:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f97bc06cba0 con 0x7f97bc071740 2024-08-18T21:10:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f97bc06cea0 con 0x7f97bc09da30 2024-08-18T21:10:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.141+0000 7f97c293d640 10 monclient(hunting): authenticate will time out at 1382.159913s 2024-08-18T21:10:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97bc0a3110 0x7f97bc1d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97bc0a3110 0x7f97bc1d2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33146/0 (socket says 172.21.15.5:33146) 2024-08-18T21:10:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 1 -- 172.21.15.5:0/918629372 learned_addr learned my addr 172.21.15.5:0/918629372 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 10 monclient(hunting): get_auth_request con 0x7f97bc0a3110 auth_method 0 2024-08-18T21:10:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97bbfff640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f97bc09da30 0x7f97bc1d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97c0eda640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97bc071740 0x7f97bc071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97bbfff640 10 monclient(hunting): get_auth_request con 0x7f97bc09da30 auth_method 0 2024-08-18T21:10:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97c0eda640 10 monclient(hunting): get_auth_request con 0x7f97bc071740 auth_method 0 2024-08-18T21:10:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97c0eda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97c0eda640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97c0eda640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 10 monclient(hunting): handle_auth_done global_id 84638 payload 824 2024-08-18T21:10:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 1 -- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f97bc09da30 msgr2=0x7f97bc1d1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f97bc09da30 0x7f97bc1d1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 1 -- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97bc071740 msgr2=0x7f97bc071b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97bc071740 0x7f97bc071b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 10 monclient: _finish_hunting 0 2024-08-18T21:10:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 1 monclient: found mon.noname-b 2024-08-18T21:10:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:10:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 1 -- 172.21.15.5:0/918629372 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97bc138920 con 0x7f97bc0a3110 2024-08-18T21:10:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 1 -- 172.21.15.5:0/918629372 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97bc0a3110 msgr2=0x7f97bc1d2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b37fe640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97bc0a3110 0x7f97bc1d2250 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f97a400d800 tx=0x7f97a400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b97fa640 1 -- 172.21.15.5:0/918629372 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97a400bd40 con 0x7f97bc0a3110 2024-08-18T21:10:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b97fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:10:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b97fa640 10 monclient: dump: 2024-08-18T21:10:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:15.161 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:15.161 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:15.161 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:15.161 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:15.161 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:15.161 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:15.161 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:15.161 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:15.161 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:15.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b97fa640 10 monclient: _finish_auth 0 2024-08-18T21:10:15.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b97fa640 10 monclient: _check_auth_tickets 2024-08-18T21:10:15.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:15.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97c293d640 5 monclient: authenticate success, global_id 84638 2024-08-18T21:10:15.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b97fa640 1 -- 172.21.15.5:0/918629372 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a4014430 con 0x7f97bc0a3110 2024-08-18T21:10:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97c293d640 10 monclient: _renew_subs 2024-08-18T21:10:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97c293d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:10:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97c293d640 1 -- 172.21.15.5:0/918629372 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97bc0736d0 con 0x7f97bc0a3110 2024-08-18T21:10:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b97fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b97fa640 1 -- 172.21.15.5:0/918629372 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97a4014a50 con 0x7f97bc0a3110 2024-08-18T21:10:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b97fa640 10 monclient: dump: 2024-08-18T21:10:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:15.163 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97c293d640 10 monclient: _renew_subs 2024-08-18T21:10:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97c293d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:10:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97c293d640 1 -- 172.21.15.5:0/918629372 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f97bc0a87c0 con 0x7f97bc0a3110 2024-08-18T21:10:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97baffd640 4 set_mon_vals no callback set 2024-08-18T21:10:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97c293d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97c293d640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc0a03e0 0x7f97bc072080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97c293d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97c293d640 1 -- 172.21.15.5:0/918629372 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f97bc073d90 con 0x7f97bc0a03e0 2024-08-18T21:10:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.145+0000 7f97b97fa640 1 -- 172.21.15.5:0/918629372 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f97a401b030 con 0x7f97bc0a3110 2024-08-18T21:10:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97b97fa640 1 --2- 172.21.15.5:0/918629372 >> v2:172.21.15.157:6812/631023601 conn(0x7f979c03bdc0 0x7f979c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97b97fa640 1 -- 172.21.15.5:0/918629372 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(183..183 src has 22..183) ==== 3898+0+0 (secure 0 0 0) 0x7f97a4019020 con 0x7f97bc0a3110 2024-08-18T21:10:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97bbfff640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc0a03e0 0x7f97bc072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97bbfff640 10 monclient: get_auth_request con 0x7f97bc0a03e0 auth_method 0 2024-08-18T21:10:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:15.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:15.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97bbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:15.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97bbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:15.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97bbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:15.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97c0eda640 1 --2- 172.21.15.5:0/918629372 >> v2:172.21.15.157:6812/631023601 conn(0x7f979c03bdc0 0x7f979c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97c0eda640 10 monclient: get_auth_request con 0x7f979c03bdc0 auth_method 0 2024-08-18T21:10:15.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97bbfff640 10 monclient(hunting): handle_auth_done global_id 94361 payload 824 2024-08-18T21:10:15.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97bbfff640 1 -- 172.21.15.5:0/918629372 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97bc06dbf0 con 0x7f97bc0a03e0 2024-08-18T21:10:15.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97bbfff640 1 -- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc0a03e0 msgr2=0x7f97bc072080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:15.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97bbfff640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc0a03e0 0x7f97bc072080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00f4b0 tx=0x7f97ac00f970 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:15.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97c0eda640 1 --2- 172.21.15.5:0/918629372 >> v2:172.21.15.157:6812/631023601 conn(0x7f979c03bdc0 0x7f979c03e280 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f97b400d150 tx=0x7f97b4004ac0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:15.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97b97fa640 1 -- 172.21.15.5:0/918629372 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97ac019020 con 0x7f97bc0a03e0 2024-08-18T21:10:15.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:15.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97b97fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:10:15.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.149+0000 7f97b97fa640 10 monclient: dump: 2024-08-18T21:10:15.167 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:15.167 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:15.167 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.168 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.168 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:15.168 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:15.168 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:15.168 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:15.168 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:15.168 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:15.168 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:15.168 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:15.168 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:15.168 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:15.168 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:15.168 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.153+0000 7f97b97fa640 1 -- 172.21.15.5:0/918629372 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f97ac014880 con 0x7f97bc0a03e0 2024-08-18T21:10:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.153+0000 7f97b97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.153+0000 7f97b97fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.153+0000 7f97b97fa640 1 -- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc0a03e0 msgr2=0x7f97bc072080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.153+0000 7f97b97fa640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc0a03e0 0x7f97bc072080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00f4b0 tx=0x7f97ac00f970 comp rx=0 tx=0).stop 2024-08-18T21:10:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.153+0000 7f97b97fa640 1 -- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc0a03e0 msgr2=0x7f97bc072080 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.153+0000 7f97b97fa640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc0a03e0 0x7f97bc072080 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.157+0000 7f97c293d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.157+0000 7f97c293d640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc0725c0 0x7f97bc133d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.157+0000 7f97c293d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.157+0000 7f97c293d640 1 -- 172.21.15.5:0/918629372 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f97bc051140 con 0x7f97bc0725c0 2024-08-18T21:10:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.157+0000 7f97bbfff640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc0725c0 0x7f97bc133d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.157+0000 7f97bbfff640 10 monclient: get_auth_request con 0x7f97bc0725c0 auth_method 0 2024-08-18T21:10:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.157+0000 7f97bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.157+0000 7f97bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.157+0000 7f97bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.157+0000 7f97bbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.157+0000 7f97bbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.157+0000 7f97bbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.157+0000 7f97bbfff640 10 monclient(hunting): handle_auth_done global_id 94370 payload 824 2024-08-18T21:10:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.157+0000 7f97bbfff640 1 -- 172.21.15.5:0/918629372 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f97bc077370 con 0x7f97bc0725c0 2024-08-18T21:10:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97bbfff640 1 -- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc0725c0 msgr2=0x7f97bc133d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97bbfff640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc0725c0 0x7f97bc133d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f97ac01a000 tx=0x7f97ac0046d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97b97fa640 1 -- 172.21.15.5:0/918629372 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97ac019040 con 0x7f97bc0725c0 2024-08-18T21:10:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97b97fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:10:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97b97fa640 10 monclient: dump: 2024-08-18T21:10:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.173 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.173 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:15.173 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:15.173 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:15.173 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:15.173 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:15.173 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:15.173 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:15.173 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:15.173 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:15.174 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:15.174 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:15.174 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:15.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97b97fa640 1 -- 172.21.15.5:0/918629372 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9236 (secure 0 0 0) 0x7f97ac004020 con 0x7f97bc0725c0 2024-08-18T21:10:15.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97b97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:15.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97b97fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:15.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97b97fa640 1 -- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc0725c0 msgr2=0x7f97bc133d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:15.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97b97fa640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc0725c0 0x7f97bc133d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f97ac01a000 tx=0x7f97ac0046d0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97b97fa640 1 -- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc0725c0 msgr2=0x7f97bc133d40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:15.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97b97fa640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f97bc0725c0 0x7f97bc133d40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.175 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 150, 2024-08-18T21:10:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 43199, 2024-08-18T21:10:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:10:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:15.199 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:15.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97c293d640 1 -- 172.21.15.5:0/918629372 >> v2:172.21.15.157:6812/631023601 conn(0x7f979c03bdc0 msgr2=0x7f979c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:15.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97c293d640 1 --2- 172.21.15.5:0/918629372 >> v2:172.21.15.157:6812/631023601 conn(0x7f979c03bdc0 0x7f979c03e280 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f97b400d150 tx=0x7f97b4004ac0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97c293d640 10 monclient: shutdown 2024-08-18T21:10:15.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97c293d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:15.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97c293d640 1 -- 172.21.15.5:0/918629372 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97bc0a3110 msgr2=0x7f97bc1d2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:15.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97c0eda640 1 -- 172.21.15.5:0/918629372 reap_dead start 2024-08-18T21:10:15.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.161+0000 7f97c293d640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97bc0a3110 0x7f97bc1d2250 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f97a400d800 tx=0x7f97a400dcc0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.165+0000 7f97c293d640 1 -- 172.21.15.5:0/918629372 shutdown_connections 2024-08-18T21:10:15.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.165+0000 7f97c293d640 1 --2- 172.21.15.5:0/918629372 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97bc0a3110 0x7f97bc1d2250 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.165+0000 7f97c293d640 1 -- 172.21.15.5:0/918629372 >> 172.21.15.5:0/918629372 conn(0x7f97bc0688d0 msgr2=0x7f97bc0a7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:15.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.165+0000 7f97c293d640 1 -- 172.21.15.5:0/918629372 shutdown_connections 2024-08-18T21:10:15.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.165+0000 7f97c293d640 1 -- 172.21.15.5:0/918629372 wait complete. 2024-08-18T21:10:15.202 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-18T21:10:15.202 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-08-18T21:10:15.202 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:10:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 10 monclient: get_monmap_and_config 2024-08-18T21:10:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 10 monclient: build_initial_monmap 2024-08-18T21:10:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 10 monclient: monmap: 2024-08-18T21:10:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:15.329 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:15.329409+0000 2024-08-18T21:10:15.329 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:15.329409+0000 2024-08-18T21:10:15.329 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:15.329 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:15.329 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:15.329 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:15.331 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:15.331 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:15.331 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:15.331 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:15.331 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:15.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 1 Processor -- start 2024-08-18T21:10:15.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 1 -- start start 2024-08-18T21:10:15.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 10 monclient: init 2024-08-18T21:10:15.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:15.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 10 monclient: _add_conns ranks=[2,0,6,8,4,5,9,10,7,1,3] 2024-08-18T21:10:15.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f68100a6ce0 0x7f68100a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 10 monclient(hunting): picked mon.noname-b con 0x7f68100a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f68100a7600 addr v1:172.21.15.5:6789/0 2024-08-18T21:10:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f681013a1b0 0x7f6810141d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 10 monclient(hunting): picked mon.noname-d con 0x7f681013a1b0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68100a45d0 con 0x7f68100a7600 2024-08-18T21:10:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f68100a5000 con 0x7f68100a6ce0 2024-08-18T21:10:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f68100a32d0 con 0x7f681013a1b0 2024-08-18T21:10:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f6815a4f640 10 monclient(hunting): authenticate will time out at 1382.342780s 2024-08-18T21:10:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680e7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f68100a7600 0x7f6810139aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56442/0 (socket says 172.21.15.5:56442) 2024-08-18T21:10:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f681013a1b0 0x7f6810141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680effd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f68100a6ce0 0x7f68100a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680e7fc640 1 -- 172.21.15.5:0/139170457 learned_addr learned my addr 172.21.15.5:0/139170457 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:10:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 10 monclient(hunting): get_auth_request con 0x7f681013a1b0 auth_method 0 2024-08-18T21:10:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:15.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:15.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680effd640 10 monclient(hunting): get_auth_request con 0x7f68100a6ce0 auth_method 0 2024-08-18T21:10:15.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:15.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:15.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:15.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 10 monclient(hunting): handle_auth_done global_id 84822 payload 274 2024-08-18T21:10:15.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 1 -- 172.21.15.5:0/139170457 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f68100a6ce0 msgr2=0x7f68100a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:15.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 1 --2- 172.21.15.5:0/139170457 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f68100a6ce0 0x7f68100a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 1 -- 172.21.15.5:0/139170457 >> v1:172.21.15.5:6789/0 conn(0x7f68100a7600 legacy=0x7f6810139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:15.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:10:15.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 1 monclient: found mon.noname-d 2024-08-18T21:10:15.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:15.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:10:15.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680f7fe640 1 -- 172.21.15.5:0/139170457 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68100a8900 con 0x7f681013a1b0 2024-08-18T21:10:15.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.325+0000 7f680effd640 1 --2- 172.21.15.5:0/139170457 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f68100a6ce0 0x7f68100a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:15.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.329+0000 7f680f7fe640 1 -- 172.21.15.5:0/139170457 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f681013a1b0 msgr2=0x7f6810141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:15.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.329+0000 7f680f7fe640 1 --2- 172.21.15.5:0/139170457 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f681013a1b0 0x7f6810141d00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6808009dc0 tx=0x7f680801c850 comp rx=0 tx=0).ready entity=mon.6 client_cookie=51b3f296b3283bd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.329+0000 7f680dffb640 1 -- 172.21.15.5:0/139170457 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68080b2070 con 0x7f681013a1b0 2024-08-18T21:10:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.329+0000 7f680dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680dffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:10:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680dffb640 10 monclient: dump: 2024-08-18T21:10:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:15.358 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:15.358 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:15.358 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:15.358 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:15.358 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:15.358 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:15.358 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:15.358 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:15.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680dffb640 10 monclient: _finish_auth 0 2024-08-18T21:10:15.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680dffb640 10 monclient: _check_auth_tickets 2024-08-18T21:10:15.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:15.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680dffb640 1 -- 172.21.15.5:0/139170457 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68080a5aa0 con 0x7f681013a1b0 2024-08-18T21:10:15.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680dffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:15.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680dffb640 1 -- 172.21.15.5:0/139170457 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68080a5c50 con 0x7f681013a1b0 2024-08-18T21:10:15.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 5 monclient: authenticate success, global_id 84822 2024-08-18T21:10:15.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:15.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 4 set_mon_vals no callback set 2024-08-18T21:10:15.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:15.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:15.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680dffb640 10 monclient: dump: 2024-08-18T21:10:15.360 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:15.360 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:15.360 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.360 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.361 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:15.361 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:15.361 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:15.361 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:15.361 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:15.361 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:15.361 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:15.361 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:15.361 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:15.361 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:15.361 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:15.362 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:15.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 10 monclient: shutdown 2024-08-18T21:10:15.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:15.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 1 -- 172.21.15.5:0/139170457 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f681013a1b0 msgr2=0x7f6810141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:15.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 1 --2- 172.21.15.5:0/139170457 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f681013a1b0 0x7f6810141d00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6808009dc0 tx=0x7f680801c850 comp rx=0 tx=0).stop 2024-08-18T21:10:15.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 1 -- 172.21.15.5:0/139170457 shutdown_connections 2024-08-18T21:10:15.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 1 --2- 172.21.15.5:0/139170457 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f681013a1b0 0x7f6810141d00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 1 --2- 172.21.15.5:0/139170457 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f68100a6ce0 0x7f68100a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 1 -- 172.21.15.5:0/139170457 >> 172.21.15.5:0/139170457 conn(0x7f68100acbc0 msgr2=0x7f68100a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:15.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 1 -- 172.21.15.5:0/139170457 shutdown_connections 2024-08-18T21:10:15.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 1 -- 172.21.15.5:0/139170457 wait complete. 2024-08-18T21:10:15.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 10 monclient: build_initial_monmap 2024-08-18T21:10:15.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 10 monclient: monmap: 2024-08-18T21:10:15.363 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:15.363 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:15.363 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:15.363 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:15.363 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:15.363 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:15.363 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:15.363 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:15.363 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:15.364 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:15.364 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:15.364 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:15.364 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:15.364 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:15.364 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:15.364 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:15.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 1 Processor -- start 2024-08-18T21:10:15.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 1 -- start start 2024-08-18T21:10:15.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 10 monclient: init 2024-08-18T21:10:15.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:15.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 10 monclient: _add_conns ranks=[3,6,4,5,1,7,8,0,2] 2024-08-18T21:10:15.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68100a6ce0 0x7f6810134ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 10 monclient(hunting): picked mon.noname-g con 0x7f68100a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:15.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f68100a7600 0x7f6810135220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 10 monclient(hunting): picked mon.noname-d con 0x7f68100a7600 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:15.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f681013a1b0 0x7f681013aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 10 monclient(hunting): picked mon.noname-c con 0x7f681013a1b0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:15.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:15.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f68100a79e0 con 0x7f68100a6ce0 2024-08-18T21:10:15.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:15.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f68100a8220 con 0x7f681013a1b0 2024-08-18T21:10:15.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:15.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f68100a20b0 con 0x7f68100a7600 2024-08-18T21:10:15.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:15.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f6815a4f640 10 monclient(hunting): authenticate will time out at 1382.350484s 2024-08-18T21:10:15.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f68100a7600 0x7f6810135220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680f7fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f681013a1b0 0x7f681013aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680f7fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f681013a1b0 0x7f681013aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:45132/0 (socket says 172.21.15.5:45132) 2024-08-18T21:10:15.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f68100a7600 0x7f6810135220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:58506/0 (socket says 172.21.15.5:58506) 2024-08-18T21:10:15.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680f7fe640 1 -- 172.21.15.5:0/2627421355 learned_addr learned my addr 172.21.15.5:0/2627421355 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:15.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680f7fe640 10 monclient(hunting): get_auth_request con 0x7f681013a1b0 auth_method 0 2024-08-18T21:10:15.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:15.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:15.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:15.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 10 monclient(hunting): get_auth_request con 0x7f68100a7600 auth_method 0 2024-08-18T21:10:15.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:15.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:15.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:15.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:15.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:15.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:15.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:15.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:15.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:15.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 10 monclient(hunting): handle_auth_done global_id 84831 payload 824 2024-08-18T21:10:15.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680effd640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68100a6ce0 0x7f6810134ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 1 -- 172.21.15.5:0/2627421355 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f681013a1b0 msgr2=0x7f681013aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:15.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f681013a1b0 0x7f681013aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 1 -- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68100a6ce0 msgr2=0x7f6810134ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:15.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68100a6ce0 0x7f6810134ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:10:15.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 1 monclient: found mon.noname-d 2024-08-18T21:10:15.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:15.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:10:15.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680e7fc640 1 -- 172.21.15.5:0/2627421355 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68100a2520 con 0x7f68100a7600 2024-08-18T21:10:15.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680effd640 10 monclient: get_auth_request con 0x7f68100a6ce0 auth_method 0 2024-08-18T21:10:15.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680f7fe640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f681013a1b0 0x7f681013aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:15.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.333+0000 7f680effd640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68100a6ce0 0x7f6810134ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:10:15.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f680e7fc640 1 -- 172.21.15.5:0/2627421355 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f68100a7600 msgr2=0x7f6810135220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:15.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f680e7fc640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f68100a7600 0x7f6810135220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f680000c410 tx=0x7f680000c8d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:15.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f67f7fff640 1 -- 172.21.15.5:0/2627421355 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6800017070 con 0x7f68100a7600 2024-08-18T21:10:15.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f67f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:15.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f67f7fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:10:15.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f67f7fff640 10 monclient: dump: 2024-08-18T21:10:15.370 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:15.370 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:15.370 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.370 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.370 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:15.370 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:15.370 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:15.370 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:15.370 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:15.370 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:15.370 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:15.370 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:15.371 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f67f7fff640 10 monclient: _finish_auth 0 2024-08-18T21:10:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f67f7fff640 10 monclient: _check_auth_tickets 2024-08-18T21:10:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f67f7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f67f7fff640 1 -- 172.21.15.5:0/2627421355 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6800005d00 con 0x7f68100a7600 2024-08-18T21:10:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f67f7fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f67f7fff640 1 -- 172.21.15.5:0/2627421355 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6800007540 con 0x7f68100a7600 2024-08-18T21:10:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f67f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f67f7fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f67f7fff640 10 monclient: dump: 2024-08-18T21:10:15.372 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:15.372 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:15.372 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.372 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.372 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:15.372 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:15.372 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:15.372 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:15.372 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:15.372 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:15.372 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:15.372 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:15.372 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:15.373 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f680d7fa640 4 set_mon_vals no callback set 2024-08-18T21:10:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f6815a4f640 5 monclient: authenticate success, global_id 84831 2024-08-18T21:10:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f6815a4f640 10 monclient: _renew_subs 2024-08-18T21:10:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f6815a4f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f6815a4f640 1 -- 172.21.15.5:0/2627421355 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f681013c130 con 0x7f68100a7600 2024-08-18T21:10:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f6815a4f640 10 monclient: _renew_subs 2024-08-18T21:10:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f6815a4f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f6815a4f640 1 -- 172.21.15.5:0/2627421355 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f6810141940 con 0x7f68100a7600 2024-08-18T21:10:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f6815a4f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:15.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f6815a4f640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f681013aff0 0x7f681013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f6815a4f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:15.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f6815a4f640 1 -- 172.21.15.5:0/2627421355 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f68100a7b60 con 0x7f681013aff0 2024-08-18T21:10:15.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f67f7fff640 1 -- 172.21.15.5:0/2627421355 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f6800007070 con 0x7f68100a7600 2024-08-18T21:10:15.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f680effd640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f681013aff0 0x7f681013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f67f7fff640 1 --2- 172.21.15.5:0/2627421355 >> v2:172.21.15.157:6812/631023601 conn(0x7f67fc03bdc0 0x7f67fc03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f680effd640 10 monclient: get_auth_request con 0x7f681013aff0 auth_method 0 2024-08-18T21:10:15.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f680effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:15.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f680effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:15.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f680effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f67f7fff640 1 -- 172.21.15.5:0/2627421355 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(183..183 src has 22..183) ==== 3898+0+0 (secure 0 0 0) 0x7f680004da50 con 0x7f68100a7600 2024-08-18T21:10:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f680effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f680effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f680effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f680f7fe640 1 --2- 172.21.15.5:0/2627421355 >> v2:172.21.15.157:6812/631023601 conn(0x7f67fc03bdc0 0x7f67fc03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f680f7fe640 10 monclient: get_auth_request con 0x7f67fc03bdc0 auth_method 0 2024-08-18T21:10:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f680effd640 10 monclient(hunting): handle_auth_done global_id 5992 payload 824 2024-08-18T21:10:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.337+0000 7f680effd640 1 -- 172.21.15.5:0/2627421355 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f681013e220 con 0x7f681013aff0 2024-08-18T21:10:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.341+0000 7f680effd640 1 -- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f681013aff0 msgr2=0x7f681013b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.341+0000 7f680effd640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f681013aff0 0x7f681013b3d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f68040107c0 tx=0x7f6804010c80 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:15.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.341+0000 7f680f7fe640 1 --2- 172.21.15.5:0/2627421355 >> v2:172.21.15.157:6812/631023601 conn(0x7f67fc03bdc0 0x7f67fc03e280 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6808009bd0 tx=0x7f68080a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:15.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.341+0000 7f67f7fff640 1 -- 172.21.15.5:0/2627421355 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f680400f040 con 0x7f681013aff0 2024-08-18T21:10:15.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.341+0000 7f67f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:15.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.341+0000 7f67f7fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:10:15.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.341+0000 7f67f7fff640 10 monclient: dump: 2024-08-18T21:10:15.376 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:15.376 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:15.376 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.376 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.377 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:15.377 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:15.377 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:15.377 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:15.377 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:15.377 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:15.377 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:15.377 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:15.377 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:15.377 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:15.377 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:15.377 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:15.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.341+0000 7f67f7fff640 1 -- 172.21.15.5:0/2627421355 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f680401c400 con 0x7f681013aff0 2024-08-18T21:10:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.341+0000 7f67f7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.341+0000 7f67f7fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.341+0000 7f67f7fff640 1 -- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f681013aff0 msgr2=0x7f681013b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.341+0000 7f67f7fff640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f681013aff0 0x7f681013b3d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f68040107c0 tx=0x7f6804010c80 comp rx=0 tx=0).stop 2024-08-18T21:10:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.341+0000 7f67f7fff640 1 -- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f681013aff0 msgr2=0x7f681013b3d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.341+0000 7f67f7fff640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f681013aff0 0x7f681013b3d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.349+0000 7f6815a4f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:15.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.349+0000 7f6815a4f640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f681013b910 0x7f6810138e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:15.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.349+0000 7f6815a4f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:15.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.349+0000 7f6815a4f640 1 -- 172.21.15.5:0/2627421355 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f6810051140 con 0x7f681013b910 2024-08-18T21:10:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.349+0000 7f680effd640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f681013b910 0x7f6810138e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.349+0000 7f680effd640 10 monclient: get_auth_request con 0x7f681013b910 auth_method 0 2024-08-18T21:10:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.349+0000 7f680effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.349+0000 7f680effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.349+0000 7f680effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.349+0000 7f680effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.349+0000 7f680effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.349+0000 7f680effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.349+0000 7f680effd640 10 monclient(hunting): handle_auth_done global_id 6001 payload 824 2024-08-18T21:10:15.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.349+0000 7f680effd640 1 -- 172.21.15.5:0/2627421355 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f68100a70c0 con 0x7f681013b910 2024-08-18T21:10:15.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f680effd640 1 -- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f681013b910 msgr2=0x7f6810138e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:15.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f680effd640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f681013b910 0x7f6810138e20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6804011010 tx=0x7f68040046d0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:15.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f67f7fff640 1 -- 172.21.15.5:0/2627421355 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68040064c0 con 0x7f681013b910 2024-08-18T21:10:15.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f67f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:15.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f67f7fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:10:15.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f67f7fff640 10 monclient: dump: 2024-08-18T21:10:15.383 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:15.383 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:15.383 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.383 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:15.385 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:15.385 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:15.385 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:15.385 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:15.385 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:15.385 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:15.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f67f7fff640 1 -- 172.21.15.5:0/2627421355 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9571 (secure 0 0 0) 0x7f6804025070 con 0x7f681013b910 2024-08-18T21:10:15.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f67f7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:15.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f67f7fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:15.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f67f7fff640 1 -- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f681013b910 msgr2=0x7f6810138e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:15.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f67f7fff640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f681013b910 0x7f6810138e20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6804011010 tx=0x7f68040046d0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f67f7fff640 1 -- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f681013b910 msgr2=0x7f6810138e20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:15.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f67f7fff640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f681013b910 0x7f6810138e20 secure :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6804011010 tx=0x7f68040046d0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.387 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 150, 2024-08-18T21:10:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 424450, 2024-08-18T21:10:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:10:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:10:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:10:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:10:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:15.419 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f6815a4f640 1 -- 172.21.15.5:0/2627421355 >> v2:172.21.15.157:6812/631023601 conn(0x7f67fc03bdc0 msgr2=0x7f67fc03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f6815a4f640 1 --2- 172.21.15.5:0/2627421355 >> v2:172.21.15.157:6812/631023601 conn(0x7f67fc03bdc0 0x7f67fc03e280 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6808009bd0 tx=0x7f68080a7070 comp rx=0 tx=0).stop 2024-08-18T21:10:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f6815a4f640 10 monclient: shutdown 2024-08-18T21:10:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f6815a4f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f6815a4f640 1 -- 172.21.15.5:0/2627421355 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f68100a7600 msgr2=0x7f6810135220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f6815a4f640 1 --2- 172.21.15.5:0/2627421355 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f68100a7600 0x7f6810135220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f680000c410 tx=0x7f680000c8d0 comp rx=0 tx=0).stop 2024-08-18T21:10:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f680f7fe640 1 -- 172.21.15.5:0/2627421355 reap_dead start 2024-08-18T21:10:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f680f7fe640 1 -- 172.21.15.5:0/2627421355 reap_dead start 2024-08-18T21:10:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f6815a4f640 1 -- 172.21.15.5:0/2627421355 shutdown_connections 2024-08-18T21:10:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f6815a4f640 1 -- 172.21.15.5:0/2627421355 >> 172.21.15.5:0/2627421355 conn(0x7f68100acbc0 msgr2=0x7f68100aaa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f6815a4f640 1 -- 172.21.15.5:0/2627421355 shutdown_connections 2024-08-18T21:10:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:15.353+0000 7f6815a4f640 1 -- 172.21.15.5:0/2627421355 wait complete. 2024-08-18T21:10:15.422 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-18T21:10:15.422 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-18T21:10:15.563 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:15.563 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30399]: starting. 2024-08-18T21:10:15.563 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30399]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30363 2024-08-18T21:10:15.563 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30399]: shutting down. 2024-08-18T21:10:15.566 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:15.567 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:15.567 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:10:15.569 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:10:17.884 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30452]: starting. 2024-08-18T21:10:17.884 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30452]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30451 2024-08-18T21:10:17.884 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30452]: created object 0... 2024-08-18T21:10:17.884 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30452]: created object 25... 2024-08-18T21:10:17.885 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30452]: created object 49... 2024-08-18T21:10:17.885 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30452]: finishing. 2024-08-18T21:10:17.885 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30452]: shutting down. 2024-08-18T21:10:18.708 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30453]: starting. 2024-08-18T21:10:18.708 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30453]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30451 2024-08-18T21:10:18.708 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30453]: shutting down. 2024-08-18T21:10:20.932 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:20.932 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30486]: starting. 2024-08-18T21:10:20.933 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30486]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30451 2024-08-18T21:10:20.933 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30486]: created object 0... 2024-08-18T21:10:20.933 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30486]: created object 25... 2024-08-18T21:10:20.933 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30486]: created object 49... 2024-08-18T21:10:20.933 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30486]: finishing. 2024-08-18T21:10:20.933 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30486]: shutting down. 2024-08-18T21:10:20.992 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:20.992 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30488]: starting. 2024-08-18T21:10:20.992 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30488]: listing objects. 2024-08-18T21:10:20.992 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30488]: listed object 0... 2024-08-18T21:10:20.992 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30488]: listed object 25... 2024-08-18T21:10:20.992 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30488]: saw 50 objects 2024-08-18T21:10:20.992 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30488]: shutting down. 2024-08-18T21:10:21.734 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:21.734 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30487]: starting. 2024-08-18T21:10:21.734 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30487]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30451 2024-08-18T21:10:21.734 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30487]: shutting down. 2024-08-18T21:10:21.739 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:21.739 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:21.739 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:10:21.742 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:10:23.367 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30539]: starting. 2024-08-18T21:10:23.367 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30539]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30538 2024-08-18T21:10:23.367 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30539]: created object 0... 2024-08-18T21:10:23.367 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30539]: created object 25... 2024-08-18T21:10:23.367 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30539]: created object 49... 2024-08-18T21:10:23.367 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30539]: finishing. 2024-08-18T21:10:23.367 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30539]: shutting down. 2024-08-18T21:10:23.947 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30540]: starting. 2024-08-18T21:10:23.947 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30540]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30538 2024-08-18T21:10:23.947 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30540]: shutting down. 2024-08-18T21:10:26.181 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:26.181 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30573]: starting. 2024-08-18T21:10:26.181 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30573]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30538 2024-08-18T21:10:26.181 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30573]: created object 0... 2024-08-18T21:10:26.182 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30573]: created object 25... 2024-08-18T21:10:26.182 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30573]: created object 49... 2024-08-18T21:10:26.182 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30573]: finishing. 2024-08-18T21:10:26.182 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30573]: shutting down. 2024-08-18T21:10:26.242 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:26.243 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30575]: starting. 2024-08-18T21:10:26.243 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30575]: listing objects. 2024-08-18T21:10:26.243 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30575]: listed object 0... 2024-08-18T21:10:26.243 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30575]: listed object 25... 2024-08-18T21:10:26.243 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30575]: saw 50 objects 2024-08-18T21:10:26.243 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30575]: shutting down. 2024-08-18T21:10:26.971 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:26.971 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30574]: starting. 2024-08-18T21:10:26.971 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30574]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30538 2024-08-18T21:10:26.972 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30574]: shutting down. 2024-08-18T21:10:26.976 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:26.976 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:26.976 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:10:26.978 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:10:30.133 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30627]: starting. 2024-08-18T21:10:30.134 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30627]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30626 2024-08-18T21:10:30.134 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30627]: created object 0... 2024-08-18T21:10:30.134 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30627]: created object 25... 2024-08-18T21:10:30.134 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30627]: created object 49... 2024-08-18T21:10:30.134 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30627]: finishing. 2024-08-18T21:10:30.134 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30627]: shutting down. 2024-08-18T21:10:30.919 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30628]: starting. 2024-08-18T21:10:30.919 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30628]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30626 2024-08-18T21:10:30.919 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30628]: shutting down. 2024-08-18T21:10:33.152 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:33.152 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30661]: starting. 2024-08-18T21:10:33.152 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30661]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30626 2024-08-18T21:10:33.152 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30661]: created object 0... 2024-08-18T21:10:33.152 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30661]: created object 25... 2024-08-18T21:10:33.152 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30661]: created object 49... 2024-08-18T21:10:33.152 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30661]: finishing. 2024-08-18T21:10:33.152 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30661]: shutting down. 2024-08-18T21:10:33.209 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:33.209 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30663]: starting. 2024-08-18T21:10:33.209 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30663]: listing objects. 2024-08-18T21:10:33.209 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30663]: listed object 0... 2024-08-18T21:10:33.209 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30663]: listed object 25... 2024-08-18T21:10:33.209 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30663]: saw 50 objects 2024-08-18T21:10:33.209 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30663]: shutting down. 2024-08-18T21:10:33.969 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:33.970 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30662]: starting. 2024-08-18T21:10:33.970 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30662]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30626 2024-08-18T21:10:33.970 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30662]: shutting down. 2024-08-18T21:10:33.973 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:33.973 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:33.973 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:10:33.976 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:10:35.423 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.f 2024-08-18T21:10:35.423 INFO:tasks.ceph.mon.f:Restarting daemon 2024-08-18T21:10:35.424 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-08-18T21:10:35.427 INFO:tasks.ceph.mon.f:Started 2024-08-18T21:10:35.427 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:10:35.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:10:35.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 10 monclient: get_monmap_and_config 2024-08-18T21:10:35.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 10 monclient: build_initial_monmap 2024-08-18T21:10:35.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 10 monclient: monmap: 2024-08-18T21:10:35.563 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:35.565299+0000 2024-08-18T21:10:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:35.565299+0000 2024-08-18T21:10:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:35.565 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:35.565 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:35.565 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:35.565 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 1 Processor -- start 2024-08-18T21:10:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 1 -- start start 2024-08-18T21:10:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 10 monclient: init 2024-08-18T21:10:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 10 monclient: _add_conns ranks=[7,4,3,9,6,10,8,0,1,5,2] 2024-08-18T21:10:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fda240a6ce0 0x7fda240a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 10 monclient(hunting): picked mon.noname-i con 0x7fda240a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:35.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fda240a7600 0x7fda24139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:35.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 10 monclient(hunting): picked mon.noname-c con 0x7fda240a7600 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:35.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda24139fe0 0x7fda2413a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:35.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 10 monclient(hunting): picked mon.noname-g con 0x7fda24139fe0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:35.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:35.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fda240a5000 con 0x7fda24139fe0 2024-08-18T21:10:35.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:35.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fda240a4360 con 0x7fda240a7600 2024-08-18T21:10:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fda240a45d0 con 0x7fda240a6ce0 2024-08-18T21:10:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda29f79640 10 monclient(hunting): authenticate will time out at 1402.578460s 2024-08-18T21:10:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fda240a7600 0x7fda24139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fda240a7600 0x7fda24139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:58830/0 (socket says 172.21.15.5:58830) 2024-08-18T21:10:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 1 -- 172.21.15.5:0/1427282620 learned_addr learned my addr 172.21.15.5:0/1427282620 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 10 monclient(hunting): get_auth_request con 0x7fda240a7600 auth_method 0 2024-08-18T21:10:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda23fff640 1 --2- 172.21.15.5:0/1427282620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda24139fe0 0x7fda2413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda23fff640 10 monclient(hunting): get_auth_request con 0x7fda24139fe0 auth_method 0 2024-08-18T21:10:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda23fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda23fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda23fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda237fe640 1 --2- 172.21.15.5:0/1427282620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fda240a6ce0 0x7fda240a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda237fe640 10 monclient(hunting): get_auth_request con 0x7fda240a6ce0 auth_method 0 2024-08-18T21:10:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda237fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda237fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 10 monclient(hunting): handle_auth_done global_id 6475 payload 274 2024-08-18T21:10:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 1 -- 172.21.15.5:0/1427282620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fda240a6ce0 msgr2=0x7fda240a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 1 --2- 172.21.15.5:0/1427282620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fda240a6ce0 0x7fda240a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 1 -- 172.21.15.5:0/1427282620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda24139fe0 msgr2=0x7fda2413a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 1 --2- 172.21.15.5:0/1427282620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda24139fe0 0x7fda2413a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:10:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 1 monclient: found mon.noname-c 2024-08-18T21:10:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:10:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda22ffd640 1 -- 172.21.15.5:0/1427282620 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda240a32d0 con 0x7fda240a7600 2024-08-18T21:10:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.561+0000 7fda23fff640 1 --2- 172.21.15.5:0/1427282620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda24139fe0 0x7fda2413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:10:35.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda22ffd640 1 -- 172.21.15.5:0/1427282620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fda240a7600 msgr2=0x7fda24139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:35.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda22ffd640 1 --2- 172.21.15.5:0/1427282620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fda240a7600 0x7fda24139aa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fda140098a0 tx=0x7fda1401c440 comp rx=0 tx=0).ready entity=mon.4 client_cookie=4c353e4dc646ffab server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:35.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda227fc640 1 -- 172.21.15.5:0/1427282620 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fda140b0070 con 0x7fda240a7600 2024-08-18T21:10:35.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:35.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda227fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:10:35.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda227fc640 10 monclient: dump: 2024-08-18T21:10:35.580 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:35.580 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:35.580 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:35.581 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:35.581 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:35.581 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:35.581 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:35.581 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:35.581 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:35.583 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda227fc640 10 monclient: _finish_auth 0 2024-08-18T21:10:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda227fc640 10 monclient: _check_auth_tickets 2024-08-18T21:10:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda29f79640 5 monclient: authenticate success, global_id 6475 2024-08-18T21:10:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda29f79640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:10:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda227fc640 1 -- 172.21.15.5:0/1427282620 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda140aa810 con 0x7fda240a7600 2024-08-18T21:10:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda227fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda29f79640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda29f79640 4 set_mon_vals no callback set 2024-08-18T21:10:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda227fc640 1 -- 172.21.15.5:0/1427282620 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fda140aae30 con 0x7fda240a7600 2024-08-18T21:10:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda227fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.565+0000 7fda227fc640 10 monclient: dump: 2024-08-18T21:10:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:35.586 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:35.586 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:35.586 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:35.586 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:35.586 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:35.588 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 10 monclient: shutdown 2024-08-18T21:10:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 -- 172.21.15.5:0/1427282620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fda240a7600 msgr2=0x7fda24139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 --2- 172.21.15.5:0/1427282620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fda240a7600 0x7fda24139aa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fda140098a0 tx=0x7fda1401c440 comp rx=0 tx=0).stop 2024-08-18T21:10:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 -- 172.21.15.5:0/1427282620 shutdown_connections 2024-08-18T21:10:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 --2- 172.21.15.5:0/1427282620 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda24139fe0 0x7fda2413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 --2- 172.21.15.5:0/1427282620 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fda240a7600 0x7fda24139aa0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 --2- 172.21.15.5:0/1427282620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fda240a6ce0 0x7fda240a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 -- 172.21.15.5:0/1427282620 >> 172.21.15.5:0/1427282620 conn(0x7fda240acbc0 msgr2=0x7fda240a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 -- 172.21.15.5:0/1427282620 shutdown_connections 2024-08-18T21:10:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 -- 172.21.15.5:0/1427282620 wait complete. 2024-08-18T21:10:35.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 10 monclient: build_initial_monmap 2024-08-18T21:10:35.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 10 monclient: monmap: 2024-08-18T21:10:35.590 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:35.590 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:35.590 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:35.590 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:35.591 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:35.591 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:35.591 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:35.591 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:35.591 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:35.592 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:35.592 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:35.592 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:35.592 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:35.592 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:35.592 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:35.592 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:35.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 Processor -- start 2024-08-18T21:10:35.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 -- start start 2024-08-18T21:10:35.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 10 monclient: init 2024-08-18T21:10:35.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:35.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 10 monclient: _add_conns ranks=[4,8,3,0,1,2,5,6,7] 2024-08-18T21:10:35.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fda240a6ce0 0x7fda24134e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:35.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 10 monclient(hunting): picked mon.noname-c con 0x7fda240a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:35.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fda240a7600 0x7fda241353b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:35.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 10 monclient(hunting): picked mon.noname-e con 0x7fda240a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:35.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda24139fe0 0x7fda2413aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:35.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 10 monclient(hunting): picked mon.noname-g con 0x7fda24139fe0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:35.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:35.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fda240a79e0 con 0x7fda24139fe0 2024-08-18T21:10:35.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:35.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fda240a8220 con 0x7fda240a6ce0 2024-08-18T21:10:35.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:35.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fda240a7330 con 0x7fda240a7600 2024-08-18T21:10:35.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:35.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda29f79640 10 monclient(hunting): authenticate will time out at 1402.585811s 2024-08-18T21:10:35.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fda240a6ce0 0x7fda24134e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:35.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fda240a6ce0 0x7fda24134e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:58842/0 (socket says 172.21.15.5:58842) 2024-08-18T21:10:35.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 1 -- 172.21.15.5:0/3038344138 learned_addr learned my addr 172.21.15.5:0/3038344138 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:35.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 10 monclient(hunting): get_auth_request con 0x7fda240a6ce0 auth_method 0 2024-08-18T21:10:35.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:35.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:35.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:35.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda22ffd640 1 --2- 172.21.15.5:0/3038344138 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fda240a7600 0x7fda241353b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:35.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda22ffd640 10 monclient(hunting): get_auth_request con 0x7fda240a7600 auth_method 0 2024-08-18T21:10:35.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda22ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:35.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda22ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:35.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:35.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:35.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:35.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda23fff640 1 --2- 172.21.15.5:0/3038344138 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda24139fe0 0x7fda2413aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:35.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:35.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda23fff640 10 monclient(hunting): get_auth_request con 0x7fda24139fe0 auth_method 0 2024-08-18T21:10:35.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda23fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:35.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda23fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:35.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda23fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:35.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda22ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:35.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda22ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:35.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda22ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:35.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda23fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:35.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda23fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:35.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda23fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:35.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 10 monclient(hunting): handle_auth_done global_id 6484 payload 824 2024-08-18T21:10:35.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 1 -- 172.21.15.5:0/3038344138 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fda240a7600 msgr2=0x7fda241353b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:35.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 1 --2- 172.21.15.5:0/3038344138 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fda240a7600 0x7fda241353b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:35.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 1 -- 172.21.15.5:0/3038344138 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda24139fe0 msgr2=0x7fda2413aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:35.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 1 --2- 172.21.15.5:0/3038344138 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda24139fe0 0x7fda2413aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 10 monclient: _finish_hunting 0 2024-08-18T21:10:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 1 monclient: found mon.noname-c 2024-08-18T21:10:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:10:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda237fe640 1 -- 172.21.15.5:0/3038344138 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2413c360 con 0x7fda240a6ce0 2024-08-18T21:10:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.569+0000 7fda22ffd640 1 --2- 172.21.15.5:0/3038344138 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fda240a7600 0x7fda241353b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:35.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda237fe640 1 -- 172.21.15.5:0/3038344138 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fda240a6ce0 msgr2=0x7fda24134e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:35.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda237fe640 1 --2- 172.21.15.5:0/3038344138 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fda240a6ce0 0x7fda24134e70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fda0c00d800 tx=0x7fda0c00dcc0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:35.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda1bfff640 1 -- 172.21.15.5:0/3038344138 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fda0c018020 con 0x7fda240a6ce0 2024-08-18T21:10:35.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda1bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:35.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda1bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:10:35.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda1bfff640 10 monclient: dump: 2024-08-18T21:10:35.604 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:35.604 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:35.604 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:35.604 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:35.604 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:35.605 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:35.605 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:35.605 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:35.605 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:35.605 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:35.606 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:35.606 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:35.606 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:35.606 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:35.606 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:35.607 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:35.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda1bfff640 10 monclient: _finish_auth 0 2024-08-18T21:10:35.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda1bfff640 10 monclient: _check_auth_tickets 2024-08-18T21:10:35.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda1bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:35.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda1bfff640 1 -- 172.21.15.5:0/3038344138 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda0c009d20 con 0x7fda240a6ce0 2024-08-18T21:10:35.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda1bfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:35.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda1bfff640 1 -- 172.21.15.5:0/3038344138 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fda0c014880 con 0x7fda240a6ce0 2024-08-18T21:10:35.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda29f79640 5 monclient: authenticate success, global_id 6484 2024-08-18T21:10:35.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda29f79640 10 monclient: _renew_subs 2024-08-18T21:10:35.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda29f79640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:10:35.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda29f79640 1 -- 172.21.15.5:0/3038344138 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda2413de20 con 0x7fda240a6ce0 2024-08-18T21:10:35.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda21ffb640 4 set_mon_vals no callback set 2024-08-18T21:10:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda1bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda1bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda1bfff640 10 monclient: dump: 2024-08-18T21:10:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:35.612 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda29f79640 10 monclient: _renew_subs 2024-08-18T21:10:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda29f79640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:10:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda29f79640 1 -- 172.21.15.5:0/3038344138 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fda2413f0d0 con 0x7fda240a6ce0 2024-08-18T21:10:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda29f79640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda29f79640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda29f79640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:10:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda29f79640 1 -- 172.21.15.5:0/3038344138 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda24139aa0 con 0x7fda240a6ce0 2024-08-18T21:10:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda1bfff640 1 -- 172.21.15.5:0/3038344138 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fda0c01b020 con 0x7fda240a6ce0 2024-08-18T21:10:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda1bfff640 1 --2- 172.21.15.5:0/3038344138 >> v2:172.21.15.157:6812/631023601 conn(0x7fda0403bdf0 0x7fda0403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:35.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda1bfff640 1 -- 172.21.15.5:0/3038344138 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(203..203 src has 22..203) ==== 3898+0+0 (secure 0 0 0) 0x7fda0c00f040 con 0x7fda240a6ce0 2024-08-18T21:10:35.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda22ffd640 1 --2- 172.21.15.5:0/3038344138 >> v2:172.21.15.157:6812/631023601 conn(0x7fda0403bdf0 0x7fda0403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:35.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.573+0000 7fda22ffd640 10 monclient: get_auth_request con 0x7fda0403bdf0 auth_method 0 2024-08-18T21:10:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.577+0000 7fda22ffd640 1 --2- 172.21.15.5:0/3038344138 >> v2:172.21.15.157:6812/631023601 conn(0x7fda0403bdf0 0x7fda0403e2b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fda140098a0 tx=0x7fda140a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.577+0000 7fda1bfff640 1 -- 172.21.15.5:0/3038344138 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fda0c022070 con 0x7fda240a6ce0 2024-08-18T21:10:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.577+0000 7fda1bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.577+0000 7fda1bfff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:35.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:10:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:10:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:10:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 1 -- 172.21.15.5:0/3038344138 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fda2413dff0 con 0x7fda240a6ce0 2024-08-18T21:10:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda1bfff640 1 -- 172.21.15.5:0/3038344138 <== mon.4 v2:172.21.15.5:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3168 (secure 0 0 0) 0x7fda0c0145f0 con 0x7fda240a6ce0 2024-08-18T21:10:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda1bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:10:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda1bfff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:35.820 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":150,"quorum":[0,2,3,4,5,6,7,8],"quorum_names":["a","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:10:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 1 -- 172.21.15.5:0/3038344138 >> v2:172.21.15.157:6812/631023601 conn(0x7fda0403bdf0 msgr2=0x7fda0403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 1 --2- 172.21.15.5:0/3038344138 >> v2:172.21.15.157:6812/631023601 conn(0x7fda0403bdf0 0x7fda0403e2b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fda140098a0 tx=0x7fda140a6000 comp rx=0 tx=0).stop 2024-08-18T21:10:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 10 monclient: shutdown 2024-08-18T21:10:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 1 -- 172.21.15.5:0/3038344138 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fda240a6ce0 msgr2=0x7fda24134e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 1 --2- 172.21.15.5:0/3038344138 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fda240a6ce0 0x7fda24134e70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fda0c00d800 tx=0x7fda0c00dcc0 comp rx=0 tx=0).stop 2024-08-18T21:10:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 1 -- 172.21.15.5:0/3038344138 shutdown_connections 2024-08-18T21:10:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 1 --2- 172.21.15.5:0/3038344138 >> v2:172.21.15.157:6812/631023601 conn(0x7fda0403bdf0 0x7fda0403e2b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 1 --2- 172.21.15.5:0/3038344138 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda24139fe0 0x7fda2413aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 1 --2- 172.21.15.5:0/3038344138 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fda240a7600 0x7fda241353b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 1 --2- 172.21.15.5:0/3038344138 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fda240a6ce0 0x7fda24134e70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 1 -- 172.21.15.5:0/3038344138 >> 172.21.15.5:0/3038344138 conn(0x7fda240acbc0 msgr2=0x7fda24138730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 1 -- 172.21.15.5:0/3038344138 shutdown_connections 2024-08-18T21:10:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:35.817+0000 7fda29f79640 1 -- 172.21.15.5:0/3038344138 wait complete. 2024-08-18T21:10:36.214 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30714]: starting. 2024-08-18T21:10:36.214 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30714]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30713 2024-08-18T21:10:36.215 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30714]: created object 0... 2024-08-18T21:10:36.215 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30714]: created object 25... 2024-08-18T21:10:36.215 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30714]: created object 49... 2024-08-18T21:10:36.215 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30714]: finishing. 2024-08-18T21:10:36.215 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30714]: shutting down. 2024-08-18T21:10:36.938 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30715]: starting. 2024-08-18T21:10:36.938 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30715]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30713 2024-08-18T21:10:36.938 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30715]: shutting down. 2024-08-18T21:10:38.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:10:38.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.969+0000 7f381f182640 10 monclient: get_monmap_and_config 2024-08-18T21:10:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.969+0000 7f381f182640 10 monclient: build_initial_monmap 2024-08-18T21:10:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.969+0000 7f381f182640 10 monclient: monmap: 2024-08-18T21:10:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:38.974617+0000 2024-08-18T21:10:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:38.974617+0000 2024-08-18T21:10:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:38.974 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.969+0000 7f381f182640 1 Processor -- start 2024-08-18T21:10:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.969+0000 7f381f182640 1 -- start start 2024-08-18T21:10:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.969+0000 7f381f182640 10 monclient: init 2024-08-18T21:10:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381f182640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381f182640 10 monclient: _add_conns ranks=[10,2,9,0,1,3,4,6,5,7,8] 2024-08-18T21:10:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381f182640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f38180a6ce0 0x7f38180a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381f182640 10 monclient(hunting): picked mon.noname-f con 0x7f38180a6ce0 addr v2:172.21.15.157:3300/0 2024-08-18T21:10:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381f182640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f38180a7600 0x7f3818139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381f182640 10 monclient(hunting): picked mon.noname-b con 0x7f38180a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381f182640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3818139fe0 0x7f381813a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381f182640 10 monclient(hunting): picked mon.noname-a con 0x7f3818139fe0 addr v2:172.21.15.5:3300/0 2024-08-18T21:10:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381f182640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381f182640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f38180a5000 con 0x7f3818139fe0 2024-08-18T21:10:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381f182640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381f182640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f38180a4360 con 0x7f38180a6ce0 2024-08-18T21:10:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381f182640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381f182640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f38180a45d0 con 0x7f38180a7600 2024-08-18T21:10:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381f182640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381f182640 10 monclient(hunting): authenticate will time out at 1405.988460s 2024-08-18T21:10:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3818139fe0 0x7f381813a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f3817fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f38180a7600 0x7f3818139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3818139fe0 0x7f381813a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57146/0 (socket says 172.21.15.5:57146) 2024-08-18T21:10:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 1 -- 172.21.15.5:0/1398178870 learned_addr learned my addr 172.21.15.5:0/1398178870 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f3817fff640 10 monclient(hunting): get_auth_request con 0x7f38180a7600 auth_method 0 2024-08-18T21:10:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f3817fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f3817fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f3817fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 10 monclient(hunting): get_auth_request con 0x7f3818139fe0 auth_method 0 2024-08-18T21:10:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381cf1e640 1 --2- 172.21.15.5:0/1398178870 >> v2:172.21.15.157:3300/0 conn(0x7f38180a6ce0 0x7f38180a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f3817fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f3817fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f3817fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381cf1e640 10 monclient(hunting): get_auth_request con 0x7f38180a6ce0 auth_method 0 2024-08-18T21:10:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381cf1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381cf1e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381cf1e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 10 monclient(hunting): handle_auth_done global_id 84654 payload 274 2024-08-18T21:10:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 1 -- 172.21.15.5:0/1398178870 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f38180a7600 msgr2=0x7f3818139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 1 --2- 172.21.15.5:0/1398178870 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f38180a7600 0x7f3818139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 1 -- 172.21.15.5:0/1398178870 >> v2:172.21.15.157:3300/0 conn(0x7f38180a6ce0 msgr2=0x7f38180a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 1 --2- 172.21.15.5:0/1398178870 >> v2:172.21.15.157:3300/0 conn(0x7f38180a6ce0 0x7f38180a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 10 monclient: _finish_hunting 0 2024-08-18T21:10:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 1 monclient: found mon.noname-a 2024-08-18T21:10:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:10:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f381d71f640 1 -- 172.21.15.5:0/1398178870 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38180a32d0 con 0x7f3818139fe0 2024-08-18T21:10:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.973+0000 7f3817fff640 1 --2- 172.21.15.5:0/1398178870 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f38180a7600 0x7f3818139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:38.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381d71f640 1 -- 172.21.15.5:0/1398178870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3818139fe0 msgr2=0x7f381813a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:38.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381d71f640 1 --2- 172.21.15.5:0/1398178870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3818139fe0 0x7f381813a490 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f381806df00 tx=0x7f381001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9da37f663e4efe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:38.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f38177fe640 1 -- 172.21.15.5:0/1398178870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38100090d0 con 0x7f3818139fe0 2024-08-18T21:10:38.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f38177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:38.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f38177fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:10:38.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f38177fe640 10 monclient: dump: 2024-08-18T21:10:38.984 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:38.984 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:38.984 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:38.985 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:38.985 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:38.985 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:38.985 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:38.985 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:38.985 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:38.985 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:38.985 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:38.985 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:38.985 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:38.985 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:38.985 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:38.985 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:38.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f38177fe640 10 monclient: _finish_auth 0 2024-08-18T21:10:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f38177fe640 10 monclient: _check_auth_tickets 2024-08-18T21:10:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f38177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f38177fe640 1 -- 172.21.15.5:0/1398178870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38100a5a90 con 0x7f3818139fe0 2024-08-18T21:10:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f38177fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f38177fe640 1 -- 172.21.15.5:0/1398178870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38100a5c40 con 0x7f3818139fe0 2024-08-18T21:10:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 5 monclient: authenticate success, global_id 84654 2024-08-18T21:10:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 4 set_mon_vals no callback set 2024-08-18T21:10:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f38177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f38177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f38177fe640 10 monclient: dump: 2024-08-18T21:10:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:38.988 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 10 monclient: shutdown 2024-08-18T21:10:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 -- 172.21.15.5:0/1398178870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3818139fe0 msgr2=0x7f381813a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 --2- 172.21.15.5:0/1398178870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3818139fe0 0x7f381813a490 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f381806df00 tx=0x7f381001c8b0 comp rx=0 tx=0).stop 2024-08-18T21:10:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 -- 172.21.15.5:0/1398178870 shutdown_connections 2024-08-18T21:10:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 --2- 172.21.15.5:0/1398178870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3818139fe0 0x7f381813a490 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 --2- 172.21.15.5:0/1398178870 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f38180a7600 0x7f3818139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 --2- 172.21.15.5:0/1398178870 >> v2:172.21.15.157:3300/0 conn(0x7f38180a6ce0 0x7f38180a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 -- 172.21.15.5:0/1398178870 >> 172.21.15.5:0/1398178870 conn(0x7f38180acbc0 msgr2=0x7f38180a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 -- 172.21.15.5:0/1398178870 shutdown_connections 2024-08-18T21:10:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 -- 172.21.15.5:0/1398178870 wait complete. 2024-08-18T21:10:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 10 monclient: build_initial_monmap 2024-08-18T21:10:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 10 monclient: monmap: 2024-08-18T21:10:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:38.990 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 Processor -- start 2024-08-18T21:10:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 -- start start 2024-08-18T21:10:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 10 monclient: init 2024-08-18T21:10:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 10 monclient: _add_conns ranks=[5,6,0,4,3,1,2,8,7] 2024-08-18T21:10:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f38180a6ce0 0x7f3818134ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 10 monclient(hunting): picked mon.noname-h con 0x7f38180a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f38180a7600 0x7f38181353e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 10 monclient(hunting): picked mon.noname-d con 0x7f38180a7600 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3818139fe0 0x7f381813aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 10 monclient(hunting): picked mon.noname-a con 0x7f3818139fe0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:10:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f38180a79e0 con 0x7f3818139fe0 2024-08-18T21:10:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f38180a8220 con 0x7f38180a6ce0 2024-08-18T21:10:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f38180aa190 con 0x7f38180a7600 2024-08-18T21:10:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.977+0000 7f381f182640 10 monclient(hunting): authenticate will time out at 1405.995998s 2024-08-18T21:10:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f38180a7600 0x7f38181353e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381d71f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3818139fe0 0x7f381813aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381d71f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3818139fe0 0x7f381813aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57158/0 (socket says 172.21.15.5:57158) 2024-08-18T21:10:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f38180a7600 0x7f38181353e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54734/0 (socket says 172.21.15.5:54734) 2024-08-18T21:10:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381d71f640 1 -- 172.21.15.5:0/2664981968 learned_addr learned my addr 172.21.15.5:0/2664981968 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381d71f640 10 monclient(hunting): get_auth_request con 0x7f3818139fe0 auth_method 0 2024-08-18T21:10:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381d71f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381d71f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381d71f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 10 monclient(hunting): get_auth_request con 0x7f38180a7600 auth_method 0 2024-08-18T21:10:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381d71f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381d71f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381cf1e640 1 --2- 172.21.15.5:0/2664981968 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f38180a6ce0 0x7f3818134ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381d71f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381cf1e640 10 monclient(hunting): get_auth_request con 0x7f38180a6ce0 auth_method 0 2024-08-18T21:10:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381cf1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381cf1e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381cf1e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 10 monclient(hunting): handle_auth_done global_id 84921 payload 824 2024-08-18T21:10:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 1 -- 172.21.15.5:0/2664981968 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f38180a6ce0 msgr2=0x7f3818134ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 1 --2- 172.21.15.5:0/2664981968 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f38180a6ce0 0x7f3818134ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 1 -- 172.21.15.5:0/2664981968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3818139fe0 msgr2=0x7f381813aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 1 --2- 172.21.15.5:0/2664981968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3818139fe0 0x7f381813aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 10 monclient: _finish_hunting 0 2024-08-18T21:10:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 1 monclient: found mon.noname-d 2024-08-18T21:10:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:10:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 1 -- 172.21.15.5:0/2664981968 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381813c2f0 con 0x7f38180a7600 2024-08-18T21:10:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381d71f640 1 --2- 172.21.15.5:0/2664981968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3818139fe0 0x7f381813aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381cf1e640 1 --2- 172.21.15.5:0/2664981968 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f38180a6ce0 0x7f3818134ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:10:38.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 1 -- 172.21.15.5:0/2664981968 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f38180a7600 msgr2=0x7f38181353e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:38.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3817fff640 1 --2- 172.21.15.5:0/2664981968 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f38180a7600 0x7f38181353e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f380c00e9b0 tx=0x7f380c00ee70 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:38.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f38157fa640 1 -- 172.21.15.5:0/2664981968 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f380c017070 con 0x7f38180a7600 2024-08-18T21:10:38.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f38157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:38.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f38157fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:10:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f38157fa640 10 monclient: dump: 2024-08-18T21:10:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:38.998 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f38157fa640 10 monclient: _finish_auth 0 2024-08-18T21:10:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f38157fa640 10 monclient: _check_auth_tickets 2024-08-18T21:10:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f38157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f38157fa640 1 -- 172.21.15.5:0/2664981968 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f380c00cbb0 con 0x7f38180a7600 2024-08-18T21:10:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f38157fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f38157fa640 1 -- 172.21.15.5:0/2664981968 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f380c00cd60 con 0x7f38180a7600 2024-08-18T21:10:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f38157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f38157fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f38157fa640 10 monclient: dump: 2024-08-18T21:10:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:39.000 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f3816ffd640 4 set_mon_vals no callback set 2024-08-18T21:10:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381f182640 5 monclient: authenticate success, global_id 84921 2024-08-18T21:10:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381f182640 10 monclient: _renew_subs 2024-08-18T21:10:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381f182640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381f182640 1 -- 172.21.15.5:0/2664981968 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38180a7150 con 0x7f38180a7600 2024-08-18T21:10:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381f182640 10 monclient: _renew_subs 2024-08-18T21:10:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381f182640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.981+0000 7f381f182640 1 -- 172.21.15.5:0/2664981968 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f3818135920 con 0x7f38180a7600 2024-08-18T21:10:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.985+0000 7f3817fff640 1 --2- 172.21.15.5:0/2664981968 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f38180a7600 0x7f38181353e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f380c00e9b0 tx=0x7f380c00ee70 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7f380c00f040 osd_map(206..206 src has 22..206) 2024-08-18T21:10:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.985+0000 7f38157fa640 1 -- 172.21.15.5:0/2664981968 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f380c01a070 con 0x7f38180a7600 2024-08-18T21:10:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.985+0000 7f381f182640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.985+0000 7f381f182640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.985+0000 7f381f182640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.985+0000 7f381f182640 1 -- 172.21.15.5:0/2664981968 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3818139aa0 con 0x7f38180a7600 2024-08-18T21:10:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.985+0000 7f38157fa640 1 --2- 172.21.15.5:0/2664981968 >> v2:172.21.15.157:6812/631023601 conn(0x7f380403bdc0 0x7f380403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.985+0000 7f381cf1e640 1 --2- 172.21.15.5:0/2664981968 >> v2:172.21.15.157:6812/631023601 conn(0x7f380403bdc0 0x7f380403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.985+0000 7f381cf1e640 10 monclient: get_auth_request con 0x7f380403bdc0 auth_method 0 2024-08-18T21:10:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.985+0000 7f381cf1e640 1 --2- 172.21.15.5:0/2664981968 >> v2:172.21.15.157:6812/631023601 conn(0x7f380403bdc0 0x7f380403e280 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3808004660 tx=0x7f3808008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:38.989+0000 7f38157fa640 1 -- 172.21.15.5:0/2664981968 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(206..206 src has 22..206) ==== 3898+0+0 (secure 0 0 0) 0x7f380c00f040 con 0x7f38180a7600 2024-08-18T21:10:39.501 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:39.502 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30790]: starting. 2024-08-18T21:10:39.502 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30790]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30713 2024-08-18T21:10:39.502 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30790]: created object 0... 2024-08-18T21:10:39.502 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30790]: created object 25... 2024-08-18T21:10:39.502 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30790]: created object 49... 2024-08-18T21:10:39.502 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30790]: finishing. 2024-08-18T21:10:39.502 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30790]: shutting down. 2024-08-18T21:10:39.562 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:39.563 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30792]: starting. 2024-08-18T21:10:39.563 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30792]: listing objects. 2024-08-18T21:10:39.563 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30792]: listed object 0... 2024-08-18T21:10:39.563 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30792]: listed object 25... 2024-08-18T21:10:39.563 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30792]: saw 50 objects 2024-08-18T21:10:39.563 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30792]: shutting down. 2024-08-18T21:10:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:39.813+0000 7f38157fa640 1 -- 172.21.15.5:0/2664981968 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f380c021070 con 0x7f38180a7600 2024-08-18T21:10:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:39.813+0000 7f38157fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:39.813+0000 7f38157fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:40.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:10:40.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:10:40.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:40.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 1 -- 172.21.15.5:0/2664981968 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f381813e190 con 0x7f38180a7600 2024-08-18T21:10:40.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f38157fa640 1 -- 172.21.15.5:0/2664981968 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7f380c04d380 con 0x7f38180a7600 2024-08-18T21:10:40.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f38157fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:10:40.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f38157fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:40.068 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":152,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:10:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 1 -- 172.21.15.5:0/2664981968 >> v2:172.21.15.157:6812/631023601 conn(0x7f380403bdc0 msgr2=0x7f380403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 1 --2- 172.21.15.5:0/2664981968 >> v2:172.21.15.157:6812/631023601 conn(0x7f380403bdc0 0x7f380403e280 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3808004660 tx=0x7f3808008040 comp rx=0 tx=0).stop 2024-08-18T21:10:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 10 monclient: shutdown 2024-08-18T21:10:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 1 -- 172.21.15.5:0/2664981968 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f38180a7600 msgr2=0x7f38181353e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 1 --2- 172.21.15.5:0/2664981968 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f38180a7600 0x7f38181353e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f380c00e9b0 tx=0x7f380c00ee70 comp rx=0 tx=0).stop 2024-08-18T21:10:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 1 -- 172.21.15.5:0/2664981968 shutdown_connections 2024-08-18T21:10:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 1 --2- 172.21.15.5:0/2664981968 >> v2:172.21.15.157:6812/631023601 conn(0x7f380403bdc0 0x7f380403e280 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 1 --2- 172.21.15.5:0/2664981968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3818139fe0 0x7f381813aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 1 --2- 172.21.15.5:0/2664981968 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f38180a7600 0x7f38181353e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 1 --2- 172.21.15.5:0/2664981968 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f38180a6ce0 0x7f3818134ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 1 -- 172.21.15.5:0/2664981968 >> 172.21.15.5:0/2664981968 conn(0x7f38180acbc0 msgr2=0x7f3818135c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:40.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 1 -- 172.21.15.5:0/2664981968 shutdown_connections 2024-08-18T21:10:40.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.065+0000 7f381f182640 1 -- 172.21.15.5:0/2664981968 wait complete. 2024-08-18T21:10:40.086 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:10:40.087 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:10:40.087 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:10:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.201+0000 7fe5cfdda640 10 monclient: get_monmap_and_config 2024-08-18T21:10:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.201+0000 7fe5cfdda640 10 monclient: build_initial_monmap 2024-08-18T21:10:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 10 monclient: monmap: 2024-08-18T21:10:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:40.208431+0000 2024-08-18T21:10:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:40.208431+0000 2024-08-18T21:10:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:40.208 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 1 Processor -- start 2024-08-18T21:10:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 1 -- start start 2024-08-18T21:10:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 10 monclient: init 2024-08-18T21:10:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 10 monclient: _add_conns ranks=[2,3,8,0,6,10,4,9,7,1,5] 2024-08-18T21:10:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe5c80a4a40 0x7fe5c80a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 10 monclient(hunting): picked mon.noname-b con 0x7fe5c80a4a40 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5c806ca00 0x7fe5c80a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 10 monclient(hunting): picked mon.noname-g con 0x7fe5c806ca00 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe5c809ec80 0x7fe5c8139820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 10 monclient(hunting): picked mon.noname-e con 0x7fe5c809ec80 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c80a58a0 con 0x7fe5c80a4a40 2024-08-18T21:10:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c809e7f0 con 0x7fe5c806ca00 2024-08-18T21:10:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fe5c809da30 con 0x7fe5c809ec80 2024-08-18T21:10:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cfdda640 10 monclient(hunting): authenticate will time out at 1407.221664s 2024-08-18T21:10:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe5c80a4a40 0x7fe5c80a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5ce377640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe5c809ec80 0x7fe5c8139820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe5c80a4a40 0x7fe5c80a4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:43806/0 (socket says 172.21.15.5:43806) 2024-08-18T21:10:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 1 -- 172.21.15.5:0/4163437511 learned_addr learned my addr 172.21.15.5:0/4163437511 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5ce377640 10 monclient(hunting): get_auth_request con 0x7fe5c809ec80 auth_method 0 2024-08-18T21:10:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5ce377640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5ce377640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5ce377640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 10 monclient(hunting): get_auth_request con 0x7fe5c80a4a40 auth_method 0 2024-08-18T21:10:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5ce377640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5ce377640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5ce377640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cd375640 1 --2- 172.21.15.5:0/4163437511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5c806ca00 0x7fe5c80a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cd375640 10 monclient(hunting): get_auth_request con 0x7fe5c806ca00 auth_method 0 2024-08-18T21:10:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cd375640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cd375640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cd375640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 10 monclient(hunting): handle_auth_done global_id 84728 payload 274 2024-08-18T21:10:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 1 -- 172.21.15.5:0/4163437511 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe5c809ec80 msgr2=0x7fe5c8139820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 1 --2- 172.21.15.5:0/4163437511 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe5c809ec80 0x7fe5c8139820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 1 -- 172.21.15.5:0/4163437511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5c806ca00 msgr2=0x7fe5c80a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 1 --2- 172.21.15.5:0/4163437511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5c806ca00 0x7fe5c80a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 10 monclient: _finish_hunting 0 2024-08-18T21:10:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 1 monclient: found mon.noname-b 2024-08-18T21:10:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:10:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5cdb76640 1 -- 172.21.15.5:0/4163437511 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c809df50 con 0x7fe5c80a4a40 2024-08-18T21:10:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.205+0000 7fe5ce377640 1 --2- 172.21.15.5:0/4163437511 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe5c809ec80 0x7fe5c8139820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cdb76640 1 -- 172.21.15.5:0/4163437511 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe5c80a4a40 msgr2=0x7fe5c80a4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cdb76640 1 --2- 172.21.15.5:0/4163437511 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe5c80a4a40 0x7fe5c80a4e20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0098d0 tx=0x7fe5bc01c150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99df640f4ac9445c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5ccb74640 1 -- 172.21.15.5:0/4163437511 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe5bc0b0070 con 0x7fe5c80a4a40 2024-08-18T21:10:40.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5ccb74640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5ccb74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:10:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5ccb74640 10 monclient: dump: 2024-08-18T21:10:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.227 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5ccb74640 10 monclient: _finish_auth 0 2024-08-18T21:10:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5ccb74640 10 monclient: _check_auth_tickets 2024-08-18T21:10:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5ccb74640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cfdda640 5 monclient: authenticate success, global_id 84728 2024-08-18T21:10:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cfdda640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:10:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5ccb74640 1 -- 172.21.15.5:0/4163437511 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5bc0aa810 con 0x7fe5c80a4a40 2024-08-18T21:10:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5ccb74640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cfdda640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5ccb74640 1 -- 172.21.15.5:0/4163437511 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe5bc0a9300 con 0x7fe5c80a4a40 2024-08-18T21:10:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cfdda640 4 set_mon_vals no callback set 2024-08-18T21:10:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5ccb74640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5ccb74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5ccb74640 10 monclient: dump: 2024-08-18T21:10:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.230 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cfdda640 10 monclient: shutdown 2024-08-18T21:10:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cfdda640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cfdda640 1 -- 172.21.15.5:0/4163437511 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe5c80a4a40 msgr2=0x7fe5c80a4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cfdda640 1 --2- 172.21.15.5:0/4163437511 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe5c80a4a40 0x7fe5c80a4e20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0098d0 tx=0x7fe5bc01c150 comp rx=0 tx=0).stop 2024-08-18T21:10:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cfdda640 1 -- 172.21.15.5:0/4163437511 shutdown_connections 2024-08-18T21:10:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cfdda640 1 --2- 172.21.15.5:0/4163437511 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe5c809ec80 0x7fe5c8139820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cfdda640 1 --2- 172.21.15.5:0/4163437511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5c806ca00 0x7fe5c80a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cfdda640 1 --2- 172.21.15.5:0/4163437511 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe5c80a4a40 0x7fe5c80a4e20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cfdda640 1 -- 172.21.15.5:0/4163437511 >> 172.21.15.5:0/4163437511 conn(0x7fe5c8068700 msgr2=0x7fe5c8068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cfdda640 1 -- 172.21.15.5:0/4163437511 shutdown_connections 2024-08-18T21:10:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.209+0000 7fe5cfdda640 1 -- 172.21.15.5:0/4163437511 wait complete. 2024-08-18T21:10:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 10 monclient: build_initial_monmap 2024-08-18T21:10:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 10 monclient: monmap: 2024-08-18T21:10:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:40.233 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 1 Processor -- start 2024-08-18T21:10:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 1 -- start start 2024-08-18T21:10:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 10 monclient: init 2024-08-18T21:10:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 10 monclient: _add_conns ranks=[8,6,7,5,2,0,4,3,1] 2024-08-18T21:10:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe5c806ca00 0x7fe5c81d1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 10 monclient(hunting): picked mon.noname-e con 0x7fe5c806ca00 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe5c809ec80 0x7fe5c81d1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 10 monclient(hunting): picked mon.noname-d con 0x7fe5c809ec80 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe5c81d1ec0 0x7fe5c8136400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 10 monclient(hunting): picked mon.noname-i con 0x7fe5c81d1ec0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fe5c8143020 con 0x7fe5c809ec80 2024-08-18T21:10:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fe5c8142ea0 con 0x7fe5c81d1ec0 2024-08-18T21:10:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fe5c81431a0 con 0x7fe5c806ca00 2024-08-18T21:10:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cfdda640 10 monclient(hunting): authenticate will time out at 1407.229262s 2024-08-18T21:10:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe5c806ca00 0x7fe5c81d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe5c806ca00 0x7fe5c81d1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:50978/0 (socket says 172.21.15.5:50978) 2024-08-18T21:10:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 1 -- 172.21.15.5:0/3588931012 learned_addr learned my addr 172.21.15.5:0/3588931012 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 10 monclient(hunting): get_auth_request con 0x7fe5c806ca00 auth_method 0 2024-08-18T21:10:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cd375640 1 --2- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe5c809ec80 0x7fe5c81d1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cd375640 10 monclient(hunting): get_auth_request con 0x7fe5c809ec80 auth_method 0 2024-08-18T21:10:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cd375640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cd375640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cd375640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cd375640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cd375640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cd375640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 10 monclient(hunting): handle_auth_done global_id 55520 payload 824 2024-08-18T21:10:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 1 -- 172.21.15.5:0/3588931012 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe5c81d1ec0 msgr2=0x7fe5c8136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 1 --2- 172.21.15.5:0/3588931012 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe5c81d1ec0 0x7fe5c8136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 1 -- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe5c809ec80 msgr2=0x7fe5c81d1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 1 --2- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe5c809ec80 0x7fe5c81d1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 10 monclient: _finish_hunting 0 2024-08-18T21:10:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 1 monclient: found mon.noname-e 2024-08-18T21:10:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:10:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 1 -- 172.21.15.5:0/3588931012 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c81400d0 con 0x7fe5c806ca00 2024-08-18T21:10:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 1 -- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe5c806ca00 msgr2=0x7fe5c81d1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.213+0000 7fe5cdb76640 1 --2- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe5c806ca00 0x7fe5c81d1440 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8121cf0 tx=0x7fe5bc018ef0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c67fc640 1 -- 172.21.15.5:0/3588931012 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe5bc0b0040 con 0x7fe5c806ca00 2024-08-18T21:10:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c67fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:10:40.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c67fc640 10 monclient: dump: 2024-08-18T21:10:40.238 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.238 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.238 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.238 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.238 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.238 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.238 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.238 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.238 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.238 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.239 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.239 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.239 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.239 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.239 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.239 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c67fc640 10 monclient: _finish_auth 0 2024-08-18T21:10:40.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c67fc640 10 monclient: _check_auth_tickets 2024-08-18T21:10:40.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:40.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cfdda640 5 monclient: authenticate success, global_id 55520 2024-08-18T21:10:40.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cfdda640 10 monclient: _renew_subs 2024-08-18T21:10:40.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cfdda640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:10:40.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c67fc640 1 -- 172.21.15.5:0/3588931012 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5bc0044a0 con 0x7fe5c806ca00 2024-08-18T21:10:40.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cfdda640 1 -- 172.21.15.5:0/3588931012 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c81224a0 con 0x7fe5c806ca00 2024-08-18T21:10:40.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c67fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:40.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c67fc640 1 -- 172.21.15.5:0/3588931012 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe5bc0aad10 con 0x7fe5c806ca00 2024-08-18T21:10:40.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:10:40.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c7fff640 4 set_mon_vals no callback set 2024-08-18T21:10:40.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c67fc640 10 monclient: dump: 2024-08-18T21:10:40.240 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.240 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.242 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cfdda640 10 monclient: _renew_subs 2024-08-18T21:10:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cfdda640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:10:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cfdda640 1 -- 172.21.15.5:0/3588931012 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c80a84f0 con 0x7fe5c806ca00 2024-08-18T21:10:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cfdda640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cfdda640 1 --2- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c81220c0 0x7fe5c8136940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cfdda640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cfdda640 1 -- 172.21.15.5:0/3588931012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c8051140 con 0x7fe5c81220c0 2024-08-18T21:10:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cd375640 1 --2- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c81220c0 0x7fe5c8136940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cd375640 10 monclient: get_auth_request con 0x7fe5c81220c0 auth_method 0 2024-08-18T21:10:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cd375640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cd375640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cd375640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cd375640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cd375640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cd375640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c67fc640 1 -- 172.21.15.5:0/3588931012 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe5bc0bb060 con 0x7fe5c806ca00 2024-08-18T21:10:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cd375640 10 monclient(hunting): handle_auth_done global_id 84672 payload 824 2024-08-18T21:10:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cd375640 1 -- 172.21.15.5:0/3588931012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe5c8139820 con 0x7fe5c81220c0 2024-08-18T21:10:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c67fc640 1 --2- 172.21.15.5:0/3588931012 >> v2:172.21.15.157:6812/631023601 conn(0x7fe5b403bdc0 0x7fe5b403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5c67fc640 1 -- 172.21.15.5:0/3588931012 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(207..207 src has 22..207) ==== 3898+0+0 (secure 0 0 0) 0x7fe5bc0e75b0 con 0x7fe5c806ca00 2024-08-18T21:10:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5ce377640 1 --2- 172.21.15.5:0/3588931012 >> v2:172.21.15.157:6812/631023601 conn(0x7fe5b403bdc0 0x7fe5b403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5ce377640 10 monclient: get_auth_request con 0x7fe5b403bdc0 auth_method 0 2024-08-18T21:10:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cd375640 1 -- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c81220c0 msgr2=0x7fe5c8136940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.217+0000 7fe5cd375640 1 --2- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c81220c0 0x7fe5c8136940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe5c813ec60 tx=0x7fe5b8007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.221+0000 7fe5c67fc640 1 -- 172.21.15.5:0/3588931012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe5b8014a00 con 0x7fe5c81220c0 2024-08-18T21:10:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.221+0000 7fe5c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.221+0000 7fe5c67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.221+0000 7fe5c67fc640 10 monclient: dump: 2024-08-18T21:10:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.245 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.245 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.245 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.245 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.245 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.245 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.245 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.245 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.245 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.245 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.245 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.245 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.246 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.221+0000 7fe5c67fc640 1 -- 172.21.15.5:0/3588931012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe5b801a070 con 0x7fe5c81220c0 2024-08-18T21:10:40.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.221+0000 7fe5c67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:40.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.221+0000 7fe5c67fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:40.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.221+0000 7fe5c67fc640 1 -- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c81220c0 msgr2=0x7fe5c8136940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.221+0000 7fe5c67fc640 1 --2- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c81220c0 0x7fe5c8136940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe5c813ec60 tx=0x7fe5b8007700 comp rx=0 tx=0).stop 2024-08-18T21:10:40.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.221+0000 7fe5c67fc640 1 -- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c81220c0 msgr2=0x7fe5c8136940 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:40.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.221+0000 7fe5c67fc640 1 --2- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c81220c0 0x7fe5c8136940 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.221+0000 7fe5ce377640 1 --2- 172.21.15.5:0/3588931012 >> v2:172.21.15.157:6812/631023601 conn(0x7fe5b403bdc0 0x7fe5b403e280 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8137540 tx=0x7fe5c0009480 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.225+0000 7fe5cfdda640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:40.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.225+0000 7fe5cfdda640 1 --2- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8136e80 0x7fe5c8137a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.225+0000 7fe5cfdda640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.225+0000 7fe5cfdda640 1 -- 172.21.15.5:0/3588931012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c8137290 con 0x7fe5c8136e80 2024-08-18T21:10:40.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.225+0000 7fe5cd375640 1 --2- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8136e80 0x7fe5c8137a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.225+0000 7fe5cd375640 10 monclient: get_auth_request con 0x7fe5c8136e80 auth_method 0 2024-08-18T21:10:40.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.225+0000 7fe5cd375640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.225+0000 7fe5cd375640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.225+0000 7fe5cd375640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.225+0000 7fe5cd375640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.225+0000 7fe5cd375640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.225+0000 7fe5cd375640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.225+0000 7fe5cd375640 10 monclient(hunting): handle_auth_done global_id 84681 payload 824 2024-08-18T21:10:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.225+0000 7fe5cd375640 1 -- 172.21.15.5:0/3588931012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe5c813f740 con 0x7fe5c8136e80 2024-08-18T21:10:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5cd375640 1 -- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8136e80 msgr2=0x7fe5c8137a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5cd375640 1 --2- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8136e80 0x7fe5c8137a10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe5c813ec60 tx=0x7fe5b8004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5c67fc640 1 -- 172.21.15.5:0/3588931012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe5b8014c30 con 0x7fe5c8136e80 2024-08-18T21:10:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5c67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5c67fc640 10 monclient: dump: 2024-08-18T21:10:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.252 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.252 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.252 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.252 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5c67fc640 1 -- 172.21.15.5:0/3588931012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9250 (secure 0 0 0) 0x7fe5b8014c30 con 0x7fe5c8136e80 2024-08-18T21:10:40.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5c67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:40.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5c67fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:40.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5c67fc640 1 -- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8136e80 msgr2=0x7fe5c8137a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5c67fc640 1 --2- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8136e80 0x7fe5c8137a10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe5c813ec60 tx=0x7fe5b8004a50 comp rx=0 tx=0).stop 2024-08-18T21:10:40.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5c67fc640 1 -- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8136e80 msgr2=0x7fe5c8137a10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:40.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5c67fc640 1 --2- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8136e80 0x7fe5c8137a10 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe5c813ec60 tx=0x7fe5b8004a50 comp rx=0 tx=0).stop 2024-08-18T21:10:40.253 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:10:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 137062, 2024-08-18T21:10:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:10:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:40.277 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.277 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.277 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:40.277 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:40.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5cfdda640 1 -- 172.21.15.5:0/3588931012 >> v2:172.21.15.157:6812/631023601 conn(0x7fe5b403bdc0 msgr2=0x7fe5b403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5cfdda640 1 --2- 172.21.15.5:0/3588931012 >> v2:172.21.15.157:6812/631023601 conn(0x7fe5b403bdc0 0x7fe5b403e280 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8137540 tx=0x7fe5c0009480 comp rx=0 tx=0).stop 2024-08-18T21:10:40.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5cfdda640 10 monclient: shutdown 2024-08-18T21:10:40.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5cfdda640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:40.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5cfdda640 1 -- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe5c806ca00 msgr2=0x7fe5c81d1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5cfdda640 1 --2- 172.21.15.5:0/3588931012 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe5c806ca00 0x7fe5c81d1440 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8121cf0 tx=0x7fe5bc018ef0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5ce377640 1 -- 172.21.15.5:0/3588931012 reap_dead start 2024-08-18T21:10:40.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5ce377640 1 -- 172.21.15.5:0/3588931012 reap_dead start 2024-08-18T21:10:40.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5cfdda640 1 -- 172.21.15.5:0/3588931012 shutdown_connections 2024-08-18T21:10:40.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5cfdda640 1 -- 172.21.15.5:0/3588931012 >> 172.21.15.5:0/3588931012 conn(0x7fe5c8068700 msgr2=0x7fe5c80a6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:40.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5cfdda640 1 -- 172.21.15.5:0/3588931012 shutdown_connections 2024-08-18T21:10:40.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.229+0000 7fe5cfdda640 1 -- 172.21.15.5:0/3588931012 wait complete. 2024-08-18T21:10:40.279 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:40.280 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:10:40.280 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:10:40.293 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:40.293 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30791]: starting. 2024-08-18T21:10:40.293 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30791]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30713 2024-08-18T21:10:40.293 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30791]: shutting down. 2024-08-18T21:10:40.297 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:40.297 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:10:40.297 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:10:40.301 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:10:40.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 10 monclient: get_monmap_and_config 2024-08-18T21:10:40.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 10 monclient: build_initial_monmap 2024-08-18T21:10:40.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 10 monclient: monmap: 2024-08-18T21:10:40.399 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:40.399 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.399 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:40.400837+0000 2024-08-18T21:10:40.399 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:40.400837+0000 2024-08-18T21:10:40.399 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:40.400 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.400 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:40.400 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:40.400 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:40.400 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:40.400 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:40.400 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:40.400 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:40.400 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:40.400 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:40.400 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:40.400 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:40.400 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 1 Processor -- start 2024-08-18T21:10:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 1 -- start start 2024-08-18T21:10:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 10 monclient: init 2024-08-18T21:10:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 10 monclient: _add_conns ranks=[3,8,1,0,4,7,5,6,9,2,10] 2024-08-18T21:10:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f352c137a70 0x7f352c0a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 10 monclient(hunting): picked mon.noname-g con 0x7f352c137a70 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f352c0a4c10 0x7f352c137e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 10 monclient(hunting): picked mon.noname-e con 0x7f352c0a4c10 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f352c06c950 addr v1:172.21.15.157:6789/0 2024-08-18T21:10:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f352c09fe40 con 0x7f352c06c950 2024-08-18T21:10:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f352c0a03e0 con 0x7f352c137a70 2024-08-18T21:10:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f352c0a08e0 con 0x7f352c0a4c10 2024-08-18T21:10:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3530f4b640 10 monclient(hunting): authenticate will time out at 1407.413991s 2024-08-18T21:10:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f352c0a4c10 0x7f352c137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f352c0a4c10 0x7f352c137e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:50994/0 (socket says 172.21.15.5:50994) 2024-08-18T21:10:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 1 -- 172.21.15.5:0/2485924938 learned_addr learned my addr 172.21.15.5:0/2485924938 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 10 monclient(hunting): get_auth_request con 0x7f352c0a4c10 auth_method 0 2024-08-18T21:10:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f352a59c640 1 --2- 172.21.15.5:0/2485924938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f352c137a70 0x7f352c0a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f352a59c640 10 monclient(hunting): get_auth_request con 0x7f352c137a70 auth_method 0 2024-08-18T21:10:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f352a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f352a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f352a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f352a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f352a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f352a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 10 monclient(hunting): handle_auth_done global_id 55538 payload 274 2024-08-18T21:10:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 1 -- 172.21.15.5:0/2485924938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f352c137a70 msgr2=0x7f352c0a1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 1 --2- 172.21.15.5:0/2485924938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f352c137a70 0x7f352c0a1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 1 -- 172.21.15.5:0/2485924938 >> v1:172.21.15.157:6789/0 conn(0x7f352c06c950 legacy=0x7f352c06cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:10:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 1 monclient: found mon.noname-e 2024-08-18T21:10:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:10:40.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.397+0000 7f3529d9b640 1 -- 172.21.15.5:0/2485924938 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352c0a0bc0 con 0x7f352c0a4c10 2024-08-18T21:10:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f3529d9b640 1 -- 172.21.15.5:0/2485924938 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f352c0a4c10 msgr2=0x7f352c137e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f3529d9b640 1 --2- 172.21.15.5:0/2485924938 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f352c0a4c10 0x7f352c137e50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3514009870 tx=0x7f351401c440 comp rx=0 tx=0).ready entity=mon.8 client_cookie=52fb7684aa576b84 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f352959a640 1 -- 172.21.15.5:0/2485924938 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f35140b0070 con 0x7f352c0a4c10 2024-08-18T21:10:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f352959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f352959a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:10:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f352959a640 10 monclient: dump: 2024-08-18T21:10:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.411 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.411 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.411 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.411 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.411 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.411 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.411 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.412 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f352959a640 10 monclient: _finish_auth 0 2024-08-18T21:10:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f352959a640 10 monclient: _check_auth_tickets 2024-08-18T21:10:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f352959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f352959a640 1 -- 172.21.15.5:0/2485924938 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35140aa810 con 0x7f352c0a4c10 2024-08-18T21:10:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f352959a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f352959a640 1 -- 172.21.15.5:0/2485924938 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f35140a9300 con 0x7f352c0a4c10 2024-08-18T21:10:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f352959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f352959a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:10:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f352959a640 10 monclient: dump: 2024-08-18T21:10:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.414 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f3530f4b640 5 monclient: authenticate success, global_id 55538 2024-08-18T21:10:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f3530f4b640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.401+0000 7f3530f4b640 4 set_mon_vals no callback set 2024-08-18T21:10:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 10 monclient: shutdown 2024-08-18T21:10:40.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:40.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 1 -- 172.21.15.5:0/2485924938 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f352c0a4c10 msgr2=0x7f352c137e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 1 --2- 172.21.15.5:0/2485924938 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f352c0a4c10 0x7f352c137e50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3514009870 tx=0x7f351401c440 comp rx=0 tx=0).stop 2024-08-18T21:10:40.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 1 -- 172.21.15.5:0/2485924938 shutdown_connections 2024-08-18T21:10:40.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 1 --2- 172.21.15.5:0/2485924938 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f352c0a4c10 0x7f352c137e50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 1 --2- 172.21.15.5:0/2485924938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f352c137a70 0x7f352c0a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 1 -- 172.21.15.5:0/2485924938 >> 172.21.15.5:0/2485924938 conn(0x7f352c0688d0 msgr2=0x7f352c068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:40.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 1 -- 172.21.15.5:0/2485924938 shutdown_connections 2024-08-18T21:10:40.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 1 -- 172.21.15.5:0/2485924938 wait complete. 2024-08-18T21:10:40.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 10 monclient: build_initial_monmap 2024-08-18T21:10:40.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 10 monclient: monmap: 2024-08-18T21:10:40.415 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:40.417 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 1 Processor -- start 2024-08-18T21:10:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 1 -- start start 2024-08-18T21:10:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 10 monclient: init 2024-08-18T21:10:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 10 monclient: _add_conns ranks=[8,1,5,7,0,3,2,6,4] 2024-08-18T21:10:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f352c06c950 0x7f352c1d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 10 monclient(hunting): picked mon.noname-e con 0x7f352c06c950 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f352c0a4c10 0x7f352c1367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 10 monclient(hunting): picked mon.noname-f con 0x7f352c0a4c10 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:10:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f352c137a70 0x7f352c136d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 10 monclient(hunting): picked mon.noname-h con 0x7f352c137a70 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f352c1424c0 con 0x7f352c0a4c10 2024-08-18T21:10:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f352c142340 con 0x7f352c137a70 2024-08-18T21:10:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f352c142640 con 0x7f352c06c950 2024-08-18T21:10:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3530f4b640 10 monclient(hunting): authenticate will time out at 1407.422113s 2024-08-18T21:10:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f352c06c950 0x7f352c1d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f352c06c950 0x7f352c1d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:51000/0 (socket says 172.21.15.5:51000) 2024-08-18T21:10:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 1 -- 172.21.15.5:0/2998055039 learned_addr learned my addr 172.21.15.5:0/2998055039 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:40.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 10 monclient(hunting): get_auth_request con 0x7f352c06c950 auth_method 0 2024-08-18T21:10:40.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3529d9b640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f352c0a4c10 0x7f352c1367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 10 monclient(hunting): handle_auth_done global_id 55547 payload 824 2024-08-18T21:10:40.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 1 -- 172.21.15.5:0/2998055039 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f352c137a70 msgr2=0x7f352c136d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352ad9d640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f352c137a70 0x7f352c136d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f352c137a70 0x7f352c136d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 1 -- 172.21.15.5:0/2998055039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f352c0a4c10 msgr2=0x7f352c1367c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f352c0a4c10 0x7f352c1367c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 10 monclient: _finish_hunting 0 2024-08-18T21:10:40.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 1 monclient: found mon.noname-e 2024-08-18T21:10:40.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:40.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:10:40.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f352a59c640 1 -- 172.21.15.5:0/2998055039 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352c120e10 con 0x7f352c06c950 2024-08-18T21:10:40.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3529d9b640 10 monclient: get_auth_request con 0x7f352c0a4c10 auth_method 0 2024-08-18T21:10:40.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.405+0000 7f3529d9b640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f352c0a4c10 0x7f352c1367c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:10:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f352a59c640 1 -- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f352c06c950 msgr2=0x7f352c1d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f352a59c640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f352c06c950 0x7f352c1d18e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f351c00e8a0 tx=0x7f351c00ed60 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3522ffd640 1 -- 172.21.15.5:0/2998055039 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f351c017070 con 0x7f352c06c950 2024-08-18T21:10:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3522ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3522ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:10:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3522ffd640 10 monclient: dump: 2024-08-18T21:10:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.425 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3522ffd640 10 monclient: _finish_auth 0 2024-08-18T21:10:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3522ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:10:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3522ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3522ffd640 1 -- 172.21.15.5:0/2998055039 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f351c013470 con 0x7f352c06c950 2024-08-18T21:10:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3530f4b640 5 monclient: authenticate success, global_id 55547 2024-08-18T21:10:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3530f4b640 10 monclient: _renew_subs 2024-08-18T21:10:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3530f4b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:10:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3530f4b640 1 -- 172.21.15.5:0/2998055039 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f352c06d050 con 0x7f352c06c950 2024-08-18T21:10:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3522ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3522ffd640 1 -- 172.21.15.5:0/2998055039 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f351c013a90 con 0x7f352c06c950 2024-08-18T21:10:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3522ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3522ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:10:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3522ffd640 10 monclient: dump: 2024-08-18T21:10:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.428 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3530f4b640 10 monclient: _renew_subs 2024-08-18T21:10:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3528d99640 4 set_mon_vals no callback set 2024-08-18T21:10:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3530f4b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:10:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3530f4b640 1 -- 172.21.15.5:0/2998055039 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f352c122bb0 con 0x7f352c06c950 2024-08-18T21:10:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3530f4b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3530f4b640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f352c06ff60 0x7f352c070340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3530f4b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3530f4b640 1 -- 172.21.15.5:0/2998055039 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f352c051140 con 0x7f352c06ff60 2024-08-18T21:10:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3529d9b640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f352c06ff60 0x7f352c070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3522ffd640 1 -- 172.21.15.5:0/2998055039 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f351c01a070 con 0x7f352c06c950 2024-08-18T21:10:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3529d9b640 10 monclient: get_auth_request con 0x7f352c06ff60 auth_method 0 2024-08-18T21:10:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3529d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3529d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3529d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3529d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3529d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3529d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3522ffd640 1 --2- 172.21.15.5:0/2998055039 >> v2:172.21.15.157:6812/631023601 conn(0x7f350c03bdc0 0x7f350c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3522ffd640 1 -- 172.21.15.5:0/2998055039 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(208..208 src has 22..208) ==== 3506+0+0 (secure 0 0 0) 0x7f351c00f040 con 0x7f352c06c950 2024-08-18T21:10:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3529d9b640 10 monclient(hunting): handle_auth_done global_id 84746 payload 824 2024-08-18T21:10:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f3529d9b640 1 -- 172.21.15.5:0/2998055039 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f352c123020 con 0x7f352c06ff60 2024-08-18T21:10:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f352ad9d640 1 --2- 172.21.15.5:0/2998055039 >> v2:172.21.15.157:6812/631023601 conn(0x7f350c03bdc0 0x7f350c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.409+0000 7f352ad9d640 10 monclient: get_auth_request con 0x7f350c03bdc0 auth_method 0 2024-08-18T21:10:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.413+0000 7f3529d9b640 1 -- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f352c06ff60 msgr2=0x7f352c070340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.413+0000 7f3529d9b640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f352c06ff60 0x7f352c070340 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f35140ad000 tx=0x7f35140191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.413+0000 7f3522ffd640 1 -- 172.21.15.5:0/2998055039 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f35140b0070 con 0x7f352c06ff60 2024-08-18T21:10:40.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.413+0000 7f3522ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.413+0000 7f3522ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:40.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.413+0000 7f3522ffd640 10 monclient: dump: 2024-08-18T21:10:40.430 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.430 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.430 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.430 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.430 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.430 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.430 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.430 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.431 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.413+0000 7f352ad9d640 1 --2- 172.21.15.5:0/2998055039 >> v2:172.21.15.157:6812/631023601 conn(0x7f350c03bdc0 0x7f350c03e280 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f352c0a2130 tx=0x7f3524009040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.413+0000 7f3522ffd640 1 -- 172.21.15.5:0/2998055039 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f35140b1040 con 0x7f352c06ff60 2024-08-18T21:10:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.413+0000 7f3522ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.413+0000 7f3522ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.413+0000 7f3522ffd640 1 -- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f352c06ff60 msgr2=0x7f352c070340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.413+0000 7f3522ffd640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f352c06ff60 0x7f352c070340 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f35140ad000 tx=0x7f35140191e0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.413+0000 7f3522ffd640 1 -- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f352c06ff60 msgr2=0x7f352c070340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.413+0000 7f3522ffd640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f352c06ff60 0x7f352c070340 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f35140ad000 tx=0x7f35140191e0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3530f4b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3530f4b640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f352c070880 0x7f352c11f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3530f4b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3530f4b640 1 -- 172.21.15.5:0/2998055039 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f352c06dbf0 con 0x7f352c070880 2024-08-18T21:10:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3529d9b640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f352c070880 0x7f352c11f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3529d9b640 10 monclient: get_auth_request con 0x7f352c070880 auth_method 0 2024-08-18T21:10:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3529d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3529d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3529d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3529d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3529d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3529d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3529d9b640 10 monclient(hunting): handle_auth_done global_id 84755 payload 824 2024-08-18T21:10:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3529d9b640 1 -- 172.21.15.5:0/2998055039 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f352c137e50 con 0x7f352c070880 2024-08-18T21:10:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3529d9b640 1 -- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f352c070880 msgr2=0x7f352c11f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3529d9b640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f352c070880 0x7f352c11f530 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f351401c270 tx=0x7f35140a8000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3522ffd640 1 -- 172.21.15.5:0/2998055039 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f35140b5a80 con 0x7f352c070880 2024-08-18T21:10:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3522ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3522ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3522ffd640 10 monclient: dump: 2024-08-18T21:10:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.435 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3522ffd640 1 -- 172.21.15.5:0/2998055039 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7f35140b5610 con 0x7f352c070880 2024-08-18T21:10:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3522ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3522ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3522ffd640 1 -- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f352c070880 msgr2=0x7f352c11f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3522ffd640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f352c070880 0x7f352c11f530 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f351401c270 tx=0x7f35140a8000 comp rx=0 tx=0).stop 2024-08-18T21:10:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3522ffd640 1 -- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f352c070880 msgr2=0x7f352c11f530 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3522ffd640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f352c070880 0x7f352c11f530 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f351401c270 tx=0x7f35140a8000 comp rx=0 tx=0).stop 2024-08-18T21:10:40.436 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 137250, 2024-08-18T21:10:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.438 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:10:40.438 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:40.438 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:40.438 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:40.438 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:40.438 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:40.438 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:40.438 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:40.438 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:40.438 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:40.438 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:40.438 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:40.438 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:40.439 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:40.439 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:40.439 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.439 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:40.439 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:40.439 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:40.439 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:40.439 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:40.439 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:40.439 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:40.439 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:40.439 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:40.439 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:40.440 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:40.440 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:40.440 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:40.440 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.440 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:40.440 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:40.440 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:40.440 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:40.440 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:40.440 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:40.440 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:40.440 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:40.440 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:40.441 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:40.441 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:40.441 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:40.441 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:40.441 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:40.441 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:40.441 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:40.441 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:40.441 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:40.441 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:40.441 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:40.441 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:40.441 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:40.442 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:40.442 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:40.442 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:40.442 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:40.442 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:40.442 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:40.442 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.442 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:40.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.442 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:40.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.442 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:40.442 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:40.443 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.443 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.443 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:40.443 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.443 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:40.443 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.443 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.443 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.444 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:40.444 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:40.444 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.444 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.444 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.444 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:40.444 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:40.444 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.444 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.445 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:40.445 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.445 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:40.445 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.445 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.445 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.445 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:40.445 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:40.446 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.446 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.446 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.446 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:40.446 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:40.446 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.446 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.446 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.446 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:40.446 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.447 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.447 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:40.447 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.447 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.447 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:40.447 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:40.447 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.447 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.447 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.448 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:40.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:40.448 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.448 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.448 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:40.448 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.448 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:40.449 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.449 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.449 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.449 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:40.449 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:40.449 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.449 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.449 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.449 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:40.449 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:40.450 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:40.450 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:40.450 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.450 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.450 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.451 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:40.451 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:40.451 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.451 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.451 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.451 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:40.451 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:40.451 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.451 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.452 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:40.452 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.452 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:40.452 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.452 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.452 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.452 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:40.452 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:40.452 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.453 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.453 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.453 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:40.453 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:40.453 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.453 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.453 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.453 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:40.453 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.454 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.454 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:40.454 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.454 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.454 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.454 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:40.454 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:40.454 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.454 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.454 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.455 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:40.455 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:40.455 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.455 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.455 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:40.455 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.455 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:40.455 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.456 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.456 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.456 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:40.456 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:40.456 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.456 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.456 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.456 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:40.456 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:40.456 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.457 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.457 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.457 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:40.457 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.457 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.457 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:40.457 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.457 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.457 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.457 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:40.458 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:40.458 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.458 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.458 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.458 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.458 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.458 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:40.458 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:40.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.458 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:40.458 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:40.458 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:40.459 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.459 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.459 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:40.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.459 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:40.459 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:40.459 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:40.459 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.459 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.459 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:40.459 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:40.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3530f4b640 1 -- 172.21.15.5:0/2998055039 >> v2:172.21.15.157:6812/631023601 conn(0x7f350c03bdc0 msgr2=0x7f350c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3530f4b640 1 --2- 172.21.15.5:0/2998055039 >> v2:172.21.15.157:6812/631023601 conn(0x7f350c03bdc0 0x7f350c03e280 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f352c0a2130 tx=0x7f3524009040 comp rx=0 tx=0).stop 2024-08-18T21:10:40.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3530f4b640 10 monclient: shutdown 2024-08-18T21:10:40.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3530f4b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:40.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3530f4b640 1 -- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f352c06c950 msgr2=0x7f352c1d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3530f4b640 1 --2- 172.21.15.5:0/2998055039 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f352c06c950 0x7f352c1d18e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f351c00e8a0 tx=0x7f351c00ed60 comp rx=0 tx=0).stop 2024-08-18T21:10:40.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f352ad9d640 1 -- 172.21.15.5:0/2998055039 reap_dead start 2024-08-18T21:10:40.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f352ad9d640 1 -- 172.21.15.5:0/2998055039 reap_dead start 2024-08-18T21:10:40.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3530f4b640 1 -- 172.21.15.5:0/2998055039 shutdown_connections 2024-08-18T21:10:40.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3530f4b640 1 -- 172.21.15.5:0/2998055039 >> 172.21.15.5:0/2998055039 conn(0x7f352c0688d0 msgr2=0x7f352c13ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:40.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3530f4b640 1 -- 172.21.15.5:0/2998055039 shutdown_connections 2024-08-18T21:10:40.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.421+0000 7f3530f4b640 1 -- 172.21.15.5:0/2998055039 wait complete. 2024-08-18T21:10:40.462 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:40.462 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:10:40.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:10:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 10 monclient: get_monmap_and_config 2024-08-18T21:10:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 10 monclient: build_initial_monmap 2024-08-18T21:10:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 10 monclient: monmap: 2024-08-18T21:10:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:40.581639+0000 2024-08-18T21:10:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:40.581639+0000 2024-08-18T21:10:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:40.581 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 1 Processor -- start 2024-08-18T21:10:40.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 1 -- start start 2024-08-18T21:10:40.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 10 monclient: init 2024-08-18T21:10:40.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:40.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 10 monclient: _add_conns ranks=[4,10,8,3,5,2,7,0,1,9,6] 2024-08-18T21:10:40.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e740a6ce0 0x7f3e740a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 10 monclient(hunting): picked mon.noname-c con 0x7f3e740a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3e740a7600 0x7f3e74139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 10 monclient(hunting): picked mon.noname-f con 0x7f3e740a7600 addr v2:172.21.15.157:3300/0 2024-08-18T21:10:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3e74139fe0 0x7f3e7413a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 10 monclient(hunting): picked mon.noname-e con 0x7f3e74139fe0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3e740a5000 con 0x7f3e740a7600 2024-08-18T21:10:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f3e740a4360 con 0x7f3e740a6ce0 2024-08-18T21:10:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f3e740a45d0 con 0x7f3e74139fe0 2024-08-18T21:10:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e797fb640 10 monclient(hunting): authenticate will time out at 1407.595156s 2024-08-18T21:10:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e737fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3e74139fe0 0x7f3e7413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e740a6ce0 0x7f3e740a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e737fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3e74139fe0 0x7f3e7413a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:51014/0 (socket says 172.21.15.5:51014) 2024-08-18T21:10:40.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e737fe640 1 -- 172.21.15.5:0/4038220129 learned_addr learned my addr 172.21.15.5:0/4038220129 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:40.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e737fe640 10 monclient(hunting): get_auth_request con 0x7f3e74139fe0 auth_method 0 2024-08-18T21:10:40.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e737fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e737fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 10 monclient(hunting): get_auth_request con 0x7f3e740a6ce0 auth_method 0 2024-08-18T21:10:40.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e737fe640 1 -- 172.21.15.5:0/4038220129 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3e74139fe0 msgr2=0x7f3e7413a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:10:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e737fe640 1 -- 172.21.15.5:0/4038220129 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3e74139fe0 msgr2=0x7f3e7413a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e737fe640 1 --2- 172.21.15.5:0/4038220129 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3e74139fe0 0x7f3e7413a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e737fe640 1 --2- 172.21.15.5:0/4038220129 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3e74139fe0 0x7f3e7413a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e727fc640 1 --2- 172.21.15.5:0/4038220129 >> v2:172.21.15.157:3300/0 conn(0x7f3e740a7600 0x7f3e74139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e727fc640 10 monclient(hunting): get_auth_request con 0x7f3e740a7600 auth_method 0 2024-08-18T21:10:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e727fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e727fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 10 monclient(hunting): handle_auth_done global_id 6511 payload 274 2024-08-18T21:10:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 1 -- 172.21.15.5:0/4038220129 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3e74139fe0 msgr2=0x7f3e7413a440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:40.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 1 --2- 172.21.15.5:0/4038220129 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3e74139fe0 0x7f3e7413a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 1 -- 172.21.15.5:0/4038220129 >> v2:172.21.15.157:3300/0 conn(0x7f3e740a7600 msgr2=0x7f3e74139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:40.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 1 --2- 172.21.15.5:0/4038220129 >> v2:172.21.15.157:3300/0 conn(0x7f3e740a7600 0x7f3e74139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:10:40.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 1 monclient: found mon.noname-c 2024-08-18T21:10:40.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:40.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:10:40.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.577+0000 7f3e72ffd640 1 -- 172.21.15.5:0/4038220129 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e740a32d0 con 0x7f3e740a6ce0 2024-08-18T21:10:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e72ffd640 1 -- 172.21.15.5:0/4038220129 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e740a6ce0 msgr2=0x7f3e740a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e72ffd640 1 --2- 172.21.15.5:0/4038220129 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e740a6ce0 0x7f3e740a70c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c009dc0 tx=0x7f3e6c01c810 comp rx=0 tx=0).ready entity=mon.4 client_cookie=51e9f818e797dcd9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e71ffb640 1 -- 172.21.15.5:0/4038220129 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3e6c0b2070 con 0x7f3e740a6ce0 2024-08-18T21:10:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e71ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e71ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:10:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e71ffb640 10 monclient: dump: 2024-08-18T21:10:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.593 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e71ffb640 10 monclient: _finish_auth 0 2024-08-18T21:10:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e71ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:10:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e71ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 5 monclient: authenticate success, global_id 6511 2024-08-18T21:10:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:10:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e71ffb640 1 -- 172.21.15.5:0/4038220129 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6c0a59b0 con 0x7f3e740a6ce0 2024-08-18T21:10:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e71ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 4 set_mon_vals no callback set 2024-08-18T21:10:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e71ffb640 1 -- 172.21.15.5:0/4038220129 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3e6c0ab340 con 0x7f3e740a6ce0 2024-08-18T21:10:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e71ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e71ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e71ffb640 10 monclient: dump: 2024-08-18T21:10:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.595 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 10 monclient: shutdown 2024-08-18T21:10:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 -- 172.21.15.5:0/4038220129 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e740a6ce0 msgr2=0x7f3e740a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 --2- 172.21.15.5:0/4038220129 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e740a6ce0 0x7f3e740a70c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c009dc0 tx=0x7f3e6c01c810 comp rx=0 tx=0).stop 2024-08-18T21:10:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 -- 172.21.15.5:0/4038220129 shutdown_connections 2024-08-18T21:10:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 --2- 172.21.15.5:0/4038220129 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3e74139fe0 0x7f3e7413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 --2- 172.21.15.5:0/4038220129 >> v2:172.21.15.157:3300/0 conn(0x7f3e740a7600 0x7f3e74139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 --2- 172.21.15.5:0/4038220129 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e740a6ce0 0x7f3e740a70c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 -- 172.21.15.5:0/4038220129 >> 172.21.15.5:0/4038220129 conn(0x7f3e740acbc0 msgr2=0x7f3e740a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 -- 172.21.15.5:0/4038220129 shutdown_connections 2024-08-18T21:10:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 -- 172.21.15.5:0/4038220129 wait complete. 2024-08-18T21:10:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 10 monclient: build_initial_monmap 2024-08-18T21:10:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 10 monclient: monmap: 2024-08-18T21:10:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:40.597 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 Processor -- start 2024-08-18T21:10:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 -- start start 2024-08-18T21:10:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 10 monclient: init 2024-08-18T21:10:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 10 monclient: _add_conns ranks=[3,2,1,0,7,4,8,5,6] 2024-08-18T21:10:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e740a6ce0 0x7f3e74135af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 10 monclient(hunting): picked mon.noname-g con 0x7f3e740a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3e740a7600 0x7f3e74136030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 10 monclient(hunting): picked mon.noname-b con 0x7f3e740a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e74139fe0 0x7f3e74136570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 10 monclient(hunting): picked mon.noname-f con 0x7f3e74139fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:10:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3e740a79e0 con 0x7f3e74139fe0 2024-08-18T21:10:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f3e740a8220 con 0x7f3e740a7600 2024-08-18T21:10:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3e7413f130 con 0x7f3e740a6ce0 2024-08-18T21:10:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e797fb640 10 monclient(hunting): authenticate will time out at 1407.603061s 2024-08-18T21:10:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3e740a7600 0x7f3e74136030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3e740a7600 0x7f3e74136030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:43822/0 (socket says 172.21.15.5:43822) 2024-08-18T21:10:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 1 -- 172.21.15.5:0/239359439 learned_addr learned my addr 172.21.15.5:0/239359439 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 10 monclient(hunting): get_auth_request con 0x7f3e740a7600 auth_method 0 2024-08-18T21:10:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e72ffd640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e740a6ce0 0x7f3e74135af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e737fe640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e74139fe0 0x7f3e74136570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 10 monclient(hunting): handle_auth_done global_id 84764 payload 824 2024-08-18T21:10:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 1 -- 172.21.15.5:0/239359439 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e740a6ce0 msgr2=0x7f3e74135af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e740a6ce0 0x7f3e74135af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 1 -- 172.21.15.5:0/239359439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e74139fe0 msgr2=0x7f3e74136570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e74139fe0 0x7f3e74136570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 10 monclient: _finish_hunting 0 2024-08-18T21:10:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 1 monclient: found mon.noname-b 2024-08-18T21:10:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:10:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e727fc640 1 -- 172.21.15.5:0/239359439 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7413f410 con 0x7f3e740a7600 2024-08-18T21:10:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e737fe640 10 monclient: get_auth_request con 0x7f3e74139fe0 auth_method 0 2024-08-18T21:10:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e737fe640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e74139fe0 0x7f3e74136570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:10:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e72ffd640 10 monclient: get_auth_request con 0x7f3e740a6ce0 auth_method 0 2024-08-18T21:10:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.585+0000 7f3e72ffd640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e740a6ce0 0x7f3e74135af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:10:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e727fc640 1 -- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3e740a7600 msgr2=0x7f3e74136030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e727fc640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3e740a7600 0x7f3e74136030 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00d800 tx=0x7f3e5c00dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e6b7fe640 1 -- 172.21.15.5:0/239359439 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3e5c00bd40 con 0x7f3e740a7600 2024-08-18T21:10:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e6b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:10:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e6b7fe640 10 monclient: dump: 2024-08-18T21:10:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.606 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e6b7fe640 10 monclient: _finish_auth 0 2024-08-18T21:10:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e6b7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:10:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e6b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e6b7fe640 1 -- 172.21.15.5:0/239359439 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5c019070 con 0x7f3e740a7600 2024-08-18T21:10:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e797fb640 5 monclient: authenticate success, global_id 84764 2024-08-18T21:10:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e797fb640 10 monclient: _renew_subs 2024-08-18T21:10:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e797fb640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:10:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e797fb640 1 -- 172.21.15.5:0/239359439 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e740aa6d0 con 0x7f3e740a7600 2024-08-18T21:10:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e6b7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e6b7fe640 1 -- 172.21.15.5:0/239359439 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3e5c0148a0 con 0x7f3e740a7600 2024-08-18T21:10:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e6b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e6b7fe640 10 monclient: dump: 2024-08-18T21:10:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.609 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e797fb640 10 monclient: _renew_subs 2024-08-18T21:10:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e797fb640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:10:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e797fb640 1 -- 172.21.15.5:0/239359439 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e740a1c00 con 0x7f3e740a7600 2024-08-18T21:10:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e717fa640 4 set_mon_vals no callback set 2024-08-18T21:10:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e797fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e797fb640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e7413bab0 0x7f3e7413be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e797fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e797fb640 1 -- 172.21.15.5:0/239359439 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f3e740a7b60 con 0x7f3e7413bab0 2024-08-18T21:10:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e72ffd640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e7413bab0 0x7f3e7413be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e72ffd640 10 monclient: get_auth_request con 0x7f3e7413bab0 auth_method 0 2024-08-18T21:10:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e72ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e72ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e72ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e6b7fe640 1 -- 172.21.15.5:0/239359439 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f3e5c014430 con 0x7f3e740a7600 2024-08-18T21:10:40.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e72ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e72ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e72ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e72ffd640 10 monclient(hunting): handle_auth_done global_id 6520 payload 824 2024-08-18T21:10:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e6b7fe640 1 --2- 172.21.15.5:0/239359439 >> v2:172.21.15.157:6812/631023601 conn(0x7f3e5403bdc0 0x7f3e5403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e72ffd640 1 -- 172.21.15.5:0/239359439 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e7413f810 con 0x7f3e7413bab0 2024-08-18T21:10:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e6b7fe640 1 -- 172.21.15.5:0/239359439 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(208..208 src has 22..208) ==== 3506+0+0 (secure 0 0 0) 0x7f3e5c00f040 con 0x7f3e740a7600 2024-08-18T21:10:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e737fe640 1 --2- 172.21.15.5:0/239359439 >> v2:172.21.15.157:6812/631023601 conn(0x7f3e5403bdc0 0x7f3e5403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.589+0000 7f3e737fe640 10 monclient: get_auth_request con 0x7f3e5403bdc0 auth_method 0 2024-08-18T21:10:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.593+0000 7f3e72ffd640 1 -- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e7413bab0 msgr2=0x7f3e7413be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.593+0000 7f3e72ffd640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e7413bab0 0x7f3e7413be90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0af000 tx=0x7f3e6c0195b0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.593+0000 7f3e6b7fe640 1 -- 172.21.15.5:0/239359439 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3e6c0bc020 con 0x7f3e7413bab0 2024-08-18T21:10:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.593+0000 7f3e6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.593+0000 7f3e6b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.593+0000 7f3e6b7fe640 10 monclient: dump: 2024-08-18T21:10:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.613 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.593+0000 7f3e6b7fe640 1 -- 172.21.15.5:0/239359439 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3e6c0b3040 con 0x7f3e7413bab0 2024-08-18T21:10:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.593+0000 7f3e6b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.593+0000 7f3e6b7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.593+0000 7f3e6b7fe640 1 -- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e7413bab0 msgr2=0x7f3e7413be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.593+0000 7f3e6b7fe640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e7413bab0 0x7f3e7413be90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0af000 tx=0x7f3e6c0195b0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.593+0000 7f3e6b7fe640 1 -- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e7413bab0 msgr2=0x7f3e7413be90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.593+0000 7f3e6b7fe640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e7413bab0 0x7f3e7413be90 secure :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0af000 tx=0x7f3e6c0195b0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.593+0000 7f3e737fe640 1 --2- 172.21.15.5:0/239359439 >> v2:172.21.15.157:6812/631023601 conn(0x7f3e5403bdc0 0x7f3e5403e280 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3e7413d190 tx=0x7f3e64008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e797fb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e797fb640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e7413c3d0 0x7f3e7409dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e797fb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e797fb640 1 -- 172.21.15.5:0/239359439 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f3e74051140 con 0x7f3e7413c3d0 2024-08-18T21:10:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e72ffd640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e7413c3d0 0x7f3e7409dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e72ffd640 10 monclient: get_auth_request con 0x7f3e7413c3d0 auth_method 0 2024-08-18T21:10:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e72ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e72ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e72ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e72ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e72ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e72ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e72ffd640 10 monclient(hunting): handle_auth_done global_id 6529 payload 824 2024-08-18T21:10:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e72ffd640 1 -- 172.21.15.5:0/239359439 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3e7413def0 con 0x7f3e7413c3d0 2024-08-18T21:10:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e72ffd640 1 -- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e7413c3d0 msgr2=0x7f3e7409dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e72ffd640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e7413c3d0 0x7f3e7409dc70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c01d0b0 tx=0x7f3e6c0a7000 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e6b7fe640 1 -- 172.21.15.5:0/239359439 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3e6c0bc040 con 0x7f3e7413c3d0 2024-08-18T21:10:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e6b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e6b7fe640 10 monclient: dump: 2024-08-18T21:10:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.617 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e6b7fe640 1 -- 172.21.15.5:0/239359439 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f3e6c0a5540 con 0x7f3e7413c3d0 2024-08-18T21:10:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e6b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e6b7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e6b7fe640 1 -- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e7413c3d0 msgr2=0x7f3e7409dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e6b7fe640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e7413c3d0 0x7f3e7409dc70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c01d0b0 tx=0x7f3e6c0a7000 comp rx=0 tx=0).stop 2024-08-18T21:10:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e6b7fe640 1 -- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e7413c3d0 msgr2=0x7f3e7409dc70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.601+0000 7f3e6b7fe640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3e7413c3d0 0x7f3e7409dc70 secure :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c01d0b0 tx=0x7f3e6c0a7000 comp rx=0 tx=0).stop 2024-08-18T21:10:40.618 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:40.618 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:40.618 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:40.618 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:40.618 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:40.618 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 449719, 2024-08-18T21:10:40.619 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:40.619 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:40.619 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:40.619 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:40.619 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:40.619 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:40.619 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:40.619 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:40.619 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:40.619 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:40.619 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.619 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:10:40.620 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:40.620 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:40.620 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:40.620 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:40.620 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:40.620 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:40.620 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:40.620 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:40.620 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:40.621 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:40.621 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:40.621 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:40.621 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:40.621 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:40.621 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.621 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:40.621 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:40.621 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:40.621 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:40.621 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:40.621 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:40.621 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:40.622 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:40.622 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:40.622 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:40.622 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:40.622 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:40.622 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:40.622 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.622 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:40.622 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:40.622 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:40.622 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:40.623 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:40.623 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:40.623 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:40.623 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:40.623 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:40.623 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:40.623 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:40.623 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:40.623 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:40.623 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:40.623 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:40.623 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:40.624 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:40.624 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:40.624 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:40.624 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:40.624 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:40.624 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:40.624 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:40.624 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:40.624 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:40.624 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:40.624 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:40.624 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:40.624 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.624 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:40.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.625 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:40.625 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.625 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:40.625 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:40.625 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.625 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.625 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.625 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.625 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:40.625 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.625 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.626 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.626 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:40.626 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.626 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.626 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.626 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:40.626 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:40.626 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.626 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.626 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.627 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:40.627 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:40.627 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.627 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.627 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.627 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:40.627 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.627 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.627 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:40.628 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.628 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.628 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.628 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:40.628 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:40.628 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.628 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.628 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.628 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.628 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:40.628 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:40.629 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.629 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.629 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.629 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.629 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:40.629 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.629 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.629 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.629 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:40.629 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.629 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.629 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.630 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:40.630 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:40.630 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.630 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.630 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.630 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.630 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:40.630 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:40.630 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.630 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.630 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.631 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.631 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:40.631 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.631 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.631 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:40.631 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.631 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.631 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.631 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:40.631 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:40.632 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.632 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.632 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.632 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:40.632 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:40.632 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.632 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.632 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.632 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:40.632 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.633 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.633 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:40.633 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.633 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.633 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.633 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:40.633 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:40.633 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.633 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.633 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.634 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:40.634 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:40.634 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.634 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.634 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.634 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:40.634 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.634 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.634 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:40.635 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.635 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.635 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.635 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:40.635 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:40.635 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.635 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.635 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.635 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:40.635 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:40.636 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.636 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.636 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.636 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:40.636 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.636 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.636 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:40.636 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.636 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.636 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.637 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:40.637 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:40.637 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.637 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.637 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.637 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:40.637 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:40.637 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.637 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.638 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.638 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:40.638 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.638 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.638 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:40.638 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.638 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.638 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.638 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:40.638 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:40.639 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.639 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.639 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.639 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:40.639 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:40.639 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.639 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.639 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.639 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:40.639 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.640 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.640 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:40.640 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.640 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.640 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.640 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:40.640 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:40.640 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.640 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.640 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.640 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.641 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.641 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:40.641 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:40.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.642 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:40.642 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:40.642 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:40.642 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.642 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.642 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:10:40.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.642 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:40.642 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:40.642 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:40.642 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.642 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.643 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:40.643 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.643 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:40.643 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:40.643 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:10:40.643 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.643 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.643 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:40.643 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:40.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.605+0000 7f3e797fb640 1 -- 172.21.15.5:0/239359439 >> v2:172.21.15.157:6812/631023601 conn(0x7f3e5403bdc0 msgr2=0x7f3e5403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.605+0000 7f3e797fb640 1 --2- 172.21.15.5:0/239359439 >> v2:172.21.15.157:6812/631023601 conn(0x7f3e5403bdc0 0x7f3e5403e280 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3e7413d190 tx=0x7f3e64008040 comp rx=0 tx=0).stop 2024-08-18T21:10:40.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.605+0000 7f3e797fb640 10 monclient: shutdown 2024-08-18T21:10:40.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.605+0000 7f3e797fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:40.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.605+0000 7f3e797fb640 1 -- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3e740a7600 msgr2=0x7f3e74136030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.605+0000 7f3e797fb640 1 --2- 172.21.15.5:0/239359439 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3e740a7600 0x7f3e74136030 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00d800 tx=0x7f3e5c00dcc0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.605+0000 7f3e737fe640 1 -- 172.21.15.5:0/239359439 reap_dead start 2024-08-18T21:10:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.605+0000 7f3e737fe640 1 -- 172.21.15.5:0/239359439 reap_dead start 2024-08-18T21:10:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.605+0000 7f3e797fb640 1 -- 172.21.15.5:0/239359439 shutdown_connections 2024-08-18T21:10:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.605+0000 7f3e797fb640 1 -- 172.21.15.5:0/239359439 >> 172.21.15.5:0/239359439 conn(0x7f3e740acbc0 msgr2=0x7f3e740a5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.605+0000 7f3e797fb640 1 -- 172.21.15.5:0/239359439 shutdown_connections 2024-08-18T21:10:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.605+0000 7f3e797fb640 1 -- 172.21.15.5:0/239359439 wait complete. 2024-08-18T21:10:40.646 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:40.646 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:10:40.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:10:40.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 10 monclient: get_monmap_and_config 2024-08-18T21:10:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 10 monclient: build_initial_monmap 2024-08-18T21:10:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 10 monclient: monmap: 2024-08-18T21:10:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:40.768657+0000 2024-08-18T21:10:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:40.768657+0000 2024-08-18T21:10:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:40.768 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 1 Processor -- start 2024-08-18T21:10:40.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 1 -- start start 2024-08-18T21:10:40.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 10 monclient: init 2024-08-18T21:10:40.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 10 monclient: _add_conns ranks=[0,6,10,3,8,9,5,7,2,1,4] 2024-08-18T21:10:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f931c0a6bd0 addr v1:172.21.15.5:6789/0 2024-08-18T21:10:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c09f080 0x7f931c13ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 10 monclient(hunting): picked mon.noname-d con 0x7f931c09f080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f931c0a76c0 0x7f931c141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 10 monclient(hunting): picked mon.noname-f con 0x7f931c0a76c0 addr v2:172.21.15.157:3300/0 2024-08-18T21:10:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931c0a7fb0 con 0x7f931c0a6bd0 2024-08-18T21:10:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f931c09e4c0 con 0x7f931c0a76c0 2024-08-18T21:10:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f931c06f930 con 0x7f931c09f080 2024-08-18T21:10:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9324102640 10 monclient(hunting): authenticate will time out at 1407.781687s 2024-08-18T21:10:40.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9321e9e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f931c0a6bd0 0x7f931c0a6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32854/0 (socket says 172.21.15.5:32854) 2024-08-18T21:10:40.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f9321e9e640 1 -- 172.21.15.5:0/66230201 learned_addr learned my addr 172.21.15.5:0/66230201 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:10:40.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 1 --2- 172.21.15.5:0/66230201 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c09f080 0x7f931c13ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 10 monclient(hunting): get_auth_request con 0x7f931c09f080 auth_method 0 2024-08-18T21:10:40.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932269f640 1 --2- 172.21.15.5:0/66230201 >> v2:172.21.15.157:3300/0 conn(0x7f931c0a76c0 0x7f931c141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932269f640 10 monclient(hunting): get_auth_request con 0x7f931c0a76c0 auth_method 0 2024-08-18T21:10:40.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932269f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932269f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932269f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 10 monclient(hunting): handle_auth_done global_id 84948 payload 274 2024-08-18T21:10:40.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 1 -- 172.21.15.5:0/66230201 >> v2:172.21.15.157:3300/0 conn(0x7f931c0a76c0 msgr2=0x7f931c141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:40.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 1 --2- 172.21.15.5:0/66230201 >> v2:172.21.15.157:3300/0 conn(0x7f931c0a76c0 0x7f931c141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 1 -- 172.21.15.5:0/66230201 >> v1:172.21.15.5:6789/0 conn(0x7f931c0a6bd0 legacy=0x7f931c0a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:40.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 10 monclient: _finish_hunting 0 2024-08-18T21:10:40.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 1 monclient: found mon.noname-d 2024-08-18T21:10:40.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:40.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:10:40.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.765+0000 7f932169d640 1 -- 172.21.15.5:0/66230201 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c09de70 con 0x7f931c09f080 2024-08-18T21:10:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f932169d640 1 -- 172.21.15.5:0/66230201 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c09f080 msgr2=0x7f931c13ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f932169d640 1 --2- 172.21.15.5:0/66230201 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c09f080 0x7f931c13ede0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f930c0097c0 tx=0x7f930c01c360 comp rx=0 tx=0).ready entity=mon.6 client_cookie=f4a589266d0c25b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9320e9c640 1 -- 172.21.15.5:0/66230201 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f930c0b0070 con 0x7f931c09f080 2024-08-18T21:10:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9320e9c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9320e9c640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:10:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9320e9c640 10 monclient: dump: 2024-08-18T21:10:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.779 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9320e9c640 10 monclient: _finish_auth 0 2024-08-18T21:10:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9320e9c640 10 monclient: _check_auth_tickets 2024-08-18T21:10:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9320e9c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9324102640 5 monclient: authenticate success, global_id 84948 2024-08-18T21:10:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9320e9c640 1 -- 172.21.15.5:0/66230201 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f930c0aa810 con 0x7f931c09f080 2024-08-18T21:10:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9324102640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:10:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9320e9c640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9324102640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9324102640 4 set_mon_vals no callback set 2024-08-18T21:10:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9320e9c640 1 -- 172.21.15.5:0/66230201 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f930c0a9300 con 0x7f931c09f080 2024-08-18T21:10:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9320e9c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9320e9c640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9320e9c640 10 monclient: dump: 2024-08-18T21:10:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.781 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9324102640 10 monclient: shutdown 2024-08-18T21:10:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9324102640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9324102640 1 -- 172.21.15.5:0/66230201 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c09f080 msgr2=0x7f931c13ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9324102640 1 --2- 172.21.15.5:0/66230201 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c09f080 0x7f931c13ede0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f930c0097c0 tx=0x7f930c01c360 comp rx=0 tx=0).stop 2024-08-18T21:10:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9324102640 1 -- 172.21.15.5:0/66230201 shutdown_connections 2024-08-18T21:10:40.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9324102640 1 --2- 172.21.15.5:0/66230201 >> v2:172.21.15.157:3300/0 conn(0x7f931c0a76c0 0x7f931c141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9324102640 1 --2- 172.21.15.5:0/66230201 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c09f080 0x7f931c13ede0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9324102640 1 -- 172.21.15.5:0/66230201 >> 172.21.15.5:0/66230201 conn(0x7f931c068700 msgr2=0x7f931c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:40.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9324102640 1 -- 172.21.15.5:0/66230201 shutdown_connections 2024-08-18T21:10:40.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9324102640 1 -- 172.21.15.5:0/66230201 wait complete. 2024-08-18T21:10:40.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9324102640 10 monclient: build_initial_monmap 2024-08-18T21:10:40.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.769+0000 7f9324102640 10 monclient: monmap: 2024-08-18T21:10:40.782 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:40.782 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:40.782 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:40.783 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 1 Processor -- start 2024-08-18T21:10:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 1 -- start start 2024-08-18T21:10:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 10 monclient: init 2024-08-18T21:10:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 10 monclient: _add_conns ranks=[8,7,6,1,2,4,3,0,5] 2024-08-18T21:10:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f931c09f080 0x7f931c128e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 10 monclient(hunting): picked mon.noname-e con 0x7f931c09f080 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f931c0a6bd0 0x7f931c1d1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 10 monclient(hunting): picked mon.noname-i con 0x7f931c0a6bd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c0a76c0 0x7f931c1267c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 10 monclient(hunting): picked mon.noname-d con 0x7f931c0a76c0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f931c144210 con 0x7f931c0a76c0 2024-08-18T21:10:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f931c144090 con 0x7f931c0a6bd0 2024-08-18T21:10:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f931c144390 con 0x7f931c09f080 2024-08-18T21:10:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 10 monclient(hunting): authenticate will time out at 1407.788775s 2024-08-18T21:10:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c0a76c0 0x7f931c1267c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9321e9e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f931c09f080 0x7f931c128e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9321e9e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f931c09f080 0x7f931c128e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:51028/0 (socket says 172.21.15.5:51028) 2024-08-18T21:10:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c0a76c0 0x7f931c1267c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54768/0 (socket says 172.21.15.5:54768) 2024-08-18T21:10:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9321e9e640 1 -- 172.21.15.5:0/2778948224 learned_addr learned my addr 172.21.15.5:0/2778948224 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9321e9e640 10 monclient(hunting): get_auth_request con 0x7f931c09f080 auth_method 0 2024-08-18T21:10:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9321e9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9321e9e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9321e9e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 10 monclient(hunting): get_auth_request con 0x7f931c0a76c0 auth_method 0 2024-08-18T21:10:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9321e9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9321e9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9321e9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932169d640 1 --2- 172.21.15.5:0/2778948224 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f931c0a6bd0 0x7f931c1d1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932169d640 10 monclient(hunting): get_auth_request con 0x7f931c0a6bd0 auth_method 0 2024-08-18T21:10:40.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932169d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932169d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932169d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 10 monclient(hunting): handle_auth_done global_id 84957 payload 824 2024-08-18T21:10:40.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 1 -- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f931c09f080 msgr2=0x7f931c128e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 1 --2- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f931c09f080 0x7f931c128e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 1 -- 172.21.15.5:0/2778948224 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f931c0a6bd0 msgr2=0x7f931c1d1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 1 --2- 172.21.15.5:0/2778948224 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f931c0a6bd0 0x7f931c1d1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 10 monclient: _finish_hunting 0 2024-08-18T21:10:40.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 1 monclient: found mon.noname-d 2024-08-18T21:10:40.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:40.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:10:40.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 1 -- 172.21.15.5:0/2778948224 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c0aba80 con 0x7f931c0a76c0 2024-08-18T21:10:40.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 1 -- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c0a76c0 msgr2=0x7f931c1267c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f932269f640 1 --2- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c0a76c0 0x7f931c1267c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9314007cf0 tx=0x7f931400e4b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f93127fc640 1 -- 172.21.15.5:0/2778948224 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f93140098b0 con 0x7f931c0a76c0 2024-08-18T21:10:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f93127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f93127fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:10:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f93127fc640 10 monclient: dump: 2024-08-18T21:10:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.794 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f93127fc640 10 monclient: _finish_auth 0 2024-08-18T21:10:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f93127fc640 10 monclient: _check_auth_tickets 2024-08-18T21:10:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f93127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f93127fc640 1 -- 172.21.15.5:0/2778948224 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9314014890 con 0x7f931c0a76c0 2024-08-18T21:10:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f93127fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 5 monclient: authenticate success, global_id 84957 2024-08-18T21:10:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f93127fc640 1 -- 172.21.15.5:0/2778948224 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9314013380 con 0x7f931c0a76c0 2024-08-18T21:10:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 10 monclient: _renew_subs 2024-08-18T21:10:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 1 -- 172.21.15.5:0/2778948224 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931c12a050 con 0x7f931c0a76c0 2024-08-18T21:10:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9313fff640 4 set_mon_vals no callback set 2024-08-18T21:10:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f93127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f93127fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f93127fc640 10 monclient: dump: 2024-08-18T21:10:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.796 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.773+0000 7f9324102640 10 monclient: _renew_subs 2024-08-18T21:10:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9324102640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9324102640 1 -- 172.21.15.5:0/2778948224 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f931c1c9220 con 0x7f931c0a76c0 2024-08-18T21:10:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9324102640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9324102640 1 --2- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c1d1ec0 0x7f931c126d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9324102640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9324102640 1 -- 172.21.15.5:0/2778948224 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f931c0abf90 con 0x7f931c1d1ec0 2024-08-18T21:10:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f93127fc640 1 -- 172.21.15.5:0/2778948224 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f931401b030 con 0x7f931c0a76c0 2024-08-18T21:10:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9321e9e640 1 --2- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c1d1ec0 0x7f931c126d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9321e9e640 10 monclient: get_auth_request con 0x7f931c1d1ec0 auth_method 0 2024-08-18T21:10:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9321e9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9321e9e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9321e9e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9321e9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9321e9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9321e9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f93127fc640 1 --2- 172.21.15.5:0/2778948224 >> v2:172.21.15.157:6812/631023601 conn(0x7f930003bdc0 0x7f930003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9321e9e640 10 monclient(hunting): handle_auth_done global_id 84966 payload 824 2024-08-18T21:10:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9321e9e640 1 -- 172.21.15.5:0/2778948224 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f931c1297a0 con 0x7f931c1d1ec0 2024-08-18T21:10:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f93127fc640 1 -- 172.21.15.5:0/2778948224 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(208..208 src has 22..208) ==== 3506+0+0 (secure 0 0 0) 0x7f9314019020 con 0x7f931c0a76c0 2024-08-18T21:10:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f932169d640 1 --2- 172.21.15.5:0/2778948224 >> v2:172.21.15.157:6812/631023601 conn(0x7f930003bdc0 0x7f930003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f932169d640 10 monclient: get_auth_request con 0x7f930003bdc0 auth_method 0 2024-08-18T21:10:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9321e9e640 1 -- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c1d1ec0 msgr2=0x7f931c126d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f9321e9e640 1 --2- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c1d1ec0 0x7f931c126d00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f931800eaa0 tx=0x7f931800ef60 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f93127fc640 1 -- 172.21.15.5:0/2778948224 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f931800cc40 con 0x7f931c1d1ec0 2024-08-18T21:10:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f93127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f93127fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f93127fc640 10 monclient: dump: 2024-08-18T21:10:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.799 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f93127fc640 1 -- 172.21.15.5:0/2778948224 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9318019070 con 0x7f931c1d1ec0 2024-08-18T21:10:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f93127fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f93127fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f93127fc640 1 -- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c1d1ec0 msgr2=0x7f931c126d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f93127fc640 1 --2- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c1d1ec0 0x7f931c126d00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f931800eaa0 tx=0x7f931800ef60 comp rx=0 tx=0).stop 2024-08-18T21:10:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f93127fc640 1 -- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c1d1ec0 msgr2=0x7f931c126d00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.777+0000 7f93127fc640 1 --2- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c1d1ec0 0x7f931c126d00 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f931800eaa0 tx=0x7f931800ef60 comp rx=0 tx=0).stop 2024-08-18T21:10:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.781+0000 7f932169d640 1 --2- 172.21.15.5:0/2778948224 >> v2:172.21.15.157:6812/631023601 conn(0x7f930003bdc0 0x7f930003e280 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f931c09db50 tx=0x7f930c0a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.785+0000 7f9324102640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.785+0000 7f9324102640 1 --2- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c127240 0x7f931c122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.785+0000 7f9324102640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.785+0000 7f9324102640 1 -- 172.21.15.5:0/2778948224 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f931c051140 con 0x7f931c127240 2024-08-18T21:10:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.785+0000 7f9321e9e640 1 --2- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c127240 0x7f931c122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.785+0000 7f9321e9e640 10 monclient: get_auth_request con 0x7f931c127240 auth_method 0 2024-08-18T21:10:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.785+0000 7f9321e9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.785+0000 7f9321e9e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.785+0000 7f9321e9e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.785+0000 7f9321e9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.785+0000 7f9321e9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.785+0000 7f9321e9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.785+0000 7f9321e9e640 10 monclient(hunting): handle_auth_done global_id 84975 payload 824 2024-08-18T21:10:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.785+0000 7f9321e9e640 1 -- 172.21.15.5:0/2778948224 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f931c127650 con 0x7f931c127240 2024-08-18T21:10:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f9321e9e640 1 -- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c127240 msgr2=0x7f931c122820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f9321e9e640 1 --2- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c127240 0x7f931c122820 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9318018000 tx=0x7f9318004950 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f93127fc640 1 -- 172.21.15.5:0/2778948224 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f93180148f0 con 0x7f931c127240 2024-08-18T21:10:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f93127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f93127fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f93127fc640 10 monclient: dump: 2024-08-18T21:10:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.803 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.803 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.803 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.803 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f93127fc640 1 -- 172.21.15.5:0/2778948224 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f9318014480 con 0x7f931c127240 2024-08-18T21:10:40.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f93127fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:40.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f93127fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:40.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f93127fc640 1 -- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c127240 msgr2=0x7f931c122820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f93127fc640 1 --2- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c127240 0x7f931c122820 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9318018000 tx=0x7f9318004950 comp rx=0 tx=0).stop 2024-08-18T21:10:40.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f93127fc640 1 -- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c127240 msgr2=0x7f931c122820 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:40.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f93127fc640 1 --2- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c127240 0x7f931c122820 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9318018000 tx=0x7f9318004950 comp rx=0 tx=0).stop 2024-08-18T21:10:40.804 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:40.804 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:40.804 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:40.804 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:40.804 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:40.804 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 137618, 2024-08-18T21:10:40.804 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:40.804 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:40.804 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:40.804 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:40.804 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:40.804 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:40.805 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:40.805 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:40.805 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:40.805 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:40.805 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.805 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:10:40.805 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:40.805 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:40.805 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:40.805 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:40.805 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:40.805 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:40.805 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:40.806 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:40.806 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:40.806 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:40.806 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:40.806 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:40.806 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:40.806 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:40.806 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.806 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:40.806 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:40.806 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:40.806 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:40.806 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:40.807 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:40.807 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:40.807 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:40.807 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:40.807 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:40.807 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:40.807 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:40.807 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:40.807 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.807 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:40.807 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:40.807 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:40.808 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:40.808 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:40.808 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:40.808 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:40.808 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:40.808 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:40.808 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:40.808 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:40.808 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:40.808 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:40.808 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:40.808 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:40.808 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:40.809 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:40.809 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:40.809 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:40.809 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:40.809 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:40.809 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:40.809 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:40.809 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:40.809 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:40.809 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:40.809 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:40.809 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:40.809 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.809 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:40.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.810 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:40.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.810 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:40.810 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:40.810 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.810 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.810 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.810 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:40.810 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.811 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.811 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:40.811 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.811 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.811 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.811 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:40.811 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:40.811 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.811 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.811 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.812 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:40.812 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:40.812 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.812 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.812 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.812 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:40.812 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.812 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.812 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:40.813 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.813 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.813 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.813 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:40.813 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:40.813 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.813 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.813 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.813 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:40.813 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:40.814 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.814 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.814 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.814 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.814 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:40.814 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.814 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.814 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.814 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:40.814 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.814 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.814 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.815 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:40.815 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:40.815 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.815 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.815 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.815 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:40.815 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:40.815 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.815 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.815 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.816 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:40.816 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.816 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.816 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.816 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:40.816 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.816 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.816 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.816 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:40.816 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:40.816 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.816 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.817 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.817 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:40.817 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:40.817 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.817 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.817 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.817 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:40.817 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.817 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.818 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:40.818 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.818 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.818 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.818 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:40.818 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:40.818 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.818 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.818 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.818 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:40.819 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:40.819 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.819 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.819 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.819 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:40.819 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.819 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.819 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:40.819 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.819 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.819 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.820 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:40.820 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:40.820 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.820 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.820 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.820 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:40.820 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:40.820 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.820 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.820 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:40.821 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.821 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:40.821 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.821 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.821 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:40.821 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:40.821 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.821 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.822 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.822 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:40.822 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:40.822 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.822 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.822 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.822 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:40.822 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.823 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.823 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:40.823 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.823 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.823 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.823 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:40.823 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:40.823 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.823 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.823 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.823 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:40.824 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:40.824 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.824 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.824 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.824 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:40.824 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.825 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.825 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:40.825 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.825 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.825 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.825 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:40.825 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:40.825 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.825 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.825 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.825 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.825 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.826 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:40.826 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:40.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.826 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:40.826 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:40.826 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:40.826 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.826 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.826 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:10:40.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.826 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:40.826 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:40.827 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:10:40.827 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.827 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.827 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:40.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.827 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:40.827 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:40.827 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:10:40.827 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.827 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.827 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:40.827 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f9324102640 1 -- 172.21.15.5:0/2778948224 >> v2:172.21.15.157:6812/631023601 conn(0x7f930003bdc0 msgr2=0x7f930003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f9324102640 1 --2- 172.21.15.5:0/2778948224 >> v2:172.21.15.157:6812/631023601 conn(0x7f930003bdc0 0x7f930003e280 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f931c09db50 tx=0x7f930c0a6000 comp rx=0 tx=0).stop 2024-08-18T21:10:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f9324102640 10 monclient: shutdown 2024-08-18T21:10:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f9324102640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f9324102640 1 -- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c0a76c0 msgr2=0x7f931c1267c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f932269f640 1 -- 172.21.15.5:0/2778948224 reap_dead start 2024-08-18T21:10:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f9324102640 1 --2- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c0a76c0 0x7f931c1267c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9314007cf0 tx=0x7f931400e4b0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f9324102640 1 -- 172.21.15.5:0/2778948224 shutdown_connections 2024-08-18T21:10:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f9324102640 1 --2- 172.21.15.5:0/2778948224 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f931c0a76c0 0x7f931c1267c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f9324102640 1 -- 172.21.15.5:0/2778948224 >> 172.21.15.5:0/2778948224 conn(0x7f931c068700 msgr2=0x7f931c0a5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f9324102640 1 -- 172.21.15.5:0/2778948224 shutdown_connections 2024-08-18T21:10:40.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.789+0000 7f9324102640 1 -- 172.21.15.5:0/2778948224 wait complete. 2024-08-18T21:10:40.830 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:40.830 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:10:40.830 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:10:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.945+0000 7f089a3b0640 10 monclient: get_monmap_and_config 2024-08-18T21:10:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.945+0000 7f089a3b0640 10 monclient: build_initial_monmap 2024-08-18T21:10:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.945+0000 7f089a3b0640 10 monclient: monmap: 2024-08-18T21:10:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:40.951320+0000 2024-08-18T21:10:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:40.951320+0000 2024-08-18T21:10:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:40.951 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:40.951 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:40.951 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:40.951 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 1 Processor -- start 2024-08-18T21:10:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 1 -- start start 2024-08-18T21:10:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 10 monclient: init 2024-08-18T21:10:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 10 monclient: _add_conns ranks=[6,10,2,8,1,3,7,4,0,5,9] 2024-08-18T21:10:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08940a6ce0 0x7f08940a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 10 monclient(hunting): picked mon.noname-d con 0x7f08940a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f08940a7600 0x7f0894139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 10 monclient(hunting): picked mon.noname-f con 0x7f08940a7600 addr v2:172.21.15.157:3300/0 2024-08-18T21:10:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0894139fe0 0x7f089413a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 10 monclient(hunting): picked mon.noname-b con 0x7f0894139fe0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f08940a5000 con 0x7f08940a7600 2024-08-18T21:10:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f08940a4360 con 0x7f0894139fe0 2024-08-18T21:10:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f08940a45d0 con 0x7f08940a6ce0 2024-08-18T21:10:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089a3b0640 10 monclient(hunting): authenticate will time out at 1407.965005s 2024-08-18T21:10:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08940a6ce0 0x7f08940a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08940a6ce0 0x7f08940a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54800/0 (socket says 172.21.15.5:54800) 2024-08-18T21:10:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 1 -- 172.21.15.5:0/3438253210 learned_addr learned my addr 172.21.15.5:0/3438253210 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 10 monclient(hunting): get_auth_request con 0x7f08940a6ce0 auth_method 0 2024-08-18T21:10:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089894d640 1 --2- 172.21.15.5:0/3438253210 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0894139fe0 0x7f089413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089894d640 10 monclient(hunting): get_auth_request con 0x7f0894139fe0 auth_method 0 2024-08-18T21:10:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089894d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089894d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089894d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089894d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089894d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089894d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f088b7fe640 1 --2- 172.21.15.5:0/3438253210 >> v2:172.21.15.157:3300/0 conn(0x7f08940a7600 0x7f0894139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f088b7fe640 10 monclient(hunting): get_auth_request con 0x7f08940a7600 auth_method 0 2024-08-18T21:10:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f088b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f088b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f088b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 10 monclient(hunting): handle_auth_done global_id 84984 payload 274 2024-08-18T21:10:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 1 -- 172.21.15.5:0/3438253210 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0894139fe0 msgr2=0x7f089413a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 1 --2- 172.21.15.5:0/3438253210 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0894139fe0 0x7f089413a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 1 -- 172.21.15.5:0/3438253210 >> v2:172.21.15.157:3300/0 conn(0x7f08940a7600 msgr2=0x7f0894139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 1 --2- 172.21.15.5:0/3438253210 >> v2:172.21.15.157:3300/0 conn(0x7f08940a7600 0x7f0894139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 10 monclient: _finish_hunting 0 2024-08-18T21:10:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 1 monclient: found mon.noname-d 2024-08-18T21:10:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:10:40.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f0893fff640 1 -- 172.21.15.5:0/3438253210 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08940a32d0 con 0x7f08940a6ce0 2024-08-18T21:10:40.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.949+0000 7f089894d640 1 --2- 172.21.15.5:0/3438253210 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0894139fe0 0x7f089413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:40.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f0893fff640 1 -- 172.21.15.5:0/3438253210 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08940a6ce0 msgr2=0x7f08940a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f0893fff640 1 --2- 172.21.15.5:0/3438253210 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08940a6ce0 0x7f08940a70c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0884009e80 tx=0x7f088401c8d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=e2589237c07064da server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f08937fe640 1 -- 172.21.15.5:0/3438253210 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f08840090d0 con 0x7f08940a6ce0 2024-08-18T21:10:40.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f08937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f08937fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:10:40.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f08937fe640 10 monclient: dump: 2024-08-18T21:10:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.969 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.969 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f08937fe640 10 monclient: _finish_auth 0 2024-08-18T21:10:40.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f08937fe640 10 monclient: _check_auth_tickets 2024-08-18T21:10:40.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f08937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:40.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 5 monclient: authenticate success, global_id 84984 2024-08-18T21:10:40.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:10:40.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f08937fe640 1 -- 172.21.15.5:0/3438253210 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08840a5a70 con 0x7f08940a6ce0 2024-08-18T21:10:40.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f08937fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:40.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:40.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 4 set_mon_vals no callback set 2024-08-18T21:10:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f08937fe640 1 -- 172.21.15.5:0/3438253210 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f08840a5c20 con 0x7f08940a6ce0 2024-08-18T21:10:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f08937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f08937fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f08937fe640 10 monclient: dump: 2024-08-18T21:10:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.971 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 10 monclient: shutdown 2024-08-18T21:10:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 1 -- 172.21.15.5:0/3438253210 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08940a6ce0 msgr2=0x7f08940a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 1 --2- 172.21.15.5:0/3438253210 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08940a6ce0 0x7f08940a70c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0884009e80 tx=0x7f088401c8d0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 1 -- 172.21.15.5:0/3438253210 shutdown_connections 2024-08-18T21:10:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 1 --2- 172.21.15.5:0/3438253210 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0894139fe0 0x7f089413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 1 --2- 172.21.15.5:0/3438253210 >> v2:172.21.15.157:3300/0 conn(0x7f08940a7600 0x7f0894139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 1 --2- 172.21.15.5:0/3438253210 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f08940a6ce0 0x7f08940a70c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 1 -- 172.21.15.5:0/3438253210 >> 172.21.15.5:0/3438253210 conn(0x7f08940acbc0 msgr2=0x7f08940a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 1 -- 172.21.15.5:0/3438253210 shutdown_connections 2024-08-18T21:10:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 1 -- 172.21.15.5:0/3438253210 wait complete. 2024-08-18T21:10:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 10 monclient: build_initial_monmap 2024-08-18T21:10:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 10 monclient: monmap: 2024-08-18T21:10:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:40.973 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.953+0000 7f089a3b0640 1 Processor -- start 2024-08-18T21:10:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 1 -- start start 2024-08-18T21:10:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 10 monclient: init 2024-08-18T21:10:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 10 monclient: _add_conns ranks=[1,8,5,3,4,7,0,2,6] 2024-08-18T21:10:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08940a6ce0 0x7f0894136130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 10 monclient(hunting): picked mon.noname-f con 0x7f08940a6ce0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:10:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f08940a7600 0x7f0894136670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 10 monclient(hunting): picked mon.noname-e con 0x7f08940a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0894139fe0 0x7f0894136bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 10 monclient(hunting): picked mon.noname-h con 0x7f0894139fe0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f08940a79e0 con 0x7f08940a6ce0 2024-08-18T21:10:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f08940a8220 con 0x7f0894139fe0 2024-08-18T21:10:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f0894140400 con 0x7f08940a7600 2024-08-18T21:10:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089a3b0640 10 monclient(hunting): authenticate will time out at 1407.972500s 2024-08-18T21:10:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f08940a7600 0x7f0894136670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f08940a7600 0x7f0894136670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:51044/0 (socket says 172.21.15.5:51044) 2024-08-18T21:10:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 1 -- 172.21.15.5:0/2566638516 learned_addr learned my addr 172.21.15.5:0/2566638516 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 10 monclient(hunting): get_auth_request con 0x7f08940a7600 auth_method 0 2024-08-18T21:10:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f0893fff640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08940a6ce0 0x7f0894136130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 10 monclient(hunting): handle_auth_done global_id 55565 payload 824 2024-08-18T21:10:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 1 -- 172.21.15.5:0/2566638516 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0894139fe0 msgr2=0x7f0894136bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f089894d640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0894139fe0 0x7f0894136bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0894139fe0 0x7f0894136bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 1 -- 172.21.15.5:0/2566638516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08940a6ce0 msgr2=0x7f0894136130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08940a6ce0 0x7f0894136130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:10:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 1 monclient: found mon.noname-e 2024-08-18T21:10:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:10:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 1 -- 172.21.15.5:0/2566638516 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08940a1fa0 con 0x7f08940a7600 2024-08-18T21:10:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f0893fff640 10 monclient: get_auth_request con 0x7f08940a6ce0 auth_method 0 2024-08-18T21:10:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f0893fff640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08940a6ce0 0x7f0894136130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 1 -- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f08940a7600 msgr2=0x7f0894136670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f088b7fe640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f08940a7600 0x7f0894136670 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f087c00d800 tx=0x7f087c00dcc0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f08917fa640 1 -- 172.21.15.5:0/2566638516 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f087c00bd40 con 0x7f08940a7600 2024-08-18T21:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f08917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f08917fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f08917fa640 10 monclient: dump: 2024-08-18T21:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.978 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f08917fa640 10 monclient: _finish_auth 0 2024-08-18T21:10:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f08917fa640 10 monclient: _check_auth_tickets 2024-08-18T21:10:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f08917fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f08917fa640 1 -- 172.21.15.5:0/2566638516 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087c019070 con 0x7f08940a7600 2024-08-18T21:10:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f08917fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f08917fa640 1 -- 172.21.15.5:0/2566638516 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f087c0148a0 con 0x7f08940a7600 2024-08-18T21:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f08917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f08917fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f08917fa640 10 monclient: dump: 2024-08-18T21:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.957+0000 7f0892ffd640 4 set_mon_vals no callback set 2024-08-18T21:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f089a3b0640 5 monclient: authenticate success, global_id 55565 2024-08-18T21:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f089a3b0640 10 monclient: _renew_subs 2024-08-18T21:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f089a3b0640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f089a3b0640 1 -- 172.21.15.5:0/2566638516 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08940aa6e0 con 0x7f08940a7600 2024-08-18T21:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f089a3b0640 10 monclient: _renew_subs 2024-08-18T21:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f089a3b0640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f089a3b0640 1 -- 172.21.15.5:0/2566638516 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f0894137700 con 0x7f08940a7600 2024-08-18T21:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f089a3b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f089a3b0640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f089413dae0 0x7f0894063b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f089a3b0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f089a3b0640 1 -- 172.21.15.5:0/2566638516 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f08940a7b60 con 0x7f089413dae0 2024-08-18T21:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f0893fff640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f089413dae0 0x7f0894063b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f0893fff640 10 monclient: get_auth_request con 0x7f089413dae0 auth_method 0 2024-08-18T21:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f0893fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f0893fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f0893fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f08917fa640 1 -- 172.21.15.5:0/2566638516 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f087c014430 con 0x7f08940a7600 2024-08-18T21:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f0893fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f0893fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f0893fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f0893fff640 10 monclient(hunting): handle_auth_done global_id 55574 payload 824 2024-08-18T21:10:40.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f0893fff640 1 -- 172.21.15.5:0/2566638516 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08940a70c0 con 0x7f089413dae0 2024-08-18T21:10:40.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f08917fa640 1 --2- 172.21.15.5:0/2566638516 >> v2:172.21.15.157:6812/631023601 conn(0x7f087403bdf0 0x7f087403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f08917fa640 1 -- 172.21.15.5:0/2566638516 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(208..208 src has 22..208) ==== 3506+0+0 (secure 0 0 0) 0x7f087c00f040 con 0x7f08940a7600 2024-08-18T21:10:40.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f089894d640 1 --2- 172.21.15.5:0/2566638516 >> v2:172.21.15.157:6812/631023601 conn(0x7f087403bdf0 0x7f087403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f089894d640 10 monclient: get_auth_request con 0x7f087403bdf0 auth_method 0 2024-08-18T21:10:40.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f0893fff640 1 -- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f089413dae0 msgr2=0x7f0894063b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f0893fff640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f089413dae0 0x7f0894063b30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f08940a9780 tx=0x7f0884019670 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f08917fa640 1 -- 172.21.15.5:0/2566638516 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f08840bb070 con 0x7f089413dae0 2024-08-18T21:10:40.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f08917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f08917fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:10:40.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.961+0000 7f08917fa640 10 monclient: dump: 2024-08-18T21:10:40.982 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.984 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.965+0000 7f08917fa640 1 -- 172.21.15.5:0/2566638516 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0884004460 con 0x7f089413dae0 2024-08-18T21:10:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.965+0000 7f08917fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.965+0000 7f08917fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.965+0000 7f08917fa640 1 -- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f089413dae0 msgr2=0x7f0894063b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.965+0000 7f08917fa640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f089413dae0 0x7f0894063b30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f08940a9780 tx=0x7f0884019670 comp rx=0 tx=0).stop 2024-08-18T21:10:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.965+0000 7f08917fa640 1 -- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f089413dae0 msgr2=0x7f0894063b30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.965+0000 7f08917fa640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f089413dae0 0x7f0894063b30 secure :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f08940a9780 tx=0x7f0884019670 comp rx=0 tx=0).stop 2024-08-18T21:10:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.965+0000 7f089894d640 1 --2- 172.21.15.5:0/2566638516 >> v2:172.21.15.157:6812/631023601 conn(0x7f087403bdf0 0x7f087403e2b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f089413e080 tx=0x7f088c008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.969+0000 7f089a3b0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:40.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.969+0000 7f089a3b0640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0894064070 0x7f089402d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:40.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.969+0000 7f089a3b0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:40.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.969+0000 7f089a3b0640 1 -- 172.21.15.5:0/2566638516 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f0894051140 con 0x7f0894064070 2024-08-18T21:10:40.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.969+0000 7f0893fff640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0894064070 0x7f089402d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.969+0000 7f0893fff640 10 monclient: get_auth_request con 0x7f0894064070 auth_method 0 2024-08-18T21:10:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.969+0000 7f0893fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.969+0000 7f0893fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.969+0000 7f0893fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.969+0000 7f0893fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.969+0000 7f0893fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.969+0000 7f0893fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.969+0000 7f0893fff640 10 monclient(hunting): handle_auth_done global_id 55583 payload 824 2024-08-18T21:10:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.969+0000 7f0893fff640 1 -- 172.21.15.5:0/2566638516 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f089409f460 con 0x7f0894064070 2024-08-18T21:10:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f0893fff640 1 -- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0894064070 msgr2=0x7f089402d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f0893fff640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0894064070 0x7f089402d1d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f088401c700 tx=0x7f08840a7000 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f08917fa640 1 -- 172.21.15.5:0/2566638516 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f08840ce020 con 0x7f0894064070 2024-08-18T21:10:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f08917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f08917fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:10:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f08917fa640 10 monclient: dump: 2024-08-18T21:10:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:40.989 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f08917fa640 1 -- 172.21.15.5:0/2566638516 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f08840b7420 con 0x7f0894064070 2024-08-18T21:10:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f08917fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f08917fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f08917fa640 1 -- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0894064070 msgr2=0x7f089402d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f08917fa640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0894064070 0x7f089402d1d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f088401c700 tx=0x7f08840a7000 comp rx=0 tx=0).stop 2024-08-18T21:10:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f08917fa640 1 -- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0894064070 msgr2=0x7f089402d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f08917fa640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0894064070 0x7f089402d1d0 secure :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f088401c700 tx=0x7f08840a7000 comp rx=0 tx=0).stop 2024-08-18T21:10:40.990 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:40.990 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:40.990 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:40.990 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:40.990 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:40.990 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 297094, 2024-08-18T21:10:40.990 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:40.990 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:40.990 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:40.990 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:40.990 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:40.991 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:40.991 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:40.991 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:40.991 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:40.991 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:40.991 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.991 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:10:40.991 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:40.991 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:40.991 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:40.991 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:40.991 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:40.991 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:40.992 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:40.992 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:40.992 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:40.992 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:40.992 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:40.992 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:40.992 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:40.992 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:40.992 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.992 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:40.992 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:40.992 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:40.992 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:40.993 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:40.993 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:40.993 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:40.993 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:40.993 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:40.993 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:40.993 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:40.993 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:40.993 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:40.993 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.993 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:40.993 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:40.994 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:40.994 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:40.994 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:40.994 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:40.994 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:40.994 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:40.994 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:40.994 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:40.994 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:40.994 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:40.994 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:40.994 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:40.994 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:40.995 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:40.995 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:40.995 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:40.995 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:40.995 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:40.995 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:40.995 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:40.995 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:40.995 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:40.995 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:40.995 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:40.995 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:40.995 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:40.995 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:40.996 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:40.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.996 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:40.996 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.996 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:40.996 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:40.996 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.996 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.996 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.996 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.996 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:40.996 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.997 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.997 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:40.997 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.997 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.997 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.997 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:40.997 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:40.997 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.997 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.997 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.998 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:40.998 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:40.998 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:40.998 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:40.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.998 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:40.998 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:40.998 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:40.999 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:40.999 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:40.999 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:40.999 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:40.999 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:40.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.999 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:40.999 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:40.999 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:40.999 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:40.999 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:40.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:40.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.000 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:41.000 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:41.000 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.000 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.000 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:41.000 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.000 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:41.000 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.001 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.001 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:41.001 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:41.001 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.001 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.001 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.001 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:41.001 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:41.001 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.002 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:41.002 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.002 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:41.002 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.002 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.002 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:41.003 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:41.003 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.003 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.003 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.003 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:41.003 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:41.003 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.003 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.003 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.003 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:41.004 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:41.004 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.004 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.004 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:41.004 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:41.004 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.004 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.005 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.005 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:41.005 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:41.005 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.005 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.005 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:41.005 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.006 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.006 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:41.006 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.006 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.006 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.006 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:41.006 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:41.006 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.006 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.006 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.007 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:41.007 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:41.007 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.007 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.007 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.007 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:41.007 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.007 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.007 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:41.008 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.008 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.008 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.008 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:41.008 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:41.008 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.008 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.008 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.008 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:41.008 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:41.008 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.009 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.009 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:41.009 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.009 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:41.009 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.009 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.009 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.010 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:41.010 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:41.010 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.010 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.010 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.010 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:41.010 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:41.010 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.010 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.011 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.011 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:41.011 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.011 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.011 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:41.011 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.011 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.011 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.011 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:41.011 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:41.011 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.012 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.012 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.012 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.012 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.012 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:41.012 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:41.012 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.012 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:41.012 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:41.012 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:41.012 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.012 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.012 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:10:41.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.013 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:41.013 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:41.013 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:10:41.013 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.013 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.013 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:41.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.013 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:41.013 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:41.013 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:10:41.013 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.013 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.014 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:41.014 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f089a3b0640 1 -- 172.21.15.5:0/2566638516 >> v2:172.21.15.157:6812/631023601 conn(0x7f087403bdf0 msgr2=0x7f087403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f089a3b0640 1 --2- 172.21.15.5:0/2566638516 >> v2:172.21.15.157:6812/631023601 conn(0x7f087403bdf0 0x7f087403e2b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f089413e080 tx=0x7f088c008040 comp rx=0 tx=0).stop 2024-08-18T21:10:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f089a3b0640 10 monclient: shutdown 2024-08-18T21:10:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f089a3b0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:41.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f089a3b0640 1 -- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f08940a7600 msgr2=0x7f0894136670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f089a3b0640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f08940a7600 0x7f0894136670 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f087c00d800 tx=0x7f087c00dcc0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f089894d640 1 -- 172.21.15.5:0/2566638516 reap_dead start 2024-08-18T21:10:41.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f089a3b0640 1 -- 172.21.15.5:0/2566638516 shutdown_connections 2024-08-18T21:10:41.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f089a3b0640 1 --2- 172.21.15.5:0/2566638516 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f08940a7600 0x7f0894136670 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f089a3b0640 1 -- 172.21.15.5:0/2566638516 >> 172.21.15.5:0/2566638516 conn(0x7f08940acbc0 msgr2=0x7f08940a21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:41.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f089a3b0640 1 -- 172.21.15.5:0/2566638516 shutdown_connections 2024-08-18T21:10:41.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:40.973+0000 7f089a3b0640 1 -- 172.21.15.5:0/2566638516 wait complete. 2024-08-18T21:10:41.016 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:41.017 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:10:41.017 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:10:41.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 10 monclient: get_monmap_and_config 2024-08-18T21:10:41.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 10 monclient: build_initial_monmap 2024-08-18T21:10:41.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 10 monclient: monmap: 2024-08-18T21:10:41.131 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:41.131 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.132 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:41.133219+0000 2024-08-18T21:10:41.132 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:41.133219+0000 2024-08-18T21:10:41.132 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:41.132 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.132 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:41.132 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:41.132 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:41.132 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:41.132 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:41.132 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:41.132 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:41.132 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:41.133 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:41.133 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:41.133 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:41.133 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 1 Processor -- start 2024-08-18T21:10:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 1 -- start start 2024-08-18T21:10:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 10 monclient: init 2024-08-18T21:10:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 10 monclient: _add_conns ranks=[5,1,9,8,3,4,0,10,2,7,6] 2024-08-18T21:10:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc0bc0a1ff0 0x7fc0bc137430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 10 monclient(hunting): picked mon.noname-h con 0x7fc0bc0a1ff0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fc0bc137970 addr v1:172.21.15.157:6789/0 2024-08-18T21:10:41.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc0bc137dd0 0x7fc0bc1345c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 10 monclient(hunting): picked mon.noname-a con 0x7fc0bc137dd0 addr v2:172.21.15.5:3300/0 2024-08-18T21:10:41.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0bc0a23d0 con 0x7fc0bc137970 2024-08-18T21:10:41.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc0bc09dd50 con 0x7fc0bc137dd0 2024-08-18T21:10:41.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fc0bc138280 con 0x7fc0bc0a1ff0 2024-08-18T21:10:41.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:41.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0c10a2640 10 monclient(hunting): authenticate will time out at 1408.146918s 2024-08-18T21:10:41.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc0bc137dd0 0x7fc0bc1345c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc0bc137dd0 0x7fc0bc1345c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57176/0 (socket says 172.21.15.5:57176) 2024-08-18T21:10:41.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 1 -- 172.21.15.5:0/3268752959 learned_addr learned my addr 172.21.15.5:0/3268752959 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:41.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 10 monclient(hunting): get_auth_request con 0x7fc0bc137dd0 auth_method 0 2024-08-18T21:10:41.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bad9d640 1 --2- 172.21.15.5:0/3268752959 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc0bc0a1ff0 0x7fc0bc137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bad9d640 10 monclient(hunting): get_auth_request con 0x7fc0bc0a1ff0 auth_method 0 2024-08-18T21:10:41.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 10 monclient(hunting): handle_auth_done global_id 84699 payload 274 2024-08-18T21:10:41.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 1 -- 172.21.15.5:0/3268752959 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc0bc0a1ff0 msgr2=0x7fc0bc137430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:41.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 1 --2- 172.21.15.5:0/3268752959 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc0bc0a1ff0 0x7fc0bc137430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 1 -- 172.21.15.5:0/3268752959 >> v1:172.21.15.157:6789/0 conn(0x7fc0bc137970 legacy=0x7fc0bc133eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:41.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 10 monclient: _finish_hunting 0 2024-08-18T21:10:41.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 1 monclient: found mon.noname-a 2024-08-18T21:10:41.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:41.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:10:41.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.129+0000 7fc0bb59e640 1 -- 172.21.15.5:0/3268752959 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0bc09e970 con 0x7fc0bc137dd0 2024-08-18T21:10:41.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.133+0000 7fc0bb59e640 1 -- 172.21.15.5:0/3268752959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0bc137dd0 msgr2=0x7fc0bc1345c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.133+0000 7fc0bb59e640 1 --2- 172.21.15.5:0/3268752959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0bc137dd0 0x7fc0bc1345c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009e50 tx=0x7fc0b401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9cfd1b92e67a9f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.133+0000 7fc0b9d9b640 1 -- 172.21.15.5:0/3268752959 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc0b40090d0 con 0x7fc0bc137dd0 2024-08-18T21:10:41.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.133+0000 7fc0b9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.133+0000 7fc0b9d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:10:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.133+0000 7fc0b9d9b640 10 monclient: dump: 2024-08-18T21:10:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.144 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.133+0000 7fc0b9d9b640 10 monclient: _finish_auth 0 2024-08-18T21:10:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.133+0000 7fc0b9d9b640 10 monclient: _check_auth_tickets 2024-08-18T21:10:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.133+0000 7fc0b9d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.133+0000 7fc0c10a2640 5 monclient: authenticate success, global_id 84699 2024-08-18T21:10:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.133+0000 7fc0b9d9b640 1 -- 172.21.15.5:0/3268752959 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b40a5ab0 con 0x7fc0bc137dd0 2024-08-18T21:10:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.133+0000 7fc0b9d9b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.133+0000 7fc0b9d9b640 1 -- 172.21.15.5:0/3268752959 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc0b40a5c60 con 0x7fc0bc137dd0 2024-08-18T21:10:41.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.133+0000 7fc0c10a2640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:41.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.133+0000 7fc0c10a2640 4 set_mon_vals no callback set 2024-08-18T21:10:41.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.133+0000 7fc0b9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0b9d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:41.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0b9d9b640 10 monclient: dump: 2024-08-18T21:10:41.145 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.145 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.145 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.145 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.146 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.146 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.146 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.146 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.146 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.146 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.146 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.146 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.146 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.146 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.146 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.146 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 10 monclient: shutdown 2024-08-18T21:10:41.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:41.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 1 -- 172.21.15.5:0/3268752959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0bc137dd0 msgr2=0x7fc0bc1345c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 1 --2- 172.21.15.5:0/3268752959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0bc137dd0 0x7fc0bc1345c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009e50 tx=0x7fc0b401c8f0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 1 -- 172.21.15.5:0/3268752959 shutdown_connections 2024-08-18T21:10:41.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 1 --2- 172.21.15.5:0/3268752959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0bc137dd0 0x7fc0bc1345c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 1 --2- 172.21.15.5:0/3268752959 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc0bc0a1ff0 0x7fc0bc137430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 1 -- 172.21.15.5:0/3268752959 >> 172.21.15.5:0/3268752959 conn(0x7fc0bc0a8020 msgr2=0x7fc0bc0a8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:41.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 1 -- 172.21.15.5:0/3268752959 shutdown_connections 2024-08-18T21:10:41.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 1 -- 172.21.15.5:0/3268752959 wait complete. 2024-08-18T21:10:41.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 10 monclient: build_initial_monmap 2024-08-18T21:10:41.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 10 monclient: monmap: 2024-08-18T21:10:41.147 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:41.148 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:41.148 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:41.148 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:41.148 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:41.148 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.148 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:41.148 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:41.148 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:41.148 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:41.148 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:41.148 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:41.148 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:41.148 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:41.148 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:41.149 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 1 Processor -- start 2024-08-18T21:10:41.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 1 -- start start 2024-08-18T21:10:41.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 10 monclient: init 2024-08-18T21:10:41.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:41.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 10 monclient: _add_conns ranks=[8,5,2,4,0,7,3,6,1] 2024-08-18T21:10:41.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc0bc0a1ff0 0x7fc0bc071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 10 monclient(hunting): picked mon.noname-e con 0x7fc0bc0a1ff0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:41.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc0bc137970 0x7fc0bc071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 10 monclient(hunting): picked mon.noname-h con 0x7fc0bc137970 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:41.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc0bc137dd0 0x7fc0bc071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 10 monclient(hunting): picked mon.noname-b con 0x7fc0bc137dd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:41.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fc0bc142380 con 0x7fc0bc137dd0 2024-08-18T21:10:41.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fc0bc142200 con 0x7fc0bc137970 2024-08-18T21:10:41.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fc0bc142500 con 0x7fc0bc0a1ff0 2024-08-18T21:10:41.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:41.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0c10a2640 10 monclient(hunting): authenticate will time out at 1408.154094s 2024-08-18T21:10:41.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bad9d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc0bc0a1ff0 0x7fc0bc071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc0bc137dd0 0x7fc0bc071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bad9d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc0bc0a1ff0 0x7fc0bc071030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:51068/0 (socket says 172.21.15.5:51068) 2024-08-18T21:10:41.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bad9d640 1 -- 172.21.15.5:0/1586436263 learned_addr learned my addr 172.21.15.5:0/1586436263 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:41.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bad9d640 10 monclient(hunting): get_auth_request con 0x7fc0bc0a1ff0 auth_method 0 2024-08-18T21:10:41.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 10 monclient(hunting): get_auth_request con 0x7fc0bc137dd0 auth_method 0 2024-08-18T21:10:41.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0ba59c640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc0bc137970 0x7fc0bc071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0ba59c640 10 monclient(hunting): get_auth_request con 0x7fc0bc137970 auth_method 0 2024-08-18T21:10:41.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0ba59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0ba59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0ba59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 10 monclient(hunting): handle_auth_done global_id 84782 payload 824 2024-08-18T21:10:41.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 1 -- 172.21.15.5:0/1586436263 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc0bc0a1ff0 msgr2=0x7fc0bc071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc0bc0a1ff0 0x7fc0bc071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 1 -- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc0bc137970 msgr2=0x7fc0bc071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc0bc137970 0x7fc0bc071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 10 monclient: _finish_hunting 0 2024-08-18T21:10:41.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 1 monclient: found mon.noname-b 2024-08-18T21:10:41.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:41.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:10:41.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bb59e640 1 -- 172.21.15.5:0/1586436263 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0bc133dd0 con 0x7fc0bc137dd0 2024-08-18T21:10:41.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0ba59c640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc0bc137970 0x7fc0bc071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:10:41.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.137+0000 7fc0bad9d640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc0bc0a1ff0 0x7fc0bc071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:41.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0bb59e640 1 -- 172.21.15.5:0/1586436263 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc0bc137dd0 msgr2=0x7fc0bc071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0bb59e640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc0bc137dd0 0x7fc0bc071ab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40ae000 tx=0x7fc0b4019690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0a37fe640 1 -- 172.21.15.5:0/1586436263 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc0b40bc030 con 0x7fc0bc137dd0 2024-08-18T21:10:41.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0a37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0a37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:10:41.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0a37fe640 10 monclient: dump: 2024-08-18T21:10:41.158 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.158 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.158 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.158 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.158 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.158 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.158 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.158 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.158 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.158 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.158 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.158 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.159 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.159 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.159 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.159 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0a37fe640 10 monclient: _finish_auth 0 2024-08-18T21:10:41.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0a37fe640 10 monclient: _check_auth_tickets 2024-08-18T21:10:41.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:41.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0a37fe640 1 -- 172.21.15.5:0/1586436263 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b4003dc0 con 0x7fc0bc137dd0 2024-08-18T21:10:41.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0c10a2640 5 monclient: authenticate success, global_id 84782 2024-08-18T21:10:41.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0c10a2640 10 monclient: _renew_subs 2024-08-18T21:10:41.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0c10a2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:10:41.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0c10a2640 1 -- 172.21.15.5:0/1586436263 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0bc0a3c50 con 0x7fc0bc137dd0 2024-08-18T21:10:41.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0a37fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:41.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0a37fe640 1 -- 172.21.15.5:0/1586436263 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc0b40b7450 con 0x7fc0bc137dd0 2024-08-18T21:10:41.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0a37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0a37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:41.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0a37fe640 10 monclient: dump: 2024-08-18T21:10:41.160 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.160 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.160 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.160 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.160 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.160 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.160 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.160 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.160 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.161 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.161 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.161 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.161 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.161 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.161 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.161 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0b959a640 4 set_mon_vals no callback set 2024-08-18T21:10:41.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0c10a2640 10 monclient: _renew_subs 2024-08-18T21:10:41.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0c10a2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:10:41.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0c10a2640 1 -- 172.21.15.5:0/1586436263 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0bc138d70 con 0x7fc0bc137dd0 2024-08-18T21:10:41.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0c10a2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:41.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0c10a2640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0bc1cfd40 0x7fc0bc1d0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0c10a2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0c10a2640 1 -- 172.21.15.5:0/1586436263 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc051140 con 0x7fc0bc1cfd40 2024-08-18T21:10:41.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0a37fe640 1 -- 172.21.15.5:0/1586436263 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fc0b40bf070 con 0x7fc0bc137dd0 2024-08-18T21:10:41.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0bad9d640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0bc1cfd40 0x7fc0bc1d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0bad9d640 10 monclient: get_auth_request con 0x7fc0bc1cfd40 auth_method 0 2024-08-18T21:10:41.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0bad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0bad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0bad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0a37fe640 1 --2- 172.21.15.5:0/1586436263 >> v2:172.21.15.157:6812/631023601 conn(0x7fc0a803bdc0 0x7fc0a803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0a37fe640 1 -- 172.21.15.5:0/1586436263 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(208..208 src has 22..208) ==== 3506+0+0 (secure 0 0 0) 0x7fc0b40bd070 con 0x7fc0bc137dd0 2024-08-18T21:10:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0bad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0bad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0bad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0ba59c640 1 --2- 172.21.15.5:0/1586436263 >> v2:172.21.15.157:6812/631023601 conn(0x7fc0a803bdc0 0x7fc0a803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0ba59c640 10 monclient: get_auth_request con 0x7fc0a803bdc0 auth_method 0 2024-08-18T21:10:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0bad9d640 10 monclient(hunting): handle_auth_done global_id 104131 payload 824 2024-08-18T21:10:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.141+0000 7fc0bad9d640 1 -- 172.21.15.5:0/1586436263 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0bc137430 con 0x7fc0bc1cfd40 2024-08-18T21:10:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.145+0000 7fc0bad9d640 1 -- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0bc1cfd40 msgr2=0x7fc0bc1d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.145+0000 7fc0bad9d640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0bc1cfd40 0x7fc0bc1d0120 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac010cb0 tx=0x7fc0ac00e5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.145+0000 7fc0ba59c640 1 --2- 172.21.15.5:0/1586436263 >> v2:172.21.15.157:6812/631023601 conn(0x7fc0a803bdc0 0x7fc0a803e280 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc073020 tx=0x7fc0b0009040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.145+0000 7fc0a37fe640 1 -- 172.21.15.5:0/1586436263 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc0ac0044a0 con 0x7fc0bc1cfd40 2024-08-18T21:10:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.145+0000 7fc0a37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.145+0000 7fc0a37fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:10:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.145+0000 7fc0a37fe640 10 monclient: dump: 2024-08-18T21:10:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.165 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.165 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.165 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.165 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.145+0000 7fc0a37fe640 1 -- 172.21.15.5:0/1586436263 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc0ac004030 con 0x7fc0bc1cfd40 2024-08-18T21:10:41.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.145+0000 7fc0a37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:41.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.145+0000 7fc0a37fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:41.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.145+0000 7fc0a37fe640 1 -- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0bc1cfd40 msgr2=0x7fc0bc1d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.145+0000 7fc0a37fe640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0bc1cfd40 0x7fc0bc1d0120 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac010cb0 tx=0x7fc0ac00e5a0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.145+0000 7fc0a37fe640 1 -- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0bc1cfd40 msgr2=0x7fc0bc1d0120 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:41.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.145+0000 7fc0a37fe640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0bc1cfd40 0x7fc0bc1d0120 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac010cb0 tx=0x7fc0ac00e5a0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.153+0000 7fc0c10a2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:41.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.153+0000 7fc0c10a2640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0bc02d1d0 0x7fc0bc02d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.153+0000 7fc0c10a2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.153+0000 7fc0c10a2640 1 -- 172.21.15.5:0/1586436263 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc073340 con 0x7fc0bc02d1d0 2024-08-18T21:10:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.153+0000 7fc0bad9d640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0bc02d1d0 0x7fc0bc02d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.153+0000 7fc0bad9d640 10 monclient: get_auth_request con 0x7fc0bc02d1d0 auth_method 0 2024-08-18T21:10:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.153+0000 7fc0bad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.153+0000 7fc0bad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.153+0000 7fc0bad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.153+0000 7fc0bad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.153+0000 7fc0bad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.153+0000 7fc0bad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.153+0000 7fc0bad9d640 10 monclient(hunting): handle_auth_done global_id 104140 payload 824 2024-08-18T21:10:41.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.153+0000 7fc0bad9d640 1 -- 172.21.15.5:0/1586436263 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc0bc130090 con 0x7fc0bc02d1d0 2024-08-18T21:10:41.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0bad9d640 1 -- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0bc02d1d0 msgr2=0x7fc0bc02d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0bad9d640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0bc02d1d0 0x7fc0bc02d5e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac010cb0 tx=0x7fc0ac0046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0a37fe640 1 -- 172.21.15.5:0/1586436263 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc0ac003a90 con 0x7fc0bc02d1d0 2024-08-18T21:10:41.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0a37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0a37fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:10:41.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0a37fe640 10 monclient: dump: 2024-08-18T21:10:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.173 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0a37fe640 1 -- 172.21.15.5:0/1586436263 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9246 (secure 0 0 0) 0x7fc0ac003620 con 0x7fc0bc02d1d0 2024-08-18T21:10:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0a37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0a37fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0a37fe640 1 -- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0bc02d1d0 msgr2=0x7fc0bc02d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0a37fe640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0bc02d1d0 0x7fc0bc02d5e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac010cb0 tx=0x7fc0ac0046d0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0a37fe640 1 -- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0bc02d1d0 msgr2=0x7fc0bc02d5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0a37fe640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0bc02d1d0 0x7fc0bc02d5e0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac010cb0 tx=0x7fc0ac0046d0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.174 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:41.174 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:41.174 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:41.174 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:41.174 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:41.174 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 5647, 2024-08-18T21:10:41.174 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:41.174 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:41.174 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:41.174 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:41.174 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:41.175 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:41.175 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:41.175 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:41.175 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:41.175 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:41.175 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.175 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:10:41.175 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:41.175 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:41.175 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:41.175 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:41.175 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:41.176 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:41.176 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:41.176 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:41.176 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:41.176 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:41.176 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:41.176 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:41.176 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:41.176 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:41.176 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.176 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:41.176 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:41.176 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:41.177 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:41.177 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:41.177 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:41.177 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:41.177 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:41.177 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:41.177 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:41.177 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:41.177 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:41.177 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:41.177 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.177 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:41.178 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:41.178 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:41.178 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:41.178 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:41.178 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:41.178 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:41.178 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:41.178 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:41.178 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:41.178 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:41.178 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:41.179 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:41.179 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:41.179 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:41.179 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:41.179 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:41.179 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:41.179 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:41.179 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:41.179 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:41.180 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:41.180 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:41.180 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:41.180 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:41.180 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:41.180 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:41.180 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:41.180 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.180 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:41.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.180 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:41.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.180 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:41.181 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:41.181 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.181 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.181 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.181 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:41.181 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.181 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.181 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:41.181 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.181 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.182 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:41.182 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:41.182 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.182 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.182 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.182 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:41.182 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:41.182 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.183 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.183 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.183 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:41.183 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.183 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.183 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:41.183 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.183 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.183 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.184 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:41.184 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:41.184 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.184 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.184 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.184 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:41.184 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:41.184 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.184 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:41.185 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.185 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:41.185 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.185 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.185 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:41.185 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:41.185 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.185 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.186 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.186 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:41.186 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:41.186 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.186 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.186 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:41.186 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.187 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.187 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:41.187 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.187 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.187 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.187 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:41.187 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:41.187 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.187 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.187 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.188 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:41.188 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:41.188 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.188 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.188 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:41.188 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.188 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:41.189 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.189 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.189 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.189 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:41.189 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:41.189 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.189 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.189 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.190 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:41.190 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:41.190 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:41.190 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:41.190 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.191 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.191 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:41.191 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:41.191 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.191 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.191 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.191 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:41.191 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:41.191 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:41.192 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:41.192 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.192 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.193 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:41.193 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:41.193 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.193 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.193 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.193 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:41.193 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:41.194 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:41.194 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:41.194 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.194 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.195 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:41.195 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:41.195 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.195 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.195 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.195 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:41.195 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:41.195 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.196 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.196 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.196 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:41.196 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.196 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.196 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:41.196 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.196 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.196 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.197 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:41.197 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:41.197 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.197 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.197 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.197 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.197 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.197 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:41.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:41.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.197 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:41.197 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:41.198 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:41.198 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.198 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.198 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:41.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.198 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:41.198 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:41.198 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:41.198 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.198 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.198 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:41.198 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:41.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0c10a2640 1 -- 172.21.15.5:0/1586436263 >> v2:172.21.15.157:6812/631023601 conn(0x7fc0a803bdc0 msgr2=0x7fc0a803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0c10a2640 1 --2- 172.21.15.5:0/1586436263 >> v2:172.21.15.157:6812/631023601 conn(0x7fc0a803bdc0 0x7fc0a803e280 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc073020 tx=0x7fc0b0009040 comp rx=0 tx=0).stop 2024-08-18T21:10:41.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0c10a2640 10 monclient: shutdown 2024-08-18T21:10:41.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0c10a2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:41.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0c10a2640 1 -- 172.21.15.5:0/1586436263 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc0bc137dd0 msgr2=0x7fc0bc071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0c10a2640 1 --2- 172.21.15.5:0/1586436263 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc0bc137dd0 0x7fc0bc071ab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40ae000 tx=0x7fc0b4019690 comp rx=0 tx=0).stop 2024-08-18T21:10:41.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0bb59e640 1 -- 172.21.15.5:0/1586436263 reap_dead start 2024-08-18T21:10:41.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0bb59e640 1 -- 172.21.15.5:0/1586436263 reap_dead start 2024-08-18T21:10:41.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0c10a2640 1 -- 172.21.15.5:0/1586436263 shutdown_connections 2024-08-18T21:10:41.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0c10a2640 1 -- 172.21.15.5:0/1586436263 >> 172.21.15.5:0/1586436263 conn(0x7fc0bc0a8020 msgr2=0x7fc0bc136000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:41.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0c10a2640 1 -- 172.21.15.5:0/1586436263 shutdown_connections 2024-08-18T21:10:41.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.157+0000 7fc0c10a2640 1 -- 172.21.15.5:0/1586436263 wait complete. 2024-08-18T21:10:41.201 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:41.201 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:10:41.201 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:10:41.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.325+0000 7f5da47fd640 10 monclient: get_monmap_and_config 2024-08-18T21:10:41.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.325+0000 7f5da47fd640 10 monclient: build_initial_monmap 2024-08-18T21:10:41.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.325+0000 7f5da47fd640 10 monclient: monmap: 2024-08-18T21:10:41.330 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:41.330 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.331 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:41.332304+0000 2024-08-18T21:10:41.331 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:41.332304+0000 2024-08-18T21:10:41.331 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:41.331 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.331 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:41.331 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:41.331 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:41.331 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:41.331 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:41.331 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:41.332 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:41.332 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:41.332 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:41.332 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:41.332 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:41.332 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 1 Processor -- start 2024-08-18T21:10:41.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 1 -- start start 2024-08-18T21:10:41.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 10 monclient: init 2024-08-18T21:10:41.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:41.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 10 monclient: _add_conns ranks=[10,6,1,3,5,4,9,8,0,2,7] 2024-08-18T21:10:41.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5d9c06c950 0x7f5d9c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 10 monclient(hunting): picked mon.noname-f con 0x7f5d9c06c950 addr v2:172.21.15.157:3300/0 2024-08-18T21:10:41.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5d9c09e8e0 0x7f5d9c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 10 monclient(hunting): picked mon.noname-d con 0x7f5d9c09e8e0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:41.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f5d9c13dc80 addr v1:172.21.15.157:6789/0 2024-08-18T21:10:41.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d9c09dc20 con 0x7f5d9c13dc80 2024-08-18T21:10:41.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5d9c09e550 con 0x7f5d9c06c950 2024-08-18T21:10:41.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f5d9c068d10 con 0x7f5d9c09e8e0 2024-08-18T21:10:41.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:41.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da47fd640 10 monclient(hunting): authenticate will time out at 1408.345403s 2024-08-18T21:10:41.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5d9c09e8e0 0x7f5d9c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5d9c09e8e0 0x7f5d9c06d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54816/0 (socket says 172.21.15.5:54816) 2024-08-18T21:10:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 1 -- 172.21.15.5:0/198489188 learned_addr learned my addr 172.21.15.5:0/198489188 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 10 monclient(hunting): get_auth_request con 0x7f5d9c09e8e0 auth_method 0 2024-08-18T21:10:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da2599640 1 --2- 172.21.15.5:0/198489188 >> v2:172.21.15.157:3300/0 conn(0x7f5d9c06c950 0x7f5d9c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da2599640 10 monclient(hunting): get_auth_request con 0x7f5d9c06c950 auth_method 0 2024-08-18T21:10:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da2599640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da2599640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da2599640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da2599640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da2599640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da2599640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 10 monclient(hunting): handle_auth_done global_id 84993 payload 274 2024-08-18T21:10:41.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 1 -- 172.21.15.5:0/198489188 >> v2:172.21.15.157:3300/0 conn(0x7f5d9c06c950 msgr2=0x7f5d9c06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:41.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 1 --2- 172.21.15.5:0/198489188 >> v2:172.21.15.157:3300/0 conn(0x7f5d9c06c950 0x7f5d9c06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 1 -- 172.21.15.5:0/198489188 >> v1:172.21.15.157:6789/0 conn(0x7f5d9c13dc80 legacy=0x7f5d9c140070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:41.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 10 monclient: _finish_hunting 0 2024-08-18T21:10:41.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 1 monclient: found mon.noname-d 2024-08-18T21:10:41.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:41.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:10:41.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.329+0000 7f5da1d98640 1 -- 172.21.15.5:0/198489188 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9c0a9ee0 con 0x7f5d9c09e8e0 2024-08-18T21:10:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da1d98640 1 -- 172.21.15.5:0/198489188 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5d9c09e8e0 msgr2=0x7f5d9c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da1d98640 1 --2- 172.21.15.5:0/198489188 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5d9c09e8e0 0x7f5d9c06d270 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0098a0 tx=0x7f5d8c01c400 comp rx=0 tx=0).ready entity=mon.6 client_cookie=595ac2c345e7b944 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da1597640 1 -- 172.21.15.5:0/198489188 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5d8c0b0070 con 0x7f5d9c09e8e0 2024-08-18T21:10:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da1597640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da1597640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:10:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da1597640 10 monclient: dump: 2024-08-18T21:10:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.343 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.343 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.343 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.343 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da1597640 10 monclient: _finish_auth 0 2024-08-18T21:10:41.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da1597640 10 monclient: _check_auth_tickets 2024-08-18T21:10:41.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da1597640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:41.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da47fd640 5 monclient: authenticate success, global_id 84993 2024-08-18T21:10:41.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da1597640 1 -- 172.21.15.5:0/198489188 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8c0aa810 con 0x7f5d9c09e8e0 2024-08-18T21:10:41.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da47fd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:10:41.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da1597640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:41.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da47fd640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:41.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da47fd640 4 set_mon_vals no callback set 2024-08-18T21:10:41.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da1597640 1 -- 172.21.15.5:0/198489188 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5d8c0a9300 con 0x7f5d9c09e8e0 2024-08-18T21:10:41.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da1597640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da1597640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:41.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da1597640 10 monclient: dump: 2024-08-18T21:10:41.344 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.344 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.346 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da47fd640 10 monclient: shutdown 2024-08-18T21:10:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da47fd640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da47fd640 1 -- 172.21.15.5:0/198489188 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5d9c09e8e0 msgr2=0x7f5d9c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da47fd640 1 --2- 172.21.15.5:0/198489188 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5d9c09e8e0 0x7f5d9c06d270 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0098a0 tx=0x7f5d8c01c400 comp rx=0 tx=0).stop 2024-08-18T21:10:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da47fd640 1 -- 172.21.15.5:0/198489188 shutdown_connections 2024-08-18T21:10:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da47fd640 1 --2- 172.21.15.5:0/198489188 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5d9c09e8e0 0x7f5d9c06d270 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da47fd640 1 --2- 172.21.15.5:0/198489188 >> v2:172.21.15.157:3300/0 conn(0x7f5d9c06c950 0x7f5d9c06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da47fd640 1 -- 172.21.15.5:0/198489188 >> 172.21.15.5:0/198489188 conn(0x7f5d9c0a90a0 msgr2=0x7f5d9c0a9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da47fd640 1 -- 172.21.15.5:0/198489188 shutdown_connections 2024-08-18T21:10:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.333+0000 7f5da47fd640 1 -- 172.21.15.5:0/198489188 wait complete. 2024-08-18T21:10:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 10 monclient: build_initial_monmap 2024-08-18T21:10:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 10 monclient: monmap: 2024-08-18T21:10:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:41.348 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 1 Processor -- start 2024-08-18T21:10:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 1 -- start start 2024-08-18T21:10:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 10 monclient: init 2024-08-18T21:10:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 10 monclient: _add_conns ranks=[5,4,3,8,0,6,7,2,1] 2024-08-18T21:10:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d9c06c950 0x7f5d9c125ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 10 monclient(hunting): picked mon.noname-h con 0x7f5d9c06c950 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5d9c09e8e0 0x7f5d9c13cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 10 monclient(hunting): picked mon.noname-c con 0x7f5d9c09e8e0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c13dc80 0x7f5d9c1d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 10 monclient(hunting): picked mon.noname-g con 0x7f5d9c13dc80 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9c09df00 con 0x7f5d9c13dc80 2024-08-18T21:10:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f5d9c068ee0 con 0x7f5d9c09e8e0 2024-08-18T21:10:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f5d9c1441c0 con 0x7f5d9c06c950 2024-08-18T21:10:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da47fd640 10 monclient(hunting): authenticate will time out at 1408.353170s 2024-08-18T21:10:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5d9c09e8e0 0x7f5d9c13cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5d9c09e8e0 0x7f5d9c13cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:58900/0 (socket says 172.21.15.5:58900) 2024-08-18T21:10:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 1 -- 172.21.15.5:0/2732664391 learned_addr learned my addr 172.21.15.5:0/2732664391 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 10 monclient(hunting): get_auth_request con 0x7f5d9c09e8e0 auth_method 0 2024-08-18T21:10:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da2599640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d9c06c950 0x7f5d9c125ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da2599640 10 monclient(hunting): get_auth_request con 0x7f5d9c06c950 auth_method 0 2024-08-18T21:10:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da2599640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da2599640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da2599640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da2d9a640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c13dc80 0x7f5d9c1d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da2d9a640 10 monclient(hunting): get_auth_request con 0x7f5d9c13dc80 auth_method 0 2024-08-18T21:10:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da2d9a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da2d9a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da2d9a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 10 monclient(hunting): handle_auth_done global_id 6538 payload 824 2024-08-18T21:10:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 1 -- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d9c06c950 msgr2=0x7f5d9c125ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d9c06c950 0x7f5d9c125ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 1 -- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c13dc80 msgr2=0x7f5d9c1d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c13dc80 0x7f5d9c1d11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 10 monclient: _finish_hunting 0 2024-08-18T21:10:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 1 monclient: found mon.noname-c 2024-08-18T21:10:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:10:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da1d98640 1 -- 172.21.15.5:0/2732664391 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9c125360 con 0x7f5d9c09e8e0 2024-08-18T21:10:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.337+0000 7f5da2599640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d9c06c950 0x7f5d9c125ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:10:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da1d98640 1 -- 172.21.15.5:0/2732664391 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5d9c09e8e0 msgr2=0x7f5d9c13cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da1d98640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5d9c09e8e0 0x7f5d9c13cd30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0097c0 tx=0x7f5d8c0191a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5d92ffd640 1 -- 172.21.15.5:0/2732664391 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5d8c0b9070 con 0x7f5d9c09e8e0 2024-08-18T21:10:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5d92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5d92ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:10:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5d92ffd640 10 monclient: dump: 2024-08-18T21:10:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.357 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5d92ffd640 10 monclient: _finish_auth 0 2024-08-18T21:10:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5d92ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:10:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5d92ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da47fd640 5 monclient: authenticate success, global_id 6538 2024-08-18T21:10:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5d92ffd640 1 -- 172.21.15.5:0/2732664391 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8c004250 con 0x7f5d9c09e8e0 2024-08-18T21:10:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5d92ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da47fd640 10 monclient: _renew_subs 2024-08-18T21:10:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5d92ffd640 1 -- 172.21.15.5:0/2732664391 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5d8c0b0040 con 0x7f5d9c09e8e0 2024-08-18T21:10:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da47fd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:10:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da47fd640 1 -- 172.21.15.5:0/2732664391 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d9c13d9d0 con 0x7f5d9c09e8e0 2024-08-18T21:10:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5d92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da0d96640 4 set_mon_vals no callback set 2024-08-18T21:10:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5d92ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5d92ffd640 10 monclient: dump: 2024-08-18T21:10:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.360 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da47fd640 10 monclient: _renew_subs 2024-08-18T21:10:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da47fd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:10:41.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da47fd640 1 -- 172.21.15.5:0/2732664391 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d9c126e20 con 0x7f5d9c09e8e0 2024-08-18T21:10:41.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da47fd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:41.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da47fd640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c13d270 0x7f5d9c1d16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da47fd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da47fd640 1 -- 172.21.15.5:0/2732664391 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9c051140 con 0x7f5d9c13d270 2024-08-18T21:10:41.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5d92ffd640 1 -- 172.21.15.5:0/2732664391 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f5d8c003620 con 0x7f5d9c09e8e0 2024-08-18T21:10:41.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da2599640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c13d270 0x7f5d9c1d16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da2599640 10 monclient: get_auth_request con 0x7f5d9c13d270 auth_method 0 2024-08-18T21:10:41.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da2599640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da2599640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da2599640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5d92ffd640 1 --2- 172.21.15.5:0/2732664391 >> v2:172.21.15.157:6812/631023601 conn(0x7f5d8003bdf0 0x7f5d8003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da2599640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da2599640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da2599640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5d92ffd640 1 -- 172.21.15.5:0/2732664391 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(209..209 src has 22..209) ==== 3898+0+0 (secure 0 0 0) 0x7f5d8c0e79a0 con 0x7f5d9c09e8e0 2024-08-18T21:10:41.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da2d9a640 1 --2- 172.21.15.5:0/2732664391 >> v2:172.21.15.157:6812/631023601 conn(0x7f5d8003bdf0 0x7f5d8003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da2599640 10 monclient(hunting): handle_auth_done global_id 84783 payload 824 2024-08-18T21:10:41.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da2599640 1 -- 172.21.15.5:0/2732664391 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d9c1411b0 con 0x7f5d9c13d270 2024-08-18T21:10:41.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.341+0000 7f5da2d9a640 10 monclient: get_auth_request con 0x7f5d8003bdf0 auth_method 0 2024-08-18T21:10:41.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.345+0000 7f5da2599640 1 -- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c13d270 msgr2=0x7f5d9c1d16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.345+0000 7f5da2599640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c13d270 0x7f5d9c1d16f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5d98011830 tx=0x7f5d98011cf0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.345+0000 7f5d92ffd640 1 -- 172.21.15.5:0/2732664391 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5d9800fc50 con 0x7f5d9c13d270 2024-08-18T21:10:41.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.345+0000 7f5d92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.345+0000 7f5d92ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:10:41.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.345+0000 7f5da2d9a640 1 --2- 172.21.15.5:0/2732664391 >> v2:172.21.15.157:6812/631023601 conn(0x7f5d8003bdf0 0x7f5d8003e2b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c070100 tx=0x7f5d94009410 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.345+0000 7f5d92ffd640 10 monclient: dump: 2024-08-18T21:10:41.363 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.363 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.363 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.363 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.363 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.363 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.363 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.363 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.363 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.363 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.363 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.364 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.364 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.364 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.364 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.364 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.345+0000 7f5d92ffd640 1 -- 172.21.15.5:0/2732664391 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5d9800fc50 con 0x7f5d9c13d270 2024-08-18T21:10:41.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.345+0000 7f5d92ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:41.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.345+0000 7f5d92ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:41.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.345+0000 7f5d92ffd640 1 -- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c13d270 msgr2=0x7f5d9c1d16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.345+0000 7f5d92ffd640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c13d270 0x7f5d9c1d16f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5d98011830 tx=0x7f5d98011cf0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.345+0000 7f5d92ffd640 1 -- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c13d270 msgr2=0x7f5d9c1d16f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:41.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.345+0000 7f5d92ffd640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c13d270 0x7f5d9c1d16f0 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5d98011830 tx=0x7f5d98011cf0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.349+0000 7f5da47fd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.349+0000 7f5da47fd640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c124010 0x7f5d9c1d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.349+0000 7f5da47fd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.349+0000 7f5da47fd640 1 -- 172.21.15.5:0/2732664391 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9c069fa0 con 0x7f5d9c124010 2024-08-18T21:10:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.353+0000 7f5da2599640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c124010 0x7f5d9c1d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.353+0000 7f5da2599640 10 monclient: get_auth_request con 0x7f5d9c124010 auth_method 0 2024-08-18T21:10:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.353+0000 7f5da2599640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.353+0000 7f5da2599640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.353+0000 7f5da2599640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.353+0000 7f5da2599640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.353+0000 7f5da2599640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.353+0000 7f5da2599640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.353+0000 7f5da2599640 10 monclient(hunting): handle_auth_done global_id 84792 payload 824 2024-08-18T21:10:41.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.353+0000 7f5da2599640 1 -- 172.21.15.5:0/2732664391 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5d9c06cd30 con 0x7f5d9c124010 2024-08-18T21:10:41.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.353+0000 7f5da2599640 1 -- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c124010 msgr2=0x7f5d9c1d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.353+0000 7f5da2599640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c124010 0x7f5d9c1d1c30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5d98011830 tx=0x7f5d980046d0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.353+0000 7f5d92ffd640 1 -- 172.21.15.5:0/2732664391 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5d980158d0 con 0x7f5d9c124010 2024-08-18T21:10:41.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.353+0000 7f5d92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.353+0000 7f5d92ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:10:41.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.353+0000 7f5d92ffd640 10 monclient: dump: 2024-08-18T21:10:41.367 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.367 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.367 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.367 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.367 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.367 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.367 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.367 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.368 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5d92ffd640 1 -- 172.21.15.5:0/2732664391 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7f5d9802b470 con 0x7f5d9c124010 2024-08-18T21:10:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5d92ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5d92ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5d92ffd640 1 -- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c124010 msgr2=0x7f5d9c1d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5d92ffd640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c124010 0x7f5d9c1d1c30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5d98011830 tx=0x7f5d980046d0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5d92ffd640 1 -- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c124010 msgr2=0x7f5d9c1d1c30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5d92ffd640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d9c124010 0x7f5d9c1d1c30 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5d98011830 tx=0x7f5d980046d0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.369 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:41.369 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:41.369 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:41.369 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:41.369 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:41.369 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 138177, 2024-08-18T21:10:41.369 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:41.369 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:41.370 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:41.370 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:41.370 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:41.370 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:41.370 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:41.370 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:41.370 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:41.370 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:41.370 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.370 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:10:41.370 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:41.370 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:41.370 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:41.371 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:41.371 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:41.371 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:41.371 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:41.374 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:41.374 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:41.374 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:41.374 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:41.374 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:41.374 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:41.374 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:41.375 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.375 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:41.375 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:41.375 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:41.375 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:41.375 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:41.375 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:41.375 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:41.375 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:41.375 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:41.375 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:41.375 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:41.376 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:41.376 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:41.376 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.376 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:41.376 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:41.376 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:41.376 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:41.376 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:41.376 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:41.376 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:41.376 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:41.376 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:41.377 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:41.377 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:41.377 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:41.377 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:41.377 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:41.377 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:41.377 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:41.377 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:41.377 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:41.377 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:41.377 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:41.377 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:41.377 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:41.378 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:41.378 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:41.378 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:41.378 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:41.378 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:41.378 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:41.378 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.378 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:41.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.378 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:41.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.378 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:41.378 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:41.379 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.379 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.379 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.379 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:41.379 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.379 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.379 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:41.379 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.379 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.379 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.380 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:41.380 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:41.380 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.380 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.380 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.380 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.380 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:41.380 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:41.380 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.380 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.380 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.381 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:41.381 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.381 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:41.381 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.381 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.381 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.381 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:41.382 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:41.382 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.382 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.382 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.382 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:41.382 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:41.382 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.382 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.382 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.382 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:41.383 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.383 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.383 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:41.383 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.383 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.383 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.383 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:41.383 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:41.383 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.384 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.384 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.384 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:41.384 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:41.384 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.384 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:41.384 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.385 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.385 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.385 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:41.385 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.385 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.385 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.385 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:41.385 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:41.385 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.385 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.385 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.386 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:41.386 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:41.386 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.386 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.386 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.386 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:41.386 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.387 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:41.387 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.387 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.387 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:41.387 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:41.387 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.387 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.387 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.387 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.387 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:41.388 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:41.388 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:41.388 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:41.388 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.388 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.389 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:41.389 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:41.389 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.389 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.389 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.389 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:41.389 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:41.389 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.390 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:41.391 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:41.393 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:41.394 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:10:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.395 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.396 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:41.396 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:41.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5da47fd640 1 -- 172.21.15.5:0/2732664391 >> v2:172.21.15.157:6812/631023601 conn(0x7f5d8003bdf0 msgr2=0x7f5d8003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5da47fd640 1 --2- 172.21.15.5:0/2732664391 >> v2:172.21.15.157:6812/631023601 conn(0x7f5d8003bdf0 0x7f5d8003e2b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c070100 tx=0x7f5d94009410 comp rx=0 tx=0).stop 2024-08-18T21:10:41.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5da47fd640 10 monclient: shutdown 2024-08-18T21:10:41.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5da47fd640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:41.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5da47fd640 1 -- 172.21.15.5:0/2732664391 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5d9c09e8e0 msgr2=0x7f5d9c13cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5da47fd640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5d9c09e8e0 0x7f5d9c13cd30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0097c0 tx=0x7f5d8c0191a0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5da2d9a640 1 -- 172.21.15.5:0/2732664391 reap_dead start 2024-08-18T21:10:41.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5da47fd640 1 -- 172.21.15.5:0/2732664391 shutdown_connections 2024-08-18T21:10:41.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5da47fd640 1 --2- 172.21.15.5:0/2732664391 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5d9c09e8e0 0x7f5d9c13cd30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5da47fd640 1 -- 172.21.15.5:0/2732664391 >> 172.21.15.5:0/2732664391 conn(0x7f5d9c0a90a0 msgr2=0x7f5d9c0a17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:41.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5da47fd640 1 -- 172.21.15.5:0/2732664391 shutdown_connections 2024-08-18T21:10:41.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.357+0000 7f5da47fd640 1 -- 172.21.15.5:0/2732664391 wait complete. 2024-08-18T21:10:41.398 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:41.398 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:10:41.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:10:41.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 10 monclient: get_monmap_and_config 2024-08-18T21:10:41.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 10 monclient: build_initial_monmap 2024-08-18T21:10:41.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 10 monclient: monmap: 2024-08-18T21:10:41.515 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:41.515 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.515 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:41.517145+0000 2024-08-18T21:10:41.515 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:41.517145+0000 2024-08-18T21:10:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:41.517 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:41.517 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:41.517 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 1 Processor -- start 2024-08-18T21:10:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 1 -- start start 2024-08-18T21:10:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 10 monclient: init 2024-08-18T21:10:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 10 monclient: _add_conns ranks=[5,6,3,7,8,1,0,4,9,2,10] 2024-08-18T21:10:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c0a6bd0 0x7fc92c0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 10 monclient(hunting): picked mon.noname-h con 0x7fc92c0a6bd0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc92c09f080 0x7fc92c0a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 10 monclient(hunting): picked mon.noname-d con 0x7fc92c09f080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc92c139990 0x7fc92c139df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 10 monclient(hunting): picked mon.noname-g con 0x7fc92c139990 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc92c09e4c0 con 0x7fc92c139990 2024-08-18T21:10:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fc92c06f930 con 0x7fc92c0a6bd0 2024-08-18T21:10:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fc92c0a7a30 con 0x7fc92c09f080 2024-08-18T21:10:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc9325d1640 10 monclient(hunting): authenticate will time out at 1408.531076s 2024-08-18T21:10:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc92c09f080 0x7fc92c0a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc92c09f080 0x7fc92c0a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54818/0 (socket says 172.21.15.5:54818) 2024-08-18T21:10:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 1 -- 172.21.15.5:0/3282796035 learned_addr learned my addr 172.21.15.5:0/3282796035 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 10 monclient(hunting): get_auth_request con 0x7fc92c09f080 auth_method 0 2024-08-18T21:10:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92bfff640 1 --2- 172.21.15.5:0/3282796035 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c0a6bd0 0x7fc92c0a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92bfff640 10 monclient(hunting): get_auth_request con 0x7fc92c0a6bd0 auth_method 0 2024-08-18T21:10:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc930b6e640 1 --2- 172.21.15.5:0/3282796035 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc92c139990 0x7fc92c139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc930b6e640 10 monclient(hunting): get_auth_request con 0x7fc92c139990 auth_method 0 2024-08-18T21:10:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc930b6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc930b6e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc930b6e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 10 monclient(hunting): handle_auth_done global_id 85002 payload 274 2024-08-18T21:10:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 1 -- 172.21.15.5:0/3282796035 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c0a6bd0 msgr2=0x7fc92c0a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 1 --2- 172.21.15.5:0/3282796035 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c0a6bd0 0x7fc92c0a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 1 -- 172.21.15.5:0/3282796035 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc92c139990 msgr2=0x7fc92c139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 1 --2- 172.21.15.5:0/3282796035 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc92c139990 0x7fc92c139df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:10:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 1 monclient: found mon.noname-d 2024-08-18T21:10:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:10:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.513+0000 7fc92b7fe640 1 -- 172.21.15.5:0/3282796035 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c0a7fb0 con 0x7fc92c09f080 2024-08-18T21:10:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.517+0000 7fc92b7fe640 1 -- 172.21.15.5:0/3282796035 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc92c09f080 msgr2=0x7fc92c0a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.517+0000 7fc92b7fe640 1 --2- 172.21.15.5:0/3282796035 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc92c09f080 0x7fc92c0a74f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc9200098a0 tx=0x7fc92001c440 comp rx=0 tx=0).ready entity=mon.6 client_cookie=22cfc4596188f3bb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92affd640 1 -- 172.21.15.5:0/3282796035 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9200b0070 con 0x7fc92c09f080 2024-08-18T21:10:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92affd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:10:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92affd640 10 monclient: dump: 2024-08-18T21:10:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.530 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92affd640 10 monclient: _finish_auth 0 2024-08-18T21:10:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92affd640 10 monclient: _check_auth_tickets 2024-08-18T21:10:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92affd640 1 -- 172.21.15.5:0/3282796035 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9200aa810 con 0x7fc92c09f080 2024-08-18T21:10:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92affd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92affd640 1 -- 172.21.15.5:0/3282796035 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9200aae30 con 0x7fc92c09f080 2024-08-18T21:10:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 5 monclient: authenticate success, global_id 85002 2024-08-18T21:10:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 4 set_mon_vals no callback set 2024-08-18T21:10:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92affd640 10 monclient: dump: 2024-08-18T21:10:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.533 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 10 monclient: shutdown 2024-08-18T21:10:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 -- 172.21.15.5:0/3282796035 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc92c09f080 msgr2=0x7fc92c0a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 --2- 172.21.15.5:0/3282796035 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc92c09f080 0x7fc92c0a74f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc9200098a0 tx=0x7fc92001c440 comp rx=0 tx=0).stop 2024-08-18T21:10:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 -- 172.21.15.5:0/3282796035 shutdown_connections 2024-08-18T21:10:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 --2- 172.21.15.5:0/3282796035 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc92c139990 0x7fc92c139df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 --2- 172.21.15.5:0/3282796035 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc92c09f080 0x7fc92c0a74f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 --2- 172.21.15.5:0/3282796035 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c0a6bd0 0x7fc92c0a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 -- 172.21.15.5:0/3282796035 >> 172.21.15.5:0/3282796035 conn(0x7fc92c068700 msgr2=0x7fc92c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 -- 172.21.15.5:0/3282796035 shutdown_connections 2024-08-18T21:10:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 -- 172.21.15.5:0/3282796035 wait complete. 2024-08-18T21:10:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 10 monclient: build_initial_monmap 2024-08-18T21:10:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 10 monclient: monmap: 2024-08-18T21:10:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:41.535 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 Processor -- start 2024-08-18T21:10:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 -- start start 2024-08-18T21:10:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 10 monclient: init 2024-08-18T21:10:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 10 monclient: _add_conns ranks=[0,6,7,4,2,5,3,8,1] 2024-08-18T21:10:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc92c09f080 0x7fc92c138490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 10 monclient(hunting): picked mon.noname-a con 0x7fc92c09f080 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:10:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc92c0a6bd0 0x7fc92c1389d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 10 monclient(hunting): picked mon.noname-d con 0x7fc92c0a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc92c139990 0x7fc92c13da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 10 monclient(hunting): picked mon.noname-i con 0x7fc92c139990 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c0a89f0 con 0x7fc92c09f080 2024-08-18T21:10:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fc92c0a7ce0 con 0x7fc92c0a6bd0 2024-08-18T21:10:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fc92c143610 con 0x7fc92c139990 2024-08-18T21:10:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc9325d1640 10 monclient(hunting): authenticate will time out at 1408.538560s 2024-08-18T21:10:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc92c0a6bd0 0x7fc92c1389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc92c0a6bd0 0x7fc92c1389d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54824/0 (socket says 172.21.15.5:54824) 2024-08-18T21:10:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 1 -- 172.21.15.5:0/2053576483 learned_addr learned my addr 172.21.15.5:0/2053576483 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 10 monclient(hunting): get_auth_request con 0x7fc92c0a6bd0 auth_method 0 2024-08-18T21:10:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92bfff640 1 --2- 172.21.15.5:0/2053576483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc92c09f080 0x7fc92c138490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92bfff640 10 monclient(hunting): get_auth_request con 0x7fc92c09f080 auth_method 0 2024-08-18T21:10:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc930b6e640 1 --2- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc92c139990 0x7fc92c13da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc930b6e640 10 monclient(hunting): get_auth_request con 0x7fc92c139990 auth_method 0 2024-08-18T21:10:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc930b6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc930b6e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc930b6e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 10 monclient(hunting): handle_auth_done global_id 85011 payload 824 2024-08-18T21:10:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 1 -- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc92c139990 msgr2=0x7fc92c13da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 1 --2- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc92c139990 0x7fc92c13da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 1 -- 172.21.15.5:0/2053576483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc92c09f080 msgr2=0x7fc92c138490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 1 --2- 172.21.15.5:0/2053576483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc92c09f080 0x7fc92c138490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:10:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 1 monclient: found mon.noname-d 2024-08-18T21:10:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:10:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.521+0000 7fc92b7fe640 1 -- 172.21.15.5:0/2053576483 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c1242a0 con 0x7fc92c0a6bd0 2024-08-18T21:10:41.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc92b7fe640 1 -- 172.21.15.5:0/2053576483 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc92c0a6bd0 msgr2=0x7fc92c1389d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc92b7fe640 1 --2- 172.21.15.5:0/2053576483 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc92c0a6bd0 0x7fc92c1389d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc9200097c0 tx=0x7fc9200191e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc928ff9640 1 -- 172.21.15.5:0/2053576483 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9200ba070 con 0x7fc92c0a6bd0 2024-08-18T21:10:41.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc928ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc928ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:10:41.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc928ff9640 10 monclient: dump: 2024-08-18T21:10:41.540 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.540 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.540 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.540 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.540 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.540 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.541 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.541 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.541 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.541 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.541 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.541 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.541 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.541 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.541 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.541 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc928ff9640 10 monclient: _finish_auth 0 2024-08-18T21:10:41.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc928ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:10:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc928ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc9325d1640 5 monclient: authenticate success, global_id 85011 2024-08-18T21:10:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc928ff9640 1 -- 172.21.15.5:0/2053576483 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9200b1040 con 0x7fc92c0a6bd0 2024-08-18T21:10:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc928ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc928ff9640 1 -- 172.21.15.5:0/2053576483 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9200b0070 con 0x7fc92c0a6bd0 2024-08-18T21:10:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc928ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc928ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc929ffb640 4 set_mon_vals no callback set 2024-08-18T21:10:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc928ff9640 10 monclient: dump: 2024-08-18T21:10:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.544 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc9325d1640 10 monclient: _renew_subs 2024-08-18T21:10:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc9325d1640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc9325d1640 1 -- 172.21.15.5:0/2053576483 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc92c13f520 con 0x7fc92c0a6bd0 2024-08-18T21:10:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc9325d1640 10 monclient: _renew_subs 2024-08-18T21:10:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc9325d1640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc9325d1640 1 -- 172.21.15.5:0/2053576483 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fc92c13fdd0 con 0x7fc92c0a6bd0 2024-08-18T21:10:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc9325d1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc9325d1640 1 --2- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c122aa0 0x7fc92c13dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc9325d1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc9325d1640 1 -- 172.21.15.5:0/2053576483 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fc92c051140 con 0x7fc92c122aa0 2024-08-18T21:10:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc928ff9640 1 -- 172.21.15.5:0/2053576483 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fc920004250 con 0x7fc92c0a6bd0 2024-08-18T21:10:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc92bfff640 1 --2- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c122aa0 0x7fc92c13dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc92bfff640 10 monclient: get_auth_request con 0x7fc92c122aa0 auth_method 0 2024-08-18T21:10:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc92bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc92bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc92bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc928ff9640 1 --2- 172.21.15.5:0/2053576483 >> v2:172.21.15.157:6812/631023601 conn(0x7fc91803bdf0 0x7fc91803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc92bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc92bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc92bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc928ff9640 1 -- 172.21.15.5:0/2053576483 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(209..209 src has 22..209) ==== 3898+0+0 (secure 0 0 0) 0x7fc9200e7e40 con 0x7fc92c0a6bd0 2024-08-18T21:10:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc930b6e640 1 --2- 172.21.15.5:0/2053576483 >> v2:172.21.15.157:6812/631023601 conn(0x7fc91803bdf0 0x7fc91803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc92bfff640 10 monclient(hunting): handle_auth_done global_id 94586 payload 824 2024-08-18T21:10:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc92bfff640 1 -- 172.21.15.5:0/2053576483 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc92c139df0 con 0x7fc92c122aa0 2024-08-18T21:10:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.525+0000 7fc930b6e640 10 monclient: get_auth_request con 0x7fc91803bdf0 auth_method 0 2024-08-18T21:10:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.529+0000 7fc92bfff640 1 -- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c122aa0 msgr2=0x7fc92c13dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.529+0000 7fc92bfff640 1 --2- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c122aa0 0x7fc92c13dfb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc91c010820 tx=0x7fc91c010ce0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.529+0000 7fc928ff9640 1 -- 172.21.15.5:0/2053576483 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc91c018020 con 0x7fc92c122aa0 2024-08-18T21:10:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.529+0000 7fc928ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.529+0000 7fc928ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:10:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.529+0000 7fc928ff9640 10 monclient: dump: 2024-08-18T21:10:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.550 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.529+0000 7fc930b6e640 1 --2- 172.21.15.5:0/2053576483 >> v2:172.21.15.157:6812/631023601 conn(0x7fc91803bdf0 0x7fc91803e2b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0a6890 tx=0x7fc92400b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.529+0000 7fc928ff9640 1 -- 172.21.15.5:0/2053576483 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc91c004450 con 0x7fc92c122aa0 2024-08-18T21:10:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.529+0000 7fc928ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.529+0000 7fc928ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.529+0000 7fc928ff9640 1 -- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c122aa0 msgr2=0x7fc92c13dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.529+0000 7fc928ff9640 1 --2- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c122aa0 0x7fc92c13dfb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc91c010820 tx=0x7fc91c010ce0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.529+0000 7fc928ff9640 1 -- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c122aa0 msgr2=0x7fc92c13dfb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.529+0000 7fc928ff9640 1 --2- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c122aa0 0x7fc92c13dfb0 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc91c010820 tx=0x7fc91c010ce0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.537+0000 7fc9325d1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.537+0000 7fc9325d1640 1 --2- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c13e4f0 0x7fc92c13e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.537+0000 7fc9325d1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.537+0000 7fc9325d1640 1 -- 172.21.15.5:0/2053576483 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fc92c13ee40 con 0x7fc92c13e4f0 2024-08-18T21:10:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.537+0000 7fc92bfff640 1 --2- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c13e4f0 0x7fc92c13e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.537+0000 7fc92bfff640 10 monclient: get_auth_request con 0x7fc92c13e4f0 auth_method 0 2024-08-18T21:10:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.537+0000 7fc92bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.537+0000 7fc92bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.537+0000 7fc92bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.537+0000 7fc92bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.537+0000 7fc92bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.537+0000 7fc92bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.537+0000 7fc92bfff640 10 monclient(hunting): handle_auth_done global_id 94595 payload 824 2024-08-18T21:10:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.537+0000 7fc92bfff640 1 -- 172.21.15.5:0/2053576483 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc92c1396a0 con 0x7fc92c13e4f0 2024-08-18T21:10:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc92bfff640 1 -- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c13e4f0 msgr2=0x7fc92c13e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc92bfff640 1 --2- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c13e4f0 0x7fc92c13e900 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc91c000c10 tx=0x7fc91c0046d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc928ff9640 1 -- 172.21.15.5:0/2053576483 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc91c018040 con 0x7fc92c13e4f0 2024-08-18T21:10:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc928ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc928ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:10:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc928ff9640 10 monclient: dump: 2024-08-18T21:10:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.554 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc928ff9640 1 -- 172.21.15.5:0/2053576483 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7fc91c003620 con 0x7fc92c13e4f0 2024-08-18T21:10:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc928ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc928ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc928ff9640 1 -- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c13e4f0 msgr2=0x7fc92c13e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc928ff9640 1 --2- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c13e4f0 0x7fc92c13e900 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc91c000c10 tx=0x7fc91c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc928ff9640 1 -- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c13e4f0 msgr2=0x7fc92c13e900 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc928ff9640 1 --2- 172.21.15.5:0/2053576483 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc92c13e4f0 0x7fc92c13e900 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.555 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 69578, 2024-08-18T21:10:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:10:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:41.560 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:41.560 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:41.560 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:41.560 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:41.560 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:41.560 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:41.560 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:41.560 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:41.560 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:41.560 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:41.560 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.560 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:41.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.560 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:41.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:41.561 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:41.561 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.561 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.561 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.561 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:41.561 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.561 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.562 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:41.562 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.562 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.562 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.562 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:41.562 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:41.562 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.562 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.562 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:41.562 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:41.563 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.563 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.563 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.563 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.563 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:41.563 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.563 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.563 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.563 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:41.563 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.563 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.564 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.564 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:41.564 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:41.564 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.564 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.564 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:41.564 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:41.564 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.564 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.565 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.565 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.565 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:41.565 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.565 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.565 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.565 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:41.565 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.565 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.565 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.566 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:41.566 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:41.566 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.566 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.566 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.566 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:41.566 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:41.566 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.566 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.566 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.567 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:41.567 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.567 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.567 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:41.567 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.567 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.567 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.567 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:41.567 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:41.577 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:10:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.578 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.579 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:41.579 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:41.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc9325d1640 1 -- 172.21.15.5:0/2053576483 >> v2:172.21.15.157:6812/631023601 conn(0x7fc91803bdf0 msgr2=0x7fc91803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc9325d1640 1 --2- 172.21.15.5:0/2053576483 >> v2:172.21.15.157:6812/631023601 conn(0x7fc91803bdf0 0x7fc91803e2b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0a6890 tx=0x7fc92400b040 comp rx=0 tx=0).stop 2024-08-18T21:10:41.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc9325d1640 10 monclient: shutdown 2024-08-18T21:10:41.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc9325d1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:41.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc9325d1640 1 -- 172.21.15.5:0/2053576483 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc92c0a6bd0 msgr2=0x7fc92c1389d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc9325d1640 1 --2- 172.21.15.5:0/2053576483 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc92c0a6bd0 0x7fc92c1389d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc9200097c0 tx=0x7fc9200191e0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc930b6e640 1 -- 172.21.15.5:0/2053576483 reap_dead start 2024-08-18T21:10:41.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc930b6e640 1 -- 172.21.15.5:0/2053576483 reap_dead start 2024-08-18T21:10:41.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc9325d1640 1 -- 172.21.15.5:0/2053576483 shutdown_connections 2024-08-18T21:10:41.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc9325d1640 1 -- 172.21.15.5:0/2053576483 >> 172.21.15.5:0/2053576483 conn(0x7fc92c068700 msgr2=0x7fc92c0a9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:41.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc9325d1640 1 -- 172.21.15.5:0/2053576483 shutdown_connections 2024-08-18T21:10:41.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.541+0000 7fc9325d1640 1 -- 172.21.15.5:0/2053576483 wait complete. 2024-08-18T21:10:41.581 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:41.581 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:10:41.581 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:10:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.705+0000 7fc6edffa640 10 monclient: get_monmap_and_config 2024-08-18T21:10:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.705+0000 7fc6edffa640 10 monclient: build_initial_monmap 2024-08-18T21:10:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.705+0000 7fc6edffa640 10 monclient: monmap: 2024-08-18T21:10:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:41.712365+0000 2024-08-18T21:10:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:41.712365+0000 2024-08-18T21:10:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:41.712 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 1 Processor -- start 2024-08-18T21:10:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 1 -- start start 2024-08-18T21:10:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 10 monclient: init 2024-08-18T21:10:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 10 monclient: _add_conns ranks=[2,3,0,4,8,9,5,1,10,7,6] 2024-08-18T21:10:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc6e80a6ce0 0x7fc6e80a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 10 monclient(hunting): picked mon.noname-b con 0x7fc6e80a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6e80a7600 0x7fc6e8139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 10 monclient(hunting): picked mon.noname-g con 0x7fc6e80a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc6e8139fe0 addr v1:172.21.15.5:6789/0 2024-08-18T21:10:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6e80a45d0 con 0x7fc6e8139fe0 2024-08-18T21:10:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e80a5000 con 0x7fc6e80a6ce0 2024-08-18T21:10:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e80a32d0 con 0x7fc6e80a7600 2024-08-18T21:10:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6edffa640 10 monclient(hunting): authenticate will time out at 1408.725570s 2024-08-18T21:10:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc6e8139fe0 0x7fc6e8140cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32862/0 (socket says 172.21.15.5:32862) 2024-08-18T21:10:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e7fff640 1 -- 172.21.15.5:0/4158666749 learned_addr learned my addr 172.21.15.5:0/4158666749 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:10:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 1 --2- 172.21.15.5:0/4158666749 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc6e80a6ce0 0x7fc6e80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 10 monclient(hunting): get_auth_request con 0x7fc6e80a6ce0 auth_method 0 2024-08-18T21:10:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e6ffd640 1 --2- 172.21.15.5:0/4158666749 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6e80a7600 0x7fc6e8139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e6ffd640 10 monclient(hunting): get_auth_request con 0x7fc6e80a7600 auth_method 0 2024-08-18T21:10:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 10 monclient(hunting): handle_auth_done global_id 84791 payload 274 2024-08-18T21:10:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 1 -- 172.21.15.5:0/4158666749 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6e80a7600 msgr2=0x7fc6e8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 1 --2- 172.21.15.5:0/4158666749 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6e80a7600 0x7fc6e8139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 1 -- 172.21.15.5:0/4158666749 >> v1:172.21.15.5:6789/0 conn(0x7fc6e8139fe0 legacy=0x7fc6e8140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 10 monclient: _finish_hunting 0 2024-08-18T21:10:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 1 monclient: found mon.noname-b 2024-08-18T21:10:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:10:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.709+0000 7fc6e77fe640 1 -- 172.21.15.5:0/4158666749 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e80a8900 con 0x7fc6e80a6ce0 2024-08-18T21:10:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6e77fe640 1 -- 172.21.15.5:0/4158666749 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc6e80a6ce0 msgr2=0x7fc6e80a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6e77fe640 1 --2- 172.21.15.5:0/4158666749 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc6e80a6ce0 0x7fc6e80a70c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009dc0 tx=0x7fc6e001c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32ffb35c96b2e5d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6e67fc640 1 -- 172.21.15.5:0/4158666749 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc6e00b2070 con 0x7fc6e80a6ce0 2024-08-18T21:10:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6e67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:10:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6e67fc640 10 monclient: dump: 2024-08-18T21:10:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.721 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6e67fc640 10 monclient: _finish_auth 0 2024-08-18T21:10:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6e67fc640 10 monclient: _check_auth_tickets 2024-08-18T21:10:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6e67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6e67fc640 1 -- 172.21.15.5:0/4158666749 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e00a5aa0 con 0x7fc6e80a6ce0 2024-08-18T21:10:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6e67fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6e67fc640 1 -- 172.21.15.5:0/4158666749 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc6e00a5c90 con 0x7fc6e80a6ce0 2024-08-18T21:10:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6e67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6e67fc640 10 monclient: dump: 2024-08-18T21:10:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.723 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6edffa640 5 monclient: authenticate success, global_id 84791 2024-08-18T21:10:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6edffa640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.713+0000 7fc6edffa640 4 set_mon_vals no callback set 2024-08-18T21:10:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 10 monclient: shutdown 2024-08-18T21:10:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 1 -- 172.21.15.5:0/4158666749 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc6e80a6ce0 msgr2=0x7fc6e80a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 1 --2- 172.21.15.5:0/4158666749 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc6e80a6ce0 0x7fc6e80a70c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009dc0 tx=0x7fc6e001c850 comp rx=0 tx=0).stop 2024-08-18T21:10:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 1 -- 172.21.15.5:0/4158666749 shutdown_connections 2024-08-18T21:10:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 1 --2- 172.21.15.5:0/4158666749 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6e80a7600 0x7fc6e8139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 1 --2- 172.21.15.5:0/4158666749 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc6e80a6ce0 0x7fc6e80a70c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 1 -- 172.21.15.5:0/4158666749 >> 172.21.15.5:0/4158666749 conn(0x7fc6e80acbc0 msgr2=0x7fc6e80a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 1 -- 172.21.15.5:0/4158666749 shutdown_connections 2024-08-18T21:10:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 1 -- 172.21.15.5:0/4158666749 wait complete. 2024-08-18T21:10:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 10 monclient: build_initial_monmap 2024-08-18T21:10:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 10 monclient: monmap: 2024-08-18T21:10:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:41.725 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 1 Processor -- start 2024-08-18T21:10:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 1 -- start start 2024-08-18T21:10:41.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 10 monclient: init 2024-08-18T21:10:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 10 monclient: _add_conns ranks=[4,2,1,8,7,5,6,3,0] 2024-08-18T21:10:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc6e80a6ce0 0x7fc6e81d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 10 monclient(hunting): picked mon.noname-c con 0x7fc6e80a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc6e80a7600 0x7fc6e81d2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 10 monclient(hunting): picked mon.noname-b con 0x7fc6e80a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6e8139fe0 0x7fc6e813e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 10 monclient(hunting): picked mon.noname-f con 0x7fc6e8139fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:10:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e80a79e0 con 0x7fc6e8139fe0 2024-08-18T21:10:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e80a9810 con 0x7fc6e80a7600 2024-08-18T21:10:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fc6e8140ef0 con 0x7fc6e80a6ce0 2024-08-18T21:10:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6edffa640 10 monclient(hunting): authenticate will time out at 1408.734296s 2024-08-18T21:10:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc6e80a7600 0x7fc6e81d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc6e80a7600 0x7fc6e81d2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:43860/0 (socket says 172.21.15.5:43860) 2024-08-18T21:10:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e77fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc6e80a6ce0 0x7fc6e81d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 1 -- 172.21.15.5:0/1626708312 learned_addr learned my addr 172.21.15.5:0/1626708312 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 10 monclient(hunting): get_auth_request con 0x7fc6e80a7600 auth_method 0 2024-08-18T21:10:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e77fe640 10 monclient(hunting): get_auth_request con 0x7fc6e80a6ce0 auth_method 0 2024-08-18T21:10:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e7fff640 1 --2- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6e8139fe0 0x7fc6e813e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e7fff640 10 monclient(hunting): get_auth_request con 0x7fc6e8139fe0 auth_method 0 2024-08-18T21:10:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 10 monclient(hunting): handle_auth_done global_id 84800 payload 824 2024-08-18T21:10:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 1 -- 172.21.15.5:0/1626708312 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc6e80a6ce0 msgr2=0x7fc6e81d1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 1 --2- 172.21.15.5:0/1626708312 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc6e80a6ce0 0x7fc6e81d1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 1 -- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6e8139fe0 msgr2=0x7fc6e813e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 1 --2- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6e8139fe0 0x7fc6e813e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:10:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 1 monclient: found mon.noname-b 2024-08-18T21:10:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:10:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.717+0000 7fc6e6ffd640 1 -- 172.21.15.5:0/1626708312 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e8123240 con 0x7fc6e80a7600 2024-08-18T21:10:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6e6ffd640 1 -- 172.21.15.5:0/1626708312 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc6e80a7600 msgr2=0x7fc6e81d2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6e6ffd640 1 --2- 172.21.15.5:0/1626708312 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc6e80a7600 0x7fc6e81d2190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000d830 tx=0x7fc6d000dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6dffff640 1 -- 172.21.15.5:0/1626708312 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc6d000bd40 con 0x7fc6e80a7600 2024-08-18T21:10:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6dffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:10:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6dffff640 10 monclient: dump: 2024-08-18T21:10:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.736 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6dffff640 10 monclient: _finish_auth 0 2024-08-18T21:10:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6dffff640 10 monclient: _check_auth_tickets 2024-08-18T21:10:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6dffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6dffff640 1 -- 172.21.15.5:0/1626708312 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d0019070 con 0x7fc6e80a7600 2024-08-18T21:10:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6edffa640 5 monclient: authenticate success, global_id 84800 2024-08-18T21:10:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6edffa640 10 monclient: _renew_subs 2024-08-18T21:10:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6edffa640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:10:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6edffa640 1 -- 172.21.15.5:0/1626708312 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e8123520 con 0x7fc6e80a7600 2024-08-18T21:10:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6dffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6dffff640 1 -- 172.21.15.5:0/1626708312 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc6d00148a0 con 0x7fc6e80a7600 2024-08-18T21:10:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6dffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6e57fa640 4 set_mon_vals no callback set 2024-08-18T21:10:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6dffff640 10 monclient: dump: 2024-08-18T21:10:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.739 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6edffa640 10 monclient: _renew_subs 2024-08-18T21:10:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6edffa640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:10:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6edffa640 1 -- 172.21.15.5:0/1626708312 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e80a2230 con 0x7fc6e80a7600 2024-08-18T21:10:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6edffa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6edffa640 1 --2- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc6e813ee20 0x7fc6e813f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6edffa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6edffa640 1 -- 172.21.15.5:0/1626708312 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fc6e80a7b60 con 0x7fc6e813ee20 2024-08-18T21:10:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6dffff640 1 -- 172.21.15.5:0/1626708312 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fc6d0014430 con 0x7fc6e80a7600 2024-08-18T21:10:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6e77fe640 1 --2- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc6e813ee20 0x7fc6e813f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6e77fe640 10 monclient: get_auth_request con 0x7fc6e813ee20 auth_method 0 2024-08-18T21:10:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6e77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6dffff640 1 --2- 172.21.15.5:0/1626708312 >> v2:172.21.15.157:6812/631023601 conn(0x7fc6c803bdf0 0x7fc6c803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6e77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6e77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6e77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6dffff640 1 -- 172.21.15.5:0/1626708312 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(209..209 src has 22..209) ==== 3898+0+0 (secure 0 0 0) 0x7fc6d000f040 con 0x7fc6e80a7600 2024-08-18T21:10:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6e77fe640 10 monclient(hunting): handle_auth_done global_id 6145 payload 824 2024-08-18T21:10:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6e77fe640 1 -- 172.21.15.5:0/1626708312 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6e81403f0 con 0x7fc6e813ee20 2024-08-18T21:10:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6e7fff640 1 --2- 172.21.15.5:0/1626708312 >> v2:172.21.15.157:6812/631023601 conn(0x7fc6c803bdf0 0x7fc6c803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.721+0000 7fc6e7fff640 10 monclient: get_auth_request con 0x7fc6c803bdf0 auth_method 0 2024-08-18T21:10:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.725+0000 7fc6e77fe640 1 -- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc6e813ee20 msgr2=0x7fc6e813f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.725+0000 7fc6e77fe640 1 --2- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc6e813ee20 0x7fc6e813f200 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00af000 tx=0x7fc6e00195f0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.725+0000 7fc6dffff640 1 -- 172.21.15.5:0/1626708312 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc6e00bc070 con 0x7fc6e813ee20 2024-08-18T21:10:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.725+0000 7fc6dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.725+0000 7fc6dffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:10:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.725+0000 7fc6dffff640 10 monclient: dump: 2024-08-18T21:10:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.742 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.725+0000 7fc6e7fff640 1 --2- 172.21.15.5:0/1626708312 >> v2:172.21.15.157:6812/631023601 conn(0x7fc6c803bdf0 0x7fc6c803e2b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8142300 tx=0x7fc6d8008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.725+0000 7fc6dffff640 1 -- 172.21.15.5:0/1626708312 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc6e00b3040 con 0x7fc6e813ee20 2024-08-18T21:10:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.725+0000 7fc6dffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.725+0000 7fc6dffff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.725+0000 7fc6dffff640 1 -- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc6e813ee20 msgr2=0x7fc6e813f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.725+0000 7fc6dffff640 1 --2- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc6e813ee20 0x7fc6e813f200 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00af000 tx=0x7fc6e00195f0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.725+0000 7fc6dffff640 1 -- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc6e813ee20 msgr2=0x7fc6e813f200 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.725+0000 7fc6dffff640 1 --2- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc6e813ee20 0x7fc6e813f200 secure :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00af000 tx=0x7fc6e00195f0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.733+0000 7fc6edffa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:41.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.733+0000 7fc6edffa640 1 --2- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc6e813f740 0x7fc6e813aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.733+0000 7fc6edffa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.733+0000 7fc6edffa640 1 -- 172.21.15.5:0/1626708312 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fc6e8051140 con 0x7fc6e813f740 2024-08-18T21:10:41.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.733+0000 7fc6e77fe640 1 --2- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc6e813f740 0x7fc6e813aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.733+0000 7fc6e77fe640 10 monclient: get_auth_request con 0x7fc6e813f740 auth_method 0 2024-08-18T21:10:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.733+0000 7fc6e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.733+0000 7fc6e77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.733+0000 7fc6e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.733+0000 7fc6e77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.733+0000 7fc6e77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.733+0000 7fc6e77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.733+0000 7fc6e77fe640 10 monclient(hunting): handle_auth_done global_id 6154 payload 824 2024-08-18T21:10:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.733+0000 7fc6e77fe640 1 -- 172.21.15.5:0/1626708312 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc6e80a8220 con 0x7fc6e813f740 2024-08-18T21:10:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6e77fe640 1 -- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc6e813f740 msgr2=0x7fc6e813aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6e77fe640 1 --2- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc6e813f740 0x7fc6e813aa90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0000f90 tx=0x7fc6e00a7000 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6dffff640 1 -- 172.21.15.5:0/1626708312 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc6e00b2070 con 0x7fc6e813f740 2024-08-18T21:10:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6dffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:10:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6dffff640 10 monclient: dump: 2024-08-18T21:10:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.747 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6dffff640 1 -- 172.21.15.5:0/1626708312 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9582 (secure 0 0 0) 0x7fc6e00a5e40 con 0x7fc6e813f740 2024-08-18T21:10:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6dffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6dffff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6dffff640 1 -- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc6e813f740 msgr2=0x7fc6e813aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6dffff640 1 --2- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc6e813f740 0x7fc6e813aa90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0000f90 tx=0x7fc6e00a7000 comp rx=0 tx=0).stop 2024-08-18T21:10:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6dffff640 1 -- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc6e813f740 msgr2=0x7fc6e813aa90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6dffff640 1 --2- 172.21.15.5:0/1626708312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc6e813f740 0x7fc6e813aa90 secure :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0000f90 tx=0x7fc6e00a7000 comp rx=0 tx=0).stop 2024-08-18T21:10:41.748 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 450834, 2024-08-18T21:10:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:41.748 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:10:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:41.749 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:41.750 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:41.752 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:41.755 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:41.756 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:41.759 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.761 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.762 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:41.762 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.762 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.762 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:41.762 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.762 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.762 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.762 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:41.762 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:41.762 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.763 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.763 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.763 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.763 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.763 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:41.763 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:41.763 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.763 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.763 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.763 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.763 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:41.763 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.764 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.764 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:41.764 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.764 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.764 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.764 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:41.764 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:41.764 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.764 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.764 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.765 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:41.765 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:41.765 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.765 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.765 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.765 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:41.765 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.765 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.765 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:41.766 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.766 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.766 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.766 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:41.766 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:41.766 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.766 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.766 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.766 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:41.766 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:41.767 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.767 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.767 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.767 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:41.767 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.767 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.767 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:41.767 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.767 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.767 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.768 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:41.768 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:41.768 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.768 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.768 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.768 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:41.768 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:41.768 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:41.768 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:41.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.769 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:41.769 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:41.769 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.769 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:41.769 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:41.769 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:41.769 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.769 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.769 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:41.769 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:41.769 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:10:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:10:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:10:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:41.772 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6edffa640 1 -- 172.21.15.5:0/1626708312 >> v2:172.21.15.157:6812/631023601 conn(0x7fc6c803bdf0 msgr2=0x7fc6c803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6edffa640 1 --2- 172.21.15.5:0/1626708312 >> v2:172.21.15.157:6812/631023601 conn(0x7fc6c803bdf0 0x7fc6c803e2b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8142300 tx=0x7fc6d8008040 comp rx=0 tx=0).stop 2024-08-18T21:10:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6edffa640 10 monclient: shutdown 2024-08-18T21:10:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6edffa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6edffa640 1 -- 172.21.15.5:0/1626708312 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc6e80a7600 msgr2=0x7fc6e81d2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6edffa640 1 --2- 172.21.15.5:0/1626708312 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc6e80a7600 0x7fc6e81d2190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000d830 tx=0x7fc6d000dcf0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6e7fff640 1 -- 172.21.15.5:0/1626708312 reap_dead start 2024-08-18T21:10:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6e7fff640 1 -- 172.21.15.5:0/1626708312 reap_dead start 2024-08-18T21:10:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6edffa640 1 -- 172.21.15.5:0/1626708312 shutdown_connections 2024-08-18T21:10:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6edffa640 1 -- 172.21.15.5:0/1626708312 >> 172.21.15.5:0/1626708312 conn(0x7fc6e80acbc0 msgr2=0x7fc6e80aa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6edffa640 1 -- 172.21.15.5:0/1626708312 shutdown_connections 2024-08-18T21:10:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.737+0000 7fc6edffa640 1 -- 172.21.15.5:0/1626708312 wait complete. 2024-08-18T21:10:41.775 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:41.775 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-18T21:10:41.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-18T21:10:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.889+0000 7fdef1b3a640 10 monclient: get_monmap_and_config 2024-08-18T21:10:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.889+0000 7fdef1b3a640 10 monclient: build_initial_monmap 2024-08-18T21:10:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.889+0000 7fdef1b3a640 10 monclient: monmap: 2024-08-18T21:10:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:41.894941+0000 2024-08-18T21:10:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:41.894941+0000 2024-08-18T21:10:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:41.894 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.889+0000 7fdef1b3a640 1 Processor -- start 2024-08-18T21:10:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.889+0000 7fdef1b3a640 1 -- start start 2024-08-18T21:10:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.889+0000 7fdef1b3a640 10 monclient: init 2024-08-18T21:10:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdef1b3a640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdef1b3a640 10 monclient: _add_conns ranks=[6,2,5,3,4,9,10,1,8,0,7] 2024-08-18T21:10:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdef1b3a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdeec0a6ce0 0x7fdeec0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdef1b3a640 10 monclient(hunting): picked mon.noname-d con 0x7fdeec0a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdef1b3a640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdeec0a7600 0x7fdeec139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdef1b3a640 10 monclient(hunting): picked mon.noname-b con 0x7fdeec0a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdef1b3a640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdeec139fe0 0x7fdeec13a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdef1b3a640 10 monclient(hunting): picked mon.noname-h con 0x7fdeec139fe0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdef1b3a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdef1b3a640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fdeec0a5000 con 0x7fdeec0a7600 2024-08-18T21:10:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdef1b3a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdef1b3a640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdeec0a4360 con 0x7fdeec139fe0 2024-08-18T21:10:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdef1b3a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdef1b3a640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fdeec0a45d0 con 0x7fdeec0a6ce0 2024-08-18T21:10:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdef1b3a640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdef1b3a640 10 monclient(hunting): authenticate will time out at 1408.908635s 2024-08-18T21:10:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdeec0a7600 0x7fdeec139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdeec0a7600 0x7fdeec139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:43876/0 (socket says 172.21.15.5:43876) 2024-08-18T21:10:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 1 -- 172.21.15.5:0/809835310 learned_addr learned my addr 172.21.15.5:0/809835310 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 10 monclient(hunting): get_auth_request con 0x7fdeec0a7600 auth_method 0 2024-08-18T21:10:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdeeb7fe640 1 --2- 172.21.15.5:0/809835310 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdeec0a6ce0 0x7fdeec0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdeeb7fe640 10 monclient(hunting): get_auth_request con 0x7fdeec0a6ce0 auth_method 0 2024-08-18T21:10:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdeeb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdeeb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdeeb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdeeb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdeeb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdeeb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 10 monclient(hunting): handle_auth_done global_id 84809 payload 274 2024-08-18T21:10:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 1 -- 172.21.15.5:0/809835310 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdeec0a6ce0 msgr2=0x7fdeec0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 1 --2- 172.21.15.5:0/809835310 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdeec0a6ce0 0x7fdeec0a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdeebfff640 1 --2- 172.21.15.5:0/809835310 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdeec139fe0 0x7fdeec13a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 1 -- 172.21.15.5:0/809835310 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdeec139fe0 msgr2=0x7fdeec13a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 1 --2- 172.21.15.5:0/809835310 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdeec139fe0 0x7fdeec13a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:10:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 1 monclient: found mon.noname-b 2024-08-18T21:10:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:10:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdee2ffd640 1 -- 172.21.15.5:0/809835310 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeec0a32d0 con 0x7fdeec0a7600 2024-08-18T21:10:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdeebfff640 10 monclient: get_auth_request con 0x7fdeec139fe0 auth_method 0 2024-08-18T21:10:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.893+0000 7fdeebfff640 1 --2- 172.21.15.5:0/809835310 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdeec139fe0 0x7fdeec13a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:10:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdee2ffd640 1 -- 172.21.15.5:0/809835310 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdeec0a7600 msgr2=0x7fdeec139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdee2ffd640 1 --2- 172.21.15.5:0/809835310 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdeec0a7600 0x7fdeec139aa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fded40098d0 tx=0x7fded401c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21e2fd237326bb2c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdeeaffd640 1 -- 172.21.15.5:0/809835310 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fded40b0070 con 0x7fdeec0a7600 2024-08-18T21:10:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdeeaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdeeaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:10:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdeeaffd640 10 monclient: dump: 2024-08-18T21:10:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.905 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdeeaffd640 10 monclient: _finish_auth 0 2024-08-18T21:10:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdeeaffd640 10 monclient: _check_auth_tickets 2024-08-18T21:10:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdeeaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdeeaffd640 1 -- 172.21.15.5:0/809835310 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded40aa810 con 0x7fdeec0a7600 2024-08-18T21:10:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 5 monclient: authenticate success, global_id 84809 2024-08-18T21:10:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:10:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdeeaffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdeeaffd640 1 -- 172.21.15.5:0/809835310 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fded40aae30 con 0x7fdeec0a7600 2024-08-18T21:10:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 4 set_mon_vals no callback set 2024-08-18T21:10:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdeeaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdeeaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdeeaffd640 10 monclient: dump: 2024-08-18T21:10:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.908 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 10 monclient: shutdown 2024-08-18T21:10:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 -- 172.21.15.5:0/809835310 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdeec0a7600 msgr2=0x7fdeec139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 --2- 172.21.15.5:0/809835310 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdeec0a7600 0x7fdeec139aa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fded40098d0 tx=0x7fded401c440 comp rx=0 tx=0).stop 2024-08-18T21:10:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 -- 172.21.15.5:0/809835310 shutdown_connections 2024-08-18T21:10:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 --2- 172.21.15.5:0/809835310 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdeec139fe0 0x7fdeec13a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 --2- 172.21.15.5:0/809835310 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdeec0a7600 0x7fdeec139aa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 --2- 172.21.15.5:0/809835310 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdeec0a6ce0 0x7fdeec0a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 -- 172.21.15.5:0/809835310 >> 172.21.15.5:0/809835310 conn(0x7fdeec0acbc0 msgr2=0x7fdeec0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 -- 172.21.15.5:0/809835310 shutdown_connections 2024-08-18T21:10:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 -- 172.21.15.5:0/809835310 wait complete. 2024-08-18T21:10:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 10 monclient: build_initial_monmap 2024-08-18T21:10:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 10 monclient: monmap: 2024-08-18T21:10:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:41.910 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 Processor -- start 2024-08-18T21:10:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 -- start start 2024-08-18T21:10:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 10 monclient: init 2024-08-18T21:10:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 10 monclient: _add_conns ranks=[3,0,6,1,2,5,4,8,7] 2024-08-18T21:10:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdeec0a6ce0 0x7fdeec135260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 10 monclient(hunting): picked mon.noname-g con 0x7fdeec0a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec0a7600 0x7fdeec13aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 10 monclient(hunting): picked mon.noname-a con 0x7fdeec0a7600 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:10:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdeec139fe0 0x7fdeec13aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 10 monclient(hunting): picked mon.noname-d con 0x7fdeec139fe0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec0a79e0 con 0x7fdeec0a7600 2024-08-18T21:10:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdeec0a8220 con 0x7fdeec0a6ce0 2024-08-18T21:10:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fdeec0a72c0 con 0x7fdeec139fe0 2024-08-18T21:10:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.897+0000 7fdef1b3a640 10 monclient(hunting): authenticate will time out at 1408.915976s 2024-08-18T21:10:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeebfff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdeec139fe0 0x7fdeec13aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec0a7600 0x7fdeec13aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeebfff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdeec139fe0 0x7fdeec13aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54842/0 (socket says 172.21.15.5:54842) 2024-08-18T21:10:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec0a7600 0x7fdeec13aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57188/0 (socket says 172.21.15.5:57188) 2024-08-18T21:10:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeebfff640 1 -- 172.21.15.5:0/1722267258 learned_addr learned my addr 172.21.15.5:0/1722267258 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeebfff640 10 monclient(hunting): get_auth_request con 0x7fdeec139fe0 auth_method 0 2024-08-18T21:10:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeebfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeebfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 10 monclient(hunting): get_auth_request con 0x7fdeec0a7600 auth_method 0 2024-08-18T21:10:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeeb7fe640 1 --2- 172.21.15.5:0/1722267258 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdeec0a6ce0 0x7fdeec135260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeeb7fe640 10 monclient(hunting): get_auth_request con 0x7fdeec0a6ce0 auth_method 0 2024-08-18T21:10:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeeb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeeb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeeb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 10 monclient(hunting): handle_auth_done global_id 84717 payload 824 2024-08-18T21:10:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 1 -- 172.21.15.5:0/1722267258 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdeec139fe0 msgr2=0x7fdeec13aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 1 --2- 172.21.15.5:0/1722267258 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdeec139fe0 0x7fdeec13aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 1 -- 172.21.15.5:0/1722267258 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdeec0a6ce0 msgr2=0x7fdeec135260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 1 --2- 172.21.15.5:0/1722267258 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdeec0a6ce0 0x7fdeec135260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:10:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 1 monclient: found mon.noname-a 2024-08-18T21:10:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:10:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 1 -- 172.21.15.5:0/1722267258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeec0aa370 con 0x7fdeec0a7600 2024-08-18T21:10:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeebfff640 1 --2- 172.21.15.5:0/1722267258 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdeec139fe0 0x7fdeec13aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:41.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 1 -- 172.21.15.5:0/1722267258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec0a7600 msgr2=0x7fdeec13aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:41.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee2ffd640 1 --2- 172.21.15.5:0/1722267258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec0a7600 0x7fdeec13aab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fded40ad000 tx=0x7fded40191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee8ff9640 1 -- 172.21.15.5:0/1722267258 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fded40b0070 con 0x7fdeec0a7600 2024-08-18T21:10:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:10:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee8ff9640 10 monclient: dump: 2024-08-18T21:10:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.918 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee8ff9640 10 monclient: _finish_auth 0 2024-08-18T21:10:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee8ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:10:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee8ff9640 1 -- 172.21.15.5:0/1722267258 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded40b1040 con 0x7fdeec0a7600 2024-08-18T21:10:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdef1b3a640 5 monclient: authenticate success, global_id 84717 2024-08-18T21:10:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdef1b3a640 10 monclient: _renew_subs 2024-08-18T21:10:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdef1b3a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:10:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdef1b3a640 1 -- 172.21.15.5:0/1722267258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeec13c2a0 con 0x7fdeec0a7600 2024-08-18T21:10:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee8ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee8ff9640 1 -- 172.21.15.5:0/1722267258 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fded40aae00 con 0x7fdeec0a7600 2024-08-18T21:10:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdef1b3a640 10 monclient: _renew_subs 2024-08-18T21:10:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdef1b3a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:10:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdef1b3a640 1 -- 172.21.15.5:0/1722267258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeec13e600 con 0x7fdeec0a7600 2024-08-18T21:10:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdeea7fc640 4 set_mon_vals no callback set 2024-08-18T21:10:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.901+0000 7fdee8ff9640 10 monclient: dump: 2024-08-18T21:10:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:41.921 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.905+0000 7fdef1b3a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.905+0000 7fdef1b3a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.905+0000 7fdef1b3a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:10:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.905+0000 7fdef1b3a640 1 -- 172.21.15.5:0/1722267258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeec139aa0 con 0x7fdeec0a7600 2024-08-18T21:10:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.905+0000 7fdee8ff9640 1 -- 172.21.15.5:0/1722267258 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fded40bc060 con 0x7fdeec0a7600 2024-08-18T21:10:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.905+0000 7fdee8ff9640 1 --2- 172.21.15.5:0/1722267258 >> v2:172.21.15.157:6812/631023601 conn(0x7fdecc03bde0 0x7fdecc03e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.905+0000 7fdee8ff9640 1 -- 172.21.15.5:0/1722267258 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 22..209) ==== 3898+0+0 (secure 0 0 0) 0x7fded40e7d80 con 0x7fdeec0a7600 2024-08-18T21:10:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.905+0000 7fdeeb7fe640 1 --2- 172.21.15.5:0/1722267258 >> v2:172.21.15.157:6812/631023601 conn(0x7fdecc03bde0 0x7fdecc03e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.905+0000 7fdeeb7fe640 10 monclient: get_auth_request con 0x7fdecc03bde0 auth_method 0 2024-08-18T21:10:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.909+0000 7fdeeb7fe640 1 --2- 172.21.15.5:0/1722267258 >> v2:172.21.15.157:6812/631023601 conn(0x7fdecc03bde0 0x7fdecc03e2a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009af0 tx=0x7fdedc008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.909+0000 7fdee8ff9640 1 -- 172.21.15.5:0/1722267258 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fded4016150 con 0x7fdeec0a7600 2024-08-18T21:10:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.909+0000 7fdee8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:41.909+0000 7fdee8ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:42.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.141+0000 7fdef1b3a640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-18T21:10:42.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.141+0000 7fdef1b3a640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-18T21:10:42.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.141+0000 7fdef1b3a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:10:42.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.141+0000 7fdef1b3a640 1 -- 172.21.15.5:0/1722267258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fdeec13ce00 con 0x7fdeec0a7600 2024-08-18T21:10:42.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdee8ff9640 1 -- 172.21.15.5:0/1722267258 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fded4004450 con 0x7fdeec0a7600 2024-08-18T21:10:42.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdee8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-18T21:10:42.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdee8ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdef1b3a640 1 -- 172.21.15.5:0/1722267258 >> v2:172.21.15.157:6812/631023601 conn(0x7fdecc03bde0 msgr2=0x7fdecc03e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdef1b3a640 1 --2- 172.21.15.5:0/1722267258 >> v2:172.21.15.157:6812/631023601 conn(0x7fdecc03bde0 0x7fdecc03e2a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009af0 tx=0x7fdedc008040 comp rx=0 tx=0).stop 2024-08-18T21:10:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdef1b3a640 10 monclient: shutdown 2024-08-18T21:10:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdef1b3a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdef1b3a640 1 -- 172.21.15.5:0/1722267258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec0a7600 msgr2=0x7fdeec13aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdef1b3a640 1 --2- 172.21.15.5:0/1722267258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec0a7600 0x7fdeec13aab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fded40ad000 tx=0x7fded40191e0 comp rx=0 tx=0).stop 2024-08-18T21:10:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdef1b3a640 1 -- 172.21.15.5:0/1722267258 shutdown_connections 2024-08-18T21:10:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdef1b3a640 1 --2- 172.21.15.5:0/1722267258 >> v2:172.21.15.157:6812/631023601 conn(0x7fdecc03bde0 0x7fdecc03e2a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdef1b3a640 1 --2- 172.21.15.5:0/1722267258 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdeec139fe0 0x7fdeec13aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdef1b3a640 1 --2- 172.21.15.5:0/1722267258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec0a7600 0x7fdeec13aab0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdef1b3a640 1 --2- 172.21.15.5:0/1722267258 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdeec0a6ce0 0x7fdeec135260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdef1b3a640 1 -- 172.21.15.5:0/1722267258 >> 172.21.15.5:0/1722267258 conn(0x7fdeec0acbc0 msgr2=0x7fdeec138850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdef1b3a640 1 -- 172.21.15.5:0/1722267258 shutdown_connections 2024-08-18T21:10:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:42.145+0000 7fdef1b3a640 1 -- 172.21.15.5:0/1722267258 wait complete. 2024-08-18T21:10:42.152 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.145+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.145+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=11,kv=10,logm=61} crc {auth=2531039743,config=1618278320,health=3495677664,kv=3664197221,logm=519948088}) 2024-08-18T21:10:42.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.145+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=16,config=2,health=11,kv=10,logm=61} crc {auth=3073562642,config=1618278320,health=2098117209,kv=834105495,logm=2103310021}) 2024-08-18T21:10:42.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.145+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=11,kv=10,logm=61} crc {auth=2531039743,config=1618278320,health=3495677664,kv=3664197221,logm=519948088}) 2024-08-18T21:10:42.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=17,config=2,health=12,kv=8,logm=61} crc {auth=3594882646,config=1618278320,health=3762268701,kv=672252078,logm=3463516452}) 2024-08-18T21:10:42.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=11,kv=10,logm=61} crc {auth=2531039743,config=1618278320,health=3495677664,kv=3664197221,logm=519948088}) 2024-08-18T21:10:42.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=16,config=1,health=11,kv=10,logm=62} crc {auth=959201560,config=1228700967,health=3888152988,kv=1113373555,logm=3048425492}) 2024-08-18T21:10:42.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=11,kv=10,logm=61} crc {auth=2531039743,config=1618278320,health=3495677664,kv=3664197221,logm=519948088}) 2024-08-18T21:10:42.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=16,config=2,health=12,kv=10,logm=60} crc {auth=3853011269,config=1618278320,health=3762268701,kv=3664197221,logm=3909201776}) 2024-08-18T21:10:42.153 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=11,kv=10,logm=61} crc {auth=2531039743,config=1618278320,health=3495677664,kv=3664197221,logm=519948088}) 2024-08-18T21:10:42.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=16,config=2,health=11,kv=10,logm=61} crc {auth=1581486265,config=1618278320,health=2258311352,kv=3664197221,logm=2523554302}) 2024-08-18T21:10:42.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=11,kv=10,logm=61} crc {auth=2531039743,config=1618278320,health=3495677664,kv=3664197221,logm=519948088}) 2024-08-18T21:10:42.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=17,config=2,health=12,kv=10,logm=59} crc {auth=3594882646,config=1618278320,health=3762268701,kv=3664197221,logm=2084888461}) 2024-08-18T21:10:42.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=11,kv=10,logm=61} crc {auth=2531039743,config=1618278320,health=3495677664,kv=3664197221,logm=519948088}) 2024-08-18T21:10:42.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=17,config=2,health=10,kv=10,logm=61} crc {auth=218171711,config=1618278320,health=3331678060,kv=3664197221,logm=4091795048}) 2024-08-18T21:10:42.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=11,kv=10,logm=61} crc {auth=2531039743,config=1618278320,health=3495677664,kv=3664197221,logm=519948088}) 2024-08-18T21:10:42.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.149+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=17,config=2,health=12,kv=10,logm=59} crc {auth=3594882646,config=1618278320,health=3762268701,kv=3664197221,logm=25145553}) 2024-08-18T21:10:42.166 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-18T21:10:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068143500}) 2024-08-18T21:10:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3611871166}) 2024-08-18T21:10:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068143500}) 2024-08-18T21:10:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3537793418}) 2024-08-18T21:10:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068143500}) 2024-08-18T21:10:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1147501342}) 2024-08-18T21:10:42.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.291 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068143500}) 2024-08-18T21:10:42.291 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3162179219}) 2024-08-18T21:10:42.291 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.291 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068143500}) 2024-08-18T21:10:42.291 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1825416826}) 2024-08-18T21:10:42.291 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.291 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068143500}) 2024-08-18T21:10:42.291 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2916255095}) 2024-08-18T21:10:42.291 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.291 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068143500}) 2024-08-18T21:10:42.291 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4204224508}) 2024-08-18T21:10:42.291 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.291 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068143500}) 2024-08-18T21:10:42.292 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3457440178}) 2024-08-18T21:10:42.307 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.309 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2583020987}) 2024-08-18T21:10:42.309 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2422723423}) 2024-08-18T21:10:42.309 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.309 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2583020987}) 2024-08-18T21:10:42.310 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3837036124}) 2024-08-18T21:10:42.310 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.310 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2583020987}) 2024-08-18T21:10:42.310 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=232858286}) 2024-08-18T21:10:42.310 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.310 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2583020987}) 2024-08-18T21:10:42.310 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1606691853}) 2024-08-18T21:10:42.310 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.310 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2583020987}) 2024-08-18T21:10:42.310 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3296392109}) 2024-08-18T21:10:42.310 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.310 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2583020987}) 2024-08-18T21:10:42.310 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=154703172}) 2024-08-18T21:10:42.311 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.311 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2583020987}) 2024-08-18T21:10:42.311 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1074858855}) 2024-08-18T21:10:42.311 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.311 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2583020987}) 2024-08-18T21:10:42.311 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.305+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2172665688}) 2024-08-18T21:10:42.348 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.348 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4124223098}) 2024-08-18T21:10:42.348 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2752409263}) 2024-08-18T21:10:42.348 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.348 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4124223098}) 2024-08-18T21:10:42.348 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3588064206}) 2024-08-18T21:10:42.348 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.348 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4124223098}) 2024-08-18T21:10:42.348 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3470864169}) 2024-08-18T21:10:42.349 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.349 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4124223098}) 2024-08-18T21:10:42.349 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3162953528}) 2024-08-18T21:10:42.349 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.349 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4124223098}) 2024-08-18T21:10:42.349 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1248824800}) 2024-08-18T21:10:42.349 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.349 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4124223098}) 2024-08-18T21:10:42.349 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=77351536}) 2024-08-18T21:10:42.349 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.349 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4124223098}) 2024-08-18T21:10:42.349 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4204972166}) 2024-08-18T21:10:42.349 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.349 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4124223098}) 2024-08-18T21:10:42.350 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.345+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=708852785}) 2024-08-18T21:10:42.491 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30844]: starting. 2024-08-18T21:10:42.491 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30844]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30843 2024-08-18T21:10:42.491 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30844]: created object 0... 2024-08-18T21:10:42.491 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30844]: created object 25... 2024-08-18T21:10:42.491 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30844]: created object 49... 2024-08-18T21:10:42.491 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30844]: finishing. 2024-08-18T21:10:42.491 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30844]: shutting down. 2024-08-18T21:10:42.908 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.908 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2128786649}) 2024-08-18T21:10:42.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3311419546}) 2024-08-18T21:10:42.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2128786649}) 2024-08-18T21:10:42.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3221096595}) 2024-08-18T21:10:42.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2128786649}) 2024-08-18T21:10:42.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2060621545}) 2024-08-18T21:10:42.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2128786649}) 2024-08-18T21:10:42.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=924574570}) 2024-08-18T21:10:42.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2128786649}) 2024-08-18T21:10:42.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=505106808}) 2024-08-18T21:10:42.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2128786649}) 2024-08-18T21:10:42.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3051345426}) 2024-08-18T21:10:42.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2128786649}) 2024-08-18T21:10:42.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3335208776}) 2024-08-18T21:10:42.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:42.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2128786649}) 2024-08-18T21:10:42.910 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:42.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=95640511}) 2024-08-18T21:10:43.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163229399}) 2024-08-18T21:10:43.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3098996639}) 2024-08-18T21:10:43.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163229399}) 2024-08-18T21:10:43.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1668479383}) 2024-08-18T21:10:43.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163229399}) 2024-08-18T21:10:43.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2337549329}) 2024-08-18T21:10:43.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163229399}) 2024-08-18T21:10:43.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1323254642}) 2024-08-18T21:10:43.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163229399}) 2024-08-18T21:10:43.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2190643021}) 2024-08-18T21:10:43.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163229399}) 2024-08-18T21:10:43.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=104913946}) 2024-08-18T21:10:43.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163229399}) 2024-08-18T21:10:43.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3298804515}) 2024-08-18T21:10:43.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163229399}) 2024-08-18T21:10:43.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.113+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3742494573}) 2024-08-18T21:10:43.167 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:10:43.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:10:43.278 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.278 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3904731287}) 2024-08-18T21:10:43.278 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1445528741}) 2024-08-18T21:10:43.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3904731287}) 2024-08-18T21:10:43.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2918215784}) 2024-08-18T21:10:43.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3904731287}) 2024-08-18T21:10:43.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1467192219}) 2024-08-18T21:10:43.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3904731287}) 2024-08-18T21:10:43.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2480325063}) 2024-08-18T21:10:43.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3904731287}) 2024-08-18T21:10:43.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1187489382}) 2024-08-18T21:10:43.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3904731287}) 2024-08-18T21:10:43.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2685664269}) 2024-08-18T21:10:43.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3904731287}) 2024-08-18T21:10:43.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1518036136}) 2024-08-18T21:10:43.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3904731287}) 2024-08-18T21:10:43.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.273+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2533083171}) 2024-08-18T21:10:43.281 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.281 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1903994604}) 2024-08-18T21:10:43.281 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2713753127}) 2024-08-18T21:10:43.281 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1903994604}) 2024-08-18T21:10:43.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2758345827}) 2024-08-18T21:10:43.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1903994604}) 2024-08-18T21:10:43.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1738607247}) 2024-08-18T21:10:43.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1903994604}) 2024-08-18T21:10:43.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3229247154}) 2024-08-18T21:10:43.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1903994604}) 2024-08-18T21:10:43.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3483218480}) 2024-08-18T21:10:43.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1903994604}) 2024-08-18T21:10:43.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1908354838}) 2024-08-18T21:10:43.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1903994604}) 2024-08-18T21:10:43.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=512558612}) 2024-08-18T21:10:43.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1903994604}) 2024-08-18T21:10:43.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.277+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1304268394}) 2024-08-18T21:10:43.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3544622033}) 2024-08-18T21:10:43.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2371253229}) 2024-08-18T21:10:43.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3544622033}) 2024-08-18T21:10:43.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4068873538}) 2024-08-18T21:10:43.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3544622033}) 2024-08-18T21:10:43.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2600094772}) 2024-08-18T21:10:43.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3544622033}) 2024-08-18T21:10:43.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=564876661}) 2024-08-18T21:10:43.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3544622033}) 2024-08-18T21:10:43.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4292764868}) 2024-08-18T21:10:43.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3544622033}) 2024-08-18T21:10:43.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2285358025}) 2024-08-18T21:10:43.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3544622033}) 2024-08-18T21:10:43.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=617003913}) 2024-08-18T21:10:43.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3544622033}) 2024-08-18T21:10:43.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.281+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=179731180}) 2024-08-18T21:10:43.288 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.288 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002079017}) 2024-08-18T21:10:43.288 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3123555499}) 2024-08-18T21:10:43.289 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.289 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002079017}) 2024-08-18T21:10:43.289 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=494855236}) 2024-08-18T21:10:43.289 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.289 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002079017}) 2024-08-18T21:10:43.289 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2657192091}) 2024-08-18T21:10:43.289 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.289 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002079017}) 2024-08-18T21:10:43.289 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1310375999}) 2024-08-18T21:10:43.289 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.289 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002079017}) 2024-08-18T21:10:43.289 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1764709152}) 2024-08-18T21:10:43.289 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002079017}) 2024-08-18T21:10:43.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2753599834}) 2024-08-18T21:10:43.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002079017}) 2024-08-18T21:10:43.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=646506060}) 2024-08-18T21:10:43.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002079017}) 2024-08-18T21:10:43.290 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.285+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=616985981}) 2024-08-18T21:10:43.292 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1985586469}) 2024-08-18T21:10:43.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3723962653}) 2024-08-18T21:10:43.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1985586469}) 2024-08-18T21:10:43.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3808428435}) 2024-08-18T21:10:43.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1985586469}) 2024-08-18T21:10:43.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=532220505}) 2024-08-18T21:10:43.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1985586469}) 2024-08-18T21:10:43.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3057371484}) 2024-08-18T21:10:43.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1985586469}) 2024-08-18T21:10:43.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4052961321}) 2024-08-18T21:10:43.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1985586469}) 2024-08-18T21:10:43.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1188150459}) 2024-08-18T21:10:43.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.295 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1985586469}) 2024-08-18T21:10:43.295 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2624449888}) 2024-08-18T21:10:43.295 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.295 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1985586469}) 2024-08-18T21:10:43.295 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.289+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3187402723}) 2024-08-18T21:10:43.298 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.298 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612167439}) 2024-08-18T21:10:43.298 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1255849358}) 2024-08-18T21:10:43.298 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.298 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612167439}) 2024-08-18T21:10:43.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1006085782}) 2024-08-18T21:10:43.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612167439}) 2024-08-18T21:10:43.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4162589000}) 2024-08-18T21:10:43.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612167439}) 2024-08-18T21:10:43.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=112977276}) 2024-08-18T21:10:43.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612167439}) 2024-08-18T21:10:43.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4157915191}) 2024-08-18T21:10:43.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612167439}) 2024-08-18T21:10:43.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2955928347}) 2024-08-18T21:10:43.299 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612167439}) 2024-08-18T21:10:43.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=351121023}) 2024-08-18T21:10:43.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612167439}) 2024-08-18T21:10:43.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.293+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2327012575}) 2024-08-18T21:10:43.303 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.303 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4079532777}) 2024-08-18T21:10:43.303 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=628538059}) 2024-08-18T21:10:43.303 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.303 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4079532777}) 2024-08-18T21:10:43.303 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2402366875}) 2024-08-18T21:10:43.303 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.303 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4079532777}) 2024-08-18T21:10:43.303 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2589553236}) 2024-08-18T21:10:43.303 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.303 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4079532777}) 2024-08-18T21:10:43.304 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1085475998}) 2024-08-18T21:10:43.304 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.304 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4079532777}) 2024-08-18T21:10:43.304 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2443139962}) 2024-08-18T21:10:43.304 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.304 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4079532777}) 2024-08-18T21:10:43.304 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=19341149}) 2024-08-18T21:10:43.304 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.304 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4079532777}) 2024-08-18T21:10:43.304 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1448456590}) 2024-08-18T21:10:43.304 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.304 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4079532777}) 2024-08-18T21:10:43.305 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.297+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1318101020}) 2024-08-18T21:10:43.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 10 monclient: get_monmap_and_config 2024-08-18T21:10:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 10 monclient: build_initial_monmap 2024-08-18T21:10:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 10 monclient: monmap: 2024-08-18T21:10:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:43.306183+0000 2024-08-18T21:10:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:43.306183+0000 2024-08-18T21:10:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:43.309 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 1 Processor -- start 2024-08-18T21:10:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 1 -- start start 2024-08-18T21:10:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 10 monclient: init 2024-08-18T21:10:43.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:43.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 10 monclient: _add_conns ranks=[9,1,7,6,8,10,3,4,0,5,2] 2024-08-18T21:10:43.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdbd006c950 0x7fdbd006cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 10 monclient(hunting): picked mon.noname-a con 0x7fdbd006c950 addr v2:172.21.15.5:3300/0 2024-08-18T21:10:43.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fdbd006d270 addr v1:172.21.15.157:6789/0 2024-08-18T21:10:43.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbd013e5b0 0x7fdbd0146170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 10 monclient(hunting): picked mon.noname-i con 0x7fdbd013e5b0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:43.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbd009f780 con 0x7fdbd006d270 2024-08-18T21:10:43.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdbd00a5220 con 0x7fdbd006c950 2024-08-18T21:10:43.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fdbd009e320 con 0x7fdbd013e5b0 2024-08-18T21:10:43.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:43.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbd5d0d640 10 monclient(hunting): authenticate will time out at 1410.319096s 2024-08-18T21:10:43.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdbd006c950 0x7fdbd006cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdbd006c950 0x7fdbd006cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57198/0 (socket says 172.21.15.5:57198) 2024-08-18T21:10:43.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbceffd640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fdbd006d270 0x7fdbd013dea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:49196/0 (socket says 172.21.15.5:49196) 2024-08-18T21:10:43.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcf7fe640 1 -- 172.21.15.5:0/3455820252 learned_addr learned my addr 172.21.15.5:0/3455820252 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:43.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcf7fe640 10 monclient(hunting): get_auth_request con 0x7fdbd006c950 auth_method 0 2024-08-18T21:10:43.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcf7fe640 1 -- 172.21.15.5:0/3455820252 >> v2:172.21.15.5:3300/0 conn(0x7fdbd006c950 msgr2=0x7fdbd006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:43.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcf7fe640 1 -- 172.21.15.5:0/3455820252 >> v2:172.21.15.5:3300/0 conn(0x7fdbd006c950 msgr2=0x7fdbd006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:43.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcf7fe640 1 --2- 172.21.15.5:0/3455820252 >> v2:172.21.15.5:3300/0 conn(0x7fdbd006c950 0x7fdbd006cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:43.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcf7fe640 1 --2- 172.21.15.5:0/3455820252 >> v2:172.21.15.5:3300/0 conn(0x7fdbd006c950 0x7fdbd006cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:43.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcffff640 1 --2- 172.21.15.5:0/3455820252 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbd013e5b0 0x7fdbd0146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcffff640 10 monclient(hunting): get_auth_request con 0x7fdbd013e5b0 auth_method 0 2024-08-18T21:10:43.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.301+0000 7fdbcffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.305+0000 7fdbcffff640 10 monclient(hunting): handle_auth_done global_id 6163 payload 274 2024-08-18T21:10:43.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.305+0000 7fdbcffff640 1 -- 172.21.15.5:0/3455820252 >> v2:172.21.15.5:3300/0 conn(0x7fdbd006c950 msgr2=0x7fdbd006cd30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:43.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.305+0000 7fdbcffff640 1 --2- 172.21.15.5:0/3455820252 >> v2:172.21.15.5:3300/0 conn(0x7fdbd006c950 0x7fdbd006cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.305+0000 7fdbcffff640 1 -- 172.21.15.5:0/3455820252 >> v1:172.21.15.157:6789/0 conn(0x7fdbd006d270 legacy=0x7fdbd013dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:43.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.305+0000 7fdbcffff640 10 monclient: _finish_hunting 0 2024-08-18T21:10:43.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.305+0000 7fdbcffff640 1 monclient: found mon.noname-i 2024-08-18T21:10:43.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.305+0000 7fdbcffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:43.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.305+0000 7fdbcffff640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:10:43.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.305+0000 7fdbcffff640 1 -- 172.21.15.5:0/3455820252 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd009e600 con 0x7fdbd013e5b0 2024-08-18T21:10:43.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbcffff640 1 -- 172.21.15.5:0/3455820252 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbd013e5b0 msgr2=0x7fdbd0146170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:43.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbcffff640 1 --2- 172.21.15.5:0/3455820252 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbd013e5b0 0x7fdbd0146170 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009d90 tx=0x7fdbc801c800 comp rx=0 tx=0).ready entity=mon.7 client_cookie=72ba0801dbe11481 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:43.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbce7fc640 1 -- 172.21.15.5:0/3455820252 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbc80b2070 con 0x7fdbd013e5b0 2024-08-18T21:10:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbce7fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:10:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbce7fc640 10 monclient: dump: 2024-08-18T21:10:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:43.319 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:43.319 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:43.319 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:43.319 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:43.319 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:43.319 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:43.319 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:43.319 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbce7fc640 10 monclient: _finish_auth 0 2024-08-18T21:10:43.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbce7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:10:43.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:43.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbce7fc640 1 -- 172.21.15.5:0/3455820252 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc80a5a90 con 0x7fdbd013e5b0 2024-08-18T21:10:43.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbce7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:43.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbce7fc640 1 -- 172.21.15.5:0/3455820252 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbc80a5cc0 con 0x7fdbd013e5b0 2024-08-18T21:10:43.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:43.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbce7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:10:43.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbce7fc640 10 monclient: dump: 2024-08-18T21:10:43.320 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:43.320 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.320 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.320 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.320 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:43.320 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.321 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:43.321 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:43.321 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:43.321 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:43.321 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:43.321 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:43.321 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:43.321 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:43.321 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:43.321 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbd5d0d640 5 monclient: authenticate success, global_id 6163 2024-08-18T21:10:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbd5d0d640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbd5d0d640 4 set_mon_vals no callback set 2024-08-18T21:10:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbd5d0d640 10 monclient: shutdown 2024-08-18T21:10:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbd5d0d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbd5d0d640 1 -- 172.21.15.5:0/3455820252 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbd013e5b0 msgr2=0x7fdbd0146170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbd5d0d640 1 --2- 172.21.15.5:0/3455820252 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbd013e5b0 0x7fdbd0146170 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009d90 tx=0x7fdbc801c800 comp rx=0 tx=0).stop 2024-08-18T21:10:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbd5d0d640 1 -- 172.21.15.5:0/3455820252 shutdown_connections 2024-08-18T21:10:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbd5d0d640 1 --2- 172.21.15.5:0/3455820252 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbd013e5b0 0x7fdbd0146170 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbd5d0d640 1 --2- 172.21.15.5:0/3455820252 >> v2:172.21.15.5:3300/0 conn(0x7fdbd006c950 0x7fdbd006cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbd5d0d640 1 -- 172.21.15.5:0/3455820252 >> 172.21.15.5:0/3455820252 conn(0x7fdbd00688d0 msgr2=0x7fdbd0068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbd5d0d640 1 -- 172.21.15.5:0/3455820252 shutdown_connections 2024-08-18T21:10:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.309+0000 7fdbd5d0d640 1 -- 172.21.15.5:0/3455820252 wait complete. 2024-08-18T21:10:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 10 monclient: build_initial_monmap 2024-08-18T21:10:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 10 monclient: monmap: 2024-08-18T21:10:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:43.324 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 1 Processor -- start 2024-08-18T21:10:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 1 -- start start 2024-08-18T21:10:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 10 monclient: init 2024-08-18T21:10:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 10 monclient: _add_conns ranks=[3,1,6,4,0,5,7,8,2] 2024-08-18T21:10:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbd006c950 0x7fdbd013ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 10 monclient(hunting): picked mon.noname-g con 0x7fdbd006c950 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbd006d270 0x7fdbd013f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 10 monclient(hunting): picked mon.noname-f con 0x7fdbd006d270 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:10:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbd013e5b0 0x7fdbd013f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 10 monclient(hunting): picked mon.noname-d con 0x7fdbd013e5b0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd00a4f30 con 0x7fdbd006d270 2024-08-18T21:10:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdbd00a4db0 con 0x7fdbd006c950 2024-08-18T21:10:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fdbd009da30 con 0x7fdbd013e5b0 2024-08-18T21:10:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbd5d0d640 10 monclient(hunting): authenticate will time out at 1410.329685s 2024-08-18T21:10:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbd013e5b0 0x7fdbd013f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbd013e5b0 0x7fdbd013f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54846/0 (socket says 172.21.15.5:54846) 2024-08-18T21:10:43.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 1 -- 172.21.15.5:0/3845341886 learned_addr learned my addr 172.21.15.5:0/3845341886 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:43.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 10 monclient(hunting): get_auth_request con 0x7fdbd013e5b0 auth_method 0 2024-08-18T21:10:43.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbceffd640 1 --2- 172.21.15.5:0/3845341886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbd006d270 0x7fdbd013f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbceffd640 10 monclient(hunting): get_auth_request con 0x7fdbd006d270 auth_method 0 2024-08-18T21:10:43.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbceffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbceffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcf7fe640 1 --2- 172.21.15.5:0/3845341886 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbd006c950 0x7fdbd013ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcf7fe640 10 monclient(hunting): get_auth_request con 0x7fdbd006c950 auth_method 0 2024-08-18T21:10:43.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 10 monclient(hunting): handle_auth_done global_id 85038 payload 824 2024-08-18T21:10:43.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 1 -- 172.21.15.5:0/3845341886 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbd006c950 msgr2=0x7fdbd013ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 1 --2- 172.21.15.5:0/3845341886 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbd006c950 0x7fdbd013ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 1 -- 172.21.15.5:0/3845341886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbd006d270 msgr2=0x7fdbd013f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 1 --2- 172.21.15.5:0/3845341886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbd006d270 0x7fdbd013f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 10 monclient: _finish_hunting 0 2024-08-18T21:10:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 1 monclient: found mon.noname-d 2024-08-18T21:10:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:10:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.313+0000 7fdbcffff640 1 -- 172.21.15.5:0/3845341886 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd01427b0 con 0x7fdbd013e5b0 2024-08-18T21:10:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbcffff640 1 -- 172.21.15.5:0/3845341886 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbd013e5b0 msgr2=0x7fdbd013f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbcffff640 1 --2- 172.21.15.5:0/3845341886 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbd013e5b0 0x7fdbd013f9a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdbc801c630 tx=0x7fdbc80195a0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbb7fff640 1 -- 172.21.15.5:0/3845341886 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbc80b2050 con 0x7fdbd013e5b0 2024-08-18T21:10:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbb7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbb7fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:10:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbb7fff640 10 monclient: dump: 2024-08-18T21:10:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:43.332 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbb7fff640 10 monclient: _finish_auth 0 2024-08-18T21:10:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbb7fff640 10 monclient: _check_auth_tickets 2024-08-18T21:10:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbb7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbb7fff640 1 -- 172.21.15.5:0/3845341886 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc80be070 con 0x7fdbd013e5b0 2024-08-18T21:10:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbb7fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbb7fff640 1 -- 172.21.15.5:0/3845341886 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbc8003dc0 con 0x7fdbd013e5b0 2024-08-18T21:10:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbd5d0d640 5 monclient: authenticate success, global_id 85038 2024-08-18T21:10:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbd5d0d640 10 monclient: _renew_subs 2024-08-18T21:10:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbd5d0d640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbd5d0d640 1 -- 172.21.15.5:0/3845341886 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd01424d0 con 0x7fdbd013e5b0 2024-08-18T21:10:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbb7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbcdffb640 4 set_mon_vals no callback set 2024-08-18T21:10:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbb7fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbb7fff640 10 monclient: dump: 2024-08-18T21:10:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:43.334 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:43.334 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:43.334 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:43.334 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:43.334 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:43.334 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:43.334 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbd5d0d640 10 monclient: _renew_subs 2024-08-18T21:10:43.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbd5d0d640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:43.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbd5d0d640 1 -- 172.21.15.5:0/3845341886 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd0141210 con 0x7fdbd013e5b0 2024-08-18T21:10:43.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbd5d0d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:43.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbd5d0d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:43.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbd5d0d640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:43.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbd5d0d640 1 -- 172.21.15.5:0/3845341886 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbd00a8340 con 0x7fdbd013e5b0 2024-08-18T21:10:43.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbb7fff640 1 -- 172.21.15.5:0/3845341886 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fdbc8004040 con 0x7fdbd013e5b0 2024-08-18T21:10:43.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbb7fff640 1 --2- 172.21.15.5:0/3845341886 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbbc03bdc0 0x7fdbbc03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbb7fff640 1 -- 172.21.15.5:0/3845341886 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(210..210 src has 22..210) ==== 3898+0+0 (secure 0 0 0) 0x7fdbc80e9840 con 0x7fdbd013e5b0 2024-08-18T21:10:43.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbcf7fe640 1 --2- 172.21.15.5:0/3845341886 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbbc03bdc0 0x7fdbbc03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.317+0000 7fdbcf7fe640 10 monclient: get_auth_request con 0x7fdbbc03bdc0 auth_method 0 2024-08-18T21:10:43.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.321+0000 7fdbcf7fe640 1 --2- 172.21.15.5:0/3845341886 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbbc03bdc0 0x7fdbbc03e280 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009100 tx=0x7fdbc0008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:43.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.321+0000 7fdbb7fff640 1 -- 172.21.15.5:0/3845341886 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fdbc8016540 con 0x7fdbd013e5b0 2024-08-18T21:10:43.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.321+0000 7fdbb7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:43.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.321+0000 7fdbb7fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:43.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3410977393}) 2024-08-18T21:10:43.336 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3524875813}) 2024-08-18T21:10:43.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3410977393}) 2024-08-18T21:10:43.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4080520123}) 2024-08-18T21:10:43.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3410977393}) 2024-08-18T21:10:43.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=219764685}) 2024-08-18T21:10:43.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3410977393}) 2024-08-18T21:10:43.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=311628898}) 2024-08-18T21:10:43.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3410977393}) 2024-08-18T21:10:43.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2075030805}) 2024-08-18T21:10:43.337 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.338 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3410977393}) 2024-08-18T21:10:43.338 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1271709911}) 2024-08-18T21:10:43.338 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.338 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3410977393}) 2024-08-18T21:10:43.338 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=981466016}) 2024-08-18T21:10:43.338 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.338 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3410977393}) 2024-08-18T21:10:43.338 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.329+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2229769769}) 2024-08-18T21:10:43.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.333+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.333+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3332893642}) 2024-08-18T21:10:43.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.333+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3089813778}) 2024-08-18T21:10:43.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.333+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3332893642}) 2024-08-18T21:10:43.339 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2578198778}) 2024-08-18T21:10:43.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3332893642}) 2024-08-18T21:10:43.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=94184976}) 2024-08-18T21:10:43.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3332893642}) 2024-08-18T21:10:43.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3032746088}) 2024-08-18T21:10:43.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3332893642}) 2024-08-18T21:10:43.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=865782517}) 2024-08-18T21:10:43.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3332893642}) 2024-08-18T21:10:43.340 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=86233202}) 2024-08-18T21:10:43.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3332893642}) 2024-08-18T21:10:43.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1780343106}) 2024-08-18T21:10:43.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3332893642}) 2024-08-18T21:10:43.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.337+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2827823413}) 2024-08-18T21:10:43.362 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30845]: starting. 2024-08-18T21:10:43.362 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30845]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30843 2024-08-18T21:10:43.362 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30845]: shutting down. 2024-08-18T21:10:43.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1709204822}) 2024-08-18T21:10:43.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=375637078}) 2024-08-18T21:10:43.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1709204822}) 2024-08-18T21:10:43.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1459754336}) 2024-08-18T21:10:43.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1709204822}) 2024-08-18T21:10:43.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=637752378}) 2024-08-18T21:10:43.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.361+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.361+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1709204822}) 2024-08-18T21:10:43.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.361+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3472579776}) 2024-08-18T21:10:43.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.361+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.361+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1709204822}) 2024-08-18T21:10:43.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.361+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2282706820}) 2024-08-18T21:10:43.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.361+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.361+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1709204822}) 2024-08-18T21:10:43.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.361+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1648586300}) 2024-08-18T21:10:43.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.361+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.365 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.361+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1709204822}) 2024-08-18T21:10:43.365 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.361+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2180085870}) 2024-08-18T21:10:43.365 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.361+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.365 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.361+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1709204822}) 2024-08-18T21:10:43.365 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.361+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3082910174}) 2024-08-18T21:10:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.577+0000 7fdbd5d0d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:10:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.577+0000 7fdbd5d0d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:10:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.577+0000 7fdbd5d0d640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.577+0000 7fdbd5d0d640 1 -- 172.21.15.5:0/3845341886 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdbd006cd30 con 0x7fdbd013e5b0 2024-08-18T21:10:43.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.577+0000 7fdbb7fff640 1 -- 172.21.15.5:0/3845341886 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7fdbc80b7400 con 0x7fdbd013e5b0 2024-08-18T21:10:43.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.577+0000 7fdbb7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:10:43.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.577+0000 7fdbb7fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:43.582 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":152,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:10:43.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.581+0000 7fdbd5d0d640 1 -- 172.21.15.5:0/3845341886 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbbc03bdc0 msgr2=0x7fdbbc03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.581+0000 7fdbd5d0d640 1 --2- 172.21.15.5:0/3845341886 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbbc03bdc0 0x7fdbbc03e280 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009100 tx=0x7fdbc0008040 comp rx=0 tx=0).stop 2024-08-18T21:10:43.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.581+0000 7fdbd5d0d640 10 monclient: shutdown 2024-08-18T21:10:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.581+0000 7fdbd5d0d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.581+0000 7fdbd5d0d640 1 -- 172.21.15.5:0/3845341886 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbd013e5b0 msgr2=0x7fdbd013f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.581+0000 7fdbd5d0d640 1 --2- 172.21.15.5:0/3845341886 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbd013e5b0 0x7fdbd013f9a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdbc801c630 tx=0x7fdbc80195a0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.581+0000 7fdbd5d0d640 1 -- 172.21.15.5:0/3845341886 shutdown_connections 2024-08-18T21:10:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.581+0000 7fdbd5d0d640 1 --2- 172.21.15.5:0/3845341886 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbbc03bdc0 0x7fdbbc03e280 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.581+0000 7fdbd5d0d640 1 --2- 172.21.15.5:0/3845341886 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdbd013e5b0 0x7fdbd013f9a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.581+0000 7fdbd5d0d640 1 --2- 172.21.15.5:0/3845341886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbd006d270 0x7fdbd013f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.581+0000 7fdbd5d0d640 1 --2- 172.21.15.5:0/3845341886 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbd006c950 0x7fdbd013ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.581+0000 7fdbd5d0d640 1 -- 172.21.15.5:0/3845341886 >> 172.21.15.5:0/3845341886 conn(0x7fdbd00688d0 msgr2=0x7fdbd00a1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.581+0000 7fdbd5d0d640 1 -- 172.21.15.5:0/3845341886 shutdown_connections 2024-08-18T21:10:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.581+0000 7fdbd5d0d640 1 -- 172.21.15.5:0/3845341886 wait complete. 2024-08-18T21:10:43.602 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:10:43.602 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-18T21:10:43.602 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:10:43.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:10:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 10 monclient: get_monmap_and_config 2024-08-18T21:10:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 10 monclient: build_initial_monmap 2024-08-18T21:10:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 10 monclient: monmap: 2024-08-18T21:10:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:43.724645+0000 2024-08-18T21:10:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:43.724645+0000 2024-08-18T21:10:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:43.724 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 1 Processor -- start 2024-08-18T21:10:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 1 -- start start 2024-08-18T21:10:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 10 monclient: init 2024-08-18T21:10:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 10 monclient: _add_conns ranks=[5,7,3,2,4,1,9,0,8,10,6] 2024-08-18T21:10:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbcc40a5a50 0x7fbcc4137800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 10 monclient(hunting): picked mon.noname-h con 0x7fbcc40a5a50 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbcc4137d40 0x7fbcc4138120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 10 monclient(hunting): picked mon.noname-i con 0x7fbcc4137d40 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcc40a1540 0x7fbcc40a1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 10 monclient(hunting): picked mon.noname-g con 0x7fbcc40a1540 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc40a5e30 con 0x7fbcc40a1540 2024-08-18T21:10:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fbcc40a3740 con 0x7fbcc40a5a50 2024-08-18T21:10:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fbcc40a67a0 con 0x7fbcc4137d40 2024-08-18T21:10:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc8c40640 10 monclient(hunting): authenticate will time out at 1410.737931s 2024-08-18T21:10:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbcc4137d40 0x7fbcc4138120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc259c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbcc40a5a50 0x7fbcc4137800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbcc4137d40 0x7fbcc4138120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:33004/0 (socket says 172.21.15.5:33004) 2024-08-18T21:10:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc2d9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcc40a1540 0x7fbcc40a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 1 -- 172.21.15.5:0/2370532994 learned_addr learned my addr 172.21.15.5:0/2370532994 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 10 monclient(hunting): get_auth_request con 0x7fbcc4137d40 auth_method 0 2024-08-18T21:10:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc259c640 10 monclient(hunting): get_auth_request con 0x7fbcc40a5a50 auth_method 0 2024-08-18T21:10:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc2d9d640 10 monclient(hunting): get_auth_request con 0x7fbcc40a1540 auth_method 0 2024-08-18T21:10:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc2d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 10 monclient(hunting): handle_auth_done global_id 6217 payload 274 2024-08-18T21:10:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 1 -- 172.21.15.5:0/2370532994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbcc40a5a50 msgr2=0x7fbcc4137800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 1 --2- 172.21.15.5:0/2370532994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbcc40a5a50 0x7fbcc4137800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 1 -- 172.21.15.5:0/2370532994 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcc40a1540 msgr2=0x7fbcc40a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 1 --2- 172.21.15.5:0/2370532994 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcc40a1540 0x7fbcc40a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:10:43.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 1 monclient: found mon.noname-i 2024-08-18T21:10:43.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:43.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:10:43.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.721+0000 7fbcc1d9b640 1 -- 172.21.15.5:0/2370532994 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc40a2660 con 0x7fbcc4137d40 2024-08-18T21:10:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc1d9b640 1 -- 172.21.15.5:0/2370532994 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbcc4137d40 msgr2=0x7fbcc4138120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc1d9b640 1 --2- 172.21.15.5:0/2370532994 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbcc4137d40 0x7fbcc4138120 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0098d0 tx=0x7fbcac01c440 comp rx=0 tx=0).ready entity=mon.7 client_cookie=e9e0e8b132199833 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc159a640 1 -- 172.21.15.5:0/2370532994 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbcac0b0070 con 0x7fbcc4137d40 2024-08-18T21:10:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc159a640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:10:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc159a640 10 monclient: dump: 2024-08-18T21:10:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:43.736 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc159a640 10 monclient: _finish_auth 0 2024-08-18T21:10:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc159a640 10 monclient: _check_auth_tickets 2024-08-18T21:10:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc159a640 1 -- 172.21.15.5:0/2370532994 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcac0aa810 con 0x7fbcc4137d40 2024-08-18T21:10:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc159a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc159a640 1 -- 172.21.15.5:0/2370532994 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbcac0aaa00 con 0x7fbcc4137d40 2024-08-18T21:10:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc159a640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:10:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc159a640 10 monclient: dump: 2024-08-18T21:10:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:43.737 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:43.738 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc8c40640 5 monclient: authenticate success, global_id 6217 2024-08-18T21:10:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc8c40640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.725+0000 7fbcc8c40640 4 set_mon_vals no callback set 2024-08-18T21:10:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 10 monclient: shutdown 2024-08-18T21:10:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 -- 172.21.15.5:0/2370532994 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbcc4137d40 msgr2=0x7fbcc4138120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 --2- 172.21.15.5:0/2370532994 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbcc4137d40 0x7fbcc4138120 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0098d0 tx=0x7fbcac01c440 comp rx=0 tx=0).stop 2024-08-18T21:10:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 -- 172.21.15.5:0/2370532994 shutdown_connections 2024-08-18T21:10:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 --2- 172.21.15.5:0/2370532994 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcc40a1540 0x7fbcc40a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 --2- 172.21.15.5:0/2370532994 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbcc4137d40 0x7fbcc4138120 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 --2- 172.21.15.5:0/2370532994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbcc40a5a50 0x7fbcc4137800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 -- 172.21.15.5:0/2370532994 >> 172.21.15.5:0/2370532994 conn(0x7fbcc40688d0 msgr2=0x7fbcc4068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 -- 172.21.15.5:0/2370532994 shutdown_connections 2024-08-18T21:10:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 -- 172.21.15.5:0/2370532994 wait complete. 2024-08-18T21:10:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 10 monclient: build_initial_monmap 2024-08-18T21:10:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 10 monclient: monmap: 2024-08-18T21:10:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:43.740 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:43.740 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:43.740 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:43.740 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:43.740 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:43.740 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:43.740 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:43.740 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 Processor -- start 2024-08-18T21:10:43.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 -- start start 2024-08-18T21:10:43.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 10 monclient: init 2024-08-18T21:10:43.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:43.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 10 monclient: _add_conns ranks=[6,3,1,7,0,2,8,5,4] 2024-08-18T21:10:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbcc40a1540 0x7fbcc41cf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 10 monclient(hunting): picked mon.noname-d con 0x7fbcc40a1540 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcc40a5a50 0x7fbcc41368c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 10 monclient(hunting): picked mon.noname-g con 0x7fbcc40a5a50 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcc4137d40 0x7fbcc413bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 10 monclient(hunting): picked mon.noname-f con 0x7fbcc4137d40 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:10:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc40a23f0 con 0x7fbcc4137d40 2024-08-18T21:10:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc40a2270 con 0x7fbcc40a5a50 2024-08-18T21:10:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fbcc4141480 con 0x7fbcc40a1540 2024-08-18T21:10:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc8c40640 10 monclient(hunting): authenticate will time out at 1410.746901s 2024-08-18T21:10:43.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbcc40a1540 0x7fbcc41cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbcc40a1540 0x7fbcc41cf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:54850/0 (socket says 172.21.15.5:54850) 2024-08-18T21:10:43.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 1 -- 172.21.15.5:0/453494636 learned_addr learned my addr 172.21.15.5:0/453494636 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:43.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 10 monclient(hunting): get_auth_request con 0x7fbcc40a1540 auth_method 0 2024-08-18T21:10:43.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc1d9b640 1 --2- 172.21.15.5:0/453494636 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcc40a5a50 0x7fbcc41368c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc2d9d640 1 --2- 172.21.15.5:0/453494636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcc4137d40 0x7fbcc413bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc2d9d640 10 monclient(hunting): get_auth_request con 0x7fbcc4137d40 auth_method 0 2024-08-18T21:10:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc2d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc1d9b640 10 monclient(hunting): get_auth_request con 0x7fbcc40a5a50 auth_method 0 2024-08-18T21:10:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc1d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 10 monclient(hunting): handle_auth_done global_id 85047 payload 824 2024-08-18T21:10:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 1 -- 172.21.15.5:0/453494636 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcc40a5a50 msgr2=0x7fbcc41368c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 1 --2- 172.21.15.5:0/453494636 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcc40a5a50 0x7fbcc41368c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 1 -- 172.21.15.5:0/453494636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcc4137d40 msgr2=0x7fbcc413bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 1 --2- 172.21.15.5:0/453494636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcc4137d40 0x7fbcc413bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 10 monclient: _finish_hunting 0 2024-08-18T21:10:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 1 monclient: found mon.noname-d 2024-08-18T21:10:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:10:43.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.729+0000 7fbcc259c640 1 -- 172.21.15.5:0/453494636 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc4073320 con 0x7fbcc40a1540 2024-08-18T21:10:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc259c640 1 -- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbcc40a1540 msgr2=0x7fbcc41cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc259c640 1 --2- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbcc40a1540 0x7fbcc41cf510 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400efc0 tx=0x7fbcb400c490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcbaffd640 1 -- 172.21.15.5:0/453494636 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbcb4018020 con 0x7fbcc40a1540 2024-08-18T21:10:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcbaffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:10:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcbaffd640 10 monclient: dump: 2024-08-18T21:10:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:43.750 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcbaffd640 10 monclient: _finish_auth 0 2024-08-18T21:10:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcbaffd640 10 monclient: _check_auth_tickets 2024-08-18T21:10:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcbaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcbaffd640 1 -- 172.21.15.5:0/453494636 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb40148f0 con 0x7fbcc40a1540 2024-08-18T21:10:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcbaffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcbaffd640 1 -- 172.21.15.5:0/453494636 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbcb40133e0 con 0x7fbcc40a1540 2024-08-18T21:10:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcbaffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcbaffd640 10 monclient: dump: 2024-08-18T21:10:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:43.752 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc0d99640 4 set_mon_vals no callback set 2024-08-18T21:10:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc8c40640 5 monclient: authenticate success, global_id 85047 2024-08-18T21:10:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc8c40640 10 monclient: _renew_subs 2024-08-18T21:10:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc8c40640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc8c40640 1 -- 172.21.15.5:0/453494636 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc4122260 con 0x7fbcc40a1540 2024-08-18T21:10:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc8c40640 10 monclient: _renew_subs 2024-08-18T21:10:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc8c40640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc8c40640 1 -- 172.21.15.5:0/453494636 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc413d5e0 con 0x7fbcc40a1540 2024-08-18T21:10:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc8c40640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc8c40640 1 --2- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc4136e00 0x7fbcc413c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc8c40640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc8c40640 1 -- 172.21.15.5:0/453494636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc4051140 con 0x7fbcc4136e00 2024-08-18T21:10:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc1d9b640 1 --2- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc4136e00 0x7fbcc413c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc1d9b640 10 monclient: get_auth_request con 0x7fbcc4136e00 auth_method 0 2024-08-18T21:10:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc1d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcbaffd640 1 -- 172.21.15.5:0/453494636 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fbcb401b020 con 0x7fbcc40a1540 2024-08-18T21:10:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcbaffd640 1 --2- 172.21.15.5:0/453494636 >> v2:172.21.15.157:6812/631023601 conn(0x7fbca403bdc0 0x7fbca403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc1d9b640 10 monclient(hunting): handle_auth_done global_id 84744 payload 824 2024-08-18T21:10:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcbaffd640 1 -- 172.21.15.5:0/453494636 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(211..211 src has 22..211) ==== 3506+0+0 (secure 0 0 0) 0x7fbcb404ed40 con 0x7fbcc40a1540 2024-08-18T21:10:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.733+0000 7fbcc1d9b640 1 -- 172.21.15.5:0/453494636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbcc413dda0 con 0x7fbcc4136e00 2024-08-18T21:10:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.737+0000 7fbcc2d9d640 1 --2- 172.21.15.5:0/453494636 >> v2:172.21.15.157:6812/631023601 conn(0x7fbca403bdc0 0x7fbca403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.737+0000 7fbcc2d9d640 10 monclient: get_auth_request con 0x7fbca403bdc0 auth_method 0 2024-08-18T21:10:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.737+0000 7fbcc1d9b640 1 -- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc4136e00 msgr2=0x7fbcc413c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.737+0000 7fbcc1d9b640 1 --2- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc4136e00 0x7fbcc413c070 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0ad000 tx=0x7fbcac0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.737+0000 7fbcbaffd640 1 -- 172.21.15.5:0/453494636 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbcac0ba070 con 0x7fbcc4136e00 2024-08-18T21:10:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.737+0000 7fbcbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.737+0000 7fbcbaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.737+0000 7fbcbaffd640 10 monclient: dump: 2024-08-18T21:10:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:43.755 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.737+0000 7fbcbaffd640 1 -- 172.21.15.5:0/453494636 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbcac003830 con 0x7fbcc4136e00 2024-08-18T21:10:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.737+0000 7fbcbaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.737+0000 7fbcbaffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.737+0000 7fbcbaffd640 1 -- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc4136e00 msgr2=0x7fbcc413c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.737+0000 7fbcbaffd640 1 --2- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc4136e00 0x7fbcc413c070 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0ad000 tx=0x7fbcac0191e0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.737+0000 7fbcbaffd640 1 -- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc4136e00 msgr2=0x7fbcc413c070 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.737+0000 7fbcbaffd640 1 --2- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc4136e00 0x7fbcc413c070 secure :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0ad000 tx=0x7fbcac0191e0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.737+0000 7fbcc2d9d640 1 --2- 172.21.15.5:0/453494636 >> v2:172.21.15.157:6812/631023601 conn(0x7fbca403bdc0 0x7fbca403e280 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009ac0 tx=0x7fbcbc009190 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.745+0000 7fbcc8c40640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.745+0000 7fbcc8c40640 1 --2- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc413c5b0 0x7fbcc4071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.745+0000 7fbcc8c40640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.745+0000 7fbcc8c40640 1 -- 172.21.15.5:0/453494636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc4068f60 con 0x7fbcc413c5b0 2024-08-18T21:10:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.745+0000 7fbcc1d9b640 1 --2- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc413c5b0 0x7fbcc4071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.745+0000 7fbcc1d9b640 10 monclient: get_auth_request con 0x7fbcc413c5b0 auth_method 0 2024-08-18T21:10:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.745+0000 7fbcc1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.745+0000 7fbcc1d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.745+0000 7fbcc1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.745+0000 7fbcc1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.745+0000 7fbcc1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.745+0000 7fbcc1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.745+0000 7fbcc1d9b640 10 monclient(hunting): handle_auth_done global_id 84753 payload 824 2024-08-18T21:10:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.745+0000 7fbcc1d9b640 1 -- 172.21.15.5:0/453494636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbcc413c9c0 con 0x7fbcc413c5b0 2024-08-18T21:10:43.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.745+0000 7fbcc1d9b640 1 -- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc413c5b0 msgr2=0x7fbcc4071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:43.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.745+0000 7fbcc1d9b640 1 --2- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc413c5b0 0x7fbcc4071c00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbcac01c270 tx=0x7fbcac0a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:43.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcbaffd640 1 -- 172.21.15.5:0/453494636 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbcac0b0040 con 0x7fbcc413c5b0 2024-08-18T21:10:43.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:43.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcbaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcbaffd640 10 monclient: dump: 2024-08-18T21:10:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:43.760 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:43.760 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:43.760 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcbaffd640 1 -- 172.21.15.5:0/453494636 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9250 (secure 0 0 0) 0x7fbcac0bfc90 con 0x7fbcc413c5b0 2024-08-18T21:10:43.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcbaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:43.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcbaffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:43.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcbaffd640 1 -- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc413c5b0 msgr2=0x7fbcc4071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcbaffd640 1 --2- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc413c5b0 0x7fbcc4071c00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbcac01c270 tx=0x7fbcac0a8000 comp rx=0 tx=0).stop 2024-08-18T21:10:43.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcbaffd640 1 -- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc413c5b0 msgr2=0x7fbcc4071c00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:43.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcbaffd640 1 --2- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc413c5b0 0x7fbcc4071c00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.761 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:10:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 140582, 2024-08-18T21:10:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:10:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.771 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.771 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.771 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:43.771 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.771 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.771 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:43.771 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.771 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.771 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.771 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:43.772 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:43.772 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.772 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.772 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.772 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:43.772 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:43.772 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.772 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.772 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.772 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:43.773 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.773 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.773 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.773 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:43.773 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.773 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.773 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.773 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:43.773 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:43.773 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.773 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.773 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.774 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.774 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:43.774 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:43.774 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.774 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.774 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.774 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.774 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:43.774 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.774 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.774 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.775 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:43.775 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.775 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.775 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.775 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:43.775 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:43.775 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.775 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.775 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.775 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:43.776 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:43.776 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.776 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.776 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.776 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:43.776 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.776 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.776 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:43.776 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.776 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.776 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.777 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:43.777 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:43.777 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.777 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.777 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.777 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:43.777 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:43.777 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.777 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.778 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.778 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:43.778 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.778 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.778 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:43.778 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.778 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.778 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.778 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:43.778 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:43.779 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.779 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.779 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.779 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:43.779 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:43.779 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.779 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.779 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.779 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:43.779 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.780 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.780 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:43.780 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.780 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.780 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.780 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:43.780 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:43.780 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.780 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.780 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.781 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:43.781 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:43.781 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.781 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.781 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.781 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:43.781 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.781 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.781 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:43.782 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.782 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.782 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.782 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:43.782 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:43.782 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.782 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.782 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.782 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.782 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.782 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:43.783 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:43.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.783 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:43.783 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:43.783 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:43.783 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.783 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:43.783 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:43.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.783 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:43.783 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:43.783 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:43.783 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.783 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.784 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:43.784 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcc8c40640 1 -- 172.21.15.5:0/453494636 >> v2:172.21.15.157:6812/631023601 conn(0x7fbca403bdc0 msgr2=0x7fbca403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcc8c40640 1 --2- 172.21.15.5:0/453494636 >> v2:172.21.15.157:6812/631023601 conn(0x7fbca403bdc0 0x7fbca403e280 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009ac0 tx=0x7fbcbc009190 comp rx=0 tx=0).stop 2024-08-18T21:10:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcc8c40640 10 monclient: shutdown 2024-08-18T21:10:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcc8c40640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcc8c40640 1 -- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbcc40a1540 msgr2=0x7fbcc41cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcc8c40640 1 --2- 172.21.15.5:0/453494636 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbcc40a1540 0x7fbcc41cf510 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400efc0 tx=0x7fbcb400c490 comp rx=0 tx=0).stop 2024-08-18T21:10:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcc2d9d640 1 -- 172.21.15.5:0/453494636 reap_dead start 2024-08-18T21:10:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcc2d9d640 1 -- 172.21.15.5:0/453494636 reap_dead start 2024-08-18T21:10:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcc8c40640 1 -- 172.21.15.5:0/453494636 shutdown_connections 2024-08-18T21:10:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcc8c40640 1 -- 172.21.15.5:0/453494636 >> 172.21.15.5:0/453494636 conn(0x7fbcc40688d0 msgr2=0x7fbcc40a8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcc8c40640 1 -- 172.21.15.5:0/453494636 shutdown_connections 2024-08-18T21:10:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.749+0000 7fbcc8c40640 1 -- 172.21.15.5:0/453494636 wait complete. 2024-08-18T21:10:43.786 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:43.786 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:10:43.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:10:43.908 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.908 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910659226}) 2024-08-18T21:10:43.908 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2395969579}) 2024-08-18T21:10:43.908 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.908 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910659226}) 2024-08-18T21:10:43.908 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3570449213}) 2024-08-18T21:10:43.908 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910659226}) 2024-08-18T21:10:43.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=301568459}) 2024-08-18T21:10:43.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f8863817640 10 monclient: get_monmap_and_config 2024-08-18T21:10:43.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f8863817640 10 monclient: build_initial_monmap 2024-08-18T21:10:43.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910659226}) 2024-08-18T21:10:43.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f8863817640 10 monclient: monmap: 2024-08-18T21:10:43.910 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:43.910 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.910 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:43.909924+0000 2024-08-18T21:10:43.910 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:43.909924+0000 2024-08-18T21:10:43.910 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:43.910 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.910 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:43.910 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:43.910 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:43.910 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:43.911 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:43.911 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:43.911 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:43.911 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:43.911 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:43.911 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:43.911 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:43.911 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=393906532}) 2024-08-18T21:10:43.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910659226}) 2024-08-18T21:10:43.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2974599671}) 2024-08-18T21:10:43.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910659226}) 2024-08-18T21:10:43.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4008389717}) 2024-08-18T21:10:43.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910659226}) 2024-08-18T21:10:43.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2558292900}) 2024-08-18T21:10:43.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910659226}) 2024-08-18T21:10:43.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3143559194}) 2024-08-18T21:10:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f8863817640 1 Processor -- start 2024-08-18T21:10:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f8863817640 1 -- start start 2024-08-18T21:10:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f8863817640 10 monclient: init 2024-08-18T21:10:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f8863817640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f8863817640 10 monclient: _add_conns ranks=[9,0,7,2,3,10,1,4,8,5,6] 2024-08-18T21:10:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f8863817640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f885c0a6de0 0x7f885c0a71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.905+0000 7f8863817640 10 monclient(hunting): picked mon.noname-a con 0x7f885c0a6de0 addr v2:172.21.15.5:3300/0 2024-08-18T21:10:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8863817640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f885c09eb30 addr v1:172.21.15.5:6789/0 2024-08-18T21:10:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8863817640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f885c0a7700 0x7f885c13a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8863817640 10 monclient(hunting): picked mon.noname-i con 0x7f885c0a7700 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8863817640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f885c06f790 con 0x7f885c09eb30 2024-08-18T21:10:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8863817640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8863817640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f885c09e430 con 0x7f885c0a6de0 2024-08-18T21:10:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8863817640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8863817640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f885c09de70 con 0x7f885c0a7700 2024-08-18T21:10:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8863817640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8863817640 10 monclient(hunting): authenticate will time out at 1410.924079s 2024-08-18T21:10:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f88615b3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f885c0a6de0 0x7f885c0a71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f88615b3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f885c0a6de0 0x7f885c0a71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57212/0 (socket says 172.21.15.5:57212) 2024-08-18T21:10:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f88615b3640 1 -- 172.21.15.5:0/3115879477 learned_addr learned my addr 172.21.15.5:0/3115879477 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f88615b3640 10 monclient(hunting): get_auth_request con 0x7f885c0a6de0 auth_method 0 2024-08-18T21:10:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f88615b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f88615b3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f88615b3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8860db2640 1 --1- 172.21.15.5:0/3115879477 >> v1:172.21.15.5:6789/0 conn(0x7f885c09eb30 0x7f885c139ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32866/0 (socket says 172.21.15.5:32866) 2024-08-18T21:10:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 1 --2- 172.21.15.5:0/3115879477 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f885c0a7700 0x7f885c13a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 10 monclient(hunting): get_auth_request con 0x7f885c0a7700 auth_method 0 2024-08-18T21:10:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 10 monclient(hunting): handle_auth_done global_id 6226 payload 274 2024-08-18T21:10:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 1 -- 172.21.15.5:0/3115879477 >> v2:172.21.15.5:3300/0 conn(0x7f885c0a6de0 msgr2=0x7f885c0a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 1 --2- 172.21.15.5:0/3115879477 >> v2:172.21.15.5:3300/0 conn(0x7f885c0a6de0 0x7f885c0a71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 1 -- 172.21.15.5:0/3115879477 >> v1:172.21.15.5:6789/0 conn(0x7f885c09eb30 legacy=0x7f885c139ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 10 monclient: _finish_hunting 0 2024-08-18T21:10:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 1 monclient: found mon.noname-i 2024-08-18T21:10:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:10:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.909+0000 7f8861db4640 1 -- 172.21.15.5:0/3115879477 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c09e150 con 0x7f885c0a7700 2024-08-18T21:10:43.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8861db4640 1 -- 172.21.15.5:0/3115879477 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f885c0a7700 msgr2=0x7f885c13a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:43.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8861db4640 1 --2- 172.21.15.5:0/3115879477 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f885c0a7700 0x7f885c13a2b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8854009d90 tx=0x7f885401c830 comp rx=0 tx=0).ready entity=mon.7 client_cookie=a2aabdfde49657d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8853fff640 1 -- 172.21.15.5:0/3115879477 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f88540b2070 con 0x7f885c0a7700 2024-08-18T21:10:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8853fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8853fff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:10:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8853fff640 10 monclient: dump: 2024-08-18T21:10:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:43.925 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8853fff640 10 monclient: _finish_auth 0 2024-08-18T21:10:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8853fff640 10 monclient: _check_auth_tickets 2024-08-18T21:10:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8853fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8853fff640 1 -- 172.21.15.5:0/3115879477 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88540a5ac0 con 0x7f885c0a7700 2024-08-18T21:10:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8853fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8853fff640 1 -- 172.21.15.5:0/3115879477 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f88540a5c70 con 0x7f885c0a7700 2024-08-18T21:10:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8863817640 5 monclient: authenticate success, global_id 6226 2024-08-18T21:10:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8863817640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8863817640 4 set_mon_vals no callback set 2024-08-18T21:10:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8853fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8853fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:10:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8853fff640 10 monclient: dump: 2024-08-18T21:10:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:43.927 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8863817640 10 monclient: shutdown 2024-08-18T21:10:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8863817640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8863817640 1 -- 172.21.15.5:0/3115879477 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f885c0a7700 msgr2=0x7f885c13a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8863817640 1 --2- 172.21.15.5:0/3115879477 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f885c0a7700 0x7f885c13a2b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8854009d90 tx=0x7f885401c830 comp rx=0 tx=0).stop 2024-08-18T21:10:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8863817640 1 -- 172.21.15.5:0/3115879477 shutdown_connections 2024-08-18T21:10:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8863817640 1 --2- 172.21.15.5:0/3115879477 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f885c0a7700 0x7f885c13a2b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8863817640 1 --2- 172.21.15.5:0/3115879477 >> v2:172.21.15.5:3300/0 conn(0x7f885c0a6de0 0x7f885c0a71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8863817640 1 -- 172.21.15.5:0/3115879477 >> 172.21.15.5:0/3115879477 conn(0x7f885c0ace00 msgr2=0x7f885c0a8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8863817640 1 -- 172.21.15.5:0/3115879477 shutdown_connections 2024-08-18T21:10:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8863817640 1 -- 172.21.15.5:0/3115879477 wait complete. 2024-08-18T21:10:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8863817640 10 monclient: build_initial_monmap 2024-08-18T21:10:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8863817640 10 monclient: monmap: 2024-08-18T21:10:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:43.929 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.913+0000 7f8863817640 1 Processor -- start 2024-08-18T21:10:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 1 -- start start 2024-08-18T21:10:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 10 monclient: init 2024-08-18T21:10:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 10 monclient: _add_conns ranks=[2,0,8,7,3,4,6,5,1] 2024-08-18T21:10:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c09eb30 0x7f885c139400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 10 monclient(hunting): picked mon.noname-b con 0x7f885c09eb30 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c0a6de0 0x7f885c139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 10 monclient(hunting): picked mon.noname-a con 0x7f885c0a6de0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:10:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f885c0a7700 0x7f885c13f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 10 monclient(hunting): picked mon.noname-e con 0x7f885c0a7700 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f885c13a7f0 con 0x7f885c0a6de0 2024-08-18T21:10:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f885c0a8680 con 0x7f885c09eb30 2024-08-18T21:10:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f885c13a970 con 0x7f885c0a7700 2024-08-18T21:10:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 10 monclient(hunting): authenticate will time out at 1410.932559s 2024-08-18T21:10:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c0a6de0 0x7f885c139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f88615b3640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c09eb30 0x7f885c139400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c0a6de0 0x7f885c139940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57220/0 (socket says 172.21.15.5:57220) 2024-08-18T21:10:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f88615b3640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c09eb30 0x7f885c139400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:43890/0 (socket says 172.21.15.5:43890) 2024-08-18T21:10:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 1 -- 172.21.15.5:0/1825875143 learned_addr learned my addr 172.21.15.5:0/1825875143 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8861db4640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f885c0a7700 0x7f885c13f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 10 monclient(hunting): get_auth_request con 0x7f885c0a6de0 auth_method 0 2024-08-18T21:10:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f88615b3640 10 monclient(hunting): get_auth_request con 0x7f885c09eb30 auth_method 0 2024-08-18T21:10:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f88615b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f88615b3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f88615b3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8861db4640 10 monclient(hunting): get_auth_request con 0x7f885c0a7700 auth_method 0 2024-08-18T21:10:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8861db4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8861db4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8861db4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f88615b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f88615b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f88615b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8861db4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8861db4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8861db4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 10 monclient(hunting): handle_auth_done global_id 84771 payload 824 2024-08-18T21:10:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 1 -- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f885c0a7700 msgr2=0x7f885c13f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 1 --2- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f885c0a7700 0x7f885c13f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 1 -- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c09eb30 msgr2=0x7f885c139400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 1 --2- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c09eb30 0x7f885c139400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 10 monclient: _finish_hunting 0 2024-08-18T21:10:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 1 monclient: found mon.noname-a 2024-08-18T21:10:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:10:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 1 -- 172.21.15.5:0/1825875143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c123110 con 0x7f885c0a6de0 2024-08-18T21:10:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f88615b3640 1 --2- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c09eb30 0x7f885c139400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8861db4640 1 --2- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f885c0a7700 0x7f885c13f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 1 -- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c0a6de0 msgr2=0x7f885c139940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8860db2640 1 --2- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c0a6de0 0x7f885c139940 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c460 tx=0x7f884c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8851ffb640 1 -- 172.21.15.5:0/1825875143 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f884c017070 con 0x7f885c0a6de0 2024-08-18T21:10:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8851ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8851ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:10:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8851ffb640 10 monclient: dump: 2024-08-18T21:10:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:43.935 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8851ffb640 10 monclient: _finish_auth 0 2024-08-18T21:10:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8851ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:10:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8851ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 5 monclient: authenticate success, global_id 84771 2024-08-18T21:10:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 10 monclient: _renew_subs 2024-08-18T21:10:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8851ffb640 1 -- 172.21.15.5:0/1825875143 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f884c005c90 con 0x7f885c0a6de0 2024-08-18T21:10:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:10:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 1 -- 172.21.15.5:0/1825875143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885c0a3120 con 0x7f885c0a6de0 2024-08-18T21:10:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8851ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8851ffb640 1 -- 172.21.15.5:0/1825875143 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f884c005e40 con 0x7f885c0a6de0 2024-08-18T21:10:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8851ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8851ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8851ffb640 10 monclient: dump: 2024-08-18T21:10:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:43.937 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 10 monclient: _renew_subs 2024-08-18T21:10:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:10:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f88537fe640 4 set_mon_vals no callback set 2024-08-18T21:10:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.917+0000 7f8863817640 1 -- 172.21.15.5:0/1825875143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885c140fd0 con 0x7f885c0a6de0 2024-08-18T21:10:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8863817640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8863817640 1 --2- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c123be0 0x7f885c1402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8863817640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8863817640 1 -- 172.21.15.5:0/1825875143 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f885c051140 con 0x7f885c123be0 2024-08-18T21:10:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f88615b3640 1 --2- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c123be0 0x7f885c1402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f88615b3640 10 monclient: get_auth_request con 0x7f885c123be0 auth_method 0 2024-08-18T21:10:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f88615b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f88615b3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f88615b3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f88615b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f88615b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f88615b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8851ffb640 1 -- 172.21.15.5:0/1825875143 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f884c007490 con 0x7f885c0a6de0 2024-08-18T21:10:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f88615b3640 10 monclient(hunting): handle_auth_done global_id 84836 payload 824 2024-08-18T21:10:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f88615b3640 1 -- 172.21.15.5:0/1825875143 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f885c0a71c0 con 0x7f885c123be0 2024-08-18T21:10:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8851ffb640 1 --2- 172.21.15.5:0/1825875143 >> v2:172.21.15.157:6812/631023601 conn(0x7f884003be20 0x7f884003e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8851ffb640 1 -- 172.21.15.5:0/1825875143 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(211..211 src has 22..211) ==== 3506+0+0 (secure 0 0 0) 0x7f884c04d820 con 0x7f885c0a6de0 2024-08-18T21:10:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8861db4640 1 --2- 172.21.15.5:0/1825875143 >> v2:172.21.15.157:6812/631023601 conn(0x7f884003be20 0x7f884003e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8861db4640 10 monclient: get_auth_request con 0x7f884003be20 auth_method 0 2024-08-18T21:10:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f88615b3640 1 -- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c123be0 msgr2=0x7f885c1402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f88615b3640 1 --2- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c123be0 0x7f885c1402b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8858011970 tx=0x7f8858011e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8851ffb640 1 -- 172.21.15.5:0/1825875143 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8858019070 con 0x7f885c123be0 2024-08-18T21:10:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8851ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8851ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8851ffb640 10 monclient: dump: 2024-08-18T21:10:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:43.942 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8851ffb640 1 -- 172.21.15.5:0/1825875143 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f885800fe50 con 0x7f885c123be0 2024-08-18T21:10:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8851ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8851ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8851ffb640 1 -- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c123be0 msgr2=0x7f885c1402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8851ffb640 1 --2- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c123be0 0x7f885c1402b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8858011970 tx=0x7f8858011e30 comp rx=0 tx=0).stop 2024-08-18T21:10:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8851ffb640 1 -- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c123be0 msgr2=0x7f885c1402b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.921+0000 7f8851ffb640 1 --2- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c123be0 0x7f885c1402b0 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8858011970 tx=0x7f8858011e30 comp rx=0 tx=0).stop 2024-08-18T21:10:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f8861db4640 1 --2- 172.21.15.5:0/1825875143 >> v2:172.21.15.157:6812/631023601 conn(0x7f884003be20 0x7f884003e2e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f88540ac000 tx=0x7f88540a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:43.944 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.944 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735697093}) 2024-08-18T21:10:43.944 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=258527961}) 2024-08-18T21:10:43.944 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.944 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735697093}) 2024-08-18T21:10:43.944 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2314322892}) 2024-08-18T21:10:43.944 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.944 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735697093}) 2024-08-18T21:10:43.944 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1172525384}) 2024-08-18T21:10:43.945 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.945 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735697093}) 2024-08-18T21:10:43.945 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=862190483}) 2024-08-18T21:10:43.945 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.945 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735697093}) 2024-08-18T21:10:43.945 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=604982143}) 2024-08-18T21:10:43.945 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.945 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735697093}) 2024-08-18T21:10:43.945 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=345050125}) 2024-08-18T21:10:43.945 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.945 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735697093}) 2024-08-18T21:10:43.945 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3910383835}) 2024-08-18T21:10:43.945 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:43.946 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735697093}) 2024-08-18T21:10:43.946 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:43.925+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3856124900}) 2024-08-18T21:10:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.929+0000 7f8863817640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.929+0000 7f8863817640 1 --2- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c02d1d0 0x7f885c02d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.929+0000 7f8863817640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.929+0000 7f8863817640 1 -- 172.21.15.5:0/1825875143 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f885c13c2c0 con 0x7f885c02d1d0 2024-08-18T21:10:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.929+0000 7f88615b3640 1 --2- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c02d1d0 0x7f885c02d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.929+0000 7f88615b3640 10 monclient: get_auth_request con 0x7f885c02d1d0 auth_method 0 2024-08-18T21:10:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.929+0000 7f88615b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.929+0000 7f88615b3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.929+0000 7f88615b3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.929+0000 7f88615b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.929+0000 7f88615b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.929+0000 7f88615b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.929+0000 7f88615b3640 10 monclient(hunting): handle_auth_done global_id 84845 payload 824 2024-08-18T21:10:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.929+0000 7f88615b3640 1 -- 172.21.15.5:0/1825875143 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f885c141b30 con 0x7f885c02d1d0 2024-08-18T21:10:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f88615b3640 1 -- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c02d1d0 msgr2=0x7f885c02d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f88615b3640 1 --2- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c02d1d0 0x7f885c02d5e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8858012010 tx=0x7f8858004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8851ffb640 1 -- 172.21.15.5:0/1825875143 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f885800f040 con 0x7f885c02d1d0 2024-08-18T21:10:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8851ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8851ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8851ffb640 10 monclient: dump: 2024-08-18T21:10:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:43.950 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8851ffb640 1 -- 172.21.15.5:0/1825875143 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7f88580143e0 con 0x7f885c02d1d0 2024-08-18T21:10:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8851ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8851ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8851ffb640 1 -- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c02d1d0 msgr2=0x7f885c02d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8851ffb640 1 --2- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c02d1d0 0x7f885c02d5e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8858012010 tx=0x7f8858004740 comp rx=0 tx=0).stop 2024-08-18T21:10:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8851ffb640 1 -- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c02d1d0 msgr2=0x7f885c02d5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8851ffb640 1 --2- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f885c02d1d0 0x7f885c02d5e0 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8858012010 tx=0x7f8858004740 comp rx=0 tx=0).stop 2024-08-18T21:10:43.951 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:43.951 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:43.951 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:43.951 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:43.951 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:43.952 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 140762, 2024-08-18T21:10:43.952 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:43.952 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:43.952 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:43.952 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:43.952 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:43.952 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:43.952 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:43.952 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:43.953 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:43.953 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:43.953 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:43.953 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:10:43.953 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:43.953 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:43.953 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:43.953 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:43.953 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:43.953 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:43.953 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:43.953 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:43.953 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:43.953 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:43.954 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:43.954 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:43.954 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:43.954 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:43.954 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:43.954 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:43.954 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:43.954 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:43.954 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:43.954 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:43.954 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:43.954 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:43.954 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:43.954 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:43.955 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:43.955 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:43.955 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:43.955 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:43.955 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.955 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:43.955 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:43.955 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:43.955 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:43.955 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:43.955 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:43.955 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:43.956 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:43.956 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:43.956 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:43.956 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:43.956 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:43.956 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:43.956 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:43.956 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:43.956 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:43.956 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:43.956 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:43.956 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:43.956 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:43.956 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:43.958 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.958 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.958 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.958 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:43.958 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.958 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.958 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:43.958 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.958 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.958 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.959 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:43.959 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:43.959 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.959 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.959 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.959 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.959 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:43.959 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:43.960 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.960 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.960 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.960 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:43.960 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.960 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.960 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.961 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:43.961 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.961 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.961 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.961 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:43.961 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:43.961 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.961 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.961 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.961 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.961 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:43.962 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:43.962 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.962 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.962 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.962 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.962 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:43.962 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.962 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.962 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.962 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.962 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:43.962 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.962 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.962 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.963 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:43.963 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:43.963 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.963 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.963 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.963 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.963 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:43.963 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:43.963 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.963 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.963 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.963 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.964 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:43.964 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.964 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.964 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.964 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:43.964 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.964 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.964 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.964 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:43.964 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:43.964 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.964 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.965 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.965 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.965 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:43.965 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:43.965 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.965 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.965 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.965 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.965 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:43.965 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.965 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.965 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.966 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:43.966 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.966 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.966 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.966 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:43.966 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:43.966 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.966 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.966 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.966 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.966 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:43.966 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:43.967 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.967 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.967 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.967 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.967 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:43.967 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.967 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.967 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.967 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:43.967 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.967 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.967 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.968 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:43.968 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:43.968 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.968 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.968 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.968 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.968 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.968 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:43.968 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:43.968 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.968 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.968 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.968 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.968 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:43.969 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.969 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.969 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.969 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.969 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:43.969 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.969 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.969 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.969 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.969 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:43.969 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:43.969 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.969 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.969 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.970 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.970 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:43.970 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:43.970 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.970 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.970 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.970 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.970 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:43.970 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.970 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.970 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.971 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:43.971 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.971 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.971 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.971 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:43.971 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:43.971 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.972 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.972 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.972 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.972 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.972 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:43.972 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:43.972 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:43.972 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:43.972 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.972 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:43.972 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:43.972 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.972 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.973 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.973 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:43.973 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:43.973 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:43.973 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.973 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.973 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.973 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:43.973 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:43.973 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:43.973 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:43.973 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:43.973 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.973 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.974 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.974 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:43.974 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:43.974 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.974 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:43.974 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:43.974 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:43.974 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.974 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:43.974 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:43.974 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:43.974 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:43.974 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:43.975 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:43.975 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:43.975 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:43.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:43.975 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:43.975 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8863817640 1 -- 172.21.15.5:0/1825875143 >> v2:172.21.15.157:6812/631023601 conn(0x7f884003be20 msgr2=0x7f884003e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8863817640 1 --2- 172.21.15.5:0/1825875143 >> v2:172.21.15.157:6812/631023601 conn(0x7f884003be20 0x7f884003e2e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f88540ac000 tx=0x7f88540a7070 comp rx=0 tx=0).stop 2024-08-18T21:10:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8863817640 10 monclient: shutdown 2024-08-18T21:10:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8863817640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8863817640 1 -- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c0a6de0 msgr2=0x7f885c139940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8863817640 1 --2- 172.21.15.5:0/1825875143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c0a6de0 0x7f885c139940 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c460 tx=0x7f884c00c920 comp rx=0 tx=0).stop 2024-08-18T21:10:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8861db4640 1 -- 172.21.15.5:0/1825875143 reap_dead start 2024-08-18T21:10:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8861db4640 1 -- 172.21.15.5:0/1825875143 reap_dead start 2024-08-18T21:10:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8863817640 1 -- 172.21.15.5:0/1825875143 shutdown_connections 2024-08-18T21:10:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8863817640 1 -- 172.21.15.5:0/1825875143 >> 172.21.15.5:0/1825875143 conn(0x7f885c0ace00 msgr2=0x7f885c0a52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8863817640 1 -- 172.21.15.5:0/1825875143 shutdown_connections 2024-08-18T21:10:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:43.933+0000 7f8863817640 1 -- 172.21.15.5:0/1825875143 wait complete. 2024-08-18T21:10:43.978 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:43.978 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:10:43.978 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:10:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 10 monclient: get_monmap_and_config 2024-08-18T21:10:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 10 monclient: build_initial_monmap 2024-08-18T21:10:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 10 monclient: monmap: 2024-08-18T21:10:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:44.097800+0000 2024-08-18T21:10:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:44.097800+0000 2024-08-18T21:10:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:44.097 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 1 Processor -- start 2024-08-18T21:10:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 1 -- start start 2024-08-18T21:10:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 10 monclient: init 2024-08-18T21:10:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 10 monclient: _add_conns ranks=[1,2,9,7,8,0,4,5,3,10,6] 2024-08-18T21:10:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f693c0a6bd0 addr v1:172.21.15.157:6789/0 2024-08-18T21:10:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f693c09f080 0x7f693c13ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 10 monclient(hunting): picked mon.noname-b con 0x7f693c09f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f693c0a76c0 0x7f693c141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 10 monclient(hunting): picked mon.noname-a con 0x7f693c0a76c0 addr v2:172.21.15.5:3300/0 2024-08-18T21:10:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f693c0a7fb0 con 0x7f693c0a6bd0 2024-08-18T21:10:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f693c09e4c0 con 0x7f693c0a76c0 2024-08-18T21:10:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f693c06f930 con 0x7f693c09f080 2024-08-18T21:10:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f6942b13640 10 monclient(hunting): authenticate will time out at 1411.110959s 2024-08-18T21:10:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f693c0a76c0 0x7f693c141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f693bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f693c09f080 0x7f693c13ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f693c0a76c0 0x7f693c141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48020/0 (socket says 172.21.15.5:48020) 2024-08-18T21:10:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f693bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f693c09f080 0x7f693c13ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:45000/0 (socket says 172.21.15.5:45000) 2024-08-18T21:10:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 1 -- 172.21.15.5:0/2139578757 learned_addr learned my addr 172.21.15.5:0/2139578757 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 10 monclient(hunting): get_auth_request con 0x7f693c0a76c0 auth_method 0 2024-08-18T21:10:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f693bfff640 10 monclient(hunting): get_auth_request con 0x7f693c09f080 auth_method 0 2024-08-18T21:10:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f693bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f693bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f693bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f693bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f693bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f693bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 10 monclient(hunting): handle_auth_done global_id 84780 payload 274 2024-08-18T21:10:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 1 -- 172.21.15.5:0/2139578757 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f693c09f080 msgr2=0x7f693c13ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 1 --2- 172.21.15.5:0/2139578757 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f693c09f080 0x7f693c13ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 1 -- 172.21.15.5:0/2139578757 >> v1:172.21.15.157:6789/0 conn(0x7f693c0a6bd0 legacy=0x7f693c0a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 10 monclient: _finish_hunting 0 2024-08-18T21:10:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 1 monclient: found mon.noname-a 2024-08-18T21:10:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:10:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.093+0000 7f69410b0640 1 -- 172.21.15.5:0/2139578757 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693c09de70 con 0x7f693c0a76c0 2024-08-18T21:10:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.097+0000 7f69410b0640 1 -- 172.21.15.5:0/2139578757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f693c0a76c0 msgr2=0x7f693c141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.097+0000 7f69410b0640 1 --2- 172.21.15.5:0/2139578757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f693c0a76c0 0x7f693c141330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6934009e50 tx=0x7f693401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39404311eee6573a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693b7fe640 1 -- 172.21.15.5:0/2139578757 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f69340090d0 con 0x7f693c0a76c0 2024-08-18T21:10:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:10:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693b7fe640 10 monclient: dump: 2024-08-18T21:10:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.108 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693b7fe640 10 monclient: _finish_auth 0 2024-08-18T21:10:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693b7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:10:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693b7fe640 1 -- 172.21.15.5:0/2139578757 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69340a5a30 con 0x7f693c0a76c0 2024-08-18T21:10:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693b7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693b7fe640 1 -- 172.21.15.5:0/2139578757 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f69340a5be0 con 0x7f693c0a76c0 2024-08-18T21:10:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 5 monclient: authenticate success, global_id 84780 2024-08-18T21:10:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 4 set_mon_vals no callback set 2024-08-18T21:10:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693b7fe640 10 monclient: dump: 2024-08-18T21:10:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.109 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.110 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 10 monclient: shutdown 2024-08-18T21:10:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 1 -- 172.21.15.5:0/2139578757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f693c0a76c0 msgr2=0x7f693c141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 1 --2- 172.21.15.5:0/2139578757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f693c0a76c0 0x7f693c141330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6934009e50 tx=0x7f693401c8f0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 1 -- 172.21.15.5:0/2139578757 shutdown_connections 2024-08-18T21:10:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 1 --2- 172.21.15.5:0/2139578757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f693c0a76c0 0x7f693c141330 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 1 --2- 172.21.15.5:0/2139578757 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f693c09f080 0x7f693c13ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 1 -- 172.21.15.5:0/2139578757 >> 172.21.15.5:0/2139578757 conn(0x7f693c068700 msgr2=0x7f693c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 1 -- 172.21.15.5:0/2139578757 shutdown_connections 2024-08-18T21:10:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 1 -- 172.21.15.5:0/2139578757 wait complete. 2024-08-18T21:10:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 10 monclient: build_initial_monmap 2024-08-18T21:10:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 10 monclient: monmap: 2024-08-18T21:10:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:44.112 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 1 Processor -- start 2024-08-18T21:10:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 1 -- start start 2024-08-18T21:10:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 10 monclient: init 2024-08-18T21:10:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 10 monclient: _add_conns ranks=[5,2,7,4,8,3,0,1,6] 2024-08-18T21:10:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f693c09f080 0x7f693c128e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 10 monclient(hunting): picked mon.noname-h con 0x7f693c09f080 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f693c0a6bd0 0x7f693c1d1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 10 monclient(hunting): picked mon.noname-b con 0x7f693c0a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f693c0a76c0 0x7f693c126890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 10 monclient(hunting): picked mon.noname-i con 0x7f693c0a76c0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f693c144210 con 0x7f693c0a6bd0 2024-08-18T21:10:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f693c144090 con 0x7f693c09f080 2024-08-18T21:10:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f693c144390 con 0x7f693c0a76c0 2024-08-18T21:10:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f6942b13640 10 monclient(hunting): authenticate will time out at 1411.118422s 2024-08-18T21:10:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f693c0a6bd0 0x7f693c1d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f693c0a6bd0 0x7f693c1d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:45006/0 (socket says 172.21.15.5:45006) 2024-08-18T21:10:44.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 1 -- 172.21.15.5:0/1131978251 learned_addr learned my addr 172.21.15.5:0/1131978251 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:44.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 10 monclient(hunting): get_auth_request con 0x7f693c0a6bd0 auth_method 0 2024-08-18T21:10:44.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f69410b0640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f693c0a76c0 0x7f693c126890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f69408af640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f693c09f080 0x7f693c128e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f69410b0640 10 monclient(hunting): get_auth_request con 0x7f693c0a76c0 auth_method 0 2024-08-18T21:10:44.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f69410b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f69410b0640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f69410b0640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 10 monclient(hunting): handle_auth_done global_id 84863 payload 824 2024-08-18T21:10:44.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 1 -- 172.21.15.5:0/1131978251 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f693c0a76c0 msgr2=0x7f693c126890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f693c0a76c0 0x7f693c126890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 1 -- 172.21.15.5:0/1131978251 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f693c09f080 msgr2=0x7f693c128e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f693c09f080 0x7f693c128e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:10:44.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 1 monclient: found mon.noname-b 2024-08-18T21:10:44.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:44.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:10:44.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f693bfff640 1 -- 172.21.15.5:0/1131978251 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693c1297a0 con 0x7f693c0a6bd0 2024-08-18T21:10:44.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f69408af640 10 monclient: get_auth_request con 0x7f693c09f080 auth_method 0 2024-08-18T21:10:44.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.101+0000 7f69408af640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f693c09f080 0x7f693c128e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:10:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f693bfff640 1 -- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f693c0a6bd0 msgr2=0x7f693c1d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f693bfff640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f693c0a6bd0 0x7f693c1d1970 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f692c00e8b0 tx=0x7f692c00ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69397fa640 1 -- 172.21.15.5:0/1131978251 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f692c017070 con 0x7f693c0a6bd0 2024-08-18T21:10:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69397fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:10:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69397fa640 10 monclient: dump: 2024-08-18T21:10:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.120 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69397fa640 10 monclient: _finish_auth 0 2024-08-18T21:10:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69397fa640 10 monclient: _check_auth_tickets 2024-08-18T21:10:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69397fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69397fa640 1 -- 172.21.15.5:0/1131978251 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692c013470 con 0x7f693c0a6bd0 2024-08-18T21:10:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f6942b13640 5 monclient: authenticate success, global_id 84863 2024-08-18T21:10:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f6942b13640 10 monclient: _renew_subs 2024-08-18T21:10:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f6942b13640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:10:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f6942b13640 1 -- 172.21.15.5:0/1131978251 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f693c12a610 con 0x7f693c0a6bd0 2024-08-18T21:10:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69397fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69397fa640 1 -- 172.21.15.5:0/1131978251 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f692c013a90 con 0x7f693c0a6bd0 2024-08-18T21:10:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69397fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69397fa640 10 monclient: dump: 2024-08-18T21:10:44.121 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.122 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.123 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f693affd640 4 set_mon_vals no callback set 2024-08-18T21:10:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f6942b13640 10 monclient: _renew_subs 2024-08-18T21:10:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f6942b13640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:10:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f6942b13640 1 -- 172.21.15.5:0/1131978251 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f693c140320 con 0x7f693c0a6bd0 2024-08-18T21:10:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f6942b13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f6942b13640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f693c1d1eb0 0x7f693c126dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f6942b13640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f6942b13640 1 -- 172.21.15.5:0/1131978251 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f693c051140 con 0x7f693c1d1eb0 2024-08-18T21:10:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69408af640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f693c1d1eb0 0x7f693c126dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69408af640 10 monclient: get_auth_request con 0x7f693c1d1eb0 auth_method 0 2024-08-18T21:10:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69408af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69408af640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69408af640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69408af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69408af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69408af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f693bfff640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f693c0a6bd0 0x7f693c1d1970 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f692c00e8b0 tx=0x7f692c00ed70 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7f692c00f040 osd_map(211..211 src has 22..211) 2024-08-18T21:10:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69397fa640 1 -- 172.21.15.5:0/1131978251 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f692c01a070 con 0x7f693c0a6bd0 2024-08-18T21:10:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69408af640 10 monclient(hunting): handle_auth_done global_id 6574 payload 824 2024-08-18T21:10:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69408af640 1 -- 172.21.15.5:0/1131978251 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f693c0ab7c0 con 0x7f693c1d1eb0 2024-08-18T21:10:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69397fa640 1 --2- 172.21.15.5:0/1131978251 >> v2:172.21.15.157:6812/631023601 conn(0x7f692803bdc0 0x7f692803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69410b0640 1 --2- 172.21.15.5:0/1131978251 >> v2:172.21.15.157:6812/631023601 conn(0x7f692803bdc0 0x7f692803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.105+0000 7f69410b0640 10 monclient: get_auth_request con 0x7f692803bdc0 auth_method 0 2024-08-18T21:10:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.109+0000 7f69408af640 1 -- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f693c1d1eb0 msgr2=0x7f693c126dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.109+0000 7f69408af640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f693c1d1eb0 0x7f693c126dd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f693000d480 tx=0x7f693000d940 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.109+0000 7f69397fa640 1 -- 172.21.15.5:0/1131978251 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6930012c80 con 0x7f693c1d1eb0 2024-08-18T21:10:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.109+0000 7f69397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.109+0000 7f69397fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.109+0000 7f69397fa640 10 monclient: dump: 2024-08-18T21:10:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.126 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.109+0000 7f69397fa640 1 -- 172.21.15.5:0/1131978251 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6930012810 con 0x7f693c1d1eb0 2024-08-18T21:10:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.109+0000 7f69397fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.109+0000 7f69397fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.109+0000 7f69397fa640 1 -- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f693c1d1eb0 msgr2=0x7f693c126dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.109+0000 7f69397fa640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f693c1d1eb0 0x7f693c126dd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f693000d480 tx=0x7f693000d940 comp rx=0 tx=0).stop 2024-08-18T21:10:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.109+0000 7f69397fa640 1 -- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f693c1d1eb0 msgr2=0x7f693c126dd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.109+0000 7f69397fa640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f693c1d1eb0 0x7f693c126dd0 secure :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f693000d480 tx=0x7f693000d940 comp rx=0 tx=0).stop 2024-08-18T21:10:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.109+0000 7f69410b0640 1 --2- 172.21.15.5:0/1131978251 >> v2:172.21.15.157:6812/631023601 conn(0x7f692803bdc0 0x7f692803e280 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f69340ab000 tx=0x7f69340a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.113+0000 7f6942b13640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.113+0000 7f6942b13640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f693c127310 0x7f693c122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.113+0000 7f6942b13640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.113+0000 7f6942b13640 1 -- 172.21.15.5:0/1131978251 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f693c0ab270 con 0x7f693c127310 2024-08-18T21:10:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.113+0000 7f69408af640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f693c127310 0x7f693c122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.113+0000 7f69408af640 10 monclient: get_auth_request con 0x7f693c127310 auth_method 0 2024-08-18T21:10:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.113+0000 7f69408af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.113+0000 7f69408af640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.113+0000 7f69408af640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.113+0000 7f69408af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.113+0000 7f69408af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.113+0000 7f69408af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69408af640 10 monclient(hunting): handle_auth_done global_id 6583 payload 824 2024-08-18T21:10:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69408af640 1 -- 172.21.15.5:0/1131978251 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f693c127720 con 0x7f693c127310 2024-08-18T21:10:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69408af640 1 -- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f693c127310 msgr2=0x7f693c122820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69408af640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f693c127310 0x7f693c122820 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f693000dee0 tx=0x7f6930003770 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69397fa640 1 -- 172.21.15.5:0/1131978251 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6930028020 con 0x7f693c127310 2024-08-18T21:10:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69397fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69397fa640 10 monclient: dump: 2024-08-18T21:10:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.130 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69397fa640 1 -- 172.21.15.5:0/1131978251 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f6930007240 con 0x7f693c127310 2024-08-18T21:10:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69397fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69397fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69397fa640 1 -- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f693c127310 msgr2=0x7f693c122820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69397fa640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f693c127310 0x7f693c122820 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f693000dee0 tx=0x7f6930003770 comp rx=0 tx=0).stop 2024-08-18T21:10:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69397fa640 1 -- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f693c127310 msgr2=0x7f693c122820 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69397fa640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f693c127310 0x7f693c122820 secure :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f693000dee0 tx=0x7f6930003770 comp rx=0 tx=0).stop 2024-08-18T21:10:44.131 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:44.131 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:44.131 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:44.131 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:44.131 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:44.131 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 453234, 2024-08-18T21:10:44.131 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:44.131 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:44.131 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:44.131 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:44.132 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:44.132 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:44.132 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:44.132 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:44.132 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:44.132 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:44.132 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.132 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:10:44.132 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:44.132 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:44.132 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:44.132 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:44.132 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:44.132 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:44.133 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:44.133 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:44.133 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:44.133 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:44.133 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:44.133 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:44.133 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:44.133 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:44.133 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.133 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:44.133 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:44.133 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:44.133 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:44.133 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:44.134 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:44.134 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:44.134 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:44.134 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:44.134 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:44.134 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:44.134 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:44.134 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:44.134 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.134 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:44.134 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:44.134 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:44.135 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:44.135 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:44.135 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:44.135 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:44.135 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:44.135 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:44.135 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:44.135 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:44.135 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:44.135 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:44.135 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:44.135 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:44.135 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:44.135 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:44.136 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:44.136 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:44.136 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:44.136 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:44.136 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:44.136 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:44.136 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:44.136 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:44.136 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:44.136 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:44.136 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:44.136 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.136 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:44.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.136 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:44.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.137 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:44.137 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:44.137 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.137 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.137 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.137 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:44.137 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.137 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.137 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:44.138 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.138 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.138 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.138 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:44.138 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:44.138 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.138 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.138 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.139 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:44.139 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:44.139 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.139 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.139 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.139 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:44.139 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.139 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.139 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:44.139 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.140 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.140 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.140 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:44.140 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:44.140 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.140 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.140 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.140 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:44.140 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:44.140 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.140 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.141 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.141 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:44.141 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.141 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.141 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:44.141 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.141 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.141 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.141 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:44.141 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:44.141 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.142 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.142 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.142 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:44.142 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:44.142 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.142 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.142 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.142 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:44.142 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.143 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.143 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:44.143 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.143 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.143 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.143 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:44.143 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:44.143 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.143 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.143 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.144 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:44.144 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:44.144 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.144 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.144 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.144 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:44.144 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.144 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.144 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:44.144 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.144 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.144 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.145 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:44.145 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:44.145 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.145 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.145 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.145 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.145 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:44.145 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:44.145 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.145 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.145 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.145 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.146 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:44.146 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.146 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.146 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:44.146 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.146 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.146 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.146 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:44.146 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:44.146 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.147 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.147 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.147 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:44.147 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:44.147 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.147 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.147 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.147 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:44.147 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.147 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.148 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:44.148 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.148 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.148 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.148 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:44.148 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:44.148 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.148 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.148 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.148 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.148 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:44.148 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:44.149 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.149 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.149 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.149 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:44.149 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.149 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.149 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:44.149 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.149 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.149 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.150 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:44.150 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:44.150 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.150 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.150 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.150 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:44.150 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:44.150 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.150 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.150 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.151 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:44.151 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.151 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.151 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:44.151 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.151 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.151 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.151 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:44.151 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:44.151 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.151 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.151 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.152 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.152 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.152 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:44.152 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:44.152 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.152 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:44.152 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:44.152 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:44.152 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.152 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.152 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:10:44.152 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.152 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:44.153 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:44.153 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:44.153 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.153 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.153 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:44.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.153 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:44.153 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:44.153 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:10:44.153 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.153 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.153 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:44.153 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f6942b13640 1 -- 172.21.15.5:0/1131978251 >> v2:172.21.15.157:6812/631023601 conn(0x7f692803bdc0 msgr2=0x7f692803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f6942b13640 1 --2- 172.21.15.5:0/1131978251 >> v2:172.21.15.157:6812/631023601 conn(0x7f692803bdc0 0x7f692803e280 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f69340ab000 tx=0x7f69340a7070 comp rx=0 tx=0).stop 2024-08-18T21:10:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f6942b13640 10 monclient: shutdown 2024-08-18T21:10:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f6942b13640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f6942b13640 1 -- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f693c0a6bd0 msgr2=0x7f693c1d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f6942b13640 1 --2- 172.21.15.5:0/1131978251 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f693c0a6bd0 0x7f693c1d1970 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f692c00e8b0 tx=0x7f692c00ed70 comp rx=0 tx=0).stop 2024-08-18T21:10:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69410b0640 1 -- 172.21.15.5:0/1131978251 reap_dead start 2024-08-18T21:10:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69397fa640 1 -- 172.21.15.5:0/1131978251 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(211..211 src has 22..211) ==== 3506+0+0 (unknown 0 0 0) 0x7f692c00f040 con 0x7f693c0a6bd0 2024-08-18T21:10:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f69410b0640 1 -- 172.21.15.5:0/1131978251 reap_dead start 2024-08-18T21:10:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f6942b13640 1 -- 172.21.15.5:0/1131978251 shutdown_connections 2024-08-18T21:10:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f6942b13640 1 -- 172.21.15.5:0/1131978251 >> 172.21.15.5:0/1131978251 conn(0x7f693c068700 msgr2=0x7f693c0a57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f6942b13640 1 -- 172.21.15.5:0/1131978251 shutdown_connections 2024-08-18T21:10:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.117+0000 7f6942b13640 1 -- 172.21.15.5:0/1131978251 wait complete. 2024-08-18T21:10:44.156 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:44.156 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:10:44.156 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:10:44.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2849990991}) 2024-08-18T21:10:44.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2387981904}) 2024-08-18T21:10:44.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2849990991}) 2024-08-18T21:10:44.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2798736572}) 2024-08-18T21:10:44.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.241 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2849990991}) 2024-08-18T21:10:44.242 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2512564362}) 2024-08-18T21:10:44.242 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.242 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2849990991}) 2024-08-18T21:10:44.242 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3116791931}) 2024-08-18T21:10:44.242 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.242 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2849990991}) 2024-08-18T21:10:44.242 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2634982101}) 2024-08-18T21:10:44.242 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.242 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2849990991}) 2024-08-18T21:10:44.242 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1088966635}) 2024-08-18T21:10:44.242 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.242 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2849990991}) 2024-08-18T21:10:44.242 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2621656149}) 2024-08-18T21:10:44.243 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.243 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2849990991}) 2024-08-18T21:10:44.243 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.233+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1855062496}) 2024-08-18T21:10:44.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149646487}) 2024-08-18T21:10:44.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=880033099}) 2024-08-18T21:10:44.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149646487}) 2024-08-18T21:10:44.245 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=546623410}) 2024-08-18T21:10:44.246 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.246 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149646487}) 2024-08-18T21:10:44.246 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=233961037}) 2024-08-18T21:10:44.246 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.246 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149646487}) 2024-08-18T21:10:44.246 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3225952394}) 2024-08-18T21:10:44.246 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.246 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149646487}) 2024-08-18T21:10:44.246 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3792461474}) 2024-08-18T21:10:44.246 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.247 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149646487}) 2024-08-18T21:10:44.247 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3740470769}) 2024-08-18T21:10:44.247 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.247 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149646487}) 2024-08-18T21:10:44.247 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.237+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3120589153}) 2024-08-18T21:10:44.247 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.241+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.247 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.241+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149646487}) 2024-08-18T21:10:44.247 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.241+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1483272102}) 2024-08-18T21:10:44.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.241+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3874094414}) 2024-08-18T21:10:44.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3905340682}) 2024-08-18T21:10:44.249 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3874094414}) 2024-08-18T21:10:44.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2274982334}) 2024-08-18T21:10:44.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3874094414}) 2024-08-18T21:10:44.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1150842379}) 2024-08-18T21:10:44.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3874094414}) 2024-08-18T21:10:44.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1747384337}) 2024-08-18T21:10:44.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3874094414}) 2024-08-18T21:10:44.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4189967977}) 2024-08-18T21:10:44.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.250 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3874094414}) 2024-08-18T21:10:44.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=905732327}) 2024-08-18T21:10:44.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3874094414}) 2024-08-18T21:10:44.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2381079155}) 2024-08-18T21:10:44.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3874094414}) 2024-08-18T21:10:44.251 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.245+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1328774516}) 2024-08-18T21:10:44.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3898559756}) 2024-08-18T21:10:44.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=438335070}) 2024-08-18T21:10:44.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3898559756}) 2024-08-18T21:10:44.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3069913561}) 2024-08-18T21:10:44.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3898559756}) 2024-08-18T21:10:44.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3902425607}) 2024-08-18T21:10:44.254 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3898559756}) 2024-08-18T21:10:44.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1859039724}) 2024-08-18T21:10:44.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3898559756}) 2024-08-18T21:10:44.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3799037150}) 2024-08-18T21:10:44.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3898559756}) 2024-08-18T21:10:44.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3387035538}) 2024-08-18T21:10:44.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3898559756}) 2024-08-18T21:10:44.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987397671}) 2024-08-18T21:10:44.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3898559756}) 2024-08-18T21:10:44.255 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.249+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3129684764}) 2024-08-18T21:10:44.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 10 monclient: get_monmap_and_config 2024-08-18T21:10:44.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 10 monclient: build_initial_monmap 2024-08-18T21:10:44.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 10 monclient: monmap: 2024-08-18T21:10:44.276 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:44.276 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.276 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:44.277512+0000 2024-08-18T21:10:44.276 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:44.277512+0000 2024-08-18T21:10:44.276 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:44.276 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.276 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:44.276 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:44.276 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:44.277 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 1 Processor -- start 2024-08-18T21:10:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 1 -- start start 2024-08-18T21:10:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 10 monclient: init 2024-08-18T21:10:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 10 monclient: _add_conns ranks=[10,0,3,2,7,8,9,4,1,5,6] 2024-08-18T21:10:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f39300a6bd0 0x7f39300a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 10 monclient(hunting): picked mon.noname-f con 0x7f39300a6bd0 addr v2:172.21.15.157:3300/0 2024-08-18T21:10:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f393009f080 addr v1:172.21.15.5:6789/0 2024-08-18T21:10:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39300a74f0 0x7f393013a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 10 monclient(hunting): picked mon.noname-g con 0x7f39300a74f0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39300a7fb0 con 0x7f393009f080 2024-08-18T21:10:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f393009e4c0 con 0x7f39300a6bd0 2024-08-18T21:10:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f393006f930 con 0x7f39300a74f0 2024-08-18T21:10:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3936cea640 10 monclient(hunting): authenticate will time out at 1411.290629s 2024-08-18T21:10:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f392ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f393009f080 0x7f3930139990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41008/0 (socket says 172.21.15.5:41008) 2024-08-18T21:10:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f392ffff640 1 -- 172.21.15.5:0/3356654433 learned_addr learned my addr 172.21.15.5:0/3356654433 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:10:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 1 --2- 172.21.15.5:0/3356654433 >> v2:172.21.15.157:3300/0 conn(0x7f39300a6bd0 0x7f39300a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 10 monclient(hunting): get_auth_request con 0x7f39300a6bd0 auth_method 0 2024-08-18T21:10:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3935287640 1 --2- 172.21.15.5:0/3356654433 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39300a74f0 0x7f393013a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3935287640 10 monclient(hunting): get_auth_request con 0x7f39300a74f0 auth_method 0 2024-08-18T21:10:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3935287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3935287640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3935287640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3935287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3935287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3935287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 10 monclient(hunting): handle_auth_done global_id 104212 payload 274 2024-08-18T21:10:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 1 -- 172.21.15.5:0/3356654433 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39300a74f0 msgr2=0x7f393013a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:44.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 1 --2- 172.21.15.5:0/3356654433 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39300a74f0 0x7f393013a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 1 -- 172.21.15.5:0/3356654433 >> v1:172.21.15.5:6789/0 conn(0x7f393009f080 legacy=0x7f3930139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:44.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 10 monclient: _finish_hunting 0 2024-08-18T21:10:44.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 1 monclient: found mon.noname-f 2024-08-18T21:10:44.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:44.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:10:44.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.273+0000 7f3934a86640 1 -- 172.21.15.5:0/3356654433 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f393009de70 con 0x7f39300a6bd0 2024-08-18T21:10:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.277+0000 7f3934a86640 1 -- 172.21.15.5:0/3356654433 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39300a6bd0 msgr2=0x7f39300a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.277+0000 7f3934a86640 1 --2- 172.21.15.5:0/3356654433 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39300a6bd0 0x7f39300a6fb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f39200097c0 tx=0x7f392001cdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31e888daeb4056cc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392f7fe640 1 -- 172.21.15.5:0/3356654433 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f39200b0070 con 0x7f39300a6bd0 2024-08-18T21:10:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392f7fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:10:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392f7fe640 10 monclient: dump: 2024-08-18T21:10:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.288 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392f7fe640 10 monclient: _finish_auth 0 2024-08-18T21:10:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392f7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:10:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392f7fe640 1 -- 172.21.15.5:0/3356654433 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39200aa810 con 0x7f39300a6bd0 2024-08-18T21:10:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392f7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392f7fe640 1 -- 172.21.15.5:0/3356654433 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f39200a9300 con 0x7f39300a6bd0 2024-08-18T21:10:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392f7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:10:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392f7fe640 10 monclient: dump: 2024-08-18T21:10:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.291 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 5 monclient: authenticate success, global_id 104212 2024-08-18T21:10:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 4 set_mon_vals no callback set 2024-08-18T21:10:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 10 monclient: shutdown 2024-08-18T21:10:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 1 -- 172.21.15.5:0/3356654433 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39300a6bd0 msgr2=0x7f39300a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 1 --2- 172.21.15.5:0/3356654433 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39300a6bd0 0x7f39300a6fb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f39200097c0 tx=0x7f392001cdc0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 1 -- 172.21.15.5:0/3356654433 shutdown_connections 2024-08-18T21:10:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 1 --2- 172.21.15.5:0/3356654433 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39300a74f0 0x7f393013a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 1 --2- 172.21.15.5:0/3356654433 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39300a6bd0 0x7f39300a6fb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 1 -- 172.21.15.5:0/3356654433 >> 172.21.15.5:0/3356654433 conn(0x7f3930068700 msgr2=0x7f3930068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 1 -- 172.21.15.5:0/3356654433 shutdown_connections 2024-08-18T21:10:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 1 -- 172.21.15.5:0/3356654433 wait complete. 2024-08-18T21:10:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 10 monclient: build_initial_monmap 2024-08-18T21:10:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 10 monclient: monmap: 2024-08-18T21:10:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:44.293 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:44.293 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:44.293 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:44.293 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:44.293 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:44.294 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 1 Processor -- start 2024-08-18T21:10:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 1 -- start start 2024-08-18T21:10:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 10 monclient: init 2024-08-18T21:10:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 10 monclient: _add_conns ranks=[2,3,5,0,8,4,6,1,7] 2024-08-18T21:10:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f393009f080 0x7f3930138e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 10 monclient(hunting): picked mon.noname-b con 0x7f393009f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39300a6bd0 0x7f3930139390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 10 monclient(hunting): picked mon.noname-g con 0x7f39300a6bd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f39300a74f0 0x7f393013e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 10 monclient(hunting): picked mon.noname-h con 0x7f39300a74f0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f393013a5e0 con 0x7f393009f080 2024-08-18T21:10:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f39300a89f0 con 0x7f39300a6bd0 2024-08-18T21:10:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f393013a760 con 0x7f39300a74f0 2024-08-18T21:10:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3936cea640 10 monclient(hunting): authenticate will time out at 1411.299401s 2024-08-18T21:10:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f393009f080 0x7f3930138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f393009f080 0x7f3930138e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:45016/0 (socket says 172.21.15.5:45016) 2024-08-18T21:10:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 1 -- 172.21.15.5:0/118357100 learned_addr learned my addr 172.21.15.5:0/118357100 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 10 monclient(hunting): get_auth_request con 0x7f393009f080 auth_method 0 2024-08-18T21:10:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392ffff640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39300a6bd0 0x7f3930139390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3935287640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f39300a74f0 0x7f393013e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392ffff640 10 monclient(hunting): get_auth_request con 0x7f39300a6bd0 auth_method 0 2024-08-18T21:10:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f392ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 10 monclient(hunting): handle_auth_done global_id 84872 payload 824 2024-08-18T21:10:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 1 -- 172.21.15.5:0/118357100 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f39300a74f0 msgr2=0x7f393013e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f39300a74f0 0x7f393013e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 1 -- 172.21.15.5:0/118357100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39300a6bd0 msgr2=0x7f3930139390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39300a6bd0 0x7f3930139390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 10 monclient: _finish_hunting 0 2024-08-18T21:10:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 1 monclient: found mon.noname-b 2024-08-18T21:10:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:10:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3934a86640 1 -- 172.21.15.5:0/118357100 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3930122f00 con 0x7f393009f080 2024-08-18T21:10:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3935287640 10 monclient: get_auth_request con 0x7f39300a74f0 auth_method 0 2024-08-18T21:10:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.281+0000 7f3935287640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f39300a74f0 0x7f393013e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:10:44.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f3934a86640 1 -- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f393009f080 msgr2=0x7f3930138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f3934a86640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f393009f080 0x7f3930138e50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3920009710 tx=0x7f3920019100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392d7fa640 1 -- 172.21.15.5:0/118357100 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f39200b0040 con 0x7f393009f080 2024-08-18T21:10:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392d7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:10:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392d7fa640 10 monclient: dump: 2024-08-18T21:10:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.303 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392d7fa640 10 monclient: _finish_auth 0 2024-08-18T21:10:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392d7fa640 10 monclient: _check_auth_tickets 2024-08-18T21:10:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392d7fa640 1 -- 172.21.15.5:0/118357100 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39200b9070 con 0x7f393009f080 2024-08-18T21:10:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f3936cea640 5 monclient: authenticate success, global_id 84872 2024-08-18T21:10:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f3936cea640 10 monclient: _renew_subs 2024-08-18T21:10:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f3936cea640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:10:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f3936cea640 1 -- 172.21.15.5:0/118357100 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3930123d50 con 0x7f393009f080 2024-08-18T21:10:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392d7fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392d7fa640 1 -- 172.21.15.5:0/118357100 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f39200044b0 con 0x7f393009f080 2024-08-18T21:10:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:10:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392d7fa640 10 monclient: dump: 2024-08-18T21:10:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.305 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392effd640 4 set_mon_vals no callback set 2024-08-18T21:10:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f3936cea640 10 monclient: _renew_subs 2024-08-18T21:10:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f3936cea640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:10:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f3936cea640 1 -- 172.21.15.5:0/118357100 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f39300a5f60 con 0x7f393009f080 2024-08-18T21:10:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f3936cea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f3936cea640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f393013eb10 0x7f393013eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f3936cea640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f3936cea640 1 -- 172.21.15.5:0/118357100 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f3930051140 con 0x7f393013eb10 2024-08-18T21:10:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392d7fa640 1 -- 172.21.15.5:0/118357100 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f39200b3070 con 0x7f393009f080 2024-08-18T21:10:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392ffff640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f393013eb10 0x7f393013eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392ffff640 10 monclient: get_auth_request con 0x7f393013eb10 auth_method 0 2024-08-18T21:10:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392d7fa640 1 --2- 172.21.15.5:0/118357100 >> v2:172.21.15.157:6812/631023601 conn(0x7f391003bdc0 0x7f391003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.285+0000 7f392d7fa640 1 -- 172.21.15.5:0/118357100 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(211..211 src has 22..211) ==== 3506+0+0 (secure 0 0 0) 0x7f39200e78f0 con 0x7f393009f080 2024-08-18T21:10:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f392ffff640 10 monclient(hunting): handle_auth_done global_id 85056 payload 824 2024-08-18T21:10:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f392ffff640 1 -- 172.21.15.5:0/118357100 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39300008e0 con 0x7f393013eb10 2024-08-18T21:10:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f3935287640 1 --2- 172.21.15.5:0/118357100 >> v2:172.21.15.157:6812/631023601 conn(0x7f391003bdc0 0x7f391003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f3935287640 10 monclient: get_auth_request con 0x7f391003bdc0 auth_method 0 2024-08-18T21:10:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f392ffff640 1 -- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f393013eb10 msgr2=0x7f393013eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f392ffff640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f393013eb10 0x7f393013eef0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f391800e4d0 tx=0x7f391800e990 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f392d7fa640 1 -- 172.21.15.5:0/118357100 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3918004e40 con 0x7f393013eb10 2024-08-18T21:10:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f392d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f392d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f392d7fa640 10 monclient: dump: 2024-08-18T21:10:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.308 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f392d7fa640 1 -- 172.21.15.5:0/118357100 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3918018070 con 0x7f393013eb10 2024-08-18T21:10:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f392d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f392d7fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f392d7fa640 1 -- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f393013eb10 msgr2=0x7f393013eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f392d7fa640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f393013eb10 0x7f393013eef0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f391800e4d0 tx=0x7f391800e990 comp rx=0 tx=0).stop 2024-08-18T21:10:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f392d7fa640 1 -- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f393013eb10 msgr2=0x7f393013eef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f392d7fa640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f393013eb10 0x7f393013eef0 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f391800e4d0 tx=0x7f391800e990 comp rx=0 tx=0).stop 2024-08-18T21:10:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.289+0000 7f3935287640 1 --2- 172.21.15.5:0/118357100 >> v2:172.21.15.157:6812/631023601 conn(0x7f391003bdc0 0x7f391003e280 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f39301412b0 tx=0x7f392800b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.297+0000 7f3936cea640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.297+0000 7f3936cea640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f393013f430 0x7f39300a20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.297+0000 7f3936cea640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.297+0000 7f3936cea640 1 -- 172.21.15.5:0/118357100 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f39300a6fb0 con 0x7f393013f430 2024-08-18T21:10:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.297+0000 7f392ffff640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f393013f430 0x7f39300a20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.297+0000 7f392ffff640 10 monclient: get_auth_request con 0x7f393013f430 auth_method 0 2024-08-18T21:10:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.297+0000 7f392ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.297+0000 7f392ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.297+0000 7f392ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.297+0000 7f392ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.297+0000 7f392ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.297+0000 7f392ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.297+0000 7f392ffff640 10 monclient(hunting): handle_auth_done global_id 85065 payload 824 2024-08-18T21:10:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.297+0000 7f392ffff640 1 -- 172.21.15.5:0/118357100 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f39301398d0 con 0x7f393013f430 2024-08-18T21:10:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.297+0000 7f392ffff640 1 -- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f393013f430 msgr2=0x7f39300a20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.297+0000 7f392ffff640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f393013f430 0x7f39300a20e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3918017000 tx=0x7f3918004950 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f392d7fa640 1 -- 172.21.15.5:0/118357100 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3918006750 con 0x7f393013f430 2024-08-18T21:10:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f392d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f392d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f392d7fa640 10 monclient: dump: 2024-08-18T21:10:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.313 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f392d7fa640 1 -- 172.21.15.5:0/118357100 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f39180062e0 con 0x7f393013f430 2024-08-18T21:10:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f392d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f392d7fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f392d7fa640 1 -- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f393013f430 msgr2=0x7f39300a20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f392d7fa640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f393013f430 0x7f39300a20e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3918017000 tx=0x7f3918004950 comp rx=0 tx=0).stop 2024-08-18T21:10:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f392d7fa640 1 -- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f393013f430 msgr2=0x7f39300a20e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f392d7fa640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f393013f430 0x7f39300a20e0 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3918017000 tx=0x7f3918004950 comp rx=0 tx=0).stop 2024-08-18T21:10:44.313 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:44.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:44.314 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:44.314 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:44.314 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:44.314 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 141130, 2024-08-18T21:10:44.314 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:44.314 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:44.314 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:44.314 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:44.314 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:44.314 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:44.314 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:44.315 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:44.315 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:44.315 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:44.315 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.315 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:10:44.315 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:44.315 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:44.315 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:44.315 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:44.315 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:44.315 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:44.315 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:44.315 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:44.315 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:44.316 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:44.316 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:44.316 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:44.316 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:44.316 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:44.316 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.316 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:44.316 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:44.316 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:44.316 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:44.316 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:44.316 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:44.316 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:44.316 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:44.317 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:44.317 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:44.317 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:44.317 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:44.317 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:44.317 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.317 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:44.317 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:44.317 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:44.317 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:44.317 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:44.318 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:44.318 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:44.318 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:44.318 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:44.318 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:44.318 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:44.318 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:44.318 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:44.318 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:44.318 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:44.318 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:44.318 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:44.318 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:44.318 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:44.319 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:44.319 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:44.319 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:44.319 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:44.319 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:44.319 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:44.319 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:44.319 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:44.319 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:44.319 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.319 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:44.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.319 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:44.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.320 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:44.320 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:44.320 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.320 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.320 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.320 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:44.320 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.320 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.320 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:44.320 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.321 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.321 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.321 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:44.321 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:44.321 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.321 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.321 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.321 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:44.321 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:44.321 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.321 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.322 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.322 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:44.322 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.322 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.322 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:44.322 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.322 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.322 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.322 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:44.323 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:44.323 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.323 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.323 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.323 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:44.323 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:44.323 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.323 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.323 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.323 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:44.323 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.324 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.324 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.324 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:44.324 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.324 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.324 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.324 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:44.324 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:44.324 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.324 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.324 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.325 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:44.325 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:44.325 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.325 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.325 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.325 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:44.325 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.325 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.325 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:44.325 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.326 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.326 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.326 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:44.326 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:44.326 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.326 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.326 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.326 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:44.326 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:44.326 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.326 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.327 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.327 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.327 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:44.327 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.327 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.327 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.327 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:44.327 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.327 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.327 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.327 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:44.327 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:44.328 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.328 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.328 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.328 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:44.328 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:44.328 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.328 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.328 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.328 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:44.328 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.329 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.329 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:44.329 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.329 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.329 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.329 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:44.329 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:44.329 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.329 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.329 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.329 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:44.330 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:44.330 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.330 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.330 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.330 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:44.330 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.330 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.330 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:44.330 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.330 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.330 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.331 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:44.331 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:44.331 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.331 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.331 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.331 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:44.331 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:44.331 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.331 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.331 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.332 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:44.332 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.332 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.332 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:44.332 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.332 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.332 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.332 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:44.332 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:44.332 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.332 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.332 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.333 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:44.333 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:44.333 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.333 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.333 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.333 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:44.333 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.333 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.334 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:44.334 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.334 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.334 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.334 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:44.334 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:44.334 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.334 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.334 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.334 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.334 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.334 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:44.335 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:44.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.335 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:44.335 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:44.335 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:44.335 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.335 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.335 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:10:44.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.335 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:44.335 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:44.335 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:10:44.335 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.335 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.336 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:44.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.336 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:44.336 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:44.336 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:44.336 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.336 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.336 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:44.336 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f3936cea640 1 -- 172.21.15.5:0/118357100 >> v2:172.21.15.157:6812/631023601 conn(0x7f391003bdc0 msgr2=0x7f391003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f3936cea640 1 --2- 172.21.15.5:0/118357100 >> v2:172.21.15.157:6812/631023601 conn(0x7f391003bdc0 0x7f391003e280 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f39301412b0 tx=0x7f392800b040 comp rx=0 tx=0).stop 2024-08-18T21:10:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f3936cea640 10 monclient: shutdown 2024-08-18T21:10:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f3936cea640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f3936cea640 1 -- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f393009f080 msgr2=0x7f3930138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f3936cea640 1 --2- 172.21.15.5:0/118357100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f393009f080 0x7f3930138e50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3920009710 tx=0x7f3920019100 comp rx=0 tx=0).stop 2024-08-18T21:10:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f3935287640 1 -- 172.21.15.5:0/118357100 reap_dead start 2024-08-18T21:10:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f3935287640 1 -- 172.21.15.5:0/118357100 reap_dead start 2024-08-18T21:10:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f3936cea640 1 -- 172.21.15.5:0/118357100 shutdown_connections 2024-08-18T21:10:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f3936cea640 1 -- 172.21.15.5:0/118357100 >> 172.21.15.5:0/118357100 conn(0x7f3930068700 msgr2=0x7f39301416f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f3936cea640 1 -- 172.21.15.5:0/118357100 shutdown_connections 2024-08-18T21:10:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.301+0000 7f3936cea640 1 -- 172.21.15.5:0/118357100 wait complete. 2024-08-18T21:10:44.339 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:44.339 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:10:44.339 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:10:44.352 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.352 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=545774416}) 2024-08-18T21:10:44.352 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=942263791}) 2024-08-18T21:10:44.352 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.352 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=545774416}) 2024-08-18T21:10:44.352 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=879188279}) 2024-08-18T21:10:44.352 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.352 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=545774416}) 2024-08-18T21:10:44.353 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2868061576}) 2024-08-18T21:10:44.353 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.353 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=545774416}) 2024-08-18T21:10:44.353 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1680080369}) 2024-08-18T21:10:44.353 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.353 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=545774416}) 2024-08-18T21:10:44.353 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3332850876}) 2024-08-18T21:10:44.353 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.353 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=545774416}) 2024-08-18T21:10:44.353 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2964470746}) 2024-08-18T21:10:44.353 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.353 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=545774416}) 2024-08-18T21:10:44.354 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1870628338}) 2024-08-18T21:10:44.354 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.354 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=545774416}) 2024-08-18T21:10:44.354 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.349+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3355597793}) 2024-08-18T21:10:44.362 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.362 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737476040}) 2024-08-18T21:10:44.362 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=340868092}) 2024-08-18T21:10:44.362 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.362 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737476040}) 2024-08-18T21:10:44.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3146066132}) 2024-08-18T21:10:44.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737476040}) 2024-08-18T21:10:44.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3298164856}) 2024-08-18T21:10:44.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737476040}) 2024-08-18T21:10:44.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3518157470}) 2024-08-18T21:10:44.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737476040}) 2024-08-18T21:10:44.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=27699250}) 2024-08-18T21:10:44.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737476040}) 2024-08-18T21:10:44.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3047585889}) 2024-08-18T21:10:44.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737476040}) 2024-08-18T21:10:44.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2384328865}) 2024-08-18T21:10:44.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737476040}) 2024-08-18T21:10:44.364 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.357+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3741078596}) 2024-08-18T21:10:44.402 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.402 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=567516732}) 2024-08-18T21:10:44.402 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1215829916}) 2024-08-18T21:10:44.402 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.402 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=567516732}) 2024-08-18T21:10:44.402 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1226268746}) 2024-08-18T21:10:44.402 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.402 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=567516732}) 2024-08-18T21:10:44.402 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4026527063}) 2024-08-18T21:10:44.402 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.402 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=567516732}) 2024-08-18T21:10:44.403 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3842037377}) 2024-08-18T21:10:44.403 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.403 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=567516732}) 2024-08-18T21:10:44.403 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1709669554}) 2024-08-18T21:10:44.403 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.403 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=567516732}) 2024-08-18T21:10:44.403 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3908485643}) 2024-08-18T21:10:44.403 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.403 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=567516732}) 2024-08-18T21:10:44.403 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1116876924}) 2024-08-18T21:10:44.403 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.403 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=567516732}) 2024-08-18T21:10:44.403 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.397+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2453566614}) 2024-08-18T21:10:44.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.461+0000 7f5e1f1ba640 10 monclient: get_monmap_and_config 2024-08-18T21:10:44.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.461+0000 7f5e1f1ba640 10 monclient: build_initial_monmap 2024-08-18T21:10:44.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 10 monclient: monmap: 2024-08-18T21:10:44.467 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:44.467 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.467 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:44.468488+0000 2024-08-18T21:10:44.467 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:44.468488+0000 2024-08-18T21:10:44.467 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:44.467 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.467 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:44.467 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:44.467 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:44.467 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:44.467 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:44.467 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:44.467 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:44.468 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:44.468 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:44.468 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:44.468 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:44.468 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 1 Processor -- start 2024-08-18T21:10:44.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 1 -- start start 2024-08-18T21:10:44.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 10 monclient: init 2024-08-18T21:10:44.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:44.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 10 monclient: _add_conns ranks=[7,9,8,2,5,1,4,3,6,0,10] 2024-08-18T21:10:44.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5e1806c950 0x7f5e180a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 10 monclient(hunting): picked mon.noname-i con 0x7f5e1806c950 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:44.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e180a1c40 0x7f5e1806cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 10 monclient(hunting): picked mon.noname-a con 0x7f5e180a1c40 addr v2:172.21.15.5:3300/0 2024-08-18T21:10:44.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e1806d270 0x7f5e18137800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 10 monclient(hunting): picked mon.noname-e con 0x7f5e1806d270 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:44.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5e180a1210 con 0x7f5e180a1c40 2024-08-18T21:10:44.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f5e180a04c0 con 0x7f5e1806c950 2024-08-18T21:10:44.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f5e180a55a0 con 0x7f5e1806d270 2024-08-18T21:10:44.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:44.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1f1ba640 10 monclient(hunting): authenticate will time out at 1411.481782s 2024-08-18T21:10:44.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1d757640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e1806d270 0x7f5e18137800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e180a1c40 0x7f5e1806cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1d757640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e1806d270 0x7f5e18137800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:36352/0 (socket says 172.21.15.5:36352) 2024-08-18T21:10:44.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e180a1c40 0x7f5e1806cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48024/0 (socket says 172.21.15.5:48024) 2024-08-18T21:10:44.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1d757640 1 -- 172.21.15.5:0/3514172242 learned_addr learned my addr 172.21.15.5:0/3514172242 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:44.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1d757640 10 monclient(hunting): get_auth_request con 0x7f5e1806d270 auth_method 0 2024-08-18T21:10:44.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1d757640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1d757640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1d757640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 10 monclient(hunting): get_auth_request con 0x7f5e180a1c40 auth_method 0 2024-08-18T21:10:44.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1d757640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1d757640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1d757640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1cf56640 1 --2- 172.21.15.5:0/3514172242 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5e1806c950 0x7f5e180a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1cf56640 10 monclient(hunting): get_auth_request con 0x7f5e1806c950 auth_method 0 2024-08-18T21:10:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1cf56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1cf56640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e1cf56640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 10 monclient(hunting): handle_auth_done global_id 84789 payload 274 2024-08-18T21:10:44.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 1 -- 172.21.15.5:0/3514172242 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e1806d270 msgr2=0x7f5e18137800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:44.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 1 --2- 172.21.15.5:0/3514172242 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e1806d270 0x7f5e18137800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 1 -- 172.21.15.5:0/3514172242 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5e1806c950 msgr2=0x7f5e180a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:44.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 1 --2- 172.21.15.5:0/3514172242 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5e1806c950 0x7f5e180a4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 10 monclient: _finish_hunting 0 2024-08-18T21:10:44.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 1 monclient: found mon.noname-a 2024-08-18T21:10:44.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:44.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:10:44.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.465+0000 7f5e17fff640 1 -- 172.21.15.5:0/3514172242 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e180a0970 con 0x7f5e180a1c40 2024-08-18T21:10:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e17fff640 1 -- 172.21.15.5:0/3514172242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e180a1c40 msgr2=0x7f5e1806cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e17fff640 1 --2- 172.21.15.5:0/3514172242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e180a1c40 0x7f5e1806cd30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5e000097c0 tx=0x7f5e0001c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a836c44b2649d86a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e177fe640 1 -- 172.21.15.5:0/3514172242 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5e000b0070 con 0x7f5e180a1c40 2024-08-18T21:10:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e177fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:10:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e177fe640 10 monclient: dump: 2024-08-18T21:10:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.482 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.482 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.482 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e177fe640 10 monclient: _finish_auth 0 2024-08-18T21:10:44.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e177fe640 10 monclient: _check_auth_tickets 2024-08-18T21:10:44.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:44.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e177fe640 1 -- 172.21.15.5:0/3514172242 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e000aa810 con 0x7f5e180a1c40 2024-08-18T21:10:44.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 5 monclient: authenticate success, global_id 84789 2024-08-18T21:10:44.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:10:44.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e177fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:44.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e177fe640 1 -- 172.21.15.5:0/3514172242 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5e000a9300 con 0x7f5e180a1c40 2024-08-18T21:10:44.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:44.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 4 set_mon_vals no callback set 2024-08-18T21:10:44.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:44.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e177fe640 10 monclient: dump: 2024-08-18T21:10:44.483 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.483 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.483 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.483 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.483 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.483 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.483 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.484 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.484 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.484 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.484 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.484 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.484 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.484 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.484 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.484 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 10 monclient: shutdown 2024-08-18T21:10:44.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:44.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 1 -- 172.21.15.5:0/3514172242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e180a1c40 msgr2=0x7f5e1806cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 1 --2- 172.21.15.5:0/3514172242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e180a1c40 0x7f5e1806cd30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5e000097c0 tx=0x7f5e0001c070 comp rx=0 tx=0).stop 2024-08-18T21:10:44.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 1 -- 172.21.15.5:0/3514172242 shutdown_connections 2024-08-18T21:10:44.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 1 --2- 172.21.15.5:0/3514172242 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e1806d270 0x7f5e18137800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 1 --2- 172.21.15.5:0/3514172242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e180a1c40 0x7f5e1806cd30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 1 --2- 172.21.15.5:0/3514172242 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5e1806c950 0x7f5e180a4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 1 -- 172.21.15.5:0/3514172242 >> 172.21.15.5:0/3514172242 conn(0x7f5e180688d0 msgr2=0x7f5e18068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:44.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 1 -- 172.21.15.5:0/3514172242 shutdown_connections 2024-08-18T21:10:44.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 1 -- 172.21.15.5:0/3514172242 wait complete. 2024-08-18T21:10:44.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 10 monclient: build_initial_monmap 2024-08-18T21:10:44.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.469+0000 7f5e1f1ba640 10 monclient: monmap: 2024-08-18T21:10:44.485 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:44.485 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:44.485 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:44.486 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:44.486 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:44.486 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.486 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:44.486 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:44.486 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:44.486 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:44.486 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:44.486 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:44.486 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:44.486 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:44.486 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:44.486 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 1 Processor -- start 2024-08-18T21:10:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 1 -- start start 2024-08-18T21:10:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 10 monclient: init 2024-08-18T21:10:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 10 monclient: _add_conns ranks=[1,4,8,6,3,7,5,0,2] 2024-08-18T21:10:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e1806c950 0x7f5e18134880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 10 monclient(hunting): picked mon.noname-f con 0x7f5e1806c950 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:10:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e1806d270 0x7f5e1813ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 10 monclient(hunting): picked mon.noname-c con 0x7f5e1806d270 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e180a1c40 0x7f5e1813b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 10 monclient(hunting): picked mon.noname-e con 0x7f5e180a1c40 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5e18141000 con 0x7f5e1806c950 2024-08-18T21:10:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f5e18140e80 con 0x7f5e1806d270 2024-08-18T21:10:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f5e18141180 con 0x7f5e180a1c40 2024-08-18T21:10:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 10 monclient(hunting): authenticate will time out at 1411.488840s 2024-08-18T21:10:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e180a1c40 0x7f5e1813b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e17fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e1806d270 0x7f5e1813ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e180a1c40 0x7f5e1813b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:36364/0 (socket says 172.21.15.5:36364) 2024-08-18T21:10:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e17fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e1806d270 0x7f5e1813ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:51524/0 (socket says 172.21.15.5:51524) 2024-08-18T21:10:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 1 -- 172.21.15.5:0/3503878017 learned_addr learned my addr 172.21.15.5:0/3503878017 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 10 monclient(hunting): get_auth_request con 0x7f5e180a1c40 auth_method 0 2024-08-18T21:10:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e17fff640 10 monclient(hunting): get_auth_request con 0x7f5e1806d270 auth_method 0 2024-08-18T21:10:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e17fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e17fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e17fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e17fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e17fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e17fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1cf56640 1 --2- 172.21.15.5:0/3503878017 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e1806c950 0x7f5e18134880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1cf56640 10 monclient(hunting): get_auth_request con 0x7f5e1806c950 auth_method 0 2024-08-18T21:10:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1cf56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1cf56640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1cf56640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 10 monclient(hunting): handle_auth_done global_id 55619 payload 824 2024-08-18T21:10:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 1 -- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e1806d270 msgr2=0x7f5e1813ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 1 --2- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e1806d270 0x7f5e1813ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 1 -- 172.21.15.5:0/3503878017 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e1806c950 msgr2=0x7f5e18134880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 1 --2- 172.21.15.5:0/3503878017 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e1806c950 0x7f5e18134880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 10 monclient: _finish_hunting 0 2024-08-18T21:10:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 1 monclient: found mon.noname-e 2024-08-18T21:10:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:10:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 1 -- 172.21.15.5:0/3503878017 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e18120220 con 0x7f5e180a1c40 2024-08-18T21:10:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e17fff640 1 --2- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5e1806d270 0x7f5e1813ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 1 -- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e180a1c40 msgr2=0x7f5e1813b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1d757640 1 --2- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e180a1c40 0x7f5e1813b140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000efc0 tx=0x7f5e1000c490 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e157fa640 1 -- 172.21.15.5:0/3503878017 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5e10003e10 con 0x7f5e180a1c40 2024-08-18T21:10:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e157fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:10:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e157fa640 10 monclient: dump: 2024-08-18T21:10:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.492 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e157fa640 10 monclient: _finish_auth 0 2024-08-18T21:10:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e157fa640 10 monclient: _check_auth_tickets 2024-08-18T21:10:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:44.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e157fa640 1 -- 172.21.15.5:0/3503878017 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e1000cd30 con 0x7f5e180a1c40 2024-08-18T21:10:44.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 5 monclient: authenticate success, global_id 55619 2024-08-18T21:10:44.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 10 monclient: _renew_subs 2024-08-18T21:10:44.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:10:44.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 1 -- 172.21.15.5:0/3503878017 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e1813de80 con 0x7f5e180a1c40 2024-08-18T21:10:44.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e157fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:44.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e157fa640 1 -- 172.21.15.5:0/3503878017 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5e100044a0 con 0x7f5e180a1c40 2024-08-18T21:10:44.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e157fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:10:44.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e157fa640 10 monclient: dump: 2024-08-18T21:10:44.493 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.493 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.493 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.494 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.494 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.494 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.494 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.494 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.494 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.494 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.494 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.494 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.494 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.494 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.494 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.494 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 10 monclient: _renew_subs 2024-08-18T21:10:44.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e16ffd640 4 set_mon_vals no callback set 2024-08-18T21:10:44.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:10:44.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.473+0000 7f5e1f1ba640 1 -- 172.21.15.5:0/3503878017 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e180690c0 con 0x7f5e180a1c40 2024-08-18T21:10:44.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e1f1ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:44.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e1f1ba640 1 --2- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e181cf410 0x7f5e1813b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e1f1ba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e1f1ba640 1 -- 172.21.15.5:0/3503878017 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f5e1813dbe0 con 0x7f5e181cf410 2024-08-18T21:10:44.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e1cf56640 1 --2- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e181cf410 0x7f5e1813b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e1cf56640 10 monclient: get_auth_request con 0x7f5e181cf410 auth_method 0 2024-08-18T21:10:44.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e1cf56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e1cf56640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e1cf56640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e1cf56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e1cf56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e1cf56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e157fa640 1 -- 172.21.15.5:0/3503878017 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f5e10012050 con 0x7f5e180a1c40 2024-08-18T21:10:44.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e1cf56640 10 monclient(hunting): handle_auth_done global_id 55628 payload 824 2024-08-18T21:10:44.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e1cf56640 1 -- 172.21.15.5:0/3503878017 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e18068cb0 con 0x7f5e181cf410 2024-08-18T21:10:44.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e157fa640 1 --2- 172.21.15.5:0/3503878017 >> v2:172.21.15.157:6812/631023601 conn(0x7f5df803bdc0 0x7f5df803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e157fa640 1 -- 172.21.15.5:0/3503878017 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(212..212 src has 22..212) ==== 3898+0+0 (secure 0 0 0) 0x7f5e1004ebb0 con 0x7f5e180a1c40 2024-08-18T21:10:44.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e17fff640 1 --2- 172.21.15.5:0/3503878017 >> v2:172.21.15.157:6812/631023601 conn(0x7f5df803bdc0 0x7f5df803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e17fff640 10 monclient: get_auth_request con 0x7f5df803bdc0 auth_method 0 2024-08-18T21:10:44.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e1cf56640 1 -- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e181cf410 msgr2=0x7f5e1813b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e1cf56640 1 --2- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e181cf410 0x7f5e1813b680 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800f4b0 tx=0x7f5e0800f970 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e157fa640 1 -- 172.21.15.5:0/3503878017 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5e08019020 con 0x7f5e181cf410 2024-08-18T21:10:44.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e157fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:10:44.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e157fa640 10 monclient: dump: 2024-08-18T21:10:44.499 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.499 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.499 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.499 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.499 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.500 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.500 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.500 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.500 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.500 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.500 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.500 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.500 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.500 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.500 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.500 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e157fa640 1 -- 172.21.15.5:0/3503878017 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5e08014880 con 0x7f5e181cf410 2024-08-18T21:10:44.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e157fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:44.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e157fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:44.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e157fa640 1 -- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e181cf410 msgr2=0x7f5e1813b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e157fa640 1 --2- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e181cf410 0x7f5e1813b680 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800f4b0 tx=0x7f5e0800f970 comp rx=0 tx=0).stop 2024-08-18T21:10:44.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e157fa640 1 -- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e181cf410 msgr2=0x7f5e1813b680 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:44.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.477+0000 7f5e157fa640 1 --2- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e181cf410 0x7f5e1813b680 secure :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800f4b0 tx=0x7f5e0800f970 comp rx=0 tx=0).stop 2024-08-18T21:10:44.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.481+0000 7f5e17fff640 1 --2- 172.21.15.5:0/3503878017 >> v2:172.21.15.157:6812/631023601 conn(0x7f5df803bdc0 0x7f5df803e280 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5e180a4ca0 tx=0x7f5e000a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.485+0000 7f5e1f1ba640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:44.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.485+0000 7f5e1f1ba640 1 --2- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e18134dc0 0x7f5e181359f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.485+0000 7f5e1f1ba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.485+0000 7f5e1f1ba640 1 -- 172.21.15.5:0/3503878017 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f5e18051140 con 0x7f5e18134dc0 2024-08-18T21:10:44.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.485+0000 7f5e1cf56640 1 --2- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e18134dc0 0x7f5e181359f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.485+0000 7f5e1cf56640 10 monclient: get_auth_request con 0x7f5e18134dc0 auth_method 0 2024-08-18T21:10:44.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.485+0000 7f5e1cf56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.485+0000 7f5e1cf56640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.485+0000 7f5e1cf56640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.485+0000 7f5e1cf56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.485+0000 7f5e1cf56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.485+0000 7f5e1cf56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.485+0000 7f5e1cf56640 10 monclient(hunting): handle_auth_done global_id 55637 payload 824 2024-08-18T21:10:44.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.485+0000 7f5e1cf56640 1 -- 172.21.15.5:0/3503878017 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5e1806b7e0 con 0x7f5e18134dc0 2024-08-18T21:10:44.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e1cf56640 1 -- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e18134dc0 msgr2=0x7f5e181359f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e1cf56640 1 --2- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e18134dc0 0x7f5e181359f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800f4b0 tx=0x7f5e080046d0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e157fa640 1 -- 172.21.15.5:0/3503878017 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5e08019040 con 0x7f5e18134dc0 2024-08-18T21:10:44.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e157fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:10:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e157fa640 10 monclient: dump: 2024-08-18T21:10:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.504 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e157fa640 1 -- 172.21.15.5:0/3503878017 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f5e08004030 con 0x7f5e18134dc0 2024-08-18T21:10:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e157fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e157fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e157fa640 1 -- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e18134dc0 msgr2=0x7f5e181359f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e157fa640 1 --2- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e18134dc0 0x7f5e181359f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800f4b0 tx=0x7f5e080046d0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e157fa640 1 -- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e18134dc0 msgr2=0x7f5e181359f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e157fa640 1 --2- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e18134dc0 0x7f5e181359f0 secure :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800f4b0 tx=0x7f5e080046d0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.505 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:44.505 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:44.505 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:44.505 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:44.505 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:44.505 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 300610, 2024-08-18T21:10:44.505 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:44.505 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:44.505 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:44.505 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:44.505 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:44.505 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:44.506 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:44.506 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:44.506 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:44.506 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:44.506 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.506 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:10:44.506 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:44.506 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:44.506 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:44.506 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:44.506 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:44.506 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:44.507 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:44.507 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:44.507 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:44.507 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:44.507 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:44.507 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:44.507 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:44.507 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:44.507 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.507 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:44.507 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:44.507 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:44.507 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:44.508 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:44.508 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:44.508 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:44.508 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:44.508 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:44.508 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:44.508 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:44.508 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:44.508 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:44.508 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.508 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:44.508 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:44.508 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:44.509 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:44.509 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:44.509 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:44.509 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:44.509 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:44.509 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:44.509 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:44.509 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:44.509 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:44.509 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:44.509 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:44.509 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:44.509 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:44.510 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:44.510 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:44.510 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:44.510 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:44.510 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:44.510 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:44.510 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:44.510 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:44.510 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:44.510 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:44.510 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:44.510 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:44.510 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.511 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:44.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.511 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:44.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.511 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:44.511 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:44.511 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.511 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.511 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.511 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:44.511 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.512 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.512 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:44.512 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.512 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.512 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.512 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:44.512 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:44.512 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.512 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.512 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.512 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.513 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:44.513 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:44.513 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.513 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.513 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.513 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.513 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:44.513 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.513 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.513 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.513 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:44.513 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.514 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.514 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.514 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:44.514 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:44.514 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.514 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.514 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.514 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.514 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:44.514 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:44.514 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.515 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.515 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.515 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.515 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:44.515 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.515 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.515 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.515 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:44.515 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.515 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.515 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.516 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:44.516 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:44.516 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.516 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.516 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.516 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.516 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.516 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:44.516 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:44.516 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.516 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.516 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.516 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.517 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:44.517 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.517 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.517 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.517 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:44.517 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.517 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.517 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.517 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:44.517 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:44.517 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.518 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.518 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.518 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.518 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:44.518 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:44.518 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.518 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.518 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.518 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.518 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:44.518 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.519 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.519 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.519 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:44.519 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.519 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.519 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.519 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:44.519 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:44.519 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.519 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.519 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.520 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.520 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:44.520 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:44.520 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.520 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.520 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.520 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.520 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:44.520 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.520 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.520 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.520 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.520 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:44.520 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.521 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.521 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.521 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:44.521 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:44.521 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.521 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.521 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.521 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.521 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:44.521 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:44.521 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.522 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.522 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.522 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.522 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:44.522 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.522 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.522 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.522 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:44.522 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.522 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.522 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.523 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:44.523 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:44.523 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.523 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.523 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.523 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.523 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:44.523 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:44.523 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.523 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.523 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.523 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.524 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:44.524 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.524 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.524 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.524 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:44.524 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.524 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.524 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.524 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:44.524 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:44.524 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.525 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.525 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.525 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.525 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:44.525 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:44.525 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.525 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.525 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.525 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.525 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:44.525 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.525 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.526 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.526 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:44.526 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.526 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.526 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.526 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:44.526 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:44.526 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.526 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.526 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.526 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.526 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.527 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:44.527 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:44.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.527 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:44.527 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:44.527 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:44.527 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.527 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:10:44.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.527 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:44.527 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:44.528 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:10:44.528 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.528 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.528 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:44.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.528 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:44.528 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:44.528 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:10:44.528 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.528 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.528 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:44.528 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:44.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e1f1ba640 1 -- 172.21.15.5:0/3503878017 >> v2:172.21.15.157:6812/631023601 conn(0x7f5df803bdc0 msgr2=0x7f5df803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e1f1ba640 1 --2- 172.21.15.5:0/3503878017 >> v2:172.21.15.157:6812/631023601 conn(0x7f5df803bdc0 0x7f5df803e280 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5e180a4ca0 tx=0x7f5e000a6000 comp rx=0 tx=0).stop 2024-08-18T21:10:44.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e1f1ba640 10 monclient: shutdown 2024-08-18T21:10:44.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e1f1ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:44.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e1f1ba640 1 -- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e180a1c40 msgr2=0x7f5e1813b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e1f1ba640 1 --2- 172.21.15.5:0/3503878017 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5e180a1c40 0x7f5e1813b140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000efc0 tx=0x7f5e1000c490 comp rx=0 tx=0).stop 2024-08-18T21:10:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e1d757640 1 -- 172.21.15.5:0/3503878017 reap_dead start 2024-08-18T21:10:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e1d757640 1 -- 172.21.15.5:0/3503878017 reap_dead start 2024-08-18T21:10:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e1f1ba640 1 -- 172.21.15.5:0/3503878017 shutdown_connections 2024-08-18T21:10:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e1f1ba640 1 -- 172.21.15.5:0/3503878017 >> 172.21.15.5:0/3503878017 conn(0x7f5e180688d0 msgr2=0x7f5e1813e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e1f1ba640 1 -- 172.21.15.5:0/3503878017 shutdown_connections 2024-08-18T21:10:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.489+0000 7f5e1f1ba640 1 -- 172.21.15.5:0/3503878017 wait complete. 2024-08-18T21:10:44.531 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:44.531 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:10:44.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:10:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 10 monclient: get_monmap_and_config 2024-08-18T21:10:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 10 monclient: build_initial_monmap 2024-08-18T21:10:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 10 monclient: monmap: 2024-08-18T21:10:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:44.701385+0000 2024-08-18T21:10:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:44.701385+0000 2024-08-18T21:10:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:44.701 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 1 Processor -- start 2024-08-18T21:10:44.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 1 -- start start 2024-08-18T21:10:44.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 10 monclient: init 2024-08-18T21:10:44.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 10 monclient: _add_conns ranks=[4,9,8,6,7,0,5,2,1,10,3] 2024-08-18T21:10:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1080a6ce0 0x7fe1080a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 10 monclient(hunting): picked mon.noname-c con 0x7fe1080a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe1080a7600 0x7fe108139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 10 monclient(hunting): picked mon.noname-a con 0x7fe1080a7600 addr v2:172.21.15.5:3300/0 2024-08-18T21:10:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe108139fe0 0x7fe10813a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 10 monclient(hunting): picked mon.noname-e con 0x7fe108139fe0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe1080a5000 con 0x7fe1080a7600 2024-08-18T21:10:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fe1080a4360 con 0x7fe1080a6ce0 2024-08-18T21:10:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fe1080a45d0 con 0x7fe108139fe0 2024-08-18T21:10:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe10d3c3640 10 monclient(hunting): authenticate will time out at 1411.714558s 2024-08-18T21:10:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1080a6ce0 0x7fe1080a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1080a6ce0 0x7fe1080a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:51538/0 (socket says 172.21.15.5:51538) 2024-08-18T21:10:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 1 -- 172.21.15.5:0/474654656 learned_addr learned my addr 172.21.15.5:0/474654656 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 10 monclient(hunting): get_auth_request con 0x7fe1080a6ce0 auth_method 0 2024-08-18T21:10:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe1077fe640 1 --2- 172.21.15.5:0/474654656 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe108139fe0 0x7fe10813a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe0fffff640 1 --2- 172.21.15.5:0/474654656 >> v2:172.21.15.5:3300/0 conn(0x7fe1080a7600 0x7fe108139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe1077fe640 10 monclient(hunting): get_auth_request con 0x7fe108139fe0 auth_method 0 2024-08-18T21:10:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe1077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe1077fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe1077fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe0fffff640 10 monclient(hunting): get_auth_request con 0x7fe1080a7600 auth_method 0 2024-08-18T21:10:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe0fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe0fffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe0fffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe1077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe1077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe1077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe0fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe0fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe0fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 10 monclient(hunting): handle_auth_done global_id 6601 payload 274 2024-08-18T21:10:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 1 -- 172.21.15.5:0/474654656 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe108139fe0 msgr2=0x7fe10813a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 1 --2- 172.21.15.5:0/474654656 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe108139fe0 0x7fe10813a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 1 -- 172.21.15.5:0/474654656 >> v2:172.21.15.5:3300/0 conn(0x7fe1080a7600 msgr2=0x7fe108139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 1 --2- 172.21.15.5:0/474654656 >> v2:172.21.15.5:3300/0 conn(0x7fe1080a7600 0x7fe108139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:10:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 1 monclient: found mon.noname-c 2024-08-18T21:10:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:10:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe106ffd640 1 -- 172.21.15.5:0/474654656 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1080a32d0 con 0x7fe1080a6ce0 2024-08-18T21:10:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.697+0000 7fe1077fe640 1 --2- 172.21.15.5:0/474654656 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe108139fe0 0x7fe10813a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe106ffd640 1 -- 172.21.15.5:0/474654656 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1080a6ce0 msgr2=0x7fe1080a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe106ffd640 1 --2- 172.21.15.5:0/474654656 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1080a6ce0 0x7fe1080a70c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80098a0 tx=0x7fe0f801c400 comp rx=0 tx=0).ready entity=mon.4 client_cookie=428dade1bcf2417 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe1067fc640 1 -- 172.21.15.5:0/474654656 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe0f80b0070 con 0x7fe1080a6ce0 2024-08-18T21:10:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe1067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe1067fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:10:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe1067fc640 10 monclient: dump: 2024-08-18T21:10:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.715 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe1067fc640 10 monclient: _finish_auth 0 2024-08-18T21:10:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe1067fc640 10 monclient: _check_auth_tickets 2024-08-18T21:10:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe1067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe1067fc640 1 -- 172.21.15.5:0/474654656 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f80aa810 con 0x7fe1080a6ce0 2024-08-18T21:10:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe1067fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe1067fc640 1 -- 172.21.15.5:0/474654656 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe0f80aae30 con 0x7fe1080a6ce0 2024-08-18T21:10:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe10d3c3640 5 monclient: authenticate success, global_id 6601 2024-08-18T21:10:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe10d3c3640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe10d3c3640 4 set_mon_vals no callback set 2024-08-18T21:10:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe1067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe1067fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.701+0000 7fe1067fc640 10 monclient: dump: 2024-08-18T21:10:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.717 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 10 monclient: shutdown 2024-08-18T21:10:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 -- 172.21.15.5:0/474654656 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1080a6ce0 msgr2=0x7fe1080a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 --2- 172.21.15.5:0/474654656 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1080a6ce0 0x7fe1080a70c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80098a0 tx=0x7fe0f801c400 comp rx=0 tx=0).stop 2024-08-18T21:10:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 -- 172.21.15.5:0/474654656 shutdown_connections 2024-08-18T21:10:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 --2- 172.21.15.5:0/474654656 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe108139fe0 0x7fe10813a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 --2- 172.21.15.5:0/474654656 >> v2:172.21.15.5:3300/0 conn(0x7fe1080a7600 0x7fe108139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 --2- 172.21.15.5:0/474654656 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe1080a6ce0 0x7fe1080a70c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 -- 172.21.15.5:0/474654656 >> 172.21.15.5:0/474654656 conn(0x7fe1080acbc0 msgr2=0x7fe1080a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 -- 172.21.15.5:0/474654656 shutdown_connections 2024-08-18T21:10:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 -- 172.21.15.5:0/474654656 wait complete. 2024-08-18T21:10:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 10 monclient: build_initial_monmap 2024-08-18T21:10:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 10 monclient: monmap: 2024-08-18T21:10:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:44.719 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 Processor -- start 2024-08-18T21:10:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 -- start start 2024-08-18T21:10:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 10 monclient: init 2024-08-18T21:10:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 10 monclient: _add_conns ranks=[5,3,0,6,8,1,4,2,7] 2024-08-18T21:10:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe1080a6ce0 0x7fe108135db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 10 monclient(hunting): picked mon.noname-h con 0x7fe1080a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1080a7600 0x7fe1081362f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 10 monclient(hunting): picked mon.noname-g con 0x7fe1080a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe108139fe0 0x7fe10813b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 10 monclient(hunting): picked mon.noname-a con 0x7fe108139fe0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:10:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe1080a79e0 con 0x7fe108139fe0 2024-08-18T21:10:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe1080a8220 con 0x7fe1080a7600 2024-08-18T21:10:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe10813de50 con 0x7fe1080a6ce0 2024-08-18T21:10:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe10d3c3640 10 monclient(hunting): authenticate will time out at 1411.722062s 2024-08-18T21:10:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe108139fe0 0x7fe10813b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe108139fe0 0x7fe10813b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48036/0 (socket says 172.21.15.5:48036) 2024-08-18T21:10:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 1 -- 172.21.15.5:0/3746544491 learned_addr learned my addr 172.21.15.5:0/3746544491 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 10 monclient(hunting): get_auth_request con 0x7fe108139fe0 auth_method 0 2024-08-18T21:10:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 10 monclient(hunting): handle_auth_done global_id 84807 payload 824 2024-08-18T21:10:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 1 -- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe1080a6ce0 msgr2=0x7fe108135db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe0fffff640 1 --2- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1080a7600 0x7fe1081362f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe106ffd640 1 --2- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe1080a6ce0 0x7fe108135db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 1 --2- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe1080a6ce0 0x7fe108135db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 1 -- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1080a7600 msgr2=0x7fe1081362f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 1 --2- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1080a7600 0x7fe1081362f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 10 monclient: _finish_hunting 0 2024-08-18T21:10:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 1 monclient: found mon.noname-a 2024-08-18T21:10:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:10:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.705+0000 7fe1077fe640 1 -- 172.21.15.5:0/3746544491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10813f370 con 0x7fe108139fe0 2024-08-18T21:10:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe1077fe640 1 -- 172.21.15.5:0/3746544491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe108139fe0 msgr2=0x7fe10813b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe1077fe640 1 --2- 172.21.15.5:0/3746544491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe108139fe0 0x7fe10813b800 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe10000efc0 tx=0x7fe10000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0ff7fe640 1 -- 172.21.15.5:0/3746544491 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe100018030 con 0x7fe108139fe0 2024-08-18T21:10:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0ff7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:10:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0ff7fe640 10 monclient: dump: 2024-08-18T21:10:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.724 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0ff7fe640 10 monclient: _finish_auth 0 2024-08-18T21:10:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0ff7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:10:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0ff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0ff7fe640 1 -- 172.21.15.5:0/3746544491 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1000148f0 con 0x7fe108139fe0 2024-08-18T21:10:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe10d3c3640 5 monclient: authenticate success, global_id 84807 2024-08-18T21:10:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0ff7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe10d3c3640 10 monclient: _renew_subs 2024-08-18T21:10:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0ff7fe640 1 -- 172.21.15.5:0/3746544491 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe1000133e0 con 0x7fe108139fe0 2024-08-18T21:10:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe10d3c3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:10:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe10d3c3640 1 -- 172.21.15.5:0/3746544491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1080a1b90 con 0x7fe108139fe0 2024-08-18T21:10:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0ff7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe105ffb640 4 set_mon_vals no callback set 2024-08-18T21:10:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0ff7fe640 10 monclient: dump: 2024-08-18T21:10:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.726 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe10d3c3640 10 monclient: _renew_subs 2024-08-18T21:10:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe10d3c3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:10:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe10d3c3640 1 -- 172.21.15.5:0/3746544491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1080aa790 con 0x7fe108139fe0 2024-08-18T21:10:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe10d3c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe10d3c3640 1 --2- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe10813bd40 0x7fe10813c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe10d3c3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe10d3c3640 1 -- 172.21.15.5:0/3746544491 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe1080a7b60 con 0x7fe10813bd40 2024-08-18T21:10:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0ff7fe640 1 -- 172.21.15.5:0/3746544491 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe10001b070 con 0x7fe108139fe0 2024-08-18T21:10:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe106ffd640 1 --2- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe10813bd40 0x7fe10813c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe106ffd640 10 monclient: get_auth_request con 0x7fe10813bd40 auth_method 0 2024-08-18T21:10:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe106ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe106ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe106ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0ff7fe640 1 --2- 172.21.15.5:0/3746544491 >> v2:172.21.15.157:6812/631023601 conn(0x7fe0e803bdf0 0x7fe0e803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0ff7fe640 1 -- 172.21.15.5:0/3746544491 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(212..212 src has 22..212) ==== 3898+0+0 (secure 0 0 0) 0x7fe100019070 con 0x7fe108139fe0 2024-08-18T21:10:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe106ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe106ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe106ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0fffff640 1 --2- 172.21.15.5:0/3746544491 >> v2:172.21.15.157:6812/631023601 conn(0x7fe0e803bdf0 0x7fe0e803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe0fffff640 10 monclient: get_auth_request con 0x7fe0e803bdf0 auth_method 0 2024-08-18T21:10:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe106ffd640 10 monclient(hunting): handle_auth_done global_id 104230 payload 824 2024-08-18T21:10:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.709+0000 7fe106ffd640 1 -- 172.21.15.5:0/3746544491 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe10813c660 con 0x7fe10813bd40 2024-08-18T21:10:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.713+0000 7fe106ffd640 1 -- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe10813bd40 msgr2=0x7fe10813c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.713+0000 7fe106ffd640 1 --2- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe10813bd40 0x7fe10813c120 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe1080a9780 tx=0x7fe0f80191a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.713+0000 7fe0fffff640 1 --2- 172.21.15.5:0/3746544491 >> v2:172.21.15.157:6812/631023601 conn(0x7fe0e803bdf0 0x7fe0e803e2b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe10813cf60 tx=0x7fe0f0008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.713+0000 7fe0ff7fe640 1 -- 172.21.15.5:0/3746544491 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe0f80b9020 con 0x7fe10813bd40 2024-08-18T21:10:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.713+0000 7fe0ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.713+0000 7fe0ff7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:10:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.713+0000 7fe0ff7fe640 10 monclient: dump: 2024-08-18T21:10:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.732 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.713+0000 7fe0ff7fe640 1 -- 172.21.15.5:0/3746544491 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe0f80093d0 con 0x7fe10813bd40 2024-08-18T21:10:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.713+0000 7fe0ff7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.713+0000 7fe0ff7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.713+0000 7fe0ff7fe640 1 -- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe10813bd40 msgr2=0x7fe10813c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.713+0000 7fe0ff7fe640 1 --2- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe10813bd40 0x7fe10813c120 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe1080a9780 tx=0x7fe0f80191a0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.713+0000 7fe0ff7fe640 1 -- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe10813bd40 msgr2=0x7fe10813c120 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.713+0000 7fe0ff7fe640 1 --2- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe10813bd40 0x7fe10813c120 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe1080a9780 tx=0x7fe0f80191a0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.721+0000 7fe10d3c3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.721+0000 7fe10d3c3640 1 --2- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe10809dd70 0x7fe10809e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.721+0000 7fe10d3c3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.721+0000 7fe10d3c3640 1 -- 172.21.15.5:0/3746544491 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe108051140 con 0x7fe10809dd70 2024-08-18T21:10:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.721+0000 7fe106ffd640 1 --2- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe10809dd70 0x7fe10809e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.721+0000 7fe106ffd640 10 monclient: get_auth_request con 0x7fe10809dd70 auth_method 0 2024-08-18T21:10:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.721+0000 7fe106ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.721+0000 7fe106ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.721+0000 7fe106ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.721+0000 7fe106ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.721+0000 7fe106ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.721+0000 7fe106ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.721+0000 7fe106ffd640 10 monclient(hunting): handle_auth_done global_id 104239 payload 824 2024-08-18T21:10:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.721+0000 7fe106ffd640 1 -- 172.21.15.5:0/3746544491 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe108069580 con 0x7fe10809dd70 2024-08-18T21:10:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe106ffd640 1 -- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe10809dd70 msgr2=0x7fe10809e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe106ffd640 1 --2- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe10809dd70 0x7fe10809e180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8000c10 tx=0x7fe0f80a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe0ff7fe640 1 -- 172.21.15.5:0/3746544491 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe0f80b9040 con 0x7fe10809dd70 2024-08-18T21:10:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe0ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe0ff7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:10:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe0ff7fe640 10 monclient: dump: 2024-08-18T21:10:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.735 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe0ff7fe640 1 -- 172.21.15.5:0/3746544491 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9246 (secure 0 0 0) 0x7fe0f80ca440 con 0x7fe10809dd70 2024-08-18T21:10:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe0ff7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe0ff7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe0ff7fe640 1 -- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe10809dd70 msgr2=0x7fe10809e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe0ff7fe640 1 --2- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe10809dd70 0x7fe10809e180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8000c10 tx=0x7fe0f80a8000 comp rx=0 tx=0).stop 2024-08-18T21:10:44.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe0ff7fe640 1 -- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe10809dd70 msgr2=0x7fe10809e180 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:44.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe0ff7fe640 1 --2- 172.21.15.5:0/3746544491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe10809dd70 0x7fe10809e180 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8000c10 tx=0x7fe0f80a8000 comp rx=0 tx=0).stop 2024-08-18T21:10:44.736 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:44.736 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:44.736 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:44.736 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:44.736 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:44.736 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 9215, 2024-08-18T21:10:44.736 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:44.737 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:44.737 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:44.737 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:44.737 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:44.737 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:44.737 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:44.737 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:44.737 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:44.737 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:44.737 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.737 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:10:44.737 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:44.737 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:44.737 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:44.738 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:44.738 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:44.738 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:44.738 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:44.738 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:44.738 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:44.738 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:44.738 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:44.738 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:44.738 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:44.738 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:44.738 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.738 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:44.739 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:44.739 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:44.739 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:44.739 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:44.739 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:44.739 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:44.739 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:44.739 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:44.739 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:44.739 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:44.739 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:44.739 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:44.739 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.740 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:44.740 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:44.740 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:44.740 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:44.740 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:44.740 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:44.740 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:44.740 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:44.740 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:44.740 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:44.740 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:44.740 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:44.740 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:44.741 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:44.741 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:44.741 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:44.741 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:44.741 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:44.741 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:44.741 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:44.741 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:44.741 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:44.741 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:44.741 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:44.741 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:44.741 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:44.741 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:44.742 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:44.742 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.742 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:44.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.742 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:44.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.742 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:44.742 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:44.742 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.742 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.742 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:44.743 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:44.743 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.743 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.743 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:44.743 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:44.743 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.744 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.744 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.744 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:44.744 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:44.744 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.744 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.744 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.744 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:44.744 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:44.745 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.745 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.745 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:44.745 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:44.745 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.745 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.745 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.746 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:44.746 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:44.746 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.746 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.746 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.746 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:44.746 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.746 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.746 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:44.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.747 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.747 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:44.747 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:44.747 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.747 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.747 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.747 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:44.747 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:44.748 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:44.748 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:44.748 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.748 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.748 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:44.749 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:44.749 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.749 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.749 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.749 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:44.749 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:44.749 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:44.750 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:44.750 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.750 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.750 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:44.751 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:44.751 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.751 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.751 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.751 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:44.751 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:44.751 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.751 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.751 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:44.752 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:44.752 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.752 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.752 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:44.752 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:44.752 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.753 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.753 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.753 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:44.753 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:44.753 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:44.753 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.754 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:44.754 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.754 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.754 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:44.754 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:44.754 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.754 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.754 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.755 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:44.755 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:44.755 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:44.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:44.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.756 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.756 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:44.756 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:44.756 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.756 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.756 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.756 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:44.756 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:44.756 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:44.757 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:44.757 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.757 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.757 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:44.758 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:44.758 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.758 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.758 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.758 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.758 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.758 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:44.758 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:44.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.758 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:44.758 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:44.758 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:44.759 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.759 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.759 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:44.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.759 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:44.759 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:44.759 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:44.759 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.759 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.759 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:44.759 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:44.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe10d3c3640 1 -- 172.21.15.5:0/3746544491 >> v2:172.21.15.157:6812/631023601 conn(0x7fe0e803bdf0 msgr2=0x7fe0e803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe10d3c3640 1 --2- 172.21.15.5:0/3746544491 >> v2:172.21.15.157:6812/631023601 conn(0x7fe0e803bdf0 0x7fe0e803e2b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe10813cf60 tx=0x7fe0f0008040 comp rx=0 tx=0).stop 2024-08-18T21:10:44.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe10d3c3640 10 monclient: shutdown 2024-08-18T21:10:44.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe10d3c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:44.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe10d3c3640 1 -- 172.21.15.5:0/3746544491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe108139fe0 msgr2=0x7fe10813b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe10d3c3640 1 --2- 172.21.15.5:0/3746544491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe108139fe0 0x7fe10813b800 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe10000efc0 tx=0x7fe10000c490 comp rx=0 tx=0).stop 2024-08-18T21:10:44.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe1077fe640 1 -- 172.21.15.5:0/3746544491 reap_dead start 2024-08-18T21:10:44.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe1077fe640 1 -- 172.21.15.5:0/3746544491 reap_dead start 2024-08-18T21:10:44.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe10d3c3640 1 -- 172.21.15.5:0/3746544491 shutdown_connections 2024-08-18T21:10:44.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe10d3c3640 1 -- 172.21.15.5:0/3746544491 >> 172.21.15.5:0/3746544491 conn(0x7fe1080acbc0 msgr2=0x7fe1080aaba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:44.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe10d3c3640 1 -- 172.21.15.5:0/3746544491 shutdown_connections 2024-08-18T21:10:44.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.725+0000 7fe10d3c3640 1 -- 172.21.15.5:0/3746544491 wait complete. 2024-08-18T21:10:44.762 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:44.762 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:10:44.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:10:44.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=838604968}) 2024-08-18T21:10:44.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=304257995}) 2024-08-18T21:10:44.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=838604968}) 2024-08-18T21:10:44.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=106236506}) 2024-08-18T21:10:44.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=838604968}) 2024-08-18T21:10:44.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1990795309}) 2024-08-18T21:10:44.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=838604968}) 2024-08-18T21:10:44.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3318507737}) 2024-08-18T21:10:44.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=838604968}) 2024-08-18T21:10:44.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1910192172}) 2024-08-18T21:10:44.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=838604968}) 2024-08-18T21:10:44.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4023809561}) 2024-08-18T21:10:44.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=838604968}) 2024-08-18T21:10:44.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=594824442}) 2024-08-18T21:10:44.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=838604968}) 2024-08-18T21:10:44.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.773+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=511494915}) 2024-08-18T21:10:44.781 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.781 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707021079}) 2024-08-18T21:10:44.781 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=735463785}) 2024-08-18T21:10:44.781 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.781 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707021079}) 2024-08-18T21:10:44.782 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=230847766}) 2024-08-18T21:10:44.782 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.782 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707021079}) 2024-08-18T21:10:44.782 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1187546316}) 2024-08-18T21:10:44.782 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.782 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707021079}) 2024-08-18T21:10:44.782 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3024355878}) 2024-08-18T21:10:44.782 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.782 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707021079}) 2024-08-18T21:10:44.782 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1035624308}) 2024-08-18T21:10:44.782 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.782 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707021079}) 2024-08-18T21:10:44.783 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2093088524}) 2024-08-18T21:10:44.783 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.783 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707021079}) 2024-08-18T21:10:44.783 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=109111082}) 2024-08-18T21:10:44.783 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.783 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707021079}) 2024-08-18T21:10:44.783 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.777+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=379171642}) 2024-08-18T21:10:44.785 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.785 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2174405141}) 2024-08-18T21:10:44.785 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1471686150}) 2024-08-18T21:10:44.785 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.785 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2174405141}) 2024-08-18T21:10:44.785 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4234961702}) 2024-08-18T21:10:44.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2174405141}) 2024-08-18T21:10:44.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=190860164}) 2024-08-18T21:10:44.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2174405141}) 2024-08-18T21:10:44.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2075228310}) 2024-08-18T21:10:44.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2174405141}) 2024-08-18T21:10:44.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3214274312}) 2024-08-18T21:10:44.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2174405141}) 2024-08-18T21:10:44.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2431134760}) 2024-08-18T21:10:44.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2174405141}) 2024-08-18T21:10:44.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3485858365}) 2024-08-18T21:10:44.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2174405141}) 2024-08-18T21:10:44.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.781+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4070540177}) 2024-08-18T21:10:44.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4167795731}) 2024-08-18T21:10:44.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1748614073}) 2024-08-18T21:10:44.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4167795731}) 2024-08-18T21:10:44.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2720579411}) 2024-08-18T21:10:44.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4167795731}) 2024-08-18T21:10:44.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2090084526}) 2024-08-18T21:10:44.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4167795731}) 2024-08-18T21:10:44.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3886086166}) 2024-08-18T21:10:44.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4167795731}) 2024-08-18T21:10:44.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3861677392}) 2024-08-18T21:10:44.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4167795731}) 2024-08-18T21:10:44.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3586604759}) 2024-08-18T21:10:44.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4167795731}) 2024-08-18T21:10:44.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=553605271}) 2024-08-18T21:10:44.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4167795731}) 2024-08-18T21:10:44.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.785+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3321193121}) 2024-08-18T21:10:44.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1792561130}) 2024-08-18T21:10:44.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2004536128}) 2024-08-18T21:10:44.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1792561130}) 2024-08-18T21:10:44.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2589585986}) 2024-08-18T21:10:44.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1792561130}) 2024-08-18T21:10:44.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1096150642}) 2024-08-18T21:10:44.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1792561130}) 2024-08-18T21:10:44.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1991607808}) 2024-08-18T21:10:44.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1792561130}) 2024-08-18T21:10:44.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1011934511}) 2024-08-18T21:10:44.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1792561130}) 2024-08-18T21:10:44.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3230289538}) 2024-08-18T21:10:44.795 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.795 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1792561130}) 2024-08-18T21:10:44.795 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1817011719}) 2024-08-18T21:10:44.795 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.795 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1792561130}) 2024-08-18T21:10:44.795 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2699113069}) 2024-08-18T21:10:44.798 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.798 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2846961171}) 2024-08-18T21:10:44.798 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1134155538}) 2024-08-18T21:10:44.798 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.799 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2846961171}) 2024-08-18T21:10:44.799 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.789+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=912360661}) 2024-08-18T21:10:44.799 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.799 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2846961171}) 2024-08-18T21:10:44.799 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2467142056}) 2024-08-18T21:10:44.799 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.799 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2846961171}) 2024-08-18T21:10:44.799 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1237094005}) 2024-08-18T21:10:44.799 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.799 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2846961171}) 2024-08-18T21:10:44.799 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=334754782}) 2024-08-18T21:10:44.800 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.800 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2846961171}) 2024-08-18T21:10:44.800 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1806557030}) 2024-08-18T21:10:44.800 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.800 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2846961171}) 2024-08-18T21:10:44.800 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3289086653}) 2024-08-18T21:10:44.800 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.800 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2846961171}) 2024-08-18T21:10:44.800 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=303390899}) 2024-08-18T21:10:44.800 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.800 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102459092}) 2024-08-18T21:10:44.800 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2885034730}) 2024-08-18T21:10:44.800 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.801 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102459092}) 2024-08-18T21:10:44.801 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=113789217}) 2024-08-18T21:10:44.801 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.801 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102459092}) 2024-08-18T21:10:44.801 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1781886047}) 2024-08-18T21:10:44.801 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.801 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102459092}) 2024-08-18T21:10:44.801 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2209779038}) 2024-08-18T21:10:44.801 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.801 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102459092}) 2024-08-18T21:10:44.801 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=734589093}) 2024-08-18T21:10:44.801 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.801 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102459092}) 2024-08-18T21:10:44.801 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3553421895}) 2024-08-18T21:10:44.802 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.802 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102459092}) 2024-08-18T21:10:44.802 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4057101662}) 2024-08-18T21:10:44.802 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.802 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102459092}) 2024-08-18T21:10:44.802 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.793+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3636840963}) 2024-08-18T21:10:44.806 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.806 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2240075240}) 2024-08-18T21:10:44.806 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3263549557}) 2024-08-18T21:10:44.807 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.807 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2240075240}) 2024-08-18T21:10:44.807 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1755757674}) 2024-08-18T21:10:44.807 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.807 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2240075240}) 2024-08-18T21:10:44.807 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3072224454}) 2024-08-18T21:10:44.807 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.807 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2240075240}) 2024-08-18T21:10:44.807 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=608781272}) 2024-08-18T21:10:44.807 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.807 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2240075240}) 2024-08-18T21:10:44.807 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2636501679}) 2024-08-18T21:10:44.807 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.807 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2240075240}) 2024-08-18T21:10:44.808 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3934724935}) 2024-08-18T21:10:44.808 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.808 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2240075240}) 2024-08-18T21:10:44.808 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2701967594}) 2024-08-18T21:10:44.808 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.808 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2240075240}) 2024-08-18T21:10:44.808 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.797+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=396356030}) 2024-08-18T21:10:44.808 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.808 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1357813564}) 2024-08-18T21:10:44.808 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3652475793}) 2024-08-18T21:10:44.808 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.808 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1357813564}) 2024-08-18T21:10:44.808 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2034462850}) 2024-08-18T21:10:44.809 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.809 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1357813564}) 2024-08-18T21:10:44.809 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=727822709}) 2024-08-18T21:10:44.809 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.809 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1357813564}) 2024-08-18T21:10:44.809 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4124475014}) 2024-08-18T21:10:44.809 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.809 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1357813564}) 2024-08-18T21:10:44.809 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3879891037}) 2024-08-18T21:10:44.809 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.809 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1357813564}) 2024-08-18T21:10:44.809 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4216486568}) 2024-08-18T21:10:44.809 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.809 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1357813564}) 2024-08-18T21:10:44.810 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3013998483}) 2024-08-18T21:10:44.810 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.810 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1357813564}) 2024-08-18T21:10:44.810 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.801+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3099729566}) 2024-08-18T21:10:44.816 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.816 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1630584021}) 2024-08-18T21:10:44.817 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2775282006}) 2024-08-18T21:10:44.817 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.817 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1630584021}) 2024-08-18T21:10:44.817 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2103028222}) 2024-08-18T21:10:44.817 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.817 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1630584021}) 2024-08-18T21:10:44.817 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4204203021}) 2024-08-18T21:10:44.817 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.817 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1630584021}) 2024-08-18T21:10:44.817 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=640355683}) 2024-08-18T21:10:44.817 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.817 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1630584021}) 2024-08-18T21:10:44.817 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2595251304}) 2024-08-18T21:10:44.818 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.818 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1630584021}) 2024-08-18T21:10:44.818 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3907805260}) 2024-08-18T21:10:44.818 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.818 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1630584021}) 2024-08-18T21:10:44.818 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=999889735}) 2024-08-18T21:10:44.818 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.818 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1630584021}) 2024-08-18T21:10:44.818 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.805+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2757602628}) 2024-08-18T21:10:44.818 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.818 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=182091887}) 2024-08-18T21:10:44.818 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3305917822}) 2024-08-18T21:10:44.818 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.819 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=182091887}) 2024-08-18T21:10:44.819 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4196794514}) 2024-08-18T21:10:44.819 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.819 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=182091887}) 2024-08-18T21:10:44.819 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4112367760}) 2024-08-18T21:10:44.819 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.819 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=182091887}) 2024-08-18T21:10:44.819 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2852228091}) 2024-08-18T21:10:44.819 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.819 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=182091887}) 2024-08-18T21:10:44.819 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1685871121}) 2024-08-18T21:10:44.819 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.819 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=182091887}) 2024-08-18T21:10:44.820 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=509944664}) 2024-08-18T21:10:44.820 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.820 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=182091887}) 2024-08-18T21:10:44.820 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2166876385}) 2024-08-18T21:10:44.820 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.820 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=182091887}) 2024-08-18T21:10:44.820 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.809+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=293664552}) 2024-08-18T21:10:44.820 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.820 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504303675}) 2024-08-18T21:10:44.820 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2419584268}) 2024-08-18T21:10:44.820 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.820 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504303675}) 2024-08-18T21:10:44.820 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4210933987}) 2024-08-18T21:10:44.821 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.821 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504303675}) 2024-08-18T21:10:44.821 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4079337325}) 2024-08-18T21:10:44.821 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.821 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504303675}) 2024-08-18T21:10:44.821 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3885646516}) 2024-08-18T21:10:44.821 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.821 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504303675}) 2024-08-18T21:10:44.821 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=864274435}) 2024-08-18T21:10:44.821 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.821 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504303675}) 2024-08-18T21:10:44.821 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1189257863}) 2024-08-18T21:10:44.821 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.821 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504303675}) 2024-08-18T21:10:44.822 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2593828367}) 2024-08-18T21:10:44.822 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.822 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504303675}) 2024-08-18T21:10:44.822 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.813+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1139182030}) 2024-08-18T21:10:44.824 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.824 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544603069}) 2024-08-18T21:10:44.824 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=965929186}) 2024-08-18T21:10:44.824 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.824 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544603069}) 2024-08-18T21:10:44.824 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4010794575}) 2024-08-18T21:10:44.824 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544603069}) 2024-08-18T21:10:44.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1275731562}) 2024-08-18T21:10:44.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544603069}) 2024-08-18T21:10:44.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4050323402}) 2024-08-18T21:10:44.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544603069}) 2024-08-18T21:10:44.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1997324566}) 2024-08-18T21:10:44.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544603069}) 2024-08-18T21:10:44.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3438954204}) 2024-08-18T21:10:44.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544603069}) 2024-08-18T21:10:44.826 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=470718321}) 2024-08-18T21:10:44.826 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.826 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544603069}) 2024-08-18T21:10:44.826 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.821+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1333392716}) 2024-08-18T21:10:44.828 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.828 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3521321227}) 2024-08-18T21:10:44.828 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=191839419}) 2024-08-18T21:10:44.828 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.828 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3521321227}) 2024-08-18T21:10:44.828 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=416996834}) 2024-08-18T21:10:44.828 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.828 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3521321227}) 2024-08-18T21:10:44.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2501192645}) 2024-08-18T21:10:44.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3521321227}) 2024-08-18T21:10:44.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=446138238}) 2024-08-18T21:10:44.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3521321227}) 2024-08-18T21:10:44.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2488277136}) 2024-08-18T21:10:44.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3521321227}) 2024-08-18T21:10:44.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1153322922}) 2024-08-18T21:10:44.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3521321227}) 2024-08-18T21:10:44.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1109305966}) 2024-08-18T21:10:44.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.830 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3521321227}) 2024-08-18T21:10:44.830 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2028866654}) 2024-08-18T21:10:44.832 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.832 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=509589011}) 2024-08-18T21:10:44.832 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=649039259}) 2024-08-18T21:10:44.832 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.832 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=509589011}) 2024-08-18T21:10:44.832 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.825+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=622474882}) 2024-08-18T21:10:44.832 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.832 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=509589011}) 2024-08-18T21:10:44.832 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1890182057}) 2024-08-18T21:10:44.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=509589011}) 2024-08-18T21:10:44.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2131885962}) 2024-08-18T21:10:44.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=509589011}) 2024-08-18T21:10:44.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=451706196}) 2024-08-18T21:10:44.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=509589011}) 2024-08-18T21:10:44.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1680794510}) 2024-08-18T21:10:44.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=509589011}) 2024-08-18T21:10:44.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3765249624}) 2024-08-18T21:10:44.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=509589011}) 2024-08-18T21:10:44.834 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=201749179}) 2024-08-18T21:10:44.836 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.836 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1624421381}) 2024-08-18T21:10:44.836 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2799283843}) 2024-08-18T21:10:44.836 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.836 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1624421381}) 2024-08-18T21:10:44.836 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2514246442}) 2024-08-18T21:10:44.836 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.836 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1624421381}) 2024-08-18T21:10:44.836 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3075372287}) 2024-08-18T21:10:44.836 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.837 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1624421381}) 2024-08-18T21:10:44.837 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1787754777}) 2024-08-18T21:10:44.837 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.837 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1624421381}) 2024-08-18T21:10:44.837 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=932817312}) 2024-08-18T21:10:44.837 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.837 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1624421381}) 2024-08-18T21:10:44.837 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=179419775}) 2024-08-18T21:10:44.837 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.837 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1624421381}) 2024-08-18T21:10:44.837 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.829+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1854933919}) 2024-08-18T21:10:44.837 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.837 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1624421381}) 2024-08-18T21:10:44.838 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3496420}) 2024-08-18T21:10:44.840 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.840 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1286657368}) 2024-08-18T21:10:44.840 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3810270080}) 2024-08-18T21:10:44.840 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.840 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1286657368}) 2024-08-18T21:10:44.840 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2531778233}) 2024-08-18T21:10:44.840 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.840 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1286657368}) 2024-08-18T21:10:44.840 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3332945723}) 2024-08-18T21:10:44.840 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.841 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1286657368}) 2024-08-18T21:10:44.841 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1298988918}) 2024-08-18T21:10:44.841 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.841 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1286657368}) 2024-08-18T21:10:44.841 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2486891898}) 2024-08-18T21:10:44.841 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.841 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1286657368}) 2024-08-18T21:10:44.841 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2471731730}) 2024-08-18T21:10:44.841 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.841 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1286657368}) 2024-08-18T21:10:44.841 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3432701905}) 2024-08-18T21:10:44.841 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.841 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1286657368}) 2024-08-18T21:10:44.842 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.833+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=784307098}) 2024-08-18T21:10:44.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2421243794}) 2024-08-18T21:10:44.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3115486858}) 2024-08-18T21:10:44.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2421243794}) 2024-08-18T21:10:44.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3549028108}) 2024-08-18T21:10:44.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2421243794}) 2024-08-18T21:10:44.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3589828367}) 2024-08-18T21:10:44.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2421243794}) 2024-08-18T21:10:44.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2450402370}) 2024-08-18T21:10:44.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2421243794}) 2024-08-18T21:10:44.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1470250677}) 2024-08-18T21:10:44.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2421243794}) 2024-08-18T21:10:44.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4097580003}) 2024-08-18T21:10:44.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2421243794}) 2024-08-18T21:10:44.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1768780969}) 2024-08-18T21:10:44.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:44.846 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2421243794}) 2024-08-18T21:10:44.846 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:44.837+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=989905402}) 2024-08-18T21:10:44.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.885+0000 7fe862fb2640 10 monclient: get_monmap_and_config 2024-08-18T21:10:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.885+0000 7fe862fb2640 10 monclient: build_initial_monmap 2024-08-18T21:10:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.885+0000 7fe862fb2640 10 monclient: monmap: 2024-08-18T21:10:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:44.891813+0000 2024-08-18T21:10:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:44.891813+0000 2024-08-18T21:10:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:44.891 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 1 Processor -- start 2024-08-18T21:10:44.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 1 -- start start 2024-08-18T21:10:44.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 10 monclient: init 2024-08-18T21:10:44.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:44.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 10 monclient: _add_conns ranks=[10,7,4,6,0,3,5,9,2,8,1] 2024-08-18T21:10:44.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe85c06c950 0x7fe85c09f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 10 monclient(hunting): picked mon.noname-f con 0x7fe85c06c950 addr v2:172.21.15.157:3300/0 2024-08-18T21:10:44.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe85c06cd30 0x7fe85c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 10 monclient(hunting): picked mon.noname-i con 0x7fe85c06cd30 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:44.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe85c139820 0x7fe85c139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 10 monclient(hunting): picked mon.noname-c con 0x7fe85c139820 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:44.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe85c09dfc0 con 0x7fe85c06c950 2024-08-18T21:10:44.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fe85c09e580 con 0x7fe85c139820 2024-08-18T21:10:44.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fe85c09e2a0 con 0x7fe85c06cd30 2024-08-18T21:10:44.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe862fb2640 10 monclient(hunting): authenticate will time out at 1411.905194s 2024-08-18T21:10:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe85c139820 0x7fe85c139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe85c139820 0x7fe85c139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:51544/0 (socket says 172.21.15.5:51544) 2024-08-18T21:10:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 1 -- 172.21.15.5:0/2812357415 learned_addr learned my addr 172.21.15.5:0/2812357415 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 10 monclient(hunting): get_auth_request con 0x7fe85c139820 auth_method 0 2024-08-18T21:10:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 10 monclient(hunting): handle_auth_done global_id 6610 payload 274 2024-08-18T21:10:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe85bfff640 1 --2- 172.21.15.5:0/2812357415 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe85c06cd30 0x7fe85c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe860d4e640 1 --2- 172.21.15.5:0/2812357415 >> v2:172.21.15.157:3300/0 conn(0x7fe85c06c950 0x7fe85c09f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 1 -- 172.21.15.5:0/2812357415 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe85c06cd30 msgr2=0x7fe85c06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:44.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 1 --2- 172.21.15.5:0/2812357415 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe85c06cd30 0x7fe85c06d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 1 -- 172.21.15.5:0/2812357415 >> v2:172.21.15.157:3300/0 conn(0x7fe85c06c950 msgr2=0x7fe85c09f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:44.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 1 --2- 172.21.15.5:0/2812357415 >> v2:172.21.15.157:3300/0 conn(0x7fe85c06c950 0x7fe85c09f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 10 monclient: _finish_hunting 0 2024-08-18T21:10:44.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 1 monclient: found mon.noname-c 2024-08-18T21:10:44.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:44.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:10:44.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.889+0000 7fe86154f640 1 -- 172.21.15.5:0/2812357415 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c09da30 con 0x7fe85c139820 2024-08-18T21:10:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe86154f640 1 -- 172.21.15.5:0/2812357415 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe85c139820 msgr2=0x7fe85c139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe86154f640 1 --2- 172.21.15.5:0/2812357415 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe85c139820 0x7fe85c139c20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe854009e50 tx=0x7fe85401c8f0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=f5c2d9083f65e42f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe85b7fe640 1 -- 172.21.15.5:0/2812357415 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe8540091b0 con 0x7fe85c139820 2024-08-18T21:10:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe85b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe85b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:10:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe85b7fe640 10 monclient: dump: 2024-08-18T21:10:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.901 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe85b7fe640 10 monclient: _finish_auth 0 2024-08-18T21:10:44.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe85b7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:10:44.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe85b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:44.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe85b7fe640 1 -- 172.21.15.5:0/2812357415 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8540a5ac0 con 0x7fe85c139820 2024-08-18T21:10:44.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 5 monclient: authenticate success, global_id 6610 2024-08-18T21:10:44.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe85b7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:44.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:44.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe85b7fe640 1 -- 172.21.15.5:0/2812357415 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe8540a5c70 con 0x7fe85c139820 2024-08-18T21:10:44.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 4 set_mon_vals no callback set 2024-08-18T21:10:44.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe85b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe85b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:10:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe85b7fe640 10 monclient: dump: 2024-08-18T21:10:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.904 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.904 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.904 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.904 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.904 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.904 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.904 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 10 monclient: shutdown 2024-08-18T21:10:44.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:44.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 1 -- 172.21.15.5:0/2812357415 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe85c139820 msgr2=0x7fe85c139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 1 --2- 172.21.15.5:0/2812357415 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe85c139820 0x7fe85c139c20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe854009e50 tx=0x7fe85401c8f0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 1 -- 172.21.15.5:0/2812357415 shutdown_connections 2024-08-18T21:10:44.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 1 --2- 172.21.15.5:0/2812357415 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe85c139820 0x7fe85c139c20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 1 --2- 172.21.15.5:0/2812357415 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe85c06cd30 0x7fe85c06d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 1 --2- 172.21.15.5:0/2812357415 >> v2:172.21.15.157:3300/0 conn(0x7fe85c06c950 0x7fe85c09f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 1 -- 172.21.15.5:0/2812357415 >> 172.21.15.5:0/2812357415 conn(0x7fe85c0688d0 msgr2=0x7fe85c068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:44.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 1 -- 172.21.15.5:0/2812357415 shutdown_connections 2024-08-18T21:10:44.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 1 -- 172.21.15.5:0/2812357415 wait complete. 2024-08-18T21:10:44.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 10 monclient: build_initial_monmap 2024-08-18T21:10:44.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 10 monclient: monmap: 2024-08-18T21:10:44.905 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:44.905 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:44.905 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:44.905 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:44.905 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:44.905 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:44.906 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 1 Processor -- start 2024-08-18T21:10:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 1 -- start start 2024-08-18T21:10:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.893+0000 7fe862fb2640 10 monclient: init 2024-08-18T21:10:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe862fb2640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe862fb2640 10 monclient: _add_conns ranks=[5,7,3,4,0,8,6,1,2] 2024-08-18T21:10:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe862fb2640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe85c06c950 0x7fe85c1226e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe862fb2640 10 monclient(hunting): picked mon.noname-h con 0x7fe85c06c950 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe862fb2640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe85c06cd30 0x7fe85c1d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe862fb2640 10 monclient(hunting): picked mon.noname-i con 0x7fe85c06cd30 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe862fb2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c139820 0x7fe85c120090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe862fb2640 10 monclient(hunting): picked mon.noname-g con 0x7fe85c139820 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe862fb2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe862fb2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe85c143690 con 0x7fe85c139820 2024-08-18T21:10:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe862fb2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe862fb2640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe85c143510 con 0x7fe85c06c950 2024-08-18T21:10:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe862fb2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe862fb2640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fe85c143810 con 0x7fe85c06cd30 2024-08-18T21:10:44.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe862fb2640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:44.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe862fb2640 10 monclient(hunting): authenticate will time out at 1411.912433s 2024-08-18T21:10:44.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe85c06c950 0x7fe85c1226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe85bfff640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe85c06cd30 0x7fe85c1d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe86154f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c139820 0x7fe85c120090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe85c06c950 0x7fe85c1226e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:46452/0 (socket says 172.21.15.5:46452) 2024-08-18T21:10:44.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 1 -- 172.21.15.5:0/1880785213 learned_addr learned my addr 172.21.15.5:0/1880785213 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:44.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 10 monclient(hunting): get_auth_request con 0x7fe85c06c950 auth_method 0 2024-08-18T21:10:44.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe85bfff640 10 monclient(hunting): get_auth_request con 0x7fe85c06cd30 auth_method 0 2024-08-18T21:10:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe85bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe85bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe85bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe86154f640 10 monclient(hunting): get_auth_request con 0x7fe85c139820 auth_method 0 2024-08-18T21:10:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe86154f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe86154f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe86154f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe85bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe85bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe85bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe86154f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe86154f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe86154f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 10 monclient(hunting): handle_auth_done global_id 94631 payload 824 2024-08-18T21:10:44.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 1 -- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe85c06cd30 msgr2=0x7fe85c1d1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 1 --2- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe85c06cd30 0x7fe85c1d1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 1 -- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c139820 msgr2=0x7fe85c120090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 1 --2- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c139820 0x7fe85c120090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 10 monclient: _finish_hunting 0 2024-08-18T21:10:44.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 1 monclient: found mon.noname-h 2024-08-18T21:10:44.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:44.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:10:44.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 1 -- 172.21.15.5:0/1880785213 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c123ee0 con 0x7fe85c06c950 2024-08-18T21:10:44.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 1 -- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe85c06c950 msgr2=0x7fe85c1226e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.897+0000 7fe860d4e640 1 --2- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe85c06c950 0x7fe85c1226e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe85000c850 tx=0x7fe85000cd10 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe8597fa640 1 -- 172.21.15.5:0/1880785213 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe850015070 con 0x7fe85c06c950 2024-08-18T21:10:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe8597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe8597fa640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:10:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe8597fa640 10 monclient: dump: 2024-08-18T21:10:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.916 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.916 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.916 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.916 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.916 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.916 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.916 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.916 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.916 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe8597fa640 10 monclient: _finish_auth 0 2024-08-18T21:10:44.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe8597fa640 10 monclient: _check_auth_tickets 2024-08-18T21:10:44.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe8597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:44.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe8597fa640 1 -- 172.21.15.5:0/1880785213 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe85000ce40 con 0x7fe85c06c950 2024-08-18T21:10:44.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe862fb2640 5 monclient: authenticate success, global_id 94631 2024-08-18T21:10:44.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe862fb2640 10 monclient: _renew_subs 2024-08-18T21:10:44.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe862fb2640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:10:44.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe862fb2640 1 -- 172.21.15.5:0/1880785213 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe85c123070 con 0x7fe85c06c950 2024-08-18T21:10:44.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe8597fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:44.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe8597fa640 1 -- 172.21.15.5:0/1880785213 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe850011860 con 0x7fe85c06c950 2024-08-18T21:10:44.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe8597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe8597fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:10:44.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe8597fa640 10 monclient: dump: 2024-08-18T21:10:44.917 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.917 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.917 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.917 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.917 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.918 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.918 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.918 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.918 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.918 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.918 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.918 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.918 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.918 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.918 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.918 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe85affd640 4 set_mon_vals no callback set 2024-08-18T21:10:44.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe862fb2640 10 monclient: _renew_subs 2024-08-18T21:10:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe862fb2640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:10:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe862fb2640 1 -- 172.21.15.5:0/1880785213 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fe85c123c00 con 0x7fe85c06c950 2024-08-18T21:10:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe862fb2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe862fb2640 1 --2- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c1d22a0 0x7fe85c1205d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe862fb2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe862fb2640 1 -- 172.21.15.5:0/1880785213 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe85c051140 con 0x7fe85c1d22a0 2024-08-18T21:10:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe85bfff640 1 --2- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c1d22a0 0x7fe85c1205d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe85bfff640 10 monclient: get_auth_request con 0x7fe85c1d22a0 auth_method 0 2024-08-18T21:10:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe85bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe85bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe85bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe85bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe85bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe85bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe8597fa640 1 -- 172.21.15.5:0/1880785213 <== mon.5 v2:172.21.15.157:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe8500113f0 con 0x7fe85c06c950 2024-08-18T21:10:44.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe8597fa640 1 --2- 172.21.15.5:0/1880785213 >> v2:172.21.15.157:6812/631023601 conn(0x7fe84803bdc0 0x7fe84803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe85bfff640 10 monclient(hunting): handle_auth_done global_id 84891 payload 824 2024-08-18T21:10:44.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe8597fa640 1 -- 172.21.15.5:0/1880785213 <== mon.5 v2:172.21.15.157:3302/0 5 ==== osd_map(212..212 src has 22..212) ==== 3898+0+0 (secure 0 0 0) 0x7fe85004e440 con 0x7fe85c06c950 2024-08-18T21:10:44.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe85bfff640 1 -- 172.21.15.5:0/1880785213 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe85c09f380 con 0x7fe85c1d22a0 2024-08-18T21:10:44.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe86154f640 1 --2- 172.21.15.5:0/1880785213 >> v2:172.21.15.157:6812/631023601 conn(0x7fe84803bdc0 0x7fe84803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.901+0000 7fe86154f640 10 monclient: get_auth_request con 0x7fe84803bdc0 auth_method 0 2024-08-18T21:10:44.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.905+0000 7fe85bfff640 1 -- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c1d22a0 msgr2=0x7fe85c1205d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.905+0000 7fe85bfff640 1 --2- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c1d22a0 0x7fe85c1205d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe85c1217f0 tx=0x7fe84c00fc70 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.905+0000 7fe8597fa640 1 -- 172.21.15.5:0/1880785213 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe84c00fe60 con 0x7fe85c1d22a0 2024-08-18T21:10:44.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.905+0000 7fe8597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.905+0000 7fe8597fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:10:44.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.905+0000 7fe8597fa640 10 monclient: dump: 2024-08-18T21:10:44.921 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.921 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.921 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.921 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.921 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.921 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.921 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.921 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.921 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.922 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.922 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.922 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.922 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.922 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.922 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.922 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.905+0000 7fe86154f640 1 --2- 172.21.15.5:0/1880785213 >> v2:172.21.15.157:6812/631023601 conn(0x7fe84803bdc0 0x7fe84803e280 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0a5530 tx=0x7fe8540a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.905+0000 7fe8597fa640 1 -- 172.21.15.5:0/1880785213 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe84c00fe60 con 0x7fe85c1d22a0 2024-08-18T21:10:44.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.905+0000 7fe8597fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:44.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.905+0000 7fe8597fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:44.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.905+0000 7fe8597fa640 1 -- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c1d22a0 msgr2=0x7fe85c1205d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.905+0000 7fe8597fa640 1 --2- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c1d22a0 0x7fe85c1205d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe85c1217f0 tx=0x7fe84c00fc70 comp rx=0 tx=0).stop 2024-08-18T21:10:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.905+0000 7fe8597fa640 1 -- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c1d22a0 msgr2=0x7fe85c1205d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.905+0000 7fe8597fa640 1 --2- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c1d22a0 0x7fe85c1205d0 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe85c1217f0 tx=0x7fe84c00fc70 comp rx=0 tx=0).stop 2024-08-18T21:10:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.909+0000 7fe862fb2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.909+0000 7fe862fb2640 1 --2- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c120b10 0x7fe85c13cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.909+0000 7fe862fb2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.909+0000 7fe862fb2640 1 -- 172.21.15.5:0/1880785213 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe85c120f20 con 0x7fe85c120b10 2024-08-18T21:10:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.913+0000 7fe85bfff640 1 --2- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c120b10 0x7fe85c13cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.913+0000 7fe85bfff640 10 monclient: get_auth_request con 0x7fe85c120b10 auth_method 0 2024-08-18T21:10:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.913+0000 7fe85bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.913+0000 7fe85bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.913+0000 7fe85bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.913+0000 7fe85bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.913+0000 7fe85bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:44.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.913+0000 7fe85bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:44.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.913+0000 7fe85bfff640 10 monclient(hunting): handle_auth_done global_id 84900 payload 824 2024-08-18T21:10:44.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.913+0000 7fe85bfff640 1 -- 172.21.15.5:0/1880785213 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe85c0a2f50 con 0x7fe85c120b10 2024-08-18T21:10:44.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.913+0000 7fe85bfff640 1 -- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c120b10 msgr2=0x7fe85c13cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:44.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.913+0000 7fe85bfff640 1 --2- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c120b10 0x7fe85c13cac0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00afd0 tx=0x7fe84c0046d0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:44.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.913+0000 7fe8597fa640 1 -- 172.21.15.5:0/1880785213 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe84c013440 con 0x7fe85c120b10 2024-08-18T21:10:44.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.913+0000 7fe8597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:44.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.913+0000 7fe8597fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:10:44.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.913+0000 7fe8597fa640 10 monclient: dump: 2024-08-18T21:10:44.925 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:44.925 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:44.925 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.925 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:44.925 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:44.926 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe8597fa640 1 -- 172.21.15.5:0/1880785213 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7fe84c003b80 con 0x7fe85c120b10 2024-08-18T21:10:44.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe8597fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:44.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe8597fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:44.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe8597fa640 1 -- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c120b10 msgr2=0x7fe85c13cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe8597fa640 1 --2- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c120b10 0x7fe85c13cac0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00afd0 tx=0x7fe84c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe8597fa640 1 -- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c120b10 msgr2=0x7fe85c13cac0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:44.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe8597fa640 1 --2- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe85c120b10 0x7fe85c13cac0 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00afd0 tx=0x7fe84c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:10:44.927 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:44.927 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:44.927 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:44.928 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:44.928 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:44.928 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 141737, 2024-08-18T21:10:44.928 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:44.928 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:44.928 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:44.928 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:44.928 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:44.928 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:44.928 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:44.928 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:44.928 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:44.929 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:44.929 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.929 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:10:44.929 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:44.929 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:44.929 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:44.929 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:44.929 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:44.929 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:44.929 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:44.929 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:44.929 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:44.929 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:44.930 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:44.930 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:44.930 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:44.930 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:44.930 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.930 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:44.930 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:44.930 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:44.930 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:44.930 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:44.930 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:44.930 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:44.931 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:44.931 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:44.931 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:44.931 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:44.931 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:44.931 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:44.931 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.931 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:44.931 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:44.931 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:44.931 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:44.932 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:44.932 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:44.932 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:44.932 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:44.932 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:44.932 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:44.932 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:44.932 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:44.932 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:44.932 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:44.932 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:44.932 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:44.933 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:44.933 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:44.933 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:44.933 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:44.933 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:44.933 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:44.933 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:44.933 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:44.933 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:44.933 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:44.933 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:44.934 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:44.934 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.934 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:44.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.934 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:44.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.934 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:44.934 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:44.934 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.934 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.934 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.935 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:44.935 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.935 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:44.935 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.935 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.935 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.935 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:44.935 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:44.935 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.935 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.936 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.936 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:44.936 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:44.936 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.936 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.936 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.936 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:44.936 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.937 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.937 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:44.937 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.937 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.937 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.937 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:44.937 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:44.937 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.937 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.937 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.937 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:44.938 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:44.938 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.938 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.938 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.938 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:44.938 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.938 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.938 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:44.938 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.938 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.939 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.939 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:44.939 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:44.939 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.939 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.939 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.939 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:44.939 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:44.939 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.939 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.940 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.940 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:44.940 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.940 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.940 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:44.940 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.940 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.940 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.940 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:44.940 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:44.940 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.941 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.941 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.941 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:44.941 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:44.941 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.941 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.941 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.941 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:44.941 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.942 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.942 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:44.942 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.942 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.942 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.942 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:44.942 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:44.942 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.942 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.942 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.943 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:44.943 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:44.943 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:44.943 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:44.943 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.944 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.944 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.944 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:44.944 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:44.944 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.944 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.944 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.944 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:44.944 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:44.944 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.944 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.945 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:44.945 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.945 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:44.945 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.945 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.945 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.945 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:44.946 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:44.946 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.946 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.946 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.946 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:44.946 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:44.946 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.946 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.946 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:44.947 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.947 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.947 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:44.947 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.947 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.947 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.947 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:44.947 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:44.947 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.947 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.948 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.948 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:44.948 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:44.948 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:44.948 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:44.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.948 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:44.948 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:44.948 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.948 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:44.949 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:44.949 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:44.949 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.949 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.949 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:44.949 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:44.949 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:44.949 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:44.949 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:44.949 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.949 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.950 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:44.950 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:44.950 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.950 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:44.950 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:44.950 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:44.950 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.950 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:44.950 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:44.950 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:44.950 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:44.950 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:44.950 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:10:44.951 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:44.951 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:44.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:44.951 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:44.951 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe862fb2640 1 -- 172.21.15.5:0/1880785213 >> v2:172.21.15.157:6812/631023601 conn(0x7fe84803bdc0 msgr2=0x7fe84803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe862fb2640 1 --2- 172.21.15.5:0/1880785213 >> v2:172.21.15.157:6812/631023601 conn(0x7fe84803bdc0 0x7fe84803e280 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0a5530 tx=0x7fe8540a7070 comp rx=0 tx=0).stop 2024-08-18T21:10:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe862fb2640 10 monclient: shutdown 2024-08-18T21:10:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe862fb2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe862fb2640 1 -- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe85c06c950 msgr2=0x7fe85c1226e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe862fb2640 1 --2- 172.21.15.5:0/1880785213 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe85c06c950 0x7fe85c1226e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe85000c850 tx=0x7fe85000cd10 comp rx=0 tx=0).stop 2024-08-18T21:10:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe86154f640 1 -- 172.21.15.5:0/1880785213 reap_dead start 2024-08-18T21:10:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe86154f640 1 -- 172.21.15.5:0/1880785213 reap_dead start 2024-08-18T21:10:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe862fb2640 1 -- 172.21.15.5:0/1880785213 shutdown_connections 2024-08-18T21:10:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe862fb2640 1 -- 172.21.15.5:0/1880785213 >> 172.21.15.5:0/1880785213 conn(0x7fe85c0688d0 msgr2=0x7fe85c0a7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe862fb2640 1 -- 172.21.15.5:0/1880785213 shutdown_connections 2024-08-18T21:10:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:44.917+0000 7fe862fb2640 1 -- 172.21.15.5:0/1880785213 wait complete. 2024-08-18T21:10:44.953 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:44.954 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:10:44.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:10:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 10 monclient: get_monmap_and_config 2024-08-18T21:10:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 10 monclient: build_initial_monmap 2024-08-18T21:10:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 10 monclient: monmap: 2024-08-18T21:10:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:45.113467+0000 2024-08-18T21:10:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:45.113467+0000 2024-08-18T21:10:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:45.113 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 1 Processor -- start 2024-08-18T21:10:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 1 -- start start 2024-08-18T21:10:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 10 monclient: init 2024-08-18T21:10:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 10 monclient: _add_conns ranks=[3,8,2,10,7,5,0,9,1,6,4] 2024-08-18T21:10:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04240a6ce0 0x7f04240a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 10 monclient(hunting): picked mon.noname-g con 0x7f04240a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a7600 0x7f0424139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 10 monclient(hunting): picked mon.noname-e con 0x7f04240a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0424139fe0 0x7f042413a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 10 monclient(hunting): picked mon.noname-b con 0x7f0424139fe0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f04240a5000 con 0x7f0424139fe0 2024-08-18T21:10:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f04240a4360 con 0x7f04240a6ce0 2024-08-18T21:10:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f04240a45d0 con 0x7f04240a7600 2024-08-18T21:10:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042b29e640 10 monclient(hunting): authenticate will time out at 1412.127225s 2024-08-18T21:10:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a7600 0x7f0424139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042983b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0424139fe0 0x7f042413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a7600 0x7f0424139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:36404/0 (socket says 172.21.15.5:36404) 2024-08-18T21:10:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 1 -- 172.21.15.5:0/1297849415 learned_addr learned my addr 172.21.15.5:0/1297849415 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 10 monclient(hunting): get_auth_request con 0x7f04240a7600 auth_method 0 2024-08-18T21:10:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042983b640 10 monclient(hunting): get_auth_request con 0x7f0424139fe0 auth_method 0 2024-08-18T21:10:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042983b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042983b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042983b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042983b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042983b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042983b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042903a640 1 --2- 172.21.15.5:0/1297849415 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04240a6ce0 0x7f04240a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042903a640 10 monclient(hunting): get_auth_request con 0x7f04240a6ce0 auth_method 0 2024-08-18T21:10:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042903a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042903a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042903a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 10 monclient(hunting): handle_auth_done global_id 55655 payload 274 2024-08-18T21:10:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 1 -- 172.21.15.5:0/1297849415 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04240a6ce0 msgr2=0x7f04240a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 1 --2- 172.21.15.5:0/1297849415 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04240a6ce0 0x7f04240a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 1 -- 172.21.15.5:0/1297849415 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0424139fe0 msgr2=0x7f042413a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 1 --2- 172.21.15.5:0/1297849415 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0424139fe0 0x7f042413a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 10 monclient: _finish_hunting 0 2024-08-18T21:10:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 1 monclient: found mon.noname-e 2024-08-18T21:10:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:10:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f0428839640 1 -- 172.21.15.5:0/1297849415 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04240a32d0 con 0x7f04240a7600 2024-08-18T21:10:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.109+0000 7f042983b640 1 --2- 172.21.15.5:0/1297849415 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0424139fe0 0x7f042413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:45.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.113+0000 7f0428839640 1 -- 172.21.15.5:0/1297849415 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a7600 msgr2=0x7f0424139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:45.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.113+0000 7f0428839640 1 --2- 172.21.15.5:0/1297849415 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a7600 0x7f0424139aa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f04140098d0 tx=0x7f041401c440 comp rx=0 tx=0).ready entity=mon.8 client_cookie=fd2259cb3fe4ed1d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:45.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f041bfff640 1 -- 172.21.15.5:0/1297849415 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f04140b0070 con 0x7f04240a7600 2024-08-18T21:10:45.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f041bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:45.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f041bfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:10:45.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f041bfff640 10 monclient: dump: 2024-08-18T21:10:45.125 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:45.125 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.125 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.125 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.125 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:45.125 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.125 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:45.125 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:45.125 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:45.125 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:45.125 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:45.125 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:45.126 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:45.126 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:45.126 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:45.126 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f041bfff640 10 monclient: _finish_auth 0 2024-08-18T21:10:45.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f041bfff640 10 monclient: _check_auth_tickets 2024-08-18T21:10:45.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f041bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:45.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f041bfff640 1 -- 172.21.15.5:0/1297849415 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04140aa810 con 0x7f04240a7600 2024-08-18T21:10:45.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f041bfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:45.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f041bfff640 1 -- 172.21.15.5:0/1297849415 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f04140aae30 con 0x7f04240a7600 2024-08-18T21:10:45.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 5 monclient: authenticate success, global_id 55655 2024-08-18T21:10:45.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:45.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 4 set_mon_vals no callback set 2024-08-18T21:10:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f041bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f041bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:10:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f041bfff640 10 monclient: dump: 2024-08-18T21:10:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:45.128 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 10 monclient: shutdown 2024-08-18T21:10:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 -- 172.21.15.5:0/1297849415 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a7600 msgr2=0x7f0424139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 --2- 172.21.15.5:0/1297849415 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a7600 0x7f0424139aa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f04140098d0 tx=0x7f041401c440 comp rx=0 tx=0).stop 2024-08-18T21:10:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 -- 172.21.15.5:0/1297849415 shutdown_connections 2024-08-18T21:10:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 --2- 172.21.15.5:0/1297849415 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0424139fe0 0x7f042413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 --2- 172.21.15.5:0/1297849415 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a7600 0x7f0424139aa0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 --2- 172.21.15.5:0/1297849415 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04240a6ce0 0x7f04240a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 -- 172.21.15.5:0/1297849415 >> 172.21.15.5:0/1297849415 conn(0x7f04240acbc0 msgr2=0x7f04240a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 -- 172.21.15.5:0/1297849415 shutdown_connections 2024-08-18T21:10:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 -- 172.21.15.5:0/1297849415 wait complete. 2024-08-18T21:10:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 10 monclient: build_initial_monmap 2024-08-18T21:10:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 10 monclient: monmap: 2024-08-18T21:10:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:45.130 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 Processor -- start 2024-08-18T21:10:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 -- start start 2024-08-18T21:10:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 10 monclient: init 2024-08-18T21:10:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:45.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 10 monclient: _add_conns ranks=[8,1,5,4,3,2,6,0,7] 2024-08-18T21:10:45.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a6ce0 0x7f04241d15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 10 monclient(hunting): picked mon.noname-e con 0x7f04240a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:45.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04240a7600 0x7f042413fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 10 monclient(hunting): picked mon.noname-f con 0x7f04240a7600 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:10:45.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0424139fe0 0x7f04241403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 10 monclient(hunting): picked mon.noname-h con 0x7f0424139fe0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:45.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f04240a79e0 con 0x7f04240a7600 2024-08-18T21:10:45.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f04240a8220 con 0x7f0424139fe0 2024-08-18T21:10:45.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f0424135ad0 con 0x7f04240a6ce0 2024-08-18T21:10:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042b29e640 10 monclient(hunting): authenticate will time out at 1412.134482s 2024-08-18T21:10:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a6ce0 0x7f04241d15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a6ce0 0x7f04241d15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:36420/0 (socket says 172.21.15.5:36420) 2024-08-18T21:10:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 1 -- 172.21.15.5:0/752913429 learned_addr learned my addr 172.21.15.5:0/752913429 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 10 monclient(hunting): get_auth_request con 0x7f04240a6ce0 auth_method 0 2024-08-18T21:10:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f0428839640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04240a7600 0x7f042413fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042983b640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0424139fe0 0x7f04241403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f0428839640 10 monclient(hunting): get_auth_request con 0x7f04240a7600 auth_method 0 2024-08-18T21:10:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f0428839640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f0428839640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f0428839640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042983b640 10 monclient(hunting): get_auth_request con 0x7f0424139fe0 auth_method 0 2024-08-18T21:10:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042983b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042983b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042983b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f0428839640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f0428839640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f0428839640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 10 monclient(hunting): handle_auth_done global_id 55664 payload 824 2024-08-18T21:10:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 1 -- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0424139fe0 msgr2=0x7f04241403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0424139fe0 0x7f04241403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 1 -- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04240a7600 msgr2=0x7f042413fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04240a7600 0x7f042413fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 10 monclient: _finish_hunting 0 2024-08-18T21:10:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 1 monclient: found mon.noname-e 2024-08-18T21:10:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:10:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.117+0000 7f042903a640 1 -- 172.21.15.5:0/752913429 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04240a2570 con 0x7f04240a6ce0 2024-08-18T21:10:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f042903a640 1 -- 172.21.15.5:0/752913429 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a6ce0 msgr2=0x7f04241d15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f042903a640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a6ce0 0x7f04241d15f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f042000d860 tx=0x7f042000dd20 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0419ffb640 1 -- 172.21.15.5:0/752913429 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f042000de50 con 0x7f04240a6ce0 2024-08-18T21:10:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0419ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0419ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:10:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0419ffb640 10 monclient: dump: 2024-08-18T21:10:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:45.136 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0419ffb640 10 monclient: _finish_auth 0 2024-08-18T21:10:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0419ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:10:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0419ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0419ffb640 1 -- 172.21.15.5:0/752913429 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0420019070 con 0x7f04240a6ce0 2024-08-18T21:10:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0419ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0419ffb640 1 -- 172.21.15.5:0/752913429 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f04200148a0 con 0x7f04240a6ce0 2024-08-18T21:10:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0419ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0419ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:10:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0419ffb640 10 monclient: dump: 2024-08-18T21:10:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:45.138 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f041affd640 4 set_mon_vals no callback set 2024-08-18T21:10:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f042b29e640 5 monclient: authenticate success, global_id 55664 2024-08-18T21:10:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f042b29e640 10 monclient: _renew_subs 2024-08-18T21:10:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f042b29e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:10:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f042b29e640 1 -- 172.21.15.5:0/752913429 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04240aa390 con 0x7f04240a6ce0 2024-08-18T21:10:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f042b29e640 10 monclient: _renew_subs 2024-08-18T21:10:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f042b29e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:10:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f042b29e640 1 -- 172.21.15.5:0/752913429 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f042413c930 con 0x7f04240a6ce0 2024-08-18T21:10:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f042b29e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:45.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f042b29e640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f04240a0c40 0x7f04240a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f042b29e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f042b29e640 1 -- 172.21.15.5:0/752913429 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f04240a7b60 con 0x7f04240a0c40 2024-08-18T21:10:45.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f042903a640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a6ce0 0x7f04241d15f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f042000d860 tx=0x7f042000dd20 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7f042000f040 osd_map(212..212 src has 22..212) 2024-08-18T21:10:45.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0419ffb640 1 -- 172.21.15.5:0/752913429 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f0420014430 con 0x7f04240a6ce0 2024-08-18T21:10:45.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0428839640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f04240a0c40 0x7f04240a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0428839640 10 monclient: get_auth_request con 0x7f04240a0c40 auth_method 0 2024-08-18T21:10:45.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0428839640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0428839640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0428839640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0419ffb640 1 --2- 172.21.15.5:0/752913429 >> v2:172.21.15.157:6812/631023601 conn(0x7f040803bdf0 0x7f040803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0428839640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:45.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0428839640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:45.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0428839640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f042983b640 1 --2- 172.21.15.5:0/752913429 >> v2:172.21.15.157:6812/631023601 conn(0x7f040803bdf0 0x7f040803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f042983b640 10 monclient: get_auth_request con 0x7f040803bdf0 auth_method 0 2024-08-18T21:10:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0428839640 10 monclient(hunting): handle_auth_done global_id 94649 payload 824 2024-08-18T21:10:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.121+0000 7f0428839640 1 -- 172.21.15.5:0/752913429 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04241d1b30 con 0x7f04240a0c40 2024-08-18T21:10:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.125+0000 7f0428839640 1 -- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f04240a0c40 msgr2=0x7f04240a1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.125+0000 7f0428839640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f04240a0c40 0x7f04240a1020 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f04140098a0 tx=0x7f04140191e0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.125+0000 7f042983b640 1 --2- 172.21.15.5:0/752913429 >> v2:172.21.15.157:6812/631023601 conn(0x7f040803bdf0 0x7f040803e2b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f042413ce20 tx=0x7f041c00b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.125+0000 7f0419ffb640 1 -- 172.21.15.5:0/752913429 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f04140ba070 con 0x7f04240a0c40 2024-08-18T21:10:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.125+0000 7f0419ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.125+0000 7f0419ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:10:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.125+0000 7f0419ffb640 10 monclient: dump: 2024-08-18T21:10:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:45.145 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.125+0000 7f0419ffb640 1 -- 172.21.15.5:0/752913429 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f04140b1040 con 0x7f04240a0c40 2024-08-18T21:10:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.125+0000 7f0419ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.125+0000 7f0419ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.125+0000 7f0419ffb640 1 -- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f04240a0c40 msgr2=0x7f04240a1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.125+0000 7f0419ffb640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f04240a0c40 0x7f04240a1020 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f04140098a0 tx=0x7f04140191e0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.125+0000 7f0419ffb640 1 -- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f04240a0c40 msgr2=0x7f04240a1020 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.125+0000 7f0419ffb640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f04240a0c40 0x7f04240a1020 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f04140098a0 tx=0x7f04140191e0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.133+0000 7f042b29e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.133+0000 7f042b29e640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f04240a1560 0x7f0424133ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.133+0000 7f042b29e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.133+0000 7f042b29e640 1 -- 172.21.15.5:0/752913429 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f0424051140 con 0x7f04240a1560 2024-08-18T21:10:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.133+0000 7f0428839640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f04240a1560 0x7f0424133ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.133+0000 7f0428839640 10 monclient: get_auth_request con 0x7f04240a1560 auth_method 0 2024-08-18T21:10:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.133+0000 7f0428839640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.133+0000 7f0428839640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.133+0000 7f0428839640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.133+0000 7f0428839640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.133+0000 7f0428839640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.133+0000 7f0428839640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.133+0000 7f0428839640 10 monclient(hunting): handle_auth_done global_id 94658 payload 824 2024-08-18T21:10:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.133+0000 7f0428839640 1 -- 172.21.15.5:0/752913429 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f042413c500 con 0x7f04240a1560 2024-08-18T21:10:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f0428839640 1 -- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f04240a1560 msgr2=0x7f0424133ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f0428839640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f04240a1560 0x7f0424133ce0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f041401c270 tx=0x7f04140a8000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f0419ffb640 1 -- 172.21.15.5:0/752913429 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f04140ba070 con 0x7f04240a1560 2024-08-18T21:10:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f0419ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f0419ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:10:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f0419ffb640 10 monclient: dump: 2024-08-18T21:10:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:45.148 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.148 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:45.148 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:45.148 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:45.148 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:45.148 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:45.148 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:45.148 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:45.148 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:45.148 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:45.148 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f0419ffb640 1 -- 172.21.15.5:0/752913429 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f04140c73f0 con 0x7f04240a1560 2024-08-18T21:10:45.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f0419ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:45.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f0419ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:45.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f0419ffb640 1 -- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f04240a1560 msgr2=0x7f0424133ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f0419ffb640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f04240a1560 0x7f0424133ce0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f041401c270 tx=0x7f04140a8000 comp rx=0 tx=0).stop 2024-08-18T21:10:45.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f0419ffb640 1 -- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f04240a1560 msgr2=0x7f0424133ce0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:45.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f0419ffb640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f04240a1560 0x7f0424133ce0 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f041401c270 tx=0x7f04140a8000 comp rx=0 tx=0).stop 2024-08-18T21:10:45.149 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:45.149 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:45.149 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:45.149 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:45.150 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:45.150 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 73174, 2024-08-18T21:10:45.150 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:45.150 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:45.150 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:45.150 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:45.150 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:45.150 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:45.150 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:45.150 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:45.150 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:45.151 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:45.151 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:45.151 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:10:45.151 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:45.151 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:45.151 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:45.151 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:45.151 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:45.151 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:45.151 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:45.151 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:45.151 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:45.151 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:45.153 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:45.153 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:45.153 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:45.153 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:45.153 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:45.153 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.153 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:45.153 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:45.153 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:45.153 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:45.153 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:45.154 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:45.154 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:45.154 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:45.154 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:45.154 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:45.154 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:45.154 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:45.154 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:45.154 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:45.154 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:45.154 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:45.154 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:45.154 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:45.155 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:45.155 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:45.155 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:45.155 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:45.155 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:45.155 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:45.155 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:45.155 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:45.155 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:45.155 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:45.155 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:45.155 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:45.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.155 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:45.156 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.156 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:45.156 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:45.156 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.156 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.156 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.156 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.156 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:45.156 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.156 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.156 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.157 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:45.157 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.157 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.157 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.157 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:45.157 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:45.157 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.157 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.157 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.157 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:45.157 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:45.158 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.158 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.158 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.158 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.158 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:45.158 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.158 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.158 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.158 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:45.158 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.158 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.159 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.159 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:45.159 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:45.159 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.159 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.159 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.159 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:45.159 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:45.159 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.160 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.160 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.160 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:45.160 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.160 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.160 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:45.160 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.160 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.160 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.161 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:45.161 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:45.161 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.161 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.161 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.161 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:45.161 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:45.161 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.161 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.161 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.162 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:45.162 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.162 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.162 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:45.162 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.162 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.162 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.162 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:45.162 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:45.162 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.163 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.163 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.163 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:45.163 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:45.163 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.163 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.163 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.163 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:45.163 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.164 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.164 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:45.164 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.164 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.164 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.164 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:45.164 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:45.164 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.164 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.164 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.164 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:45.165 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:45.165 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.165 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.165 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.165 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:45.165 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.165 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.165 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:45.165 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.165 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.166 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.166 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:45.166 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:45.166 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.166 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.166 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.166 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:45.166 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:45.166 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.166 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.167 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.167 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:45.167 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.167 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.167 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:45.167 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.167 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.167 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.167 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:45.167 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:45.168 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.168 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.168 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.168 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:45.168 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:45.168 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.168 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.168 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.168 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:45.168 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.169 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.169 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:45.169 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.169 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.169 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.169 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:45.169 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:45.169 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.169 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.169 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.170 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:45.170 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:45.170 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.170 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.170 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.170 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:45.170 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.170 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.170 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:45.170 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.171 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.171 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.171 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:45.171 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:45.171 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.171 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.171 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.171 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.171 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.171 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:45.171 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:45.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.172 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:45.172 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:45.172 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:45.172 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.172 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:45.172 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:45.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.172 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:45.172 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:45.172 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:45.172 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.172 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.172 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:45.173 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:45.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f042b29e640 1 -- 172.21.15.5:0/752913429 >> v2:172.21.15.157:6812/631023601 conn(0x7f040803bdf0 msgr2=0x7f040803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f042b29e640 1 --2- 172.21.15.5:0/752913429 >> v2:172.21.15.157:6812/631023601 conn(0x7f040803bdf0 0x7f040803e2b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f042413ce20 tx=0x7f041c00b040 comp rx=0 tx=0).stop 2024-08-18T21:10:45.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f042b29e640 10 monclient: shutdown 2024-08-18T21:10:45.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f042b29e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:45.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f042b29e640 1 -- 172.21.15.5:0/752913429 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a6ce0 msgr2=0x7f04241d15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f042b29e640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a6ce0 0x7f04241d15f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f042000d860 tx=0x7f042000dd20 comp rx=0 tx=0).stop 2024-08-18T21:10:45.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f042983b640 1 -- 172.21.15.5:0/752913429 reap_dead start 2024-08-18T21:10:45.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f0419ffb640 1 -- 172.21.15.5:0/752913429 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(212..212 src has 22..212) ==== 3898+0+0 (unknown 0 0 0) 0x7f042000f040 con 0x7f04240a6ce0 2024-08-18T21:10:45.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f042b29e640 1 -- 172.21.15.5:0/752913429 shutdown_connections 2024-08-18T21:10:45.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f042b29e640 1 --2- 172.21.15.5:0/752913429 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f04240a6ce0 0x7f04241d15f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f042b29e640 1 -- 172.21.15.5:0/752913429 >> 172.21.15.5:0/752913429 conn(0x7f04240acbc0 msgr2=0x7f0424138b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:45.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f042b29e640 1 -- 172.21.15.5:0/752913429 shutdown_connections 2024-08-18T21:10:45.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.137+0000 7f042b29e640 1 -- 172.21.15.5:0/752913429 wait complete. 2024-08-18T21:10:45.175 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:45.175 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:10:45.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:10:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 10 monclient: get_monmap_and_config 2024-08-18T21:10:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 10 monclient: build_initial_monmap 2024-08-18T21:10:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 10 monclient: monmap: 2024-08-18T21:10:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:45.293838+0000 2024-08-18T21:10:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:45.293838+0000 2024-08-18T21:10:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:45.293 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 1 Processor -- start 2024-08-18T21:10:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 1 -- start start 2024-08-18T21:10:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 10 monclient: init 2024-08-18T21:10:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 10 monclient: _add_conns ranks=[10,9,3,0,4,5,2,1,8,7,6] 2024-08-18T21:10:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f86d80a6ce0 0x7f86d80a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 10 monclient(hunting): picked mon.noname-f con 0x7f86d80a6ce0 addr v2:172.21.15.157:3300/0 2024-08-18T21:10:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86d80a7600 0x7f86d8139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 10 monclient(hunting): picked mon.noname-a con 0x7f86d80a7600 addr v2:172.21.15.5:3300/0 2024-08-18T21:10:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86d8139fe0 0x7f86d813a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 10 monclient(hunting): picked mon.noname-g con 0x7f86d8139fe0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:10:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f86d80a5000 con 0x7f86d80a7600 2024-08-18T21:10:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f86d80a4360 con 0x7f86d80a6ce0 2024-08-18T21:10:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f86d80a45d0 con 0x7f86d8139fe0 2024-08-18T21:10:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86de367640 10 monclient(hunting): authenticate will time out at 1412.306920s 2024-08-18T21:10:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86d80a7600 0x7f86d8139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86d80a7600 0x7f86d8139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48040/0 (socket says 172.21.15.5:48040) 2024-08-18T21:10:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 1 -- 172.21.15.5:0/2271310517 learned_addr learned my addr 172.21.15.5:0/2271310517 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 10 monclient(hunting): get_auth_request con 0x7f86d80a7600 auth_method 0 2024-08-18T21:10:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d7fff640 1 --2- 172.21.15.5:0/2271310517 >> v2:172.21.15.157:3300/0 conn(0x7f86d80a6ce0 0x7f86d80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86dc904640 1 --2- 172.21.15.5:0/2271310517 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86d8139fe0 0x7f86d813a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d7fff640 10 monclient(hunting): get_auth_request con 0x7f86d80a6ce0 auth_method 0 2024-08-18T21:10:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86dc904640 10 monclient(hunting): get_auth_request con 0x7f86d8139fe0 auth_method 0 2024-08-18T21:10:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86dc904640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86dc904640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86dc904640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 10 monclient(hunting): handle_auth_done global_id 84816 payload 274 2024-08-18T21:10:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 1 -- 172.21.15.5:0/2271310517 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86d8139fe0 msgr2=0x7f86d813a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 1 --2- 172.21.15.5:0/2271310517 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86d8139fe0 0x7f86d813a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 1 -- 172.21.15.5:0/2271310517 >> v2:172.21.15.157:3300/0 conn(0x7f86d80a6ce0 msgr2=0x7f86d80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:45.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 1 --2- 172.21.15.5:0/2271310517 >> v2:172.21.15.157:3300/0 conn(0x7f86d80a6ce0 0x7f86d80a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 10 monclient: _finish_hunting 0 2024-08-18T21:10:45.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 1 monclient: found mon.noname-a 2024-08-18T21:10:45.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:45.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:10:45.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.289+0000 7f86d77fe640 1 -- 172.21.15.5:0/2271310517 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d80a32d0 con 0x7f86d80a7600 2024-08-18T21:10:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.293+0000 7f86d77fe640 1 -- 172.21.15.5:0/2271310517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86d80a7600 msgr2=0x7f86d8139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.293+0000 7f86d77fe640 1 --2- 172.21.15.5:0/2271310517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86d80a7600 0x7f86d8139aa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86d806df00 tx=0x7f86cc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4cd177d1650775e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.293+0000 7f86d6ffd640 1 -- 172.21.15.5:0/2271310517 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86cc0b0070 con 0x7f86d80a7600 2024-08-18T21:10:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:10:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d6ffd640 10 monclient: dump: 2024-08-18T21:10:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:45.307 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:10:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:10:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 5 monclient: authenticate success, global_id 84816 2024-08-18T21:10:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:10:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d6ffd640 1 -- 172.21.15.5:0/2271310517 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86cc0aa810 con 0x7f86d80a7600 2024-08-18T21:10:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 4 set_mon_vals no callback set 2024-08-18T21:10:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d6ffd640 1 -- 172.21.15.5:0/2271310517 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86cc0aae30 con 0x7f86d80a7600 2024-08-18T21:10:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d6ffd640 10 monclient: dump: 2024-08-18T21:10:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:45.309 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 10 monclient: shutdown 2024-08-18T21:10:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 -- 172.21.15.5:0/2271310517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86d80a7600 msgr2=0x7f86d8139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 --2- 172.21.15.5:0/2271310517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86d80a7600 0x7f86d8139aa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86d806df00 tx=0x7f86cc01c3e0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 -- 172.21.15.5:0/2271310517 shutdown_connections 2024-08-18T21:10:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 --2- 172.21.15.5:0/2271310517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86d80a7600 0x7f86d8139aa0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 --2- 172.21.15.5:0/2271310517 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86d8139fe0 0x7f86d813a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 --2- 172.21.15.5:0/2271310517 >> v2:172.21.15.157:3300/0 conn(0x7f86d80a6ce0 0x7f86d80a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 -- 172.21.15.5:0/2271310517 >> 172.21.15.5:0/2271310517 conn(0x7f86d80acbc0 msgr2=0x7f86d80a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 -- 172.21.15.5:0/2271310517 shutdown_connections 2024-08-18T21:10:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 -- 172.21.15.5:0/2271310517 wait complete. 2024-08-18T21:10:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 10 monclient: build_initial_monmap 2024-08-18T21:10:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 10 monclient: monmap: 2024-08-18T21:10:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:45.311 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 Processor -- start 2024-08-18T21:10:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 -- start start 2024-08-18T21:10:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 10 monclient: init 2024-08-18T21:10:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 10 monclient: _add_conns ranks=[0,8,1,4,3,7,5,2,6] 2024-08-18T21:10:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86d80a6ce0 0x7f86d8135a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 10 monclient(hunting): picked mon.noname-a con 0x7f86d80a6ce0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:10:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f86d80a7600 0x7f86d8135fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 10 monclient(hunting): picked mon.noname-e con 0x7f86d80a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86d8139fe0 0x7f86d81364e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 10 monclient(hunting): picked mon.noname-f con 0x7f86d8139fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:10:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f86d80a79e0 con 0x7f86d80a6ce0 2024-08-18T21:10:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f86d80a8220 con 0x7f86d8139fe0 2024-08-18T21:10:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f86d813dec0 con 0x7f86d80a7600 2024-08-18T21:10:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86de367640 10 monclient(hunting): authenticate will time out at 1412.314170s 2024-08-18T21:10:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86d80a6ce0 0x7f86d8135a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d77fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f86d80a7600 0x7f86d8135fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86d80a6ce0 0x7f86d8135a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48042/0 (socket says 172.21.15.5:48042) 2024-08-18T21:10:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 1 -- 172.21.15.5:0/3583447254 learned_addr learned my addr 172.21.15.5:0/3583447254 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 10 monclient(hunting): get_auth_request con 0x7f86d80a6ce0 auth_method 0 2024-08-18T21:10:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d77fe640 10 monclient(hunting): get_auth_request con 0x7f86d80a7600 auth_method 0 2024-08-18T21:10:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:45.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:45.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:45.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:45.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:45.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86dc904640 1 --2- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86d8139fe0 0x7f86d81364e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86dc904640 10 monclient(hunting): get_auth_request con 0x7f86d8139fe0 auth_method 0 2024-08-18T21:10:45.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86dc904640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86dc904640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86dc904640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 10 monclient(hunting): handle_auth_done global_id 84825 payload 824 2024-08-18T21:10:45.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 1 -- 172.21.15.5:0/3583447254 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f86d80a7600 msgr2=0x7f86d8135fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 1 --2- 172.21.15.5:0/3583447254 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f86d80a7600 0x7f86d8135fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 1 -- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86d8139fe0 msgr2=0x7f86d81364e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 1 --2- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86d8139fe0 0x7f86d81364e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:10:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 1 monclient: found mon.noname-a 2024-08-18T21:10:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:10:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d7fff640 1 -- 172.21.15.5:0/3583447254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d813d5c0 con 0x7f86d80a6ce0 2024-08-18T21:10:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.297+0000 7f86d77fe640 1 --2- 172.21.15.5:0/3583447254 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f86d80a7600 0x7f86d8135fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d7fff640 1 -- 172.21.15.5:0/3583447254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86d80a6ce0 msgr2=0x7f86d8135a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d7fff640 1 --2- 172.21.15.5:0/3583447254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86d80a6ce0 0x7f86d8135a60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f86c800d800 tx=0x7f86c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d4ff9640 1 -- 172.21.15.5:0/3583447254 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86c800bd40 con 0x7f86d80a6ce0 2024-08-18T21:10:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:10:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d4ff9640 10 monclient: dump: 2024-08-18T21:10:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:45.317 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d4ff9640 10 monclient: _finish_auth 0 2024-08-18T21:10:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d4ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:10:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d4ff9640 1 -- 172.21.15.5:0/3583447254 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c8019070 con 0x7f86d80a6ce0 2024-08-18T21:10:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d4ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86de367640 5 monclient: authenticate success, global_id 84825 2024-08-18T21:10:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d4ff9640 1 -- 172.21.15.5:0/3583447254 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86c80148a0 con 0x7f86d80a6ce0 2024-08-18T21:10:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:10:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d5ffb640 4 set_mon_vals no callback set 2024-08-18T21:10:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d4ff9640 10 monclient: dump: 2024-08-18T21:10:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:45.319 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86de367640 10 monclient: _renew_subs 2024-08-18T21:10:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86de367640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:10:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86de367640 1 -- 172.21.15.5:0/3583447254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d80a1b50 con 0x7f86d80a6ce0 2024-08-18T21:10:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86de367640 10 monclient: _renew_subs 2024-08-18T21:10:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86de367640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:10:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86de367640 1 -- 172.21.15.5:0/3583447254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d813f100 con 0x7f86d80a6ce0 2024-08-18T21:10:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86de367640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86de367640 1 --2- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f86d813f340 0x7f86d813b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86de367640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86de367640 1 -- 172.21.15.5:0/3583447254 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f86d80a7b60 con 0x7f86d813f340 2024-08-18T21:10:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d4ff9640 1 -- 172.21.15.5:0/3583447254 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f86c8014430 con 0x7f86d80a6ce0 2024-08-18T21:10:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d77fe640 1 --2- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f86d813f340 0x7f86d813b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d77fe640 10 monclient: get_auth_request con 0x7f86d813f340 auth_method 0 2024-08-18T21:10:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d4ff9640 1 --2- 172.21.15.5:0/3583447254 >> v2:172.21.15.157:6812/631023601 conn(0x7f86c403bdc0 0x7f86c403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d4ff9640 1 -- 172.21.15.5:0/3583447254 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(212..212 src has 22..212) ==== 3898+0+0 (secure 0 0 0) 0x7f86c800f040 con 0x7f86d80a6ce0 2024-08-18T21:10:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86dc904640 1 --2- 172.21.15.5:0/3583447254 >> v2:172.21.15.157:6812/631023601 conn(0x7f86c403bdc0 0x7f86c403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86dc904640 10 monclient: get_auth_request con 0x7f86c403bdc0 auth_method 0 2024-08-18T21:10:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d77fe640 10 monclient(hunting): handle_auth_done global_id 6262 payload 824 2024-08-18T21:10:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.301+0000 7f86d77fe640 1 -- 172.21.15.5:0/3583447254 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86d80a70c0 con 0x7f86d813f340 2024-08-18T21:10:45.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.305+0000 7f86d77fe640 1 -- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f86d813f340 msgr2=0x7f86d813b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.305+0000 7f86d77fe640 1 --2- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f86d813f340 0x7f86d813b870 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f86d80a81b0 tx=0x7f86cc019180 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.305+0000 7f86dc904640 1 --2- 172.21.15.5:0/3583447254 >> v2:172.21.15.157:6812/631023601 conn(0x7f86c403bdc0 0x7f86c403e280 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f86d80aa890 tx=0x7f86d000b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.305+0000 7f86d4ff9640 1 -- 172.21.15.5:0/3583447254 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86cc0ba020 con 0x7f86d813f340 2024-08-18T21:10:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.305+0000 7f86d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.305+0000 7f86d4ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:10:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.305+0000 7f86d4ff9640 10 monclient: dump: 2024-08-18T21:10:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:45.324 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.305+0000 7f86d4ff9640 1 -- 172.21.15.5:0/3583447254 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f86cc0b1040 con 0x7f86d813f340 2024-08-18T21:10:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.305+0000 7f86d4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.305+0000 7f86d4ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.305+0000 7f86d4ff9640 1 -- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f86d813f340 msgr2=0x7f86d813b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.305+0000 7f86d4ff9640 1 --2- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f86d813f340 0x7f86d813b870 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f86d80a81b0 tx=0x7f86cc019180 comp rx=0 tx=0).stop 2024-08-18T21:10:45.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.305+0000 7f86d4ff9640 1 -- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f86d813f340 msgr2=0x7f86d813b870 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:45.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.305+0000 7f86d4ff9640 1 --2- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f86d813f340 0x7f86d813b870 secure :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f86d80a81b0 tx=0x7f86cc019180 comp rx=0 tx=0).stop 2024-08-18T21:10:45.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.313+0000 7f86de367640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:10:45.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.313+0000 7f86de367640 1 --2- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f86d813bdb0 0x7f86d813c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.313+0000 7f86de367640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.313+0000 7f86de367640 1 -- 172.21.15.5:0/3583447254 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f86d8051140 con 0x7f86d813bdb0 2024-08-18T21:10:45.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.313+0000 7f86d77fe640 1 --2- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f86d813bdb0 0x7f86d813c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.313+0000 7f86d77fe640 10 monclient: get_auth_request con 0x7f86d813bdb0 auth_method 0 2024-08-18T21:10:45.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.313+0000 7f86d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.313+0000 7f86d77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.313+0000 7f86d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.313+0000 7f86d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:45.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.313+0000 7f86d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:45.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.313+0000 7f86d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:45.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.313+0000 7f86d77fe640 10 monclient(hunting): handle_auth_done global_id 6271 payload 824 2024-08-18T21:10:45.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.313+0000 7f86d77fe640 1 -- 172.21.15.5:0/3583447254 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f86d813c700 con 0x7f86d813bdb0 2024-08-18T21:10:45.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86d77fe640 1 -- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f86d813bdb0 msgr2=0x7f86d813c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:45.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86d77fe640 1 --2- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f86d813bdb0 0x7f86d813c1c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f86cc01cc80 tx=0x7f86cc0a8000 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:45.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86d4ff9640 1 -- 172.21.15.5:0/3583447254 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86cc0ba040 con 0x7f86d813bdb0 2024-08-18T21:10:45.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:45.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86d4ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:10:45.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86d4ff9640 10 monclient: dump: 2024-08-18T21:10:45.326 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:45.326 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.326 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.327 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.327 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:45.327 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.327 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:45.327 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:45.327 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:45.327 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:45.327 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:45.327 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:45.327 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:45.327 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:45.327 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:45.327 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86d4ff9640 1 -- 172.21.15.5:0/3583447254 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9582 (secure 0 0 0) 0x7f86cc003a40 con 0x7f86d813bdb0 2024-08-18T21:10:45.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86d4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:10:45.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86d4ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:45.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86d4ff9640 1 -- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f86d813bdb0 msgr2=0x7f86d813c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86d4ff9640 1 --2- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f86d813bdb0 0x7f86d813c1c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f86cc01cc80 tx=0x7f86cc0a8000 comp rx=0 tx=0).stop 2024-08-18T21:10:45.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86d4ff9640 1 -- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f86d813bdb0 msgr2=0x7f86d813c1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:10:45.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86d4ff9640 1 --2- 172.21.15.5:0/3583447254 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f86d813bdb0 0x7f86d813c1c0 secure :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f86cc01cc80 tx=0x7f86cc0a8000 comp rx=0 tx=0).stop 2024-08-18T21:10:45.328 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:10:45.328 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:45.328 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:45.328 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:10:45.329 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 152, 2024-08-18T21:10:45.329 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 454414, 2024-08-18T21:10:45.329 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:10:45.329 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:10:45.329 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:10:45.329 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:10:45.329 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:10:45.329 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:10:45.329 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:10:45.329 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:10:45.329 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:10:45.329 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:10:45.329 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:45.329 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:10:45.330 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:45.330 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:10:45.330 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:10:45.330 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:45.330 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:45.330 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:45.330 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:45.330 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:45.330 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:45.330 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:45.330 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:45.330 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:45.330 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:45.331 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:45.331 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:45.331 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:10:45.331 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:10:45.331 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:45.331 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:45.331 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:45.331 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:45.331 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:45.331 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:45.331 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:45.331 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:45.331 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:45.331 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:45.332 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:45.332 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.332 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:10:45.332 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:10:45.332 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:10:45.332 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:10:45.332 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:10:45.332 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:10:45.332 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:45.332 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:10:45.332 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:10:45.332 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:10:45.333 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:10:45.333 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:10:45.333 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:10:45.333 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:10:45.333 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:10:45.333 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:10:45.333 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:10:45.333 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:10:45.333 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:10:45.333 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:10:45.333 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:10:45.333 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:10:45.333 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:10:45.333 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:10:45.334 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:10:45.334 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:10:45.334 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:10:45.334 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:10:45.334 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:45.334 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:10:45.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.334 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:10:45.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.334 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:10:45.334 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:10:45.334 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.334 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.335 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.335 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:10:45.335 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.335 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.335 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:10:45.335 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.335 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.335 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.335 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:10:45.336 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:10:45.336 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.336 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.336 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.336 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:10:45.336 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:10:45.336 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.336 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.336 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.336 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:10:45.336 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.337 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.337 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:10:45.337 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.337 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.337 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.337 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:10:45.337 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:10:45.337 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.337 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.337 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.338 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:10:45.338 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:10:45.338 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.338 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.338 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.338 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:10:45.338 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.338 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.338 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:10:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:10:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:10:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:10:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:10:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.340 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.340 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:10:45.340 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.340 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.340 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:10:45.340 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.340 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.340 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.341 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:10:45.341 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:10:45.341 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.341 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.341 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.341 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:10:45.341 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:10:45.341 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.341 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.341 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.341 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:10:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:10:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:10:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:10:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:10:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:10:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:10:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:10:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:10:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:10:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:10:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:10:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.345 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.345 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.345 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:10:45.345 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.345 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.345 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:10:45.345 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.345 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.345 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:10:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:10:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:10:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:10:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:10:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:10:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:10:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:10:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.348 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.348 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:10:45.348 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:10:45.348 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:10:45.348 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:10:45.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.348 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:10:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:10:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:10:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:10:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:10:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:10:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:10:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:10:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:10:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:10:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:10:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:10:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:10:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:10:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 6 2024-08-18T21:10:45.352 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.352 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:10:45.352 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:10:45.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:10:45.352 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:10:45.352 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:10:45.352 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:10:45.352 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:10:45.352 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:10:45.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:10:45.352 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:10:45.352 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:10:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86de367640 1 -- 172.21.15.5:0/3583447254 >> v2:172.21.15.157:6812/631023601 conn(0x7f86c403bdc0 msgr2=0x7f86c403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86de367640 1 --2- 172.21.15.5:0/3583447254 >> v2:172.21.15.157:6812/631023601 conn(0x7f86c403bdc0 0x7f86c403e280 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f86d80aa890 tx=0x7f86d000b040 comp rx=0 tx=0).stop 2024-08-18T21:10:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86de367640 10 monclient: shutdown 2024-08-18T21:10:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86de367640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86de367640 1 -- 172.21.15.5:0/3583447254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86d80a6ce0 msgr2=0x7f86d8135a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86de367640 1 --2- 172.21.15.5:0/3583447254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86d80a6ce0 0x7f86d8135a60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f86c800d800 tx=0x7f86c800dcc0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86dc904640 1 -- 172.21.15.5:0/3583447254 reap_dead start 2024-08-18T21:10:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86dc904640 1 -- 172.21.15.5:0/3583447254 reap_dead start 2024-08-18T21:10:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86de367640 1 -- 172.21.15.5:0/3583447254 shutdown_connections 2024-08-18T21:10:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86de367640 1 -- 172.21.15.5:0/3583447254 >> 172.21.15.5:0/3583447254 conn(0x7f86d80acbc0 msgr2=0x7f86d80a2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86de367640 1 -- 172.21.15.5:0/3583447254 shutdown_connections 2024-08-18T21:10:45.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.317+0000 7f86de367640 1 -- 172.21.15.5:0/3583447254 wait complete. 2024-08-18T21:10:45.355 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:10:45.355 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['e', 'c', 'a', 'b'] 2024-08-18T21:10:45.355 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-18T21:10:45.355 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-08-18T21:10:45.355 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-08-18T21:10:45.356 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-08-18T21:10:45.356 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:10:45.368 INFO:tasks.ceph.mon.e:Stopped 2024-08-18T21:10:45.368 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-08-18T21:10:45.368 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-08-18T21:10:45.368 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-18T21:10:45.368 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:10:45.378 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:45.378 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2655836856}) 2024-08-18T21:10:45.378 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1683009985}) 2024-08-18T21:10:45.378 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:45.378 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2655836856}) 2024-08-18T21:10:45.378 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1385392197}) 2024-08-18T21:10:45.378 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:45.378 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2655836856}) 2024-08-18T21:10:45.378 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2821498330}) 2024-08-18T21:10:45.378 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:45.378 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2655836856}) 2024-08-18T21:10:45.378 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2673027753}) 2024-08-18T21:10:45.379 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:45.379 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2655836856}) 2024-08-18T21:10:45.379 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=266268250}) 2024-08-18T21:10:45.379 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:45.379 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2655836856}) 2024-08-18T21:10:45.379 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3657869457}) 2024-08-18T21:10:45.379 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:45.379 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2655836856}) 2024-08-18T21:10:45.379 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=467424361}) 2024-08-18T21:10:45.379 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:10:45.379 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2655836856}) 2024-08-18T21:10:45.379 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:10:45.373+0000 7f69b5be9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3901567779}) 2024-08-18T21:10:45.389 INFO:tasks.ceph.mon.c:Stopped 2024-08-18T21:10:45.389 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-18T21:10:45.389 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-18T21:10:45.389 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-18T21:10:45.389 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:10:45.442 INFO:tasks.ceph.mon.a:Stopped 2024-08-18T21:10:45.442 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-08-18T21:10:45.442 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-08-18T21:10:45.442 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-18T21:10:45.442 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:10:45.506 INFO:tasks.ceph.mon.b:Stopped 2024-08-18T21:10:45.506 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 5 2024-08-18T21:10:45.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:10:45.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 10 monclient: get_monmap_and_config 2024-08-18T21:10:45.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 10 monclient: build_initial_monmap 2024-08-18T21:10:45.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 10 monclient: monmap: 2024-08-18T21:10:45.672 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:45.672 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.672 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:45.674215+0000 2024-08-18T21:10:45.673 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:45.674215+0000 2024-08-18T21:10:45.673 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:45.673 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.673 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:45.673 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:45.673 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:45.673 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:45.673 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:45.673 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:45.673 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:45.673 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:45.673 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:45.673 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:45.674 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:45.674 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 1 Processor -- start 2024-08-18T21:10:45.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 1 -- start start 2024-08-18T21:10:45.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 10 monclient: init 2024-08-18T21:10:45.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:45.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 10 monclient: _add_conns ranks=[8,10,7,2,9,3,6,5,0,1,4] 2024-08-18T21:10:45.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f64e40a6ce0 0x7f64e40a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 10 monclient(hunting): picked mon.noname-e con 0x7f64e40a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:10:45.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f64e40a7600 0x7f64e4139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 10 monclient(hunting): picked mon.noname-f con 0x7f64e40a7600 addr v2:172.21.15.157:3300/0 2024-08-18T21:10:45.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f64e4139fe0 0x7f64e413a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 10 monclient(hunting): picked mon.noname-i con 0x7f64e4139fe0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:45.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f64e40a5000 con 0x7f64e40a7600 2024-08-18T21:10:45.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f64e40a4360 con 0x7f64e4139fe0 2024-08-18T21:10:45.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f64e40a45d0 con 0x7f64e40a6ce0 2024-08-18T21:10:45.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:45.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ec237640 10 monclient(hunting): authenticate will time out at 1412.687374s 2024-08-18T21:10:45.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64e9fd3640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f64e40a6ce0 msgr2=0x7f64e40a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:10:45.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64e9fd3640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f64e40a6ce0 0x7f64e40a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:45.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64e97d2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f64e40a7600 0x7f64e4139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ea7d4640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f64e4139fe0 0x7f64e413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64e97d2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f64e40a7600 0x7f64e4139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:53284/0 (socket says 172.21.15.5:53284) 2024-08-18T21:10:45.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ea7d4640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f64e4139fe0 0x7f64e413a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:52818/0 (socket says 172.21.15.5:52818) 2024-08-18T21:10:45.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64e97d2640 1 -- 172.21.15.5:0/3631950927 learned_addr learned my addr 172.21.15.5:0/3631950927 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:45.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64e97d2640 10 monclient(hunting): get_auth_request con 0x7f64e40a7600 auth_method 0 2024-08-18T21:10:45.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64e97d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64e97d2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64e97d2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ea7d4640 10 monclient(hunting): get_auth_request con 0x7f64e4139fe0 auth_method 0 2024-08-18T21:10:45.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ea7d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ea7d4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ea7d4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64e97d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64e97d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64e97d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ea7d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.669+0000 7f64ea7d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.673+0000 7f64ea7d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.673+0000 7f64e97d2640 10 monclient(hunting): handle_auth_done global_id 104275 payload 274 2024-08-18T21:10:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.673+0000 7f64e97d2640 1 -- 172.21.15.5:0/3631950927 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f64e40a6ce0 msgr2=0x7f64e40a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.673+0000 7f64e97d2640 1 --2- 172.21.15.5:0/3631950927 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f64e40a6ce0 0x7f64e40a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.673+0000 7f64e97d2640 1 -- 172.21.15.5:0/3631950927 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f64e4139fe0 msgr2=0x7f64e413a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:10:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.673+0000 7f64e97d2640 1 --2- 172.21.15.5:0/3631950927 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f64e4139fe0 0x7f64e413a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.673+0000 7f64e97d2640 10 monclient: _finish_hunting 0 2024-08-18T21:10:45.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.673+0000 7f64e97d2640 1 monclient: found mon.noname-f 2024-08-18T21:10:45.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.673+0000 7f64e97d2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:45.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.673+0000 7f64e97d2640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:10:45.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.673+0000 7f64e97d2640 1 -- 172.21.15.5:0/3631950927 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e40a32d0 con 0x7f64e40a7600 2024-08-18T21:10:45.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.673+0000 7f64ea7d4640 1 --2- 172.21.15.5:0/3631950927 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f64e4139fe0 0x7f64e413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:10:45.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e97d2640 1 -- 172.21.15.5:0/3631950927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64e40a7600 msgr2=0x7f64e4139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:45.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e97d2640 1 --2- 172.21.15.5:0/3631950927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64e40a7600 0x7f64e4139aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009870 tx=0x7f64e001c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fec77e60bb5a0284 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:45.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e8fd1640 1 -- 172.21.15.5:0/3631950927 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f64e00b0070 con 0x7f64e40a7600 2024-08-18T21:10:45.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e8fd1640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:45.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e8fd1640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:10:45.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e8fd1640 10 monclient: dump: 2024-08-18T21:10:45.684 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:45.684 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.684 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.684 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.684 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:45.684 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.684 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:45.684 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:45.684 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:45.684 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:45.684 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:45.684 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:45.684 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:45.685 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:45.685 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:45.685 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e8fd1640 10 monclient: _finish_auth 0 2024-08-18T21:10:45.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e8fd1640 10 monclient: _check_auth_tickets 2024-08-18T21:10:45.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e8fd1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:45.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e8fd1640 1 -- 172.21.15.5:0/3631950927 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e00aa810 con 0x7f64e40a7600 2024-08-18T21:10:45.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e8fd1640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:45.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e8fd1640 1 -- 172.21.15.5:0/3631950927 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f64e00aae30 con 0x7f64e40a7600 2024-08-18T21:10:45.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 5 monclient: authenticate success, global_id 104275 2024-08-18T21:10:45.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:45.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 4 set_mon_vals no callback set 2024-08-18T21:10:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e8fd1640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e8fd1640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:10:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e8fd1640 10 monclient: dump: 2024-08-18T21:10:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:45.687 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:45.687 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:45.687 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:45.687 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:45.687 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 10 monclient: shutdown 2024-08-18T21:10:45.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:45.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 -- 172.21.15.5:0/3631950927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64e40a7600 msgr2=0x7f64e4139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 --2- 172.21.15.5:0/3631950927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64e40a7600 0x7f64e4139aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009870 tx=0x7f64e001c440 comp rx=0 tx=0).stop 2024-08-18T21:10:45.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 -- 172.21.15.5:0/3631950927 shutdown_connections 2024-08-18T21:10:45.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 --2- 172.21.15.5:0/3631950927 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f64e4139fe0 0x7f64e413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 --2- 172.21.15.5:0/3631950927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64e40a7600 0x7f64e4139aa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 --2- 172.21.15.5:0/3631950927 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f64e40a6ce0 0x7f64e40a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 -- 172.21.15.5:0/3631950927 >> 172.21.15.5:0/3631950927 conn(0x7f64e40acbc0 msgr2=0x7f64e40a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:45.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 -- 172.21.15.5:0/3631950927 shutdown_connections 2024-08-18T21:10:45.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 -- 172.21.15.5:0/3631950927 wait complete. 2024-08-18T21:10:45.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 10 monclient: build_initial_monmap 2024-08-18T21:10:45.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 10 monclient: monmap: 2024-08-18T21:10:45.688 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:45.688 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:45.688 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:45.688 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:45.688 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:45.688 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.688 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:45.688 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:45.689 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:45.689 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:45.689 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:45.689 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:45.689 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:45.689 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:45.689 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:45.689 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 Processor -- start 2024-08-18T21:10:45.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 -- start start 2024-08-18T21:10:45.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 10 monclient: init 2024-08-18T21:10:45.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:45.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 10 monclient: _add_conns ranks=[7,4,5,3,0,1,6,8,2] 2024-08-18T21:10:45.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f64e40a6ce0 0x7f64e40a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 10 monclient(hunting): picked mon.noname-i con 0x7f64e40a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:45.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f64e40a7600 0x7f64e413af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 10 monclient(hunting): picked mon.noname-c con 0x7f64e40a7600 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:45.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f64e4139fe0 0x7f64e413b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 10 monclient(hunting): picked mon.noname-h con 0x7f64e4139fe0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:45.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f64e40a79e0 con 0x7f64e40a7600 2024-08-18T21:10:45.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f64e40a8220 con 0x7f64e4139fe0 2024-08-18T21:10:45.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:45.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f64e413d6d0 con 0x7f64e40a6ce0 2024-08-18T21:10:45.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:45.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64ec237640 10 monclient(hunting): authenticate will time out at 1412.695667s 2024-08-18T21:10:45.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e97d2640 1 -- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f64e40a7600 msgr2=0x7f64e413af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:10:45.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e97d2640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f64e40a7600 0x7f64e413af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:45.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.677+0000 7f64e9fd3640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f64e40a6ce0 0x7f64e40a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f64e40a6ce0 0x7f64e40a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:52830/0 (socket says 172.21.15.5:52830) 2024-08-18T21:10:45.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 1 -- 172.21.15.5:0/2845675126 learned_addr learned my addr 172.21.15.5:0/2845675126 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:45.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 10 monclient(hunting): get_auth_request con 0x7f64e40a6ce0 auth_method 0 2024-08-18T21:10:45.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64ea7d4640 1 --2- 172.21.15.5:0/2845675126 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f64e4139fe0 0x7f64e413b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64ea7d4640 10 monclient(hunting): get_auth_request con 0x7f64e4139fe0 auth_method 0 2024-08-18T21:10:45.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64ea7d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:45.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64ea7d4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:45.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64ea7d4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:45.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:45.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:45.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:45.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64ea7d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:45.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64ea7d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:45.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64ea7d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:45.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 10 monclient(hunting): handle_auth_done global_id 6289 payload 824 2024-08-18T21:10:45.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 1 -- 172.21.15.5:0/2845675126 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f64e4139fe0 msgr2=0x7f64e413b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 1 --2- 172.21.15.5:0/2845675126 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f64e4139fe0 0x7f64e413b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 1 -- 172.21.15.5:0/2845675126 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f64e40a7600 msgr2=0x7f64e413af00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:10:45.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 1 --2- 172.21.15.5:0/2845675126 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f64e40a7600 0x7f64e413af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 10 monclient: _finish_hunting 0 2024-08-18T21:10:45.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 1 monclient: found mon.noname-i 2024-08-18T21:10:45.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:45.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:10:45.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 1 -- 172.21.15.5:0/2845675126 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e40a1b90 con 0x7f64e40a6ce0 2024-08-18T21:10:45.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 1 -- 172.21.15.5:0/2845675126 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f64e40a6ce0 msgr2=0x7f64e40a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:45.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64e9fd3640 1 --2- 172.21.15.5:0/2845675126 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f64e40a6ce0 0x7f64e40a05b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f64d400b5b0 tx=0x7f64d400b9b0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:45.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64da7fc640 1 -- 172.21.15.5:0/2845675126 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f64d40092d0 con 0x7f64e40a6ce0 2024-08-18T21:10:45.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64da7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:45.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64da7fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:10:45.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64da7fc640 10 monclient: dump: 2024-08-18T21:10:45.695 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:45.695 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.696 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.696 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.696 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:45.696 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.696 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:45.696 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:45.696 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:45.696 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:45.696 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:45.696 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:45.696 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:45.696 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:45.696 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:45.697 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64da7fc640 10 monclient: _finish_auth 0 2024-08-18T21:10:45.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64da7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:10:45.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:45.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64da7fc640 1 -- 172.21.15.5:0/2845675126 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64d4015070 con 0x7f64e40a6ce0 2024-08-18T21:10:45.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64da7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:45.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64da7fc640 1 -- 172.21.15.5:0/2845675126 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f64d4003de0 con 0x7f64e40a6ce0 2024-08-18T21:10:45.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64da7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:45.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64da7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:10:45.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64da7fc640 10 monclient: dump: 2024-08-18T21:10:45.697 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:45.697 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:45.697 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:45.698 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64ec237640 5 monclient: authenticate success, global_id 6289 2024-08-18T21:10:45.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64ec237640 10 monclient: _renew_subs 2024-08-18T21:10:45.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64ec237640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:10:45.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64ec237640 1 -- 172.21.15.5:0/2845675126 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e40aa680 con 0x7f64e40a6ce0 2024-08-18T21:10:45.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64dbfff640 4 set_mon_vals no callback set 2024-08-18T21:10:45.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64ec237640 10 monclient: _renew_subs 2024-08-18T21:10:45.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64ec237640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:10:45.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.681+0000 7f64ec237640 1 -- 172.21.15.5:0/2845675126 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e413d3f0 con 0x7f64e40a6ce0 2024-08-18T21:10:45.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.685+0000 7f64ec237640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:45.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.685+0000 7f64ec237640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:45.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.685+0000 7f64ec237640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:10:45.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.685+0000 7f64ec237640 1 -- 172.21.15.5:0/2845675126 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e40a7b60 con 0x7f64e40a6ce0 2024-08-18T21:10:45.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.685+0000 7f64da7fc640 1 -- 172.21.15.5:0/2845675126 <== mon.7 v2:172.21.15.157:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f64d400f070 con 0x7f64e40a6ce0 2024-08-18T21:10:45.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.685+0000 7f64da7fc640 1 --2- 172.21.15.5:0/2845675126 >> v2:172.21.15.157:6812/631023601 conn(0x7f64c803bdc0 0x7f64c803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.685+0000 7f64da7fc640 1 -- 172.21.15.5:0/2845675126 <== mon.7 v2:172.21.15.157:3303/0 5 ==== osd_map(212..212 src has 22..212) ==== 3898+0+0 (secure 0 0 0) 0x7f64d404eaf0 con 0x7f64e40a6ce0 2024-08-18T21:10:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.685+0000 7f64e97d2640 1 --2- 172.21.15.5:0/2845675126 >> v2:172.21.15.157:6812/631023601 conn(0x7f64c803bdc0 0x7f64c803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.685+0000 7f64e97d2640 10 monclient: get_auth_request con 0x7f64c803bdc0 auth_method 0 2024-08-18T21:10:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.689+0000 7f64e97d2640 1 --2- 172.21.15.5:0/2845675126 >> v2:172.21.15.157:6812/631023601 conn(0x7f64c803bdc0 0x7f64c803e280 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009870 tx=0x7f64e00a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.697+0000 7f64da7fc640 1 -- 172.21.15.5:0/2845675126 <== mon.7 v2:172.21.15.157:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f64e40a7b60 con 0x7f64e40a6ce0 2024-08-18T21:10:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.697+0000 7f64da7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.697+0000 7f64da7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:45.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.937+0000 7f64ec237640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:10:45.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.937+0000 7f64ec237640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:10:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.937+0000 7f64ec237640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:10:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.937+0000 7f64ec237640 1 -- 172.21.15.5:0/2845675126 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f64e40a70c0 con 0x7f64e40a6ce0 2024-08-18T21:10:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.937+0000 7f64da7fc640 1 -- 172.21.15.5:0/2845675126 <== mon.7 v2:172.21.15.157:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7f64d400d040 con 0x7f64e40a6ce0 2024-08-18T21:10:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.937+0000 7f64da7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:10:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.937+0000 7f64da7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:45.940 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":152,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:10:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.937+0000 7f64ec237640 1 -- 172.21.15.5:0/2845675126 >> v2:172.21.15.157:6812/631023601 conn(0x7f64c803bdc0 msgr2=0x7f64c803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.937+0000 7f64ec237640 1 --2- 172.21.15.5:0/2845675126 >> v2:172.21.15.157:6812/631023601 conn(0x7f64c803bdc0 0x7f64c803e280 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009870 tx=0x7f64e00a6000 comp rx=0 tx=0).stop 2024-08-18T21:10:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.937+0000 7f64ec237640 10 monclient: shutdown 2024-08-18T21:10:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.937+0000 7f64ec237640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.937+0000 7f64ec237640 1 -- 172.21.15.5:0/2845675126 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f64e40a6ce0 msgr2=0x7f64e40a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.937+0000 7f64ec237640 1 --2- 172.21.15.5:0/2845675126 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f64e40a6ce0 0x7f64e40a05b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f64d400b5b0 tx=0x7f64d400b9b0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.941+0000 7f64ec237640 1 -- 172.21.15.5:0/2845675126 shutdown_connections 2024-08-18T21:10:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.941+0000 7f64ec237640 1 --2- 172.21.15.5:0/2845675126 >> v2:172.21.15.157:6812/631023601 conn(0x7f64c803bdc0 0x7f64c803e280 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.941+0000 7f64ec237640 1 --2- 172.21.15.5:0/2845675126 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f64e4139fe0 0x7f64e413b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.941+0000 7f64ec237640 1 --2- 172.21.15.5:0/2845675126 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f64e40a7600 0x7f64e413af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.941+0000 7f64ec237640 1 --2- 172.21.15.5:0/2845675126 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f64e40a6ce0 0x7f64e40a05b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.941+0000 7f64ec237640 1 -- 172.21.15.5:0/2845675126 >> 172.21.15.5:0/2845675126 conn(0x7f64e40acbc0 msgr2=0x7f64e40abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.941+0000 7f64ec237640 1 -- 172.21.15.5:0/2845675126 shutdown_connections 2024-08-18T21:10:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:45.941+0000 7f64ec237640 1 -- 172.21.15.5:0/2845675126 wait complete. 2024-08-18T21:10:48.961 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:10:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.089+0000 7f2bd02de640 10 monclient: get_monmap_and_config 2024-08-18T21:10:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.089+0000 7f2bd02de640 10 monclient: build_initial_monmap 2024-08-18T21:10:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.089+0000 7f2bd02de640 10 monclient: monmap: 2024-08-18T21:10:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:49.095340+0000 2024-08-18T21:10:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:49.095340+0000 2024-08-18T21:10:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:49.095 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:49.095 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:49.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.089+0000 7f2bd02de640 1 Processor -- start 2024-08-18T21:10:49.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.089+0000 7f2bd02de640 1 -- start start 2024-08-18T21:10:49.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.089+0000 7f2bd02de640 10 monclient: init 2024-08-18T21:10:49.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bd02de640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:49.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bd02de640 10 monclient: _add_conns ranks=[0,4,1,2,9,5,3,10,8,7,6] 2024-08-18T21:10:49.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bd02de640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2bc80a6ce0 addr v1:172.21.15.5:6789/0 2024-08-18T21:10:49.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bd02de640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2bc80a77d0 0x7f2bc813ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:49.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bd02de640 10 monclient(hunting): picked mon.noname-c con 0x7f2bc80a77d0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:10:49.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bd02de640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f2bc813f220 addr v1:172.21.15.157:6789/0 2024-08-18T21:10:49.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bd02de640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc80a45d0 con 0x7f2bc80a6ce0 2024-08-18T21:10:49.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bd02de640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc80a32d0 con 0x7f2bc813f220 2024-08-18T21:10:49.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bd02de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:49.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bd02de640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f2bc80a5000 con 0x7f2bc80a77d0 2024-08-18T21:10:49.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bd02de640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:49.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bd02de640 10 monclient(hunting): authenticate will time out at 1416.108588s 2024-08-18T21:10:49.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bce07a640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7f2bc80a6ce0 legacy=0x7f2bc80a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:10:49.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bcd879640 1 -- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2bc80a77d0 msgr2=0x7f2bc813ece0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:10:49.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bcd879640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2bc80a77d0 0x7f2bc813ece0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:49.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bce87b640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f2bc813f220 0x7f2bc8141610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:40360/0 (socket says 172.21.15.5:40360) 2024-08-18T21:10:49.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bce87b640 1 -- 172.21.15.5:0/3266964806 learned_addr learned my addr 172.21.15.5:0/3266964806 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:10:49.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.093+0000 7f2bce87b640 1 -- 172.21.15.5:0/3266964806 >> v1:172.21.15.157:6789/0 conn(0x7f2bc813f220 legacy=0x7f2bc8141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:49.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.297+0000 7f2bce07a640 1 -- 172.21.15.5:0/3266964806 >> v1:172.21.15.5:6789/0 conn(0x7f2bc80a6ce0 legacy=0x7f2bc80a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:10:49.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.297+0000 7f2bcd879640 1 -- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2bc80a77d0 msgr2=0x7f2bc813ece0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:10:49.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.297+0000 7f2bcd879640 1 --2- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2bc80a77d0 0x7f2bc813ece0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:10:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.701+0000 7f2bcd879640 1 -- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2bc80a77d0 msgr2=0x7f2bc813ece0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:10:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.701+0000 7f2bce07a640 1 -- 172.21.15.5:0/3266964806 >> v1:172.21.15.5:6789/0 conn(0x7f2bc80a6ce0 legacy=0x7f2bc80a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:10:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:49.701+0000 7f2bcd879640 1 --2- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2bc80a77d0 0x7f2bc813ece0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:10:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:50.505+0000 7f2bcd879640 1 -- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2bc80a77d0 msgr2=0x7f2bc813ece0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:10:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:50.505+0000 7f2bce07a640 1 -- 172.21.15.5:0/3266964806 >> v1:172.21.15.5:6789/0 conn(0x7f2bc80a6ce0 legacy=0x7f2bc80a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:10:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:50.505+0000 7f2bcd879640 1 --2- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2bc80a77d0 0x7f2bc813ece0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:10:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 10 monclient(hunting): tick 2024-08-18T21:10:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:10:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 1 monclient(hunting): continuing hunt 2024-08-18T21:10:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:10:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 1 -- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2bc80a77d0 msgr2=0x7f2bc813ece0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 1 --2- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f2bc80a77d0 0x7f2bc813ece0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 1 -- 172.21.15.5:0/3266964806 >> v1:172.21.15.157:6789/0 conn(0x7f2bc813f220 legacy=0x7f2bc8141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 1 -- 172.21.15.5:0/3266964806 >> v1:172.21.15.5:6789/0 conn(0x7f2bc80a6ce0 legacy=0x7f2bc80a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 10 monclient: _add_conns ranks=[2,6,9,3,5,10,7,8] 2024-08-18T21:10:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 1 --2- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bac0038b0 0x7f2bac005d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 10 monclient(hunting): picked mon.noname-b con 0x7f2bac0038b0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:10:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 1 --2- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2bac0062b0 0x7f2bac008740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 10 monclient(hunting): picked mon.noname-d con 0x7f2bac0062b0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 1 --2- 172.21.15.5:0/3266964806 >> v2:172.21.15.5:3300/0 conn(0x7f2bac008e10 0x7f2bac00b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 10 monclient(hunting): picked mon.noname-a con 0x7f2bac008e10 addr v2:172.21.15.5:3300/0 2024-08-18T21:10:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 1 -- 172.21.15.5:0/3266964806 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2bac00ba10 con 0x7f2bac008e10 2024-08-18T21:10:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 1 -- 172.21.15.5:0/3266964806 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f2bac00bb90 con 0x7f2bac0038b0 2024-08-18T21:10:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 1 -- 172.21.15.5:0/3266964806 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f2bac00bd90 con 0x7f2bac0062b0 2024-08-18T21:10:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bbffff640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bce07a640 1 -- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bac0038b0 msgr2=0x7f2bac005d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:10:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bce87b640 1 -- 172.21.15.5:0/3266964806 >> v2:172.21.15.5:3300/0 conn(0x7f2bac008e10 msgr2=0x7f2bac00b2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:10:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bce87b640 1 --2- 172.21.15.5:0/3266964806 >> v2:172.21.15.5:3300/0 conn(0x7f2bac008e10 0x7f2bac00b2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bce07a640 1 --2- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bac0038b0 0x7f2bac005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 1 --2- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2bac0062b0 0x7f2bac008740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 10 monclient(hunting): get_auth_request con 0x7f2bac0062b0 auth_method 0 2024-08-18T21:10:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 10 monclient(hunting): handle_auth_done global_id 85074 payload 274 2024-08-18T21:10:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 1 -- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bac0038b0 msgr2=0x7f2bac005d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 1 --2- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2bac0038b0 0x7f2bac005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 1 -- 172.21.15.5:0/3266964806 >> v2:172.21.15.5:3300/0 conn(0x7f2bac008e10 msgr2=0x7f2bac00b2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 1 --2- 172.21.15.5:0/3266964806 >> v2:172.21.15.5:3300/0 conn(0x7f2bac008e10 0x7f2bac00b2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 10 monclient: _finish_hunting 0 2024-08-18T21:10:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 1 monclient: found mon.noname-d 2024-08-18T21:10:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bce87b640 1 -- 172.21.15.5:0/3266964806 reap_dead start 2024-08-18T21:10:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:10:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.093+0000 7f2bcd879640 1 -- 172.21.15.5:0/3266964806 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc80a8900 con 0x7f2bac0062b0 2024-08-18T21:10:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bcd879640 1 -- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2bac0062b0 msgr2=0x7f2bac008740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bcd879640 1 --2- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2bac0062b0 0x7f2bac008740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8003990 tx=0x7f2bb801cb30 comp rx=0 tx=0).ready entity=mon.6 client_cookie=7768ea1fb423cffb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bcd078640 1 -- 172.21.15.5:0/3266964806 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2bb80ae470 con 0x7f2bac0062b0 2024-08-18T21:10:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bcd078640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bcd078640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:10:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bcd078640 10 monclient: dump: 2024-08-18T21:10:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:52.108 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:52.108 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:52.108 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:52.108 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:52.108 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:52.108 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:52.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bcd078640 10 monclient: _finish_auth 0 2024-08-18T21:10:52.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bcd078640 10 monclient: _check_auth_tickets 2024-08-18T21:10:52.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bcd078640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:52.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bcd078640 1 -- 172.21.15.5:0/3266964806 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb80a9070 con 0x7f2bac0062b0 2024-08-18T21:10:52.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bcd078640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:52.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bcd078640 1 -- 172.21.15.5:0/3266964806 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2bb80aeaa0 con 0x7f2bac0062b0 2024-08-18T21:10:52.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bd02de640 5 monclient: authenticate success, global_id 85074 2024-08-18T21:10:52.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bd02de640 10 monclient: get_monmap_and_config success 2024-08-18T21:10:52.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bd02de640 4 set_mon_vals no callback set 2024-08-18T21:10:52.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bcd078640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:52.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bcd078640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:52.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bcd078640 10 monclient: dump: 2024-08-18T21:10:52.110 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:52.110 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:52.110 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:52.110 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:52.110 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:52.111 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:52.111 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:52.111 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:52.111 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:52.111 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:52.111 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:52.111 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:52.111 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:52.112 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:52.112 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:52.112 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bd02de640 10 monclient: shutdown 2024-08-18T21:10:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bd02de640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bd02de640 1 -- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2bac0062b0 msgr2=0x7f2bac008740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bd02de640 1 --2- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2bac0062b0 0x7f2bac008740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8003990 tx=0x7f2bb801cb30 comp rx=0 tx=0).stop 2024-08-18T21:10:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bd02de640 1 -- 172.21.15.5:0/3266964806 shutdown_connections 2024-08-18T21:10:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bd02de640 1 --2- 172.21.15.5:0/3266964806 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2bac0062b0 0x7f2bac008740 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bd02de640 1 -- 172.21.15.5:0/3266964806 >> 172.21.15.5:0/3266964806 conn(0x7f2bc80acbc0 msgr2=0x7f2bc80a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.101+0000 7f2bd02de640 1 -- 172.21.15.5:0/3266964806 shutdown_connections 2024-08-18T21:10:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 1 -- 172.21.15.5:0/3266964806 wait complete. 2024-08-18T21:10:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 10 monclient: build_initial_monmap 2024-08-18T21:10:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 10 monclient: monmap: 2024-08-18T21:10:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:10:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:10:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:10:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:10:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:10:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:52.121 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 1 Processor -- start 2024-08-18T21:10:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 1 -- start start 2024-08-18T21:10:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 10 monclient: init 2024-08-18T21:10:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 10 monclient: _add_conns ranks=[1,0,6,8,2,4,5,7,3] 2024-08-18T21:10:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bac0062b0 0x7f2bc81ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 10 monclient(hunting): picked mon.noname-f con 0x7f2bac0062b0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:10:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bc81cedd0 0x7f2bc81cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 10 monclient(hunting): picked mon.noname-a con 0x7f2bc81cedd0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:10:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2bc809eef0 0x7f2bc809f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 10 monclient(hunting): picked mon.noname-d con 0x7f2bc809eef0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc80a9810 con 0x7f2bc81cedd0 2024-08-18T21:10:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc80a3d30 con 0x7f2bac0062b0 2024-08-18T21:10:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:52.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f2bc80a8220 con 0x7f2bc809eef0 2024-08-18T21:10:52.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:52.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bd02de640 10 monclient(hunting): authenticate will time out at 1419.122555s 2024-08-18T21:10:52.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bcd879640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bc81cedd0 msgr2=0x7f2bc81cf1f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:10:52.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bcd879640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bc81cedd0 0x7f2bc81cf1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:52.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2bc809eef0 0x7f2bc809f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:52.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce07a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bac0062b0 0x7f2bc81ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:52.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2bc809eef0 0x7f2bc809f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:52134/0 (socket says 172.21.15.5:52134) 2024-08-18T21:10:52.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 1 -- 172.21.15.5:0/1653992681 learned_addr learned my addr 172.21.15.5:0/1653992681 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:52.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 10 monclient(hunting): get_auth_request con 0x7f2bc809eef0 auth_method 0 2024-08-18T21:10:52.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:52.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce07a640 10 monclient(hunting): get_auth_request con 0x7f2bac0062b0 auth_method 0 2024-08-18T21:10:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce07a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce07a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce07a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce07a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:10:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce07a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:10:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce07a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:10:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 10 monclient(hunting): handle_auth_done global_id 85083 payload 824 2024-08-18T21:10:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 1 -- 172.21.15.5:0/1653992681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bac0062b0 msgr2=0x7f2bc81ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 1 --2- 172.21.15.5:0/1653992681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bac0062b0 0x7f2bc81ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 1 -- 172.21.15.5:0/1653992681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bc81cedd0 msgr2=0x7f2bc81cf1f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:10:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 1 --2- 172.21.15.5:0/1653992681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bc81cedd0 0x7f2bc81cf1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 10 monclient: _finish_hunting 0 2024-08-18T21:10:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 1 monclient: found mon.noname-d 2024-08-18T21:10:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:10:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:10:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.105+0000 7f2bce87b640 1 -- 172.21.15.5:0/1653992681 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc8122e40 con 0x7f2bc809eef0 2024-08-18T21:10:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bce87b640 1 -- 172.21.15.5:0/1653992681 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2bc809eef0 msgr2=0x7f2bc809f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bce87b640 1 --2- 172.21.15.5:0/1653992681 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2bc809eef0 0x7f2bc809f370 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0005c10 tx=0x7f2bc000cd50 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bbeffd640 1 -- 172.21.15.5:0/1653992681 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2bc0017070 con 0x7f2bc809eef0 2024-08-18T21:10:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bbeffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:10:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bbeffd640 10 monclient: dump: 2024-08-18T21:10:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:52.127 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bbeffd640 10 monclient: _finish_auth 0 2024-08-18T21:10:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bbeffd640 10 monclient: _check_auth_tickets 2024-08-18T21:10:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bbeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:10:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bbeffd640 1 -- 172.21.15.5:0/1653992681 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc0007070 con 0x7f2bc809eef0 2024-08-18T21:10:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bd02de640 5 monclient: authenticate success, global_id 85083 2024-08-18T21:10:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bd02de640 10 monclient: _renew_subs 2024-08-18T21:10:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bd02de640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bd02de640 1 -- 172.21.15.5:0/1653992681 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc80a12b0 con 0x7f2bc809eef0 2024-08-18T21:10:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bbeffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:10:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bbeffd640 1 -- 172.21.15.5:0/1653992681 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2bc000aea0 con 0x7f2bc809eef0 2024-08-18T21:10:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:10:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bbeffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:10:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bcc877640 4 set_mon_vals no callback set 2024-08-18T21:10:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bbeffd640 10 monclient: dump: 2024-08-18T21:10:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:10:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:10:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:10:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:10:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:10:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:10:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:10:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:10:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:10:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:10:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:10:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:10:52.131 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bd02de640 10 monclient: _renew_subs 2024-08-18T21:10:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bd02de640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bd02de640 1 -- 172.21.15.5:0/1653992681 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc80a1d80 con 0x7f2bc809eef0 2024-08-18T21:10:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bbeffd640 1 -- 172.21.15.5:0/1653992681 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f2bc000aa30 con 0x7f2bc809eef0 2024-08-18T21:10:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bd02de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bd02de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bd02de640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bd02de640 1 -- 172.21.15.5:0/1653992681 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bc80a70c0 con 0x7f2bc809eef0 2024-08-18T21:10:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bbeffd640 1 --2- 172.21.15.5:0/1653992681 >> v2:172.21.15.157:6812/631023601 conn(0x7f2bac0402d0 0x7f2bac042790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.109+0000 7f2bbeffd640 1 -- 172.21.15.5:0/1653992681 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(212..212 src has 22..212) ==== 3898+0+0 (secure 0 0 0) 0x7f2bc004e010 con 0x7f2bc809eef0 2024-08-18T21:10:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.113+0000 7f2bce07a640 1 --2- 172.21.15.5:0/1653992681 >> v2:172.21.15.157:6812/631023601 conn(0x7f2bac0402d0 0x7f2bac042790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:52.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.113+0000 7f2bce07a640 10 monclient: get_auth_request con 0x7f2bac0402d0 auth_method 0 2024-08-18T21:10:52.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.113+0000 7f2bce07a640 1 --2- 172.21.15.5:0/1653992681 >> v2:172.21.15.157:6812/631023601 conn(0x7f2bac0402d0 0x7f2bac042790 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40038a0 tx=0x7f2bc4009190 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:10:52.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.117+0000 7f2bbeffd640 1 -- 172.21.15.5:0/1653992681 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f2bc8122e40 con 0x7f2bc809eef0 2024-08-18T21:10:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.117+0000 7f2bbeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:10:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.117+0000 7f2bbeffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:10:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.357+0000 7f2bd02de640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:10:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.357+0000 7f2bd02de640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:10:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.357+0000 7f2bd02de640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:10:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.357+0000 7f2bd02de640 1 -- 172.21.15.5:0/1653992681 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2bc80a0750 con 0x7f2bc809eef0 2024-08-18T21:10:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bbeffd640 1 -- 172.21.15.5:0/1653992681 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3174 (secure 0 0 0) 0x7f2bc0007400 con 0x7f2bc809eef0 2024-08-18T21:10:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bbeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:10:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bbeffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:10:52.363 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":152,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:10:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bd02de640 1 -- 172.21.15.5:0/1653992681 >> v2:172.21.15.157:6812/631023601 conn(0x7f2bac0402d0 msgr2=0x7f2bac042790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bd02de640 1 --2- 172.21.15.5:0/1653992681 >> v2:172.21.15.157:6812/631023601 conn(0x7f2bac0402d0 0x7f2bac042790 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40038a0 tx=0x7f2bc4009190 comp rx=0 tx=0).stop 2024-08-18T21:10:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bd02de640 10 monclient: shutdown 2024-08-18T21:10:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bd02de640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:10:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bd02de640 1 -- 172.21.15.5:0/1653992681 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2bc809eef0 msgr2=0x7f2bc809f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bd02de640 1 --2- 172.21.15.5:0/1653992681 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2bc809eef0 0x7f2bc809f370 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0005c10 tx=0x7f2bc000cd50 comp rx=0 tx=0).stop 2024-08-18T21:10:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bd02de640 1 -- 172.21.15.5:0/1653992681 shutdown_connections 2024-08-18T21:10:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bd02de640 1 --2- 172.21.15.5:0/1653992681 >> v2:172.21.15.157:6812/631023601 conn(0x7f2bac0402d0 0x7f2bac042790 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bd02de640 1 --2- 172.21.15.5:0/1653992681 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2bc809eef0 0x7f2bc809f370 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bd02de640 1 --2- 172.21.15.5:0/1653992681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bc81cedd0 0x7f2bc81cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bd02de640 1 --2- 172.21.15.5:0/1653992681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bac0062b0 0x7f2bc81ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bd02de640 1 -- 172.21.15.5:0/1653992681 >> 172.21.15.5:0/1653992681 conn(0x7f2bc80acbc0 msgr2=0x7f2bc813e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:10:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bd02de640 1 -- 172.21.15.5:0/1653992681 shutdown_connections 2024-08-18T21:10:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:52.361+0000 7f2bd02de640 1 -- 172.21.15.5:0/1653992681 wait complete. 2024-08-18T21:10:55.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:10:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 10 monclient: get_monmap_and_config 2024-08-18T21:10:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 10 monclient: build_initial_monmap 2024-08-18T21:10:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 10 monclient: monmap: 2024-08-18T21:10:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:10:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:10:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:10:55.518381+0000 2024-08-18T21:10:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:10:55.518381+0000 2024-08-18T21:10:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:10:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:10:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:10:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:10:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:10:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:10:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:10:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:10:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:10:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:10:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:10:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:10:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:10:55.518 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:10:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 1 Processor -- start 2024-08-18T21:10:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 1 -- start start 2024-08-18T21:10:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 10 monclient: init 2024-08-18T21:10:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 10 monclient: _reopen_session rank -1 2024-08-18T21:10:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 10 monclient: _add_conns ranks=[6,10,1,5,9,7,0,2,3,8,4] 2024-08-18T21:10:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 0x7f9ca80a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 10 monclient(hunting): picked mon.noname-d con 0x7f9ca80a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:10:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 0x7f9ca8139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 10 monclient(hunting): picked mon.noname-f con 0x7f9ca80a7600 addr v2:172.21.15.157:3300/0 2024-08-18T21:10:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f9ca8139fe0 addr v1:172.21.15.157:6789/0 2024-08-18T21:10:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ca80a45d0 con 0x7f9ca8139fe0 2024-08-18T21:10:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca80a5000 con 0x7f9ca80a7600 2024-08-18T21:10:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f9ca80a4360 con 0x7f9ca80a6ce0 2024-08-18T21:10:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9cae31f640 10 monclient(hunting): authenticate will time out at 1422.531574s 2024-08-18T21:10:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9ca7fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 0x7f9ca80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9ca7fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 0x7f9ca80a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:42278/0 (socket says 172.21.15.5:42278) 2024-08-18T21:10:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 learned_addr learned my addr 172.21.15.5:0/1763804466 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:10:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request con 0x7f9ca80a6ce0 auth_method 0 2024-08-18T21:10:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9ca7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9ca7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.513+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 msgr2=0x7f9ca80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.517+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 msgr2=0x7f9ca80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.517+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 0x7f9ca80a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.517+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 0x7f9ca80a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.517+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 0x7f9ca8139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.517+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request con 0x7f9ca80a7600 auth_method 0 2024-08-18T21:10:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.517+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.517+0000 7f9ca77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.517+0000 7f9ca77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.517+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 msgr2=0x7f9ca8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:10:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.517+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 msgr2=0x7f9ca8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.517+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 0x7f9ca8139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.517+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 0x7f9ca8139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.517+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 >> v1:172.21.15.157:6789/0 conn(0x7f9ca8139fe0 legacy=0x7f9ca8140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:10:55.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 0x7f9ca80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:55.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request con 0x7f9ca80a6ce0 auth_method 0 2024-08-18T21:10:55.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:55.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:55.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:55.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 0x7f9ca8139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:55.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request con 0x7f9ca80a7600 auth_method 0 2024-08-18T21:10:55.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:55.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:55.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:55.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 msgr2=0x7f9ca80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:55.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 msgr2=0x7f9ca80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:55.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 0x7f9ca80a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:55.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 msgr2=0x7f9ca8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:10:55.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 0x7f9ca80a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:10:55.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 msgr2=0x7f9ca8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:55.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 0x7f9ca8139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:55.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:55.721+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 0x7f9ca8139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:10:56.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 0x7f9ca80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:56.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request con 0x7f9ca80a6ce0 auth_method 0 2024-08-18T21:10:56.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:56.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 0x7f9ca8139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request con 0x7f9ca80a7600 auth_method 0 2024-08-18T21:10:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 msgr2=0x7f9ca80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 msgr2=0x7f9ca80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 0x7f9ca80a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 0x7f9ca80a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:10:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 msgr2=0x7f9ca8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:10:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 msgr2=0x7f9ca8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 0x7f9ca8139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:56.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.125+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 0x7f9ca8139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:10:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 0x7f9ca80a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request con 0x7f9ca80a6ce0 auth_method 0 2024-08-18T21:10:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 0x7f9ca8139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request con 0x7f9ca80a7600 auth_method 0 2024-08-18T21:10:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 msgr2=0x7f9ca80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:10:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 msgr2=0x7f9ca80a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 0x7f9ca80a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 msgr2=0x7f9ca8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 0x7f9ca80a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:10:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 msgr2=0x7f9ca8139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 0x7f9ca8139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:56.929+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 0x7f9ca8139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:10:58.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 10 monclient(hunting): tick 2024-08-18T21:10:58.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:10:58.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 1 monclient(hunting): continuing hunt 2024-08-18T21:10:58.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:10:58.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 msgr2=0x7f9ca80a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:58.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9ca80a6ce0 0x7f9ca80a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:58.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 msgr2=0x7f9ca8139aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:10:58.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.157:3300/0 conn(0x7f9ca80a7600 0x7f9ca8139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:10:58.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 >> v1:172.21.15.157:6789/0 conn(0x7f9ca8139fe0 legacy=0x7f9ca8140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:10:58.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 10 monclient: _add_conns ranks=[7,5,0,4,8,2,9,3] 2024-08-18T21:10:58.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 0x7f9c94005cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:58.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 10 monclient(hunting): picked mon.noname-i con 0x7f9c94003880 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:10:58.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 0x7f9c940087c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:10:58.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 10 monclient(hunting): picked mon.noname-h con 0x7f9c94006350 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:10:58.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9c94008e90 addr v1:172.21.15.5:6789/0 2024-08-18T21:10:58.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ca80a8900 con 0x7f9c94008e90 2024-08-18T21:10:58.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:58.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f9ca80a4360 con 0x7f9c94006350 2024-08-18T21:10:58.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:10:58.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f9c9400dcd0 con 0x7f9c94003880 2024-08-18T21:10:58.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca5ffb640 10 monclient(hunting): _renew_subs 2024-08-18T21:10:58.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 >> v1:172.21.15.5:6789/0 conn(0x7f9c94008e90 legacy=0x7f9c9400b350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:10:58.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 0x7f9c94005cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:58.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 0x7f9c940087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:58.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request con 0x7f9c94003880 auth_method 0 2024-08-18T21:10:58.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:58.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:58.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:58.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request con 0x7f9c94006350 auth_method 0 2024-08-18T21:10:58.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:58.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:58.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:10:58.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 msgr2=0x7f9c94005cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:58.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:10:58.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 msgr2=0x7f9c94005cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:58.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:58.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 0x7f9c94005cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:58.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 0x7f9c940087c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:58.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 0x7f9c94005cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:58.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.517+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 0x7f9c940087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:10:58.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 0x7f9c940087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:58.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 0x7f9c94005cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:58.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request con 0x7f9c94006350 auth_method 0 2024-08-18T21:10:58.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:58.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:58.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:58.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request con 0x7f9c94003880 auth_method 0 2024-08-18T21:10:58.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:58.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:58.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:58.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 >> v1:172.21.15.5:6789/0 conn(0x7f9c94008e90 legacy=0x7f9c9400b350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:10:58.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 0x7f9c940087c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 msgr2=0x7f9c94005cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:10:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 msgr2=0x7f9c94005cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 0x7f9c94005cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 0x7f9c940087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:10:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:58.721+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 0x7f9c94005cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:10:59.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 >> v1:172.21.15.5:6789/0 conn(0x7f9c94008e90 legacy=0x7f9c9400b350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:10:59.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 0x7f9c94005cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:59.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 0x7f9c940087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:59.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request con 0x7f9c94003880 auth_method 0 2024-08-18T21:10:59.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:59.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:59.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:59.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request con 0x7f9c94006350 auth_method 0 2024-08-18T21:10:59.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:59.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:59.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:59.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:59.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 msgr2=0x7f9c94005cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:10:59.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:59.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 msgr2=0x7f9c94005cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:59.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 0x7f9c940087c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:59.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 0x7f9c94005cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:59.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 0x7f9c94005cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:10:59.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.125+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 0x7f9c940087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:10:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 >> v1:172.21.15.5:6789/0 conn(0x7f9c94008e90 legacy=0x7f9c9400b350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:10:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 0x7f9c940087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 0x7f9c94005cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:10:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request con 0x7f9c94006350 auth_method 0 2024-08-18T21:10:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request con 0x7f9c94003880 auth_method 0 2024-08-18T21:10:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:10:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:10:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:10:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:10:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 msgr2=0x7f9c94005cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:10:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 0x7f9c940087c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 msgr2=0x7f9c94005cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:10:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 0x7f9c94005cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:10:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 0x7f9c940087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:10:59.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:10:59.929+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 0x7f9c94005cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:11:01.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 10 monclient(hunting): tick 2024-08-18T21:11:01.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:11:01.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 1 monclient(hunting): continuing hunt 2024-08-18T21:11:01.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:11:01.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 msgr2=0x7f9c94005cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:01.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94003880 0x7f9c94005cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:01.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:01.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9c94006350 0x7f9c940087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:01.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 >> v1:172.21.15.5:6789/0 conn(0x7f9c94008e90 legacy=0x7f9c9400b350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:01.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 reap_dead start 2024-08-18T21:11:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 10 monclient: _add_conns ranks=[4,2,9,3,8] 2024-08-18T21:11:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 reap_dead start 2024-08-18T21:11:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 0x7f9c9400d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f9c9400cd40 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 0x7f9c94005cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f9c9400d700 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:11:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 0x7f9c940087c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f9c9400b350 addr v2:172.21.15.5:3300/0 2024-08-18T21:11:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca80a4360 con 0x7f9c9400b350 2024-08-18T21:11:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9400dcd0 con 0x7f9c9400d700 2024-08-18T21:11:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f9c9400bb20 con 0x7f9c9400cd40 2024-08-18T21:11:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca5ffb640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 msgr2=0x7f9c94005cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:11:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 msgr2=0x7f9c9400d120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:11:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 0x7f9c9400d120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 0x7f9c94005cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.517+0000 7f9cac8bc640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 0x7f9c940087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:01.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.721+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:11:01.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.721+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 msgr2=0x7f9c94005cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:11:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.721+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 msgr2=0x7f9c9400d120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.721+0000 7f9cac8bc640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 0x7f9c940087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:11:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.721+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 0x7f9c94005cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:11:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:01.721+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 0x7f9c9400d120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:11:02.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:02.125+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:11:02.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:02.125+0000 7f9cac8bc640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 0x7f9c940087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:11:02.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:02.125+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 msgr2=0x7f9c94005cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:11:02.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:02.125+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 msgr2=0x7f9c9400d120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:02.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:02.125+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 0x7f9c94005cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:11:02.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:02.125+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 0x7f9c9400d120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:11:02.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:02.929+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:11:02.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:02.929+0000 7f9cac8bc640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 0x7f9c940087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:11:02.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:02.929+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 msgr2=0x7f9c94005cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:11:02.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:02.929+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 msgr2=0x7f9c9400d120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:02.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:02.929+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 0x7f9c94005cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:11:02.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:02.929+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 0x7f9c9400d120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:11:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 10 monclient(hunting): tick 2024-08-18T21:11:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:11:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 1 monclient(hunting): continuing hunt 2024-08-18T21:11:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:11:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 msgr2=0x7f9c9400d120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 0x7f9c9400d120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 msgr2=0x7f9c94005cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 0x7f9c94005cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 0x7f9c940087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 10 monclient: _add_conns ranks=[8,3] 2024-08-18T21:11:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9c9400be90 0x7f9c9400c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 10 monclient(hunting): picked mon.noname-e con 0x7f9c9400be90 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 0x7f9c940123a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 10 monclient(hunting): picked mon.noname-g con 0x7f9c9400c7b0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca80a4360 con 0x7f9c9400c7b0 2024-08-18T21:11:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f9c9400dcd0 con 0x7f9c9400be90 2024-08-18T21:11:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca5ffb640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9c9400be90 msgr2=0x7f9c9400c270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:11:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9c9400be90 0x7f9c9400c270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 0x7f9c940123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request con 0x7f9c9400c7b0 auth_method 0 2024-08-18T21:11:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 msgr2=0x7f9c940123a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:11:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 msgr2=0x7f9c940123a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:11:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 0x7f9c940123a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.517+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 0x7f9c940123a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.721+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9c9400be90 msgr2=0x7f9c9400c270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:11:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.721+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 0x7f9c940123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.721+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9c9400be90 0x7f9c9400c270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:11:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.721+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request con 0x7f9c9400c7b0 auth_method 0 2024-08-18T21:11:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.721+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.721+0000 7f9ca77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.721+0000 7f9ca77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:11:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.721+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 msgr2=0x7f9c940123a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:11:04.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.721+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 msgr2=0x7f9c940123a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:11:04.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.721+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 0x7f9c940123a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:04.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:04.721+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 0x7f9c940123a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:11:05.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.125+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9c9400be90 msgr2=0x7f9c9400c270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:11:05.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.125+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9c9400be90 0x7f9c9400c270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:11:05.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.125+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 0x7f9c940123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:05.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.125+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request con 0x7f9c9400c7b0 auth_method 0 2024-08-18T21:11:05.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.125+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:05.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.125+0000 7f9ca77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:05.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.125+0000 7f9ca77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:11:05.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.125+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 msgr2=0x7f9c940123a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:11:05.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.125+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 msgr2=0x7f9c940123a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:11:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.125+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 0x7f9c940123a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.125+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 0x7f9c940123a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:11:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.929+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9c9400be90 msgr2=0x7f9c9400c270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:11:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.929+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9c9400be90 0x7f9c9400c270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:11:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.929+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 0x7f9c940123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.929+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request con 0x7f9c9400c7b0 auth_method 0 2024-08-18T21:11:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.929+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.929+0000 7f9ca77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.929+0000 7f9ca77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:11:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.929+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 msgr2=0x7f9c940123a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:11:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.929+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 msgr2=0x7f9c940123a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:11:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.929+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 0x7f9c940123a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:05.929+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 0x7f9c940123a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:11:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 10 monclient(hunting): tick 2024-08-18T21:11:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:11:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 1 monclient(hunting): continuing hunt 2024-08-18T21:11:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:11:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9c9400be90 msgr2=0x7f9c9400c270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9c9400be90 0x7f9c9400c270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 msgr2=0x7f9c940123a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400c7b0 0x7f9c940123a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 10 monclient: _add_conns ranks=[2,9,4,1,3,8,0,5,10,6,7] 2024-08-18T21:11:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 reap_dead start 2024-08-18T21:11:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 0x7f9c94005c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f9c9400d700 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:11:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 0x7f9c940087c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f9c9400b350 addr v2:172.21.15.5:3300/0 2024-08-18T21:11:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 0x7f9c9400d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f9c9400cd40 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca80a4360 con 0x7f9c9400b350 2024-08-18T21:11:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9400dcd0 con 0x7f9c9400d700 2024-08-18T21:11:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f9c9400bb20 con 0x7f9c9400cd40 2024-08-18T21:11:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca5ffb640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:11:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 msgr2=0x7f9c94005c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:11:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 0x7f9c940087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 msgr2=0x7f9c9400d120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 0x7f9c94005c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.517+0000 7f9cac8bc640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 0x7f9c9400d120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:07.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.721+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:11:07.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.721+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 0x7f9c940087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:11:07.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.721+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 msgr2=0x7f9c94005c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:11:07.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.721+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 msgr2=0x7f9c9400d120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:07.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.721+0000 7f9cac8bc640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 0x7f9c9400d120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:11:07.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:07.721+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 0x7f9c94005c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:11:08.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:08.125+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:11:08.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:08.125+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 0x7f9c940087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:11:08.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:08.125+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 msgr2=0x7f9c9400d120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:08.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:08.125+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 msgr2=0x7f9c94005c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:11:08.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:08.125+0000 7f9cac8bc640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 0x7f9c9400d120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:11:08.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:08.125+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 0x7f9c94005c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:11:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:08.928+0000 7f9ca77fe640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:11:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:08.928+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 0x7f9c940087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:11:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:08.928+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 msgr2=0x7f9c9400d120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:08.928+0000 7f9ca7fff640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 msgr2=0x7f9c94005c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:11:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:08.928+0000 7f9cac8bc640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 0x7f9c9400d120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:11:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:08.928+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 0x7f9c94005c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:11:10.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 10 monclient(hunting): tick 2024-08-18T21:11:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:11:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 1 monclient(hunting): continuing hunt 2024-08-18T21:11:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:11:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 msgr2=0x7f9c9400d120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9c9400cd40 0x7f9c9400d120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 msgr2=0x7f9c94005c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9c9400d700 0x7f9c94005c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 msgr2=0x7f9c940087c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> v2:172.21.15.5:3300/0 conn(0x7f9c9400b350 0x7f9c940087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 10 monclient: _add_conns ranks=[3,1,7,0,5,6,8,10] 2024-08-18T21:11:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400be90 0x7f9c9400c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 10 monclient(hunting): picked mon.noname-g con 0x7f9c9400be90 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f9c94010390 addr v1:172.21.15.157:6789/0 2024-08-18T21:11:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94014230 0x7f9c94016620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 10 monclient(hunting): picked mon.noname-i con 0x7f9c94014230 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c9400ded0 con 0x7f9c94010390 2024-08-18T21:11:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca80a4360 con 0x7f9c9400be90 2024-08-18T21:11:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 1 -- 172.21.15.5:0/1763804466 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f9c9400dcd0 con 0x7f9c94014230 2024-08-18T21:11:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca5ffb640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94014230 0x7f9c94016620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 10 monclient(hunting): get_auth_request con 0x7f9c94014230 auth_method 0 2024-08-18T21:11:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400be90 0x7f9c9400c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request con 0x7f9c9400be90 auth_method 0 2024-08-18T21:11:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9ca7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 10 monclient(hunting): handle_auth_done global_id 6298 payload 274 2024-08-18T21:11:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400be90 msgr2=0x7f9c9400c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9c9400be90 0x7f9c9400c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 >> v1:172.21.15.157:6789/0 conn(0x7f9c94010390 legacy=0x7f9c94012b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 10 monclient: _finish_hunting 0 2024-08-18T21:11:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 1 monclient: found mon.noname-i 2024-08-18T21:11:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:11:10.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.516+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca80a8900 con 0x7f9c94014230 2024-08-18T21:11:10.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.524+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 reap_dead start 2024-08-18T21:11:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.524+0000 7f9cac8bc640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94014230 msgr2=0x7f9c94016620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.524+0000 7f9cac8bc640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94014230 0x7f9c94016620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80a9780 tx=0x7f9ca001ca10 comp rx=0 tx=0).ready entity=mon.7 client_cookie=e2bddd143306de7f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.528+0000 7f9ca6ffd640 1 -- 172.21.15.5:0/1763804466 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ca00074e0 con 0x7f9c94014230 2024-08-18T21:11:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.528+0000 7f9ca6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.528+0000 7f9ca6ffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:11:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.528+0000 7f9ca6ffd640 10 monclient: dump: 2024-08-18T21:11:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:10.534 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.528+0000 7f9ca6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:11:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.528+0000 7f9ca6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:11:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.528+0000 7f9ca6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.528+0000 7f9ca6ffd640 1 -- 172.21.15.5:0/1763804466 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca00076c0 con 0x7f9c94014230 2024-08-18T21:11:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.528+0000 7f9ca6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.528+0000 7f9ca6ffd640 1 -- 172.21.15.5:0/1763804466 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ca0007870 con 0x7f9c94014230 2024-08-18T21:11:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.528+0000 7f9cae31f640 5 monclient: authenticate success, global_id 6298 2024-08-18T21:11:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.528+0000 7f9cae31f640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.528+0000 7f9cae31f640 4 set_mon_vals no callback set 2024-08-18T21:11:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.528+0000 7f9ca6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.528+0000 7f9ca6ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:11:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.528+0000 7f9ca6ffd640 10 monclient: dump: 2024-08-18T21:11:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:10.536 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:10.536 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:10.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.532+0000 7f9cae31f640 10 monclient: shutdown 2024-08-18T21:11:10.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.532+0000 7f9cae31f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:10.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.532+0000 7f9cae31f640 1 -- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94014230 msgr2=0x7f9c94016620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:10.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.532+0000 7f9cae31f640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94014230 0x7f9c94016620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80a9780 tx=0x7f9ca001ca10 comp rx=0 tx=0).stop 2024-08-18T21:11:10.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.532+0000 7f9cae31f640 1 -- 172.21.15.5:0/1763804466 shutdown_connections 2024-08-18T21:11:10.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.532+0000 7f9cae31f640 1 --2- 172.21.15.5:0/1763804466 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9c94014230 0x7f9c94016620 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.532+0000 7f9cae31f640 1 -- 172.21.15.5:0/1763804466 >> 172.21.15.5:0/1763804466 conn(0x7f9ca80acbc0 msgr2=0x7f9ca80a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:10.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.532+0000 7f9cae31f640 1 -- 172.21.15.5:0/1763804466 shutdown_connections 2024-08-18T21:11:10.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.532+0000 7f9cae31f640 1 -- 172.21.15.5:0/1763804466 wait complete. 2024-08-18T21:11:10.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.532+0000 7f9cae31f640 10 monclient: build_initial_monmap 2024-08-18T21:11:10.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.532+0000 7f9cae31f640 10 monclient: monmap: 2024-08-18T21:11:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:10.538 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:10.539 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:10.539 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:10.539 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:10.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.532+0000 7f9cae31f640 1 Processor -- start 2024-08-18T21:11:10.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.532+0000 7f9cae31f640 1 -- start start 2024-08-18T21:11:10.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.532+0000 7f9cae31f640 10 monclient: init 2024-08-18T21:11:10.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cae31f640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cae31f640 10 monclient: _add_conns ranks=[6,5,1,7,4,0,8,3,2] 2024-08-18T21:11:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cae31f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9c94014230 0x7f9ca81d1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cae31f640 10 monclient(hunting): picked mon.noname-d con 0x7f9c94014230 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cae31f640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9ca8137c50 0x7f9ca81380b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cae31f640 10 monclient(hunting): picked mon.noname-h con 0x7f9ca8137c50 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cae31f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ca8125830 0x7f9ca8125c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cae31f640 10 monclient(hunting): picked mon.noname-f con 0x7f9ca8125830 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:11:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cae31f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cae31f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca80a79e0 con 0x7f9ca8125830 2024-08-18T21:11:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cae31f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cae31f640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f9ca80a8220 con 0x7f9ca8137c50 2024-08-18T21:11:10.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cae31f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cae31f640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f9ca80aa200 con 0x7f9c94014230 2024-08-18T21:11:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cae31f640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cae31f640 10 monclient(hunting): authenticate will time out at 1437.553934s 2024-08-18T21:11:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9c94014230 0x7f9ca81d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9c94014230 0x7f9ca81d1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:37492/0 (socket says 172.21.15.5:37492) 2024-08-18T21:11:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 1 -- 172.21.15.5:0/2635660443 learned_addr learned my addr 172.21.15.5:0/2635660443 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request con 0x7f9c94014230 auth_method 0 2024-08-18T21:11:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:10.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/2635660443 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9ca8137c50 0x7f9ca81380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request con 0x7f9ca8137c50 auth_method 0 2024-08-18T21:11:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cac8bc640 1 --2- 172.21.15.5:0/2635660443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ca8125830 0x7f9ca8125c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 10 monclient(hunting): handle_auth_done global_id 85092 payload 824 2024-08-18T21:11:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 1 -- 172.21.15.5:0/2635660443 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9ca8137c50 msgr2=0x7f9ca81380b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/2635660443 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9ca8137c50 0x7f9ca81380b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 1 -- 172.21.15.5:0/2635660443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ca8125830 msgr2=0x7f9ca8125c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:10.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/2635660443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ca8125830 0x7f9ca8125c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:11:10.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 1 monclient: found mon.noname-d 2024-08-18T21:11:10.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:10.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:11:10.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9ca7fff640 1 -- 172.21.15.5:0/2635660443 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca81272f0 con 0x7f9c94014230 2024-08-18T21:11:10.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cac8bc640 10 monclient: get_auth_request con 0x7f9ca8125830 auth_method 0 2024-08-18T21:11:10.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.536+0000 7f9cac8bc640 1 --2- 172.21.15.5:0/2635660443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ca8125830 0x7f9ca8125c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:11:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca7fff640 1 -- 172.21.15.5:0/2635660443 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9c94014230 msgr2=0x7f9ca81d1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca7fff640 1 --2- 172.21.15.5:0/2635660443 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9c94014230 0x7f9ca81d1750 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9c980185d0 tx=0x7f9c98018a90 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca4ff9640 1 -- 172.21.15.5:0/2635660443 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9c9800f040 con 0x7f9c94014230 2024-08-18T21:11:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca4ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:11:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca4ff9640 10 monclient: dump: 2024-08-18T21:11:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:10.549 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca4ff9640 10 monclient: _finish_auth 0 2024-08-18T21:11:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca4ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:11:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca4ff9640 1 -- 172.21.15.5:0/2635660443 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c98029070 con 0x7f9c94014230 2024-08-18T21:11:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9cae31f640 5 monclient: authenticate success, global_id 85092 2024-08-18T21:11:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9cae31f640 10 monclient: _renew_subs 2024-08-18T21:11:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9cae31f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9cae31f640 1 -- 172.21.15.5:0/2635660443 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca8127e50 con 0x7f9c94014230 2024-08-18T21:11:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9cae31f640 10 monclient: _renew_subs 2024-08-18T21:11:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9cae31f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9cae31f640 1 -- 172.21.15.5:0/2635660443 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca8129090 con 0x7f9c94014230 2024-08-18T21:11:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca4ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca4ff9640 1 -- 172.21.15.5:0/2635660443 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9c980248f0 con 0x7f9c94014230 2024-08-18T21:11:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca67fc640 4 set_mon_vals no callback set 2024-08-18T21:11:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca4ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca4ff9640 10 monclient: dump: 2024-08-18T21:11:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:10.552 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9cae31f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9cae31f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9cae31f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9cae31f640 1 -- 172.21.15.5:0/2635660443 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c88005090 con 0x7f9c94014230 2024-08-18T21:11:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.540+0000 7f9ca4ff9640 1 -- 172.21.15.5:0/2635660443 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f9c98024480 con 0x7f9c94014230 2024-08-18T21:11:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.544+0000 7f9ca4ff9640 1 --2- 172.21.15.5:0/2635660443 >> v2:172.21.15.157:6812/631023601 conn(0x7f9c9403df60 0x7f9c94040420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.544+0000 7f9ca4ff9640 1 -- 172.21.15.5:0/2635660443 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(213..213 src has 22..213) ==== 3898+0+0 (secure 0 0 0) 0x7f9c98050470 con 0x7f9c94014230 2024-08-18T21:11:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.544+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/2635660443 >> v2:172.21.15.157:6812/631023601 conn(0x7f9c9403df60 0x7f9c94040420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.544+0000 7f9ca77fe640 10 monclient: get_auth_request con 0x7f9c9403df60 auth_method 0 2024-08-18T21:11:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.544+0000 7f9ca77fe640 1 --2- 172.21.15.5:0/2635660443 >> v2:172.21.15.157:6812/631023601 conn(0x7f9c9403df60 0x7f9c94040420 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0042c0 tx=0x7f9c9c01a040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.548+0000 7f9ca4ff9640 1 -- 172.21.15.5:0/2635660443 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f9c9801f050 con 0x7f9c94014230 2024-08-18T21:11:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.548+0000 7f9ca4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.548+0000 7f9ca4ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:10.692 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:10.692 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30878]: starting. 2024-08-18T21:11:10.692 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30878]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30843 2024-08-18T21:11:10.692 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30878]: created object 0... 2024-08-18T21:11:10.692 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30878]: created object 25... 2024-08-18T21:11:10.692 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30878]: created object 49... 2024-08-18T21:11:10.692 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30878]: finishing. 2024-08-18T21:11:10.692 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30878]: shutting down. 2024-08-18T21:11:10.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.796+0000 7f9cae31f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:11:10.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.796+0000 7f9cae31f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:11:10.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.796+0000 7f9cae31f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:10.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.796+0000 7f9cae31f640 1 -- 172.21.15.5:0/2635660443 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9c88005380 con 0x7f9c94014230 2024-08-18T21:11:10.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.796+0000 7f9ca4ff9640 1 -- 172.21.15.5:0/2635660443 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3149 (secure 0 0 0) 0x7f9c98050230 con 0x7f9c94014230 2024-08-18T21:11:10.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.796+0000 7f9ca4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:11:10.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.796+0000 7f9ca4ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:10.801 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":158,"quorum":[1,3,5,6,7],"quorum_names":["f","g","h","d","i"],"quorum_leader_name":"f","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:11:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.800+0000 7f9cae31f640 1 -- 172.21.15.5:0/2635660443 >> v2:172.21.15.157:6812/631023601 conn(0x7f9c9403df60 msgr2=0x7f9c94040420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.800+0000 7f9cae31f640 1 --2- 172.21.15.5:0/2635660443 >> v2:172.21.15.157:6812/631023601 conn(0x7f9c9403df60 0x7f9c94040420 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0042c0 tx=0x7f9c9c01a040 comp rx=0 tx=0).stop 2024-08-18T21:11:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.800+0000 7f9cae31f640 10 monclient: shutdown 2024-08-18T21:11:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.800+0000 7f9cae31f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.800+0000 7f9cae31f640 1 -- 172.21.15.5:0/2635660443 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9c94014230 msgr2=0x7f9ca81d1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.800+0000 7f9cae31f640 1 --2- 172.21.15.5:0/2635660443 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9c94014230 0x7f9ca81d1750 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9c980185d0 tx=0x7f9c98018a90 comp rx=0 tx=0).stop 2024-08-18T21:11:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.800+0000 7f9cae31f640 1 -- 172.21.15.5:0/2635660443 shutdown_connections 2024-08-18T21:11:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.800+0000 7f9cae31f640 1 --2- 172.21.15.5:0/2635660443 >> v2:172.21.15.157:6812/631023601 conn(0x7f9c9403df60 0x7f9c94040420 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.800+0000 7f9cae31f640 1 --2- 172.21.15.5:0/2635660443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ca8125830 0x7f9ca8125c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.800+0000 7f9cae31f640 1 --2- 172.21.15.5:0/2635660443 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9ca8137c50 0x7f9ca81380b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.800+0000 7f9cae31f640 1 --2- 172.21.15.5:0/2635660443 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9c94014230 0x7f9ca81d1750 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.800+0000 7f9cae31f640 1 -- 172.21.15.5:0/2635660443 >> 172.21.15.5:0/2635660443 conn(0x7f9ca80acbc0 msgr2=0x7f9ca80a4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.800+0000 7f9cae31f640 1 -- 172.21.15.5:0/2635660443 shutdown_connections 2024-08-18T21:11:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.800+0000 7f9cae31f640 1 -- 172.21.15.5:0/2635660443 wait complete. 2024-08-18T21:11:10.822 INFO:tasks.mon_thrash.ceph_manager:quorum is size 5 2024-08-18T21:11:10.822 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon d 2024-08-18T21:11:10.822 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:11:10.897 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:10.897 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30880]: starting. 2024-08-18T21:11:10.897 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30880]: listing objects. 2024-08-18T21:11:10.897 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30880]: listed object 0... 2024-08-18T21:11:10.897 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30880]: listed object 25... 2024-08-18T21:11:10.897 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30880]: saw 50 objects 2024-08-18T21:11:10.898 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30880]: shutting down. 2024-08-18T21:11:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.932+0000 7f4e50fc3640 10 monclient: get_monmap_and_config 2024-08-18T21:11:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.932+0000 7f4e50fc3640 10 monclient: build_initial_monmap 2024-08-18T21:11:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.932+0000 7f4e50fc3640 10 monclient: monmap: 2024-08-18T21:11:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:10.940226+0000 2024-08-18T21:11:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:10.940226+0000 2024-08-18T21:11:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:10.939 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e50fc3640 1 Processor -- start 2024-08-18T21:11:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e50fc3640 1 -- start start 2024-08-18T21:11:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e50fc3640 10 monclient: init 2024-08-18T21:11:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e50fc3640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e50fc3640 10 monclient: _add_conns ranks=[9,0,1,10,6,5,4,7,2,8,3] 2024-08-18T21:11:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e50fc3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e4c0a6ce0 0x7f4e4c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e50fc3640 10 monclient(hunting): picked mon.noname-a con 0x7f4e4c0a6ce0 addr v2:172.21.15.5:3300/0 2024-08-18T21:11:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e50fc3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4e4c0a7600 addr v1:172.21.15.5:6789/0 2024-08-18T21:11:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e50fc3640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f4e4c13a1b0 addr v1:172.21.15.157:6789/0 2024-08-18T21:11:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e50fc3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e4c0a45d0 con 0x7f4e4c0a7600 2024-08-18T21:11:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e50fc3640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e4c0a32d0 con 0x7f4e4c13a1b0 2024-08-18T21:11:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e50fc3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e4a59c640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7f4e4c0a6ce0 msgr2=0x7f4e4c0a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:11:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e50fc3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4e4c0a5000 con 0x7f4e4c0a6ce0 2024-08-18T21:11:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e50fc3640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e49d9b640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7f4e4c0a7600 legacy=0x7f4e4c139aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:11:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e50fc3640 10 monclient(hunting): authenticate will time out at 1437.953793s 2024-08-18T21:11:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e4a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e4c0a6ce0 0x7f4e4c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e4ad9d640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f4e4c13a1b0 0x7f4e4c141d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:46794/0 (socket says 172.21.15.5:46794) 2024-08-18T21:11:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.936+0000 7f4e4ad9d640 1 -- 172.21.15.5:0/1364965754 learned_addr learned my addr 172.21.15.5:0/1364965754 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:11:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4ad9d640 1 -- 172.21.15.5:0/1364965754 >> v1:172.21.15.157:6789/0 conn(0x7f4e4c13a1b0 legacy=0x7f4e4c141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 -- 172.21.15.5:0/1364965754 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3895515899 0 0) 0x7f4e4c0a32d0 con 0x7f4e4c13a1b0 2024-08-18T21:11:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient(hunting): _negotiate 2024-08-18T21:11:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient(hunting): my global_id is 104293 2024-08-18T21:11:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 -- 172.21.15.5:0/1364965754 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e38003530 con 0x7f4e4c13a1b0 2024-08-18T21:11:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 -- 172.21.15.5:0/1364965754 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2347908107 0 0) 0x7f4e38003530 con 0x7f4e4c13a1b0 2024-08-18T21:11:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 -- 172.21.15.5:0/1364965754 >> v2:172.21.15.5:3300/0 conn(0x7f4e4c0a6ce0 msgr2=0x7f4e4c0a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 --2- 172.21.15.5:0/1364965754 >> v2:172.21.15.5:3300/0 conn(0x7f4e4c0a6ce0 0x7f4e4c0a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 -- 172.21.15.5:0/1364965754 >> v1:172.21.15.5:6789/0 conn(0x7f4e4c0a7600 legacy=0x7f4e4c139aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient: _finish_hunting 0 2024-08-18T21:11:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 monclient: found mon.noname-f-legacy 2024-08-18T21:11:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient: _send_mon_message to mon.noname-f-legacy at v1:172.21.15.157:6789/0 2024-08-18T21:11:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 -- 172.21.15.5:0/1364965754 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4c0a8900 con 0x7f4e4c13a1b0 2024-08-18T21:11:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient: _finish_auth 0 2024-08-18T21:11:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient: _check_auth_tickets 2024-08-18T21:11:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 -- 172.21.15.5:0/1364965754 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 4141550541 0 0) 0x7f4e44001c20 con 0x7f4e4c13a1b0 2024-08-18T21:11:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient: got monmap 1 from mon.noname-f-legacy (according to old e1) 2024-08-18T21:11:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient: dump: 2024-08-18T21:11:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:10.951 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 monclient: mon.f has (v2) addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] but i'm connected to v1:172.21.15.157:6789/0, reconnecting 2024-08-18T21:11:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 -- 172.21.15.5:0/1364965754 >> v1:172.21.15.157:6789/0 conn(0x7f4e4c13a1b0 legacy=0x7f4e4c141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient: _add_conns ranks=[3,5,4,7,8,6,2,1,0] 2024-08-18T21:11:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 --2- 172.21.15.5:0/1364965754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e38004210 0x7f4e38004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient(hunting): picked mon.g con 0x7f4e38004210 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 --2- 172.21.15.5:0/1364965754 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4e38004f50 0x7f4e380099c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient(hunting): picked mon.h con 0x7f4e38004f50 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 --2- 172.21.15.5:0/1364965754 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e38009f00 0x7f4e3800c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient(hunting): picked mon.c con 0x7f4e38009f00 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 -- 172.21.15.5:0/1364965754 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3800cb00 con 0x7f4e38004210 2024-08-18T21:11:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 -- 172.21.15.5:0/1364965754 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f4e3800ccb0 con 0x7f4e38009f00 2024-08-18T21:11:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 1 -- 172.21.15.5:0/1364965754 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f4e3800ce60 con 0x7f4e38004f50 2024-08-18T21:11:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4ad9d640 1 -- 172.21.15.5:0/1364965754 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e38009f00 msgr2=0x7f4e3800c2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4ad9d640 1 --2- 172.21.15.5:0/1364965754 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e38009f00 0x7f4e3800c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4959a640 10 monclient(hunting): _finish_auth 0 2024-08-18T21:11:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 1 --2- 172.21.15.5:0/1364965754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e38004210 0x7f4e38004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e49d9b640 1 --2- 172.21.15.5:0/1364965754 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4e38004f50 0x7f4e380099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 10 monclient(hunting): get_auth_request con 0x7f4e38004210 auth_method 0 2024-08-18T21:11:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:11:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e49d9b640 10 monclient(hunting): get_auth_request con 0x7f4e38004f50 auth_method 0 2024-08-18T21:11:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e49d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e49d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e49d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:11:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:11:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e49d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e49d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e49d9b640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:11:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 10 monclient(hunting): handle_auth_done global_id 104293 payload 293 2024-08-18T21:11:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 1 -- 172.21.15.5:0/1364965754 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4e38004f50 msgr2=0x7f4e380099c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 1 --2- 172.21.15.5:0/1364965754 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4e38004f50 0x7f4e380099c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 1 -- 172.21.15.5:0/1364965754 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e38009f00 msgr2=0x7f4e3800c2f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 1 --2- 172.21.15.5:0/1364965754 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e38009f00 0x7f4e3800c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 10 monclient: _finish_hunting 0 2024-08-18T21:11:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 1 monclient: found mon.g 2024-08-18T21:11:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4ad9d640 1 -- 172.21.15.5:0/1364965754 reap_dead start 2024-08-18T21:11:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.157:3301/0 2024-08-18T21:11:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 1 -- 172.21.15.5:0/1364965754 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e38003530 con 0x7f4e38004210 2024-08-18T21:11:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 10 monclient: _finish_auth 0 2024-08-18T21:11:10.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 10 monclient: _check_auth_tickets 2024-08-18T21:11:10.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e4a59c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:10.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e50fc3640 5 monclient: authenticate success, global_id 104293 2024-08-18T21:11:10.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.940+0000 7f4e50fc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e4a59c640 1 -- 172.21.15.5:0/1364965754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e38004210 msgr2=0x7f4e38004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e4a59c640 1 --2- 172.21.15.5:0/1364965754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e38004210 0x7f4e38004810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009e30 tx=0x7f4e3c01caf0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=cf42ca9e97011267 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e4959a640 1 -- 172.21.15.5:0/1364965754 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e3c009a30 con 0x7f4e38004210 2024-08-18T21:11:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e4959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e4959a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:11:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e4959a640 10 monclient: dump: 2024-08-18T21:11:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:10.963 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e4959a640 1 -- 172.21.15.5:0/1364965754 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e3c0a9070 con 0x7f4e38004210 2024-08-18T21:11:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e4959a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e4959a640 1 -- 172.21.15.5:0/1364965754 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e3c0ae470 con 0x7f4e38004210 2024-08-18T21:11:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e50fc3640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e50fc3640 4 set_mon_vals no callback set 2024-08-18T21:11:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e4959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e4959a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:11:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e4959a640 10 monclient: dump: 2024-08-18T21:11:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:10.965 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e50fc3640 10 monclient: shutdown 2024-08-18T21:11:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e50fc3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e50fc3640 1 -- 172.21.15.5:0/1364965754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e38004210 msgr2=0x7f4e38004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.948+0000 7f4e50fc3640 1 --2- 172.21.15.5:0/1364965754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e38004210 0x7f4e38004810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009e30 tx=0x7f4e3c01caf0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 1 -- 172.21.15.5:0/1364965754 shutdown_connections 2024-08-18T21:11:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 1 --2- 172.21.15.5:0/1364965754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e38004210 0x7f4e38004810 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 1 -- 172.21.15.5:0/1364965754 >> 172.21.15.5:0/1364965754 conn(0x7f4e4c0acbc0 msgr2=0x7f4e4c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 1 -- 172.21.15.5:0/1364965754 shutdown_connections 2024-08-18T21:11:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 1 -- 172.21.15.5:0/1364965754 wait complete. 2024-08-18T21:11:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 10 monclient: build_initial_monmap 2024-08-18T21:11:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 10 monclient: monmap: 2024-08-18T21:11:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:10.967 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 1 Processor -- start 2024-08-18T21:11:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 1 -- start start 2024-08-18T21:11:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 10 monclient: init 2024-08-18T21:11:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 10 monclient: _add_conns ranks=[1,8,4,2,5,0,7,3,6] 2024-08-18T21:11:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e38004210 0x7f4e4c0a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 10 monclient(hunting): picked mon.noname-f con 0x7f4e38004210 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:11:10.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4e4c137c40 0x7f4e4c138060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:10.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 10 monclient(hunting): picked mon.noname-e con 0x7f4e4c137c40 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:10.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e4c1d16d0 0x7f4e4c1d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:10.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 10 monclient(hunting): picked mon.noname-c con 0x7f4e4c1d16d0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:10.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:10.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c0a79e0 con 0x7f4e38004210 2024-08-18T21:11:10.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:10.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f4e4c0a8220 con 0x7f4e4c1d16d0 2024-08-18T21:11:10.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:10.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f4e4c124d60 con 0x7f4e4c137c40 2024-08-18T21:11:10.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:10.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e50fc3640 10 monclient(hunting): authenticate will time out at 1437.970284s 2024-08-18T21:11:10.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4ad9d640 1 -- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e4c1d16d0 msgr2=0x7f4e4c1d1b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4ad9d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e4c1d16d0 0x7f4e4c1d1b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e49d9b640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4e4c137c40 msgr2=0x7f4e4c138060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:11:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e42ffd640 1 -- DispatchQueue::entry inject delay of 0.002000 2024-08-18T21:11:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e49d9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4e4c137c40 0x7f4e4c138060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e38004210 0x7f4e4c0a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e38004210 0x7f4e4c0a13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:56110/0 (socket says 172.21.15.5:56110) 2024-08-18T21:11:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 1 -- 172.21.15.5:0/1555197235 learned_addr learned my addr 172.21.15.5:0/1555197235 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 10 monclient(hunting): get_auth_request con 0x7f4e38004210 auth_method 0 2024-08-18T21:11:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 10 monclient(hunting): handle_auth_done global_id 104302 payload 824 2024-08-18T21:11:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 1 -- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4e4c137c40 msgr2=0x7f4e4c138060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:11:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 1 --2- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4e4c137c40 0x7f4e4c138060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 1 -- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e4c1d16d0 msgr2=0x7f4e4c1d1b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:11:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 1 --2- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e4c1d16d0 0x7f4e4c1d1b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 10 monclient: _finish_hunting 0 2024-08-18T21:11:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 1 monclient: found mon.noname-f 2024-08-18T21:11:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:11:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.952+0000 7f4e4a59c640 1 -- 172.21.15.5:0/1555197235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4c0a1cf0 con 0x7f4e38004210 2024-08-18T21:11:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e4a59c640 1 -- 172.21.15.5:0/1555197235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e38004210 msgr2=0x7f4e4c0a13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e4a59c640 1 --2- 172.21.15.5:0/1555197235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e38004210 0x7f4e4c0a13f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c01c920 tx=0x7f4e38005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e42ffd640 1 -- 172.21.15.5:0/1555197235 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e3c009a30 con 0x7f4e38004210 2024-08-18T21:11:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e42ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e42ffd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:11:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e42ffd640 10 monclient: dump: 2024-08-18T21:11:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:10.972 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e42ffd640 10 monclient: _finish_auth 0 2024-08-18T21:11:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e42ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:11:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e42ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e50fc3640 5 monclient: authenticate success, global_id 104302 2024-08-18T21:11:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e42ffd640 1 -- 172.21.15.5:0/1555197235 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e3c0a6e80 con 0x7f4e38004210 2024-08-18T21:11:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e50fc3640 10 monclient: _renew_subs 2024-08-18T21:11:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e50fc3640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:11:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e50fc3640 1 -- 172.21.15.5:0/1555197235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4c122e40 con 0x7f4e38004210 2024-08-18T21:11:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e42ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e42ffd640 1 -- 172.21.15.5:0/1555197235 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e3c0b7400 con 0x7f4e38004210 2024-08-18T21:11:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e42ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e42ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:11:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e48d99640 4 set_mon_vals no callback set 2024-08-18T21:11:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e42ffd640 10 monclient: dump: 2024-08-18T21:11:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:10.974 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e50fc3640 10 monclient: _renew_subs 2024-08-18T21:11:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e50fc3640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:11:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e50fc3640 1 -- 172.21.15.5:0/1555197235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e4c1385a0 con 0x7f4e38004210 2024-08-18T21:11:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e50fc3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:10.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e50fc3640 1 --2- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4e4c1d2070 0x7f4e4c09daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:10.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e50fc3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:10.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e50fc3640 1 -- 172.21.15.5:0/1555197235 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f4e4c125280 con 0x7f4e4c1d2070 2024-08-18T21:11:10.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e49d9b640 1 --2- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4e4c1d2070 0x7f4e4c09daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:10.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e49d9b640 10 monclient: get_auth_request con 0x7f4e4c1d2070 auth_method 0 2024-08-18T21:11:10.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e49d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:10.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e49d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:10.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e49d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:10.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e49d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:10.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e49d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:10.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e49d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:10.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e49d9b640 10 monclient(hunting): handle_auth_done global_id 85101 payload 824 2024-08-18T21:11:10.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e49d9b640 1 -- 172.21.15.5:0/1555197235 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e4c0a8fe0 con 0x7f4e4c1d2070 2024-08-18T21:11:10.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e42ffd640 1 -- 172.21.15.5:0/1555197235 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f4e3c0be030 con 0x7f4e38004210 2024-08-18T21:11:10.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e42ffd640 1 --2- 172.21.15.5:0/1555197235 >> v2:172.21.15.157:6812/631023601 conn(0x7f4e2c03bdc0 0x7f4e2c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:10.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.956+0000 7f4e42ffd640 1 -- 172.21.15.5:0/1555197235 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(213..213 src has 22..213) ==== 3898+0+0 (secure 0 0 0) 0x7f4e3c0bc020 con 0x7f4e38004210 2024-08-18T21:11:10.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.960+0000 7f4e4ad9d640 1 --2- 172.21.15.5:0/1555197235 >> v2:172.21.15.157:6812/631023601 conn(0x7f4e2c03bdc0 0x7f4e2c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:10.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.960+0000 7f4e4ad9d640 10 monclient: get_auth_request con 0x7f4e2c03bdc0 auth_method 0 2024-08-18T21:11:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.960+0000 7f4e49d9b640 1 -- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4e4c1d2070 msgr2=0x7f4e4c09daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:10.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.960+0000 7f4e49d9b640 1 --2- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4e4c1d2070 0x7f4e4c09daa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4e34006fd0 tx=0x7f4e34009930 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.960+0000 7f4e42ffd640 1 -- 172.21.15.5:0/1555197235 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e34016020 con 0x7f4e4c1d2070 2024-08-18T21:11:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.960+0000 7f4e42ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.960+0000 7f4e42ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.960+0000 7f4e42ffd640 10 monclient: dump: 2024-08-18T21:11:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:10.979 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:10.980 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.960+0000 7f4e42ffd640 1 -- 172.21.15.5:0/1555197235 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4e340128f0 con 0x7f4e4c1d2070 2024-08-18T21:11:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.960+0000 7f4e42ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.960+0000 7f4e42ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.960+0000 7f4e42ffd640 1 -- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4e4c1d2070 msgr2=0x7f4e4c09daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:10.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.960+0000 7f4e42ffd640 1 --2- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4e4c1d2070 0x7f4e4c09daa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4e34006fd0 tx=0x7f4e34009930 comp rx=0 tx=0).stop 2024-08-18T21:11:10.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.960+0000 7f4e42ffd640 1 -- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4e4c1d2070 msgr2=0x7f4e4c09daa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:10.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.960+0000 7f4e42ffd640 1 --2- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4e4c1d2070 0x7f4e4c09daa0 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4e34006fd0 tx=0x7f4e34009930 comp rx=0 tx=0).stop 2024-08-18T21:11:10.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.960+0000 7f4e4ad9d640 1 --2- 172.21.15.5:0/1555197235 >> v2:172.21.15.157:6812/631023601 conn(0x7f4e2c03bdc0 0x7f4e2c03e280 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0a4a80 tx=0x7f4e440013b0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:10.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e50fc3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:10.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e50fc3640 1 --2- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4e4c09dfe0 0x7f4e4c09e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:10.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e50fc3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:10.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e50fc3640 1 -- 172.21.15.5:0/1555197235 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f4e4c0a7b60 con 0x7f4e4c09dfe0 2024-08-18T21:11:10.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e49d9b640 1 --2- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4e4c09dfe0 0x7f4e4c09e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:10.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e49d9b640 10 monclient: get_auth_request con 0x7f4e4c09dfe0 auth_method 0 2024-08-18T21:11:10.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e49d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:10.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e49d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:10.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e49d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:10.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e49d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e49d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e49d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e49d9b640 10 monclient(hunting): handle_auth_done global_id 85110 payload 824 2024-08-18T21:11:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e49d9b640 1 -- 172.21.15.5:0/1555197235 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4e4c139aa0 con 0x7f4e4c09dfe0 2024-08-18T21:11:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e49d9b640 1 -- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4e4c09dfe0 msgr2=0x7f4e4c09e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e49d9b640 1 --2- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4e4c09dfe0 0x7f4e4c09e3f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e34006fd0 tx=0x7f4e340059c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e42ffd640 1 -- 172.21.15.5:0/1555197235 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e34016050 con 0x7f4e4c09dfe0 2024-08-18T21:11:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e42ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e42ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e42ffd640 10 monclient: dump: 2024-08-18T21:11:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:10.983 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:10.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e42ffd640 1 -- 172.21.15.5:0/1555197235 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9371 (secure 0 0 0) 0x7f4e34027470 con 0x7f4e4c09dfe0 2024-08-18T21:11:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e42ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e42ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e42ffd640 1 -- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4e4c09dfe0 msgr2=0x7f4e4c09e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e42ffd640 1 --2- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4e4c09dfe0 0x7f4e4c09e3f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e34006fd0 tx=0x7f4e340059c0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e42ffd640 1 -- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4e4c09dfe0 msgr2=0x7f4e4c09e3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e42ffd640 1 --2- 172.21.15.5:0/1555197235 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f4e4c09dfe0 0x7f4e4c09e3f0 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e34006fd0 tx=0x7f4e340059c0 comp rx=0 tx=0).stop 2024-08-18T21:11:10.984 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:10.984 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:10.984 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:10.985 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:10.985 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 158, 2024-08-18T21:11:10.985 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 167798, 2024-08-18T21:11:10.985 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:10.985 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:10.985 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:10.985 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:10.985 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:10.985 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:11:10.985 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:10.985 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:11:10.985 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:10.985 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:10.986 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:10.986 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:10.986 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:10.986 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:10.986 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:10.986 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:10.986 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:10.986 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:10.986 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:10.986 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:10.986 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:10.986 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:10.986 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:10.987 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:10.987 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:10.987 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:10.987 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:10.987 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:10.987 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:10.987 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:10.987 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:10.987 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:10.988 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:10.988 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:10.988 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:10.988 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:10.988 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:10.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:10.988 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:10.988 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:10.988 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:10.988 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:10.988 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:10.988 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:10.988 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:10.988 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:10.989 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:10.989 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:10.989 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:10.989 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:10.989 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:10.989 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:10.989 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:10.989 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:10.989 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:10.989 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:10.989 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:10.989 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:10.989 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:10.990 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:10.990 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:10.990 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:10.990 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:10.990 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:10.990 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:10.990 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:10.990 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:10.990 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:10.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:10.990 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:10.990 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:10.991 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:10.991 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:10.991 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:10.991 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:10.991 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:10.991 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:10.991 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:10.991 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:10.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:10.991 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:10.991 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:10.991 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:10.991 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:10.992 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:10.992 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:10.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:10.992 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:10.992 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:10.992 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:10.992 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:10.992 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:10.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:10.992 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:10.992 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:10.992 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:10.993 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:10.993 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:10.993 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:10.993 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:10.993 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:10.993 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:10.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:10.993 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:10.993 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:10.993 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:10.993 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:10.993 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:10.993 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:10.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:10.994 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:10.994 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:10.994 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:10.994 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:10.994 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:10.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:10.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:10.994 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:10.994 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:10.994 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:10.994 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:10.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:10.995 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:10.995 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:10.995 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:10.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:10.995 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:10.995 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:10.995 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:10.995 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:10.995 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:10.995 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:10.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:10.995 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:10.995 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:10.996 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:10.996 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:10.996 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:10.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:10.996 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:10.996 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:10.996 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:10.996 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:10.996 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:10.996 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:10.996 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:10.996 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:10.996 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:10.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:10.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:10.997 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:10.997 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:10.997 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:10.997 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:10.997 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:10.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:10.997 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:10.997 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:10.997 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:10.997 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:10.997 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:10.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:10.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:10.998 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:10.998 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:10.998 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:10.998 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:10.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:10.998 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:10.998 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:10.998 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:10.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:10.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:10.999 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:10.999 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:10.999 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:10.999 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:10.999 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:10.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:10.999 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:10.999 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:10.999 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:10.999 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:10.999 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.000 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:11.000 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:11.000 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.000 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.000 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:11.000 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.000 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:11.001 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.001 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.001 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.001 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:11.001 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:11.001 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.001 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.001 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.001 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:11.001 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:11.002 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.002 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:11.002 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.002 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.002 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:11.002 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.002 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.002 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.003 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:11.003 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:11.003 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.003 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.003 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.003 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:11.003 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:11.003 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.003 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.004 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:11.005 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.006 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.007 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.007 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.007 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:11.007 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:11.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.007 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:11.007 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:11.007 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:11.007 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.007 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.007 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:11:11.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.007 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:11.008 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:11.008 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:11.008 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.008 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.008 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:11.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.008 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:11.008 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:11.008 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:11.008 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.008 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.008 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:11.008 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e50fc3640 1 -- 172.21.15.5:0/1555197235 >> v2:172.21.15.157:6812/631023601 conn(0x7f4e2c03bdc0 msgr2=0x7f4e2c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e50fc3640 1 --2- 172.21.15.5:0/1555197235 >> v2:172.21.15.157:6812/631023601 conn(0x7f4e2c03bdc0 0x7f4e2c03e280 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0a4a80 tx=0x7f4e440013b0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e50fc3640 10 monclient: shutdown 2024-08-18T21:11:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e50fc3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e50fc3640 1 -- 172.21.15.5:0/1555197235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e38004210 msgr2=0x7f4e4c0a13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e4ad9d640 1 -- 172.21.15.5:0/1555197235 reap_dead start 2024-08-18T21:11:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e50fc3640 1 --2- 172.21.15.5:0/1555197235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e38004210 0x7f4e4c0a13f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c01c920 tx=0x7f4e38005840 comp rx=0 tx=0).stop 2024-08-18T21:11:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e50fc3640 1 -- 172.21.15.5:0/1555197235 shutdown_connections 2024-08-18T21:11:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e50fc3640 1 --2- 172.21.15.5:0/1555197235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e38004210 0x7f4e4c0a13f0 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c01c920 tx=0x7f4e38005840 comp rx=0 tx=0).stop 2024-08-18T21:11:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e50fc3640 1 -- 172.21.15.5:0/1555197235 >> 172.21.15.5:0/1555197235 conn(0x7f4e4c0acbc0 msgr2=0x7f4e4c0aa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e50fc3640 1 -- 172.21.15.5:0/1555197235 shutdown_connections 2024-08-18T21:11:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:10.968+0000 7f4e50fc3640 1 -- 172.21.15.5:0/1555197235 wait complete. 2024-08-18T21:11:11.011 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:11:11.011 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon f 2024-08-18T21:11:11.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:11:11.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.132+0000 7f0810e5b640 10 monclient: get_monmap_and_config 2024-08-18T21:11:11.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.132+0000 7f0810e5b640 10 monclient: build_initial_monmap 2024-08-18T21:11:11.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.132+0000 7f0810e5b640 10 monclient: monmap: 2024-08-18T21:11:11.137 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:11.137 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.137 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:11.139158+0000 2024-08-18T21:11:11.137 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:11.139158+0000 2024-08-18T21:11:11.137 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:11.137 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.137 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:11.137 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:11.137 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:11.138 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:11.138 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:11.138 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:11.138 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:11.138 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:11.138 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:11.138 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:11.138 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:11.138 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.132+0000 7f0810e5b640 1 Processor -- start 2024-08-18T21:11:11.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.132+0000 7f0810e5b640 1 -- start start 2024-08-18T21:11:11.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.132+0000 7f0810e5b640 10 monclient: init 2024-08-18T21:11:11.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0810e5b640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:11.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0810e5b640 10 monclient: _add_conns ranks=[3,7,0,6,10,5,9,4,2,1,8] 2024-08-18T21:11:11.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0810e5b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f080c0a6ce0 0x7f080c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0810e5b640 10 monclient(hunting): picked mon.noname-g con 0x7f080c0a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:11.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0810e5b640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f080c0a7600 0x7f080c139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0810e5b640 10 monclient(hunting): picked mon.noname-i con 0x7f080c0a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:11.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0810e5b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f080c139fe0 addr v1:172.21.15.5:6789/0 2024-08-18T21:11:11.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0810e5b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f080c0a45d0 con 0x7f080c139fe0 2024-08-18T21:11:11.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0810e5b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0810e5b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f080c0a5000 con 0x7f080c0a6ce0 2024-08-18T21:11:11.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0810e5b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0810e5b640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f080c0a32d0 con 0x7f080c0a7600 2024-08-18T21:11:11.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0810e5b640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:11.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0810e5b640 10 monclient(hunting): authenticate will time out at 1438.152319s 2024-08-18T21:11:11.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f080ad9d640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7f080c139fe0 legacy=0x7f080c140cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:11:11.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f080c0a7600 0x7f080c139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f080a59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f080c0a6ce0 0x7f080c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f080c0a7600 0x7f080c139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:36736/0 (socket says 172.21.15.5:36736) 2024-08-18T21:11:11.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 1 -- 172.21.15.5:0/2222359004 learned_addr learned my addr 172.21.15.5:0/2222359004 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:11.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 10 monclient(hunting): get_auth_request con 0x7f080c0a7600 auth_method 0 2024-08-18T21:11:11.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:11.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:11.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:11.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f080a59c640 10 monclient(hunting): get_auth_request con 0x7f080c0a6ce0 auth_method 0 2024-08-18T21:11:11.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f080a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:11.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f080a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:11.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f080a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f080a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f080a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f080a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 10 monclient(hunting): handle_auth_done global_id 6307 payload 274 2024-08-18T21:11:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 1 -- 172.21.15.5:0/2222359004 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f080c0a6ce0 msgr2=0x7f080c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 1 --2- 172.21.15.5:0/2222359004 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f080c0a6ce0 0x7f080c0a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 1 -- 172.21.15.5:0/2222359004 >> v1:172.21.15.5:6789/0 conn(0x7f080c139fe0 legacy=0x7f080c140cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:11:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 1 monclient: found mon.noname-i 2024-08-18T21:11:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:11:11.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f0809d9b640 1 -- 172.21.15.5:0/2222359004 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080c0a8900 con 0x7f080c0a7600 2024-08-18T21:11:11.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.136+0000 7f080a59c640 1 --2- 172.21.15.5:0/2222359004 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f080c0a6ce0 0x7f080c0a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f0809d9b640 1 -- 172.21.15.5:0/2222359004 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f080c0a7600 msgr2=0x7f080c139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f0809d9b640 1 --2- 172.21.15.5:0/2222359004 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f080c0a7600 0x7f080c139aa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f08000098a0 tx=0x7f080001c440 comp rx=0 tx=0).ready entity=mon.7 client_cookie=a44d1cc4f405d5ab server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f080959a640 1 -- 172.21.15.5:0/2222359004 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f08000b2070 con 0x7f080c0a7600 2024-08-18T21:11:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f080959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f080959a640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:11:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f080959a640 10 monclient: dump: 2024-08-18T21:11:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.151 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f080959a640 10 monclient: _finish_auth 0 2024-08-18T21:11:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f080959a640 10 monclient: _check_auth_tickets 2024-08-18T21:11:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f080959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f080959a640 1 -- 172.21.15.5:0/2222359004 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08000a9070 con 0x7f080c0a7600 2024-08-18T21:11:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f080959a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f080959a640 1 -- 172.21.15.5:0/2222359004 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f08000abc40 con 0x7f080c0a7600 2024-08-18T21:11:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f080959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f080959a640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:11:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f080959a640 10 monclient: dump: 2024-08-18T21:11:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.152 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.152 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.152 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.152 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.152 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.152 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.152 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.152 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.152 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.152 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.152 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.152 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.152 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.152 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f0810e5b640 5 monclient: authenticate success, global_id 6307 2024-08-18T21:11:11.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f0810e5b640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:11.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.140+0000 7f0810e5b640 4 set_mon_vals no callback set 2024-08-18T21:11:11.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 10 monclient: shutdown 2024-08-18T21:11:11.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:11.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 1 -- 172.21.15.5:0/2222359004 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f080c0a7600 msgr2=0x7f080c139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 1 --2- 172.21.15.5:0/2222359004 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f080c0a7600 0x7f080c139aa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f08000098a0 tx=0x7f080001c440 comp rx=0 tx=0).stop 2024-08-18T21:11:11.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 1 -- 172.21.15.5:0/2222359004 shutdown_connections 2024-08-18T21:11:11.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 1 --2- 172.21.15.5:0/2222359004 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f080c0a7600 0x7f080c139aa0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 1 --2- 172.21.15.5:0/2222359004 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f080c0a6ce0 0x7f080c0a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 1 -- 172.21.15.5:0/2222359004 >> 172.21.15.5:0/2222359004 conn(0x7f080c0acbc0 msgr2=0x7f080c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:11.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 1 -- 172.21.15.5:0/2222359004 shutdown_connections 2024-08-18T21:11:11.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 1 -- 172.21.15.5:0/2222359004 wait complete. 2024-08-18T21:11:11.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 10 monclient: build_initial_monmap 2024-08-18T21:11:11.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 10 monclient: monmap: 2024-08-18T21:11:11.154 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:11.154 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:11.154 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:11.154 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:11.154 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:11.154 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.154 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:11.154 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:11.154 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:11.154 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:11.154 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:11.155 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 1 Processor -- start 2024-08-18T21:11:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 1 -- start start 2024-08-18T21:11:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 10 monclient: init 2024-08-18T21:11:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 10 monclient: _add_conns ranks=[2,1,7,5,0,3,6,8,4] 2024-08-18T21:11:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f080c0a6ce0 0x7f080c1d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 10 monclient(hunting): picked mon.noname-b con 0x7f080c0a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:11:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c0a7600 0x7f080c1d21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 10 monclient(hunting): picked mon.noname-f con 0x7f080c0a7600 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:11:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f080c139fe0 0x7f080c13eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 10 monclient(hunting): picked mon.noname-i con 0x7f080c139fe0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f080c0a79e0 con 0x7f080c0a7600 2024-08-18T21:11:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f080c0a9810 con 0x7f080c0a6ce0 2024-08-18T21:11:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f080c140f20 con 0x7f080c139fe0 2024-08-18T21:11:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0810e5b640 10 monclient(hunting): authenticate will time out at 1438.162076s 2024-08-18T21:11:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f080a59c640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f080c0a6ce0 msgr2=0x7f080c1d1c80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:11:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f080a59c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f080c0a6ce0 0x7f080c1d1c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f080ad9d640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f080c139fe0 0x7f080c13eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c0a7600 0x7f080c1d21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c0a7600 0x7f080c1d21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:56120/0 (socket says 172.21.15.5:56120) 2024-08-18T21:11:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 1 -- 172.21.15.5:0/1539361819 learned_addr learned my addr 172.21.15.5:0/1539361819 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 10 monclient(hunting): get_auth_request con 0x7f080c0a7600 auth_method 0 2024-08-18T21:11:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f080ad9d640 10 monclient(hunting): get_auth_request con 0x7f080c139fe0 auth_method 0 2024-08-18T21:11:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f080ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f080ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f080ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f080ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f080ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f080ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 10 monclient(hunting): handle_auth_done global_id 104311 payload 824 2024-08-18T21:11:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 1 -- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f080c139fe0 msgr2=0x7f080c13eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 1 --2- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f080c139fe0 0x7f080c13eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 1 -- 172.21.15.5:0/1539361819 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f080c0a6ce0 msgr2=0x7f080c1d1c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:11:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 1 --2- 172.21.15.5:0/1539361819 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f080c0a6ce0 0x7f080c1d1c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:11:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 1 monclient: found mon.noname-f 2024-08-18T21:11:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:11:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.144+0000 7f0809d9b640 1 -- 172.21.15.5:0/1539361819 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080c0a2320 con 0x7f080c0a7600 2024-08-18T21:11:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f0809d9b640 1 -- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c0a7600 msgr2=0x7f080c1d21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f0809d9b640 1 --2- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c0a7600 0x7f080c1d21c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f080001cce0 tx=0x7f08000191e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07faffd640 1 -- 172.21.15.5:0/1539361819 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f08000bc070 con 0x7f080c0a7600 2024-08-18T21:11:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07faffd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:11:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07faffd640 10 monclient: dump: 2024-08-18T21:11:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.163 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07faffd640 10 monclient: _finish_auth 0 2024-08-18T21:11:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07faffd640 10 monclient: _check_auth_tickets 2024-08-18T21:11:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07faffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07faffd640 1 -- 172.21.15.5:0/1539361819 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08000b3040 con 0x7f080c0a7600 2024-08-18T21:11:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f0810e5b640 5 monclient: authenticate success, global_id 104311 2024-08-18T21:11:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f0810e5b640 10 monclient: _renew_subs 2024-08-18T21:11:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f0810e5b640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:11:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f0810e5b640 1 -- 172.21.15.5:0/1539361819 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080c1421a0 con 0x7f080c0a7600 2024-08-18T21:11:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07faffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07faffd640 1 -- 172.21.15.5:0/1539361819 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f08000b2070 con 0x7f080c0a7600 2024-08-18T21:11:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07faffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:11:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07faffd640 10 monclient: dump: 2024-08-18T21:11:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.165 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f0810e5b640 10 monclient: _renew_subs 2024-08-18T21:11:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f0810e5b640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.157:3300/0 2024-08-18T21:11:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f0810e5b640 1 -- 172.21.15.5:0/1539361819 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f080c123540 con 0x7f080c0a7600 2024-08-18T21:11:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07fbfff640 4 set_mon_vals no callback set 2024-08-18T21:11:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f0810e5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f0810e5b640 1 --2- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c122ca0 0x7f080c13f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f0810e5b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f0810e5b640 1 -- 172.21.15.5:0/1539361819 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f080c0a7b60 con 0x7f080c122ca0 2024-08-18T21:11:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f080a59c640 1 --2- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c122ca0 0x7f080c13f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f080a59c640 10 monclient: get_auth_request con 0x7f080c122ca0 auth_method 0 2024-08-18T21:11:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f080a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f080a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f080a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07faffd640 1 -- 172.21.15.5:0/1539361819 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f08000ab070 con 0x7f080c0a7600 2024-08-18T21:11:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f080a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f080a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f080a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07faffd640 1 --2- 172.21.15.5:0/1539361819 >> v2:172.21.15.157:6812/631023601 conn(0x7f07ec03bdf0 0x7f07ec03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f07faffd640 1 -- 172.21.15.5:0/1539361819 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(213..213 src has 22..213) ==== 3898+0+0 (secure 0 0 0) 0x7f08000e78d0 con 0x7f080c0a7600 2024-08-18T21:11:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f080a59c640 10 monclient(hunting): handle_auth_done global_id 104320 payload 824 2024-08-18T21:11:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f080a59c640 1 -- 172.21.15.5:0/1539361819 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f080c0a8220 con 0x7f080c122ca0 2024-08-18T21:11:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f080ad9d640 1 --2- 172.21.15.5:0/1539361819 >> v2:172.21.15.157:6812/631023601 conn(0x7f07ec03bdf0 0x7f07ec03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.148+0000 7f080ad9d640 10 monclient: get_auth_request con 0x7f07ec03bdf0 auth_method 0 2024-08-18T21:11:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.152+0000 7f080a59c640 1 -- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c122ca0 msgr2=0x7f080c13f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.152+0000 7f080a59c640 1 --2- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c122ca0 0x7f080c13f030 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0096a0 tx=0x7f07fc00ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.152+0000 7f07faffd640 1 -- 172.21.15.5:0/1539361819 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07fc017070 con 0x7f080c122ca0 2024-08-18T21:11:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.152+0000 7f07faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.152+0000 7f07faffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:11:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.152+0000 7f07faffd640 10 monclient: dump: 2024-08-18T21:11:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.168 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.152+0000 7f080ad9d640 1 --2- 172.21.15.5:0/1539361819 >> v2:172.21.15.157:6812/631023601 conn(0x7f07ec03bdf0 0x7f07ec03e2b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0804003cc0 tx=0x7f080400d040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.152+0000 7f07faffd640 1 -- 172.21.15.5:0/1539361819 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f07fc00cb60 con 0x7f080c122ca0 2024-08-18T21:11:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.152+0000 7f07faffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.152+0000 7f07faffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.152+0000 7f07faffd640 1 -- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c122ca0 msgr2=0x7f080c13f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.152+0000 7f07faffd640 1 --2- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c122ca0 0x7f080c13f030 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0096a0 tx=0x7f07fc00ec00 comp rx=0 tx=0).stop 2024-08-18T21:11:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.152+0000 7f07faffd640 1 -- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c122ca0 msgr2=0x7f080c13f030 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.152+0000 7f07faffd640 1 --2- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c122ca0 0x7f080c13f030 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0096a0 tx=0x7f07fc00ec00 comp rx=0 tx=0).stop 2024-08-18T21:11:11.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.160+0000 7f0810e5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:11.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.160+0000 7f0810e5b640 1 --2- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c13f570 0x7f080c13f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.160+0000 7f0810e5b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.160+0000 7f0810e5b640 1 -- 172.21.15.5:0/1539361819 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f080c051140 con 0x7f080c13f570 2024-08-18T21:11:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.160+0000 7f080a59c640 1 --2- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c13f570 0x7f080c13f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.160+0000 7f080a59c640 10 monclient: get_auth_request con 0x7f080c13f570 auth_method 0 2024-08-18T21:11:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.160+0000 7f080a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.160+0000 7f080a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.160+0000 7f080a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.160+0000 7f080a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.160+0000 7f080a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.160+0000 7f080a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.160+0000 7f080a59c640 10 monclient(hunting): handle_auth_done global_id 104329 payload 824 2024-08-18T21:11:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.160+0000 7f080a59c640 1 -- 172.21.15.5:0/1539361819 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f080c13fec0 con 0x7f080c13f570 2024-08-18T21:11:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f080a59c640 1 -- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c13f570 msgr2=0x7f080c13f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f080a59c640 1 --2- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c13f570 0x7f080c13f980 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f07fc019000 tx=0x7f07fc004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f07faffd640 1 -- 172.21.15.5:0/1539361819 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f07fc017070 con 0x7f080c13f570 2024-08-18T21:11:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f07faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f07faffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:11:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f07faffd640 10 monclient: dump: 2024-08-18T21:11:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.173 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f07faffd640 1 -- 172.21.15.5:0/1539361819 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9372 (secure 0 0 0) 0x7f07fc0066e0 con 0x7f080c13f570 2024-08-18T21:11:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f07faffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f07faffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f07faffd640 1 -- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c13f570 msgr2=0x7f080c13f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f07faffd640 1 --2- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c13f570 0x7f080c13f980 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f07fc019000 tx=0x7f07fc004740 comp rx=0 tx=0).stop 2024-08-18T21:11:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f07faffd640 1 -- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c13f570 msgr2=0x7f080c13f980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f07faffd640 1 --2- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c13f570 0x7f080c13f980 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f07fc019000 tx=0x7f07fc004740 comp rx=0 tx=0).stop 2024-08-18T21:11:11.174 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:11:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 158, 2024-08-18T21:11:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 35655, 2024-08-18T21:11:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:11:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:11:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:11.179 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:11.179 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:11.179 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:11.179 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:11.179 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:11.179 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:11.179 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:11.179 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:11.179 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:11.179 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:11.179 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.179 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:11.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.180 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:11.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.180 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:11.180 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:11.180 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.180 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.180 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.180 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:11.180 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.181 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.181 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:11.181 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.181 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.181 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.181 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:11.181 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:11.181 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.181 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.181 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.182 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:11.182 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:11.182 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:11.182 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:11.182 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.183 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.183 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.183 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:11.183 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:11.183 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.183 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.183 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.183 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:11.183 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:11.184 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.184 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.184 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:11.184 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.184 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:11.184 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.184 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.184 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:11.185 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:11.185 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.185 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.185 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.185 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:11.185 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:11.185 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.185 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.186 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:11.186 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.186 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:11.186 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.186 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.186 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.186 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:11.186 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:11.186 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.187 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.187 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.187 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:11.187 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:11.187 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.187 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.187 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.187 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:11.187 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.188 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:11.188 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.188 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.188 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.188 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:11.188 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:11.188 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.188 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.188 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.189 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:11.189 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:11.189 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.189 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.189 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.189 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:11.189 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.189 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.189 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:11.189 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.190 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.190 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:11.190 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:11.190 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.190 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.190 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.190 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:11.190 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:11.190 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:11.191 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:11.191 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.191 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.191 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:11.192 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:11.195 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:11:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:11:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.196 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:11:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.197 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:11.197 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f0810e5b640 1 -- 172.21.15.5:0/1539361819 >> v2:172.21.15.157:6812/631023601 conn(0x7f07ec03bdf0 msgr2=0x7f07ec03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f0810e5b640 1 --2- 172.21.15.5:0/1539361819 >> v2:172.21.15.157:6812/631023601 conn(0x7f07ec03bdf0 0x7f07ec03e2b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0804003cc0 tx=0x7f080400d040 comp rx=0 tx=0).stop 2024-08-18T21:11:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f0810e5b640 10 monclient: shutdown 2024-08-18T21:11:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f0810e5b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f0810e5b640 1 -- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c0a7600 msgr2=0x7f080c1d21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f0810e5b640 1 --2- 172.21.15.5:0/1539361819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f080c0a7600 0x7f080c1d21c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f080001cce0 tx=0x7f08000191e0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f080ad9d640 1 -- 172.21.15.5:0/1539361819 reap_dead start 2024-08-18T21:11:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f080ad9d640 1 -- 172.21.15.5:0/1539361819 reap_dead start 2024-08-18T21:11:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f0810e5b640 1 -- 172.21.15.5:0/1539361819 shutdown_connections 2024-08-18T21:11:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f0810e5b640 1 -- 172.21.15.5:0/1539361819 >> 172.21.15.5:0/1539361819 conn(0x7f080c0acbc0 msgr2=0x7f080c0aa540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f0810e5b640 1 -- 172.21.15.5:0/1539361819 shutdown_connections 2024-08-18T21:11:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.164+0000 7f0810e5b640 1 -- 172.21.15.5:0/1539361819 wait complete. 2024-08-18T21:11:11.200 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:11:11.200 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon g 2024-08-18T21:11:11.200 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:11:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.312+0000 7f6873b9f640 10 monclient: get_monmap_and_config 2024-08-18T21:11:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.312+0000 7f6873b9f640 10 monclient: build_initial_monmap 2024-08-18T21:11:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 10 monclient: monmap: 2024-08-18T21:11:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:11.320385+0000 2024-08-18T21:11:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:11.320385+0000 2024-08-18T21:11:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:11.320 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 1 Processor -- start 2024-08-18T21:11:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 1 -- start start 2024-08-18T21:11:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 10 monclient: init 2024-08-18T21:11:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 10 monclient: _add_conns ranks=[2,4,7,5,0,6,10,1,8,9,3] 2024-08-18T21:11:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f686c0a6bd0 0x7f686c0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 10 monclient(hunting): picked mon.noname-b con 0x7f686c0a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:11:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f686c09f080 0x7f686c0a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 10 monclient(hunting): picked mon.noname-c con 0x7f686c09f080 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f686c139990 0x7f686c139df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 10 monclient(hunting): picked mon.noname-i con 0x7f686c139990 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f686c09e4c0 con 0x7f686c0a6bd0 2024-08-18T21:11:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f686c06f930 con 0x7f686c09f080 2024-08-18T21:11:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f686c0a7a30 con 0x7f686c139990 2024-08-18T21:11:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f6873b9f640 10 monclient(hunting): authenticate will time out at 1438.333541s 2024-08-18T21:11:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687113a640 1 -- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f686c09f080 msgr2=0x7f686c0a74f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687193b640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f686c0a6bd0 msgr2=0x7f686c0a6fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:11:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687113a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f686c09f080 0x7f686c0a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687193b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f686c0a6bd0 0x7f686c0a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f686c139990 0x7f686c139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f686c139990 0x7f686c139df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:36742/0 (socket says 172.21.15.5:36742) 2024-08-18T21:11:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 1 -- 172.21.15.5:0/58912833 learned_addr learned my addr 172.21.15.5:0/58912833 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 10 monclient(hunting): get_auth_request con 0x7f686c139990 auth_method 0 2024-08-18T21:11:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 10 monclient(hunting): handle_auth_done global_id 6325 payload 274 2024-08-18T21:11:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 1 -- 172.21.15.5:0/58912833 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f686c09f080 msgr2=0x7f686c0a74f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 1 --2- 172.21.15.5:0/58912833 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f686c09f080 0x7f686c0a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 1 -- 172.21.15.5:0/58912833 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f686c0a6bd0 msgr2=0x7f686c0a6fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 1 --2- 172.21.15.5:0/58912833 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f686c0a6bd0 0x7f686c0a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 10 monclient: _finish_hunting 0 2024-08-18T21:11:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 1 monclient: found mon.noname-i 2024-08-18T21:11:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:11:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.316+0000 7f687213c640 1 -- 172.21.15.5:0/58912833 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686c0a7fb0 con 0x7f686c139990 2024-08-18T21:11:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.320+0000 7f687213c640 1 -- 172.21.15.5:0/58912833 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f686c139990 msgr2=0x7f686c139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.320+0000 7f687213c640 1 --2- 172.21.15.5:0/58912833 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f686c139990 0x7f686c139df0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f68640098a0 tx=0x7f686401c480 comp rx=0 tx=0).ready entity=mon.7 client_cookie=7e232fad77935a48 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.320+0000 7f6870939640 1 -- 172.21.15.5:0/58912833 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68640b0070 con 0x7f686c139990 2024-08-18T21:11:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.320+0000 7f6870939640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6870939640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:11:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6870939640 10 monclient: dump: 2024-08-18T21:11:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.328 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6870939640 10 monclient: _finish_auth 0 2024-08-18T21:11:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6870939640 10 monclient: _check_auth_tickets 2024-08-18T21:11:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6870939640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 5 monclient: authenticate success, global_id 6325 2024-08-18T21:11:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6870939640 1 -- 172.21.15.5:0/58912833 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68640aa810 con 0x7f686c139990 2024-08-18T21:11:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6870939640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6870939640 1 -- 172.21.15.5:0/58912833 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68640a93e0 con 0x7f686c139990 2024-08-18T21:11:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6870939640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 4 set_mon_vals no callback set 2024-08-18T21:11:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6870939640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:11:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6870939640 10 monclient: dump: 2024-08-18T21:11:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.330 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 10 monclient: shutdown 2024-08-18T21:11:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 -- 172.21.15.5:0/58912833 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f686c139990 msgr2=0x7f686c139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 --2- 172.21.15.5:0/58912833 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f686c139990 0x7f686c139df0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f68640098a0 tx=0x7f686401c480 comp rx=0 tx=0).stop 2024-08-18T21:11:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 -- 172.21.15.5:0/58912833 shutdown_connections 2024-08-18T21:11:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 --2- 172.21.15.5:0/58912833 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f686c139990 0x7f686c139df0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 --2- 172.21.15.5:0/58912833 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f686c09f080 0x7f686c0a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 --2- 172.21.15.5:0/58912833 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f686c0a6bd0 0x7f686c0a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 -- 172.21.15.5:0/58912833 >> 172.21.15.5:0/58912833 conn(0x7f686c068700 msgr2=0x7f686c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 -- 172.21.15.5:0/58912833 shutdown_connections 2024-08-18T21:11:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 -- 172.21.15.5:0/58912833 wait complete. 2024-08-18T21:11:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 10 monclient: build_initial_monmap 2024-08-18T21:11:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 10 monclient: monmap: 2024-08-18T21:11:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:11.332 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 Processor -- start 2024-08-18T21:11:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 -- start start 2024-08-18T21:11:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 10 monclient: init 2024-08-18T21:11:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 10 monclient: _add_conns ranks=[7,8,4,5,2,0,1,3,6] 2024-08-18T21:11:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f686c09f080 0x7f686c138910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 10 monclient(hunting): picked mon.noname-i con 0x7f686c09f080 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f686c0a6bd0 0x7f686c13dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 10 monclient(hunting): picked mon.noname-e con 0x7f686c0a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f686c139990 0x7f686c13e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 10 monclient(hunting): picked mon.noname-c con 0x7f686c139990 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f686c0a89f0 con 0x7f686c139990 2024-08-18T21:11:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f686c0a7ce0 con 0x7f686c09f080 2024-08-18T21:11:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f686c143610 con 0x7f686c0a6bd0 2024-08-18T21:11:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f6873b9f640 10 monclient(hunting): authenticate will time out at 1438.342217s 2024-08-18T21:11:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687113a640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f686c0a6bd0 msgr2=0x7f686c13dba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:11:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687113a640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f686c0a6bd0 0x7f686c13dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687213c640 1 -- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f686c139990 msgr2=0x7f686c13e0e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687213c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f686c139990 0x7f686c13e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f686c09f080 0x7f686c138910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f686c09f080 0x7f686c138910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:36756/0 (socket says 172.21.15.5:36756) 2024-08-18T21:11:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 1 -- 172.21.15.5:0/1297797312 learned_addr learned my addr 172.21.15.5:0/1297797312 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 10 monclient(hunting): get_auth_request con 0x7f686c09f080 auth_method 0 2024-08-18T21:11:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 10 monclient(hunting): handle_auth_done global_id 6334 payload 824 2024-08-18T21:11:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 1 -- 172.21.15.5:0/1297797312 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f686c0a6bd0 msgr2=0x7f686c13dba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:11:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 1 --2- 172.21.15.5:0/1297797312 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f686c0a6bd0 0x7f686c13dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 1 -- 172.21.15.5:0/1297797312 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f686c139990 msgr2=0x7f686c13e0e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:11:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 1 --2- 172.21.15.5:0/1297797312 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f686c139990 0x7f686c13e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 10 monclient: _finish_hunting 0 2024-08-18T21:11:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 1 monclient: found mon.noname-i 2024-08-18T21:11:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:11:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.324+0000 7f687193b640 1 -- 172.21.15.5:0/1297797312 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686c13f520 con 0x7f686c09f080 2024-08-18T21:11:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f687193b640 1 -- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f686c09f080 msgr2=0x7f686c138910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f687193b640 1 --2- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f686c09f080 0x7f686c138910 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f685c00b580 tx=0x7f685c00ba40 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686a7fc640 1 -- 172.21.15.5:0/1297797312 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f685c017070 con 0x7f686c09f080 2024-08-18T21:11:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686a7fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:11:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686a7fc640 10 monclient: dump: 2024-08-18T21:11:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.343 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686a7fc640 10 monclient: _finish_auth 0 2024-08-18T21:11:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686a7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:11:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686a7fc640 1 -- 172.21.15.5:0/1297797312 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f685c003de0 con 0x7f686c09f080 2024-08-18T21:11:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f6873b9f640 5 monclient: authenticate success, global_id 6334 2024-08-18T21:11:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f6873b9f640 10 monclient: _renew_subs 2024-08-18T21:11:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f6873b9f640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:11:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f6873b9f640 1 -- 172.21.15.5:0/1297797312 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f686c1242a0 con 0x7f686c09f080 2024-08-18T21:11:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686a7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686a7fc640 1 -- 172.21.15.5:0/1297797312 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f685c00f380 con 0x7f686c09f080 2024-08-18T21:11:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686a7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:11:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686b7fe640 4 set_mon_vals no callback set 2024-08-18T21:11:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686a7fc640 10 monclient: dump: 2024-08-18T21:11:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.345 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f6873b9f640 10 monclient: _renew_subs 2024-08-18T21:11:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f6873b9f640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:11:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f6873b9f640 1 -- 172.21.15.5:0/1297797312 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f686c0ab420 con 0x7f686c09f080 2024-08-18T21:11:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f6873b9f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f6873b9f640 1 --2- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f686c138e50 0x7f686c13e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f6873b9f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f6873b9f640 1 -- 172.21.15.5:0/1297797312 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f686c051140 con 0x7f686c138e50 2024-08-18T21:11:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f687113a640 1 --2- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f686c138e50 0x7f686c13e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f687113a640 10 monclient: get_auth_request con 0x7f686c138e50 auth_method 0 2024-08-18T21:11:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f687113a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f687113a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f687113a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f687113a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f687113a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f687113a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686a7fc640 1 -- 172.21.15.5:0/1297797312 <== mon.7 v2:172.21.15.157:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f685c0050d0 con 0x7f686c09f080 2024-08-18T21:11:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f687113a640 10 monclient(hunting): handle_auth_done global_id 84945 payload 824 2024-08-18T21:11:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f687113a640 1 -- 172.21.15.5:0/1297797312 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f686c139df0 con 0x7f686c138e50 2024-08-18T21:11:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686a7fc640 1 --2- 172.21.15.5:0/1297797312 >> v2:172.21.15.157:6812/631023601 conn(0x7f685803bdc0 0x7f685803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.328+0000 7f686a7fc640 1 -- 172.21.15.5:0/1297797312 <== mon.7 v2:172.21.15.157:3303/0 5 ==== osd_map(213..213 src has 22..213) ==== 3898+0+0 (secure 0 0 0) 0x7f685c00d040 con 0x7f686c09f080 2024-08-18T21:11:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.332+0000 7f687213c640 1 --2- 172.21.15.5:0/1297797312 >> v2:172.21.15.157:6812/631023601 conn(0x7f685803bdc0 0x7f685803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.332+0000 7f687213c640 10 monclient: get_auth_request con 0x7f685803bdc0 auth_method 0 2024-08-18T21:11:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.332+0000 7f687113a640 1 -- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f686c138e50 msgr2=0x7f686c13e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.332+0000 7f687113a640 1 --2- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f686c138e50 0x7f686c13e620 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f686c122a30 tx=0x7f686000bcf0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.332+0000 7f686a7fc640 1 -- 172.21.15.5:0/1297797312 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68600057d0 con 0x7f686c138e50 2024-08-18T21:11:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.332+0000 7f686a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.332+0000 7f686a7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:11:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.332+0000 7f686a7fc640 10 monclient: dump: 2024-08-18T21:11:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.349 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.332+0000 7f687213c640 1 --2- 172.21.15.5:0/1297797312 >> v2:172.21.15.157:6812/631023601 conn(0x7f685803bdc0 0x7f685803e280 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f68640ad000 tx=0x7f6864008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.332+0000 7f686a7fc640 1 -- 172.21.15.5:0/1297797312 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6860005360 con 0x7f686c138e50 2024-08-18T21:11:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.332+0000 7f686a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.332+0000 7f686a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.332+0000 7f686a7fc640 1 -- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f686c138e50 msgr2=0x7f686c13e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.332+0000 7f686a7fc640 1 --2- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f686c138e50 0x7f686c13e620 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f686c122a30 tx=0x7f686000bcf0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.332+0000 7f686a7fc640 1 -- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f686c138e50 msgr2=0x7f686c13e620 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.332+0000 7f686a7fc640 1 --2- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f686c138e50 0x7f686c13e620 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f686c122a30 tx=0x7f686000bcf0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.340+0000 7f6873b9f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.340+0000 7f6873b9f640 1 --2- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f686c13eb60 0x7f686c0a3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.340+0000 7f6873b9f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.340+0000 7f6873b9f640 1 -- 172.21.15.5:0/1297797312 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f686c13ef70 con 0x7f686c13eb60 2024-08-18T21:11:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.340+0000 7f687113a640 1 --2- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f686c13eb60 0x7f686c0a3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.340+0000 7f687113a640 10 monclient: get_auth_request con 0x7f686c13eb60 auth_method 0 2024-08-18T21:11:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.340+0000 7f687113a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.340+0000 7f687113a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.340+0000 7f687113a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.340+0000 7f687113a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.340+0000 7f687113a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.340+0000 7f687113a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.340+0000 7f687113a640 10 monclient(hunting): handle_auth_done global_id 84954 payload 824 2024-08-18T21:11:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.340+0000 7f687113a640 1 -- 172.21.15.5:0/1297797312 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f686c0746d0 con 0x7f686c13eb60 2024-08-18T21:11:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f687113a640 1 -- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f686c13eb60 msgr2=0x7f686c0a3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f687113a640 1 --2- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f686c13eb60 0x7f686c0a3ff0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6860014000 tx=0x7f6860003b80 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f686a7fc640 1 -- 172.21.15.5:0/1297797312 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f686001ac90 con 0x7f686c13eb60 2024-08-18T21:11:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f686a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f686a7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:11:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f686a7fc640 10 monclient: dump: 2024-08-18T21:11:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.353 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f686a7fc640 1 -- 172.21.15.5:0/1297797312 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9371 (secure 0 0 0) 0x7f686001a820 con 0x7f686c13eb60 2024-08-18T21:11:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f686a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f686a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f686a7fc640 1 -- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f686c13eb60 msgr2=0x7f686c0a3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f686a7fc640 1 --2- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f686c13eb60 0x7f686c0a3ff0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6860014000 tx=0x7f6860003b80 comp rx=0 tx=0).stop 2024-08-18T21:11:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f686a7fc640 1 -- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f686c13eb60 msgr2=0x7f686c0a3ff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f686a7fc640 1 --2- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f686c13eb60 0x7f686c0a3ff0 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6860014000 tx=0x7f6860003b80 comp rx=0 tx=0).stop 2024-08-18T21:11:11.354 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:11.354 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 158, 2024-08-18T21:11:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 168169, 2024-08-18T21:11:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:11:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:11:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:11:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:11:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:11.378 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f6873b9f640 1 -- 172.21.15.5:0/1297797312 >> v2:172.21.15.157:6812/631023601 conn(0x7f685803bdc0 msgr2=0x7f685803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f6873b9f640 1 --2- 172.21.15.5:0/1297797312 >> v2:172.21.15.157:6812/631023601 conn(0x7f685803bdc0 0x7f685803e280 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f68640ad000 tx=0x7f6864008040 comp rx=0 tx=0).stop 2024-08-18T21:11:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f6873b9f640 10 monclient: shutdown 2024-08-18T21:11:11.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f6873b9f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:11.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f6873b9f640 1 -- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f686c09f080 msgr2=0x7f686c138910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f6873b9f640 1 --2- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f686c09f080 0x7f686c138910 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f685c00b580 tx=0x7f685c00ba40 comp rx=0 tx=0).stop 2024-08-18T21:11:11.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f687213c640 1 -- 172.21.15.5:0/1297797312 reap_dead start 2024-08-18T21:11:11.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f6873b9f640 1 -- 172.21.15.5:0/1297797312 shutdown_connections 2024-08-18T21:11:11.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f6873b9f640 1 --2- 172.21.15.5:0/1297797312 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f686c09f080 0x7f686c138910 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f6873b9f640 1 -- 172.21.15.5:0/1297797312 >> 172.21.15.5:0/1297797312 conn(0x7f686c068700 msgr2=0x7f686c140610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:11.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f6873b9f640 1 -- 172.21.15.5:0/1297797312 shutdown_connections 2024-08-18T21:11:11.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.344+0000 7f6873b9f640 1 -- 172.21.15.5:0/1297797312 wait complete. 2024-08-18T21:11:11.380 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:11:11.381 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon h 2024-08-18T21:11:11.381 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:11:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 10 monclient: get_monmap_and_config 2024-08-18T21:11:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 10 monclient: build_initial_monmap 2024-08-18T21:11:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 10 monclient: monmap: 2024-08-18T21:11:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:11.497779+0000 2024-08-18T21:11:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:11.497779+0000 2024-08-18T21:11:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:11.497 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:11.497 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:11.497 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:11.497 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 1 Processor -- start 2024-08-18T21:11:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 1 -- start start 2024-08-18T21:11:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 10 monclient: init 2024-08-18T21:11:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 10 monclient: _add_conns ranks=[0,1,6,2,8,4,9,10,7,3,5] 2024-08-18T21:11:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f388806c950 addr v1:172.21.15.5:6789/0 2024-08-18T21:11:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f38880a1b60 addr v1:172.21.15.157:6789/0 2024-08-18T21:11:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f388806d440 0x7f38880a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 10 monclient(hunting): picked mon.noname-d con 0x7f388806d440 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f38877fe640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7f388806c950 legacy=0x7f388806cd30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:11:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38880a03e0 con 0x7f388806c950 2024-08-18T21:11:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38880a11a0 con 0x7f38880a1b60 2024-08-18T21:11:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f388809fdd0 con 0x7f388806d440 2024-08-18T21:11:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f388dab2640 10 monclient(hunting): authenticate will time out at 1438.511365s 2024-08-18T21:11:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f388806d440 0x7f38880a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f388806d440 0x7f38880a4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:37508/0 (socket says 172.21.15.5:37508) 2024-08-18T21:11:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 1 -- 172.21.15.5:0/1660105864 learned_addr learned my addr 172.21.15.5:0/1660105864 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 10 monclient(hunting): get_auth_request con 0x7f388806d440 auth_method 0 2024-08-18T21:11:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 10 monclient(hunting): handle_auth_done global_id 85119 payload 274 2024-08-18T21:11:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 1 -- 172.21.15.5:0/1660105864 >> v1:172.21.15.157:6789/0 conn(0x7f38880a1b60 legacy=0x7f388813cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 1 -- 172.21.15.5:0/1660105864 >> v1:172.21.15.5:6789/0 conn(0x7f388806c950 legacy=0x7f388806cd30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 10 monclient: _finish_hunting 0 2024-08-18T21:11:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 1 monclient: found mon.noname-d 2024-08-18T21:11:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:11:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.492+0000 7f3887fff640 1 -- 172.21.15.5:0/1660105864 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38880a0ec0 con 0x7f388806d440 2024-08-18T21:11:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.496+0000 7f3887fff640 1 -- 172.21.15.5:0/1660105864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f388806d440 msgr2=0x7f38880a4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.496+0000 7f3887fff640 1 --2- 172.21.15.5:0/1660105864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f388806d440 0x7f38880a4b80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3880009e80 tx=0x7f388001c8e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=931f318bfd6158ec server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f38867fc640 1 -- 172.21.15.5:0/1660105864 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38800091b0 con 0x7f388806d440 2024-08-18T21:11:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f38867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f38867fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:11:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f38867fc640 10 monclient: dump: 2024-08-18T21:11:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.505 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f38867fc640 10 monclient: _finish_auth 0 2024-08-18T21:11:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f38867fc640 10 monclient: _check_auth_tickets 2024-08-18T21:11:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f38867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f38867fc640 1 -- 172.21.15.5:0/1660105864 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38800a5b50 con 0x7f388806d440 2024-08-18T21:11:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 5 monclient: authenticate success, global_id 85119 2024-08-18T21:11:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f38867fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f38867fc640 1 -- 172.21.15.5:0/1660105864 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38800a5d00 con 0x7f388806d440 2024-08-18T21:11:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f38867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 4 set_mon_vals no callback set 2024-08-18T21:11:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f38867fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f38867fc640 10 monclient: dump: 2024-08-18T21:11:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.507 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 10 monclient: shutdown 2024-08-18T21:11:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 1 -- 172.21.15.5:0/1660105864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f388806d440 msgr2=0x7f38880a4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 1 --2- 172.21.15.5:0/1660105864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f388806d440 0x7f38880a4b80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3880009e80 tx=0x7f388001c8e0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 1 -- 172.21.15.5:0/1660105864 shutdown_connections 2024-08-18T21:11:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 1 --2- 172.21.15.5:0/1660105864 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f388806d440 0x7f38880a4b80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 1 -- 172.21.15.5:0/1660105864 >> 172.21.15.5:0/1660105864 conn(0x7f38880688d0 msgr2=0x7f3888068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 1 -- 172.21.15.5:0/1660105864 shutdown_connections 2024-08-18T21:11:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 1 -- 172.21.15.5:0/1660105864 wait complete. 2024-08-18T21:11:11.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 10 monclient: build_initial_monmap 2024-08-18T21:11:11.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 10 monclient: monmap: 2024-08-18T21:11:11.512 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:11.512 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:11.512 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:11.512 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:11.512 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:11.513 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 1 Processor -- start 2024-08-18T21:11:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 1 -- start start 2024-08-18T21:11:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 10 monclient: init 2024-08-18T21:11:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 10 monclient: _add_conns ranks=[2,5,0,3,7,6,8,1,4] 2024-08-18T21:11:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f388806c950 0x7f3888126cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 10 monclient(hunting): picked mon.noname-b con 0x7f388806c950 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:11:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f388806d440 0x7f388813eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 10 monclient(hunting): picked mon.noname-h con 0x7f388806d440 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38881246b0 0x7f3888124b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 10 monclient(hunting): picked mon.noname-a con 0x7f38881246b0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:11:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3888142de0 con 0x7f38881246b0 2024-08-18T21:11:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f3888142c60 con 0x7f388806c950 2024-08-18T21:11:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f3888142f60 con 0x7f388806d440 2024-08-18T21:11:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f38877fe640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f388806c950 msgr2=0x7f3888126cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3301/0 2024-08-18T21:11:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f38877fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f388806c950 0x7f3888126cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f388dab2640 10 monclient(hunting): authenticate will time out at 1438.519186s 2024-08-18T21:11:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f3887fff640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38881246b0 msgr2=0x7f3888124b10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:11:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f3887fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38881246b0 0x7f3888124b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f3886ffd640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f388806d440 0x7f388813eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f3886ffd640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f388806d440 0x7f388813eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:60360/0 (socket says 172.21.15.5:60360) 2024-08-18T21:11:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f3886ffd640 1 -- 172.21.15.5:0/3676389101 learned_addr learned my addr 172.21.15.5:0/3676389101 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f3886ffd640 10 monclient(hunting): get_auth_request con 0x7f388806d440 auth_method 0 2024-08-18T21:11:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f3886ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f3886ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f3886ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f3886ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f3886ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.500+0000 7f3886ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f3886ffd640 10 monclient(hunting): handle_auth_done global_id 94685 payload 824 2024-08-18T21:11:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f3886ffd640 1 -- 172.21.15.5:0/3676389101 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f388806c950 msgr2=0x7f3888126cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:11:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f3886ffd640 1 --2- 172.21.15.5:0/3676389101 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f388806c950 0x7f3888126cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f3886ffd640 1 -- 172.21.15.5:0/3676389101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38881246b0 msgr2=0x7f3888124b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:11:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f3886ffd640 1 --2- 172.21.15.5:0/3676389101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38881246b0 0x7f3888124b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f3886ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:11:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f3886ffd640 1 monclient: found mon.noname-h 2024-08-18T21:11:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f3886ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f3886ffd640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:11:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f3886ffd640 1 -- 172.21.15.5:0/3676389101 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3888127640 con 0x7f388806d440 2024-08-18T21:11:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f3886ffd640 1 -- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f388806d440 msgr2=0x7f388813eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f3886ffd640 1 --2- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f388806d440 0x7f388813eb30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f387c00b440 tx=0x7f387c00b900 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f386ffff640 1 -- 172.21.15.5:0/3676389101 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f387c015020 con 0x7f388806d440 2024-08-18T21:11:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f386ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f386ffff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:11:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f386ffff640 10 monclient: dump: 2024-08-18T21:11:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.518 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f386ffff640 10 monclient: _finish_auth 0 2024-08-18T21:11:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f386ffff640 10 monclient: _check_auth_tickets 2024-08-18T21:11:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f386ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f386ffff640 1 -- 172.21.15.5:0/3676389101 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387c011d10 con 0x7f388806d440 2024-08-18T21:11:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f388dab2640 5 monclient: authenticate success, global_id 94685 2024-08-18T21:11:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f388dab2640 10 monclient: _renew_subs 2024-08-18T21:11:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f388dab2640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:11:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f388dab2640 1 -- 172.21.15.5:0/3676389101 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38881284b0 con 0x7f388806d440 2024-08-18T21:11:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f386ffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f386ffff640 1 -- 172.21.15.5:0/3676389101 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f387c010850 con 0x7f388806d440 2024-08-18T21:11:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f386ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f386ffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:11:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f386ffff640 10 monclient: dump: 2024-08-18T21:11:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.521 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f3885ffb640 4 set_mon_vals no callback set 2024-08-18T21:11:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f388dab2640 10 monclient: _renew_subs 2024-08-18T21:11:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f388dab2640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:11:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.504+0000 7f388dab2640 1 -- 172.21.15.5:0/3676389101 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f388813fce0 con 0x7f388806d440 2024-08-18T21:11:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f388dab2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f388dab2640 1 --2- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f38880a1b60 0x7f388802e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f388dab2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f388dab2640 1 -- 172.21.15.5:0/3676389101 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f3888051140 con 0x7f38880a1b60 2024-08-18T21:11:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f38877fe640 1 --2- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f38880a1b60 0x7f388802e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f38877fe640 10 monclient: get_auth_request con 0x7f38880a1b60 auth_method 0 2024-08-18T21:11:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f38877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f38877fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f38877fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f38877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f38877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f38877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f386ffff640 1 -- 172.21.15.5:0/3676389101 <== mon.5 v2:172.21.15.157:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f387c018020 con 0x7f388806d440 2024-08-18T21:11:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f38877fe640 10 monclient(hunting): handle_auth_done global_id 94694 payload 824 2024-08-18T21:11:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f38877fe640 1 -- 172.21.15.5:0/3676389101 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f388806dbf0 con 0x7f38880a1b60 2024-08-18T21:11:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f386ffff640 1 --2- 172.21.15.5:0/3676389101 >> v2:172.21.15.157:6812/631023601 conn(0x7f387403bdc0 0x7f387403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f386ffff640 1 -- 172.21.15.5:0/3676389101 <== mon.5 v2:172.21.15.157:3302/0 5 ==== osd_map(213..213 src has 22..213) ==== 3898+0+0 (secure 0 0 0) 0x7f387c04e500 con 0x7f388806d440 2024-08-18T21:11:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f3887fff640 1 --2- 172.21.15.5:0/3676389101 >> v2:172.21.15.157:6812/631023601 conn(0x7f387403bdc0 0x7f387403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.508+0000 7f3887fff640 10 monclient: get_auth_request con 0x7f387403bdc0 auth_method 0 2024-08-18T21:11:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.512+0000 7f38877fe640 1 -- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f38880a1b60 msgr2=0x7f388802e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.512+0000 7f38877fe640 1 --2- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f38880a1b60 0x7f388802e350 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3878003990 tx=0x7f387800b810 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.512+0000 7f386ffff640 1 -- 172.21.15.5:0/3676389101 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3878016070 con 0x7f38880a1b60 2024-08-18T21:11:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.512+0000 7f386ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.512+0000 7f386ffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:11:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.512+0000 7f386ffff640 10 monclient: dump: 2024-08-18T21:11:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.527 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.512+0000 7f3887fff640 1 --2- 172.21.15.5:0/3676389101 >> v2:172.21.15.157:6812/631023601 conn(0x7f387403bdc0 0x7f387403e280 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f38880a6d90 tx=0x7f38800a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.512+0000 7f386ffff640 1 -- 172.21.15.5:0/3676389101 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3878005070 con 0x7f38880a1b60 2024-08-18T21:11:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.512+0000 7f386ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.512+0000 7f386ffff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.512+0000 7f386ffff640 1 -- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f38880a1b60 msgr2=0x7f388802e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.512+0000 7f386ffff640 1 --2- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f38880a1b60 0x7f388802e350 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3878003990 tx=0x7f387800b810 comp rx=0 tx=0).stop 2024-08-18T21:11:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.512+0000 7f386ffff640 1 -- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f38880a1b60 msgr2=0x7f388802e350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.512+0000 7f386ffff640 1 --2- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f38880a1b60 0x7f388802e350 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3878003990 tx=0x7f387800b810 comp rx=0 tx=0).stop 2024-08-18T21:11:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.516+0000 7f388dab2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.516+0000 7f388dab2640 1 --2- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3888125050 0x7f3888063b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.516+0000 7f388dab2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.516+0000 7f388dab2640 1 -- 172.21.15.5:0/3676389101 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f38880a4b80 con 0x7f3888125050 2024-08-18T21:11:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.516+0000 7f38877fe640 1 --2- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3888125050 0x7f3888063b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.516+0000 7f38877fe640 10 monclient: get_auth_request con 0x7f3888125050 auth_method 0 2024-08-18T21:11:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.516+0000 7f38877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.516+0000 7f38877fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.516+0000 7f38877fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.516+0000 7f38877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.516+0000 7f38877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.516+0000 7f38877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.520+0000 7f38877fe640 10 monclient(hunting): handle_auth_done global_id 94703 payload 824 2024-08-18T21:11:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.520+0000 7f38877fe640 1 -- 172.21.15.5:0/3676389101 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3888120c40 con 0x7f3888125050 2024-08-18T21:11:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.520+0000 7f38877fe640 1 -- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3888125050 msgr2=0x7f3888063b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.520+0000 7f38877fe640 1 --2- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3888125050 0x7f3888063b30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3878003990 tx=0x7f3878003800 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.520+0000 7f386ffff640 1 -- 172.21.15.5:0/3676389101 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3878016030 con 0x7f3888125050 2024-08-18T21:11:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.520+0000 7f386ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.520+0000 7f386ffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:11:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.520+0000 7f386ffff640 10 monclient: dump: 2024-08-18T21:11:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.530 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.520+0000 7f386ffff640 1 -- 172.21.15.5:0/3676389101 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9370 (secure 0 0 0) 0x7f3878021450 con 0x7f3888125050 2024-08-18T21:11:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.520+0000 7f386ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.520+0000 7f386ffff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.520+0000 7f386ffff640 1 -- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3888125050 msgr2=0x7f3888063b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.520+0000 7f386ffff640 1 --2- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3888125050 0x7f3888063b30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3878003990 tx=0x7f3878003800 comp rx=0 tx=0).stop 2024-08-18T21:11:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.520+0000 7f386ffff640 1 -- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3888125050 msgr2=0x7f3888063b30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.520+0000 7f386ffff640 1 --2- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3888125050 0x7f3888063b30 secure :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3878003990 tx=0x7f3878003800 comp rx=0 tx=0).stop 2024-08-18T21:11:11.531 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 158, 2024-08-18T21:11:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 99558, 2024-08-18T21:11:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:11:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:11:11.533 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:11.533 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:11.533 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:11.533 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:11.533 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:11.533 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:11.533 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:11.533 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:11.533 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:11.533 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:11.533 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:11.533 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:11.533 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:11.533 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:11.534 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.534 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:11.534 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:11.534 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:11.534 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:11.534 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:11.534 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:11.534 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:11.534 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:11.534 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:11.534 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:11.534 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:11.534 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:11.534 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:11.535 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.535 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:11.535 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:11.535 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:11.535 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:11.535 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:11.535 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:11.535 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:11.535 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:11.535 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:11.535 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:11.535 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:11.535 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:11.536 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:11.536 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:11.536 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:11.536 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:11.536 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:11.536 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:11.536 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:11.536 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:11.536 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:11.536 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:11.536 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:11.536 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:11.536 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:11.536 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:11.537 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:11.537 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:11.537 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.537 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:11.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.537 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:11.537 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:11.537 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:11.537 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.537 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.537 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.537 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.537 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:11.538 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.538 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.538 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:11.538 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.538 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.538 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.538 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:11.538 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:11.538 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.538 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.538 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.539 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:11.539 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:11.539 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.539 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.539 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.539 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:11.539 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.539 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.539 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:11.540 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.540 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.540 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.540 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:11.540 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:11.540 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.540 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.540 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:11.540 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:11.540 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.540 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.541 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.541 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:11.541 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.541 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.541 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:11.541 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.541 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.541 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.541 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:11.541 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:11.542 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.542 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.542 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.542 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.542 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:11.542 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:11.542 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.542 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.542 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.542 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.542 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:11.542 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.543 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.543 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.543 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:11.543 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.543 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.543 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.543 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:11.543 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:11.543 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.543 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.543 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.543 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.544 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:11.544 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:11.544 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.544 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.544 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.544 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.544 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:11.544 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.544 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.544 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.544 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.544 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:11.544 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.544 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.545 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.545 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:11.545 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:11.545 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.545 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.545 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.545 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:11.545 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:11.545 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.545 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.545 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.546 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.546 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:11.546 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.546 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.546 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.546 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:11.546 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.546 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.546 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.546 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:11.546 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:11.546 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.547 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.547 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.547 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:11.547 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:11.547 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.547 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.547 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.547 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.547 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:11.547 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.547 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.548 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.548 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:11.548 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.548 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.548 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.548 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:11.548 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:11.548 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.548 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.548 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.548 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:11.548 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:11.549 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.549 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.549 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.549 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.549 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:11.549 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.549 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.549 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.549 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:11.549 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.549 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.549 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.550 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:11.550 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:11.550 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.550 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.550 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.550 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.550 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:11.550 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:11.550 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:11.550 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:11.550 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.550 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:11.551 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:11.551 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.551 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.551 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:11.551 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:11.551 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:11.551 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.551 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.551 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:11.551 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:11.551 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:11.551 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:11.551 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:11.552 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.552 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.552 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:11.552 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:11.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.552 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:11.552 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:11.552 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:11.552 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.552 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.552 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:11.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.552 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:11.553 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:11.553 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:11:11.553 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.553 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:11.553 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:11:11.553 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:11.553 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:11.553 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:11.553 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:11.553 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:11.553 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:11.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:11.553 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:11.553 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.524+0000 7f388dab2640 1 -- 172.21.15.5:0/3676389101 >> v2:172.21.15.157:6812/631023601 conn(0x7f387403bdc0 msgr2=0x7f387403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.524+0000 7f388dab2640 1 --2- 172.21.15.5:0/3676389101 >> v2:172.21.15.157:6812/631023601 conn(0x7f387403bdc0 0x7f387403e280 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f38880a6d90 tx=0x7f38800a7070 comp rx=0 tx=0).stop 2024-08-18T21:11:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.524+0000 7f388dab2640 10 monclient: shutdown 2024-08-18T21:11:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.524+0000 7f388dab2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.524+0000 7f388dab2640 1 -- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f388806d440 msgr2=0x7f388813eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.524+0000 7f388dab2640 1 --2- 172.21.15.5:0/3676389101 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f388806d440 0x7f388813eb30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f387c00b440 tx=0x7f387c00b900 comp rx=0 tx=0).stop 2024-08-18T21:11:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.524+0000 7f3887fff640 1 -- 172.21.15.5:0/3676389101 reap_dead start 2024-08-18T21:11:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.524+0000 7f3887fff640 1 -- 172.21.15.5:0/3676389101 reap_dead start 2024-08-18T21:11:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.524+0000 7f388dab2640 1 -- 172.21.15.5:0/3676389101 shutdown_connections 2024-08-18T21:11:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.524+0000 7f388dab2640 1 -- 172.21.15.5:0/3676389101 >> 172.21.15.5:0/3676389101 conn(0x7f38880688d0 msgr2=0x7f3888072070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.524+0000 7f388dab2640 1 -- 172.21.15.5:0/3676389101 shutdown_connections 2024-08-18T21:11:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.524+0000 7f388dab2640 1 -- 172.21.15.5:0/3676389101 wait complete. 2024-08-18T21:11:11.556 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:11:11.556 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon i 2024-08-18T21:11:11.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:11:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 10 monclient: get_monmap_and_config 2024-08-18T21:11:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 10 monclient: build_initial_monmap 2024-08-18T21:11:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 10 monclient: monmap: 2024-08-18T21:11:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:11.669425+0000 2024-08-18T21:11:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:11.669425+0000 2024-08-18T21:11:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:11.668 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 1 Processor -- start 2024-08-18T21:11:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 1 -- start start 2024-08-18T21:11:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 10 monclient: init 2024-08-18T21:11:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 10 monclient: _add_conns ranks=[4,0,3,10,5,2,1,7,8,6,9] 2024-08-18T21:11:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 0x7f11e80a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 10 monclient(hunting): picked mon.noname-c con 0x7f11e80a6bd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f11e809f080 addr v1:172.21.15.5:6789/0 2024-08-18T21:11:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11e80a74f0 0x7f11e813a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 10 monclient(hunting): picked mon.noname-g con 0x7f11e80a74f0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11e80a7fb0 con 0x7f11e809f080 2024-08-18T21:11:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f11e809e4c0 con 0x7f11e80a74f0 2024-08-18T21:11:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f11e806f930 con 0x7f11e80a6bd0 2024-08-18T21:11:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eecbb640 10 monclient(hunting): authenticate will time out at 1438.682555s 2024-08-18T21:11:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11e7fff640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7f11e809f080 legacy=0x7f11e8139990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:11:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eca57640 1 -- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 msgr2=0x7f11e80a6fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11eca57640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 0x7f11e80a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11e80a74f0 0x7f11e813a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11e80a74f0 0x7f11e813a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:44806/0 (socket says 172.21.15.5:44806) 2024-08-18T21:11:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 1 -- 172.21.15.5:0/4191331169 learned_addr learned my addr 172.21.15.5:0/4191331169 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 10 monclient(hunting): get_auth_request con 0x7f11e80a74f0 auth_method 0 2024-08-18T21:11:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 10 monclient(hunting): handle_auth_done global_id 84963 payload 274 2024-08-18T21:11:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 1 -- 172.21.15.5:0/4191331169 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 msgr2=0x7f11e80a6fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 1 --2- 172.21.15.5:0/4191331169 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 0x7f11e80a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 1 -- 172.21.15.5:0/4191331169 >> v1:172.21.15.5:6789/0 conn(0x7f11e809f080 legacy=0x7f11e8139990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 10 monclient: _finish_hunting 0 2024-08-18T21:11:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 1 monclient: found mon.noname-g 2024-08-18T21:11:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:11.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:11:11.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.664+0000 7f11ed258640 1 -- 172.21.15.5:0/4191331169 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e809de70 con 0x7f11e80a74f0 2024-08-18T21:11:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11ed258640 1 -- 172.21.15.5:0/4191331169 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11e80a74f0 msgr2=0x7f11e813a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11ed258640 1 --2- 172.21.15.5:0/4191331169 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11e80a74f0 0x7f11e813a0a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f11e00098a0 tx=0x7f11e001cec0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=270a369202e1278c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11e77fe640 1 -- 172.21.15.5:0/4191331169 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f11e00b0070 con 0x7f11e80a74f0 2024-08-18T21:11:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11e77fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:11:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11e77fe640 10 monclient: dump: 2024-08-18T21:11:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.679 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11e77fe640 10 monclient: _finish_auth 0 2024-08-18T21:11:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11e77fe640 10 monclient: _check_auth_tickets 2024-08-18T21:11:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11e77fe640 1 -- 172.21.15.5:0/4191331169 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e00aa810 con 0x7f11e80a74f0 2024-08-18T21:11:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 5 monclient: authenticate success, global_id 84963 2024-08-18T21:11:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11e77fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11e77fe640 1 -- 172.21.15.5:0/4191331169 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f11e00a9300 con 0x7f11e80a74f0 2024-08-18T21:11:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 4 set_mon_vals no callback set 2024-08-18T21:11:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11e77fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:11:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11e77fe640 10 monclient: dump: 2024-08-18T21:11:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:11.681 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 10 monclient: shutdown 2024-08-18T21:11:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 1 -- 172.21.15.5:0/4191331169 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11e80a74f0 msgr2=0x7f11e813a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 1 --2- 172.21.15.5:0/4191331169 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11e80a74f0 0x7f11e813a0a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f11e00098a0 tx=0x7f11e001cec0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 1 -- 172.21.15.5:0/4191331169 shutdown_connections 2024-08-18T21:11:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 1 --2- 172.21.15.5:0/4191331169 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11e80a74f0 0x7f11e813a0a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 1 --2- 172.21.15.5:0/4191331169 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 0x7f11e80a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 1 -- 172.21.15.5:0/4191331169 >> 172.21.15.5:0/4191331169 conn(0x7f11e8068700 msgr2=0x7f11e8068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 1 -- 172.21.15.5:0/4191331169 shutdown_connections 2024-08-18T21:11:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 1 -- 172.21.15.5:0/4191331169 wait complete. 2024-08-18T21:11:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 10 monclient: build_initial_monmap 2024-08-18T21:11:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 10 monclient: monmap: 2024-08-18T21:11:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:11.684 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 1 Processor -- start 2024-08-18T21:11:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 1 -- start start 2024-08-18T21:11:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 10 monclient: init 2024-08-18T21:11:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 10 monclient: _add_conns ranks=[0,4,8,7,6,1,3,2,5] 2024-08-18T21:11:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e809f080 0x7f11e8138d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 10 monclient(hunting): picked mon.noname-a con 0x7f11e809f080 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:11:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 0x7f11e8139290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 10 monclient(hunting): picked mon.noname-c con 0x7f11e80a6bd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f11e80a74f0 0x7f11e813e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 10 monclient(hunting): picked mon.noname-e con 0x7f11e80a74f0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f11e813a5e0 con 0x7f11e809f080 2024-08-18T21:11:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f11e80a89f0 con 0x7f11e80a6bd0 2024-08-18T21:11:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f11e813a760 con 0x7f11e80a74f0 2024-08-18T21:11:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eecbb640 10 monclient(hunting): authenticate will time out at 1438.690932s 2024-08-18T21:11:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11e7fff640 1 -- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 msgr2=0x7f11e8139290 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11ed258640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f11e80a74f0 msgr2=0x7f11e813e740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:11:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11e7fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 0x7f11e8139290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eca57640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e809f080 msgr2=0x7f11e8138d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:11:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11ed258640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f11e80a74f0 0x7f11e813e740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.672+0000 7f11eca57640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e809f080 0x7f11e8138d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:11.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.876+0000 7f11ed258640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f11e80a74f0 msgr2=0x7f11e813e740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:11:11.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.876+0000 7f11e7fff640 1 -- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 msgr2=0x7f11e8139290 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:11.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.876+0000 7f11ed258640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f11e80a74f0 0x7f11e813e740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:11:11.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.876+0000 7f11e7fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 0x7f11e8139290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:11:11.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.876+0000 7f11eca57640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e809f080 msgr2=0x7f11e8138d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:11:11.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:11.876+0000 7f11eca57640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e809f080 0x7f11e8138d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:11:12.158 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:12.158 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30879]: starting. 2024-08-18T21:11:12.158 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30879]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30843 2024-08-18T21:11:12.159 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30879]: shutting down. 2024-08-18T21:11:12.162 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:12.162 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:12.162 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:11:12.166 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:11:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:12.280+0000 7f11ed258640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f11e80a74f0 msgr2=0x7f11e813e740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:11:12.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:12.280+0000 7f11eca57640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e809f080 msgr2=0x7f11e8138d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:11:12.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:12.280+0000 7f11e7fff640 1 -- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 msgr2=0x7f11e8139290 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:12.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:12.280+0000 7f11eca57640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e809f080 0x7f11e8138d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:11:12.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:12.280+0000 7f11e7fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 0x7f11e8139290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:11:12.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:12.280+0000 7f11ed258640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f11e80a74f0 0x7f11e813e740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:11:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:13.084+0000 7f11eca57640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e809f080 msgr2=0x7f11e8138d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:11:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:13.084+0000 7f11e7fff640 1 -- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 msgr2=0x7f11e8139290 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3302/0 2024-08-18T21:11:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:13.084+0000 7f11ed258640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f11e80a74f0 msgr2=0x7f11e813e740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3304/0 2024-08-18T21:11:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:13.084+0000 7f11eca57640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e809f080 0x7f11e8138d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:11:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:13.084+0000 7f11e7fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 0x7f11e8139290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:11:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:13.084+0000 7f11ed258640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f11e80a74f0 0x7f11e813e740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:11:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 10 monclient(hunting): tick 2024-08-18T21:11:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:11:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 1 monclient(hunting): continuing hunt 2024-08-18T21:11:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:11:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 1 -- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f11e80a74f0 msgr2=0x7f11e813e740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:11:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f11e80a74f0 0x7f11e813e740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 1 -- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 msgr2=0x7f11e8139290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:11:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f11e80a6bd0 0x7f11e8139290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e809f080 msgr2=0x7f11e8138d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:11:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e809f080 0x7f11e8138d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 10 monclient: _add_conns ranks=[7,3,1,5,2,6] 2024-08-18T21:11:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11c8003820 0x7f11c8005c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 10 monclient(hunting): picked mon.noname-i con 0x7f11c8003820 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11c8006210 0x7f11c80086a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 10 monclient(hunting): picked mon.noname-g con 0x7f11c8006210 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11c8008d40 0x7f11c800b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 10 monclient(hunting): picked mon.noname-f con 0x7f11c8008d40 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:11:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f11e813a5e0 con 0x7f11c8008d40 2024-08-18T21:11:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f11e80a89f0 con 0x7f11c8006210 2024-08-18T21:11:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f11e813a760 con 0x7f11c8003820 2024-08-18T21:11:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11cffff640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11eca57640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11c8003820 0x7f11c8005c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11ed258640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11c8008d40 0x7f11c800b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11e7fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11c8006210 0x7f11c80086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11eca57640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11c8003820 0x7f11c8005c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:43676/0 (socket says 172.21.15.5:43676) 2024-08-18T21:11:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11eca57640 1 -- 172.21.15.5:0/764308710 learned_addr learned my addr 172.21.15.5:0/764308710 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11eca57640 10 monclient(hunting): get_auth_request con 0x7f11c8003820 auth_method 0 2024-08-18T21:11:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11eca57640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11eca57640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11eca57640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11ed258640 10 monclient(hunting): get_auth_request con 0x7f11c8008d40 auth_method 0 2024-08-18T21:11:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11ed258640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11ed258640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.672+0000 7f11ed258640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11e7fff640 10 monclient(hunting): get_auth_request con 0x7f11c8006210 auth_method 0 2024-08-18T21:11:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11e7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11eca57640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11eca57640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11eca57640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11ed258640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11ed258640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11ed258640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11eca57640 10 monclient(hunting): handle_auth_done global_id 6343 payload 824 2024-08-18T21:11:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11eca57640 1 -- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11c8006210 msgr2=0x7f11c80086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11eca57640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11c8006210 0x7f11c80086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11eca57640 1 -- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11c8008d40 msgr2=0x7f11c800b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11eca57640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11c8008d40 0x7f11c800b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11eca57640 10 monclient: _finish_hunting 0 2024-08-18T21:11:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11eca57640 1 monclient: found mon.noname-i 2024-08-18T21:11:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11eca57640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11eca57640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:11:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11eca57640 1 -- 172.21.15.5:0/764308710 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c800bac0 con 0x7f11c8003820 2024-08-18T21:11:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11ed258640 1 -- 172.21.15.5:0/764308710 reap_dead start 2024-08-18T21:11:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11eca57640 1 -- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11c8003820 msgr2=0x7f11c8005c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.676+0000 7f11eca57640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11c8003820 0x7f11c8005c10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f11d800cb70 tx=0x7f11d800a4b0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e57fa640 1 -- 172.21.15.5:0/764308710 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f11d800add0 con 0x7f11c8003820 2024-08-18T21:11:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e57fa640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:11:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e57fa640 10 monclient: dump: 2024-08-18T21:11:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:14.688 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e57fa640 10 monclient: _finish_auth 0 2024-08-18T21:11:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e57fa640 10 monclient: _check_auth_tickets 2024-08-18T21:11:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e57fa640 1 -- 172.21.15.5:0/764308710 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11d8016070 con 0x7f11c8003820 2024-08-18T21:11:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e57fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e57fa640 1 -- 172.21.15.5:0/764308710 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f11d8011d00 con 0x7f11c8003820 2024-08-18T21:11:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e57fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:11:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e6ffd640 4 set_mon_vals no callback set 2024-08-18T21:11:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e57fa640 10 monclient: dump: 2024-08-18T21:11:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:14.690 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11eecbb640 5 monclient: authenticate success, global_id 6343 2024-08-18T21:11:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11eecbb640 10 monclient: _renew_subs 2024-08-18T21:11:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11eecbb640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:11:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11eecbb640 1 -- 172.21.15.5:0/764308710 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e8123770 con 0x7f11c8003820 2024-08-18T21:11:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11eecbb640 10 monclient: _renew_subs 2024-08-18T21:11:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11eecbb640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:11:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11eecbb640 1 -- 172.21.15.5:0/764308710 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e80a6110 con 0x7f11c8003820 2024-08-18T21:11:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11eecbb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11eecbb640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8138d20 0x7f11e8139100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11eecbb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11eecbb640 1 -- 172.21.15.5:0/764308710 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f11e8051140 con 0x7f11e8138d20 2024-08-18T21:11:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e7fff640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8138d20 0x7f11e8139100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e7fff640 10 monclient: get_auth_request con 0x7f11e8138d20 auth_method 0 2024-08-18T21:11:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11eca57640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11c8003820 0x7f11c8005c10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f11d800cb70 tx=0x7f11d800a4b0 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7f11d8011420 mgrmap(e 5) 2024-08-18T21:11:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e57fa640 1 -- 172.21.15.5:0/764308710 <== mon.7 v2:172.21.15.157:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f11d8011420 con 0x7f11c8003820 2024-08-18T21:11:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e7fff640 10 monclient(hunting): handle_auth_done global_id 6352 payload 824 2024-08-18T21:11:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e7fff640 1 -- 172.21.15.5:0/764308710 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11e80a6fb0 con 0x7f11e8138d20 2024-08-18T21:11:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11e57fa640 1 --2- 172.21.15.5:0/764308710 >> v2:172.21.15.157:6812/631023601 conn(0x7f11d403bd30 0x7f11d403e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11ed258640 1 --2- 172.21.15.5:0/764308710 >> v2:172.21.15.157:6812/631023601 conn(0x7f11d403bd30 0x7f11d403e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.680+0000 7f11ed258640 10 monclient: get_auth_request con 0x7f11d403bd30 auth_method 0 2024-08-18T21:11:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.684+0000 7f11e7fff640 1 -- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8138d20 msgr2=0x7f11e8139100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.684+0000 7f11e7fff640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8138d20 0x7f11e8139100 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f11e813e620 tx=0x7f11dc009b80 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.684+0000 7f11e57fa640 1 -- 172.21.15.5:0/764308710 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f11dc016070 con 0x7f11e8138d20 2024-08-18T21:11:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.684+0000 7f11e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.684+0000 7f11e57fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:11:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.684+0000 7f11e57fa640 10 monclient: dump: 2024-08-18T21:11:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:14.695 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.684+0000 7f11ed258640 1 --2- 172.21.15.5:0/764308710 >> v2:172.21.15.157:6812/631023601 conn(0x7f11d403bd30 0x7f11d403e1f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f11e00098a0 tx=0x7f11e0004740 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.684+0000 7f11e57fa640 1 -- 172.21.15.5:0/764308710 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f11dc00e980 con 0x7f11e8138d20 2024-08-18T21:11:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.684+0000 7f11e57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.684+0000 7f11e57fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.684+0000 7f11e57fa640 1 -- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8138d20 msgr2=0x7f11e8139100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.684+0000 7f11e57fa640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8138d20 0x7f11e8139100 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f11e813e620 tx=0x7f11dc009b80 comp rx=0 tx=0).stop 2024-08-18T21:11:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.684+0000 7f11e57fa640 1 -- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8138d20 msgr2=0x7f11e8139100 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.684+0000 7f11e57fa640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8138d20 0x7f11e8139100 secure :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f11e813e620 tx=0x7f11dc009b80 comp rx=0 tx=0).stop 2024-08-18T21:11:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.696+0000 7f11eecbb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.696+0000 7f11eecbb640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8139640 0x7f11e813abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.696+0000 7f11eecbb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.696+0000 7f11eecbb640 1 -- 172.21.15.5:0/764308710 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f11e80746d0 con 0x7f11e8139640 2024-08-18T21:11:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.696+0000 7f11e7fff640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8139640 0x7f11e813abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.696+0000 7f11e7fff640 10 monclient: get_auth_request con 0x7f11e8139640 auth_method 0 2024-08-18T21:11:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.696+0000 7f11e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.696+0000 7f11e7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.696+0000 7f11e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.696+0000 7f11e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.696+0000 7f11e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.696+0000 7f11e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.696+0000 7f11e7fff640 10 monclient(hunting): handle_auth_done global_id 6361 payload 824 2024-08-18T21:11:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.696+0000 7f11e7fff640 1 -- 172.21.15.5:0/764308710 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f11e8123be0 con 0x7f11e8139640 2024-08-18T21:11:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.696+0000 7f11e7fff640 1 -- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8139640 msgr2=0x7f11e813abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.696+0000 7f11e7fff640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8139640 0x7f11e813abb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f11dc018000 tx=0x7f11dc005a90 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11e57fa640 1 -- 172.21.15.5:0/764308710 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f11dc016040 con 0x7f11e8139640 2024-08-18T21:11:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11e57fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:11:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11e57fa640 10 monclient: dump: 2024-08-18T21:11:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:14.705 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11e57fa640 1 -- 172.21.15.5:0/764308710 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9371 (secure 0 0 0) 0x7f11dc01d2b0 con 0x7f11e8139640 2024-08-18T21:11:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11e57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11e57fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11e57fa640 1 -- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8139640 msgr2=0x7f11e813abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11e57fa640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8139640 0x7f11e813abb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f11dc018000 tx=0x7f11dc005a90 comp rx=0 tx=0).stop 2024-08-18T21:11:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11e57fa640 1 -- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8139640 msgr2=0x7f11e813abb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11e57fa640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8139640 0x7f11e813abb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:14.706 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:14.706 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:14.706 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:14.706 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:14.706 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 158, 2024-08-18T21:11:14.706 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 483793, 2024-08-18T21:11:14.706 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:14.706 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:14.706 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:14.706 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:14.707 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:14.707 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-08-18T21:11:14.707 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:14.707 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:11:14.707 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:14.707 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:14.707 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:14.707 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:14.707 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:14.707 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:14.707 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:14.707 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:14.707 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:14.708 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:14.708 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:14.708 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:14.708 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:14.708 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:14.708 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:14.708 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:14.708 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:14.708 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:14.708 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:14.708 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:14.708 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:14.708 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:14.709 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:14.709 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:14.709 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:14.709 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:14.709 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:14.709 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:14.709 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:14.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.709 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:14.710 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:14.710 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:14.710 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:14.710 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:14.710 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:14.710 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:14.710 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:14.710 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:14.710 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:14.710 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:14.710 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:14.711 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:14.711 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:14.711 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:14.711 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:14.711 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:14.711 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:14.711 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:14.711 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:14.711 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:14.711 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:14.711 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:14.711 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:14.711 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:14.712 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:14.712 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:14.712 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:14.712 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:14.712 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:14.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.712 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:14.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.712 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:14.712 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:14.712 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:14.712 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:14.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.713 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:14.713 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:14.713 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.713 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:14.713 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:14.713 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.713 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:14.713 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:14.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.713 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:14.714 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:14.714 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:14.714 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:14.714 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:14.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.714 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.714 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:14.714 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:14.715 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:14.715 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:14.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.715 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:14.715 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:14.715 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.715 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:14.715 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:14.715 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.715 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:14.715 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:14.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.716 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:14.716 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:14.716 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:14.716 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:14.716 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:14.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.716 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:14.716 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:14.716 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:14.716 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:14.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.717 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:14.717 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:14.717 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.717 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:14.717 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:14.717 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.717 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:14.717 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:14.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.717 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:14.717 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:14.717 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:14.718 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:14.718 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:14.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.718 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:14.718 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:14.718 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:14.718 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:14.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:14.719 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:14.719 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:14.719 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:14.719 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.719 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:14.720 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:14.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.720 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:14.720 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:14.720 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:14.720 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:14.720 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:14.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.720 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:14.720 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:14.720 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:14.720 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:14.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.721 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:14.721 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:14.721 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.721 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:14.721 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:14.721 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.721 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:14.721 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:14.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.721 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:14.721 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:14.721 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:14.722 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:14.722 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:14.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.722 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:14.722 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:14.722 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:14.722 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:14.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.722 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:14.722 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:14.722 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.723 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:14.723 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:14.723 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.723 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:14.723 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:14.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.723 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:14.723 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:14.723 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:14.723 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:14.723 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:14.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.724 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:14.724 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:14.724 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:14.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:14.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:14.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:14.724 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:14.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:14.724 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.724 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:14.725 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:14.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:14.725 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:14.725 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:14.725 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:14.725 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:14.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.726 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:14.726 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:14.726 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:14.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:14.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.726 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:14.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:14.726 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:14.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:14.727 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.727 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:14.727 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:14.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:14.727 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:14.727 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:14.727 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:14.727 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:14.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.728 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:14.728 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:14.728 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:14.728 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:14.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.728 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:14.728 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:14.728 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:14.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:14.729 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:14.729 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:14.729 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:14.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:14.729 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:14.729 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:14.729 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:14.729 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:14.729 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:14.729 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:14.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.730 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:14.730 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:14.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.730 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:14.730 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:14.730 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:14.730 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:14.730 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:14.730 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:11:14.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.730 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:14.730 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:14.731 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:11:14.731 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:14.731 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:14.731 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:14.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:14.731 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:14.731 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:14.731 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:11:14.731 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:14.731 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:14.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:14.731 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:14.731 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11eecbb640 1 -- 172.21.15.5:0/764308710 >> v2:172.21.15.157:6812/631023601 conn(0x7f11d403bd30 msgr2=0x7f11d403e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11eecbb640 1 --2- 172.21.15.5:0/764308710 >> v2:172.21.15.157:6812/631023601 conn(0x7f11d403bd30 0x7f11d403e1f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f11e00098a0 tx=0x7f11e0004740 comp rx=0 tx=0).stop 2024-08-18T21:11:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11eecbb640 10 monclient: shutdown 2024-08-18T21:11:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11eecbb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11eecbb640 1 -- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11c8003820 msgr2=0x7f11c8005c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11eecbb640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11c8003820 0x7f11c8005c10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f11d800cb70 tx=0x7f11d800a4b0 comp rx=0 tx=0).stop 2024-08-18T21:11:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11e57fa640 1 -- 172.21.15.5:0/764308710 <== mon.7 v2:172.21.15.157:3303/0 5 ==== osd_map(214..214 src has 22..214) ==== 3506+0+0 (unknown 0 0 0) 0x7f11d800e040 con 0x7f11c8003820 2024-08-18T21:11:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11eecbb640 1 -- 172.21.15.5:0/764308710 shutdown_connections 2024-08-18T21:11:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11eecbb640 1 --2- 172.21.15.5:0/764308710 >> v2:172.21.15.157:6812/631023601 conn(0x7f11d403bd30 0x7f11d403e1f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11eecbb640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11c8003820 0x7f11c8005c10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11eecbb640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8138d20 0x7f11e8139100 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11eecbb640 1 --2- 172.21.15.5:0/764308710 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f11e8139640 0x7f11e813abb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11eecbb640 1 -- 172.21.15.5:0/764308710 >> 172.21.15.5:0/764308710 conn(0x7f11e8068700 msgr2=0x7f11e80a4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11eecbb640 1 -- 172.21.15.5:0/764308710 shutdown_connections 2024-08-18T21:11:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:14.700+0000 7f11eecbb640 1 -- 172.21.15.5:0/764308710 wait complete. 2024-08-18T21:11:14.734 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:11:14.735 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-18T21:11:20.027 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30931]: starting. 2024-08-18T21:11:20.027 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30931]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30930 2024-08-18T21:11:20.028 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30931]: created object 0... 2024-08-18T21:11:20.028 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30931]: created object 25... 2024-08-18T21:11:20.028 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30931]: created object 49... 2024-08-18T21:11:20.028 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30931]: finishing. 2024-08-18T21:11:20.028 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[30931]: shutting down. 2024-08-18T21:11:20.842 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30932]: starting. 2024-08-18T21:11:20.843 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30932]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30930 2024-08-18T21:11:20.843 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[30932]: shutting down. 2024-08-18T21:11:23.075 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:23.075 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30967]: starting. 2024-08-18T21:11:23.075 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30967]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-30930 2024-08-18T21:11:23.075 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30967]: created object 0... 2024-08-18T21:11:23.075 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30967]: created object 25... 2024-08-18T21:11:23.076 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30967]: created object 49... 2024-08-18T21:11:23.076 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30967]: finishing. 2024-08-18T21:11:23.076 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[30967]: shutting down. 2024-08-18T21:11:23.133 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:23.133 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30969]: starting. 2024-08-18T21:11:23.134 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30969]: listing objects. 2024-08-18T21:11:23.134 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30969]: listed object 0... 2024-08-18T21:11:23.134 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30969]: listed object 25... 2024-08-18T21:11:23.134 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30969]: saw 50 objects 2024-08-18T21:11:23.134 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[30969]: shutting down. 2024-08-18T21:11:23.880 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:23.881 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30968]: starting. 2024-08-18T21:11:23.881 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30968]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-30930 2024-08-18T21:11:23.881 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[30968]: shutting down. 2024-08-18T21:11:23.884 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:23.884 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:23.885 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:11:23.887 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:11:25.778 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31022]: starting. 2024-08-18T21:11:25.778 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31022]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31021 2024-08-18T21:11:25.778 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31022]: created object 0... 2024-08-18T21:11:25.778 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31022]: created object 25... 2024-08-18T21:11:25.778 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31022]: created object 49... 2024-08-18T21:11:25.778 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31022]: finishing. 2024-08-18T21:11:25.778 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31022]: shutting down. 2024-08-18T21:11:26.556 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31023]: starting. 2024-08-18T21:11:26.557 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31023]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31021 2024-08-18T21:11:26.557 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31023]: shutting down. 2024-08-18T21:11:28.976 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:28.976 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31058]: starting. 2024-08-18T21:11:28.976 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31058]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31021 2024-08-18T21:11:28.976 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31058]: created object 0... 2024-08-18T21:11:28.977 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31058]: created object 25... 2024-08-18T21:11:28.977 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31058]: created object 49... 2024-08-18T21:11:28.977 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31058]: finishing. 2024-08-18T21:11:28.977 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31058]: shutting down. 2024-08-18T21:11:29.032 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:29.032 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31060]: starting. 2024-08-18T21:11:29.032 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31060]: listing objects. 2024-08-18T21:11:29.032 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31060]: listed object 0... 2024-08-18T21:11:29.032 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31060]: listed object 25... 2024-08-18T21:11:29.032 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31060]: saw 50 objects 2024-08-18T21:11:29.032 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31060]: shutting down. 2024-08-18T21:11:30.592 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:30.592 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31059]: starting. 2024-08-18T21:11:30.593 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31059]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31021 2024-08-18T21:11:30.593 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31059]: shutting down. 2024-08-18T21:11:30.595 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:30.595 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:30.595 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:11:30.598 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:11:33.406 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31113]: starting. 2024-08-18T21:11:33.406 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31113]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31112 2024-08-18T21:11:33.406 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31113]: created object 0... 2024-08-18T21:11:33.406 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31113]: created object 25... 2024-08-18T21:11:33.406 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31113]: created object 49... 2024-08-18T21:11:33.406 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31113]: finishing. 2024-08-18T21:11:33.407 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31113]: shutting down. 2024-08-18T21:11:34.735 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-08-18T21:11:34.735 INFO:tasks.ceph.mon.e:Restarting daemon 2024-08-18T21:11:34.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-08-18T21:11:34.738 INFO:tasks.ceph.mon.e:Started 2024-08-18T21:11:34.738 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-08-18T21:11:34.739 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-18T21:11:34.739 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-18T21:11:34.741 INFO:tasks.ceph.mon.c:Started 2024-08-18T21:11:34.741 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-18T21:11:34.741 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-18T21:11:34.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-18T21:11:34.744 INFO:tasks.ceph.mon.a:Started 2024-08-18T21:11:34.744 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-08-18T21:11:34.744 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-18T21:11:34.744 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-18T21:11:34.746 INFO:tasks.ceph.mon.b:Started 2024-08-18T21:11:34.747 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:11:34.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:11:34.801 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31114]: starting. 2024-08-18T21:11:34.801 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31114]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31112 2024-08-18T21:11:34.801 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31114]: shutting down. 2024-08-18T21:11:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 10 monclient: get_monmap_and_config 2024-08-18T21:11:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 10 monclient: build_initial_monmap 2024-08-18T21:11:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 10 monclient: monmap: 2024-08-18T21:11:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:34.889772+0000 2024-08-18T21:11:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:34.889772+0000 2024-08-18T21:11:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:34.888 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:34.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 1 Processor -- start 2024-08-18T21:11:34.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 1 -- start start 2024-08-18T21:11:34.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 10 monclient: init 2024-08-18T21:11:34.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:34.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 10 monclient: _add_conns ranks=[9,1,2,0,4,10,7,8,6,5,3] 2024-08-18T21:11:34.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6d80a6bd0 0x7fd6d80a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:34.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 10 monclient(hunting): picked mon.noname-a con 0x7fd6d80a6bd0 addr v2:172.21.15.5:3300/0 2024-08-18T21:11:34.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd6d809f080 addr v1:172.21.15.157:6789/0 2024-08-18T21:11:34.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd6d80a74f0 0x7fd6d813a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:34.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 10 monclient(hunting): picked mon.noname-b con 0x7fd6d80a74f0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:11:34.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6d80a7fb0 con 0x7fd6d809f080 2024-08-18T21:11:34.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:34.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd6d809e4c0 con 0x7fd6d80a6bd0 2024-08-18T21:11:34.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:34.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d806f930 con 0x7fd6d80a74f0 2024-08-18T21:11:34.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:34.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6dd6ad640 10 monclient(hunting): authenticate will time out at 1461.902691s 2024-08-18T21:11:34.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6d80a6bd0 0x7fd6d80a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:34.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d77fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd6d80a74f0 0x7fd6d813a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6d80a6bd0 0x7fd6d80a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43836/0 (socket says 172.21.15.5:43836) 2024-08-18T21:11:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d6ffd640 1 -- 172.21.15.5:0/2017683031 learned_addr learned my addr 172.21.15.5:0/2017683031 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d6ffd640 10 monclient(hunting): get_auth_request con 0x7fd6d80a6bd0 auth_method 0 2024-08-18T21:11:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d77fe640 10 monclient(hunting): get_auth_request con 0x7fd6d80a74f0 auth_method 0 2024-08-18T21:11:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d6ffd640 1 -- 172.21.15.5:0/2017683031 >> v2:172.21.15.5:3300/0 conn(0x7fd6d80a6bd0 msgr2=0x7fd6d80a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:11:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d6ffd640 1 -- 172.21.15.5:0/2017683031 >> v2:172.21.15.5:3300/0 conn(0x7fd6d80a6bd0 msgr2=0x7fd6d80a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:11:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d6ffd640 1 --2- 172.21.15.5:0/2017683031 >> v2:172.21.15.5:3300/0 conn(0x7fd6d80a6bd0 0x7fd6d80a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d77fe640 1 -- 172.21.15.5:0/2017683031 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd6d80a74f0 msgr2=0x7fd6d813a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:11:34.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d77fe640 1 -- 172.21.15.5:0/2017683031 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd6d80a74f0 msgr2=0x7fd6d813a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:11:34.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d77fe640 1 --2- 172.21.15.5:0/2017683031 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd6d80a74f0 0x7fd6d813a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:34.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d6ffd640 1 --2- 172.21.15.5:0/2017683031 >> v2:172.21.15.5:3300/0 conn(0x7fd6d80a6bd0 0x7fd6d80a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:34.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.884+0000 7fd6d77fe640 1 --2- 172.21.15.5:0/2017683031 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd6d80a74f0 0x7fd6d813a0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:34.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d67fc640 1 -- 172.21.15.5:0/2017683031 >> v1:172.21.15.157:6789/0 conn(0x7fd6d809f080 legacy=0x7fd6d8139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:34.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 -- 172.21.15.5:0/2017683031 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 565858207 0 0) 0x7fd6d80a7fb0 con 0x7fd6d809f080 2024-08-18T21:11:34.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient(hunting): _negotiate 2024-08-18T21:11:34.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:34.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:34.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient(hunting): my global_id is 104446 2024-08-18T21:11:34.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 -- 172.21.15.5:0/2017683031 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6c0003530 con 0x7fd6d809f080 2024-08-18T21:11:34.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 -- 172.21.15.5:0/2017683031 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4237043430 0 0) 0x7fd6c0003530 con 0x7fd6d809f080 2024-08-18T21:11:34.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 -- 172.21.15.5:0/2017683031 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd6d80a74f0 msgr2=0x7fd6d813a0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:34.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 --2- 172.21.15.5:0/2017683031 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd6d80a74f0 0x7fd6d813a0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:34.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 -- 172.21.15.5:0/2017683031 >> v2:172.21.15.5:3300/0 conn(0x7fd6d80a6bd0 msgr2=0x7fd6d80a6fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:34.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 --2- 172.21.15.5:0/2017683031 >> v2:172.21.15.5:3300/0 conn(0x7fd6d80a6bd0 0x7fd6d80a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:34.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient: _finish_hunting 0 2024-08-18T21:11:34.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 monclient: found mon.noname-f-legacy 2024-08-18T21:11:34.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:34.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient: _send_mon_message to mon.noname-f-legacy at v1:172.21.15.157:6789/0 2024-08-18T21:11:34.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 -- 172.21.15.5:0/2017683031 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d809de70 con 0x7fd6d809f080 2024-08-18T21:11:34.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient: _finish_auth 0 2024-08-18T21:11:34.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:11:34.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:34.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6dd6ad640 5 monclient: authenticate success, global_id 104446 2024-08-18T21:11:34.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6dd6ad640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:34.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 -- 172.21.15.5:0/2017683031 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 4141550541 0 0) 0x7fd6cc001c70 con 0x7fd6d809f080 2024-08-18T21:11:34.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:34.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient: got monmap 1 from mon.noname-f-legacy (according to old e1) 2024-08-18T21:11:34.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient: dump: 2024-08-18T21:11:34.903 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:34.903 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:34.903 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:34.903 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:34.903 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:34.903 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:34.903 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:34.903 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:34.903 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:34.903 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:34.903 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:34.903 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:34.903 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:34.903 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:34.904 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:34.904 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:34.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 monclient: mon.f has (v2) addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] but i'm connected to v1:172.21.15.157:6789/0, reconnecting 2024-08-18T21:11:34.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:34.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 -- 172.21.15.5:0/2017683031 >> v1:172.21.15.157:6789/0 conn(0x7fd6d809f080 legacy=0x7fd6d8139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:34.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient: _add_conns ranks=[3,7,6,5,2,4,0,8,1] 2024-08-18T21:11:34.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 --2- 172.21.15.5:0/2017683031 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6c0004260 0x7fd6c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:34.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient(hunting): picked mon.g con 0x7fd6c0004260 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:34.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 --2- 172.21.15.5:0/2017683031 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c0004e70 0x7fd6c00099c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:34.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient(hunting): picked mon.i con 0x7fd6c0004e70 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:34.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 --2- 172.21.15.5:0/2017683031 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd6c0009f00 0x7fd6c000c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:34.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient(hunting): picked mon.d con 0x7fd6c0009f00 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:34.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:34.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 -- 172.21.15.5:0/2017683031 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d809e4c0 con 0x7fd6c0004260 2024-08-18T21:11:34.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:34.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 -- 172.21.15.5:0/2017683031 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fd6d806f930 con 0x7fd6c0009f00 2024-08-18T21:11:34.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:34.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 1 -- 172.21.15.5:0/2017683031 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fd6c000c9f0 con 0x7fd6c0004e70 2024-08-18T21:11:34.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:34.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d5ffb640 10 monclient(hunting): _finish_auth 0 2024-08-18T21:11:34.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6dd6ad640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:34.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 1 --2- 172.21.15.5:0/2017683031 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd6c0009f00 0x7fd6c000c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:34.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 10 monclient(hunting): get_auth_request con 0x7fd6c0009f00 auth_method 0 2024-08-18T21:11:34.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:34.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:34.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:11:34.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:34.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:34.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d67fc640 1 --2- 172.21.15.5:0/2017683031 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c0004e70 0x7fd6c00099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:34.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:11:34.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d67fc640 10 monclient(hunting): get_auth_request con 0x7fd6c0004e70 auth_method 0 2024-08-18T21:11:34.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:34.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d67fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:34.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d67fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:11:34.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d6ffd640 1 --2- 172.21.15.5:0/2017683031 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6c0004260 0x7fd6c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:34.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d6ffd640 10 monclient(hunting): get_auth_request con 0x7fd6c0004260 auth_method 0 2024-08-18T21:11:34.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:34.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:34.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:11:34.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d67fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:11:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 10 monclient(hunting): handle_auth_done global_id 104446 payload 293 2024-08-18T21:11:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 1 -- 172.21.15.5:0/2017683031 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c0004e70 msgr2=0x7fd6c00099c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 1 --2- 172.21.15.5:0/2017683031 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c0004e70 0x7fd6c00099c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 1 -- 172.21.15.5:0/2017683031 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6c0004260 msgr2=0x7fd6c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 1 --2- 172.21.15.5:0/2017683031 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6c0004260 0x7fd6c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 10 monclient: _finish_hunting 0 2024-08-18T21:11:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 1 monclient: found mon.d 2024-08-18T21:11:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 1 -- 172.21.15.5:0/2017683031 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c0003530 con 0x7fd6c0009f00 2024-08-18T21:11:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 10 monclient: _finish_auth 0 2024-08-18T21:11:34.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 10 monclient: _check_auth_tickets 2024-08-18T21:11:34.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.888+0000 7fd6d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:34.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6d77fe640 1 -- 172.21.15.5:0/2017683031 reap_dead start 2024-08-18T21:11:34.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6d77fe640 1 -- 172.21.15.5:0/2017683031 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd6c0009f00 msgr2=0x7fd6c000c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:34.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6d77fe640 1 --2- 172.21.15.5:0/2017683031 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd6c0009f00 0x7fd6c000c2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009fd0 tx=0x7fd6d001ce20 comp rx=0 tx=0).ready entity=mon.6 client_cookie=c0909272a4be429c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:34.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6d5ffb640 1 -- 172.21.15.5:0/2017683031 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd6d0009bd0 con 0x7fd6c0009f00 2024-08-18T21:11:34.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:34.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6d5ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:34.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6d5ffb640 10 monclient: dump: 2024-08-18T21:11:34.909 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:34.909 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:34.909 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:34.909 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:34.910 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:34.910 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:34.910 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:34.910 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:34.910 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:34.910 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:34.910 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:34.910 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:34.910 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:34.910 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:34.910 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:34.910 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:34.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6d5ffb640 1 -- 172.21.15.5:0/2017683031 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d00a5d70 con 0x7fd6c0009f00 2024-08-18T21:11:34.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6dd6ad640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:34.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6d5ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:34.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6dd6ad640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:34.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6dd6ad640 4 set_mon_vals no callback set 2024-08-18T21:11:34.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6d5ffb640 1 -- 172.21.15.5:0/2017683031 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd6d00ac810 con 0x7fd6c0009f00 2024-08-18T21:11:34.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:34.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6d5ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:34.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6d5ffb640 10 monclient: dump: 2024-08-18T21:11:34.911 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:34.911 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:34.911 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:34.911 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:34.912 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:34.912 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:34.912 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:34.912 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:34.912 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:34.912 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:34.912 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:34.912 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:34.912 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:34.912 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:34.912 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:34.912 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:34.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6dd6ad640 10 monclient: shutdown 2024-08-18T21:11:34.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6dd6ad640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:34.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6dd6ad640 1 -- 172.21.15.5:0/2017683031 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd6c0009f00 msgr2=0x7fd6c000c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:34.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6dd6ad640 1 --2- 172.21.15.5:0/2017683031 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd6c0009f00 0x7fd6c000c2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009fd0 tx=0x7fd6d001ce20 comp rx=0 tx=0).stop 2024-08-18T21:11:34.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6dd6ad640 1 -- 172.21.15.5:0/2017683031 shutdown_connections 2024-08-18T21:11:34.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6dd6ad640 1 --2- 172.21.15.5:0/2017683031 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd6c0009f00 0x7fd6c000c2f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:34.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6dd6ad640 1 -- 172.21.15.5:0/2017683031 >> 172.21.15.5:0/2017683031 conn(0x7fd6d8068700 msgr2=0x7fd6d8068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:34.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6dd6ad640 1 -- 172.21.15.5:0/2017683031 shutdown_connections 2024-08-18T21:11:34.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.892+0000 7fd6dd6ad640 1 -- 172.21.15.5:0/2017683031 wait complete. 2024-08-18T21:11:34.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 10 monclient: build_initial_monmap 2024-08-18T21:11:34.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 10 monclient: monmap: 2024-08-18T21:11:34.913 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:34.913 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:34.913 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:34.913 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:34.914 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:34.914 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:34.914 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:34.914 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:34.914 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:34.914 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:34.914 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:34.914 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:34.914 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:34.914 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:34.914 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:34.914 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:34.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 1 Processor -- start 2024-08-18T21:11:34.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 1 -- start start 2024-08-18T21:11:34.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 10 monclient: init 2024-08-18T21:11:34.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:34.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 10 monclient: _add_conns ranks=[7,8,1,5,2,0,6,3,4] 2024-08-18T21:11:34.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c0009f00 0x7fd6d81d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:34.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 10 monclient(hunting): picked mon.noname-i con 0x7fd6c0009f00 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:34.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd6d81d18f0 0x7fd6d81d1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:34.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 10 monclient(hunting): picked mon.noname-e con 0x7fd6d81d18f0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:34.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6d813d5e0 0x7fd6d813da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:34.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 10 monclient(hunting): picked mon.noname-f con 0x7fd6d813d5e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:11:34.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:34.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d80a6fb0 con 0x7fd6d813d5e0 2024-08-18T21:11:34.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:34.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fd6d80a89f0 con 0x7fd6c0009f00 2024-08-18T21:11:34.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:34.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fd6d80a7130 con 0x7fd6d81d18f0 2024-08-18T21:11:34.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:34.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6dd6ad640 10 monclient(hunting): authenticate will time out at 1461.913445s 2024-08-18T21:11:34.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d67fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd6d81d18f0 0x7fd6d81d1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:34.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d67fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd6d81d18f0 0x7fd6d81d1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:44214/0 (socket says 172.21.15.5:44214) 2024-08-18T21:11:34.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d67fc640 1 -- 172.21.15.5:0/2561033771 learned_addr learned my addr 172.21.15.5:0/2561033771 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:34.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d67fc640 10 monclient(hunting): get_auth_request con 0x7fd6d81d18f0 auth_method 0 2024-08-18T21:11:34.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:34.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d67fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:34.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:34.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 1 --2- 172.21.15.5:0/2561033771 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c0009f00 0x7fd6d81d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:34.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 10 monclient(hunting): get_auth_request con 0x7fd6c0009f00 auth_method 0 2024-08-18T21:11:34.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:34.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:34.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:34.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d67fc640 1 -- 172.21.15.5:0/2561033771 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd6d81d18f0 msgr2=0x7fd6d81d1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-18T21:11:34.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d67fc640 1 -- 172.21.15.5:0/2561033771 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd6d81d18f0 msgr2=0x7fd6d81d1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:11:34.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d67fc640 1 --2- 172.21.15.5:0/2561033771 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd6d81d18f0 0x7fd6d81d1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:34.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d77fe640 1 --2- 172.21.15.5:0/2561033771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6d813d5e0 0x7fd6d813da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:34.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d67fc640 1 --2- 172.21.15.5:0/2561033771 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd6d81d18f0 0x7fd6d81d1cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:34.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d77fe640 10 monclient(hunting): get_auth_request con 0x7fd6d813d5e0 auth_method 0 2024-08-18T21:11:34.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:34.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:34.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:34.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:34.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:34.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:34.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:34.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:34.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:34.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 10 monclient(hunting): handle_auth_done global_id 6433 payload 824 2024-08-18T21:11:34.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 1 -- 172.21.15.5:0/2561033771 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd6d81d18f0 msgr2=0x7fd6d81d1cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:11:34.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 1 --2- 172.21.15.5:0/2561033771 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd6d81d18f0 0x7fd6d81d1cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:34.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 1 -- 172.21.15.5:0/2561033771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6d813d5e0 msgr2=0x7fd6d813da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:34.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 1 --2- 172.21.15.5:0/2561033771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6d813d5e0 0x7fd6d813da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:34.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:11:34.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 1 monclient: found mon.noname-i 2024-08-18T21:11:34.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:34.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:11:34.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.896+0000 7fd6d6ffd640 1 -- 172.21.15.5:0/2561033771 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d80aaa80 con 0x7fd6c0009f00 2024-08-18T21:11:34.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6d6ffd640 1 -- 172.21.15.5:0/2561033771 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c0009f00 msgr2=0x7fd6d81d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:34.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6d6ffd640 1 --2- 172.21.15.5:0/2561033771 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c0009f00 0x7fd6d81d13b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009100 tx=0x7fd6c800f6f0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:34.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6bf7fe640 1 -- 172.21.15.5:0/2561033771 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd6c8018070 con 0x7fd6c0009f00 2024-08-18T21:11:34.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6bf7fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:11:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6bf7fe640 10 monclient: dump: 2024-08-18T21:11:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:34.923 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6bf7fe640 10 monclient: _finish_auth 0 2024-08-18T21:11:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6bf7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:11:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6bf7fe640 1 -- 172.21.15.5:0/2561033771 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c8014d10 con 0x7fd6c0009f00 2024-08-18T21:11:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6bf7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6bf7fe640 1 -- 172.21.15.5:0/2561033771 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd6c8013850 con 0x7fd6c0009f00 2024-08-18T21:11:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6bf7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:11:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6bf7fe640 10 monclient: dump: 2024-08-18T21:11:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:34.925 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:34.925 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:34.925 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:34.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6dd6ad640 5 monclient: authenticate success, global_id 6433 2024-08-18T21:11:34.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6dd6ad640 10 monclient: _renew_subs 2024-08-18T21:11:34.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6d57fa640 4 set_mon_vals no callback set 2024-08-18T21:11:34.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6dd6ad640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:11:34.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6dd6ad640 1 -- 172.21.15.5:0/2561033771 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d80a62a0 con 0x7fd6c0009f00 2024-08-18T21:11:34.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6dd6ad640 10 monclient: _renew_subs 2024-08-18T21:11:34.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6dd6ad640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:11:34.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6dd6ad640 1 -- 172.21.15.5:0/2561033771 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d8122a30 con 0x7fd6c0009f00 2024-08-18T21:11:34.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6dd6ad640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:34.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6dd6ad640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:34.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6dd6ad640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:11:34.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6dd6ad640 1 -- 172.21.15.5:0/2561033771 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d80008e0 con 0x7fd6c0009f00 2024-08-18T21:11:34.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6bf7fe640 1 -- 172.21.15.5:0/2561033771 <== mon.7 v2:172.21.15.157:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fd6c8012070 con 0x7fd6c0009f00 2024-08-18T21:11:34.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6bf7fe640 1 --2- 172.21.15.5:0/2561033771 >> v2:172.21.15.157:6812/631023601 conn(0x7fd6c403bdc0 0x7fd6c403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:34.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6bf7fe640 1 -- 172.21.15.5:0/2561033771 <== mon.7 v2:172.21.15.157:3303/0 5 ==== osd_map(231..231 src has 22..231) ==== 3506+0+0 (secure 0 0 0) 0x7fd6c804e1c0 con 0x7fd6c0009f00 2024-08-18T21:11:34.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6d67fc640 1 --2- 172.21.15.5:0/2561033771 >> v2:172.21.15.157:6812/631023601 conn(0x7fd6c403bdc0 0x7fd6c403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:34.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.900+0000 7fd6d67fc640 10 monclient: get_auth_request con 0x7fd6c403bdc0 auth_method 0 2024-08-18T21:11:34.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.904+0000 7fd6d67fc640 1 --2- 172.21.15.5:0/2561033771 >> v2:172.21.15.157:6812/631023601 conn(0x7fd6c403bdc0 0x7fd6c403e280 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc001500 tx=0x7fd6cc00a040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:34.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.904+0000 7fd6bf7fe640 1 -- 172.21.15.5:0/2561033771 <== mon.7 v2:172.21.15.157:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fd6c80148a0 con 0x7fd6c0009f00 2024-08-18T21:11:34.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.904+0000 7fd6bf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:34.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:34.904+0000 7fd6bf7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:35.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:35.168+0000 7fd6dd6ad640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:11:35.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:35.168+0000 7fd6dd6ad640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:11:35.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:35.168+0000 7fd6dd6ad640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:11:35.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:35.168+0000 7fd6dd6ad640 1 -- 172.21.15.5:0/2561033771 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd6d813fef0 con 0x7fd6c0009f00 2024-08-18T21:11:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:37.896+0000 7fd6be7fc640 10 monclient: tick 2024-08-18T21:11:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:37.896+0000 7fd6be7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:11:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:37.896+0000 7fd6be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:37.896+0000 7fd6be7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:38.896+0000 7fd6be7fc640 10 monclient: tick 2024-08-18T21:11:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:38.896+0000 7fd6be7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:11:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:38.896+0000 7fd6be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:39.896+0000 7fd6be7fc640 10 monclient: tick 2024-08-18T21:11:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:39.896+0000 7fd6be7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:11:39.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:39.896+0000 7fd6be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:40.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.116+0000 7fd6bf7fe640 1 -- 172.21.15.5:0/2561033771 <== mon.7 v2:172.21.15.157:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3149 (secure 0 0 0) 0x7fd6c80133e0 con 0x7fd6c0009f00 2024-08-18T21:11:40.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.116+0000 7fd6bf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:11:40.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.116+0000 7fd6bf7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:40.120 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":162,"quorum":[1,3,5,6,7],"quorum_names":["f","g","h","d","i"],"quorum_leader_name":"f","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:11:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.120+0000 7fd6dd6ad640 1 -- 172.21.15.5:0/2561033771 >> v2:172.21.15.157:6812/631023601 conn(0x7fd6c403bdc0 msgr2=0x7fd6c403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.120+0000 7fd6dd6ad640 1 --2- 172.21.15.5:0/2561033771 >> v2:172.21.15.157:6812/631023601 conn(0x7fd6c403bdc0 0x7fd6c403e280 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc001500 tx=0x7fd6cc00a040 comp rx=0 tx=0).stop 2024-08-18T21:11:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.120+0000 7fd6dd6ad640 10 monclient: shutdown 2024-08-18T21:11:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.120+0000 7fd6dd6ad640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.120+0000 7fd6dd6ad640 1 -- 172.21.15.5:0/2561033771 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c0009f00 msgr2=0x7fd6d81d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.120+0000 7fd6dd6ad640 1 --2- 172.21.15.5:0/2561033771 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c0009f00 0x7fd6d81d13b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009100 tx=0x7fd6c800f6f0 comp rx=0 tx=0).stop 2024-08-18T21:11:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.120+0000 7fd6dd6ad640 1 -- 172.21.15.5:0/2561033771 shutdown_connections 2024-08-18T21:11:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.120+0000 7fd6dd6ad640 1 --2- 172.21.15.5:0/2561033771 >> v2:172.21.15.157:6812/631023601 conn(0x7fd6c403bdc0 0x7fd6c403e280 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.120+0000 7fd6dd6ad640 1 --2- 172.21.15.5:0/2561033771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6d813d5e0 0x7fd6d813da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.120+0000 7fd6dd6ad640 1 --2- 172.21.15.5:0/2561033771 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd6d81d18f0 0x7fd6d81d1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.120+0000 7fd6dd6ad640 1 --2- 172.21.15.5:0/2561033771 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c0009f00 0x7fd6d81d13b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.120+0000 7fd6dd6ad640 1 -- 172.21.15.5:0/2561033771 >> 172.21.15.5:0/2561033771 conn(0x7fd6d8068700 msgr2=0x7fd6d8141680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.120+0000 7fd6dd6ad640 1 -- 172.21.15.5:0/2561033771 shutdown_connections 2024-08-18T21:11:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:40.120+0000 7fd6dd6ad640 1 -- 172.21.15.5:0/2561033771 wait complete. 2024-08-18T21:11:43.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:11:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 10 monclient: get_monmap_and_config 2024-08-18T21:11:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 10 monclient: build_initial_monmap 2024-08-18T21:11:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 10 monclient: monmap: 2024-08-18T21:11:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:43.286022+0000 2024-08-18T21:11:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:43.286022+0000 2024-08-18T21:11:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:43.285 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:43.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 1 Processor -- start 2024-08-18T21:11:43.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 1 -- start start 2024-08-18T21:11:43.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 10 monclient: init 2024-08-18T21:11:43.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:43.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 10 monclient: _add_conns ranks=[2,3,0,6,7,9,4,8,5,1,10] 2024-08-18T21:11:43.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 0x7f3a940a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:43.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 10 monclient(hunting): picked mon.noname-b con 0x7f3a940a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:11:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 0x7f3a94139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 10 monclient(hunting): picked mon.noname-g con 0x7f3a940a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3a94139fe0 addr v1:172.21.15.5:6789/0 2024-08-18T21:11:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a940a45d0 con 0x7f3a94139fe0 2024-08-18T21:11:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f3a940a5000 con 0x7f3a940a6ce0 2024-08-18T21:11:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3a940a32d0 con 0x7f3a940a7600 2024-08-18T21:11:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9c007640 10 monclient(hunting): authenticate will time out at 1470.299285s 2024-08-18T21:11:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9a5a4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3a94139fe0 0x7f3a94140cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58322/0 (socket says 172.21.15.5:58322) 2024-08-18T21:11:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a9a5a4640 1 -- 172.21.15.5:0/217171100 learned_addr learned my addr 172.21.15.5:0/217171100 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:11:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a99da3640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 0x7f3a940a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a99da3640 10 monclient(hunting): get_auth_request con 0x7f3a940a6ce0 auth_method 0 2024-08-18T21:11:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a99da3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a99da3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a99da3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a995a2640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 0x7f3a94139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a99da3640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 msgr2=0x7f3a940a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:11:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a99da3640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 msgr2=0x7f3a940a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:11:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a99da3640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 0x7f3a940a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a995a2640 10 monclient(hunting): get_auth_request con 0x7f3a940a7600 auth_method 0 2024-08-18T21:11:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a995a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a995a2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a995a2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a99da3640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 0x7f3a940a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.280+0000 7f3a995a2640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 msgr2=0x7f3a94139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:11:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.284+0000 7f3a995a2640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 msgr2=0x7f3a94139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:11:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.284+0000 7f3a995a2640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 0x7f3a94139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.284+0000 7f3a995a2640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 0x7f3a94139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.284+0000 7f3a9a5a4640 1 -- 172.21.15.5:0/217171100 >> v1:172.21.15.5:6789/0 conn(0x7f3a94139fe0 legacy=0x7f3a94140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:43.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.484+0000 7f3a99da3640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 0x7f3a940a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:43.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.484+0000 7f3a99da3640 10 monclient(hunting): get_auth_request con 0x7f3a940a6ce0 auth_method 0 2024-08-18T21:11:43.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.484+0000 7f3a99da3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:43.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.484+0000 7f3a99da3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:43.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.484+0000 7f3a99da3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:11:43.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.484+0000 7f3a99da3640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 msgr2=0x7f3a940a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:11:43.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.484+0000 7f3a99da3640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 msgr2=0x7f3a940a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:11:43.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.484+0000 7f3a99da3640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 0x7f3a940a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:43.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.484+0000 7f3a99da3640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 0x7f3a940a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:11:43.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.488+0000 7f3a995a2640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 0x7f3a94139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:43.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.488+0000 7f3a995a2640 10 monclient(hunting): get_auth_request con 0x7f3a940a7600 auth_method 0 2024-08-18T21:11:43.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.488+0000 7f3a995a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:43.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.488+0000 7f3a995a2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:43.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.488+0000 7f3a995a2640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:11:43.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.488+0000 7f3a995a2640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 msgr2=0x7f3a94139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:11:43.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.488+0000 7f3a995a2640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 msgr2=0x7f3a94139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:11:43.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.488+0000 7f3a995a2640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 0x7f3a94139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:43.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.488+0000 7f3a995a2640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 0x7f3a94139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:11:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.888+0000 7f3a99da3640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 0x7f3a940a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.888+0000 7f3a99da3640 10 monclient(hunting): get_auth_request con 0x7f3a940a6ce0 auth_method 0 2024-08-18T21:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.888+0000 7f3a99da3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.888+0000 7f3a99da3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.888+0000 7f3a99da3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.888+0000 7f3a99da3640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 msgr2=0x7f3a940a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.888+0000 7f3a99da3640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 msgr2=0x7f3a940a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.888+0000 7f3a99da3640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 0x7f3a940a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.888+0000 7f3a99da3640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 0x7f3a940a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:11:43.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.892+0000 7f3a995a2640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 0x7f3a94139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:43.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.892+0000 7f3a995a2640 10 monclient(hunting): get_auth_request con 0x7f3a940a7600 auth_method 0 2024-08-18T21:11:43.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.892+0000 7f3a995a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:43.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.892+0000 7f3a995a2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:43.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.892+0000 7f3a995a2640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:11:43.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.892+0000 7f3a995a2640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 msgr2=0x7f3a94139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:11:43.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.892+0000 7f3a995a2640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 msgr2=0x7f3a94139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:11:43.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.892+0000 7f3a995a2640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 0x7f3a94139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:43.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:43.892+0000 7f3a995a2640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 0x7f3a94139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:11:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.692+0000 7f3a99da3640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 0x7f3a940a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.692+0000 7f3a99da3640 10 monclient(hunting): get_auth_request con 0x7f3a940a6ce0 auth_method 0 2024-08-18T21:11:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.692+0000 7f3a99da3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.692+0000 7f3a99da3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.692+0000 7f3a99da3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:11:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.692+0000 7f3a99da3640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 msgr2=0x7f3a940a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:11:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.692+0000 7f3a99da3640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 msgr2=0x7f3a940a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:11:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.692+0000 7f3a99da3640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 0x7f3a940a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.692+0000 7f3a99da3640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 0x7f3a940a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:11:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.696+0000 7f3a995a2640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 0x7f3a94139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.696+0000 7f3a995a2640 10 monclient(hunting): get_auth_request con 0x7f3a940a7600 auth_method 0 2024-08-18T21:11:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.696+0000 7f3a995a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.696+0000 7f3a995a2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.696+0000 7f3a995a2640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:11:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.696+0000 7f3a995a2640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 msgr2=0x7f3a94139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:11:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.696+0000 7f3a995a2640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 msgr2=0x7f3a94139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:11:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.696+0000 7f3a995a2640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 0x7f3a94139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.696+0000 7f3a995a2640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 0x7f3a94139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:11:44.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.852+0000 7f3a9a5a4640 1 -- 172.21.15.5:0/217171100 >> v1:172.21.15.5:6789/0 conn(0x7f3a94139fe0 legacy=0x7f3a94140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-08-18T21:11:44.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.852+0000 7f3a9a5a4640 1 -- 172.21.15.5:0/217171100 >> v1:172.21.15.5:6789/0 conn(0x7f3a94139fe0 legacy=0x7f3a94140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:11:44.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.852+0000 7f3a9a5a4640 1 --1- 172.21.15.5:0/217171100 >> v1:172.21.15.5:6789/0 conn(0x7f3a94139fe0 0x7f3a94140cf0 :-1 s=OPENED pgs=65 cs=1 l=1).handle_message read tag failed 2024-08-18T21:11:44.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.852+0000 7f3a9a5a4640 1 --1- 172.21.15.5:0/217171100 >> v1:172.21.15.5:6789/0 conn(0x7f3a94139fe0 0x7f3a94140cf0 :-1 s=OPENED pgs=65 cs=1 l=1).fault on lossy channel, failing 2024-08-18T21:11:44.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:44.852+0000 7f3a98da1640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.5:6789/0 2024-08-18T21:11:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 10 monclient(hunting): tick 2024-08-18T21:11:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:11:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 1 monclient(hunting): continuing hunt 2024-08-18T21:11:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:11:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 msgr2=0x7f3a94139aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a940a7600 0x7f3a94139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 msgr2=0x7f3a940a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3a940a6ce0 0x7f3a940a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 1 -- 172.21.15.5:0/217171100 >> v1:172.21.15.5:6789/0 conn(0x7f3a94139fe0 legacy=0x7f3a94140cf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 10 monclient: _add_conns ranks=[10,1,8,7,5,6,4,9] 2024-08-18T21:11:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 1 --2- 172.21.15.5:0/217171100 >> v2:172.21.15.157:3300/0 conn(0x7f3a78003740 0x7f3a78005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 10 monclient(hunting): picked mon.noname-f con 0x7f3a78003740 addr v2:172.21.15.157:3300/0 2024-08-18T21:11:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f3a780061c0 addr v1:172.21.15.157:6789/0 2024-08-18T21:11:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3a78009ef0 0x7f3a7800c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 10 monclient(hunting): picked mon.noname-e con 0x7f3a78009ef0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 1 -- 172.21.15.5:0/217171100 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a940a8900 con 0x7f3a780061c0 2024-08-18T21:11:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 1 -- 172.21.15.5:0/217171100 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3a940a32d0 con 0x7f3a78003740 2024-08-18T21:11:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 1 -- 172.21.15.5:0/217171100 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f3a7800db20 con 0x7f3a78009ef0 2024-08-18T21:11:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.280+0000 7f3a8b7fe640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 1 --2- 172.21.15.5:0/217171100 >> v2:172.21.15.157:3300/0 conn(0x7f3a78003740 0x7f3a78005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 10 monclient(hunting): get_auth_request con 0x7f3a78003740 auth_method 0 2024-08-18T21:11:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a9a5a4640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3a78009ef0 0x7f3a7800c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a9a5a4640 10 monclient(hunting): get_auth_request con 0x7f3a78009ef0 auth_method 0 2024-08-18T21:11:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a9a5a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a9a5a4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a9a5a4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a9a5a4640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3a78009ef0 msgr2=0x7f3a7800c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:11:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a9a5a4640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3a78009ef0 msgr2=0x7f3a7800c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:11:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 10 monclient(hunting): handle_auth_done global_id 104464 payload 274 2024-08-18T21:11:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a9a5a4640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3a78009ef0 0x7f3a7800c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3a78009ef0 msgr2=0x7f3a7800c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a9a5a4640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3a78009ef0 0x7f3a7800c3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3a78009ef0 0x7f3a7800c3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 1 -- 172.21.15.5:0/217171100 >> v1:172.21.15.157:6789/0 conn(0x7f3a780061c0 legacy=0x7f3a78008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 10 monclient: _finish_hunting 0 2024-08-18T21:11:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 1 monclient: found mon.noname-f 2024-08-18T21:11:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:11:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.284+0000 7f3a99da3640 1 -- 172.21.15.5:0/217171100 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7800dd20 con 0x7f3a78003740 2024-08-18T21:11:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.288+0000 7f3a9a5a4640 1 -- 172.21.15.5:0/217171100 reap_dead start 2024-08-18T21:11:46.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a99da3640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a78003740 msgr2=0x7f3a78005b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:46.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a99da3640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a78003740 0x7f3a78005b90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3a90000ee0 tx=0x7f3a9001d190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33e4f08d27466849 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a98da1640 1 -- 172.21.15.5:0/217171100 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3a900b3070 con 0x7f3a78003740 2024-08-18T21:11:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a98da1640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a98da1640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:11:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a98da1640 10 monclient: dump: 2024-08-18T21:11:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:46.298 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a98da1640 10 monclient: _finish_auth 0 2024-08-18T21:11:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a98da1640 10 monclient: _check_auth_tickets 2024-08-18T21:11:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a98da1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a98da1640 1 -- 172.21.15.5:0/217171100 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a900ac780 con 0x7f3a78003740 2024-08-18T21:11:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a98da1640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a98da1640 1 -- 172.21.15.5:0/217171100 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3a9000f040 con 0x7f3a78003740 2024-08-18T21:11:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a98da1640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a98da1640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:11:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a98da1640 10 monclient: dump: 2024-08-18T21:11:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:46.300 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a9c007640 5 monclient: authenticate success, global_id 104464 2024-08-18T21:11:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a9c007640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a9c007640 4 set_mon_vals no callback set 2024-08-18T21:11:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a9c007640 10 monclient: shutdown 2024-08-18T21:11:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.292+0000 7f3a9c007640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 1 -- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a78003740 msgr2=0x7f3a78005b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a78003740 0x7f3a78005b90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3a90000ee0 tx=0x7f3a9001d190 comp rx=0 tx=0).stop 2024-08-18T21:11:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 1 -- 172.21.15.5:0/217171100 shutdown_connections 2024-08-18T21:11:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 1 --2- 172.21.15.5:0/217171100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a78003740 0x7f3a78005b90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 1 -- 172.21.15.5:0/217171100 >> 172.21.15.5:0/217171100 conn(0x7f3a940acbc0 msgr2=0x7f3a940a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 1 -- 172.21.15.5:0/217171100 shutdown_connections 2024-08-18T21:11:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 1 -- 172.21.15.5:0/217171100 wait complete. 2024-08-18T21:11:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 10 monclient: build_initial_monmap 2024-08-18T21:11:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 10 monclient: monmap: 2024-08-18T21:11:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:46.306 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 1 Processor -- start 2024-08-18T21:11:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 1 -- start start 2024-08-18T21:11:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 10 monclient: init 2024-08-18T21:11:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 10 monclient: _add_conns ranks=[7,5,1,4,8,2,0,3,6] 2024-08-18T21:11:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3a78003740 0x7f3a941d1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 10 monclient(hunting): picked mon.noname-i con 0x7f3a78003740 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3a941d2230 0x7f3a9413e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 10 monclient(hunting): picked mon.noname-h con 0x7f3a941d2230 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a9413eeb0 0x7f3a9413f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 10 monclient(hunting): picked mon.noname-f con 0x7f3a9413eeb0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:11:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3a940a79e0 con 0x7f3a9413eeb0 2024-08-18T21:11:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f3a9413a7d0 con 0x7f3a941d2230 2024-08-18T21:11:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f3a941402a0 con 0x7f3a78003740 2024-08-18T21:11:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9c007640 10 monclient(hunting): authenticate will time out at 1473.315084s 2024-08-18T21:11:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a99da3640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3a78003740 0x7f3a941d1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a995a2640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3a941d2230 0x7f3a9413e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a99da3640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3a78003740 0x7f3a941d1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:41526/0 (socket says 172.21.15.5:41526) 2024-08-18T21:11:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a99da3640 1 -- 172.21.15.5:0/2499844045 learned_addr learned my addr 172.21.15.5:0/2499844045 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a99da3640 10 monclient(hunting): get_auth_request con 0x7f3a78003740 auth_method 0 2024-08-18T21:11:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a99da3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a99da3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a99da3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9a5a4640 1 --2- 172.21.15.5:0/2499844045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a9413eeb0 0x7f3a9413f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9a5a4640 10 monclient(hunting): get_auth_request con 0x7f3a9413eeb0 auth_method 0 2024-08-18T21:11:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9a5a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9a5a4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9a5a4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a995a2640 10 monclient(hunting): get_auth_request con 0x7f3a941d2230 auth_method 0 2024-08-18T21:11:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a995a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a995a2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a995a2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a99da3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a99da3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a99da3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9a5a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9a5a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a9a5a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a995a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a995a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.296+0000 7f3a995a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a99da3640 10 monclient(hunting): handle_auth_done global_id 6442 payload 824 2024-08-18T21:11:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a99da3640 1 -- 172.21.15.5:0/2499844045 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3a941d2230 msgr2=0x7f3a9413e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a99da3640 1 --2- 172.21.15.5:0/2499844045 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3a941d2230 0x7f3a9413e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a99da3640 1 -- 172.21.15.5:0/2499844045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a9413eeb0 msgr2=0x7f3a9413f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a99da3640 1 --2- 172.21.15.5:0/2499844045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a9413eeb0 0x7f3a9413f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a99da3640 10 monclient: _finish_hunting 0 2024-08-18T21:11:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a99da3640 1 monclient: found mon.noname-i 2024-08-18T21:11:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a99da3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a99da3640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:11:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a99da3640 1 -- 172.21.15.5:0/2499844045 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a94123570 con 0x7f3a78003740 2024-08-18T21:11:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a9a5a4640 1 --2- 172.21.15.5:0/2499844045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a9413eeb0 0x7f3a9413f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a995a2640 1 --2- 172.21.15.5:0/2499844045 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3a941d2230 0x7f3a9413e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a99da3640 1 -- 172.21.15.5:0/2499844045 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3a78003740 msgr2=0x7f3a941d1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a99da3640 1 --2- 172.21.15.5:0/2499844045 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3a78003740 0x7f3a941d1cf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3a9001b840 tx=0x7f3a9001b9d0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a8a7fc640 1 -- 172.21.15.5:0/2499844045 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3a900bd070 con 0x7f3a78003740 2024-08-18T21:11:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a8a7fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:11:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a8a7fc640 10 monclient: dump: 2024-08-18T21:11:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:46.313 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a8a7fc640 10 monclient: _finish_auth 0 2024-08-18T21:11:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a8a7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:11:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a8a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a8a7fc640 1 -- 172.21.15.5:0/2499844045 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a900b4040 con 0x7f3a78003740 2024-08-18T21:11:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a8a7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a8a7fc640 1 -- 172.21.15.5:0/2499844045 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3a900b3070 con 0x7f3a78003740 2024-08-18T21:11:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a8a7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:11:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a8a7fc640 10 monclient: dump: 2024-08-18T21:11:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:46.315 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a8bfff640 4 set_mon_vals no callback set 2024-08-18T21:11:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a9c007640 5 monclient: authenticate success, global_id 6442 2024-08-18T21:11:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a9c007640 10 monclient: _renew_subs 2024-08-18T21:11:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a9c007640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:11:46.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a9c007640 1 -- 172.21.15.5:0/2499844045 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a940a2720 con 0x7f3a78003740 2024-08-18T21:11:46.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a9c007640 10 monclient: _renew_subs 2024-08-18T21:11:46.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a9c007640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:11:46.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.300+0000 7f3a9c007640 1 -- 172.21.15.5:0/2499844045 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a9406eb70 con 0x7f3a78003740 2024-08-18T21:11:46.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.304+0000 7f3a9c007640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:46.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.304+0000 7f3a9c007640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:46.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.304+0000 7f3a9c007640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:11:46.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.304+0000 7f3a9c007640 1 -- 172.21.15.5:0/2499844045 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a940a8220 con 0x7f3a78003740 2024-08-18T21:11:46.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.304+0000 7f3a8a7fc640 1 -- 172.21.15.5:0/2499844045 <== mon.7 v2:172.21.15.157:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f3a900c1430 con 0x7f3a78003740 2024-08-18T21:11:46.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.304+0000 7f3a8a7fc640 1 --2- 172.21.15.5:0/2499844045 >> v2:172.21.15.157:6812/631023601 conn(0x7f3a7803d240 0x7f3a7803f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:46.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.304+0000 7f3a8a7fc640 1 -- 172.21.15.5:0/2499844045 <== mon.7 v2:172.21.15.157:3303/0 5 ==== osd_map(231..231 src has 22..231) ==== 3506+0+0 (secure 0 0 0) 0x7f3a900ab070 con 0x7f3a78003740 2024-08-18T21:11:46.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.304+0000 7f3a995a2640 1 --2- 172.21.15.5:0/2499844045 >> v2:172.21.15.157:6812/631023601 conn(0x7f3a7803d240 0x7f3a7803f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:46.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.304+0000 7f3a995a2640 10 monclient: get_auth_request con 0x7f3a7803d240 auth_method 0 2024-08-18T21:11:46.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.308+0000 7f3a995a2640 1 --2- 172.21.15.5:0/2499844045 >> v2:172.21.15.157:6812/631023601 conn(0x7f3a7803d240 0x7f3a7803f700 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3a94140910 tx=0x7f3a84012320 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.316+0000 7f3a8a7fc640 1 -- 172.21.15.5:0/2499844045 <== mon.7 v2:172.21.15.157:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f3a90016ee0 con 0x7f3a78003740 2024-08-18T21:11:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.316+0000 7f3a8a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:46.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.316+0000 7f3a8a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:46.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.560+0000 7f3a9c007640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:11:46.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.560+0000 7f3a9c007640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:11:46.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.560+0000 7f3a9c007640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.157:3303/0 2024-08-18T21:11:46.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.560+0000 7f3a9c007640 1 -- 172.21.15.5:0/2499844045 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3a94140f90 con 0x7f3a78003740 2024-08-18T21:11:46.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.560+0000 7f3a8a7fc640 1 -- 172.21.15.5:0/2499844045 <== mon.7 v2:172.21.15.157:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3167 (secure 0 0 0) 0x7f3a900add80 con 0x7f3a78003740 2024-08-18T21:11:46.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.560+0000 7f3a8a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:11:46.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.560+0000 7f3a8a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:46.563 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":170,"quorum":[1,2,3,4,5,6,7,8],"quorum_names":["f","b","g","c","h","d","i","e"],"quorum_leader_name":"f","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:11:46.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.560+0000 7f3a9c007640 1 -- 172.21.15.5:0/2499844045 >> v2:172.21.15.157:6812/631023601 conn(0x7f3a7803d240 msgr2=0x7f3a7803f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:46.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.560+0000 7f3a9c007640 1 --2- 172.21.15.5:0/2499844045 >> v2:172.21.15.157:6812/631023601 conn(0x7f3a7803d240 0x7f3a7803f700 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3a94140910 tx=0x7f3a84012320 comp rx=0 tx=0).stop 2024-08-18T21:11:46.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.560+0000 7f3a9c007640 10 monclient: shutdown 2024-08-18T21:11:46.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.560+0000 7f3a9c007640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:46.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.560+0000 7f3a9c007640 1 -- 172.21.15.5:0/2499844045 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3a78003740 msgr2=0x7f3a941d1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:46.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.560+0000 7f3a9c007640 1 --2- 172.21.15.5:0/2499844045 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3a78003740 0x7f3a941d1cf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3a9001b840 tx=0x7f3a9001b9d0 comp rx=0 tx=0).stop 2024-08-18T21:11:46.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.564+0000 7f3a9c007640 1 -- 172.21.15.5:0/2499844045 shutdown_connections 2024-08-18T21:11:46.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.564+0000 7f3a9c007640 1 --2- 172.21.15.5:0/2499844045 >> v2:172.21.15.157:6812/631023601 conn(0x7f3a7803d240 0x7f3a7803f700 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:46.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.564+0000 7f3a9c007640 1 --2- 172.21.15.5:0/2499844045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a9413eeb0 0x7f3a9413f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:46.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.564+0000 7f3a9c007640 1 --2- 172.21.15.5:0/2499844045 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3a941d2230 0x7f3a9413e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:46.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.564+0000 7f3a9c007640 1 --2- 172.21.15.5:0/2499844045 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f3a78003740 0x7f3a941d1cf0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:46.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.564+0000 7f3a9c007640 1 -- 172.21.15.5:0/2499844045 >> 172.21.15.5:0/2499844045 conn(0x7f3a940acbc0 msgr2=0x7f3a9409fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:46.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.564+0000 7f3a9c007640 1 -- 172.21.15.5:0/2499844045 shutdown_connections 2024-08-18T21:11:46.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:46.564+0000 7f3a9c007640 1 -- 172.21.15.5:0/2499844045 wait complete. 2024-08-18T21:11:49.076 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:49.076 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31149]: starting. 2024-08-18T21:11:49.076 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31149]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31112 2024-08-18T21:11:49.076 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31149]: created object 0... 2024-08-18T21:11:49.076 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31149]: created object 25... 2024-08-18T21:11:49.076 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31149]: created object 49... 2024-08-18T21:11:49.076 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31149]: finishing. 2024-08-18T21:11:49.076 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31149]: shutting down. 2024-08-18T21:11:49.137 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:49.138 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31151]: starting. 2024-08-18T21:11:49.138 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31151]: listing objects. 2024-08-18T21:11:49.138 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31151]: listed object 0... 2024-08-18T21:11:49.138 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31151]: listed object 25... 2024-08-18T21:11:49.138 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31151]: saw 50 objects 2024-08-18T21:11:49.138 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31151]: shutting down. 2024-08-18T21:11:49.585 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:11:49.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.716+0000 7fa1ca707640 10 monclient: get_monmap_and_config 2024-08-18T21:11:49.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.716+0000 7fa1ca707640 10 monclient: build_initial_monmap 2024-08-18T21:11:49.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.716+0000 7fa1ca707640 10 monclient: monmap: 2024-08-18T21:11:49.722 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:49.722 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:49.722 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:49.723860+0000 2024-08-18T21:11:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:49.723860+0000 2024-08-18T21:11:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:49.724 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 1 Processor -- start 2024-08-18T21:11:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 1 -- start start 2024-08-18T21:11:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 10 monclient: init 2024-08-18T21:11:49.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:49.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 10 monclient: _add_conns ranks=[8,10,9,3,7,2,0,1,5,4,6] 2024-08-18T21:11:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa1c4069710 0x7fa1c4137bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 10 monclient(hunting): picked mon.noname-e con 0x7fa1c4069710 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa1c4138130 0x7fa1c409da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 10 monclient(hunting): picked mon.noname-f con 0x7fa1c4138130 addr v2:172.21.15.157:3300/0 2024-08-18T21:11:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa1c4138510 0x7fa1c409df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 10 monclient(hunting): picked mon.noname-a con 0x7fa1c4138510 addr v2:172.21.15.5:3300/0 2024-08-18T21:11:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa1c4069af0 con 0x7fa1c4138510 2024-08-18T21:11:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fa1c406e960 con 0x7fa1c4138130 2024-08-18T21:11:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fa1c4072020 con 0x7fa1c4069710 2024-08-18T21:11:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1ca707640 10 monclient(hunting): authenticate will time out at 1476.737763s 2024-08-18T21:11:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa1c4069710 0x7fa1c4137bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa1c4069710 0x7fa1c4137bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:50736/0 (socket says 172.21.15.5:50736) 2024-08-18T21:11:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 1 -- 172.21.15.5:0/2611986923 learned_addr learned my addr 172.21.15.5:0/2611986923 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 10 monclient(hunting): get_auth_request con 0x7fa1c4069710 auth_method 0 2024-08-18T21:11:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c8ca4640 1 --2- 172.21.15.5:0/2611986923 >> v2:172.21.15.5:3300/0 conn(0x7fa1c4138510 0x7fa1c409df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c8ca4640 10 monclient(hunting): get_auth_request con 0x7fa1c4138510 auth_method 0 2024-08-18T21:11:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c8ca4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c8ca4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c8ca4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 10 monclient(hunting): handle_auth_done global_id 114110 payload 274 2024-08-18T21:11:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 1 -- 172.21.15.5:0/2611986923 >> v2:172.21.15.157:3300/0 conn(0x7fa1c4138130 msgr2=0x7fa1c409da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 1 --2- 172.21.15.5:0/2611986923 >> v2:172.21.15.157:3300/0 conn(0x7fa1c4138130 0x7fa1c409da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 1 -- 172.21.15.5:0/2611986923 >> v2:172.21.15.5:3300/0 conn(0x7fa1c4138510 msgr2=0x7fa1c409df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 1 --2- 172.21.15.5:0/2611986923 >> v2:172.21.15.5:3300/0 conn(0x7fa1c4138510 0x7fa1c409df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 10 monclient: _finish_hunting 0 2024-08-18T21:11:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 1 monclient: found mon.noname-e 2024-08-18T21:11:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:11:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.720+0000 7fa1c3fff640 1 -- 172.21.15.5:0/2611986923 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c406d4e0 con 0x7fa1c4069710 2024-08-18T21:11:49.730 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:49.730 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31150]: starting. 2024-08-18T21:11:49.730 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31150]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31112 2024-08-18T21:11:49.730 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31150]: shutting down. 2024-08-18T21:11:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1c3fff640 1 -- 172.21.15.5:0/2611986923 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa1c4069710 msgr2=0x7fa1c4137bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1c3fff640 1 --2- 172.21.15.5:0/2611986923 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa1c4069710 0x7fa1c4137bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc009f00 tx=0x7fa1bc020d40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=de0a1695d87cbd9b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1c2ffd640 1 -- 172.21.15.5:0/2611986923 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa1bc0090d0 con 0x7fa1c4069710 2024-08-18T21:11:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1c2ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:11:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1c2ffd640 10 monclient: dump: 2024-08-18T21:11:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:49.738 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1c2ffd640 10 monclient: _finish_auth 0 2024-08-18T21:11:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1c2ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:11:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1c2ffd640 1 -- 172.21.15.5:0/2611986923 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1bc0b13f0 con 0x7fa1c4069710 2024-08-18T21:11:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1ca707640 5 monclient: authenticate success, global_id 114110 2024-08-18T21:11:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1ca707640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1c2ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1ca707640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1ca707640 4 set_mon_vals no callback set 2024-08-18T21:11:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1c2ffd640 1 -- 172.21.15.5:0/2611986923 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa1bc0b1a10 con 0x7fa1c4069710 2024-08-18T21:11:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1c2ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1c2ffd640 10 monclient: dump: 2024-08-18T21:11:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:49.740 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:49.740 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:49.740 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:49.740 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:49.740 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:49.740 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:49.740 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:49.740 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:49.740 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:49.740 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:49.740 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:49.741 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1ca707640 10 monclient: shutdown 2024-08-18T21:11:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1ca707640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1ca707640 1 -- 172.21.15.5:0/2611986923 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa1c4069710 msgr2=0x7fa1c4137bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1ca707640 1 --2- 172.21.15.5:0/2611986923 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa1c4069710 0x7fa1c4137bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc009f00 tx=0x7fa1bc020d40 comp rx=0 tx=0).stop 2024-08-18T21:11:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1ca707640 1 -- 172.21.15.5:0/2611986923 shutdown_connections 2024-08-18T21:11:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1ca707640 1 --2- 172.21.15.5:0/2611986923 >> v2:172.21.15.5:3300/0 conn(0x7fa1c4138510 0x7fa1c409df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1ca707640 1 --2- 172.21.15.5:0/2611986923 >> v2:172.21.15.157:3300/0 conn(0x7fa1c4138130 0x7fa1c409da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1ca707640 1 --2- 172.21.15.5:0/2611986923 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa1c4069710 0x7fa1c4137bf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1ca707640 1 -- 172.21.15.5:0/2611986923 >> 172.21.15.5:0/2611986923 conn(0x7fa1c40a4b20 msgr2=0x7fa1c40a4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1ca707640 1 -- 172.21.15.5:0/2611986923 shutdown_connections 2024-08-18T21:11:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.724+0000 7fa1ca707640 1 -- 172.21.15.5:0/2611986923 wait complete. 2024-08-18T21:11:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 10 monclient: build_initial_monmap 2024-08-18T21:11:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 10 monclient: monmap: 2024-08-18T21:11:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:49.743 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 1 Processor -- start 2024-08-18T21:11:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 1 -- start start 2024-08-18T21:11:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 10 monclient: init 2024-08-18T21:11:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 10 monclient: _add_conns ranks=[4,6,3,5,1,0,2,8,7] 2024-08-18T21:11:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa1c4069710 0x7fa1c41cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 10 monclient(hunting): picked mon.noname-c con 0x7fa1c4069710 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa1c4138130 0x7fa1c41cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 10 monclient(hunting): picked mon.noname-d con 0x7fa1c4138130 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1c4138510 0x7fa1c41ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 10 monclient(hunting): picked mon.noname-g con 0x7fa1c4138510 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa1c4073fd0 con 0x7fa1c4138510 2024-08-18T21:11:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fa1c409e8c0 con 0x7fa1c4069710 2024-08-18T21:11:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fa1c40a8de0 con 0x7fa1c4138130 2024-08-18T21:11:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1ca707640 10 monclient(hunting): authenticate will time out at 1476.745404s 2024-08-18T21:11:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa1c4069710 0x7fa1c41cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c37fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa1c4138130 0x7fa1c41cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa1c4069710 0x7fa1c41cd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:60182/0 (socket says 172.21.15.5:60182) 2024-08-18T21:11:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 1 -- 172.21.15.5:0/124313308 learned_addr learned my addr 172.21.15.5:0/124313308 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 10 monclient(hunting): get_auth_request con 0x7fa1c4069710 auth_method 0 2024-08-18T21:11:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c37fe640 10 monclient(hunting): get_auth_request con 0x7fa1c4138130 auth_method 0 2024-08-18T21:11:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c8ca4640 1 --2- 172.21.15.5:0/124313308 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1c4138510 0x7fa1c41ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c8ca4640 10 monclient(hunting): get_auth_request con 0x7fa1c4138510 auth_method 0 2024-08-18T21:11:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c8ca4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c8ca4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c8ca4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 10 monclient(hunting): handle_auth_done global_id 114106 payload 824 2024-08-18T21:11:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 1 -- 172.21.15.5:0/124313308 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa1c4138130 msgr2=0x7fa1c41cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 1 --2- 172.21.15.5:0/124313308 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa1c4138130 0x7fa1c41cdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 1 -- 172.21.15.5:0/124313308 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1c4138510 msgr2=0x7fa1c41ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 1 --2- 172.21.15.5:0/124313308 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1c4138510 0x7fa1c41ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 10 monclient: _finish_hunting 0 2024-08-18T21:11:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 1 monclient: found mon.noname-c 2024-08-18T21:11:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:11:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c3fff640 1 -- 172.21.15.5:0/124313308 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c413d900 con 0x7fa1c4069710 2024-08-18T21:11:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.728+0000 7fa1c37fe640 1 --2- 172.21.15.5:0/124313308 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa1c4138130 0x7fa1c41cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c3fff640 1 -- 172.21.15.5:0/124313308 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa1c4069710 msgr2=0x7fa1c41cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c3fff640 1 --2- 172.21.15.5:0/124313308 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa1c4069710 0x7fa1c41cd5b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc0215e0 tx=0x7fa1bc01dae0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c0ff9640 1 -- 172.21.15.5:0/124313308 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa1bc0c0020 con 0x7fa1c4069710 2024-08-18T21:11:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:11:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c0ff9640 10 monclient: dump: 2024-08-18T21:11:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:49.751 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c0ff9640 10 monclient: _finish_auth 0 2024-08-18T21:11:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c0ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:11:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c0ff9640 1 -- 172.21.15.5:0/124313308 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1bc0044b0 con 0x7fa1c4069710 2024-08-18T21:11:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1ca707640 5 monclient: authenticate success, global_id 114106 2024-08-18T21:11:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1ca707640 10 monclient: _renew_subs 2024-08-18T21:11:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1ca707640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:11:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1ca707640 1 -- 172.21.15.5:0/124313308 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c40a30e0 con 0x7fa1c4069710 2024-08-18T21:11:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c0ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c0ff9640 1 -- 172.21.15.5:0/124313308 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa1bc004660 con 0x7fa1c4069710 2024-08-18T21:11:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:11:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c0ff9640 10 monclient: dump: 2024-08-18T21:11:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:49.753 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c27fc640 4 set_mon_vals no callback set 2024-08-18T21:11:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1ca707640 10 monclient: _renew_subs 2024-08-18T21:11:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1ca707640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:11:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1ca707640 1 -- 172.21.15.5:0/124313308 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c413d620 con 0x7fa1c4069710 2024-08-18T21:11:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c0ff9640 1 -- 172.21.15.5:0/124313308 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fa1bc0c3020 con 0x7fa1c4069710 2024-08-18T21:11:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c0ff9640 1 --2- 172.21.15.5:0/124313308 >> v2:172.21.15.157:6812/631023601 conn(0x7fa1b003bdc0 0x7fa1b003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1ca707640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1ca707640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1ca707640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:11:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1ca707640 1 -- 172.21.15.5:0/124313308 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1c4077a10 con 0x7fa1c4069710 2024-08-18T21:11:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c0ff9640 1 -- 172.21.15.5:0/124313308 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(234..234 src has 22..234) ==== 3506+0+0 (secure 0 0 0) 0x7fa1c4071930 con 0x7fa1c4069710 2024-08-18T21:11:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c37fe640 1 --2- 172.21.15.5:0/124313308 >> v2:172.21.15.157:6812/631023601 conn(0x7fa1b003bdc0 0x7fa1b003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.732+0000 7fa1c37fe640 10 monclient: get_auth_request con 0x7fa1b003bdc0 auth_method 0 2024-08-18T21:11:49.755 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:49.755 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:49.756 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:11:49.756 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:11:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.736+0000 7fa1c37fe640 1 --2- 172.21.15.5:0/124313308 >> v2:172.21.15.157:6812/631023601 conn(0x7fa1b003bdc0 0x7fa1b003e280 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa1c413bc10 tx=0x7fa1b4009110 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.736+0000 7fa1c0ff9640 1 -- 172.21.15.5:0/124313308 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fa1c4077a10 con 0x7fa1c4069710 2024-08-18T21:11:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.736+0000 7fa1c0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.736+0000 7fa1c0ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:11:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:11:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:11:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 1 -- 172.21.15.5:0/124313308 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa1c4137bf0 con 0x7fa1c4069710 2024-08-18T21:11:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1c0ff9640 1 -- 172.21.15.5:0/124313308 <== mon.4 v2:172.21.15.5:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7fa1bc0ca030 con 0x7fa1c4069710 2024-08-18T21:11:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1c0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:11:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1c0ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:49.995 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":178,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:11:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 1 -- 172.21.15.5:0/124313308 >> v2:172.21.15.157:6812/631023601 conn(0x7fa1b003bdc0 msgr2=0x7fa1b003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 1 --2- 172.21.15.5:0/124313308 >> v2:172.21.15.157:6812/631023601 conn(0x7fa1b003bdc0 0x7fa1b003e280 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa1c413bc10 tx=0x7fa1b4009110 comp rx=0 tx=0).stop 2024-08-18T21:11:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 10 monclient: shutdown 2024-08-18T21:11:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 1 -- 172.21.15.5:0/124313308 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa1c4069710 msgr2=0x7fa1c41cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 1 --2- 172.21.15.5:0/124313308 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa1c4069710 0x7fa1c41cd5b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc0215e0 tx=0x7fa1bc01dae0 comp rx=0 tx=0).stop 2024-08-18T21:11:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 1 -- 172.21.15.5:0/124313308 shutdown_connections 2024-08-18T21:11:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 1 --2- 172.21.15.5:0/124313308 >> v2:172.21.15.157:6812/631023601 conn(0x7fa1b003bdc0 0x7fa1b003e280 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 1 --2- 172.21.15.5:0/124313308 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1c4138510 0x7fa1c41ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 1 --2- 172.21.15.5:0/124313308 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa1c4138130 0x7fa1c41cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 1 --2- 172.21.15.5:0/124313308 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa1c4069710 0x7fa1c41cd5b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 1 -- 172.21.15.5:0/124313308 >> 172.21.15.5:0/124313308 conn(0x7fa1c40a4b20 msgr2=0x7fa1c41328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 1 -- 172.21.15.5:0/124313308 shutdown_connections 2024-08-18T21:11:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:49.992+0000 7fa1ca707640 1 -- 172.21.15.5:0/124313308 wait complete. 2024-08-18T21:11:50.015 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:11:50.015 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:11:50.015 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:11:50.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.132+0000 7f5cf8bd3640 10 monclient: get_monmap_and_config 2024-08-18T21:11:50.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.132+0000 7f5cf8bd3640 10 monclient: build_initial_monmap 2024-08-18T21:11:50.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.132+0000 7f5cf8bd3640 10 monclient: monmap: 2024-08-18T21:11:50.140 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:50.140 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:50.138989+0000 2024-08-18T21:11:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:50.138989+0000 2024-08-18T21:11:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:50.142 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.132+0000 7f5cf8bd3640 1 Processor -- start 2024-08-18T21:11:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.132+0000 7f5cf8bd3640 1 -- start start 2024-08-18T21:11:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.132+0000 7f5cf8bd3640 10 monclient: init 2024-08-18T21:11:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf8bd3640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf8bd3640 10 monclient: _add_conns ranks=[3,4,8,5,9,7,6,2,0,1,10] 2024-08-18T21:11:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf8bd3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cf40a6ce0 0x7f5cf40a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf8bd3640 10 monclient(hunting): picked mon.noname-g con 0x7f5cf40a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf8bd3640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5cf40a7600 0x7f5cf4139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf8bd3640 10 monclient(hunting): picked mon.noname-c con 0x7f5cf40a7600 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf8bd3640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5cf4139fe0 0x7f5cf413a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf8bd3640 10 monclient(hunting): picked mon.noname-e con 0x7f5cf4139fe0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf8bd3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf8bd3640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf40a5000 con 0x7f5cf40a6ce0 2024-08-18T21:11:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf8bd3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf8bd3640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f5cf40a4360 con 0x7f5cf40a7600 2024-08-18T21:11:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf8bd3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf8bd3640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f5cf40a45d0 con 0x7f5cf4139fe0 2024-08-18T21:11:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf8bd3640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf8bd3640 10 monclient(hunting): authenticate will time out at 1477.152579s 2024-08-18T21:11:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf2d9d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5cf4139fe0 0x7f5cf413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5cf40a7600 0x7f5cf4139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5cf40a7600 0x7f5cf4139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:60184/0 (socket says 172.21.15.5:60184) 2024-08-18T21:11:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf2d9d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5cf4139fe0 0x7f5cf413a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:50744/0 (socket says 172.21.15.5:50744) 2024-08-18T21:11:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 1 -- 172.21.15.5:0/2591608209 learned_addr learned my addr 172.21.15.5:0/2591608209 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 10 monclient(hunting): get_auth_request con 0x7f5cf40a7600 auth_method 0 2024-08-18T21:11:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf2d9d640 10 monclient(hunting): get_auth_request con 0x7f5cf4139fe0 auth_method 0 2024-08-18T21:11:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf2d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf259c640 1 --2- 172.21.15.5:0/2591608209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cf40a6ce0 0x7f5cf40a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf259c640 10 monclient(hunting): get_auth_request con 0x7f5cf40a6ce0 auth_method 0 2024-08-18T21:11:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 10 monclient(hunting): handle_auth_done global_id 114115 payload 274 2024-08-18T21:11:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 1 -- 172.21.15.5:0/2591608209 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5cf4139fe0 msgr2=0x7f5cf413a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 1 --2- 172.21.15.5:0/2591608209 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5cf4139fe0 0x7f5cf413a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 1 -- 172.21.15.5:0/2591608209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cf40a6ce0 msgr2=0x7f5cf40a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 1 --2- 172.21.15.5:0/2591608209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cf40a6ce0 0x7f5cf40a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:11:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 1 monclient: found mon.noname-c 2024-08-18T21:11:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:11:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf1d9b640 1 -- 172.21.15.5:0/2591608209 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf40a32d0 con 0x7f5cf40a7600 2024-08-18T21:11:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.136+0000 7f5cf2d9d640 1 --2- 172.21.15.5:0/2591608209 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5cf4139fe0 0x7f5cf413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:50.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf1d9b640 1 -- 172.21.15.5:0/2591608209 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5cf40a7600 msgr2=0x7f5cf4139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf1d9b640 1 --2- 172.21.15.5:0/2591608209 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5cf40a7600 0x7f5cf4139aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80098a0 tx=0x7f5ce801c440 comp rx=0 tx=0).ready entity=mon.4 client_cookie=30179250f6b0730b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf159a640 1 -- 172.21.15.5:0/2591608209 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5ce80b0070 con 0x7f5cf40a7600 2024-08-18T21:11:50.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf159a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:11:50.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf159a640 10 monclient: dump: 2024-08-18T21:11:50.151 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.151 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.151 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.151 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.151 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.151 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.151 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.152 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf159a640 10 monclient: _finish_auth 0 2024-08-18T21:11:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf159a640 10 monclient: _check_auth_tickets 2024-08-18T21:11:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf159a640 1 -- 172.21.15.5:0/2591608209 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce80aa810 con 0x7f5cf40a7600 2024-08-18T21:11:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 5 monclient: authenticate success, global_id 114115 2024-08-18T21:11:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf159a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf159a640 1 -- 172.21.15.5:0/2591608209 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5ce80aae30 con 0x7f5cf40a7600 2024-08-18T21:11:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 4 set_mon_vals no callback set 2024-08-18T21:11:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:11:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf159a640 10 monclient: dump: 2024-08-18T21:11:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.154 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 10 monclient: shutdown 2024-08-18T21:11:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 -- 172.21.15.5:0/2591608209 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5cf40a7600 msgr2=0x7f5cf4139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 --2- 172.21.15.5:0/2591608209 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5cf40a7600 0x7f5cf4139aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80098a0 tx=0x7f5ce801c440 comp rx=0 tx=0).stop 2024-08-18T21:11:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 -- 172.21.15.5:0/2591608209 shutdown_connections 2024-08-18T21:11:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 --2- 172.21.15.5:0/2591608209 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5cf4139fe0 0x7f5cf413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 --2- 172.21.15.5:0/2591608209 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5cf40a7600 0x7f5cf4139aa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 --2- 172.21.15.5:0/2591608209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cf40a6ce0 0x7f5cf40a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 -- 172.21.15.5:0/2591608209 >> 172.21.15.5:0/2591608209 conn(0x7f5cf40acbc0 msgr2=0x7f5cf40a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 -- 172.21.15.5:0/2591608209 shutdown_connections 2024-08-18T21:11:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 -- 172.21.15.5:0/2591608209 wait complete. 2024-08-18T21:11:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 10 monclient: build_initial_monmap 2024-08-18T21:11:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 10 monclient: monmap: 2024-08-18T21:11:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:50.157 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 Processor -- start 2024-08-18T21:11:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 -- start start 2024-08-18T21:11:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 10 monclient: init 2024-08-18T21:11:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 10 monclient: _add_conns ranks=[1,7,6,4,0,3,8,2,5] 2024-08-18T21:11:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cf40a6ce0 0x7f5cf413fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 10 monclient(hunting): picked mon.noname-f con 0x7f5cf40a6ce0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:11:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5cf40a7600 0x7f5cf41402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 10 monclient(hunting): picked mon.noname-i con 0x7f5cf40a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5cf4139fe0 0x7f5cf413aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 10 monclient(hunting): picked mon.noname-d con 0x7f5cf4139fe0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf40a79e0 con 0x7f5cf40a6ce0 2024-08-18T21:11:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f5cf40a8220 con 0x7f5cf4139fe0 2024-08-18T21:11:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f5cf4135a80 con 0x7f5cf40a7600 2024-08-18T21:11:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf8bd3640 10 monclient(hunting): authenticate will time out at 1477.159726s 2024-08-18T21:11:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf2d9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5cf4139fe0 0x7f5cf413aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf2d9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5cf4139fe0 0x7f5cf413aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:53086/0 (socket says 172.21.15.5:53086) 2024-08-18T21:11:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf2d9d640 1 -- 172.21.15.5:0/924831407 learned_addr learned my addr 172.21.15.5:0/924831407 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf2d9d640 10 monclient(hunting): get_auth_request con 0x7f5cf4139fe0 auth_method 0 2024-08-18T21:11:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf2d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.140+0000 7f5cf2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf1d9b640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5cf40a7600 0x7f5cf41402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf1d9b640 10 monclient(hunting): get_auth_request con 0x7f5cf40a7600 auth_method 0 2024-08-18T21:11:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf1d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf259c640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cf40a6ce0 0x7f5cf413fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf2d9d640 10 monclient(hunting): handle_auth_done global_id 85254 payload 824 2024-08-18T21:11:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf2d9d640 1 -- 172.21.15.5:0/924831407 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5cf40a7600 msgr2=0x7f5cf41402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf2d9d640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5cf40a7600 0x7f5cf41402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf2d9d640 1 -- 172.21.15.5:0/924831407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cf40a6ce0 msgr2=0x7f5cf413fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf2d9d640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cf40a6ce0 0x7f5cf413fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf2d9d640 10 monclient: _finish_hunting 0 2024-08-18T21:11:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf2d9d640 1 monclient: found mon.noname-d 2024-08-18T21:11:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf2d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf2d9d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:11:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf2d9d640 1 -- 172.21.15.5:0/924831407 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf413e850 con 0x7f5cf4139fe0 2024-08-18T21:11:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf2d9d640 1 -- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5cf4139fe0 msgr2=0x7f5cf413aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf2d9d640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5cf4139fe0 0x7f5cf413aae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00efc0 tx=0x7f5cec00c490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5ce2ffd640 1 -- 172.21.15.5:0/924831407 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5cec018020 con 0x7f5cf4139fe0 2024-08-18T21:11:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5ce2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5ce2ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:11:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5ce2ffd640 10 monclient: dump: 2024-08-18T21:11:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.162 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5ce2ffd640 10 monclient: _finish_auth 0 2024-08-18T21:11:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5ce2ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:11:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5ce2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5ce2ffd640 1 -- 172.21.15.5:0/924831407 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cec0148f0 con 0x7f5cf4139fe0 2024-08-18T21:11:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf8bd3640 5 monclient: authenticate success, global_id 85254 2024-08-18T21:11:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5ce2ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5ce2ffd640 1 -- 172.21.15.5:0/924831407 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5cec0133e0 con 0x7f5cf4139fe0 2024-08-18T21:11:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5ce2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5ce2ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5ce2ffd640 10 monclient: dump: 2024-08-18T21:11:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.164 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf0d99640 4 set_mon_vals no callback set 2024-08-18T21:11:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf8bd3640 10 monclient: _renew_subs 2024-08-18T21:11:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf8bd3640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf8bd3640 1 -- 172.21.15.5:0/924831407 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf40aa390 con 0x7f5cf4139fe0 2024-08-18T21:11:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf8bd3640 10 monclient: _renew_subs 2024-08-18T21:11:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf8bd3640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf8bd3640 1 -- 172.21.15.5:0/924831407 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf413c4f0 con 0x7f5cf4139fe0 2024-08-18T21:11:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf8bd3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf8bd3640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf41d1620 0x7f5cf413b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf8bd3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf8bd3640 1 -- 172.21.15.5:0/924831407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf40a7b60 con 0x7f5cf41d1620 2024-08-18T21:11:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf259c640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf41d1620 0x7f5cf413b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf259c640 10 monclient: get_auth_request con 0x7f5cf41d1620 auth_method 0 2024-08-18T21:11:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf2d9d640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5cf4139fe0 0x7f5cf413aae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00efc0 tx=0x7f5cec00c490 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7f5cec01b020 mgrmap(e 5) 2024-08-18T21:11:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5ce2ffd640 1 -- 172.21.15.5:0/924831407 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f5cec01b020 con 0x7f5cf4139fe0 2024-08-18T21:11:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5cf259c640 10 monclient(hunting): handle_auth_done global_id 114120 payload 824 2024-08-18T21:11:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.144+0000 7f5ce2ffd640 1 --2- 172.21.15.5:0/924831407 >> v2:172.21.15.157:6812/631023601 conn(0x7f5cd403bdf0 0x7f5cd403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5cf259c640 1 -- 172.21.15.5:0/924831407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5cf4140840 con 0x7f5cf41d1620 2024-08-18T21:11:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5cf1d9b640 1 --2- 172.21.15.5:0/924831407 >> v2:172.21.15.157:6812/631023601 conn(0x7f5cd403bdf0 0x7f5cd403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5cf1d9b640 10 monclient: get_auth_request con 0x7f5cd403bdf0 auth_method 0 2024-08-18T21:11:50.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5cf259c640 1 -- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf41d1620 msgr2=0x7f5cf413b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5cf259c640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf41d1620 0x7f5cf413b020 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400e530 tx=0x7f5ce400e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5ce2ffd640 1 -- 172.21.15.5:0/924831407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5ce4017070 con 0x7f5cf41d1620 2024-08-18T21:11:50.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5ce2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5ce2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:11:50.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5ce2ffd640 10 monclient: dump: 2024-08-18T21:11:50.169 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.169 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.169 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.169 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.170 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5ce2ffd640 1 -- 172.21.15.5:0/924831407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5ce4013700 con 0x7f5cf41d1620 2024-08-18T21:11:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5ce2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5ce2ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5ce2ffd640 1 -- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf41d1620 msgr2=0x7f5cf413b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5ce2ffd640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf41d1620 0x7f5cf413b020 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400e530 tx=0x7f5ce400e9f0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5ce2ffd640 1 -- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf41d1620 msgr2=0x7f5cf413b020 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5ce2ffd640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf41d1620 0x7f5cf413b020 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400e530 tx=0x7f5ce400e9f0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.148+0000 7f5cf1d9b640 1 --2- 172.21.15.5:0/924831407 >> v2:172.21.15.157:6812/631023601 conn(0x7f5cd403bdf0 0x7f5cd403e2b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80098a0 tx=0x7f5ce80a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5cf8bd3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5cf8bd3640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf413b560 0x7f5cf409da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5cf8bd3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5cf8bd3640 1 -- 172.21.15.5:0/924831407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf413b970 con 0x7f5cf413b560 2024-08-18T21:11:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5cf259c640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf413b560 0x7f5cf409da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5cf259c640 10 monclient: get_auth_request con 0x7f5cf413b560 auth_method 0 2024-08-18T21:11:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5cf259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5cf259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5cf259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5cf259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5cf259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5cf259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5cf259c640 10 monclient(hunting): handle_auth_done global_id 114129 payload 824 2024-08-18T21:11:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5cf259c640 1 -- 172.21.15.5:0/924831407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5cf4068760 con 0x7f5cf413b560 2024-08-18T21:11:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5cf259c640 1 -- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf413b560 msgr2=0x7f5cf409da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5cf259c640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf413b560 0x7f5cf409da30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400e530 tx=0x7f5ce4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5ce2ffd640 1 -- 172.21.15.5:0/924831407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5ce400f040 con 0x7f5cf413b560 2024-08-18T21:11:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5ce2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5ce2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:11:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.156+0000 7f5ce2ffd640 10 monclient: dump: 2024-08-18T21:11:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.174 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5ce2ffd640 1 -- 172.21.15.5:0/924831407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9249 (secure 0 0 0) 0x7f5ce4026390 con 0x7f5cf413b560 2024-08-18T21:11:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5ce2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:50.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5ce2ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:50.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5ce2ffd640 1 -- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf413b560 msgr2=0x7f5cf409da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5ce2ffd640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf413b560 0x7f5cf409da30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400e530 tx=0x7f5ce4004740 comp rx=0 tx=0).stop 2024-08-18T21:11:50.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5ce2ffd640 1 -- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf413b560 msgr2=0x7f5cf409da30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:50.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5ce2ffd640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf413b560 0x7f5cf409da30 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400e530 tx=0x7f5ce4004740 comp rx=0 tx=0).stop 2024-08-18T21:11:50.175 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:11:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15311, 2024-08-18T21:11:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:11:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:50.198 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:50.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5cf8bd3640 1 -- 172.21.15.5:0/924831407 >> v2:172.21.15.157:6812/631023601 conn(0x7f5cd403bdf0 msgr2=0x7f5cd403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5cf8bd3640 1 --2- 172.21.15.5:0/924831407 >> v2:172.21.15.157:6812/631023601 conn(0x7f5cd403bdf0 0x7f5cd403e2b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80098a0 tx=0x7f5ce80a6000 comp rx=0 tx=0).stop 2024-08-18T21:11:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5cf8bd3640 10 monclient: shutdown 2024-08-18T21:11:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5cf8bd3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5cf8bd3640 1 -- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5cf4139fe0 msgr2=0x7f5cf413aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5cf8bd3640 1 --2- 172.21.15.5:0/924831407 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5cf4139fe0 0x7f5cf413aae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00efc0 tx=0x7f5cec00c490 comp rx=0 tx=0).stop 2024-08-18T21:11:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5cf2d9d640 1 -- 172.21.15.5:0/924831407 reap_dead start 2024-08-18T21:11:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5cf2d9d640 1 -- 172.21.15.5:0/924831407 reap_dead start 2024-08-18T21:11:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5ce2ffd640 1 -- 172.21.15.5:0/924831407 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(235..235 src has 22..235) ==== 3898+0+0 (unknown 0 0 0) 0x7f5cec04f3f0 con 0x7f5cf4139fe0 2024-08-18T21:11:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5cf8bd3640 1 -- 172.21.15.5:0/924831407 shutdown_connections 2024-08-18T21:11:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5cf8bd3640 1 -- 172.21.15.5:0/924831407 >> 172.21.15.5:0/924831407 conn(0x7f5cf40acbc0 msgr2=0x7f5cf4135c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5cf8bd3640 1 -- 172.21.15.5:0/924831407 shutdown_connections 2024-08-18T21:11:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.160+0000 7f5cf8bd3640 1 -- 172.21.15.5:0/924831407 wait complete. 2024-08-18T21:11:50.201 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:50.201 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:11:50.201 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:11:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 10 monclient: get_monmap_and_config 2024-08-18T21:11:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 10 monclient: build_initial_monmap 2024-08-18T21:11:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 10 monclient: monmap: 2024-08-18T21:11:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:50.329340+0000 2024-08-18T21:11:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:50.329340+0000 2024-08-18T21:11:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:50.328 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:50.328 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:50.328 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:50.328 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:50.328 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 1 Processor -- start 2024-08-18T21:11:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 1 -- start start 2024-08-18T21:11:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 10 monclient: init 2024-08-18T21:11:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 10 monclient: _add_conns ranks=[10,9,5,3,6,0,1,7,2,4,8] 2024-08-18T21:11:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3ecc0a6ce0 0x7f3ecc0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 10 monclient(hunting): picked mon.noname-f con 0x7f3ecc0a6ce0 addr v2:172.21.15.157:3300/0 2024-08-18T21:11:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ecc0a7600 0x7f3ecc139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 10 monclient(hunting): picked mon.noname-a con 0x7f3ecc0a7600 addr v2:172.21.15.5:3300/0 2024-08-18T21:11:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3ecc139fe0 0x7f3ecc13a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 10 monclient(hunting): picked mon.noname-h con 0x7f3ecc139fe0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3ecc0a5000 con 0x7f3ecc0a7600 2024-08-18T21:11:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3ecc0a4360 con 0x7f3ecc0a6ce0 2024-08-18T21:11:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f3ecc0a45d0 con 0x7f3ecc139fe0 2024-08-18T21:11:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed337c640 10 monclient(hunting): authenticate will time out at 1477.342608s 2024-08-18T21:11:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ecc0a7600 0x7f3ecc139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ecc0a7600 0x7f3ecc139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49772/0 (socket says 172.21.15.5:49772) 2024-08-18T21:11:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 1 -- 172.21.15.5:0/2906425741 learned_addr learned my addr 172.21.15.5:0/2906425741 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 10 monclient(hunting): get_auth_request con 0x7f3ecc0a7600 auth_method 0 2024-08-18T21:11:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed1118640 1 --2- 172.21.15.5:0/2906425741 >> v2:172.21.15.157:3300/0 conn(0x7f3ecc0a6ce0 0x7f3ecc0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed1118640 10 monclient(hunting): get_auth_request con 0x7f3ecc0a6ce0 auth_method 0 2024-08-18T21:11:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed1118640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed1118640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed1919640 1 --2- 172.21.15.5:0/2906425741 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3ecc139fe0 0x7f3ecc13a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed1118640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed1919640 10 monclient(hunting): get_auth_request con 0x7f3ecc139fe0 auth_method 0 2024-08-18T21:11:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed1919640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed1919640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed1919640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 10 monclient(hunting): handle_auth_done global_id 114138 payload 274 2024-08-18T21:11:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 1 -- 172.21.15.5:0/2906425741 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3ecc139fe0 msgr2=0x7f3ecc13a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 1 --2- 172.21.15.5:0/2906425741 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3ecc139fe0 0x7f3ecc13a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 1 -- 172.21.15.5:0/2906425741 >> v2:172.21.15.157:3300/0 conn(0x7f3ecc0a6ce0 msgr2=0x7f3ecc0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 1 --2- 172.21.15.5:0/2906425741 >> v2:172.21.15.157:3300/0 conn(0x7f3ecc0a6ce0 0x7f3ecc0a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 10 monclient: _finish_hunting 0 2024-08-18T21:11:50.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 1 monclient: found mon.noname-a 2024-08-18T21:11:50.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:50.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:11:50.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.324+0000 7f3ed0917640 1 -- 172.21.15.5:0/2906425741 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ecc0a32d0 con 0x7f3ecc0a7600 2024-08-18T21:11:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ed0917640 1 -- 172.21.15.5:0/2906425741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ecc0a7600 msgr2=0x7f3ecc139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ed0917640 1 --2- 172.21.15.5:0/2906425741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ecc0a7600 0x7f3ecc139aa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc06df00 tx=0x7f3ec801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5d1d1218cca6a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ec3fff640 1 -- 172.21.15.5:0/2906425741 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ec80b0070 con 0x7f3ecc0a7600 2024-08-18T21:11:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ec3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ec3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:11:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ec3fff640 10 monclient: dump: 2024-08-18T21:11:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.340 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ec3fff640 10 monclient: _finish_auth 0 2024-08-18T21:11:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ec3fff640 10 monclient: _check_auth_tickets 2024-08-18T21:11:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ec3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ec3fff640 1 -- 172.21.15.5:0/2906425741 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ec80aa810 con 0x7f3ecc0a7600 2024-08-18T21:11:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ec3fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ec3fff640 1 -- 172.21.15.5:0/2906425741 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ec80a9300 con 0x7f3ecc0a7600 2024-08-18T21:11:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ed337c640 5 monclient: authenticate success, global_id 114138 2024-08-18T21:11:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ed337c640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ed337c640 4 set_mon_vals no callback set 2024-08-18T21:11:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ec3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ec3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:11:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.328+0000 7f3ec3fff640 10 monclient: dump: 2024-08-18T21:11:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.345 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 10 monclient: shutdown 2024-08-18T21:11:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 -- 172.21.15.5:0/2906425741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ecc0a7600 msgr2=0x7f3ecc139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 --2- 172.21.15.5:0/2906425741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ecc0a7600 0x7f3ecc139aa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc06df00 tx=0x7f3ec801c3e0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 -- 172.21.15.5:0/2906425741 shutdown_connections 2024-08-18T21:11:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 --2- 172.21.15.5:0/2906425741 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3ecc139fe0 0x7f3ecc13a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 --2- 172.21.15.5:0/2906425741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ecc0a7600 0x7f3ecc139aa0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 --2- 172.21.15.5:0/2906425741 >> v2:172.21.15.157:3300/0 conn(0x7f3ecc0a6ce0 0x7f3ecc0a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 -- 172.21.15.5:0/2906425741 >> 172.21.15.5:0/2906425741 conn(0x7f3ecc0acbc0 msgr2=0x7f3ecc0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 -- 172.21.15.5:0/2906425741 shutdown_connections 2024-08-18T21:11:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 -- 172.21.15.5:0/2906425741 wait complete. 2024-08-18T21:11:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 10 monclient: build_initial_monmap 2024-08-18T21:11:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 10 monclient: monmap: 2024-08-18T21:11:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:50.347 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 Processor -- start 2024-08-18T21:11:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 -- start start 2024-08-18T21:11:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 10 monclient: init 2024-08-18T21:11:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 10 monclient: _add_conns ranks=[1,5,2,0,4,6,3,7,8] 2024-08-18T21:11:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ecc0a6ce0 0x7f3ecc132cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 10 monclient(hunting): picked mon.noname-f con 0x7f3ecc0a6ce0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:11:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3ecc0a7600 0x7f3ecc133200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 10 monclient(hunting): picked mon.noname-h con 0x7f3ecc0a7600 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc139fe0 0x7f3ecc0a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 10 monclient(hunting): picked mon.noname-b con 0x7f3ecc139fe0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:11:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc0a79e0 con 0x7f3ecc0a6ce0 2024-08-18T21:11:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f3ecc0a8220 con 0x7f3ecc139fe0 2024-08-18T21:11:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f3ecc13ad10 con 0x7f3ecc0a7600 2024-08-18T21:11:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed337c640 10 monclient(hunting): authenticate will time out at 1477.350028s 2024-08-18T21:11:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc139fe0 0x7f3ecc0a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc139fe0 0x7f3ecc0a07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:37284/0 (socket says 172.21.15.5:37284) 2024-08-18T21:11:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 1 -- 172.21.15.5:0/804357269 learned_addr learned my addr 172.21.15.5:0/804357269 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 10 monclient(hunting): get_auth_request con 0x7f3ecc139fe0 auth_method 0 2024-08-18T21:11:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed0917640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3ecc0a7600 0x7f3ecc133200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1118640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ecc0a6ce0 0x7f3ecc132cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1118640 10 monclient(hunting): get_auth_request con 0x7f3ecc0a6ce0 auth_method 0 2024-08-18T21:11:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1118640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1118640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1118640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed0917640 10 monclient(hunting): get_auth_request con 0x7f3ecc0a7600 auth_method 0 2024-08-18T21:11:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed0917640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed0917640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed0917640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 10 monclient(hunting): handle_auth_done global_id 114104 payload 824 2024-08-18T21:11:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 1 -- 172.21.15.5:0/804357269 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3ecc0a7600 msgr2=0x7f3ecc133200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3ecc0a7600 0x7f3ecc133200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 1 -- 172.21.15.5:0/804357269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ecc0a6ce0 msgr2=0x7f3ecc132cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ecc0a6ce0 0x7f3ecc132cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 10 monclient: _finish_hunting 0 2024-08-18T21:11:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 1 monclient: found mon.noname-b 2024-08-18T21:11:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:11:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1919640 1 -- 172.21.15.5:0/804357269 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ecc13c230 con 0x7f3ecc139fe0 2024-08-18T21:11:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.332+0000 7f3ed1118640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ecc0a6ce0 0x7f3ecc132cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:11:50.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed1919640 1 -- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc139fe0 msgr2=0x7f3ecc0a07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed1919640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc139fe0 0x7f3ecc0a07f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4007e90 tx=0x7f3ec400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec1ffb640 1 -- 172.21.15.5:0/804357269 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ec4014890 con 0x7f3ecc139fe0 2024-08-18T21:11:50.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:11:50.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec1ffb640 10 monclient: dump: 2024-08-18T21:11:50.356 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.356 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.356 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.357 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec1ffb640 10 monclient: _finish_auth 0 2024-08-18T21:11:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec1ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:11:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec1ffb640 1 -- 172.21.15.5:0/804357269 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ec4019070 con 0x7f3ecc139fe0 2024-08-18T21:11:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec1ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec1ffb640 1 -- 172.21.15.5:0/804357269 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ec4013380 con 0x7f3ecc139fe0 2024-08-18T21:11:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed337c640 5 monclient: authenticate success, global_id 114104 2024-08-18T21:11:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed337c640 10 monclient: _renew_subs 2024-08-18T21:11:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed337c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:11:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed337c640 1 -- 172.21.15.5:0/804357269 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ecc13c510 con 0x7f3ecc139fe0 2024-08-18T21:11:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec37fe640 4 set_mon_vals no callback set 2024-08-18T21:11:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:11:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec1ffb640 10 monclient: dump: 2024-08-18T21:11:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.360 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed337c640 10 monclient: _renew_subs 2024-08-18T21:11:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed337c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:11:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed337c640 1 -- 172.21.15.5:0/804357269 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ecc13bf50 con 0x7f3ecc139fe0 2024-08-18T21:11:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed337c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed337c640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc0a0d30 0x7f3ecc0a1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed337c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed337c640 1 -- 172.21.15.5:0/804357269 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f3ecc051140 con 0x7f3ecc0a0d30 2024-08-18T21:11:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed1118640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc0a0d30 0x7f3ecc0a1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed1118640 10 monclient: get_auth_request con 0x7f3ecc0a0d30 auth_method 0 2024-08-18T21:11:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed1118640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed1118640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed1118640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed1118640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed1118640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed1118640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec1ffb640 1 -- 172.21.15.5:0/804357269 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f3ec4014420 con 0x7f3ecc139fe0 2024-08-18T21:11:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed1118640 10 monclient(hunting): handle_auth_done global_id 114113 payload 824 2024-08-18T21:11:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec1ffb640 1 --2- 172.21.15.5:0/804357269 >> v2:172.21.15.157:6812/631023601 conn(0x7f3eb003bdc0 0x7f3eb003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed1118640 1 -- 172.21.15.5:0/804357269 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ecc0aa320 con 0x7f3ecc0a0d30 2024-08-18T21:11:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ec1ffb640 1 -- 172.21.15.5:0/804357269 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(235..235 src has 22..235) ==== 3898+0+0 (secure 0 0 0) 0x7f3ec404ee70 con 0x7f3ecc139fe0 2024-08-18T21:11:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed0917640 1 --2- 172.21.15.5:0/804357269 >> v2:172.21.15.157:6812/631023601 conn(0x7f3eb003bdc0 0x7f3eb003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.336+0000 7f3ed0917640 10 monclient: get_auth_request con 0x7f3eb003bdc0 auth_method 0 2024-08-18T21:11:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.340+0000 7f3ed1118640 1 -- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc0a0d30 msgr2=0x7f3ecc0a1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.340+0000 7f3ed1118640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc0a0d30 0x7f3ecc0a1110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00f550 tx=0x7f3ebc00fa10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.340+0000 7f3ec1ffb640 1 -- 172.21.15.5:0/804357269 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ebc019030 con 0x7f3ecc0a0d30 2024-08-18T21:11:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.340+0000 7f3ec1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.340+0000 7f3ec1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:11:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.340+0000 7f3ec1ffb640 10 monclient: dump: 2024-08-18T21:11:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.363 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.340+0000 7f3ec1ffb640 1 -- 172.21.15.5:0/804357269 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3ebc014880 con 0x7f3ecc0a0d30 2024-08-18T21:11:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.340+0000 7f3ec1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.340+0000 7f3ec1ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.340+0000 7f3ec1ffb640 1 -- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc0a0d30 msgr2=0x7f3ecc0a1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.340+0000 7f3ec1ffb640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc0a0d30 0x7f3ecc0a1110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00f550 tx=0x7f3ebc00fa10 comp rx=0 tx=0).stop 2024-08-18T21:11:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.340+0000 7f3ec1ffb640 1 -- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc0a0d30 msgr2=0x7f3ecc0a1110 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.340+0000 7f3ec1ffb640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc0a0d30 0x7f3ecc0a1110 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00f550 tx=0x7f3ebc00fa10 comp rx=0 tx=0).stop 2024-08-18T21:11:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.340+0000 7f3ed0917640 1 --2- 172.21.15.5:0/804357269 >> v2:172.21.15.157:6812/631023601 conn(0x7f3eb003bdc0 0x7f3eb003e280 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80ad000 tx=0x7f3ec80a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.344+0000 7f3ed337c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.344+0000 7f3ed337c640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc0a1650 0x7f3ecc133c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.344+0000 7f3ed337c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.344+0000 7f3ed337c640 1 -- 172.21.15.5:0/804357269 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f3ecc069fa0 con 0x7f3ecc0a1650 2024-08-18T21:11:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.344+0000 7f3ed1118640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc0a1650 0x7f3ecc133c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.344+0000 7f3ed1118640 10 monclient: get_auth_request con 0x7f3ecc0a1650 auth_method 0 2024-08-18T21:11:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.344+0000 7f3ed1118640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.344+0000 7f3ed1118640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.344+0000 7f3ed1118640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.344+0000 7f3ed1118640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.344+0000 7f3ed1118640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.344+0000 7f3ed1118640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.344+0000 7f3ed1118640 10 monclient(hunting): handle_auth_done global_id 114122 payload 824 2024-08-18T21:11:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ed1118640 1 -- 172.21.15.5:0/804357269 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3ecc135a60 con 0x7f3ecc0a1650 2024-08-18T21:11:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ed1118640 1 -- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc0a1650 msgr2=0x7f3ecc133c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ed1118640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc0a1650 0x7f3ecc133c50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc019000 tx=0x7f3ebc0046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ec1ffb640 1 -- 172.21.15.5:0/804357269 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ebc01fc80 con 0x7f3ecc0a1650 2024-08-18T21:11:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ec1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ec1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:11:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ec1ffb640 10 monclient: dump: 2024-08-18T21:11:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.366 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ec1ffb640 1 -- 172.21.15.5:0/804357269 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f3ebc01f810 con 0x7f3ecc0a1650 2024-08-18T21:11:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ec1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:50.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ec1ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:50.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ec1ffb640 1 -- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc0a1650 msgr2=0x7f3ecc133c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ec1ffb640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc0a1650 0x7f3ecc133c50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc019000 tx=0x7f3ebc0046d0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ec1ffb640 1 -- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc0a1650 msgr2=0x7f3ecc133c50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:50.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ec1ffb640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc0a1650 0x7f3ecc133c50 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc019000 tx=0x7f3ebc0046d0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.367 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:50.367 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:50.367 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:50.368 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:50.368 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:50.368 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15503, 2024-08-18T21:11:50.368 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:50.368 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:50.368 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:50.368 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:50.368 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:50.368 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:50.368 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:50.368 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:50.368 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:50.368 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:50.369 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.369 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:11:50.369 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:50.369 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:50.369 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:50.369 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:50.369 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:50.369 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:50.370 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:50.370 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:50.370 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:50.370 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:50.370 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:50.370 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:50.370 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:50.370 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:50.370 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.370 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:50.370 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:50.370 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:50.370 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:50.371 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:50.371 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:50.371 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:50.371 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:50.371 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:50.371 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:50.371 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:50.371 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:50.371 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:50.371 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.371 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:50.371 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:50.371 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:50.372 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:50.372 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:50.372 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:50.372 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:50.372 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:50.372 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:50.372 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:50.372 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:50.372 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:50.372 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:50.372 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:50.372 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:50.372 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:50.373 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:50.373 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:50.373 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:50.373 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:50.373 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:50.373 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:50.373 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:50.373 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:50.373 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:50.373 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:50.373 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:50.373 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:50.373 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.373 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:50.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.374 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:50.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.374 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:50.374 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:50.374 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.374 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.374 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.374 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:50.374 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.375 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.375 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:50.375 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.375 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.375 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.375 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:50.375 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:50.375 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.375 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.375 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.376 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:50.376 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:50.376 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.376 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.376 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.376 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:50.376 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.376 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.376 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:50.377 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.377 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.377 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.377 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:50.377 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:50.377 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.377 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.377 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.377 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:50.377 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:50.378 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.378 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.378 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.378 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:50.378 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.378 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.378 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:50.378 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.378 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.378 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.379 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:50.379 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:50.379 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.379 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.379 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.379 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:50.379 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:50.379 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.379 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.380 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.380 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:50.380 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.380 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.380 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.380 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:50.380 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.380 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.380 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.380 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:50.380 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:50.381 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.381 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.381 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.381 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:50.381 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:50.381 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.381 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.381 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:50.381 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:50.384 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.384 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.384 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:50.384 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:50.384 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.384 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.384 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.384 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:50.384 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:50.384 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.385 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.385 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.385 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.385 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:50.385 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.385 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.385 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.385 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:50.385 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.385 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.385 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.386 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:50.386 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:50.386 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.386 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.386 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.386 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:50.386 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:50.386 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.386 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.386 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.388 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.388 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.388 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:50.388 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:50.388 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:50.388 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.389 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:50.389 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.389 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.389 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:50.389 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:50.389 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.389 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.389 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.389 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.390 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.390 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:50.390 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:50.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.390 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:50.390 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:50.390 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:50.390 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.390 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.390 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:50.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.391 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:50.391 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:50.391 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:11:50.391 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.391 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.391 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:50.391 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ed337c640 1 -- 172.21.15.5:0/804357269 >> v2:172.21.15.157:6812/631023601 conn(0x7f3eb003bdc0 msgr2=0x7f3eb003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ed337c640 1 --2- 172.21.15.5:0/804357269 >> v2:172.21.15.157:6812/631023601 conn(0x7f3eb003bdc0 0x7f3eb003e280 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80ad000 tx=0x7f3ec80a6000 comp rx=0 tx=0).stop 2024-08-18T21:11:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ed337c640 10 monclient: shutdown 2024-08-18T21:11:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ed337c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ed337c640 1 -- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc139fe0 msgr2=0x7f3ecc0a07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ed337c640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc139fe0 0x7f3ecc0a07f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4007e90 tx=0x7f3ec400e4b0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ed1919640 1 -- 172.21.15.5:0/804357269 reap_dead start 2024-08-18T21:11:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ed337c640 1 -- 172.21.15.5:0/804357269 shutdown_connections 2024-08-18T21:11:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ed337c640 1 --2- 172.21.15.5:0/804357269 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3ecc139fe0 0x7f3ecc0a07f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ed337c640 1 -- 172.21.15.5:0/804357269 >> 172.21.15.5:0/804357269 conn(0x7f3ecc0acbc0 msgr2=0x7f3ecc135c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ed337c640 1 -- 172.21.15.5:0/804357269 shutdown_connections 2024-08-18T21:11:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.348+0000 7f3ed337c640 1 -- 172.21.15.5:0/804357269 wait complete. 2024-08-18T21:11:50.394 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:50.394 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:11:50.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:11:50.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.508+0000 7f4489585640 10 monclient: get_monmap_and_config 2024-08-18T21:11:50.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.508+0000 7f4489585640 10 monclient: build_initial_monmap 2024-08-18T21:11:50.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.508+0000 7f4489585640 10 monclient: monmap: 2024-08-18T21:11:50.514 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:50.514 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.514 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:50.515684+0000 2024-08-18T21:11:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:50.515684+0000 2024-08-18T21:11:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:50.516 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4489585640 1 Processor -- start 2024-08-18T21:11:50.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4489585640 1 -- start start 2024-08-18T21:11:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4489585640 10 monclient: init 2024-08-18T21:11:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4489585640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4489585640 10 monclient: _add_conns ranks=[2,0,1,7,5,6,10,8,3,4,9] 2024-08-18T21:11:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4489585640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f44840a6bd0 0x7f44840a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4489585640 10 monclient(hunting): picked mon.noname-b con 0x7f44840a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:11:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4489585640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f448409f080 addr v1:172.21.15.5:6789/0 2024-08-18T21:11:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4489585640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f44840a74f0 addr v1:172.21.15.157:6789/0 2024-08-18T21:11:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4489585640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448413a7b0 con 0x7f448409f080 2024-08-18T21:11:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4489585640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44840a7fb0 con 0x7f44840a74f0 2024-08-18T21:11:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4489585640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4489585640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f448409e4c0 con 0x7f44840a6bd0 2024-08-18T21:11:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4489585640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4489585640 10 monclient(hunting): authenticate will time out at 1477.529261s 2024-08-18T21:11:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f44827fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f448409f080 0x7f4484139990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49132/0 (socket says 172.21.15.5:49132) 2024-08-18T21:11:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f44827fc640 1 -- 172.21.15.5:0/1587234089 learned_addr learned my addr 172.21.15.5:0/1587234089 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:11:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4482ffd640 1 --2- 172.21.15.5:0/1587234089 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f44840a6bd0 0x7f44840a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4482ffd640 10 monclient(hunting): get_auth_request con 0x7f44840a6bd0 auth_method 0 2024-08-18T21:11:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4482ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4482ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4482ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4482ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4482ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4482ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4482ffd640 10 monclient(hunting): handle_auth_done global_id 114131 payload 274 2024-08-18T21:11:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4482ffd640 1 -- 172.21.15.5:0/1587234089 >> v1:172.21.15.157:6789/0 conn(0x7f44840a74f0 legacy=0x7f448413a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4482ffd640 1 -- 172.21.15.5:0/1587234089 >> v1:172.21.15.5:6789/0 conn(0x7f448409f080 legacy=0x7f4484139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:50.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4482ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:11:50.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4482ffd640 1 monclient: found mon.noname-b 2024-08-18T21:11:50.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4482ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:50.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4482ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:11:50.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.512+0000 7f4482ffd640 1 -- 172.21.15.5:0/1587234089 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448409de70 con 0x7f44840a6bd0 2024-08-18T21:11:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4482ffd640 1 -- 172.21.15.5:0/1587234089 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f44840a6bd0 msgr2=0x7f44840a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4482ffd640 1 --2- 172.21.15.5:0/1587234089 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f44840a6bd0 0x7f44840a6fb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f44740097f0 tx=0x7f447401c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b42949fcb4cea020 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4481ffb640 1 -- 172.21.15.5:0/1587234089 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f44740b0070 con 0x7f44840a6bd0 2024-08-18T21:11:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4481ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4481ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:11:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4481ffb640 10 monclient: dump: 2024-08-18T21:11:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.523 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4481ffb640 10 monclient: _finish_auth 0 2024-08-18T21:11:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4481ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:11:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4481ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4481ffb640 1 -- 172.21.15.5:0/1587234089 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44740aa810 con 0x7f44840a6bd0 2024-08-18T21:11:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4481ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4489585640 5 monclient: authenticate success, global_id 114131 2024-08-18T21:11:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4481ffb640 1 -- 172.21.15.5:0/1587234089 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f44740aae30 con 0x7f44840a6bd0 2024-08-18T21:11:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4489585640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4481ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4489585640 4 set_mon_vals no callback set 2024-08-18T21:11:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4481ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:11:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4481ffb640 10 monclient: dump: 2024-08-18T21:11:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.525 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4489585640 10 monclient: shutdown 2024-08-18T21:11:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4489585640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4489585640 1 -- 172.21.15.5:0/1587234089 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f44840a6bd0 msgr2=0x7f44840a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4489585640 1 --2- 172.21.15.5:0/1587234089 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f44840a6bd0 0x7f44840a6fb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f44740097f0 tx=0x7f447401c3a0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4489585640 1 -- 172.21.15.5:0/1587234089 shutdown_connections 2024-08-18T21:11:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4489585640 1 --2- 172.21.15.5:0/1587234089 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f44840a6bd0 0x7f44840a6fb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4489585640 1 -- 172.21.15.5:0/1587234089 >> 172.21.15.5:0/1587234089 conn(0x7f4484068700 msgr2=0x7f4484068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4489585640 1 -- 172.21.15.5:0/1587234089 shutdown_connections 2024-08-18T21:11:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.516+0000 7f4489585640 1 -- 172.21.15.5:0/1587234089 wait complete. 2024-08-18T21:11:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 10 monclient: build_initial_monmap 2024-08-18T21:11:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 10 monclient: monmap: 2024-08-18T21:11:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:50.527 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 1 Processor -- start 2024-08-18T21:11:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 1 -- start start 2024-08-18T21:11:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 10 monclient: init 2024-08-18T21:11:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 10 monclient: _add_conns ranks=[5,8,0,3,6,4,7,1,2] 2024-08-18T21:11:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f448409f080 0x7f4484140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 10 monclient(hunting): picked mon.noname-h con 0x7f448409f080 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f44840a6bd0 0x7f44841d1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 10 monclient(hunting): picked mon.noname-e con 0x7f44840a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44840a74f0 0x7f448413e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 10 monclient(hunting): picked mon.noname-a con 0x7f44840a74f0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:11:50.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4484145630 con 0x7f44840a74f0 2024-08-18T21:11:50.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f44840a89f0 con 0x7f448409f080 2024-08-18T21:11:50.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f44841457b0 con 0x7f44840a6bd0 2024-08-18T21:11:50.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:50.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4489585640 10 monclient(hunting): authenticate will time out at 1477.537386s 2024-08-18T21:11:50.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44840a74f0 0x7f448413e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44840a74f0 0x7f448413e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49784/0 (socket says 172.21.15.5:49784) 2024-08-18T21:11:50.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 1 -- 172.21.15.5:0/1469207632 learned_addr learned my addr 172.21.15.5:0/1469207632 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:50.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 10 monclient(hunting): get_auth_request con 0x7f44840a74f0 auth_method 0 2024-08-18T21:11:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44827fc640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f44840a6bd0 0x7f44841d1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44827fc640 10 monclient(hunting): get_auth_request con 0x7f44840a6bd0 auth_method 0 2024-08-18T21:11:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44827fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44827fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44827fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4482ffd640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f448409f080 0x7f4484140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44827fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44827fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44827fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4482ffd640 10 monclient(hunting): get_auth_request con 0x7f448409f080 auth_method 0 2024-08-18T21:11:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4482ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4482ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4482ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 10 monclient(hunting): handle_auth_done global_id 114147 payload 824 2024-08-18T21:11:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 1 -- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f44840a6bd0 msgr2=0x7f44841d1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f44840a6bd0 0x7f44841d1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 1 -- 172.21.15.5:0/1469207632 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f448409f080 msgr2=0x7f4484140d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f448409f080 0x7f4484140d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 10 monclient: _finish_hunting 0 2024-08-18T21:11:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 1 monclient: found mon.noname-a 2024-08-18T21:11:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:11:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f44837fe640 1 -- 172.21.15.5:0/1469207632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4484122bc0 con 0x7f44840a74f0 2024-08-18T21:11:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.520+0000 7f4482ffd640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f448409f080 0x7f4484140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:11:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f44837fe640 1 -- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44840a74f0 msgr2=0x7f448413e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f44837fe640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44840a74f0 0x7f448413e7e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f447c00b9a0 tx=0x7f447c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f446b7fe640 1 -- 172.21.15.5:0/1469207632 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f447c019070 con 0x7f44840a74f0 2024-08-18T21:11:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f446b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f446b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:11:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f446b7fe640 10 monclient: dump: 2024-08-18T21:11:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.538 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f446b7fe640 10 monclient: _finish_auth 0 2024-08-18T21:11:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f446b7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:11:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f446b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f446b7fe640 1 -- 172.21.15.5:0/1469207632 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447c00cbb0 con 0x7f44840a74f0 2024-08-18T21:11:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f446b7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f446b7fe640 1 -- 172.21.15.5:0/1469207632 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f447c00cd60 con 0x7f44840a74f0 2024-08-18T21:11:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f446b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f446b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:11:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f446b7fe640 10 monclient: dump: 2024-08-18T21:11:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.539 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f44817fa640 4 set_mon_vals no callback set 2024-08-18T21:11:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4489585640 5 monclient: authenticate success, global_id 114147 2024-08-18T21:11:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4489585640 10 monclient: _renew_subs 2024-08-18T21:11:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4489585640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:11:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4489585640 1 -- 172.21.15.5:0/1469207632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4484122ea0 con 0x7f44840a74f0 2024-08-18T21:11:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4489585640 10 monclient: _renew_subs 2024-08-18T21:11:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4489585640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:11:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4489585640 1 -- 172.21.15.5:0/1469207632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44840abfc0 con 0x7f44840a74f0 2024-08-18T21:11:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4489585640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4489585640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f44841d21d0 0x7f448413ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4489585640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4489585640 1 -- 172.21.15.5:0/1469207632 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f44841ca640 con 0x7f44841d21d0 2024-08-18T21:11:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f446b7fe640 1 -- 172.21.15.5:0/1469207632 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f447c006d10 con 0x7f44840a74f0 2024-08-18T21:11:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4482ffd640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f44841d21d0 0x7f448413ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4482ffd640 10 monclient: get_auth_request con 0x7f44841d21d0 auth_method 0 2024-08-18T21:11:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4482ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4482ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4482ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f446b7fe640 1 --2- 172.21.15.5:0/1469207632 >> v2:172.21.15.157:6812/631023601 conn(0x7f447003bdc0 0x7f447003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4482ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4482ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4482ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f446b7fe640 1 -- 172.21.15.5:0/1469207632 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(235..235 src has 22..235) ==== 3898+0+0 (secure 0 0 0) 0x7f447c04df40 con 0x7f44840a74f0 2024-08-18T21:11:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4482ffd640 10 monclient(hunting): handle_auth_done global_id 114124 payload 824 2024-08-18T21:11:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f4482ffd640 1 -- 172.21.15.5:0/1469207632 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44840aba70 con 0x7f44841d21d0 2024-08-18T21:11:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f44827fc640 1 --2- 172.21.15.5:0/1469207632 >> v2:172.21.15.157:6812/631023601 conn(0x7f447003bdc0 0x7f447003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.524+0000 7f44827fc640 10 monclient: get_auth_request con 0x7f447003bdc0 auth_method 0 2024-08-18T21:11:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.528+0000 7f4482ffd640 1 -- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f44841d21d0 msgr2=0x7f448413ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.528+0000 7f4482ffd640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f44841d21d0 0x7f448413ed20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f448406f1f0 tx=0x7f4474019140 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.528+0000 7f446b7fe640 1 -- 172.21.15.5:0/1469207632 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f44740ba020 con 0x7f44841d21d0 2024-08-18T21:11:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.528+0000 7f446b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.528+0000 7f446b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:11:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.528+0000 7f446b7fe640 10 monclient: dump: 2024-08-18T21:11:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.543 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.528+0000 7f446b7fe640 1 -- 172.21.15.5:0/1469207632 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f44740039d0 con 0x7f44841d21d0 2024-08-18T21:11:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.528+0000 7f446b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.528+0000 7f446b7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.528+0000 7f446b7fe640 1 -- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f44841d21d0 msgr2=0x7f448413ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.528+0000 7f446b7fe640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f44841d21d0 0x7f448413ed20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f448406f1f0 tx=0x7f4474019140 comp rx=0 tx=0).stop 2024-08-18T21:11:50.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.528+0000 7f446b7fe640 1 -- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f44841d21d0 msgr2=0x7f448413ed20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:50.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.528+0000 7f446b7fe640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f44841d21d0 0x7f448413ed20 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f448406f1f0 tx=0x7f4474019140 comp rx=0 tx=0).stop 2024-08-18T21:11:50.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.528+0000 7f44827fc640 1 --2- 172.21.15.5:0/1469207632 >> v2:172.21.15.157:6812/631023601 conn(0x7f447003bdc0 0x7f447003e280 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4478007ca0 tx=0x7f4478007bf0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.532+0000 7f4489585640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:50.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.532+0000 7f4489585640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f448413f260 0x7f448413abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.532+0000 7f4489585640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.532+0000 7f4489585640 1 -- 172.21.15.5:0/1469207632 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f4484051140 con 0x7f448413f260 2024-08-18T21:11:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.532+0000 7f4482ffd640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f448413f260 0x7f448413abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.532+0000 7f4482ffd640 10 monclient: get_auth_request con 0x7f448413f260 auth_method 0 2024-08-18T21:11:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.532+0000 7f4482ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.532+0000 7f4482ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.532+0000 7f4482ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.532+0000 7f4482ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.532+0000 7f4482ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.532+0000 7f4482ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.532+0000 7f4482ffd640 10 monclient(hunting): handle_auth_done global_id 114133 payload 824 2024-08-18T21:11:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.532+0000 7f4482ffd640 1 -- 172.21.15.5:0/1469207632 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f448413f670 con 0x7f448413f260 2024-08-18T21:11:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f4482ffd640 1 -- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f448413f260 msgr2=0x7f448413abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f4482ffd640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f448413f260 0x7f448413abb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f447401c3e0 tx=0x7f44740a8000 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f446b7fe640 1 -- 172.21.15.5:0/1469207632 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f44740ba040 con 0x7f448413f260 2024-08-18T21:11:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f446b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f446b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:11:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f446b7fe640 10 monclient: dump: 2024-08-18T21:11:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.548 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f446b7fe640 1 -- 172.21.15.5:0/1469207632 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f44740b6960 con 0x7f448413f260 2024-08-18T21:11:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f446b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f446b7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f446b7fe640 1 -- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f448413f260 msgr2=0x7f448413abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f446b7fe640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f448413f260 0x7f448413abb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f447401c3e0 tx=0x7f44740a8000 comp rx=0 tx=0).stop 2024-08-18T21:11:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f446b7fe640 1 -- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f448413f260 msgr2=0x7f448413abb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f446b7fe640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f448413f260 0x7f448413abb0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f447401c3e0 tx=0x7f44740a8000 comp rx=0 tx=0).stop 2024-08-18T21:11:50.549 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:50.549 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:50.549 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:50.549 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:50.549 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:50.549 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15695, 2024-08-18T21:11:50.549 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:50.549 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:50.549 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:50.549 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:50.549 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:11:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:50.552 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:50.552 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:50.552 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:50.552 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:50.552 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:50.552 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:50.552 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:50.552 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:50.552 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:50.552 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:50.552 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.552 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:50.553 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:50.553 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:50.553 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:50.553 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:50.553 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:50.553 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:50.553 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:50.553 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:50.553 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:50.553 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:50.553 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:50.553 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:50.553 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:50.553 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:50.554 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:50.554 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:50.554 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:50.554 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:50.554 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:50.554 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:50.554 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:50.554 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:50.554 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:50.554 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:50.554 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:50.554 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:50.554 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:50.554 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.555 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:50.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.555 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:50.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.555 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:50.555 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:50.555 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.555 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.555 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.555 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:50.555 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.556 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.556 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.556 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:50.556 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.556 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.556 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.556 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:50.556 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:50.556 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.556 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.556 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:50.557 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:50.557 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.557 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.557 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.557 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:50.557 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.557 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.557 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:50.558 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.558 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.558 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.558 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:50.558 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:50.558 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.558 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.558 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.558 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.558 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:50.558 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:50.558 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.559 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.559 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.559 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:50.559 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.559 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.559 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:50.559 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.559 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.559 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.560 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:50.560 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:50.560 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.560 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.560 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.560 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:50.560 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:50.560 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.560 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.560 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.560 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.561 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:50.561 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.561 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.561 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:50.561 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.561 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.561 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.561 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:50.561 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:50.561 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.561 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.562 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:50.562 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:50.562 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.562 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.562 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.562 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:50.562 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.562 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.563 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:50.563 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.563 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.563 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.563 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:50.563 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:50.563 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.563 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.563 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.563 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:50.563 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:50.564 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.564 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.564 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.564 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:50.564 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.564 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.564 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:50.564 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.565 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.565 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.565 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:50.565 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:50.565 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.565 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.565 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.565 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.565 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:50.565 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:50.565 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.566 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.566 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.566 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:50.566 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.566 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.566 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:50.566 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.566 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.566 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.566 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:50.567 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:50.567 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.567 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.567 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.567 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:50.567 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:50.567 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.567 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.567 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.567 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:50.568 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.568 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.568 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:50.568 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.568 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.568 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.568 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:50.568 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:50.568 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.568 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.568 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.569 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:50.569 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:50.569 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.569 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.569 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:50.569 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.570 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.570 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:50.570 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.570 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.570 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.570 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:50.570 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:50.570 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.570 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.570 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.570 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.570 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.571 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:50.571 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:50.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.571 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:50.571 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:50.571 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:50.571 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.571 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.571 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:50.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.571 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:50.571 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:50.571 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:50.572 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.572 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.572 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:50.572 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f4489585640 1 -- 172.21.15.5:0/1469207632 >> v2:172.21.15.157:6812/631023601 conn(0x7f447003bdc0 msgr2=0x7f447003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f4489585640 1 --2- 172.21.15.5:0/1469207632 >> v2:172.21.15.157:6812/631023601 conn(0x7f447003bdc0 0x7f447003e280 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4478007ca0 tx=0x7f4478007bf0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f4489585640 10 monclient: shutdown 2024-08-18T21:11:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f4489585640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f4489585640 1 -- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44840a74f0 msgr2=0x7f448413e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f4489585640 1 --2- 172.21.15.5:0/1469207632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44840a74f0 0x7f448413e7e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f447c00b9a0 tx=0x7f447c00be60 comp rx=0 tx=0).stop 2024-08-18T21:11:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f44837fe640 1 -- 172.21.15.5:0/1469207632 reap_dead start 2024-08-18T21:11:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f44837fe640 1 -- 172.21.15.5:0/1469207632 reap_dead start 2024-08-18T21:11:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f4489585640 1 -- 172.21.15.5:0/1469207632 shutdown_connections 2024-08-18T21:11:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f4489585640 1 -- 172.21.15.5:0/1469207632 >> 172.21.15.5:0/1469207632 conn(0x7f4484068700 msgr2=0x7f4484142620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f4489585640 1 -- 172.21.15.5:0/1469207632 shutdown_connections 2024-08-18T21:11:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.536+0000 7f4489585640 1 -- 172.21.15.5:0/1469207632 wait complete. 2024-08-18T21:11:50.574 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:50.574 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:11:50.575 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:11:50.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 10 monclient: get_monmap_and_config 2024-08-18T21:11:50.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 10 monclient: build_initial_monmap 2024-08-18T21:11:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 10 monclient: monmap: 2024-08-18T21:11:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:50.696558+0000 2024-08-18T21:11:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:50.696558+0000 2024-08-18T21:11:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:50.695 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 1 Processor -- start 2024-08-18T21:11:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 1 -- start start 2024-08-18T21:11:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 10 monclient: init 2024-08-18T21:11:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 10 monclient: _add_conns ranks=[5,10,9,8,0,7,3,6,2,1,4] 2024-08-18T21:11:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f51b00a4210 0x7f51b00a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 10 monclient(hunting): picked mon.noname-h con 0x7f51b00a4210 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f51b00a4b30 0x7f51b0135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 10 monclient(hunting): picked mon.noname-f con 0x7f51b00a4b30 addr v2:172.21.15.157:3300/0 2024-08-18T21:11:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f51b0136500 0x7f51b01369b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 10 monclient(hunting): picked mon.noname-a con 0x7f51b0136500 addr v2:172.21.15.5:3300/0 2024-08-18T21:11:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f51b00701f0 con 0x7f51b0136500 2024-08-18T21:11:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f51b0071570 con 0x7f51b00a4b30 2024-08-18T21:11:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f51b0071b30 con 0x7f51b00a4210 2024-08-18T21:11:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b6d23640 10 monclient(hunting): authenticate will time out at 1477.709798s 2024-08-18T21:11:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f51b0136500 0x7f51b01369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f51b0136500 0x7f51b01369b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49788/0 (socket says 172.21.15.5:49788) 2024-08-18T21:11:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 1 -- 172.21.15.5:0/3032491787 learned_addr learned my addr 172.21.15.5:0/3032491787 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 10 monclient(hunting): get_auth_request con 0x7f51b0136500 auth_method 0 2024-08-18T21:11:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51affff640 1 --2- 172.21.15.5:0/3032491787 >> v2:172.21.15.157:3300/0 conn(0x7f51b00a4b30 0x7f51b0135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b4abf640 1 --2- 172.21.15.5:0/3032491787 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f51b00a4210 0x7f51b00a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51affff640 10 monclient(hunting): get_auth_request con 0x7f51b00a4b30 auth_method 0 2024-08-18T21:11:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51affff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51affff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b4abf640 10 monclient(hunting): get_auth_request con 0x7f51b00a4210 auth_method 0 2024-08-18T21:11:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b4abf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b4abf640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b4abf640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 10 monclient(hunting): handle_auth_done global_id 114156 payload 274 2024-08-18T21:11:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 1 -- 172.21.15.5:0/3032491787 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f51b00a4210 msgr2=0x7f51b00a45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 1 --2- 172.21.15.5:0/3032491787 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f51b00a4210 0x7f51b00a45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 1 -- 172.21.15.5:0/3032491787 >> v2:172.21.15.157:3300/0 conn(0x7f51b00a4b30 msgr2=0x7f51b0135fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 1 --2- 172.21.15.5:0/3032491787 >> v2:172.21.15.157:3300/0 conn(0x7f51b00a4b30 0x7f51b0135fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 10 monclient: _finish_hunting 0 2024-08-18T21:11:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 1 monclient: found mon.noname-a 2024-08-18T21:11:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:11:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b52c0640 1 -- 172.21.15.5:0/3032491787 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b006f830 con 0x7f51b0136500 2024-08-18T21:11:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51affff640 1 --2- 172.21.15.5:0/3032491787 >> v2:172.21.15.157:3300/0 conn(0x7f51b00a4b30 0x7f51b0135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:11:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.692+0000 7f51b4abf640 1 --2- 172.21.15.5:0/3032491787 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f51b00a4210 0x7f51b00a45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:11:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b52c0640 1 -- 172.21.15.5:0/3032491787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b0136500 msgr2=0x7f51b01369b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b52c0640 1 --2- 172.21.15.5:0/3032491787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b0136500 0x7f51b01369b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51b00a5ca0 tx=0x7f51a801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4f419a077c2ad3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51af7fe640 1 -- 172.21.15.5:0/3032491787 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f51a80b0070 con 0x7f51b0136500 2024-08-18T21:11:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51af7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51af7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:11:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51af7fe640 10 monclient: dump: 2024-08-18T21:11:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.709 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51af7fe640 10 monclient: _finish_auth 0 2024-08-18T21:11:50.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51af7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:11:50.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:50.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51af7fe640 1 -- 172.21.15.5:0/3032491787 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a80aa810 con 0x7f51b0136500 2024-08-18T21:11:50.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b6d23640 5 monclient: authenticate success, global_id 114156 2024-08-18T21:11:50.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b6d23640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:50.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51af7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:50.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b6d23640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:50.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b6d23640 4 set_mon_vals no callback set 2024-08-18T21:11:50.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51af7fe640 1 -- 172.21.15.5:0/3032491787 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f51a80a9300 con 0x7f51b0136500 2024-08-18T21:11:50.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51af7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51af7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:11:50.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51af7fe640 10 monclient: dump: 2024-08-18T21:11:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.712 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.712 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.712 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b6d23640 10 monclient: shutdown 2024-08-18T21:11:50.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b6d23640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:50.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b6d23640 1 -- 172.21.15.5:0/3032491787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b0136500 msgr2=0x7f51b01369b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b6d23640 1 --2- 172.21.15.5:0/3032491787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b0136500 0x7f51b01369b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51b00a5ca0 tx=0x7f51a801c3e0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b6d23640 1 -- 172.21.15.5:0/3032491787 shutdown_connections 2024-08-18T21:11:50.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b6d23640 1 --2- 172.21.15.5:0/3032491787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b0136500 0x7f51b01369b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b6d23640 1 --2- 172.21.15.5:0/3032491787 >> v2:172.21.15.157:3300/0 conn(0x7f51b00a4b30 0x7f51b0135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b6d23640 1 --2- 172.21.15.5:0/3032491787 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f51b00a4210 0x7f51b00a45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b6d23640 1 -- 172.21.15.5:0/3032491787 >> 172.21.15.5:0/3032491787 conn(0x7f51b00a8e00 msgr2=0x7f51b00a5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:50.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b6d23640 1 -- 172.21.15.5:0/3032491787 shutdown_connections 2024-08-18T21:11:50.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.696+0000 7f51b6d23640 1 -- 172.21.15.5:0/3032491787 wait complete. 2024-08-18T21:11:50.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 10 monclient: build_initial_monmap 2024-08-18T21:11:50.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 10 monclient: monmap: 2024-08-18T21:11:50.714 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:50.714 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:50.714 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:50.714 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:50.714 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:50.714 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.714 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:50.714 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:50.715 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:50.715 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:50.715 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:50.715 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:50.715 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:50.715 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:50.715 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:50.715 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 1 Processor -- start 2024-08-18T21:11:50.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 1 -- start start 2024-08-18T21:11:50.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 10 monclient: init 2024-08-18T21:11:50.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:50.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 10 monclient: _add_conns ranks=[1,0,6,2,8,5,7,4,3] 2024-08-18T21:11:50.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51b00a4210 0x7f51b0133620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 10 monclient(hunting): picked mon.noname-f con 0x7f51b00a4210 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:11:50.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b00a4b30 0x7f51b009da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 10 monclient(hunting): picked mon.noname-a con 0x7f51b00a4b30 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:11:50.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0136500 0x7f51b009dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 10 monclient(hunting): picked mon.noname-d con 0x7f51b0136500 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:50.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f51b0070430 con 0x7f51b00a4b30 2024-08-18T21:11:50.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f51b00723a0 con 0x7f51b00a4210 2024-08-18T21:11:50.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f51b009f420 con 0x7f51b0136500 2024-08-18T21:11:50.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:50.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b6d23640 10 monclient(hunting): authenticate will time out at 1477.717410s 2024-08-18T21:11:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b00a4b30 0x7f51b009da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b00a4b30 0x7f51b009da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49798/0 (socket says 172.21.15.5:49798) 2024-08-18T21:11:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 1 -- 172.21.15.5:0/555589312 learned_addr learned my addr 172.21.15.5:0/555589312 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 10 monclient(hunting): get_auth_request con 0x7f51b00a4b30 auth_method 0 2024-08-18T21:11:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b52c0640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0136500 0x7f51b009dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b52c0640 10 monclient(hunting): get_auth_request con 0x7f51b0136500 auth_method 0 2024-08-18T21:11:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b52c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b52c0640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b52c0640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b52c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b52c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b52c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b4abf640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51b00a4210 0x7f51b0133620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b4abf640 10 monclient(hunting): get_auth_request con 0x7f51b00a4210 auth_method 0 2024-08-18T21:11:50.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b4abf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b4abf640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51b4abf640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 10 monclient(hunting): handle_auth_done global_id 114165 payload 824 2024-08-18T21:11:50.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 1 -- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0136500 msgr2=0x7f51b009dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0136500 0x7f51b009dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 1 -- 172.21.15.5:0/555589312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51b00a4210 msgr2=0x7f51b0133620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51b00a4210 0x7f51b0133620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 10 monclient: _finish_hunting 0 2024-08-18T21:11:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 1 monclient: found mon.noname-a 2024-08-18T21:11:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:11:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.700+0000 7f51affff640 1 -- 172.21.15.5:0/555589312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b013ca60 con 0x7f51b00a4b30 2024-08-18T21:11:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51affff640 1 -- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b00a4b30 msgr2=0x7f51b009da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51affff640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b00a4b30 0x7f51b009da70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f51a400e730 tx=0x7f51a400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ad7fa640 1 -- 172.21.15.5:0/555589312 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f51a4017070 con 0x7f51b00a4b30 2024-08-18T21:11:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ad7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:11:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ad7fa640 10 monclient: dump: 2024-08-18T21:11:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.721 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ad7fa640 10 monclient: _finish_auth 0 2024-08-18T21:11:50.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ad7fa640 10 monclient: _check_auth_tickets 2024-08-18T21:11:50.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:50.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ad7fa640 1 -- 172.21.15.5:0/555589312 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a400ee40 con 0x7f51b00a4b30 2024-08-18T21:11:50.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b6d23640 5 monclient: authenticate success, global_id 114165 2024-08-18T21:11:50.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b6d23640 10 monclient: _renew_subs 2024-08-18T21:11:50.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b6d23640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:11:50.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b6d23640 1 -- 172.21.15.5:0/555589312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b00a5300 con 0x7f51b00a4b30 2024-08-18T21:11:50.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ad7fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ad7fa640 1 -- 172.21.15.5:0/555589312 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f51a400f040 con 0x7f51b00a4b30 2024-08-18T21:11:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ad7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:11:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ae7fc640 4 set_mon_vals no callback set 2024-08-18T21:11:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ad7fa640 10 monclient: dump: 2024-08-18T21:11:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.723 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.723 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.723 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.723 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.723 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.723 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.723 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.723 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b6d23640 10 monclient: _renew_subs 2024-08-18T21:11:50.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b6d23640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:11:50.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b6d23640 1 -- 172.21.15.5:0/555589312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b013b260 con 0x7f51b00a4b30 2024-08-18T21:11:50.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b6d23640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b6d23640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0133b60 0x7f51b009e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b6d23640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b6d23640 1 -- 172.21.15.5:0/555589312 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f51b013b090 con 0x7f51b0133b60 2024-08-18T21:11:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b4abf640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0133b60 0x7f51b009e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b4abf640 10 monclient: get_auth_request con 0x7f51b0133b60 auth_method 0 2024-08-18T21:11:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b4abf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b4abf640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b4abf640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b4abf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b4abf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b4abf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ad7fa640 1 -- 172.21.15.5:0/555589312 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f51a401a070 con 0x7f51b00a4b30 2024-08-18T21:11:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b4abf640 10 monclient(hunting): handle_auth_done global_id 85272 payload 824 2024-08-18T21:11:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b4abf640 1 -- 172.21.15.5:0/555589312 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51b00a1f40 con 0x7f51b0133b60 2024-08-18T21:11:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ad7fa640 1 --2- 172.21.15.5:0/555589312 >> v2:172.21.15.157:6812/631023601 conn(0x7f519c03bdc0 0x7f519c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51ad7fa640 1 -- 172.21.15.5:0/555589312 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(235..235 src has 22..235) ==== 3898+0+0 (secure 0 0 0) 0x7f51a404e200 con 0x7f51b00a4b30 2024-08-18T21:11:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b52c0640 1 --2- 172.21.15.5:0/555589312 >> v2:172.21.15.157:6812/631023601 conn(0x7f519c03bdc0 0x7f519c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.704+0000 7f51b52c0640 10 monclient: get_auth_request con 0x7f519c03bdc0 auth_method 0 2024-08-18T21:11:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.708+0000 7f51b4abf640 1 -- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0133b60 msgr2=0x7f51b009e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.708+0000 7f51b4abf640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0133b60 0x7f51b009e4f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f51a0004610 tx=0x7f51a0007330 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.708+0000 7f51b52c0640 1 --2- 172.21.15.5:0/555589312 >> v2:172.21.15.157:6812/631023601 conn(0x7f519c03bdc0 0x7f519c03e280 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f51b00a3010 tx=0x7f51a80a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.708+0000 7f51ad7fa640 1 -- 172.21.15.5:0/555589312 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f51a00139f0 con 0x7f51b0133b60 2024-08-18T21:11:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.708+0000 7f51ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.708+0000 7f51ad7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.708+0000 7f51ad7fa640 10 monclient: dump: 2024-08-18T21:11:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.729 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.708+0000 7f51ad7fa640 1 -- 172.21.15.5:0/555589312 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f51a0019070 con 0x7f51b0133b60 2024-08-18T21:11:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.708+0000 7f51ad7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.708+0000 7f51ad7fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.708+0000 7f51ad7fa640 1 -- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0133b60 msgr2=0x7f51b009e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.708+0000 7f51ad7fa640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0133b60 0x7f51b009e4f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f51a0004610 tx=0x7f51a0007330 comp rx=0 tx=0).stop 2024-08-18T21:11:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.708+0000 7f51ad7fa640 1 -- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0133b60 msgr2=0x7f51b009e4f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.708+0000 7f51ad7fa640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0133b60 0x7f51b009e4f0 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f51a0004610 tx=0x7f51a0007330 comp rx=0 tx=0).stop 2024-08-18T21:11:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51b6d23640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51b6d23640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0135350 0x7f51b0135760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51b6d23640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51b6d23640 1 -- 172.21.15.5:0/555589312 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f51b00705b0 con 0x7f51b0135350 2024-08-18T21:11:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51b4abf640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0135350 0x7f51b0135760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51b4abf640 10 monclient: get_auth_request con 0x7f51b0135350 auth_method 0 2024-08-18T21:11:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51b4abf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51b4abf640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51b4abf640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51b4abf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51b4abf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51b4abf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51b4abf640 10 monclient(hunting): handle_auth_done global_id 85281 payload 824 2024-08-18T21:11:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51b4abf640 1 -- 172.21.15.5:0/555589312 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f51b00a4f10 con 0x7f51b0135350 2024-08-18T21:11:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51b4abf640 1 -- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0135350 msgr2=0x7f51b0135760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51b4abf640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0135350 0x7f51b0135760 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f51a0004610 tx=0x7f51a0004a50 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51ad7fa640 1 -- 172.21.15.5:0/555589312 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f51a0013ca0 con 0x7f51b0135350 2024-08-18T21:11:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51ad7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.716+0000 7f51ad7fa640 10 monclient: dump: 2024-08-18T21:11:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.733 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51ad7fa640 1 -- 172.21.15.5:0/555589312 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f51a0013ca0 con 0x7f51b0135350 2024-08-18T21:11:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51ad7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51ad7fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51ad7fa640 1 -- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0135350 msgr2=0x7f51b0135760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51ad7fa640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0135350 0x7f51b0135760 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f51a0004610 tx=0x7f51a0004a50 comp rx=0 tx=0).stop 2024-08-18T21:11:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51ad7fa640 1 -- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0135350 msgr2=0x7f51b0135760 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51ad7fa640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f51b0135350 0x7f51b0135760 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f51a0004610 tx=0x7f51a0004a50 comp rx=0 tx=0).stop 2024-08-18T21:11:50.734 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:50.734 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:50.734 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:50.734 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:50.734 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:50.734 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 207545, 2024-08-18T21:11:50.734 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:50.734 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:50.734 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:50.734 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:50.735 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:50.735 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:50.735 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:50.735 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:50.735 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:50.735 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:50.735 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.735 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:11:50.735 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:50.735 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:50.735 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:50.735 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:50.735 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:50.736 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:50.736 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:50.736 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:50.736 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:50.736 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:50.736 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:50.736 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:50.736 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:50.736 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:50.736 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.736 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:50.736 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:50.737 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:50.737 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:50.737 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:50.737 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:50.737 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:50.737 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:50.737 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:50.737 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:50.737 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:50.737 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:50.737 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:50.737 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.738 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:50.738 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:50.738 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:50.738 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:50.738 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:50.738 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:50.738 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:50.738 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:50.738 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:50.738 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:50.738 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:50.738 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:50.738 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:50.739 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:50.739 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:50.739 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:50.739 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:50.739 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:50.739 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:50.739 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:50.739 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:50.739 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:50.740 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:50.740 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:50.740 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:50.740 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:50.740 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:50.740 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:50.740 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.740 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:50.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.740 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:50.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.740 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:50.740 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:50.741 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.741 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.741 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.741 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:50.741 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.741 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.741 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:50.742 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.742 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.742 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.742 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:50.742 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:50.742 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.742 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.742 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.743 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:50.743 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:50.743 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:50.743 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:50.743 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.744 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.744 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.744 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:50.744 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:50.744 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.744 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.744 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.744 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:50.744 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:50.744 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:50.745 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:50.745 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.745 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.745 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:50.746 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:50.746 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.746 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.746 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.746 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:50.746 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:50.746 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.746 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.746 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:50.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:50.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.747 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.747 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:50.747 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:50.747 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.748 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.748 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.748 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:50.748 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:50.748 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:50.748 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.749 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:50.749 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.749 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:50.749 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:50.749 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.749 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.749 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.750 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:50.750 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:50.750 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:50.750 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.751 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:50.751 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.751 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.751 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.751 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:50.751 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:50.751 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.751 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.751 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.752 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:50.752 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:50.752 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:50.752 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.754 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:50.754 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.754 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.755 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:50.755 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:50.755 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.755 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.755 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.755 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:50.755 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:50.755 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.756 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:50.756 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.756 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:50.756 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.756 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.756 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:50.756 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:50.756 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.757 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.757 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.757 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:50.757 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:50.757 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:50.757 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:50.758 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.758 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.758 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:50.758 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:50.758 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.758 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.758 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.758 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.758 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.759 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:50.759 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:50.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.759 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:50.759 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:50.759 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:50.759 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.759 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.759 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:11:50.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.759 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:50.759 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:50.759 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:11:50.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.760 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.760 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:50.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.760 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:50.760 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:50.760 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:50.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.760 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.760 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:50.760 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:50.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51b6d23640 1 -- 172.21.15.5:0/555589312 >> v2:172.21.15.157:6812/631023601 conn(0x7f519c03bdc0 msgr2=0x7f519c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51b6d23640 1 --2- 172.21.15.5:0/555589312 >> v2:172.21.15.157:6812/631023601 conn(0x7f519c03bdc0 0x7f519c03e280 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f51b00a3010 tx=0x7f51a80a6000 comp rx=0 tx=0).stop 2024-08-18T21:11:50.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51b6d23640 10 monclient: shutdown 2024-08-18T21:11:50.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51b6d23640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:50.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51b6d23640 1 -- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b00a4b30 msgr2=0x7f51b009da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51b6d23640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b00a4b30 0x7f51b009da70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f51a400e730 tx=0x7f51a400ebf0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51b52c0640 1 -- 172.21.15.5:0/555589312 reap_dead start 2024-08-18T21:11:50.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51b6d23640 1 -- 172.21.15.5:0/555589312 shutdown_connections 2024-08-18T21:11:50.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51b6d23640 1 --2- 172.21.15.5:0/555589312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b00a4b30 0x7f51b009da70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51b6d23640 1 -- 172.21.15.5:0/555589312 >> 172.21.15.5:0/555589312 conn(0x7f51b00a8e00 msgr2=0x7f51b00a6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:50.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51b6d23640 1 -- 172.21.15.5:0/555589312 shutdown_connections 2024-08-18T21:11:50.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.720+0000 7f51b6d23640 1 -- 172.21.15.5:0/555589312 wait complete. 2024-08-18T21:11:50.763 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:50.763 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:11:50.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:11:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.884+0000 7f20389b6640 10 monclient: get_monmap_and_config 2024-08-18T21:11:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.884+0000 7f20389b6640 10 monclient: build_initial_monmap 2024-08-18T21:11:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.884+0000 7f20389b6640 10 monclient: monmap: 2024-08-18T21:11:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:50.890739+0000 2024-08-18T21:11:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:50.890739+0000 2024-08-18T21:11:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:50.889 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 1 Processor -- start 2024-08-18T21:11:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 1 -- start start 2024-08-18T21:11:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 10 monclient: init 2024-08-18T21:11:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 10 monclient: _add_conns ranks=[8,3,4,6,5,9,7,10,1,2,0] 2024-08-18T21:11:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034073960 0x7f2034073d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 10 monclient(hunting): picked mon.noname-e con 0x7f2034073960 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20340a2c80 0x7f20340a4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 10 monclient(hunting): picked mon.noname-g con 0x7f20340a2c80 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f20340a4750 0x7f20340a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 10 monclient(hunting): picked mon.noname-c con 0x7f20340a4750 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f20341372e0 con 0x7f20340a2c80 2024-08-18T21:11:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f20340721e0 con 0x7f20340a4750 2024-08-18T21:11:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f20340a5db0 con 0x7f2034073960 2024-08-18T21:11:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f20389b6640 10 monclient(hunting): authenticate will time out at 1477.905108s 2024-08-18T21:11:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034073960 0x7f2034073d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f2032d9d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f20340a4750 0x7f20340a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034073960 0x7f2034073d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:50760/0 (socket says 172.21.15.5:50760) 2024-08-18T21:11:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 1 -- 172.21.15.5:0/3060251869 learned_addr learned my addr 172.21.15.5:0/3060251869 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 10 monclient(hunting): get_auth_request con 0x7f2034073960 auth_method 0 2024-08-18T21:11:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f2032d9d640 10 monclient(hunting): get_auth_request con 0x7f20340a4750 auth_method 0 2024-08-18T21:11:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f2032d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f2032d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f2032d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f2032d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f2032d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f2032d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 10 monclient(hunting): handle_auth_done global_id 114137 payload 274 2024-08-18T21:11:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 1 -- 172.21.15.5:0/3060251869 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f20340a4750 msgr2=0x7f20340a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 1 --2- 172.21.15.5:0/3060251869 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f20340a4750 0x7f20340a4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f2031d9b640 1 --2- 172.21.15.5:0/3060251869 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20340a2c80 0x7f20340a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 1 -- 172.21.15.5:0/3060251869 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20340a2c80 msgr2=0x7f20340a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 1 --2- 172.21.15.5:0/3060251869 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20340a2c80 0x7f20340a4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 10 monclient: _finish_hunting 0 2024-08-18T21:11:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 1 monclient: found mon.noname-e 2024-08-18T21:11:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:11:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f203259c640 1 -- 172.21.15.5:0/3060251869 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2034071b90 con 0x7f2034073960 2024-08-18T21:11:50.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.888+0000 7f2032d9d640 1 --2- 172.21.15.5:0/3060251869 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f20340a4750 0x7f20340a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:50.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f203259c640 1 -- 172.21.15.5:0/3060251869 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034073960 msgr2=0x7f2034073d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f203259c640 1 --2- 172.21.15.5:0/3060251869 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034073960 0x7f2034073d40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f202400bb70 tx=0x7f202401ea80 comp rx=0 tx=0).ready entity=mon.8 client_cookie=931a07f4d79b0e41 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f203159a640 1 -- 172.21.15.5:0/3060251869 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f20240b4070 con 0x7f2034073960 2024-08-18T21:11:50.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f203159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f203159a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:11:50.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f203159a640 10 monclient: dump: 2024-08-18T21:11:50.898 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.898 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.898 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.898 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.898 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.898 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.898 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.898 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.898 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.898 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.898 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.899 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.899 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.899 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.899 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.899 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f203159a640 10 monclient: _finish_auth 0 2024-08-18T21:11:50.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f203159a640 10 monclient: _check_auth_tickets 2024-08-18T21:11:50.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f203159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:50.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f203159a640 1 -- 172.21.15.5:0/3060251869 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20240a7c40 con 0x7f2034073960 2024-08-18T21:11:50.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f203159a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:50.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f203159a640 1 -- 172.21.15.5:0/3060251869 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f20240a7e30 con 0x7f2034073960 2024-08-18T21:11:50.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f20389b6640 5 monclient: authenticate success, global_id 114137 2024-08-18T21:11:50.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f20389b6640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f20389b6640 4 set_mon_vals no callback set 2024-08-18T21:11:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f203159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f203159a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.892+0000 7f203159a640 10 monclient: dump: 2024-08-18T21:11:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.901 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.901 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.901 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.901 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.901 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.901 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 10 monclient: shutdown 2024-08-18T21:11:50.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:50.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 -- 172.21.15.5:0/3060251869 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034073960 msgr2=0x7f2034073d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 --2- 172.21.15.5:0/3060251869 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034073960 0x7f2034073d40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f202400bb70 tx=0x7f202401ea80 comp rx=0 tx=0).stop 2024-08-18T21:11:50.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 -- 172.21.15.5:0/3060251869 shutdown_connections 2024-08-18T21:11:50.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 --2- 172.21.15.5:0/3060251869 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f20340a4750 0x7f20340a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 --2- 172.21.15.5:0/3060251869 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20340a2c80 0x7f20340a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 --2- 172.21.15.5:0/3060251869 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034073960 0x7f2034073d40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 -- 172.21.15.5:0/3060251869 >> 172.21.15.5:0/3060251869 conn(0x7f20340a8e00 msgr2=0x7f20340a5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:50.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 -- 172.21.15.5:0/3060251869 shutdown_connections 2024-08-18T21:11:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 -- 172.21.15.5:0/3060251869 wait complete. 2024-08-18T21:11:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 10 monclient: build_initial_monmap 2024-08-18T21:11:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 10 monclient: monmap: 2024-08-18T21:11:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:50.908 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 Processor -- start 2024-08-18T21:11:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 -- start start 2024-08-18T21:11:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 10 monclient: init 2024-08-18T21:11:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 10 monclient: _add_conns ranks=[6,8,1,2,4,7,3,5,0] 2024-08-18T21:11:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2034073960 0x7f20341d1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 10 monclient(hunting): picked mon.noname-d con 0x7f2034073960 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20340a2c80 0x7f20341d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 10 monclient(hunting): picked mon.noname-e con 0x7f20340a2c80 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20340a4750 0x7f2034120930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 10 monclient(hunting): picked mon.noname-f con 0x7f20340a4750 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:11:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2034070af0 con 0x7f20340a4750 2024-08-18T21:11:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f2034050da0 con 0x7f2034073960 2024-08-18T21:11:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f2034136800 con 0x7f20340a2c80 2024-08-18T21:11:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f20389b6640 10 monclient(hunting): authenticate will time out at 1477.914427s 2024-08-18T21:11:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2034073960 0x7f20341d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f2031d9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20340a2c80 0x7f20341d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2034073960 0x7f20341d1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:53126/0 (socket says 172.21.15.5:53126) 2024-08-18T21:11:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 1 -- 172.21.15.5:0/3239010474 learned_addr learned my addr 172.21.15.5:0/3239010474 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 10 monclient(hunting): get_auth_request con 0x7f2034073960 auth_method 0 2024-08-18T21:11:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f2031d9b640 10 monclient(hunting): get_auth_request con 0x7f20340a2c80 auth_method 0 2024-08-18T21:11:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f2031d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f2031d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f2031d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f2031d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f2031d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f2031d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 10 monclient(hunting): handle_auth_done global_id 85290 payload 824 2024-08-18T21:11:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 1 -- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20340a2c80 msgr2=0x7f20341d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 1 --2- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20340a2c80 0x7f20341d1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 1 -- 172.21.15.5:0/3239010474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20340a4750 msgr2=0x7f2034120930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 1 --2- 172.21.15.5:0/3239010474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20340a4750 0x7f2034120930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 10 monclient: _finish_hunting 0 2024-08-18T21:11:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 1 monclient: found mon.noname-d 2024-08-18T21:11:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:11:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f203259c640 1 -- 172.21.15.5:0/3239010474 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2034124410 con 0x7f2034073960 2024-08-18T21:11:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.896+0000 7f2031d9b640 1 --2- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f20340a2c80 0x7f20341d1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f203259c640 1 -- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2034073960 msgr2=0x7f20341d1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f203259c640 1 --2- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2034073960 0x7f20341d1780 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f202400b2c0 tx=0x7f202401b880 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2022ffd640 1 -- 172.21.15.5:0/3239010474 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f20240b4070 con 0x7f2034073960 2024-08-18T21:11:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2022ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2022ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:11:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2022ffd640 10 monclient: dump: 2024-08-18T21:11:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.913 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2022ffd640 10 monclient: _finish_auth 0 2024-08-18T21:11:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2022ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:11:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2022ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f20389b6640 5 monclient: authenticate success, global_id 85290 2024-08-18T21:11:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2022ffd640 1 -- 172.21.15.5:0/3239010474 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20240b6070 con 0x7f2034073960 2024-08-18T21:11:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2022ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2022ffd640 1 -- 172.21.15.5:0/3239010474 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2024004410 con 0x7f2034073960 2024-08-18T21:11:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f20389b6640 10 monclient: _renew_subs 2024-08-18T21:11:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f20389b6640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f20389b6640 1 -- 172.21.15.5:0/3239010474 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20341246f0 con 0x7f2034073960 2024-08-18T21:11:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2022ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2030d99640 4 set_mon_vals no callback set 2024-08-18T21:11:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2022ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2022ffd640 10 monclient: dump: 2024-08-18T21:11:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.915 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f20389b6640 10 monclient: _renew_subs 2024-08-18T21:11:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f20389b6640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f20389b6640 1 -- 172.21.15.5:0/3239010474 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f20340778b0 con 0x7f2034073960 2024-08-18T21:11:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f20389b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f20389b6640 1 --2- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034121630 0x7f203402d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f20389b6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f20389b6640 1 -- 172.21.15.5:0/3239010474 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f2034122ef0 con 0x7f2034121630 2024-08-18T21:11:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2031d9b640 1 --2- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034121630 0x7f203402d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2022ffd640 1 -- 172.21.15.5:0/3239010474 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f2024003620 con 0x7f2034073960 2024-08-18T21:11:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2031d9b640 10 monclient: get_auth_request con 0x7f2034121630 auth_method 0 2024-08-18T21:11:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2031d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2031d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2031d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2031d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2031d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2031d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2031d9b640 10 monclient(hunting): handle_auth_done global_id 114155 payload 824 2024-08-18T21:11:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2022ffd640 1 --2- 172.21.15.5:0/3239010474 >> v2:172.21.15.157:6812/631023601 conn(0x7f201403bdc0 0x7f201403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2031d9b640 1 -- 172.21.15.5:0/3239010474 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20340a6990 con 0x7f2034121630 2024-08-18T21:11:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2022ffd640 1 -- 172.21.15.5:0/3239010474 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(236..236 src has 22..236) ==== 3898+0+0 (secure 0 0 0) 0x7f20240e87e0 con 0x7f2034073960 2024-08-18T21:11:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2032d9d640 1 --2- 172.21.15.5:0/3239010474 >> v2:172.21.15.157:6812/631023601 conn(0x7f201403bdc0 0x7f201403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.900+0000 7f2032d9d640 10 monclient: get_auth_request con 0x7f201403bdc0 auth_method 0 2024-08-18T21:11:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.904+0000 7f2031d9b640 1 -- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034121630 msgr2=0x7f203402d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.904+0000 7f2031d9b640 1 --2- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034121630 0x7f203402d1d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20340a9880 tx=0x7f202800d590 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.904+0000 7f2022ffd640 1 -- 172.21.15.5:0/3239010474 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f202800fe80 con 0x7f2034121630 2024-08-18T21:11:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.904+0000 7f2022ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.904+0000 7f2022ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.904+0000 7f2022ffd640 10 monclient: dump: 2024-08-18T21:11:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.921 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.904+0000 7f2032d9d640 1 --2- 172.21.15.5:0/3239010474 >> v2:172.21.15.157:6812/631023601 conn(0x7f201403bdc0 0x7f201403e280 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2034068f60 tx=0x7f202c00d040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.904+0000 7f2022ffd640 1 -- 172.21.15.5:0/3239010474 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f202800fe80 con 0x7f2034121630 2024-08-18T21:11:50.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.904+0000 7f2022ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:50.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.904+0000 7f2022ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:50.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.904+0000 7f2022ffd640 1 -- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034121630 msgr2=0x7f203402d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.904+0000 7f2022ffd640 1 --2- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034121630 0x7f203402d1d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20340a9880 tx=0x7f202800d590 comp rx=0 tx=0).stop 2024-08-18T21:11:50.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.904+0000 7f2022ffd640 1 -- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034121630 msgr2=0x7f203402d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:50.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.904+0000 7f2022ffd640 1 --2- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034121630 0x7f203402d1d0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20340a9880 tx=0x7f202800d590 comp rx=0 tx=0).stop 2024-08-18T21:11:50.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f20389b6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:50.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f20389b6640 1 --2- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034121a10 0x7f203402d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:50.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f20389b6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:50.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f20389b6640 1 -- 172.21.15.5:0/3239010474 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f203406a5e0 con 0x7f2034121a10 2024-08-18T21:11:50.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2031d9b640 1 --2- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034121a10 0x7f203402d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:50.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2031d9b640 10 monclient: get_auth_request con 0x7f2034121a10 auth_method 0 2024-08-18T21:11:50.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2031d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:50.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2031d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:50.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2031d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:50.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2031d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:50.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2031d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:50.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2031d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:50.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2031d9b640 10 monclient(hunting): handle_auth_done global_id 114164 payload 824 2024-08-18T21:11:50.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2031d9b640 1 -- 172.21.15.5:0/3239010474 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f20340a4210 con 0x7f2034121a10 2024-08-18T21:11:50.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2031d9b640 1 -- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034121a10 msgr2=0x7f203402d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:50.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2031d9b640 1 --2- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034121a10 0x7f203402d710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2028019000 tx=0x7f20280046d0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:50.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2022ffd640 1 -- 172.21.15.5:0/3239010474 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2028004490 con 0x7f2034121a10 2024-08-18T21:11:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2022ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2022ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2022ffd640 10 monclient: dump: 2024-08-18T21:11:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:50.925 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2022ffd640 1 -- 172.21.15.5:0/3239010474 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f2028004020 con 0x7f2034121a10 2024-08-18T21:11:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2022ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2022ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2022ffd640 1 -- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034121a10 msgr2=0x7f203402d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2022ffd640 1 --2- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034121a10 0x7f203402d710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2028019000 tx=0x7f20280046d0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2022ffd640 1 -- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034121a10 msgr2=0x7f203402d710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2022ffd640 1 --2- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f2034121a10 0x7f203402d710 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2028019000 tx=0x7f20280046d0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.926 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:50.926 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:50.926 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:50.926 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:50.926 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:50.926 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 16079, 2024-08-18T21:11:50.926 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:50.926 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:50.926 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:50.927 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:50.927 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:50.927 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:50.927 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:50.927 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:50.927 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:50.927 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:50.927 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.927 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:11:50.927 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:50.927 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:50.927 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:50.927 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:50.928 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:50.928 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:50.928 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:50.928 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:50.928 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:50.928 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:50.928 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:50.928 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:50.928 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:50.928 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:50.928 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.928 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:50.928 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:50.929 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:50.929 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:50.929 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:50.929 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:50.929 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:50.929 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:50.929 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:50.929 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:50.929 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:50.929 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:50.929 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:50.929 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.930 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:50.930 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:50.930 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:50.930 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:50.930 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:50.930 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:50.930 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:50.930 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:50.930 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:50.930 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:50.930 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:50.930 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:50.930 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:50.931 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:50.931 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:50.931 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:50.931 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:50.931 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:50.931 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:50.931 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:50.931 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:50.931 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:50.931 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:50.931 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:50.931 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:50.931 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:50.931 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:50.932 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:50.932 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.932 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:50.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.932 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:50.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.932 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:50.932 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:50.932 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.932 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.932 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.932 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:50.932 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.933 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.933 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:50.933 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.933 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.933 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:50.933 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:50.933 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.933 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.934 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.934 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:50.934 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:50.934 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.934 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.934 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.934 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:50.934 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.935 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:50.935 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.935 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.935 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.935 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:50.935 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:50.935 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.935 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.935 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.935 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:50.936 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:50.936 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.936 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.936 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.936 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:50.936 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.936 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.936 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:50.936 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.936 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.936 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.937 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:50.937 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:50.937 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.937 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.937 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.937 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:50.937 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:50.937 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.937 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.938 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.938 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:50.938 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.938 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.938 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:50.938 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.938 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.938 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.938 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:50.939 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:50.939 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.939 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.939 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.939 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:50.939 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:50.939 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.939 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.939 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.939 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:50.939 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.940 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.940 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:50.940 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.940 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.940 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.940 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:50.940 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:50.940 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.940 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.940 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.941 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:50.941 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:50.941 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.941 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.941 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.941 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:50.941 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.941 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.941 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:50.942 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.942 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.942 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.942 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:50.942 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:50.942 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.942 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.942 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.942 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:50.942 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:50.942 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:50.943 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:50.943 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.943 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.943 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:50.944 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:50.944 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.944 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.944 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.944 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:50.944 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:50.944 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.944 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.944 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.944 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:50.945 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.945 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:50.945 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.945 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.945 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.945 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:50.945 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:50.945 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.945 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.946 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.946 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:50.946 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:50.946 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:50.946 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:50.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:50.946 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:50.946 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.947 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:50.947 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:50.947 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:50.947 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.947 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.947 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:50.947 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:50.947 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:50.947 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:50.947 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:50.947 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.947 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.948 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:50.948 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:50.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.948 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:50.948 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:50.948 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:50.948 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.948 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:50.948 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:50.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:50.949 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:50.949 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:50.949 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:50.949 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:50.949 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:50.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:50.949 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:50.949 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:50.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f20389b6640 1 -- 172.21.15.5:0/3239010474 >> v2:172.21.15.157:6812/631023601 conn(0x7f201403bdc0 msgr2=0x7f201403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f20389b6640 1 --2- 172.21.15.5:0/3239010474 >> v2:172.21.15.157:6812/631023601 conn(0x7f201403bdc0 0x7f201403e280 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2034068f60 tx=0x7f202c00d040 comp rx=0 tx=0).stop 2024-08-18T21:11:50.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f20389b6640 10 monclient: shutdown 2024-08-18T21:11:50.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f20389b6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:50.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f20389b6640 1 -- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2034073960 msgr2=0x7f20341d1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:50.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f2032d9d640 1 -- 172.21.15.5:0/3239010474 reap_dead start 2024-08-18T21:11:50.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.912+0000 7f20389b6640 1 --2- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2034073960 0x7f20341d1780 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f202400b2c0 tx=0x7f202401b880 comp rx=0 tx=0).stop 2024-08-18T21:11:50.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.916+0000 7f20389b6640 1 -- 172.21.15.5:0/3239010474 shutdown_connections 2024-08-18T21:11:50.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.916+0000 7f20389b6640 1 --2- 172.21.15.5:0/3239010474 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2034073960 0x7f20341d1780 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:50.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.916+0000 7f20389b6640 1 -- 172.21.15.5:0/3239010474 >> 172.21.15.5:0/3239010474 conn(0x7f20340a8e00 msgr2=0x7f20340a1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:50.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.916+0000 7f20389b6640 1 -- 172.21.15.5:0/3239010474 shutdown_connections 2024-08-18T21:11:50.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:50.916+0000 7f20389b6640 1 -- 172.21.15.5:0/3239010474 wait complete. 2024-08-18T21:11:50.951 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:50.952 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:11:50.952 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:11:51.059 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31207]: starting. 2024-08-18T21:11:51.060 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31207]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31206 2024-08-18T21:11:51.060 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31207]: created object 0... 2024-08-18T21:11:51.060 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31207]: created object 25... 2024-08-18T21:11:51.060 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31207]: created object 49... 2024-08-18T21:11:51.060 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31207]: finishing. 2024-08-18T21:11:51.060 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31207]: shutting down. 2024-08-18T21:11:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.068+0000 7f62981d2640 10 monclient: get_monmap_and_config 2024-08-18T21:11:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.068+0000 7f62981d2640 10 monclient: build_initial_monmap 2024-08-18T21:11:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 10 monclient: monmap: 2024-08-18T21:11:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:51.076371+0000 2024-08-18T21:11:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:51.076371+0000 2024-08-18T21:11:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:51.076 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:51.076 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:51.076 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 1 Processor -- start 2024-08-18T21:11:51.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 1 -- start start 2024-08-18T21:11:51.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 10 monclient: init 2024-08-18T21:11:51.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:51.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 10 monclient: _add_conns ranks=[0,8,6,9,2,10,5,4,3,7,1] 2024-08-18T21:11:51.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f62900a4a40 addr v1:172.21.15.5:6789/0 2024-08-18T21:11:51.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f62900a5530 0x7f629013ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 10 monclient(hunting): picked mon.noname-e con 0x7f62900a5530 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:51.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f62900a1c20 0x7f629013ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 10 monclient(hunting): picked mon.noname-d con 0x7f62900a1c20 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:51.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62900745f0 con 0x7f62900a4a40 2024-08-18T21:11:51.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f62900a0fc0 con 0x7f62900a1c20 2024-08-18T21:11:51.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f62900a1210 con 0x7f62900a5530 2024-08-18T21:11:51.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:51.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f62981d2640 10 monclient(hunting): authenticate will time out at 1478.089602s 2024-08-18T21:11:51.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f6295f6e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f62900a4a40 0x7f62900a4e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49140/0 (socket says 172.21.15.5:49140) 2024-08-18T21:11:51.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f6295f6e640 1 -- 172.21.15.5:0/3032943253 learned_addr learned my addr 172.21.15.5:0/3032943253 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:11:51.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 1 --2- 172.21.15.5:0/3032943253 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f62900a1c20 0x7f629013ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 10 monclient(hunting): get_auth_request con 0x7f62900a1c20 auth_method 0 2024-08-18T21:11:51.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629576d640 1 --2- 172.21.15.5:0/3032943253 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f62900a5530 0x7f629013ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629576d640 10 monclient(hunting): get_auth_request con 0x7f62900a5530 auth_method 0 2024-08-18T21:11:51.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629576d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629576d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629576d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629576d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629576d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629576d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 10 monclient(hunting): handle_auth_done global_id 85299 payload 274 2024-08-18T21:11:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 1 -- 172.21.15.5:0/3032943253 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f62900a5530 msgr2=0x7f629013ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 1 --2- 172.21.15.5:0/3032943253 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f62900a5530 0x7f629013ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 1 -- 172.21.15.5:0/3032943253 >> v1:172.21.15.5:6789/0 conn(0x7f62900a4a40 legacy=0x7f62900a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:51.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 10 monclient: _finish_hunting 0 2024-08-18T21:11:51.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 1 monclient: found mon.noname-d 2024-08-18T21:11:51.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:51.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:11:51.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.072+0000 7f629676f640 1 -- 172.21.15.5:0/3032943253 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629006ca70 con 0x7f62900a1c20 2024-08-18T21:11:51.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f629676f640 1 -- 172.21.15.5:0/3032943253 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f62900a1c20 msgr2=0x7f629013ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f629676f640 1 --2- 172.21.15.5:0/3032943253 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f62900a1c20 0x7f629013ef90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f62900a2120 tx=0x7f628801c850 comp rx=0 tx=0).ready entity=mon.6 client_cookie=82137b8791da5ca3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f6294f6c640 1 -- 172.21.15.5:0/3032943253 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f62880ac070 con 0x7f62900a1c20 2024-08-18T21:11:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f6294f6c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f6294f6c640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:11:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f6294f6c640 10 monclient: dump: 2024-08-18T21:11:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.090 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f6294f6c640 10 monclient: _finish_auth 0 2024-08-18T21:11:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f6294f6c640 10 monclient: _check_auth_tickets 2024-08-18T21:11:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f6294f6c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f6294f6c640 1 -- 172.21.15.5:0/3032943253 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62880a68b0 con 0x7f62900a1c20 2024-08-18T21:11:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f6294f6c640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f6294f6c640 1 -- 172.21.15.5:0/3032943253 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f62880a7420 con 0x7f62900a1c20 2024-08-18T21:11:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f62981d2640 5 monclient: authenticate success, global_id 85299 2024-08-18T21:11:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f62981d2640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f62981d2640 4 set_mon_vals no callback set 2024-08-18T21:11:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f6294f6c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f6294f6c640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f6294f6c640 10 monclient: dump: 2024-08-18T21:11:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.092 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f62981d2640 10 monclient: shutdown 2024-08-18T21:11:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f62981d2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f62981d2640 1 -- 172.21.15.5:0/3032943253 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f62900a1c20 msgr2=0x7f629013ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f62981d2640 1 --2- 172.21.15.5:0/3032943253 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f62900a1c20 0x7f629013ef90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f62900a2120 tx=0x7f628801c850 comp rx=0 tx=0).stop 2024-08-18T21:11:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f62981d2640 1 -- 172.21.15.5:0/3032943253 shutdown_connections 2024-08-18T21:11:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f62981d2640 1 --2- 172.21.15.5:0/3032943253 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f62900a1c20 0x7f629013ef90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f62981d2640 1 --2- 172.21.15.5:0/3032943253 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f62900a5530 0x7f629013ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f62981d2640 1 -- 172.21.15.5:0/3032943253 >> 172.21.15.5:0/3032943253 conn(0x7f6290068700 msgr2=0x7f6290068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f62981d2640 1 -- 172.21.15.5:0/3032943253 shutdown_connections 2024-08-18T21:11:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f62981d2640 1 -- 172.21.15.5:0/3032943253 wait complete. 2024-08-18T21:11:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f62981d2640 10 monclient: build_initial_monmap 2024-08-18T21:11:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.076+0000 7f62981d2640 10 monclient: monmap: 2024-08-18T21:11:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:51.095 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 1 Processor -- start 2024-08-18T21:11:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 1 -- start start 2024-08-18T21:11:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 10 monclient: init 2024-08-18T21:11:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 10 monclient: _add_conns ranks=[8,5,3,4,6,2,0,1,7] 2024-08-18T21:11:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f62900a1c20 0x7f62901d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 10 monclient(hunting): picked mon.noname-e con 0x7f62900a1c20 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f62900a4a40 0x7f629013df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 10 monclient(hunting): picked mon.noname-h con 0x7f62900a4a40 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62900a5530 0x7f629013e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 10 monclient(hunting): picked mon.noname-g con 0x7f62900a5530 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6290142080 con 0x7f62900a5530 2024-08-18T21:11:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f6290141f00 con 0x7f62900a4a40 2024-08-18T21:11:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f6290142200 con 0x7f62900a1c20 2024-08-18T21:11:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 10 monclient(hunting): authenticate will time out at 1478.096759s 2024-08-18T21:11:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f62900a1c20 0x7f62901d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f62900a1c20 0x7f62901d13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:50804/0 (socket says 172.21.15.5:50804) 2024-08-18T21:11:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 1 -- 172.21.15.5:0/1273629441 learned_addr learned my addr 172.21.15.5:0/1273629441 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 10 monclient(hunting): get_auth_request con 0x7f62900a1c20 auth_method 0 2024-08-18T21:11:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f629576d640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f62900a4a40 0x7f629013df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f629576d640 10 monclient(hunting): get_auth_request con 0x7f62900a4a40 auth_method 0 2024-08-18T21:11:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f629576d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f629576d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f629576d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f629676f640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62900a5530 0x7f629013e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 10 monclient(hunting): handle_auth_done global_id 114182 payload 824 2024-08-18T21:11:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 1 -- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f62900a4a40 msgr2=0x7f629013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f62900a4a40 0x7f629013df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 1 -- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62900a5530 msgr2=0x7f629013e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62900a5530 0x7f629013e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 10 monclient: _finish_hunting 0 2024-08-18T21:11:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 1 monclient: found mon.noname-e 2024-08-18T21:11:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:11:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 1 -- 172.21.15.5:0/1273629441 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629012a8b0 con 0x7f62900a1c20 2024-08-18T21:11:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f629676f640 10 monclient: get_auth_request con 0x7f62900a5530 auth_method 0 2024-08-18T21:11:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f629676f640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62900a5530 0x7f629013e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:11:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f629576d640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f62900a4a40 0x7f629013df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:11:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 1 -- 172.21.15.5:0/1273629441 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f62900a1c20 msgr2=0x7f62901d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6295f6e640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f62900a1c20 0x7f62901d13b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c4a0 tx=0x7f628c00c960 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62867fc640 1 -- 172.21.15.5:0/1273629441 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f628c017070 con 0x7f62900a1c20 2024-08-18T21:11:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62867fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:11:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62867fc640 10 monclient: dump: 2024-08-18T21:11:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.100 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62867fc640 10 monclient: _finish_auth 0 2024-08-18T21:11:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62867fc640 10 monclient: _check_auth_tickets 2024-08-18T21:11:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62867fc640 1 -- 172.21.15.5:0/1273629441 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f628c005d00 con 0x7f62900a1c20 2024-08-18T21:11:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62981d2640 5 monclient: authenticate success, global_id 114182 2024-08-18T21:11:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62867fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62867fc640 1 -- 172.21.15.5:0/1273629441 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f628c0074e0 con 0x7f62900a1c20 2024-08-18T21:11:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62867fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f6287fff640 4 set_mon_vals no callback set 2024-08-18T21:11:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.080+0000 7f62867fc640 10 monclient: dump: 2024-08-18T21:11:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.103 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.103 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.103 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.103 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.103 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.103 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.103 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.104 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f62981d2640 10 monclient: _renew_subs 2024-08-18T21:11:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f62981d2640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f62981d2640 1 -- 172.21.15.5:0/1273629441 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f629009f730 con 0x7f62900a1c20 2024-08-18T21:11:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f62981d2640 10 monclient: _renew_subs 2024-08-18T21:11:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f62981d2640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:51.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f62981d2640 1 -- 172.21.15.5:0/1273629441 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f62900a43f0 con 0x7f62900a1c20 2024-08-18T21:11:51.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f62981d2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:51.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f62981d2640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6290126ca0 0x7f6290127080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f62981d2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f62981d2640 1 -- 172.21.15.5:0/1273629441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f629012a250 con 0x7f6290126ca0 2024-08-18T21:11:51.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f62867fc640 1 -- 172.21.15.5:0/1273629441 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f628c007070 con 0x7f62900a1c20 2024-08-18T21:11:51.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f629576d640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6290126ca0 0x7f6290127080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f62867fc640 1 --2- 172.21.15.5:0/1273629441 >> v2:172.21.15.157:6812/631023601 conn(0x7f627403bdf0 0x7f627403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f629576d640 10 monclient: get_auth_request con 0x7f6290126ca0 auth_method 0 2024-08-18T21:11:51.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f629576d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f629576d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f629576d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f62867fc640 1 -- 172.21.15.5:0/1273629441 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(236..236 src has 22..236) ==== 3898+0+0 (secure 0 0 0) 0x7f628c04da70 con 0x7f62900a1c20 2024-08-18T21:11:51.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f629576d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f629576d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f629576d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f629676f640 1 --2- 172.21.15.5:0/1273629441 >> v2:172.21.15.157:6812/631023601 conn(0x7f627403bdf0 0x7f627403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f629676f640 10 monclient: get_auth_request con 0x7f627403bdf0 auth_method 0 2024-08-18T21:11:51.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f629576d640 10 monclient(hunting): handle_auth_done global_id 104545 payload 824 2024-08-18T21:11:51.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.084+0000 7f629576d640 1 -- 172.21.15.5:0/1273629441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f62900a4e20 con 0x7f6290126ca0 2024-08-18T21:11:51.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.088+0000 7f629576d640 1 -- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6290126ca0 msgr2=0x7f6290127080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.088+0000 7f629576d640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6290126ca0 0x7f6290127080 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6290128bc0 tx=0x7f6280011a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.088+0000 7f629676f640 1 --2- 172.21.15.5:0/1273629441 >> v2:172.21.15.157:6812/631023601 conn(0x7f627403bdf0 0x7f627403e2b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6290074270 tx=0x7f62880a7000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.088+0000 7f62867fc640 1 -- 172.21.15.5:0/1273629441 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f628000fe20 con 0x7f6290126ca0 2024-08-18T21:11:51.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.088+0000 7f62867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.088+0000 7f62867fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:11:51.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.088+0000 7f62867fc640 10 monclient: dump: 2024-08-18T21:11:51.112 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.113 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.113 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.113 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.113 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.113 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.113 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.113 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.114 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.114 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.114 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.114 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.114 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.114 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.115 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.115 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.088+0000 7f62867fc640 1 -- 172.21.15.5:0/1273629441 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f628000f9b0 con 0x7f6290126ca0 2024-08-18T21:11:51.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.088+0000 7f62867fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:51.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.088+0000 7f62867fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:51.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.088+0000 7f62867fc640 1 -- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6290126ca0 msgr2=0x7f6290127080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.088+0000 7f62867fc640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6290126ca0 0x7f6290127080 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6290128bc0 tx=0x7f6280011a60 comp rx=0 tx=0).stop 2024-08-18T21:11:51.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.088+0000 7f62867fc640 1 -- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6290126ca0 msgr2=0x7f6290127080 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:51.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.088+0000 7f62867fc640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6290126ca0 0x7f6290127080 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.092+0000 7f62981d2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:51.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.092+0000 7f62981d2640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62901275c0 0x7f629009da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.092+0000 7f62981d2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.092+0000 7f62981d2640 1 -- 172.21.15.5:0/1273629441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6290128550 con 0x7f62901275c0 2024-08-18T21:11:51.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.096+0000 7f629576d640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62901275c0 0x7f629009da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.096+0000 7f629576d640 10 monclient: get_auth_request con 0x7f62901275c0 auth_method 0 2024-08-18T21:11:51.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.096+0000 7f629576d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.096+0000 7f629576d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.096+0000 7f629576d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.096+0000 7f629576d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.096+0000 7f629576d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.096+0000 7f629576d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.096+0000 7f629576d640 10 monclient(hunting): handle_auth_done global_id 104554 payload 824 2024-08-18T21:11:51.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.096+0000 7f629576d640 1 -- 172.21.15.5:0/1273629441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f629006e0d0 con 0x7f62901275c0 2024-08-18T21:11:51.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.096+0000 7f629576d640 1 -- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62901275c0 msgr2=0x7f629009da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.096+0000 7f629576d640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62901275c0 0x7f629009da30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f628001c000 tx=0x7f62800046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.096+0000 7f62867fc640 1 -- 172.21.15.5:0/1273629441 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f62800158d0 con 0x7f62901275c0 2024-08-18T21:11:51.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.096+0000 7f62867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.096+0000 7f62867fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:11:51.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.096+0000 7f62867fc640 10 monclient: dump: 2024-08-18T21:11:51.117 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.117 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.118 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.118 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.118 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.118 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.118 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.118 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.118 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.118 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.118 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.118 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.118 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.118 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.118 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.119 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62867fc640 1 -- 172.21.15.5:0/1273629441 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f6280015460 con 0x7f62901275c0 2024-08-18T21:11:51.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62867fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:51.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62867fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:51.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62867fc640 1 -- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62901275c0 msgr2=0x7f629009da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62867fc640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62901275c0 0x7f629009da30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f628001c000 tx=0x7f62800046d0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62867fc640 1 -- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62901275c0 msgr2=0x7f629009da30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:51.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62867fc640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62901275c0 0x7f629009da30 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f628001c000 tx=0x7f62800046d0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.119 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:51.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:51.120 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:51.120 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:51.120 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:51.120 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 75590, 2024-08-18T21:11:51.120 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:51.120 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:51.120 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:51.120 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:51.120 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:51.120 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:51.120 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:51.121 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:51.121 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:51.121 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:51.121 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.121 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:11:51.121 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:51.121 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:51.121 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:51.121 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:51.121 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:51.121 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:51.121 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:51.121 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:51.122 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:51.122 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:51.122 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:51.122 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:51.122 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:51.122 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:51.122 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.122 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:51.122 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:51.122 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:51.122 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:51.122 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:51.122 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:51.123 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:51.123 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:51.123 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:51.123 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:51.123 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:51.123 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:51.123 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:51.123 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.123 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:51.123 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:51.123 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:51.124 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:51.124 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:51.124 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:51.124 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:51.124 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:51.124 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:51.124 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:51.124 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:51.124 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:51.124 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:51.124 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:51.124 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:51.124 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:51.124 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:51.125 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:51.125 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:51.125 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:51.125 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:51.125 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:51.125 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:51.125 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:51.125 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:51.125 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:51.125 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:51.125 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:51.125 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.125 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:51.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.126 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:51.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.126 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:51.126 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:51.126 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.126 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.126 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.126 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:51.126 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.127 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.127 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:51.127 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.127 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.127 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.127 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:51.127 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:51.127 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.127 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.127 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.127 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:51.128 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:51.128 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.128 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.128 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.128 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:51.128 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.128 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.128 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:51.128 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.128 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.128 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.129 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:51.129 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:51.129 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.129 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.129 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.129 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:51.129 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:51.129 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.129 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.130 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.130 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:51.130 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.130 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.130 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:51.130 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.130 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.130 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.130 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:51.130 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:51.130 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.131 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.131 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.131 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:51.131 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:51.131 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.131 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.131 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.131 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:51.131 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.132 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.132 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:51.132 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.132 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.132 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.132 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:51.132 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:51.132 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.133 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.133 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.133 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:51.133 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:51.133 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.133 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.133 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.133 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:51.133 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.134 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.134 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:51.134 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.134 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.134 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.134 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:51.134 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:51.134 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.134 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.134 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.135 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.135 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:51.135 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:51.135 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.135 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.135 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.135 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.135 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:51.135 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.135 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.135 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.136 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:51.136 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.136 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.136 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.136 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:51.136 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:51.136 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.136 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.136 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.136 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:51.136 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:51.137 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.137 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.137 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.137 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:51.137 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.137 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.137 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:51.137 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.137 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.137 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.138 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:51.138 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:51.138 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.138 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.138 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.138 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:51.138 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:51.138 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.138 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.139 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.139 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:51.139 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.139 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.139 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:51.139 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.139 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.139 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.139 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:51.140 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:51.140 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.140 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.140 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.140 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:51.140 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:51.140 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.140 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.140 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.140 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:51.141 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.141 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.141 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:51.141 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.141 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.141 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.141 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:51.141 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:51.141 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.141 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.142 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.142 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.142 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.142 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:51.142 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:51.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.142 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:51.142 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:51.142 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:51.142 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.142 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.142 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:11:51.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.143 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:51.143 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:51.143 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:51.143 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.143 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.143 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:51.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.143 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:51.143 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:51.143 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:11:51.143 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.143 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.144 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:51.144 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:51.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62981d2640 1 -- 172.21.15.5:0/1273629441 >> v2:172.21.15.157:6812/631023601 conn(0x7f627403bdf0 msgr2=0x7f627403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62981d2640 1 --2- 172.21.15.5:0/1273629441 >> v2:172.21.15.157:6812/631023601 conn(0x7f627403bdf0 0x7f627403e2b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6290074270 tx=0x7f62880a7000 comp rx=0 tx=0).stop 2024-08-18T21:11:51.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62981d2640 10 monclient: shutdown 2024-08-18T21:11:51.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62981d2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:51.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62981d2640 1 -- 172.21.15.5:0/1273629441 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f62900a1c20 msgr2=0x7f62901d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62981d2640 1 --2- 172.21.15.5:0/1273629441 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f62900a1c20 0x7f62901d13b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c4a0 tx=0x7f628c00c960 comp rx=0 tx=0).stop 2024-08-18T21:11:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f629676f640 1 -- 172.21.15.5:0/1273629441 reap_dead start 2024-08-18T21:11:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f629676f640 1 -- 172.21.15.5:0/1273629441 reap_dead start 2024-08-18T21:11:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62981d2640 1 -- 172.21.15.5:0/1273629441 shutdown_connections 2024-08-18T21:11:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62981d2640 1 -- 172.21.15.5:0/1273629441 >> 172.21.15.5:0/1273629441 conn(0x7f6290068700 msgr2=0x7f62900a7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62981d2640 1 -- 172.21.15.5:0/1273629441 shutdown_connections 2024-08-18T21:11:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.100+0000 7f62981d2640 1 -- 172.21.15.5:0/1273629441 wait complete. 2024-08-18T21:11:51.146 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:51.146 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:11:51.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:11:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.260+0000 7f2e712b5640 10 monclient: get_monmap_and_config 2024-08-18T21:11:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.260+0000 7f2e712b5640 10 monclient: build_initial_monmap 2024-08-18T21:11:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.260+0000 7f2e712b5640 10 monclient: monmap: 2024-08-18T21:11:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.266 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:51.267714+0000 2024-08-18T21:11:51.266 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:51.267714+0000 2024-08-18T21:11:51.266 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:51.266 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.266 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:51.266 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:51.266 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:51.267 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 1 Processor -- start 2024-08-18T21:11:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 1 -- start start 2024-08-18T21:11:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 10 monclient: init 2024-08-18T21:11:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 10 monclient: _add_conns ranks=[7,3,9,2,4,6,8,1,5,0,10] 2024-08-18T21:11:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2e6c0a6ce0 0x7f2e6c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 10 monclient(hunting): picked mon.noname-i con 0x7f2e6c0a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c0a7600 0x7f2e6c139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 10 monclient(hunting): picked mon.noname-g con 0x7f2e6c0a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e6c139fe0 0x7f2e6c13a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 10 monclient(hunting): picked mon.noname-a con 0x7f2e6c139fe0 addr v2:172.21.15.5:3300/0 2024-08-18T21:11:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2e6c0a5000 con 0x7f2e6c139fe0 2024-08-18T21:11:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6c0a4360 con 0x7f2e6c0a7600 2024-08-18T21:11:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f2e6c0a45d0 con 0x7f2e6c0a6ce0 2024-08-18T21:11:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e712b5640 10 monclient(hunting): authenticate will time out at 1478.280880s 2024-08-18T21:11:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e6c139fe0 0x7f2e6c13a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e6c139fe0 0x7f2e6c13a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49810/0 (socket says 172.21.15.5:49810) 2024-08-18T21:11:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 1 -- 172.21.15.5:0/3954206755 learned_addr learned my addr 172.21.15.5:0/3954206755 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 10 monclient(hunting): get_auth_request con 0x7f2e6c139fe0 auth_method 0 2024-08-18T21:11:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6affd640 1 --2- 172.21.15.5:0/3954206755 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2e6c0a6ce0 0x7f2e6c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6affd640 10 monclient(hunting): get_auth_request con 0x7f2e6c0a6ce0 auth_method 0 2024-08-18T21:11:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6a7fc640 1 --2- 172.21.15.5:0/3954206755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c0a7600 0x7f2e6c139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 10 monclient(hunting): handle_auth_done global_id 114174 payload 274 2024-08-18T21:11:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 1 -- 172.21.15.5:0/3954206755 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2e6c0a6ce0 msgr2=0x7f2e6c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 1 --2- 172.21.15.5:0/3954206755 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2e6c0a6ce0 0x7f2e6c0a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 1 -- 172.21.15.5:0/3954206755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c0a7600 msgr2=0x7f2e6c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 1 --2- 172.21.15.5:0/3954206755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c0a7600 0x7f2e6c139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:11:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 1 monclient: found mon.noname-a 2024-08-18T21:11:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:11:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6b7fe640 1 -- 172.21.15.5:0/3954206755 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6c0a32d0 con 0x7f2e6c139fe0 2024-08-18T21:11:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6a7fc640 10 monclient: get_auth_request con 0x7f2e6c0a7600 auth_method 0 2024-08-18T21:11:51.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.264+0000 7f2e6a7fc640 1 --2- 172.21.15.5:0/3954206755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c0a7600 0x7f2e6c139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:11:51.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e6b7fe640 1 -- 172.21.15.5:0/3954206755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e6c139fe0 msgr2=0x7f2e6c13a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e6b7fe640 1 --2- 172.21.15.5:0/3954206755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e6c139fe0 0x7f2e6c13a440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009e50 tx=0x7f2e6401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8156cc6ace70a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e69ffb640 1 -- 172.21.15.5:0/3954206755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2e640090d0 con 0x7f2e6c139fe0 2024-08-18T21:11:51.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e69ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e69ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:11:51.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e69ffb640 10 monclient: dump: 2024-08-18T21:11:51.280 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.280 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.280 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.280 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.280 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.280 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.280 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.281 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.281 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.281 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.281 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.281 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.281 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.281 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.281 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.281 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e69ffb640 10 monclient: _finish_auth 0 2024-08-18T21:11:51.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e69ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:11:51.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e69ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:51.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e69ffb640 1 -- 172.21.15.5:0/3954206755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e640a5a90 con 0x7f2e6c139fe0 2024-08-18T21:11:51.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e69ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e69ffb640 1 -- 172.21.15.5:0/3954206755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2e640a5c40 con 0x7f2e6c139fe0 2024-08-18T21:11:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 5 monclient: authenticate success, global_id 114174 2024-08-18T21:11:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 4 set_mon_vals no callback set 2024-08-18T21:11:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e69ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e69ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:11:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e69ffb640 10 monclient: dump: 2024-08-18T21:11:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.283 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 10 monclient: shutdown 2024-08-18T21:11:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 1 -- 172.21.15.5:0/3954206755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e6c139fe0 msgr2=0x7f2e6c13a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 1 --2- 172.21.15.5:0/3954206755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e6c139fe0 0x7f2e6c13a440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009e50 tx=0x7f2e6401c8f0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 1 -- 172.21.15.5:0/3954206755 shutdown_connections 2024-08-18T21:11:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 1 --2- 172.21.15.5:0/3954206755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e6c139fe0 0x7f2e6c13a440 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 1 --2- 172.21.15.5:0/3954206755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c0a7600 0x7f2e6c139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 1 --2- 172.21.15.5:0/3954206755 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2e6c0a6ce0 0x7f2e6c0a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 1 -- 172.21.15.5:0/3954206755 >> 172.21.15.5:0/3954206755 conn(0x7f2e6c0acbc0 msgr2=0x7f2e6c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 1 -- 172.21.15.5:0/3954206755 shutdown_connections 2024-08-18T21:11:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 1 -- 172.21.15.5:0/3954206755 wait complete. 2024-08-18T21:11:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 10 monclient: build_initial_monmap 2024-08-18T21:11:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 10 monclient: monmap: 2024-08-18T21:11:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:51.285 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 1 Processor -- start 2024-08-18T21:11:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 1 -- start start 2024-08-18T21:11:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.268+0000 7f2e712b5640 10 monclient: init 2024-08-18T21:11:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 10 monclient: _add_conns ranks=[7,6,1,5,0,3,8,4,2] 2024-08-18T21:11:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2e6c0a6ce0 0x7f2e6c134cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 10 monclient(hunting): picked mon.noname-i con 0x7f2e6c0a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2e6c0a7600 0x7f2e6c1351f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 10 monclient(hunting): picked mon.noname-d con 0x7f2e6c0a7600 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e6c139fe0 0x7f2e6c13aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 10 monclient(hunting): picked mon.noname-f con 0x7f2e6c139fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:11:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6c0a79e0 con 0x7f2e6c139fe0 2024-08-18T21:11:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f2e6c0a8220 con 0x7f2e6c0a7600 2024-08-18T21:11:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f2e6c140950 con 0x7f2e6c0a6ce0 2024-08-18T21:11:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 10 monclient(hunting): authenticate will time out at 1478.288344s 2024-08-18T21:11:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2e6c0a7600 0x7f2e6c1351f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2e6c0a7600 0x7f2e6c1351f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:53146/0 (socket says 172.21.15.5:53146) 2024-08-18T21:11:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 1 -- 172.21.15.5:0/1763695745 learned_addr learned my addr 172.21.15.5:0/1763695745 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 10 monclient(hunting): get_auth_request con 0x7f2e6c0a7600 auth_method 0 2024-08-18T21:11:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6affd640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2e6c0a6ce0 0x7f2e6c134cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6b7fe640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e6c139fe0 0x7f2e6c13aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6affd640 10 monclient(hunting): get_auth_request con 0x7f2e6c0a6ce0 auth_method 0 2024-08-18T21:11:51.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6b7fe640 10 monclient(hunting): get_auth_request con 0x7f2e6c139fe0 auth_method 0 2024-08-18T21:11:51.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 10 monclient(hunting): handle_auth_done global_id 85308 payload 824 2024-08-18T21:11:51.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 1 -- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2e6c0a6ce0 msgr2=0x7f2e6c134cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2e6c0a6ce0 0x7f2e6c134cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 1 -- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e6c139fe0 msgr2=0x7f2e6c13aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e6c139fe0 0x7f2e6c13aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:11:51.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 1 monclient: found mon.noname-d 2024-08-18T21:11:51.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:51.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:11:51.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 1 -- 172.21.15.5:0/1763695745 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6c0aa370 con 0x7f2e6c0a7600 2024-08-18T21:11:51.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6affd640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f2e6c0a6ce0 0x7f2e6c134cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:11:51.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 1 -- 172.21.15.5:0/1763695745 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2e6c0a7600 msgr2=0x7f2e6c1351f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e6a7fc640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2e6c0a7600 0x7f2e6c1351f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000c7f0 tx=0x7f2e6000ccb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e537fe640 1 -- 172.21.15.5:0/1763695745 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2e600113f0 con 0x7f2e6c0a7600 2024-08-18T21:11:51.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e537fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:11:51.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e537fe640 10 monclient: dump: 2024-08-18T21:11:51.290 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.290 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.290 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.290 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.290 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.290 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.290 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.290 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.290 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.290 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.291 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.291 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.291 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.291 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.291 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.291 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e537fe640 10 monclient: _finish_auth 0 2024-08-18T21:11:51.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e537fe640 10 monclient: _check_auth_tickets 2024-08-18T21:11:51.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:51.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e537fe640 1 -- 172.21.15.5:0/1763695745 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e600115d0 con 0x7f2e6c0a7600 2024-08-18T21:11:51.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 5 monclient: authenticate success, global_id 85308 2024-08-18T21:11:51.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 10 monclient: _renew_subs 2024-08-18T21:11:51.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:51.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 1 -- 172.21.15.5:0/1763695745 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6c0ac020 con 0x7f2e6c0a7600 2024-08-18T21:11:51.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e537fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:51.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e537fe640 1 -- 172.21.15.5:0/1763695745 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2e60011bf0 con 0x7f2e6c0a7600 2024-08-18T21:11:51.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e537fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:51.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e537fe640 10 monclient: dump: 2024-08-18T21:11:51.292 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.292 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.292 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.292 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.292 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.292 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.292 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.292 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.292 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.292 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.293 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.293 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.293 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.293 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.293 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.293 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e697fa640 4 set_mon_vals no callback set 2024-08-18T21:11:51.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 10 monclient: _renew_subs 2024-08-18T21:11:51.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:51.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.272+0000 7f2e712b5640 1 -- 172.21.15.5:0/1763695745 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e6c13d900 con 0x7f2e6c0a7600 2024-08-18T21:11:51.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e712b5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:51.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e712b5640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c13b740 0x7f2e6c02d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e712b5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e712b5640 1 -- 172.21.15.5:0/1763695745 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6c0a7b60 con 0x7f2e6c13b740 2024-08-18T21:11:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e6affd640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c13b740 0x7f2e6c02d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e537fe640 1 -- 172.21.15.5:0/1763695745 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f2e60011780 con 0x7f2e6c0a7600 2024-08-18T21:11:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e6affd640 10 monclient: get_auth_request con 0x7f2e6c13b740 auth_method 0 2024-08-18T21:11:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e6affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e6affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e6affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e6affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e6affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e6affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e537fe640 1 --2- 172.21.15.5:0/1763695745 >> v2:172.21.15.157:6812/631023601 conn(0x7f2e5803bdc0 0x7f2e5803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e537fe640 1 -- 172.21.15.5:0/1763695745 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(236..236 src has 22..236) ==== 3898+0+0 (secure 0 0 0) 0x7f2e6004e820 con 0x7f2e6c0a7600 2024-08-18T21:11:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e6b7fe640 1 --2- 172.21.15.5:0/1763695745 >> v2:172.21.15.157:6812/631023601 conn(0x7f2e5803bdc0 0x7f2e5803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e6affd640 10 monclient(hunting): handle_auth_done global_id 85152 payload 824 2024-08-18T21:11:51.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e6affd640 1 -- 172.21.15.5:0/1763695745 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e6c139aa0 con 0x7f2e6c13b740 2024-08-18T21:11:51.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e6b7fe640 10 monclient: get_auth_request con 0x7f2e5803bdc0 auth_method 0 2024-08-18T21:11:51.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e6affd640 1 -- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c13b740 msgr2=0x7f2e6c02d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e6affd640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c13b740 0x7f2e6c02d1d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00f420 tx=0x7f2e5c00f8e0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e537fe640 1 -- 172.21.15.5:0/1763695745 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2e5c018020 con 0x7f2e6c13b740 2024-08-18T21:11:51.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e537fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:11:51.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e537fe640 10 monclient: dump: 2024-08-18T21:11:51.297 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.297 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.297 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.297 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.298 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.298 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.298 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.298 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.298 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.298 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.298 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.298 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.298 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.298 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.298 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.298 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.276+0000 7f2e6b7fe640 1 --2- 172.21.15.5:0/1763695745 >> v2:172.21.15.157:6812/631023601 conn(0x7f2e5803bdc0 0x7f2e5803e280 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009e50 tx=0x7f2e640a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.280+0000 7f2e537fe640 1 -- 172.21.15.5:0/1763695745 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2e5c014880 con 0x7f2e6c13b740 2024-08-18T21:11:51.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.280+0000 7f2e537fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:51.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.280+0000 7f2e537fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:51.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.280+0000 7f2e537fe640 1 -- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c13b740 msgr2=0x7f2e6c02d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.280+0000 7f2e537fe640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c13b740 0x7f2e6c02d1d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00f420 tx=0x7f2e5c00f8e0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.280+0000 7f2e537fe640 1 -- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c13b740 msgr2=0x7f2e6c02d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:51.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.280+0000 7f2e537fe640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c13b740 0x7f2e6c02d1d0 secure :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00f420 tx=0x7f2e5c00f8e0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.284+0000 7f2e712b5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:51.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.284+0000 7f2e712b5640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c13bb20 0x7f2e6c02d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.284+0000 7f2e712b5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.284+0000 7f2e712b5640 1 -- 172.21.15.5:0/1763695745 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6c051140 con 0x7f2e6c13bb20 2024-08-18T21:11:51.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.284+0000 7f2e6affd640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c13bb20 0x7f2e6c02d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.284+0000 7f2e6affd640 10 monclient: get_auth_request con 0x7f2e6c13bb20 auth_method 0 2024-08-18T21:11:51.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.284+0000 7f2e6affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.284+0000 7f2e6affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.284+0000 7f2e6affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.284+0000 7f2e6affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.284+0000 7f2e6affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.284+0000 7f2e6affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.284+0000 7f2e6affd640 10 monclient(hunting): handle_auth_done global_id 85161 payload 824 2024-08-18T21:11:51.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.284+0000 7f2e6affd640 1 -- 172.21.15.5:0/1763695745 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2e6c09f140 con 0x7f2e6c13bb20 2024-08-18T21:11:51.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.288+0000 7f2e6affd640 1 -- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c13bb20 msgr2=0x7f2e6c02d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.288+0000 7f2e6affd640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c13bb20 0x7f2e6c02d710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c019000 tx=0x7f2e5c0046d0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.288+0000 7f2e537fe640 1 -- 172.21.15.5:0/1763695745 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2e5c018040 con 0x7f2e6c13bb20 2024-08-18T21:11:51.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.288+0000 7f2e537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.288+0000 7f2e537fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:11:51.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.288+0000 7f2e537fe640 10 monclient: dump: 2024-08-18T21:11:51.301 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.301 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.301 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.301 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.301 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.301 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.301 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.301 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.301 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.301 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.301 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.301 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.302 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.302 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.302 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.302 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.288+0000 7f2e537fe640 1 -- 172.21.15.5:0/1763695745 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f2e5c01f020 con 0x7f2e6c13bb20 2024-08-18T21:11:51.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.288+0000 7f2e537fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:51.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.288+0000 7f2e537fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:51.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.288+0000 7f2e537fe640 1 -- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c13bb20 msgr2=0x7f2e6c02d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.288+0000 7f2e537fe640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c13bb20 0x7f2e6c02d710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c019000 tx=0x7f2e5c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.288+0000 7f2e537fe640 1 -- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c13bb20 msgr2=0x7f2e6c02d710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:51.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.288+0000 7f2e537fe640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e6c13bb20 0x7f2e6c02d710 secure :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c019000 tx=0x7f2e5c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.303 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:51.303 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:51.303 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:51.303 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:51.303 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:51.303 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 208116, 2024-08-18T21:11:51.303 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:51.303 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:51.303 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:51.303 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:51.304 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:51.304 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:51.304 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:51.304 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:51.304 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:51.304 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:51.304 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.304 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:11:51.304 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:51.304 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:51.304 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:51.304 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:51.304 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:51.305 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:51.305 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:51.305 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:51.305 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:51.305 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:51.305 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:51.305 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:51.305 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:51.305 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:51.305 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.305 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:51.305 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:51.305 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:51.305 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:51.306 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:51.306 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:51.306 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:51.306 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:51.306 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:51.306 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:51.306 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:51.306 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:51.306 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:51.306 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.306 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:51.306 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:51.307 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:51.307 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:51.307 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:51.307 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:51.307 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:51.307 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:51.307 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:51.307 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:51.307 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:51.307 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:51.307 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:51.307 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:51.307 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:51.308 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:51.308 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:51.308 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:51.308 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:51.308 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:51.308 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:51.308 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:51.308 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:51.308 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:51.308 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:51.308 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:51.308 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:51.308 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:51.308 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.309 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:51.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.309 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:51.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.309 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:51.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:51.309 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:51.309 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:51.310 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.310 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.310 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:51.310 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:51.310 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.310 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.310 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.311 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:51.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:51.311 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:51.311 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:51.312 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.312 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.312 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:51.312 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:51.312 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.312 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.312 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.312 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:51.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:51.313 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:51.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:51.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.316 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.316 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.316 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:51.316 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:51.316 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:51.316 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.317 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.317 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:51.317 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.317 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.317 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.317 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:51.317 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:51.317 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.317 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.317 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.317 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:51.318 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:51.318 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.318 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.318 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:51.318 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.318 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:51.318 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.318 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.319 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.319 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:51.319 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:51.319 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.319 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.319 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.319 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:51.319 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:51.319 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.319 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.320 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.320 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:51.320 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.320 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.320 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:51.320 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.320 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.320 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.320 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:51.320 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:51.320 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.322 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.322 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:51.322 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.322 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.322 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.322 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:51.322 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:51.322 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.322 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.322 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.323 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:51.323 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:51.323 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.323 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.323 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.323 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:51.323 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.323 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.323 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:51.323 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.323 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.323 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:11:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:51.326 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:51.326 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.326 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.326 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:51.326 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:51.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.292+0000 7f2e712b5640 1 -- 172.21.15.5:0/1763695745 >> v2:172.21.15.157:6812/631023601 conn(0x7f2e5803bdc0 msgr2=0x7f2e5803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.292+0000 7f2e712b5640 1 --2- 172.21.15.5:0/1763695745 >> v2:172.21.15.157:6812/631023601 conn(0x7f2e5803bdc0 0x7f2e5803e280 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009e50 tx=0x7f2e640a7070 comp rx=0 tx=0).stop 2024-08-18T21:11:51.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.292+0000 7f2e712b5640 10 monclient: shutdown 2024-08-18T21:11:51.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.292+0000 7f2e712b5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:51.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.292+0000 7f2e712b5640 1 -- 172.21.15.5:0/1763695745 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2e6c0a7600 msgr2=0x7f2e6c1351f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.292+0000 7f2e712b5640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2e6c0a7600 0x7f2e6c1351f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000c7f0 tx=0x7f2e6000ccb0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.292+0000 7f2e6b7fe640 1 -- 172.21.15.5:0/1763695745 reap_dead start 2024-08-18T21:11:51.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.292+0000 7f2e712b5640 1 -- 172.21.15.5:0/1763695745 shutdown_connections 2024-08-18T21:11:51.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.292+0000 7f2e712b5640 1 --2- 172.21.15.5:0/1763695745 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2e6c0a7600 0x7f2e6c1351f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.292+0000 7f2e712b5640 1 -- 172.21.15.5:0/1763695745 >> 172.21.15.5:0/1763695745 conn(0x7f2e6c0acbc0 msgr2=0x7f2e6c138610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:51.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.292+0000 7f2e712b5640 1 -- 172.21.15.5:0/1763695745 shutdown_connections 2024-08-18T21:11:51.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.292+0000 7f2e712b5640 1 -- 172.21.15.5:0/1763695745 wait complete. 2024-08-18T21:11:51.328 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:51.328 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:11:51.329 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:11:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 10 monclient: get_monmap_and_config 2024-08-18T21:11:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 10 monclient: build_initial_monmap 2024-08-18T21:11:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 10 monclient: monmap: 2024-08-18T21:11:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:51.449279+0000 2024-08-18T21:11:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:51.449279+0000 2024-08-18T21:11:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:51.450 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 1 Processor -- start 2024-08-18T21:11:51.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 1 -- start start 2024-08-18T21:11:51.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 10 monclient: init 2024-08-18T21:11:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 10 monclient: _add_conns ranks=[6,2,10,9,3,4,5,7,1,8,0] 2024-08-18T21:11:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9d980a6bd0 0x7f9d980a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 10 monclient(hunting): picked mon.noname-d con 0x7f9d980a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9d9809f080 0x7f9d980a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 10 monclient(hunting): picked mon.noname-b con 0x7f9d9809f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:11:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9d98139990 0x7f9d98139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 10 monclient(hunting): picked mon.noname-f con 0x7f9d98139990 addr v2:172.21.15.157:3300/0 2024-08-18T21:11:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f9d9809e4c0 con 0x7f9d98139990 2024-08-18T21:11:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f9d9806f930 con 0x7f9d9809f080 2024-08-18T21:11:51.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f9d980a7a30 con 0x7f9d980a6bd0 2024-08-18T21:11:51.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:51.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9e91a640 10 monclient(hunting): authenticate will time out at 1478.462449s 2024-08-18T21:11:51.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d97fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9d980a6bd0 0x7f9d980a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d97fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9d980a6bd0 0x7f9d980a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:53156/0 (socket says 172.21.15.5:53156) 2024-08-18T21:11:51.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d97fff640 1 -- 172.21.15.5:0/435073956 learned_addr learned my addr 172.21.15.5:0/435073956 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:51.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d97fff640 10 monclient(hunting): get_auth_request con 0x7f9d980a6bd0 auth_method 0 2024-08-18T21:11:51.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d97fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d97fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d97fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 1 --2- 172.21.15.5:0/435073956 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9d9809f080 0x7f9d980a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 10 monclient(hunting): get_auth_request con 0x7f9d9809f080 auth_method 0 2024-08-18T21:11:51.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d97fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d97fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d97fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9ceb7640 1 --2- 172.21.15.5:0/435073956 >> v2:172.21.15.157:3300/0 conn(0x7f9d98139990 0x7f9d98139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9ceb7640 10 monclient(hunting): get_auth_request con 0x7f9d98139990 auth_method 0 2024-08-18T21:11:51.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9ceb7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9ceb7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d9ceb7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 10 monclient(hunting): handle_auth_done global_id 114140 payload 274 2024-08-18T21:11:51.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 1 -- 172.21.15.5:0/435073956 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9d980a6bd0 msgr2=0x7f9d980a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:51.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 1 --2- 172.21.15.5:0/435073956 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9d980a6bd0 0x7f9d980a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 1 -- 172.21.15.5:0/435073956 >> v2:172.21.15.157:3300/0 conn(0x7f9d98139990 msgr2=0x7f9d98139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 1 --2- 172.21.15.5:0/435073956 >> v2:172.21.15.157:3300/0 conn(0x7f9d98139990 0x7f9d98139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 10 monclient: _finish_hunting 0 2024-08-18T21:11:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 1 monclient: found mon.noname-b 2024-08-18T21:11:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:51.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:11:51.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d977fe640 1 -- 172.21.15.5:0/435073956 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d980a7fb0 con 0x7f9d9809f080 2024-08-18T21:11:51.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.444+0000 7f9d97fff640 1 --2- 172.21.15.5:0/435073956 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9d980a6bd0 0x7f9d980a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:51.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.448+0000 7f9d977fe640 1 -- 172.21.15.5:0/435073956 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9d9809f080 msgr2=0x7f9d980a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.448+0000 7f9d977fe640 1 --2- 172.21.15.5:0/435073956 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9d9809f080 0x7f9d980a74f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9d800097f0 tx=0x7f9d8001c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=669d4e9028ae1720 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.448+0000 7f9d96ffd640 1 -- 172.21.15.5:0/435073956 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9d800b0070 con 0x7f9d9809f080 2024-08-18T21:11:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.448+0000 7f9d96ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.448+0000 7f9d96ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:11:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.448+0000 7f9d96ffd640 10 monclient: dump: 2024-08-18T21:11:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.474 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.474 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.474 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.474 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.474 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.474 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.476 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.448+0000 7f9d96ffd640 10 monclient: _finish_auth 0 2024-08-18T21:11:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.448+0000 7f9d96ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:11:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.448+0000 7f9d96ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.448+0000 7f9d9e91a640 5 monclient: authenticate success, global_id 114140 2024-08-18T21:11:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.448+0000 7f9d96ffd640 1 -- 172.21.15.5:0/435073956 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d800aa810 con 0x7f9d9809f080 2024-08-18T21:11:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.448+0000 7f9d96ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.448+0000 7f9d96ffd640 1 -- 172.21.15.5:0/435073956 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9d800a4e60 con 0x7f9d9809f080 2024-08-18T21:11:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.448+0000 7f9d9e91a640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.448+0000 7f9d9e91a640 4 set_mon_vals no callback set 2024-08-18T21:11:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.448+0000 7f9d96ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d96ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:11:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d96ffd640 10 monclient: dump: 2024-08-18T21:11:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.480 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 10 monclient: shutdown 2024-08-18T21:11:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 -- 172.21.15.5:0/435073956 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9d9809f080 msgr2=0x7f9d980a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 --2- 172.21.15.5:0/435073956 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9d9809f080 0x7f9d980a74f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9d800097f0 tx=0x7f9d8001c360 comp rx=0 tx=0).stop 2024-08-18T21:11:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 -- 172.21.15.5:0/435073956 shutdown_connections 2024-08-18T21:11:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 --2- 172.21.15.5:0/435073956 >> v2:172.21.15.157:3300/0 conn(0x7f9d98139990 0x7f9d98139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 --2- 172.21.15.5:0/435073956 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9d9809f080 0x7f9d980a74f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 --2- 172.21.15.5:0/435073956 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9d980a6bd0 0x7f9d980a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 -- 172.21.15.5:0/435073956 >> 172.21.15.5:0/435073956 conn(0x7f9d98068700 msgr2=0x7f9d98068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 -- 172.21.15.5:0/435073956 shutdown_connections 2024-08-18T21:11:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 -- 172.21.15.5:0/435073956 wait complete. 2024-08-18T21:11:51.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 10 monclient: build_initial_monmap 2024-08-18T21:11:51.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 10 monclient: monmap: 2024-08-18T21:11:51.482 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:51.482 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:51.482 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:51.485 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 Processor -- start 2024-08-18T21:11:51.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 -- start start 2024-08-18T21:11:51.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 10 monclient: init 2024-08-18T21:11:51.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:51.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 10 monclient: _add_conns ranks=[6,3,8,2,1,5,4,0,7] 2024-08-18T21:11:51.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9d9809f080 0x7f9d98138840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 10 monclient(hunting): picked mon.noname-d con 0x7f9d9809f080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:51.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d980a6bd0 0x7f9d98138d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 10 monclient(hunting): picked mon.noname-g con 0x7f9d980a6bd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:51.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d98139990 0x7f9d9813dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 10 monclient(hunting): picked mon.noname-e con 0x7f9d98139990 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9d980a89f0 con 0x7f9d980a6bd0 2024-08-18T21:11:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f9d980a7ce0 con 0x7f9d9809f080 2024-08-18T21:11:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f9d98143610 con 0x7f9d98139990 2024-08-18T21:11:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9e91a640 10 monclient(hunting): authenticate will time out at 1478.470857s 2024-08-18T21:11:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9d9809f080 0x7f9d98138840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9d9809f080 0x7f9d98138840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:53166/0 (socket says 172.21.15.5:53166) 2024-08-18T21:11:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 1 -- 172.21.15.5:0/3893814199 learned_addr learned my addr 172.21.15.5:0/3893814199 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 10 monclient(hunting): get_auth_request con 0x7f9d9809f080 auth_method 0 2024-08-18T21:11:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9ceb7640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d98139990 0x7f9d9813dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9ceb7640 10 monclient(hunting): get_auth_request con 0x7f9d98139990 auth_method 0 2024-08-18T21:11:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9ceb7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9ceb7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d9ceb7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 10 monclient(hunting): handle_auth_done global_id 85326 payload 824 2024-08-18T21:11:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d977fe640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d980a6bd0 0x7f9d98138d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 1 -- 172.21.15.5:0/3893814199 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d98139990 msgr2=0x7f9d9813dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9d98139990 0x7f9d9813dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 1 -- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d980a6bd0 msgr2=0x7f9d98138d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d980a6bd0 0x7f9d98138d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 10 monclient: _finish_hunting 0 2024-08-18T21:11:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 1 monclient: found mon.noname-d 2024-08-18T21:11:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:11:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d97fff640 1 -- 172.21.15.5:0/3893814199 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d981242a0 con 0x7f9d9809f080 2024-08-18T21:11:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d977fe640 10 monclient: get_auth_request con 0x7f9d980a6bd0 auth_method 0 2024-08-18T21:11:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.452+0000 7f9d977fe640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d980a6bd0 0x7f9d98138d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:11:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d97fff640 1 -- 172.21.15.5:0/3893814199 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9d9809f080 msgr2=0x7f9d98138840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d97fff640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9d9809f080 0x7f9d98138840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009f20 tx=0x7f9d9000c550 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d94ff9640 1 -- 172.21.15.5:0/3893814199 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9d900148f0 con 0x7f9d9809f080 2024-08-18T21:11:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d94ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d94ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:11:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d94ff9640 10 monclient: dump: 2024-08-18T21:11:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.492 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.492 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.492 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.492 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.492 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.492 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.493 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.493 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.493 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.493 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.493 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d94ff9640 10 monclient: _finish_auth 0 2024-08-18T21:11:51.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d94ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:11:51.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d94ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:51.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d94ff9640 1 -- 172.21.15.5:0/3893814199 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d90019070 con 0x7f9d9809f080 2024-08-18T21:11:51.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d94ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:51.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d94ff9640 1 -- 172.21.15.5:0/3893814199 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9d900073f0 con 0x7f9d9809f080 2024-08-18T21:11:51.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d94ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d94ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d94ff9640 10 monclient: dump: 2024-08-18T21:11:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.495 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.496 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.497 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.497 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.497 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.497 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d967fc640 4 set_mon_vals no callback set 2024-08-18T21:11:51.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d9e91a640 5 monclient: authenticate success, global_id 85326 2024-08-18T21:11:51.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d9e91a640 10 monclient: _renew_subs 2024-08-18T21:11:51.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d9e91a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:51.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d9e91a640 1 -- 172.21.15.5:0/3893814199 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d980ab6c0 con 0x7f9d9809f080 2024-08-18T21:11:51.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d9e91a640 10 monclient: _renew_subs 2024-08-18T21:11:51.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d9e91a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:51.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d9e91a640 1 -- 172.21.15.5:0/3893814199 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d980ab170 con 0x7f9d9809f080 2024-08-18T21:11:51.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d9e91a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:51.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d9e91a640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d9813e150 0x7f9d9813e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d9e91a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d9e91a640 1 -- 172.21.15.5:0/3893814199 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f9d98051140 con 0x7f9d9813e150 2024-08-18T21:11:51.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d94ff9640 1 -- 172.21.15.5:0/3893814199 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f9d90012050 con 0x7f9d9809f080 2024-08-18T21:11:51.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d977fe640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d9813e150 0x7f9d9813e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d94ff9640 1 --2- 172.21.15.5:0/3893814199 >> v2:172.21.15.157:6812/631023601 conn(0x7f9d7803bdc0 0x7f9d7803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d977fe640 10 monclient: get_auth_request con 0x7f9d9813e150 auth_method 0 2024-08-18T21:11:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d94ff9640 1 -- 172.21.15.5:0/3893814199 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(236..236 src has 22..236) ==== 3898+0+0 (secure 0 0 0) 0x7f9d9004e8b0 con 0x7f9d9809f080 2024-08-18T21:11:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d977fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d977fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d9ceb7640 1 --2- 172.21.15.5:0/3893814199 >> v2:172.21.15.157:6812/631023601 conn(0x7f9d7803bdc0 0x7f9d7803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.456+0000 7f9d9ceb7640 10 monclient: get_auth_request con 0x7f9d7803bdc0 auth_method 0 2024-08-18T21:11:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.460+0000 7f9d977fe640 10 monclient(hunting): handle_auth_done global_id 94838 payload 824 2024-08-18T21:11:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.460+0000 7f9d977fe640 1 -- 172.21.15.5:0/3893814199 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d98123b90 con 0x7f9d9813e150 2024-08-18T21:11:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.460+0000 7f9d9ceb7640 1 --2- 172.21.15.5:0/3893814199 >> v2:172.21.15.157:6812/631023601 conn(0x7f9d7803bdc0 0x7f9d7803e280 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800d850 tx=0x7f9d88008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.460+0000 7f9d977fe640 1 -- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d9813e150 msgr2=0x7f9d9813e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.460+0000 7f9d977fe640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d9813e150 0x7f9d9813e530 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9d800ad000 tx=0x7f9d80019100 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.460+0000 7f9d94ff9640 1 -- 172.21.15.5:0/3893814199 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9d800b9020 con 0x7f9d9813e150 2024-08-18T21:11:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.460+0000 7f9d94ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.460+0000 7f9d94ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:11:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.460+0000 7f9d94ff9640 10 monclient: dump: 2024-08-18T21:11:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.504 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.505 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.460+0000 7f9d94ff9640 1 -- 172.21.15.5:0/3893814199 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9d800a4e60 con 0x7f9d9813e150 2024-08-18T21:11:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.460+0000 7f9d94ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.460+0000 7f9d94ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.460+0000 7f9d94ff9640 1 -- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d9813e150 msgr2=0x7f9d9813e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.460+0000 7f9d94ff9640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d9813e150 0x7f9d9813e530 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9d800ad000 tx=0x7f9d80019100 comp rx=0 tx=0).stop 2024-08-18T21:11:51.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.460+0000 7f9d94ff9640 1 -- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d9813e150 msgr2=0x7f9d9813e530 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.460+0000 7f9d94ff9640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d9813e150 0x7f9d9813e530 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9d800ad000 tx=0x7f9d80019100 comp rx=0 tx=0).stop 2024-08-18T21:11:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.468+0000 7f9d9e91a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.468+0000 7f9d9e91a640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d9813ea70 0x7f9d980a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.468+0000 7f9d9e91a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.468+0000 7f9d9e91a640 1 -- 172.21.15.5:0/3893814199 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f9d98139e10 con 0x7f9d9813ea70 2024-08-18T21:11:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.468+0000 7f9d977fe640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d9813ea70 0x7f9d980a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.468+0000 7f9d977fe640 10 monclient: get_auth_request con 0x7f9d9813ea70 auth_method 0 2024-08-18T21:11:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.468+0000 7f9d977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.468+0000 7f9d977fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.468+0000 7f9d977fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.468+0000 7f9d977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.468+0000 7f9d977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.468+0000 7f9d977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.468+0000 7f9d977fe640 10 monclient(hunting): handle_auth_done global_id 94847 payload 824 2024-08-18T21:11:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.468+0000 7f9d977fe640 1 -- 172.21.15.5:0/3893814199 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9d980746d0 con 0x7f9d9813ea70 2024-08-18T21:11:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d977fe640 1 -- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d9813ea70 msgr2=0x7f9d980a4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d977fe640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d9813ea70 0x7f9d980a4570 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9d8001cc00 tx=0x7f9d800a8000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d94ff9640 1 -- 172.21.15.5:0/3893814199 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9d800b9040 con 0x7f9d9813ea70 2024-08-18T21:11:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d94ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d94ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:11:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d94ff9640 10 monclient: dump: 2024-08-18T21:11:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.507 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.508 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d94ff9640 1 -- 172.21.15.5:0/3893814199 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f9d80003cf0 con 0x7f9d9813ea70 2024-08-18T21:11:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d94ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d94ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d94ff9640 1 -- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d9813ea70 msgr2=0x7f9d980a4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d94ff9640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d9813ea70 0x7f9d980a4570 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9d8001cc00 tx=0x7f9d800a8000 comp rx=0 tx=0).stop 2024-08-18T21:11:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d94ff9640 1 -- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d9813ea70 msgr2=0x7f9d980a4570 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:51.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d94ff9640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9d9813ea70 0x7f9d980a4570 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9d8001cc00 tx=0x7f9d800a8000 comp rx=0 tx=0).stop 2024-08-18T21:11:51.509 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 139513, 2024-08-18T21:11:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:11:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.534 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.534 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:51.534 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.534 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.534 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.535 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:51.535 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:51.535 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.535 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.535 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.535 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:11:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:11:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.542 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.542 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:51.542 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d9e91a640 1 -- 172.21.15.5:0/3893814199 >> v2:172.21.15.157:6812/631023601 conn(0x7f9d7803bdc0 msgr2=0x7f9d7803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d9e91a640 1 --2- 172.21.15.5:0/3893814199 >> v2:172.21.15.157:6812/631023601 conn(0x7f9d7803bdc0 0x7f9d7803e280 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800d850 tx=0x7f9d88008040 comp rx=0 tx=0).stop 2024-08-18T21:11:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d9e91a640 10 monclient: shutdown 2024-08-18T21:11:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d9e91a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d9e91a640 1 -- 172.21.15.5:0/3893814199 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9d9809f080 msgr2=0x7f9d98138840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d9e91a640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9d9809f080 0x7f9d98138840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009f20 tx=0x7f9d9000c550 comp rx=0 tx=0).stop 2024-08-18T21:11:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d9ceb7640 1 -- 172.21.15.5:0/3893814199 reap_dead start 2024-08-18T21:11:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d9e91a640 1 -- 172.21.15.5:0/3893814199 shutdown_connections 2024-08-18T21:11:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d9e91a640 1 --2- 172.21.15.5:0/3893814199 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9d9809f080 0x7f9d98138840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d9e91a640 1 -- 172.21.15.5:0/3893814199 >> 172.21.15.5:0/3893814199 conn(0x7f9d98068700 msgr2=0x7f9d980a9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d9e91a640 1 -- 172.21.15.5:0/3893814199 shutdown_connections 2024-08-18T21:11:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.472+0000 7f9d9e91a640 1 -- 172.21.15.5:0/3893814199 wait complete. 2024-08-18T21:11:51.545 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:51.546 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:11:51.546 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:11:51.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 10 monclient: get_monmap_and_config 2024-08-18T21:11:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 10 monclient: build_initial_monmap 2024-08-18T21:11:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 10 monclient: monmap: 2024-08-18T21:11:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:51.677469+0000 2024-08-18T21:11:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:51.677469+0000 2024-08-18T21:11:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:51.676 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:51.676 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:51.676 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:51.676 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:51.676 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:51.676 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:51.676 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:51.676 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:51.676 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:51.676 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 1 Processor -- start 2024-08-18T21:11:51.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 1 -- start start 2024-08-18T21:11:51.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 10 monclient: init 2024-08-18T21:11:51.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:51.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 10 monclient: _add_conns ranks=[0,5,6,9,4,1,8,7,2,10,3] 2024-08-18T21:11:51.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f88780a6ce0 addr v1:172.21.15.5:6789/0 2024-08-18T21:11:51.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f88780a77d0 0x7f887813ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 10 monclient(hunting): picked mon.noname-h con 0x7f88780a77d0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:51.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f887813f220 0x7f8878141610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 10 monclient(hunting): picked mon.noname-d con 0x7f887813f220 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:51.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88780a45d0 con 0x7f88780a6ce0 2024-08-18T21:11:51.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f88780a5000 con 0x7f88780a77d0 2024-08-18T21:11:51.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f88780a4360 con 0x7f887813f220 2024-08-18T21:11:51.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:51.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f887d513640 10 monclient(hunting): authenticate will time out at 1478.690679s 2024-08-18T21:11:51.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f8876ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f88780a6ce0 0x7f88780a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49148/0 (socket says 172.21.15.5:49148) 2024-08-18T21:11:51.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f8876ffd640 1 -- 172.21.15.5:0/2492144917 learned_addr learned my addr 172.21.15.5:0/2492144917 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:11:51.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 1 --2- 172.21.15.5:0/2492144917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f887813f220 0x7f8878141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 10 monclient(hunting): get_auth_request con 0x7f887813f220 auth_method 0 2024-08-18T21:11:51.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88767fc640 1 --2- 172.21.15.5:0/2492144917 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f88780a77d0 0x7f887813ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88767fc640 10 monclient(hunting): get_auth_request con 0x7f88780a77d0 auth_method 0 2024-08-18T21:11:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88767fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88767fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88767fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 10 monclient(hunting): handle_auth_done global_id 85335 payload 274 2024-08-18T21:11:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 1 -- 172.21.15.5:0/2492144917 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f88780a77d0 msgr2=0x7f887813ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 1 --2- 172.21.15.5:0/2492144917 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f88780a77d0 0x7f887813ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 1 -- 172.21.15.5:0/2492144917 >> v1:172.21.15.5:6789/0 conn(0x7f88780a6ce0 legacy=0x7f88780a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:51.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 10 monclient: _finish_hunting 0 2024-08-18T21:11:51.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 1 monclient: found mon.noname-d 2024-08-18T21:11:51.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:51.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:11:51.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.672+0000 7f88777fe640 1 -- 172.21.15.5:0/2492144917 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88780a32d0 con 0x7f887813f220 2024-08-18T21:11:51.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f88777fe640 1 -- 172.21.15.5:0/2492144917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f887813f220 msgr2=0x7f8878141610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f88777fe640 1 --2- 172.21.15.5:0/2492144917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f887813f220 0x7f8878141610 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8870009dc0 tx=0x7f887001c850 comp rx=0 tx=0).ready entity=mon.6 client_cookie=600bfbc3654d3a21 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f8875ffb640 1 -- 172.21.15.5:0/2492144917 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f88700b2070 con 0x7f887813f220 2024-08-18T21:11:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f8875ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f8875ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:11:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f8875ffb640 10 monclient: dump: 2024-08-18T21:11:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.688 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f8875ffb640 10 monclient: _finish_auth 0 2024-08-18T21:11:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f8875ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:11:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f8875ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f8875ffb640 1 -- 172.21.15.5:0/2492144917 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88700a5990 con 0x7f887813f220 2024-08-18T21:11:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f887d513640 5 monclient: authenticate success, global_id 85335 2024-08-18T21:11:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f887d513640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f8875ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f887d513640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f8875ffb640 1 -- 172.21.15.5:0/2492144917 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f88700ab340 con 0x7f887813f220 2024-08-18T21:11:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f887d513640 4 set_mon_vals no callback set 2024-08-18T21:11:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f8875ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f8875ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.676+0000 7f8875ffb640 10 monclient: dump: 2024-08-18T21:11:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.690 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 10 monclient: shutdown 2024-08-18T21:11:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 1 -- 172.21.15.5:0/2492144917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f887813f220 msgr2=0x7f8878141610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 1 --2- 172.21.15.5:0/2492144917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f887813f220 0x7f8878141610 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8870009dc0 tx=0x7f887001c850 comp rx=0 tx=0).stop 2024-08-18T21:11:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 1 -- 172.21.15.5:0/2492144917 shutdown_connections 2024-08-18T21:11:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 1 --2- 172.21.15.5:0/2492144917 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f887813f220 0x7f8878141610 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 1 --2- 172.21.15.5:0/2492144917 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f88780a77d0 0x7f887813ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 1 -- 172.21.15.5:0/2492144917 >> 172.21.15.5:0/2492144917 conn(0x7f88780acbc0 msgr2=0x7f88780a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 1 -- 172.21.15.5:0/2492144917 shutdown_connections 2024-08-18T21:11:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 1 -- 172.21.15.5:0/2492144917 wait complete. 2024-08-18T21:11:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 10 monclient: build_initial_monmap 2024-08-18T21:11:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 10 monclient: monmap: 2024-08-18T21:11:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:51.693 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:51.693 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:51.693 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 1 Processor -- start 2024-08-18T21:11:51.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 1 -- start start 2024-08-18T21:11:51.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 10 monclient: init 2024-08-18T21:11:51.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:51.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 10 monclient: _add_conns ranks=[6,2,1,8,5,3,4,0,7] 2024-08-18T21:11:51.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f88780a6ce0 0x7f88780a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 10 monclient(hunting): picked mon.noname-d con 0x7f88780a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:51.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f88780a77d0 0x7f88781d1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 10 monclient(hunting): picked mon.noname-b con 0x7f88780a77d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:11:51.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f887813f220 0x7f887809e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 10 monclient(hunting): picked mon.noname-f con 0x7f887813f220 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:11:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f88780a83a0 con 0x7f887813f220 2024-08-18T21:11:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f88780a8220 con 0x7f88780a77d0 2024-08-18T21:11:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f8878144370 con 0x7f88780a6ce0 2024-08-18T21:11:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f887d513640 10 monclient(hunting): authenticate will time out at 1478.698604s 2024-08-18T21:11:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f8876ffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f88780a6ce0 0x7f88780a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f88780a77d0 0x7f88781d1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f8876ffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f88780a6ce0 0x7f88780a0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:53170/0 (socket says 172.21.15.5:53170) 2024-08-18T21:11:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f8876ffd640 1 -- 172.21.15.5:0/1358110551 learned_addr learned my addr 172.21.15.5:0/1358110551 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f8876ffd640 10 monclient(hunting): get_auth_request con 0x7f88780a6ce0 auth_method 0 2024-08-18T21:11:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f8876ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f8876ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f8876ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 10 monclient(hunting): get_auth_request con 0x7f88780a77d0 auth_method 0 2024-08-18T21:11:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f8876ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f8876ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f8876ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88777fe640 1 --2- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f887813f220 0x7f887809e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88777fe640 10 monclient(hunting): get_auth_request con 0x7f887813f220 auth_method 0 2024-08-18T21:11:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88777fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88777fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 10 monclient(hunting): handle_auth_done global_id 114149 payload 824 2024-08-18T21:11:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 1 -- 172.21.15.5:0/1358110551 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f88780a6ce0 msgr2=0x7f88780a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 1 --2- 172.21.15.5:0/1358110551 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f88780a6ce0 0x7f88780a0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 1 -- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f887813f220 msgr2=0x7f887809e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 1 --2- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f887813f220 0x7f887809e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 10 monclient: _finish_hunting 0 2024-08-18T21:11:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 1 monclient: found mon.noname-b 2024-08-18T21:11:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:51.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:11:51.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.680+0000 7f88767fc640 1 -- 172.21.15.5:0/1358110551 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88780a1e70 con 0x7f88780a77d0 2024-08-18T21:11:51.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f88767fc640 1 -- 172.21.15.5:0/1358110551 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f88780a77d0 msgr2=0x7f88781d1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f88767fc640 1 --2- 172.21.15.5:0/1358110551 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f88780a77d0 0x7f88781d1980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f886c00d5f0 tx=0x7f886c00dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f885f7fe640 1 -- 172.21.15.5:0/1358110551 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f886c012c70 con 0x7f88780a77d0 2024-08-18T21:11:51.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f885f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f885f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:11:51.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f885f7fe640 10 monclient: dump: 2024-08-18T21:11:51.702 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.702 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.702 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.702 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.702 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.702 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.702 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.702 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.703 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.703 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.703 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.703 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.703 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.704 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f885f7fe640 10 monclient: _finish_auth 0 2024-08-18T21:11:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f885f7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:11:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f885f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f885f7fe640 1 -- 172.21.15.5:0/1358110551 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f886c019070 con 0x7f88780a77d0 2024-08-18T21:11:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f885f7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f885f7fe640 1 -- 172.21.15.5:0/1358110551 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f886c012e50 con 0x7f88780a77d0 2024-08-18T21:11:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f885f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f885f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:11:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f885f7fe640 10 monclient: dump: 2024-08-18T21:11:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.705 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.705 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.705 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.705 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.705 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.705 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.705 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.705 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.705 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.705 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.705 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.705 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.706 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.706 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.706 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f88757fa640 4 set_mon_vals no callback set 2024-08-18T21:11:51.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f887d513640 5 monclient: authenticate success, global_id 114149 2024-08-18T21:11:51.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f887d513640 10 monclient: _renew_subs 2024-08-18T21:11:51.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f887d513640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:11:51.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f887d513640 1 -- 172.21.15.5:0/1358110551 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88780a2150 con 0x7f88780a77d0 2024-08-18T21:11:51.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f887d513640 10 monclient: _renew_subs 2024-08-18T21:11:51.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f887d513640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:11:51.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f887d513640 1 -- 172.21.15.5:0/1358110551 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8878140d50 con 0x7f88780a77d0 2024-08-18T21:11:51.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f887d513640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:51.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f887d513640 1 --2- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f887809ebf0 0x7f887809efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f887d513640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f887d513640 1 -- 172.21.15.5:0/1358110551 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f8878051140 con 0x7f887809ebf0 2024-08-18T21:11:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f885f7fe640 1 -- 172.21.15.5:0/1358110551 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f886c012800 con 0x7f88780a77d0 2024-08-18T21:11:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f885f7fe640 1 --2- 172.21.15.5:0/1358110551 >> v2:172.21.15.157:6812/631023601 conn(0x7f886403bf90 0x7f886403e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f885f7fe640 1 -- 172.21.15.5:0/1358110551 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(236..236 src has 22..236) ==== 3898+0+0 (secure 0 0 0) 0x7f886c00f040 con 0x7f88780a77d0 2024-08-18T21:11:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f8876ffd640 1 --2- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f887809ebf0 0x7f887809efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f8876ffd640 10 monclient: get_auth_request con 0x7f887809ebf0 auth_method 0 2024-08-18T21:11:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f8876ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f8876ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f8876ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f8876ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f8876ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f8876ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f88777fe640 1 --2- 172.21.15.5:0/1358110551 >> v2:172.21.15.157:6812/631023601 conn(0x7f886403bf90 0x7f886403e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f88777fe640 10 monclient: get_auth_request con 0x7f886403bf90 auth_method 0 2024-08-18T21:11:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f8876ffd640 10 monclient(hunting): handle_auth_done global_id 6487 payload 824 2024-08-18T21:11:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.684+0000 7f8876ffd640 1 -- 172.21.15.5:0/1358110551 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f887809f510 con 0x7f887809ebf0 2024-08-18T21:11:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.688+0000 7f8876ffd640 1 -- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f887809ebf0 msgr2=0x7f887809efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.688+0000 7f8876ffd640 1 --2- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f887809ebf0 0x7f887809efd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f886800eaa0 tx=0x7f886800ef60 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.688+0000 7f88777fe640 1 --2- 172.21.15.5:0/1358110551 >> v2:172.21.15.157:6812/631023601 conn(0x7f886403bf90 0x7f886403e450 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8870009dc0 tx=0x7f88700a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.688+0000 7f885f7fe640 1 -- 172.21.15.5:0/1358110551 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f886800cc40 con 0x7f887809ebf0 2024-08-18T21:11:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.688+0000 7f885f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.688+0000 7f885f7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:11:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.688+0000 7f885f7fe640 10 monclient: dump: 2024-08-18T21:11:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.709 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.709 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.709 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.709 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.709 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.709 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.709 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.709 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.709 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.710 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.710 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.710 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.710 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.710 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.688+0000 7f885f7fe640 1 -- 172.21.15.5:0/1358110551 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8868019070 con 0x7f887809ebf0 2024-08-18T21:11:51.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.688+0000 7f885f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:51.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.688+0000 7f885f7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:51.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.688+0000 7f885f7fe640 1 -- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f887809ebf0 msgr2=0x7f887809efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.688+0000 7f885f7fe640 1 --2- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f887809ebf0 0x7f887809efd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f886800eaa0 tx=0x7f886800ef60 comp rx=0 tx=0).stop 2024-08-18T21:11:51.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.688+0000 7f885f7fe640 1 -- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f887809ebf0 msgr2=0x7f887809efd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:51.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.688+0000 7f885f7fe640 1 --2- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f887809ebf0 0x7f887809efd0 secure :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f886800eaa0 tx=0x7f886800ef60 comp rx=0 tx=0).stop 2024-08-18T21:11:51.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.696+0000 7f887d513640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.696+0000 7f887d513640 1 --2- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f887813bf60 0x7f887813c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.696+0000 7f887d513640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.696+0000 7f887d513640 1 -- 172.21.15.5:0/1358110551 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f8878069fa0 con 0x7f887813bf60 2024-08-18T21:11:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.696+0000 7f8876ffd640 1 --2- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f887813bf60 0x7f887813c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.696+0000 7f8876ffd640 10 monclient: get_auth_request con 0x7f887813bf60 auth_method 0 2024-08-18T21:11:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.696+0000 7f8876ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.696+0000 7f8876ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.696+0000 7f8876ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.696+0000 7f8876ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.696+0000 7f8876ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.696+0000 7f8876ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.696+0000 7f8876ffd640 10 monclient(hunting): handle_auth_done global_id 6496 payload 824 2024-08-18T21:11:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.696+0000 7f8876ffd640 1 -- 172.21.15.5:0/1358110551 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f88780a70c0 con 0x7f887813bf60 2024-08-18T21:11:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f8876ffd640 1 -- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f887813bf60 msgr2=0x7f887813c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f8876ffd640 1 --2- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f887813bf60 0x7f887813c370 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8868018000 tx=0x7f8868004950 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f885f7fe640 1 -- 172.21.15.5:0/1358110551 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f88680148f0 con 0x7f887813bf60 2024-08-18T21:11:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f885f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f885f7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:11:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f885f7fe640 10 monclient: dump: 2024-08-18T21:11:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.714 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.714 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.714 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.714 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.714 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.714 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.714 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.714 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.714 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.714 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f885f7fe640 1 -- 172.21.15.5:0/1358110551 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f8868014480 con 0x7f887813bf60 2024-08-18T21:11:51.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f885f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f885f7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f885f7fe640 1 -- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f887813bf60 msgr2=0x7f887813c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f885f7fe640 1 --2- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f887813bf60 0x7f887813c370 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8868018000 tx=0x7f8868004950 comp rx=0 tx=0).stop 2024-08-18T21:11:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f885f7fe640 1 -- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f887813bf60 msgr2=0x7f887813c370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f885f7fe640 1 --2- 172.21.15.5:0/1358110551 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f887813bf60 0x7f887813c370 secure :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8868018000 tx=0x7f8868004950 comp rx=0 tx=0).stop 2024-08-18T21:11:51.715 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:51.715 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:51.715 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:51.715 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:51.716 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:51.716 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 520801, 2024-08-18T21:11:51.716 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:51.716 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:51.716 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:51.716 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:51.716 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:51.716 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:51.716 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:51.716 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:51.716 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:51.716 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:51.716 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.717 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:11:51.717 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:51.717 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:51.717 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:51.717 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:51.717 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:51.717 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:51.717 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:51.717 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:51.717 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:51.717 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:51.717 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:51.717 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:51.718 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:51.718 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:51.718 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.718 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:51.718 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:51.718 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:51.718 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:51.718 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:51.718 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:51.718 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:51.718 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:51.718 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:51.718 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:51.718 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:51.719 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:51.719 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:51.719 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.719 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:51.719 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:51.719 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:51.719 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:51.719 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:51.719 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:51.719 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:51.719 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:51.720 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:51.720 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:51.720 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:51.720 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:51.720 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:51.720 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:51.720 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:51.720 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:51.720 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:51.720 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:51.720 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:51.720 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:51.720 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:51.721 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:51.721 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:51.721 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:51.721 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:51.721 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:51.721 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:51.721 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:51.721 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.721 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:51.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.721 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:51.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.721 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:51.722 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:51.722 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.722 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.722 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.722 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:51.722 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.722 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.722 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:51.723 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.723 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.723 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.723 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:51.723 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:51.723 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.723 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.723 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.723 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:51.723 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:51.723 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:51.724 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:51.724 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.724 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.724 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:51.725 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:51.725 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.725 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.725 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.725 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:51.725 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:51.725 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.725 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:51.726 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.726 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:51.726 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.726 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.726 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:51.726 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:51.726 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.727 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.727 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.727 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:51.727 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:51.727 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:51.727 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.728 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.728 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:51.728 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.728 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.728 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.728 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:51.728 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:51.728 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.728 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.728 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.729 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:51.729 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:51.729 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:51.729 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:51.730 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.730 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.730 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.730 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:51.730 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:51.730 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.730 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.730 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.730 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:51.730 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:51.731 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:51.731 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:51.731 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.731 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.731 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.732 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:51.732 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:51.732 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.732 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.732 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.732 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.732 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:51.732 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:51.732 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.732 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.732 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.732 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.733 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:51.733 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.733 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:51.733 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.733 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.733 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.733 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:51.733 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:51.733 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.734 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.734 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.734 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:51.734 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:51.734 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.734 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.734 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.734 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:51.734 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.735 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.735 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:51.735 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.735 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.735 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.735 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:51.735 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:51.735 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.735 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.735 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.736 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:51.736 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:51.736 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:51.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:51.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:51.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:51.736 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:51.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:51.737 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:51.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.737 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:51.737 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:51.737 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:51.737 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:51.737 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:51.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.737 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.738 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:51.738 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:51.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.738 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:51.738 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:51.738 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:51.738 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.738 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.738 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:11:51.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.738 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:51.738 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:51.738 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:11:51.738 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.739 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:51.739 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:51.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:51.739 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:51.739 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:51.739 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:11:51.739 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:51.739 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:51.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:51.739 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:51.739 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f887d513640 1 -- 172.21.15.5:0/1358110551 >> v2:172.21.15.157:6812/631023601 conn(0x7f886403bf90 msgr2=0x7f886403e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f887d513640 1 --2- 172.21.15.5:0/1358110551 >> v2:172.21.15.157:6812/631023601 conn(0x7f886403bf90 0x7f886403e450 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8870009dc0 tx=0x7f88700a7070 comp rx=0 tx=0).stop 2024-08-18T21:11:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f887d513640 10 monclient: shutdown 2024-08-18T21:11:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f887d513640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f887d513640 1 -- 172.21.15.5:0/1358110551 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f88780a77d0 msgr2=0x7f88781d1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f887d513640 1 --2- 172.21.15.5:0/1358110551 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f88780a77d0 0x7f88781d1980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f886c00d5f0 tx=0x7f886c00dab0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f88777fe640 1 -- 172.21.15.5:0/1358110551 reap_dead start 2024-08-18T21:11:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f88777fe640 1 -- 172.21.15.5:0/1358110551 reap_dead start 2024-08-18T21:11:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f887d513640 1 -- 172.21.15.5:0/1358110551 shutdown_connections 2024-08-18T21:11:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f887d513640 1 -- 172.21.15.5:0/1358110551 >> 172.21.15.5:0/1358110551 conn(0x7f88780acbc0 msgr2=0x7f887813ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f887d513640 1 -- 172.21.15.5:0/1358110551 shutdown_connections 2024-08-18T21:11:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.700+0000 7f887d513640 1 -- 172.21.15.5:0/1358110551 wait complete. 2024-08-18T21:11:51.742 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:51.742 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-18T21:11:51.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-18T21:11:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.852+0000 7f1c3e9f9640 10 monclient: get_monmap_and_config 2024-08-18T21:11:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.852+0000 7f1c3e9f9640 10 monclient: build_initial_monmap 2024-08-18T21:11:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.852+0000 7f1c3e9f9640 10 monclient: monmap: 2024-08-18T21:11:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:51.859793+0000 2024-08-18T21:11:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:51.859793+0000 2024-08-18T21:11:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:51.859 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 1 Processor -- start 2024-08-18T21:11:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 1 -- start start 2024-08-18T21:11:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 10 monclient: init 2024-08-18T21:11:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 10 monclient: _add_conns ranks=[7,8,0,2,1,5,6,9,3,10,4] 2024-08-18T21:11:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1c380a6ce0 0x7f1c380a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 10 monclient(hunting): picked mon.noname-i con 0x7f1c380a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1c380a7600 0x7f1c38139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 10 monclient(hunting): picked mon.noname-e con 0x7f1c380a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1c38139fe0 addr v1:172.21.15.5:6789/0 2024-08-18T21:11:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c380a45d0 con 0x7f1c38139fe0 2024-08-18T21:11:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f1c380a5000 con 0x7f1c380a6ce0 2024-08-18T21:11:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f1c380a32d0 con 0x7f1c380a7600 2024-08-18T21:11:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3e9f9640 10 monclient(hunting): authenticate will time out at 1478.873005s 2024-08-18T21:11:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3cf96640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1c38139fe0 0x7f1c38140cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49152/0 (socket says 172.21.15.5:49152) 2024-08-18T21:11:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c3cf96640 1 -- 172.21.15.5:0/1589909348 learned_addr learned my addr 172.21.15.5:0/1589909348 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:11:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 1 --2- 172.21.15.5:0/1589909348 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1c380a7600 0x7f1c38139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 10 monclient(hunting): get_auth_request con 0x7f1c380a7600 auth_method 0 2024-08-18T21:11:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c37fff640 1 --2- 172.21.15.5:0/1589909348 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1c380a6ce0 0x7f1c380a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c37fff640 10 monclient(hunting): get_auth_request con 0x7f1c380a6ce0 auth_method 0 2024-08-18T21:11:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c37fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c37fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c37fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 10 monclient(hunting): handle_auth_done global_id 114200 payload 274 2024-08-18T21:11:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 1 -- 172.21.15.5:0/1589909348 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1c380a6ce0 msgr2=0x7f1c380a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 1 --2- 172.21.15.5:0/1589909348 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1c380a6ce0 0x7f1c380a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 1 -- 172.21.15.5:0/1589909348 >> v1:172.21.15.5:6789/0 conn(0x7f1c38139fe0 legacy=0x7f1c38140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 10 monclient: _finish_hunting 0 2024-08-18T21:11:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 1 monclient: found mon.noname-e 2024-08-18T21:11:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:11:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.856+0000 7f1c377fe640 1 -- 172.21.15.5:0/1589909348 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c380a8900 con 0x7f1c380a7600 2024-08-18T21:11:51.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c377fe640 1 -- 172.21.15.5:0/1589909348 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1c380a7600 msgr2=0x7f1c38139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c377fe640 1 --2- 172.21.15.5:0/1589909348 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1c380a7600 0x7f1c38139aa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0097f0 tx=0x7f1c2c01c3a0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=1cf5bb241dcc2569 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c36ffd640 1 -- 172.21.15.5:0/1589909348 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1c2c0b0070 con 0x7f1c380a7600 2024-08-18T21:11:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c36ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c36ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:11:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c36ffd640 10 monclient: dump: 2024-08-18T21:11:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.869 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c36ffd640 10 monclient: _finish_auth 0 2024-08-18T21:11:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c36ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:11:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c36ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c36ffd640 1 -- 172.21.15.5:0/1589909348 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c2c0aa810 con 0x7f1c380a7600 2024-08-18T21:11:51.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c36ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:51.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c36ffd640 1 -- 172.21.15.5:0/1589909348 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1c2c0aae30 con 0x7f1c380a7600 2024-08-18T21:11:51.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c36ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c36ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:51.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c36ffd640 10 monclient: dump: 2024-08-18T21:11:51.870 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.870 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.870 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.870 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.872 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c3e9f9640 5 monclient: authenticate success, global_id 114200 2024-08-18T21:11:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c3e9f9640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c3e9f9640 4 set_mon_vals no callback set 2024-08-18T21:11:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c3e9f9640 10 monclient: shutdown 2024-08-18T21:11:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c3e9f9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c3e9f9640 1 -- 172.21.15.5:0/1589909348 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1c380a7600 msgr2=0x7f1c38139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c3e9f9640 1 --2- 172.21.15.5:0/1589909348 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1c380a7600 0x7f1c38139aa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0097f0 tx=0x7f1c2c01c3a0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c3e9f9640 1 -- 172.21.15.5:0/1589909348 shutdown_connections 2024-08-18T21:11:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c3e9f9640 1 --2- 172.21.15.5:0/1589909348 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1c380a7600 0x7f1c38139aa0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c3e9f9640 1 --2- 172.21.15.5:0/1589909348 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1c380a6ce0 0x7f1c380a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c3e9f9640 1 -- 172.21.15.5:0/1589909348 >> 172.21.15.5:0/1589909348 conn(0x7f1c380acbc0 msgr2=0x7f1c380a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c3e9f9640 1 -- 172.21.15.5:0/1589909348 shutdown_connections 2024-08-18T21:11:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c3e9f9640 1 -- 172.21.15.5:0/1589909348 wait complete. 2024-08-18T21:11:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c3e9f9640 10 monclient: build_initial_monmap 2024-08-18T21:11:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.860+0000 7f1c3e9f9640 10 monclient: monmap: 2024-08-18T21:11:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:51.874 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 1 Processor -- start 2024-08-18T21:11:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 1 -- start start 2024-08-18T21:11:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 10 monclient: init 2024-08-18T21:11:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 10 monclient: _add_conns ranks=[4,8,3,2,1,6,5,0,7] 2024-08-18T21:11:51.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f1c380a6ce0 0x7f1c381d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 10 monclient(hunting): picked mon.noname-c con 0x7f1c380a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:51.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1c380a7600 0x7f1c381d2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 10 monclient(hunting): picked mon.noname-e con 0x7f1c380a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:51.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c38139fe0 0x7f1c3813b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 10 monclient(hunting): picked mon.noname-g con 0x7f1c38139fe0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:51.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1c380a79e0 con 0x7f1c38139fe0 2024-08-18T21:11:51.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f1c380a9810 con 0x7f1c380a6ce0 2024-08-18T21:11:51.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:51.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f1c3813f300 con 0x7f1c380a7600 2024-08-18T21:11:51.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:51.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 10 monclient(hunting): authenticate will time out at 1478.880869s 2024-08-18T21:11:51.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1c380a7600 0x7f1c381d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c37fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f1c380a6ce0 0x7f1c381d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1c380a7600 0x7f1c381d2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:50828/0 (socket says 172.21.15.5:50828) 2024-08-18T21:11:51.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 1 -- 172.21.15.5:0/1910442777 learned_addr learned my addr 172.21.15.5:0/1910442777 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:51.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 10 monclient(hunting): get_auth_request con 0x7f1c380a7600 auth_method 0 2024-08-18T21:11:51.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c37fff640 10 monclient(hunting): get_auth_request con 0x7f1c380a6ce0 auth_method 0 2024-08-18T21:11:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c37fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c37fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c37fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c37fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c37fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c37fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 10 monclient(hunting): handle_auth_done global_id 114209 payload 824 2024-08-18T21:11:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 1 -- 172.21.15.5:0/1910442777 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f1c380a6ce0 msgr2=0x7f1c381d1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 1 --2- 172.21.15.5:0/1910442777 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f1c380a6ce0 0x7f1c381d1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 1 -- 172.21.15.5:0/1910442777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c38139fe0 msgr2=0x7f1c3813b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:51.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3cf96640 1 --2- 172.21.15.5:0/1910442777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c38139fe0 0x7f1c3813b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 1 --2- 172.21.15.5:0/1910442777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c38139fe0 0x7f1c3813b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:51.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 10 monclient: _finish_hunting 0 2024-08-18T21:11:51.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 1 monclient: found mon.noname-e 2024-08-18T21:11:51.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:51.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:11:51.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 1 -- 172.21.15.5:0/1910442777 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c380a22c0 con 0x7f1c380a7600 2024-08-18T21:11:51.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3cf96640 10 monclient: get_auth_request con 0x7f1c38139fe0 auth_method 0 2024-08-18T21:11:51.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3cf96640 1 --2- 172.21.15.5:0/1910442777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c38139fe0 0x7f1c3813b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:11:51.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 1 -- 172.21.15.5:0/1910442777 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1c380a7600 msgr2=0x7f1c381d2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:51.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c377fe640 1 --2- 172.21.15.5:0/1910442777 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1c380a7600 0x7f1c381d2190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009710 tx=0x7f1c2c019140 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c34ff9640 1 -- 172.21.15.5:0/1910442777 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1c2c0b0040 con 0x7f1c380a7600 2024-08-18T21:11:51.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c34ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c34ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:11:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c34ff9640 10 monclient: dump: 2024-08-18T21:11:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.882 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c34ff9640 10 monclient: _finish_auth 0 2024-08-18T21:11:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c34ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:11:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c34ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c34ff9640 1 -- 172.21.15.5:0/1910442777 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c2c0b9070 con 0x7f1c380a7600 2024-08-18T21:11:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c34ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c34ff9640 1 -- 172.21.15.5:0/1910442777 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1c2c004250 con 0x7f1c380a7600 2024-08-18T21:11:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c34ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c34ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c34ff9640 10 monclient: dump: 2024-08-18T21:11:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:51.884 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c367fc640 4 set_mon_vals no callback set 2024-08-18T21:11:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 5 monclient: authenticate success, global_id 114209 2024-08-18T21:11:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.864+0000 7f1c3e9f9640 10 monclient: _renew_subs 2024-08-18T21:11:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.868+0000 7f1c3e9f9640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.868+0000 7f1c3e9f9640 1 -- 172.21.15.5:0/1910442777 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c381421b0 con 0x7f1c380a7600 2024-08-18T21:11:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.868+0000 7f1c3e9f9640 10 monclient: _renew_subs 2024-08-18T21:11:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.868+0000 7f1c3e9f9640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.868+0000 7f1c3e9f9640 1 -- 172.21.15.5:0/1910442777 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c3813f020 con 0x7f1c380a7600 2024-08-18T21:11:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.868+0000 7f1c3e9f9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.868+0000 7f1c3e9f9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.868+0000 7f1c3e9f9640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.868+0000 7f1c3e9f9640 1 -- 172.21.15.5:0/1910442777 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c380a8220 con 0x7f1c380a7600 2024-08-18T21:11:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.868+0000 7f1c34ff9640 1 -- 172.21.15.5:0/1910442777 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f1c2c0b3070 con 0x7f1c380a7600 2024-08-18T21:11:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.868+0000 7f1c34ff9640 1 --2- 172.21.15.5:0/1910442777 >> v2:172.21.15.157:6812/631023601 conn(0x7f1c2403bdf0 0x7f1c2403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.868+0000 7f1c34ff9640 1 -- 172.21.15.5:0/1910442777 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(236..236 src has 22..236) ==== 3898+0+0 (secure 0 0 0) 0x7f1c2c0e8200 con 0x7f1c380a7600 2024-08-18T21:11:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.868+0000 7f1c37fff640 1 --2- 172.21.15.5:0/1910442777 >> v2:172.21.15.157:6812/631023601 conn(0x7f1c2403bdf0 0x7f1c2403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.868+0000 7f1c37fff640 10 monclient: get_auth_request con 0x7f1c2403bdf0 auth_method 0 2024-08-18T21:11:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.872+0000 7f1c37fff640 1 --2- 172.21.15.5:0/1910442777 >> v2:172.21.15.157:6812/631023601 conn(0x7f1c2403bdf0 0x7f1c2403e2b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1c28007a60 tx=0x7f1c28008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.872+0000 7f1c34ff9640 1 -- 172.21.15.5:0/1910442777 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f1c2c0160b0 con 0x7f1c380a7600 2024-08-18T21:11:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.872+0000 7f1c34ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:51.872+0000 7f1c34ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.120+0000 7f1c3e9f9640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-18T21:11:52.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.120+0000 7f1c3e9f9640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-18T21:11:52.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.120+0000 7f1c3e9f9640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:52.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.120+0000 7f1c3e9f9640 1 -- 172.21.15.5:0/1910442777 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f1c3813db00 con 0x7f1c380a7600 2024-08-18T21:11:52.131 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31208]: starting. 2024-08-18T21:11:52.131 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31208]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31206 2024-08-18T21:11:52.131 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31208]: shutting down. 2024-08-18T21:11:52.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.132+0000 7f1c34ff9640 1 -- 172.21.15.5:0/1910442777 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f1c2c0aa7e0 con 0x7f1c380a7600 2024-08-18T21:11:52.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.132+0000 7f1c34ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-18T21:11:52.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.132+0000 7f1c34ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.136+0000 7f1c3e9f9640 1 -- 172.21.15.5:0/1910442777 >> v2:172.21.15.157:6812/631023601 conn(0x7f1c2403bdf0 msgr2=0x7f1c2403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.136+0000 7f1c3e9f9640 1 --2- 172.21.15.5:0/1910442777 >> v2:172.21.15.157:6812/631023601 conn(0x7f1c2403bdf0 0x7f1c2403e2b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1c28007a60 tx=0x7f1c28008040 comp rx=0 tx=0).stop 2024-08-18T21:11:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.136+0000 7f1c3e9f9640 10 monclient: shutdown 2024-08-18T21:11:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.136+0000 7f1c3e9f9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.136+0000 7f1c3e9f9640 1 -- 172.21.15.5:0/1910442777 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1c380a7600 msgr2=0x7f1c381d2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.136+0000 7f1c3e9f9640 1 --2- 172.21.15.5:0/1910442777 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1c380a7600 0x7f1c381d2190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009710 tx=0x7f1c2c019140 comp rx=0 tx=0).stop 2024-08-18T21:11:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.136+0000 7f1c3e9f9640 1 -- 172.21.15.5:0/1910442777 shutdown_connections 2024-08-18T21:11:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.136+0000 7f1c3e9f9640 1 --2- 172.21.15.5:0/1910442777 >> v2:172.21.15.157:6812/631023601 conn(0x7f1c2403bdf0 0x7f1c2403e2b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.136+0000 7f1c3e9f9640 1 --2- 172.21.15.5:0/1910442777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c38139fe0 0x7f1c3813b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.136+0000 7f1c3e9f9640 1 --2- 172.21.15.5:0/1910442777 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1c380a7600 0x7f1c381d2190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.136+0000 7f1c3e9f9640 1 --2- 172.21.15.5:0/1910442777 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f1c380a6ce0 0x7f1c381d1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.136+0000 7f1c3e9f9640 1 -- 172.21.15.5:0/1910442777 >> 172.21.15.5:0/1910442777 conn(0x7f1c380acbc0 msgr2=0x7f1c380aa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.136+0000 7f1c3e9f9640 1 -- 172.21.15.5:0/1910442777 shutdown_connections 2024-08-18T21:11:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:52.136+0000 7f1c3e9f9640 1 -- 172.21.15.5:0/1910442777 wait complete. 2024-08-18T21:11:52.154 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-18T21:11:52.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=17,config=2,health=12,kv=9,logm=60} crc {auth=2842621177,config=1618278320,health=484101164,kv=64388820,logm=751994241}) 2024-08-18T21:11:52.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=19,config=2,health=10,kv=9,logm=60} crc {auth=1009058991,config=1618278320,health=1578611770,kv=672252078,logm=2941719443}) 2024-08-18T21:11:52.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=17,config=2,health=12,kv=9,logm=60} crc {auth=2842621177,config=1618278320,health=484101164,kv=64388820,logm=751994241}) 2024-08-18T21:11:52.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=12,kv=9,logm=58} crc {auth=1009058991,config=1618278320,health=484101164,kv=64388820,logm=2403806757}) 2024-08-18T21:11:52.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=17,config=2,health=12,kv=9,logm=60} crc {auth=2842621177,config=1618278320,health=484101164,kv=64388820,logm=751994241}) 2024-08-18T21:11:52.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=1497124256,config=1618278320,health=932233158,kv=3664197221,logm=3504260928}) 2024-08-18T21:11:52.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=17,config=2,health=12,kv=9,logm=60} crc {auth=2842621177,config=1618278320,health=484101164,kv=64388820,logm=751994241}) 2024-08-18T21:11:52.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=19,config=2,health=10,kv=10,logm=59} crc {auth=1009058991,config=1618278320,health=1399464577,kv=3664197221,logm=2414285621}) 2024-08-18T21:11:52.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=17,config=2,health=12,kv=9,logm=60} crc {auth=2842621177,config=1618278320,health=484101164,kv=64388820,logm=751994241}) 2024-08-18T21:11:52.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=4234753225,config=1618278320,health=1751782267,kv=3664197221,logm=1689904712}) 2024-08-18T21:11:52.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=17,config=2,health=12,kv=9,logm=60} crc {auth=2842621177,config=1618278320,health=484101164,kv=64388820,logm=751994241}) 2024-08-18T21:11:52.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=19,config=2,health=12,kv=10,logm=57} crc {auth=1009058991,config=1618278320,health=484101164,kv=3664197221,logm=2763928982}) 2024-08-18T21:11:52.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=17,config=2,health=12,kv=9,logm=60} crc {auth=2842621177,config=1618278320,health=484101164,kv=64388820,logm=751994241}) 2024-08-18T21:11:52.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=18,config=2,health=11,kv=9,logm=60} crc {auth=1231051037,config=1618278320,health=2390165510,kv=3664197221,logm=1126202515}) 2024-08-18T21:11:52.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.227 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=17,config=2,health=12,kv=9,logm=60} crc {auth=2842621177,config=1618278320,health=484101164,kv=64388820,logm=751994241}) 2024-08-18T21:11:52.228 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.220+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=16,config=2,health=12,kv=10,logm=60} crc {auth=1035666096,config=1618278320,health=484101164,kv=9163099,logm=2978957365}) 2024-08-18T21:11:52.517 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.517 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3916840536}) 2024-08-18T21:11:52.517 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=133692327}) 2024-08-18T21:11:52.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3916840536}) 2024-08-18T21:11:52.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2090140805}) 2024-08-18T21:11:52.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3916840536}) 2024-08-18T21:11:52.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=305208951}) 2024-08-18T21:11:52.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3916840536}) 2024-08-18T21:11:52.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2414270026}) 2024-08-18T21:11:52.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3916840536}) 2024-08-18T21:11:52.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3392221039}) 2024-08-18T21:11:52.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3916840536}) 2024-08-18T21:11:52.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3994149879}) 2024-08-18T21:11:52.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3916840536}) 2024-08-18T21:11:52.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.512+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2624126125}) 2024-08-18T21:11:52.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3916840536}) 2024-08-18T21:11:52.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3566267584}) 2024-08-18T21:11:52.875 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.876 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653393465}) 2024-08-18T21:11:52.876 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=812341505}) 2024-08-18T21:11:52.876 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.876 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653393465}) 2024-08-18T21:11:52.876 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3810794670}) 2024-08-18T21:11:52.876 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.876 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653393465}) 2024-08-18T21:11:52.876 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=421898168}) 2024-08-18T21:11:52.876 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.876 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653393465}) 2024-08-18T21:11:52.876 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2628234982}) 2024-08-18T21:11:52.876 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653393465}) 2024-08-18T21:11:52.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1743556941}) 2024-08-18T21:11:52.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653393465}) 2024-08-18T21:11:52.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2787526187}) 2024-08-18T21:11:52.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653393465}) 2024-08-18T21:11:52.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1569170924}) 2024-08-18T21:11:52.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653393465}) 2024-08-18T21:11:52.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.872+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=170353301}) 2024-08-18T21:11:52.880 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.881 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2510908175}) 2024-08-18T21:11:52.881 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3674210631}) 2024-08-18T21:11:52.881 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.881 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2510908175}) 2024-08-18T21:11:52.881 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1033346320}) 2024-08-18T21:11:52.881 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.881 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2510908175}) 2024-08-18T21:11:52.881 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=568786461}) 2024-08-18T21:11:52.881 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.881 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2510908175}) 2024-08-18T21:11:52.881 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=108644371}) 2024-08-18T21:11:52.881 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.881 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2510908175}) 2024-08-18T21:11:52.882 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=392555248}) 2024-08-18T21:11:52.882 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.882 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2510908175}) 2024-08-18T21:11:52.882 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3424202613}) 2024-08-18T21:11:52.882 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.882 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2510908175}) 2024-08-18T21:11:52.882 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1606726055}) 2024-08-18T21:11:52.882 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.882 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2510908175}) 2024-08-18T21:11:52.882 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.876+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2275443057}) 2024-08-18T21:11:52.886 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.886 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3038002168}) 2024-08-18T21:11:52.886 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=239840591}) 2024-08-18T21:11:52.886 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.886 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3038002168}) 2024-08-18T21:11:52.886 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=284543243}) 2024-08-18T21:11:52.886 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.886 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3038002168}) 2024-08-18T21:11:52.886 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1196499358}) 2024-08-18T21:11:52.887 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.887 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3038002168}) 2024-08-18T21:11:52.887 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2530007581}) 2024-08-18T21:11:52.887 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.887 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3038002168}) 2024-08-18T21:11:52.887 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=828645561}) 2024-08-18T21:11:52.887 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.887 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3038002168}) 2024-08-18T21:11:52.887 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.880+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=426912457}) 2024-08-18T21:11:52.887 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.884+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.887 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.884+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3038002168}) 2024-08-18T21:11:52.887 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.884+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=538937671}) 2024-08-18T21:11:52.887 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.884+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.888 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.884+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3038002168}) 2024-08-18T21:11:52.888 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.884+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1903129800}) 2024-08-18T21:11:52.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1125393959}) 2024-08-18T21:11:52.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1102780203}) 2024-08-18T21:11:52.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1125393959}) 2024-08-18T21:11:52.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=379986377}) 2024-08-18T21:11:52.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1125393959}) 2024-08-18T21:11:52.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1898711683}) 2024-08-18T21:11:52.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1125393959}) 2024-08-18T21:11:52.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2646479138}) 2024-08-18T21:11:52.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1125393959}) 2024-08-18T21:11:52.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2586292591}) 2024-08-18T21:11:52.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1125393959}) 2024-08-18T21:11:52.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2414849963}) 2024-08-18T21:11:52.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1125393959}) 2024-08-18T21:11:52.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=485135065}) 2024-08-18T21:11:52.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1125393959}) 2024-08-18T21:11:52.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3983113156}) 2024-08-18T21:11:52.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.896+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.896+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4156259545}) 2024-08-18T21:11:52.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.896+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=305194746}) 2024-08-18T21:11:52.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.896+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.896+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4156259545}) 2024-08-18T21:11:52.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.896+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1558596237}) 2024-08-18T21:11:52.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4156259545}) 2024-08-18T21:11:52.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3452879755}) 2024-08-18T21:11:52.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4156259545}) 2024-08-18T21:11:52.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2196704082}) 2024-08-18T21:11:52.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4156259545}) 2024-08-18T21:11:52.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1205052497}) 2024-08-18T21:11:52.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4156259545}) 2024-08-18T21:11:52.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1453001502}) 2024-08-18T21:11:52.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4156259545}) 2024-08-18T21:11:52.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2890609373}) 2024-08-18T21:11:52.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:52.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4156259545}) 2024-08-18T21:11:52.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:52.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3988584838}) 2024-08-18T21:11:53.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1954932699}) 2024-08-18T21:11:53.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=998533127}) 2024-08-18T21:11:53.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1954932699}) 2024-08-18T21:11:53.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3757343588}) 2024-08-18T21:11:53.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1954932699}) 2024-08-18T21:11:53.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1429152594}) 2024-08-18T21:11:53.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1954932699}) 2024-08-18T21:11:53.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4199648617}) 2024-08-18T21:11:53.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1954932699}) 2024-08-18T21:11:53.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2186260814}) 2024-08-18T21:11:53.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1954932699}) 2024-08-18T21:11:53.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1391907450}) 2024-08-18T21:11:53.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1954932699}) 2024-08-18T21:11:53.120 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=215164229}) 2024-08-18T21:11:53.120 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.120 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1954932699}) 2024-08-18T21:11:53.120 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.112+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3275150631}) 2024-08-18T21:11:53.148 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=730261084}) 2024-08-18T21:11:53.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=516958471}) 2024-08-18T21:11:53.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=730261084}) 2024-08-18T21:11:53.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2917877181}) 2024-08-18T21:11:53.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=730261084}) 2024-08-18T21:11:53.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3099754394}) 2024-08-18T21:11:53.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=730261084}) 2024-08-18T21:11:53.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3670498171}) 2024-08-18T21:11:53.149 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.150 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=730261084}) 2024-08-18T21:11:53.150 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2373444126}) 2024-08-18T21:11:53.150 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.150 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=730261084}) 2024-08-18T21:11:53.150 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3381408155}) 2024-08-18T21:11:53.150 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.150 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=730261084}) 2024-08-18T21:11:53.150 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2395740523}) 2024-08-18T21:11:53.150 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.150 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=730261084}) 2024-08-18T21:11:53.150 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.144+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2213705233}) 2024-08-18T21:11:53.155 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:11:53.155 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:11:53.177 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.177 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3713370305}) 2024-08-18T21:11:53.178 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4112201340}) 2024-08-18T21:11:53.178 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.178 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3713370305}) 2024-08-18T21:11:53.178 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2117797398}) 2024-08-18T21:11:53.178 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.178 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3713370305}) 2024-08-18T21:11:53.178 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3751342797}) 2024-08-18T21:11:53.178 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.178 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3713370305}) 2024-08-18T21:11:53.178 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=466615409}) 2024-08-18T21:11:53.178 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.178 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3713370305}) 2024-08-18T21:11:53.178 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=77401323}) 2024-08-18T21:11:53.179 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.179 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3713370305}) 2024-08-18T21:11:53.179 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3910433790}) 2024-08-18T21:11:53.179 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.179 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3713370305}) 2024-08-18T21:11:53.179 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=66521199}) 2024-08-18T21:11:53.179 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.179 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3713370305}) 2024-08-18T21:11:53.179 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.172+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3983095989}) 2024-08-18T21:11:53.183 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.183 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3784365184}) 2024-08-18T21:11:53.183 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2053764149}) 2024-08-18T21:11:53.183 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.183 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3784365184}) 2024-08-18T21:11:53.184 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=684128908}) 2024-08-18T21:11:53.184 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.184 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3784365184}) 2024-08-18T21:11:53.184 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=385607467}) 2024-08-18T21:11:53.184 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.184 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3784365184}) 2024-08-18T21:11:53.184 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1216477278}) 2024-08-18T21:11:53.184 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.184 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3784365184}) 2024-08-18T21:11:53.184 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3646695741}) 2024-08-18T21:11:53.184 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.184 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3784365184}) 2024-08-18T21:11:53.184 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3487852606}) 2024-08-18T21:11:53.184 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.185 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3784365184}) 2024-08-18T21:11:53.185 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2034448692}) 2024-08-18T21:11:53.185 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.185 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3784365184}) 2024-08-18T21:11:53.185 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.180+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3253966768}) 2024-08-18T21:11:53.187 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.187 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492845681}) 2024-08-18T21:11:53.187 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1933465599}) 2024-08-18T21:11:53.187 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492845681}) 2024-08-18T21:11:53.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2127749357}) 2024-08-18T21:11:53.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492845681}) 2024-08-18T21:11:53.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=183124908}) 2024-08-18T21:11:53.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492845681}) 2024-08-18T21:11:53.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4130380305}) 2024-08-18T21:11:53.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492845681}) 2024-08-18T21:11:53.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2184877676}) 2024-08-18T21:11:53.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492845681}) 2024-08-18T21:11:53.188 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=553712450}) 2024-08-18T21:11:53.189 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.189 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492845681}) 2024-08-18T21:11:53.189 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1733960539}) 2024-08-18T21:11:53.189 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.189 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492845681}) 2024-08-18T21:11:53.189 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.184+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=853263070}) 2024-08-18T21:11:53.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 10 monclient: get_monmap_and_config 2024-08-18T21:11:53.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 10 monclient: build_initial_monmap 2024-08-18T21:11:53.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 10 monclient: monmap: 2024-08-18T21:11:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:53.294442+0000 2024-08-18T21:11:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:53.294442+0000 2024-08-18T21:11:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:53.293 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:53.293 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:53.293 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:53.293 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:53.293 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 1 Processor -- start 2024-08-18T21:11:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 1 -- start start 2024-08-18T21:11:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 10 monclient: init 2024-08-18T21:11:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 10 monclient: _add_conns ranks=[1,8,6,4,9,10,3,5,7,0,2] 2024-08-18T21:11:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f12600a6ce0 addr v1:172.21.15.157:6789/0 2024-08-18T21:11:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f12600a77d0 0x7f126013ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 10 monclient(hunting): picked mon.noname-e con 0x7f12600a77d0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f126013f220 0x7f1260141610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 10 monclient(hunting): picked mon.noname-d con 0x7f126013f220 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12600a45d0 con 0x7f12600a6ce0 2024-08-18T21:11:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f12600a5000 con 0x7f126013f220 2024-08-18T21:11:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f12600a4360 con 0x7f12600a77d0 2024-08-18T21:11:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f126869d640 10 monclient(hunting): authenticate will time out at 1480.307677s 2024-08-18T21:11:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f1266c3a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f126013f220 0x7f1260141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f1265c38640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f12600a77d0 0x7f126013ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f1266c3a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f126013f220 0x7f1260141610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:53174/0 (socket says 172.21.15.5:53174) 2024-08-18T21:11:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f1266c3a640 1 -- 172.21.15.5:0/2586628470 learned_addr learned my addr 172.21.15.5:0/2586628470 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f1266c3a640 10 monclient(hunting): get_auth_request con 0x7f126013f220 auth_method 0 2024-08-18T21:11:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f1266c3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f1266c3a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f1266c3a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f1265c38640 10 monclient(hunting): get_auth_request con 0x7f12600a77d0 auth_method 0 2024-08-18T21:11:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f1265c38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f1265c38640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.288+0000 7f1265c38640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.292+0000 7f1266c3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.292+0000 7f1266c3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.292+0000 7f1266c3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.292+0000 7f1265c38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.292+0000 7f1265c38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.292+0000 7f1265c38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.292+0000 7f1266c3a640 10 monclient(hunting): handle_auth_done global_id 85371 payload 274 2024-08-18T21:11:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.292+0000 7f1266c3a640 1 -- 172.21.15.5:0/2586628470 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f12600a77d0 msgr2=0x7f126013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.292+0000 7f1266c3a640 1 --2- 172.21.15.5:0/2586628470 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f12600a77d0 0x7f126013ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.292+0000 7f1266c3a640 1 -- 172.21.15.5:0/2586628470 >> v1:172.21.15.157:6789/0 conn(0x7f12600a6ce0 legacy=0x7f12600a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.292+0000 7f1266c3a640 10 monclient: _finish_hunting 0 2024-08-18T21:11:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.292+0000 7f1266c3a640 1 monclient: found mon.noname-d 2024-08-18T21:11:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.292+0000 7f1266c3a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.292+0000 7f1266c3a640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:11:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.292+0000 7f1266c3a640 1 -- 172.21.15.5:0/2586628470 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12600a32d0 con 0x7f126013f220 2024-08-18T21:11:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1266c3a640 1 -- 172.21.15.5:0/2586628470 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f126013f220 msgr2=0x7f1260141610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1266c3a640 1 --2- 172.21.15.5:0/2586628470 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f126013f220 0x7f1260141610 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f125c0098d0 tx=0x7f125c01c440 comp rx=0 tx=0).ready entity=mon.6 client_cookie=f2029469c6b4ef05 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265437640 1 -- 172.21.15.5:0/2586628470 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f125c0b0070 con 0x7f126013f220 2024-08-18T21:11:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265437640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265437640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:11:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265437640 10 monclient: dump: 2024-08-18T21:11:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:53.307 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265437640 10 monclient: _finish_auth 0 2024-08-18T21:11:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265437640 10 monclient: _check_auth_tickets 2024-08-18T21:11:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265437640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265437640 1 -- 172.21.15.5:0/2586628470 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125c0aa810 con 0x7f126013f220 2024-08-18T21:11:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265437640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265437640 1 -- 172.21.15.5:0/2586628470 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f125c0aae30 con 0x7f126013f220 2024-08-18T21:11:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 5 monclient: authenticate success, global_id 85371 2024-08-18T21:11:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:53.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 4 set_mon_vals no callback set 2024-08-18T21:11:53.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265437640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:53.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265437640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:53.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265437640 10 monclient: dump: 2024-08-18T21:11:53.308 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:53.308 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.308 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.309 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.309 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:53.309 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.309 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:53.309 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:53.309 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:53.309 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:53.310 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:53.310 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:53.310 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:53.310 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:53.310 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:53.310 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 10 monclient: shutdown 2024-08-18T21:11:53.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 1 -- 172.21.15.5:0/2586628470 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f126013f220 msgr2=0x7f1260141610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 1 --2- 172.21.15.5:0/2586628470 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f126013f220 0x7f1260141610 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f125c0098d0 tx=0x7f125c01c440 comp rx=0 tx=0).stop 2024-08-18T21:11:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 1 -- 172.21.15.5:0/2586628470 shutdown_connections 2024-08-18T21:11:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 1 --2- 172.21.15.5:0/2586628470 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f12600a77d0 0x7f126013ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 1 --2- 172.21.15.5:0/2586628470 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f126013f220 0x7f1260141610 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 1 -- 172.21.15.5:0/2586628470 >> 172.21.15.5:0/2586628470 conn(0x7f12600acbc0 msgr2=0x7f12600a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 1 -- 172.21.15.5:0/2586628470 shutdown_connections 2024-08-18T21:11:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 1 -- 172.21.15.5:0/2586628470 wait complete. 2024-08-18T21:11:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 10 monclient: build_initial_monmap 2024-08-18T21:11:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 10 monclient: monmap: 2024-08-18T21:11:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:53.312 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 1 Processor -- start 2024-08-18T21:11:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 1 -- start start 2024-08-18T21:11:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 10 monclient: init 2024-08-18T21:11:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 10 monclient: _add_conns ranks=[0,6,5,4,8,3,1,2,7] 2024-08-18T21:11:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12600a6ce0 0x7f12600a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 10 monclient(hunting): picked mon.noname-a con 0x7f12600a6ce0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:11:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f12600a77d0 0x7f126009ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 10 monclient(hunting): picked mon.noname-d con 0x7f12600a77d0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f126013f220 0x7f1260137b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 10 monclient(hunting): picked mon.noname-h con 0x7f126013f220 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f12600a83a0 con 0x7f12600a6ce0 2024-08-18T21:11:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f12600a8220 con 0x7f126013f220 2024-08-18T21:11:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f1260144370 con 0x7f12600a77d0 2024-08-18T21:11:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f126869d640 10 monclient(hunting): authenticate will time out at 1480.315041s 2024-08-18T21:11:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f12600a77d0 0x7f126009ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f12600a77d0 0x7f126009ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:53180/0 (socket says 172.21.15.5:53180) 2024-08-18T21:11:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 1 -- 172.21.15.5:0/4068883081 learned_addr learned my addr 172.21.15.5:0/4068883081 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 10 monclient(hunting): get_auth_request con 0x7f12600a77d0 auth_method 0 2024-08-18T21:11:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1266439640 1 --2- 172.21.15.5:0/4068883081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12600a6ce0 0x7f12600a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1266439640 10 monclient(hunting): get_auth_request con 0x7f12600a6ce0 auth_method 0 2024-08-18T21:11:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1266439640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1266439640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1266439640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 10 monclient(hunting): handle_auth_done global_id 85380 payload 824 2024-08-18T21:11:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 1 -- 172.21.15.5:0/4068883081 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f126013f220 msgr2=0x7f1260137b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 1 --2- 172.21.15.5:0/4068883081 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f126013f220 0x7f1260137b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 1 -- 172.21.15.5:0/4068883081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12600a6ce0 msgr2=0x7f12600a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 1 --2- 172.21.15.5:0/4068883081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12600a6ce0 0x7f12600a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 10 monclient: _finish_hunting 0 2024-08-18T21:11:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 1 monclient: found mon.noname-d 2024-08-18T21:11:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:11:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1265c38640 1 -- 172.21.15.5:0/4068883081 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1260138800 con 0x7f12600a77d0 2024-08-18T21:11:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.296+0000 7f1266439640 1 --2- 172.21.15.5:0/4068883081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12600a6ce0 0x7f12600a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:11:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1265c38640 1 -- 172.21.15.5:0/4068883081 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f12600a77d0 msgr2=0x7f126009ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1265c38640 1 --2- 172.21.15.5:0/4068883081 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f12600a77d0 0x7f126009ed80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f125000e8b0 tx=0x7f125000ed70 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1256ffd640 1 -- 172.21.15.5:0/4068883081 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1250017070 con 0x7f12600a77d0 2024-08-18T21:11:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1256ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1256ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:11:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1256ffd640 10 monclient: dump: 2024-08-18T21:11:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:53.317 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1256ffd640 10 monclient: _finish_auth 0 2024-08-18T21:11:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1256ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:11:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1256ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1256ffd640 1 -- 172.21.15.5:0/4068883081 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1250013470 con 0x7f12600a77d0 2024-08-18T21:11:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f126869d640 5 monclient: authenticate success, global_id 85380 2024-08-18T21:11:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f126869d640 10 monclient: _renew_subs 2024-08-18T21:11:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f126869d640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f126869d640 1 -- 172.21.15.5:0/4068883081 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12600aaf60 con 0x7f12600a77d0 2024-08-18T21:11:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1256ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1256ffd640 1 -- 172.21.15.5:0/4068883081 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1250013a90 con 0x7f12600a77d0 2024-08-18T21:11:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1256ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1256ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1264c36640 4 set_mon_vals no callback set 2024-08-18T21:11:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1256ffd640 10 monclient: dump: 2024-08-18T21:11:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:53.320 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f126869d640 10 monclient: _renew_subs 2024-08-18T21:11:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f126869d640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f126869d640 1 -- 172.21.15.5:0/4068883081 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f12600a1da0 con 0x7f12600a77d0 2024-08-18T21:11:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f126869d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f126869d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f126869d640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1256ffd640 1 -- 172.21.15.5:0/4068883081 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f125001a070 con 0x7f12600a77d0 2024-08-18T21:11:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f126869d640 1 -- 172.21.15.5:0/4068883081 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12600a70c0 con 0x7f12600a77d0 2024-08-18T21:11:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1256ffd640 1 --2- 172.21.15.5:0/4068883081 >> v2:172.21.15.157:6812/631023601 conn(0x7f124403bdc0 0x7f124403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1256ffd640 1 -- 172.21.15.5:0/4068883081 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(238..238 src has 22..238) ==== 3898+0+0 (secure 0 0 0) 0x7f125000f040 con 0x7f12600a77d0 2024-08-18T21:11:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1266439640 1 --2- 172.21.15.5:0/4068883081 >> v2:172.21.15.157:6812/631023601 conn(0x7f124403bdc0 0x7f124403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.300+0000 7f1266439640 10 monclient: get_auth_request con 0x7f124403bdc0 auth_method 0 2024-08-18T21:11:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.304+0000 7f1266439640 1 --2- 172.21.15.5:0/4068883081 >> v2:172.21.15.157:6812/631023601 conn(0x7f124403bdc0 0x7f124403e280 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f12580045c0 tx=0x7f1258009040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.304+0000 7f1256ffd640 1 -- 172.21.15.5:0/4068883081 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f1250021070 con 0x7f12600a77d0 2024-08-18T21:11:53.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.304+0000 7f1256ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:53.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.304+0000 7f1256ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:53.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534063990}) 2024-08-18T21:11:53.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2913000677}) 2024-08-18T21:11:53.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534063990}) 2024-08-18T21:11:53.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=609137978}) 2024-08-18T21:11:53.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534063990}) 2024-08-18T21:11:53.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=621201366}) 2024-08-18T21:11:53.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534063990}) 2024-08-18T21:11:53.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1749232043}) 2024-08-18T21:11:53.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534063990}) 2024-08-18T21:11:53.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1628352819}) 2024-08-18T21:11:53.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534063990}) 2024-08-18T21:11:53.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=762091656}) 2024-08-18T21:11:53.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534063990}) 2024-08-18T21:11:53.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2992767050}) 2024-08-18T21:11:53.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534063990}) 2024-08-18T21:11:53.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.516+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=978837417}) 2024-08-18T21:11:53.526 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.527 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3475494359}) 2024-08-18T21:11:53.527 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3362055426}) 2024-08-18T21:11:53.527 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.527 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3475494359}) 2024-08-18T21:11:53.527 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2962482799}) 2024-08-18T21:11:53.527 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.527 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3475494359}) 2024-08-18T21:11:53.527 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3499359266}) 2024-08-18T21:11:53.528 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.528 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3475494359}) 2024-08-18T21:11:53.528 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=859537090}) 2024-08-18T21:11:53.528 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.528 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3475494359}) 2024-08-18T21:11:53.528 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3338596467}) 2024-08-18T21:11:53.528 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3475494359}) 2024-08-18T21:11:53.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=638772534}) 2024-08-18T21:11:53.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3475494359}) 2024-08-18T21:11:53.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1874995847}) 2024-08-18T21:11:53.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3475494359}) 2024-08-18T21:11:53.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.520+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1732548206}) 2024-08-18T21:11:53.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.544+0000 7f126869d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:11:53.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.544+0000 7f126869d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:11:53.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.544+0000 7f126869d640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:53.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.544+0000 7f126869d640 1 -- 172.21.15.5:0/4068883081 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f12600a1f70 con 0x7f12600a77d0 2024-08-18T21:11:53.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f1256ffd640 1 -- 172.21.15.5:0/4068883081 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7f12500102b0 con 0x7f12600a77d0 2024-08-18T21:11:53.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f1256ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:11:53.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f1256ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:53.550 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":178,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:11:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f126869d640 1 -- 172.21.15.5:0/4068883081 >> v2:172.21.15.157:6812/631023601 conn(0x7f124403bdc0 msgr2=0x7f124403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f126869d640 1 --2- 172.21.15.5:0/4068883081 >> v2:172.21.15.157:6812/631023601 conn(0x7f124403bdc0 0x7f124403e280 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f12580045c0 tx=0x7f1258009040 comp rx=0 tx=0).stop 2024-08-18T21:11:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f126869d640 10 monclient: shutdown 2024-08-18T21:11:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f126869d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f126869d640 1 -- 172.21.15.5:0/4068883081 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f12600a77d0 msgr2=0x7f126009ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f126869d640 1 --2- 172.21.15.5:0/4068883081 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f12600a77d0 0x7f126009ed80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f125000e8b0 tx=0x7f125000ed70 comp rx=0 tx=0).stop 2024-08-18T21:11:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f126869d640 1 -- 172.21.15.5:0/4068883081 shutdown_connections 2024-08-18T21:11:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f126869d640 1 --2- 172.21.15.5:0/4068883081 >> v2:172.21.15.157:6812/631023601 conn(0x7f124403bdc0 0x7f124403e280 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f126869d640 1 --2- 172.21.15.5:0/4068883081 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f126013f220 0x7f1260137b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f126869d640 1 --2- 172.21.15.5:0/4068883081 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f12600a77d0 0x7f126009ed80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f126869d640 1 --2- 172.21.15.5:0/4068883081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12600a6ce0 0x7f12600a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f126869d640 1 -- 172.21.15.5:0/4068883081 >> 172.21.15.5:0/4068883081 conn(0x7f12600acbc0 msgr2=0x7f12600ab3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f126869d640 1 -- 172.21.15.5:0/4068883081 shutdown_connections 2024-08-18T21:11:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.548+0000 7f126869d640 1 -- 172.21.15.5:0/4068883081 wait complete. 2024-08-18T21:11:53.569 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:11:53.570 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-18T21:11:53.570 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:11:53.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:11:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 10 monclient: get_monmap_and_config 2024-08-18T21:11:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 10 monclient: build_initial_monmap 2024-08-18T21:11:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 10 monclient: monmap: 2024-08-18T21:11:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:53.745203+0000 2024-08-18T21:11:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:53.745203+0000 2024-08-18T21:11:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:53.743 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 1 Processor -- start 2024-08-18T21:11:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 1 -- start start 2024-08-18T21:11:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 10 monclient: init 2024-08-18T21:11:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 10 monclient: _add_conns ranks=[7,5,0,2,10,3,8,4,6,1,9] 2024-08-18T21:11:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f142c0a6ce0 0x7f142c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 10 monclient(hunting): picked mon.noname-i con 0x7f142c0a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f142c0a7600 0x7f142c139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 10 monclient(hunting): picked mon.noname-h con 0x7f142c0a7600 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f142c139fe0 addr v1:172.21.15.5:6789/0 2024-08-18T21:11:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f142c0a45d0 con 0x7f142c139fe0 2024-08-18T21:11:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f142c0a5000 con 0x7f142c0a7600 2024-08-18T21:11:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f142c0a32d0 con 0x7f142c0a6ce0 2024-08-18T21:11:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1432b5e640 10 monclient(hunting): authenticate will time out at 1480.758372s 2024-08-18T21:11:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f14310fb640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f142c139fe0 0x7f142c140cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49168/0 (socket says 172.21.15.5:49168) 2024-08-18T21:11:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f14310fb640 1 -- 172.21.15.5:0/2828682460 learned_addr learned my addr 172.21.15.5:0/2828682460 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:11:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 1 --2- 172.21.15.5:0/2828682460 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f142c0a7600 0x7f142c139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f14308fa640 1 --2- 172.21.15.5:0/2828682460 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f142c0a6ce0 0x7f142c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 10 monclient(hunting): get_auth_request con 0x7f142c0a7600 auth_method 0 2024-08-18T21:11:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f14308fa640 10 monclient(hunting): get_auth_request con 0x7f142c0a6ce0 auth_method 0 2024-08-18T21:11:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f14308fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f14308fa640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f14308fa640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f14308fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f14308fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f14308fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 10 monclient(hunting): handle_auth_done global_id 94874 payload 274 2024-08-18T21:11:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 1 -- 172.21.15.5:0/2828682460 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f142c0a6ce0 msgr2=0x7f142c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 1 --2- 172.21.15.5:0/2828682460 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f142c0a6ce0 0x7f142c0a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 1 -- 172.21.15.5:0/2828682460 >> v1:172.21.15.5:6789/0 conn(0x7f142c139fe0 legacy=0x7f142c140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 10 monclient: _finish_hunting 0 2024-08-18T21:11:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 1 monclient: found mon.noname-h 2024-08-18T21:11:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:11:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.740+0000 7f1423fff640 1 -- 172.21.15.5:0/2828682460 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142c0a8900 con 0x7f142c0a7600 2024-08-18T21:11:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.744+0000 7f1423fff640 1 -- 172.21.15.5:0/2828682460 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f142c0a7600 msgr2=0x7f142c139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.744+0000 7f1423fff640 1 --2- 172.21.15.5:0/2828682460 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f142c0a7600 0x7f142c139aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f141c0097f0 tx=0x7f141c01c3a0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=7c5c63f539dd4d46 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14237fe640 1 -- 172.21.15.5:0/2828682460 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f141c0b0070 con 0x7f142c0a7600 2024-08-18T21:11:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14237fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:11:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14237fe640 10 monclient: dump: 2024-08-18T21:11:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:53.751 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14237fe640 10 monclient: _finish_auth 0 2024-08-18T21:11:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14237fe640 10 monclient: _check_auth_tickets 2024-08-18T21:11:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14237fe640 1 -- 172.21.15.5:0/2828682460 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f141c0aa810 con 0x7f142c0a7600 2024-08-18T21:11:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14237fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14237fe640 1 -- 172.21.15.5:0/2828682460 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f141c0aae30 con 0x7f142c0a7600 2024-08-18T21:11:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 5 monclient: authenticate success, global_id 94874 2024-08-18T21:11:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 4 set_mon_vals no callback set 2024-08-18T21:11:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14237fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:11:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14237fe640 10 monclient: dump: 2024-08-18T21:11:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:53.753 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 10 monclient: shutdown 2024-08-18T21:11:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 1 -- 172.21.15.5:0/2828682460 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f142c0a7600 msgr2=0x7f142c139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 1 --2- 172.21.15.5:0/2828682460 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f142c0a7600 0x7f142c139aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f141c0097f0 tx=0x7f141c01c3a0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 1 -- 172.21.15.5:0/2828682460 shutdown_connections 2024-08-18T21:11:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 1 --2- 172.21.15.5:0/2828682460 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f142c0a7600 0x7f142c139aa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 1 --2- 172.21.15.5:0/2828682460 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f142c0a6ce0 0x7f142c0a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 1 -- 172.21.15.5:0/2828682460 >> 172.21.15.5:0/2828682460 conn(0x7f142c0acbc0 msgr2=0x7f142c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 1 -- 172.21.15.5:0/2828682460 shutdown_connections 2024-08-18T21:11:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 1 -- 172.21.15.5:0/2828682460 wait complete. 2024-08-18T21:11:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 10 monclient: build_initial_monmap 2024-08-18T21:11:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 10 monclient: monmap: 2024-08-18T21:11:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:53.760 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 1 Processor -- start 2024-08-18T21:11:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 1 -- start start 2024-08-18T21:11:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 10 monclient: init 2024-08-18T21:11:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 10 monclient: _add_conns ranks=[4,8,7,1,6,5,2,3,0] 2024-08-18T21:11:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f142c0a6ce0 0x7f142c135d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 10 monclient(hunting): picked mon.noname-c con 0x7f142c0a6ce0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f142c0a7600 0x7f142c136290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 10 monclient(hunting): picked mon.noname-e con 0x7f142c0a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f142c139fe0 0x7f142c13baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 10 monclient(hunting): picked mon.noname-i con 0x7f142c139fe0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f142c0a79e0 con 0x7f142c0a6ce0 2024-08-18T21:11:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f142c0a9810 con 0x7f142c139fe0 2024-08-18T21:11:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f142c0a2260 con 0x7f142c0a7600 2024-08-18T21:11:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1432b5e640 10 monclient(hunting): authenticate will time out at 1480.767439s 2024-08-18T21:11:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1423fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f142c0a7600 0x7f142c136290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14308fa640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f142c0a6ce0 0x7f142c135d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1423fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f142c0a7600 0x7f142c136290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:50846/0 (socket says 172.21.15.5:50846) 2024-08-18T21:11:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1423fff640 1 -- 172.21.15.5:0/518959529 learned_addr learned my addr 172.21.15.5:0/518959529 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1423fff640 10 monclient(hunting): get_auth_request con 0x7f142c0a7600 auth_method 0 2024-08-18T21:11:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1423fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1423fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1423fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14308fa640 10 monclient(hunting): get_auth_request con 0x7f142c0a6ce0 auth_method 0 2024-08-18T21:11:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14308fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14308fa640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14308fa640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1423fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1423fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f1423fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14308fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14308fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14308fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14310fb640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f142c139fe0 0x7f142c13baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14310fb640 10 monclient(hunting): get_auth_request con 0x7f142c139fe0 auth_method 0 2024-08-18T21:11:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14310fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14310fb640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.748+0000 7f14310fb640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1423fff640 10 monclient(hunting): handle_auth_done global_id 114263 payload 824 2024-08-18T21:11:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1423fff640 1 -- 172.21.15.5:0/518959529 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f142c139fe0 msgr2=0x7f142c13baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1423fff640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f142c139fe0 0x7f142c13baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1423fff640 1 -- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f142c0a6ce0 msgr2=0x7f142c135d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1423fff640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f142c0a6ce0 0x7f142c135d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1423fff640 10 monclient: _finish_hunting 0 2024-08-18T21:11:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1423fff640 1 monclient: found mon.noname-e 2024-08-18T21:11:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1423fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1423fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:11:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1423fff640 1 -- 172.21.15.5:0/518959529 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142c1420d0 con 0x7f142c0a7600 2024-08-18T21:11:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14308fa640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f142c0a6ce0 0x7f142c135d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1423fff640 1 -- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f142c0a7600 msgr2=0x7f142c136290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1423fff640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f142c0a7600 0x7f142c136290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f141c009710 tx=0x7f141c019140 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14217fa640 1 -- 172.21.15.5:0/518959529 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f141c0b0040 con 0x7f142c0a7600 2024-08-18T21:11:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14217fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:11:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14217fa640 10 monclient: dump: 2024-08-18T21:11:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:53.766 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14217fa640 10 monclient: _finish_auth 0 2024-08-18T21:11:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14217fa640 10 monclient: _check_auth_tickets 2024-08-18T21:11:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14217fa640 1 -- 172.21.15.5:0/518959529 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f141c0b9070 con 0x7f142c0a7600 2024-08-18T21:11:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14217fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14217fa640 1 -- 172.21.15.5:0/518959529 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f141c0044b0 con 0x7f142c0a7600 2024-08-18T21:11:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14217fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14217fa640 10 monclient: dump: 2024-08-18T21:11:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:53.767 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1422ffd640 4 set_mon_vals no callback set 2024-08-18T21:11:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1432b5e640 5 monclient: authenticate success, global_id 114263 2024-08-18T21:11:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1432b5e640 10 monclient: _renew_subs 2024-08-18T21:11:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1432b5e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1432b5e640 1 -- 172.21.15.5:0/518959529 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f142c13d450 con 0x7f142c0a7600 2024-08-18T21:11:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1432b5e640 10 monclient: _renew_subs 2024-08-18T21:11:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1432b5e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1432b5e640 1 -- 172.21.15.5:0/518959529 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f142c1367d0 con 0x7f142c0a7600 2024-08-18T21:11:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1432b5e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1432b5e640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f142c13c030 0x7f142c13c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1432b5e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f1432b5e640 1 -- 172.21.15.5:0/518959529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f142c0a7b60 con 0x7f142c13c030 2024-08-18T21:11:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14308fa640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f142c13c030 0x7f142c13c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14308fa640 10 monclient: get_auth_request con 0x7f142c13c030 auth_method 0 2024-08-18T21:11:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14308fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14308fa640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14308fa640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14217fa640 1 -- 172.21.15.5:0/518959529 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f141c0b3070 con 0x7f142c0a7600 2024-08-18T21:11:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14308fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14308fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14308fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14308fa640 10 monclient(hunting): handle_auth_done global_id 114201 payload 824 2024-08-18T21:11:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14308fa640 1 -- 172.21.15.5:0/518959529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f142c0a8220 con 0x7f142c13c030 2024-08-18T21:11:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.752+0000 7f14217fa640 1 --2- 172.21.15.5:0/518959529 >> v2:172.21.15.157:6812/631023601 conn(0x7f141803bdc0 0x7f141803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14217fa640 1 -- 172.21.15.5:0/518959529 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(238..238 src has 22..238) ==== 3898+0+0 (secure 0 0 0) 0x7f141c0e7b60 con 0x7f142c0a7600 2024-08-18T21:11:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14310fb640 1 --2- 172.21.15.5:0/518959529 >> v2:172.21.15.157:6812/631023601 conn(0x7f141803bdc0 0x7f141803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14310fb640 10 monclient: get_auth_request con 0x7f141803bdc0 auth_method 0 2024-08-18T21:11:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14308fa640 1 -- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f142c13c030 msgr2=0x7f142c13c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14308fa640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f142c13c030 0x7f142c13c410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1428011cf0 tx=0x7f142800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14217fa640 1 -- 172.21.15.5:0/518959529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f142800fe70 con 0x7f142c13c030 2024-08-18T21:11:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14217fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:11:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14217fa640 10 monclient: dump: 2024-08-18T21:11:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:53.773 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14217fa640 1 -- 172.21.15.5:0/518959529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f142800fe70 con 0x7f142c13c030 2024-08-18T21:11:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14217fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14217fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14217fa640 1 -- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f142c13c030 msgr2=0x7f142c13c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14217fa640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f142c13c030 0x7f142c13c410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1428011cf0 tx=0x7f142800f610 comp rx=0 tx=0).stop 2024-08-18T21:11:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14217fa640 1 -- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f142c13c030 msgr2=0x7f142c13c410 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14217fa640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f142c13c030 0x7f142c13c410 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.756+0000 7f14310fb640 1 --2- 172.21.15.5:0/518959529 >> v2:172.21.15.157:6812/631023601 conn(0x7f141803bdc0 0x7f141803e280 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1424009e90 tx=0x7f1424009480 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.764+0000 7f1432b5e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.764+0000 7f1432b5e640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f142c13c950 0x7f142c09e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.764+0000 7f1432b5e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.764+0000 7f1432b5e640 1 -- 172.21.15.5:0/518959529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f142c051140 con 0x7f142c13c950 2024-08-18T21:11:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.764+0000 7f14308fa640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f142c13c950 0x7f142c09e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.764+0000 7f14308fa640 10 monclient: get_auth_request con 0x7f142c13c950 auth_method 0 2024-08-18T21:11:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.764+0000 7f14308fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.764+0000 7f14308fa640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.764+0000 7f14308fa640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.764+0000 7f14308fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.764+0000 7f14308fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.764+0000 7f14308fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.764+0000 7f14308fa640 10 monclient(hunting): handle_auth_done global_id 114210 payload 824 2024-08-18T21:11:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.764+0000 7f14308fa640 1 -- 172.21.15.5:0/518959529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f142c069580 con 0x7f142c13c950 2024-08-18T21:11:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.764+0000 7f14308fa640 1 -- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f142c13c950 msgr2=0x7f142c09e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.764+0000 7f14308fa640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f142c13c950 0x7f142c09e1f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1428011cf0 tx=0x7f14280046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f14217fa640 1 -- 172.21.15.5:0/518959529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1428027860 con 0x7f142c13c950 2024-08-18T21:11:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f14217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f14217fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:11:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f14217fa640 10 monclient: dump: 2024-08-18T21:11:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:53.777 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f14217fa640 1 -- 172.21.15.5:0/518959529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9249 (secure 0 0 0) 0x7f14280273f0 con 0x7f142c13c950 2024-08-18T21:11:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f14217fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f14217fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f14217fa640 1 -- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f142c13c950 msgr2=0x7f142c09e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f14217fa640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f142c13c950 0x7f142c09e1f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1428011cf0 tx=0x7f14280046d0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f14217fa640 1 -- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f142c13c950 msgr2=0x7f142c09e1f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f14217fa640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f142c13c950 0x7f142c09e1f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.778 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:53.778 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:53.778 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:53.778 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:11:53.778 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:53.778 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 18923, 2024-08-18T21:11:53.778 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:53.778 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:53.778 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:53.778 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:53.779 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:53.779 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:53.779 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:53.779 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:53.779 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:53.779 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:53.779 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:53.779 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:11:53.779 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:53.779 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:53.779 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:53.779 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:53.779 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:53.779 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:53.780 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:53.780 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:53.780 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:53.780 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:53.780 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:53.780 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:53.780 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:53.780 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:53.780 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:53.780 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:53.780 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:53.780 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:53.780 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:53.780 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:53.781 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:53.781 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:53.781 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:53.781 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:53.781 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:53.781 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:53.781 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:53.781 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:53.781 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.781 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:53.781 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:53.781 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:53.782 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:53.782 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:53.782 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:53.782 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:53.782 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:53.782 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:53.782 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:53.782 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:53.782 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:53.782 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:53.782 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:53.782 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:53.782 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:53.783 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:53.783 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:53.783 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:53.783 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:53.783 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:53.783 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:53.783 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:53.783 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:53.783 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:53.783 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:53.783 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:53.783 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:53.783 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:53.783 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:53.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.784 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:53.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.784 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:53.784 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:53.784 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.784 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.784 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.784 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:53.784 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.784 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.785 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:53.785 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.785 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.785 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.785 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:53.785 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:53.785 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.785 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.785 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.785 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.786 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.787 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.787 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:53.787 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:53.787 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.787 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.787 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.787 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:53.787 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:53.787 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.787 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.788 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.788 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:53.788 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.788 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.788 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:53.788 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.788 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.788 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.788 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:53.788 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:53.788 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.790 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.791 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.792 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:53.792 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:53.792 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.792 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.792 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.792 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:53.792 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:53.792 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.792 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.792 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.793 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:53.793 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.793 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.793 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:53.793 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.793 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.793 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.793 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:53.793 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:53.793 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.794 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.794 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.794 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:53.794 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:53.794 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.794 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.794 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.794 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:53.794 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.795 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.795 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:53.795 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.795 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.795 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.795 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:53.795 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:53.795 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.795 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.795 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.795 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:53.796 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:53.796 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.796 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.796 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.796 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:53.796 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.796 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.796 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:53.796 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.796 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.796 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.797 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:53.797 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:53.797 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.797 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.797 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.797 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:53.797 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:53.797 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.797 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.797 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.798 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:53.798 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.798 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.798 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:53.798 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.798 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.798 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.798 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:53.798 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:53.798 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.799 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.799 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.799 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.799 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.799 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:53.799 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:53.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.799 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:53.799 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:53.799 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:53.799 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.799 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:53.799 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:53.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.800 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:53.800 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:53.800 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:53.800 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.800 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.800 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:53.800 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f1432b5e640 1 -- 172.21.15.5:0/518959529 >> v2:172.21.15.157:6812/631023601 conn(0x7f141803bdc0 msgr2=0x7f141803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f1432b5e640 1 --2- 172.21.15.5:0/518959529 >> v2:172.21.15.157:6812/631023601 conn(0x7f141803bdc0 0x7f141803e280 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1424009e90 tx=0x7f1424009480 comp rx=0 tx=0).stop 2024-08-18T21:11:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f1432b5e640 10 monclient: shutdown 2024-08-18T21:11:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f1432b5e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f1432b5e640 1 -- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f142c0a7600 msgr2=0x7f142c136290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f14310fb640 1 -- 172.21.15.5:0/518959529 reap_dead start 2024-08-18T21:11:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f1432b5e640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f142c0a7600 0x7f142c136290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f141c009710 tx=0x7f141c019140 comp rx=0 tx=0).stop 2024-08-18T21:11:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f1432b5e640 1 -- 172.21.15.5:0/518959529 shutdown_connections 2024-08-18T21:11:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f1432b5e640 1 --2- 172.21.15.5:0/518959529 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f142c0a7600 0x7f142c136290 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f1432b5e640 1 -- 172.21.15.5:0/518959529 >> 172.21.15.5:0/518959529 conn(0x7f142c0acbc0 msgr2=0x7f142c138db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f1432b5e640 1 -- 172.21.15.5:0/518959529 shutdown_connections 2024-08-18T21:11:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.768+0000 7f1432b5e640 1 -- 172.21.15.5:0/518959529 wait complete. 2024-08-18T21:11:53.803 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:53.803 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:11:53.803 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:11:53.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=659416891}) 2024-08-18T21:11:53.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1649421727}) 2024-08-18T21:11:53.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.829 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=659416891}) 2024-08-18T21:11:53.830 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3707602552}) 2024-08-18T21:11:53.830 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.830 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=659416891}) 2024-08-18T21:11:53.830 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4159470367}) 2024-08-18T21:11:53.830 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.830 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=659416891}) 2024-08-18T21:11:53.830 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3936110279}) 2024-08-18T21:11:53.830 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.830 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=659416891}) 2024-08-18T21:11:53.830 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1874967681}) 2024-08-18T21:11:53.830 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.830 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=659416891}) 2024-08-18T21:11:53.831 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1199305910}) 2024-08-18T21:11:53.831 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.831 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=659416891}) 2024-08-18T21:11:53.831 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3935152739}) 2024-08-18T21:11:53.831 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.831 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=659416891}) 2024-08-18T21:11:53.831 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.824+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3157680369}) 2024-08-18T21:11:53.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3019327136}) 2024-08-18T21:11:53.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3845343184}) 2024-08-18T21:11:53.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3019327136}) 2024-08-18T21:11:53.833 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3492352576}) 2024-08-18T21:11:53.834 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.834 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3019327136}) 2024-08-18T21:11:53.834 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1664098900}) 2024-08-18T21:11:53.834 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.834 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3019327136}) 2024-08-18T21:11:53.834 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3426814105}) 2024-08-18T21:11:53.834 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.834 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3019327136}) 2024-08-18T21:11:53.834 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1369709991}) 2024-08-18T21:11:53.834 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.834 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3019327136}) 2024-08-18T21:11:53.834 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3835393511}) 2024-08-18T21:11:53.835 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.835 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3019327136}) 2024-08-18T21:11:53.835 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3977204267}) 2024-08-18T21:11:53.835 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.835 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3019327136}) 2024-08-18T21:11:53.835 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.828+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1779497672}) 2024-08-18T21:11:53.837 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.837 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4200237377}) 2024-08-18T21:11:53.837 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4146783797}) 2024-08-18T21:11:53.838 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.838 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4200237377}) 2024-08-18T21:11:53.838 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=347202969}) 2024-08-18T21:11:53.838 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.838 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4200237377}) 2024-08-18T21:11:53.838 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3887125699}) 2024-08-18T21:11:53.838 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.838 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4200237377}) 2024-08-18T21:11:53.838 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=248417031}) 2024-08-18T21:11:53.838 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.838 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4200237377}) 2024-08-18T21:11:53.838 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=41196832}) 2024-08-18T21:11:53.838 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.839 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4200237377}) 2024-08-18T21:11:53.839 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=127586764}) 2024-08-18T21:11:53.839 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.839 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4200237377}) 2024-08-18T21:11:53.839 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1899773646}) 2024-08-18T21:11:53.839 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.839 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4200237377}) 2024-08-18T21:11:53.839 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.832+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2911240766}) 2024-08-18T21:11:53.842 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.842 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341213536}) 2024-08-18T21:11:53.842 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3325729948}) 2024-08-18T21:11:53.842 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.842 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341213536}) 2024-08-18T21:11:53.842 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1421917494}) 2024-08-18T21:11:53.843 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.843 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341213536}) 2024-08-18T21:11:53.843 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1848451463}) 2024-08-18T21:11:53.843 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.843 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341213536}) 2024-08-18T21:11:53.843 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1810881990}) 2024-08-18T21:11:53.843 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.843 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341213536}) 2024-08-18T21:11:53.843 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2940723052}) 2024-08-18T21:11:53.843 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.843 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341213536}) 2024-08-18T21:11:53.843 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1714415713}) 2024-08-18T21:11:53.843 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341213536}) 2024-08-18T21:11:53.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2127007955}) 2024-08-18T21:11:53.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341213536}) 2024-08-18T21:11:53.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.836+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=181999299}) 2024-08-18T21:11:53.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3382445387}) 2024-08-18T21:11:53.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=667031945}) 2024-08-18T21:11:53.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3382445387}) 2024-08-18T21:11:53.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3473814390}) 2024-08-18T21:11:53.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.844 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3382445387}) 2024-08-18T21:11:53.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=182696519}) 2024-08-18T21:11:53.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3382445387}) 2024-08-18T21:11:53.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1708591839}) 2024-08-18T21:11:53.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3382445387}) 2024-08-18T21:11:53.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1951305634}) 2024-08-18T21:11:53.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3382445387}) 2024-08-18T21:11:53.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=964062107}) 2024-08-18T21:11:53.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3382445387}) 2024-08-18T21:11:53.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3144351271}) 2024-08-18T21:11:53.845 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.846 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3382445387}) 2024-08-18T21:11:53.846 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=224319917}) 2024-08-18T21:11:53.849 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.850 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2294169773}) 2024-08-18T21:11:53.850 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4257224184}) 2024-08-18T21:11:53.850 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.850 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2294169773}) 2024-08-18T21:11:53.850 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2776137717}) 2024-08-18T21:11:53.850 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.850 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2294169773}) 2024-08-18T21:11:53.850 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=643674802}) 2024-08-18T21:11:53.850 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.850 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2294169773}) 2024-08-18T21:11:53.850 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3301882478}) 2024-08-18T21:11:53.850 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2294169773}) 2024-08-18T21:11:53.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=656807831}) 2024-08-18T21:11:53.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2294169773}) 2024-08-18T21:11:53.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=887189747}) 2024-08-18T21:11:53.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2294169773}) 2024-08-18T21:11:53.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=857056846}) 2024-08-18T21:11:53.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2294169773}) 2024-08-18T21:11:53.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.840+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2163649902}) 2024-08-18T21:11:53.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3802370095}) 2024-08-18T21:11:53.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3508093165}) 2024-08-18T21:11:53.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3802370095}) 2024-08-18T21:11:53.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2170836469}) 2024-08-18T21:11:53.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3802370095}) 2024-08-18T21:11:53.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4285256699}) 2024-08-18T21:11:53.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3802370095}) 2024-08-18T21:11:53.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3082392163}) 2024-08-18T21:11:53.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3802370095}) 2024-08-18T21:11:53.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3308996712}) 2024-08-18T21:11:53.853 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.853 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3802370095}) 2024-08-18T21:11:53.853 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1087991601}) 2024-08-18T21:11:53.853 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.853 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3802370095}) 2024-08-18T21:11:53.853 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3544157924}) 2024-08-18T21:11:53.853 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.853 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3802370095}) 2024-08-18T21:11:53.853 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.844+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=223362392}) 2024-08-18T21:11:53.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675218519}) 2024-08-18T21:11:53.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2852403209}) 2024-08-18T21:11:53.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675218519}) 2024-08-18T21:11:53.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2296003743}) 2024-08-18T21:11:53.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675218519}) 2024-08-18T21:11:53.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=430522248}) 2024-08-18T21:11:53.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675218519}) 2024-08-18T21:11:53.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4281555476}) 2024-08-18T21:11:53.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675218519}) 2024-08-18T21:11:53.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=147992676}) 2024-08-18T21:11:53.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675218519}) 2024-08-18T21:11:53.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4175595766}) 2024-08-18T21:11:53.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675218519}) 2024-08-18T21:11:53.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1041358922}) 2024-08-18T21:11:53.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675218519}) 2024-08-18T21:11:53.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.848+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2881612649}) 2024-08-18T21:11:53.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528472951}) 2024-08-18T21:11:53.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1716326665}) 2024-08-18T21:11:53.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528472951}) 2024-08-18T21:11:53.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1105067625}) 2024-08-18T21:11:53.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528472951}) 2024-08-18T21:11:53.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2291575518}) 2024-08-18T21:11:53.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.896 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528472951}) 2024-08-18T21:11:53.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2477039206}) 2024-08-18T21:11:53.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528472951}) 2024-08-18T21:11:53.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3923420555}) 2024-08-18T21:11:53.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528472951}) 2024-08-18T21:11:53.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2553200627}) 2024-08-18T21:11:53.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528472951}) 2024-08-18T21:11:53.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=541189803}) 2024-08-18T21:11:53.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528472951}) 2024-08-18T21:11:53.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1029411870}) 2024-08-18T21:11:53.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.896+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.896+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021446576}) 2024-08-18T21:11:53.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.896+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2126231462}) 2024-08-18T21:11:53.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.896+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.896+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021446576}) 2024-08-18T21:11:53.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.896+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=696179725}) 2024-08-18T21:11:53.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.896+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.896+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021446576}) 2024-08-18T21:11:53.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.896+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3348205126}) 2024-08-18T21:11:53.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.896+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021446576}) 2024-08-18T21:11:53.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1901161350}) 2024-08-18T21:11:53.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021446576}) 2024-08-18T21:11:53.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4003475249}) 2024-08-18T21:11:53.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021446576}) 2024-08-18T21:11:53.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1524966359}) 2024-08-18T21:11:53.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021446576}) 2024-08-18T21:11:53.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1153596822}) 2024-08-18T21:11:53.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:53.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021446576}) 2024-08-18T21:11:53.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:53.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3098322559}) 2024-08-18T21:11:53.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 10 monclient: get_monmap_and_config 2024-08-18T21:11:53.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 10 monclient: build_initial_monmap 2024-08-18T21:11:53.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 10 monclient: monmap: 2024-08-18T21:11:53.931 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:53.931 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.931 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:53.933500+0000 2024-08-18T21:11:53.931 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:53.933500+0000 2024-08-18T21:11:53.931 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:53.931 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.931 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:53.931 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:53.931 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:53.931 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:53.931 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:53.931 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:53.932 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:53.932 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:53.932 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:53.932 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:53.932 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:53.932 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 1 Processor -- start 2024-08-18T21:11:53.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 1 -- start start 2024-08-18T21:11:53.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 10 monclient: init 2024-08-18T21:11:53.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:53.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 10 monclient: _add_conns ranks=[8,6,9,7,5,1,10,3,0,4,2] 2024-08-18T21:11:53.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd8940a7400 0x7fd8940a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 10 monclient(hunting): picked mon.noname-e con 0x7fd8940a7400 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:53.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd89406e080 0x7fd8940a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 10 monclient(hunting): picked mon.noname-d con 0x7fd89406e080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:53.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8940a6000 0x7fd8940a6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 10 monclient(hunting): picked mon.noname-a con 0x7fd8940a6000 addr v2:172.21.15.5:3300/0 2024-08-18T21:11:53.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd89406f910 con 0x7fd8940a6000 2024-08-18T21:11:53.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fd8940a1790 con 0x7fd89406e080 2024-08-18T21:11:53.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fd89406e500 con 0x7fd8940a7400 2024-08-18T21:11:53.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:53.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd89ba0f640 10 monclient(hunting): authenticate will time out at 1480.947253s 2024-08-18T21:11:53.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd8940a7400 0x7fd8940a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd8940a7400 0x7fd8940a1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:50848/0 (socket says 172.21.15.5:50848) 2024-08-18T21:11:53.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd899fac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8940a6000 0x7fd8940a6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 1 -- 172.21.15.5:0/4049770186 learned_addr learned my addr 172.21.15.5:0/4049770186 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:53.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 10 monclient(hunting): get_auth_request con 0x7fd8940a7400 auth_method 0 2024-08-18T21:11:53.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd898faa640 1 --2- 172.21.15.5:0/4049770186 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd89406e080 0x7fd8940a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd899fac640 10 monclient(hunting): get_auth_request con 0x7fd8940a6000 auth_method 0 2024-08-18T21:11:53.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd899fac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd899fac640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd899fac640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd898faa640 10 monclient(hunting): get_auth_request con 0x7fd89406e080 auth_method 0 2024-08-18T21:11:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd898faa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd898faa640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd898faa640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd899fac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd899fac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd899fac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd898faa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd898faa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd898faa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 10 monclient(hunting): handle_auth_done global_id 114272 payload 274 2024-08-18T21:11:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 1 -- 172.21.15.5:0/4049770186 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd89406e080 msgr2=0x7fd8940a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 1 --2- 172.21.15.5:0/4049770186 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd89406e080 0x7fd8940a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 1 -- 172.21.15.5:0/4049770186 >> v2:172.21.15.5:3300/0 conn(0x7fd8940a6000 msgr2=0x7fd8940a6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 1 --2- 172.21.15.5:0/4049770186 >> v2:172.21.15.5:3300/0 conn(0x7fd8940a6000 0x7fd8940a6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 10 monclient: _finish_hunting 0 2024-08-18T21:11:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 1 monclient: found mon.noname-e 2024-08-18T21:11:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:11:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd8997ab640 1 -- 172.21.15.5:0/4049770186 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89406de40 con 0x7fd8940a7400 2024-08-18T21:11:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.928+0000 7fd899fac640 1 --2- 172.21.15.5:0/4049770186 >> v2:172.21.15.5:3300/0 conn(0x7fd8940a6000 0x7fd8940a6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd8997ab640 1 -- 172.21.15.5:0/4049770186 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd8940a7400 msgr2=0x7fd8940a1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd8997ab640 1 --2- 172.21.15.5:0/4049770186 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd8940a7400 0x7fd8940a1c20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd884009870 tx=0x7fd88401c4b0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=28f65bf0e84393fb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd88bfff640 1 -- 172.21.15.5:0/4049770186 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd8840aaa30 con 0x7fd8940a7400 2024-08-18T21:11:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd88bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd88bfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:11:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd88bfff640 10 monclient: dump: 2024-08-18T21:11:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:53.943 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd88bfff640 10 monclient: _finish_auth 0 2024-08-18T21:11:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd88bfff640 10 monclient: _check_auth_tickets 2024-08-18T21:11:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd88bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd88bfff640 1 -- 172.21.15.5:0/4049770186 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8840b0070 con 0x7fd8940a7400 2024-08-18T21:11:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 5 monclient: authenticate success, global_id 114272 2024-08-18T21:11:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd88bfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd88bfff640 1 -- 172.21.15.5:0/4049770186 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd8840ab450 con 0x7fd8940a7400 2024-08-18T21:11:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd88bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 4 set_mon_vals no callback set 2024-08-18T21:11:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd88bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd88bfff640 10 monclient: dump: 2024-08-18T21:11:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:53.945 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 10 monclient: shutdown 2024-08-18T21:11:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 -- 172.21.15.5:0/4049770186 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd8940a7400 msgr2=0x7fd8940a1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 --2- 172.21.15.5:0/4049770186 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd8940a7400 0x7fd8940a1c20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd884009870 tx=0x7fd88401c4b0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 -- 172.21.15.5:0/4049770186 shutdown_connections 2024-08-18T21:11:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 --2- 172.21.15.5:0/4049770186 >> v2:172.21.15.5:3300/0 conn(0x7fd8940a6000 0x7fd8940a6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 --2- 172.21.15.5:0/4049770186 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd89406e080 0x7fd8940a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 --2- 172.21.15.5:0/4049770186 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd8940a7400 0x7fd8940a1c20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 -- 172.21.15.5:0/4049770186 >> 172.21.15.5:0/4049770186 conn(0x7fd8940aa770 msgr2=0x7fd8940a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 -- 172.21.15.5:0/4049770186 shutdown_connections 2024-08-18T21:11:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 -- 172.21.15.5:0/4049770186 wait complete. 2024-08-18T21:11:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 10 monclient: build_initial_monmap 2024-08-18T21:11:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 10 monclient: monmap: 2024-08-18T21:11:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:53.948 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 Processor -- start 2024-08-18T21:11:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 -- start start 2024-08-18T21:11:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 10 monclient: init 2024-08-18T21:11:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 10 monclient: _add_conns ranks=[3,5,6,0,8,2,7,1,4] 2024-08-18T21:11:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8940a6000 0x7fd8940a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 10 monclient(hunting): picked mon.noname-g con 0x7fd8940a6000 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8940a7400 0x7fd8941d5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 10 monclient(hunting): picked mon.noname-h con 0x7fd8940a7400 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd8941d5870 0x7fd8941d5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 10 monclient(hunting): picked mon.noname-d con 0x7fd8941d5870 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd894147010 con 0x7fd8940a6000 2024-08-18T21:11:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fd894146e90 con 0x7fd8940a7400 2024-08-18T21:11:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fd894147190 con 0x7fd8941d5870 2024-08-18T21:11:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd89ba0f640 10 monclient(hunting): authenticate will time out at 1480.954528s 2024-08-18T21:11:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd8941d5870 0x7fd8941d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd8941d5870 0x7fd8941d5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:53186/0 (socket says 172.21.15.5:53186) 2024-08-18T21:11:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 1 -- 172.21.15.5:0/254872994 learned_addr learned my addr 172.21.15.5:0/254872994 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 10 monclient(hunting): get_auth_request con 0x7fd8941d5870 auth_method 0 2024-08-18T21:11:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 10 monclient(hunting): handle_auth_done global_id 85398 payload 824 2024-08-18T21:11:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd8997ab640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8940a6000 0x7fd8940a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 1 -- 172.21.15.5:0/254872994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8940a7400 msgr2=0x7fd8941d5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd898faa640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8940a7400 0x7fd8941d5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd8940a7400 0x7fd8941d5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 1 -- 172.21.15.5:0/254872994 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8940a6000 msgr2=0x7fd8940a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8940a6000 0x7fd8940a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 10 monclient: _finish_hunting 0 2024-08-18T21:11:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 1 monclient: found mon.noname-d 2024-08-18T21:11:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:53.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:11:53.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd899fac640 1 -- 172.21.15.5:0/254872994 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89409faf0 con 0x7fd8941d5870 2024-08-18T21:11:53.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd8997ab640 10 monclient: get_auth_request con 0x7fd8940a6000 auth_method 0 2024-08-18T21:11:53.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.936+0000 7fd8997ab640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8940a6000 0x7fd8940a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:11:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd899fac640 1 -- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd8941d5870 msgr2=0x7fd8941d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd899fac640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd8941d5870 0x7fd8941d5c90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00efc0 tx=0x7fd88c009f90 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd889ffb640 1 -- 172.21.15.5:0/254872994 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd88c018030 con 0x7fd8941d5870 2024-08-18T21:11:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd889ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd889ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:11:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd889ffb640 10 monclient: dump: 2024-08-18T21:11:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:53.956 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd889ffb640 10 monclient: _finish_auth 0 2024-08-18T21:11:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd889ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:11:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd889ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd889ffb640 1 -- 172.21.15.5:0/254872994 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88c0148f0 con 0x7fd8941d5870 2024-08-18T21:11:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd89ba0f640 5 monclient: authenticate success, global_id 85398 2024-08-18T21:11:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd89ba0f640 10 monclient: _renew_subs 2024-08-18T21:11:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd89ba0f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd89ba0f640 1 -- 172.21.15.5:0/254872994 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89409e070 con 0x7fd8941d5870 2024-08-18T21:11:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd889ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd889ffb640 1 -- 172.21.15.5:0/254872994 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd88c0133e0 con 0x7fd8941d5870 2024-08-18T21:11:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd889ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd88b7fe640 4 set_mon_vals no callback set 2024-08-18T21:11:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd889ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd889ffb640 10 monclient: dump: 2024-08-18T21:11:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:53.959 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd89ba0f640 10 monclient: _renew_subs 2024-08-18T21:11:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd89ba0f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd89ba0f640 1 -- 172.21.15.5:0/254872994 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89409f810 con 0x7fd8941d5870 2024-08-18T21:11:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd89ba0f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd89ba0f640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd89406e080 0x7fd89413c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd89ba0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd89ba0f640 1 -- 172.21.15.5:0/254872994 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fd894051140 con 0x7fd89406e080 2024-08-18T21:11:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd889ffb640 1 -- 172.21.15.5:0/254872994 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fd88c01b070 con 0x7fd8941d5870 2024-08-18T21:11:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd8997ab640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd89406e080 0x7fd89413c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd8997ab640 10 monclient: get_auth_request con 0x7fd89406e080 auth_method 0 2024-08-18T21:11:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd8997ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd8997ab640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd8997ab640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd8997ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd8997ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd8997ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd889ffb640 1 --2- 172.21.15.5:0/254872994 >> v2:172.21.15.157:6812/631023601 conn(0x7fd87803bdc0 0x7fd87803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd889ffb640 1 -- 172.21.15.5:0/254872994 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(238..238 src has 22..238) ==== 3898+0+0 (secure 0 0 0) 0x7fd88c019070 con 0x7fd8941d5870 2024-08-18T21:11:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd8997ab640 10 monclient(hunting): handle_auth_done global_id 114176 payload 824 2024-08-18T21:11:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd8997ab640 1 -- 172.21.15.5:0/254872994 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd894140810 con 0x7fd89406e080 2024-08-18T21:11:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd898faa640 1 --2- 172.21.15.5:0/254872994 >> v2:172.21.15.157:6812/631023601 conn(0x7fd87803bdc0 0x7fd87803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.940+0000 7fd898faa640 10 monclient: get_auth_request con 0x7fd87803bdc0 auth_method 0 2024-08-18T21:11:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.944+0000 7fd8997ab640 1 -- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd89406e080 msgr2=0x7fd89413c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.944+0000 7fd8997ab640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd89406e080 0x7fd89413c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd8940a73d0 tx=0x7fd884019250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.944+0000 7fd889ffb640 1 -- 172.21.15.5:0/254872994 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd8840aa5c0 con 0x7fd89406e080 2024-08-18T21:11:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.944+0000 7fd889ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.944+0000 7fd889ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:11:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.944+0000 7fd889ffb640 10 monclient: dump: 2024-08-18T21:11:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:53.962 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.944+0000 7fd889ffb640 1 -- 172.21.15.5:0/254872994 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd8840b0070 con 0x7fd89406e080 2024-08-18T21:11:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.944+0000 7fd889ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.944+0000 7fd889ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.944+0000 7fd889ffb640 1 -- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd89406e080 msgr2=0x7fd89413c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.944+0000 7fd889ffb640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd89406e080 0x7fd89413c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd8940a73d0 tx=0x7fd884019250 comp rx=0 tx=0).stop 2024-08-18T21:11:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.944+0000 7fd889ffb640 1 -- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd89406e080 msgr2=0x7fd89413c5a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.944+0000 7fd889ffb640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd89406e080 0x7fd89413c5a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.944+0000 7fd898faa640 1 --2- 172.21.15.5:0/254872994 >> v2:172.21.15.157:6812/631023601 conn(0x7fd87803bdc0 0x7fd87803e280 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd89409f0b0 tx=0x7fd890008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd89ba0f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd89ba0f640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd89413cae0 0x7fd89413cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd89ba0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd89ba0f640 1 -- 172.21.15.5:0/254872994 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fd89413d430 con 0x7fd89413cae0 2024-08-18T21:11:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd8997ab640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd89413cae0 0x7fd89413cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd8997ab640 10 monclient: get_auth_request con 0x7fd89413cae0 auth_method 0 2024-08-18T21:11:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd8997ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd8997ab640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd8997ab640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd8997ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd8997ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd8997ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd8997ab640 10 monclient(hunting): handle_auth_done global_id 114185 payload 824 2024-08-18T21:11:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd8997ab640 1 -- 172.21.15.5:0/254872994 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd8940a6450 con 0x7fd89413cae0 2024-08-18T21:11:53.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd8997ab640 1 -- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd89413cae0 msgr2=0x7fd89413cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:53.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd8997ab640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd89413cae0 0x7fd89413cef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd884000c10 tx=0x7fd8840a9000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:53.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd889ffb640 1 -- 172.21.15.5:0/254872994 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd8840be480 con 0x7fd89413cae0 2024-08-18T21:11:53.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd889ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:53.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd889ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:11:53.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd889ffb640 10 monclient: dump: 2024-08-18T21:11:53.965 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:53.965 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:53.965 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:53.967 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd889ffb640 1 -- 172.21.15.5:0/254872994 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7fd8840aab80 con 0x7fd89413cae0 2024-08-18T21:11:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd889ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd889ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd889ffb640 1 -- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd89413cae0 msgr2=0x7fd89413cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd889ffb640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd89413cae0 0x7fd89413cef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd884000c10 tx=0x7fd8840a9000 comp rx=0 tx=0).stop 2024-08-18T21:11:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd889ffb640 1 -- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd89413cae0 msgr2=0x7fd89413cef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.952+0000 7fd889ffb640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd89413cae0 0x7fd89413cef0 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd884000c10 tx=0x7fd8840a9000 comp rx=0 tx=0).stop 2024-08-18T21:11:53.967 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:53.967 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:53.968 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:53.968 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:53.968 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:53.968 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 19107, 2024-08-18T21:11:53.968 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:53.968 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:53.968 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:53.968 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:53.968 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:53.968 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:53.968 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:53.968 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:53.969 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:53.969 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:53.969 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:53.969 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:11:53.969 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:53.969 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:53.969 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:53.969 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:53.969 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:53.969 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:53.969 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:53.969 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:53.969 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:53.970 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:53.970 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:53.970 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:53.970 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:53.970 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:53.970 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:53.970 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:53.970 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:53.970 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:53.970 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:53.970 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:53.970 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:53.970 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:53.971 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:53.971 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:53.971 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:53.971 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:53.971 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:53.971 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:53.971 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.971 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:53.971 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:53.971 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:53.971 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:53.971 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:53.972 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:53.972 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:53.972 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:53.972 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:53.972 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:53.972 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:53.972 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:53.972 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:53.972 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:53.972 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:53.972 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:53.972 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:53.972 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:53.973 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:53.973 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:53.973 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:53.973 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:53.973 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:53.973 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:53.973 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:53.973 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:53.973 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:53.973 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:53.973 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:53.973 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:53.973 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.973 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:53.974 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.974 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:53.974 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:53.974 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.974 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.974 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.974 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.974 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:53.974 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.974 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.974 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.974 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.975 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:53.975 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.975 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.975 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.975 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:53.975 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:53.975 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.975 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.975 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.975 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.975 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:53.975 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:53.976 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.976 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.976 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.976 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.976 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:53.976 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.977 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.977 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.977 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:53.977 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.977 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.977 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.977 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.977 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:53.977 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:53.977 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.977 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.977 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.977 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.978 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.978 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:53.978 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:53.978 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.978 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.978 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.978 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.978 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:53.978 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.978 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.978 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.978 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.979 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:53.979 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.979 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.979 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.979 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:53.979 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:53.979 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.979 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.979 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.979 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.979 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:53.980 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:53.980 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.980 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.980 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.980 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.980 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:53.980 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.980 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.980 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.980 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:53.980 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.980 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.981 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.981 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:53.981 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:53.981 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.981 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.981 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.981 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.981 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:53.981 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:53.981 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.983 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:53.983 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:53.983 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.983 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.983 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.983 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.983 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.983 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:53.983 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:53.983 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.983 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.983 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.983 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.984 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:53.984 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.984 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.984 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.984 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:53.984 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.984 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.984 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.984 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:53.984 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:53.984 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.985 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.985 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.985 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.985 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:53.985 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:53.985 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.985 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.985 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.986 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.986 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:53.986 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.986 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.986 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.986 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:53.986 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.986 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.986 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.986 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:53.987 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:53.987 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.987 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.987 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.987 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.987 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.987 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:53.987 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:53.987 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.987 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.987 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.987 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.987 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:53.987 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.988 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.988 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.988 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:53.988 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.988 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.988 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.988 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:53.988 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:53.988 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.988 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.989 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.989 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.989 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:53.989 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:53.989 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:53.989 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:53.989 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.989 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:53.989 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:53.989 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.989 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.990 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:53.990 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:53.990 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:53.990 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.990 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.990 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:53.990 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:53.990 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:53.990 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:53.990 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:53.990 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.990 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.991 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:53.991 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:53.991 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.991 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:53.991 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:53.991 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:53.991 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.991 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:53.991 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:53.991 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:53.991 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:53.991 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:53.991 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:53.992 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:53.992 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:53.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:53.992 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:53.992 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:53.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.956+0000 7fd89ba0f640 1 -- 172.21.15.5:0/254872994 >> v2:172.21.15.157:6812/631023601 conn(0x7fd87803bdc0 msgr2=0x7fd87803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.956+0000 7fd89ba0f640 1 --2- 172.21.15.5:0/254872994 >> v2:172.21.15.157:6812/631023601 conn(0x7fd87803bdc0 0x7fd87803e280 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd89409f0b0 tx=0x7fd890008040 comp rx=0 tx=0).stop 2024-08-18T21:11:53.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.956+0000 7fd89ba0f640 10 monclient: shutdown 2024-08-18T21:11:53.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.956+0000 7fd89ba0f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:53.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.956+0000 7fd89ba0f640 1 -- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd8941d5870 msgr2=0x7fd8941d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:53.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.956+0000 7fd899fac640 1 -- 172.21.15.5:0/254872994 reap_dead start 2024-08-18T21:11:53.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.956+0000 7fd89ba0f640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd8941d5870 0x7fd8941d5c90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00efc0 tx=0x7fd88c009f90 comp rx=0 tx=0).stop 2024-08-18T21:11:53.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.956+0000 7fd89ba0f640 1 -- 172.21.15.5:0/254872994 shutdown_connections 2024-08-18T21:11:53.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.956+0000 7fd89ba0f640 1 --2- 172.21.15.5:0/254872994 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fd8941d5870 0x7fd8941d5c90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:53.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.956+0000 7fd89ba0f640 1 -- 172.21.15.5:0/254872994 >> 172.21.15.5:0/254872994 conn(0x7fd8940aa770 msgr2=0x7fd8940a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:53.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.956+0000 7fd89ba0f640 1 -- 172.21.15.5:0/254872994 shutdown_connections 2024-08-18T21:11:53.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:53.956+0000 7fd89ba0f640 1 -- 172.21.15.5:0/254872994 wait complete. 2024-08-18T21:11:53.995 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:53.995 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:11:53.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:11:54.157 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.157 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3857620396}) 2024-08-18T21:11:54.157 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=77320368}) 2024-08-18T21:11:54.157 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.157 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3857620396}) 2024-08-18T21:11:54.157 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3707118832}) 2024-08-18T21:11:54.157 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.157 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3857620396}) 2024-08-18T21:11:54.157 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1898624614}) 2024-08-18T21:11:54.158 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.158 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3857620396}) 2024-08-18T21:11:54.158 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=771340061}) 2024-08-18T21:11:54.158 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.158 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3857620396}) 2024-08-18T21:11:54.158 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2038056300}) 2024-08-18T21:11:54.158 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.158 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3857620396}) 2024-08-18T21:11:54.158 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4256823228}) 2024-08-18T21:11:54.158 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.158 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3857620396}) 2024-08-18T21:11:54.158 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3821883100}) 2024-08-18T21:11:54.158 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.159 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3857620396}) 2024-08-18T21:11:54.159 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.152+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=472200313}) 2024-08-18T21:11:54.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=678698601}) 2024-08-18T21:11:54.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=436018181}) 2024-08-18T21:11:54.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=678698601}) 2024-08-18T21:11:54.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2113523808}) 2024-08-18T21:11:54.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=678698601}) 2024-08-18T21:11:54.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3108117539}) 2024-08-18T21:11:54.169 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=678698601}) 2024-08-18T21:11:54.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2927301659}) 2024-08-18T21:11:54.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=678698601}) 2024-08-18T21:11:54.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2255553911}) 2024-08-18T21:11:54.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=678698601}) 2024-08-18T21:11:54.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1851935107}) 2024-08-18T21:11:54.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=678698601}) 2024-08-18T21:11:54.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2004206772}) 2024-08-18T21:11:54.170 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.171 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=678698601}) 2024-08-18T21:11:54.171 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.164+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1496951801}) 2024-08-18T21:11:54.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 10 monclient: get_monmap_and_config 2024-08-18T21:11:54.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 10 monclient: build_initial_monmap 2024-08-18T21:11:54.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 10 monclient: monmap: 2024-08-18T21:11:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:54.172728+0000 2024-08-18T21:11:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:54.172728+0000 2024-08-18T21:11:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:54.174 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:54.174 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:54.174 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:54.174 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 1 Processor -- start 2024-08-18T21:11:54.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 1 -- start start 2024-08-18T21:11:54.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 10 monclient: init 2024-08-18T21:11:54.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:54.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 10 monclient: _add_conns ranks=[1,10,3,6,8,5,4,2,7,0,9] 2024-08-18T21:11:54.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f97f40a6bd0 addr v1:172.21.15.157:6789/0 2024-08-18T21:11:54.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f97f409f080 0x7f97f413ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 10 monclient(hunting): picked mon.noname-f con 0x7f97f409f080 addr v2:172.21.15.157:3300/0 2024-08-18T21:11:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97f40a76c0 0x7f97f4141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 10 monclient(hunting): picked mon.noname-g con 0x7f97f40a76c0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f40a7fb0 con 0x7f97f40a6bd0 2024-08-18T21:11:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f97f409e4c0 con 0x7f97f409f080 2024-08-18T21:11:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f97f406f930 con 0x7f97f40a76c0 2024-08-18T21:11:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fc202640 10 monclient(hunting): authenticate will time out at 1481.186017s 2024-08-18T21:11:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97f979d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f97f409f080 0x7f97f413ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97f979d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f97f409f080 0x7f97f413ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:60276/0 (socket says 172.21.15.5:60276) 2024-08-18T21:11:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97f979d640 1 -- 172.21.15.5:0/3214109745 learned_addr learned my addr 172.21.15.5:0/3214109745 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:54.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97f979d640 10 monclient(hunting): get_auth_request con 0x7f97f409f080 auth_method 0 2024-08-18T21:11:54.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97f979d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97f979d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97f979d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 1 --2- 172.21.15.5:0/3214109745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97f40a76c0 0x7f97f4141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97f979d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97f979d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97f979d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 10 monclient(hunting): get_auth_request con 0x7f97f40a76c0 auth_method 0 2024-08-18T21:11:54.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 10 monclient(hunting): handle_auth_done global_id 85179 payload 274 2024-08-18T21:11:54.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 1 -- 172.21.15.5:0/3214109745 >> v2:172.21.15.157:3300/0 conn(0x7f97f409f080 msgr2=0x7f97f413ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:54.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 1 --2- 172.21.15.5:0/3214109745 >> v2:172.21.15.157:3300/0 conn(0x7f97f409f080 0x7f97f413ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 1 -- 172.21.15.5:0/3214109745 >> v1:172.21.15.157:6789/0 conn(0x7f97f40a6bd0 legacy=0x7f97f40a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:54.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 10 monclient: _finish_hunting 0 2024-08-18T21:11:54.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 1 monclient: found mon.noname-g 2024-08-18T21:11:54.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:54.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:11:54.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.168+0000 7f97fa79f640 1 -- 172.21.15.5:0/3214109745 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f409de70 con 0x7f97f40a76c0 2024-08-18T21:11:54.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.180+0000 7f97fa79f640 1 -- 172.21.15.5:0/3214109745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97f40a76c0 msgr2=0x7f97f4141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:54.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.180+0000 7f97fa79f640 1 --2- 172.21.15.5:0/3214109745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97f40a76c0 0x7f97f4141330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009d90 tx=0x7f97ec01c7d0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=5910c8d6d5a1751b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:54.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97f8f9c640 1 -- 172.21.15.5:0/3214109745 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97ec0a6960 con 0x7f97f40a76c0 2024-08-18T21:11:54.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97f8f9c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97f8f9c640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:11:54.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97f8f9c640 10 monclient: dump: 2024-08-18T21:11:54.194 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.194 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.194 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.194 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.194 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.194 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.194 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.194 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.194 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.194 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.194 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.194 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.195 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97f8f9c640 10 monclient: _finish_auth 0 2024-08-18T21:11:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97f8f9c640 10 monclient: _check_auth_tickets 2024-08-18T21:11:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97f8f9c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97f8f9c640 1 -- 172.21.15.5:0/3214109745 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97ec0a6b20 con 0x7f97f40a76c0 2024-08-18T21:11:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 5 monclient: authenticate success, global_id 85179 2024-08-18T21:11:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97f8f9c640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97f8f9c640 1 -- 172.21.15.5:0/3214109745 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97ec0a6cd0 con 0x7f97f40a76c0 2024-08-18T21:11:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97f8f9c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97f8f9c640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:11:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97f8f9c640 10 monclient: dump: 2024-08-18T21:11:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.197 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 4 set_mon_vals no callback set 2024-08-18T21:11:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 10 monclient: shutdown 2024-08-18T21:11:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 1 -- 172.21.15.5:0/3214109745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97f40a76c0 msgr2=0x7f97f4141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 1 --2- 172.21.15.5:0/3214109745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97f40a76c0 0x7f97f4141330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009d90 tx=0x7f97ec01c7d0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 1 -- 172.21.15.5:0/3214109745 shutdown_connections 2024-08-18T21:11:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 1 --2- 172.21.15.5:0/3214109745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97f40a76c0 0x7f97f4141330 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 1 --2- 172.21.15.5:0/3214109745 >> v2:172.21.15.157:3300/0 conn(0x7f97f409f080 0x7f97f413ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 1 -- 172.21.15.5:0/3214109745 >> 172.21.15.5:0/3214109745 conn(0x7f97f4068700 msgr2=0x7f97f4068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 1 -- 172.21.15.5:0/3214109745 shutdown_connections 2024-08-18T21:11:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 1 -- 172.21.15.5:0/3214109745 wait complete. 2024-08-18T21:11:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 10 monclient: build_initial_monmap 2024-08-18T21:11:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 10 monclient: monmap: 2024-08-18T21:11:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:54.201 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:54.201 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:54.201 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.201 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:54.201 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:54.201 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:54.201 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:54.201 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:54.201 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:54.201 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:54.201 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:54.201 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:54.201 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 1 Processor -- start 2024-08-18T21:11:54.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 1 -- start start 2024-08-18T21:11:54.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 10 monclient: init 2024-08-18T21:11:54.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:54.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 10 monclient: _add_conns ranks=[3,6,7,4,1,8,0,2,5] 2024-08-18T21:11:54.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97f409f080 0x7f97f4128db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 10 monclient(hunting): picked mon.noname-g con 0x7f97f409f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:54.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f97f40a6bd0 0x7f97f41d1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 10 monclient(hunting): picked mon.noname-d con 0x7f97f40a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:54.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f97f40a76c0 0x7f97f4126760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 10 monclient(hunting): picked mon.noname-i con 0x7f97f40a76c0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:54.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f97f4144210 con 0x7f97f409f080 2024-08-18T21:11:54.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f97f4144090 con 0x7f97f40a6bd0 2024-08-18T21:11:54.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f97f4144390 con 0x7f97f40a76c0 2024-08-18T21:11:54.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:54.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.192+0000 7f97fc202640 10 monclient(hunting): authenticate will time out at 1481.211651s 2024-08-18T21:11:54.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97f409f080 0x7f97f4128db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97f409f080 0x7f97f4128db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:38282/0 (socket says 172.21.15.5:38282) 2024-08-18T21:11:54.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 1 -- 172.21.15.5:0/1111638907 learned_addr learned my addr 172.21.15.5:0/1111638907 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:54.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 10 monclient(hunting): get_auth_request con 0x7f97f409f080 auth_method 0 2024-08-18T21:11:54.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 10 monclient(hunting): handle_auth_done global_id 85188 payload 824 2024-08-18T21:11:54.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 1 -- 172.21.15.5:0/1111638907 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f97f40a76c0 msgr2=0x7f97f4126760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-18T21:11:54.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f97f40a76c0 0x7f97f4126760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 1 -- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f97f40a6bd0 msgr2=0x7f97f41d1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f979d640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f97f40a6bd0 0x7f97f41d1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f97f40a6bd0 0x7f97f41d1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 10 monclient: _finish_hunting 0 2024-08-18T21:11:54.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 1 monclient: found mon.noname-g 2024-08-18T21:11:54.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:54.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:11:54.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 1 -- 172.21.15.5:0/1111638907 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f40a62d0 con 0x7f97f409f080 2024-08-18T21:11:54.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f979d640 10 monclient: get_auth_request con 0x7f97f40a6bd0 auth_method 0 2024-08-18T21:11:54.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f979d640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f97f40a6bd0 0x7f97f41d1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:11:54.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 1 -- 172.21.15.5:0/1111638907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97f409f080 msgr2=0x7f97f4128db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:54.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.196+0000 7f97f9f9e640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97f409f080 0x7f97f4128db0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f97e800c3d0 tx=0x7f97e800c890 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:54.207 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.207 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257422920}) 2024-08-18T21:11:54.207 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2741235554}) 2024-08-18T21:11:54.207 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.207 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257422920}) 2024-08-18T21:11:54.207 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2024047878}) 2024-08-18T21:11:54.207 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.207 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257422920}) 2024-08-18T21:11:54.207 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2555405827}) 2024-08-18T21:11:54.207 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257422920}) 2024-08-18T21:11:54.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2436266467}) 2024-08-18T21:11:54.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257422920}) 2024-08-18T21:11:54.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=186793903}) 2024-08-18T21:11:54.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257422920}) 2024-08-18T21:11:54.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3806134647}) 2024-08-18T21:11:54.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257422920}) 2024-08-18T21:11:54.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.200+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1374279192}) 2024-08-18T21:11:54.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.204+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.204+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257422920}) 2024-08-18T21:11:54.208 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.204+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3022932399}) 2024-08-18T21:11:54.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97e67fc640 1 -- 172.21.15.5:0/1111638907 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97e8011c10 con 0x7f97f409f080 2024-08-18T21:11:54.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97e67fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:11:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97e67fc640 10 monclient: dump: 2024-08-18T21:11:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.224 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97e67fc640 10 monclient: _finish_auth 0 2024-08-18T21:11:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97e67fc640 10 monclient: _check_auth_tickets 2024-08-18T21:11:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97e67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97e67fc640 1 -- 172.21.15.5:0/1111638907 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e8017070 con 0x7f97f409f080 2024-08-18T21:11:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97fc202640 5 monclient: authenticate success, global_id 85188 2024-08-18T21:11:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97fc202640 10 monclient: _renew_subs 2024-08-18T21:11:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97fc202640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.157:3301/0 2024-08-18T21:11:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97fc202640 1 -- 172.21.15.5:0/1111638907 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f412a2d0 con 0x7f97f409f080 2024-08-18T21:11:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97e67fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97e67fc640 1 -- 172.21.15.5:0/1111638907 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97e8011e30 con 0x7f97f409f080 2024-08-18T21:11:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97e67fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:11:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97e67fc640 10 monclient: dump: 2024-08-18T21:11:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.226 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97e77fe640 4 set_mon_vals no callback set 2024-08-18T21:11:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97fc202640 10 monclient: _renew_subs 2024-08-18T21:11:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97fc202640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.157:3301/0 2024-08-18T21:11:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97fc202640 1 -- 172.21.15.5:0/1111638907 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f40abf70 con 0x7f97f409f080 2024-08-18T21:11:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.216+0000 7f97fc202640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97fc202640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f97f41d1ec0 0x7f97f4126ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97fc202640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97fc202640 1 -- 172.21.15.5:0/1111638907 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f97f40aba20 con 0x7f97f41d1ec0 2024-08-18T21:11:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97f979d640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f97f41d1ec0 0x7f97f4126ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97f979d640 10 monclient: get_auth_request con 0x7f97f41d1ec0 auth_method 0 2024-08-18T21:11:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97f979d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97f979d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97f979d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97f979d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97f979d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97f979d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97f979d640 10 monclient(hunting): handle_auth_done global_id 114178 payload 824 2024-08-18T21:11:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97f979d640 1 -- 172.21.15.5:0/1111638907 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97f40a6fb0 con 0x7f97f41d1ec0 2024-08-18T21:11:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97e67fc640 1 -- 172.21.15.5:0/1111638907 <== mon.3 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f97e80117a0 con 0x7f97f409f080 2024-08-18T21:11:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97e67fc640 1 --2- 172.21.15.5:0/1111638907 >> v2:172.21.15.157:6812/631023601 conn(0x7f97d803bdc0 0x7f97d803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97e67fc640 1 -- 172.21.15.5:0/1111638907 <== mon.3 v2:172.21.15.157:3301/0 5 ==== osd_map(239..239 src has 22..239) ==== 3898+0+0 (secure 0 0 0) 0x7f97e804e610 con 0x7f97f409f080 2024-08-18T21:11:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97fa79f640 1 --2- 172.21.15.5:0/1111638907 >> v2:172.21.15.157:6812/631023601 conn(0x7f97d803bdc0 0x7f97d803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97fa79f640 10 monclient: get_auth_request con 0x7f97d803bdc0 auth_method 0 2024-08-18T21:11:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97f979d640 1 -- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f97f41d1ec0 msgr2=0x7f97f4126ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97f979d640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f97f41d1ec0 0x7f97f4126ca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f97f41288c0 tx=0x7f97f0010c20 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97e67fc640 1 -- 172.21.15.5:0/1111638907 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97f000f040 con 0x7f97f41d1ec0 2024-08-18T21:11:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97e67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:11:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97e67fc640 10 monclient: dump: 2024-08-18T21:11:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.231 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97e67fc640 1 -- 172.21.15.5:0/1111638907 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f97f0010e70 con 0x7f97f41d1ec0 2024-08-18T21:11:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97e67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97e67fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97e67fc640 1 -- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f97f41d1ec0 msgr2=0x7f97f4126ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97e67fc640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f97f41d1ec0 0x7f97f4126ca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f97f41288c0 tx=0x7f97f0010c20 comp rx=0 tx=0).stop 2024-08-18T21:11:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97e67fc640 1 -- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f97f41d1ec0 msgr2=0x7f97f4126ca0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97e67fc640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f97f41d1ec0 0x7f97f4126ca0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.220+0000 7f97fa79f640 1 --2- 172.21.15.5:0/1111638907 >> v2:172.21.15.157:6812/631023601 conn(0x7f97d803bdc0 0x7f97d803e280 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f97f409db50 tx=0x7f97ec0a7000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:54.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.228+0000 7f97fc202640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.228+0000 7f97fc202640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f97f41271e0 0x7f97f40a20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.228+0000 7f97fc202640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.228+0000 7f97fc202640 1 -- 172.21.15.5:0/1111638907 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f97f4051140 con 0x7f97f41271e0 2024-08-18T21:11:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.228+0000 7f97f979d640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f97f41271e0 0x7f97f40a20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.228+0000 7f97f979d640 10 monclient: get_auth_request con 0x7f97f41271e0 auth_method 0 2024-08-18T21:11:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.228+0000 7f97f979d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.228+0000 7f97f979d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.228+0000 7f97f979d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.228+0000 7f97f979d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.228+0000 7f97f979d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.228+0000 7f97f979d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.228+0000 7f97f979d640 10 monclient(hunting): handle_auth_done global_id 114187 payload 824 2024-08-18T21:11:54.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.228+0000 7f97f979d640 1 -- 172.21.15.5:0/1111638907 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f97f41275f0 con 0x7f97f41271e0 2024-08-18T21:11:54.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97f979d640 1 -- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f97f41271e0 msgr2=0x7f97f40a20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:54.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97f979d640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f97f41271e0 0x7f97f40a20e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f97f41288c0 tx=0x7f97f00046d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97e67fc640 1 -- 172.21.15.5:0/1111638907 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97f0005bb0 con 0x7f97f41271e0 2024-08-18T21:11:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97e67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:11:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97e67fc640 10 monclient: dump: 2024-08-18T21:11:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.236 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97e67fc640 1 -- 172.21.15.5:0/1111638907 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f97f0005bb0 con 0x7f97f41271e0 2024-08-18T21:11:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97e67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97e67fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97e67fc640 1 -- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f97f41271e0 msgr2=0x7f97f40a20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97e67fc640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f97f41271e0 0x7f97f40a20e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f97f41288c0 tx=0x7f97f00046d0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97e67fc640 1 -- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f97f41271e0 msgr2=0x7f97f40a20e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:54.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97e67fc640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f97f41271e0 0x7f97f40a20e0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f97f41288c0 tx=0x7f97f00046d0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.237 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:54.237 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:54.237 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:54.237 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:54.237 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:54.237 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 19391, 2024-08-18T21:11:54.237 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:54.237 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:54.238 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:54.238 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:54.238 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:54.238 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:54.238 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:54.238 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:54.238 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:54.238 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:54.238 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:54.238 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:11:54.238 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:54.238 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:54.239 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:54.239 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:54.239 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:54.239 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:54.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:54.239 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:54.239 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:54.239 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:54.239 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:54.239 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:54.239 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:54.239 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:54.239 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:54.240 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:54.240 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:54.240 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:54.240 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:54.240 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:54.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:54.240 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:54.240 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:54.240 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:54.240 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:54.240 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:54.240 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:54.240 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:54.241 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.241 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:54.241 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:54.241 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:54.241 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:54.241 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:54.241 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:54.241 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:54.241 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:54.241 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:54.242 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:54.242 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:54.242 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:54.242 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:54.242 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:54.242 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:54.242 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:54.242 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:54.242 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:54.242 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:54.242 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:54.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:54.242 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:54.243 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:54.243 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:54.243 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:54.243 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:54.243 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:54.243 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:54.243 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:54.243 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:54.243 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.243 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:54.243 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.243 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:54.244 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:54.244 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.244 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.244 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.244 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:54.244 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.244 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.244 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:54.244 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.244 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.245 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.245 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:54.245 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:54.245 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.245 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.245 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.245 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.245 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:54.245 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:54.245 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.245 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.245 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.246 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.246 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:54.246 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.246 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.246 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:54.246 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.246 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.246 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.246 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:54.246 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:54.247 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.247 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.247 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.247 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:54.247 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:54.247 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.247 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.247 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.247 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:54.247 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.248 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.248 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:54.248 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.248 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.248 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.248 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:54.248 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:54.248 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.248 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.248 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.248 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:54.249 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:54.249 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.249 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.249 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.249 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:54.249 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.249 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.249 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:54.249 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.249 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.249 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.250 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:54.250 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:54.250 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.250 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.250 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.250 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:54.250 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:54.250 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.250 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.251 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.251 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:54.251 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.251 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.251 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:54.251 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.251 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.251 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.251 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:54.251 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:54.252 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.252 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.252 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.252 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:54.252 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:54.252 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.252 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.252 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.252 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:54.252 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.253 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.253 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:54.253 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.253 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.253 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.253 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:54.253 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:54.253 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.253 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.253 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.253 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.254 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:54.254 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:54.254 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.254 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.254 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:54.254 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.254 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:54.254 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.255 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.255 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.255 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:54.255 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:54.255 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.255 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.255 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.255 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:54.255 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:54.255 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.256 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.256 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.256 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:54.256 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.256 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.256 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:54.256 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.256 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.256 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.256 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:54.257 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:54.257 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.257 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.257 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.257 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:54.257 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:54.257 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.257 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.257 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:54.258 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.258 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:54.258 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.258 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.258 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.258 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:54.258 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:54.258 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.259 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.259 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.259 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.259 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.259 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:54.259 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:54.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.259 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:54.259 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:54.259 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:54.259 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.259 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:54.259 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:54.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.260 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:54.260 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:54.260 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:54.260 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.260 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.260 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:54.260 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97fc202640 1 -- 172.21.15.5:0/1111638907 >> v2:172.21.15.157:6812/631023601 conn(0x7f97d803bdc0 msgr2=0x7f97d803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97fc202640 1 --2- 172.21.15.5:0/1111638907 >> v2:172.21.15.157:6812/631023601 conn(0x7f97d803bdc0 0x7f97d803e280 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f97f409db50 tx=0x7f97ec0a7000 comp rx=0 tx=0).stop 2024-08-18T21:11:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97fc202640 10 monclient: shutdown 2024-08-18T21:11:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97fc202640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97fc202640 1 -- 172.21.15.5:0/1111638907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97f409f080 msgr2=0x7f97f4128db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97fc202640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97f409f080 0x7f97f4128db0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f97e800c3d0 tx=0x7f97e800c890 comp rx=0 tx=0).stop 2024-08-18T21:11:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97fa79f640 1 -- 172.21.15.5:0/1111638907 reap_dead start 2024-08-18T21:11:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97fc202640 1 -- 172.21.15.5:0/1111638907 shutdown_connections 2024-08-18T21:11:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97fc202640 1 --2- 172.21.15.5:0/1111638907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97f409f080 0x7f97f4128db0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97fc202640 1 -- 172.21.15.5:0/1111638907 >> 172.21.15.5:0/1111638907 conn(0x7f97f4068700 msgr2=0x7f97f40aa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97fc202640 1 -- 172.21.15.5:0/1111638907 shutdown_connections 2024-08-18T21:11:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.232+0000 7f97fc202640 1 -- 172.21.15.5:0/1111638907 wait complete. 2024-08-18T21:11:54.263 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:54.263 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:11:54.263 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:11:54.342 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:54.343 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31241]: starting. 2024-08-18T21:11:54.343 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31241]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31206 2024-08-18T21:11:54.343 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31241]: created object 0... 2024-08-18T21:11:54.343 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31241]: created object 25... 2024-08-18T21:11:54.343 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31241]: created object 49... 2024-08-18T21:11:54.343 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31241]: finishing. 2024-08-18T21:11:54.343 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31241]: shutting down. 2024-08-18T21:11:54.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 10 monclient: get_monmap_and_config 2024-08-18T21:11:54.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 10 monclient: build_initial_monmap 2024-08-18T21:11:54.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 10 monclient: monmap: 2024-08-18T21:11:54.383 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:54.383 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.383 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:54.385296+0000 2024-08-18T21:11:54.383 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:54.385296+0000 2024-08-18T21:11:54.383 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:54.383 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.383 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:54.383 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:54.383 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:54.383 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:54.383 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:54.383 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:54.384 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:54.384 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:54.384 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:54.384 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:54.384 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:54.384 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 1 Processor -- start 2024-08-18T21:11:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 1 -- start start 2024-08-18T21:11:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 10 monclient: init 2024-08-18T21:11:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 10 monclient: _add_conns ranks=[4,5,10,0,6,7,3,2,1,9,8] 2024-08-18T21:11:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb1c09da30 0x7fbb1c09de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 10 monclient(hunting): picked mon.noname-c con 0x7fbb1c09da30 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb1c0a03e0 0x7fbb1c09e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 10 monclient(hunting): picked mon.noname-h con 0x7fbb1c0a03e0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbb1c0a3110 0x7fbb1c1366a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 10 monclient(hunting): picked mon.noname-f con 0x7fbb1c0a3110 addr v2:172.21.15.157:3300/0 2024-08-18T21:11:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fbb1c09e890 con 0x7fbb1c0a3110 2024-08-18T21:11:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fbb1c09f7c0 con 0x7fbb1c09da30 2024-08-18T21:11:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fbb1c09f4e0 con 0x7fbb1c0a03e0 2024-08-18T21:11:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb212c7640 10 monclient(hunting): authenticate will time out at 1481.398513s 2024-08-18T21:11:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb1c09da30 0x7fbb1c09de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb1c09da30 0x7fbb1c09de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:37898/0 (socket says 172.21.15.5:37898) 2024-08-18T21:11:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 1 -- 172.21.15.5:0/3651231145 learned_addr learned my addr 172.21.15.5:0/3651231145 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 10 monclient(hunting): get_auth_request con 0x7fbb1c09da30 auth_method 0 2024-08-18T21:11:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1b7fe640 1 --2- 172.21.15.5:0/3651231145 >> v2:172.21.15.157:3300/0 conn(0x7fbb1c0a3110 0x7fbb1c1366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1a7fc640 1 --2- 172.21.15.5:0/3651231145 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb1c0a03e0 0x7fbb1c09e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1b7fe640 10 monclient(hunting): get_auth_request con 0x7fbb1c0a3110 auth_method 0 2024-08-18T21:11:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1a7fc640 10 monclient(hunting): get_auth_request con 0x7fbb1c0a03e0 auth_method 0 2024-08-18T21:11:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 10 monclient(hunting): handle_auth_done global_id 114196 payload 274 2024-08-18T21:11:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 1 -- 172.21.15.5:0/3651231145 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb1c0a03e0 msgr2=0x7fbb1c09e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 1 --2- 172.21.15.5:0/3651231145 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb1c0a03e0 0x7fbb1c09e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 1 -- 172.21.15.5:0/3651231145 >> v2:172.21.15.157:3300/0 conn(0x7fbb1c0a3110 msgr2=0x7fbb1c1366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 1 --2- 172.21.15.5:0/3651231145 >> v2:172.21.15.157:3300/0 conn(0x7fbb1c0a3110 0x7fbb1c1366a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 10 monclient: _finish_hunting 0 2024-08-18T21:11:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 1 monclient: found mon.noname-c 2024-08-18T21:11:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:11:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1affd640 1 -- 172.21.15.5:0/3651231145 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c09faa0 con 0x7fbb1c09da30 2024-08-18T21:11:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.380+0000 7fbb1b7fe640 1 --2- 172.21.15.5:0/3651231145 >> v2:172.21.15.157:3300/0 conn(0x7fbb1c0a3110 0x7fbb1c1366a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:11:54.391 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:54.391 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31243]: starting. 2024-08-18T21:11:54.391 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31243]: listing objects. 2024-08-18T21:11:54.391 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31243]: listed object 0... 2024-08-18T21:11:54.391 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31243]: listed object 25... 2024-08-18T21:11:54.391 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31243]: saw 50 objects 2024-08-18T21:11:54.391 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31243]: shutting down. 2024-08-18T21:11:54.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.384+0000 7fbb1affd640 1 -- 172.21.15.5:0/3651231145 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb1c09da30 msgr2=0x7fbb1c09de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:54.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.384+0000 7fbb1affd640 1 --2- 172.21.15.5:0/3651231145 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb1c09da30 0x7fbb1c09de10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009e50 tx=0x7fbb0c01d060 comp rx=0 tx=0).ready entity=mon.4 client_cookie=bd280e8bad08a7b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:54.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb19ffb640 1 -- 172.21.15.5:0/3651231145 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbb0c009110 con 0x7fbb1c09da30 2024-08-18T21:11:54.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb19ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb19ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:11:54.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb19ffb640 10 monclient: dump: 2024-08-18T21:11:54.397 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.401 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.401 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.402 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.402 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb19ffb640 10 monclient: _finish_auth 0 2024-08-18T21:11:54.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb19ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:11:54.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:54.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 5 monclient: authenticate success, global_id 114196 2024-08-18T21:11:54.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:54.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb19ffb640 1 -- 172.21.15.5:0/3651231145 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb0c0a68e0 con 0x7fbb1c09da30 2024-08-18T21:11:54.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb19ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:54.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:54.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 4 set_mon_vals no callback set 2024-08-18T21:11:54.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb19ffb640 1 -- 172.21.15.5:0/3651231145 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbb0c0a7450 con 0x7fbb1c09da30 2024-08-18T21:11:54.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb19ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb19ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:11:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb19ffb640 10 monclient: dump: 2024-08-18T21:11:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.404 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 10 monclient: shutdown 2024-08-18T21:11:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 -- 172.21.15.5:0/3651231145 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb1c09da30 msgr2=0x7fbb1c09de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 --2- 172.21.15.5:0/3651231145 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb1c09da30 0x7fbb1c09de10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009e50 tx=0x7fbb0c01d060 comp rx=0 tx=0).stop 2024-08-18T21:11:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 -- 172.21.15.5:0/3651231145 shutdown_connections 2024-08-18T21:11:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 --2- 172.21.15.5:0/3651231145 >> v2:172.21.15.157:3300/0 conn(0x7fbb1c0a3110 0x7fbb1c1366a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 --2- 172.21.15.5:0/3651231145 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbb1c0a03e0 0x7fbb1c09e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 --2- 172.21.15.5:0/3651231145 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb1c09da30 0x7fbb1c09de10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 -- 172.21.15.5:0/3651231145 >> 172.21.15.5:0/3651231145 conn(0x7fbb1c0688d0 msgr2=0x7fbb1c068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 -- 172.21.15.5:0/3651231145 shutdown_connections 2024-08-18T21:11:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 -- 172.21.15.5:0/3651231145 wait complete. 2024-08-18T21:11:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 10 monclient: build_initial_monmap 2024-08-18T21:11:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 10 monclient: monmap: 2024-08-18T21:11:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:54.406 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 Processor -- start 2024-08-18T21:11:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 -- start start 2024-08-18T21:11:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 10 monclient: init 2024-08-18T21:11:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 10 monclient: _add_conns ranks=[3,4,0,6,8,7,1,5,2] 2024-08-18T21:11:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb1c09da30 0x7fbb1c070a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 10 monclient(hunting): picked mon.noname-g con 0x7fbb1c09da30 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb1c0a3110 0x7fbb1c070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 10 monclient(hunting): picked mon.noname-c con 0x7fbb1c0a3110 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb1c071500 0x7fbb1c1d58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 10 monclient(hunting): picked mon.noname-a con 0x7fbb1c071500 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:11:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c06cce0 con 0x7fbb1c071500 2024-08-18T21:11:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbb1c06cb60 con 0x7fbb1c09da30 2024-08-18T21:11:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fbb1c06ce60 con 0x7fbb1c0a3110 2024-08-18T21:11:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb212c7640 10 monclient(hunting): authenticate will time out at 1481.406596s 2024-08-18T21:11:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1a7fc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb1c0a3110 0x7fbb1c070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb1c071500 0x7fbb1c1d58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1a7fc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb1c0a3110 0x7fbb1c070fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:37908/0 (socket says 172.21.15.5:37908) 2024-08-18T21:11:54.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1a7fc640 1 -- 172.21.15.5:0/1415194339 learned_addr learned my addr 172.21.15.5:0/1415194339 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:54.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1a7fc640 10 monclient(hunting): get_auth_request con 0x7fbb1c0a3110 auth_method 0 2024-08-18T21:11:54.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 10 monclient(hunting): get_auth_request con 0x7fbb1c071500 auth_method 0 2024-08-18T21:11:54.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1affd640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb1c09da30 0x7fbb1c070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1affd640 10 monclient(hunting): get_auth_request con 0x7fbb1c09da30 auth_method 0 2024-08-18T21:11:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 10 monclient(hunting): handle_auth_done global_id 114228 payload 824 2024-08-18T21:11:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 1 -- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb1c0a3110 msgr2=0x7fbb1c070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbb1c0a3110 0x7fbb1c070fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 1 -- 172.21.15.5:0/1415194339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb1c09da30 msgr2=0x7fbb1c070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb1c09da30 0x7fbb1c070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:11:54.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 1 monclient: found mon.noname-a 2024-08-18T21:11:54.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:54.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:11:54.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.388+0000 7fbb1b7fe640 1 -- 172.21.15.5:0/1415194339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c073890 con 0x7fbb1c071500 2024-08-18T21:11:54.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1b7fe640 1 -- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb1c071500 msgr2=0x7fbb1c1d58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:54.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1b7fe640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb1c071500 0x7fbb1c1d58e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400d520 tx=0x7fbb1400d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:54.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb037fe640 1 -- 172.21.15.5:0/1415194339 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbb14012c70 con 0x7fbb1c071500 2024-08-18T21:11:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb037fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:11:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb037fe640 10 monclient: dump: 2024-08-18T21:11:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.412 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.412 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.412 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.412 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.412 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb037fe640 10 monclient: _finish_auth 0 2024-08-18T21:11:54.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb037fe640 10 monclient: _check_auth_tickets 2024-08-18T21:11:54.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:54.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb037fe640 1 -- 172.21.15.5:0/1415194339 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb14019070 con 0x7fbb1c071500 2024-08-18T21:11:54.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb037fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:54.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb037fe640 1 -- 172.21.15.5:0/1415194339 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbb14012e30 con 0x7fbb1c071500 2024-08-18T21:11:54.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb037fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:11:54.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb037fe640 10 monclient: dump: 2024-08-18T21:11:54.413 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.413 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.413 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.413 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.413 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.413 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.413 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.413 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.413 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.413 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.413 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.413 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.413 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.414 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb212c7640 5 monclient: authenticate success, global_id 114228 2024-08-18T21:11:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb212c7640 10 monclient: _renew_subs 2024-08-18T21:11:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb197fa640 4 set_mon_vals no callback set 2024-08-18T21:11:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb212c7640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:11:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb212c7640 1 -- 172.21.15.5:0/1415194339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1c1377e0 con 0x7fbb1c071500 2024-08-18T21:11:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb212c7640 10 monclient: _renew_subs 2024-08-18T21:11:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb212c7640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:11:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb212c7640 1 -- 172.21.15.5:0/1415194339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb1c073ef0 con 0x7fbb1c071500 2024-08-18T21:11:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb212c7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb212c7640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a03e0 0x7fbb1c0a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb212c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb212c7640 1 -- 172.21.15.5:0/1415194339 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fbb1c051140 con 0x7fbb1c0a03e0 2024-08-18T21:11:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1b7fe640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb1c071500 0x7fbb1c1d58e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400d520 tx=0x7fbb1400d9e0 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7fbb1400f040 osd_map(239..239 src has 22..239) 2024-08-18T21:11:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1affd640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a03e0 0x7fbb1c0a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb037fe640 1 -- 172.21.15.5:0/1415194339 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fbb14012800 con 0x7fbb1c071500 2024-08-18T21:11:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1affd640 10 monclient: get_auth_request con 0x7fbb1c0a03e0 auth_method 0 2024-08-18T21:11:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1affd640 1 -- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a03e0 msgr2=0x7fbb1c0a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-18T21:11:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1affd640 1 -- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a03e0 msgr2=0x7fbb1c0a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:11:54.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1affd640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a03e0 0x7fbb1c0a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:11:54.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1affd640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a03e0 0x7fbb1c0a0ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:54.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb037fe640 1 --2- 172.21.15.5:0/1415194339 >> v2:172.21.15.157:6812/631023601 conn(0x7fbb0803bdc0 0x7fbb0803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1a7fc640 1 --2- 172.21.15.5:0/1415194339 >> v2:172.21.15.157:6812/631023601 conn(0x7fbb0803bdc0 0x7fbb0803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.392+0000 7fbb1a7fc640 10 monclient: get_auth_request con 0x7fbb0803bdc0 auth_method 0 2024-08-18T21:11:54.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.396+0000 7fbb1a7fc640 1 --2- 172.21.15.5:0/1415194339 >> v2:172.21.15.157:6812/631023601 conn(0x7fbb0803bdc0 0x7fbb0803e280 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c072160 tx=0x7fbb10008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:54.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.596+0000 7fbb1affd640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a03e0 0x7fbb1c0a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.596+0000 7fbb1affd640 10 monclient: get_auth_request con 0x7fbb1c0a03e0 auth_method 0 2024-08-18T21:11:54.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.596+0000 7fbb1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.596+0000 7fbb1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.596+0000 7fbb1affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:11:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.596+0000 7fbb1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.596+0000 7fbb1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.596+0000 7fbb1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.596+0000 7fbb1affd640 10 monclient(hunting): handle_auth_done global_id 85416 payload 824 2024-08-18T21:11:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.596+0000 7fbb1affd640 1 -- 172.21.15.5:0/1415194339 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb1c06dbf0 con 0x7fbb1c0a03e0 2024-08-18T21:11:54.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.596+0000 7fbb1affd640 1 -- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a03e0 msgr2=0x7fbb1c0a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.596+0000 7fbb1affd640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a03e0 0x7fbb1c0a0ff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c06e050 tx=0x7fbb0c01ae40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.596+0000 7fbb037fe640 1 -- 172.21.15.5:0/1415194339 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbb0c0046c0 con 0x7fbb1c0a03e0 2024-08-18T21:11:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.596+0000 7fbb037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.596+0000 7fbb037fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.596+0000 7fbb037fe640 10 monclient: dump: 2024-08-18T21:11:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.602 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.600+0000 7fbb037fe640 1 -- 172.21.15.5:0/1415194339 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbb0c004250 con 0x7fbb1c0a03e0 2024-08-18T21:11:54.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.600+0000 7fbb037fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:54.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.600+0000 7fbb037fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:54.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.600+0000 7fbb037fe640 1 -- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a03e0 msgr2=0x7fbb1c0a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.600+0000 7fbb037fe640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a03e0 0x7fbb1c0a0ff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c06e050 tx=0x7fbb0c01ae40 comp rx=0 tx=0).stop 2024-08-18T21:11:54.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.600+0000 7fbb037fe640 1 -- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a03e0 msgr2=0x7fbb1c0a0ff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:54.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.600+0000 7fbb037fe640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a03e0 0x7fbb1c0a0ff0 secure :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c06e050 tx=0x7fbb0c01ae40 comp rx=0 tx=0).stop 2024-08-18T21:11:54.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.608+0000 7fbb212c7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:54.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.608+0000 7fbb212c7640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a1530 0x7fbb1c0a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.608+0000 7fbb212c7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.608+0000 7fbb212c7640 1 -- 172.21.15.5:0/1415194339 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fbb1c137d00 con 0x7fbb1c0a1530 2024-08-18T21:11:54.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.608+0000 7fbb1affd640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a1530 0x7fbb1c0a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.608+0000 7fbb1affd640 10 monclient: get_auth_request con 0x7fbb1c0a1530 auth_method 0 2024-08-18T21:11:54.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.608+0000 7fbb1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.608+0000 7fbb1affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.608+0000 7fbb1affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.608+0000 7fbb1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.608+0000 7fbb1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.608+0000 7fbb1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.608+0000 7fbb1affd640 10 monclient(hunting): handle_auth_done global_id 85425 payload 824 2024-08-18T21:11:54.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.608+0000 7fbb1affd640 1 -- 172.21.15.5:0/1415194339 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbb1c1366a0 con 0x7fbb1c0a1530 2024-08-18T21:11:54.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb1affd640 1 -- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a1530 msgr2=0x7fbb1c0a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:54.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb1affd640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a1530 0x7fbb1c0a1940 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c01cea0 tx=0x7fbb0c0193a0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb037fe640 1 -- 172.21.15.5:0/1415194339 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbb0c0c5030 con 0x7fbb1c0a1530 2024-08-18T21:11:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb037fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb037fe640 10 monclient: dump: 2024-08-18T21:11:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.616 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.616 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.616 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.616 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.616 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.616 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.616 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.616 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb037fe640 1 -- 172.21.15.5:0/1415194339 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7fbb0c0a6930 con 0x7fbb1c0a1530 2024-08-18T21:11:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb037fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb037fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb037fe640 1 -- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a1530 msgr2=0x7fbb1c0a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb037fe640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a1530 0x7fbb1c0a1940 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c01cea0 tx=0x7fbb0c0193a0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb037fe640 1 -- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a1530 msgr2=0x7fbb1c0a1940 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb037fe640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbb1c0a1530 0x7fbb1c0a1940 secure :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c01cea0 tx=0x7fbb0c0193a0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.617 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 211441, 2024-08-18T21:11:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:11:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.625 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.625 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.625 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:54.625 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.625 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.625 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.625 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:54.625 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:54.625 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.625 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.625 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.626 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.626 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:54.626 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:54.626 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.626 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.626 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.626 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.626 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:54.626 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.626 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.627 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.627 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:54.627 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.627 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.627 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.627 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:54.627 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:54.627 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.627 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.627 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.627 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:54.627 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:54.628 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.628 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.628 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.628 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.628 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:54.628 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.628 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.628 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.628 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:54.628 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.628 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.628 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.628 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:54.629 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:54.629 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.629 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.629 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.629 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.629 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:54.629 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:54.629 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.629 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.629 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.629 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.629 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:54.629 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.630 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.630 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.630 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:54.630 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.630 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.630 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.630 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:54.630 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:54.630 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.630 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.630 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.631 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:54.631 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:54.631 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.631 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.631 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.631 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:54.631 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.631 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.631 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:54.631 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.631 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.632 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.632 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:54.632 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:54.632 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.632 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.632 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.632 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:54.632 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:54.632 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.633 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.633 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.633 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:54.633 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.633 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.633 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:54.633 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.633 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.633 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.634 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:54.634 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:54.634 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.634 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.634 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.634 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:54.634 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:54.634 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.634 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.634 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.635 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:54.635 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.635 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.635 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:54.635 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.635 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.635 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.635 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:54.635 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:54.635 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.635 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.636 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.636 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:54.636 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:54.637 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.637 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.638 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.638 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:54.638 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.638 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.638 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:54.638 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.638 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.638 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.638 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:54.639 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:54.639 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.639 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.639 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.639 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:54.639 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:54.639 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.639 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.639 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.639 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:54.640 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.640 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.640 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:54.640 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.640 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.640 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.640 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:54.640 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:54.640 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.640 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.641 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.641 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.641 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.641 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:54.641 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:54.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.641 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:54.641 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:54.641 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:54.641 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.641 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:54.641 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:11:54.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.642 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:54.642 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:54.642 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:11:54.642 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.642 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:54.642 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:54.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.642 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:54.642 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:54.642 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:54.642 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.642 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.643 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:54.643 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb212c7640 1 -- 172.21.15.5:0/1415194339 >> v2:172.21.15.157:6812/631023601 conn(0x7fbb0803bdc0 msgr2=0x7fbb0803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb212c7640 1 --2- 172.21.15.5:0/1415194339 >> v2:172.21.15.157:6812/631023601 conn(0x7fbb0803bdc0 0x7fbb0803e280 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c072160 tx=0x7fbb10008040 comp rx=0 tx=0).stop 2024-08-18T21:11:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb212c7640 10 monclient: shutdown 2024-08-18T21:11:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb212c7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb212c7640 1 -- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb1c071500 msgr2=0x7fbb1c1d58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb212c7640 1 --2- 172.21.15.5:0/1415194339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb1c071500 0x7fbb1c1d58e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400d520 tx=0x7fbb1400d9e0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb1b7fe640 1 -- 172.21.15.5:0/1415194339 reap_dead start 2024-08-18T21:11:54.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb1b7fe640 1 -- 172.21.15.5:0/1415194339 reap_dead start 2024-08-18T21:11:54.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb037fe640 1 -- 172.21.15.5:0/1415194339 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(239..239 src has 22..239) ==== 3898+0+0 (unknown 0 0 0) 0x7fbb1400f040 con 0x7fbb1c071500 2024-08-18T21:11:54.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb212c7640 1 -- 172.21.15.5:0/1415194339 shutdown_connections 2024-08-18T21:11:54.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb212c7640 1 -- 172.21.15.5:0/1415194339 >> 172.21.15.5:0/1415194339 conn(0x7fbb1c0688d0 msgr2=0x7fbb1c132cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:54.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb212c7640 1 -- 172.21.15.5:0/1415194339 shutdown_connections 2024-08-18T21:11:54.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.612+0000 7fbb212c7640 1 -- 172.21.15.5:0/1415194339 wait complete. 2024-08-18T21:11:54.645 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:54.645 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:11:54.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:11:54.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 10 monclient: get_monmap_and_config 2024-08-18T21:11:54.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 10 monclient: build_initial_monmap 2024-08-18T21:11:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 10 monclient: monmap: 2024-08-18T21:11:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:54.777621+0000 2024-08-18T21:11:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:54.777621+0000 2024-08-18T21:11:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:54.776 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:54.776 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:54.776 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:54.776 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:54.776 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:54.776 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:54.776 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 1 Processor -- start 2024-08-18T21:11:54.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 1 -- start start 2024-08-18T21:11:54.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 10 monclient: init 2024-08-18T21:11:54.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:54.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 10 monclient: _add_conns ranks=[2,7,3,0,8,10,4,5,1,9,6] 2024-08-18T21:11:54.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fac7809da30 0x7fac7809de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 10 monclient(hunting): picked mon.noname-b con 0x7fac7809da30 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:11:54.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fac780a03e0 0x7fac7809e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 10 monclient(hunting): picked mon.noname-i con 0x7fac780a03e0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:54.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac780a3110 0x7fac781366a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 10 monclient(hunting): picked mon.noname-g con 0x7fac780a3110 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:54.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fac7809e890 con 0x7fac7809da30 2024-08-18T21:11:54.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fac7809f7c0 con 0x7fac780a3110 2024-08-18T21:11:54.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fac7809f4e0 con 0x7fac780a03e0 2024-08-18T21:11:54.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:54.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac801e7640 10 monclient(hunting): authenticate will time out at 1481.791515s 2024-08-18T21:11:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac7df83640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fac7809da30 0x7fac7809de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac7df83640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fac7809da30 0x7fac7809de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34648/0 (socket says 172.21.15.5:34648) 2024-08-18T21:11:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac7df83640 1 -- 172.21.15.5:0/2381941498 learned_addr learned my addr 172.21.15.5:0/2381941498 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac7df83640 10 monclient(hunting): get_auth_request con 0x7fac7809da30 auth_method 0 2024-08-18T21:11:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac7df83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac7df83640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac7df83640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.772+0000 7fac7d782640 1 --2- 172.21.15.5:0/2381941498 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fac780a03e0 0x7fac7809e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7e784640 1 --2- 172.21.15.5:0/2381941498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac780a3110 0x7fac781366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7df83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7df83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7df83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7e784640 10 monclient(hunting): get_auth_request con 0x7fac780a3110 auth_method 0 2024-08-18T21:11:54.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7e784640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7e784640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7e784640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7d782640 10 monclient(hunting): get_auth_request con 0x7fac780a03e0 auth_method 0 2024-08-18T21:11:54.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7d782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7d782640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7d782640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7d782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7d782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7d782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7df83640 10 monclient(hunting): handle_auth_done global_id 114194 payload 274 2024-08-18T21:11:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7df83640 1 -- 172.21.15.5:0/2381941498 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fac780a03e0 msgr2=0x7fac7809e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7df83640 1 --2- 172.21.15.5:0/2381941498 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fac780a03e0 0x7fac7809e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7df83640 1 -- 172.21.15.5:0/2381941498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac780a3110 msgr2=0x7fac781366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7df83640 1 --2- 172.21.15.5:0/2381941498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac780a3110 0x7fac781366a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7df83640 10 monclient: _finish_hunting 0 2024-08-18T21:11:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7df83640 1 monclient: found mon.noname-b 2024-08-18T21:11:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7df83640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7df83640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:11:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7df83640 1 -- 172.21.15.5:0/2381941498 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7809faa0 con 0x7fac7809da30 2024-08-18T21:11:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.776+0000 7fac7e784640 1 --2- 172.21.15.5:0/2381941498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac780a3110 0x7fac781366a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:11:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac7df83640 1 -- 172.21.15.5:0/2381941498 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fac7809da30 msgr2=0x7fac7809de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac7df83640 1 --2- 172.21.15.5:0/2381941498 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fac7809da30 0x7fac7809de10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fac740098a0 tx=0x7fac7401cbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ad2c0f999ae209f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac7cf81640 1 -- 172.21.15.5:0/2381941498 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac740b0070 con 0x7fac7809da30 2024-08-18T21:11:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac7cf81640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac7cf81640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:11:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac7cf81640 10 monclient: dump: 2024-08-18T21:11:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.786 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.786 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.786 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.786 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac7cf81640 10 monclient: _finish_auth 0 2024-08-18T21:11:54.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac7cf81640 10 monclient: _check_auth_tickets 2024-08-18T21:11:54.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac7cf81640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:54.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 5 monclient: authenticate success, global_id 114194 2024-08-18T21:11:54.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac7cf81640 1 -- 172.21.15.5:0/2381941498 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac740aa810 con 0x7fac7809da30 2024-08-18T21:11:54.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:54.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac7cf81640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:54.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:54.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 4 set_mon_vals no callback set 2024-08-18T21:11:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac7cf81640 1 -- 172.21.15.5:0/2381941498 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac740aae30 con 0x7fac7809da30 2024-08-18T21:11:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac7cf81640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac7cf81640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:11:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac7cf81640 10 monclient: dump: 2024-08-18T21:11:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.788 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.788 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.788 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.788 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.788 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.788 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.788 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 10 monclient: shutdown 2024-08-18T21:11:54.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:54.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 1 -- 172.21.15.5:0/2381941498 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fac7809da30 msgr2=0x7fac7809de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 1 --2- 172.21.15.5:0/2381941498 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fac7809da30 0x7fac7809de10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fac740098a0 tx=0x7fac7401cbb0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 1 -- 172.21.15.5:0/2381941498 shutdown_connections 2024-08-18T21:11:54.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 1 --2- 172.21.15.5:0/2381941498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac780a3110 0x7fac781366a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 1 --2- 172.21.15.5:0/2381941498 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fac780a03e0 0x7fac7809e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 1 --2- 172.21.15.5:0/2381941498 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fac7809da30 0x7fac7809de10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 1 -- 172.21.15.5:0/2381941498 >> 172.21.15.5:0/2381941498 conn(0x7fac780688d0 msgr2=0x7fac78068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 1 -- 172.21.15.5:0/2381941498 shutdown_connections 2024-08-18T21:11:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 1 -- 172.21.15.5:0/2381941498 wait complete. 2024-08-18T21:11:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 10 monclient: build_initial_monmap 2024-08-18T21:11:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 10 monclient: monmap: 2024-08-18T21:11:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:54.790 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 1 Processor -- start 2024-08-18T21:11:54.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 1 -- start start 2024-08-18T21:11:54.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.780+0000 7fac801e7640 10 monclient: init 2024-08-18T21:11:54.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:54.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 10 monclient: _add_conns ranks=[5,6,4,7,1,0,2,8,3] 2024-08-18T21:11:54.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fac7809da30 0x7fac781cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 10 monclient(hunting): picked mon.noname-h con 0x7fac7809da30 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:54.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fac780a3110 0x7fac781cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 10 monclient(hunting): picked mon.noname-d con 0x7fac780a3110 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:54.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fac781d0330 0x7fac780706c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 10 monclient(hunting): picked mon.noname-c con 0x7fac781d0330 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:54.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fac7806cce0 con 0x7fac781d0330 2024-08-18T21:11:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fac7806cb60 con 0x7fac7809da30 2024-08-18T21:11:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fac7806ce60 con 0x7fac780a3110 2024-08-18T21:11:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 10 monclient(hunting): authenticate will time out at 1481.800260s 2024-08-18T21:11:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7e784640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fac781d0330 0x7fac780706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fac780a3110 0x7fac781cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7e784640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fac781d0330 0x7fac780706c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:37924/0 (socket says 172.21.15.5:37924) 2024-08-18T21:11:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fac780a3110 0x7fac781cfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:37870/0 (socket says 172.21.15.5:37870) 2024-08-18T21:11:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7e784640 1 -- 172.21.15.5:0/3199658023 learned_addr learned my addr 172.21.15.5:0/3199658023 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7e784640 10 monclient(hunting): get_auth_request con 0x7fac781d0330 auth_method 0 2024-08-18T21:11:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7e784640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7e784640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7e784640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 10 monclient(hunting): get_auth_request con 0x7fac780a3110 auth_method 0 2024-08-18T21:11:54.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7e784640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7e784640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7e784640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7df83640 1 --2- 172.21.15.5:0/3199658023 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fac7809da30 0x7fac781cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7df83640 10 monclient(hunting): get_auth_request con 0x7fac7809da30 auth_method 0 2024-08-18T21:11:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7df83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7df83640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7df83640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 10 monclient(hunting): handle_auth_done global_id 85434 payload 824 2024-08-18T21:11:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 1 -- 172.21.15.5:0/3199658023 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fac7809da30 msgr2=0x7fac781cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 1 --2- 172.21.15.5:0/3199658023 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fac7809da30 0x7fac781cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 1 -- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fac781d0330 msgr2=0x7fac780706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 1 --2- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fac781d0330 0x7fac780706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 10 monclient: _finish_hunting 0 2024-08-18T21:11:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 1 monclient: found mon.noname-d 2024-08-18T21:11:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:11:54.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 1 -- 172.21.15.5:0/3199658023 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac78137850 con 0x7fac780a3110 2024-08-18T21:11:54.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 1 -- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fac780a3110 msgr2=0x7fac781cfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:54.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac7d782640 1 --2- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fac780a3110 0x7fac781cfdf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fac6800e820 tx=0x7fac6800ece0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:54.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac6e7fc640 1 -- 172.21.15.5:0/3199658023 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac68017070 con 0x7fac780a3110 2024-08-18T21:11:54.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac6e7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:11:54.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac6e7fc640 10 monclient: dump: 2024-08-18T21:11:54.800 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.800 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.800 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.800 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.800 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.800 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.800 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.800 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.801 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.801 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.801 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.801 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.801 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.801 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.801 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.801 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac6e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:11:54.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac6e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:11:54.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac6e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:54.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 5 monclient: authenticate success, global_id 85434 2024-08-18T21:11:54.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac6e7fc640 1 -- 172.21.15.5:0/3199658023 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac68013470 con 0x7fac780a3110 2024-08-18T21:11:54.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac6e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:54.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac6e7fc640 1 -- 172.21.15.5:0/3199658023 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac68013a90 con 0x7fac780a3110 2024-08-18T21:11:54.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac6e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:11:54.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac6ffff640 4 set_mon_vals no callback set 2024-08-18T21:11:54.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac6e7fc640 10 monclient: dump: 2024-08-18T21:11:54.802 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.802 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.802 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.802 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.802 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.802 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.802 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.803 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 10 monclient: _renew_subs 2024-08-18T21:11:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.784+0000 7fac801e7640 1 -- 172.21.15.5:0/3199658023 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac780a8ab0 con 0x7fac780a3110 2024-08-18T21:11:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac801e7640 10 monclient: _renew_subs 2024-08-18T21:11:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac801e7640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:11:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac801e7640 1 -- 172.21.15.5:0/3199658023 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fac78077640 con 0x7fac780a3110 2024-08-18T21:11:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac801e7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac801e7640 1 --2- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fac780a03e0 0x7fac78070c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac801e7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac801e7640 1 -- 172.21.15.5:0/3199658023 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fac7813d380 con 0x7fac780a03e0 2024-08-18T21:11:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac7df83640 1 --2- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fac780a03e0 0x7fac78070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac7df83640 10 monclient: get_auth_request con 0x7fac780a03e0 auth_method 0 2024-08-18T21:11:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac7df83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac7df83640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac7df83640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac6e7fc640 1 -- 172.21.15.5:0/3199658023 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fac68013cb0 con 0x7fac780a3110 2024-08-18T21:11:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac7df83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac7df83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac7df83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac7df83640 10 monclient(hunting): handle_auth_done global_id 114281 payload 824 2024-08-18T21:11:54.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac7df83640 1 -- 172.21.15.5:0/3199658023 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac78072750 con 0x7fac780a03e0 2024-08-18T21:11:54.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac6e7fc640 1 --2- 172.21.15.5:0/3199658023 >> v2:172.21.15.157:6812/631023601 conn(0x7fac5c03bdc0 0x7fac5c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac6e7fc640 1 -- 172.21.15.5:0/3199658023 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(239..239 src has 22..239) ==== 3898+0+0 (secure 0 0 0) 0x7fac6800f040 con 0x7fac780a3110 2024-08-18T21:11:54.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac7e784640 1 --2- 172.21.15.5:0/3199658023 >> v2:172.21.15.157:6812/631023601 conn(0x7fac5c03bdc0 0x7fac5c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac7e784640 10 monclient: get_auth_request con 0x7fac5c03bdc0 auth_method 0 2024-08-18T21:11:54.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac7df83640 1 -- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fac780a03e0 msgr2=0x7fac78070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:54.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac7df83640 1 --2- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fac780a03e0 0x7fac78070c00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fac74009870 tx=0x7fac74018ef0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:54.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac6e7fc640 1 -- 172.21.15.5:0/3199658023 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac740b0070 con 0x7fac780a03e0 2024-08-18T21:11:54.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac6e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:54.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac6e7fc640 10 monclient: dump: 2024-08-18T21:11:54.806 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.806 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.806 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.806 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.806 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.806 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.806 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.806 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.806 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.806 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.806 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.806 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.807 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.807 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.807 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.807 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac6e7fc640 1 -- 172.21.15.5:0/3199658023 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fac740bb070 con 0x7fac780a03e0 2024-08-18T21:11:54.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac6e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:54.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac6e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:54.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac6e7fc640 1 -- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fac780a03e0 msgr2=0x7fac78070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.788+0000 7fac6e7fc640 1 --2- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fac780a03e0 0x7fac78070c00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fac74009870 tx=0x7fac74018ef0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.792+0000 7fac6e7fc640 1 -- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fac780a03e0 msgr2=0x7fac78070c00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:54.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.792+0000 7fac6e7fc640 1 --2- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fac780a03e0 0x7fac78070c00 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fac74009870 tx=0x7fac74018ef0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.792+0000 7fac7e784640 1 --2- 172.21.15.5:0/3199658023 >> v2:172.21.15.157:6812/631023601 conn(0x7fac5c03bdc0 0x7fac5c03e280 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fac70007330 tx=0x7fac70009810 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.796+0000 7fac801e7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.796+0000 7fac801e7640 1 --2- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fac78071140 0x7fac78071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.796+0000 7fac801e7640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.796+0000 7fac801e7640 1 -- 172.21.15.5:0/3199658023 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fac78051140 con 0x7fac78071140 2024-08-18T21:11:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.796+0000 7fac7df83640 1 --2- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fac78071140 0x7fac78071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.796+0000 7fac7df83640 10 monclient: get_auth_request con 0x7fac78071140 auth_method 0 2024-08-18T21:11:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.796+0000 7fac7df83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.796+0000 7fac7df83640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.796+0000 7fac7df83640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.796+0000 7fac7df83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.796+0000 7fac7df83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.796+0000 7fac7df83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.796+0000 7fac7df83640 10 monclient(hunting): handle_auth_done global_id 114290 payload 824 2024-08-18T21:11:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.796+0000 7fac7df83640 1 -- 172.21.15.5:0/3199658023 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fac781d0710 con 0x7fac78071140 2024-08-18T21:11:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac7df83640 1 -- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fac78071140 msgr2=0x7fac78071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac7df83640 1 --2- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fac78071140 0x7fac78071550 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fac740098a0 tx=0x7fac740a6000 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac6e7fc640 1 -- 172.21.15.5:0/3199658023 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac740c0e40 con 0x7fac78071140 2024-08-18T21:11:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac6e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac6e7fc640 10 monclient: dump: 2024-08-18T21:11:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.812 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac6e7fc640 1 -- 172.21.15.5:0/3199658023 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7fac740b1040 con 0x7fac78071140 2024-08-18T21:11:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac6e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac6e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac6e7fc640 1 -- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fac78071140 msgr2=0x7fac78071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac6e7fc640 1 --2- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fac78071140 0x7fac78071550 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fac740098a0 tx=0x7fac740a6000 comp rx=0 tx=0).stop 2024-08-18T21:11:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac6e7fc640 1 -- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fac78071140 msgr2=0x7fac78071550 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac6e7fc640 1 --2- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fac78071140 0x7fac78071550 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fac740098a0 tx=0x7fac740a6000 comp rx=0 tx=0).stop 2024-08-18T21:11:54.813 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:54.813 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:54.813 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:54.813 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:54.813 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:54.813 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 19967, 2024-08-18T21:11:54.813 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:54.813 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:54.813 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:54.813 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:54.813 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:54.813 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:11:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:54.818 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:54.818 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:54.818 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:54.818 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:54.818 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:54.818 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:54.818 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:54.818 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:54.818 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:54.818 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:54.818 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:54.818 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:54.818 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:54.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.819 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:54.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.819 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:54.819 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:54.819 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.819 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.819 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.819 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:54.819 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.819 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.820 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:54.820 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.820 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.820 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.820 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:54.820 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:54.820 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.820 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.820 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.820 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:54.821 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:54.821 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.821 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:54.821 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.821 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:54.821 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.821 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.821 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.822 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:54.822 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:54.822 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.822 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.822 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.822 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:54.822 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:54.822 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.822 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.823 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.823 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:54.823 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.823 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.823 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:54.823 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.823 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.823 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.823 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:54.823 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:54.824 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.824 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.824 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.824 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:54.824 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:54.824 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.824 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.824 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.824 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:54.824 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.825 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.825 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:54.825 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.825 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.825 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.825 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:54.825 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:54.825 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.825 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.825 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.826 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:54.826 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:54.826 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.826 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.826 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.826 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:54.826 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.826 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.826 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:54.827 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.827 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.827 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.827 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:54.827 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:54.827 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.827 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.827 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.827 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:54.827 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:54.828 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.828 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.828 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.828 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:54.828 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.828 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.828 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:54.828 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.828 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.828 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.829 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:54.829 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:54.829 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.829 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.829 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.829 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:54.829 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:54.829 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.829 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.829 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.830 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:54.830 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.830 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.830 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.830 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:54.830 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.830 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.830 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.830 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:54.830 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:54.831 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.831 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.831 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.831 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:54.831 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:54.831 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.831 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.831 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.831 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:54.831 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.832 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.832 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.832 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:54.832 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.832 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.832 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.832 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:54.832 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:54.832 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.832 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.832 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.833 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:54.833 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:54.833 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:54.833 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:54.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.833 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:54.833 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:54.833 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.833 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:54.833 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:54.834 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:54.834 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.834 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.834 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:54.834 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:54.834 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:54.834 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:54.834 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:54.834 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.834 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.834 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:54.835 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:54.835 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.835 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:54.835 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:54.835 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:54.835 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.835 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:54.835 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:54.835 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:54.835 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:54.835 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:54.835 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:54.835 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:54.836 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:54.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:54.836 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:54.836 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:54.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac801e7640 1 -- 172.21.15.5:0/3199658023 >> v2:172.21.15.157:6812/631023601 conn(0x7fac5c03bdc0 msgr2=0x7fac5c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac801e7640 1 --2- 172.21.15.5:0/3199658023 >> v2:172.21.15.157:6812/631023601 conn(0x7fac5c03bdc0 0x7fac5c03e280 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fac70007330 tx=0x7fac70009810 comp rx=0 tx=0).stop 2024-08-18T21:11:54.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac801e7640 10 monclient: shutdown 2024-08-18T21:11:54.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac801e7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:54.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac801e7640 1 -- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fac780a3110 msgr2=0x7fac781cfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac801e7640 1 --2- 172.21.15.5:0/3199658023 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fac780a3110 0x7fac781cfdf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fac6800e820 tx=0x7fac6800ece0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac7e784640 1 -- 172.21.15.5:0/3199658023 reap_dead start 2024-08-18T21:11:54.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac7e784640 1 -- 172.21.15.5:0/3199658023 reap_dead start 2024-08-18T21:11:54.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac801e7640 1 -- 172.21.15.5:0/3199658023 shutdown_connections 2024-08-18T21:11:54.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac801e7640 1 -- 172.21.15.5:0/3199658023 >> 172.21.15.5:0/3199658023 conn(0x7fac780688d0 msgr2=0x7fac780a7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:54.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac801e7640 1 -- 172.21.15.5:0/3199658023 shutdown_connections 2024-08-18T21:11:54.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.800+0000 7fac801e7640 1 -- 172.21.15.5:0/3199658023 wait complete. 2024-08-18T21:11:54.838 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:54.842 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:11:54.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:11:54.858 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.852+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.858 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.852+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2125426621}) 2024-08-18T21:11:54.858 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.852+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2475464509}) 2024-08-18T21:11:54.858 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.852+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.858 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.852+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2125426621}) 2024-08-18T21:11:54.858 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.852+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4246419061}) 2024-08-18T21:11:54.858 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.852+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.858 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.852+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2125426621}) 2024-08-18T21:11:54.858 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.852+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=108305829}) 2024-08-18T21:11:54.858 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.852+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.859 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.856+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2125426621}) 2024-08-18T21:11:54.859 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.856+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3348742131}) 2024-08-18T21:11:54.859 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.856+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.859 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.856+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2125426621}) 2024-08-18T21:11:54.859 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.856+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2795531007}) 2024-08-18T21:11:54.859 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.856+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.859 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.856+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2125426621}) 2024-08-18T21:11:54.859 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.856+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=680303395}) 2024-08-18T21:11:54.859 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.856+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.859 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.856+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2125426621}) 2024-08-18T21:11:54.859 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.856+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2490816574}) 2024-08-18T21:11:54.859 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.856+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.859 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.856+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2125426621}) 2024-08-18T21:11:54.859 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.856+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=859685344}) 2024-08-18T21:11:54.868 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.868 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802849502}) 2024-08-18T21:11:54.868 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1653985913}) 2024-08-18T21:11:54.868 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.868 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802849502}) 2024-08-18T21:11:54.868 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2636318760}) 2024-08-18T21:11:54.868 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.868 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802849502}) 2024-08-18T21:11:54.868 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2229519694}) 2024-08-18T21:11:54.869 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.869 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802849502}) 2024-08-18T21:11:54.869 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=515127119}) 2024-08-18T21:11:54.869 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.869 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802849502}) 2024-08-18T21:11:54.869 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3171896739}) 2024-08-18T21:11:54.869 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.869 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802849502}) 2024-08-18T21:11:54.869 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4050863025}) 2024-08-18T21:11:54.869 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.869 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802849502}) 2024-08-18T21:11:54.869 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4069241359}) 2024-08-18T21:11:54.869 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.870 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802849502}) 2024-08-18T21:11:54.870 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.864+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3792521214}) 2024-08-18T21:11:54.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254336318}) 2024-08-18T21:11:54.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3639164342}) 2024-08-18T21:11:54.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254336318}) 2024-08-18T21:11:54.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3549086696}) 2024-08-18T21:11:54.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254336318}) 2024-08-18T21:11:54.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3915023850}) 2024-08-18T21:11:54.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254336318}) 2024-08-18T21:11:54.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3717995359}) 2024-08-18T21:11:54.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254336318}) 2024-08-18T21:11:54.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=294973317}) 2024-08-18T21:11:54.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254336318}) 2024-08-18T21:11:54.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=584741696}) 2024-08-18T21:11:54.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254336318}) 2024-08-18T21:11:54.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=184866651}) 2024-08-18T21:11:54.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254336318}) 2024-08-18T21:11:54.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.892+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=947524441}) 2024-08-18T21:11:54.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3051677441}) 2024-08-18T21:11:54.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=642836184}) 2024-08-18T21:11:54.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3051677441}) 2024-08-18T21:11:54.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3937503637}) 2024-08-18T21:11:54.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3051677441}) 2024-08-18T21:11:54.904 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3877179097}) 2024-08-18T21:11:54.905 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.905 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3051677441}) 2024-08-18T21:11:54.905 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=381358698}) 2024-08-18T21:11:54.905 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.905 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3051677441}) 2024-08-18T21:11:54.905 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=619331777}) 2024-08-18T21:11:54.905 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.905 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3051677441}) 2024-08-18T21:11:54.905 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2459964058}) 2024-08-18T21:11:54.905 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.905 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3051677441}) 2024-08-18T21:11:54.905 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=42082735}) 2024-08-18T21:11:54.905 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:54.905 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3051677441}) 2024-08-18T21:11:54.905 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:54.900+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=414940523}) 2024-08-18T21:11:54.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 10 monclient: get_monmap_and_config 2024-08-18T21:11:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 10 monclient: build_initial_monmap 2024-08-18T21:11:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 10 monclient: monmap: 2024-08-18T21:11:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:54.985547+0000 2024-08-18T21:11:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:54.985547+0000 2024-08-18T21:11:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:54.984 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:54.984 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:54.984 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:54.984 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:54.984 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:54.984 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:54.984 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 1 Processor -- start 2024-08-18T21:11:54.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 1 -- start start 2024-08-18T21:11:54.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 10 monclient: init 2024-08-18T21:11:54.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 10 monclient: _add_conns ranks=[4,9,5,6,10,0,1,3,2,8,7] 2024-08-18T21:11:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f71880a6bd0 0x7f71880a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 10 monclient(hunting): picked mon.noname-c con 0x7f71880a6bd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f718809f080 0x7f71880a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 10 monclient(hunting): picked mon.noname-a con 0x7f718809f080 addr v2:172.21.15.5:3300/0 2024-08-18T21:11:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7188139990 0x7f7188139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 10 monclient(hunting): picked mon.noname-h con 0x7f7188139990 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f718809e4c0 con 0x7f718809f080 2024-08-18T21:11:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f718806f930 con 0x7f71880a6bd0 2024-08-18T21:11:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f71880a7a30 con 0x7f7188139990 2024-08-18T21:11:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718fac2640 10 monclient(hunting): authenticate will time out at 1481.998711s 2024-08-18T21:11:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d05d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f718809f080 0x7f71880a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f71880a6bd0 0x7f71880a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f71880a6bd0 0x7f71880a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:37926/0 (socket says 172.21.15.5:37926) 2024-08-18T21:11:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 1 -- 172.21.15.5:0/3597690974 learned_addr learned my addr 172.21.15.5:0/3597690974 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d05d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f718809f080 0x7f71880a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32912/0 (socket says 172.21.15.5:32912) 2024-08-18T21:11:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 10 monclient(hunting): get_auth_request con 0x7f71880a6bd0 auth_method 0 2024-08-18T21:11:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d05d640 10 monclient(hunting): get_auth_request con 0x7f718809f080 auth_method 0 2024-08-18T21:11:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d05d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d05d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d05d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d05d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d05d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d05d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718e05f640 1 --2- 172.21.15.5:0/3597690974 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7188139990 0x7f7188139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718e05f640 10 monclient(hunting): get_auth_request con 0x7f7188139990 auth_method 0 2024-08-18T21:11:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718e05f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718e05f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718e05f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 10 monclient(hunting): handle_auth_done global_id 114223 payload 274 2024-08-18T21:11:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 1 -- 172.21.15.5:0/3597690974 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7188139990 msgr2=0x7f7188139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 1 --2- 172.21.15.5:0/3597690974 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7188139990 0x7f7188139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 1 -- 172.21.15.5:0/3597690974 >> v2:172.21.15.5:3300/0 conn(0x7f718809f080 msgr2=0x7f71880a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 1 --2- 172.21.15.5:0/3597690974 >> v2:172.21.15.5:3300/0 conn(0x7f718809f080 0x7f71880a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 10 monclient: _finish_hunting 0 2024-08-18T21:11:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 1 monclient: found mon.noname-c 2024-08-18T21:11:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:11:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d85e640 1 -- 172.21.15.5:0/3597690974 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71880a7fb0 con 0x7f71880a6bd0 2024-08-18T21:11:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.980+0000 7f718d05d640 1 --2- 172.21.15.5:0/3597690974 >> v2:172.21.15.5:3300/0 conn(0x7f718809f080 0x7f71880a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718d85e640 1 -- 172.21.15.5:0/3597690974 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f71880a6bd0 msgr2=0x7f71880a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718d85e640 1 --2- 172.21.15.5:0/3597690974 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f71880a6bd0 0x7f71880a6fb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7180009870 tx=0x7f718001c420 comp rx=0 tx=0).ready entity=mon.4 client_cookie=22e85576fae5409 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718c85c640 1 -- 172.21.15.5:0/3597690974 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71800b0070 con 0x7f71880a6bd0 2024-08-18T21:11:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718c85c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718c85c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:11:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718c85c640 10 monclient: dump: 2024-08-18T21:11:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.995 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718c85c640 10 monclient: _finish_auth 0 2024-08-18T21:11:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718c85c640 10 monclient: _check_auth_tickets 2024-08-18T21:11:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718c85c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718fac2640 5 monclient: authenticate success, global_id 114223 2024-08-18T21:11:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718c85c640 1 -- 172.21.15.5:0/3597690974 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71800aa810 con 0x7f71880a6bd0 2024-08-18T21:11:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718fac2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718c85c640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718fac2640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718fac2640 4 set_mon_vals no callback set 2024-08-18T21:11:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718c85c640 1 -- 172.21.15.5:0/3597690974 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71800a9300 con 0x7f71880a6bd0 2024-08-18T21:11:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718c85c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718c85c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:11:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.984+0000 7f718c85c640 10 monclient: dump: 2024-08-18T21:11:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:54.997 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 10 monclient: shutdown 2024-08-18T21:11:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 -- 172.21.15.5:0/3597690974 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f71880a6bd0 msgr2=0x7f71880a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 --2- 172.21.15.5:0/3597690974 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f71880a6bd0 0x7f71880a6fb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7180009870 tx=0x7f718001c420 comp rx=0 tx=0).stop 2024-08-18T21:11:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 -- 172.21.15.5:0/3597690974 shutdown_connections 2024-08-18T21:11:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 --2- 172.21.15.5:0/3597690974 >> v2:172.21.15.5:3300/0 conn(0x7f718809f080 0x7f71880a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 --2- 172.21.15.5:0/3597690974 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7188139990 0x7f7188139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 --2- 172.21.15.5:0/3597690974 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f71880a6bd0 0x7f71880a6fb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 -- 172.21.15.5:0/3597690974 >> 172.21.15.5:0/3597690974 conn(0x7f7188068700 msgr2=0x7f7188068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 -- 172.21.15.5:0/3597690974 shutdown_connections 2024-08-18T21:11:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 -- 172.21.15.5:0/3597690974 wait complete. 2024-08-18T21:11:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 10 monclient: build_initial_monmap 2024-08-18T21:11:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 10 monclient: monmap: 2024-08-18T21:11:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:54.999 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 Processor -- start 2024-08-18T21:11:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 -- start start 2024-08-18T21:11:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 10 monclient: init 2024-08-18T21:11:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 10 monclient: _add_conns ranks=[1,8,3,4,6,2,5,7,0] 2024-08-18T21:11:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718809f080 0x7f71881d1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 10 monclient(hunting): picked mon.noname-f con 0x7f718809f080 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:11:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71880a6bd0 0x7f7188138c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 10 monclient(hunting): picked mon.noname-e con 0x7f71880a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7188139990 0x7f71881391b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 10 monclient(hunting): picked mon.noname-g con 0x7f7188139990 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f71880a89f0 con 0x7f718809f080 2024-08-18T21:11:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f71880a7ce0 con 0x7f7188139990 2024-08-18T21:11:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f7188143610 con 0x7f71880a6bd0 2024-08-18T21:11:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718fac2640 10 monclient(hunting): authenticate will time out at 1482.005818s 2024-08-18T21:11:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71880a6bd0 0x7f7188138c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71880a6bd0 0x7f7188138c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:55550/0 (socket says 172.21.15.5:55550) 2024-08-18T21:11:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 1 -- 172.21.15.5:0/2744904274 learned_addr learned my addr 172.21.15.5:0/2744904274 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 10 monclient(hunting): get_auth_request con 0x7f71880a6bd0 auth_method 0 2024-08-18T21:11:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d85e640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718809f080 0x7f71881d1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d85e640 10 monclient(hunting): get_auth_request con 0x7f718809f080 auth_method 0 2024-08-18T21:11:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d85e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d85e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d85e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718e05f640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7188139990 0x7f71881391b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 10 monclient(hunting): handle_auth_done global_id 114299 payload 824 2024-08-18T21:11:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 1 -- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7188139990 msgr2=0x7f71881391b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7188139990 0x7f71881391b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 1 -- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718809f080 msgr2=0x7f71881d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718809f080 0x7f71881d1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 10 monclient: _finish_hunting 0 2024-08-18T21:11:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 1 monclient: found mon.noname-e 2024-08-18T21:11:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:11:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.988+0000 7f718d05d640 1 -- 172.21.15.5:0/2744904274 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71880ab510 con 0x7f71880a6bd0 2024-08-18T21:11:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718d05d640 1 -- 172.21.15.5:0/2744904274 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71880a6bd0 msgr2=0x7f7188138c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718d05d640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71880a6bd0 0x7f7188138c70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f717c00ebe0 tx=0x7f717c00c520 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f71867fc640 1 -- 172.21.15.5:0/2744904274 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f717c017070 con 0x7f71880a6bd0 2024-08-18T21:11:55.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f71867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f71867fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:11:55.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f71867fc640 10 monclient: dump: 2024-08-18T21:11:55.007 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.007 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.007 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.007 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.007 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.007 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.007 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.007 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.007 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.007 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.007 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.007 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.007 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.008 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.008 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.008 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f71867fc640 10 monclient: _finish_auth 0 2024-08-18T21:11:55.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f71867fc640 10 monclient: _check_auth_tickets 2024-08-18T21:11:55.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f71867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:55.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f71867fc640 1 -- 172.21.15.5:0/2744904274 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f717c00ce40 con 0x7f71880a6bd0 2024-08-18T21:11:55.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f71867fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:55.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f71867fc640 1 -- 172.21.15.5:0/2744904274 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f717c013d50 con 0x7f71880a6bd0 2024-08-18T21:11:55.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718fac2640 5 monclient: authenticate success, global_id 114299 2024-08-18T21:11:55.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718fac2640 10 monclient: _renew_subs 2024-08-18T21:11:55.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718fac2640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:55.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718fac2640 1 -- 172.21.15.5:0/2744904274 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71880aafe0 con 0x7f71880a6bd0 2024-08-18T21:11:55.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f71867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f7187fff640 4 set_mon_vals no callback set 2024-08-18T21:11:55.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f71867fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:55.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f71867fc640 10 monclient: dump: 2024-08-18T21:11:55.009 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.009 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.009 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.009 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.009 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.009 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.009 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.009 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.009 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.009 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.009 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.010 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718fac2640 10 monclient: _renew_subs 2024-08-18T21:11:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718fac2640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718fac2640 1 -- 172.21.15.5:0/2744904274 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f7188124630 con 0x7f71880a6bd0 2024-08-18T21:11:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718fac2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718fac2640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718813ddd0 0x7f718813e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718fac2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718fac2640 1 -- 172.21.15.5:0/2744904274 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7188051140 con 0x7f718813ddd0 2024-08-18T21:11:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f71867fc640 1 -- 172.21.15.5:0/2744904274 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f717c01a070 con 0x7f71880a6bd0 2024-08-18T21:11:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718d85e640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718813ddd0 0x7f718813e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718d85e640 10 monclient: get_auth_request con 0x7f718813ddd0 auth_method 0 2024-08-18T21:11:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718d85e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718d85e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718d85e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f71867fc640 1 --2- 172.21.15.5:0/2744904274 >> v2:172.21.15.157:6812/631023601 conn(0x7f717403bdc0 0x7f717403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f71867fc640 1 -- 172.21.15.5:0/2744904274 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(239..239 src has 22..239) ==== 3898+0+0 (secure 0 0 0) 0x7f717c00f040 con 0x7f71880a6bd0 2024-08-18T21:11:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718d85e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718d85e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718d85e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718e05f640 1 --2- 172.21.15.5:0/2744904274 >> v2:172.21.15.157:6812/631023601 conn(0x7f717403bdc0 0x7f717403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718e05f640 10 monclient: get_auth_request con 0x7f717403bdc0 auth_method 0 2024-08-18T21:11:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718d85e640 10 monclient(hunting): handle_auth_done global_id 104626 payload 824 2024-08-18T21:11:55.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.992+0000 7f718d85e640 1 -- 172.21.15.5:0/2744904274 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7188139e10 con 0x7f718813ddd0 2024-08-18T21:11:55.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.996+0000 7f718d85e640 1 -- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718813ddd0 msgr2=0x7f718813e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.996+0000 7f718d85e640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718813ddd0 0x7f718813e1b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f71800ad000 tx=0x7f71800191c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.996+0000 7f718e05f640 1 --2- 172.21.15.5:0/2744904274 >> v2:172.21.15.157:6812/631023601 conn(0x7f717403bdc0 0x7f717403e280 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7178009d90 tx=0x7f717800b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.996+0000 7f71867fc640 1 -- 172.21.15.5:0/2744904274 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71800b9020 con 0x7f718813ddd0 2024-08-18T21:11:55.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.996+0000 7f71867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.996+0000 7f71867fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:11:55.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.996+0000 7f71867fc640 10 monclient: dump: 2024-08-18T21:11:55.012 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.012 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.012 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.012 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.012 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.012 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.013 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.013 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.013 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.013 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.013 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.013 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.013 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.013 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.013 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.013 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.996+0000 7f71867fc640 1 -- 172.21.15.5:0/2744904274 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f71800b1040 con 0x7f718813ddd0 2024-08-18T21:11:55.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.996+0000 7f71867fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:55.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.996+0000 7f71867fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.996+0000 7f71867fc640 1 -- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718813ddd0 msgr2=0x7f718813e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.996+0000 7f71867fc640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718813ddd0 0x7f718813e1b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f71800ad000 tx=0x7f71800191c0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.996+0000 7f71867fc640 1 -- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718813ddd0 msgr2=0x7f718813e1b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:54.996+0000 7f71867fc640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718813ddd0 0x7f718813e1b0 secure :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f71800ad000 tx=0x7f71800191c0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.004+0000 7f718fac2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.004+0000 7f718fac2640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718813e6f0 0x7f71880a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.004+0000 7f718fac2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.004+0000 7f718fac2640 1 -- 172.21.15.5:0/2744904274 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7188122e30 con 0x7f718813e6f0 2024-08-18T21:11:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.004+0000 7f718d85e640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718813e6f0 0x7f71880a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.004+0000 7f718d85e640 10 monclient: get_auth_request con 0x7f718813e6f0 auth_method 0 2024-08-18T21:11:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.004+0000 7f718d85e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.004+0000 7f718d85e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.004+0000 7f718d85e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.004+0000 7f718d85e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.004+0000 7f718d85e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.004+0000 7f718d85e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.004+0000 7f718d85e640 10 monclient(hunting): handle_auth_done global_id 104635 payload 824 2024-08-18T21:11:55.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.004+0000 7f718d85e640 1 -- 172.21.15.5:0/2744904274 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f71880746d0 con 0x7f718813e6f0 2024-08-18T21:11:55.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.004+0000 7f718d85e640 1 -- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718813e6f0 msgr2=0x7f71880a0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.004+0000 7f718d85e640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718813e6f0 0x7f71880a0d60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7180009870 tx=0x7f71800a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f71867fc640 1 -- 172.21.15.5:0/2744904274 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71800b9040 con 0x7f718813e6f0 2024-08-18T21:11:55.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f71867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f71867fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:11:55.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f71867fc640 10 monclient: dump: 2024-08-18T21:11:55.016 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.016 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.016 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.017 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f71867fc640 1 -- 172.21.15.5:0/2744904274 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f71800c0280 con 0x7f718813e6f0 2024-08-18T21:11:55.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f71867fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:55.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f71867fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:55.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f71867fc640 1 -- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718813e6f0 msgr2=0x7f71880a0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f71867fc640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718813e6f0 0x7f71880a0d60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7180009870 tx=0x7f71800a8000 comp rx=0 tx=0).stop 2024-08-18T21:11:55.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f71867fc640 1 -- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718813e6f0 msgr2=0x7f71880a0d60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:55.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f71867fc640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f718813e6f0 0x7f71880a0d60 secure :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7180009870 tx=0x7f71800a8000 comp rx=0 tx=0).stop 2024-08-18T21:11:55.018 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:55.018 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:55.019 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:55.019 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:55.019 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:55.019 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 79498, 2024-08-18T21:11:55.019 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:55.019 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:55.019 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:55.019 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:55.019 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:55.019 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:55.019 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:55.019 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:55.019 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:55.019 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:55.020 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.020 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:11:55.020 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:55.020 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:55.020 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:55.020 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:55.020 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:55.020 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:55.020 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:55.020 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:55.020 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:55.020 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:55.020 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:55.021 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:55.021 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:55.021 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:55.021 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.021 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:55.021 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:55.021 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:55.021 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:55.021 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:55.021 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:55.021 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:55.021 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:55.021 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:55.022 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:55.022 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:55.022 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:55.022 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:55.022 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.022 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:55.022 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:55.022 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:55.022 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:55.022 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:55.022 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:55.022 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:55.022 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:55.023 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:55.023 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:55.023 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:55.023 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:55.023 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:55.023 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:55.023 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:55.023 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:55.023 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:55.023 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:55.023 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:55.023 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:55.023 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:55.024 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:55.024 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:55.024 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:55.024 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:55.024 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:55.024 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:55.024 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:55.024 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.024 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:55.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.024 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:55.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.024 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:55.025 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:55.025 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:55.025 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:55.025 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.025 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.025 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.026 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:55.026 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:55.026 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.026 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.026 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.026 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:55.026 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:55.026 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.026 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.026 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:55.027 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:55.027 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.027 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.027 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:55.027 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:55.027 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.028 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.028 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.028 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:55.028 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:55.028 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.028 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.028 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.028 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:55.028 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.028 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.029 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:55.029 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.029 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.029 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.029 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:55.029 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:55.029 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.029 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.029 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.029 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:55.030 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:55.030 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.030 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.030 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:55.030 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.030 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:55.030 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.030 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.030 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:55.031 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:55.031 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.031 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.031 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.031 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:55.031 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:55.031 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.031 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.032 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:55.032 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.032 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:55.032 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.032 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.032 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.032 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:55.032 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:55.032 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.032 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.033 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.033 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:55.033 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:55.033 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.033 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.033 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.033 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:55.033 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.033 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.034 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:55.034 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.034 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.034 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.034 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:55.034 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:55.034 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.034 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.034 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.034 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:55.034 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:55.035 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.035 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.035 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.035 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:55.035 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.035 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.035 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:55.035 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.035 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.035 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.036 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:55.036 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:55.036 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.036 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.036 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.036 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:55.036 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:55.036 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.036 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.036 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.036 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:55.037 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.037 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.037 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:55.037 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.037 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.037 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.037 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:55.037 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:55.037 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.037 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.037 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.038 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:55.038 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:55.038 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.038 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.038 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.038 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:55.038 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.038 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.039 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:55.039 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.039 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.039 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.039 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:55.039 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:55.039 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.039 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.039 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.039 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.039 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.039 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:55.040 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:55.040 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.040 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:55.040 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:55.040 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:55.040 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.040 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.040 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:11:55.040 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.040 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:55.040 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:55.040 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:55.040 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.041 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.041 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:55.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.041 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:55.041 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:55.041 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:11:55.041 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.041 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.041 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:55.041 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:55.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f718fac2640 1 -- 172.21.15.5:0/2744904274 >> v2:172.21.15.157:6812/631023601 conn(0x7f717403bdc0 msgr2=0x7f717403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f718fac2640 1 --2- 172.21.15.5:0/2744904274 >> v2:172.21.15.157:6812/631023601 conn(0x7f717403bdc0 0x7f717403e280 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7178009d90 tx=0x7f717800b040 comp rx=0 tx=0).stop 2024-08-18T21:11:55.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f718fac2640 10 monclient: shutdown 2024-08-18T21:11:55.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f718fac2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:55.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f718fac2640 1 -- 172.21.15.5:0/2744904274 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71880a6bd0 msgr2=0x7f7188138c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f718e05f640 1 -- 172.21.15.5:0/2744904274 reap_dead start 2024-08-18T21:11:55.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f718fac2640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71880a6bd0 0x7f7188138c70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f717c00ebe0 tx=0x7f717c00c520 comp rx=0 tx=0).stop 2024-08-18T21:11:55.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f718fac2640 1 -- 172.21.15.5:0/2744904274 shutdown_connections 2024-08-18T21:11:55.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f718fac2640 1 --2- 172.21.15.5:0/2744904274 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f71880a6bd0 0x7f7188138c70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f718fac2640 1 -- 172.21.15.5:0/2744904274 >> 172.21.15.5:0/2744904274 conn(0x7f7188068700 msgr2=0x7f71880aba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:55.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f718fac2640 1 -- 172.21.15.5:0/2744904274 shutdown_connections 2024-08-18T21:11:55.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.008+0000 7f718fac2640 1 -- 172.21.15.5:0/2744904274 wait complete. 2024-08-18T21:11:55.046 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:55.047 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:11:55.047 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:11:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 10 monclient: get_monmap_and_config 2024-08-18T21:11:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 10 monclient: build_initial_monmap 2024-08-18T21:11:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 10 monclient: monmap: 2024-08-18T21:11:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:55.217078+0000 2024-08-18T21:11:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:55.217078+0000 2024-08-18T21:11:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:55.215 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 1 Processor -- start 2024-08-18T21:11:55.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 1 -- start start 2024-08-18T21:11:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 10 monclient: init 2024-08-18T21:11:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 10 monclient: _add_conns ranks=[5,8,9,1,6,3,4,10,2,7,0] 2024-08-18T21:11:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9218138a10 0x7f921809efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 10 monclient(hunting): picked mon.noname-h con 0x7f9218138a10 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:11:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f92180a4db0 0x7f9218138df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 10 monclient(hunting): picked mon.noname-e con 0x7f92180a4db0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9218139330 0x7f921806c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 10 monclient(hunting): picked mon.noname-a con 0x7f9218139330 addr v2:172.21.15.5:3300/0 2024-08-18T21:11:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f921809f660 con 0x7f9218139330 2024-08-18T21:11:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f921809dec0 con 0x7f9218138a10 2024-08-18T21:11:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f921809e1a0 con 0x7f92180a4db0 2024-08-18T21:11:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921ca35640 10 monclient(hunting): authenticate will time out at 1482.231008s 2024-08-18T21:11:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f92180a4db0 0x7f9218138df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f92180a4db0 0x7f9218138df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:55564/0 (socket says 172.21.15.5:55564) 2024-08-18T21:11:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 1 -- 172.21.15.5:0/1627412293 learned_addr learned my addr 172.21.15.5:0/1627412293 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 10 monclient(hunting): get_auth_request con 0x7f92180a4db0 auth_method 0 2024-08-18T21:11:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9216d9d640 1 --2- 172.21.15.5:0/1627412293 >> v2:172.21.15.5:3300/0 conn(0x7f9218139330 0x7f921806c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9216d9d640 10 monclient(hunting): get_auth_request con 0x7f9218139330 auth_method 0 2024-08-18T21:11:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9216d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9216d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9216d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9216d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9216d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9216d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921659c640 1 --2- 172.21.15.5:0/1627412293 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9218138a10 0x7f921809efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921659c640 10 monclient(hunting): get_auth_request con 0x7f9218138a10 auth_method 0 2024-08-18T21:11:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f921659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 10 monclient(hunting): handle_auth_done global_id 114308 payload 274 2024-08-18T21:11:55.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 1 -- 172.21.15.5:0/1627412293 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9218138a10 msgr2=0x7f921809efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:55.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 1 --2- 172.21.15.5:0/1627412293 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9218138a10 0x7f921809efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 1 -- 172.21.15.5:0/1627412293 >> v2:172.21.15.5:3300/0 conn(0x7f9218139330 msgr2=0x7f921806c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:55.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 1 --2- 172.21.15.5:0/1627412293 >> v2:172.21.15.5:3300/0 conn(0x7f9218139330 0x7f921806c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:11:55.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 1 monclient: found mon.noname-e 2024-08-18T21:11:55.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:55.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:11:55.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9215d9b640 1 -- 172.21.15.5:0/1627412293 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f921806ce90 con 0x7f92180a4db0 2024-08-18T21:11:55.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.212+0000 7f9216d9d640 1 --2- 172.21.15.5:0/1627412293 >> v2:172.21.15.5:3300/0 conn(0x7f9218139330 0x7f921806c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:55.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.216+0000 7f9215d9b640 1 -- 172.21.15.5:0/1627412293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f92180a4db0 msgr2=0x7f9218138df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.216+0000 7f9215d9b640 1 --2- 172.21.15.5:0/1627412293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f92180a4db0 0x7f9218138df0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f920c009870 tx=0x7f920c01c100 comp rx=0 tx=0).ready entity=mon.8 client_cookie=1396845daf3e7145 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921559a640 1 -- 172.21.15.5:0/1627412293 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f920c0a5d40 con 0x7f92180a4db0 2024-08-18T21:11:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921559a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:11:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921559a640 10 monclient: dump: 2024-08-18T21:11:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.226 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921559a640 10 monclient: _finish_auth 0 2024-08-18T21:11:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921559a640 10 monclient: _check_auth_tickets 2024-08-18T21:11:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921559a640 1 -- 172.21.15.5:0/1627412293 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920c0ad420 con 0x7f92180a4db0 2024-08-18T21:11:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 5 monclient: authenticate success, global_id 114308 2024-08-18T21:11:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921559a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 4 set_mon_vals no callback set 2024-08-18T21:11:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921559a640 1 -- 172.21.15.5:0/1627412293 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f920c0ada40 con 0x7f92180a4db0 2024-08-18T21:11:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921559a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921559a640 10 monclient: dump: 2024-08-18T21:11:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.228 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 10 monclient: shutdown 2024-08-18T21:11:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 -- 172.21.15.5:0/1627412293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f92180a4db0 msgr2=0x7f9218138df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 --2- 172.21.15.5:0/1627412293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f92180a4db0 0x7f9218138df0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f920c009870 tx=0x7f920c01c100 comp rx=0 tx=0).stop 2024-08-18T21:11:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 -- 172.21.15.5:0/1627412293 shutdown_connections 2024-08-18T21:11:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 --2- 172.21.15.5:0/1627412293 >> v2:172.21.15.5:3300/0 conn(0x7f9218139330 0x7f921806c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 --2- 172.21.15.5:0/1627412293 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f92180a4db0 0x7f9218138df0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 --2- 172.21.15.5:0/1627412293 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9218138a10 0x7f921809efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 -- 172.21.15.5:0/1627412293 >> 172.21.15.5:0/1627412293 conn(0x7f92180688d0 msgr2=0x7f9218068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 -- 172.21.15.5:0/1627412293 shutdown_connections 2024-08-18T21:11:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 -- 172.21.15.5:0/1627412293 wait complete. 2024-08-18T21:11:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 10 monclient: build_initial_monmap 2024-08-18T21:11:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 10 monclient: monmap: 2024-08-18T21:11:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:55.231 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 Processor -- start 2024-08-18T21:11:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 -- start start 2024-08-18T21:11:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 10 monclient: init 2024-08-18T21:11:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 10 monclient: _add_conns ranks=[4,0,2,5,6,8,1,7,3] 2024-08-18T21:11:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92180a4db0 0x7f9218132660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 10 monclient(hunting): picked mon.noname-c con 0x7f92180a4db0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9218138a10 0x7f9218132ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 10 monclient(hunting): picked mon.noname-a con 0x7f9218138a10 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:11:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9218139330 0x7f92181330e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 10 monclient(hunting): picked mon.noname-b con 0x7f9218139330 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:11:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9218143aa0 con 0x7f9218138a10 2024-08-18T21:11:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f9218143920 con 0x7f9218139330 2024-08-18T21:11:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f9218143c20 con 0x7f92180a4db0 2024-08-18T21:11:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921ca35640 10 monclient(hunting): authenticate will time out at 1482.238297s 2024-08-18T21:11:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92180a4db0 0x7f9218132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9216d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9218139330 0x7f92181330e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92180a4db0 0x7f9218132660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:37936/0 (socket says 172.21.15.5:37936) 2024-08-18T21:11:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 1 -- 172.21.15.5:0/993835859 learned_addr learned my addr 172.21.15.5:0/993835859 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 10 monclient(hunting): get_auth_request con 0x7f92180a4db0 auth_method 0 2024-08-18T21:11:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9216d9d640 10 monclient(hunting): get_auth_request con 0x7f9218139330 auth_method 0 2024-08-18T21:11:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9216d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9216d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9216d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9215d9b640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9218138a10 0x7f9218132ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9215d9b640 10 monclient(hunting): get_auth_request con 0x7f9218138a10 auth_method 0 2024-08-18T21:11:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9215d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9215d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9215d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9216d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9216d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9216d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9215d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9215d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9215d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 10 monclient(hunting): handle_auth_done global_id 114232 payload 824 2024-08-18T21:11:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 1 -- 172.21.15.5:0/993835859 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9218139330 msgr2=0x7f92181330e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9218139330 0x7f92181330e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 1 -- 172.21.15.5:0/993835859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9218138a10 msgr2=0x7f9218132ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9218138a10 0x7f9218132ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 10 monclient: _finish_hunting 0 2024-08-18T21:11:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 1 monclient: found mon.noname-c 2024-08-18T21:11:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:11:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f921659c640 1 -- 172.21.15.5:0/993835859 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92180a7f80 con 0x7f92180a4db0 2024-08-18T21:11:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.220+0000 7f9216d9d640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9218139330 0x7f92181330e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f921659c640 1 -- 172.21.15.5:0/993835859 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92180a4db0 msgr2=0x7f9218132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f921659c640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92180a4db0 0x7f9218132660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f920800d800 tx=0x7f920800dc00 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9206ffd640 1 -- 172.21.15.5:0/993835859 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f920800bd40 con 0x7f92180a4db0 2024-08-18T21:11:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9206ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9206ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:11:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9206ffd640 10 monclient: dump: 2024-08-18T21:11:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.239 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9206ffd640 10 monclient: _finish_auth 0 2024-08-18T21:11:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9206ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:11:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9206ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9206ffd640 1 -- 172.21.15.5:0/993835859 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9208019070 con 0x7f92180a4db0 2024-08-18T21:11:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9206ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9206ffd640 1 -- 172.21.15.5:0/993835859 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f92080148a0 con 0x7f92180a4db0 2024-08-18T21:11:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9206ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9206ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:11:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9206ffd640 10 monclient: dump: 2024-08-18T21:11:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.241 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9214d99640 4 set_mon_vals no callback set 2024-08-18T21:11:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f921ca35640 5 monclient: authenticate success, global_id 114232 2024-08-18T21:11:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f921ca35640 10 monclient: _renew_subs 2024-08-18T21:11:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f921ca35640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:11:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f921ca35640 1 -- 172.21.15.5:0/993835859 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92180a84b0 con 0x7f92180a4db0 2024-08-18T21:11:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f921ca35640 10 monclient: _renew_subs 2024-08-18T21:11:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f921ca35640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:11:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f921ca35640 1 -- 172.21.15.5:0/993835859 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f921813f210 con 0x7f92180a4db0 2024-08-18T21:11:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f921ca35640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f921ca35640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921813da10 0x7f921813b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f921ca35640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f921ca35640 1 -- 172.21.15.5:0/993835859 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9218051140 con 0x7f921813da10 2024-08-18T21:11:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f921659c640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92180a4db0 0x7f9218132660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f920800d800 tx=0x7f920800dc00 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7f920800f040 osd_map(239..239 src has 22..239) 2024-08-18T21:11:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9206ffd640 1 -- 172.21.15.5:0/993835859 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f9208014430 con 0x7f92180a4db0 2024-08-18T21:11:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9206ffd640 1 --2- 172.21.15.5:0/993835859 >> v2:172.21.15.157:6812/631023601 conn(0x7f91f803bdc0 0x7f91f803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9215d9b640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921813da10 0x7f921813b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9215d9b640 10 monclient: get_auth_request con 0x7f921813da10 auth_method 0 2024-08-18T21:11:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9215d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9215d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9215d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9215d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9215d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9215d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9216d9d640 1 --2- 172.21.15.5:0/993835859 >> v2:172.21.15.157:6812/631023601 conn(0x7f91f803bdc0 0x7f91f803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9216d9d640 10 monclient: get_auth_request con 0x7f91f803bdc0 auth_method 0 2024-08-18T21:11:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9215d9b640 10 monclient(hunting): handle_auth_done global_id 85215 payload 824 2024-08-18T21:11:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.224+0000 7f9215d9b640 1 -- 172.21.15.5:0/993835859 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f921806dbf0 con 0x7f921813da10 2024-08-18T21:11:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.228+0000 7f9215d9b640 1 -- 172.21.15.5:0/993835859 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921813da10 msgr2=0x7f921813b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.228+0000 7f9215d9b640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921813da10 0x7f921813b3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f920c0ae000 tx=0x7f920c0191c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.228+0000 7f9216d9d640 1 --2- 172.21.15.5:0/993835859 >> v2:172.21.15.157:6812/631023601 conn(0x7f91f803bdc0 0x7f91f803e280 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f921813f700 tx=0x7f921000b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.228+0000 7f9206ffd640 1 -- 172.21.15.5:0/993835859 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f920c0bc070 con 0x7f921813da10 2024-08-18T21:11:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.228+0000 7f9206ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.228+0000 7f9206ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:11:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.228+0000 7f9206ffd640 10 monclient: dump: 2024-08-18T21:11:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.245 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.228+0000 7f9206ffd640 1 -- 172.21.15.5:0/993835859 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f920c0044e0 con 0x7f921813da10 2024-08-18T21:11:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.228+0000 7f9206ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.228+0000 7f9206ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.228+0000 7f9206ffd640 1 -- 172.21.15.5:0/993835859 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921813da10 msgr2=0x7f921813b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.228+0000 7f9206ffd640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921813da10 0x7f921813b3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f920c0ae000 tx=0x7f920c0191c0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.228+0000 7f9206ffd640 1 -- 172.21.15.5:0/993835859 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921813da10 msgr2=0x7f921813b3c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:55.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.228+0000 7f9206ffd640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921813da10 0x7f921813b3c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.236+0000 7f921ca35640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:55.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.236+0000 7f921ca35640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921813f990 0x7f921813b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.236+0000 7f921ca35640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.236+0000 7f921ca35640 1 -- 172.21.15.5:0/993835859 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f921809efd0 con 0x7f921813f990 2024-08-18T21:11:55.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.236+0000 7f9215d9b640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921813f990 0x7f921813b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.236+0000 7f9215d9b640 10 monclient: get_auth_request con 0x7f921813f990 auth_method 0 2024-08-18T21:11:55.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.236+0000 7f9215d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.236+0000 7f9215d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.236+0000 7f9215d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.236+0000 7f9215d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.236+0000 7f9215d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.236+0000 7f9215d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.236+0000 7f9215d9b640 10 monclient(hunting): handle_auth_done global_id 85224 payload 824 2024-08-18T21:11:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.236+0000 7f9215d9b640 1 -- 172.21.15.5:0/993835859 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f921806e0d0 con 0x7f921813f990 2024-08-18T21:11:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f9215d9b640 1 -- 172.21.15.5:0/993835859 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921813f990 msgr2=0x7f921813b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f9215d9b640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921813f990 0x7f921813b900 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f920c01c9a0 tx=0x7f920c0a8000 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f9206ffd640 1 -- 172.21.15.5:0/993835859 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f920c0ca8c0 con 0x7f921813f990 2024-08-18T21:11:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f9206ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f9206ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:11:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f9206ffd640 10 monclient: dump: 2024-08-18T21:11:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.250 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f9206ffd640 1 -- 172.21.15.5:0/993835859 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f920c0ca450 con 0x7f921813f990 2024-08-18T21:11:55.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f9206ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:55.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f9206ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:55.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f9206ffd640 1 -- 172.21.15.5:0/993835859 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921813f990 msgr2=0x7f921813b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f9206ffd640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921813f990 0x7f921813b900 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f920c01c9a0 tx=0x7f920c0a8000 comp rx=0 tx=0).stop 2024-08-18T21:11:55.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f9206ffd640 1 -- 172.21.15.5:0/993835859 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921813f990 msgr2=0x7f921813b900 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:55.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f9206ffd640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921813f990 0x7f921813b900 secure :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f920c01c9a0 tx=0x7f920c0a8000 comp rx=0 tx=0).stop 2024-08-18T21:11:55.250 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:55.250 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:55.251 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:55.251 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:55.251 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:55.251 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 212068, 2024-08-18T21:11:55.251 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:55.251 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:55.251 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:55.251 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:55.251 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:55.251 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:55.251 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:55.251 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:55.251 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:55.251 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:55.252 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.252 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:11:55.252 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:55.252 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:55.252 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:55.252 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:55.252 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:55.252 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:55.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:55.252 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:55.252 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:55.252 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:55.252 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:55.253 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:55.253 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:55.253 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:55.253 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.253 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:55.253 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:55.253 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:55.253 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:55.253 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:55.253 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:55.253 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:55.253 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:55.253 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:55.253 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:55.254 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:55.254 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:55.254 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:55.254 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.254 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:55.254 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:55.254 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:55.254 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:55.254 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:55.254 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:55.254 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:55.254 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:55.255 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:55.255 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:55.255 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:55.255 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:55.255 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:55.255 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:55.255 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:55.255 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:55.255 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:55.255 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:55.255 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:55.255 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:55.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:55.255 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:55.256 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:55.256 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:55.256 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:55.256 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:55.256 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:55.256 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:55.256 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.256 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:55.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.256 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:55.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.256 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:55.256 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:55.256 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.257 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.257 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:55.257 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.257 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:55.257 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.257 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.257 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.258 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:55.258 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:55.258 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.258 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.258 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.258 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:55.258 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:55.258 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.258 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.258 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:55.259 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.259 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.259 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:55.259 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.259 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.259 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.259 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:55.259 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:55.259 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.259 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.260 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.260 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:55.260 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:55.260 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.260 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.260 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:55.260 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.261 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:55.261 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.261 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.261 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:55.261 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:55.261 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.261 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.261 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.261 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:55.262 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:55.262 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.262 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.262 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:55.262 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.262 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:55.262 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.262 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.263 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.263 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:55.263 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:55.263 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.263 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.263 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.263 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:55.263 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:55.263 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.263 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.264 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.264 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:55.264 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.264 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.264 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:55.264 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.264 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.264 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.264 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:55.264 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:55.264 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.265 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.265 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.265 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:55.265 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:55.265 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.265 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.265 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.265 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:55.265 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.266 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.266 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:55.266 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.266 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.266 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.266 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:55.266 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:55.266 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.266 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.266 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:55.267 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:55.267 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.267 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.267 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.267 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:55.267 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.267 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.267 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:55.267 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.268 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.268 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.268 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:55.268 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:55.268 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.268 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.268 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:55.268 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:55.268 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.269 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.269 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:55.269 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.269 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:55.269 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.269 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.269 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.269 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:55.270 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:55.270 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.270 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.270 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:55.270 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:55.270 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.270 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.270 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.270 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:55.271 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.271 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:55.271 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.271 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.271 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.271 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:55.271 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:55.271 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.271 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.271 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:11:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:55.273 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f921ca35640 1 -- 172.21.15.5:0/993835859 >> v2:172.21.15.157:6812/631023601 conn(0x7f91f803bdc0 msgr2=0x7f91f803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f921ca35640 1 --2- 172.21.15.5:0/993835859 >> v2:172.21.15.157:6812/631023601 conn(0x7f91f803bdc0 0x7f91f803e280 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f921813f700 tx=0x7f921000b040 comp rx=0 tx=0).stop 2024-08-18T21:11:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f921ca35640 10 monclient: shutdown 2024-08-18T21:11:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f921ca35640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f921ca35640 1 -- 172.21.15.5:0/993835859 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92180a4db0 msgr2=0x7f9218132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f921ca35640 1 --2- 172.21.15.5:0/993835859 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f92180a4db0 0x7f9218132660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f920800d800 tx=0x7f920800dc00 comp rx=0 tx=0).stop 2024-08-18T21:11:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f9216d9d640 1 -- 172.21.15.5:0/993835859 reap_dead start 2024-08-18T21:11:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f9206ffd640 1 -- 172.21.15.5:0/993835859 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(239..239 src has 22..239) ==== 3898+0+0 (unknown 0 0 0) 0x7f920800f040 con 0x7f92180a4db0 2024-08-18T21:11:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f9216d9d640 1 -- 172.21.15.5:0/993835859 reap_dead start 2024-08-18T21:11:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f921ca35640 1 -- 172.21.15.5:0/993835859 shutdown_connections 2024-08-18T21:11:55.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f921ca35640 1 -- 172.21.15.5:0/993835859 >> 172.21.15.5:0/993835859 conn(0x7f92180688d0 msgr2=0x7f92180a6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:55.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f921ca35640 1 -- 172.21.15.5:0/993835859 shutdown_connections 2024-08-18T21:11:55.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.240+0000 7f921ca35640 1 -- 172.21.15.5:0/993835859 wait complete. 2024-08-18T21:11:55.276 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:55.276 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:11:55.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:11:55.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 10 monclient: get_monmap_and_config 2024-08-18T21:11:55.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 10 monclient: build_initial_monmap 2024-08-18T21:11:55.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 10 monclient: monmap: 2024-08-18T21:11:55.399 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:55.399 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.399 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:55.401598+0000 2024-08-18T21:11:55.399 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:55.401598+0000 2024-08-18T21:11:55.399 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:55.399 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.399 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:55.399 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:55.399 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:55.399 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:55.399 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:55.400 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:55.400 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:55.400 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:55.400 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:55.400 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:55.400 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:55.400 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 1 Processor -- start 2024-08-18T21:11:55.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 1 -- start start 2024-08-18T21:11:55.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 10 monclient: init 2024-08-18T21:11:55.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:55.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 10 monclient: _add_conns ranks=[4,9,8,0,6,7,1,10,2,3,5] 2024-08-18T21:11:55.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6338068700 0x7f6338068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 10 monclient(hunting): picked mon.noname-c con 0x7f6338068700 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:55.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6338069750 0x7f6338069020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 10 monclient(hunting): picked mon.noname-a con 0x7f6338069750 addr v2:172.21.15.5:3300/0 2024-08-18T21:11:55.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f633809b080 0x7f633809b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 10 monclient(hunting): picked mon.noname-e con 0x7f633809b080 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:55.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6338069560 con 0x7f6338069750 2024-08-18T21:11:55.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f633809fab0 con 0x7f6338068700 2024-08-18T21:11:55.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f63380a0070 con 0x7f633809b080 2024-08-18T21:11:55.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:55.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633cd69640 10 monclient(hunting): authenticate will time out at 1482.414949s 2024-08-18T21:11:55.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633659c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6338068700 0x7f6338068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6335d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6338069750 0x7f6338069020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633659c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6338068700 0x7f6338068ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:37944/0 (socket says 172.21.15.5:37944) 2024-08-18T21:11:55.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633659c640 1 -- 172.21.15.5:0/561957823 learned_addr learned my addr 172.21.15.5:0/561957823 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:55.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 1 --2- 172.21.15.5:0/561957823 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f633809b080 0x7f633809b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6335d9b640 1 --2- 172.21.15.5:0/561957823 >> v2:172.21.15.5:3300/0 conn(0x7f6338069750 0x7f6338069020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32930/0 (socket says 172.21.15.5:32930) 2024-08-18T21:11:55.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633659c640 10 monclient(hunting): get_auth_request con 0x7f6338068700 auth_method 0 2024-08-18T21:11:55.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6335d9b640 10 monclient(hunting): get_auth_request con 0x7f6338069750 auth_method 0 2024-08-18T21:11:55.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6335d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6335d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6335d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 10 monclient(hunting): get_auth_request con 0x7f633809b080 auth_method 0 2024-08-18T21:11:55.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6335d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6335d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6335d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f633659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 10 monclient(hunting): handle_auth_done global_id 114317 payload 274 2024-08-18T21:11:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 1 -- 172.21.15.5:0/561957823 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6338068700 msgr2=0x7f6338068ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 1 --2- 172.21.15.5:0/561957823 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6338068700 0x7f6338068ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 1 -- 172.21.15.5:0/561957823 >> v2:172.21.15.5:3300/0 conn(0x7f6338069750 msgr2=0x7f6338069020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:55.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 1 --2- 172.21.15.5:0/561957823 >> v2:172.21.15.5:3300/0 conn(0x7f6338069750 0x7f6338069020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 10 monclient: _finish_hunting 0 2024-08-18T21:11:55.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 1 monclient: found mon.noname-e 2024-08-18T21:11:55.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:55.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:11:55.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.396+0000 7f6336d9d640 1 -- 172.21.15.5:0/561957823 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633809fd90 con 0x7f633809b080 2024-08-18T21:11:55.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.400+0000 7f6336d9d640 1 -- 172.21.15.5:0/561957823 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f633809b080 msgr2=0x7f633809b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.400+0000 7f6336d9d640 1 --2- 172.21.15.5:0/561957823 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f633809b080 0x7f633809b4a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6330009d90 tx=0x7f633001c7f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=39b1899606ba45d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633559a640 1 -- 172.21.15.5:0/561957823 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63300b2070 con 0x7f633809b080 2024-08-18T21:11:55.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633559a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:11:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633559a640 10 monclient: dump: 2024-08-18T21:11:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.411 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633559a640 10 monclient: _finish_auth 0 2024-08-18T21:11:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633559a640 10 monclient: _check_auth_tickets 2024-08-18T21:11:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633559a640 1 -- 172.21.15.5:0/561957823 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63300a5b00 con 0x7f633809b080 2024-08-18T21:11:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 5 monclient: authenticate success, global_id 114317 2024-08-18T21:11:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633559a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 4 set_mon_vals no callback set 2024-08-18T21:11:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633559a640 1 -- 172.21.15.5:0/561957823 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63300a5cf0 con 0x7f633809b080 2024-08-18T21:11:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633559a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633559a640 10 monclient: dump: 2024-08-18T21:11:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.413 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 10 monclient: shutdown 2024-08-18T21:11:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 -- 172.21.15.5:0/561957823 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f633809b080 msgr2=0x7f633809b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 --2- 172.21.15.5:0/561957823 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f633809b080 0x7f633809b4a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6330009d90 tx=0x7f633001c7f0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 -- 172.21.15.5:0/561957823 shutdown_connections 2024-08-18T21:11:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 --2- 172.21.15.5:0/561957823 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f633809b080 0x7f633809b4a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 --2- 172.21.15.5:0/561957823 >> v2:172.21.15.5:3300/0 conn(0x7f6338069750 0x7f6338069020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 --2- 172.21.15.5:0/561957823 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6338068700 0x7f6338068ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 -- 172.21.15.5:0/561957823 >> 172.21.15.5:0/561957823 conn(0x7f63380a8480 msgr2=0x7f63380a8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 -- 172.21.15.5:0/561957823 shutdown_connections 2024-08-18T21:11:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 -- 172.21.15.5:0/561957823 wait complete. 2024-08-18T21:11:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 10 monclient: build_initial_monmap 2024-08-18T21:11:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 10 monclient: monmap: 2024-08-18T21:11:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:55.415 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 Processor -- start 2024-08-18T21:11:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 -- start start 2024-08-18T21:11:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 10 monclient: init 2024-08-18T21:11:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 10 monclient: _add_conns ranks=[4,8,1,3,6,0,7,2,5] 2024-08-18T21:11:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6338068700 0x7f633809c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 10 monclient(hunting): picked mon.noname-c con 0x7f6338068700 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6338069750 0x7f633809cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 10 monclient(hunting): picked mon.noname-e con 0x7f6338069750 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f633809b080 0x7f633809d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 10 monclient(hunting): picked mon.noname-f con 0x7f633809b080 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:11:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6338141340 con 0x7f633809b080 2024-08-18T21:11:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f63380a0d80 con 0x7f6338068700 2024-08-18T21:11:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f63381414c0 con 0x7f6338069750 2024-08-18T21:11:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633cd69640 10 monclient(hunting): authenticate will time out at 1482.422480s 2024-08-18T21:11:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6338068700 0x7f633809c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6338068700 0x7f633809c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:37950/0 (socket says 172.21.15.5:37950) 2024-08-18T21:11:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f6335d9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6338069750 0x7f633809cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 1 -- 172.21.15.5:0/851957899 learned_addr learned my addr 172.21.15.5:0/851957899 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 10 monclient(hunting): get_auth_request con 0x7f6338068700 auth_method 0 2024-08-18T21:11:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f6335d9b640 10 monclient(hunting): get_auth_request con 0x7f6338069750 auth_method 0 2024-08-18T21:11:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f6335d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f6335d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f6335d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f6335d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f6335d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f6335d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f6336d9d640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f633809b080 0x7f633809d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 10 monclient(hunting): handle_auth_done global_id 114250 payload 824 2024-08-18T21:11:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 1 -- 172.21.15.5:0/851957899 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6338069750 msgr2=0x7f633809cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6338069750 0x7f633809cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 1 -- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f633809b080 msgr2=0x7f633809d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f633809b080 0x7f633809d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 10 monclient: _finish_hunting 0 2024-08-18T21:11:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 1 monclient: found mon.noname-c 2024-08-18T21:11:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:55.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:11:55.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f633659c640 1 -- 172.21.15.5:0/851957899 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63380a4530 con 0x7f6338068700 2024-08-18T21:11:55.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f6336d9d640 10 monclient: get_auth_request con 0x7f633809b080 auth_method 0 2024-08-18T21:11:55.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f6336d9d640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f633809b080 0x7f633809d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:11:55.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.404+0000 7f6335d9b640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6338069750 0x7f633809cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:55.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f633659c640 1 -- 172.21.15.5:0/851957899 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6338068700 msgr2=0x7f633809c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f633659c640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6338068700 0x7f633809c5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f632800e890 tx=0x7f632800ed50 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6326ffd640 1 -- 172.21.15.5:0/851957899 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6328017070 con 0x7f6338068700 2024-08-18T21:11:55.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6326ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6326ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:11:55.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6326ffd640 10 monclient: dump: 2024-08-18T21:11:55.423 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.423 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.423 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.423 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.423 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.424 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6326ffd640 10 monclient: _finish_auth 0 2024-08-18T21:11:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6326ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:11:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6326ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6326ffd640 1 -- 172.21.15.5:0/851957899 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6328013470 con 0x7f6338068700 2024-08-18T21:11:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f633cd69640 5 monclient: authenticate success, global_id 114250 2024-08-18T21:11:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f633cd69640 10 monclient: _renew_subs 2024-08-18T21:11:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f633cd69640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:11:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f633cd69640 1 -- 172.21.15.5:0/851957899 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63380a4000 con 0x7f6338068700 2024-08-18T21:11:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6326ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6326ffd640 1 -- 172.21.15.5:0/851957899 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6328013a90 con 0x7f6338068700 2024-08-18T21:11:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6326ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6326ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:11:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6334d99640 4 set_mon_vals no callback set 2024-08-18T21:11:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6326ffd640 10 monclient: dump: 2024-08-18T21:11:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.426 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f633cd69640 10 monclient: _renew_subs 2024-08-18T21:11:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f633cd69640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:11:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f633cd69640 1 -- 172.21.15.5:0/851957899 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f633813cdc0 con 0x7f6338068700 2024-08-18T21:11:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f633cd69640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f633cd69640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63381d1600 0x7f63381d19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f633cd69640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f633cd69640 1 -- 172.21.15.5:0/851957899 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f6338051140 con 0x7f63381d1600 2024-08-18T21:11:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6326ffd640 1 -- 172.21.15.5:0/851957899 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f632801a070 con 0x7f6338068700 2024-08-18T21:11:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6335d9b640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63381d1600 0x7f63381d19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6335d9b640 10 monclient: get_auth_request con 0x7f63381d1600 auth_method 0 2024-08-18T21:11:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6335d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6335d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6335d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6326ffd640 1 --2- 172.21.15.5:0/851957899 >> v2:172.21.15.157:6812/631023601 conn(0x7f631803bdc0 0x7f631803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6326ffd640 1 -- 172.21.15.5:0/851957899 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(239..239 src has 22..239) ==== 3898+0+0 (secure 0 0 0) 0x7f632800f040 con 0x7f6338068700 2024-08-18T21:11:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6335d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6335d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6335d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6336d9d640 1 --2- 172.21.15.5:0/851957899 >> v2:172.21.15.157:6812/631023601 conn(0x7f631803bdc0 0x7f631803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6336d9d640 10 monclient: get_auth_request con 0x7f631803bdc0 auth_method 0 2024-08-18T21:11:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6335d9b640 10 monclient(hunting): handle_auth_done global_id 94919 payload 824 2024-08-18T21:11:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.408+0000 7f6335d9b640 1 -- 172.21.15.5:0/851957899 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f633813b9c0 con 0x7f63381d1600 2024-08-18T21:11:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.412+0000 7f6335d9b640 1 -- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63381d1600 msgr2=0x7f63381d19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.412+0000 7f6335d9b640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63381d1600 0x7f63381d19e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f632c011cf0 tx=0x7f632c00f610 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.412+0000 7f6336d9d640 1 --2- 172.21.15.5:0/851957899 >> v2:172.21.15.157:6812/631023601 conn(0x7f631803bdc0 0x7f631803e280 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f633809e950 tx=0x7f63300a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.412+0000 7f6326ffd640 1 -- 172.21.15.5:0/851957899 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f632c014ac0 con 0x7f63381d1600 2024-08-18T21:11:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.412+0000 7f6326ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.412+0000 7f6326ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:11:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.412+0000 7f6326ffd640 10 monclient: dump: 2024-08-18T21:11:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.430 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.412+0000 7f6326ffd640 1 -- 172.21.15.5:0/851957899 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f632c014650 con 0x7f63381d1600 2024-08-18T21:11:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.412+0000 7f6326ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.412+0000 7f6326ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.412+0000 7f6326ffd640 1 -- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63381d1600 msgr2=0x7f63381d19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.412+0000 7f6326ffd640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63381d1600 0x7f63381d19e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f632c011cf0 tx=0x7f632c00f610 comp rx=0 tx=0).stop 2024-08-18T21:11:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.412+0000 7f6326ffd640 1 -- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63381d1600 msgr2=0x7f63381d19e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.412+0000 7f6326ffd640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63381d1600 0x7f63381d19e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.420+0000 7f633cd69640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.420+0000 7f633cd69640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63381d1f20 0x7f63381388c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.420+0000 7f633cd69640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.420+0000 7f633cd69640 1 -- 172.21.15.5:0/851957899 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f6338069fa0 con 0x7f63381d1f20 2024-08-18T21:11:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.420+0000 7f6335d9b640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63381d1f20 0x7f63381388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.420+0000 7f6335d9b640 10 monclient: get_auth_request con 0x7f63381d1f20 auth_method 0 2024-08-18T21:11:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.420+0000 7f6335d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.420+0000 7f6335d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.420+0000 7f6335d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.420+0000 7f6335d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.420+0000 7f6335d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.420+0000 7f6335d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.420+0000 7f6335d9b640 10 monclient(hunting): handle_auth_done global_id 94928 payload 824 2024-08-18T21:11:55.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.420+0000 7f6335d9b640 1 -- 172.21.15.5:0/851957899 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f633813d4a0 con 0x7f63381d1f20 2024-08-18T21:11:55.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f6335d9b640 1 -- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63381d1f20 msgr2=0x7f63381388c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f6335d9b640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63381d1f20 0x7f63381388c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f632c01b000 tx=0x7f632c0046d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f6326ffd640 1 -- 172.21.15.5:0/851957899 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f632c004490 con 0x7f63381d1f20 2024-08-18T21:11:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f6326ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f6326ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:11:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f6326ffd640 10 monclient: dump: 2024-08-18T21:11:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.434 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f6326ffd640 1 -- 172.21.15.5:0/851957899 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f632c0273f0 con 0x7f63381d1f20 2024-08-18T21:11:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f6326ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f6326ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f6326ffd640 1 -- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63381d1f20 msgr2=0x7f63381388c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f6326ffd640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63381d1f20 0x7f63381388c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f632c01b000 tx=0x7f632c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f6326ffd640 1 -- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63381d1f20 msgr2=0x7f63381388c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f6326ffd640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f63381d1f20 0x7f63381388c0 secure :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f632c01b000 tx=0x7f632c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.435 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:55.435 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:55.435 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:55.435 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:55.435 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:55.435 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 143465, 2024-08-18T21:11:55.435 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:55.435 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:55.436 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:55.436 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:55.436 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:55.436 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:55.436 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:55.436 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:55.436 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:55.436 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:55.436 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.436 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:11:55.436 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:55.436 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:55.436 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:55.437 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:55.437 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:55.437 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:55.437 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:55.437 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:55.437 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:55.437 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:55.437 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:55.437 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:55.437 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:55.437 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:55.437 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.437 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:55.437 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:55.438 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:55.438 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:55.438 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:55.438 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:55.438 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:55.438 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:55.438 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:55.438 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:55.438 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:55.438 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:55.438 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:55.438 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.438 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:55.439 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:55.439 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:55.439 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:55.439 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:55.439 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:55.439 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:55.439 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:55.439 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:55.439 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:55.439 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:55.439 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:55.439 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:55.439 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:55.440 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:55.440 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:55.440 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:55.440 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:55.440 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:55.440 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:55.440 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:55.440 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:55.440 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:55.440 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:55.440 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:55.440 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:55.440 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:55.441 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:55.441 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.441 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:55.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.441 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:55.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.441 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:55.441 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:55.441 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.441 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.441 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.441 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:55.441 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.442 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.442 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:55.442 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.442 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.442 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.442 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:55.442 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:55.442 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.442 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.442 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.443 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:55.443 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:55.443 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.443 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.443 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:55.443 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.444 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:55.444 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.444 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.444 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.444 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:55.444 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:55.444 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.444 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.444 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.444 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:55.444 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:55.445 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.445 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.445 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:55.445 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.445 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:55.445 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.445 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.445 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.446 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:55.446 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:55.446 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.446 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.446 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.446 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:55.446 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:55.446 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.446 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.446 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.446 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:55.447 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.447 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.447 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:55.447 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.447 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.447 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:55.447 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:55.447 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.447 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.447 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.448 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:55.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:55.448 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.448 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.448 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:55.448 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.448 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:55.449 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.449 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.449 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.449 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:55.449 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:55.449 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.449 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.449 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.449 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:55.449 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:55.450 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:55.450 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:55.450 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.450 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.450 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.451 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:55.451 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:55.454 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.454 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.454 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.454 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:55.454 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:55.454 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.454 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.455 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:55.455 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.455 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:55.455 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.455 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.455 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.455 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:55.455 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:55.455 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.456 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.456 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.456 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:55.456 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:55.456 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.456 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.456 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:55.456 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.457 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.457 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:55.457 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.457 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.457 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.457 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:55.457 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:55.457 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.457 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.457 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.457 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:11:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:11:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:55.461 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:55.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f633cd69640 1 -- 172.21.15.5:0/851957899 >> v2:172.21.15.157:6812/631023601 conn(0x7f631803bdc0 msgr2=0x7f631803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f633cd69640 1 --2- 172.21.15.5:0/851957899 >> v2:172.21.15.157:6812/631023601 conn(0x7f631803bdc0 0x7f631803e280 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f633809e950 tx=0x7f63300a7070 comp rx=0 tx=0).stop 2024-08-18T21:11:55.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f633cd69640 10 monclient: shutdown 2024-08-18T21:11:55.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f633cd69640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:55.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f633cd69640 1 -- 172.21.15.5:0/851957899 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6338068700 msgr2=0x7f633809c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f633cd69640 1 --2- 172.21.15.5:0/851957899 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6338068700 0x7f633809c5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f632800e890 tx=0x7f632800ed50 comp rx=0 tx=0).stop 2024-08-18T21:11:55.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f6336d9d640 1 -- 172.21.15.5:0/851957899 reap_dead start 2024-08-18T21:11:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f6336d9d640 1 -- 172.21.15.5:0/851957899 reap_dead start 2024-08-18T21:11:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f633cd69640 1 -- 172.21.15.5:0/851957899 shutdown_connections 2024-08-18T21:11:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f633cd69640 1 -- 172.21.15.5:0/851957899 >> 172.21.15.5:0/851957899 conn(0x7f63380a8480 msgr2=0x7f63380a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f633cd69640 1 -- 172.21.15.5:0/851957899 shutdown_connections 2024-08-18T21:11:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.424+0000 7f633cd69640 1 -- 172.21.15.5:0/851957899 wait complete. 2024-08-18T21:11:55.464 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:55.464 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:11:55.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:11:55.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3624530851}) 2024-08-18T21:11:55.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=777122630}) 2024-08-18T21:11:55.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.554 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3624530851}) 2024-08-18T21:11:55.554 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2447876730}) 2024-08-18T21:11:55.554 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.554 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3624530851}) 2024-08-18T21:11:55.554 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=754520297}) 2024-08-18T21:11:55.554 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.554 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3624530851}) 2024-08-18T21:11:55.554 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=808746646}) 2024-08-18T21:11:55.554 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.554 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3624530851}) 2024-08-18T21:11:55.554 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4129927193}) 2024-08-18T21:11:55.554 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.554 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3624530851}) 2024-08-18T21:11:55.555 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2995594382}) 2024-08-18T21:11:55.555 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.555 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3624530851}) 2024-08-18T21:11:55.555 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3489822114}) 2024-08-18T21:11:55.555 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.555 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3624530851}) 2024-08-18T21:11:55.555 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.548+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=995864106}) 2024-08-18T21:11:55.578 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.578 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2607181475}) 2024-08-18T21:11:55.579 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2393138957}) 2024-08-18T21:11:55.579 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.579 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2607181475}) 2024-08-18T21:11:55.579 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3759788264}) 2024-08-18T21:11:55.579 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.579 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2607181475}) 2024-08-18T21:11:55.579 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3380421103}) 2024-08-18T21:11:55.579 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.579 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2607181475}) 2024-08-18T21:11:55.579 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1129670828}) 2024-08-18T21:11:55.579 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.579 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2607181475}) 2024-08-18T21:11:55.579 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2581733326}) 2024-08-18T21:11:55.580 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.580 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2607181475}) 2024-08-18T21:11:55.580 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3713573124}) 2024-08-18T21:11:55.580 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.580 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2607181475}) 2024-08-18T21:11:55.580 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1490901041}) 2024-08-18T21:11:55.580 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.580 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2607181475}) 2024-08-18T21:11:55.580 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.576+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3522772944}) 2024-08-18T21:11:55.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.588+0000 7f8485d21640 10 monclient: get_monmap_and_config 2024-08-18T21:11:55.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.588+0000 7f8485d21640 10 monclient: build_initial_monmap 2024-08-18T21:11:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.588+0000 7f8485d21640 10 monclient: monmap: 2024-08-18T21:11:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:55.594656+0000 2024-08-18T21:11:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:55.594656+0000 2024-08-18T21:11:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:55.594 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:55.594 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:55.594 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:55.594 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:55.594 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:55.594 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f8485d21640 1 Processor -- start 2024-08-18T21:11:55.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f8485d21640 1 -- start start 2024-08-18T21:11:55.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f8485d21640 10 monclient: init 2024-08-18T21:11:55.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f8485d21640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:55.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f8485d21640 10 monclient: _add_conns ranks=[0,1,4,8,2,10,9,7,5,3,6] 2024-08-18T21:11:55.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f8485d21640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f848009da30 addr v1:172.21.15.5:6789/0 2024-08-18T21:11:55.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f8485d21640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f848009e520 addr v1:172.21.15.157:6789/0 2024-08-18T21:11:55.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f8485d21640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8480144b10 0x7f8480146f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f8485d21640 10 monclient(hunting): picked mon.noname-c con 0x7f8480144b10 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:11:55.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=252579696}) 2024-08-18T21:11:55.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2691735508}) 2024-08-18T21:11:55.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=252579696}) 2024-08-18T21:11:55.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2551378810}) 2024-08-18T21:11:55.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=252579696}) 2024-08-18T21:11:55.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1552259922}) 2024-08-18T21:11:55.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=252579696}) 2024-08-18T21:11:55.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2971493220}) 2024-08-18T21:11:55.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=252579696}) 2024-08-18T21:11:55.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1163615363}) 2024-08-18T21:11:55.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=252579696}) 2024-08-18T21:11:55.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2576123648}) 2024-08-18T21:11:55.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=252579696}) 2024-08-18T21:11:55.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=188947113}) 2024-08-18T21:11:55.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=252579696}) 2024-08-18T21:11:55.600 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.592+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=253537026}) 2024-08-18T21:11:55.600 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:55.600 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31242]: starting. 2024-08-18T21:11:55.600 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31242]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31206 2024-08-18T21:11:55.600 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31242]: shutting down. 2024-08-18T21:11:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f8485d21640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848006d4e0 con 0x7f848009da30 2024-08-18T21:11:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f8485d21640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848006eba0 con 0x7f848009e520 2024-08-18T21:11:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f8485d21640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f8485d21640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f848006e550 con 0x7f8480144b10 2024-08-18T21:11:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f8485d21640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f8485d21640 10 monclient(hunting): authenticate will time out at 1482.610556s 2024-08-18T21:11:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8480144b10 0x7f8480146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8480144b10 0x7f8480146f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:37962/0 (socket says 172.21.15.5:37962) 2024-08-18T21:11:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 1 -- 172.21.15.5:0/1374195841 learned_addr learned my addr 172.21.15.5:0/1374195841 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 10 monclient(hunting): get_auth_request con 0x7f8480144b10 auth_method 0 2024-08-18T21:11:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 10 monclient(hunting): handle_auth_done global_id 114259 payload 274 2024-08-18T21:11:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 1 -- 172.21.15.5:0/1374195841 >> v1:172.21.15.157:6789/0 conn(0x7f848009e520 legacy=0x7f84801433f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 1 -- 172.21.15.5:0/1374195841 >> v1:172.21.15.5:6789/0 conn(0x7f848009da30 legacy=0x7f848009de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:11:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 10 monclient: _finish_hunting 0 2024-08-18T21:11:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 1 monclient: found mon.noname-c 2024-08-18T21:11:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:11:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.592+0000 7f847ffff640 1 -- 172.21.15.5:0/1374195841 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84800a6d40 con 0x7f8480144b10 2024-08-18T21:11:55.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f847ffff640 1 -- 172.21.15.5:0/1374195841 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8480144b10 msgr2=0x7f8480146f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f847ffff640 1 --2- 172.21.15.5:0/1374195841 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8480144b10 0x7f8480146f00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8478009e80 tx=0x7f847801c730 comp rx=0 tx=0).ready entity=mon.4 client_cookie=185b32f53570b61a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f847e7fc640 1 -- 172.21.15.5:0/1374195841 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f84780091b0 con 0x7f8480144b10 2024-08-18T21:11:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f847e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f847e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:11:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f847e7fc640 10 monclient: dump: 2024-08-18T21:11:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.608 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f847e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:11:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f847e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:11:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f847e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f847e7fc640 1 -- 172.21.15.5:0/1374195841 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84780ae070 con 0x7f8480144b10 2024-08-18T21:11:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 5 monclient: authenticate success, global_id 114259 2024-08-18T21:11:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:11:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f847e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f847e7fc640 1 -- 172.21.15.5:0/1374195841 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f84780a9d00 con 0x7f8480144b10 2024-08-18T21:11:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 4 set_mon_vals no callback set 2024-08-18T21:11:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f847e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f847e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:11:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f847e7fc640 10 monclient: dump: 2024-08-18T21:11:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.610 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 10 monclient: shutdown 2024-08-18T21:11:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 1 -- 172.21.15.5:0/1374195841 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8480144b10 msgr2=0x7f8480146f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 1 --2- 172.21.15.5:0/1374195841 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8480144b10 0x7f8480146f00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8478009e80 tx=0x7f847801c730 comp rx=0 tx=0).stop 2024-08-18T21:11:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 1 -- 172.21.15.5:0/1374195841 shutdown_connections 2024-08-18T21:11:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 1 --2- 172.21.15.5:0/1374195841 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8480144b10 0x7f8480146f00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 1 -- 172.21.15.5:0/1374195841 >> 172.21.15.5:0/1374195841 conn(0x7f84800a4b20 msgr2=0x7f84800a4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 1 -- 172.21.15.5:0/1374195841 shutdown_connections 2024-08-18T21:11:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 1 -- 172.21.15.5:0/1374195841 wait complete. 2024-08-18T21:11:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 10 monclient: build_initial_monmap 2024-08-18T21:11:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 10 monclient: monmap: 2024-08-18T21:11:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:55.612 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 1 Processor -- start 2024-08-18T21:11:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 1 -- start start 2024-08-18T21:11:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 10 monclient: init 2024-08-18T21:11:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 10 monclient: _add_conns ranks=[3,1,7,6,4,0,5,2,8] 2024-08-18T21:11:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f848009da30 0x7f8480135a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 10 monclient(hunting): picked mon.noname-g con 0x7f848009da30 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f848009e520 0x7f8480135f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 10 monclient(hunting): picked mon.noname-f con 0x7f848009e520 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:11:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8480144b10 0x7f8480072480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 10 monclient(hunting): picked mon.noname-i con 0x7f8480144b10 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8480069a00 con 0x7f848009e520 2024-08-18T21:11:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f84800a2460 con 0x7f848009da30 2024-08-18T21:11:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f8480123290 con 0x7f8480144b10 2024-08-18T21:11:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.600+0000 7f8485d21640 10 monclient(hunting): authenticate will time out at 1482.619742s 2024-08-18T21:11:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847ffff640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8480144b10 0x7f8480072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f848009da30 0x7f8480135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847effd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f848009e520 0x7f8480135f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847ffff640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8480144b10 0x7f8480072480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:41470/0 (socket says 172.21.15.5:41470) 2024-08-18T21:11:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847ffff640 1 -- 172.21.15.5:0/4002479635 learned_addr learned my addr 172.21.15.5:0/4002479635 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847ffff640 10 monclient(hunting): get_auth_request con 0x7f8480144b10 auth_method 0 2024-08-18T21:11:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 10 monclient(hunting): get_auth_request con 0x7f848009da30 auth_method 0 2024-08-18T21:11:55.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847effd640 10 monclient(hunting): get_auth_request con 0x7f848009e520 auth_method 0 2024-08-18T21:11:55.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 10 monclient(hunting): handle_auth_done global_id 85233 payload 824 2024-08-18T21:11:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 1 -- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8480144b10 msgr2=0x7f8480072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8480144b10 0x7f8480072480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 1 -- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f848009e520 msgr2=0x7f8480135f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f848009e520 0x7f8480135f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:11:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 1 monclient: found mon.noname-g 2024-08-18T21:11:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:11:55.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 1 -- 172.21.15.5:0/4002479635 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8480074410 con 0x7f848009da30 2024-08-18T21:11:55.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847ffff640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8480144b10 0x7f8480072480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:55.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847effd640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f848009e520 0x7f8480135f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:55.618 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:55.618 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:11:55.619 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:11:55.619 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:11:55.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 1 -- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f848009da30 msgr2=0x7f8480135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847f7fe640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f848009da30 0x7f8480135a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f847400c3e0 tx=0x7f847400c8a0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8467fff640 1 -- 172.21.15.5:0/4002479635 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8474011c10 con 0x7f848009da30 2024-08-18T21:11:55.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8467fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8467fff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:11:55.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8467fff640 10 monclient: dump: 2024-08-18T21:11:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.624 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8467fff640 10 monclient: _finish_auth 0 2024-08-18T21:11:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8467fff640 10 monclient: _check_auth_tickets 2024-08-18T21:11:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8467fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8467fff640 1 -- 172.21.15.5:0/4002479635 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8474017070 con 0x7f848009da30 2024-08-18T21:11:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8485d21640 5 monclient: authenticate success, global_id 85233 2024-08-18T21:11:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8485d21640 10 monclient: _renew_subs 2024-08-18T21:11:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8485d21640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.157:3301/0 2024-08-18T21:11:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8485d21640 1 -- 172.21.15.5:0/4002479635 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8480138100 con 0x7f848009da30 2024-08-18T21:11:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8467fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8467fff640 1 -- 172.21.15.5:0/4002479635 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8474011df0 con 0x7f848009da30 2024-08-18T21:11:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8467fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8467fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:11:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8467fff640 10 monclient: dump: 2024-08-18T21:11:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.626 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.626 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.626 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.626 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.626 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8485d21640 10 monclient: _renew_subs 2024-08-18T21:11:55.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f847dffb640 4 set_mon_vals no callback set 2024-08-18T21:11:55.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8485d21640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.157:3301/0 2024-08-18T21:11:55.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.604+0000 7f8485d21640 1 -- 172.21.15.5:0/4002479635 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f84800a20c0 con 0x7f848009da30 2024-08-18T21:11:55.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f8485d21640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:55.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f8485d21640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84800729c0 0x7f8480072da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f8485d21640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f8485d21640 1 -- 172.21.15.5:0/4002479635 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f8480051140 con 0x7f84800729c0 2024-08-18T21:11:55.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f847effd640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84800729c0 0x7f8480072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f847effd640 10 monclient: get_auth_request con 0x7f84800729c0 auth_method 0 2024-08-18T21:11:55.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f847effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f847effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f847effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f847effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f847effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f847effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f8467fff640 1 -- 172.21.15.5:0/4002479635 <== mon.3 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f84740117a0 con 0x7f848009da30 2024-08-18T21:11:55.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f847effd640 10 monclient(hunting): handle_auth_done global_id 6577 payload 824 2024-08-18T21:11:55.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f847effd640 1 -- 172.21.15.5:0/4002479635 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f848009de10 con 0x7f84800729c0 2024-08-18T21:11:55.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f8467fff640 1 --2- 172.21.15.5:0/4002479635 >> v2:172.21.15.157:6812/631023601 conn(0x7f846c03bdc0 0x7f846c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f8467fff640 1 -- 172.21.15.5:0/4002479635 <== mon.3 v2:172.21.15.157:3301/0 5 ==== osd_map(240..240 src has 22..240) ==== 3506+0+0 (secure 0 0 0) 0x7f847404dc40 con 0x7f848009da30 2024-08-18T21:11:55.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f847ffff640 1 --2- 172.21.15.5:0/4002479635 >> v2:172.21.15.157:6812/631023601 conn(0x7f846c03bdc0 0x7f846c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f847ffff640 10 monclient: get_auth_request con 0x7f846c03bdc0 auth_method 0 2024-08-18T21:11:55.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f847effd640 1 -- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84800729c0 msgr2=0x7f8480072da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f847effd640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84800729c0 0x7f8480072da0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f847000eae0 tx=0x7f8470009ef0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f8467fff640 1 -- 172.21.15.5:0/4002479635 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8470017070 con 0x7f84800729c0 2024-08-18T21:11:55.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f8467fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f8467fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:11:55.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.608+0000 7f8467fff640 10 monclient: dump: 2024-08-18T21:11:55.628 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.628 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.628 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.628 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.628 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.628 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.629 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.629 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.629 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.629 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.629 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.629 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.629 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.629 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.629 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.629 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.612+0000 7f8467fff640 1 -- 172.21.15.5:0/4002479635 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f847000cdc0 con 0x7f84800729c0 2024-08-18T21:11:55.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.612+0000 7f8467fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:55.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.612+0000 7f8467fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:55.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.612+0000 7f8467fff640 1 -- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84800729c0 msgr2=0x7f8480072da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.612+0000 7f8467fff640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84800729c0 0x7f8480072da0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f847000eae0 tx=0x7f8470009ef0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.612+0000 7f8467fff640 1 -- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84800729c0 msgr2=0x7f8480072da0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:55.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.612+0000 7f847ffff640 1 --2- 172.21.15.5:0/4002479635 >> v2:172.21.15.157:6812/631023601 conn(0x7f846c03bdc0 0x7f846c03e280 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f847801c770 tx=0x7f84780a7000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.612+0000 7f8467fff640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84800729c0 0x7f8480072da0 secure :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f847000eae0 tx=0x7f8470009ef0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.616+0000 7f8485d21640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:11:55.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.616+0000 7f8485d21640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84800732e0 0x7f8480120680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.616+0000 7f8485d21640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.616+0000 7f8485d21640 1 -- 172.21.15.5:0/4002479635 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f848006d150 con 0x7f84800732e0 2024-08-18T21:11:55.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.616+0000 7f847effd640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84800732e0 0x7f8480120680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.616+0000 7f847effd640 10 monclient: get_auth_request con 0x7f84800732e0 auth_method 0 2024-08-18T21:11:55.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.616+0000 7f847effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.616+0000 7f847effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.616+0000 7f847effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.616+0000 7f847effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.616+0000 7f847effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.620+0000 7f847effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.620+0000 7f847effd640 10 monclient(hunting): handle_auth_done global_id 6586 payload 824 2024-08-18T21:11:55.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.620+0000 7f847effd640 1 -- 172.21.15.5:0/4002479635 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f84801368b0 con 0x7f84800732e0 2024-08-18T21:11:55.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.620+0000 7f847effd640 1 -- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84800732e0 msgr2=0x7f8480120680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.620+0000 7f847effd640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84800732e0 0x7f8480120680 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8470019000 tx=0x7f8470004780 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.620+0000 7f8467fff640 1 -- 172.21.15.5:0/4002479635 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8470017070 con 0x7f84800732e0 2024-08-18T21:11:55.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.620+0000 7f8467fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.620+0000 7f8467fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:11:55.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.620+0000 7f8467fff640 10 monclient: dump: 2024-08-18T21:11:55.632 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.634 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.620+0000 7f8467fff640 1 -- 172.21.15.5:0/4002479635 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f8470013470 con 0x7f84800732e0 2024-08-18T21:11:55.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.620+0000 7f8467fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:11:55.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.620+0000 7f8467fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:55.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.620+0000 7f8467fff640 1 -- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84800732e0 msgr2=0x7f8480120680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.620+0000 7f8467fff640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84800732e0 0x7f8480120680 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8470019000 tx=0x7f8470004780 comp rx=0 tx=0).stop 2024-08-18T21:11:55.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.620+0000 7f8467fff640 1 -- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84800732e0 msgr2=0x7f8480120680 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:11:55.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.620+0000 7f8467fff640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f84800732e0 0x7f8480120680 secure :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8470019000 tx=0x7f8470004780 comp rx=0 tx=0).stop 2024-08-18T21:11:55.634 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:11:55.635 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:55.635 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:55.635 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:11:55.635 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 178, 2024-08-18T21:11:55.635 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 524720, 2024-08-18T21:11:55.635 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:11:55.635 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:11:55.635 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:11:55.635 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:11:55.635 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:11:55.635 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:11:55.635 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:11:55.635 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:11:55.635 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:11:55.636 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:11:55.636 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.636 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 8, 2024-08-18T21:11:55.636 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:55.636 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:11:55.636 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:11:55.636 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:55.636 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:55.636 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:55.636 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:55.636 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:55.636 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:55.636 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:55.637 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:55.637 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:55.637 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:55.637 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:55.637 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.637 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:11:55.637 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:11:55.637 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:55.637 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:55.637 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:55.637 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:55.637 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:55.637 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:55.637 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:55.638 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:55.638 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:55.638 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:55.638 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:55.638 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.638 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:11:55.638 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:11:55.638 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:11:55.638 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:11:55.638 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:11:55.638 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:11:55.638 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:11:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:11:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:11:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:11:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:11:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:11:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:11:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:11:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:11:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:11:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:11:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:11:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:11:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:11:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:11:55.640 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:11:55.640 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:11:55.640 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:11:55.640 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:11:55.640 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:11:55.640 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:11:55.640 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.640 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:11:55.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.640 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:11:55.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.640 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:11:55.640 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:11:55.640 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.641 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.641 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.641 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:11:55.641 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.641 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.641 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:11:55.641 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.641 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.641 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.641 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:11:55.642 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:11:55.642 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.642 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.642 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.642 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:11:55.642 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:11:55.642 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.642 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.642 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.642 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:11:55.642 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.643 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.643 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.643 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:11:55.643 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.643 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.643 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.643 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:11:55.643 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:11:55.643 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.643 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.643 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.644 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:11:55.644 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:11:55.644 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.644 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.644 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.644 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:11:55.644 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.644 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.644 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:11:55.645 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.645 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.645 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.645 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:11:55.645 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:11:55.645 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.645 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.645 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.645 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.645 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:11:55.645 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:11:55.645 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.646 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.646 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.646 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:11:55.646 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.646 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.646 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:11:55.646 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.646 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.646 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.646 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:11:55.647 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:11:55.647 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.647 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.647 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.647 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.647 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:11:55.647 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:11:55.647 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.647 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.647 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.647 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.647 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:11:55.647 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.648 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.648 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:11:55.648 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.648 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.648 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.648 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:11:55.648 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:11:55.648 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.648 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.648 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.649 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:11:55.649 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:11:55.649 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.649 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.649 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.649 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:11:55.649 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.649 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.649 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:11:55.649 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.650 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.650 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.650 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:11:55.650 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:11:55.650 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.650 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.650 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.650 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.650 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:11:55.650 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:11:55.650 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.650 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.651 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.651 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:11:55.651 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.651 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.651 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:11:55.651 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.651 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.651 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.651 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:11:55.651 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:11:55.652 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.652 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.652 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.652 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.652 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:11:55.652 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:11:55.652 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.652 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.652 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.652 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.652 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:11:55.652 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.653 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.653 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:11:55.653 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.653 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.653 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.653 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:11:55.653 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:11:55.653 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.653 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.653 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.654 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:11:55.654 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:11:55.654 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:11:55.654 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:11:55.654 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.654 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:11:55.654 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:11:55.654 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.654 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.654 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:11:55.654 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:11:55.655 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:11:55.655 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.655 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.655 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:11:55.655 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:11:55.655 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:11:55.655 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:11:55.655 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:11:55.655 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.655 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.655 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:11:55.655 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:11:55.655 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.656 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:55.656 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:55.656 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:11:55.656 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.656 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.656 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:11:55.656 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.656 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:55.656 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:55.656 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:11:55.656 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.656 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:11:55.656 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:11:55.656 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:11:55.657 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:11:55.657 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:11:55.657 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:11:55.657 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:11:55.657 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:11:55.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:11:55.657 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:11:55.657 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:11:55.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.624+0000 7f8485d21640 1 -- 172.21.15.5:0/4002479635 >> v2:172.21.15.157:6812/631023601 conn(0x7f846c03bdc0 msgr2=0x7f846c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.624+0000 7f8485d21640 1 --2- 172.21.15.5:0/4002479635 >> v2:172.21.15.157:6812/631023601 conn(0x7f846c03bdc0 0x7f846c03e280 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f847801c770 tx=0x7f84780a7000 comp rx=0 tx=0).stop 2024-08-18T21:11:55.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.624+0000 7f8485d21640 10 monclient: shutdown 2024-08-18T21:11:55.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.624+0000 7f8485d21640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:55.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.624+0000 7f8485d21640 1 -- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f848009da30 msgr2=0x7f8480135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.624+0000 7f8485d21640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f848009da30 0x7f8480135a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f847400c3e0 tx=0x7f847400c8a0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.624+0000 7f847ffff640 1 -- 172.21.15.5:0/4002479635 reap_dead start 2024-08-18T21:11:55.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.624+0000 7f8485d21640 1 -- 172.21.15.5:0/4002479635 shutdown_connections 2024-08-18T21:11:55.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.624+0000 7f8485d21640 1 --2- 172.21.15.5:0/4002479635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f848009da30 0x7f8480135a40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.624+0000 7f8485d21640 1 -- 172.21.15.5:0/4002479635 >> 172.21.15.5:0/4002479635 conn(0x7f84800a4b20 msgr2=0x7f84800a3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:55.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.624+0000 7f8485d21640 1 -- 172.21.15.5:0/4002479635 shutdown_connections 2024-08-18T21:11:55.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.624+0000 7f8485d21640 1 -- 172.21.15.5:0/4002479635 wait complete. 2024-08-18T21:11:55.660 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:11:55.660 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['i', 'g', 'a', 'f'] 2024-08-18T21:11:55.660 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-18T21:11:55.660 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i 2024-08-18T21:11:55.660 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2024-08-18T21:11:55.660 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2024-08-18T21:11:55.660 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:11:55.673 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.674 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3111022131}) 2024-08-18T21:11:55.674 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2244251152}) 2024-08-18T21:11:55.674 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.674 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3111022131}) 2024-08-18T21:11:55.674 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1204528710}) 2024-08-18T21:11:55.674 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.674 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3111022131}) 2024-08-18T21:11:55.674 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1527676529}) 2024-08-18T21:11:55.674 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.674 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3111022131}) 2024-08-18T21:11:55.674 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3685555977}) 2024-08-18T21:11:55.674 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.675 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3111022131}) 2024-08-18T21:11:55.675 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3790626710}) 2024-08-18T21:11:55.675 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.675 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3111022131}) 2024-08-18T21:11:55.675 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3131933878}) 2024-08-18T21:11:55.675 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.675 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3111022131}) 2024-08-18T21:11:55.675 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3019164975}) 2024-08-18T21:11:55.675 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:11:55.675 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3111022131}) 2024-08-18T21:11:55.675 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:11:55.668+0000 7fec5a611640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=987150339}) 2024-08-18T21:11:55.679 INFO:tasks.ceph.mon.i:Stopped 2024-08-18T21:11:55.680 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.g 2024-08-18T21:11:55.680 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2024-08-18T21:11:55.680 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-08-18T21:11:55.680 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:11:55.738 INFO:tasks.ceph.mon.g:Stopped 2024-08-18T21:11:55.738 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-18T21:11:55.738 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-18T21:11:55.739 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-18T21:11:55.739 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:11:55.755 INFO:tasks.ceph.mon.a:Stopped 2024-08-18T21:11:55.755 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.f 2024-08-18T21:11:55.755 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2024-08-18T21:11:55.755 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-08-18T21:11:55.756 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:11:55.795 INFO:tasks.ceph.mon.f:Stopped 2024-08-18T21:11:55.795 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 5 2024-08-18T21:11:55.795 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:11:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 10 monclient: get_monmap_and_config 2024-08-18T21:11:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 10 monclient: build_initial_monmap 2024-08-18T21:11:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 10 monclient: monmap: 2024-08-18T21:11:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:55.930289+0000 2024-08-18T21:11:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:55.930289+0000 2024-08-18T21:11:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:55.930 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:55.930 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 1 Processor -- start 2024-08-18T21:11:55.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 1 -- start start 2024-08-18T21:11:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 10 monclient: init 2024-08-18T21:11:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 10 monclient: _add_conns ranks=[7,0,2,10,3,1,9,4,5,6,8] 2024-08-18T21:11:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f76e00a5a50 0x7f76e0137800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 10 monclient(hunting): picked mon.noname-i con 0x7f76e00a5a50 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:11:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f76e0137d40 addr v1:172.21.15.5:6789/0 2024-08-18T21:11:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f76e0138120 0x7f76e00a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 10 monclient(hunting): picked mon.noname-b con 0x7f76e0138120 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:11:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e00a67a0 con 0x7f76e0137d40 2024-08-18T21:11:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f76e00a3740 con 0x7f76e0138120 2024-08-18T21:11:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f76e00a2660 con 0x7f76e00a5a50 2024-08-18T21:11:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76e5f2e640 10 monclient(hunting): authenticate will time out at 1482.943491s 2024-08-18T21:11:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76deffd640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7f76e0137d40 legacy=0x7f76e00a1540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:11:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76df7fe640 1 -- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f76e00a5a50 msgr2=0x7f76e0137800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:11:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f76e0138120 0x7f76e00a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76df7fe640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f76e00a5a50 0x7f76e0137800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f76e0138120 0x7f76e00a1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:34680/0 (socket says 172.21.15.5:34680) 2024-08-18T21:11:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 1 -- 172.21.15.5:0/1476942581 learned_addr learned my addr 172.21.15.5:0/1476942581 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 10 monclient(hunting): get_auth_request con 0x7f76e0138120 auth_method 0 2024-08-18T21:11:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 10 monclient(hunting): handle_auth_done global_id 114221 payload 274 2024-08-18T21:11:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 1 -- 172.21.15.5:0/1476942581 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f76e00a5a50 msgr2=0x7f76e0137800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 1 --2- 172.21.15.5:0/1476942581 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f76e00a5a50 0x7f76e0137800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 1 -- 172.21.15.5:0/1476942581 >> v1:172.21.15.5:6789/0 conn(0x7f76e0137d40 legacy=0x7f76e00a1540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 10 monclient: _finish_hunting 0 2024-08-18T21:11:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 1 monclient: found mon.noname-b 2024-08-18T21:11:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:11:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.924+0000 7f76dffff640 1 -- 172.21.15.5:0/1476942581 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e00a2f70 con 0x7f76e0138120 2024-08-18T21:11:55.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76dffff640 1 -- 172.21.15.5:0/1476942581 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f76e0138120 msgr2=0x7f76e00a1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76dffff640 1 --2- 172.21.15.5:0/1476942581 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f76e0138120 0x7f76e00a1c50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009e80 tx=0x7f76d801c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4859db19e518f454 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76de7fc640 1 -- 172.21.15.5:0/1476942581 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f76d80091b0 con 0x7f76e0138120 2024-08-18T21:11:55.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76de7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76de7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:11:55.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76de7fc640 10 monclient: dump: 2024-08-18T21:11:55.938 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.938 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.940 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76de7fc640 10 monclient: _finish_auth 0 2024-08-18T21:11:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76de7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:11:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76de7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76de7fc640 1 -- 172.21.15.5:0/1476942581 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d80a5b50 con 0x7f76e0138120 2024-08-18T21:11:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76de7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76de7fc640 1 -- 172.21.15.5:0/1476942581 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f76d80a5d00 con 0x7f76e0138120 2024-08-18T21:11:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76de7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76de7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:11:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76de7fc640 10 monclient: dump: 2024-08-18T21:11:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.942 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 5 monclient: authenticate success, global_id 114221 2024-08-18T21:11:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 4 set_mon_vals no callback set 2024-08-18T21:11:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 10 monclient: shutdown 2024-08-18T21:11:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 1 -- 172.21.15.5:0/1476942581 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f76e0138120 msgr2=0x7f76e00a1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 1 --2- 172.21.15.5:0/1476942581 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f76e0138120 0x7f76e00a1c50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009e80 tx=0x7f76d801c900 comp rx=0 tx=0).stop 2024-08-18T21:11:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 1 -- 172.21.15.5:0/1476942581 shutdown_connections 2024-08-18T21:11:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 1 --2- 172.21.15.5:0/1476942581 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f76e0138120 0x7f76e00a1c50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 1 --2- 172.21.15.5:0/1476942581 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f76e00a5a50 0x7f76e0137800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 1 -- 172.21.15.5:0/1476942581 >> 172.21.15.5:0/1476942581 conn(0x7f76e00688d0 msgr2=0x7f76e0068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 1 -- 172.21.15.5:0/1476942581 shutdown_connections 2024-08-18T21:11:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 1 -- 172.21.15.5:0/1476942581 wait complete. 2024-08-18T21:11:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 10 monclient: build_initial_monmap 2024-08-18T21:11:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 10 monclient: monmap: 2024-08-18T21:11:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:55.945 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 1 Processor -- start 2024-08-18T21:11:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 1 -- start start 2024-08-18T21:11:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 10 monclient: init 2024-08-18T21:11:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 10 monclient: _add_conns ranks=[8,6,3,0,1,4,5,7,2] 2024-08-18T21:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f76e00a5a50 0x7f76e0136df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 10 monclient(hunting): picked mon.noname-e con 0x7f76e00a5a50 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f76e0137d40 0x7f76e006db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 10 monclient(hunting): picked mon.noname-d con 0x7f76e0137d40 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76e0138120 0x7f76e006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 10 monclient(hunting): picked mon.noname-g con 0x7f76e0138120 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f76e0138500 con 0x7f76e0138120 2024-08-18T21:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f76e0142490 con 0x7f76e0137d40 2024-08-18T21:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f76e013b8c0 con 0x7f76e00a5a50 2024-08-18T21:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76e5f2e640 10 monclient(hunting): authenticate will time out at 1482.950511s 2024-08-18T21:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f76e00a5a50 0x7f76e0136df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f76e00a5a50 0x7f76e0136df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:55610/0 (socket says 172.21.15.5:55610) 2024-08-18T21:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 1 -- 172.21.15.5:0/3659871368 learned_addr learned my addr 172.21.15.5:0/3659871368 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 10 monclient(hunting): get_auth_request con 0x7f76e00a5a50 auth_method 0 2024-08-18T21:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76deffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f76e0137d40 0x7f76e006db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76dffff640 1 -- 172.21.15.5:0/3659871368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76e0138120 msgr2=0x7f76e006e090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76deffd640 10 monclient(hunting): get_auth_request con 0x7f76e0137d40 auth_method 0 2024-08-18T21:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76deffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76deffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76deffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76dffff640 1 --2- 172.21.15.5:0/3659871368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76e0138120 0x7f76e006e090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76deffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76deffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76deffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 10 monclient(hunting): handle_auth_done global_id 114344 payload 824 2024-08-18T21:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 1 -- 172.21.15.5:0/3659871368 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f76e0137d40 msgr2=0x7f76e006db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 1 --2- 172.21.15.5:0/3659871368 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f76e0137d40 0x7f76e006db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 1 -- 172.21.15.5:0/3659871368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76e0138120 msgr2=0x7f76e006e090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:11:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 1 --2- 172.21.15.5:0/3659871368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76e0138120 0x7f76e006e090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:11:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 1 monclient: found mon.noname-e 2024-08-18T21:11:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:11:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76df7fe640 1 -- 172.21.15.5:0/3659871368 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e0068d40 con 0x7f76e00a5a50 2024-08-18T21:11:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.932+0000 7f76deffd640 1 --2- 172.21.15.5:0/3659871368 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f76e0137d40 0x7f76e006db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76df7fe640 1 -- 172.21.15.5:0/3659871368 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f76e00a5a50 msgr2=0x7f76e0136df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76df7fe640 1 --2- 172.21.15.5:0/3659871368 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f76e00a5a50 0x7f76e0136df0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f76d400b530 tx=0x7f76d400b9f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76c7fff640 1 -- 172.21.15.5:0/3659871368 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f76d4013020 con 0x7f76e00a5a50 2024-08-18T21:11:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76c7fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:11:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76c7fff640 10 monclient: dump: 2024-08-18T21:11:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.953 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76c7fff640 10 monclient: _finish_auth 0 2024-08-18T21:11:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76c7fff640 10 monclient: _check_auth_tickets 2024-08-18T21:11:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76e5f2e640 5 monclient: authenticate success, global_id 114344 2024-08-18T21:11:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76c7fff640 1 -- 172.21.15.5:0/3659871368 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d4003de0 con 0x7f76e00a5a50 2024-08-18T21:11:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76e5f2e640 10 monclient: _renew_subs 2024-08-18T21:11:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76e5f2e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76e5f2e640 1 -- 172.21.15.5:0/3659871368 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e013cfb0 con 0x7f76e00a5a50 2024-08-18T21:11:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76c7fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76c7fff640 1 -- 172.21.15.5:0/3659871368 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f76d400f400 con 0x7f76e00a5a50 2024-08-18T21:11:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76c7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76ddffb640 4 set_mon_vals no callback set 2024-08-18T21:11:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76c7fff640 10 monclient: dump: 2024-08-18T21:11:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:55.955 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76e5f2e640 10 monclient: _renew_subs 2024-08-18T21:11:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76e5f2e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76e5f2e640 1 -- 172.21.15.5:0/3659871368 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e0073e00 con 0x7f76e00a5a50 2024-08-18T21:11:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76c7fff640 1 -- 172.21.15.5:0/3659871368 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f76d4016020 con 0x7f76e00a5a50 2024-08-18T21:11:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76e5f2e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76e5f2e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76e5f2e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76e5f2e640 1 -- 172.21.15.5:0/3659871368 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76e013ba90 con 0x7f76e00a5a50 2024-08-18T21:11:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76c7fff640 1 --2- 172.21.15.5:0/3659871368 >> v2:172.21.15.157:6812/631023601 conn(0x7f76cc03bdc0 0x7f76cc03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76c7fff640 1 -- 172.21.15.5:0/3659871368 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(240..240 src has 22..240) ==== 3506+0+0 (secure 0 0 0) 0x7f76d404e120 con 0x7f76e00a5a50 2024-08-18T21:11:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76deffd640 1 --2- 172.21.15.5:0/3659871368 >> v2:172.21.15.157:6812/631023601 conn(0x7f76cc03bdc0 0x7f76cc03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.936+0000 7f76deffd640 10 monclient: get_auth_request con 0x7f76cc03bdc0 auth_method 0 2024-08-18T21:11:55.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.940+0000 7f76deffd640 1 --2- 172.21.15.5:0/3659871368 >> v2:172.21.15.157:6812/631023601 conn(0x7f76cc03bdc0 0x7f76cc03e280 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f76e006f1c0 tx=0x7f76d0009110 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:55.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.940+0000 7f76c7fff640 1 -- 172.21.15.5:0/3659871368 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f76d401d020 con 0x7f76e00a5a50 2024-08-18T21:11:55.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.940+0000 7f76c7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:55.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:55.940+0000 7f76c7fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:56.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.176+0000 7f76e5f2e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:11:56.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.176+0000 7f76e5f2e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:11:56.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.176+0000 7f76e5f2e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:56.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.176+0000 7f76e5f2e640 1 -- 172.21.15.5:0/3659871368 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f76e013bd60 con 0x7f76e00a5a50 2024-08-18T21:11:56.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76c7fff640 1 -- 172.21.15.5:0/3659871368 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7f76e0068d40 con 0x7f76e00a5a50 2024-08-18T21:11:56.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76c7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:11:56.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76c7fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:56.182 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":178,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:11:56.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76e5f2e640 1 -- 172.21.15.5:0/3659871368 >> v2:172.21.15.157:6812/631023601 conn(0x7f76cc03bdc0 msgr2=0x7f76cc03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:56.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76e5f2e640 1 --2- 172.21.15.5:0/3659871368 >> v2:172.21.15.157:6812/631023601 conn(0x7f76cc03bdc0 0x7f76cc03e280 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f76e006f1c0 tx=0x7f76d0009110 comp rx=0 tx=0).stop 2024-08-18T21:11:56.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76e5f2e640 10 monclient: shutdown 2024-08-18T21:11:56.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76e5f2e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:56.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76e5f2e640 1 -- 172.21.15.5:0/3659871368 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f76e00a5a50 msgr2=0x7f76e0136df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:56.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76e5f2e640 1 --2- 172.21.15.5:0/3659871368 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f76e00a5a50 0x7f76e0136df0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f76d400b530 tx=0x7f76d400b9f0 comp rx=0 tx=0).stop 2024-08-18T21:11:56.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76e5f2e640 1 -- 172.21.15.5:0/3659871368 shutdown_connections 2024-08-18T21:11:56.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76e5f2e640 1 --2- 172.21.15.5:0/3659871368 >> v2:172.21.15.157:6812/631023601 conn(0x7f76cc03bdc0 0x7f76cc03e280 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:56.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76e5f2e640 1 --2- 172.21.15.5:0/3659871368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76e0138120 0x7f76e006e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:56.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76e5f2e640 1 --2- 172.21.15.5:0/3659871368 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f76e0137d40 0x7f76e006db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:56.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76e5f2e640 1 --2- 172.21.15.5:0/3659871368 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f76e00a5a50 0x7f76e0136df0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:56.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76e5f2e640 1 -- 172.21.15.5:0/3659871368 >> 172.21.15.5:0/3659871368 conn(0x7f76e00688d0 msgr2=0x7f76e00a9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:56.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76e5f2e640 1 -- 172.21.15.5:0/3659871368 shutdown_connections 2024-08-18T21:11:56.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:56.180+0000 7f76e5f2e640 1 -- 172.21.15.5:0/3659871368 wait complete. 2024-08-18T21:11:59.202 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:11:59.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 10 monclient: get_monmap_and_config 2024-08-18T21:11:59.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 10 monclient: build_initial_monmap 2024-08-18T21:11:59.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 10 monclient: monmap: 2024-08-18T21:11:59.335 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:59.335 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:11:59.338114+0000 2024-08-18T21:11:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:11:59.338114+0000 2024-08-18T21:11:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:11:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:11:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:59.337 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:59.337 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:11:59.337 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:11:59.337 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 1 Processor -- start 2024-08-18T21:11:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 1 -- start start 2024-08-18T21:11:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 10 monclient: init 2024-08-18T21:11:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 10 monclient: _add_conns ranks=[10,3,8,4,1,7,5,6,0,2,9] 2024-08-18T21:11:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6fa00a6ce0 0x7f6fa00a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 10 monclient(hunting): picked mon.noname-f con 0x7f6fa00a6ce0 addr v2:172.21.15.157:3300/0 2024-08-18T21:11:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa00a7600 0x7f6fa0139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 10 monclient(hunting): picked mon.noname-g con 0x7f6fa00a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:11:59.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6fa0139fe0 0x7f6fa013a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:59.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 10 monclient(hunting): picked mon.noname-e con 0x7f6fa0139fe0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:59.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:59.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f6fa00a5000 con 0x7f6fa00a6ce0 2024-08-18T21:11:59.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:59.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa00a4360 con 0x7f6fa00a7600 2024-08-18T21:11:59.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:59.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f6fa00a45d0 con 0x7f6fa0139fe0 2024-08-18T21:11:59.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:59.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa75de640 10 monclient(hunting): authenticate will time out at 1486.351336s 2024-08-18T21:11:59.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa4b79640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa00a7600 msgr2=0x7f6fa0139aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:11:59.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa5b7b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6fa0139fe0 0x7f6fa013a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:59.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa537a640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7f6fa00a6ce0 msgr2=0x7f6fa00a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:11:59.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa4b79640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa00a7600 0x7f6fa0139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:59.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa537a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6fa00a6ce0 0x7f6fa00a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:59.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa5b7b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6fa0139fe0 0x7f6fa013a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:55618/0 (socket says 172.21.15.5:55618) 2024-08-18T21:11:59.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa5b7b640 1 -- 172.21.15.5:0/1091378455 learned_addr learned my addr 172.21.15.5:0/1091378455 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:59.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa5b7b640 10 monclient(hunting): get_auth_request con 0x7f6fa0139fe0 auth_method 0 2024-08-18T21:11:59.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa5b7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:59.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa5b7b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:59.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa5b7b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:59.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa5b7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:59.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa5b7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:59.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.332+0000 7f6fa5b7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:59.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.336+0000 7f6fa5b7b640 10 monclient(hunting): handle_auth_done global_id 114353 payload 274 2024-08-18T21:11:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.336+0000 7f6fa5b7b640 1 -- 172.21.15.5:0/1091378455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa00a7600 msgr2=0x7f6fa0139aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.336+0000 7f6fa5b7b640 1 --2- 172.21.15.5:0/1091378455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa00a7600 0x7f6fa0139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.336+0000 7f6fa5b7b640 1 -- 172.21.15.5:0/1091378455 >> v2:172.21.15.157:3300/0 conn(0x7f6fa00a6ce0 msgr2=0x7f6fa00a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:11:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.336+0000 7f6fa5b7b640 1 --2- 172.21.15.5:0/1091378455 >> v2:172.21.15.157:3300/0 conn(0x7f6fa00a6ce0 0x7f6fa00a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.336+0000 7f6fa5b7b640 10 monclient: _finish_hunting 0 2024-08-18T21:11:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.336+0000 7f6fa5b7b640 1 monclient: found mon.noname-e 2024-08-18T21:11:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.336+0000 7f6fa5b7b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.336+0000 7f6fa5b7b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:11:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.336+0000 7f6fa5b7b640 1 -- 172.21.15.5:0/1091378455 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa00a32d0 con 0x7f6fa0139fe0 2024-08-18T21:11:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa5b7b640 1 -- 172.21.15.5:0/1091378455 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6fa0139fe0 msgr2=0x7f6fa013a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa5b7b640 1 --2- 172.21.15.5:0/1091378455 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6fa0139fe0 0x7f6fa013a440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6f900098a0 tx=0x7f6f9001c440 comp rx=0 tx=0).ready entity=mon.8 client_cookie=f8775d65674fc0d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6f97fff640 1 -- 172.21.15.5:0/1091378455 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6f900b0070 con 0x7f6fa0139fe0 2024-08-18T21:11:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6f97fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6f97fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:11:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6f97fff640 10 monclient: dump: 2024-08-18T21:11:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:59.349 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:59.349 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:59.349 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:59.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6f97fff640 10 monclient: _finish_auth 0 2024-08-18T21:11:59.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6f97fff640 10 monclient: _check_auth_tickets 2024-08-18T21:11:59.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6f97fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:59.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6f97fff640 1 -- 172.21.15.5:0/1091378455 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f900aa810 con 0x7f6fa0139fe0 2024-08-18T21:11:59.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6f97fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:59.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6f97fff640 1 -- 172.21.15.5:0/1091378455 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6f900aae30 con 0x7f6fa0139fe0 2024-08-18T21:11:59.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6f97fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:59.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6f97fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:59.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6f97fff640 10 monclient: dump: 2024-08-18T21:11:59.350 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:59.350 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:59.350 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:59.350 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:59.350 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:59.350 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:59.350 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:59.350 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:59.350 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:59.350 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:59.350 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:59.350 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:59.351 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:59.351 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:59.351 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:59.351 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:59.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 5 monclient: authenticate success, global_id 114353 2024-08-18T21:11:59.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 10 monclient: get_monmap_and_config success 2024-08-18T21:11:59.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 4 set_mon_vals no callback set 2024-08-18T21:11:59.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 10 monclient: shutdown 2024-08-18T21:11:59.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:59.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 1 -- 172.21.15.5:0/1091378455 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6fa0139fe0 msgr2=0x7f6fa013a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:59.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 1 --2- 172.21.15.5:0/1091378455 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6fa0139fe0 0x7f6fa013a440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6f900098a0 tx=0x7f6f9001c440 comp rx=0 tx=0).stop 2024-08-18T21:11:59.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 1 -- 172.21.15.5:0/1091378455 shutdown_connections 2024-08-18T21:11:59.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 1 --2- 172.21.15.5:0/1091378455 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6fa0139fe0 0x7f6fa013a440 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:59.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 1 --2- 172.21.15.5:0/1091378455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa00a7600 0x7f6fa0139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:59.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 1 --2- 172.21.15.5:0/1091378455 >> v2:172.21.15.157:3300/0 conn(0x7f6fa00a6ce0 0x7f6fa00a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:59.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 1 -- 172.21.15.5:0/1091378455 >> 172.21.15.5:0/1091378455 conn(0x7f6fa00acbc0 msgr2=0x7f6fa00a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:59.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 1 -- 172.21.15.5:0/1091378455 shutdown_connections 2024-08-18T21:11:59.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 1 -- 172.21.15.5:0/1091378455 wait complete. 2024-08-18T21:11:59.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 10 monclient: build_initial_monmap 2024-08-18T21:11:59.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 10 monclient: monmap: 2024-08-18T21:11:59.352 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:11:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:11:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:11:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:11:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:11:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:11:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:11:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:11:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:11:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:11:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:11:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:11:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:11:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:11:59.354 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:59.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 1 Processor -- start 2024-08-18T21:11:59.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 1 -- start start 2024-08-18T21:11:59.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.340+0000 7f6fa75de640 10 monclient: init 2024-08-18T21:11:59.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 10 monclient: _reopen_session rank -1 2024-08-18T21:11:59.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 10 monclient: _add_conns ranks=[0,2,8,5,4,6,7,1,3] 2024-08-18T21:11:59.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa00a6ce0 0x7f6fa0135230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:59.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 10 monclient(hunting): picked mon.noname-a con 0x7f6fa00a6ce0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:11:59.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6fa00a7600 0x7f6fa013aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:59.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 10 monclient(hunting): picked mon.noname-b con 0x7f6fa00a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:11:59.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6fa0139fe0 0x7f6fa013afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:59.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 10 monclient(hunting): picked mon.noname-e con 0x7f6fa0139fe0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:11:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa00a79e0 con 0x7f6fa00a6ce0 2024-08-18T21:11:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa00a8220 con 0x7f6fa00a7600 2024-08-18T21:11:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 10 monclient(hunting): start opening mon connection 2024-08-18T21:11:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f6fa013c380 con 0x7f6fa0139fe0 2024-08-18T21:11:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 10 monclient(hunting): _renew_subs 2024-08-18T21:11:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 10 monclient(hunting): authenticate will time out at 1486.360416s 2024-08-18T21:11:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa537a640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa00a6ce0 msgr2=0x7f6fa0135230 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:11:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa537a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa00a6ce0 0x7f6fa0135230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:11:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6fa0139fe0 0x7f6fa013afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa4b79640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6fa00a7600 0x7f6fa013aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6fa0139fe0 0x7f6fa013afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:55634/0 (socket says 172.21.15.5:55634) 2024-08-18T21:11:59.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 1 -- 172.21.15.5:0/2800583655 learned_addr learned my addr 172.21.15.5:0/2800583655 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:11:59.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 10 monclient(hunting): get_auth_request con 0x7f6fa0139fe0 auth_method 0 2024-08-18T21:11:59.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:59.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:59.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:59.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa4b79640 10 monclient(hunting): get_auth_request con 0x7f6fa00a7600 auth_method 0 2024-08-18T21:11:59.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa4b79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:11:59.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa4b79640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:11:59.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa4b79640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:11:59.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:59.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:59.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:59.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa4b79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:11:59.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa4b79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:11:59.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa4b79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:11:59.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 10 monclient(hunting): handle_auth_done global_id 114362 payload 824 2024-08-18T21:11:59.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 1 -- 172.21.15.5:0/2800583655 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6fa00a7600 msgr2=0x7f6fa013aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:59.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 1 --2- 172.21.15.5:0/2800583655 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6fa00a7600 0x7f6fa013aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:59.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 1 -- 172.21.15.5:0/2800583655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa00a6ce0 msgr2=0x7f6fa0135230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:11:59.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 1 --2- 172.21.15.5:0/2800583655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa00a6ce0 0x7f6fa0135230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:59.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 10 monclient: _finish_hunting 0 2024-08-18T21:11:59.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 1 monclient: found mon.noname-e 2024-08-18T21:11:59.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:11:59.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:11:59.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 1 -- 172.21.15.5:0/2800583655 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa013a470 con 0x7f6fa0139fe0 2024-08-18T21:11:59.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa4b79640 1 --2- 172.21.15.5:0/2800583655 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6fa00a7600 0x7f6fa013aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:11:59.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 1 -- 172.21.15.5:0/2800583655 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6fa0139fe0 msgr2=0x7f6fa013afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:11:59.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa5b7b640 1 --2- 172.21.15.5:0/2800583655 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6fa0139fe0 0x7f6fa013afb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6f9001c270 tx=0x7f6f900191e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:59.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6f95ffb640 1 -- 172.21.15.5:0/2800583655 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6f900b0040 con 0x7f6fa0139fe0 2024-08-18T21:11:59.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6f95ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:59.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6f95ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:11:59.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6f95ffb640 10 monclient: dump: 2024-08-18T21:11:59.360 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:59.361 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:59.361 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:59.361 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:59.361 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:59.361 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:59.361 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:59.361 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:59.361 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:59.361 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:59.361 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:59.361 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:59.361 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:59.361 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:59.362 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:59.362 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:59.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6f95ffb640 10 monclient: _finish_auth 0 2024-08-18T21:11:59.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6f95ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:11:59.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6f95ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:11:59.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6f95ffb640 1 -- 172.21.15.5:0/2800583655 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f900ba070 con 0x7f6fa0139fe0 2024-08-18T21:11:59.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6f95ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:11:59.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6f95ffb640 1 -- 172.21.15.5:0/2800583655 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6f900aae20 con 0x7f6fa0139fe0 2024-08-18T21:11:59.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6f95ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:11:59.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6f95ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:11:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6f95ffb640 10 monclient: dump: 2024-08-18T21:11:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:11:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:11:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:11:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:11:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:11:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:11:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:11:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:11:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:11:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:11:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:11:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:11:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:11:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:11:59.364 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:11:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6f977fe640 4 set_mon_vals no callback set 2024-08-18T21:11:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 5 monclient: authenticate success, global_id 114362 2024-08-18T21:11:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 10 monclient: _renew_subs 2024-08-18T21:11:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 1 -- 172.21.15.5:0/2800583655 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa013de40 con 0x7f6fa0139fe0 2024-08-18T21:11:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 10 monclient: _renew_subs 2024-08-18T21:11:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.344+0000 7f6fa75de640 1 -- 172.21.15.5:0/2800583655 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa013cee0 con 0x7f6fa0139fe0 2024-08-18T21:11:59.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.348+0000 7f6fa75de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:59.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.348+0000 7f6fa75de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:59.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.348+0000 7f6fa75de640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:59.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.348+0000 7f6fa75de640 1 -- 172.21.15.5:0/2800583655 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa013e500 con 0x7f6fa0139fe0 2024-08-18T21:11:59.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.348+0000 7f6f95ffb640 1 -- 172.21.15.5:0/2800583655 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f6f90004240 con 0x7f6fa0139fe0 2024-08-18T21:11:59.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.348+0000 7f6f95ffb640 1 --2- 172.21.15.5:0/2800583655 >> v2:172.21.15.157:6812/631023601 conn(0x7f6f8c03bdc0 0x7f6f8c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:11:59.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.348+0000 7f6f95ffb640 1 -- 172.21.15.5:0/2800583655 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(240..240 src has 22..240) ==== 3506+0+0 (secure 0 0 0) 0x7f6f900e8490 con 0x7f6fa0139fe0 2024-08-18T21:11:59.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.348+0000 7f6fa537a640 1 --2- 172.21.15.5:0/2800583655 >> v2:172.21.15.157:6812/631023601 conn(0x7f6f8c03bdc0 0x7f6f8c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:11:59.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.348+0000 7f6fa537a640 10 monclient: get_auth_request con 0x7f6f8c03bdc0 auth_method 0 2024-08-18T21:11:59.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.352+0000 7f6fa537a640 1 --2- 172.21.15.5:0/2800583655 >> v2:172.21.15.157:6812/631023601 conn(0x7f6f8c03bdc0 0x7f6f8c03e280 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6f980038c0 tx=0x7f6f98006cf0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:11:59.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.352+0000 7f6f95ffb640 1 -- 172.21.15.5:0/2800583655 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f6f90016150 con 0x7f6fa0139fe0 2024-08-18T21:11:59.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.352+0000 7f6f95ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:11:59.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.352+0000 7f6f95ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:11:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.584+0000 7f6fa75de640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:11:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.584+0000 7f6fa75de640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:11:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.584+0000 7f6fa75de640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:11:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.584+0000 7f6fa75de640 1 -- 172.21.15.5:0/2800583655 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6fa0139a50 con 0x7f6fa0139fe0 2024-08-18T21:11:59.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.584+0000 7f6f95ffb640 1 -- 172.21.15.5:0/2800583655 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3174 (secure 0 0 0) 0x7f6f90003620 con 0x7f6fa0139fe0 2024-08-18T21:11:59.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.584+0000 7f6f95ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:11:59.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.584+0000 7f6f95ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:11:59.588 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":178,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:11:59.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.588+0000 7f6fa75de640 1 -- 172.21.15.5:0/2800583655 >> v2:172.21.15.157:6812/631023601 conn(0x7f6f8c03bdc0 msgr2=0x7f6f8c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:59.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.588+0000 7f6fa75de640 1 --2- 172.21.15.5:0/2800583655 >> v2:172.21.15.157:6812/631023601 conn(0x7f6f8c03bdc0 0x7f6f8c03e280 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6f980038c0 tx=0x7f6f98006cf0 comp rx=0 tx=0).stop 2024-08-18T21:11:59.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.588+0000 7f6fa75de640 10 monclient: shutdown 2024-08-18T21:11:59.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.588+0000 7f6fa75de640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:11:59.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.588+0000 7f6fa75de640 1 -- 172.21.15.5:0/2800583655 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6fa0139fe0 msgr2=0x7f6fa013afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:11:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.588+0000 7f6fa75de640 1 --2- 172.21.15.5:0/2800583655 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6fa0139fe0 0x7f6fa013afb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6f9001c270 tx=0x7f6f900191e0 comp rx=0 tx=0).stop 2024-08-18T21:11:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.588+0000 7f6fa75de640 1 -- 172.21.15.5:0/2800583655 shutdown_connections 2024-08-18T21:11:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.588+0000 7f6fa75de640 1 --2- 172.21.15.5:0/2800583655 >> v2:172.21.15.157:6812/631023601 conn(0x7f6f8c03bdc0 0x7f6f8c03e280 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.588+0000 7f6fa75de640 1 --2- 172.21.15.5:0/2800583655 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6fa0139fe0 0x7f6fa013afb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.588+0000 7f6fa75de640 1 --2- 172.21.15.5:0/2800583655 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6fa00a7600 0x7f6fa013aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.588+0000 7f6fa75de640 1 --2- 172.21.15.5:0/2800583655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa00a6ce0 0x7f6fa0135230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:11:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.588+0000 7f6fa75de640 1 -- 172.21.15.5:0/2800583655 >> 172.21.15.5:0/2800583655 conn(0x7f6fa00acbc0 msgr2=0x7f6fa0135c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:11:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.588+0000 7f6fa75de640 1 -- 172.21.15.5:0/2800583655 shutdown_connections 2024-08-18T21:11:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:11:59.588+0000 7f6fa75de640 1 -- 172.21.15.5:0/2800583655 wait complete. 2024-08-18T21:12:02.607 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:12:02.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.736+0000 7fcb1cc59640 10 monclient: get_monmap_and_config 2024-08-18T21:12:02.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.736+0000 7fcb1cc59640 10 monclient: build_initial_monmap 2024-08-18T21:12:02.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.736+0000 7fcb1cc59640 10 monclient: monmap: 2024-08-18T21:12:02.740 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:12:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:12:02.743449+0000 2024-08-18T21:12:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:12:02.743449+0000 2024-08-18T21:12:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:12:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:12:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:12:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:12:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:12:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:12:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:12:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:12:02.742 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:12:02.742 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:12:02.742 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:12:02.742 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:12:02.742 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:02.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 1 Processor -- start 2024-08-18T21:12:02.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 1 -- start start 2024-08-18T21:12:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 10 monclient: init 2024-08-18T21:12:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 10 monclient: _add_conns ranks=[3,0,10,8,4,9,7,1,2,6,5] 2024-08-18T21:12:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb180a6ce0 0x7fcb180a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 10 monclient(hunting): picked mon.noname-g con 0x7fcb180a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:12:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcb180a7600 addr v1:172.21.15.5:6789/0 2024-08-18T21:12:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcb1813a1b0 0x7fcb18141d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 10 monclient(hunting): picked mon.noname-f con 0x7fcb1813a1b0 addr v2:172.21.15.157:3300/0 2024-08-18T21:12:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb180a45d0 con 0x7fcb180a7600 2024-08-18T21:12:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fcb180a5000 con 0x7fcb1813a1b0 2024-08-18T21:12:02.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:02.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcb180a4360 con 0x7fcb180a6ce0 2024-08-18T21:12:02.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:02.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1cc59640 10 monclient(hunting): authenticate will time out at 1489.756932s 2024-08-18T21:12:02.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb15d9b640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fcb180a7600 legacy=0x7fcb18139aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:12:02.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1659c640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb180a6ce0 msgr2=0x7fcb180a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:12:02.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb16d9d640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7fcb1813a1b0 msgr2=0x7fcb18141d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:12:02.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb16d9d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcb1813a1b0 0x7fcb18141d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:02.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.740+0000 7fcb1659c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb180a6ce0 0x7fcb180a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:02.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.944+0000 7fcb15d9b640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fcb180a7600 legacy=0x7fcb18139aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:12:02.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.944+0000 7fcb1659c640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb180a6ce0 msgr2=0x7fcb180a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:12:02.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.944+0000 7fcb16d9d640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7fcb1813a1b0 msgr2=0x7fcb18141d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:12:02.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.944+0000 7fcb1659c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb180a6ce0 0x7fcb180a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:02.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:02.944+0000 7fcb16d9d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcb1813a1b0 0x7fcb18141d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:03.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:03.348+0000 7fcb15d9b640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fcb180a7600 legacy=0x7fcb18139aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:12:03.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:03.348+0000 7fcb1659c640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb180a6ce0 msgr2=0x7fcb180a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:12:03.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:03.348+0000 7fcb16d9d640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7fcb1813a1b0 msgr2=0x7fcb18141d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:12:03.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:03.348+0000 7fcb16d9d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcb1813a1b0 0x7fcb18141d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:03.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:03.348+0000 7fcb1659c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb180a6ce0 0x7fcb180a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:04.152+0000 7fcb15d9b640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fcb180a7600 legacy=0x7fcb18139aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:12:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:04.152+0000 7fcb16d9d640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7fcb1813a1b0 msgr2=0x7fcb18141d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:12:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:04.152+0000 7fcb16d9d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcb1813a1b0 0x7fcb18141d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:04.152+0000 7fcb1659c640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb180a6ce0 msgr2=0x7fcb180a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:12:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:04.152+0000 7fcb1659c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb180a6ce0 0x7fcb180a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:04.152+0000 7fcb1559a640 1 -- DispatchQueue::entry inject delay of 0.002000 2024-08-18T21:12:05.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 10 monclient(hunting): tick 2024-08-18T21:12:05.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:12:05.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 1 monclient(hunting): continuing hunt 2024-08-18T21:12:05.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:12:05.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb180a6ce0 msgr2=0x7fcb180a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:05.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb180a6ce0 0x7fcb180a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:05.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7fcb1813a1b0 msgr2=0x7fcb18141d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:05.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcb1813a1b0 0x7fcb18141d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:05.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fcb180a7600 legacy=0x7fcb18139aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:05.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 10 monclient: _add_conns ranks=[6,8,2,7,9,5,4,1] 2024-08-18T21:12:05.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 0x7fcaf8005c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:05.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 10 monclient(hunting): picked mon.noname-d con 0x7fcaf8003800 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:12:05.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 0x7fcaf80086e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:05.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 10 monclient(hunting): picked mon.noname-e con 0x7fcaf8006250 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:12:05.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 0x7fcaf800b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:05.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 10 monclient(hunting): picked mon.noname-b con 0x7fcaf8008dd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:12:05.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:05.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fcb180a4360 con 0x7fcaf8008dd0 2024-08-18T21:12:05.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:05.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fcaf800b9a0 con 0x7fcaf8003800 2024-08-18T21:12:05.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:05.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fcaf800bba0 con 0x7fcaf8006250 2024-08-18T21:12:05.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb07fff640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:05.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb15d9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 0x7fcaf80086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:05.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb1659c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 0x7fcaf8005c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:05.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb16d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 0x7fcaf800b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:05.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb15d9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 0x7fcaf80086e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:38848/0 (socket says 172.21.15.5:38848) 2024-08-18T21:12:05.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb1659c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 0x7fcaf8005c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:36072/0 (socket says 172.21.15.5:36072) 2024-08-18T21:12:05.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb15d9b640 1 -- 172.21.15.5:0/2980290149 learned_addr learned my addr 172.21.15.5:0/2980290149 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:12:05.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb16d9d640 10 monclient(hunting): get_auth_request con 0x7fcaf8008dd0 auth_method 0 2024-08-18T21:12:05.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb16d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:05.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb16d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:05.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb16d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:05.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb15d9b640 10 monclient(hunting): get_auth_request con 0x7fcaf8006250 auth_method 0 2024-08-18T21:12:05.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb15d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:05.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb15d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:05.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb15d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:05.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb1659c640 10 monclient(hunting): get_auth_request con 0x7fcaf8003800 auth_method 0 2024-08-18T21:12:05.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb1659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:05.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb1659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:05.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb1659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:05.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb15d9b640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 msgr2=0x7fcaf80086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:05.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb1659c640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 msgr2=0x7fcaf8005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:05.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb15d9b640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 msgr2=0x7fcaf80086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:05.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb1659c640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 msgr2=0x7fcaf8005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:05.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 0x7fcaf80086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:05.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 0x7fcaf8005c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:05.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb16d9d640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 msgr2=0x7fcaf800b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:05.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb16d9d640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 msgr2=0x7fcaf800b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:05.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb16d9d640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 0x7fcaf800b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:05.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 0x7fcaf8005c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:05.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 0x7fcaf80086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:05.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.740+0000 7fcb16d9d640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 0x7fcaf800b260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:05.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 0x7fcaf80086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:05.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb16d9d640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 0x7fcaf800b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:05.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb15d9b640 10 monclient(hunting): get_auth_request con 0x7fcaf8006250 auth_method 0 2024-08-18T21:12:05.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb15d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:05.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb15d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:05.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb15d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:05.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb16d9d640 10 monclient(hunting): get_auth_request con 0x7fcaf8008dd0 auth_method 0 2024-08-18T21:12:05.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb16d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:05.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb16d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:05.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb16d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:05.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 0x7fcaf8005c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:05.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb1659c640 10 monclient(hunting): get_auth_request con 0x7fcaf8003800 auth_method 0 2024-08-18T21:12:05.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb1659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:05.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb1659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:05.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb1659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:05.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb16d9d640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 msgr2=0x7fcaf800b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:05.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb16d9d640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 msgr2=0x7fcaf800b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:05.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb16d9d640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 0x7fcaf800b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:05.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb15d9b640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 msgr2=0x7fcaf80086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:05.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb15d9b640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 msgr2=0x7fcaf80086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:05.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 0x7fcaf80086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:05.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb16d9d640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 0x7fcaf800b260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:05.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb1659c640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 msgr2=0x7fcaf8005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:05.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb1659c640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 msgr2=0x7fcaf8005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:05.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 0x7fcaf8005c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:05.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 0x7fcaf80086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:05.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:05.944+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 0x7fcaf8005c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:06.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb16d9d640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 0x7fcaf800b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:06.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 0x7fcaf80086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:06.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 0x7fcaf8005c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:06.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb16d9d640 10 monclient(hunting): get_auth_request con 0x7fcaf8008dd0 auth_method 0 2024-08-18T21:12:06.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb16d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:06.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb16d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:06.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb16d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:06.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb15d9b640 10 monclient(hunting): get_auth_request con 0x7fcaf8006250 auth_method 0 2024-08-18T21:12:06.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb15d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:06.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb15d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:06.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb15d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:06.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb1659c640 10 monclient(hunting): get_auth_request con 0x7fcaf8003800 auth_method 0 2024-08-18T21:12:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb1659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb1659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb1659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb16d9d640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 msgr2=0x7fcaf800b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb16d9d640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 msgr2=0x7fcaf800b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb16d9d640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 0x7fcaf800b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb15d9b640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 msgr2=0x7fcaf80086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb15d9b640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 msgr2=0x7fcaf80086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 0x7fcaf80086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb1659c640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 msgr2=0x7fcaf8005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb1659c640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 msgr2=0x7fcaf8005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 0x7fcaf8005c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb16d9d640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 0x7fcaf800b260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:06.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 0x7fcaf80086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:06.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:06.348+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 0x7fcaf8005c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 0x7fcaf8005c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 0x7fcaf80086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb1659c640 10 monclient(hunting): get_auth_request con 0x7fcaf8003800 auth_method 0 2024-08-18T21:12:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb1659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb1659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb1659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb15d9b640 10 monclient(hunting): get_auth_request con 0x7fcaf8006250 auth_method 0 2024-08-18T21:12:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb15d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb15d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb15d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb16d9d640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 0x7fcaf800b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb16d9d640 10 monclient(hunting): get_auth_request con 0x7fcaf8008dd0 auth_method 0 2024-08-18T21:12:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb16d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb16d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb16d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb1659c640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 msgr2=0x7fcaf8005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb1659c640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 msgr2=0x7fcaf8005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 0x7fcaf8005c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb15d9b640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 msgr2=0x7fcaf80086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb15d9b640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 msgr2=0x7fcaf80086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 0x7fcaf80086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 0x7fcaf8005c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 0x7fcaf80086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb16d9d640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 msgr2=0x7fcaf800b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb16d9d640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 msgr2=0x7fcaf800b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb16d9d640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 0x7fcaf800b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:07.152+0000 7fcb16d9d640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 0x7fcaf800b260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:08.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 10 monclient(hunting): tick 2024-08-18T21:12:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:12:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 1 monclient(hunting): continuing hunt 2024-08-18T21:12:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:12:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 msgr2=0x7fcaf80086e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fcaf8006250 0x7fcaf80086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 msgr2=0x7fcaf8005c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcaf8003800 0x7fcaf8005c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 msgr2=0x7fcaf800b260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcaf8008dd0 0x7fcaf800b260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 10 monclient: _add_conns ranks=[1,9,7,4,5] 2024-08-18T21:12:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb16d9d640 1 -- 172.21.15.5:0/2980290149 reap_dead start 2024-08-18T21:12:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fcaf800c1a0 addr v1:172.21.15.157:6789/0 2024-08-18T21:12:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb16d9d640 1 -- 172.21.15.5:0/2980290149 reap_dead start 2024-08-18T21:12:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 1 --2- 172.21.15.5:0/2980290149 >> v2:172.21.15.5:3300/0 conn(0x7fcaf8003c40 0x7fcaf80066d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 10 monclient(hunting): picked mon.noname-a con 0x7fcaf8003c40 addr v2:172.21.15.5:3300/0 2024-08-18T21:12:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcaf8006c10 0x7fcaf8007090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 10 monclient(hunting): picked mon.noname-i con 0x7fcaf8006c10 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:12:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 1 -- 172.21.15.5:0/2980290149 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb180a8900 con 0x7fcaf800c1a0 2024-08-18T21:12:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 1 -- 172.21.15.5:0/2980290149 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcb180a4360 con 0x7fcaf8003c40 2024-08-18T21:12:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 1 -- 172.21.15.5:0/2980290149 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fcaf800b9a0 con 0x7fcaf8006c10 2024-08-18T21:12:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb07fff640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb15d9b640 1 -- 172.21.15.5:0/2980290149 >> v2:172.21.15.5:3300/0 conn(0x7fcaf8003c40 msgr2=0x7fcaf80066d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:12:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb1659c640 1 -- 172.21.15.5:0/2980290149 >> v1:172.21.15.157:6789/0 conn(0x7fcaf800c1a0 legacy=0x7fcaf800e590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:12:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2980290149 >> v2:172.21.15.5:3300/0 conn(0x7fcaf8003c40 0x7fcaf80066d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb16d9d640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcaf8006c10 msgr2=0x7fcaf8007090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:12:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.740+0000 7fcb16d9d640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcaf8006c10 0x7fcaf8007090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.944+0000 7fcb15d9b640 1 -- 172.21.15.5:0/2980290149 >> v2:172.21.15.5:3300/0 conn(0x7fcaf8003c40 msgr2=0x7fcaf80066d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:12:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.944+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2980290149 >> v2:172.21.15.5:3300/0 conn(0x7fcaf8003c40 0x7fcaf80066d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.944+0000 7fcb1659c640 1 -- 172.21.15.5:0/2980290149 >> v1:172.21.15.157:6789/0 conn(0x7fcaf800c1a0 legacy=0x7fcaf800e590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:12:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.944+0000 7fcb16d9d640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcaf8006c10 msgr2=0x7fcaf8007090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:12:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:08.944+0000 7fcb16d9d640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcaf8006c10 0x7fcaf8007090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:09.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:09.348+0000 7fcb15d9b640 1 -- 172.21.15.5:0/2980290149 >> v2:172.21.15.5:3300/0 conn(0x7fcaf8003c40 msgr2=0x7fcaf80066d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:12:09.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:09.348+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2980290149 >> v2:172.21.15.5:3300/0 conn(0x7fcaf8003c40 0x7fcaf80066d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:09.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:09.348+0000 7fcb1659c640 1 -- 172.21.15.5:0/2980290149 >> v1:172.21.15.157:6789/0 conn(0x7fcaf800c1a0 legacy=0x7fcaf800e590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:12:09.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:09.348+0000 7fcb16d9d640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcaf8006c10 msgr2=0x7fcaf8007090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:12:09.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:09.348+0000 7fcb16d9d640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcaf8006c10 0x7fcaf8007090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:10.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:10.152+0000 7fcb16d9d640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcaf8006c10 msgr2=0x7fcaf8007090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:12:10.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:10.152+0000 7fcb16d9d640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcaf8006c10 0x7fcaf8007090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:10.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:10.152+0000 7fcb15d9b640 1 -- 172.21.15.5:0/2980290149 >> v2:172.21.15.5:3300/0 conn(0x7fcaf8003c40 msgr2=0x7fcaf80066d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:12:10.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:10.152+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2980290149 >> v2:172.21.15.5:3300/0 conn(0x7fcaf8003c40 0x7fcaf80066d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:10.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:10.152+0000 7fcb1559a640 1 -- 172.21.15.5:0/2980290149 DispatchQueue::entry inject delay of 0.002000 2024-08-18T21:12:10.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:10.152+0000 7fcb1659c640 1 -- 172.21.15.5:0/2980290149 >> v1:172.21.15.157:6789/0 conn(0x7fcaf800c1a0 legacy=0x7fcaf800e590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:12:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 10 monclient(hunting): tick 2024-08-18T21:12:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:12:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 1 monclient(hunting): continuing hunt 2024-08-18T21:12:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:12:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcaf8006c10 msgr2=0x7fcaf8007090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcaf8006c10 0x7fcaf8007090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 1 -- 172.21.15.5:0/2980290149 >> v2:172.21.15.5:3300/0 conn(0x7fcaf8003c40 msgr2=0x7fcaf80066d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 1 --2- 172.21.15.5:0/2980290149 >> v2:172.21.15.5:3300/0 conn(0x7fcaf8003c40 0x7fcaf80066d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 1 -- 172.21.15.5:0/2980290149 >> v1:172.21.15.157:6789/0 conn(0x7fcaf800c1a0 legacy=0x7fcaf800e590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 10 monclient: _add_conns ranks=[4,5] 2024-08-18T21:12:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcaf8008700 0x7fcaf800b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 10 monclient(hunting): picked mon.noname-c con 0x7fcaf8008700 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:12:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fcaf80075d0 0x7fcaf80079e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 10 monclient(hunting): picked mon.noname-h con 0x7fcaf80075d0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:12:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 1 -- 172.21.15.5:0/2980290149 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fcb180a4360 con 0x7fcaf8008700 2024-08-18T21:12:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 1 -- 172.21.15.5:0/2980290149 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fcaf800b9a0 con 0x7fcaf80075d0 2024-08-18T21:12:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb07fff640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcaf8008700 0x7fcaf800b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb1659c640 10 monclient(hunting): get_auth_request con 0x7fcaf8008700 auth_method 0 2024-08-18T21:12:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb1659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb1659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb1659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fcaf80075d0 0x7fcaf80079e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb1659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb1659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb1659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb15d9b640 10 monclient(hunting): get_auth_request con 0x7fcaf80075d0 auth_method 0 2024-08-18T21:12:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb15d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb15d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb15d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb15d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb15d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb15d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb1659c640 10 monclient(hunting): handle_auth_done global_id 114277 payload 274 2024-08-18T21:12:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb1659c640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fcaf80075d0 msgr2=0x7fcaf80079e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:12:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fcaf80075d0 0x7fcaf80079e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb1659c640 10 monclient: _finish_hunting 0 2024-08-18T21:12:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb1659c640 1 monclient: found mon.noname-c 2024-08-18T21:12:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb1659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb1659c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:12:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.740+0000 7fcb1659c640 1 -- 172.21.15.5:0/2980290149 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb180a45d0 con 0x7fcaf8008700 2024-08-18T21:12:11.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1659c640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcaf8008700 msgr2=0x7fcaf800b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:11.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcaf8008700 0x7fcaf800b260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcb08007460 tx=0x7fcb0801dc50 comp rx=0 tx=0).ready entity=mon.4 client_cookie=c85ca9a4d59b950f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:11.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1559a640 1 -- 172.21.15.5:0/2980290149 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcb080ac070 con 0x7fcaf8008700 2024-08-18T21:12:11.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:11.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1559a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:12:11.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1559a640 10 monclient: dump: 2024-08-18T21:12:11.753 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:11.753 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:11.753 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:11.753 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:11.754 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1559a640 10 monclient: _finish_auth 0 2024-08-18T21:12:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1559a640 10 monclient: _check_auth_tickets 2024-08-18T21:12:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1559a640 1 -- 172.21.15.5:0/2980290149 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb080a6e30 con 0x7fcaf8008700 2024-08-18T21:12:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1559a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:12:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1cc59640 5 monclient: authenticate success, global_id 114277 2024-08-18T21:12:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1559a640 1 -- 172.21.15.5:0/2980290149 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcb0800b040 con 0x7fcaf8008700 2024-08-18T21:12:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1cc59640 10 monclient: get_monmap_and_config success 2024-08-18T21:12:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1cc59640 4 set_mon_vals no callback set 2024-08-18T21:12:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1559a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:12:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.748+0000 7fcb1559a640 10 monclient: dump: 2024-08-18T21:12:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:11.757 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:11.757 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 10 monclient: shutdown 2024-08-18T21:12:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:12:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 1 -- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcaf8008700 msgr2=0x7fcaf800b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 1 --2- 172.21.15.5:0/2980290149 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcaf8008700 0x7fcaf800b260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcb08007460 tx=0x7fcb0801dc50 comp rx=0 tx=0).stop 2024-08-18T21:12:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb16d9d640 1 -- 172.21.15.5:0/2980290149 reap_dead start 2024-08-18T21:12:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 1 -- 172.21.15.5:0/2980290149 shutdown_connections 2024-08-18T21:12:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 1 -- 172.21.15.5:0/2980290149 >> 172.21.15.5:0/2980290149 conn(0x7fcb180acbc0 msgr2=0x7fcb180a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:12:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 1 -- 172.21.15.5:0/2980290149 shutdown_connections 2024-08-18T21:12:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 1 -- 172.21.15.5:0/2980290149 wait complete. 2024-08-18T21:12:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 10 monclient: build_initial_monmap 2024-08-18T21:12:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 10 monclient: monmap: 2024-08-18T21:12:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:12:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:12:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:12:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:12:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:12:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:12:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:12:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:12:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:12:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:12:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:12:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:12:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:12:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:12:11.763 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 1 Processor -- start 2024-08-18T21:12:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 1 -- start start 2024-08-18T21:12:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 10 monclient: init 2024-08-18T21:12:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 10 monclient: _add_conns ranks=[4,0,3,5,7,1,2,6,8] 2024-08-18T21:12:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcaf8008700 0x7fcb18137e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 10 monclient(hunting): picked mon.noname-c con 0x7fcaf8008700 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:12:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb18138340 0x7fcb181d1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 10 monclient(hunting): picked mon.noname-a con 0x7fcb18138340 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:12:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb181d1cb0 0x7fcb181d2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 10 monclient(hunting): picked mon.noname-g con 0x7fcb181d1cb0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:12:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcb180a79e0 con 0x7fcb18138340 2024-08-18T21:12:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcb180a8220 con 0x7fcb181d1cb0 2024-08-18T21:12:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fcb18124480 con 0x7fcaf8008700 2024-08-18T21:12:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1cc59640 10 monclient(hunting): authenticate will time out at 1498.771591s 2024-08-18T21:12:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb15d9b640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb18138340 msgr2=0x7fcb181d1770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:12:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb15d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb18138340 0x7fcb181d1770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1659c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcaf8008700 0x7fcb18137e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1659c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcaf8008700 0x7fcb18137e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:49356/0 (socket says 172.21.15.5:49356) 2024-08-18T21:12:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1659c640 1 -- 172.21.15.5:0/2582488068 learned_addr learned my addr 172.21.15.5:0/2582488068 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:12:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1659c640 10 monclient(hunting): get_auth_request con 0x7fcaf8008700 auth_method 0 2024-08-18T21:12:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb16d9d640 1 -- 172.21.15.5:0/2582488068 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb181d1cb0 msgr2=0x7fcb181d2130 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:12:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb16d9d640 1 --2- 172.21.15.5:0/2582488068 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb181d1cb0 0x7fcb181d2130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.752+0000 7fcb1659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1659c640 10 monclient(hunting): handle_auth_done global_id 114286 payload 824 2024-08-18T21:12:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1659c640 1 -- 172.21.15.5:0/2582488068 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb181d1cb0 msgr2=0x7fcb181d2130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:12:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2582488068 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb181d1cb0 0x7fcb181d2130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1659c640 1 -- 172.21.15.5:0/2582488068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb18138340 msgr2=0x7fcb181d1770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:12:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2582488068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb18138340 0x7fcb181d1770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1659c640 10 monclient: _finish_hunting 0 2024-08-18T21:12:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1659c640 1 monclient: found mon.noname-c 2024-08-18T21:12:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1659c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:12:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1659c640 1 -- 172.21.15.5:0/2582488068 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb181387c0 con 0x7fcaf8008700 2024-08-18T21:12:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1659c640 1 -- 172.21.15.5:0/2582488068 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcaf8008700 msgr2=0x7fcb18137e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1659c640 1 --2- 172.21.15.5:0/2582488068 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcaf8008700 0x7fcb18137e00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcb0801c300 tx=0x7fcb0801c490 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb06ffd640 1 -- 172.21.15.5:0/2582488068 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcb080ac040 con 0x7fcaf8008700 2024-08-18T21:12:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb06ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:12:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb06ffd640 10 monclient: dump: 2024-08-18T21:12:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:11.768 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb06ffd640 10 monclient: _finish_auth 0 2024-08-18T21:12:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb06ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:12:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb06ffd640 1 -- 172.21.15.5:0/2582488068 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb080bf070 con 0x7fcaf8008700 2024-08-18T21:12:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1cc59640 5 monclient: authenticate success, global_id 114286 2024-08-18T21:12:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1cc59640 10 monclient: _renew_subs 2024-08-18T21:12:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1cc59640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:12:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1cc59640 1 -- 172.21.15.5:0/2582488068 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb180aa2e0 con 0x7fcaf8008700 2024-08-18T21:12:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb06ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:12:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb06ffd640 1 -- 172.21.15.5:0/2582488068 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcb080ba870 con 0x7fcaf8008700 2024-08-18T21:12:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb06ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:12:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb06ffd640 10 monclient: dump: 2024-08-18T21:12:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:11.770 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb07fff640 4 set_mon_vals no callback set 2024-08-18T21:12:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1cc59640 10 monclient: _renew_subs 2024-08-18T21:12:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1cc59640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:12:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.756+0000 7fcb1cc59640 1 -- 172.21.15.5:0/2582488068 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb181257c0 con 0x7fcaf8008700 2024-08-18T21:12:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.760+0000 7fcb1cc59640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.760+0000 7fcb1cc59640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.760+0000 7fcb1cc59640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:12:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.760+0000 7fcb1cc59640 1 -- 172.21.15.5:0/2582488068 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb18125160 con 0x7fcaf8008700 2024-08-18T21:12:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.760+0000 7fcb06ffd640 1 -- 172.21.15.5:0/2582488068 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fcb080ba400 con 0x7fcaf8008700 2024-08-18T21:12:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.760+0000 7fcb06ffd640 1 --2- 172.21.15.5:0/2582488068 >> v2:172.21.15.157:6812/631023601 conn(0x7fcaf803dc70 0x7fcaf8040130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.760+0000 7fcb06ffd640 1 -- 172.21.15.5:0/2582488068 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(241..241 src has 22..241) ==== 3898+0+0 (secure 0 0 0) 0x7fcb080a6e00 con 0x7fcaf8008700 2024-08-18T21:12:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.760+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2582488068 >> v2:172.21.15.157:6812/631023601 conn(0x7fcaf803dc70 0x7fcaf8040130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.760+0000 7fcb15d9b640 10 monclient: get_auth_request con 0x7fcaf803dc70 auth_method 0 2024-08-18T21:12:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.764+0000 7fcb15d9b640 1 --2- 172.21.15.5:0/2582488068 >> v2:172.21.15.157:6812/631023601 conn(0x7fcaf803dc70 0x7fcaf8040130 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c000c10 tx=0x7fcb0c00d040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.764+0000 7fcb06ffd640 1 -- 172.21.15.5:0/2582488068 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fcb080ca060 con 0x7fcaf8008700 2024-08-18T21:12:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.764+0000 7fcb06ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:11.764+0000 7fcb06ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:12:12.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.004+0000 7fcb1cc59640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:12:12.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.004+0000 7fcb1cc59640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:12:12.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.004+0000 7fcb1cc59640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:12:12.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.004+0000 7fcb1cc59640 1 -- 172.21.15.5:0/2582488068 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcb181c5910 con 0x7fcaf8008700 2024-08-18T21:12:12.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb06ffd640 1 -- 172.21.15.5:0/2582488068 <== mon.4 v2:172.21.15.5:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3149 (secure 0 0 0) 0x7fcb080178d0 con 0x7fcaf8008700 2024-08-18T21:12:12.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb06ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:12:12.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb06ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:12:12.010 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":182,"quorum":[2,4,5,6,8],"quorum_names":["b","c","h","d","e"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:12:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb1cc59640 1 -- 172.21.15.5:0/2582488068 >> v2:172.21.15.157:6812/631023601 conn(0x7fcaf803dc70 msgr2=0x7fcaf8040130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb1cc59640 1 --2- 172.21.15.5:0/2582488068 >> v2:172.21.15.157:6812/631023601 conn(0x7fcaf803dc70 0x7fcaf8040130 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c000c10 tx=0x7fcb0c00d040 comp rx=0 tx=0).stop 2024-08-18T21:12:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb1cc59640 10 monclient: shutdown 2024-08-18T21:12:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb1cc59640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:12:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb1cc59640 1 -- 172.21.15.5:0/2582488068 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcaf8008700 msgr2=0x7fcb18137e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb1cc59640 1 --2- 172.21.15.5:0/2582488068 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcaf8008700 0x7fcb18137e00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcb0801c300 tx=0x7fcb0801c490 comp rx=0 tx=0).stop 2024-08-18T21:12:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb1cc59640 1 -- 172.21.15.5:0/2582488068 shutdown_connections 2024-08-18T21:12:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb1cc59640 1 --2- 172.21.15.5:0/2582488068 >> v2:172.21.15.157:6812/631023601 conn(0x7fcaf803dc70 0x7fcaf8040130 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb1cc59640 1 --2- 172.21.15.5:0/2582488068 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb181d1cb0 0x7fcb181d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb1cc59640 1 --2- 172.21.15.5:0/2582488068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb18138340 0x7fcb181d1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb1cc59640 1 --2- 172.21.15.5:0/2582488068 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcaf8008700 0x7fcb18137e00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb1cc59640 1 -- 172.21.15.5:0/2582488068 >> 172.21.15.5:0/2582488068 conn(0x7fcb180acbc0 msgr2=0x7fcb180ab700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:12:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb1cc59640 1 -- 172.21.15.5:0/2582488068 shutdown_connections 2024-08-18T21:12:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.008+0000 7fcb1cc59640 1 -- 172.21.15.5:0/2582488068 wait complete. 2024-08-18T21:12:12.027 INFO:tasks.mon_thrash.ceph_manager:quorum is size 5 2024-08-18T21:12:12.027 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon b 2024-08-18T21:12:12.027 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:12:12.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.148+0000 7f313bdcb640 10 monclient: get_monmap_and_config 2024-08-18T21:12:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.148+0000 7f313bdcb640 10 monclient: build_initial_monmap 2024-08-18T21:12:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.148+0000 7f313bdcb640 10 monclient: monmap: 2024-08-18T21:12:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:12:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:12:12.154883+0000 2024-08-18T21:12:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:12:12.154883+0000 2024-08-18T21:12:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:12:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:12:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:12:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:12:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:12:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:12:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:12:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:12:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:12:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:12:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:12:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:12:12.153 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.148+0000 7f313bdcb640 1 Processor -- start 2024-08-18T21:12:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.148+0000 7f313bdcb640 1 -- start start 2024-08-18T21:12:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.148+0000 7f313bdcb640 10 monclient: init 2024-08-18T21:12:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f313bdcb640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f313bdcb640 10 monclient: _add_conns ranks=[8,10,1,0,3,2,5,4,7,9,6] 2024-08-18T21:12:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f313bdcb640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f31340a6ce0 0x7f31340a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f313bdcb640 10 monclient(hunting): picked mon.noname-e con 0x7f31340a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:12:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f313bdcb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f31340a7600 0x7f3134139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f313bdcb640 10 monclient(hunting): picked mon.noname-f con 0x7f31340a7600 addr v2:172.21.15.157:3300/0 2024-08-18T21:12:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f313bdcb640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f3134139fe0 addr v1:172.21.15.157:6789/0 2024-08-18T21:12:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f313bdcb640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31340a45d0 con 0x7f3134139fe0 2024-08-18T21:12:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f313bdcb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f313bdcb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f31340a5000 con 0x7f31340a7600 2024-08-18T21:12:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f313bdcb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f313bdcb640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f31340a4360 con 0x7f31340a6ce0 2024-08-18T21:12:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f313bdcb640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f313bdcb640 10 monclient(hunting): authenticate will time out at 1499.168344s 2024-08-18T21:12:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f313a368640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7f3134139fe0 legacy=0x7f3134140cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:12:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139366640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7f31340a7600 msgr2=0x7f3134139aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:12:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f31340a6ce0 0x7f31340a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139366640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f31340a7600 0x7f3134139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f31340a6ce0 0x7f31340a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:38878/0 (socket says 172.21.15.5:38878) 2024-08-18T21:12:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 1 -- 172.21.15.5:0/57130708 learned_addr learned my addr 172.21.15.5:0/57130708 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:12:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 10 monclient(hunting): get_auth_request con 0x7f31340a6ce0 auth_method 0 2024-08-18T21:12:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 10 monclient(hunting): handle_auth_done global_id 114371 payload 274 2024-08-18T21:12:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 1 -- 172.21.15.5:0/57130708 >> v2:172.21.15.157:3300/0 conn(0x7f31340a7600 msgr2=0x7f3134139aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 1 --2- 172.21.15.5:0/57130708 >> v2:172.21.15.157:3300/0 conn(0x7f31340a7600 0x7f3134139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 1 -- 172.21.15.5:0/57130708 >> v1:172.21.15.157:6789/0 conn(0x7f3134139fe0 legacy=0x7f3134140cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:12.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 10 monclient: _finish_hunting 0 2024-08-18T21:12:12.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 1 monclient: found mon.noname-e 2024-08-18T21:12:12.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:12.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:12:12.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.152+0000 7f3139b67640 1 -- 172.21.15.5:0/57130708 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31340a8900 con 0x7f31340a6ce0 2024-08-18T21:12:12.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 1 -- 172.21.15.5:0/57130708 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f31340a6ce0 msgr2=0x7f31340a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 1 --2- 172.21.15.5:0/57130708 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f31340a6ce0 0x7f31340a70c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3128009870 tx=0x7f312801c440 comp rx=0 tx=0).ready entity=mon.8 client_cookie=85e5ecdadcac9b8c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3138b65640 1 -- 172.21.15.5:0/57130708 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f31280b1070 con 0x7f31340a6ce0 2024-08-18T21:12:12.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3138b65640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3138b65640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:12:12.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3138b65640 10 monclient: dump: 2024-08-18T21:12:12.161 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.161 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.161 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.161 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.162 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3138b65640 10 monclient: _finish_auth 0 2024-08-18T21:12:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3138b65640 10 monclient: _check_auth_tickets 2024-08-18T21:12:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3138b65640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3138b65640 1 -- 172.21.15.5:0/57130708 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31280a8050 con 0x7f31340a6ce0 2024-08-18T21:12:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3138b65640 10 monclient: handle_config config(0 keys) 2024-08-18T21:12:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3138b65640 1 -- 172.21.15.5:0/57130708 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f31280abcc0 con 0x7f31340a6ce0 2024-08-18T21:12:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 5 monclient: authenticate success, global_id 114371 2024-08-18T21:12:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 10 monclient: get_monmap_and_config success 2024-08-18T21:12:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 4 set_mon_vals no callback set 2024-08-18T21:12:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3138b65640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3138b65640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:12:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3138b65640 10 monclient: dump: 2024-08-18T21:12:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.164 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 10 monclient: shutdown 2024-08-18T21:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 1 -- 172.21.15.5:0/57130708 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f31340a6ce0 msgr2=0x7f31340a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 1 --2- 172.21.15.5:0/57130708 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f31340a6ce0 0x7f31340a70c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3128009870 tx=0x7f312801c440 comp rx=0 tx=0).stop 2024-08-18T21:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 1 -- 172.21.15.5:0/57130708 shutdown_connections 2024-08-18T21:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 1 --2- 172.21.15.5:0/57130708 >> v2:172.21.15.157:3300/0 conn(0x7f31340a7600 0x7f3134139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 1 --2- 172.21.15.5:0/57130708 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f31340a6ce0 0x7f31340a70c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 1 -- 172.21.15.5:0/57130708 >> 172.21.15.5:0/57130708 conn(0x7f31340acbc0 msgr2=0x7f31340a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 1 -- 172.21.15.5:0/57130708 shutdown_connections 2024-08-18T21:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 1 -- 172.21.15.5:0/57130708 wait complete. 2024-08-18T21:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 10 monclient: build_initial_monmap 2024-08-18T21:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 10 monclient: monmap: 2024-08-18T21:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:12:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:12:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:12:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:12:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:12:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:12:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:12:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:12:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:12:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:12:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:12:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:12:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:12:12.166 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 1 Processor -- start 2024-08-18T21:12:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 1 -- start start 2024-08-18T21:12:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 10 monclient: init 2024-08-18T21:12:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 10 monclient: _add_conns ranks=[8,4,5,6,7,3,2,1,0] 2024-08-18T21:12:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f31340a6ce0 0x7f31341d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 10 monclient(hunting): picked mon.noname-e con 0x7f31340a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:12:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31340a7600 0x7f31341d2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 10 monclient(hunting): picked mon.noname-c con 0x7f31340a7600 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:12:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3134139fe0 0x7f313413ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 10 monclient(hunting): picked mon.noname-h con 0x7f3134139fe0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:12:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f31340a79e0 con 0x7f31340a7600 2024-08-18T21:12:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f31340a9810 con 0x7f3134139fe0 2024-08-18T21:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f31341417f0 con 0x7f31340a6ce0 2024-08-18T21:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313bdcb640 10 monclient(hunting): authenticate will time out at 1499.175124s 2024-08-18T21:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139366640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31340a7600 0x7f31341d2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f31340a6ce0 0x7f31341d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f31340a6ce0 0x7f31341d1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:38880/0 (socket says 172.21.15.5:38880) 2024-08-18T21:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 1 -- 172.21.15.5:0/1008280387 learned_addr learned my addr 172.21.15.5:0/1008280387 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139366640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31340a7600 0x7f31341d2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:49358/0 (socket says 172.21.15.5:49358) 2024-08-18T21:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139366640 10 monclient(hunting): get_auth_request con 0x7f31340a7600 auth_method 0 2024-08-18T21:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139366640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139366640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139366640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 10 monclient(hunting): get_auth_request con 0x7f31340a6ce0 auth_method 0 2024-08-18T21:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139366640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139366640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139366640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 10 monclient(hunting): handle_auth_done global_id 114380 payload 824 2024-08-18T21:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313a368640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3134139fe0 0x7f313413ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 1 -- 172.21.15.5:0/1008280387 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3134139fe0 msgr2=0x7f313413ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3134139fe0 0x7f313413ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 1 -- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31340a7600 msgr2=0x7f31341d2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31340a7600 0x7f31341d2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 10 monclient: _finish_hunting 0 2024-08-18T21:12:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 1 monclient: found mon.noname-e 2024-08-18T21:12:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:12:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139b67640 1 -- 172.21.15.5:0/1008280387 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31340a2260 con 0x7f31340a6ce0 2024-08-18T21:12:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313a368640 10 monclient: get_auth_request con 0x7f3134139fe0 auth_method 0 2024-08-18T21:12:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f313a368640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3134139fe0 0x7f313413ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:12:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.156+0000 7f3139366640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31340a7600 0x7f31341d2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:12:12.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f3139b67640 1 -- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f31340a6ce0 msgr2=0x7f31341d1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f3139b67640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f31340a6ce0 0x7f31341d1dd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f31280af040 tx=0x7f31280191e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31267fc640 1 -- 172.21.15.5:0/1008280387 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f31280ba070 con 0x7f31340a6ce0 2024-08-18T21:12:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31267fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:12:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31267fc640 10 monclient: dump: 2024-08-18T21:12:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.176 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31267fc640 10 monclient: _finish_auth 0 2024-08-18T21:12:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31267fc640 10 monclient: _check_auth_tickets 2024-08-18T21:12:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31267fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f313bdcb640 5 monclient: authenticate success, global_id 114380 2024-08-18T21:12:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31267fc640 1 -- 172.21.15.5:0/1008280387 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31280ac440 con 0x7f31340a6ce0 2024-08-18T21:12:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f313bdcb640 10 monclient: _renew_subs 2024-08-18T21:12:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f313bdcb640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:12:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f313bdcb640 1 -- 172.21.15.5:0/1008280387 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31341421b0 con 0x7f31340a6ce0 2024-08-18T21:12:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31267fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:12:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31267fc640 1 -- 172.21.15.5:0/1008280387 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f31280b1040 con 0x7f31340a6ce0 2024-08-18T21:12:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31267fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:12:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31277fe640 4 set_mon_vals no callback set 2024-08-18T21:12:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31267fc640 10 monclient: dump: 2024-08-18T21:12:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.178 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f313bdcb640 10 monclient: _renew_subs 2024-08-18T21:12:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f313bdcb640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:12:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f313bdcb640 1 -- 172.21.15.5:0/1008280387 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f31341232b0 con 0x7f31340a6ce0 2024-08-18T21:12:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f313bdcb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f313bdcb640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f313413ef70 0x7f313413f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f313bdcb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f313bdcb640 1 -- 172.21.15.5:0/1008280387 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f3134123480 con 0x7f313413ef70 2024-08-18T21:12:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f3139366640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f313413ef70 0x7f313413f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f3139366640 10 monclient: get_auth_request con 0x7f313413ef70 auth_method 0 2024-08-18T21:12:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f3139366640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f3139366640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f3139366640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f3139366640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f3139366640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f3139366640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31267fc640 1 -- 172.21.15.5:0/1008280387 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f3128003b60 con 0x7f31340a6ce0 2024-08-18T21:12:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f3139366640 10 monclient(hunting): handle_auth_done global_id 114239 payload 824 2024-08-18T21:12:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f3139366640 1 -- 172.21.15.5:0/1008280387 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31340a8220 con 0x7f313413ef70 2024-08-18T21:12:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31267fc640 1 --2- 172.21.15.5:0/1008280387 >> v2:172.21.15.157:6812/631023601 conn(0x7f311803bdf0 0x7f311803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f31267fc640 1 -- 172.21.15.5:0/1008280387 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(241..241 src has 22..241) ==== 3898+0+0 (secure 0 0 0) 0x7f31280e7ca0 con 0x7f31340a6ce0 2024-08-18T21:12:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.160+0000 7f313a368640 1 --2- 172.21.15.5:0/1008280387 >> v2:172.21.15.157:6812/631023601 conn(0x7f311803bdf0 0x7f311803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.164+0000 7f313a368640 10 monclient: get_auth_request con 0x7f311803bdf0 auth_method 0 2024-08-18T21:12:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.164+0000 7f3139366640 1 -- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f313413ef70 msgr2=0x7f313413f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.164+0000 7f3139366640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f313413ef70 0x7f313413f350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3134140b90 tx=0x7f3130005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.164+0000 7f31267fc640 1 -- 172.21.15.5:0/1008280387 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3130016070 con 0x7f313413ef70 2024-08-18T21:12:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.164+0000 7f31267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.164+0000 7f31267fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:12:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.164+0000 7f31267fc640 10 monclient: dump: 2024-08-18T21:12:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.181 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.164+0000 7f31267fc640 1 -- 172.21.15.5:0/1008280387 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f313000ecd0 con 0x7f313413ef70 2024-08-18T21:12:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.164+0000 7f31267fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.164+0000 7f31267fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:12:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.164+0000 7f31267fc640 1 -- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f313413ef70 msgr2=0x7f313413f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.164+0000 7f31267fc640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f313413ef70 0x7f313413f350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3134140b90 tx=0x7f3130005850 comp rx=0 tx=0).stop 2024-08-18T21:12:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.164+0000 7f31267fc640 1 -- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f313413ef70 msgr2=0x7f313413f350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:12:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.164+0000 7f31267fc640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f313413ef70 0x7f313413f350 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.164+0000 7f313a368640 1 --2- 172.21.15.5:0/1008280387 >> v2:172.21.15.157:6812/631023601 conn(0x7f311803bdf0 0x7f311803e2b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f312c003cc0 tx=0x7f312c0072e0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f313bdcb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:12:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f313bdcb640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f313413f890 0x7f313413aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f313bdcb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f313bdcb640 1 -- 172.21.15.5:0/1008280387 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f31340a7b60 con 0x7f313413f890 2024-08-18T21:12:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f3139366640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f313413f890 0x7f313413aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f3139366640 10 monclient: get_auth_request con 0x7f313413f890 auth_method 0 2024-08-18T21:12:12.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f3139366640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f3139366640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f3139366640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f3139366640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f3139366640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f3139366640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f3139366640 10 monclient(hunting): handle_auth_done global_id 114248 payload 824 2024-08-18T21:12:12.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f3139366640 1 -- 172.21.15.5:0/1008280387 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3134069580 con 0x7f313413f890 2024-08-18T21:12:12.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f3139366640 1 -- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f313413f890 msgr2=0x7f313413aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f3139366640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f313413f890 0x7f313413aab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3130018000 tx=0x7f31300059e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f31267fc640 1 -- 172.21.15.5:0/1008280387 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3130016040 con 0x7f313413f890 2024-08-18T21:12:12.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f31267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f31267fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:12:12.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f31267fc640 10 monclient: dump: 2024-08-18T21:12:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.186 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.186 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.186 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f31267fc640 1 -- 172.21.15.5:0/1008280387 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9205 (secure 0 0 0) 0x7f313001d270 con 0x7f313413f890 2024-08-18T21:12:12.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f31267fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:12:12.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f31267fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:12:12.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f31267fc640 1 -- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f313413f890 msgr2=0x7f313413aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f31267fc640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f313413f890 0x7f313413aab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3130018000 tx=0x7f31300059e0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f31267fc640 1 -- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f313413f890 msgr2=0x7f313413aab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:12:12.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.172+0000 7f31267fc640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f313413f890 0x7f313413aab0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3130018000 tx=0x7f31300059e0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.186 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:12:12.187 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:12:12.187 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:12:12.187 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:12:12.187 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 182, 2024-08-18T21:12:12.187 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 37327, 2024-08-18T21:12:12.187 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:12:12.187 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:12:12.187 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:12:12.187 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:12:12.187 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:12:12.187 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:12:12.187 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.188 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:12:12.188 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:12:12.188 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:12:12.188 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:12:12.188 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:12:12.188 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:12:12.188 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:12:12.188 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:12:12.188 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:12:12.188 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:12:12.188 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:12:12.188 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:12:12.188 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:12:12.188 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:12:12.189 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:12:12.189 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.189 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:12:12.189 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:12:12.189 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:12:12.189 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:12:12.189 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:12:12.189 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:12:12.189 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:12:12.189 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:12:12.189 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:12:12.189 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:12:12.189 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:12:12.190 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:12:12.190 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:12:12.190 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.190 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:12:12.190 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:12:12.190 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:12:12.190 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:12:12.190 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:12:12.190 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:12:12.190 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:12:12.190 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:12:12.190 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:12:12.190 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:12:12.191 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:12:12.191 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:12:12.191 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:12:12.191 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:12:12.191 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:12:12.191 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:12:12.191 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:12:12.191 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:12:12.191 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:12:12.191 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:12:12.191 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:12:12.191 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:12:12.191 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:12:12.192 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:12:12.192 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:12:12.192 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:12:12.192 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:12:12.192 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:12:12.192 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.192 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:12:12.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.192 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:12:12.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.192 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:12:12.192 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:12:12.192 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:12:12.193 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:12:12.193 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.193 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.193 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:12:12.194 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:12:12.194 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.194 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.194 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.194 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:12:12.194 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:12:12.194 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:12:12.195 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:12:12.195 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.195 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.195 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:12:12.195 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:12:12.195 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.195 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.196 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.196 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:12:12.196 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:12:12.196 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.196 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.196 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.196 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:12:12.196 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.197 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.197 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:12:12.197 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.197 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.197 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.197 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:12:12.197 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:12:12.197 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.197 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.197 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.197 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:12:12.198 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:12:12.198 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.198 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.198 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.198 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:12:12.198 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.198 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.198 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:12:12.198 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.198 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.199 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.199 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:12:12.199 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:12:12.199 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.199 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.199 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.199 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:12:12.199 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:12:12.199 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.199 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.200 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:12:12.200 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.200 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:12:12.200 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.200 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.200 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.200 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:12:12.200 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:12:12.200 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.201 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.201 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.201 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.201 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:12:12.201 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:12:12.201 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.201 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.201 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.201 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.201 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:12:12.201 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.201 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.202 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.202 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:12:12.202 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.202 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.202 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.202 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:12:12.202 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:12:12.202 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.202 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.202 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.203 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:12:12.203 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:12:12.203 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.203 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.203 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.203 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:12:12.203 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.203 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.203 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:12:12.203 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.204 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.204 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.204 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:12:12.204 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:12:12.204 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.204 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.204 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.204 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.204 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:12:12.204 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:12:12.204 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.204 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:12:12.205 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:12:12.205 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.205 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.205 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:12:12.205 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:12:12.206 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.206 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.206 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.206 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:12:12.206 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:12:12.206 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.206 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.206 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.206 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:12:12.206 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:12:12.207 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.207 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.207 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:12:12.207 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:12:12.207 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.207 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.207 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.208 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.208 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.208 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:12:12.208 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:12:12.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.208 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:12:12.208 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:12:12.208 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:12:12.208 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.208 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.208 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:12:12.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.208 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:12:12.209 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:12:12.209 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:12:12.209 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.209 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.209 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:12:12.209 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:12:12.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.176+0000 7f313bdcb640 1 -- 172.21.15.5:0/1008280387 >> v2:172.21.15.157:6812/631023601 conn(0x7f311803bdf0 msgr2=0x7f311803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.176+0000 7f313bdcb640 1 --2- 172.21.15.5:0/1008280387 >> v2:172.21.15.157:6812/631023601 conn(0x7f311803bdf0 0x7f311803e2b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f312c003cc0 tx=0x7f312c0072e0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.176+0000 7f313bdcb640 10 monclient: shutdown 2024-08-18T21:12:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.176+0000 7f313bdcb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:12:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.176+0000 7f313bdcb640 1 -- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f31340a6ce0 msgr2=0x7f31341d1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.176+0000 7f313bdcb640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f31340a6ce0 0x7f31341d1dd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f31280af040 tx=0x7f31280191e0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.176+0000 7f313a368640 1 -- 172.21.15.5:0/1008280387 reap_dead start 2024-08-18T21:12:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.176+0000 7f313bdcb640 1 -- 172.21.15.5:0/1008280387 shutdown_connections 2024-08-18T21:12:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.176+0000 7f313bdcb640 1 --2- 172.21.15.5:0/1008280387 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f31340a6ce0 0x7f31341d1dd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.176+0000 7f313bdcb640 1 -- 172.21.15.5:0/1008280387 >> 172.21.15.5:0/1008280387 conn(0x7f31340acbc0 msgr2=0x7f31340aa610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:12:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.176+0000 7f313bdcb640 1 -- 172.21.15.5:0/1008280387 shutdown_connections 2024-08-18T21:12:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.176+0000 7f313bdcb640 1 -- 172.21.15.5:0/1008280387 wait complete. 2024-08-18T21:12:12.211 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:12:12.212 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon c 2024-08-18T21:12:12.212 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:12:12.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 10 monclient: get_monmap_and_config 2024-08-18T21:12:12.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 10 monclient: build_initial_monmap 2024-08-18T21:12:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 10 monclient: monmap: 2024-08-18T21:12:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:12:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:12:12.329617+0000 2024-08-18T21:12:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:12:12.329617+0000 2024-08-18T21:12:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:12:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:12:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:12:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:12:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:12:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:12:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:12:12.328 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:12:12.328 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:12:12.328 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:12:12.328 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:12:12.328 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:12:12.328 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 1 Processor -- start 2024-08-18T21:12:12.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 1 -- start start 2024-08-18T21:12:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 10 monclient: init 2024-08-18T21:12:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 10 monclient: _add_conns ranks=[10,3,4,5,1,9,8,0,2,7,6] 2024-08-18T21:12:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f57540a6bd0 0x7f57540a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 10 monclient(hunting): picked mon.noname-f con 0x7f57540a6bd0 addr v2:172.21.15.157:3300/0 2024-08-18T21:12:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f575409f080 0x7f57540a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 10 monclient(hunting): picked mon.noname-g con 0x7f575409f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:12:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5754139990 0x7f5754139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 10 monclient(hunting): picked mon.noname-c con 0x7f5754139990 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:12:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f575409e4c0 con 0x7f57540a6bd0 2024-08-18T21:12:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f575406f930 con 0x7f575409f080 2024-08-18T21:12:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f57540a7a30 con 0x7f5754139990 2024-08-18T21:12:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5758b3a640 10 monclient(hunting): authenticate will time out at 1499.342664s 2024-08-18T21:12:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f575259c640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7f57540a6bd0 msgr2=0x7f57540a6fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:12:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f575259c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f57540a6bd0 0x7f57540a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5754139990 0x7f5754139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5751d9b640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f575409f080 msgr2=0x7f57540a74f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:12:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5751d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f575409f080 0x7f57540a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5754139990 0x7f5754139e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:49372/0 (socket says 172.21.15.5:49372) 2024-08-18T21:12:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 1 -- 172.21.15.5:0/1434793398 learned_addr learned my addr 172.21.15.5:0/1434793398 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:12:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 10 monclient(hunting): get_auth_request con 0x7f5754139990 auth_method 0 2024-08-18T21:12:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 10 monclient(hunting): handle_auth_done global_id 114304 payload 274 2024-08-18T21:12:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 1 -- 172.21.15.5:0/1434793398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f575409f080 msgr2=0x7f57540a74f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 1 --2- 172.21.15.5:0/1434793398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f575409f080 0x7f57540a74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 1 -- 172.21.15.5:0/1434793398 >> v2:172.21.15.157:3300/0 conn(0x7f57540a6bd0 msgr2=0x7f57540a6fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 1 --2- 172.21.15.5:0/1434793398 >> v2:172.21.15.157:3300/0 conn(0x7f57540a6bd0 0x7f57540a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 10 monclient: _finish_hunting 0 2024-08-18T21:12:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 1 monclient: found mon.noname-c 2024-08-18T21:12:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:12:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.324+0000 7f5752d9d640 1 -- 172.21.15.5:0/1434793398 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57540a7fb0 con 0x7f5754139990 2024-08-18T21:12:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5752d9d640 1 -- 172.21.15.5:0/1434793398 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5754139990 msgr2=0x7f5754139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5752d9d640 1 --2- 172.21.15.5:0/1434793398 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5754139990 0x7f5754139e10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f574c009870 tx=0x7f574c01c460 comp rx=0 tx=0).ready entity=mon.4 client_cookie=19d7368c992047eb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f575159a640 1 -- 172.21.15.5:0/1434793398 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f574c0b0070 con 0x7f5754139990 2024-08-18T21:12:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f575159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f575159a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:12:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f575159a640 10 monclient: dump: 2024-08-18T21:12:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.337 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f575159a640 10 monclient: _finish_auth 0 2024-08-18T21:12:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f575159a640 10 monclient: _check_auth_tickets 2024-08-18T21:12:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f575159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 5 monclient: authenticate success, global_id 114304 2024-08-18T21:12:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:12:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f575159a640 1 -- 172.21.15.5:0/1434793398 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574c0aa810 con 0x7f5754139990 2024-08-18T21:12:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f575159a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:12:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 10 monclient: get_monmap_and_config success 2024-08-18T21:12:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f575159a640 1 -- 172.21.15.5:0/1434793398 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f574c0a93e0 con 0x7f5754139990 2024-08-18T21:12:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 4 set_mon_vals no callback set 2024-08-18T21:12:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f575159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f575159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:12:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f575159a640 10 monclient: dump: 2024-08-18T21:12:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.339 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 10 monclient: shutdown 2024-08-18T21:12:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:12:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 -- 172.21.15.5:0/1434793398 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5754139990 msgr2=0x7f5754139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 --2- 172.21.15.5:0/1434793398 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5754139990 0x7f5754139e10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f574c009870 tx=0x7f574c01c460 comp rx=0 tx=0).stop 2024-08-18T21:12:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 -- 172.21.15.5:0/1434793398 shutdown_connections 2024-08-18T21:12:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 --2- 172.21.15.5:0/1434793398 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5754139990 0x7f5754139e10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 --2- 172.21.15.5:0/1434793398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f575409f080 0x7f57540a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 --2- 172.21.15.5:0/1434793398 >> v2:172.21.15.157:3300/0 conn(0x7f57540a6bd0 0x7f57540a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 -- 172.21.15.5:0/1434793398 >> 172.21.15.5:0/1434793398 conn(0x7f5754068700 msgr2=0x7f5754068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:12:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 -- 172.21.15.5:0/1434793398 shutdown_connections 2024-08-18T21:12:12.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 -- 172.21.15.5:0/1434793398 wait complete. 2024-08-18T21:12:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 10 monclient: build_initial_monmap 2024-08-18T21:12:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 10 monclient: monmap: 2024-08-18T21:12:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:12:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:12:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:12:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:12:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:12:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:12:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:12:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:12:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:12:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:12:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:12:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:12:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:12:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:12:12.347 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 Processor -- start 2024-08-18T21:12:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 -- start start 2024-08-18T21:12:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 10 monclient: init 2024-08-18T21:12:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 10 monclient: _add_conns ranks=[1,6,0,8,7,4,3,2,5] 2024-08-18T21:12:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f575409f080 0x7f57541388e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 10 monclient(hunting): picked mon.noname-f con 0x7f575409f080 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:12:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f57540a6bd0 0x7f5754138e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 10 monclient(hunting): picked mon.noname-d con 0x7f57540a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:12:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5754139990 0x7f575413dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 10 monclient(hunting): picked mon.noname-a con 0x7f5754139990 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:12:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f57540a89f0 con 0x7f5754139990 2024-08-18T21:12:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f57540a7ce0 con 0x7f575409f080 2024-08-18T21:12:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f5754143610 con 0x7f57540a6bd0 2024-08-18T21:12:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5758b3a640 10 monclient(hunting): authenticate will time out at 1499.351688s 2024-08-18T21:12:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5752d9d640 1 -- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5754139990 msgr2=0x7f575413dbd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:12:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5752d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5754139990 0x7f575413dbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f575259c640 1 -- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f575409f080 msgr2=0x7f57541388e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:12:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f575259c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f575409f080 0x7f57541388e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5751d9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f57540a6bd0 0x7f5754138e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5751d9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f57540a6bd0 0x7f5754138e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:36082/0 (socket says 172.21.15.5:36082) 2024-08-18T21:12:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5751d9b640 1 -- 172.21.15.5:0/2674614885 learned_addr learned my addr 172.21.15.5:0/2674614885 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:12:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5751d9b640 10 monclient(hunting): get_auth_request con 0x7f57540a6bd0 auth_method 0 2024-08-18T21:12:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5751d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5751d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.332+0000 7f5751d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5751d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5751d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5751d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5751d9b640 10 monclient(hunting): handle_auth_done global_id 85452 payload 824 2024-08-18T21:12:12.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5751d9b640 1 -- 172.21.15.5:0/2674614885 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f575409f080 msgr2=0x7f57541388e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:12:12.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5751d9b640 1 --2- 172.21.15.5:0/2674614885 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f575409f080 0x7f57541388e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5751d9b640 1 -- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5754139990 msgr2=0x7f575413dbd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:12:12.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5751d9b640 1 --2- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5754139990 0x7f575413dbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5751d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:12:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5751d9b640 1 monclient: found mon.noname-d 2024-08-18T21:12:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5751d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5751d9b640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:12:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5751d9b640 1 -- 172.21.15.5:0/2674614885 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5754124380 con 0x7f57540a6bd0 2024-08-18T21:12:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5751d9b640 1 -- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f57540a6bd0 msgr2=0x7f5754138e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5751d9b640 1 --2- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f57540a6bd0 0x7f5754138e20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f574800b560 tx=0x7f574800ba20 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5742ffd640 1 -- 172.21.15.5:0/2674614885 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5748013020 con 0x7f57540a6bd0 2024-08-18T21:12:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5742ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5742ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:12:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5742ffd640 10 monclient: dump: 2024-08-18T21:12:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.353 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5742ffd640 10 monclient: _finish_auth 0 2024-08-18T21:12:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5742ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:12:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5742ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5742ffd640 1 -- 172.21.15.5:0/2674614885 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5748003de0 con 0x7f57540a6bd0 2024-08-18T21:12:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5742ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:12:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5742ffd640 1 -- 172.21.15.5:0/2674614885 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f574800f460 con 0x7f57540a6bd0 2024-08-18T21:12:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5742ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5742ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:12:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5743fff640 4 set_mon_vals no callback set 2024-08-18T21:12:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5742ffd640 10 monclient: dump: 2024-08-18T21:12:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.354 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5758b3a640 5 monclient: authenticate success, global_id 85452 2024-08-18T21:12:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5758b3a640 10 monclient: _renew_subs 2024-08-18T21:12:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5758b3a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:12:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5758b3a640 1 -- 172.21.15.5:0/2674614885 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575413fe10 con 0x7f57540a6bd0 2024-08-18T21:12:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5758b3a640 10 monclient: _renew_subs 2024-08-18T21:12:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5758b3a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:12:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5758b3a640 1 -- 172.21.15.5:0/2674614885 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f57540a6560 con 0x7f57540a6bd0 2024-08-18T21:12:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5758b3a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5758b3a640 1 --2- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f57541d1770 0x7f575413e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5758b3a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.336+0000 7f5758b3a640 1 -- 172.21.15.5:0/2674614885 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f5754051140 con 0x7f57541d1770 2024-08-18T21:12:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f575259c640 1 --2- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f57541d1770 0x7f575413e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f575259c640 10 monclient: get_auth_request con 0x7f57541d1770 auth_method 0 2024-08-18T21:12:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f575259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f575259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f575259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5742ffd640 1 -- 172.21.15.5:0/2674614885 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f5748016020 con 0x7f57540a6bd0 2024-08-18T21:12:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f575259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f575259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f575259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f575259c640 10 monclient(hunting): handle_auth_done global_id 114313 payload 824 2024-08-18T21:12:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5742ffd640 1 --2- 172.21.15.5:0/2674614885 >> v2:172.21.15.157:6812/631023601 conn(0x7f573403bdc0 0x7f573403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f575259c640 1 -- 172.21.15.5:0/2674614885 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5754139e10 con 0x7f57541d1770 2024-08-18T21:12:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5742ffd640 1 -- 172.21.15.5:0/2674614885 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(241..241 src has 22..241) ==== 3898+0+0 (secure 0 0 0) 0x7f574804e170 con 0x7f57540a6bd0 2024-08-18T21:12:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5752d9d640 1 --2- 172.21.15.5:0/2674614885 >> v2:172.21.15.157:6812/631023601 conn(0x7f573403bdc0 0x7f573403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5752d9d640 10 monclient: get_auth_request con 0x7f573403bdc0 auth_method 0 2024-08-18T21:12:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f575259c640 1 -- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f57541d1770 msgr2=0x7f575413e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f575259c640 1 --2- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f57541d1770 0x7f575413e110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f574400bcc0 tx=0x7f5744009f30 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5742ffd640 1 -- 172.21.15.5:0/2674614885 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f57440057d0 con 0x7f57541d1770 2024-08-18T21:12:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5742ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5742ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:12:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5742ffd640 10 monclient: dump: 2024-08-18T21:12:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.358 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5742ffd640 1 -- 172.21.15.5:0/2674614885 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5744005360 con 0x7f57541d1770 2024-08-18T21:12:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5742ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5742ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:12:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5742ffd640 1 -- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f57541d1770 msgr2=0x7f575413e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5742ffd640 1 --2- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f57541d1770 0x7f575413e110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f574400bcc0 tx=0x7f5744009f30 comp rx=0 tx=0).stop 2024-08-18T21:12:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5742ffd640 1 -- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f57541d1770 msgr2=0x7f575413e110 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:12:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5742ffd640 1 --2- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f57541d1770 0x7f575413e110 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f574400bcc0 tx=0x7f5744009f30 comp rx=0 tx=0).stop 2024-08-18T21:12:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.340+0000 7f5752d9d640 1 --2- 172.21.15.5:0/2674614885 >> v2:172.21.15.157:6812/631023601 conn(0x7f573403bdc0 0x7f573403e280 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f575409db50 tx=0x7f574c008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.348+0000 7f5758b3a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:12:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.348+0000 7f5758b3a640 1 --2- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f575413e650 0x7f57540a40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.348+0000 7f5758b3a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.348+0000 7f5758b3a640 1 -- 172.21.15.5:0/2674614885 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f575413ea60 con 0x7f575413e650 2024-08-18T21:12:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.348+0000 7f575259c640 1 --2- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f575413e650 0x7f57540a40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.348+0000 7f575259c640 10 monclient: get_auth_request con 0x7f575413e650 auth_method 0 2024-08-18T21:12:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.348+0000 7f575259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.348+0000 7f575259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.348+0000 7f575259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.348+0000 7f575259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.348+0000 7f575259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.348+0000 7f575259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.348+0000 7f575259c640 10 monclient(hunting): handle_auth_done global_id 114322 payload 824 2024-08-18T21:12:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.348+0000 7f575259c640 1 -- 172.21.15.5:0/2674614885 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f575413f5a0 con 0x7f575413e650 2024-08-18T21:12:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.348+0000 7f575259c640 1 -- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f575413e650 msgr2=0x7f57540a40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.348+0000 7f575259c640 1 --2- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f575413e650 0x7f57540a40d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5744009fd0 tx=0x7f5744005d60 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5742ffd640 1 -- 172.21.15.5:0/2674614885 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5744019040 con 0x7f575413e650 2024-08-18T21:12:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5742ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5742ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:12:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5742ffd640 10 monclient: dump: 2024-08-18T21:12:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.363 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5742ffd640 1 -- 172.21.15.5:0/2674614885 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9370 (secure 0 0 0) 0x7f574401a610 con 0x7f575413e650 2024-08-18T21:12:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5742ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:12:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5742ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:12:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5742ffd640 1 -- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f575413e650 msgr2=0x7f57540a40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5742ffd640 1 --2- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f575413e650 0x7f57540a40d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5744009fd0 tx=0x7f5744005d60 comp rx=0 tx=0).stop 2024-08-18T21:12:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5742ffd640 1 -- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f575413e650 msgr2=0x7f57540a40d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:12:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5742ffd640 1 --2- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f575413e650 0x7f57540a40d0 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5744009fd0 tx=0x7f5744005d60 comp rx=0 tx=0).stop 2024-08-18T21:12:12.364 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:12:12.364 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:12:12.364 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:12:12.364 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:12:12.364 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 182, 2024-08-18T21:12:12.364 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 37511, 2024-08-18T21:12:12.364 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:12:12.365 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:12:12.365 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:12:12.365 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:12:12.365 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:12:12.365 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:12:12.365 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.365 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:12:12.365 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:12:12.365 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:12:12.365 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:12:12.365 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:12:12.365 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:12:12.365 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:12:12.365 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:12:12.366 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:12:12.366 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:12:12.366 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:12:12.366 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:12:12.366 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:12:12.366 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:12:12.366 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:12:12.366 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.366 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:12:12.366 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:12:12.366 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:12:12.366 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:12:12.367 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:12:12.367 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:12:12.367 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:12:12.367 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:12:12.367 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:12:12.367 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:12:12.367 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:12:12.367 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:12:12.367 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:12:12.367 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.367 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:12:12.367 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:12:12.368 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:12:12.368 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:12:12.368 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:12:12.368 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:12:12.368 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:12:12.368 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:12:12.368 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:12:12.368 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:12:12.368 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:12:12.368 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:12:12.368 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:12:12.368 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:12:12.368 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:12:12.368 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:12:12.369 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:12:12.369 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:12:12.369 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:12:12.369 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:12:12.369 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:12:12.369 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:12:12.369 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:12:12.369 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:12:12.369 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:12:12.369 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:12:12.369 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:12:12.369 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:12:12.369 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.369 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:12:12.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.370 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:12:12.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.370 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:12:12.370 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:12:12.370 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.370 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.370 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.370 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:12:12.370 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.371 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.371 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:12:12.371 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.371 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.371 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.371 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:12:12.371 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:12:12.371 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.371 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.371 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.371 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.371 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:12:12.372 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:12:12.372 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.372 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.372 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.372 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:12:12.372 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.372 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.372 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:12:12.372 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.372 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.372 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.373 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:12:12.373 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:12:12.373 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.373 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.373 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.373 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:12:12.373 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:12:12.373 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.373 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.373 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.374 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:12:12.374 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.374 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.374 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:12:12.374 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.374 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.374 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.374 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:12:12.374 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:12:12.374 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.375 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.375 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.375 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:12:12.375 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:12:12.375 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.375 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.375 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.375 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:12:12.375 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.376 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.376 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:12:12.376 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.376 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.376 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.376 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:12:12.376 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:12:12.376 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.376 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.376 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.376 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:12:12.377 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:12:12.377 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.377 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.377 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.377 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:12:12.377 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.377 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.377 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:12:12.377 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.377 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.377 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.378 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:12:12.378 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:12:12.378 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.378 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.378 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.378 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:12:12.378 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:12:12.378 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.378 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.378 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.379 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:12:12.379 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.379 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.379 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:12:12.379 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.379 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.379 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.379 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:12:12.379 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:12:12.379 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.379 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.380 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.380 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.380 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:12:12.380 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:12:12.380 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.380 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.380 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.380 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.380 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:12:12.380 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.380 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.380 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.381 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:12:12.381 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.381 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.381 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.381 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:12:12.381 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:12:12.381 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.381 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.381 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.381 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:12:12.381 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:12:12.382 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.382 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.382 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.382 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:12:12.382 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.382 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.382 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:12:12.382 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.382 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.382 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.383 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:12:12.383 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:12:12.383 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.383 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.383 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.383 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:12:12.383 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:12:12.383 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.383 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.383 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:12:12.384 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.384 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:12:12.384 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.384 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.384 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:12:12.384 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:12:12.384 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.384 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.385 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.385 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.385 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.385 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:12:12.385 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:12:12.385 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.385 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:12:12.385 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:12:12.385 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:12:12.385 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.385 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.385 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:12:12.385 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.386 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:12:12.386 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:12:12.386 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:12:12.386 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.386 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.386 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:12:12.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.386 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:12:12.386 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:12:12.386 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:12:12.386 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.386 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.387 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:12:12.387 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:12:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5758b3a640 1 -- 172.21.15.5:0/2674614885 >> v2:172.21.15.157:6812/631023601 conn(0x7f573403bdc0 msgr2=0x7f573403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5758b3a640 1 --2- 172.21.15.5:0/2674614885 >> v2:172.21.15.157:6812/631023601 conn(0x7f573403bdc0 0x7f573403e280 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f575409db50 tx=0x7f574c008040 comp rx=0 tx=0).stop 2024-08-18T21:12:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5758b3a640 10 monclient: shutdown 2024-08-18T21:12:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5758b3a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:12:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5758b3a640 1 -- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f57540a6bd0 msgr2=0x7f5754138e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5758b3a640 1 --2- 172.21.15.5:0/2674614885 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f57540a6bd0 0x7f5754138e20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f574800b560 tx=0x7f574800ba20 comp rx=0 tx=0).stop 2024-08-18T21:12:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5752d9d640 1 -- 172.21.15.5:0/2674614885 reap_dead start 2024-08-18T21:12:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5752d9d640 1 -- 172.21.15.5:0/2674614885 reap_dead start 2024-08-18T21:12:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5758b3a640 1 -- 172.21.15.5:0/2674614885 shutdown_connections 2024-08-18T21:12:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5758b3a640 1 -- 172.21.15.5:0/2674614885 >> 172.21.15.5:0/2674614885 conn(0x7f5754068700 msgr2=0x7f57540aa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:12:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5758b3a640 1 -- 172.21.15.5:0/2674614885 shutdown_connections 2024-08-18T21:12:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.352+0000 7f5758b3a640 1 -- 172.21.15.5:0/2674614885 wait complete. 2024-08-18T21:12:12.389 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:12:12.390 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon d 2024-08-18T21:12:12.390 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:12:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 10 monclient: get_monmap_and_config 2024-08-18T21:12:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 10 monclient: build_initial_monmap 2024-08-18T21:12:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 10 monclient: monmap: 2024-08-18T21:12:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:12:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:12:12.513924+0000 2024-08-18T21:12:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:12:12.513924+0000 2024-08-18T21:12:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:12:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:12:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:12:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:12:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:12:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:12:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:12:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:12:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:12:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:12:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:12:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:12:12.512 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 1 Processor -- start 2024-08-18T21:12:12.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 1 -- start start 2024-08-18T21:12:12.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 10 monclient: init 2024-08-18T21:12:12.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:12.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 10 monclient: _add_conns ranks=[3,4,2,10,5,0,7,9,8,1,6] 2024-08-18T21:12:12.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9dc0a4a40 0x7fc9dc09ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 10 monclient(hunting): picked mon.noname-g con 0x7fc9dc0a4a40 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:12:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc9dc0a4e20 0x7fc9dc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 10 monclient(hunting): picked mon.noname-c con 0x7fc9dc0a4e20 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:12:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9dc139820 0x7fc9dc139c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 10 monclient(hunting): picked mon.noname-b con 0x7fc9dc139820 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:12:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fc9dc06cf20 con 0x7fc9dc139820 2024-08-18T21:12:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc9dc069a20 con 0x7fc9dc0a4a40 2024-08-18T21:12:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fc9dc09de70 con 0x7fc9dc0a4e20 2024-08-18T21:12:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.508+0000 7fc9e3448640 10 monclient(hunting): authenticate will time out at 1499.527903s 2024-08-18T21:12:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e19e5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9dc139820 0x7fc9dc139c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e19e5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9dc139820 0x7fc9dc139c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:44932/0 (socket says 172.21.15.5:44932) 2024-08-18T21:12:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e19e5640 1 -- 172.21.15.5:0/707636909 learned_addr learned my addr 172.21.15.5:0/707636909 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:12:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e19e5640 10 monclient(hunting): get_auth_request con 0x7fc9dc139820 auth_method 0 2024-08-18T21:12:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e19e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e19e5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e19e5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 1 --2- 172.21.15.5:0/707636909 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc9dc0a4e20 0x7fc9dc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e11e4640 1 -- 172.21.15.5:0/707636909 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9dc0a4a40 msgr2=0x7fc9dc09ec10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:12:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 10 monclient(hunting): get_auth_request con 0x7fc9dc0a4e20 auth_method 0 2024-08-18T21:12:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e11e4640 1 --2- 172.21.15.5:0/707636909 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9dc0a4a40 0x7fc9dc09ec10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e19e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e19e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e19e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 10 monclient(hunting): handle_auth_done global_id 114331 payload 274 2024-08-18T21:12:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 1 -- 172.21.15.5:0/707636909 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9dc0a4a40 msgr2=0x7fc9dc09ec10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 1 --2- 172.21.15.5:0/707636909 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9dc0a4a40 0x7fc9dc09ec10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 1 -- 172.21.15.5:0/707636909 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9dc139820 msgr2=0x7fc9dc139c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:12:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 1 --2- 172.21.15.5:0/707636909 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9dc139820 0x7fc9dc139c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 10 monclient: _finish_hunting 0 2024-08-18T21:12:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 1 monclient: found mon.noname-c 2024-08-18T21:12:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:12:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e09e3640 1 -- 172.21.15.5:0/707636909 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc09e150 con 0x7fc9dc0a4e20 2024-08-18T21:12:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.512+0000 7fc9e19e5640 1 --2- 172.21.15.5:0/707636909 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9dc139820 0x7fc9dc139c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:12:12.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e09e3640 1 -- 172.21.15.5:0/707636909 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc9dc0a4e20 msgr2=0x7fc9dc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e09e3640 1 --2- 172.21.15.5:0/707636909 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc9dc0a4e20 0x7fc9dc0a5240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0097f0 tx=0x7fc9cc01c390 comp rx=0 tx=0).ready entity=mon.4 client_cookie=173ae4e1da2628cf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9d3fff640 1 -- 172.21.15.5:0/707636909 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9cc0b0070 con 0x7fc9dc0a4e20 2024-08-18T21:12:12.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9d3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:12:12.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9d3fff640 10 monclient: dump: 2024-08-18T21:12:12.522 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.524 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9d3fff640 10 monclient: _finish_auth 0 2024-08-18T21:12:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9d3fff640 10 monclient: _check_auth_tickets 2024-08-18T21:12:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 5 monclient: authenticate success, global_id 114331 2024-08-18T21:12:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:12:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9d3fff640 1 -- 172.21.15.5:0/707636909 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9cc0aa810 con 0x7fc9dc0a4e20 2024-08-18T21:12:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9d3fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:12:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 10 monclient: get_monmap_and_config success 2024-08-18T21:12:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 4 set_mon_vals no callback set 2024-08-18T21:12:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9d3fff640 1 -- 172.21.15.5:0/707636909 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9cc0a9300 con 0x7fc9dc0a4e20 2024-08-18T21:12:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9d3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:12:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9d3fff640 10 monclient: dump: 2024-08-18T21:12:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.526 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 10 monclient: shutdown 2024-08-18T21:12:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:12:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 -- 172.21.15.5:0/707636909 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc9dc0a4e20 msgr2=0x7fc9dc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 --2- 172.21.15.5:0/707636909 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc9dc0a4e20 0x7fc9dc0a5240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0097f0 tx=0x7fc9cc01c390 comp rx=0 tx=0).stop 2024-08-18T21:12:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 -- 172.21.15.5:0/707636909 shutdown_connections 2024-08-18T21:12:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 --2- 172.21.15.5:0/707636909 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9dc139820 0x7fc9dc139c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 --2- 172.21.15.5:0/707636909 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc9dc0a4e20 0x7fc9dc0a5240 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 --2- 172.21.15.5:0/707636909 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9dc0a4a40 0x7fc9dc09ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 -- 172.21.15.5:0/707636909 >> 172.21.15.5:0/707636909 conn(0x7fc9dc068700 msgr2=0x7fc9dc068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:12:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 -- 172.21.15.5:0/707636909 shutdown_connections 2024-08-18T21:12:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 -- 172.21.15.5:0/707636909 wait complete. 2024-08-18T21:12:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 10 monclient: build_initial_monmap 2024-08-18T21:12:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 10 monclient: monmap: 2024-08-18T21:12:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:12:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:12:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:12:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:12:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:12:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:12:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:12:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:12:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:12:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:12:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:12:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:12:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:12:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:12:12.528 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 Processor -- start 2024-08-18T21:12:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 -- start start 2024-08-18T21:12:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 10 monclient: init 2024-08-18T21:12:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 10 monclient: _add_conns ranks=[1,7,2,0,6,5,8,4,3] 2024-08-18T21:12:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9dc0a4a40 0x7fc9dc122b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 10 monclient(hunting): picked mon.noname-f con 0x7fc9dc0a4a40 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:12:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc9dc0a4e20 0x7fc9dc1389d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 10 monclient(hunting): picked mon.noname-i con 0x7fc9dc0a4e20 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:12:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9dc139820 0x7fc9dc1d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 10 monclient(hunting): picked mon.noname-b con 0x7fc9dc139820 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:12:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc06cad0 con 0x7fc9dc0a4a40 2024-08-18T21:12:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fc9dc06c950 con 0x7fc9dc139820 2024-08-18T21:12:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fc9dc1434a0 con 0x7fc9dc0a4e20 2024-08-18T21:12:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e3448640 10 monclient(hunting): authenticate will time out at 1499.535261s 2024-08-18T21:12:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9dc139820 0x7fc9dc1d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9dc139820 0x7fc9dc1d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:44946/0 (socket says 172.21.15.5:44946) 2024-08-18T21:12:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 1 -- 172.21.15.5:0/2289194348 learned_addr learned my addr 172.21.15.5:0/2289194348 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:12:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 10 monclient(hunting): get_auth_request con 0x7fc9dc139820 auth_method 0 2024-08-18T21:12:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e09e3640 1 -- 172.21.15.5:0/2289194348 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc9dc0a4e20 msgr2=0x7fc9dc1389d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:12:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e11e4640 1 -- 172.21.15.5:0/2289194348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9dc0a4a40 msgr2=0x7fc9dc122b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:12:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e09e3640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc9dc0a4e20 0x7fc9dc1389d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e11e4640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9dc0a4a40 0x7fc9dc122b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 10 monclient(hunting): handle_auth_done global_id 114266 payload 824 2024-08-18T21:12:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 1 -- 172.21.15.5:0/2289194348 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc9dc0a4e20 msgr2=0x7fc9dc1389d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:12:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc9dc0a4e20 0x7fc9dc1389d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 1 -- 172.21.15.5:0/2289194348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9dc0a4a40 msgr2=0x7fc9dc122b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:12:12.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9dc0a4a40 0x7fc9dc122b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 10 monclient: _finish_hunting 0 2024-08-18T21:12:12.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 1 monclient: found mon.noname-b 2024-08-18T21:12:12.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:12.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:12:12.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.516+0000 7fc9e19e5640 1 -- 172.21.15.5:0/2289194348 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc124390 con 0x7fc9dc139820 2024-08-18T21:12:12.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e19e5640 1 -- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9dc139820 msgr2=0x7fc9dc1d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e19e5640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9dc139820 0x7fc9dc1d15a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400efc0 tx=0x7fc9d400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d1ffb640 1 -- 172.21.15.5:0/2289194348 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9d400cd30 con 0x7fc9dc139820 2024-08-18T21:12:12.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:12:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d1ffb640 10 monclient: dump: 2024-08-18T21:12:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.537 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d1ffb640 10 monclient: _finish_auth 0 2024-08-18T21:12:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d1ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:12:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e3448640 5 monclient: authenticate success, global_id 114266 2024-08-18T21:12:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d1ffb640 1 -- 172.21.15.5:0/2289194348 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d4019070 con 0x7fc9dc139820 2024-08-18T21:12:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e3448640 10 monclient: _renew_subs 2024-08-18T21:12:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e3448640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:12:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e3448640 1 -- 172.21.15.5:0/2289194348 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9dc0a3360 con 0x7fc9dc139820 2024-08-18T21:12:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d1ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:12:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d1ffb640 1 -- 172.21.15.5:0/2289194348 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9d4014d60 con 0x7fc9dc139820 2024-08-18T21:12:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:12:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d37fe640 4 set_mon_vals no callback set 2024-08-18T21:12:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d1ffb640 10 monclient: dump: 2024-08-18T21:12:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.539 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e3448640 10 monclient: _renew_subs 2024-08-18T21:12:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e3448640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:12:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e3448640 1 -- 172.21.15.5:0/2289194348 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9dc123ad0 con 0x7fc9dc139820 2024-08-18T21:12:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e3448640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e3448640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc9dc120a80 0x7fc9dc1d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e3448640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e3448640 1 -- 172.21.15.5:0/2289194348 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fc9dc123fa0 con 0x7fc9dc120a80 2024-08-18T21:12:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e11e4640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc9dc120a80 0x7fc9dc1d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e11e4640 10 monclient: get_auth_request con 0x7fc9dc120a80 auth_method 0 2024-08-18T21:12:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e11e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e11e4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e11e4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d1ffb640 1 -- 172.21.15.5:0/2289194348 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fc9d4012050 con 0x7fc9dc139820 2024-08-18T21:12:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e11e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e11e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e11e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e11e4640 10 monclient(hunting): handle_auth_done global_id 85461 payload 824 2024-08-18T21:12:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e11e4640 1 -- 172.21.15.5:0/2289194348 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9dc0a5240 con 0x7fc9dc120a80 2024-08-18T21:12:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d1ffb640 1 --2- 172.21.15.5:0/2289194348 >> v2:172.21.15.157:6812/631023601 conn(0x7fc9c003bdf0 0x7fc9c003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9d1ffb640 1 -- 172.21.15.5:0/2289194348 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(241..241 src has 22..241) ==== 3898+0+0 (secure 0 0 0) 0x7fc9d404ea70 con 0x7fc9dc139820 2024-08-18T21:12:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e09e3640 1 --2- 172.21.15.5:0/2289194348 >> v2:172.21.15.157:6812/631023601 conn(0x7fc9c003bdf0 0x7fc9c003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.520+0000 7fc9e09e3640 10 monclient: get_auth_request con 0x7fc9c003bdf0 auth_method 0 2024-08-18T21:12:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.524+0000 7fc9e11e4640 1 -- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc9dc120a80 msgr2=0x7fc9dc1d1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.524+0000 7fc9e11e4640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc9dc120a80 0x7fc9dc1d1ae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800b380 tx=0x7fc9d800b840 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.524+0000 7fc9d1ffb640 1 -- 172.21.15.5:0/2289194348 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9d8016070 con 0x7fc9dc120a80 2024-08-18T21:12:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.524+0000 7fc9d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.524+0000 7fc9d1ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:12:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.524+0000 7fc9d1ffb640 10 monclient: dump: 2024-08-18T21:12:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.542 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.542 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.542 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.542 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.542 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.542 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.542 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.542 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.545 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.545 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.545 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.546 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.524+0000 7fc9d1ffb640 1 -- 172.21.15.5:0/2289194348 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc9d8005070 con 0x7fc9dc120a80 2024-08-18T21:12:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.524+0000 7fc9d1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.524+0000 7fc9d1ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:12:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.524+0000 7fc9d1ffb640 1 -- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc9dc120a80 msgr2=0x7fc9dc1d1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.524+0000 7fc9d1ffb640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc9dc120a80 0x7fc9dc1d1ae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800b380 tx=0x7fc9d800b840 comp rx=0 tx=0).stop 2024-08-18T21:12:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.524+0000 7fc9d1ffb640 1 -- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc9dc120a80 msgr2=0x7fc9dc1d1ae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:12:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.524+0000 7fc9d1ffb640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc9dc120a80 0x7fc9dc1d1ae0 secure :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800b380 tx=0x7fc9d800b840 comp rx=0 tx=0).stop 2024-08-18T21:12:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.524+0000 7fc9e09e3640 1 --2- 172.21.15.5:0/2289194348 >> v2:172.21.15.157:6812/631023601 conn(0x7fc9c003bdf0 0x7fc9c003e2b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0097c0 tx=0x7fc9cc008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e3448640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:12:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e3448640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc9dc138f10 0x7fc9dc1d2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e3448640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e3448640 1 -- 172.21.15.5:0/2289194348 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fc9dc051140 con 0x7fc9dc138f10 2024-08-18T21:12:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e11e4640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc9dc138f10 0x7fc9dc1d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e11e4640 10 monclient: get_auth_request con 0x7fc9dc138f10 auth_method 0 2024-08-18T21:12:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e11e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e11e4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e11e4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e11e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e11e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e11e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e11e4640 10 monclient(hunting): handle_auth_done global_id 85470 payload 824 2024-08-18T21:12:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e11e4640 1 -- 172.21.15.5:0/2289194348 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc9dc13fd60 con 0x7fc9dc138f10 2024-08-18T21:12:12.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e11e4640 1 -- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc9dc138f10 msgr2=0x7fc9dc1d2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e11e4640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc9dc138f10 0x7fc9dc1d2020 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800b380 tx=0x7fc9d80059e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9d1ffb640 1 -- 172.21.15.5:0/2289194348 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9d8016040 con 0x7fc9dc138f10 2024-08-18T21:12:12.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9d1ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:12:12.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9d1ffb640 10 monclient: dump: 2024-08-18T21:12:12.549 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.549 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.549 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.550 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.550 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.550 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.550 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.550 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.550 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.550 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.550 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.550 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.550 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.550 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.550 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.550 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9d1ffb640 1 -- 172.21.15.5:0/2289194348 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9371 (secure 0 0 0) 0x7fc9d8018830 con 0x7fc9dc138f10 2024-08-18T21:12:12.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9d1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:12:12.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9d1ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:12:12.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9d1ffb640 1 -- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc9dc138f10 msgr2=0x7fc9dc1d2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9d1ffb640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc9dc138f10 0x7fc9dc1d2020 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800b380 tx=0x7fc9d80059e0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9d1ffb640 1 -- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc9dc138f10 msgr2=0x7fc9dc1d2020 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:12:12.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9d1ffb640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc9dc138f10 0x7fc9dc1d2020 secure :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800b380 tx=0x7fc9d80059e0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:12:12.551 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:12:12.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:12:12.552 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:12:12.552 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 182, 2024-08-18T21:12:12.552 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 229361, 2024-08-18T21:12:12.552 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:12:12.552 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:12:12.552 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:12:12.552 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:12:12.552 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:12:12.552 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:12:12.552 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.552 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:12:12.552 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:12:12.552 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:12:12.552 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:12:12.553 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:12:12.553 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:12:12.553 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:12:12.553 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:12:12.553 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:12:12.553 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:12:12.553 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:12:12.553 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:12:12.553 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:12:12.553 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:12:12.553 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:12:12.553 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.553 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:12:12.553 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:12:12.553 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:12:12.554 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:12:12.554 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:12:12.554 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:12:12.554 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:12:12.554 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:12:12.554 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:12:12.554 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:12:12.554 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:12:12.554 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:12:12.554 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:12:12.554 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.554 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:12:12.555 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:12:12.555 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:12:12.555 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:12:12.555 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:12:12.555 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:12:12.555 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:12:12.555 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:12:12.555 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:12:12.555 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:12:12.555 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:12:12.555 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:12:12.555 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:12:12.555 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:12:12.555 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:12:12.556 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:12:12.556 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:12:12.556 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:12:12.556 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:12:12.556 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:12:12.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:12:12.556 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:12:12.556 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:12:12.556 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:12:12.556 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:12:12.556 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:12:12.556 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:12:12.556 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:12:12.556 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.557 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:12:12.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.557 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:12:12.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:12:12.557 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:12:12.557 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.557 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.557 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.557 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:12:12.557 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.558 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.558 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.558 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:12:12.558 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.558 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.558 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.558 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:12:12.558 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:12:12.558 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.558 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.558 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.559 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:12:12.559 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:12:12.559 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.559 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.559 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.559 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:12:12.559 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.559 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.559 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:12:12.559 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.560 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.560 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.560 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:12:12.560 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:12:12.560 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.560 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.560 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.560 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:12:12.560 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:12:12.560 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.561 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.561 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.561 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:12:12.561 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.561 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.561 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:12:12.561 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.561 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.561 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.561 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:12:12.562 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:12:12.562 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.562 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.562 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:12:12.562 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:12:12.562 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.562 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.562 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.562 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:12:12.563 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.563 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.563 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.563 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:12:12.563 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.563 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.563 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.563 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:12:12.563 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:12:12.563 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.563 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.563 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:12:12.564 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:12:12.564 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.564 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.564 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.564 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:12:12.564 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.564 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.564 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:12:12.565 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.565 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.565 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.565 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:12:12.565 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:12:12.565 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.565 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.565 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.565 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.565 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:12:12.565 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:12:12.565 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.566 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.566 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.566 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:12:12.566 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.566 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.566 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:12:12.566 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.566 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.566 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.567 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:12:12.567 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:12:12.567 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.567 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.567 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.567 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:12:12.567 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:12:12.567 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.567 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.567 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.567 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:12:12.568 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.568 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.568 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:12:12.568 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.568 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.568 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.568 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:12:12.568 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:12:12.568 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.568 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.568 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.569 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:12:12.569 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:12:12.569 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.569 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.569 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:12:12.569 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.569 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:12:12.570 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.570 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.570 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.570 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:12:12.570 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:12:12.570 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.570 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.570 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.570 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:12:12.571 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:12:12.571 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.571 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:12:12.571 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.571 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:12:12.571 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.571 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.572 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.572 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:12:12.572 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:12:12.572 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.572 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.572 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.572 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.572 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.572 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:12:12.572 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:12:12.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.572 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:12:12.573 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:12:12.573 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:12:12.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.573 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.573 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:12:12.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.573 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:12:12.573 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:12:12.573 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:12:12.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.573 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.573 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:12:12.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.573 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:12:12.574 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:12:12.574 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:12:12.574 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.574 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.574 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:12:12.574 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:12:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e3448640 1 -- 172.21.15.5:0/2289194348 >> v2:172.21.15.157:6812/631023601 conn(0x7fc9c003bdf0 msgr2=0x7fc9c003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e3448640 1 --2- 172.21.15.5:0/2289194348 >> v2:172.21.15.157:6812/631023601 conn(0x7fc9c003bdf0 0x7fc9c003e2b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0097c0 tx=0x7fc9cc008040 comp rx=0 tx=0).stop 2024-08-18T21:12:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e3448640 10 monclient: shutdown 2024-08-18T21:12:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e3448640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:12:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e3448640 1 -- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9dc139820 msgr2=0x7fc9dc1d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e19e5640 1 -- 172.21.15.5:0/2289194348 reap_dead start 2024-08-18T21:12:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e3448640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9dc139820 0x7fc9dc1d15a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400efc0 tx=0x7fc9d400c490 comp rx=0 tx=0).stop 2024-08-18T21:12:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e3448640 1 -- 172.21.15.5:0/2289194348 shutdown_connections 2024-08-18T21:12:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e3448640 1 --2- 172.21.15.5:0/2289194348 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9dc139820 0x7fc9dc1d15a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e3448640 1 -- 172.21.15.5:0/2289194348 >> 172.21.15.5:0/2289194348 conn(0x7fc9dc068700 msgr2=0x7fc9dc0a7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:12:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e3448640 1 -- 172.21.15.5:0/2289194348 shutdown_connections 2024-08-18T21:12:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.532+0000 7fc9e3448640 1 -- 172.21.15.5:0/2289194348 wait complete. 2024-08-18T21:12:12.576 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:12:12.577 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon e 2024-08-18T21:12:12.577 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:12:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 10 monclient: get_monmap_and_config 2024-08-18T21:12:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 10 monclient: build_initial_monmap 2024-08-18T21:12:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 10 monclient: monmap: 2024-08-18T21:12:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:12:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:12:12.692628+0000 2024-08-18T21:12:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:12:12.692628+0000 2024-08-18T21:12:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:12:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:12:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:12:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:12:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:12:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:12:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:12:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:12:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:12:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:12:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:12:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:12:12.691 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 1 Processor -- start 2024-08-18T21:12:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 1 -- start start 2024-08-18T21:12:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 10 monclient: init 2024-08-18T21:12:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 10 monclient: _add_conns ranks=[0,8,6,9,7,3,5,10,2,1,4] 2024-08-18T21:12:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1f3c0a6ce0 addr v1:172.21.15.5:6789/0 2024-08-18T21:12:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c0a77d0 0x7f1f3c13ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 10 monclient(hunting): picked mon.noname-e con 0x7f1f3c0a77d0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:12:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1f3c13f220 0x7f1f3c141610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 10 monclient(hunting): picked mon.noname-d con 0x7f1f3c13f220 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:12:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f3c0a45d0 con 0x7f1f3c0a6ce0 2024-08-18T21:12:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f1f3c0a5000 con 0x7f1f3c13f220 2024-08-18T21:12:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f1f3c0a4360 con 0x7f1f3c0a77d0 2024-08-18T21:12:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f42b4d640 10 monclient(hunting): authenticate will time out at 1499.705754s 2024-08-18T21:12:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f408e9640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7f1f3c0a6ce0 legacy=0x7f1f3c0a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:12:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c0a77d0 0x7f1f3c13ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f410ea640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1f3c13f220 0x7f1f3c141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c0a77d0 0x7f1f3c13ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:38882/0 (socket says 172.21.15.5:38882) 2024-08-18T21:12:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f410ea640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1f3c13f220 0x7f1f3c141610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:36100/0 (socket says 172.21.15.5:36100) 2024-08-18T21:12:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 1 -- 172.21.15.5:0/3919395230 learned_addr learned my addr 172.21.15.5:0/3919395230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:12:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 10 monclient(hunting): get_auth_request con 0x7f1f3c0a77d0 auth_method 0 2024-08-18T21:12:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f410ea640 10 monclient(hunting): get_auth_request con 0x7f1f3c13f220 auth_method 0 2024-08-18T21:12:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f410ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f410ea640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f410ea640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f410ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f410ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f410ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 10 monclient(hunting): handle_auth_done global_id 114389 payload 274 2024-08-18T21:12:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 1 -- 172.21.15.5:0/3919395230 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1f3c13f220 msgr2=0x7f1f3c141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:12:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 1 --2- 172.21.15.5:0/3919395230 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1f3c13f220 0x7f1f3c141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 1 -- 172.21.15.5:0/3919395230 >> v1:172.21.15.5:6789/0 conn(0x7f1f3c0a6ce0 legacy=0x7f1f3c0a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:12:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 1 monclient: found mon.noname-e 2024-08-18T21:12:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:12:12.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f3bfff640 1 -- 172.21.15.5:0/3919395230 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3c0a32d0 con 0x7f1f3c0a77d0 2024-08-18T21:12:12.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.688+0000 7f1f410ea640 1 --2- 172.21.15.5:0/3919395230 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1f3c13f220 0x7f1f3c141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:12:12.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f3bfff640 1 -- 172.21.15.5:0/3919395230 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c0a77d0 msgr2=0x7f1f3c13ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f3bfff640 1 --2- 172.21.15.5:0/3919395230 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c0a77d0 0x7f1f3c13ece0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1f240098a0 tx=0x7f1f2401c440 comp rx=0 tx=0).ready entity=mon.8 client_cookie=79b606c35416cac server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f3b7fe640 1 -- 172.21.15.5:0/3919395230 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1f240b0070 con 0x7f1f3c0a77d0 2024-08-18T21:12:12.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f3b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:12:12.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f3b7fe640 10 monclient: dump: 2024-08-18T21:12:12.700 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.700 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.700 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.701 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f3b7fe640 10 monclient: _finish_auth 0 2024-08-18T21:12:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f3b7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:12:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f3b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f3b7fe640 1 -- 172.21.15.5:0/3919395230 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f240aa810 con 0x7f1f3c0a77d0 2024-08-18T21:12:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f42b4d640 5 monclient: authenticate success, global_id 114389 2024-08-18T21:12:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f42b4d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:12:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f3b7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:12:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f3b7fe640 1 -- 172.21.15.5:0/3919395230 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1f240aae30 con 0x7f1f3c0a77d0 2024-08-18T21:12:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f42b4d640 10 monclient: get_monmap_and_config success 2024-08-18T21:12:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f42b4d640 4 set_mon_vals no callback set 2024-08-18T21:12:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f3b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:12:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f3b7fe640 10 monclient: dump: 2024-08-18T21:12:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.704 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f42b4d640 10 monclient: shutdown 2024-08-18T21:12:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f42b4d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:12:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f42b4d640 1 -- 172.21.15.5:0/3919395230 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c0a77d0 msgr2=0x7f1f3c13ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f42b4d640 1 --2- 172.21.15.5:0/3919395230 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c0a77d0 0x7f1f3c13ece0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1f240098a0 tx=0x7f1f2401c440 comp rx=0 tx=0).stop 2024-08-18T21:12:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f42b4d640 1 -- 172.21.15.5:0/3919395230 shutdown_connections 2024-08-18T21:12:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f42b4d640 1 --2- 172.21.15.5:0/3919395230 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1f3c13f220 0x7f1f3c141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f42b4d640 1 --2- 172.21.15.5:0/3919395230 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c0a77d0 0x7f1f3c13ece0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f42b4d640 1 -- 172.21.15.5:0/3919395230 >> 172.21.15.5:0/3919395230 conn(0x7f1f3c0acbc0 msgr2=0x7f1f3c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:12:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f42b4d640 1 -- 172.21.15.5:0/3919395230 shutdown_connections 2024-08-18T21:12:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.692+0000 7f1f42b4d640 1 -- 172.21.15.5:0/3919395230 wait complete. 2024-08-18T21:12:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 10 monclient: build_initial_monmap 2024-08-18T21:12:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 10 monclient: monmap: 2024-08-18T21:12:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:12:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:12:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:12:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:12:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:12:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:12:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:12:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:12:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:12:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:12:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:12:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:12:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:12:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:12:12.706 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 1 Processor -- start 2024-08-18T21:12:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 1 -- start start 2024-08-18T21:12:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 10 monclient: init 2024-08-18T21:12:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 10 monclient: _add_conns ranks=[2,8,6,3,1,7,5,4,0] 2024-08-18T21:12:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1f3c0a6ce0 0x7f1f3c1d1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 10 monclient(hunting): picked mon.noname-b con 0x7f1f3c0a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:12:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c0a77d0 0x7f1f3c1d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 10 monclient(hunting): picked mon.noname-e con 0x7f1f3c0a77d0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:12:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1f3c13f220 0x7f1f3c1d1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 10 monclient(hunting): picked mon.noname-d con 0x7f1f3c13f220 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:12:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f1f3c0a83a0 con 0x7f1f3c0a6ce0 2024-08-18T21:12:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f1f3c0a8220 con 0x7f1f3c13f220 2024-08-18T21:12:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f1f3c144370 con 0x7f1f3c0a77d0 2024-08-18T21:12:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f42b4d640 10 monclient(hunting): authenticate will time out at 1499.713476s 2024-08-18T21:12:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c0a77d0 0x7f1f3c1d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f410ea640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1f3c13f220 0x7f1f3c1d1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f408e9640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1f3c0a6ce0 0x7f1f3c1d1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c0a77d0 0x7f1f3c1d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:38892/0 (socket says 172.21.15.5:38892) 2024-08-18T21:12:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f410ea640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1f3c13f220 0x7f1f3c1d1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:36116/0 (socket says 172.21.15.5:36116) 2024-08-18T21:12:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 1 -- 172.21.15.5:0/2281949880 learned_addr learned my addr 172.21.15.5:0/2281949880 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:12:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f408e9640 10 monclient(hunting): get_auth_request con 0x7f1f3c0a6ce0 auth_method 0 2024-08-18T21:12:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f408e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f408e9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f408e9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f410ea640 10 monclient(hunting): get_auth_request con 0x7f1f3c13f220 auth_method 0 2024-08-18T21:12:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f410ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f410ea640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f410ea640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 10 monclient(hunting): get_auth_request con 0x7f1f3c0a77d0 auth_method 0 2024-08-18T21:12:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f410ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f410ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f410ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f408e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f408e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f408e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 10 monclient(hunting): handle_auth_done global_id 114398 payload 824 2024-08-18T21:12:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 1 -- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1f3c13f220 msgr2=0x7f1f3c1d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 1 --2- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1f3c13f220 0x7f1f3c1d1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 1 -- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1f3c0a6ce0 msgr2=0x7f1f3c1d1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 1 --2- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1f3c0a6ce0 0x7f1f3c1d1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:12:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 1 monclient: found mon.noname-e 2024-08-18T21:12:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:12:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f3bfff640 1 -- 172.21.15.5:0/2281949880 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3c0a0ed0 con 0x7f1f3c0a77d0 2024-08-18T21:12:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.696+0000 7f1f410ea640 1 --2- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1f3c13f220 0x7f1f3c1d1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:12:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f3bfff640 1 -- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c0a77d0 msgr2=0x7f1f3c1d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f3bfff640 1 --2- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c0a77d0 0x7f1f3c1d19a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1f240097c0 tx=0x7f1f240191e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f397fa640 1 -- 172.21.15.5:0/2281949880 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1f240b0070 con 0x7f1f3c0a77d0 2024-08-18T21:12:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f397fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:12:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f397fa640 10 monclient: dump: 2024-08-18T21:12:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.716 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f397fa640 10 monclient: _finish_auth 0 2024-08-18T21:12:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f397fa640 10 monclient: _check_auth_tickets 2024-08-18T21:12:12.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f397fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:12.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f397fa640 1 -- 172.21.15.5:0/2281949880 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f240b1040 con 0x7f1f3c0a77d0 2024-08-18T21:12:12.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f42b4d640 5 monclient: authenticate success, global_id 114398 2024-08-18T21:12:12.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f42b4d640 10 monclient: _renew_subs 2024-08-18T21:12:12.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f42b4d640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:12:12.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f42b4d640 1 -- 172.21.15.5:0/2281949880 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f3c0aaf00 con 0x7f1f3c0a77d0 2024-08-18T21:12:12.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f397fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:12:12.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f397fa640 1 -- 172.21.15.5:0/2281949880 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1f24004240 con 0x7f1f3c0a77d0 2024-08-18T21:12:12.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f397fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:12:12.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f3affd640 4 set_mon_vals no callback set 2024-08-18T21:12:12.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f397fa640 10 monclient: dump: 2024-08-18T21:12:12.717 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.718 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.718 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.718 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.718 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.718 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.718 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.718 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.718 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.718 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.718 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.718 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.718 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.718 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.718 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.719 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f42b4d640 10 monclient: _renew_subs 2024-08-18T21:12:12.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f42b4d640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:12:12.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f42b4d640 1 -- 172.21.15.5:0/2281949880 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f3c0a1770 con 0x7f1f3c0a77d0 2024-08-18T21:12:12.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f42b4d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:12.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f42b4d640 1 --2- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c136a70 0x7f1f3c136e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f42b4d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f42b4d640 1 -- 172.21.15.5:0/2281949880 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f1f3c051140 con 0x7f1f3c136a70 2024-08-18T21:12:12.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f408e9640 1 --2- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c136a70 0x7f1f3c136e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f408e9640 10 monclient: get_auth_request con 0x7f1f3c136a70 auth_method 0 2024-08-18T21:12:12.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f408e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f408e9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f408e9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f408e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f408e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f408e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f397fa640 1 -- 172.21.15.5:0/2281949880 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f1f240bc060 con 0x7f1f3c0a77d0 2024-08-18T21:12:12.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f408e9640 10 monclient(hunting): handle_auth_done global_id 114407 payload 824 2024-08-18T21:12:12.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f408e9640 1 -- 172.21.15.5:0/2281949880 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f3c141330 con 0x7f1f3c136a70 2024-08-18T21:12:12.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f397fa640 1 --2- 172.21.15.5:0/2281949880 >> v2:172.21.15.157:6812/631023601 conn(0x7f1f1c03bdc0 0x7f1f1c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f397fa640 1 -- 172.21.15.5:0/2281949880 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(241..241 src has 22..241) ==== 3898+0+0 (secure 0 0 0) 0x7f1f240e7a50 con 0x7f1f3c0a77d0 2024-08-18T21:12:12.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f410ea640 1 --2- 172.21.15.5:0/2281949880 >> v2:172.21.15.157:6812/631023601 conn(0x7f1f1c03bdc0 0x7f1f1c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f410ea640 10 monclient: get_auth_request con 0x7f1f1c03bdc0 auth_method 0 2024-08-18T21:12:12.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f408e9640 1 -- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c136a70 msgr2=0x7f1f3c136e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.700+0000 7f1f408e9640 1 --2- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c136a70 0x7f1f3c136e50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009ed0 tx=0x7f1f34007660 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.704+0000 7f1f397fa640 1 -- 172.21.15.5:0/2281949880 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1f3401a070 con 0x7f1f3c136a70 2024-08-18T21:12:12.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.704+0000 7f1f397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.704+0000 7f1f397fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:12:12.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.704+0000 7f1f397fa640 10 monclient: dump: 2024-08-18T21:12:12.721 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.721 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.721 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.721 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.721 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.721 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.721 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.721 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.721 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.722 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.704+0000 7f1f397fa640 1 -- 172.21.15.5:0/2281949880 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1f340054f0 con 0x7f1f3c136a70 2024-08-18T21:12:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.704+0000 7f1f397fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.704+0000 7f1f397fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:12:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.704+0000 7f1f397fa640 1 -- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c136a70 msgr2=0x7f1f3c136e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.704+0000 7f1f397fa640 1 --2- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c136a70 0x7f1f3c136e50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009ed0 tx=0x7f1f34007660 comp rx=0 tx=0).stop 2024-08-18T21:12:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.704+0000 7f1f397fa640 1 -- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c136a70 msgr2=0x7f1f3c136e50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:12:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.704+0000 7f1f397fa640 1 --2- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c136a70 0x7f1f3c136e50 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009ed0 tx=0x7f1f34007660 comp rx=0 tx=0).stop 2024-08-18T21:12:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.704+0000 7f1f410ea640 1 --2- 172.21.15.5:0/2281949880 >> v2:172.21.15.157:6812/631023601 conn(0x7f1f1c03bdc0 0x7f1f1c03e280 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0095a0 tx=0x7f1f2c009190 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.708+0000 7f1f42b4d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:12:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.708+0000 7f1f42b4d640 1 --2- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c137390 0x7f1f3c13f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.708+0000 7f1f42b4d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.708+0000 7f1f42b4d640 1 -- 172.21.15.5:0/2281949880 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f1f3c069fa0 con 0x7f1f3c137390 2024-08-18T21:12:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.708+0000 7f1f408e9640 1 --2- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c137390 0x7f1f3c13f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.708+0000 7f1f408e9640 10 monclient: get_auth_request con 0x7f1f3c137390 auth_method 0 2024-08-18T21:12:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.708+0000 7f1f408e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.708+0000 7f1f408e9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.708+0000 7f1f408e9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.708+0000 7f1f408e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.708+0000 7f1f408e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.708+0000 7f1f408e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.708+0000 7f1f408e9640 10 monclient(hunting): handle_auth_done global_id 114416 payload 824 2024-08-18T21:12:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.708+0000 7f1f408e9640 1 -- 172.21.15.5:0/2281949880 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1f3c0a1340 con 0x7f1f3c137390 2024-08-18T21:12:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f408e9640 1 -- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c137390 msgr2=0x7f1f3c13f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f408e9640 1 --2- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c137390 0x7f1f3c13f600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f34017000 tx=0x7f1f34005d60 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f397fa640 1 -- 172.21.15.5:0/2281949880 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1f3401a070 con 0x7f1f3c137390 2024-08-18T21:12:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f397fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:12:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f397fa640 10 monclient: dump: 2024-08-18T21:12:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.724 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.725 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f397fa640 1 -- 172.21.15.5:0/2281949880 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9370 (secure 0 0 0) 0x7f1f34005bb0 con 0x7f1f3c137390 2024-08-18T21:12:12.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f397fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:12:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f397fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:12:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f397fa640 1 -- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c137390 msgr2=0x7f1f3c13f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f397fa640 1 --2- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c137390 0x7f1f3c13f600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f34017000 tx=0x7f1f34005d60 comp rx=0 tx=0).stop 2024-08-18T21:12:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f397fa640 1 -- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c137390 msgr2=0x7f1f3c13f600 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:12:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f397fa640 1 --2- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c137390 0x7f1f3c13f600 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f34017000 tx=0x7f1f34005d60 comp rx=0 tx=0).stop 2024-08-18T21:12:12.726 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:12:12.726 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:12:12.726 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:12:12.726 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:12:12.726 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 182, 2024-08-18T21:12:12.727 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 37879, 2024-08-18T21:12:12.727 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:12:12.727 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:12:12.727 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:12:12.727 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:12:12.727 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:12:12.727 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:12:12.727 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.727 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:12:12.727 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:12:12.727 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:12:12.727 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:12:12.727 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:12:12.728 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:12:12.728 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:12:12.728 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:12:12.728 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:12:12.728 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:12:12.728 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:12:12.728 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:12:12.728 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:12:12.728 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:12:12.728 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:12:12.728 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.728 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:12:12.728 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:12:12.728 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:12:12.729 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:12:12.729 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:12:12.729 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:12:12.729 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:12:12.729 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:12:12.729 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:12:12.729 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:12:12.729 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:12:12.729 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:12:12.729 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:12:12.729 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.729 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:12:12.729 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:12:12.730 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:12:12.730 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:12:12.730 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:12:12.730 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:12:12.730 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:12:12.730 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:12:12.730 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:12:12.730 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:12:12.730 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:12:12.731 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:12:12.731 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:12:12.731 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:12:12.731 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:12:12.731 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:12:12.731 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:12:12.731 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:12:12.731 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:12:12.731 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:12:12.731 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:12:12.731 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:12:12.731 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:12:12.731 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:12:12.732 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:12:12.732 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:12:12.732 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:12:12.732 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:12:12.732 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.732 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:12:12.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.732 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:12:12.732 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.732 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:12:12.732 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:12:12.732 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.732 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.732 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.733 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:12:12.733 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.733 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:12:12.733 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.733 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.733 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.733 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:12:12.733 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:12:12.734 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.734 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.734 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.734 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:12:12.734 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:12:12.734 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.734 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.734 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.734 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:12:12.734 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.735 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.735 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:12:12.735 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.735 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.735 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.735 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:12:12.735 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:12:12.735 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.735 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.735 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.736 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:12:12.736 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:12:12.736 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:12:12.736 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:12:12.736 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.737 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:12:12.737 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:12:12.737 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.737 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.737 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.737 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:12:12.737 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:12:12.737 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:12:12.738 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:12:12.738 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.738 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.738 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:12:12.738 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:12:12.739 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.739 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.739 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.739 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:12:12.739 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:12:12.739 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.739 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.739 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.739 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:12:12.739 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.740 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.740 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:12:12.740 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.740 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.740 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.740 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:12:12.740 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:12:12.740 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.740 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.740 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.741 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:12:12.741 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:12:12.741 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.741 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.741 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.741 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:12:12.741 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.742 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.742 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:12:12.742 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.742 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.742 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.742 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:12:12.742 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:12:12.742 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.742 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.742 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.743 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:12:12.743 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:12:12.743 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:12:12.743 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:12:12.743 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.743 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.744 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.744 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:12:12.744 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:12:12.744 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.744 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.744 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.744 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:12:12.744 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:12:12.744 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.744 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:12:12.745 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:12:12.745 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.745 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.745 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:12:12.745 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:12:12.746 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.746 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.746 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.746 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:12:12.746 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:12:12.746 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.746 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.746 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.746 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:12:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:12:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:12:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:12:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.748 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.748 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.748 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:12:12.748 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:12:12.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.748 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:12:12.748 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:12:12.748 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:12:12.748 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.748 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.748 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:12:12.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.748 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:12:12.749 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:12:12.749 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:12:12.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.749 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.749 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:12:12.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.749 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:12:12.749 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:12:12.749 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:12:12.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.749 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.749 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:12:12.749 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:12:12.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f42b4d640 1 -- 172.21.15.5:0/2281949880 >> v2:172.21.15.157:6812/631023601 conn(0x7f1f1c03bdc0 msgr2=0x7f1f1c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f42b4d640 1 --2- 172.21.15.5:0/2281949880 >> v2:172.21.15.157:6812/631023601 conn(0x7f1f1c03bdc0 0x7f1f1c03e280 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0095a0 tx=0x7f1f2c009190 comp rx=0 tx=0).stop 2024-08-18T21:12:12.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f42b4d640 10 monclient: shutdown 2024-08-18T21:12:12.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f42b4d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:12:12.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f42b4d640 1 -- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c0a77d0 msgr2=0x7f1f3c1d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f42b4d640 1 --2- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c0a77d0 0x7f1f3c1d19a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1f240097c0 tx=0x7f1f240191e0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f410ea640 1 -- 172.21.15.5:0/2281949880 reap_dead start 2024-08-18T21:12:12.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f42b4d640 1 -- 172.21.15.5:0/2281949880 shutdown_connections 2024-08-18T21:12:12.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f42b4d640 1 --2- 172.21.15.5:0/2281949880 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1f3c0a77d0 0x7f1f3c1d19a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f42b4d640 1 -- 172.21.15.5:0/2281949880 >> 172.21.15.5:0/2281949880 conn(0x7f1f3c0acbc0 msgr2=0x7f1f3c0a59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:12:12.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f42b4d640 1 -- 172.21.15.5:0/2281949880 shutdown_connections 2024-08-18T21:12:12.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.712+0000 7f1f42b4d640 1 -- 172.21.15.5:0/2281949880 wait complete. 2024-08-18T21:12:12.752 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:12:12.752 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon h 2024-08-18T21:12:12.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:12:12.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 10 monclient: get_monmap_and_config 2024-08-18T21:12:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 10 monclient: build_initial_monmap 2024-08-18T21:12:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 10 monclient: monmap: 2024-08-18T21:12:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:12:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:12:12.868658+0000 2024-08-18T21:12:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:12:12.868658+0000 2024-08-18T21:12:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:12:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:12:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:12:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:12:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:12:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:12:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:12:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:12:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:12:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:12:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:12:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:12:12.867 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 1 Processor -- start 2024-08-18T21:12:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 1 -- start start 2024-08-18T21:12:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 10 monclient: init 2024-08-18T21:12:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 10 monclient: _add_conns ranks=[9,0,8,4,6,5,3,7,2,1,10] 2024-08-18T21:12:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff6240a6bd0 0x7ff6240a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 10 monclient(hunting): picked mon.noname-a con 0x7ff6240a6bd0 addr v2:172.21.15.5:3300/0 2024-08-18T21:12:12.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff62409f080 addr v1:172.21.15.5:6789/0 2024-08-18T21:12:12.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6240a74f0 0x7ff62413a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 10 monclient(hunting): picked mon.noname-e con 0x7ff6240a74f0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:12:12.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6240a7fb0 con 0x7ff62409f080 2024-08-18T21:12:12.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff62409e4c0 con 0x7ff6240a6bd0 2024-08-18T21:12:12.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff62406f930 con 0x7ff6240a74f0 2024-08-18T21:12:12.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:12.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff629c66640 10 monclient(hunting): authenticate will time out at 1499.882017s 2024-08-18T21:12:12.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff6237fe640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7ff6240a6bd0 msgr2=0x7ff6240a6fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2024-08-18T21:12:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff61affd640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7ff62409f080 legacy=0x7ff624139990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2024-08-18T21:12:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff6237fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff6240a6bd0 0x7ff6240a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6240a74f0 0x7ff62413a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6240a74f0 0x7ff62413a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:38920/0 (socket says 172.21.15.5:38920) 2024-08-18T21:12:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 1 -- 172.21.15.5:0/1284257653 learned_addr learned my addr 172.21.15.5:0/1284257653 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:12:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 10 monclient(hunting): get_auth_request con 0x7ff6240a74f0 auth_method 0 2024-08-18T21:12:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 10 monclient(hunting): handle_auth_done global_id 114425 payload 274 2024-08-18T21:12:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 1 -- 172.21.15.5:0/1284257653 >> v2:172.21.15.5:3300/0 conn(0x7ff6240a6bd0 msgr2=0x7ff6240a6fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 1 --2- 172.21.15.5:0/1284257653 >> v2:172.21.15.5:3300/0 conn(0x7ff6240a6bd0 0x7ff6240a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 1 -- 172.21.15.5:0/1284257653 >> v1:172.21.15.5:6789/0 conn(0x7ff62409f080 legacy=0x7ff624139990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 10 monclient: _finish_hunting 0 2024-08-18T21:12:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 1 monclient: found mon.noname-e 2024-08-18T21:12:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:12:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.864+0000 7ff623fff640 1 -- 172.21.15.5:0/1284257653 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62409de70 con 0x7ff6240a74f0 2024-08-18T21:12:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff623fff640 1 -- 172.21.15.5:0/1284257653 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6240a74f0 msgr2=0x7ff62413a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff623fff640 1 --2- 172.21.15.5:0/1284257653 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6240a74f0 0x7ff62413a0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009e50 tx=0x7ff61c01d310 comp rx=0 tx=0).ready entity=mon.8 client_cookie=c49f66ad67a18f2e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff622ffd640 1 -- 172.21.15.5:0/1284257653 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff61c0091b0 con 0x7ff6240a74f0 2024-08-18T21:12:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff622ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff622ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:12:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff622ffd640 10 monclient: dump: 2024-08-18T21:12:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.877 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff622ffd640 10 monclient: _finish_auth 0 2024-08-18T21:12:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff622ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:12:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff622ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff629c66640 5 monclient: authenticate success, global_id 114425 2024-08-18T21:12:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff629c66640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:12:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff622ffd640 1 -- 172.21.15.5:0/1284257653 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff61c0a5ab0 con 0x7ff6240a74f0 2024-08-18T21:12:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff622ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:12:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff629c66640 10 monclient: get_monmap_and_config success 2024-08-18T21:12:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff629c66640 4 set_mon_vals no callback set 2024-08-18T21:12:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff622ffd640 1 -- 172.21.15.5:0/1284257653 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff61c0a5c60 con 0x7ff6240a74f0 2024-08-18T21:12:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff622ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff622ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:12:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff622ffd640 10 monclient: dump: 2024-08-18T21:12:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.879 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff629c66640 10 monclient: shutdown 2024-08-18T21:12:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff629c66640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:12:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff629c66640 1 -- 172.21.15.5:0/1284257653 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6240a74f0 msgr2=0x7ff62413a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff629c66640 1 --2- 172.21.15.5:0/1284257653 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6240a74f0 0x7ff62413a0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009e50 tx=0x7ff61c01d310 comp rx=0 tx=0).stop 2024-08-18T21:12:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff629c66640 1 -- 172.21.15.5:0/1284257653 shutdown_connections 2024-08-18T21:12:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff629c66640 1 --2- 172.21.15.5:0/1284257653 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6240a74f0 0x7ff62413a0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff629c66640 1 --2- 172.21.15.5:0/1284257653 >> v2:172.21.15.5:3300/0 conn(0x7ff6240a6bd0 0x7ff6240a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff629c66640 1 -- 172.21.15.5:0/1284257653 >> 172.21.15.5:0/1284257653 conn(0x7ff624068700 msgr2=0x7ff624068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:12:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff629c66640 1 -- 172.21.15.5:0/1284257653 shutdown_connections 2024-08-18T21:12:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.868+0000 7ff629c66640 1 -- 172.21.15.5:0/1284257653 wait complete. 2024-08-18T21:12:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 10 monclient: build_initial_monmap 2024-08-18T21:12:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 10 monclient: monmap: 2024-08-18T21:12:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:12:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:12:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:12:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:12:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:12:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:12:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:12:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:12:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:12:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:12:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:12:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:12:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:12:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:12:12.881 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 1 Processor -- start 2024-08-18T21:12:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 1 -- start start 2024-08-18T21:12:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 10 monclient: init 2024-08-18T21:12:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 10 monclient: _add_conns ranks=[5,6,8,7,2,0,1,4,3] 2024-08-18T21:12:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62409f080 0x7ff624139230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 10 monclient(hunting): picked mon.noname-h con 0x7ff62409f080 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:12:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff6240a6bd0 0x7ff624139770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 10 monclient(hunting): picked mon.noname-d con 0x7ff6240a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:12:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6240a74f0 0x7ff62413e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 10 monclient(hunting): picked mon.noname-e con 0x7ff6240a74f0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:12:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7ff62413a5e0 con 0x7ff62409f080 2024-08-18T21:12:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7ff6240a89f0 con 0x7ff6240a6bd0 2024-08-18T21:12:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff62413a760 con 0x7ff6240a74f0 2024-08-18T21:12:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff629c66640 10 monclient(hunting): authenticate will time out at 1499.889115s 2024-08-18T21:12:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff6240a6bd0 0x7ff624139770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff623fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6240a74f0 0x7ff62413e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff623fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6240a74f0 0x7ff62413e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:38934/0 (socket says 172.21.15.5:38934) 2024-08-18T21:12:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff6240a6bd0 0x7ff624139770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:36132/0 (socket says 172.21.15.5:36132) 2024-08-18T21:12:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff623fff640 1 -- 172.21.15.5:0/978189362 learned_addr learned my addr 172.21.15.5:0/978189362 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:12:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff623fff640 10 monclient(hunting): get_auth_request con 0x7ff6240a74f0 auth_method 0 2024-08-18T21:12:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff623fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff623fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff623fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 10 monclient(hunting): get_auth_request con 0x7ff6240a6bd0 auth_method 0 2024-08-18T21:12:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff623fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff623fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff623fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff6237fe640 1 --2- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62409f080 0x7ff624139230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff6237fe640 10 monclient(hunting): get_auth_request con 0x7ff62409f080 auth_method 0 2024-08-18T21:12:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff6237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff6237fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff6237fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 10 monclient(hunting): handle_auth_done global_id 85497 payload 824 2024-08-18T21:12:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 1 -- 172.21.15.5:0/978189362 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6240a74f0 msgr2=0x7ff62413e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 1 --2- 172.21.15.5:0/978189362 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6240a74f0 0x7ff62413e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 1 -- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62409f080 msgr2=0x7ff624139230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 1 --2- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62409f080 0x7ff624139230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 10 monclient: _finish_hunting 0 2024-08-18T21:12:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 1 monclient: found mon.noname-d 2024-08-18T21:12:12.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:12.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:12:12.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 1 -- 172.21.15.5:0/978189362 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff624123da0 con 0x7ff6240a6bd0 2024-08-18T21:12:12.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff623fff640 1 --2- 172.21.15.5:0/978189362 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff6240a74f0 0x7ff62413e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:12:12.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 1 -- 172.21.15.5:0/978189362 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff6240a6bd0 msgr2=0x7ff624139770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff61affd640 1 --2- 172.21.15.5:0/978189362 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff6240a6bd0 0x7ff624139770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00b400 tx=0x7ff60c00b8c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff620ff9640 1 -- 172.21.15.5:0/978189362 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff60c016070 con 0x7ff6240a6bd0 2024-08-18T21:12:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.872+0000 7ff620ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff620ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:12:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff620ff9640 10 monclient: dump: 2024-08-18T21:12:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.891 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff620ff9640 10 monclient: _finish_auth 0 2024-08-18T21:12:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff620ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:12:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff620ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff620ff9640 1 -- 172.21.15.5:0/978189362 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c003d10 con 0x7ff6240a6bd0 2024-08-18T21:12:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff629c66640 5 monclient: authenticate success, global_id 85497 2024-08-18T21:12:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff629c66640 10 monclient: _renew_subs 2024-08-18T21:12:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff629c66640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:12:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff629c66640 1 -- 172.21.15.5:0/978189362 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff624140ba0 con 0x7ff6240a6bd0 2024-08-18T21:12:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff620ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:12:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff620ff9640 1 -- 172.21.15.5:0/978189362 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff60c0054e0 con 0x7ff6240a6bd0 2024-08-18T21:12:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff620ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff620ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:12:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff6227fc640 4 set_mon_vals no callback set 2024-08-18T21:12:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff620ff9640 10 monclient: dump: 2024-08-18T21:12:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.893 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff629c66640 10 monclient: _renew_subs 2024-08-18T21:12:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff629c66640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:12:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff629c66640 1 -- 172.21.15.5:0/978189362 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6240abfa0 con 0x7ff6240a6bd0 2024-08-18T21:12:12.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff629c66640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:12.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff629c66640 1 --2- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62413eae0 0x7ff62413eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff629c66640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff629c66640 1 -- 172.21.15.5:0/978189362 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7ff624122820 con 0x7ff62413eae0 2024-08-18T21:12:12.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff620ff9640 1 -- 172.21.15.5:0/978189362 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7ff60c005070 con 0x7ff6240a6bd0 2024-08-18T21:12:12.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff620ff9640 1 --2- 172.21.15.5:0/978189362 >> v2:172.21.15.157:6812/631023601 conn(0x7ff60403bdc0 0x7ff60403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff6237fe640 1 --2- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62413eae0 0x7ff62413eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff6237fe640 10 monclient: get_auth_request con 0x7ff62413eae0 auth_method 0 2024-08-18T21:12:12.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff6237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff6237fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff6237fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff620ff9640 1 -- 172.21.15.5:0/978189362 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(241..241 src has 22..241) ==== 3898+0+0 (secure 0 0 0) 0x7ff60c04d940 con 0x7ff6240a6bd0 2024-08-18T21:12:12.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff6237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff6237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff6237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff623fff640 1 --2- 172.21.15.5:0/978189362 >> v2:172.21.15.157:6812/631023601 conn(0x7ff60403bdc0 0x7ff60403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff623fff640 10 monclient: get_auth_request con 0x7ff60403bdc0 auth_method 0 2024-08-18T21:12:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff6237fe640 10 monclient(hunting): handle_auth_done global_id 94964 payload 824 2024-08-18T21:12:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.876+0000 7ff6237fe640 1 -- 172.21.15.5:0/978189362 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6240aba30 con 0x7ff62413eae0 2024-08-18T21:12:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.880+0000 7ff6237fe640 1 -- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62413eae0 msgr2=0x7ff62413eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.880+0000 7ff6237fe640 1 --2- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62413eae0 0x7ff62413eec0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff614003990 tx=0x7ff61400db90 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.880+0000 7ff623fff640 1 --2- 172.21.15.5:0/978189362 >> v2:172.21.15.157:6812/631023601 conn(0x7ff60403bdc0 0x7ff60403e280 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0af040 tx=0x7ff61c004ac0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.880+0000 7ff620ff9640 1 -- 172.21.15.5:0/978189362 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff614018070 con 0x7ff62413eae0 2024-08-18T21:12:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.880+0000 7ff620ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.880+0000 7ff620ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:12:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.880+0000 7ff620ff9640 10 monclient: dump: 2024-08-18T21:12:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.897 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.880+0000 7ff620ff9640 1 -- 172.21.15.5:0/978189362 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff614005c60 con 0x7ff62413eae0 2024-08-18T21:12:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.880+0000 7ff620ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.880+0000 7ff620ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:12:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.880+0000 7ff620ff9640 1 -- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62413eae0 msgr2=0x7ff62413eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.880+0000 7ff620ff9640 1 --2- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62413eae0 0x7ff62413eec0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff614003990 tx=0x7ff61400db90 comp rx=0 tx=0).stop 2024-08-18T21:12:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.880+0000 7ff620ff9640 1 -- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62413eae0 msgr2=0x7ff62413eec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:12:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.880+0000 7ff620ff9640 1 --2- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62413eae0 0x7ff62413eec0 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff614003990 tx=0x7ff61400db90 comp rx=0 tx=0).stop 2024-08-18T21:12:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.884+0000 7ff629c66640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:12:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.884+0000 7ff629c66640 1 --2- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62413f400 0x7ff62413abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.884+0000 7ff629c66640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.884+0000 7ff629c66640 1 -- 172.21.15.5:0/978189362 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7ff624051140 con 0x7ff62413f400 2024-08-18T21:12:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.884+0000 7ff6237fe640 1 --2- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62413f400 0x7ff62413abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:12.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.884+0000 7ff6237fe640 10 monclient: get_auth_request con 0x7ff62413f400 auth_method 0 2024-08-18T21:12:12.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.884+0000 7ff6237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:12.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.884+0000 7ff6237fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:12.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.884+0000 7ff6237fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:12.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.884+0000 7ff6237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:12.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.884+0000 7ff6237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:12.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.884+0000 7ff6237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:12.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.888+0000 7ff6237fe640 10 monclient(hunting): handle_auth_done global_id 94973 payload 824 2024-08-18T21:12:12.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.888+0000 7ff6237fe640 1 -- 172.21.15.5:0/978189362 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff6240a6fb0 con 0x7ff62413f400 2024-08-18T21:12:12.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.888+0000 7ff6237fe640 1 -- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62413f400 msgr2=0x7ff62413abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:12.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.888+0000 7ff6237fe640 1 --2- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62413f400 0x7ff62413abb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff61400b130 tx=0x7ff6140059e0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:12.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.888+0000 7ff620ff9640 1 -- 172.21.15.5:0/978189362 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff614018030 con 0x7ff62413f400 2024-08-18T21:12:12.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.888+0000 7ff620ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:12.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.888+0000 7ff620ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:12:12.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.888+0000 7ff620ff9640 10 monclient: dump: 2024-08-18T21:12:12.900 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:12.900 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:12.900 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.900 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:12.900 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:12.900 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:12.900 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:12.900 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:12.901 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:12.901 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:12.901 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:12.901 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:12.901 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:12.901 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:12.901 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:12.901 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:12.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff620ff9640 1 -- 172.21.15.5:0/978189362 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9538 (secure 0 0 0) 0x7ff614005320 con 0x7ff62413f400 2024-08-18T21:12:12.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff620ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:12:12.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff620ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:12:12.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff620ff9640 1 -- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62413f400 msgr2=0x7ff62413abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff620ff9640 1 --2- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62413f400 0x7ff62413abb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff61400b130 tx=0x7ff6140059e0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff620ff9640 1 -- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62413f400 msgr2=0x7ff62413abb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:12:12.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff620ff9640 1 --2- 172.21.15.5:0/978189362 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff62413f400 0x7ff62413abb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.902 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:12:12.902 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:12:12.902 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:12:12.902 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:12:12.902 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 182, 2024-08-18T21:12:12.902 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 160929, 2024-08-18T21:12:12.903 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:12:12.903 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:12:12.903 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:12:12.903 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:12:12.903 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:12:12.903 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:12:12.903 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.903 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:12:12.903 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:12:12.903 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:12:12.903 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:12:12.903 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:12:12.903 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:12:12.904 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:12:12.904 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:12:12.904 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:12:12.904 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:12:12.904 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:12:12.904 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:12:12.904 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:12:12.904 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:12:12.904 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:12:12.904 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.904 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:12:12.904 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:12:12.904 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:12:12.905 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:12:12.905 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:12:12.905 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:12:12.905 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:12:12.905 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:12:12.905 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:12:12.905 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:12:12.905 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:12:12.905 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:12:12.905 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:12:12.905 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.905 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:12:12.906 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:12:12.906 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:12:12.906 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:12:12.906 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:12:12.906 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:12:12.906 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:12:12.906 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:12:12.906 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:12:12.906 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:12:12.906 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:12:12.906 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:12:12.906 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:12:12.906 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:12:12.907 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:12:12.907 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:12:12.907 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:12:12.907 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:12:12.907 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:12:12.907 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:12:12.907 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:12:12.907 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:12:12.907 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:12:12.907 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:12:12.907 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:12:12.907 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:12:12.907 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:12:12.907 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:12:12.907 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.908 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:12:12.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.908 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:12:12.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.908 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:12:12.908 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:12:12.908 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.908 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.908 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.908 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:12:12.908 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.909 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.909 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:12:12.909 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.909 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.909 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.909 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:12:12.909 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:12:12.909 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.909 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.909 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.910 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:12:12.910 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:12:12.910 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.910 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.910 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.910 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:12:12.910 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.910 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.910 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:12:12.910 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.911 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.911 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.911 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:12:12.911 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:12:12.911 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.911 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.911 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.911 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:12:12.911 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:12:12.911 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.911 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.912 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.912 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:12:12.912 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.912 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.912 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:12:12.912 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.912 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.912 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.912 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:12:12.913 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:12:12.913 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.913 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.913 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.913 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:12:12.913 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:12:12.913 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.913 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.913 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.913 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:12:12.913 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.914 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.914 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:12:12.914 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.914 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.914 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.914 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:12:12.914 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:12:12.914 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.914 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.914 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.915 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:12:12.915 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:12:12.915 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.915 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.915 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.915 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:12:12.915 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.915 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:12:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:12:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:12:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:12:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:12:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:12:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:12:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:12:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:12:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:12:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:12:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:12:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:12:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:12:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:12:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.920 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:12:12.920 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:12:12.920 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.920 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.920 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.920 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:12:12.920 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.920 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.920 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:12:12.921 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.921 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.921 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.921 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:12:12.921 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:12:12.921 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.921 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.921 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.922 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:12:12.922 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:12:12.922 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:12:12.922 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:12:12.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:12:12.922 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:12:12.922 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:12:12.923 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:12:12.923 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:12:12.923 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.923 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.923 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:12:12.923 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:12:12.923 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:12:12.923 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:12:12.923 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:12:12.923 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.923 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.923 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:12:12.924 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:12:12.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.924 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:12:12.924 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:12:12.924 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:12:12.924 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.924 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.924 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:12:12.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.924 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:12:12.924 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:12:12.924 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:12:12.924 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.924 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.925 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:12:12.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.925 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:12:12.925 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:12:12.925 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:12:12.925 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.925 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:12:12.925 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:12:12.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:12:12.925 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:12:12.925 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:12:12.925 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:12:12.925 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:12:12.926 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:12:12.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:12:12.926 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:12:12.926 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:12:12.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff629c66640 1 -- 172.21.15.5:0/978189362 >> v2:172.21.15.157:6812/631023601 conn(0x7ff60403bdc0 msgr2=0x7ff60403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff629c66640 1 --2- 172.21.15.5:0/978189362 >> v2:172.21.15.157:6812/631023601 conn(0x7ff60403bdc0 0x7ff60403e280 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0af040 tx=0x7ff61c004ac0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff629c66640 10 monclient: shutdown 2024-08-18T21:12:12.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff629c66640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:12:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff629c66640 1 -- 172.21.15.5:0/978189362 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff6240a6bd0 msgr2=0x7ff624139770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff629c66640 1 --2- 172.21.15.5:0/978189362 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff6240a6bd0 0x7ff624139770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00b400 tx=0x7ff60c00b8c0 comp rx=0 tx=0).stop 2024-08-18T21:12:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff623fff640 1 -- 172.21.15.5:0/978189362 reap_dead start 2024-08-18T21:12:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff623fff640 1 -- 172.21.15.5:0/978189362 reap_dead start 2024-08-18T21:12:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff629c66640 1 -- 172.21.15.5:0/978189362 shutdown_connections 2024-08-18T21:12:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff629c66640 1 -- 172.21.15.5:0/978189362 >> 172.21.15.5:0/978189362 conn(0x7ff624068700 msgr2=0x7ff6240a4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:12:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff629c66640 1 -- 172.21.15.5:0/978189362 shutdown_connections 2024-08-18T21:12:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:12.892+0000 7ff629c66640 1 -- 172.21.15.5:0/978189362 wait complete. 2024-08-18T21:12:12.928 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:12:12.929 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-18T21:12:13.083 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31294]: starting. 2024-08-18T21:12:13.084 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31294]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31293 2024-08-18T21:12:13.084 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31294]: created object 0... 2024-08-18T21:12:13.084 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31294]: created object 25... 2024-08-18T21:12:13.084 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31294]: created object 49... 2024-08-18T21:12:13.084 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31294]: finishing. 2024-08-18T21:12:13.084 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31294]: shutting down. 2024-08-18T21:12:14.928 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31295]: starting. 2024-08-18T21:12:14.928 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31295]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31293 2024-08-18T21:12:14.928 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31295]: shutting down. 2024-08-18T21:12:19.602 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:12:19.602 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31328]: starting. 2024-08-18T21:12:19.602 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31328]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31293 2024-08-18T21:12:19.602 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31328]: created object 0... 2024-08-18T21:12:19.602 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31328]: created object 25... 2024-08-18T21:12:19.602 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31328]: created object 49... 2024-08-18T21:12:19.602 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31328]: finishing. 2024-08-18T21:12:19.602 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31328]: shutting down. 2024-08-18T21:12:19.662 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:12:19.662 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31330]: starting. 2024-08-18T21:12:19.662 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31330]: listing objects. 2024-08-18T21:12:19.662 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31330]: listed object 0... 2024-08-18T21:12:19.662 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31330]: listed object 25... 2024-08-18T21:12:19.662 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31330]: saw 50 objects 2024-08-18T21:12:19.662 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31330]: shutting down. 2024-08-18T21:12:20.691 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:12:20.691 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31329]: starting. 2024-08-18T21:12:20.691 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31329]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31293 2024-08-18T21:12:20.691 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31329]: shutting down. 2024-08-18T21:12:20.696 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:12:20.696 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:12:20.696 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:12:20.699 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:12:22.922 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31381]: starting. 2024-08-18T21:12:22.922 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31381]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31380 2024-08-18T21:12:22.922 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31381]: created object 0... 2024-08-18T21:12:22.922 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31381]: created object 25... 2024-08-18T21:12:22.922 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31381]: created object 49... 2024-08-18T21:12:22.922 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31381]: finishing. 2024-08-18T21:12:22.922 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31381]: shutting down. 2024-08-18T21:12:23.711 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31382]: starting. 2024-08-18T21:12:23.711 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31382]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31380 2024-08-18T21:12:23.711 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31382]: shutting down. 2024-08-18T21:12:25.101 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:12:25.101 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31418]: starting. 2024-08-18T21:12:25.102 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31418]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31380 2024-08-18T21:12:25.102 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31418]: created object 0... 2024-08-18T21:12:25.102 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31418]: created object 25... 2024-08-18T21:12:25.102 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31418]: created object 49... 2024-08-18T21:12:25.102 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31418]: finishing. 2024-08-18T21:12:25.102 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31418]: shutting down. 2024-08-18T21:12:25.161 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:12:25.161 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31420]: starting. 2024-08-18T21:12:25.162 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31420]: listing objects. 2024-08-18T21:12:25.162 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31420]: listed object 0... 2024-08-18T21:12:25.162 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31420]: listed object 25... 2024-08-18T21:12:25.162 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31420]: saw 50 objects 2024-08-18T21:12:25.162 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31420]: shutting down. 2024-08-18T21:12:25.927 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:12:25.927 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31419]: starting. 2024-08-18T21:12:25.927 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31419]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31380 2024-08-18T21:12:25.927 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31419]: shutting down. 2024-08-18T21:12:25.930 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:12:25.930 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:12:25.930 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:12:25.933 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:12:28.869 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31471]: starting. 2024-08-18T21:12:28.869 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31471]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31470 2024-08-18T21:12:28.870 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31471]: created object 0... 2024-08-18T21:12:28.870 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31471]: created object 25... 2024-08-18T21:12:28.870 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31471]: created object 49... 2024-08-18T21:12:28.870 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31471]: finishing. 2024-08-18T21:12:28.870 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31471]: shutting down. 2024-08-18T21:12:30.662 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31472]: starting. 2024-08-18T21:12:30.662 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31472]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31470 2024-08-18T21:12:30.662 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31472]: shutting down. 2024-08-18T21:12:32.929 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.i 2024-08-18T21:12:32.930 INFO:tasks.ceph.mon.i:Restarting daemon 2024-08-18T21:12:32.930 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2024-08-18T21:12:32.933 INFO:tasks.ceph.mon.i:Started 2024-08-18T21:12:32.933 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.g 2024-08-18T21:12:32.933 INFO:tasks.ceph.mon.g:Restarting daemon 2024-08-18T21:12:32.933 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-08-18T21:12:32.935 INFO:tasks.ceph.mon.g:Started 2024-08-18T21:12:32.935 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-18T21:12:32.935 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-18T21:12:32.936 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-18T21:12:32.938 INFO:tasks.ceph.mon.a:Started 2024-08-18T21:12:32.939 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.f 2024-08-18T21:12:32.939 INFO:tasks.ceph.mon.f:Restarting daemon 2024-08-18T21:12:32.939 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-08-18T21:12:32.941 INFO:tasks.ceph.mon.f:Started 2024-08-18T21:12:32.941 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:12:32.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:12:33.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 10 monclient: get_monmap_and_config 2024-08-18T21:12:33.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 10 monclient: build_initial_monmap 2024-08-18T21:12:33.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 10 monclient: monmap: 2024-08-18T21:12:33.070 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:12:33.070 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:33.070 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:12:33.073008+0000 2024-08-18T21:12:33.070 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:12:33.073008+0000 2024-08-18T21:12:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:12:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:12:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:12:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:12:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:12:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:12:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:12:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:12:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:12:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:12:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:12:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:12:33.071 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:33.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 1 Processor -- start 2024-08-18T21:12:33.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 1 -- start start 2024-08-18T21:12:33.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 10 monclient: init 2024-08-18T21:12:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 10 monclient: _add_conns ranks=[0,2,6,1,9,8,5,7,4,3,10] 2024-08-18T21:12:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f47c8139bb0 addr v1:172.21.15.5:6789/0 2024-08-18T21:12:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 0x7f47c813ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 10 monclient(hunting): picked mon.noname-b con 0x7f47c806da40 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:12:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 0x7f47c81413a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 10 monclient(hunting): picked mon.noname-d con 0x7f47c813efb0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:12:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c806e690 con 0x7f47c8139bb0 2024-08-18T21:12:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f47c806e970 con 0x7f47c806da40 2024-08-18T21:12:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f47c806ec50 con 0x7f47c813efb0 2024-08-18T21:12:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47ccb33640 10 monclient(hunting): authenticate will time out at 1520.085846s 2024-08-18T21:12:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47c659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f47c8139bb0 0x7f47c8139f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38242/0 (socket says 172.21.15.5:38242) 2024-08-18T21:12:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 learned_addr learned my addr 172.21.15.5:0/4192902220 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:12:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 0x7f47c81413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47c813efb0 auth_method 0 2024-08-18T21:12:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47c6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 msgr2=0x7f47c81413a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 msgr2=0x7f47c81413a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 0x7f47c81413a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 0x7f47c813ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47c806da40 auth_method 0 2024-08-18T21:12:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47bffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 0x7f47c81413a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 msgr2=0x7f47c813ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 msgr2=0x7f47c813ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 0x7f47c813ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.072+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 0x7f47c813ea70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.076+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> v1:172.21.15.5:6789/0 conn(0x7f47c8139bb0 legacy=0x7f47c8139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 0x7f47c81413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47c813efb0 auth_method 0 2024-08-18T21:12:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47c6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 0x7f47c813ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47c806da40 auth_method 0 2024-08-18T21:12:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47bffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 msgr2=0x7f47c81413a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 msgr2=0x7f47c81413a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 0x7f47c81413a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 0x7f47c81413a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 msgr2=0x7f47c813ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 msgr2=0x7f47c813ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 0x7f47c813ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.276+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 0x7f47c813ea70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 0x7f47c81413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47c813efb0 auth_method 0 2024-08-18T21:12:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47c6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 0x7f47c813ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47c806da40 auth_method 0 2024-08-18T21:12:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47bffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 msgr2=0x7f47c81413a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 msgr2=0x7f47c81413a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 0x7f47c81413a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 msgr2=0x7f47c813ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 msgr2=0x7f47c813ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 0x7f47c813ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 0x7f47c81413a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:33.680+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 0x7f47c813ea70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:34.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 0x7f47c813ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:34.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 0x7f47c81413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:34.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47c806da40 auth_method 0 2024-08-18T21:12:34.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:34.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:34.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47bffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47c813efb0 auth_method 0 2024-08-18T21:12:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47c6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 msgr2=0x7f47c813ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 msgr2=0x7f47c813ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 0x7f47c813ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 msgr2=0x7f47c81413a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 msgr2=0x7f47c81413a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 0x7f47c81413a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 0x7f47c813ea70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:34.484+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 0x7f47c81413a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:36.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 10 monclient(hunting): tick 2024-08-18T21:12:36.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:12:36.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 1 monclient(hunting): continuing hunt 2024-08-18T21:12:36.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:12:36.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 msgr2=0x7f47c81413a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:36.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47c813efb0 0x7f47c81413a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:36.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 msgr2=0x7f47c813ea70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:36.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47c806da40 0x7f47c813ea70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:36.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 >> v1:172.21.15.5:6789/0 conn(0x7f47c8139bb0 legacy=0x7f47c8139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:36.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 10 monclient: _add_conns ranks=[7,10,8,3,5,1,4,9] 2024-08-18T21:12:36.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 0x7f47a8005ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 10 monclient(hunting): picked mon.noname-i con 0x7f47a80038b0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:12:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 0x7f47a8008770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 10 monclient(hunting): picked mon.noname-f con 0x7f47a80062e0 addr v2:172.21.15.157:3300/0 2024-08-18T21:12:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 0x7f47a800b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 10 monclient(hunting): picked mon.noname-e con 0x7f47a8008e20 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:12:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f47c806e970 con 0x7f47a80062e0 2024-08-18T21:12:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f47c806ec50 con 0x7f47a80038b0 2024-08-18T21:12:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f47a800baa0 con 0x7f47a8008e20 2024-08-18T21:12:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c4d99640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 0x7f47a800b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 0x7f47a8008770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 0x7f47a8005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47a8008e20 auth_method 0 2024-08-18T21:12:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47a80062e0 auth_method 0 2024-08-18T21:12:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47bffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a80038b0 auth_method 0 2024-08-18T21:12:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:36.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:36.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 msgr2=0x7f47a800b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:36.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 msgr2=0x7f47a800b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:36.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 0x7f47a800b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:36.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 msgr2=0x7f47a8008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:36.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 msgr2=0x7f47a8008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:36.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 msgr2=0x7f47a8005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:36.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 0x7f47a8008770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:36.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 msgr2=0x7f47a8005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:36.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 0x7f47a8005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:36.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 0x7f47a8008770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:36.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 0x7f47a800b2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:36.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.072+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 0x7f47a8005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:36.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 0x7f47a800b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:36.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47a8008e20 auth_method 0 2024-08-18T21:12:36.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:36.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:36.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:36.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 0x7f47a8008770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 0x7f47a8005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47a80062e0 auth_method 0 2024-08-18T21:12:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47bffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a80038b0 auth_method 0 2024-08-18T21:12:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 msgr2=0x7f47a800b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 msgr2=0x7f47a800b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 0x7f47a800b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 msgr2=0x7f47a8008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:36.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 msgr2=0x7f47a8008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:36.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 0x7f47a8008770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:36.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 0x7f47a800b2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:36.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 msgr2=0x7f47a8005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:36.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 0x7f47a8008770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:36.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 msgr2=0x7f47a8005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:36.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 0x7f47a8005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:36.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.276+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 0x7f47a8005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:36.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 0x7f47a800b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:36.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47a8008e20 auth_method 0 2024-08-18T21:12:36.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:36.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:36.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:36.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 0x7f47a8008770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:36.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47a80062e0 auth_method 0 2024-08-18T21:12:36.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 0x7f47a8005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47bffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a80038b0 auth_method 0 2024-08-18T21:12:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 msgr2=0x7f47a800b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 msgr2=0x7f47a800b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 0x7f47a800b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 0x7f47a800b2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 msgr2=0x7f47a8005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 msgr2=0x7f47a8005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 0x7f47a8005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 msgr2=0x7f47a8008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 msgr2=0x7f47a8008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 0x7f47a8008770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 0x7f47a8005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:36.680+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 0x7f47a8008770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 0x7f47a800b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47a8008e20 auth_method 0 2024-08-18T21:12:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 0x7f47a8008770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 0x7f47a8005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 msgr2=0x7f47a8008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 msgr2=0x7f47a8008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 0x7f47a8008770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a80038b0 auth_method 0 2024-08-18T21:12:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 0x7f47a8008770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 msgr2=0x7f47a800b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 msgr2=0x7f47a800b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 0x7f47a800b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 0x7f47a800b2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 msgr2=0x7f47a8005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 msgr2=0x7f47a8005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 0x7f47a8005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:37.484+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 0x7f47a8005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 10 monclient(hunting): tick 2024-08-18T21:12:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:12:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 1 monclient(hunting): continuing hunt 2024-08-18T21:12:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:12:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 msgr2=0x7f47a800b2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8008e20 0x7f47a800b2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 msgr2=0x7f47a8005ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a80038b0 0x7f47a8005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 msgr2=0x7f47a8008770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.157:3300/0 conn(0x7f47a80062e0 0x7f47a8008770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:39.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 reap_dead start 2024-08-18T21:12:39.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 10 monclient: _add_conns ranks=[4,9,5,3,1] 2024-08-18T21:12:39.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 reap_dead start 2024-08-18T21:12:39.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 0x7f47a80092d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:39.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 10 monclient(hunting): picked mon.noname-c con 0x7f47a8003cd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:12:39.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 0x7f47a80086f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:39.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 10 monclient(hunting): picked mon.noname-a con 0x7f47a8009810 addr v2:172.21.15.5:3300/0 2024-08-18T21:12:39.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 0x7f47a800a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:39.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 10 monclient(hunting): picked mon.noname-h con 0x7f47a8009c50 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:12:39.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:39.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f47c806e970 con 0x7f47a8009810 2024-08-18T21:12:39.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f47c806ec50 con 0x7f47a8003cd0 2024-08-18T21:12:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f47a800baa0 con 0x7f47a8009c50 2024-08-18T21:12:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c4d99640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 0x7f47a80086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 0x7f47a80092d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47a8009810 auth_method 0 2024-08-18T21:12:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47bffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 0x7f47a800a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47a8009c50 auth_method 0 2024-08-18T21:12:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a8003cd0 auth_method 0 2024-08-18T21:12:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 0x7f47a800a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 0x7f47a800a0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 msgr2=0x7f47a80092d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 msgr2=0x7f47a80092d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 0x7f47a80092d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 msgr2=0x7f47a80086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:39.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 msgr2=0x7f47a80086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:39.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.072+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 0x7f47a80086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:39.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.076+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 0x7f47a80086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:39.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.076+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 0x7f47a80092d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.276+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 0x7f47a800a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.276+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47a8009c50 auth_method 0 2024-08-18T21:12:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.276+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.276+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.276+0000 7f47c6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.276+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.276+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.276+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 0x7f47a800a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.276+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 0x7f47a800a0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:39.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 0x7f47a80086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:39.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 0x7f47a80092d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:39.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47a8009810 auth_method 0 2024-08-18T21:12:39.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47bffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a8003cd0 auth_method 0 2024-08-18T21:12:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47c659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 msgr2=0x7f47a80086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 msgr2=0x7f47a80086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 msgr2=0x7f47a80092d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 0x7f47a80086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 msgr2=0x7f47a80092d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 0x7f47a80092d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 0x7f47a80086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:39.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.280+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 0x7f47a80092d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.680+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 0x7f47a800a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.680+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47a8009c50 auth_method 0 2024-08-18T21:12:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.680+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.680+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.680+0000 7f47c6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.680+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.680+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.680+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 0x7f47a800a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.680+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 0x7f47a800a0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:39.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 0x7f47a80092d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a8003cd0 auth_method 0 2024-08-18T21:12:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 0x7f47a80086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47c659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47a8009810 auth_method 0 2024-08-18T21:12:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47bffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 msgr2=0x7f47a80092d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:39.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 msgr2=0x7f47a80092d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:39.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 0x7f47a80092d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:39.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 msgr2=0x7f47a80086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:39.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 msgr2=0x7f47a80086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:39.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 0x7f47a80086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:39.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 0x7f47a80092d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:39.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:39.684+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 0x7f47a80086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:40.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.484+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 0x7f47a800a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:40.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.484+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47a8009c50 auth_method 0 2024-08-18T21:12:40.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.484+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:40.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.484+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:40.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.484+0000 7f47c6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:40.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.484+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:40.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.484+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:40.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.484+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 0x7f47a800a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:40.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.484+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 0x7f47a800a0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 0x7f47a80092d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 0x7f47a80086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47a8009810 auth_method 0 2024-08-18T21:12:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47bffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a8003cd0 auth_method 0 2024-08-18T21:12:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47c659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 msgr2=0x7f47a80086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:40.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 msgr2=0x7f47a80086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:40.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 0x7f47a80086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:40.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 0x7f47a80086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:40.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 msgr2=0x7f47a80092d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:40.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 msgr2=0x7f47a80092d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:40.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 0x7f47a80092d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:40.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:40.488+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 0x7f47a80092d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 10 monclient(hunting): tick 2024-08-18T21:12:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:12:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 1 monclient(hunting): continuing hunt 2024-08-18T21:12:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:12:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f47a8009c50 0x7f47a800a0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 msgr2=0x7f47a80092d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f47a8003cd0 0x7f47a80092d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 msgr2=0x7f47a80086f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a8009810 0x7f47a80086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 10 monclient: _add_conns ranks=[3,1] 2024-08-18T21:12:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 0x7f47a800ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 10 monclient(hunting): picked mon.noname-g con 0x7f47a800a980 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:12:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f47a800b3d0 addr v1:172.21.15.157:6789/0 2024-08-18T21:12:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c80aaee0 con 0x7f47a800b3d0 2024-08-18T21:12:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f47c806e970 con 0x7f47a800a980 2024-08-18T21:12:42.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c4d99640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 0x7f47a800ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a800a980 auth_method 0 2024-08-18T21:12:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:42.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.072+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 msgr2=0x7f47a800ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.076+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 msgr2=0x7f47a800ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.076+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 0x7f47a800ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.076+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 0x7f47a800ad60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.076+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v1:172.21.15.157:6789/0 conn(0x7f47a800b3d0 legacy=0x7f47a80120e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.280+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 0x7f47a800ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.280+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a800a980 auth_method 0 2024-08-18T21:12:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.280+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.280+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.280+0000 7f47c659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.280+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 msgr2=0x7f47a800ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.280+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 msgr2=0x7f47a800ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.280+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 0x7f47a800ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.280+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 0x7f47a800ad60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.684+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 0x7f47a800ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.684+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a800a980 auth_method 0 2024-08-18T21:12:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.684+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.684+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.684+0000 7f47c659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.684+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 msgr2=0x7f47a800ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.684+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 msgr2=0x7f47a800ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.684+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 0x7f47a800ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:42.684+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 0x7f47a800ad60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:43.028+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v1:172.21.15.157:6789/0 conn(0x7f47a800b3d0 legacy=0x7f47a80120e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-08-18T21:12:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:43.028+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v1:172.21.15.157:6789/0 conn(0x7f47a800b3d0 legacy=0x7f47a80120e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:12:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:43.028+0000 7f47bffff640 1 --1- 172.21.15.5:0/4192902220 >> v1:172.21.15.157:6789/0 conn(0x7f47a800b3d0 0x7f47a80120e0 :-1 s=OPENED pgs=63 cs=1 l=1).handle_message read tag failed 2024-08-18T21:12:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:43.028+0000 7f47bffff640 1 --1- 172.21.15.5:0/4192902220 >> v1:172.21.15.157:6789/0 conn(0x7f47a800b3d0 0x7f47a80120e0 :-1 s=OPENED pgs=63 cs=1 l=1).fault on lossy channel, failing 2024-08-18T21:12:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:43.028+0000 7f47c5d9b640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.157:6789/0 2024-08-18T21:12:43.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:43.488+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 0x7f47a800ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:43.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:43.488+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a800a980 auth_method 0 2024-08-18T21:12:43.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:43.488+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:43.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:43.488+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:43.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:43.488+0000 7f47c659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:43.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:43.488+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 msgr2=0x7f47a800ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:43.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:43.488+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 msgr2=0x7f47a800ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:43.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:43.488+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 0x7f47a800ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:43.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:43.488+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 0x7f47a800ad60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 10 monclient(hunting): tick 2024-08-18T21:12:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:12:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 1 monclient(hunting): continuing hunt 2024-08-18T21:12:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:12:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 msgr2=0x7f47a800ad60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47a800a980 0x7f47a800ad60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 >> v1:172.21.15.157:6789/0 conn(0x7f47a800b3d0 legacy=0x7f47a80120e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:12:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 10 monclient: _add_conns ranks=[8,6,1,5,3,7,9,10,4,2,0] 2024-08-18T21:12:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 reap_dead start 2024-08-18T21:12:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 0x7f47a8013de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 10 monclient(hunting): picked mon.noname-e con 0x7f47a8013a00 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:12:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 0x7f47a800a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 10 monclient(hunting): picked mon.noname-d con 0x7f47a8009c50 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:12:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f47a8005cc0 addr v1:172.21.15.157:6789/0 2024-08-18T21:12:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47a8014960 con 0x7f47a8005cc0 2024-08-18T21:12:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f47c806e970 con 0x7f47a8009c50 2024-08-18T21:12:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f47c806ec50 con 0x7f47a8013a00 2024-08-18T21:12:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c4d99640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 0x7f47a8013de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a8013a00 auth_method 0 2024-08-18T21:12:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47c659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.072+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 0x7f47a800a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.076+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 msgr2=0x7f47a8013de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.076+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 msgr2=0x7f47a8013de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.076+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 0x7f47a8013de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.076+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47a8009c50 auth_method 0 2024-08-18T21:12:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.076+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.076+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.076+0000 7f47bffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.076+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 0x7f47a8013de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.076+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.076+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.076+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 0x7f47a800a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:45.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.076+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 0x7f47a800a0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:45.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.076+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> v1:172.21.15.157:6789/0 conn(0x7f47a8005cc0 legacy=0x7f47a80092d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:45.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 0x7f47a800a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:45.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47a8009c50 auth_method 0 2024-08-18T21:12:45.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:45.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:45.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47bffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:45.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:45.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:45.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 0x7f47a800a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 0x7f47a800a0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 0x7f47a8013de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a8013a00 auth_method 0 2024-08-18T21:12:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47c659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 msgr2=0x7f47a8013de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 msgr2=0x7f47a8013de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 0x7f47a8013de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.280+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 0x7f47a8013de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:45.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.684+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 0x7f47a800a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:45.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.684+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47a8009c50 auth_method 0 2024-08-18T21:12:45.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.684+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:45.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.684+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:45.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.684+0000 7f47bffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:45.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.684+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:45.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.684+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:45.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.684+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 0x7f47a800a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:45.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.684+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 0x7f47a800a0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.688+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 0x7f47a8013de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.688+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a8013a00 auth_method 0 2024-08-18T21:12:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.688+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.688+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:45.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.688+0000 7f47c659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:45.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.688+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 msgr2=0x7f47a8013de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:45.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.688+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 msgr2=0x7f47a8013de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:45.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.688+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 0x7f47a8013de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:45.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:45.688+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 0x7f47a8013de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:46.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.488+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 0x7f47a800a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:46.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.488+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47a8009c50 auth_method 0 2024-08-18T21:12:46.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.488+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:46.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.488+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:46.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.488+0000 7f47bffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:46.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.488+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:46.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.488+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:46.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.488+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 0x7f47a800a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:46.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.488+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 0x7f47a800a0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:46.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.492+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 0x7f47a8013de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:46.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.492+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a8013a00 auth_method 0 2024-08-18T21:12:46.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.492+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:46.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.492+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:46.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.492+0000 7f47c659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:46.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.492+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 msgr2=0x7f47a8013de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:46.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.492+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 msgr2=0x7f47a8013de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:46.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.492+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 0x7f47a8013de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:46.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:46.492+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 0x7f47a8013de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:48.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.028+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> v1:172.21.15.157:6789/0 conn(0x7f47a8005cc0 legacy=0x7f47a80092d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-08-18T21:12:48.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.028+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> v1:172.21.15.157:6789/0 conn(0x7f47a8005cc0 legacy=0x7f47a80092d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:12:48.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.028+0000 7f47c6d9d640 1 --1- 172.21.15.5:0/4192902220 >> v1:172.21.15.157:6789/0 conn(0x7f47a8005cc0 0x7f47a80092d0 :-1 s=OPENED pgs=64 cs=1 l=1).handle_message read tag failed 2024-08-18T21:12:48.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.028+0000 7f47c6d9d640 1 --1- 172.21.15.5:0/4192902220 >> v1:172.21.15.157:6789/0 conn(0x7f47a8005cc0 0x7f47a80092d0 :-1 s=OPENED pgs=64 cs=1 l=1).fault on lossy channel, failing 2024-08-18T21:12:48.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.028+0000 7f47c5d9b640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.157:6789/0 2024-08-18T21:12:48.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 10 monclient(hunting): tick 2024-08-18T21:12:48.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:12:48.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 1 monclient(hunting): continuing hunt 2024-08-18T21:12:48.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:12:48.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 msgr2=0x7f47a8013de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:48.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f47a8013a00 0x7f47a8013de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:48.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 msgr2=0x7f47a800a0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:48.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a8009c50 0x7f47a800a0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:48.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 >> v1:172.21.15.157:6789/0 conn(0x7f47a8005cc0 legacy=0x7f47a80092d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:12:48.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 10 monclient: _add_conns ranks=[0,9,7,10,3,4,5,2] 2024-08-18T21:12:48.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f47a80144b0 addr v1:172.21.15.5:6789/0 2024-08-18T21:12:48.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 0x7f47a8011050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:48.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 10 monclient(hunting): picked mon.noname-a con 0x7f47a80086f0 addr v2:172.21.15.5:3300/0 2024-08-18T21:12:48.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 0x7f47a80119a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 10 monclient(hunting): picked mon.noname-i con 0x7f47a8011590 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:12:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47a80099e0 con 0x7f47a80144b0 2024-08-18T21:12:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f47c806e970 con 0x7f47a80086f0 2024-08-18T21:12:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 1 -- 172.21.15.5:0/4192902220 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f47c806ec50 con 0x7f47a8011590 2024-08-18T21:12:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c4d99640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 0x7f47a8011050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47a80086f0 auth_method 0 2024-08-18T21:12:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47bffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 0x7f47a80119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47a8011590 auth_method 0 2024-08-18T21:12:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 msgr2=0x7f47a8011050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 msgr2=0x7f47a8011050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 0x7f47a8011050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 0x7f47a8011050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 msgr2=0x7f47a80119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 msgr2=0x7f47a80119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 0x7f47a80119a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 0x7f47a80119a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:48.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.076+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> v1:172.21.15.5:6789/0 conn(0x7f47a80144b0 legacy=0x7f47a800a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:48.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 0x7f47a8011050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:48.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47a80086f0 auth_method 0 2024-08-18T21:12:48.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:48.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:48.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47bffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 0x7f47a80119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47a8011590 auth_method 0 2024-08-18T21:12:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47c6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 msgr2=0x7f47a8011050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 msgr2=0x7f47a8011050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 0x7f47a8011050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 msgr2=0x7f47a80119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 msgr2=0x7f47a80119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 0x7f47a80119a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 0x7f47a8011050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.280+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 0x7f47a80119a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:48.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 0x7f47a80119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:48.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47a8011590 auth_method 0 2024-08-18T21:12:48.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:48.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:48.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47c6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:48.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 msgr2=0x7f47a80119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:48.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 msgr2=0x7f47a80119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:48.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 0x7f47a80119a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:48.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 0x7f47a80119a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:48.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 0x7f47a8011050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:48.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47a80086f0 auth_method 0 2024-08-18T21:12:48.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:48.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:48.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47bffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:48.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 msgr2=0x7f47a8011050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:48.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47bffff640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 msgr2=0x7f47a8011050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:48.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 0x7f47a8011050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:48.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:48.684+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 0x7f47a8011050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.336+0000 7f47c5d9b640 1 -- 172.21.15.5:0/4192902220 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706314903 0 0) 0x7f47a80099e0 con 0x7f47a80144b0 2024-08-18T21:12:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.336+0000 7f47c5d9b640 10 monclient(hunting): _negotiate 2024-08-18T21:12:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.336+0000 7f47c5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.336+0000 7f47c5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.336+0000 7f47c5d9b640 10 monclient(hunting): my global_id is 124101 2024-08-18T21:12:49.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.336+0000 7f47c5d9b640 1 -- 172.21.15.5:0/4192902220 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47b4003530 con 0x7f47a80144b0 2024-08-18T21:12:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 1 -- 172.21.15.5:0/4192902220 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2311840420 0 0) 0x7f47b4003530 con 0x7f47a80144b0 2024-08-18T21:12:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 msgr2=0x7f47a80119a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47a8011590 0x7f47a80119a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 1 -- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 msgr2=0x7f47a8011050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 1 --2- 172.21.15.5:0/4192902220 >> v2:172.21.15.5:3300/0 conn(0x7f47a80086f0 0x7f47a8011050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:12:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 1 monclient: found mon.noname-a-legacy 2024-08-18T21:12:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c6d9d640 1 -- 172.21.15.5:0/4192902220 reap_dead start 2024-08-18T21:12:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.5:6789/0 2024-08-18T21:12:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 1 -- 172.21.15.5:0/4192902220 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a8011ee0 con 0x7f47a80144b0 2024-08-18T21:12:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient: _finish_auth 0 2024-08-18T21:12:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient: _check_auth_tickets 2024-08-18T21:12:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 1 -- 172.21.15.5:0/4192902220 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 4141550541 0 0) 0x7f47b8001b60 con 0x7f47a80144b0 2024-08-18T21:12:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-08-18T21:12:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient: dump: 2024-08-18T21:12:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:49.345 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] but i'm connected to v1:172.21.15.5:6789/0, reconnecting 2024-08-18T21:12:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 1 -- 172.21.15.5:0/4192902220 >> v1:172.21.15.5:6789/0 conn(0x7f47a80144b0 legacy=0x7f47a800a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient: _add_conns ranks=[6,7,0,4,1,2,8,5,3] 2024-08-18T21:12:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47b4004210 0x7f47b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient(hunting): picked mon.d con 0x7f47b4004210 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:12:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47b4004e20 0x7f47b40052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient(hunting): picked mon.i con 0x7f47b4004e20 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:12:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b4009c00 0x7f47b400c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient(hunting): picked mon.a con 0x7f47b4009c00 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:12:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 1 -- 172.21.15.5:0/4192902220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f47c806e970 con 0x7f47b4009c00 2024-08-18T21:12:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 1 -- 172.21.15.5:0/4192902220 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f47c806ec50 con 0x7f47b4004210 2024-08-18T21:12:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 1 -- 172.21.15.5:0/4192902220 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f47b400c9a0 con 0x7f47b4004e20 2024-08-18T21:12:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c5d9b640 10 monclient(hunting): _finish_auth 0 2024-08-18T21:12:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47b4004210 0x7f47b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47b4004210 auth_method 0 2024-08-18T21:12:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b4009c00 0x7f47b400c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47b4004e20 0x7f47b40052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47b4004e20 auth_method 0 2024-08-18T21:12:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47bffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47b4009c00 auth_method 0 2024-08-18T21:12:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:12:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47bffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:12:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:12:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 10 monclient(hunting): handle_auth_done global_id 124101 payload 293 2024-08-18T21:12:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47b4004e20 msgr2=0x7f47b40052a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:12:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47b4004e20 0x7f47b40052a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b4009c00 msgr2=0x7f47b400c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:12:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b4009c00 0x7f47b400c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 10 monclient: _finish_hunting 0 2024-08-18T21:12:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 1 monclient: found mon.d 2024-08-18T21:12:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:12:49.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b4003530 con 0x7f47b4004210 2024-08-18T21:12:49.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 10 monclient: _finish_auth 0 2024-08-18T21:12:49.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 10 monclient: _check_auth_tickets 2024-08-18T21:12:49.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47c659c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:49.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47ccb33640 5 monclient: authenticate success, global_id 124101 2024-08-18T21:12:49.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47ccb33640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:12:49.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.344+0000 7f47bffff640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47b4004e20 0x7f47b40052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:12:49.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.352+0000 7f47c659c640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47b4004210 msgr2=0x7f47b4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:49.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.352+0000 7f47c659c640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47b4004210 0x7f47b4004810 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f47b8007c10 tx=0x7f47b800c990 comp rx=0 tx=0).ready entity=mon.6 client_cookie=d19c417b0cb0460d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47c5d9b640 1 -- 172.21.15.5:0/4192902220 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47b80ad070 con 0x7f47b4004210 2024-08-18T21:12:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47c5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47c5d9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:12:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47c5d9b640 10 monclient: dump: 2024-08-18T21:12:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:49.364 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47c5d9b640 1 -- 172.21.15.5:0/4192902220 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b80a7ca0 con 0x7f47b4004210 2024-08-18T21:12:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47ccb33640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:12:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47c5d9b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:12:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47ccb33640 10 monclient: get_monmap_and_config success 2024-08-18T21:12:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47ccb33640 4 set_mon_vals no callback set 2024-08-18T21:12:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47c5d9b640 1 -- 172.21.15.5:0/4192902220 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47b8001900 con 0x7f47b4004210 2024-08-18T21:12:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47c5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47c5d9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:12:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47c5d9b640 10 monclient: dump: 2024-08-18T21:12:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:49.366 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47ccb33640 10 monclient: shutdown 2024-08-18T21:12:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47ccb33640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:12:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47ccb33640 1 -- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47b4004210 msgr2=0x7f47b4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47ccb33640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47b4004210 0x7f47b4004810 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f47b8007c10 tx=0x7f47b800c990 comp rx=0 tx=0).stop 2024-08-18T21:12:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47ccb33640 1 -- 172.21.15.5:0/4192902220 shutdown_connections 2024-08-18T21:12:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47ccb33640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b4009c00 0x7f47b400c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47ccb33640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47b4004e20 0x7f47b40052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47ccb33640 1 --2- 172.21.15.5:0/4192902220 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47b4004210 0x7f47b4004810 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47ccb33640 1 -- 172.21.15.5:0/4192902220 >> 172.21.15.5:0/4192902220 conn(0x7f47c8069090 msgr2=0x7f47c80aa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:12:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47ccb33640 1 -- 172.21.15.5:0/4192902220 shutdown_connections 2024-08-18T21:12:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.364+0000 7f47ccb33640 1 -- 172.21.15.5:0/4192902220 wait complete. 2024-08-18T21:12:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 10 monclient: build_initial_monmap 2024-08-18T21:12:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 10 monclient: monmap: 2024-08-18T21:12:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:12:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:12:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:12:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:12:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:12:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:12:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:12:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:12:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:12:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:12:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:12:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:12:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:12:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:12:49.371 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 1 Processor -- start 2024-08-18T21:12:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 1 -- start start 2024-08-18T21:12:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 10 monclient: init 2024-08-18T21:12:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 10 monclient: _add_conns ranks=[6,3,7,5,8,2,4,1,0] 2024-08-18T21:12:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a80144b0 0x7f47c8132fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 10 monclient(hunting): picked mon.noname-d con 0x7f47a80144b0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47b4004210 0x7f47c8133510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 10 monclient(hunting): picked mon.noname-g con 0x7f47b4004210 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47b4004e20 0x7f47c81d1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 10 monclient(hunting): picked mon.noname-i con 0x7f47b4004e20 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f47c80a5350 con 0x7f47b4004210 2024-08-18T21:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f47c813a5b0 con 0x7f47a80144b0 2024-08-18T21:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f47c80a54d0 con 0x7f47b4004e20 2024-08-18T21:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47ccb33640 10 monclient(hunting): authenticate will time out at 1536.383001s 2024-08-18T21:12:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a80144b0 0x7f47c8132fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a80144b0 0x7f47c8132fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:37792/0 (socket says 172.21.15.5:37792) 2024-08-18T21:12:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 1 -- 172.21.15.5:0/1687245555 learned_addr learned my addr 172.21.15.5:0/1687245555 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:12:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 10 monclient(hunting): get_auth_request con 0x7f47a80144b0 auth_method 0 2024-08-18T21:12:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c6d9d640 1 --2- 172.21.15.5:0/1687245555 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47b4004e20 0x7f47c81d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request con 0x7f47b4004e20 auth_method 0 2024-08-18T21:12:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47bffff640 1 --2- 172.21.15.5:0/1687245555 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47b4004210 0x7f47c8133510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47bffff640 10 monclient(hunting): get_auth_request con 0x7f47b4004210 auth_method 0 2024-08-18T21:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47bffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47bffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47bffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 10 monclient(hunting): handle_auth_done global_id 85551 payload 824 2024-08-18T21:12:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 1 -- 172.21.15.5:0/1687245555 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47b4004e20 msgr2=0x7f47c81d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 1 --2- 172.21.15.5:0/1687245555 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47b4004e20 0x7f47c81d1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 1 -- 172.21.15.5:0/1687245555 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47b4004210 msgr2=0x7f47c8133510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 1 --2- 172.21.15.5:0/1687245555 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47b4004210 0x7f47c8133510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 10 monclient: _finish_hunting 0 2024-08-18T21:12:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 1 monclient: found mon.noname-d 2024-08-18T21:12:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:12:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.368+0000 7f47c659c640 1 -- 172.21.15.5:0/1687245555 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c8073790 con 0x7f47a80144b0 2024-08-18T21:12:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.372+0000 7f47c659c640 1 -- 172.21.15.5:0/1687245555 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a80144b0 msgr2=0x7f47c8132fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.372+0000 7f47c659c640 1 --2- 172.21.15.5:0/1687245555 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a80144b0 0x7f47c8132fd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f47b8000c10 tx=0x7f47b4005840 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47beffd640 1 -- 172.21.15.5:0/1687245555 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47b80c0070 con 0x7f47a80144b0 2024-08-18T21:12:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47beffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:12:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47beffd640 10 monclient: dump: 2024-08-18T21:12:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47beffd640 10 monclient: _finish_auth 0 2024-08-18T21:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47beffd640 10 monclient: _check_auth_tickets 2024-08-18T21:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47beffd640 1 -- 172.21.15.5:0/1687245555 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b80a7e50 con 0x7f47a80144b0 2024-08-18T21:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47beffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47beffd640 1 -- 172.21.15.5:0/1687245555 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47b80ad040 con 0x7f47a80144b0 2024-08-18T21:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47beffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47beffd640 10 monclient: dump: 2024-08-18T21:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:49.381 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47c4d99640 4 set_mon_vals no callback set 2024-08-18T21:12:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47ccb33640 5 monclient: authenticate success, global_id 85551 2024-08-18T21:12:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47ccb33640 10 monclient: _renew_subs 2024-08-18T21:12:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47ccb33640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:12:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47ccb33640 1 -- 172.21.15.5:0/1687245555 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c8073a70 con 0x7f47a80144b0 2024-08-18T21:12:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47ccb33640 10 monclient: _renew_subs 2024-08-18T21:12:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47ccb33640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:12:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47ccb33640 1 -- 172.21.15.5:0/1687245555 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c80a7840 con 0x7f47a80144b0 2024-08-18T21:12:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47ccb33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47ccb33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47ccb33640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:12:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47ccb33640 1 -- 172.21.15.5:0/1687245555 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c80a5800 con 0x7f47a80144b0 2024-08-18T21:12:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47beffd640 1 -- 172.21.15.5:0/1687245555 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f47b8005040 con 0x7f47a80144b0 2024-08-18T21:12:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47beffd640 1 --2- 172.21.15.5:0/1687245555 >> v2:172.21.15.157:6812/631023601 conn(0x7f47a803e0a0 0x7f47a8040560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47beffd640 1 -- 172.21.15.5:0/1687245555 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(256..256 src has 22..256) ==== 3506+0+0 (secure 0 0 0) 0x7f47b8010040 con 0x7f47a80144b0 2024-08-18T21:12:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47bffff640 1 --2- 172.21.15.5:0/1687245555 >> v2:172.21.15.157:6812/631023601 conn(0x7f47a803e0a0 0x7f47a8040560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.376+0000 7f47bffff640 10 monclient: get_auth_request con 0x7f47a803e0a0 auth_method 0 2024-08-18T21:12:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.380+0000 7f47bffff640 1 --2- 172.21.15.5:0/1687245555 >> v2:172.21.15.157:6812/631023601 conn(0x7f47a803e0a0 0x7f47a8040560 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f47b0006d10 tx=0x7f47b002b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.380+0000 7f47beffd640 1 -- 172.21.15.5:0/1687245555 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f47b8020040 con 0x7f47a80144b0 2024-08-18T21:12:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.380+0000 7f47beffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.380+0000 7f47beffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:12:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.624+0000 7f47ccb33640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:12:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.624+0000 7f47ccb33640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:12:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.624+0000 7f47ccb33640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:12:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.624+0000 7f47ccb33640 1 -- 172.21.15.5:0/1687245555 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f47c8071ff0 con 0x7f47a80144b0 2024-08-18T21:12:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.624+0000 7f47beffd640 1 -- 172.21.15.5:0/1687245555 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3167 (secure 0 0 0) 0x7f47b80b03b0 con 0x7f47a80144b0 2024-08-18T21:12:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.624+0000 7f47beffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:12:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.624+0000 7f47beffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:12:49.624 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":198,"quorum":[0,1,2,3,4,6,7,8],"quorum_names":["a","f","b","g","c","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:12:49.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.628+0000 7f47ccb33640 1 -- 172.21.15.5:0/1687245555 >> v2:172.21.15.157:6812/631023601 conn(0x7f47a803e0a0 msgr2=0x7f47a8040560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:49.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.628+0000 7f47ccb33640 1 --2- 172.21.15.5:0/1687245555 >> v2:172.21.15.157:6812/631023601 conn(0x7f47a803e0a0 0x7f47a8040560 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f47b0006d10 tx=0x7f47b002b040 comp rx=0 tx=0).stop 2024-08-18T21:12:49.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.628+0000 7f47ccb33640 10 monclient: shutdown 2024-08-18T21:12:49.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.628+0000 7f47ccb33640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:12:49.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.628+0000 7f47ccb33640 1 -- 172.21.15.5:0/1687245555 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a80144b0 msgr2=0x7f47c8132fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:49.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.628+0000 7f47ccb33640 1 --2- 172.21.15.5:0/1687245555 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a80144b0 0x7f47c8132fd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f47b8000c10 tx=0x7f47b4005840 comp rx=0 tx=0).stop 2024-08-18T21:12:49.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.628+0000 7f47ccb33640 1 -- 172.21.15.5:0/1687245555 shutdown_connections 2024-08-18T21:12:49.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.628+0000 7f47ccb33640 1 --2- 172.21.15.5:0/1687245555 >> v2:172.21.15.157:6812/631023601 conn(0x7f47a803e0a0 0x7f47a8040560 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:49.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.628+0000 7f47ccb33640 1 --2- 172.21.15.5:0/1687245555 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47b4004210 0x7f47c8133510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:49.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.628+0000 7f47ccb33640 1 --2- 172.21.15.5:0/1687245555 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f47b4004e20 0x7f47c81d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:49.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.628+0000 7f47ccb33640 1 --2- 172.21.15.5:0/1687245555 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f47a80144b0 0x7f47c8132fd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:49.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.628+0000 7f47ccb33640 1 -- 172.21.15.5:0/1687245555 >> 172.21.15.5:0/1687245555 conn(0x7f47c8069090 msgr2=0x7f47c813ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:12:49.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.628+0000 7f47ccb33640 1 -- 172.21.15.5:0/1687245555 shutdown_connections 2024-08-18T21:12:49.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:49.628+0000 7f47ccb33640 1 -- 172.21.15.5:0/1687245555 wait complete. 2024-08-18T21:12:51.784 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:12:51.784 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31505]: starting. 2024-08-18T21:12:51.784 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31505]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31470 2024-08-18T21:12:51.784 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31505]: created object 0... 2024-08-18T21:12:51.784 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31505]: created object 25... 2024-08-18T21:12:51.784 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31505]: created object 49... 2024-08-18T21:12:51.784 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31505]: finishing. 2024-08-18T21:12:51.784 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31505]: shutting down. 2024-08-18T21:12:52.643 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:12:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 10 monclient: get_monmap_and_config 2024-08-18T21:12:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 10 monclient: build_initial_monmap 2024-08-18T21:12:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 10 monclient: monmap: 2024-08-18T21:12:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:12:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:12:52.778422+0000 2024-08-18T21:12:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:12:52.778422+0000 2024-08-18T21:12:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:12:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:12:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:12:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:12:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:12:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:12:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:12:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:12:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:12:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:12:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:12:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:12:52.776 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:52.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 1 Processor -- start 2024-08-18T21:12:52.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 1 -- start start 2024-08-18T21:12:52.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 10 monclient: init 2024-08-18T21:12:52.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:52.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 10 monclient: _add_conns ranks=[3,10,4,1,0,5,8,6,2,7,9] 2024-08-18T21:12:52.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 0x7f8dec136620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:52.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 10 monclient(hunting): picked mon.noname-g con 0x7f8dec073790 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:12:52.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 0x7f8dec0a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:52.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 10 monclient(hunting): picked mon.noname-f con 0x7f8dec073b70 addr v2:172.21.15.157:3300/0 2024-08-18T21:12:52.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 0x7f8dec0a2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:52.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 10 monclient(hunting): picked mon.noname-c con 0x7f8dec0a2380 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:12:52.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:52.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f8dec0a3a70 con 0x7f8dec073b70 2024-08-18T21:12:52.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:52.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8dec0a4df0 con 0x7f8dec073790 2024-08-18T21:12:52.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:52.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f8dec06fd30 con 0x7f8dec0a2380 2024-08-18T21:12:52.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:52.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df454a640 10 monclient(hunting): authenticate will time out at 1539.791708s 2024-08-18T21:12:52.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df2ae7640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 0x7f8dec0a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:52.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df2ae7640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 0x7f8dec0a2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:53030/0 (socket says 172.21.15.5:53030) 2024-08-18T21:12:52.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df2ae7640 1 -- 172.21.15.5:0/1783399948 learned_addr learned my addr 172.21.15.5:0/1783399948 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:12:52.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request con 0x7f8dec0a2380 auth_method 0 2024-08-18T21:12:52.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:52.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df2ae7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:52.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df2ae7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:52.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df2ae7640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 msgr2=0x7f8dec0a2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:52.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.776+0000 7f8df2ae7640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 msgr2=0x7f8dec0a2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:52.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 0x7f8dec0a2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:52.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 0x7f8dec0a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:52.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 0x7f8dec136620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 0x7f8dec0a2830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request con 0x7f8dec073b70 auth_method 0 2024-08-18T21:12:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df1ae5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df1ae5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df22e6640 10 monclient(hunting): get_auth_request con 0x7f8dec073790 auth_method 0 2024-08-18T21:12:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df22e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df22e6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df22e6640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df1ae5640 1 -- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 msgr2=0x7f8dec0a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df1ae5640 1 -- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 msgr2=0x7f8dec0a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 0x7f8dec0a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 0x7f8dec0a1e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:52.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 msgr2=0x7f8dec136620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:52.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 msgr2=0x7f8dec136620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:52.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 0x7f8dec136620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:52.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.780+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 0x7f8dec136620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:52.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 0x7f8dec0a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:52.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request con 0x7f8dec0a2380 auth_method 0 2024-08-18T21:12:52.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:52.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df2ae7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:52.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df2ae7640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:52.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df2ae7640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 msgr2=0x7f8dec0a2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:52.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df2ae7640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 msgr2=0x7f8dec0a2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:52.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 0x7f8dec0a2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:52.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 0x7f8dec0a2830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:52.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 0x7f8dec136620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 0x7f8dec0a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df22e6640 10 monclient(hunting): get_auth_request con 0x7f8dec073790 auth_method 0 2024-08-18T21:12:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df22e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df22e6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df22e6640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request con 0x7f8dec073b70 auth_method 0 2024-08-18T21:12:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df1ae5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df1ae5640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 msgr2=0x7f8dec136620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 msgr2=0x7f8dec136620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 0x7f8dec136620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df1ae5640 1 -- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 msgr2=0x7f8dec0a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:52.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df1ae5640 1 -- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 msgr2=0x7f8dec0a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:52.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 0x7f8dec0a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:52.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 0x7f8dec136620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:52.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:52.984+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 0x7f8dec0a1e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 0x7f8dec0a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request con 0x7f8dec0a2380 auth_method 0 2024-08-18T21:12:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df2ae7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df2ae7640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df2ae7640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 msgr2=0x7f8dec0a2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df2ae7640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 msgr2=0x7f8dec0a2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 0x7f8dec0a2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 0x7f8dec0a2830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 0x7f8dec136620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 0x7f8dec0a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df22e6640 10 monclient(hunting): get_auth_request con 0x7f8dec073790 auth_method 0 2024-08-18T21:12:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df22e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df22e6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df22e6640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request con 0x7f8dec073b70 auth_method 0 2024-08-18T21:12:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df1ae5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df1ae5640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df1ae5640 1 -- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 msgr2=0x7f8dec0a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df1ae5640 1 -- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 msgr2=0x7f8dec0a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 0x7f8dec0a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 msgr2=0x7f8dec136620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 msgr2=0x7f8dec136620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 0x7f8dec0a1e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 0x7f8dec136620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:53.388+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 0x7f8dec136620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 0x7f8dec0a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request con 0x7f8dec0a2380 auth_method 0 2024-08-18T21:12:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df2ae7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df2ae7640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df2ae7640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 msgr2=0x7f8dec0a2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df2ae7640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 msgr2=0x7f8dec0a2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 0x7f8dec0a2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 0x7f8dec0a2830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 0x7f8dec0a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 0x7f8dec136620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:54.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request con 0x7f8dec073b70 auth_method 0 2024-08-18T21:12:54.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:54.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df1ae5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:54.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df1ae5640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:54.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df22e6640 10 monclient(hunting): get_auth_request con 0x7f8dec073790 auth_method 0 2024-08-18T21:12:54.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df22e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:54.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df22e6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:54.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df22e6640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:54.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 msgr2=0x7f8dec136620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:54.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 msgr2=0x7f8dec136620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:54.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 0x7f8dec136620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:54.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df1ae5640 1 -- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 msgr2=0x7f8dec0a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:54.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df1ae5640 1 -- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 msgr2=0x7f8dec0a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:54.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 0x7f8dec0a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:54.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 0x7f8dec136620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:54.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:54.192+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 0x7f8dec0a1e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:12:55.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 10 monclient(hunting): tick 2024-08-18T21:12:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:12:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 1 monclient(hunting): continuing hunt 2024-08-18T21:12:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:12:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 msgr2=0x7f8dec0a2830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f8dec0a2380 0x7f8dec0a2830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 msgr2=0x7f8dec136620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dec073790 0x7f8dec136620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 1 -- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 msgr2=0x7f8dec0a1e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:12:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 1 --2- 172.21.15.5:0/1783399948 >> v2:172.21.15.157:3300/0 conn(0x7f8dec073b70 0x7f8dec0a1e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 10 monclient: _add_conns ranks=[8,2,6,0,9,5,1,7] 2024-08-18T21:12:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dd8005c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 10 monclient(hunting): picked mon.noname-e con 0x7f8dd80037e0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:12:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 0x7f8dd8008600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 10 monclient(hunting): picked mon.noname-b con 0x7f8dd8006170 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:12:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 0x7f8dd800b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 10 monclient(hunting): picked mon.noname-d con 0x7f8dd8008cf0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:12:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 1 -- 172.21.15.5:0/1783399948 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f8dec0a3a70 con 0x7f8dd8006170 2024-08-18T21:12:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 1 -- 172.21.15.5:0/1783399948 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f8dec0a4df0 con 0x7f8dd8008cf0 2024-08-18T21:12:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 1 -- 172.21.15.5:0/1783399948 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f8dec06fd30 con 0x7f8dd80037e0 2024-08-18T21:12:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.776+0000 7f8de3fff640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 0x7f8dd8008600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dd8005c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 0x7f8dd800b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request con 0x7f8dd8006170 auth_method 0 2024-08-18T21:12:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df1ae5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df1ae5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df22e6640 10 monclient(hunting): get_auth_request con 0x7f8dd80037e0 auth_method 0 2024-08-18T21:12:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df22e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df22e6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df22e6640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request con 0x7f8dd8008cf0 auth_method 0 2024-08-18T21:12:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df2ae7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df2ae7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df1ae5640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 msgr2=0x7f8dd8008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df2ae7640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 msgr2=0x7f8dd800b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df1ae5640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 msgr2=0x7f8dd8008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 msgr2=0x7f8dd8005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df2ae7640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 msgr2=0x7f8dd800b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 0x7f8dd8008600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 msgr2=0x7f8dd8005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 0x7f8dd800b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dd8005c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 0x7f8dd800b180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dd8005c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:55.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.780+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 0x7f8dd8008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:12:55.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dd8005c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:55.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 0x7f8dd800b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:55.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 0x7f8dd8008600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:55.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df22e6640 10 monclient(hunting): get_auth_request con 0x7f8dd80037e0 auth_method 0 2024-08-18T21:12:55.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df22e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:55.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df22e6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:55.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df22e6640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:55.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request con 0x7f8dd8008cf0 auth_method 0 2024-08-18T21:12:55.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:55.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df2ae7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:55.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df2ae7640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:55.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request con 0x7f8dd8006170 auth_method 0 2024-08-18T21:12:55.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:55.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df1ae5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:55.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df1ae5640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:55.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 msgr2=0x7f8dd8005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:55.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 msgr2=0x7f8dd8005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:55.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dd8005c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:55.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df2ae7640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 msgr2=0x7f8dd800b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:55.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df2ae7640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 msgr2=0x7f8dd800b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:55.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 0x7f8dd800b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:55.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dd8005c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:55.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df1ae5640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 msgr2=0x7f8dd8008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:55.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df1ae5640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 msgr2=0x7f8dd8008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:55.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 0x7f8dd8008600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:55.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 0x7f8dd800b180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:55.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:55.984+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 0x7f8dd8008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:12:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 0x7f8dd800b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dd8005c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request con 0x7f8dd8008cf0 auth_method 0 2024-08-18T21:12:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 0x7f8dd8008600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df2ae7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df2ae7640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df22e6640 10 monclient(hunting): get_auth_request con 0x7f8dd80037e0 auth_method 0 2024-08-18T21:12:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df22e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df22e6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df22e6640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request con 0x7f8dd8006170 auth_method 0 2024-08-18T21:12:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df1ae5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df1ae5640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df2ae7640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 msgr2=0x7f8dd800b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:12:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df2ae7640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 msgr2=0x7f8dd800b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 0x7f8dd800b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 msgr2=0x7f8dd8005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:12:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 msgr2=0x7f8dd8005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df1ae5640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 msgr2=0x7f8dd8008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:12:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dd8005c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df1ae5640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 msgr2=0x7f8dd8008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:12:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 0x7f8dd800b180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 0x7f8dd8008600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:12:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dd8005c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:56.388+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 0x7f8dd8008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:12:56.763 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:12:56.763 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31507]: starting. 2024-08-18T21:12:56.764 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31507]: listing objects. 2024-08-18T21:12:56.764 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31507]: listed object 0... 2024-08-18T21:12:56.764 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31507]: listed object 25... 2024-08-18T21:12:56.764 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31507]: saw 50 objects 2024-08-18T21:12:56.764 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31507]: shutting down. 2024-08-18T21:12:57.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 0x7f8dd8008600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:57.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dd8005c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:57.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 0x7f8dd800b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:57.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request con 0x7f8dd8006170 auth_method 0 2024-08-18T21:12:57.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:57.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df1ae5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:57.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df1ae5640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:57.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 10 monclient(hunting): get_auth_request con 0x7f8dd80037e0 auth_method 0 2024-08-18T21:12:57.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:57.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:57.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:57.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request con 0x7f8dd8008cf0 auth_method 0 2024-08-18T21:12:57.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:57.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df2ae7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:57.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df2ae7640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:12:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df2ae7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df2ae7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df2ae7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df1ae5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df1ae5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df1ae5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 10 monclient(hunting): handle_auth_done global_id 114515 payload 274 2024-08-18T21:12:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 msgr2=0x7f8dd800b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:12:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 0x7f8dd800b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 msgr2=0x7f8dd8008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:12:57.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 0x7f8dd8008600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:57.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 10 monclient: _finish_hunting 0 2024-08-18T21:12:57.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 1 monclient: found mon.noname-e 2024-08-18T21:12:57.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:57.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:12:57.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dec070010 con 0x7f8dd80037e0 2024-08-18T21:12:57.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dd8008cf0 0x7f8dd800b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:12:57.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dd8006170 0x7f8dd8008600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:12:57.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.192+0000 7f8df2ae7640 1 -- 172.21.15.5:0/1783399948 reap_dead start 2024-08-18T21:12:57.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df22e6640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 msgr2=0x7f8dd8005c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:57.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df22e6640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dd8005c10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8de4009f00 tx=0x7f8de401e3e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=4af9c7ebfd82e1b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:57.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df12e4640 1 -- 172.21.15.5:0/1783399948 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8de40b4070 con 0x7f8dd80037e0 2024-08-18T21:12:57.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df12e4640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:57.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df12e4640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:12:57.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df12e4640 10 monclient: dump: 2024-08-18T21:12:57.199 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:57.199 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:57.199 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:57.199 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:57.199 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:57.199 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:57.199 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:57.199 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:57.199 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:57.200 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:57.200 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:57.200 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:57.200 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:57.200 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:57.200 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:57.200 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:57.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df12e4640 10 monclient: _finish_auth 0 2024-08-18T21:12:57.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df12e4640 10 monclient: _check_auth_tickets 2024-08-18T21:12:57.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df12e4640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:57.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df12e4640 1 -- 172.21.15.5:0/1783399948 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de40ad780 con 0x7f8dd80037e0 2024-08-18T21:12:57.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df12e4640 10 monclient: handle_config config(0 keys) 2024-08-18T21:12:57.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df12e4640 1 -- 172.21.15.5:0/1783399948 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8de40adda0 con 0x7f8dd80037e0 2024-08-18T21:12:57.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df454a640 5 monclient: authenticate success, global_id 114515 2024-08-18T21:12:57.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df454a640 10 monclient: get_monmap_and_config success 2024-08-18T21:12:57.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df454a640 4 set_mon_vals no callback set 2024-08-18T21:12:57.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df12e4640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:57.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df12e4640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:12:57.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df12e4640 10 monclient: dump: 2024-08-18T21:12:57.201 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:57.201 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:57.201 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:57.201 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:57.201 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:57.202 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:57.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df454a640 10 monclient: shutdown 2024-08-18T21:12:57.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df454a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:12:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df454a640 1 -- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 msgr2=0x7f8dd8005c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df454a640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dd8005c10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8de4009f00 tx=0x7f8de401e3e0 comp rx=0 tx=0).stop 2024-08-18T21:12:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df454a640 1 -- 172.21.15.5:0/1783399948 shutdown_connections 2024-08-18T21:12:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df454a640 1 --2- 172.21.15.5:0/1783399948 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dd8005c10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df454a640 1 -- 172.21.15.5:0/1783399948 >> 172.21.15.5:0/1783399948 conn(0x7f8dec0a8a90 msgr2=0x7f8dec0a8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:12:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df454a640 1 -- 172.21.15.5:0/1783399948 shutdown_connections 2024-08-18T21:12:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.200+0000 7f8df454a640 1 -- 172.21.15.5:0/1783399948 wait complete. 2024-08-18T21:12:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 10 monclient: build_initial_monmap 2024-08-18T21:12:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 10 monclient: monmap: 2024-08-18T21:12:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:12:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:12:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:12:57.207 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:12:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:12:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:12:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:12:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:12:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:12:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:12:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:12:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:12:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:12:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:12:57.208 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 1 Processor -- start 2024-08-18T21:12:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 1 -- start start 2024-08-18T21:12:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 10 monclient: init 2024-08-18T21:12:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 10 monclient: _reopen_session rank -1 2024-08-18T21:12:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 10 monclient: _add_conns ranks=[8,7,6,4,2,5,3,1,0] 2024-08-18T21:12:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dec1d2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 10 monclient(hunting): picked mon.noname-e con 0x7f8dd80037e0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:12:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8dec1d2550 0x7f8dec1d29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 10 monclient(hunting): picked mon.noname-i con 0x7f8dec1d2550 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:12:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dec1216b0 0x7f8dec121b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 10 monclient(hunting): picked mon.noname-d con 0x7f8dec1216b0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:12:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f8dec0a2790 con 0x7f8dec1216b0 2024-08-18T21:12:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f8dec074160 con 0x7f8dec1d2550 2024-08-18T21:12:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:12:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f8dec0a2910 con 0x7f8dd80037e0 2024-08-18T21:12:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 10 monclient(hunting): _renew_subs 2024-08-18T21:12:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df454a640 10 monclient(hunting): authenticate will time out at 1544.218214s 2024-08-18T21:12:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dec1216b0 0x7f8dec121b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dec1216b0 0x7f8dec121b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:41500/0 (socket says 172.21.15.5:41500) 2024-08-18T21:12:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 1 -- 172.21.15.5:0/4245716211 learned_addr learned my addr 172.21.15.5:0/4245716211 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:12:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request con 0x7f8dec1216b0 auth_method 0 2024-08-18T21:12:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df22e6640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dec1d2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df22e6640 10 monclient(hunting): get_auth_request con 0x7f8dd80037e0 auth_method 0 2024-08-18T21:12:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df22e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df22e6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df22e6640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df1ae5640 1 --2- 172.21.15.5:0/4245716211 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8dec1d2550 0x7f8dec1d29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request con 0x7f8dec1d2550 auth_method 0 2024-08-18T21:12:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df1ae5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:12:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df1ae5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:12:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df1ae5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:12:57.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df22e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:57.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df22e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:57.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df22e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:57.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df1ae5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:12:57.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df1ae5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:12:57.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df1ae5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:12:57.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 10 monclient(hunting): handle_auth_done global_id 85569 payload 824 2024-08-18T21:12:57.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 1 -- 172.21.15.5:0/4245716211 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 msgr2=0x7f8dec1d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:57.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/4245716211 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dec1d2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:57.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 1 -- 172.21.15.5:0/4245716211 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8dec1d2550 msgr2=0x7f8dec1d29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:57.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/4245716211 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8dec1d2550 0x7f8dec1d29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:57.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 10 monclient: _finish_hunting 0 2024-08-18T21:12:57.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 1 monclient: found mon.noname-d 2024-08-18T21:12:57.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:12:57.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:12:57.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.204+0000 7f8df2ae7640 1 -- 172.21.15.5:0/4245716211 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dec125130 con 0x7f8dec1216b0 2024-08-18T21:12:57.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8df2ae7640 1 -- 172.21.15.5:0/4245716211 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dec1216b0 msgr2=0x7f8dec121b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:12:57.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8df2ae7640 1 --2- 172.21.15.5:0/4245716211 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dec1216b0 0x7f8dec121b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8de8006e10 tx=0x7f8de8017e90 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:57.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8de2ffd640 1 -- 172.21.15.5:0/4245716211 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8de8027070 con 0x7f8dec1216b0 2024-08-18T21:12:57.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8de2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:57.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8de2ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:12:57.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8de2ffd640 10 monclient: dump: 2024-08-18T21:12:57.213 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:57.213 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:57.213 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:57.213 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:57.213 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:57.214 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:57.214 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:57.214 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:57.214 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:57.214 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:57.214 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:57.214 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:57.214 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:57.214 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:57.214 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:57.214 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:57.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8de2ffd640 10 monclient: _finish_auth 0 2024-08-18T21:12:57.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8de2ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:12:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8de2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:12:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8de2ffd640 1 -- 172.21.15.5:0/4245716211 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de8016d90 con 0x7f8dec1216b0 2024-08-18T21:12:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8de2ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:12:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8de2ffd640 1 -- 172.21.15.5:0/4245716211 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8de800f040 con 0x7f8dec1216b0 2024-08-18T21:12:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8df454a640 5 monclient: authenticate success, global_id 85569 2024-08-18T21:12:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8df454a640 10 monclient: _renew_subs 2024-08-18T21:12:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8df454a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:12:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8df0ae3640 4 set_mon_vals no callback set 2024-08-18T21:12:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8df454a640 1 -- 172.21.15.5:0/4245716211 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dec125410 con 0x7f8dec1216b0 2024-08-18T21:12:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8de2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:12:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8de2ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:12:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8de2ffd640 10 monclient: dump: 2024-08-18T21:12:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:12:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:12:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:12:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:12:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:12:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:12:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:12:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:12:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:12:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:12:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:12:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:12:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:12:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:12:57.217 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:12:57.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8df454a640 10 monclient: _renew_subs 2024-08-18T21:12:57.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8df454a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:12:57.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8df454a640 1 -- 172.21.15.5:0/4245716211 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dec0a5cd0 con 0x7f8dec1216b0 2024-08-18T21:12:57.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8de2ffd640 1 -- 172.21.15.5:0/4245716211 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f8de8021390 con 0x7f8dec1216b0 2024-08-18T21:12:57.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8df454a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:57.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8df454a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:57.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8df454a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:12:57.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8df454a640 1 -- 172.21.15.5:0/4245716211 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dec0a8160 con 0x7f8dec1216b0 2024-08-18T21:12:57.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8de2ffd640 1 --2- 172.21.15.5:0/4245716211 >> v2:172.21.15.157:6812/631023601 conn(0x7f8dd803d040 0x7f8dd803f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:12:57.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8de2ffd640 1 -- 172.21.15.5:0/4245716211 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(258..258 src has 22..258) ==== 3898+0+0 (secure 0 0 0) 0x7f8de804f710 con 0x7f8dec1216b0 2024-08-18T21:12:57.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8df22e6640 1 --2- 172.21.15.5:0/4245716211 >> v2:172.21.15.157:6812/631023601 conn(0x7f8dd803d040 0x7f8dd803f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:12:57.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.208+0000 7f8df22e6640 10 monclient: get_auth_request con 0x7f8dd803d040 auth_method 0 2024-08-18T21:12:57.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.212+0000 7f8df22e6640 1 --2- 172.21.15.5:0/4245716211 >> v2:172.21.15.157:6812/631023601 conn(0x7f8dd803d040 0x7f8dd803f500 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8de40ae000 tx=0x7f8de40a8000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:12:57.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.216+0000 7f8de2ffd640 1 -- 172.21.15.5:0/4245716211 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f8de801f070 con 0x7f8dec1216b0 2024-08-18T21:12:57.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.216+0000 7f8de2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:12:57.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.216+0000 7f8de2ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:12:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.456+0000 7f8df454a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:12:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.456+0000 7f8df454a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:12:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.456+0000 7f8df454a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:12:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.456+0000 7f8df454a640 1 -- 172.21.15.5:0/4245716211 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8dec0a2c40 con 0x7f8dec1216b0 2024-08-18T21:12:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.456+0000 7f8de2ffd640 1 -- 172.21.15.5:0/4245716211 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3167 (secure 0 0 0) 0x7f8de8021860 con 0x7f8dec1216b0 2024-08-18T21:12:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.456+0000 7f8de2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:12:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.456+0000 7f8de2ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:12:57.456 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":202,"quorum":[0,1,2,3,4,6,7,8],"quorum_names":["a","f","b","g","c","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:12:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.460+0000 7f8df454a640 1 -- 172.21.15.5:0/4245716211 >> v2:172.21.15.157:6812/631023601 conn(0x7f8dd803d040 msgr2=0x7f8dd803f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.460+0000 7f8df454a640 1 --2- 172.21.15.5:0/4245716211 >> v2:172.21.15.157:6812/631023601 conn(0x7f8dd803d040 0x7f8dd803f500 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8de40ae000 tx=0x7f8de40a8000 comp rx=0 tx=0).stop 2024-08-18T21:12:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.460+0000 7f8df454a640 10 monclient: shutdown 2024-08-18T21:12:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.460+0000 7f8df454a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:12:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.460+0000 7f8df454a640 1 -- 172.21.15.5:0/4245716211 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dec1216b0 msgr2=0x7f8dec121b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:12:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.460+0000 7f8df454a640 1 --2- 172.21.15.5:0/4245716211 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dec1216b0 0x7f8dec121b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8de8006e10 tx=0x7f8de8017e90 comp rx=0 tx=0).stop 2024-08-18T21:12:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.460+0000 7f8df454a640 1 -- 172.21.15.5:0/4245716211 shutdown_connections 2024-08-18T21:12:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.460+0000 7f8df454a640 1 --2- 172.21.15.5:0/4245716211 >> v2:172.21.15.157:6812/631023601 conn(0x7f8dd803d040 0x7f8dd803f500 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.460+0000 7f8df454a640 1 --2- 172.21.15.5:0/4245716211 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8dec1216b0 0x7f8dec121b10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.460+0000 7f8df454a640 1 --2- 172.21.15.5:0/4245716211 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8dec1d2550 0x7f8dec1d29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.460+0000 7f8df454a640 1 --2- 172.21.15.5:0/4245716211 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8dd80037e0 0x7f8dec1d2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:12:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.460+0000 7f8df454a640 1 -- 172.21.15.5:0/4245716211 >> 172.21.15.5:0/4245716211 conn(0x7f8dec0a8a90 msgr2=0x7f8dec072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:12:57.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.460+0000 7f8df454a640 1 -- 172.21.15.5:0/4245716211 shutdown_connections 2024-08-18T21:12:57.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:12:57.460+0000 7f8df454a640 1 -- 172.21.15.5:0/4245716211 wait complete. 2024-08-18T21:12:58.598 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:12:58.598 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31506]: starting. 2024-08-18T21:12:58.599 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31506]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31470 2024-08-18T21:12:58.599 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31506]: shutting down. 2024-08-18T21:12:58.602 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:12:58.602 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:12:58.602 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:12:58.605 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:13:00.477 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:13:00.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 10 monclient: get_monmap_and_config 2024-08-18T21:13:00.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 10 monclient: build_initial_monmap 2024-08-18T21:13:00.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 10 monclient: monmap: 2024-08-18T21:13:00.610 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:00.610 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:00.610 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:00.613833+0000 2024-08-18T21:13:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:00.613833+0000 2024-08-18T21:13:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:00.612 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:00.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 1 Processor -- start 2024-08-18T21:13:00.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 1 -- start start 2024-08-18T21:13:00.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 10 monclient: init 2024-08-18T21:13:00.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:00.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 10 monclient: _add_conns ranks=[5,6,9,2,8,10,7,3,0,4,1] 2024-08-18T21:13:00.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f79c00a6bd0 0x7f79c00a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:00.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 10 monclient(hunting): picked mon.noname-h con 0x7f79c00a6bd0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:00.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79c009f080 0x7f79c00a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:00.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 10 monclient(hunting): picked mon.noname-d con 0x7f79c009f080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:00.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79c0139990 0x7f79c0139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 10 monclient(hunting): picked mon.noname-a con 0x7f79c0139990 addr v2:172.21.15.5:3300/0 2024-08-18T21:13:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f79c009e4c0 con 0x7f79c0139990 2024-08-18T21:13:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f79c006f930 con 0x7f79c00a6bd0 2024-08-18T21:13:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f79c00a7a30 con 0x7f79c009f080 2024-08-18T21:13:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79c48d5640 10 monclient(hunting): authenticate will time out at 1547.626998s 2024-08-18T21:13:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79c009f080 0x7f79c00a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79c009f080 0x7f79c00a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:41508/0 (socket says 172.21.15.5:41508) 2024-08-18T21:13:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 1 -- 172.21.15.5:0/193864783 learned_addr learned my addr 172.21.15.5:0/193864783 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 10 monclient(hunting): get_auth_request con 0x7f79c009f080 auth_method 0 2024-08-18T21:13:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:00.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:00.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:00.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bed9d640 1 --2- 172.21.15.5:0/193864783 >> v2:172.21.15.5:3300/0 conn(0x7f79c0139990 0x7f79c0139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:00.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bed9d640 10 monclient(hunting): get_auth_request con 0x7f79c0139990 auth_method 0 2024-08-18T21:13:00.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:00.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bed9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:00.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:00.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:00.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:00.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:00.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:00.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:00.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79be59c640 1 --2- 172.21.15.5:0/193864783 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f79c00a6bd0 0x7f79c00a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79be59c640 10 monclient(hunting): get_auth_request con 0x7f79c00a6bd0 auth_method 0 2024-08-18T21:13:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79be59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79be59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79be59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 10 monclient(hunting): handle_auth_done global_id 85596 payload 274 2024-08-18T21:13:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 1 -- 172.21.15.5:0/193864783 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f79c00a6bd0 msgr2=0x7f79c00a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 1 --2- 172.21.15.5:0/193864783 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f79c00a6bd0 0x7f79c00a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 1 -- 172.21.15.5:0/193864783 >> v2:172.21.15.5:3300/0 conn(0x7f79c0139990 msgr2=0x7f79c0139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 1 --2- 172.21.15.5:0/193864783 >> v2:172.21.15.5:3300/0 conn(0x7f79c0139990 0x7f79c0139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 10 monclient: _finish_hunting 0 2024-08-18T21:13:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 1 monclient: found mon.noname-d 2024-08-18T21:13:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:00.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:13:00.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bdd9b640 1 -- 172.21.15.5:0/193864783 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c00a7fb0 con 0x7f79c009f080 2024-08-18T21:13:00.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.612+0000 7f79bed9d640 1 --2- 172.21.15.5:0/193864783 >> v2:172.21.15.5:3300/0 conn(0x7f79c0139990 0x7f79c0139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.616+0000 7f79bdd9b640 1 -- 172.21.15.5:0/193864783 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79c009f080 msgr2=0x7f79c00a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.616+0000 7f79bdd9b640 1 --2- 172.21.15.5:0/193864783 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79c009f080 0x7f79c00a74f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009e80 tx=0x7f79b001c8d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=e86ed898e8e4a7c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.616+0000 7f79bd59a640 1 -- 172.21.15.5:0/193864783 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f79b00090d0 con 0x7f79c009f080 2024-08-18T21:13:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bd59a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:13:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bd59a640 10 monclient: dump: 2024-08-18T21:13:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:00.625 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bd59a640 10 monclient: _finish_auth 0 2024-08-18T21:13:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bd59a640 10 monclient: _check_auth_tickets 2024-08-18T21:13:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 5 monclient: authenticate success, global_id 85596 2024-08-18T21:13:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bd59a640 1 -- 172.21.15.5:0/193864783 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b00a5a70 con 0x7f79c009f080 2024-08-18T21:13:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bd59a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 4 set_mon_vals no callback set 2024-08-18T21:13:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bd59a640 1 -- 172.21.15.5:0/193864783 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f79b00a5c20 con 0x7f79c009f080 2024-08-18T21:13:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bd59a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:13:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bd59a640 10 monclient: dump: 2024-08-18T21:13:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:00.628 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 10 monclient: shutdown 2024-08-18T21:13:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 -- 172.21.15.5:0/193864783 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79c009f080 msgr2=0x7f79c00a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 --2- 172.21.15.5:0/193864783 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79c009f080 0x7f79c00a74f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009e80 tx=0x7f79b001c8d0 comp rx=0 tx=0).stop 2024-08-18T21:13:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 -- 172.21.15.5:0/193864783 shutdown_connections 2024-08-18T21:13:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 --2- 172.21.15.5:0/193864783 >> v2:172.21.15.5:3300/0 conn(0x7f79c0139990 0x7f79c0139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 --2- 172.21.15.5:0/193864783 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79c009f080 0x7f79c00a74f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 --2- 172.21.15.5:0/193864783 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f79c00a6bd0 0x7f79c00a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 -- 172.21.15.5:0/193864783 >> 172.21.15.5:0/193864783 conn(0x7f79c0068700 msgr2=0x7f79c0068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 -- 172.21.15.5:0/193864783 shutdown_connections 2024-08-18T21:13:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 -- 172.21.15.5:0/193864783 wait complete. 2024-08-18T21:13:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 10 monclient: build_initial_monmap 2024-08-18T21:13:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 10 monclient: monmap: 2024-08-18T21:13:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:00.630 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 Processor -- start 2024-08-18T21:13:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 -- start start 2024-08-18T21:13:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 10 monclient: init 2024-08-18T21:13:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 10 monclient: _add_conns ranks=[1,6,0,2,5,7,3,4,8] 2024-08-18T21:13:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79c009f080 0x7f79c01385e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 10 monclient(hunting): picked mon.noname-f con 0x7f79c009f080 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:13:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79c00a6bd0 0x7f79c0138b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 10 monclient(hunting): picked mon.noname-d con 0x7f79c00a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c0139990 0x7f79c013db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 10 monclient(hunting): picked mon.noname-a con 0x7f79c0139990 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:13:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f79c00a89f0 con 0x7f79c0139990 2024-08-18T21:13:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f79c00a7ce0 con 0x7f79c009f080 2024-08-18T21:13:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f79c0143610 con 0x7f79c00a6bd0 2024-08-18T21:13:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79c48d5640 10 monclient(hunting): authenticate will time out at 1547.634430s 2024-08-18T21:13:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79c00a6bd0 0x7f79c0138b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c0139990 0x7f79c013db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79c00a6bd0 0x7f79c0138b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:41520/0 (socket says 172.21.15.5:41520) 2024-08-18T21:13:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 1 -- 172.21.15.5:0/2764570099 learned_addr learned my addr 172.21.15.5:0/2764570099 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 10 monclient(hunting): get_auth_request con 0x7f79c00a6bd0 auth_method 0 2024-08-18T21:13:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:00.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:00.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:00.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bed9d640 10 monclient(hunting): get_auth_request con 0x7f79c0139990 auth_method 0 2024-08-18T21:13:00.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:00.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bed9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:00.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:00.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:00.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:00.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:00.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:00.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:00.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:00.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 10 monclient(hunting): handle_auth_done global_id 85605 payload 824 2024-08-18T21:13:00.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79be59c640 1 --2- 172.21.15.5:0/2764570099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79c009f080 0x7f79c01385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 1 -- 172.21.15.5:0/2764570099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79c009f080 msgr2=0x7f79c01385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 1 --2- 172.21.15.5:0/2764570099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79c009f080 0x7f79c01385e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 1 -- 172.21.15.5:0/2764570099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c0139990 msgr2=0x7f79c013db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 1 --2- 172.21.15.5:0/2764570099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c0139990 0x7f79c013db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 10 monclient: _finish_hunting 0 2024-08-18T21:13:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 1 monclient: found mon.noname-d 2024-08-18T21:13:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:13:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.620+0000 7f79bdd9b640 1 -- 172.21.15.5:0/2764570099 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c0124030 con 0x7f79c00a6bd0 2024-08-18T21:13:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79bdd9b640 1 -- 172.21.15.5:0/2764570099 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79c00a6bd0 msgr2=0x7f79c0138b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79bdd9b640 1 --2- 172.21.15.5:0/2764570099 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79c00a6bd0 0x7f79c0138b20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f79b001d170 tx=0x7f79b0019670 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79b6ffd640 1 -- 172.21.15.5:0/2764570099 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f79b00bc020 con 0x7f79c00a6bd0 2024-08-18T21:13:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79b6ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:13:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79b6ffd640 10 monclient: dump: 2024-08-18T21:13:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:00.635 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79b6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:13:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79b6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:13:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79b6ffd640 1 -- 172.21.15.5:0/2764570099 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b0003e10 con 0x7f79c00a6bd0 2024-08-18T21:13:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79b6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79b6ffd640 1 -- 172.21.15.5:0/2764570099 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f79b00044b0 con 0x7f79c00a6bd0 2024-08-18T21:13:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79c48d5640 5 monclient: authenticate success, global_id 85605 2024-08-18T21:13:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79c48d5640 10 monclient: _renew_subs 2024-08-18T21:13:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79c48d5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:13:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79c48d5640 1 -- 172.21.15.5:0/2764570099 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c0139710 con 0x7f79c00a6bd0 2024-08-18T21:13:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79bcd99640 4 set_mon_vals no callback set 2024-08-18T21:13:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79b6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:13:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79b6ffd640 10 monclient: dump: 2024-08-18T21:13:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:00.637 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79c48d5640 10 monclient: _renew_subs 2024-08-18T21:13:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79c48d5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:13:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79c48d5640 1 -- 172.21.15.5:0/2764570099 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c013fe10 con 0x7f79c00a6bd0 2024-08-18T21:13:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79b6ffd640 1 -- 172.21.15.5:0/2764570099 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f79b00bf020 con 0x7f79c00a6bd0 2024-08-18T21:13:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79c48d5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79c48d5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79c48d5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:13:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79c48d5640 1 -- 172.21.15.5:0/2764570099 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c0139e10 con 0x7f79c00a6bd0 2024-08-18T21:13:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79b6ffd640 1 --2- 172.21.15.5:0/2764570099 >> v2:172.21.15.157:6812/631023601 conn(0x7f79a003bdc0 0x7f79a003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:00.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79b6ffd640 1 -- 172.21.15.5:0/2764570099 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(260..260 src has 22..260) ==== 3898+0+0 (secure 0 0 0) 0x7f79b00e9470 con 0x7f79c00a6bd0 2024-08-18T21:13:00.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79be59c640 1 --2- 172.21.15.5:0/2764570099 >> v2:172.21.15.157:6812/631023601 conn(0x7f79a003bdc0 0x7f79a003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:00.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.624+0000 7f79be59c640 10 monclient: get_auth_request con 0x7f79a003bdc0 auth_method 0 2024-08-18T21:13:00.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.628+0000 7f79be59c640 1 --2- 172.21.15.5:0/2764570099 >> v2:172.21.15.157:6812/631023601 conn(0x7f79a003bdc0 0x7f79a003e280 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009790 tx=0x7f79a8008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:00.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.628+0000 7f79b6ffd640 1 -- 172.21.15.5:0/2764570099 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f79b00c6030 con 0x7f79c00a6bd0 2024-08-18T21:13:00.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.628+0000 7f79b6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:00.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.628+0000 7f79b6ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:00.859 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31688]: starting. 2024-08-18T21:13:00.859 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31688]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31687 2024-08-18T21:13:00.859 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31688]: created object 0... 2024-08-18T21:13:00.859 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31688]: created object 25... 2024-08-18T21:13:00.859 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31688]: created object 49... 2024-08-18T21:13:00.859 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31688]: finishing. 2024-08-18T21:13:00.860 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31688]: shutting down. 2024-08-18T21:13:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.891+0000 7f79c48d5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:13:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.891+0000 7f79c48d5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:13:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.891+0000 7f79c48d5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:13:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.891+0000 7f79c48d5640 1 -- 172.21.15.5:0/2764570099 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f79c00746d0 con 0x7f79c00a6bd0 2024-08-18T21:13:00.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79b6ffd640 1 -- 172.21.15.5:0/2764570099 <== mon.6 v2:172.21.15.5:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7f79b00165e0 con 0x7f79c00a6bd0 2024-08-18T21:13:00.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79b6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:13:00.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79b6ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:00.893 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":206,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:13:00.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79c48d5640 1 -- 172.21.15.5:0/2764570099 >> v2:172.21.15.157:6812/631023601 conn(0x7f79a003bdc0 msgr2=0x7f79a003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:00.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79c48d5640 1 --2- 172.21.15.5:0/2764570099 >> v2:172.21.15.157:6812/631023601 conn(0x7f79a003bdc0 0x7f79a003e280 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009790 tx=0x7f79a8008040 comp rx=0 tx=0).stop 2024-08-18T21:13:00.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79c48d5640 10 monclient: shutdown 2024-08-18T21:13:00.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79c48d5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:00.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79c48d5640 1 -- 172.21.15.5:0/2764570099 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79c00a6bd0 msgr2=0x7f79c0138b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:00.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79c48d5640 1 --2- 172.21.15.5:0/2764570099 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79c00a6bd0 0x7f79c0138b20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f79b001d170 tx=0x7f79b0019670 comp rx=0 tx=0).stop 2024-08-18T21:13:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79c48d5640 1 -- 172.21.15.5:0/2764570099 shutdown_connections 2024-08-18T21:13:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79c48d5640 1 --2- 172.21.15.5:0/2764570099 >> v2:172.21.15.157:6812/631023601 conn(0x7f79a003bdc0 0x7f79a003e280 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79c48d5640 1 --2- 172.21.15.5:0/2764570099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c0139990 0x7f79c013db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79c48d5640 1 --2- 172.21.15.5:0/2764570099 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79c00a6bd0 0x7f79c0138b20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79c48d5640 1 --2- 172.21.15.5:0/2764570099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79c009f080 0x7f79c01385e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79c48d5640 1 -- 172.21.15.5:0/2764570099 >> 172.21.15.5:0/2764570099 conn(0x7f79c0068700 msgr2=0x7f79c00a9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79c48d5640 1 -- 172.21.15.5:0/2764570099 shutdown_connections 2024-08-18T21:13:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:00.895+0000 7f79c48d5640 1 -- 172.21.15.5:0/2764570099 wait complete. 2024-08-18T21:13:00.912 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:13:00.912 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:13:00.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:13:01.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 10 monclient: get_monmap_and_config 2024-08-18T21:13:01.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 10 monclient: build_initial_monmap 2024-08-18T21:13:01.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 10 monclient: monmap: 2024-08-18T21:13:01.033 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:01.033 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.033 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:01.036712+0000 2024-08-18T21:13:01.033 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:01.036712+0000 2024-08-18T21:13:01.033 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:01.033 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:01.034 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 1 Processor -- start 2024-08-18T21:13:01.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 1 -- start start 2024-08-18T21:13:01.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 10 monclient: init 2024-08-18T21:13:01.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:01.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 10 monclient: _add_conns ranks=[6,8,5,7,10,0,2,1,3,9,4] 2024-08-18T21:13:01.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8b5c0a49d0 0x7f8b5c09ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 10 monclient(hunting): picked mon.noname-d con 0x7f8b5c0a49d0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:01.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8b5c0a4db0 0x7f8b5c0a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 10 monclient(hunting): picked mon.noname-e con 0x7f8b5c0a4db0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:01.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8b5c1387a0 0x7f8b5c138be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 10 monclient(hunting): picked mon.noname-h con 0x7f8b5c1387a0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:01.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f8b5c09e8d0 con 0x7f8b5c1387a0 2024-08-18T21:13:01.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f8b5c09db10 con 0x7f8b5c0a49d0 2024-08-18T21:13:01.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f8b5c09e310 con 0x7f8b5c0a4db0 2024-08-18T21:13:01.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:01.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b613a0640 10 monclient(hunting): authenticate will time out at 1548.049939s 2024-08-18T21:13:01.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5affd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8b5c0a49d0 0x7f8b5c09ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8b5c0a4db0 0x7f8b5c0a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5affd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8b5c0a49d0 0x7f8b5c09ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:41524/0 (socket says 172.21.15.5:41524) 2024-08-18T21:13:01.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5affd640 1 -- 172.21.15.5:0/3133716088 learned_addr learned my addr 172.21.15.5:0/3133716088 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:01.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5affd640 10 monclient(hunting): get_auth_request con 0x7f8b5c0a49d0 auth_method 0 2024-08-18T21:13:01.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 10 monclient(hunting): get_auth_request con 0x7f8b5c0a4db0 auth_method 0 2024-08-18T21:13:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 10 monclient(hunting): handle_auth_done global_id 114551 payload 274 2024-08-18T21:13:01.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5b7fe640 1 --2- 172.21.15.5:0/3133716088 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8b5c1387a0 0x7f8b5c138be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 1 -- 172.21.15.5:0/3133716088 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8b5c0a49d0 msgr2=0x7f8b5c09ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:01.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 1 --2- 172.21.15.5:0/3133716088 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8b5c0a49d0 0x7f8b5c09ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 1 -- 172.21.15.5:0/3133716088 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8b5c1387a0 msgr2=0x7f8b5c138be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:01.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 1 --2- 172.21.15.5:0/3133716088 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8b5c1387a0 0x7f8b5c138be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:13:01.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 1 monclient: found mon.noname-e 2024-08-18T21:13:01.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:01.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:13:01.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5a7fc640 1 -- 172.21.15.5:0/3133716088 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c09e5f0 con 0x7f8b5c0a4db0 2024-08-18T21:13:01.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5b7fe640 10 monclient: get_auth_request con 0x7f8b5c1387a0 auth_method 0 2024-08-18T21:13:01.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5affd640 1 --2- 172.21.15.5:0/3133716088 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8b5c0a49d0 0x7f8b5c09ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:01.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.035+0000 7f8b5b7fe640 1 --2- 172.21.15.5:0/3133716088 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8b5c1387a0 0x7f8b5c138be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:13:01.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b5a7fc640 1 -- 172.21.15.5:0/3133716088 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8b5c0a4db0 msgr2=0x7f8b5c0a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b5a7fc640 1 --2- 172.21.15.5:0/3133716088 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8b5c0a4db0 0x7f8b5c0a51d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8b440097f0 tx=0x7f8b4401cdc0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=da69667c91ecc603 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b59ffb640 1 -- 172.21.15.5:0/3133716088 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8b440b0070 con 0x7f8b5c0a4db0 2024-08-18T21:13:01.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b59ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b59ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:13:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b59ffb640 10 monclient: dump: 2024-08-18T21:13:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.051 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.052 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b59ffb640 10 monclient: _finish_auth 0 2024-08-18T21:13:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b59ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:13:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b59ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b613a0640 5 monclient: authenticate success, global_id 114551 2024-08-18T21:13:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b613a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:13:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b59ffb640 1 -- 172.21.15.5:0/3133716088 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b440aa810 con 0x7f8b5c0a4db0 2024-08-18T21:13:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b59ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b613a0640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b613a0640 4 set_mon_vals no callback set 2024-08-18T21:13:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b59ffb640 1 -- 172.21.15.5:0/3133716088 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8b440a9300 con 0x7f8b5c0a4db0 2024-08-18T21:13:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b59ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b59ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b59ffb640 10 monclient: dump: 2024-08-18T21:13:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.054 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b613a0640 10 monclient: shutdown 2024-08-18T21:13:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b613a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b613a0640 1 -- 172.21.15.5:0/3133716088 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8b5c0a4db0 msgr2=0x7f8b5c0a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b613a0640 1 --2- 172.21.15.5:0/3133716088 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8b5c0a4db0 0x7f8b5c0a51d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8b440097f0 tx=0x7f8b4401cdc0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b613a0640 1 -- 172.21.15.5:0/3133716088 shutdown_connections 2024-08-18T21:13:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b613a0640 1 --2- 172.21.15.5:0/3133716088 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8b5c1387a0 0x7f8b5c138be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b613a0640 1 --2- 172.21.15.5:0/3133716088 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8b5c0a4db0 0x7f8b5c0a51d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b613a0640 1 --2- 172.21.15.5:0/3133716088 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f8b5c0a49d0 0x7f8b5c09ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b613a0640 1 -- 172.21.15.5:0/3133716088 >> 172.21.15.5:0/3133716088 conn(0x7f8b5c0a65f0 msgr2=0x7f8b5c068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b613a0640 1 -- 172.21.15.5:0/3133716088 shutdown_connections 2024-08-18T21:13:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.039+0000 7f8b613a0640 1 -- 172.21.15.5:0/3133716088 wait complete. 2024-08-18T21:13:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 10 monclient: build_initial_monmap 2024-08-18T21:13:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 10 monclient: monmap: 2024-08-18T21:13:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:01.056 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 1 Processor -- start 2024-08-18T21:13:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 1 -- start start 2024-08-18T21:13:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 10 monclient: init 2024-08-18T21:13:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 10 monclient: _add_conns ranks=[5,8,3,0,6,2,4,1,7] 2024-08-18T21:13:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8b5c0a49d0 0x7f8b5c1371d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 10 monclient(hunting): picked mon.noname-h con 0x7f8b5c0a49d0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8b5c0a4db0 0x7f8b5c137710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 10 monclient(hunting): picked mon.noname-e con 0x7f8b5c0a4db0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b5c1387a0 0x7f8b5c11f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 10 monclient(hunting): picked mon.noname-g con 0x7f8b5c1387a0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5c1435f0 con 0x7f8b5c1387a0 2024-08-18T21:13:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f8b5c0a5710 con 0x7f8b5c0a49d0 2024-08-18T21:13:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f8b5c143770 con 0x7f8b5c0a4db0 2024-08-18T21:13:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b613a0640 10 monclient(hunting): authenticate will time out at 1548.057552s 2024-08-18T21:13:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8b5c0a4db0 0x7f8b5c137710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8b5c0a4db0 0x7f8b5c137710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:53698/0 (socket says 172.21.15.5:53698) 2024-08-18T21:13:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 1 -- 172.21.15.5:0/3833142091 learned_addr learned my addr 172.21.15.5:0/3833142091 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 10 monclient(hunting): get_auth_request con 0x7f8b5c0a4db0 auth_method 0 2024-08-18T21:13:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5b7fe640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b5c1387a0 0x7f8b5c11f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5b7fe640 10 monclient(hunting): get_auth_request con 0x7f8b5c1387a0 auth_method 0 2024-08-18T21:13:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5affd640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8b5c0a49d0 0x7f8b5c1371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 10 monclient(hunting): handle_auth_done global_id 114560 payload 824 2024-08-18T21:13:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 1 -- 172.21.15.5:0/3833142091 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8b5c0a49d0 msgr2=0x7f8b5c1371d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8b5c0a49d0 0x7f8b5c1371d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 1 -- 172.21.15.5:0/3833142091 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b5c1387a0 msgr2=0x7f8b5c11f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b5c1387a0 0x7f8b5c11f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:13:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 1 monclient: found mon.noname-e 2024-08-18T21:13:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:13:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5a7fc640 1 -- 172.21.15.5:0/3833142091 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c122d70 con 0x7f8b5c0a4db0 2024-08-18T21:13:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5affd640 10 monclient: get_auth_request con 0x7f8b5c0a49d0 auth_method 0 2024-08-18T21:13:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.043+0000 7f8b5affd640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f8b5c0a49d0 0x7f8b5c1371d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:13:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b5a7fc640 1 -- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8b5c0a4db0 msgr2=0x7f8b5c137710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b5a7fc640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8b5c0a4db0 0x7f8b5c137710 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8b4401c190 tx=0x7f8b44019100 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b537fe640 1 -- 172.21.15.5:0/3833142091 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8b440b0040 con 0x7f8b5c0a4db0 2024-08-18T21:13:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b537fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:13:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b537fe640 10 monclient: dump: 2024-08-18T21:13:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.062 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b537fe640 10 monclient: _finish_auth 0 2024-08-18T21:13:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b537fe640 10 monclient: _check_auth_tickets 2024-08-18T21:13:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b537fe640 1 -- 172.21.15.5:0/3833142091 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b440b9070 con 0x7f8b5c0a4db0 2024-08-18T21:13:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b613a0640 5 monclient: authenticate success, global_id 114560 2024-08-18T21:13:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b613a0640 10 monclient: _renew_subs 2024-08-18T21:13:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b613a0640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b613a0640 1 -- 172.21.15.5:0/3833142091 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5c068870 con 0x7f8b5c0a4db0 2024-08-18T21:13:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b537fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b537fe640 1 -- 172.21.15.5:0/3833142091 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8b440044b0 con 0x7f8b5c0a4db0 2024-08-18T21:13:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b537fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b597fa640 4 set_mon_vals no callback set 2024-08-18T21:13:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b537fe640 10 monclient: dump: 2024-08-18T21:13:01.063 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.064 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.065 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b613a0640 10 monclient: _renew_subs 2024-08-18T21:13:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b613a0640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:01.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b613a0640 1 -- 172.21.15.5:0/3833142091 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5c122a90 con 0x7f8b5c0a4db0 2024-08-18T21:13:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b613a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b613a0640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5c11fb50 0x7f8b5c11ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b613a0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b613a0640 1 -- 172.21.15.5:0/3833142091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c051140 con 0x7f8b5c11fb50 2024-08-18T21:13:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b5affd640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5c11fb50 0x7f8b5c11ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b5affd640 10 monclient: get_auth_request con 0x7f8b5c11fb50 auth_method 0 2024-08-18T21:13:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b5affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b5affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b5affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b5affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b5affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b5affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b537fe640 1 -- 172.21.15.5:0/3833142091 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f8b44004040 con 0x7f8b5c0a4db0 2024-08-18T21:13:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b5affd640 10 monclient(hunting): handle_auth_done global_id 124137 payload 824 2024-08-18T21:13:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b5affd640 1 -- 172.21.15.5:0/3833142091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b5c121190 con 0x7f8b5c11fb50 2024-08-18T21:13:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b537fe640 1 --2- 172.21.15.5:0/3833142091 >> v2:172.21.15.157:6812/631023601 conn(0x7f8b3c03bdc0 0x7f8b3c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b537fe640 1 -- 172.21.15.5:0/3833142091 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(261..261 src has 22..261) ==== 3898+0+0 (secure 0 0 0) 0x7f8b440e81c0 con 0x7f8b5c0a4db0 2024-08-18T21:13:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b5b7fe640 1 --2- 172.21.15.5:0/3833142091 >> v2:172.21.15.157:6812/631023601 conn(0x7f8b3c03bdc0 0x7f8b3c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.047+0000 7f8b5b7fe640 10 monclient: get_auth_request con 0x7f8b3c03bdc0 auth_method 0 2024-08-18T21:13:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.051+0000 7f8b5affd640 1 -- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5c11fb50 msgr2=0x7f8b5c11ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.051+0000 7f8b5affd640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5c11fb50 0x7f8b5c11ff30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b54007cc0 tx=0x7f8b5400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.051+0000 7f8b537fe640 1 -- 172.21.15.5:0/3833142091 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8b54014a50 con 0x7f8b5c11fb50 2024-08-18T21:13:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.051+0000 7f8b537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.051+0000 7f8b537fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:13:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.051+0000 7f8b537fe640 10 monclient: dump: 2024-08-18T21:13:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.069 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.051+0000 7f8b537fe640 1 -- 172.21.15.5:0/3833142091 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8b5401b070 con 0x7f8b5c11fb50 2024-08-18T21:13:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.051+0000 7f8b537fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.051+0000 7f8b537fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.051+0000 7f8b537fe640 1 -- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5c11fb50 msgr2=0x7f8b5c11ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.051+0000 7f8b537fe640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5c11fb50 0x7f8b5c11ff30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b54007cc0 tx=0x7f8b5400f520 comp rx=0 tx=0).stop 2024-08-18T21:13:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.051+0000 7f8b537fe640 1 -- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5c11fb50 msgr2=0x7f8b5c11ff30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:01.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.051+0000 7f8b537fe640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5c11fb50 0x7f8b5c11ff30 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b54007cc0 tx=0x7f8b5400f520 comp rx=0 tx=0).stop 2024-08-18T21:13:01.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.051+0000 7f8b5b7fe640 1 --2- 172.21.15.5:0/3833142091 >> v2:172.21.15.157:6812/631023601 conn(0x7f8b3c03bdc0 0x7f8b3c03e280 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c006fd0 tx=0x7f8b4c008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.055+0000 7f8b613a0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:01.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.055+0000 7f8b613a0640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5c120470 0x7f8b5c13bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.055+0000 7f8b613a0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.055+0000 7f8b613a0640 1 -- 172.21.15.5:0/3833142091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c069f80 con 0x7f8b5c120470 2024-08-18T21:13:01.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.055+0000 7f8b5affd640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5c120470 0x7f8b5c13bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.055+0000 7f8b5affd640 10 monclient: get_auth_request con 0x7f8b5c120470 auth_method 0 2024-08-18T21:13:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.055+0000 7f8b5affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.055+0000 7f8b5affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.055+0000 7f8b5affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.055+0000 7f8b5affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.055+0000 7f8b5affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.055+0000 7f8b5affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.055+0000 7f8b5affd640 10 monclient(hunting): handle_auth_done global_id 124146 payload 824 2024-08-18T21:13:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.055+0000 7f8b5affd640 1 -- 172.21.15.5:0/3833142091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8b5c13fdf0 con 0x7f8b5c120470 2024-08-18T21:13:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b5affd640 1 -- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5c120470 msgr2=0x7f8b5c13bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b5affd640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5c120470 0x7f8b5c13bba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8b5401a000 tx=0x7f8b54004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b537fe640 1 -- 172.21.15.5:0/3833142091 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8b54003e10 con 0x7f8b5c120470 2024-08-18T21:13:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b537fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:13:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b537fe640 10 monclient: dump: 2024-08-18T21:13:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.078 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b537fe640 1 -- 172.21.15.5:0/3833142091 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9249 (secure 0 0 0) 0x7f8b540147f0 con 0x7f8b5c120470 2024-08-18T21:13:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b537fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b537fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b537fe640 1 -- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5c120470 msgr2=0x7f8b5c13bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b537fe640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5c120470 0x7f8b5c13bba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8b5401a000 tx=0x7f8b54004a50 comp rx=0 tx=0).stop 2024-08-18T21:13:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b537fe640 1 -- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5c120470 msgr2=0x7f8b5c13bba0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b537fe640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5c120470 0x7f8b5c13bba0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8b5401a000 tx=0x7f8b54004a50 comp rx=0 tx=0).stop 2024-08-18T21:13:01.079 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:13:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 28039, 2024-08-18T21:13:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:01.079 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:13:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:01.080 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:01.081 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:01.083 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:01.084 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:01.085 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.086 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.088 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.089 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:01.092 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.093 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:01.096 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.097 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:01.098 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:01.098 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.098 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.098 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:01.099 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:01.099 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.099 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.099 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.099 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:01.099 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:01.099 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:01.100 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.100 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.100 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:01.100 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.100 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.100 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.100 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:01.100 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:01.100 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.100 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.101 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.101 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.101 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.101 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:01.101 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:01.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.101 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:01.101 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:01.101 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:01.101 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.101 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.101 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:01.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.102 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:01.102 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:01.102 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:01.102 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.102 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.102 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:01.102 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:01.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b613a0640 1 -- 172.21.15.5:0/3833142091 >> v2:172.21.15.157:6812/631023601 conn(0x7f8b3c03bdc0 msgr2=0x7f8b3c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b613a0640 1 --2- 172.21.15.5:0/3833142091 >> v2:172.21.15.157:6812/631023601 conn(0x7f8b3c03bdc0 0x7f8b3c03e280 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c006fd0 tx=0x7f8b4c008040 comp rx=0 tx=0).stop 2024-08-18T21:13:01.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b613a0640 10 monclient: shutdown 2024-08-18T21:13:01.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b613a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:01.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b613a0640 1 -- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8b5c0a4db0 msgr2=0x7f8b5c137710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b613a0640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8b5c0a4db0 0x7f8b5c137710 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8b4401c190 tx=0x7f8b44019100 comp rx=0 tx=0).stop 2024-08-18T21:13:01.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b5b7fe640 1 -- 172.21.15.5:0/3833142091 reap_dead start 2024-08-18T21:13:01.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b613a0640 1 -- 172.21.15.5:0/3833142091 shutdown_connections 2024-08-18T21:13:01.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b613a0640 1 --2- 172.21.15.5:0/3833142091 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8b5c0a4db0 0x7f8b5c137710 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b613a0640 1 -- 172.21.15.5:0/3833142091 >> 172.21.15.5:0/3833142091 conn(0x7f8b5c0a65f0 msgr2=0x7f8b5c0a6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:01.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b613a0640 1 -- 172.21.15.5:0/3833142091 shutdown_connections 2024-08-18T21:13:01.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.059+0000 7f8b613a0640 1 -- 172.21.15.5:0/3833142091 wait complete. 2024-08-18T21:13:01.105 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:01.105 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:13:01.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:13:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 10 monclient: get_monmap_and_config 2024-08-18T21:13:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 10 monclient: build_initial_monmap 2024-08-18T21:13:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 10 monclient: monmap: 2024-08-18T21:13:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:01.228664+0000 2024-08-18T21:13:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:01.228664+0000 2024-08-18T21:13:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:01.225 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:01.226 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 1 Processor -- start 2024-08-18T21:13:01.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 1 -- start start 2024-08-18T21:13:01.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 10 monclient: init 2024-08-18T21:13:01.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:01.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 10 monclient: _add_conns ranks=[7,8,4,5,3,6,0,9,2,1,10] 2024-08-18T21:13:01.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5f640a6bd0 0x7f5f640a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 10 monclient(hunting): picked mon.noname-i con 0x7f5f640a6bd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:01.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f6409f080 0x7f5f640a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 10 monclient(hunting): picked mon.noname-e con 0x7f5f6409f080 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:01.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5f64139990 0x7f5f64139df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 10 monclient(hunting): picked mon.noname-c con 0x7f5f64139990 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:13:01.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f5f6409e4c0 con 0x7f5f64139990 2024-08-18T21:13:01.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f5f6406f930 con 0x7f5f640a6bd0 2024-08-18T21:13:01.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f5f640a7a30 con 0x7f5f6409f080 2024-08-18T21:13:01.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:01.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f6a13d640 10 monclient(hunting): authenticate will time out at 1548.242077s 2024-08-18T21:13:01.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f62ffd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f6409f080 0x7f5f640a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f62ffd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f6409f080 0x7f5f640a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:53704/0 (socket says 172.21.15.5:53704) 2024-08-18T21:13:01.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f62ffd640 1 -- 172.21.15.5:0/343659395 learned_addr learned my addr 172.21.15.5:0/343659395 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:01.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 1 --2- 172.21.15.5:0/343659395 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5f64139990 0x7f5f64139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f62ffd640 10 monclient(hunting): get_auth_request con 0x7f5f6409f080 auth_method 0 2024-08-18T21:13:01.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f62ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f62ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f62ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 10 monclient(hunting): get_auth_request con 0x7f5f64139990 auth_method 0 2024-08-18T21:13:01.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f62ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f62ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f62ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f637fe640 1 --2- 172.21.15.5:0/343659395 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5f640a6bd0 0x7f5f640a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f637fe640 10 monclient(hunting): get_auth_request con 0x7f5f640a6bd0 auth_method 0 2024-08-18T21:13:01.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f637fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f637fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 10 monclient(hunting): handle_auth_done global_id 114394 payload 274 2024-08-18T21:13:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 1 -- 172.21.15.5:0/343659395 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f6409f080 msgr2=0x7f5f640a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 1 --2- 172.21.15.5:0/343659395 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f6409f080 0x7f5f640a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 1 -- 172.21.15.5:0/343659395 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5f640a6bd0 msgr2=0x7f5f640a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 1 --2- 172.21.15.5:0/343659395 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5f640a6bd0 0x7f5f640a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 10 monclient: _finish_hunting 0 2024-08-18T21:13:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 1 monclient: found mon.noname-c 2024-08-18T21:13:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:13:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f63fff640 1 -- 172.21.15.5:0/343659395 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f640a7fb0 con 0x7f5f64139990 2024-08-18T21:13:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.227+0000 7f5f62ffd640 1 --2- 172.21.15.5:0/343659395 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f6409f080 0x7f5f640a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f63fff640 1 -- 172.21.15.5:0/343659395 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5f64139990 msgr2=0x7f5f64139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f63fff640 1 --2- 172.21.15.5:0/343659395 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5f64139990 0x7f5f64139df0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0097f0 tx=0x7f5f5c01c3a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=d1fa078b2425b70d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f627fc640 1 -- 172.21.15.5:0/343659395 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f5c0b0070 con 0x7f5f64139990 2024-08-18T21:13:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f627fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:13:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f627fc640 10 monclient: dump: 2024-08-18T21:13:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.241 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f627fc640 10 monclient: _finish_auth 0 2024-08-18T21:13:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f627fc640 10 monclient: _check_auth_tickets 2024-08-18T21:13:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f627fc640 1 -- 172.21.15.5:0/343659395 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f5c0aa810 con 0x7f5f64139990 2024-08-18T21:13:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f6a13d640 5 monclient: authenticate success, global_id 114394 2024-08-18T21:13:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f6a13d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:13:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f627fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f6a13d640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f627fc640 1 -- 172.21.15.5:0/343659395 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f5c0a4e60 con 0x7f5f64139990 2024-08-18T21:13:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f6a13d640 4 set_mon_vals no callback set 2024-08-18T21:13:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f627fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:13:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f627fc640 10 monclient: dump: 2024-08-18T21:13:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.243 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f6a13d640 10 monclient: shutdown 2024-08-18T21:13:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f6a13d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f6a13d640 1 -- 172.21.15.5:0/343659395 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5f64139990 msgr2=0x7f5f64139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f6a13d640 1 --2- 172.21.15.5:0/343659395 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5f64139990 0x7f5f64139df0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0097f0 tx=0x7f5f5c01c3a0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f6a13d640 1 -- 172.21.15.5:0/343659395 shutdown_connections 2024-08-18T21:13:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f6a13d640 1 --2- 172.21.15.5:0/343659395 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5f64139990 0x7f5f64139df0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f6a13d640 1 --2- 172.21.15.5:0/343659395 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f6409f080 0x7f5f640a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f6a13d640 1 --2- 172.21.15.5:0/343659395 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5f640a6bd0 0x7f5f640a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f6a13d640 1 -- 172.21.15.5:0/343659395 >> 172.21.15.5:0/343659395 conn(0x7f5f64068700 msgr2=0x7f5f64068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f6a13d640 1 -- 172.21.15.5:0/343659395 shutdown_connections 2024-08-18T21:13:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.231+0000 7f5f6a13d640 1 -- 172.21.15.5:0/343659395 wait complete. 2024-08-18T21:13:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 10 monclient: build_initial_monmap 2024-08-18T21:13:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 10 monclient: monmap: 2024-08-18T21:13:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:01.245 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:01.246 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:01.246 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 1 Processor -- start 2024-08-18T21:13:01.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 1 -- start start 2024-08-18T21:13:01.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 10 monclient: init 2024-08-18T21:13:01.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:01.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 10 monclient: _add_conns ranks=[6,1,8,0,3,5,4,2,7] 2024-08-18T21:13:01.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5f6409f080 0x7f5f64138150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 10 monclient(hunting): picked mon.noname-d con 0x7f5f6409f080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:01.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f640a6bd0 0x7f5f64138690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 10 monclient(hunting): picked mon.noname-f con 0x7f5f640a6bd0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:13:01.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f64139990 0x7f5f6413d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 10 monclient(hunting): picked mon.noname-e con 0x7f5f64139990 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5f640a89f0 con 0x7f5f640a6bd0 2024-08-18T21:13:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f5f640a7ce0 con 0x7f5f6409f080 2024-08-18T21:13:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f5f64143610 con 0x7f5f64139990 2024-08-18T21:13:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f6a13d640 10 monclient(hunting): authenticate will time out at 1548.249294s 2024-08-18T21:13:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5f6409f080 0x7f5f64138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f63fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f64139990 0x7f5f6413d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5f6409f080 0x7f5f64138150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:41534/0 (socket says 172.21.15.5:41534) 2024-08-18T21:13:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 1 -- 172.21.15.5:0/656809340 learned_addr learned my addr 172.21.15.5:0/656809340 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 10 monclient(hunting): get_auth_request con 0x7f5f6409f080 auth_method 0 2024-08-18T21:13:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f63fff640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f64139990 0x7f5f6413d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:53706/0 (socket says 172.21.15.5:53706) 2024-08-18T21:13:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f63fff640 10 monclient(hunting): get_auth_request con 0x7f5f64139990 auth_method 0 2024-08-18T21:13:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f63fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f63fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f62ffd640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f640a6bd0 0x7f5f64138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f62ffd640 10 monclient(hunting): get_auth_request con 0x7f5f640a6bd0 auth_method 0 2024-08-18T21:13:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f62ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f62ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f62ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 10 monclient(hunting): handle_auth_done global_id 85623 payload 824 2024-08-18T21:13:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 1 -- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f64139990 msgr2=0x7f5f6413d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f64139990 0x7f5f6413d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 1 -- 172.21.15.5:0/656809340 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f640a6bd0 msgr2=0x7f5f64138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f640a6bd0 0x7f5f64138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 10 monclient: _finish_hunting 0 2024-08-18T21:13:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 1 monclient: found mon.noname-d 2024-08-18T21:13:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:13:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f637fe640 1 -- 172.21.15.5:0/656809340 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f640ab050 con 0x7f5f6409f080 2024-08-18T21:13:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.235+0000 7f5f63fff640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f64139990 0x7f5f6413d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f637fe640 1 -- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5f6409f080 msgr2=0x7f5f64138150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f637fe640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5f6409f080 0x7f5f64138150 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400d800 tx=0x7f5f5400dcc0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f4bfff640 1 -- 172.21.15.5:0/656809340 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f5400bd40 con 0x7f5f6409f080 2024-08-18T21:13:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f4bfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:13:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f4bfff640 10 monclient: dump: 2024-08-18T21:13:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.252 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f4bfff640 10 monclient: _finish_auth 0 2024-08-18T21:13:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f4bfff640 10 monclient: _check_auth_tickets 2024-08-18T21:13:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f4bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f4bfff640 1 -- 172.21.15.5:0/656809340 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f54019070 con 0x7f5f6409f080 2024-08-18T21:13:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f6a13d640 5 monclient: authenticate success, global_id 85623 2024-08-18T21:13:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f6a13d640 10 monclient: _renew_subs 2024-08-18T21:13:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f6a13d640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:13:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f6a13d640 1 -- 172.21.15.5:0/656809340 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f64124190 con 0x7f5f6409f080 2024-08-18T21:13:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f4bfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f4bfff640 1 -- 172.21.15.5:0/656809340 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f540148a0 con 0x7f5f6409f080 2024-08-18T21:13:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f4bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:13:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f4bfff640 10 monclient: dump: 2024-08-18T21:13:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.254 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f61ffb640 4 set_mon_vals no callback set 2024-08-18T21:13:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f6a13d640 10 monclient: _renew_subs 2024-08-18T21:13:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f6a13d640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:13:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f6a13d640 1 -- 172.21.15.5:0/656809340 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f64123eb0 con 0x7f5f6409f080 2024-08-18T21:13:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f6a13d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f6a13d640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f6413de70 0x7f5f6413e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f6a13d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f6a13d640 1 -- 172.21.15.5:0/656809340 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f5f64051140 con 0x7f5f6413de70 2024-08-18T21:13:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f62ffd640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f6413de70 0x7f5f6413e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f62ffd640 10 monclient: get_auth_request con 0x7f5f6413de70 auth_method 0 2024-08-18T21:13:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f62ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f62ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f62ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f62ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f62ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f4bfff640 1 -- 172.21.15.5:0/656809340 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f5f54014430 con 0x7f5f6409f080 2024-08-18T21:13:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f62ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f62ffd640 10 monclient(hunting): handle_auth_done global_id 114392 payload 824 2024-08-18T21:13:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f62ffd640 1 -- 172.21.15.5:0/656809340 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f64139df0 con 0x7f5f6413de70 2024-08-18T21:13:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f4bfff640 1 --2- 172.21.15.5:0/656809340 >> v2:172.21.15.157:6812/631023601 conn(0x7f5f5003bdc0 0x7f5f5003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f4bfff640 1 -- 172.21.15.5:0/656809340 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(261..261 src has 22..261) ==== 3898+0+0 (secure 0 0 0) 0x7f5f5400f040 con 0x7f5f6409f080 2024-08-18T21:13:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f63fff640 1 --2- 172.21.15.5:0/656809340 >> v2:172.21.15.157:6812/631023601 conn(0x7f5f5003bdc0 0x7f5f5003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.239+0000 7f5f63fff640 10 monclient: get_auth_request con 0x7f5f5003bdc0 auth_method 0 2024-08-18T21:13:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.243+0000 7f5f62ffd640 1 -- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f6413de70 msgr2=0x7f5f6413e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.243+0000 7f5f62ffd640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f6413de70 0x7f5f6413e250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5f6413fa90 tx=0x7f5f58010510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.243+0000 7f5f4bfff640 1 -- 172.21.15.5:0/656809340 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f58010e20 con 0x7f5f6413de70 2024-08-18T21:13:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.243+0000 7f5f4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.243+0000 7f5f4bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.243+0000 7f5f4bfff640 10 monclient: dump: 2024-08-18T21:13:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.260 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.243+0000 7f5f4bfff640 1 -- 172.21.15.5:0/656809340 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5f5801c070 con 0x7f5f6413de70 2024-08-18T21:13:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.243+0000 7f5f4bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.243+0000 7f5f4bfff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.243+0000 7f5f4bfff640 1 -- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f6413de70 msgr2=0x7f5f6413e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.243+0000 7f5f4bfff640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f6413de70 0x7f5f6413e250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5f6413fa90 tx=0x7f5f58010510 comp rx=0 tx=0).stop 2024-08-18T21:13:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.243+0000 7f5f4bfff640 1 -- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f6413de70 msgr2=0x7f5f6413e250 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.243+0000 7f5f4bfff640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f6413de70 0x7f5f6413e250 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5f6413fa90 tx=0x7f5f58010510 comp rx=0 tx=0).stop 2024-08-18T21:13:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.243+0000 7f5f63fff640 1 --2- 172.21.15.5:0/656809340 >> v2:172.21.15.157:6812/631023601 conn(0x7f5f5003bdc0 0x7f5f5003e280 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0ab000 tx=0x7f5f5c0a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.247+0000 7f5f6a13d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.247+0000 7f5f6a13d640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f6413e790 0x7f5f640a4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.247+0000 7f5f6a13d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.247+0000 7f5f6a13d640 1 -- 172.21.15.5:0/656809340 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f5f640ab4f0 con 0x7f5f6413e790 2024-08-18T21:13:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.247+0000 7f5f62ffd640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f6413e790 0x7f5f640a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.247+0000 7f5f62ffd640 10 monclient: get_auth_request con 0x7f5f6413e790 auth_method 0 2024-08-18T21:13:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.247+0000 7f5f62ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.247+0000 7f5f62ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.247+0000 7f5f62ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.247+0000 7f5f62ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.247+0000 7f5f62ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.247+0000 7f5f62ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.247+0000 7f5f62ffd640 10 monclient(hunting): handle_auth_done global_id 114401 payload 824 2024-08-18T21:13:01.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.247+0000 7f5f62ffd640 1 -- 172.21.15.5:0/656809340 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5f64122e40 con 0x7f5f6413e790 2024-08-18T21:13:01.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f62ffd640 1 -- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f6413e790 msgr2=0x7f5f640a4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f62ffd640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f6413e790 0x7f5f640a4160 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f5801b000 tx=0x7f5f58004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f4bfff640 1 -- 172.21.15.5:0/656809340 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f58021c30 con 0x7f5f6413e790 2024-08-18T21:13:01.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f4bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:01.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f4bfff640 10 monclient: dump: 2024-08-18T21:13:01.262 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.262 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.263 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f4bfff640 1 -- 172.21.15.5:0/656809340 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f5f580293e0 con 0x7f5f6413e790 2024-08-18T21:13:01.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f4bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:01.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f4bfff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:01.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f4bfff640 1 -- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f6413e790 msgr2=0x7f5f640a4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f4bfff640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f6413e790 0x7f5f640a4160 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f5801b000 tx=0x7f5f58004a50 comp rx=0 tx=0).stop 2024-08-18T21:13:01.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f4bfff640 1 -- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f6413e790 msgr2=0x7f5f640a4160 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:01.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f4bfff640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f6413e790 0x7f5f640a4160 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f5801b000 tx=0x7f5f58004a50 comp rx=0 tx=0).stop 2024-08-18T21:13:01.264 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 86407, 2024-08-18T21:13:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:01.265 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:13:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:01.266 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:01.267 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:01.268 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:01.269 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:01.270 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:01.271 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.272 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:01.273 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.274 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.274 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.274 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:01.274 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:01.274 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.274 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.274 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.274 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:01.274 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:01.275 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.275 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.275 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.275 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:01.277 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.278 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.278 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:01.278 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.278 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.278 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.278 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:01.278 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:01.278 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.278 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.278 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.279 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:01.279 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:01.279 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.279 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.279 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.279 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:01.279 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.279 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.280 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:01.280 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.280 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.280 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.280 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:01.280 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:01.280 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.280 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.280 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:01.280 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:01.280 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.281 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.281 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.281 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:01.281 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.281 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.281 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:01.281 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.281 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.281 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.282 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:01.282 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:01.282 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.282 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.282 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.282 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:01.282 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:01.282 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.282 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.283 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.283 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:01.283 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.283 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.283 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.283 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:01.283 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.283 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.283 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.283 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:01.283 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:01.283 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.284 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.284 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.284 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:01.284 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:01.284 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.284 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.284 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:01.284 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.285 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.285 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:01.285 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.285 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.285 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.285 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:01.285 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:01.285 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.285 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.285 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:01.286 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:01.286 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.286 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.286 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.286 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:01.286 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.286 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.286 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:01.286 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.287 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.287 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.287 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:01.287 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:01.287 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.287 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.287 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.287 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:01.287 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:01.287 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.287 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.288 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.288 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:01.288 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.288 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.288 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:01.288 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.288 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.288 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.289 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:01.289 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:01.289 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.289 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.289 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.289 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.289 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.289 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:01.289 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:01.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.289 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:01.289 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:01.290 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:01.290 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.290 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.290 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:13:01.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.290 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:01.290 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:01.290 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:13:01.290 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.290 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.290 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:01.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.291 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:01.291 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:01.291 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:13:01.291 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.291 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.291 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:01.291 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:01.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f6a13d640 1 -- 172.21.15.5:0/656809340 >> v2:172.21.15.157:6812/631023601 conn(0x7f5f5003bdc0 msgr2=0x7f5f5003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f6a13d640 1 --2- 172.21.15.5:0/656809340 >> v2:172.21.15.157:6812/631023601 conn(0x7f5f5003bdc0 0x7f5f5003e280 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0ab000 tx=0x7f5f5c0a6000 comp rx=0 tx=0).stop 2024-08-18T21:13:01.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f6a13d640 10 monclient: shutdown 2024-08-18T21:13:01.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f6a13d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:01.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f6a13d640 1 -- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5f6409f080 msgr2=0x7f5f64138150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f6a13d640 1 --2- 172.21.15.5:0/656809340 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5f6409f080 0x7f5f64138150 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400d800 tx=0x7f5f5400dcc0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f63fff640 1 -- 172.21.15.5:0/656809340 reap_dead start 2024-08-18T21:13:01.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f63fff640 1 -- 172.21.15.5:0/656809340 reap_dead start 2024-08-18T21:13:01.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f6a13d640 1 -- 172.21.15.5:0/656809340 shutdown_connections 2024-08-18T21:13:01.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f6a13d640 1 -- 172.21.15.5:0/656809340 >> 172.21.15.5:0/656809340 conn(0x7f5f64068700 msgr2=0x7f5f640ab9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:01.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f6a13d640 1 -- 172.21.15.5:0/656809340 shutdown_connections 2024-08-18T21:13:01.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.251+0000 7f5f6a13d640 1 -- 172.21.15.5:0/656809340 wait complete. 2024-08-18T21:13:01.293 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:01.294 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:13:01.294 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:13:01.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.415+0000 7fb1ca98f640 10 monclient: get_monmap_and_config 2024-08-18T21:13:01.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.415+0000 7fb1ca98f640 10 monclient: build_initial_monmap 2024-08-18T21:13:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 10 monclient: monmap: 2024-08-18T21:13:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:01.420411+0000 2024-08-18T21:13:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:01.420411+0000 2024-08-18T21:13:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:01.418 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 1 Processor -- start 2024-08-18T21:13:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 1 -- start start 2024-08-18T21:13:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 10 monclient: init 2024-08-18T21:13:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 10 monclient: _add_conns ranks=[7,6,8,1,0,4,5,9,2,3,10] 2024-08-18T21:13:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb1c40a6ce0 0x7fb1c40a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 10 monclient(hunting): picked mon.noname-i con 0x7fb1c40a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb1c40a7600 0x7fb1c4139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 10 monclient(hunting): picked mon.noname-d con 0x7fb1c40a7600 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb1c4139fe0 0x7fb1c413a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 10 monclient(hunting): picked mon.noname-e con 0x7fb1c4139fe0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fb1c40a5000 con 0x7fb1c40a7600 2024-08-18T21:13:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fb1c40a4360 con 0x7fb1c40a6ce0 2024-08-18T21:13:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fb1c40a45d0 con 0x7fb1c4139fe0 2024-08-18T21:13:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1ca98f640 10 monclient(hunting): authenticate will time out at 1548.433641s 2024-08-18T21:13:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb1c4139fe0 0x7fb1c413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c37fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb1c40a7600 0x7fb1c4139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb1c4139fe0 0x7fb1c413a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:53712/0 (socket says 172.21.15.5:53712) 2024-08-18T21:13:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 1 -- 172.21.15.5:0/4257212703 learned_addr learned my addr 172.21.15.5:0/4257212703 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 10 monclient(hunting): get_auth_request con 0x7fb1c4139fe0 auth_method 0 2024-08-18T21:13:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c37fe640 10 monclient(hunting): get_auth_request con 0x7fb1c40a7600 auth_method 0 2024-08-18T21:13:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c3fff640 1 --2- 172.21.15.5:0/4257212703 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb1c40a6ce0 0x7fb1c40a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c3fff640 10 monclient(hunting): get_auth_request con 0x7fb1c40a6ce0 auth_method 0 2024-08-18T21:13:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 10 monclient(hunting): handle_auth_done global_id 114587 payload 274 2024-08-18T21:13:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 1 -- 172.21.15.5:0/4257212703 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb1c40a6ce0 msgr2=0x7fb1c40a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 1 --2- 172.21.15.5:0/4257212703 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb1c40a6ce0 0x7fb1c40a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 1 -- 172.21.15.5:0/4257212703 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb1c40a7600 msgr2=0x7fb1c4139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 1 --2- 172.21.15.5:0/4257212703 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb1c40a7600 0x7fb1c4139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 10 monclient: _finish_hunting 0 2024-08-18T21:13:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 1 monclient: found mon.noname-e 2024-08-18T21:13:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:13:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c8f2c640 1 -- 172.21.15.5:0/4257212703 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c40a32d0 con 0x7fb1c4139fe0 2024-08-18T21:13:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.419+0000 7fb1c37fe640 1 --2- 172.21.15.5:0/4257212703 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb1c40a7600 0x7fb1c4139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1c8f2c640 1 -- 172.21.15.5:0/4257212703 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb1c4139fe0 msgr2=0x7fb1c413a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1c8f2c640 1 --2- 172.21.15.5:0/4257212703 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb1c4139fe0 0x7fb1c413a440 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009eb0 tx=0x7fb1bc01c8f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=2cf8c7e34e33e3b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1c2ffd640 1 -- 172.21.15.5:0/4257212703 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb1bc0090d0 con 0x7fb1c4139fe0 2024-08-18T21:13:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1c2ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:13:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1c2ffd640 10 monclient: dump: 2024-08-18T21:13:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.433 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1c2ffd640 10 monclient: _finish_auth 0 2024-08-18T21:13:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1c2ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:13:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1c2ffd640 1 -- 172.21.15.5:0/4257212703 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1bc0a5a30 con 0x7fb1c4139fe0 2024-08-18T21:13:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1ca98f640 5 monclient: authenticate success, global_id 114587 2024-08-18T21:13:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1ca98f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:13:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1c2ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1ca98f640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1c2ffd640 1 -- 172.21.15.5:0/4257212703 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb1bc0a5be0 con 0x7fb1c4139fe0 2024-08-18T21:13:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1ca98f640 4 set_mon_vals no callback set 2024-08-18T21:13:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1c2ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1c2ffd640 10 monclient: dump: 2024-08-18T21:13:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.435 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1ca98f640 10 monclient: shutdown 2024-08-18T21:13:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1ca98f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1ca98f640 1 -- 172.21.15.5:0/4257212703 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb1c4139fe0 msgr2=0x7fb1c413a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1ca98f640 1 --2- 172.21.15.5:0/4257212703 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb1c4139fe0 0x7fb1c413a440 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009eb0 tx=0x7fb1bc01c8f0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1ca98f640 1 -- 172.21.15.5:0/4257212703 shutdown_connections 2024-08-18T21:13:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1ca98f640 1 --2- 172.21.15.5:0/4257212703 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb1c4139fe0 0x7fb1c413a440 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1ca98f640 1 --2- 172.21.15.5:0/4257212703 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb1c40a7600 0x7fb1c4139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1ca98f640 1 --2- 172.21.15.5:0/4257212703 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb1c40a6ce0 0x7fb1c40a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1ca98f640 1 -- 172.21.15.5:0/4257212703 >> 172.21.15.5:0/4257212703 conn(0x7fb1c40acbc0 msgr2=0x7fb1c40a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1ca98f640 1 -- 172.21.15.5:0/4257212703 shutdown_connections 2024-08-18T21:13:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1ca98f640 1 -- 172.21.15.5:0/4257212703 wait complete. 2024-08-18T21:13:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.423+0000 7fb1ca98f640 10 monclient: build_initial_monmap 2024-08-18T21:13:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 10 monclient: monmap: 2024-08-18T21:13:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:01.437 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 1 Processor -- start 2024-08-18T21:13:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 1 -- start start 2024-08-18T21:13:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 10 monclient: init 2024-08-18T21:13:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 10 monclient: _add_conns ranks=[5,7,0,8,1,4,6,2,3] 2024-08-18T21:13:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb1c40a6ce0 0x7fb1c41d1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 10 monclient(hunting): picked mon.noname-h con 0x7fb1c40a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb1c40a7600 0x7fb1c413fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 10 monclient(hunting): picked mon.noname-i con 0x7fb1c40a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4139fe0 0x7fb1c41402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 10 monclient(hunting): picked mon.noname-a con 0x7fb1c4139fe0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:13:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c40a79e0 con 0x7fb1c4139fe0 2024-08-18T21:13:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fb1c40a8220 con 0x7fb1c40a6ce0 2024-08-18T21:13:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fb1c4140820 con 0x7fb1c40a7600 2024-08-18T21:13:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1ca98f640 10 monclient(hunting): authenticate will time out at 1548.440983s 2024-08-18T21:13:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4139fe0 0x7fb1c41402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4139fe0 0x7fb1c41402e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43428/0 (socket says 172.21.15.5:43428) 2024-08-18T21:13:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 1 -- 172.21.15.5:0/2224448243 learned_addr learned my addr 172.21.15.5:0/2224448243 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 10 monclient(hunting): get_auth_request con 0x7fb1c4139fe0 auth_method 0 2024-08-18T21:13:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c3fff640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb1c40a6ce0 0x7fb1c41d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c37fe640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb1c40a7600 0x7fb1c413fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c3fff640 10 monclient(hunting): get_auth_request con 0x7fb1c40a6ce0 auth_method 0 2024-08-18T21:13:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c37fe640 10 monclient(hunting): get_auth_request con 0x7fb1c40a7600 auth_method 0 2024-08-18T21:13:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 10 monclient(hunting): handle_auth_done global_id 124155 payload 824 2024-08-18T21:13:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 1 -- 172.21.15.5:0/2224448243 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb1c40a7600 msgr2=0x7fb1c413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fb1c40a7600 0x7fb1c413fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 1 -- 172.21.15.5:0/2224448243 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb1c40a6ce0 msgr2=0x7fb1c41d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb1c40a6ce0 0x7fb1c41d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 10 monclient: _finish_hunting 0 2024-08-18T21:13:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 1 monclient: found mon.noname-a 2024-08-18T21:13:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:13:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 1 -- 172.21.15.5:0/2224448243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c41d1ad0 con 0x7fb1c4139fe0 2024-08-18T21:13:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c3fff640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb1c40a6ce0 0x7fb1c41d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:13:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 1 -- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4139fe0 msgr2=0x7fb1c41402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.427+0000 7fb1c8f2c640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4139fe0 0x7fb1c41402e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0af040 tx=0x7fb1bc019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c0ff9640 1 -- 172.21.15.5:0/2224448243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb1bc0bc020 con 0x7fb1c4139fe0 2024-08-18T21:13:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:13:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c0ff9640 10 monclient: dump: 2024-08-18T21:13:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.443 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c0ff9640 10 monclient: _finish_auth 0 2024-08-18T21:13:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c0ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:13:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c0ff9640 1 -- 172.21.15.5:0/2224448243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1bc0a5870 con 0x7fb1c4139fe0 2024-08-18T21:13:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1ca98f640 5 monclient: authenticate success, global_id 124155 2024-08-18T21:13:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1ca98f640 10 monclient: _renew_subs 2024-08-18T21:13:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1ca98f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:13:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1ca98f640 1 -- 172.21.15.5:0/2224448243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c413d420 con 0x7fb1c4139fe0 2024-08-18T21:13:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c0ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c0ff9640 1 -- 172.21.15.5:0/2224448243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb1bc003dc0 con 0x7fb1c4139fe0 2024-08-18T21:13:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:13:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c0ff9640 10 monclient: dump: 2024-08-18T21:13:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.446 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1ca98f640 10 monclient: _renew_subs 2024-08-18T21:13:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c27fc640 4 set_mon_vals no callback set 2024-08-18T21:13:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1ca98f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:13:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1ca98f640 1 -- 172.21.15.5:0/2224448243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c413e870 con 0x7fb1c4139fe0 2024-08-18T21:13:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1ca98f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1ca98f640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb1c413b270 0x7fb1c402d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1ca98f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1ca98f640 1 -- 172.21.15.5:0/2224448243 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fb1c40a7b60 con 0x7fb1c413b270 2024-08-18T21:13:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c3fff640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb1c413b270 0x7fb1c402d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c3fff640 10 monclient: get_auth_request con 0x7fb1c413b270 auth_method 0 2024-08-18T21:13:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c0ff9640 1 -- 172.21.15.5:0/2224448243 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fb1bc0bf020 con 0x7fb1c4139fe0 2024-08-18T21:13:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c0ff9640 1 --2- 172.21.15.5:0/2224448243 >> v2:172.21.15.157:6812/631023601 conn(0x7fb1b003bdc0 0x7fb1b003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c3fff640 10 monclient(hunting): handle_auth_done global_id 114403 payload 824 2024-08-18T21:13:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c3fff640 1 -- 172.21.15.5:0/2224448243 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb1c40aa4c0 con 0x7fb1c413b270 2024-08-18T21:13:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c0ff9640 1 -- 172.21.15.5:0/2224448243 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(261..261 src has 22..261) ==== 3898+0+0 (secure 0 0 0) 0x7fb1bc0b3040 con 0x7fb1c4139fe0 2024-08-18T21:13:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c37fe640 1 --2- 172.21.15.5:0/2224448243 >> v2:172.21.15.157:6812/631023601 conn(0x7fb1b003bdc0 0x7fb1b003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c37fe640 10 monclient: get_auth_request con 0x7fb1b003bdc0 auth_method 0 2024-08-18T21:13:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c3fff640 1 -- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb1c413b270 msgr2=0x7fb1c402d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.431+0000 7fb1c3fff640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb1c413b270 0x7fb1c402d1d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400f420 tx=0x7fb1b400f8e0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.435+0000 7fb1c0ff9640 1 -- 172.21.15.5:0/2224448243 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb1b4018020 con 0x7fb1c413b270 2024-08-18T21:13:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.435+0000 7fb1c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.435+0000 7fb1c0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:13:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.435+0000 7fb1c0ff9640 10 monclient: dump: 2024-08-18T21:13:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.451 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.435+0000 7fb1c0ff9640 1 -- 172.21.15.5:0/2224448243 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb1b4014880 con 0x7fb1c413b270 2024-08-18T21:13:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.435+0000 7fb1c0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.435+0000 7fb1c0ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.435+0000 7fb1c0ff9640 1 -- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb1c413b270 msgr2=0x7fb1c402d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.435+0000 7fb1c0ff9640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb1c413b270 0x7fb1c402d1d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400f420 tx=0x7fb1b400f8e0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.435+0000 7fb1c0ff9640 1 -- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb1c413b270 msgr2=0x7fb1c402d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.435+0000 7fb1c0ff9640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb1c413b270 0x7fb1c402d1d0 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400f420 tx=0x7fb1b400f8e0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.435+0000 7fb1c37fe640 1 --2- 172.21.15.5:0/2224448243 >> v2:172.21.15.157:6812/631023601 conn(0x7fb1b003bdc0 0x7fb1b003e280 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb1c413cb80 tx=0x7fb1b8008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.439+0000 7fb1ca98f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.439+0000 7fb1ca98f640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb1c413b650 0x7fb1c402d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.439+0000 7fb1ca98f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.439+0000 7fb1ca98f640 1 -- 172.21.15.5:0/2224448243 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fb1c4051140 con 0x7fb1c413b650 2024-08-18T21:13:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.439+0000 7fb1c3fff640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb1c413b650 0x7fb1c402d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.439+0000 7fb1c3fff640 10 monclient: get_auth_request con 0x7fb1c413b650 auth_method 0 2024-08-18T21:13:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.439+0000 7fb1c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.439+0000 7fb1c3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.439+0000 7fb1c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.439+0000 7fb1c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.439+0000 7fb1c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.439+0000 7fb1c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.439+0000 7fb1c3fff640 10 monclient(hunting): handle_auth_done global_id 114412 payload 824 2024-08-18T21:13:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.439+0000 7fb1c3fff640 1 -- 172.21.15.5:0/2224448243 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb1c4139aa0 con 0x7fb1c413b650 2024-08-18T21:13:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1c3fff640 1 -- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb1c413b650 msgr2=0x7fb1c402d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1c3fff640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb1c413b650 0x7fb1c402d710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400f420 tx=0x7fb1b40046d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1c0ff9640 1 -- 172.21.15.5:0/2224448243 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb1b4018040 con 0x7fb1c413b650 2024-08-18T21:13:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1c0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:13:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1c0ff9640 10 monclient: dump: 2024-08-18T21:13:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.455 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1c0ff9640 1 -- 172.21.15.5:0/2224448243 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7fb1b401d420 con 0x7fb1c413b650 2024-08-18T21:13:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1c0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1c0ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1c0ff9640 1 -- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb1c413b650 msgr2=0x7fb1c402d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1c0ff9640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb1c413b650 0x7fb1c402d710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400f420 tx=0x7fb1b40046d0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1c0ff9640 1 -- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb1c413b650 msgr2=0x7fb1c402d710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1c0ff9640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb1c413b650 0x7fb1c402d710 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400f420 tx=0x7fb1b40046d0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.456 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:01.456 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:01.456 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:01.456 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:01.456 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:01.456 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 86603, 2024-08-18T21:13:01.456 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:01.456 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:01.456 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:01.456 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:01.456 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:01.457 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:01.457 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:01.457 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:01.457 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:01.457 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:01.457 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.457 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:13:01.457 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:01.457 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:01.457 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:01.458 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:01.458 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:01.458 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:01.458 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:01.458 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:01.458 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:01.458 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:01.458 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:01.458 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:01.458 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:01.458 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:01.459 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.459 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:01.459 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:01.459 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:01.459 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:01.459 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:01.459 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:01.459 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:01.459 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:01.459 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:01.459 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:01.459 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:01.459 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:01.460 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:01.460 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.460 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.460 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:01.460 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:01.460 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:01.460 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:01.460 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:01.460 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:01.460 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:01.460 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:01.460 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:01.460 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:01.460 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:01.461 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:01.461 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:01.461 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:01.461 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:01.461 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:01.461 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:01.461 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:01.461 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:01.461 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:01.461 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:01.461 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:01.462 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:01.462 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:01.462 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:01.462 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:01.462 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:01.462 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:01.462 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.462 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:01.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.462 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:01.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.462 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:01.463 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:01.463 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.463 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.463 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.463 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:01.463 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.463 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.463 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:01.463 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.463 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.464 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.464 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:01.464 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:01.464 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.464 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.464 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.464 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.464 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:01.464 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:01.464 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.465 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.465 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.465 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.465 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:01.465 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.465 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.465 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.465 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:01.465 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.465 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.465 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.466 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:01.466 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:01.466 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.466 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.466 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.466 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:01.466 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:01.466 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.466 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.467 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.467 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:01.467 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.467 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.467 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:01.467 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.467 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.467 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.467 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:01.467 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:01.467 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.467 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.468 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.468 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.468 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:01.468 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:01.468 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.468 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.468 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.468 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.468 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:01.468 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.468 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.469 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.469 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:01.469 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.469 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.469 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.469 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:01.469 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:01.469 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.469 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.469 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.470 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:01.470 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:01.470 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.470 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.470 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.470 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:01.470 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.470 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.470 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:01.470 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.470 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.471 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.471 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:01.471 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:01.471 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.471 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.471 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.471 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:01.471 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:01.471 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.471 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.472 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.472 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:01.472 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.472 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.472 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.472 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:01.472 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.472 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.472 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.472 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:01.472 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:01.473 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.473 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.473 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.473 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:01.473 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:01.473 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.473 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.473 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.473 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:01.473 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.474 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.474 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:01.474 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.474 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.474 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.474 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:01.475 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:01.475 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.475 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.475 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.475 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:01.475 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:01.475 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.475 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:01.476 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:01.476 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.476 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.476 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:01.477 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:01.477 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.477 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.477 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.477 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:01.477 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:01.477 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.477 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.477 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.477 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:01.478 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.478 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:01.478 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.478 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.478 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.478 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:01.478 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:01.478 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.478 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.479 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.479 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.479 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.479 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:01.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:01.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.479 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:01.479 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:01.479 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:01.481 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.482 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.482 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:13:01.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.482 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:01.482 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:01.482 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:01.482 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.482 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.482 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:01.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.482 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:01.482 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:01.482 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:13:01.483 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.483 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.483 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:01.483 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:01.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1ca98f640 1 -- 172.21.15.5:0/2224448243 >> v2:172.21.15.157:6812/631023601 conn(0x7fb1b003bdc0 msgr2=0x7fb1b003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1ca98f640 1 --2- 172.21.15.5:0/2224448243 >> v2:172.21.15.157:6812/631023601 conn(0x7fb1b003bdc0 0x7fb1b003e280 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb1c413cb80 tx=0x7fb1b8008040 comp rx=0 tx=0).stop 2024-08-18T21:13:01.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1ca98f640 10 monclient: shutdown 2024-08-18T21:13:01.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1ca98f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:01.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1ca98f640 1 -- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4139fe0 msgr2=0x7fb1c41402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1ca98f640 1 --2- 172.21.15.5:0/2224448243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4139fe0 0x7fb1c41402e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0af040 tx=0x7fb1bc019690 comp rx=0 tx=0).stop 2024-08-18T21:13:01.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1c8f2c640 1 -- 172.21.15.5:0/2224448243 reap_dead start 2024-08-18T21:13:01.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1c8f2c640 1 -- 172.21.15.5:0/2224448243 reap_dead start 2024-08-18T21:13:01.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1ca98f640 1 -- 172.21.15.5:0/2224448243 shutdown_connections 2024-08-18T21:13:01.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1ca98f640 1 -- 172.21.15.5:0/2224448243 >> 172.21.15.5:0/2224448243 conn(0x7fb1c40acbc0 msgr2=0x7fb1c4138440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:01.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1ca98f640 1 -- 172.21.15.5:0/2224448243 shutdown_connections 2024-08-18T21:13:01.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.443+0000 7fb1ca98f640 1 -- 172.21.15.5:0/2224448243 wait complete. 2024-08-18T21:13:01.485 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:01.486 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:13:01.486 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:13:01.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 10 monclient: get_monmap_and_config 2024-08-18T21:13:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 10 monclient: build_initial_monmap 2024-08-18T21:13:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 10 monclient: monmap: 2024-08-18T21:13:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:01.617432+0000 2024-08-18T21:13:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:01.617432+0000 2024-08-18T21:13:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:01.615 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 1 Processor -- start 2024-08-18T21:13:01.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 1 -- start start 2024-08-18T21:13:01.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 10 monclient: init 2024-08-18T21:13:01.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:01.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 10 monclient: _add_conns ranks=[0,1,10,3,4,9,6,5,7,2,8] 2024-08-18T21:13:01.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f23040a6ce0 addr v1:172.21.15.5:6789/0 2024-08-18T21:13:01.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f23040a77d0 addr v1:172.21.15.157:6789/0 2024-08-18T21:13:01.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2304140400 0x7f23041427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 10 monclient(hunting): picked mon.noname-f con 0x7f2304140400 addr v2:172.21.15.157:3300/0 2024-08-18T21:13:01.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23040a45d0 con 0x7f23040a6ce0 2024-08-18T21:13:01.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23040a32d0 con 0x7f23040a77d0 2024-08-18T21:13:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f23040a5000 con 0x7f2304140400 2024-08-18T21:13:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f230af1c640 10 monclient(hunting): authenticate will time out at 1548.630722s 2024-08-18T21:13:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f2308cb8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f23040a6ce0 0x7f23040a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39042/0 (socket says 172.21.15.5:39042) 2024-08-18T21:13:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f2308cb8640 1 -- 172.21.15.5:0/865325726 learned_addr learned my addr 172.21.15.5:0/865325726 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:13:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f23094b9640 1 --2- 172.21.15.5:0/865325726 >> v2:172.21.15.157:3300/0 conn(0x7f2304140400 0x7f23041427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f23094b9640 10 monclient(hunting): get_auth_request con 0x7f2304140400 auth_method 0 2024-08-18T21:13:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f23094b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f23094b9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f23094b9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f23094b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f23094b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f23094b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f23094b9640 10 monclient(hunting): handle_auth_done global_id 124129 payload 274 2024-08-18T21:13:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f23094b9640 1 -- 172.21.15.5:0/865325726 >> v1:172.21.15.157:6789/0 conn(0x7f23040a77d0 legacy=0x7f230413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f23094b9640 1 -- 172.21.15.5:0/865325726 >> v1:172.21.15.5:6789/0 conn(0x7f23040a6ce0 legacy=0x7f23040a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f23094b9640 10 monclient: _finish_hunting 0 2024-08-18T21:13:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f23094b9640 1 monclient: found mon.noname-f 2024-08-18T21:13:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f23094b9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f23094b9640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:13:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.615+0000 7f23094b9640 1 -- 172.21.15.5:0/865325726 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23040a8900 con 0x7f2304140400 2024-08-18T21:13:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23094b9640 1 -- 172.21.15.5:0/865325726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2304140400 msgr2=0x7f23041427f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23094b9640 1 --2- 172.21.15.5:0/865325726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2304140400 0x7f23041427f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009d90 tx=0x7f22fc01c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2cc1cad81b0cd6d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23037fe640 1 -- 172.21.15.5:0/865325726 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f22fc0b2070 con 0x7f2304140400 2024-08-18T21:13:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23037fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:13:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23037fe640 10 monclient: dump: 2024-08-18T21:13:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.623 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23037fe640 10 monclient: _finish_auth 0 2024-08-18T21:13:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23037fe640 10 monclient: _check_auth_tickets 2024-08-18T21:13:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23037fe640 1 -- 172.21.15.5:0/865325726 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22fc0a5ab0 con 0x7f2304140400 2024-08-18T21:13:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23037fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23037fe640 1 -- 172.21.15.5:0/865325726 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f22fc0a5c60 con 0x7f2304140400 2024-08-18T21:13:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23037fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:13:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23037fe640 10 monclient: dump: 2024-08-18T21:13:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.624 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.624 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.624 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.624 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.624 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.624 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.624 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.624 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.624 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.624 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.624 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.624 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.624 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.624 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 5 monclient: authenticate success, global_id 124129 2024-08-18T21:13:01.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:01.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 4 set_mon_vals no callback set 2024-08-18T21:13:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 10 monclient: shutdown 2024-08-18T21:13:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 1 -- 172.21.15.5:0/865325726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2304140400 msgr2=0x7f23041427f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 1 --2- 172.21.15.5:0/865325726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2304140400 0x7f23041427f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009d90 tx=0x7f22fc01c830 comp rx=0 tx=0).stop 2024-08-18T21:13:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 1 -- 172.21.15.5:0/865325726 shutdown_connections 2024-08-18T21:13:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 1 --2- 172.21.15.5:0/865325726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2304140400 0x7f23041427f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 1 -- 172.21.15.5:0/865325726 >> 172.21.15.5:0/865325726 conn(0x7f23040acbc0 msgr2=0x7f23040a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 1 -- 172.21.15.5:0/865325726 shutdown_connections 2024-08-18T21:13:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 1 -- 172.21.15.5:0/865325726 wait complete. 2024-08-18T21:13:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 10 monclient: build_initial_monmap 2024-08-18T21:13:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 10 monclient: monmap: 2024-08-18T21:13:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:01.634 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 1 Processor -- start 2024-08-18T21:13:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 1 -- start start 2024-08-18T21:13:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 10 monclient: init 2024-08-18T21:13:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 10 monclient: _add_conns ranks=[0,7,3,5,8,6,1,2,4] 2024-08-18T21:13:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23040a6ce0 0x7f23041d1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 10 monclient(hunting): picked mon.noname-a con 0x7f23040a6ce0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:13:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f23040a77d0 0x7f23041d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 10 monclient(hunting): picked mon.noname-i con 0x7f23040a77d0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2304140400 0x7f23041d20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 10 monclient(hunting): picked mon.noname-g con 0x7f2304140400 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f23040a83a0 con 0x7f23040a6ce0 2024-08-18T21:13:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f23040a8220 con 0x7f2304140400 2024-08-18T21:13:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f2304145550 con 0x7f23040a77d0 2024-08-18T21:13:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f230af1c640 10 monclient(hunting): authenticate will time out at 1548.639149s 2024-08-18T21:13:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23040a6ce0 0x7f23041d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23040a6ce0 0x7f23041d1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43444/0 (socket says 172.21.15.5:43444) 2024-08-18T21:13:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 1 -- 172.21.15.5:0/1569950303 learned_addr learned my addr 172.21.15.5:0/1569950303 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 10 monclient(hunting): get_auth_request con 0x7f23040a6ce0 auth_method 0 2024-08-18T21:13:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23094b9640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2304140400 0x7f23041d20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23094b9640 10 monclient(hunting): get_auth_request con 0x7f2304140400 auth_method 0 2024-08-18T21:13:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23094b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23094b9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23094b9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2303fff640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f23040a77d0 0x7f23041d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2303fff640 10 monclient(hunting): get_auth_request con 0x7f23040a77d0 auth_method 0 2024-08-18T21:13:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2303fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2303fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2303fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 10 monclient(hunting): handle_auth_done global_id 124164 payload 824 2024-08-18T21:13:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 1 -- 172.21.15.5:0/1569950303 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f23040a77d0 msgr2=0x7f23041d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f23040a77d0 0x7f23041d1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 1 -- 172.21.15.5:0/1569950303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2304140400 msgr2=0x7f23041d20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2304140400 0x7f23041d20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 10 monclient: _finish_hunting 0 2024-08-18T21:13:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 1 monclient: found mon.noname-a 2024-08-18T21:13:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:13:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f2308cb8640 1 -- 172.21.15.5:0/1569950303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23040aae50 con 0x7f23040a6ce0 2024-08-18T21:13:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.623+0000 7f23094b9640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2304140400 0x7f23041d20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:13:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f2308cb8640 1 -- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23040a6ce0 msgr2=0x7f23041d1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f2308cb8640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23040a6ce0 0x7f23041d1630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f22f400c470 tx=0x7f22f400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23017fa640 1 -- 172.21.15.5:0/1569950303 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f22f4005d00 con 0x7f23040a6ce0 2024-08-18T21:13:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23017fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:13:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23017fa640 10 monclient: dump: 2024-08-18T21:13:01.638 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.640 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23017fa640 10 monclient: _finish_auth 0 2024-08-18T21:13:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23017fa640 10 monclient: _check_auth_tickets 2024-08-18T21:13:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23017fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f230af1c640 5 monclient: authenticate success, global_id 124164 2024-08-18T21:13:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23017fa640 1 -- 172.21.15.5:0/1569950303 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f40074e0 con 0x7f23040a6ce0 2024-08-18T21:13:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23017fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23017fa640 1 -- 172.21.15.5:0/1569950303 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f22f40076d0 con 0x7f23040a6ce0 2024-08-18T21:13:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23017fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:13:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23027fc640 4 set_mon_vals no callback set 2024-08-18T21:13:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23017fa640 10 monclient: dump: 2024-08-18T21:13:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.641 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.641 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.641 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.641 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.641 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.641 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.641 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.641 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.641 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.641 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.641 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.641 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.641 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.642 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.642 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f230af1c640 10 monclient: _renew_subs 2024-08-18T21:13:01.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f230af1c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:13:01.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f230af1c640 1 -- 172.21.15.5:0/1569950303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23040a1450 con 0x7f23040a6ce0 2024-08-18T21:13:01.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f230af1c640 10 monclient: _renew_subs 2024-08-18T21:13:01.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f230af1c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:13:01.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f230af1c640 1 -- 172.21.15.5:0/1569950303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2304142480 con 0x7f23040a6ce0 2024-08-18T21:13:01.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f230af1c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:01.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f230af1c640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2304137a80 0x7f2304137e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f230af1c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f230af1c640 1 -- 172.21.15.5:0/1569950303 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f2304051140 con 0x7f2304137a80 2024-08-18T21:13:01.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f2303fff640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2304137a80 0x7f2304137e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f2303fff640 10 monclient: get_auth_request con 0x7f2304137a80 auth_method 0 2024-08-18T21:13:01.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f2303fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f2303fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f2303fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23017fa640 1 -- 172.21.15.5:0/1569950303 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f22f4007070 con 0x7f23040a6ce0 2024-08-18T21:13:01.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f2303fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f2303fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f2303fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f2303fff640 10 monclient(hunting): handle_auth_done global_id 85641 payload 824 2024-08-18T21:13:01.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f2303fff640 1 -- 172.21.15.5:0/1569950303 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2304142160 con 0x7f2304137a80 2024-08-18T21:13:01.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23017fa640 1 --2- 172.21.15.5:0/1569950303 >> v2:172.21.15.157:6812/631023601 conn(0x7f22f003bdc0 0x7f22f003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.627+0000 7f23017fa640 1 -- 172.21.15.5:0/1569950303 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(261..261 src has 22..261) ==== 3898+0+0 (secure 0 0 0) 0x7f22f404e450 con 0x7f23040a6ce0 2024-08-18T21:13:01.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.631+0000 7f23094b9640 1 --2- 172.21.15.5:0/1569950303 >> v2:172.21.15.157:6812/631023601 conn(0x7f22f003bdc0 0x7f22f003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.631+0000 7f23094b9640 10 monclient: get_auth_request con 0x7f22f003bdc0 auth_method 0 2024-08-18T21:13:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.631+0000 7f2303fff640 1 -- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2304137a80 msgr2=0x7f2304137e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.631+0000 7f2303fff640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2304137a80 0x7f2304137e60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f23041402b0 tx=0x7f22f800e960 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.631+0000 7f23017fa640 1 -- 172.21.15.5:0/1569950303 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f22f8006c50 con 0x7f2304137a80 2024-08-18T21:13:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.631+0000 7f23017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.631+0000 7f23017fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:13:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.631+0000 7f23017fa640 10 monclient: dump: 2024-08-18T21:13:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.645 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.631+0000 7f23017fa640 1 -- 172.21.15.5:0/1569950303 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f22f8007450 con 0x7f2304137a80 2024-08-18T21:13:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.631+0000 7f23017fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.631+0000 7f23017fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.631+0000 7f23017fa640 1 -- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2304137a80 msgr2=0x7f2304137e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.631+0000 7f23017fa640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2304137a80 0x7f2304137e60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f23041402b0 tx=0x7f22f800e960 comp rx=0 tx=0).stop 2024-08-18T21:13:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.631+0000 7f23017fa640 1 -- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2304137a80 msgr2=0x7f2304137e60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.631+0000 7f23017fa640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f2304137a80 0x7f2304137e60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.631+0000 7f23094b9640 1 --2- 172.21.15.5:0/1569950303 >> v2:172.21.15.157:6812/631023601 conn(0x7f22f003bdc0 0x7f22f003e280 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0ac000 tx=0x7f22fc0a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f230af1c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f230af1c640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f23041383a0 0x7f230413c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f230af1c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f230af1c640 1 -- 172.21.15.5:0/1569950303 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f23040a70c0 con 0x7f23041383a0 2024-08-18T21:13:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f2303fff640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f23041383a0 0x7f230413c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f2303fff640 10 monclient: get_auth_request con 0x7f23041383a0 auth_method 0 2024-08-18T21:13:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f2303fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f2303fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f2303fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f2303fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f2303fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f2303fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f2303fff640 10 monclient(hunting): handle_auth_done global_id 85650 payload 824 2024-08-18T21:13:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f2303fff640 1 -- 172.21.15.5:0/1569950303 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f230409ff30 con 0x7f23041383a0 2024-08-18T21:13:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f2303fff640 1 -- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f23041383a0 msgr2=0x7f230413c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f2303fff640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f23041383a0 0x7f230413c190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f23041402b0 tx=0x7f22f8003770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f23017fa640 1 -- 172.21.15.5:0/1569950303 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f22f801ede0 con 0x7f23041383a0 2024-08-18T21:13:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f23017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f23017fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:13:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f23017fa640 10 monclient: dump: 2024-08-18T21:13:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.650 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f23017fa640 1 -- 172.21.15.5:0/1569950303 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7f22f801e970 con 0x7f23041383a0 2024-08-18T21:13:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f23017fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f23017fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f23017fa640 1 -- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f23041383a0 msgr2=0x7f230413c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f23017fa640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f23041383a0 0x7f230413c190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f23041402b0 tx=0x7f22f8003770 comp rx=0 tx=0).stop 2024-08-18T21:13:01.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f23017fa640 1 -- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f23041383a0 msgr2=0x7f230413c190 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:01.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.639+0000 7f23017fa640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f23041383a0 0x7f230413c190 secure :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f23041402b0 tx=0x7f22f8003770 comp rx=0 tx=0).stop 2024-08-18T21:13:01.651 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:01.651 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:01.651 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:01.651 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:01.652 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:01.652 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 278469, 2024-08-18T21:13:01.652 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:01.652 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:01.652 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:01.652 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:01.652 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:01.652 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:01.652 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:01.652 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:01.652 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:01.652 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:01.653 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.653 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:13:01.653 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:01.653 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:01.653 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:01.653 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:01.653 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:01.653 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:01.653 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:01.653 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:01.653 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:01.653 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:01.653 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:01.653 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:01.654 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:01.654 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:01.654 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.654 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:01.654 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:01.654 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:01.654 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:01.654 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:01.654 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:01.654 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:01.654 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:01.654 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:01.655 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:01.655 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:01.655 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:01.655 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:01.655 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.655 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:01.655 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:01.655 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:01.655 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:01.655 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:01.655 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:01.655 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:01.656 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:01.656 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:01.656 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:01.656 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:01.656 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:01.656 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:01.656 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:01.656 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:01.656 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:01.656 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:01.656 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:01.656 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:01.656 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:01.657 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:01.657 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:01.657 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:01.657 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:01.657 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:01.657 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:01.657 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:01.657 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:01.657 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.657 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:01.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.657 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:01.657 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.658 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:01.658 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:01.658 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.658 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.658 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.658 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:01.658 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.658 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.658 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:01.658 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.659 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.659 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.659 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:01.659 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:01.659 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.659 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.659 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.659 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:01.659 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:01.660 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.660 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:01.660 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.660 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:01.660 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.660 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.660 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.661 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:01.661 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:01.661 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.661 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.661 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.661 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:01.661 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:01.661 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.661 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.662 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.662 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:01.662 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.662 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.662 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:01.662 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.662 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.662 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.662 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:01.662 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:01.663 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.663 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.663 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.663 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:01.663 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:01.663 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.663 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.663 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.663 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:01.663 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.664 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.664 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:01.664 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.664 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.664 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.664 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:01.664 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:01.664 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.664 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.664 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.665 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:01.665 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:01.665 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.665 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.665 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.665 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:01.665 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.665 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.665 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:01.665 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.665 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.666 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.666 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:01.666 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:01.666 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.666 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.666 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.666 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:01.666 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:01.666 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.666 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.667 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.667 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:01.667 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.667 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.667 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:01.667 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.667 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.667 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.667 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:01.668 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:01.668 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.668 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.668 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.668 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.668 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:01.668 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:01.668 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.668 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.668 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.668 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.668 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:01.669 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.669 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.669 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.669 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:01.669 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.669 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.669 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.669 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:01.669 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:01.669 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.669 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.669 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.670 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.670 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:01.670 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:01.670 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.670 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.670 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.670 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.670 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:01.671 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.671 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.671 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:01.671 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.671 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.671 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.671 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:01.671 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:01.671 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.671 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.672 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.672 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:01.672 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:01.672 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.672 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.672 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.672 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:01.672 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.673 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.673 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:01.673 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.673 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.673 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.673 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:01.673 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:01.673 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.673 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.673 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.673 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.674 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.674 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:01.674 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:01.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.674 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:01.674 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:01.674 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:01.674 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.674 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.674 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:01.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.674 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:01.674 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:01.675 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:01.675 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.675 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.675 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:01.675 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:01.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.643+0000 7f230af1c640 1 -- 172.21.15.5:0/1569950303 >> v2:172.21.15.157:6812/631023601 conn(0x7f22f003bdc0 msgr2=0x7f22f003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.643+0000 7f230af1c640 1 --2- 172.21.15.5:0/1569950303 >> v2:172.21.15.157:6812/631023601 conn(0x7f22f003bdc0 0x7f22f003e280 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0ac000 tx=0x7f22fc0a7070 comp rx=0 tx=0).stop 2024-08-18T21:13:01.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.643+0000 7f230af1c640 10 monclient: shutdown 2024-08-18T21:13:01.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.643+0000 7f230af1c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:01.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.643+0000 7f230af1c640 1 -- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23040a6ce0 msgr2=0x7f23041d1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.643+0000 7f230af1c640 1 --2- 172.21.15.5:0/1569950303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23040a6ce0 0x7f23041d1630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f22f400c470 tx=0x7f22f400c930 comp rx=0 tx=0).stop 2024-08-18T21:13:01.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.643+0000 7f23094b9640 1 -- 172.21.15.5:0/1569950303 reap_dead start 2024-08-18T21:13:01.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.643+0000 7f23094b9640 1 -- 172.21.15.5:0/1569950303 reap_dead start 2024-08-18T21:13:01.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.643+0000 7f230af1c640 1 -- 172.21.15.5:0/1569950303 shutdown_connections 2024-08-18T21:13:01.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.643+0000 7f230af1c640 1 -- 172.21.15.5:0/1569950303 >> 172.21.15.5:0/1569950303 conn(0x7f23040acbc0 msgr2=0x7f23041407e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:01.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.643+0000 7f230af1c640 1 -- 172.21.15.5:0/1569950303 shutdown_connections 2024-08-18T21:13:01.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.643+0000 7f230af1c640 1 -- 172.21.15.5:0/1569950303 wait complete. 2024-08-18T21:13:01.677 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:01.678 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:13:01.678 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:13:01.684 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31689]: starting. 2024-08-18T21:13:01.685 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31689]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31687 2024-08-18T21:13:01.685 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31689]: shutting down. 2024-08-18T21:13:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 10 monclient: get_monmap_and_config 2024-08-18T21:13:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 10 monclient: build_initial_monmap 2024-08-18T21:13:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 10 monclient: monmap: 2024-08-18T21:13:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:01.796930+0000 2024-08-18T21:13:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:01.796930+0000 2024-08-18T21:13:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:01.795 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 1 Processor -- start 2024-08-18T21:13:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 1 -- start start 2024-08-18T21:13:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 10 monclient: init 2024-08-18T21:13:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 10 monclient: _add_conns ranks=[10,7,2,6,3,8,0,1,9,4,5] 2024-08-18T21:13:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4dc80a5a50 0x7f4dc8137800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 10 monclient(hunting): picked mon.noname-f con 0x7f4dc80a5a50 addr v2:172.21.15.157:3300/0 2024-08-18T21:13:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4dc8137d40 0x7f4dc8138120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 10 monclient(hunting): picked mon.noname-i con 0x7f4dc8137d40 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4dc80a1540 0x7f4dc80a1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 10 monclient(hunting): picked mon.noname-b con 0x7f4dc80a1540 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4dc80a5e30 con 0x7f4dc80a5a50 2024-08-18T21:13:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc80a3740 con 0x7f4dc80a1540 2024-08-18T21:13:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f4dc80a67a0 con 0x7f4dc8137d40 2024-08-18T21:13:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcff67640 10 monclient(hunting): authenticate will time out at 1548.810036s 2024-08-18T21:13:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4dc80a1540 0x7f4dc80a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4dc80a1540 0x7f4dc80a1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:36944/0 (socket says 172.21.15.5:36944) 2024-08-18T21:13:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 1 -- 172.21.15.5:0/4026637428 learned_addr learned my addr 172.21.15.5:0/4026637428 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 10 monclient(hunting): get_auth_request con 0x7f4dc80a1540 auth_method 0 2024-08-18T21:13:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcd502640 1 --2- 172.21.15.5:0/4026637428 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4dc8137d40 0x7f4dc8138120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcdd03640 1 --2- 172.21.15.5:0/4026637428 >> v2:172.21.15.157:3300/0 conn(0x7f4dc80a5a50 0x7f4dc8137800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcd502640 10 monclient(hunting): get_auth_request con 0x7f4dc8137d40 auth_method 0 2024-08-18T21:13:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcd502640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcd502640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcd502640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcdd03640 10 monclient(hunting): get_auth_request con 0x7f4dc80a5a50 auth_method 0 2024-08-18T21:13:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcdd03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcdd03640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dcdd03640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 10 monclient(hunting): handle_auth_done global_id 114437 payload 274 2024-08-18T21:13:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 1 -- 172.21.15.5:0/4026637428 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4dc8137d40 msgr2=0x7f4dc8138120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 1 --2- 172.21.15.5:0/4026637428 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4dc8137d40 0x7f4dc8138120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 1 -- 172.21.15.5:0/4026637428 >> v2:172.21.15.157:3300/0 conn(0x7f4dc80a5a50 msgr2=0x7f4dc8137800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 1 --2- 172.21.15.5:0/4026637428 >> v2:172.21.15.157:3300/0 conn(0x7f4dc80a5a50 0x7f4dc8137800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 10 monclient: _finish_hunting 0 2024-08-18T21:13:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 1 monclient: found mon.noname-b 2024-08-18T21:13:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:13:01.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.795+0000 7f4dce504640 1 -- 172.21.15.5:0/4026637428 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc80a2660 con 0x7f4dc80a1540 2024-08-18T21:13:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dce504640 1 -- 172.21.15.5:0/4026637428 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4dc80a1540 msgr2=0x7f4dc80a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dce504640 1 --2- 172.21.15.5:0/4026637428 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4dc80a1540 0x7f4dc80a1920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009e80 tx=0x7f4dc001c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de10b4d73d620111 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dccd01640 1 -- 172.21.15.5:0/4026637428 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4dc00090d0 con 0x7f4dc80a1540 2024-08-18T21:13:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dccd01640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dccd01640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:13:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dccd01640 10 monclient: dump: 2024-08-18T21:13:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.805 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dccd01640 10 monclient: _finish_auth 0 2024-08-18T21:13:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dccd01640 10 monclient: _check_auth_tickets 2024-08-18T21:13:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dccd01640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dccd01640 1 -- 172.21.15.5:0/4026637428 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc00a5a70 con 0x7f4dc80a1540 2024-08-18T21:13:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dccd01640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dccd01640 1 -- 172.21.15.5:0/4026637428 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4dc00a5c20 con 0x7f4dc80a1540 2024-08-18T21:13:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dcff67640 5 monclient: authenticate success, global_id 114437 2024-08-18T21:13:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dcff67640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dcff67640 4 set_mon_vals no callback set 2024-08-18T21:13:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dccd01640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dccd01640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.799+0000 7f4dccd01640 10 monclient: dump: 2024-08-18T21:13:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.808 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 10 monclient: shutdown 2024-08-18T21:13:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 -- 172.21.15.5:0/4026637428 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4dc80a1540 msgr2=0x7f4dc80a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 --2- 172.21.15.5:0/4026637428 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4dc80a1540 0x7f4dc80a1920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009e80 tx=0x7f4dc001c8d0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 -- 172.21.15.5:0/4026637428 shutdown_connections 2024-08-18T21:13:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 --2- 172.21.15.5:0/4026637428 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4dc80a1540 0x7f4dc80a1920 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 --2- 172.21.15.5:0/4026637428 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f4dc8137d40 0x7f4dc8138120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 --2- 172.21.15.5:0/4026637428 >> v2:172.21.15.157:3300/0 conn(0x7f4dc80a5a50 0x7f4dc8137800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 -- 172.21.15.5:0/4026637428 >> 172.21.15.5:0/4026637428 conn(0x7f4dc80688d0 msgr2=0x7f4dc8068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 -- 172.21.15.5:0/4026637428 shutdown_connections 2024-08-18T21:13:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 -- 172.21.15.5:0/4026637428 wait complete. 2024-08-18T21:13:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 10 monclient: build_initial_monmap 2024-08-18T21:13:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 10 monclient: monmap: 2024-08-18T21:13:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:01.810 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 Processor -- start 2024-08-18T21:13:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 -- start start 2024-08-18T21:13:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 10 monclient: init 2024-08-18T21:13:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 10 monclient: _add_conns ranks=[1,2,5,8,4,3,0,6,7] 2024-08-18T21:13:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc80a1540 0x7f4dc81d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 10 monclient(hunting): picked mon.noname-f con 0x7f4dc80a1540 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:13:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4dc80a5a50 0x7f4dc81d1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 10 monclient(hunting): picked mon.noname-b con 0x7f4dc80a5a50 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4dc8137d40 0x7f4dc81d2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 10 monclient(hunting): picked mon.noname-h con 0x7f4dc8137d40 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc80a23f0 con 0x7f4dc80a1540 2024-08-18T21:13:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc80a2270 con 0x7f4dc80a5a50 2024-08-18T21:13:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f4dc8141480 con 0x7f4dc8137d40 2024-08-18T21:13:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcff67640 10 monclient(hunting): authenticate will time out at 1548.818031s 2024-08-18T21:13:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4dc80a5a50 0x7f4dc81d1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4dc80a5a50 0x7f4dc81d1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:36946/0 (socket says 172.21.15.5:36946) 2024-08-18T21:13:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 1 -- 172.21.15.5:0/3463650566 learned_addr learned my addr 172.21.15.5:0/3463650566 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 10 monclient(hunting): get_auth_request con 0x7f4dc80a5a50 auth_method 0 2024-08-18T21:13:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcdd03640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc80a1540 0x7f4dc81d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dce504640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4dc8137d40 0x7f4dc81d2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 10 monclient(hunting): handle_auth_done global_id 114446 payload 824 2024-08-18T21:13:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 1 -- 172.21.15.5:0/3463650566 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4dc8137d40 msgr2=0x7f4dc81d2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4dc8137d40 0x7f4dc81d2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 1 -- 172.21.15.5:0/3463650566 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc80a1540 msgr2=0x7f4dc81d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc80a1540 0x7f4dc81d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 10 monclient: _finish_hunting 0 2024-08-18T21:13:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 1 monclient: found mon.noname-b 2024-08-18T21:13:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:13:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcd502640 1 -- 172.21.15.5:0/3463650566 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc813d5e0 con 0x7f4dc80a5a50 2024-08-18T21:13:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcdd03640 10 monclient: get_auth_request con 0x7f4dc80a1540 auth_method 0 2024-08-18T21:13:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dcdd03640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc80a1540 0x7f4dc81d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:13:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dce504640 10 monclient: get_auth_request con 0x7f4dc8137d40 auth_method 0 2024-08-18T21:13:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.803+0000 7f4dce504640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4dc8137d40 0x7f4dc81d2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:13:01.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcd502640 1 -- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4dc80a5a50 msgr2=0x7f4dc81d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcd502640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4dc80a5a50 0x7f4dc81d1bd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4db800d800 tx=0x7f4db800dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbe7fc640 1 -- 172.21.15.5:0/3463650566 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4db800bd40 con 0x7f4dc80a5a50 2024-08-18T21:13:01.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbe7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:13:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbe7fc640 10 monclient: dump: 2024-08-18T21:13:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.819 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.819 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.819 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.819 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.819 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbe7fc640 10 monclient: _finish_auth 0 2024-08-18T21:13:01.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbe7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:13:01.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:01.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbe7fc640 1 -- 172.21.15.5:0/3463650566 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db8019070 con 0x7f4dc80a5a50 2024-08-18T21:13:01.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcff67640 5 monclient: authenticate success, global_id 114446 2024-08-18T21:13:01.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcff67640 10 monclient: _renew_subs 2024-08-18T21:13:01.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcff67640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcff67640 1 -- 172.21.15.5:0/3463650566 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc8073f20 con 0x7f4dc80a5a50 2024-08-18T21:13:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbe7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbe7fc640 1 -- 172.21.15.5:0/3463650566 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4db80148a0 con 0x7f4dc80a5a50 2024-08-18T21:13:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbffff640 4 set_mon_vals no callback set 2024-08-18T21:13:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbe7fc640 10 monclient: dump: 2024-08-18T21:13:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.821 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcff67640 10 monclient: _renew_subs 2024-08-18T21:13:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcff67640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcff67640 1 -- 172.21.15.5:0/3463650566 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc813d300 con 0x7f4dc80a5a50 2024-08-18T21:13:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcff67640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcff67640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4dc806d9e0 0x7f4dc806ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcff67640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcff67640 1 -- 172.21.15.5:0/3463650566 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f4dc8051140 con 0x7f4dc806d9e0 2024-08-18T21:13:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbe7fc640 1 -- 172.21.15.5:0/3463650566 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f4db8014430 con 0x7f4dc80a5a50 2024-08-18T21:13:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbe7fc640 1 --2- 172.21.15.5:0/3463650566 >> v2:172.21.15.157:6812/631023601 conn(0x7f4dac03bdc0 0x7f4dac03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dbe7fc640 1 -- 172.21.15.5:0/3463650566 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(262..262 src has 22..262) ==== 3506+0+0 (secure 0 0 0) 0x7f4db800f040 con 0x7f4dc80a5a50 2024-08-18T21:13:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcdd03640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4dc806d9e0 0x7f4dc806ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcdd03640 10 monclient: get_auth_request con 0x7f4dc806d9e0 auth_method 0 2024-08-18T21:13:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcdd03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcdd03640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcdd03640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dce504640 1 --2- 172.21.15.5:0/3463650566 >> v2:172.21.15.157:6812/631023601 conn(0x7f4dac03bdc0 0x7f4dac03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcdd03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcdd03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcdd03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dce504640 10 monclient: get_auth_request con 0x7f4dac03bdc0 auth_method 0 2024-08-18T21:13:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcdd03640 10 monclient(hunting): handle_auth_done global_id 114623 payload 824 2024-08-18T21:13:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.807+0000 7f4dcdd03640 1 -- 172.21.15.5:0/3463650566 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4dc80690c0 con 0x7f4dc806d9e0 2024-08-18T21:13:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.811+0000 7f4dcdd03640 1 -- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4dc806d9e0 msgr2=0x7f4dc806ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.811+0000 7f4dcdd03640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4dc806d9e0 0x7f4dc806ddc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400e710 tx=0x7f4dc400ebd0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.811+0000 7f4dbe7fc640 1 -- 172.21.15.5:0/3463650566 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4dc400f040 con 0x7f4dc806d9e0 2024-08-18T21:13:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.811+0000 7f4dbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.811+0000 7f4dbe7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.811+0000 7f4dbe7fc640 10 monclient: dump: 2024-08-18T21:13:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.825 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.811+0000 7f4dce504640 1 --2- 172.21.15.5:0/3463650566 >> v2:172.21.15.157:6812/631023601 conn(0x7f4dac03bdc0 0x7f4dac03e280 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009e80 tx=0x7f4dc00a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.811+0000 7f4dbe7fc640 1 -- 172.21.15.5:0/3463650566 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4dc4004030 con 0x7f4dc806d9e0 2024-08-18T21:13:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.811+0000 7f4dbe7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.811+0000 7f4dbe7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.811+0000 7f4dbe7fc640 1 -- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4dc806d9e0 msgr2=0x7f4dc806ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.811+0000 7f4dbe7fc640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4dc806d9e0 0x7f4dc806ddc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400e710 tx=0x7f4dc400ebd0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.811+0000 7f4dbe7fc640 1 -- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4dc806d9e0 msgr2=0x7f4dc806ddc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.811+0000 7f4dbe7fc640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4dc806d9e0 0x7f4dc806ddc0 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400e710 tx=0x7f4dc400ebd0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.815+0000 7f4dcff67640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.815+0000 7f4dcff67640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4dc806e300 0x7f4dc8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.815+0000 7f4dcff67640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.815+0000 7f4dcff67640 1 -- 172.21.15.5:0/3463650566 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f4dc8068f00 con 0x7f4dc806e300 2024-08-18T21:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.815+0000 7f4dcdd03640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4dc806e300 0x7f4dc8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.815+0000 7f4dcdd03640 10 monclient: get_auth_request con 0x7f4dc806e300 auth_method 0 2024-08-18T21:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.815+0000 7f4dcdd03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.815+0000 7f4dcdd03640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.815+0000 7f4dcdd03640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.815+0000 7f4dcdd03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.815+0000 7f4dcdd03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.815+0000 7f4dcdd03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dcdd03640 10 monclient(hunting): handle_auth_done global_id 114632 payload 824 2024-08-18T21:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dcdd03640 1 -- 172.21.15.5:0/3463650566 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4dc8137800 con 0x7f4dc806e300 2024-08-18T21:13:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dcdd03640 1 -- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4dc806e300 msgr2=0x7f4dc8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dcdd03640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4dc806e300 0x7f4dc8071910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400e710 tx=0x7f4dc4004740 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dbe7fc640 1 -- 172.21.15.5:0/3463650566 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4dc4003ca0 con 0x7f4dc806e300 2024-08-18T21:13:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dbe7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dbe7fc640 10 monclient: dump: 2024-08-18T21:13:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.829 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dbe7fc640 1 -- 172.21.15.5:0/3463650566 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f4dc4003830 con 0x7f4dc806e300 2024-08-18T21:13:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dbe7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dbe7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dbe7fc640 1 -- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4dc806e300 msgr2=0x7f4dc8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dbe7fc640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4dc806e300 0x7f4dc8071910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400e710 tx=0x7f4dc4004740 comp rx=0 tx=0).stop 2024-08-18T21:13:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dbe7fc640 1 -- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4dc806e300 msgr2=0x7f4dc8071910 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dbe7fc640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4dc806e300 0x7f4dc8071910 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400e710 tx=0x7f4dc4004740 comp rx=0 tx=0).stop 2024-08-18T21:13:01.830 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 86987, 2024-08-18T21:13:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:13:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.840 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:01.840 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:01.840 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.840 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.840 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.840 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.840 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:01.840 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:01.840 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.840 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.840 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.840 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.840 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:01.841 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.841 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.841 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.841 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:01.841 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.841 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.841 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.841 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:01.841 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:01.841 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.841 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.841 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.842 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.842 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:01.842 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:01.842 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.842 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.842 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.842 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.842 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:01.842 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.842 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.843 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.843 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:01.843 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.843 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.843 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.843 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:01.843 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:01.843 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.843 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.843 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.843 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.843 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:01.844 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:01.844 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.844 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.844 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.844 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.844 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:01.844 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.844 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.844 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.844 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:01.844 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.844 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.845 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.845 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:01.845 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:01.845 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.845 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.845 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.845 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:01.845 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:01.845 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.845 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.846 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.846 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:01.846 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.846 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.846 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.846 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:01.846 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.846 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.846 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.846 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:01.846 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:01.847 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.847 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.847 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.847 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:01.847 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:01.847 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.847 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.847 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.847 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:01.847 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.848 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.848 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:01.848 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.848 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.848 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.848 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:01.848 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:01.848 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.848 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.848 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.848 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.849 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:01.849 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:01.849 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.849 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.849 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.849 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.849 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:01.849 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.849 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.849 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.849 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:01.849 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.849 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.850 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.850 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:01.850 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:01.850 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.850 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.850 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.850 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.850 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:01.850 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:01.850 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:01.850 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:01.851 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.851 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:01.851 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:01.851 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.851 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.851 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:01.851 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:01.851 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:01.851 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.851 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.852 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:01.852 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:01.852 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:01.852 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:01.852 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:01.852 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.852 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.852 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:01.852 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:01.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.852 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:01.852 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:01.852 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:01.852 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.853 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.853 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:13:01.853 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.853 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:01.853 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:01.853 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:01.853 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.853 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:01.853 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:01.853 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:01.853 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:01.853 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:01.853 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:13:01.854 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:01.854 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:01.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:01.854 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:01.854 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:01.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dcff67640 1 -- 172.21.15.5:0/3463650566 >> v2:172.21.15.157:6812/631023601 conn(0x7f4dac03bdc0 msgr2=0x7f4dac03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dcff67640 1 --2- 172.21.15.5:0/3463650566 >> v2:172.21.15.157:6812/631023601 conn(0x7f4dac03bdc0 0x7f4dac03e280 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009e80 tx=0x7f4dc00a7070 comp rx=0 tx=0).stop 2024-08-18T21:13:01.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dcff67640 10 monclient: shutdown 2024-08-18T21:13:01.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dcff67640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:01.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dcff67640 1 -- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4dc80a5a50 msgr2=0x7f4dc81d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dcff67640 1 --2- 172.21.15.5:0/3463650566 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4dc80a5a50 0x7f4dc81d1bd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4db800d800 tx=0x7f4db800dcc0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dce504640 1 -- 172.21.15.5:0/3463650566 reap_dead start 2024-08-18T21:13:01.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dce504640 1 -- 172.21.15.5:0/3463650566 reap_dead start 2024-08-18T21:13:01.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dcff67640 1 -- 172.21.15.5:0/3463650566 shutdown_connections 2024-08-18T21:13:01.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dcff67640 1 -- 172.21.15.5:0/3463650566 >> 172.21.15.5:0/3463650566 conn(0x7f4dc80688d0 msgr2=0x7f4dc80a8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:01.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dcff67640 1 -- 172.21.15.5:0/3463650566 shutdown_connections 2024-08-18T21:13:01.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.819+0000 7f4dcff67640 1 -- 172.21.15.5:0/3463650566 wait complete. 2024-08-18T21:13:01.856 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:01.856 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:13:01.857 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:13:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.975+0000 7f7a3000d640 10 monclient: get_monmap_and_config 2024-08-18T21:13:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.975+0000 7f7a3000d640 10 monclient: build_initial_monmap 2024-08-18T21:13:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.975+0000 7f7a3000d640 10 monclient: monmap: 2024-08-18T21:13:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:01.979102+0000 2024-08-18T21:13:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:01.979102+0000 2024-08-18T21:13:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:01.977 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.975+0000 7f7a3000d640 1 Processor -- start 2024-08-18T21:13:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a3000d640 1 -- start start 2024-08-18T21:13:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a3000d640 10 monclient: init 2024-08-18T21:13:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a3000d640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a3000d640 10 monclient: _add_conns ranks=[9,2,0,3,4,10,7,6,8,1,5] 2024-08-18T21:13:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a3000d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a280a6bd0 0x7f7a280a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a3000d640 10 monclient(hunting): picked mon.noname-a con 0x7f7a280a6bd0 addr v2:172.21.15.5:3300/0 2024-08-18T21:13:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a3000d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7a2809f080 0x7f7a280a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a3000d640 10 monclient(hunting): picked mon.noname-b con 0x7f7a2809f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a3000d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7a28139990 addr v1:172.21.15.5:6789/0 2024-08-18T21:13:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a3000d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a280a7fb0 con 0x7f7a28139990 2024-08-18T21:13:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a3000d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a3000d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7a2809e4c0 con 0x7f7a280a6bd0 2024-08-18T21:13:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a3000d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a3000d640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f7a2806f930 con 0x7f7a2809f080 2024-08-18T21:13:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a3000d640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a3000d640 10 monclient(hunting): authenticate will time out at 1548.992795s 2024-08-18T21:13:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2e5aa640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7a28139990 0x7f7a28139e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39050/0 (socket says 172.21.15.5:39050) 2024-08-18T21:13:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2e5aa640 1 -- 172.21.15.5:0/3459640757 learned_addr learned my addr 172.21.15.5:0/3459640757 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:13:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 1 --2- 172.21.15.5:0/3459640757 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7a2809f080 0x7f7a280a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2dda9640 1 --2- 172.21.15.5:0/3459640757 >> v2:172.21.15.5:3300/0 conn(0x7f7a280a6bd0 0x7f7a280a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2dda9640 10 monclient(hunting): get_auth_request con 0x7f7a280a6bd0 auth_method 0 2024-08-18T21:13:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2dda9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2dda9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2dda9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 10 monclient(hunting): get_auth_request con 0x7f7a2809f080 auth_method 0 2024-08-18T21:13:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 10 monclient(hunting): handle_auth_done global_id 114455 payload 274 2024-08-18T21:13:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 1 -- 172.21.15.5:0/3459640757 >> v2:172.21.15.5:3300/0 conn(0x7f7a280a6bd0 msgr2=0x7f7a280a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 1 --2- 172.21.15.5:0/3459640757 >> v2:172.21.15.5:3300/0 conn(0x7f7a280a6bd0 0x7f7a280a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 1 -- 172.21.15.5:0/3459640757 >> v1:172.21.15.5:6789/0 conn(0x7f7a28139990 legacy=0x7f7a28139e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 10 monclient: _finish_hunting 0 2024-08-18T21:13:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 1 monclient: found mon.noname-b 2024-08-18T21:13:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:13:01.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.979+0000 7f7a2d5a8640 1 -- 172.21.15.5:0/3459640757 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2809de70 con 0x7f7a2809f080 2024-08-18T21:13:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a2d5a8640 1 -- 172.21.15.5:0/3459640757 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7a2809f080 msgr2=0x7f7a280a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a2d5a8640 1 --2- 172.21.15.5:0/3459640757 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7a2809f080 0x7f7a280a74f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7a180097c0 tx=0x7f7a1801c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d30031041741ced server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a2cda7640 1 -- 172.21.15.5:0/3459640757 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7a180b0070 con 0x7f7a2809f080 2024-08-18T21:13:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a2cda7640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a2cda7640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:13:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a2cda7640 10 monclient: dump: 2024-08-18T21:13:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.984 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.984 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.984 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.984 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.984 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.984 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.984 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.984 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.984 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.984 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a2cda7640 10 monclient: _finish_auth 0 2024-08-18T21:13:01.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a2cda7640 10 monclient: _check_auth_tickets 2024-08-18T21:13:01.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a2cda7640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a2cda7640 1 -- 172.21.15.5:0/3459640757 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a180aa810 con 0x7f7a2809f080 2024-08-18T21:13:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a2cda7640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a2cda7640 1 -- 172.21.15.5:0/3459640757 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7a180aae30 con 0x7f7a2809f080 2024-08-18T21:13:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a3000d640 5 monclient: authenticate success, global_id 114455 2024-08-18T21:13:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a3000d640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a3000d640 4 set_mon_vals no callback set 2024-08-18T21:13:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a2cda7640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a2cda7640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a2cda7640 10 monclient: dump: 2024-08-18T21:13:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.986 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.986 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.986 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.986 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.986 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.986 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.986 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.986 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.986 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.986 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.986 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.986 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a3000d640 10 monclient: shutdown 2024-08-18T21:13:01.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a3000d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:01.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a3000d640 1 -- 172.21.15.5:0/3459640757 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7a2809f080 msgr2=0x7f7a280a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a3000d640 1 --2- 172.21.15.5:0/3459640757 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7a2809f080 0x7f7a280a74f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7a180097c0 tx=0x7f7a1801c360 comp rx=0 tx=0).stop 2024-08-18T21:13:01.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a3000d640 1 -- 172.21.15.5:0/3459640757 shutdown_connections 2024-08-18T21:13:01.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a3000d640 1 --2- 172.21.15.5:0/3459640757 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7a2809f080 0x7f7a280a74f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a3000d640 1 --2- 172.21.15.5:0/3459640757 >> v2:172.21.15.5:3300/0 conn(0x7f7a280a6bd0 0x7f7a280a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a3000d640 1 -- 172.21.15.5:0/3459640757 >> 172.21.15.5:0/3459640757 conn(0x7f7a28068700 msgr2=0x7f7a28068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:01.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a3000d640 1 -- 172.21.15.5:0/3459640757 shutdown_connections 2024-08-18T21:13:01.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a3000d640 1 -- 172.21.15.5:0/3459640757 wait complete. 2024-08-18T21:13:01.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a3000d640 10 monclient: build_initial_monmap 2024-08-18T21:13:01.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.983+0000 7f7a3000d640 10 monclient: monmap: 2024-08-18T21:13:01.992 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:01.993 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:01.993 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:01.993 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:01.993 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:01.993 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.993 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:01.993 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:01.993 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:01.993 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:01.993 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:01.993 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:01.993 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:01.993 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:01.993 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:01.994 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 1 Processor -- start 2024-08-18T21:13:01.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 1 -- start start 2024-08-18T21:13:01.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 10 monclient: init 2024-08-18T21:13:01.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:01.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 10 monclient: _add_conns ranks=[4,0,7,2,3,6,1,5,8] 2024-08-18T21:13:01.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a2809f080 0x7f7a281383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 10 monclient(hunting): picked mon.noname-c con 0x7f7a2809f080 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:13:01.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a280a6bd0 0x7f7a28138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 10 monclient(hunting): picked mon.noname-a con 0x7f7a280a6bd0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:13:01.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7a28139990 0x7f7a2813da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:01.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 10 monclient(hunting): picked mon.noname-i con 0x7f7a28139990 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:01.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7a281447a0 con 0x7f7a280a6bd0 2024-08-18T21:13:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f7a28144620 con 0x7f7a2809f080 2024-08-18T21:13:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7a28144920 con 0x7f7a28139990 2024-08-18T21:13:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a3000d640 10 monclient(hunting): authenticate will time out at 1549.001044s 2024-08-18T21:13:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a2809f080 0x7f7a281383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2d5a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a280a6bd0 0x7f7a28138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a2809f080 0x7f7a281383c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:37002/0 (socket says 172.21.15.5:37002) 2024-08-18T21:13:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 1 -- 172.21.15.5:0/3618501860 learned_addr learned my addr 172.21.15.5:0/3618501860 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 10 monclient(hunting): get_auth_request con 0x7f7a2809f080 auth_method 0 2024-08-18T21:13:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2d5a8640 10 monclient(hunting): get_auth_request con 0x7f7a280a6bd0 auth_method 0 2024-08-18T21:13:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2d5a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2d5a8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2d5a8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2d5a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2d5a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2d5a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2e5aa640 1 --2- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7a28139990 0x7f7a2813da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 10 monclient(hunting): handle_auth_done global_id 114430 payload 824 2024-08-18T21:13:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 1 -- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7a28139990 msgr2=0x7f7a2813da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 1 --2- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7a28139990 0x7f7a2813da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 1 -- 172.21.15.5:0/3618501860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a280a6bd0 msgr2=0x7f7a28138900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 1 --2- 172.21.15.5:0/3618501860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a280a6bd0 0x7f7a28138900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 10 monclient: _finish_hunting 0 2024-08-18T21:13:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 1 monclient: found mon.noname-c 2024-08-18T21:13:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:13:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 1 -- 172.21.15.5:0/3618501860 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a28140e20 con 0x7f7a2809f080 2024-08-18T21:13:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2e5aa640 10 monclient: get_auth_request con 0x7f7a28139990 auth_method 0 2024-08-18T21:13:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2e5aa640 1 --2- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7a28139990 0x7f7a2813da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:13:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 1 -- 172.21.15.5:0/3618501860 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a2809f080 msgr2=0x7f7a281383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.987+0000 7f7a2dda9640 1 --2- 172.21.15.5:0/3618501860 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a2809f080 0x7f7a281383c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7a24007f20 tx=0x7f7a2400e570 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1e7fc640 1 -- 172.21.15.5:0/3618501860 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7a24013a00 con 0x7f7a2809f080 2024-08-18T21:13:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:13:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1e7fc640 10 monclient: dump: 2024-08-18T21:13:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:01.999 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:13:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:13:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1e7fc640 1 -- 172.21.15.5:0/3618501860 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a24019070 con 0x7f7a2809f080 2024-08-18T21:13:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1e7fc640 1 -- 172.21.15.5:0/3618501860 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7a24013c00 con 0x7f7a2809f080 2024-08-18T21:13:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a3000d640 5 monclient: authenticate success, global_id 114430 2024-08-18T21:13:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a3000d640 10 monclient: _renew_subs 2024-08-18T21:13:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a3000d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:13:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a3000d640 1 -- 172.21.15.5:0/3618501860 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a281231f0 con 0x7f7a2809f080 2024-08-18T21:13:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:13:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1e7fc640 10 monclient: dump: 2024-08-18T21:13:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.001 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1ffff640 4 set_mon_vals no callback set 2024-08-18T21:13:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a3000d640 10 monclient: _renew_subs 2024-08-18T21:13:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a3000d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:13:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a3000d640 1 -- 172.21.15.5:0/3618501860 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a28122c30 con 0x7f7a2809f080 2024-08-18T21:13:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a3000d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a3000d640 1 --2- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a2813df50 0x7f7a2813e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a3000d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a3000d640 1 -- 172.21.15.5:0/3618501860 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2813ffa0 con 0x7f7a2813df50 2024-08-18T21:13:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1e7fc640 1 -- 172.21.15.5:0/3618501860 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f7a24013590 con 0x7f7a2809f080 2024-08-18T21:13:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a2d5a8640 1 --2- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a2813df50 0x7f7a2813e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a2d5a8640 10 monclient: get_auth_request con 0x7f7a2813df50 auth_method 0 2024-08-18T21:13:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a2d5a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a2d5a8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a2d5a8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1e7fc640 1 --2- 172.21.15.5:0/3618501860 >> v2:172.21.15.157:6812/631023601 conn(0x7f7a0c03bdc0 0x7f7a0c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a1e7fc640 1 -- 172.21.15.5:0/3618501860 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(262..262 src has 22..262) ==== 3506+0+0 (secure 0 0 0) 0x7f7a2404ec00 con 0x7f7a2809f080 2024-08-18T21:13:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a2d5a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a2d5a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a2d5a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a2e5aa640 1 --2- 172.21.15.5:0/3618501860 >> v2:172.21.15.157:6812/631023601 conn(0x7f7a0c03bdc0 0x7f7a0c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a2e5aa640 10 monclient: get_auth_request con 0x7f7a0c03bdc0 auth_method 0 2024-08-18T21:13:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a2d5a8640 10 monclient(hunting): handle_auth_done global_id 124165 payload 824 2024-08-18T21:13:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.991+0000 7f7a2d5a8640 1 -- 172.21.15.5:0/3618501860 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a28139e40 con 0x7f7a2813df50 2024-08-18T21:13:02.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.995+0000 7f7a2e5aa640 1 --2- 172.21.15.5:0/3618501860 >> v2:172.21.15.157:6812/631023601 conn(0x7f7a0c03bdc0 0x7f7a0c03e280 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7a28140d70 tx=0x7f7a20008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.995+0000 7f7a2d5a8640 1 -- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a2813df50 msgr2=0x7f7a2813e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.995+0000 7f7a2d5a8640 1 --2- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a2813df50 0x7f7a2813e330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7a280749c0 tx=0x7f7a18019100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.995+0000 7f7a1e7fc640 1 -- 172.21.15.5:0/3618501860 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7a180b0040 con 0x7f7a2813df50 2024-08-18T21:13:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.995+0000 7f7a1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.995+0000 7f7a1e7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:13:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.995+0000 7f7a1e7fc640 10 monclient: dump: 2024-08-18T21:13:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.006 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.995+0000 7f7a1e7fc640 1 -- 172.21.15.5:0/3618501860 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7a180039d0 con 0x7f7a2813df50 2024-08-18T21:13:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.995+0000 7f7a1e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.995+0000 7f7a1e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.995+0000 7f7a1e7fc640 1 -- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a2813df50 msgr2=0x7f7a2813e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.995+0000 7f7a1e7fc640 1 --2- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a2813df50 0x7f7a2813e330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7a280749c0 tx=0x7f7a18019100 comp rx=0 tx=0).stop 2024-08-18T21:13:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.995+0000 7f7a1e7fc640 1 -- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a2813df50 msgr2=0x7f7a2813e330 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:01.995+0000 7f7a1e7fc640 1 --2- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a2813df50 0x7f7a2813e330 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7a280749c0 tx=0x7f7a18019100 comp rx=0 tx=0).stop 2024-08-18T21:13:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.003+0000 7f7a3000d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.003+0000 7f7a3000d640 1 --2- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a2813e870 0x7f7a280a3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.003+0000 7f7a3000d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.003+0000 7f7a3000d640 1 -- 172.21.15.5:0/3618501860 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7a28051140 con 0x7f7a2813e870 2024-08-18T21:13:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.003+0000 7f7a2d5a8640 1 --2- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a2813e870 0x7f7a280a3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.003+0000 7f7a2d5a8640 10 monclient: get_auth_request con 0x7f7a2813e870 auth_method 0 2024-08-18T21:13:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.003+0000 7f7a2d5a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.003+0000 7f7a2d5a8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.003+0000 7f7a2d5a8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.003+0000 7f7a2d5a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.003+0000 7f7a2d5a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.003+0000 7f7a2d5a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.003+0000 7f7a2d5a8640 10 monclient(hunting): handle_auth_done global_id 124174 payload 824 2024-08-18T21:13:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.003+0000 7f7a2d5a8640 1 -- 172.21.15.5:0/3618501860 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7a2813fb20 con 0x7f7a2813e870 2024-08-18T21:13:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a2d5a8640 1 -- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a2813e870 msgr2=0x7f7a280a3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a2d5a8640 1 --2- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a2813e870 0x7f7a280a3f30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7a1801c190 tx=0x7f7a180a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a1e7fc640 1 -- 172.21.15.5:0/3618501860 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7a180b0070 con 0x7f7a2813e870 2024-08-18T21:13:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a1e7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:13:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a1e7fc640 10 monclient: dump: 2024-08-18T21:13:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.010 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a1e7fc640 1 -- 172.21.15.5:0/3618501860 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f7a180c0240 con 0x7f7a2813e870 2024-08-18T21:13:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a1e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a1e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a1e7fc640 1 -- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a2813e870 msgr2=0x7f7a280a3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a1e7fc640 1 --2- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a2813e870 0x7f7a280a3f30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7a1801c190 tx=0x7f7a180a8000 comp rx=0 tx=0).stop 2024-08-18T21:13:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a1e7fc640 1 -- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a2813e870 msgr2=0x7f7a280a3f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a1e7fc640 1 --2- 172.21.15.5:0/3618501860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a2813e870 0x7f7a280a3f30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.011 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:02.011 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:02.012 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:02.012 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:02.012 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:02.012 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 28991, 2024-08-18T21:13:02.012 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:02.012 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:02.012 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:02.012 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:02.012 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:02.012 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:02.012 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:02.012 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:02.012 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:02.013 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:02.013 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.013 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:13:02.013 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:02.013 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:02.013 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:02.013 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:02.013 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:02.013 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:02.013 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:02.013 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:02.013 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:02.013 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:02.014 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:02.014 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:02.014 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:02.014 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:02.014 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.014 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:02.014 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:02.014 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:02.014 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:02.014 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:02.014 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:02.014 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:02.014 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:02.015 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:02.015 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:02.015 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:02.015 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:02.015 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:02.015 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.015 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:02.015 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:02.015 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:02.015 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:02.015 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:02.016 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:02.016 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:02.016 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:02.016 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:02.016 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:02.016 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:02.016 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:02.016 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:02.016 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:02.016 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:02.016 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:02.016 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:02.016 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:02.016 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:02.017 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:02.017 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:02.017 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:02.017 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:02.017 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:02.017 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:02.017 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:02.017 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:02.017 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:02.017 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.017 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:02.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.018 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:02.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.018 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:02.018 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:02.018 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.018 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.018 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.018 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:02.018 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.018 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.019 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:02.019 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.019 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.019 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.019 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:02.019 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:02.019 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.019 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.019 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.019 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.020 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:02.020 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:02.020 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.020 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.020 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:02.020 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.020 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:02.020 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.021 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.021 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.021 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:02.021 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:02.021 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.021 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.021 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.021 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:02.021 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:02.021 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.021 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.022 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.022 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:02.022 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.022 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.022 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:02.022 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.022 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.022 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.022 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:02.023 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:02.023 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.023 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.023 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.023 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:02.023 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:02.023 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.023 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.023 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:02.024 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.024 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.024 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:02.024 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.024 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.024 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.024 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:02.024 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:02.024 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.024 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.025 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.025 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:02.025 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:02.025 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:02.025 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.026 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.026 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:02.026 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.026 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.026 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.026 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:02.026 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:02.026 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.026 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.026 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.027 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:02.027 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:02.027 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:02.027 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:02.028 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.028 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.028 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.028 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:02.028 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:02.028 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.028 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.028 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.028 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:02.028 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:02.028 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.029 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.029 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.029 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:02.029 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.029 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.029 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:02.029 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.029 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.029 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.030 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:02.030 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:02.030 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.030 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.030 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.030 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:02.030 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:02.030 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.030 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:02.031 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.031 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:02.031 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.031 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.031 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:02.031 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:02.031 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.031 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.032 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.032 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:02.032 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:02.032 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.032 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.032 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:02.032 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.033 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.033 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:02.033 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.033 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.033 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:02.033 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:02.033 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.033 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.033 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.033 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.034 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:02.034 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:02.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.034 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:02.034 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:02.034 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:02.034 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.034 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.034 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:02.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.034 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:02.034 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:02.034 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:02.034 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.035 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.035 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:02.035 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a3000d640 1 -- 172.21.15.5:0/3618501860 >> v2:172.21.15.157:6812/631023601 conn(0x7f7a0c03bdc0 msgr2=0x7f7a0c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a3000d640 1 --2- 172.21.15.5:0/3618501860 >> v2:172.21.15.157:6812/631023601 conn(0x7f7a0c03bdc0 0x7f7a0c03e280 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7a28140d70 tx=0x7f7a20008040 comp rx=0 tx=0).stop 2024-08-18T21:13:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a3000d640 10 monclient: shutdown 2024-08-18T21:13:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a3000d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a3000d640 1 -- 172.21.15.5:0/3618501860 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a2809f080 msgr2=0x7f7a281383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a3000d640 1 --2- 172.21.15.5:0/3618501860 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f7a2809f080 0x7f7a281383c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7a24007f20 tx=0x7f7a2400e570 comp rx=0 tx=0).stop 2024-08-18T21:13:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a2e5aa640 1 -- 172.21.15.5:0/3618501860 reap_dead start 2024-08-18T21:13:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a2e5aa640 1 -- 172.21.15.5:0/3618501860 reap_dead start 2024-08-18T21:13:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a3000d640 1 -- 172.21.15.5:0/3618501860 shutdown_connections 2024-08-18T21:13:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a3000d640 1 -- 172.21.15.5:0/3618501860 >> 172.21.15.5:0/3618501860 conn(0x7f7a28068700 msgr2=0x7f7a281416b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a3000d640 1 -- 172.21.15.5:0/3618501860 shutdown_connections 2024-08-18T21:13:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.007+0000 7f7a3000d640 1 -- 172.21.15.5:0/3618501860 wait complete. 2024-08-18T21:13:02.037 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:02.037 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:13:02.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:13:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 10 monclient: get_monmap_and_config 2024-08-18T21:13:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 10 monclient: build_initial_monmap 2024-08-18T21:13:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 10 monclient: monmap: 2024-08-18T21:13:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:02.165364+0000 2024-08-18T21:13:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:02.165364+0000 2024-08-18T21:13:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:02.163 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 1 Processor -- start 2024-08-18T21:13:02.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 1 -- start start 2024-08-18T21:13:02.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 10 monclient: init 2024-08-18T21:13:02.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:02.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 10 monclient: _add_conns ranks=[0,1,4,7,2,10,3,9,6,8,5] 2024-08-18T21:13:02.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb17c0a6bd0 addr v1:172.21.15.5:6789/0 2024-08-18T21:13:02.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fb17c09f080 addr v1:172.21.15.157:6789/0 2024-08-18T21:13:02.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb17c0a76c0 0x7fb17c142510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 10 monclient(hunting): picked mon.noname-c con 0x7fb17c0a76c0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:13:02.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb17c0a7fb0 con 0x7fb17c0a6bd0 2024-08-18T21:13:02.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb17c09de70 con 0x7fb17c09f080 2024-08-18T21:13:02.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fb17c09e4c0 con 0x7fb17c0a76c0 2024-08-18T21:13:02.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:02.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb1838cc640 10 monclient(hunting): authenticate will time out at 1549.178944s 2024-08-18T21:13:02.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181668640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb17c0a6bd0 0x7fb17c0a6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39066/0 (socket says 172.21.15.5:39066) 2024-08-18T21:13:02.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181668640 1 -- 172.21.15.5:0/890302104 learned_addr learned my addr 172.21.15.5:0/890302104 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:13:02.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181e69640 1 --2- 172.21.15.5:0/890302104 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb17c0a76c0 0x7fb17c142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181e69640 10 monclient(hunting): get_auth_request con 0x7fb17c0a76c0 auth_method 0 2024-08-18T21:13:02.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181e69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181e69640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181e69640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181e69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181e69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181e69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181e69640 10 monclient(hunting): handle_auth_done global_id 114439 payload 274 2024-08-18T21:13:02.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181e69640 1 -- 172.21.15.5:0/890302104 >> v1:172.21.15.157:6789/0 conn(0x7fb17c09f080 legacy=0x7fb17c13ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:02.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181e69640 1 -- 172.21.15.5:0/890302104 >> v1:172.21.15.5:6789/0 conn(0x7fb17c0a6bd0 legacy=0x7fb17c0a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:02.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181e69640 10 monclient: _finish_hunting 0 2024-08-18T21:13:02.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181e69640 1 monclient: found mon.noname-c 2024-08-18T21:13:02.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181e69640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:02.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181e69640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:13:02.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.163+0000 7fb181e69640 1 -- 172.21.15.5:0/890302104 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17c06f280 con 0x7fb17c0a76c0 2024-08-18T21:13:02.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb181e69640 1 -- 172.21.15.5:0/890302104 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb17c0a76c0 msgr2=0x7fb17c142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:02.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb181e69640 1 --2- 172.21.15.5:0/890302104 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb17c0a76c0 0x7fb17c142510 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb174009dc0 tx=0x7fb17401c7f0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=b6fc0a435e1e4ae6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb173fff640 1 -- 172.21.15.5:0/890302104 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb1740ac070 con 0x7fb17c0a76c0 2024-08-18T21:13:02.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb173fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb173fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:13:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb173fff640 10 monclient: dump: 2024-08-18T21:13:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.171 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.171 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.171 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.171 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.171 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.171 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb173fff640 10 monclient: _finish_auth 0 2024-08-18T21:13:02.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb173fff640 10 monclient: _check_auth_tickets 2024-08-18T21:13:02.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb173fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:02.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb173fff640 1 -- 172.21.15.5:0/890302104 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1740a6970 con 0x7fb17c0a76c0 2024-08-18T21:13:02.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb1838cc640 5 monclient: authenticate success, global_id 114439 2024-08-18T21:13:02.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb1838cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:13:02.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb173fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:02.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb173fff640 1 -- 172.21.15.5:0/890302104 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb1740a7400 con 0x7fb17c0a76c0 2024-08-18T21:13:02.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb1838cc640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:02.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb1838cc640 4 set_mon_vals no callback set 2024-08-18T21:13:02.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb173fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb173fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:13:02.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.167+0000 7fb173fff640 10 monclient: dump: 2024-08-18T21:13:02.172 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.172 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.172 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.172 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.172 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.172 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.172 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.172 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.173 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.173 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.173 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.173 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.173 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.173 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.173 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.173 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 10 monclient: shutdown 2024-08-18T21:13:02.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:02.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 1 -- 172.21.15.5:0/890302104 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb17c0a76c0 msgr2=0x7fb17c142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 1 --2- 172.21.15.5:0/890302104 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb17c0a76c0 0x7fb17c142510 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb174009dc0 tx=0x7fb17401c7f0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 1 -- 172.21.15.5:0/890302104 shutdown_connections 2024-08-18T21:13:02.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 1 --2- 172.21.15.5:0/890302104 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fb17c0a76c0 0x7fb17c142510 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 1 -- 172.21.15.5:0/890302104 >> 172.21.15.5:0/890302104 conn(0x7fb17c068700 msgr2=0x7fb17c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:02.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 1 -- 172.21.15.5:0/890302104 shutdown_connections 2024-08-18T21:13:02.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 1 -- 172.21.15.5:0/890302104 wait complete. 2024-08-18T21:13:02.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 10 monclient: build_initial_monmap 2024-08-18T21:13:02.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 10 monclient: monmap: 2024-08-18T21:13:02.174 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:02.174 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:02.174 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:02.174 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:02.174 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:02.174 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.174 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:02.174 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:02.175 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:02.175 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:02.175 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:02.175 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:02.175 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:02.175 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:02.175 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:02.175 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 1 Processor -- start 2024-08-18T21:13:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 1 -- start start 2024-08-18T21:13:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 10 monclient: init 2024-08-18T21:13:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 10 monclient: _add_conns ranks=[8,1,6,7,3,4,5,2,0] 2024-08-18T21:13:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb17c09f080 0x7fb17c1d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 10 monclient(hunting): picked mon.noname-e con 0x7fb17c09f080 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb17c0a6bd0 0x7fb17c1d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 10 monclient(hunting): picked mon.noname-f con 0x7fb17c0a6bd0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:13:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb17c0a76c0 0x7fb17c1d2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 10 monclient(hunting): picked mon.noname-d con 0x7fb17c0a76c0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c145a10 con 0x7fb17c0a6bd0 2024-08-18T21:13:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fb17c145890 con 0x7fb17c0a76c0 2024-08-18T21:13:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fb17c145b90 con 0x7fb17c09f080 2024-08-18T21:13:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb1838cc640 10 monclient(hunting): authenticate will time out at 1549.186298s 2024-08-18T21:13:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb17c09f080 0x7fb17c1d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181e69640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb17c0a76c0 0x7fb17c1d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb17c09f080 0x7fb17c1d1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:53736/0 (socket says 172.21.15.5:53736) 2024-08-18T21:13:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 1 -- 172.21.15.5:0/4190987109 learned_addr learned my addr 172.21.15.5:0/4190987109 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 10 monclient(hunting): get_auth_request con 0x7fb17c09f080 auth_method 0 2024-08-18T21:13:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181e69640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb17c0a76c0 0x7fb17c1d2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:41578/0 (socket says 172.21.15.5:41578) 2024-08-18T21:13:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181e69640 10 monclient(hunting): get_auth_request con 0x7fb17c0a76c0 auth_method 0 2024-08-18T21:13:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181e69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181e69640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181e69640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181e69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181e69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181e69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb180e67640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb17c0a6bd0 0x7fb17c1d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb180e67640 10 monclient(hunting): get_auth_request con 0x7fb17c0a6bd0 auth_method 0 2024-08-18T21:13:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb180e67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb180e67640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb180e67640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 10 monclient(hunting): handle_auth_done global_id 114641 payload 824 2024-08-18T21:13:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 1 -- 172.21.15.5:0/4190987109 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb17c0a76c0 msgr2=0x7fb17c1d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb17c0a76c0 0x7fb17c1d2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 1 -- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb17c0a6bd0 msgr2=0x7fb17c1d1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb17c0a6bd0 0x7fb17c1d1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 10 monclient: _finish_hunting 0 2024-08-18T21:13:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 1 monclient: found mon.noname-e 2024-08-18T21:13:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:13:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181668640 1 -- 172.21.15.5:0/4190987109 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17c12a110 con 0x7fb17c09f080 2024-08-18T21:13:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.171+0000 7fb181e69640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb17c0a76c0 0x7fb17c1d2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb181668640 1 -- 172.21.15.5:0/4190987109 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb17c09f080 msgr2=0x7fb17c1d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb181668640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb17c09f080 0x7fb17c1d1a90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb17800c470 tx=0x7fb17800c930 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb171ffb640 1 -- 172.21.15.5:0/4190987109 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb178005d00 con 0x7fb17c09f080 2024-08-18T21:13:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb171ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb171ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:13:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb171ffb640 10 monclient: dump: 2024-08-18T21:13:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.187 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb171ffb640 10 monclient: _finish_auth 0 2024-08-18T21:13:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb171ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:13:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb171ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb171ffb640 1 -- 172.21.15.5:0/4190987109 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1780074e0 con 0x7fb17c09f080 2024-08-18T21:13:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb1838cc640 5 monclient: authenticate success, global_id 114641 2024-08-18T21:13:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb1838cc640 10 monclient: _renew_subs 2024-08-18T21:13:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb1838cc640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb1838cc640 1 -- 172.21.15.5:0/4190987109 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17c0a62f0 con 0x7fb17c09f080 2024-08-18T21:13:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb171ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb171ffb640 1 -- 172.21.15.5:0/4190987109 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb178007690 con 0x7fb17c09f080 2024-08-18T21:13:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb171ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb172ffd640 4 set_mon_vals no callback set 2024-08-18T21:13:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb171ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb171ffb640 10 monclient: dump: 2024-08-18T21:13:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.189 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb1838cc640 10 monclient: _renew_subs 2024-08-18T21:13:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb1838cc640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb1838cc640 1 -- 172.21.15.5:0/4190987109 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fb17c128090 con 0x7fb17c09f080 2024-08-18T21:13:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb1838cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb1838cc640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb17c1265e0 0x7fb17c1269c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb1838cc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb1838cc640 1 -- 172.21.15.5:0/4190987109 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb17c051140 con 0x7fb17c1265e0 2024-08-18T21:13:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb180e67640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb17c1265e0 0x7fb17c1269c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb171ffb640 1 -- 172.21.15.5:0/4190987109 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fb178007070 con 0x7fb17c09f080 2024-08-18T21:13:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb180e67640 10 monclient: get_auth_request con 0x7fb17c1265e0 auth_method 0 2024-08-18T21:13:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb180e67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb180e67640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb180e67640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb180e67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb180e67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb180e67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb171ffb640 1 --2- 172.21.15.5:0/4190987109 >> v2:172.21.15.157:6812/631023601 conn(0x7fb16003bdc0 0x7fb16003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb171ffb640 1 -- 172.21.15.5:0/4190987109 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(262..262 src has 22..262) ==== 3506+0+0 (secure 0 0 0) 0x7fb17804e1a0 con 0x7fb17c09f080 2024-08-18T21:13:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb180e67640 10 monclient(hunting): handle_auth_done global_id 124131 payload 824 2024-08-18T21:13:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb180e67640 1 -- 172.21.15.5:0/4190987109 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb17c0a6fb0 con 0x7fb17c1265e0 2024-08-18T21:13:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb181e69640 1 --2- 172.21.15.5:0/4190987109 >> v2:172.21.15.157:6812/631023601 conn(0x7fb16003bdc0 0x7fb16003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.175+0000 7fb181e69640 10 monclient: get_auth_request con 0x7fb16003bdc0 auth_method 0 2024-08-18T21:13:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.179+0000 7fb180e67640 1 -- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb17c1265e0 msgr2=0x7fb17c1269c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.179+0000 7fb180e67640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb17c1265e0 0x7fb17c1269c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb17c128700 tx=0x7fb16c00e8b0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.179+0000 7fb181e69640 1 --2- 172.21.15.5:0/4190987109 >> v2:172.21.15.157:6812/631023601 conn(0x7fb16003bdc0 0x7fb16003e280 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb1740ae000 tx=0x7fb1740a7000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.179+0000 7fb171ffb640 1 -- 172.21.15.5:0/4190987109 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb16c006c50 con 0x7fb17c1265e0 2024-08-18T21:13:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.179+0000 7fb171ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.179+0000 7fb171ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:13:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.179+0000 7fb171ffb640 10 monclient: dump: 2024-08-18T21:13:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.192 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.179+0000 7fb171ffb640 1 -- 172.21.15.5:0/4190987109 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb16c007450 con 0x7fb17c1265e0 2024-08-18T21:13:02.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.179+0000 7fb171ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:02.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.179+0000 7fb171ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:02.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.179+0000 7fb171ffb640 1 -- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb17c1265e0 msgr2=0x7fb17c1269c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.179+0000 7fb171ffb640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb17c1265e0 0x7fb17c1269c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb17c128700 tx=0x7fb16c00e8b0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.179+0000 7fb171ffb640 1 -- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb17c1265e0 msgr2=0x7fb17c1269c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:02.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.179+0000 7fb171ffb640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb17c1265e0 0x7fb17c1269c0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb17c128700 tx=0x7fb16c00e8b0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.187+0000 7fb1838cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.187+0000 7fb1838cc640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb17c126f00 0x7fb17c0a20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.187+0000 7fb1838cc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.187+0000 7fb1838cc640 1 -- 172.21.15.5:0/4190987109 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb17c0746d0 con 0x7fb17c126f00 2024-08-18T21:13:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.187+0000 7fb180e67640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb17c126f00 0x7fb17c0a20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.187+0000 7fb180e67640 10 monclient: get_auth_request con 0x7fb17c126f00 auth_method 0 2024-08-18T21:13:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.187+0000 7fb180e67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.187+0000 7fb180e67640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.187+0000 7fb180e67640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.187+0000 7fb180e67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.187+0000 7fb180e67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.187+0000 7fb180e67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.187+0000 7fb180e67640 10 monclient(hunting): handle_auth_done global_id 124140 payload 824 2024-08-18T21:13:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.187+0000 7fb180e67640 1 -- 172.21.15.5:0/4190987109 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb17c127310 con 0x7fb17c126f00 2024-08-18T21:13:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb180e67640 1 -- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb17c126f00 msgr2=0x7fb17c0a20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb180e67640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb17c126f00 0x7fb17c0a20e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb17c128700 tx=0x7fb16c003770 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb171ffb640 1 -- 172.21.15.5:0/4190987109 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb16c01ebd0 con 0x7fb17c126f00 2024-08-18T21:13:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb171ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb171ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:13:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb171ffb640 10 monclient: dump: 2024-08-18T21:13:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.197 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb171ffb640 1 -- 172.21.15.5:0/4190987109 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7fb16c01e760 con 0x7fb17c126f00 2024-08-18T21:13:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb171ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb171ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:02.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb171ffb640 1 -- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb17c126f00 msgr2=0x7fb17c0a20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb171ffb640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb17c126f00 0x7fb17c0a20e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb17c128700 tx=0x7fb16c003770 comp rx=0 tx=0).stop 2024-08-18T21:13:02.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb171ffb640 1 -- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb17c126f00 msgr2=0x7fb17c0a20e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:02.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb171ffb640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb17c126f00 0x7fb17c0a20e0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb17c128700 tx=0x7fb16c003770 comp rx=0 tx=0).stop 2024-08-18T21:13:02.198 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:02.198 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:02.198 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:02.198 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:02.198 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:02.198 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 29171, 2024-08-18T21:13:02.199 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:02.199 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:02.199 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:02.199 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:02.199 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:02.199 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:02.199 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:02.199 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:02.199 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:02.199 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:02.199 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.199 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:13:02.199 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:02.200 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:02.200 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:02.200 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:02.200 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:02.200 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:02.200 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:02.200 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:02.200 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:02.200 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:02.200 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:02.200 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:02.200 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:02.200 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:02.200 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.200 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:02.201 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:02.201 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:02.201 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:02.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:02.201 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:02.201 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:02.201 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:02.201 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:02.201 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:02.201 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:02.201 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:02.201 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:02.202 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.202 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:02.202 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:02.202 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:02.202 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:02.202 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:02.202 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:02.202 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:02.202 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:02.202 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:02.202 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:02.203 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:02.203 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:02.203 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:02.203 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:02.203 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:02.203 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:02.203 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:02.203 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:02.203 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:02.203 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:02.203 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:02.203 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:02.203 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:02.204 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:02.204 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:02.204 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:02.204 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:02.204 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:02.204 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.204 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:02.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:02.204 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.204 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:02.204 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:02.204 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:02.205 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:02.205 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.205 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.206 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.206 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:02.206 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:02.206 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.206 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.206 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.206 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:02.206 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:02.207 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:02.207 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:02.207 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.207 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.208 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.208 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:02.208 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:02.208 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.208 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.208 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.208 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:02.208 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:02.208 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.208 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.209 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.209 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:02.209 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.209 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.209 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:02.209 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.209 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.209 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.210 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:02.210 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:02.210 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.210 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.210 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.210 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:02.210 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:02.210 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.210 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.211 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.211 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.211 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:02.211 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.211 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.211 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.211 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:02.211 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.211 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.211 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.211 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:02.212 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:02.212 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.212 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.212 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.212 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.212 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:02.212 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:02.212 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.212 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.212 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.212 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:02.213 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.213 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.213 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:02.213 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.213 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.213 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.213 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:02.213 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:02.213 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.213 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.213 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.214 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:02.214 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:02.214 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.214 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.214 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.214 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:02.214 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.214 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.215 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:02.215 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.215 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.215 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.215 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:02.215 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:02.215 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.215 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.215 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.215 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:02.215 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:02.216 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.216 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.216 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.216 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.216 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:02.216 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.216 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.216 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.216 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:02.216 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.216 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.216 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.217 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:02.217 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:02.217 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.217 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.217 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.217 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.217 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:02.217 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:02.217 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.217 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.217 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.217 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.217 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:02.217 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.218 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.218 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:02.218 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.218 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.218 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.218 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:02.218 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:02.218 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.218 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.219 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.219 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.219 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:02.219 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:02.219 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.219 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.219 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.219 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.219 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:02.219 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.220 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.220 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.220 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:02.220 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.220 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.220 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.220 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:02.220 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:02.220 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.220 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.220 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.220 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.220 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.221 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:02.221 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:02.221 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.221 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:02.221 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:02.221 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:02.221 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.221 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.221 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:13:02.221 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.221 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:02.221 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:02.221 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:02.221 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.222 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.222 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:02.222 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.222 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:02.222 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:02.222 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:02.222 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.222 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.222 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:02.222 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb1838cc640 1 -- 172.21.15.5:0/4190987109 >> v2:172.21.15.157:6812/631023601 conn(0x7fb16003bdc0 msgr2=0x7fb16003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb1838cc640 1 --2- 172.21.15.5:0/4190987109 >> v2:172.21.15.157:6812/631023601 conn(0x7fb16003bdc0 0x7fb16003e280 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb1740ae000 tx=0x7fb1740a7000 comp rx=0 tx=0).stop 2024-08-18T21:13:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb1838cc640 10 monclient: shutdown 2024-08-18T21:13:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb1838cc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb1838cc640 1 -- 172.21.15.5:0/4190987109 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb17c09f080 msgr2=0x7fb17c1d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb1838cc640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb17c09f080 0x7fb17c1d1a90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb17800c470 tx=0x7fb17800c930 comp rx=0 tx=0).stop 2024-08-18T21:13:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb181e69640 1 -- 172.21.15.5:0/4190987109 reap_dead start 2024-08-18T21:13:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb1838cc640 1 -- 172.21.15.5:0/4190987109 shutdown_connections 2024-08-18T21:13:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb1838cc640 1 --2- 172.21.15.5:0/4190987109 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fb17c09f080 0x7fb17c1d1a90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb1838cc640 1 -- 172.21.15.5:0/4190987109 >> 172.21.15.5:0/4190987109 conn(0x7fb17c068700 msgr2=0x7fb17c0a4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb1838cc640 1 -- 172.21.15.5:0/4190987109 shutdown_connections 2024-08-18T21:13:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.191+0000 7fb1838cc640 1 -- 172.21.15.5:0/4190987109 wait complete. 2024-08-18T21:13:02.226 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:02.226 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:13:02.226 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:13:02.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 10 monclient: get_monmap_and_config 2024-08-18T21:13:02.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 10 monclient: build_initial_monmap 2024-08-18T21:13:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 10 monclient: monmap: 2024-08-18T21:13:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:02.349274+0000 2024-08-18T21:13:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:02.349274+0000 2024-08-18T21:13:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:02.347 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 1 Processor -- start 2024-08-18T21:13:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 1 -- start start 2024-08-18T21:13:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 10 monclient: init 2024-08-18T21:13:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 10 monclient: _add_conns ranks=[1,8,2,9,6,0,10,7,3,4,5] 2024-08-18T21:13:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fc9cc0a4b40 addr v1:172.21.15.157:6789/0 2024-08-18T21:13:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc9cc071ad0 0x7fc9cc073850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 10 monclient(hunting): picked mon.noname-e con 0x7fc9cc071ad0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9cc0a5630 0x7fc9cc13eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 10 monclient(hunting): picked mon.noname-b con 0x7fc9cc0a5630 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9cc0a62f0 con 0x7fc9cc0a4b40 2024-08-18T21:13:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fc9cc072770 con 0x7fc9cc0a5630 2024-08-18T21:13:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fc9cc072a50 con 0x7fc9cc071ad0 2024-08-18T21:13:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9d0ef3640 10 monclient(hunting): authenticate will time out at 1549.363182s 2024-08-18T21:13:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc9cc071ad0 0x7fc9cc073850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9cad9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9cc0a5630 0x7fc9cc13eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc9cc071ad0 0x7fc9cc073850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:53752/0 (socket says 172.21.15.5:53752) 2024-08-18T21:13:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 1 -- 172.21.15.5:0/3870098050 learned_addr learned my addr 172.21.15.5:0/3870098050 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 10 monclient(hunting): get_auth_request con 0x7fc9cc071ad0 auth_method 0 2024-08-18T21:13:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9cad9d640 10 monclient(hunting): get_auth_request con 0x7fc9cc0a5630 auth_method 0 2024-08-18T21:13:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9cad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9cad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9cad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9cad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9cad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9cad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 10 monclient(hunting): handle_auth_done global_id 114650 payload 274 2024-08-18T21:13:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 1 -- 172.21.15.5:0/3870098050 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9cc0a5630 msgr2=0x7fc9cc13eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 1 --2- 172.21.15.5:0/3870098050 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9cc0a5630 0x7fc9cc13eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 1 -- 172.21.15.5:0/3870098050 >> v1:172.21.15.157:6789/0 conn(0x7fc9cc0a4b40 legacy=0x7fc9cc0a4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 10 monclient: _finish_hunting 0 2024-08-18T21:13:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 1 monclient: found mon.noname-e 2024-08-18T21:13:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:13:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9c3fff640 1 -- 172.21.15.5:0/3870098050 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc1400a0 con 0x7fc9cc071ad0 2024-08-18T21:13:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.347+0000 7fc9cad9d640 1 --2- 172.21.15.5:0/3870098050 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9cc0a5630 0x7fc9cc13eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:02.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.351+0000 7fc9c3fff640 1 -- 172.21.15.5:0/3870098050 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc9cc071ad0 msgr2=0x7fc9cc073850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:02.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.351+0000 7fc9c3fff640 1 --2- 172.21.15.5:0/3870098050 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc9cc071ad0 0x7fc9cc073850 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40098a0 tx=0x7fc9b401c4d0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=a30553d9d9753dc7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c9d9b640 1 -- 172.21.15.5:0/3870098050 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9b40b0070 con 0x7fc9cc071ad0 2024-08-18T21:13:02.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c9d9b640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:13:02.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c9d9b640 10 monclient: dump: 2024-08-18T21:13:02.358 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.358 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.358 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.358 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.358 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.359 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.359 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.359 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.359 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.359 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.359 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.359 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.359 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.359 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.359 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.359 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c9d9b640 10 monclient: _finish_auth 0 2024-08-18T21:13:02.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c9d9b640 10 monclient: _check_auth_tickets 2024-08-18T21:13:02.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c9d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:02.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c9d9b640 1 -- 172.21.15.5:0/3870098050 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b40a9980 con 0x7fc9cc071ad0 2024-08-18T21:13:02.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 5 monclient: authenticate success, global_id 114650 2024-08-18T21:13:02.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:13:02.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c9d9b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:02.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:02.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 4 set_mon_vals no callback set 2024-08-18T21:13:02.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c9d9b640 1 -- 172.21.15.5:0/3870098050 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9b40aa3a0 con 0x7fc9cc071ad0 2024-08-18T21:13:02.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c9d9b640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:02.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c9d9b640 10 monclient: dump: 2024-08-18T21:13:02.361 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.361 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.361 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.361 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.361 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.361 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.361 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.361 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.361 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.361 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.361 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.361 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.361 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.361 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.362 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.362 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 10 monclient: shutdown 2024-08-18T21:13:02.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:02.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 1 -- 172.21.15.5:0/3870098050 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc9cc071ad0 msgr2=0x7fc9cc073850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 1 --2- 172.21.15.5:0/3870098050 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc9cc071ad0 0x7fc9cc073850 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40098a0 tx=0x7fc9b401c4d0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 1 -- 172.21.15.5:0/3870098050 shutdown_connections 2024-08-18T21:13:02.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 1 --2- 172.21.15.5:0/3870098050 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc9cc0a5630 0x7fc9cc13eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 1 --2- 172.21.15.5:0/3870098050 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc9cc071ad0 0x7fc9cc073850 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 1 -- 172.21.15.5:0/3870098050 >> 172.21.15.5:0/3870098050 conn(0x7fc9cc069090 msgr2=0x7fc9cc0aa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:02.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 1 -- 172.21.15.5:0/3870098050 shutdown_connections 2024-08-18T21:13:02.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 1 -- 172.21.15.5:0/3870098050 wait complete. 2024-08-18T21:13:02.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 10 monclient: build_initial_monmap 2024-08-18T21:13:02.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 10 monclient: monmap: 2024-08-18T21:13:02.363 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:02.363 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:02.363 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:02.363 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:02.363 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:02.363 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.363 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:02.364 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:02.364 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:02.364 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:02.364 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:02.364 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:02.364 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:02.364 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:02.364 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:02.364 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 1 Processor -- start 2024-08-18T21:13:02.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 1 -- start start 2024-08-18T21:13:02.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 10 monclient: init 2024-08-18T21:13:02.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 10 monclient: _add_conns ranks=[7,0,5,8,4,1,3,6,2] 2024-08-18T21:13:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc9cc071ad0 0x7fc9cc124360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 10 monclient(hunting): picked mon.noname-i con 0x7fc9cc071ad0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9cc0a4b40 0x7fc9cc1248a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 10 monclient(hunting): picked mon.noname-a con 0x7fc9cc0a4b40 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:13:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc0a5630 0x7fc9cc124de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 10 monclient(hunting): picked mon.noname-h con 0x7fc9cc0a5630 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc13fc30 con 0x7fc9cc0a4b40 2024-08-18T21:13:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fc9cc13fab0 con 0x7fc9cc0a5630 2024-08-18T21:13:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fc9cc13fdb0 con 0x7fc9cc071ad0 2024-08-18T21:13:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9d0ef3640 10 monclient(hunting): authenticate will time out at 1549.370448s 2024-08-18T21:13:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9cc0a4b40 0x7fc9cc1248a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9cc0a4b40 0x7fc9cc1248a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43462/0 (socket says 172.21.15.5:43462) 2024-08-18T21:13:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 1 -- 172.21.15.5:0/3570277429 learned_addr learned my addr 172.21.15.5:0/3570277429 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 10 monclient(hunting): get_auth_request con 0x7fc9cc0a4b40 auth_method 0 2024-08-18T21:13:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9ca59c640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc9cc071ad0 0x7fc9cc124360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9cad9d640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc0a5630 0x7fc9cc124de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9cad9d640 10 monclient(hunting): get_auth_request con 0x7fc9cc0a5630 auth_method 0 2024-08-18T21:13:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9cad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9cad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9cad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 10 monclient(hunting): handle_auth_done global_id 124209 payload 824 2024-08-18T21:13:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 1 -- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc9cc071ad0 msgr2=0x7fc9cc124360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc9cc071ad0 0x7fc9cc124360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 1 -- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc0a5630 msgr2=0x7fc9cc124de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc0a5630 0x7fc9cc124de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 10 monclient: _finish_hunting 0 2024-08-18T21:13:02.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 1 monclient: found mon.noname-a 2024-08-18T21:13:02.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:02.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:13:02.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9c3fff640 1 -- 172.21.15.5:0/3570277429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc1272c0 con 0x7fc9cc0a4b40 2024-08-18T21:13:02.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9ca59c640 10 monclient: get_auth_request con 0x7fc9cc071ad0 auth_method 0 2024-08-18T21:13:02.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.355+0000 7fc9ca59c640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc9cc071ad0 0x7fc9cc124360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:13:02.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9c3fff640 1 -- 172.21.15.5:0/3570277429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9cc0a4b40 msgr2=0x7fc9cc1248a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:02.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9c3fff640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9cc0a4b40 0x7fc9cc1248a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40097c0 tx=0x7fc9b4019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9c2ffd640 1 -- 172.21.15.5:0/3570277429 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9b40ba070 con 0x7fc9cc0a4b40 2024-08-18T21:13:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9c2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:13:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9c2ffd640 10 monclient: dump: 2024-08-18T21:13:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.372 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9c2ffd640 10 monclient: _finish_auth 0 2024-08-18T21:13:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9c2ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:13:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9c2ffd640 1 -- 172.21.15.5:0/3570277429 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b40b1040 con 0x7fc9cc0a4b40 2024-08-18T21:13:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9c2ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9d0ef3640 5 monclient: authenticate success, global_id 124209 2024-08-18T21:13:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9c2ffd640 1 -- 172.21.15.5:0/3570277429 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9b40b0070 con 0x7fc9cc0a4b40 2024-08-18T21:13:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9c2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:13:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9c959a640 4 set_mon_vals no callback set 2024-08-18T21:13:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9c2ffd640 10 monclient: dump: 2024-08-18T21:13:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.374 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9d0ef3640 10 monclient: _renew_subs 2024-08-18T21:13:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9d0ef3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:13:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.359+0000 7fc9d0ef3640 1 -- 172.21.15.5:0/3570277429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9cc125dd0 con 0x7fc9cc0a4b40 2024-08-18T21:13:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9d0ef3640 10 monclient: _renew_subs 2024-08-18T21:13:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9d0ef3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:13:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9d0ef3640 1 -- 172.21.15.5:0/3570277429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9cc13eae0 con 0x7fc9cc0a4b40 2024-08-18T21:13:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9d0ef3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9d0ef3640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc1cf010 0x7fc9cc1cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9d0ef3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9d0ef3640 1 -- 172.21.15.5:0/3570277429 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fc9cc051140 con 0x7fc9cc1cf010 2024-08-18T21:13:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9c2ffd640 1 -- 172.21.15.5:0/3570277429 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fc9b4003620 con 0x7fc9cc0a4b40 2024-08-18T21:13:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9ca59c640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc1cf010 0x7fc9cc1cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9ca59c640 10 monclient: get_auth_request con 0x7fc9cc1cf010 auth_method 0 2024-08-18T21:13:02.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9ca59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9ca59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9ca59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9ca59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9ca59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9ca59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9c2ffd640 1 --2- 172.21.15.5:0/3570277429 >> v2:172.21.15.157:6812/631023601 conn(0x7fc9b003bdc0 0x7fc9b003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9c2ffd640 1 -- 172.21.15.5:0/3570277429 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(262..262 src has 22..262) ==== 3506+0+0 (secure 0 0 0) 0x7fc9b40e7c00 con 0x7fc9cc0a4b40 2024-08-18T21:13:02.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9ca59c640 10 monclient(hunting): handle_auth_done global_id 95117 payload 824 2024-08-18T21:13:02.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9ca59c640 1 -- 172.21.15.5:0/3570277429 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9cc0a8fc0 con 0x7fc9cc1cf010 2024-08-18T21:13:02.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9cad9d640 1 --2- 172.21.15.5:0/3570277429 >> v2:172.21.15.157:6812/631023601 conn(0x7fc9b003bdc0 0x7fc9b003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.363+0000 7fc9cad9d640 10 monclient: get_auth_request con 0x7fc9b003bdc0 auth_method 0 2024-08-18T21:13:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.367+0000 7fc9ca59c640 1 -- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc1cf010 msgr2=0x7fc9cc1cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.367+0000 7fc9ca59c640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc1cf010 0x7fc9cc1cf3f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00d480 tx=0x7fc9bc00d940 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.367+0000 7fc9c2ffd640 1 -- 172.21.15.5:0/3570277429 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9bc012c80 con 0x7fc9cc1cf010 2024-08-18T21:13:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.367+0000 7fc9c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.367+0000 7fc9c2ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:13:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.367+0000 7fc9c2ffd640 10 monclient: dump: 2024-08-18T21:13:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.378 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.378 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.378 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.378 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.378 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.378 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.378 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.378 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.378 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.367+0000 7fc9cad9d640 1 --2- 172.21.15.5:0/3570277429 >> v2:172.21.15.157:6812/631023601 conn(0x7fc9b003bdc0 0x7fc9b003e280 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4007440 tx=0x7fc9c400b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.367+0000 7fc9c2ffd640 1 -- 172.21.15.5:0/3570277429 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc9bc012810 con 0x7fc9cc1cf010 2024-08-18T21:13:02.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.367+0000 7fc9c2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:02.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.367+0000 7fc9c2ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:02.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.367+0000 7fc9c2ffd640 1 -- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc1cf010 msgr2=0x7fc9cc1cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.367+0000 7fc9c2ffd640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc1cf010 0x7fc9cc1cf3f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00d480 tx=0x7fc9bc00d940 comp rx=0 tx=0).stop 2024-08-18T21:13:02.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.367+0000 7fc9c2ffd640 1 -- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc1cf010 msgr2=0x7fc9cc1cf3f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:02.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.367+0000 7fc9c2ffd640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc1cf010 0x7fc9cc1cf3f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.371+0000 7fc9d0ef3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.371+0000 7fc9d0ef3640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc1cf930 0x7fc9cc120790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.371+0000 7fc9d0ef3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.371+0000 7fc9d0ef3640 1 -- 172.21.15.5:0/3570277429 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fc9cc0777d0 con 0x7fc9cc1cf930 2024-08-18T21:13:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.371+0000 7fc9ca59c640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc1cf930 0x7fc9cc120790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.371+0000 7fc9ca59c640 10 monclient: get_auth_request con 0x7fc9cc1cf930 auth_method 0 2024-08-18T21:13:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.371+0000 7fc9ca59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.371+0000 7fc9ca59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.371+0000 7fc9ca59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.371+0000 7fc9ca59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.371+0000 7fc9ca59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.371+0000 7fc9ca59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.375+0000 7fc9ca59c640 10 monclient(hunting): handle_auth_done global_id 95126 payload 824 2024-08-18T21:13:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.375+0000 7fc9ca59c640 1 -- 172.21.15.5:0/3570277429 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc9cc073040 con 0x7fc9cc1cf930 2024-08-18T21:13:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.375+0000 7fc9ca59c640 1 -- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc1cf930 msgr2=0x7fc9cc120790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.375+0000 7fc9ca59c640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc1cf930 0x7fc9cc120790 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc017000 tx=0x7fc9bc003770 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.375+0000 7fc9c2ffd640 1 -- 172.21.15.5:0/3570277429 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9bc007450 con 0x7fc9cc1cf930 2024-08-18T21:13:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.375+0000 7fc9c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.375+0000 7fc9c2ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:13:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.375+0000 7fc9c2ffd640 10 monclient: dump: 2024-08-18T21:13:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.383 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.383 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.383 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.383 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.383 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.383 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.383 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.383 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.383 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.383 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.383 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.383 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9c2ffd640 1 -- 172.21.15.5:0/3570277429 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7fc9bc007450 con 0x7fc9cc1cf930 2024-08-18T21:13:02.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9c2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:02.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9c2ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:02.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9c2ffd640 1 -- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc1cf930 msgr2=0x7fc9cc120790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9c2ffd640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc1cf930 0x7fc9cc120790 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc017000 tx=0x7fc9bc003770 comp rx=0 tx=0).stop 2024-08-18T21:13:02.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9c2ffd640 1 -- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc1cf930 msgr2=0x7fc9cc120790 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:02.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9c2ffd640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9cc1cf930 0x7fc9cc120790 secure :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc017000 tx=0x7fc9bc003770 comp rx=0 tx=0).stop 2024-08-18T21:13:02.384 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:02.384 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:02.384 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:02.384 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:02.385 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:02.385 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 210412, 2024-08-18T21:13:02.385 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:02.385 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:02.385 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:02.385 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:02.385 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:02.385 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:02.385 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:02.385 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:02.385 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:02.385 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:02.386 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.386 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 3, 2024-08-18T21:13:02.386 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:02.386 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:02.386 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:02.386 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:02.386 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:02.386 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:02.386 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:02.386 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:02.386 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:02.386 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:02.386 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:02.387 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:02.387 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:02.387 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:02.387 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.387 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:02.387 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:02.387 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:02.387 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:02.387 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:02.387 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:02.387 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:02.387 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:02.387 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:02.388 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:02.388 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:02.388 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:02.388 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:02.388 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.388 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:02.388 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:02.388 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:02.388 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:02.388 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:02.388 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:02.389 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:02.389 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:02.389 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:02.389 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:02.389 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:02.389 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:02.389 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:02.389 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:02.389 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:02.389 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:02.389 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:02.389 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:02.389 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:02.390 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:02.390 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:02.390 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:02.390 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:02.390 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:02.390 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:02.390 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:02.390 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:02.390 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:02.390 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.390 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:02.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.390 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:02.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.391 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:02.391 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:02.391 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:02.391 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:02.392 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.392 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.392 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.392 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:02.392 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:02.392 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.392 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.392 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.392 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:02.392 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:02.393 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:02.393 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:02.393 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.393 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.393 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.394 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:02.394 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:02.394 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.394 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.394 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.394 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:02.394 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:02.394 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.394 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.394 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.395 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:02.395 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.395 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.395 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:02.395 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.395 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.395 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.395 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:02.395 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:02.395 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.395 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.396 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.396 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:02.396 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:02.396 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.396 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.396 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.396 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:02.396 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.396 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.397 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:02.397 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.397 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.397 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.397 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:02.397 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:02.397 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.397 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.397 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.397 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.397 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:02.397 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:02.398 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.398 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.398 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:02.398 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.398 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:02.398 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.398 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.398 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.399 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:02.399 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:02.399 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.399 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.399 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.399 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:02.399 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:02.399 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.399 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.399 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.400 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:02.400 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.400 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.400 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.400 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:02.400 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.400 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.400 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.400 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:02.400 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:02.400 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.400 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.401 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.401 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:02.401 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:02.401 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.401 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.401 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.401 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:02.401 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.402 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.402 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:02.402 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.402 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.402 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.402 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:02.402 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:02.402 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.402 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.402 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.402 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.403 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:02.403 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:02.403 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.403 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.403 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.403 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:02.403 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.403 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.403 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:02.403 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.403 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.404 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.404 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:02.404 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:02.404 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.404 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.404 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.404 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.404 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:02.404 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:02.404 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.404 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.404 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.404 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.405 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:02.405 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.405 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:02.405 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.405 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.405 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.405 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:02.405 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:02.405 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.405 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.406 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.406 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.406 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.406 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:02.406 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:02.406 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.406 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:02.406 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:02.406 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:02.406 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.406 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.406 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:02.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.407 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:02.407 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:02.407 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:02.407 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.407 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.407 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:02.407 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9d0ef3640 1 -- 172.21.15.5:0/3570277429 >> v2:172.21.15.157:6812/631023601 conn(0x7fc9b003bdc0 msgr2=0x7fc9b003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9d0ef3640 1 --2- 172.21.15.5:0/3570277429 >> v2:172.21.15.157:6812/631023601 conn(0x7fc9b003bdc0 0x7fc9b003e280 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4007440 tx=0x7fc9c400b040 comp rx=0 tx=0).stop 2024-08-18T21:13:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9d0ef3640 10 monclient: shutdown 2024-08-18T21:13:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9d0ef3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9d0ef3640 1 -- 172.21.15.5:0/3570277429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9cc0a4b40 msgr2=0x7fc9cc1248a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9d0ef3640 1 --2- 172.21.15.5:0/3570277429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9cc0a4b40 0x7fc9cc1248a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40097c0 tx=0x7fc9b4019270 comp rx=0 tx=0).stop 2024-08-18T21:13:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9cad9d640 1 -- 172.21.15.5:0/3570277429 reap_dead start 2024-08-18T21:13:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9cad9d640 1 -- 172.21.15.5:0/3570277429 reap_dead start 2024-08-18T21:13:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9d0ef3640 1 -- 172.21.15.5:0/3570277429 shutdown_connections 2024-08-18T21:13:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9d0ef3640 1 -- 172.21.15.5:0/3570277429 >> 172.21.15.5:0/3570277429 conn(0x7fc9cc069090 msgr2=0x7fc9cc0a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9d0ef3640 1 -- 172.21.15.5:0/3570277429 shutdown_connections 2024-08-18T21:13:02.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.379+0000 7fc9d0ef3640 1 -- 172.21.15.5:0/3570277429 wait complete. 2024-08-18T21:13:02.410 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:02.410 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:13:02.410 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:13:02.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 10 monclient: get_monmap_and_config 2024-08-18T21:13:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 10 monclient: build_initial_monmap 2024-08-18T21:13:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 10 monclient: monmap: 2024-08-18T21:13:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:02.529473+0000 2024-08-18T21:13:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:02.529473+0000 2024-08-18T21:13:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:02.527 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 1 Processor -- start 2024-08-18T21:13:02.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 1 -- start start 2024-08-18T21:13:02.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 10 monclient: init 2024-08-18T21:13:02.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:02.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 10 monclient: _add_conns ranks=[0,4,5,8,3,6,2,1,10,7,9] 2024-08-18T21:13:02.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcedc134460 addr v1:172.21.15.5:6789/0 2024-08-18T21:13:02.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcedc133fa0 0x7fcedc13c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 10 monclient(hunting): picked mon.noname-c con 0x7fcedc133fa0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:13:02.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fcedc13cd40 0x7fcedc13f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 10 monclient(hunting): picked mon.noname-h con 0x7fcedc13cd40 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:02.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcedc09e320 con 0x7fcedc134460 2024-08-18T21:13:02.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fcedc09e600 con 0x7fcedc133fa0 2024-08-18T21:13:02.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fcedc09e8e0 con 0x7fcedc13cd40 2024-08-18T21:13:02.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:02.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee3b8e640 10 monclient(hunting): authenticate will time out at 1549.543306s 2024-08-18T21:13:02.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcedc133fa0 0x7fcedc13c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee192a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcedc134460 0x7fcedc134840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39074/0 (socket says 172.21.15.5:39074) 2024-08-18T21:13:02.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee192a640 1 -- 172.21.15.5:0/977033027 learned_addr learned my addr 172.21.15.5:0/977033027 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:13:02.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 10 monclient(hunting): get_auth_request con 0x7fcedc133fa0 auth_method 0 2024-08-18T21:13:02.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee212b640 1 --2- 172.21.15.5:0/977033027 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fcedc13cd40 0x7fcedc13f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 10 monclient(hunting): handle_auth_done global_id 114448 payload 274 2024-08-18T21:13:02.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 1 -- 172.21.15.5:0/977033027 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fcedc13cd40 msgr2=0x7fcedc13f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:02.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 1 --2- 172.21.15.5:0/977033027 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fcedc13cd40 0x7fcedc13f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 1 -- 172.21.15.5:0/977033027 >> v1:172.21.15.5:6789/0 conn(0x7fcedc134460 legacy=0x7fcedc134840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:02.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 10 monclient: _finish_hunting 0 2024-08-18T21:13:02.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 1 monclient: found mon.noname-c 2024-08-18T21:13:02.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:02.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:13:02.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee1129640 1 -- 172.21.15.5:0/977033027 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcedc09ebc0 con 0x7fcedc133fa0 2024-08-18T21:13:02.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee212b640 10 monclient: get_auth_request con 0x7fcedc13cd40 auth_method 0 2024-08-18T21:13:02.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.527+0000 7fcee212b640 1 --2- 172.21.15.5:0/977033027 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fcedc13cd40 0x7fcedc13f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:13:02.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 1 -- 172.21.15.5:0/977033027 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcedc133fa0 msgr2=0x7fcedc13c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:02.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 1 --2- 172.21.15.5:0/977033027 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcedc133fa0 0x7fcedc13c800 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0097f0 tx=0x7fcecc01c3a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=748bde0f4311dec6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee0928640 1 -- 172.21.15.5:0/977033027 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcecc0b0070 con 0x7fcedc133fa0 2024-08-18T21:13:02.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee0928640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee0928640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee0928640 10 monclient: dump: 2024-08-18T21:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee0928640 10 monclient: _finish_auth 0 2024-08-18T21:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee0928640 10 monclient: _check_auth_tickets 2024-08-18T21:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee0928640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee0928640 1 -- 172.21.15.5:0/977033027 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcecc0aa810 con 0x7fcedc133fa0 2024-08-18T21:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee0928640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee0928640 1 -- 172.21.15.5:0/977033027 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcecc0a4e60 con 0x7fcedc133fa0 2024-08-18T21:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee0928640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee0928640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee0928640 10 monclient: dump: 2024-08-18T21:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.537 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.537 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.537 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.537 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.537 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.537 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.537 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.537 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.537 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.537 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.537 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.538 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.538 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.538 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.538 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 5 monclient: authenticate success, global_id 114448 2024-08-18T21:13:02.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:02.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 4 set_mon_vals no callback set 2024-08-18T21:13:02.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 10 monclient: shutdown 2024-08-18T21:13:02.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:02.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 1 -- 172.21.15.5:0/977033027 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcedc133fa0 msgr2=0x7fcedc13c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 1 --2- 172.21.15.5:0/977033027 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcedc133fa0 0x7fcedc13c800 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0097f0 tx=0x7fcecc01c3a0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 1 -- 172.21.15.5:0/977033027 shutdown_connections 2024-08-18T21:13:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 1 --2- 172.21.15.5:0/977033027 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fcedc13cd40 0x7fcedc13f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 1 --2- 172.21.15.5:0/977033027 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fcedc133fa0 0x7fcedc13c800 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 1 -- 172.21.15.5:0/977033027 >> 172.21.15.5:0/977033027 conn(0x7fcedc0a8a90 msgr2=0x7fcedc0a8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 1 -- 172.21.15.5:0/977033027 shutdown_connections 2024-08-18T21:13:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 1 -- 172.21.15.5:0/977033027 wait complete. 2024-08-18T21:13:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 10 monclient: build_initial_monmap 2024-08-18T21:13:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 10 monclient: monmap: 2024-08-18T21:13:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:02.540 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 1 Processor -- start 2024-08-18T21:13:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 1 -- start start 2024-08-18T21:13:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 10 monclient: init 2024-08-18T21:13:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 10 monclient: _add_conns ranks=[1,6,2,4,7,3,5,8,0] 2024-08-18T21:13:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcedc133fa0 0x7fcedc131060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 10 monclient(hunting): picked mon.noname-f con 0x7fcedc133fa0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:13:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcedc134460 0x7fcedc1315a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 10 monclient(hunting): picked mon.noname-d con 0x7fcedc134460 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcedc13cd40 0x7fcedc135090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 10 monclient(hunting): picked mon.noname-b con 0x7fcedc13cd40 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc142220 con 0x7fcedc133fa0 2024-08-18T21:13:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fcedc1420a0 con 0x7fcedc13cd40 2024-08-18T21:13:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fcedc1423a0 con 0x7fcedc134460 2024-08-18T21:13:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee3b8e640 10 monclient(hunting): authenticate will time out at 1549.550581s 2024-08-18T21:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcedc134460 0x7fcedc1315a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcedc134460 0x7fcedc1315a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:41592/0 (socket says 172.21.15.5:41592) 2024-08-18T21:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 1 -- 172.21.15.5:0/1873220659 learned_addr learned my addr 172.21.15.5:0/1873220659 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 10 monclient(hunting): get_auth_request con 0x7fcedc134460 auth_method 0 2024-08-18T21:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee212b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcedc13cd40 0x7fcedc135090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee212b640 10 monclient(hunting): get_auth_request con 0x7fcedc13cd40 auth_method 0 2024-08-18T21:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee212b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee212b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee212b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee212b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee212b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee212b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee192a640 1 --2- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcedc133fa0 0x7fcedc131060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 10 monclient(hunting): handle_auth_done global_id 85677 payload 824 2024-08-18T21:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 1 -- 172.21.15.5:0/1873220659 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcedc13cd40 msgr2=0x7fcedc135090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 1 --2- 172.21.15.5:0/1873220659 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcedc13cd40 0x7fcedc135090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 1 -- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcedc133fa0 msgr2=0x7fcedc131060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 1 --2- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcedc133fa0 0x7fcedc131060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 10 monclient: _finish_hunting 0 2024-08-18T21:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 1 monclient: found mon.noname-d 2024-08-18T21:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee1129640 1 -- 172.21.15.5:0/1873220659 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcedc1367b0 con 0x7fcedc134460 2024-08-18T21:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee192a640 10 monclient: get_auth_request con 0x7fcedc133fa0 auth_method 0 2024-08-18T21:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.535+0000 7fcee192a640 1 --2- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcedc133fa0 0x7fcedc131060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee1129640 1 -- 172.21.15.5:0/1873220659 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcedc134460 msgr2=0x7fcedc1315a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee1129640 1 --2- 172.21.15.5:0/1873220659 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcedc134460 0x7fcedc1315a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0ae040 tx=0x7fcecc019140 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced27fc640 1 -- 172.21.15.5:0/1873220659 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcecc0b0040 con 0x7fcedc134460 2024-08-18T21:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced27fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced27fc640 10 monclient: dump: 2024-08-18T21:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced27fc640 10 monclient: _finish_auth 0 2024-08-18T21:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced27fc640 10 monclient: _check_auth_tickets 2024-08-18T21:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced27fc640 1 -- 172.21.15.5:0/1873220659 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcecc0044b0 con 0x7fcedc134460 2024-08-18T21:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced27fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced27fc640 1 -- 172.21.15.5:0/1873220659 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcedc09dd40 con 0x7fcedc134460 2024-08-18T21:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee3b8e640 5 monclient: authenticate success, global_id 85677 2024-08-18T21:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee3b8e640 10 monclient: _renew_subs 2024-08-18T21:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee3b8e640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee3b8e640 1 -- 172.21.15.5:0/1873220659 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcedc138270 con 0x7fcedc134460 2024-08-18T21:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced27fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced27fc640 10 monclient: dump: 2024-08-18T21:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced3fff640 4 set_mon_vals no callback set 2024-08-18T21:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee3b8e640 10 monclient: _renew_subs 2024-08-18T21:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee3b8e640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee3b8e640 1 -- 172.21.15.5:0/1873220659 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fcedc139540 con 0x7fcedc134460 2024-08-18T21:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee3b8e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee3b8e640 1 --2- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcedc137310 0x7fcedc1355d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee3b8e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee3b8e640 1 -- 172.21.15.5:0/1873220659 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fcedc051140 con 0x7fcedc137310 2024-08-18T21:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced27fc640 1 -- 172.21.15.5:0/1873220659 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fcecc004040 con 0x7fcedc134460 2024-08-18T21:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced27fc640 1 --2- 172.21.15.5:0/1873220659 >> v2:172.21.15.157:6812/631023601 conn(0x7fcec003bde0 0x7fcec003e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fced27fc640 1 -- 172.21.15.5:0/1873220659 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(262..262 src has 22..262) ==== 3506+0+0 (secure 0 0 0) 0x7fcecc0b9070 con 0x7fcedc134460 2024-08-18T21:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee192a640 1 --2- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcedc137310 0x7fcedc1355d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee192a640 10 monclient: get_auth_request con 0x7fcedc137310 auth_method 0 2024-08-18T21:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee192a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee192a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee192a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee192a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee192a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee192a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee212b640 1 --2- 172.21.15.5:0/1873220659 >> v2:172.21.15.157:6812/631023601 conn(0x7fcec003bde0 0x7fcec003e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee212b640 10 monclient: get_auth_request con 0x7fcec003bde0 auth_method 0 2024-08-18T21:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee192a640 10 monclient(hunting): handle_auth_done global_id 124198 payload 824 2024-08-18T21:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.539+0000 7fcee192a640 1 -- 172.21.15.5:0/1873220659 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcedc134840 con 0x7fcedc137310 2024-08-18T21:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.543+0000 7fcee192a640 1 -- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcedc137310 msgr2=0x7fcedc1355d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.543+0000 7fcee192a640 1 --2- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcedc137310 0x7fcedc1355d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fced800d4c0 tx=0x7fced800d980 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.543+0000 7fcee212b640 1 --2- 172.21.15.5:0/1873220659 >> v2:172.21.15.157:6812/631023601 conn(0x7fcec003bde0 0x7fcec003e2a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fced400f3f0 tx=0x7fced40076e0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.543+0000 7fced27fc640 1 -- 172.21.15.5:0/1873220659 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fced8005d00 con 0x7fcedc137310 2024-08-18T21:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.543+0000 7fced27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.543+0000 7fced27fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.543+0000 7fced27fc640 10 monclient: dump: 2024-08-18T21:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.556 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.543+0000 7fced27fc640 1 -- 172.21.15.5:0/1873220659 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fced8017070 con 0x7fcedc137310 2024-08-18T21:13:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.543+0000 7fced27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.543+0000 7fced27fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.543+0000 7fced27fc640 1 -- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcedc137310 msgr2=0x7fcedc1355d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.543+0000 7fced27fc640 1 --2- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcedc137310 0x7fcedc1355d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fced800d4c0 tx=0x7fced800d980 comp rx=0 tx=0).stop 2024-08-18T21:13:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.543+0000 7fced27fc640 1 -- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcedc137310 msgr2=0x7fcedc1355d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.543+0000 7fced27fc640 1 --2- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcedc137310 0x7fcedc1355d0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fced800d4c0 tx=0x7fced800d980 comp rx=0 tx=0).stop 2024-08-18T21:13:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.551+0000 7fcee3b8e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.551+0000 7fcee3b8e640 1 --2- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcedc131ae0 0x7fcedc135b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.551+0000 7fcee3b8e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.551+0000 7fcee3b8e640 1 -- 172.21.15.5:0/1873220659 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fcedc06b7e0 con 0x7fcedc131ae0 2024-08-18T21:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.551+0000 7fcee192a640 1 --2- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcedc131ae0 0x7fcedc135b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.551+0000 7fcee192a640 10 monclient: get_auth_request con 0x7fcedc131ae0 auth_method 0 2024-08-18T21:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.551+0000 7fcee192a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.551+0000 7fcee192a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.551+0000 7fcee192a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.551+0000 7fcee192a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.551+0000 7fcee192a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.551+0000 7fcee192a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.551+0000 7fcee192a640 10 monclient(hunting): handle_auth_done global_id 124207 payload 824 2024-08-18T21:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.551+0000 7fcee192a640 1 -- 172.21.15.5:0/1873220659 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcedc06d960 con 0x7fcedc131ae0 2024-08-18T21:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fcee192a640 1 -- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcedc131ae0 msgr2=0x7fcedc135b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fcee192a640 1 --2- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcedc131ae0 0x7fcedc135b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fced8009010 tx=0x7fced8004950 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fced27fc640 1 -- 172.21.15.5:0/1873220659 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fced8007500 con 0x7fcedc131ae0 2024-08-18T21:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fced27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fced27fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fced27fc640 10 monclient: dump: 2024-08-18T21:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.561 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fced27fc640 1 -- 172.21.15.5:0/1873220659 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9581 (secure 0 0 0) 0x7fced8007500 con 0x7fcedc131ae0 2024-08-18T21:13:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fced27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fced27fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fced27fc640 1 -- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcedc131ae0 msgr2=0x7fcedc135b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fced27fc640 1 --2- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcedc131ae0 0x7fcedc135b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fced8009010 tx=0x7fced8004950 comp rx=0 tx=0).stop 2024-08-18T21:13:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fced27fc640 1 -- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcedc131ae0 msgr2=0x7fcedc135b10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fced27fc640 1 --2- 172.21.15.5:0/1873220659 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fcedc131ae0 0x7fcedc135b10 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fced8009010 tx=0x7fced8004950 comp rx=0 tx=0).stop 2024-08-18T21:13:02.562 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:02.562 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:02.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:02.562 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:02.562 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:02.562 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 29543, 2024-08-18T21:13:02.562 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:02.562 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:02.562 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:02.562 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:02.562 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:02.563 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:02.563 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:02.563 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:02.563 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:02.563 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:02.563 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.563 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:13:02.563 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:02.563 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:02.564 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:02.564 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:02.564 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:02.564 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:02.564 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:02.564 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:02.564 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:02.564 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:02.564 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:02.564 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:02.564 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:02.564 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:02.564 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.565 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:02.565 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:02.565 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:02.565 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:02.565 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:02.565 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:02.565 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:02.565 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:02.565 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:02.565 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:02.565 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:02.565 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:02.565 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:02.565 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.566 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:02.566 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:02.566 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:02.566 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:02.566 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:02.566 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:02.566 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:02.566 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:02.566 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:02.566 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:02.566 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:02.567 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:02.567 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:02.567 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:02.567 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:02.567 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:02.567 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:02.567 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:02.567 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:02.567 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:02.567 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:02.567 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:02.567 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:02.567 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:02.568 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:02.568 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:02.568 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:02.568 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:02.568 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.568 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:02.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.568 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:02.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.568 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:02.568 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:02.568 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.568 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.569 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:02.569 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.569 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:02.569 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.569 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.569 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.569 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:02.569 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:02.570 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.570 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.570 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.570 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:02.570 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:02.570 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.570 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.570 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.570 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:02.570 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.571 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:02.571 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.571 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.571 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:02.571 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:02.571 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.571 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.571 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.572 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:02.572 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:02.572 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.572 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.572 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.572 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:02.572 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.572 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.572 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:02.573 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.573 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.573 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:02.573 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:02.573 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.573 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.573 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.574 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:02.574 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:02.574 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.574 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:02.574 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.575 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:02.575 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.575 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.575 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.575 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:02.575 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:02.575 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.575 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.575 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.576 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:02.576 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:02.576 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.576 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:02.576 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.576 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:02.577 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.577 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.577 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:02.577 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:02.577 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.577 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.577 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.577 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:02.577 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:02.577 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.578 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.578 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.578 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:02.578 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.578 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.578 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:02.578 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.578 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.578 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.578 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:02.579 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:02.579 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.579 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.579 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.579 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:02.579 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:02.579 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.579 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.580 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.580 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:02.580 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.580 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.580 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:02.580 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.580 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.580 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.580 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:02.580 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:02.580 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.581 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.581 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.581 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:02.581 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:02.581 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.581 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:02.581 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:02.582 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.582 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.582 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:02.582 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:02.582 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.582 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.582 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.583 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:02.583 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:02.583 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:02.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:02.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.583 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:02.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:02.583 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.583 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:02.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:02.583 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:02.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.584 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:02.584 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:02.584 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:02.584 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:02.584 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:02.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.584 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.584 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:02.585 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:02.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.585 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:02.585 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:02.585 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:02.585 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.585 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.585 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:13:02.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.585 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:02.585 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:02.585 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:02.585 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.585 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.586 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:02.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.586 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:02.586 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:02.586 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:13:02.586 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.586 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:02.586 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:13:02.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:02.586 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:02.586 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:02.586 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:02.586 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:02.587 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:02.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:02.587 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:02.587 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:02.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fcee3b8e640 1 -- 172.21.15.5:0/1873220659 >> v2:172.21.15.157:6812/631023601 conn(0x7fcec003bde0 msgr2=0x7fcec003e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fcee3b8e640 1 --2- 172.21.15.5:0/1873220659 >> v2:172.21.15.157:6812/631023601 conn(0x7fcec003bde0 0x7fcec003e2a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fced400f3f0 tx=0x7fced40076e0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fcee3b8e640 10 monclient: shutdown 2024-08-18T21:13:02.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fcee3b8e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:02.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fcee3b8e640 1 -- 172.21.15.5:0/1873220659 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcedc134460 msgr2=0x7fcedc1315a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fcee3b8e640 1 --2- 172.21.15.5:0/1873220659 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fcedc134460 0x7fcedc1315a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0ae040 tx=0x7fcecc019140 comp rx=0 tx=0).stop 2024-08-18T21:13:02.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fcee212b640 1 -- 172.21.15.5:0/1873220659 reap_dead start 2024-08-18T21:13:02.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fcee212b640 1 -- 172.21.15.5:0/1873220659 reap_dead start 2024-08-18T21:13:02.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fcee3b8e640 1 -- 172.21.15.5:0/1873220659 shutdown_connections 2024-08-18T21:13:02.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fcee3b8e640 1 -- 172.21.15.5:0/1873220659 >> 172.21.15.5:0/1873220659 conn(0x7fcedc0a8a90 msgr2=0x7fcedc0a6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:02.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fcee3b8e640 1 -- 172.21.15.5:0/1873220659 shutdown_connections 2024-08-18T21:13:02.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.555+0000 7fcee3b8e640 1 -- 172.21.15.5:0/1873220659 wait complete. 2024-08-18T21:13:02.589 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:02.589 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-18T21:13:02.590 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-18T21:13:02.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.715+0000 7ff5b01e3640 10 monclient: get_monmap_and_config 2024-08-18T21:13:02.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.715+0000 7ff5b01e3640 10 monclient: build_initial_monmap 2024-08-18T21:13:02.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.715+0000 7ff5b01e3640 10 monclient: monmap: 2024-08-18T21:13:02.716 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:02.716 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.716 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:02.719363+0000 2024-08-18T21:13:02.716 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:02.719363+0000 2024-08-18T21:13:02.716 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:02.716 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.716 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:02.716 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:02.716 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:02.716 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:02.716 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:02.716 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:02.717 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:02.717 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:02.717 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:02.717 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:02.717 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:02.717 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.715+0000 7ff5b01e3640 1 Processor -- start 2024-08-18T21:13:02.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.715+0000 7ff5b01e3640 1 -- start start 2024-08-18T21:13:02.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.715+0000 7ff5b01e3640 10 monclient: init 2024-08-18T21:13:02.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5b01e3640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:02.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5b01e3640 10 monclient: _add_conns ranks=[10,1,8,6,0,7,9,2,3,5,4] 2024-08-18T21:13:02.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5b01e3640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff5a8139d00 0x7ff5a813a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5b01e3640 10 monclient(hunting): picked mon.noname-f con 0x7ff5a8139d00 addr v2:172.21.15.157:3300/0 2024-08-18T21:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5b01e3640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7ff5a80a4b40 addr v1:172.21.15.157:6789/0 2024-08-18T21:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5b01e3640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff5a80a4f80 0x7ff5a806d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5b01e3640 10 monclient(hunting): picked mon.noname-e con 0x7ff5a80a4f80 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5b01e3640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5a809e7f0 con 0x7ff5a80a4b40 2024-08-18T21:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5b01e3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5b01e3640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff5a809e230 con 0x7ff5a8139d00 2024-08-18T21:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5b01e3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5b01e3640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff5a809e510 con 0x7ff5a80a4f80 2024-08-18T21:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5b01e3640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5b01e3640 10 monclient(hunting): authenticate will time out at 1549.732515s 2024-08-18T21:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff5a80a4f80 0x7ff5a806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff5a80a4f80 0x7ff5a806d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:53766/0 (socket says 172.21.15.5:53766) 2024-08-18T21:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 1 -- 172.21.15.5:0/1682720346 learned_addr learned my addr 172.21.15.5:0/1682720346 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 10 monclient(hunting): get_auth_request con 0x7ff5a80a4f80 auth_method 0 2024-08-18T21:13:02.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5adf7f640 1 --2- 172.21.15.5:0/1682720346 >> v2:172.21.15.157:3300/0 conn(0x7ff5a8139d00 0x7ff5a813a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5adf7f640 10 monclient(hunting): get_auth_request con 0x7ff5a8139d00 auth_method 0 2024-08-18T21:13:02.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5adf7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5adf7f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5adf7f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 10 monclient(hunting): handle_auth_done global_id 114659 payload 274 2024-08-18T21:13:02.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 1 -- 172.21.15.5:0/1682720346 >> v2:172.21.15.157:3300/0 conn(0x7ff5a8139d00 msgr2=0x7ff5a813a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:02.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 1 --2- 172.21.15.5:0/1682720346 >> v2:172.21.15.157:3300/0 conn(0x7ff5a8139d00 0x7ff5a813a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 1 -- 172.21.15.5:0/1682720346 >> v1:172.21.15.157:6789/0 conn(0x7ff5a80a4b40 legacy=0x7ff5a806c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:02.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 10 monclient: _finish_hunting 0 2024-08-18T21:13:02.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 1 monclient: found mon.noname-e 2024-08-18T21:13:02.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:02.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:13:02.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.719+0000 7ff5ae780640 1 -- 172.21.15.5:0/1682720346 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a809f000 con 0x7ff5a80a4f80 2024-08-18T21:13:02.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ae780640 1 -- 172.21.15.5:0/1682720346 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff5a80a4f80 msgr2=0x7ff5a806d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:02.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ae780640 1 --2- 172.21.15.5:0/1682720346 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff5a80a4f80 0x7ff5a806d060 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009e50 tx=0x7ff5a001c710 comp rx=0 tx=0).ready entity=mon.8 client_cookie=685c45dc626dba88 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5acf7d640 1 -- 172.21.15.5:0/1682720346 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff5a00090d0 con 0x7ff5a80a4f80 2024-08-18T21:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5acf7d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5acf7d640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5acf7d640 10 monclient: dump: 2024-08-18T21:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5acf7d640 10 monclient: _finish_auth 0 2024-08-18T21:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5acf7d640 10 monclient: _check_auth_tickets 2024-08-18T21:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5acf7d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5acf7d640 1 -- 172.21.15.5:0/1682720346 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a00ae070 con 0x7ff5a80a4f80 2024-08-18T21:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 5 monclient: authenticate success, global_id 114659 2024-08-18T21:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5acf7d640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 4 set_mon_vals no callback set 2024-08-18T21:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5acf7d640 1 -- 172.21.15.5:0/1682720346 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff5a00a9d40 con 0x7ff5a80a4f80 2024-08-18T21:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5acf7d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5acf7d640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5acf7d640 10 monclient: dump: 2024-08-18T21:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 10 monclient: shutdown 2024-08-18T21:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 1 -- 172.21.15.5:0/1682720346 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff5a80a4f80 msgr2=0x7ff5a806d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 1 --2- 172.21.15.5:0/1682720346 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff5a80a4f80 0x7ff5a806d060 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009e50 tx=0x7ff5a001c710 comp rx=0 tx=0).stop 2024-08-18T21:13:02.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 1 -- 172.21.15.5:0/1682720346 shutdown_connections 2024-08-18T21:13:02.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 1 --2- 172.21.15.5:0/1682720346 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff5a80a4f80 0x7ff5a806d060 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 1 --2- 172.21.15.5:0/1682720346 >> v2:172.21.15.157:3300/0 conn(0x7ff5a8139d00 0x7ff5a813a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 1 -- 172.21.15.5:0/1682720346 >> 172.21.15.5:0/1682720346 conn(0x7ff5a80688d0 msgr2=0x7ff5a8068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:02.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 1 -- 172.21.15.5:0/1682720346 shutdown_connections 2024-08-18T21:13:02.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 1 -- 172.21.15.5:0/1682720346 wait complete. 2024-08-18T21:13:02.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 10 monclient: build_initial_monmap 2024-08-18T21:13:02.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 10 monclient: monmap: 2024-08-18T21:13:02.730 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:02.730 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:02.730 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:02.730 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:02.731 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:02.731 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.731 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:02.731 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:02.731 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:02.731 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:02.731 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:02.731 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:02.731 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:02.731 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:02.731 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:02.731 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 1 Processor -- start 2024-08-18T21:13:02.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 1 -- start start 2024-08-18T21:13:02.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 10 monclient: init 2024-08-18T21:13:02.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:02.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 10 monclient: _add_conns ranks=[8,0,2,5,1,6,7,4,3] 2024-08-18T21:13:02.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff5a80a4b40 0x7ff5a8120910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 10 monclient(hunting): picked mon.noname-e con 0x7ff5a80a4b40 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:02.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5a80a4f80 0x7ff5a81d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 10 monclient(hunting): picked mon.noname-a con 0x7ff5a80a4f80 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:13:02.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff5a8139d00 0x7ff5a811f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 10 monclient(hunting): picked mon.noname-b con 0x7ff5a8139d00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:02.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a8144590 con 0x7ff5a80a4f80 2024-08-18T21:13:02.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a806d7b0 con 0x7ff5a8139d00 2024-08-18T21:13:02.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:02.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff5a8144710 con 0x7ff5a80a4b40 2024-08-18T21:13:02.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:02.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5b01e3640 10 monclient(hunting): authenticate will time out at 1549.739547s 2024-08-18T21:13:02.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5adf7f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff5a80a4b40 0x7ff5a8120910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ae780640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff5a8139d00 0x7ff5a811f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ad77e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5a80a4f80 0x7ff5a81d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5adf7f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff5a80a4b40 0x7ff5a8120910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:53768/0 (socket says 172.21.15.5:53768) 2024-08-18T21:13:02.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5adf7f640 1 -- 172.21.15.5:0/3489646508 learned_addr learned my addr 172.21.15.5:0/3489646508 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:02.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5adf7f640 10 monclient(hunting): get_auth_request con 0x7ff5a80a4b40 auth_method 0 2024-08-18T21:13:02.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5adf7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5adf7f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5adf7f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ae780640 10 monclient(hunting): get_auth_request con 0x7ff5a8139d00 auth_method 0 2024-08-18T21:13:02.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ae780640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ae780640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ae780640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ad77e640 10 monclient(hunting): get_auth_request con 0x7ff5a80a4f80 auth_method 0 2024-08-18T21:13:02.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ad77e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:02.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ad77e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:02.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ad77e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:02.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ae780640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ae780640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ae780640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5adf7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5adf7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5adf7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ad77e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ad77e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.723+0000 7ff5ad77e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5ae780640 10 monclient(hunting): handle_auth_done global_id 114482 payload 824 2024-08-18T21:13:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5ae780640 1 -- 172.21.15.5:0/3489646508 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff5a80a4b40 msgr2=0x7ff5a8120910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5ae780640 1 --2- 172.21.15.5:0/3489646508 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff5a80a4b40 0x7ff5a8120910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5ae780640 1 -- 172.21.15.5:0/3489646508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5a80a4f80 msgr2=0x7ff5a81d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5ae780640 1 --2- 172.21.15.5:0/3489646508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5a80a4f80 0x7ff5a81d1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5ae780640 10 monclient: _finish_hunting 0 2024-08-18T21:13:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5ae780640 1 monclient: found mon.noname-b 2024-08-18T21:13:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5ae780640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:02.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5ae780640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:13:02.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5ae780640 1 -- 172.21.15.5:0/3489646508 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a81212a0 con 0x7ff5a8139d00 2024-08-18T21:13:02.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5adf7f640 1 --2- 172.21.15.5:0/3489646508 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff5a80a4b40 0x7ff5a8120910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:02.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5ae780640 1 -- 172.21.15.5:0/3489646508 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff5a8139d00 msgr2=0x7ff5a811f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:02.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5ae780640 1 --2- 172.21.15.5:0/3489646508 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff5a8139d00 0x7ff5a811f680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00aa000 tx=0x7ff5a00194b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff59e7fc640 1 -- 172.21.15.5:0/3489646508 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff5a00044b0 con 0x7ff5a8139d00 2024-08-18T21:13:02.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff59e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff59e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:13:02.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff59e7fc640 10 monclient: dump: 2024-08-18T21:13:02.738 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.739 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.739 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.739 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.739 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.739 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.739 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.739 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.739 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.739 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.739 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.739 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.739 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.740 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.740 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.740 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff59e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:13:02.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff59e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:13:02.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff59e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:02.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff59e7fc640 1 -- 172.21.15.5:0/3489646508 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a0004670 con 0x7ff5a8139d00 2024-08-18T21:13:02.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff59e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:02.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff59e7fc640 1 -- 172.21.15.5:0/3489646508 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff5a0004820 con 0x7ff5a8139d00 2024-08-18T21:13:02.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5b01e3640 5 monclient: authenticate success, global_id 114482 2024-08-18T21:13:02.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5b01e3640 10 monclient: _renew_subs 2024-08-18T21:13:02.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5b01e3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5b01e3640 1 -- 172.21.15.5:0/3489646508 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a8121870 con 0x7ff5a8139d00 2024-08-18T21:13:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff59ffff640 4 set_mon_vals no callback set 2024-08-18T21:13:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff59e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff59e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff59e7fc640 10 monclient: dump: 2024-08-18T21:13:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:02.742 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:02.742 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:02.742 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:02.742 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:02.742 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:02.742 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:02.742 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:02.742 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:02.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5b01e3640 10 monclient: _renew_subs 2024-08-18T21:13:02.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5b01e3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:02.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5b01e3640 1 -- 172.21.15.5:0/3489646508 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a8122110 con 0x7ff5a8139d00 2024-08-18T21:13:02.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5b01e3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:02.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5b01e3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:02.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff59e7fc640 1 -- 172.21.15.5:0/3489646508 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7ff5a0004040 con 0x7ff5a8139d00 2024-08-18T21:13:02.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5b01e3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:02.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.727+0000 7ff5b01e3640 1 -- 172.21.15.5:0/3489646508 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a813a0e0 con 0x7ff5a8139d00 2024-08-18T21:13:02.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.731+0000 7ff59e7fc640 1 --2- 172.21.15.5:0/3489646508 >> v2:172.21.15.157:6812/631023601 conn(0x7ff58c03bdc0 0x7ff58c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:02.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.731+0000 7ff59e7fc640 1 -- 172.21.15.5:0/3489646508 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(263..263 src has 22..263) ==== 3898+0+0 (secure 0 0 0) 0x7ff5a00e9380 con 0x7ff5a8139d00 2024-08-18T21:13:02.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.731+0000 7ff5adf7f640 1 --2- 172.21.15.5:0/3489646508 >> v2:172.21.15.157:6812/631023601 conn(0x7ff58c03bdc0 0x7ff58c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:02.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.731+0000 7ff5adf7f640 10 monclient: get_auth_request con 0x7ff58c03bdc0 auth_method 0 2024-08-18T21:13:02.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.731+0000 7ff5adf7f640 1 --2- 172.21.15.5:0/3489646508 >> v2:172.21.15.157:6812/631023601 conn(0x7ff58c03bdc0 0x7ff58c03e280 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4007e60 tx=0x7ff5a4008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:02.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.735+0000 7ff59e7fc640 1 -- 172.21.15.5:0/3489646508 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7ff5a8121870 con 0x7ff5a8139d00 2024-08-18T21:13:02.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.735+0000 7ff59e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:02.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.735+0000 7ff59e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.975+0000 7ff5b01e3640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-18T21:13:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.975+0000 7ff5b01e3640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-18T21:13:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.975+0000 7ff5b01e3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.975+0000 7ff5b01e3640 1 -- 172.21.15.5:0/3489646508 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7ff5a8138890 con 0x7ff5a8139d00 2024-08-18T21:13:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.979+0000 7ff59e7fc640 1 -- 172.21.15.5:0/3489646508 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7ff5a809e7f0 con 0x7ff5a8139d00 2024-08-18T21:13:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.979+0000 7ff59e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-18T21:13:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.979+0000 7ff59e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.983+0000 7ff5b01e3640 1 -- 172.21.15.5:0/3489646508 >> v2:172.21.15.157:6812/631023601 conn(0x7ff58c03bdc0 msgr2=0x7ff58c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.983+0000 7ff5b01e3640 1 --2- 172.21.15.5:0/3489646508 >> v2:172.21.15.157:6812/631023601 conn(0x7ff58c03bdc0 0x7ff58c03e280 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4007e60 tx=0x7ff5a4008040 comp rx=0 tx=0).stop 2024-08-18T21:13:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.983+0000 7ff5b01e3640 10 monclient: shutdown 2024-08-18T21:13:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.983+0000 7ff5b01e3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.983+0000 7ff5b01e3640 1 -- 172.21.15.5:0/3489646508 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff5a8139d00 msgr2=0x7ff5a811f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.983+0000 7ff5b01e3640 1 --2- 172.21.15.5:0/3489646508 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff5a8139d00 0x7ff5a811f680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00aa000 tx=0x7ff5a00194b0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.983+0000 7ff5b01e3640 1 -- 172.21.15.5:0/3489646508 shutdown_connections 2024-08-18T21:13:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.983+0000 7ff5b01e3640 1 --2- 172.21.15.5:0/3489646508 >> v2:172.21.15.157:6812/631023601 conn(0x7ff58c03bdc0 0x7ff58c03e280 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.983+0000 7ff5b01e3640 1 --2- 172.21.15.5:0/3489646508 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff5a8139d00 0x7ff5a811f680 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.983+0000 7ff5b01e3640 1 --2- 172.21.15.5:0/3489646508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5a80a4f80 0x7ff5a81d1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.983+0000 7ff5b01e3640 1 --2- 172.21.15.5:0/3489646508 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff5a80a4b40 0x7ff5a8120910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.983+0000 7ff5b01e3640 1 -- 172.21.15.5:0/3489646508 >> 172.21.15.5:0/3489646508 conn(0x7ff5a80688d0 msgr2=0x7ff5a80a04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.983+0000 7ff5b01e3640 1 -- 172.21.15.5:0/3489646508 shutdown_connections 2024-08-18T21:13:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:02.983+0000 7ff5b01e3640 1 -- 172.21.15.5:0/3489646508 wait complete. 2024-08-18T21:13:02.999 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-18T21:13:03.036 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.036 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=10,logm=60} crc {auth=1818138104,config=1618278320,health=1820446136,kv=450215431,logm=2434858014}) 2024-08-18T21:13:03.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=18,config=2,health=12,kv=10,logm=58} crc {auth=4121022439,config=1618278320,health=2745890778,kv=3664197221,logm=2624268484}) 2024-08-18T21:13:03.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=10,logm=60} crc {auth=1818138104,config=1618278320,health=1820446136,kv=450215431,logm=2434858014}) 2024-08-18T21:13:03.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=1,health=11,kv=10,logm=59} crc {auth=2560197552,config=1228700967,health=3770970560,kv=3664197221,logm=1990943282}) 2024-08-18T21:13:03.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=10,logm=60} crc {auth=1818138104,config=1618278320,health=1820446136,kv=450215431,logm=2434858014}) 2024-08-18T21:13:03.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=20,config=2,health=12,kv=10,logm=56} crc {auth=2685641564,config=1618278320,health=2745890778,kv=3664197221,logm=1059613199}) 2024-08-18T21:13:03.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=10,logm=60} crc {auth=1818138104,config=1618278320,health=1820446136,kv=450215431,logm=2434858014}) 2024-08-18T21:13:03.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=20,config=2,health=12,kv=9,logm=57} crc {auth=1318054464,config=1618278320,health=2745890778,kv=846173930,logm=1340264559}) 2024-08-18T21:13:03.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=10,logm=60} crc {auth=1818138104,config=1618278320,health=1820446136,kv=450215431,logm=2434858014}) 2024-08-18T21:13:03.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=20,config=1,health=12,kv=8,logm=59} crc {auth=1318054464,config=2457401934,health=2745890778,kv=672252078,logm=1423150529}) 2024-08-18T21:13:03.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=10,logm=60} crc {auth=1818138104,config=1618278320,health=1820446136,kv=450215431,logm=2434858014}) 2024-08-18T21:13:03.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=20,config=2,health=10,kv=9,logm=59} crc {auth=642710767,config=1618278320,health=237330614,kv=147916585,logm=621624254}) 2024-08-18T21:13:03.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=10,logm=60} crc {auth=1818138104,config=1618278320,health=1820446136,kv=450215431,logm=2434858014}) 2024-08-18T21:13:03.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=19,config=2,health=12,kv=8,logm=59} crc {auth=2094173814,config=1618278320,health=2745890778,kv=147916585,logm=530647194}) 2024-08-18T21:13:03.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=10,logm=60} crc {auth=1818138104,config=1618278320,health=1820446136,kv=450215431,logm=2434858014}) 2024-08-18T21:13:03.038 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=19,config=2,health=11,kv=10,logm=58} crc {auth=4033092895,config=1618278320,health=3608815757,kv=2472233794,logm=1317104178}) 2024-08-18T21:13:03.047 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.048 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3197673588}) 2024-08-18T21:13:03.048 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=457075339}) 2024-08-18T21:13:03.048 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.048 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3197673588}) 2024-08-18T21:13:03.048 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1401746825}) 2024-08-18T21:13:03.048 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.048 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3197673588}) 2024-08-18T21:13:03.048 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2652492166}) 2024-08-18T21:13:03.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3197673588}) 2024-08-18T21:13:03.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2621333855}) 2024-08-18T21:13:03.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3197673588}) 2024-08-18T21:13:03.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1461732510}) 2024-08-18T21:13:03.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3197673588}) 2024-08-18T21:13:03.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3812617824}) 2024-08-18T21:13:03.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3197673588}) 2024-08-18T21:13:03.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2902176810}) 2024-08-18T21:13:03.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3197673588}) 2024-08-18T21:13:03.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3517773367}) 2024-08-18T21:13:03.464 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.465 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=265922227}) 2024-08-18T21:13:03.465 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3721835972}) 2024-08-18T21:13:03.465 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.465 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=265922227}) 2024-08-18T21:13:03.465 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3932543038}) 2024-08-18T21:13:03.465 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.465 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=265922227}) 2024-08-18T21:13:03.465 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=720752527}) 2024-08-18T21:13:03.465 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.465 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=265922227}) 2024-08-18T21:13:03.465 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3925719505}) 2024-08-18T21:13:03.466 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.466 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=265922227}) 2024-08-18T21:13:03.466 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2630827292}) 2024-08-18T21:13:03.466 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.466 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=265922227}) 2024-08-18T21:13:03.466 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3229112620}) 2024-08-18T21:13:03.466 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.466 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=265922227}) 2024-08-18T21:13:03.466 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2871446604}) 2024-08-18T21:13:03.466 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.466 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=265922227}) 2024-08-18T21:13:03.466 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.463+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1747757685}) 2024-08-18T21:13:03.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254228141}) 2024-08-18T21:13:03.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3007497946}) 2024-08-18T21:13:03.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254228141}) 2024-08-18T21:13:03.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=531228474}) 2024-08-18T21:13:03.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254228141}) 2024-08-18T21:13:03.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1033204478}) 2024-08-18T21:13:03.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254228141}) 2024-08-18T21:13:03.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2612643261}) 2024-08-18T21:13:03.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254228141}) 2024-08-18T21:13:03.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3228038658}) 2024-08-18T21:13:03.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254228141}) 2024-08-18T21:13:03.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2193666645}) 2024-08-18T21:13:03.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254228141}) 2024-08-18T21:13:03.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3820016663}) 2024-08-18T21:13:03.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254228141}) 2024-08-18T21:13:03.511 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=255769631}) 2024-08-18T21:13:03.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923545369}) 2024-08-18T21:13:03.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2105696652}) 2024-08-18T21:13:03.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923545369}) 2024-08-18T21:13:03.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3482356329}) 2024-08-18T21:13:03.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923545369}) 2024-08-18T21:13:03.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=208273372}) 2024-08-18T21:13:03.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923545369}) 2024-08-18T21:13:03.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=223517442}) 2024-08-18T21:13:03.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923545369}) 2024-08-18T21:13:03.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2121113709}) 2024-08-18T21:13:03.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923545369}) 2024-08-18T21:13:03.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1369124815}) 2024-08-18T21:13:03.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923545369}) 2024-08-18T21:13:03.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4058675468}) 2024-08-18T21:13:03.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923545369}) 2024-08-18T21:13:03.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.703+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2156575260}) 2024-08-18T21:13:03.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2859766842}) 2024-08-18T21:13:03.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2012011093}) 2024-08-18T21:13:03.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2859766842}) 2024-08-18T21:13:03.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1028624705}) 2024-08-18T21:13:03.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2859766842}) 2024-08-18T21:13:03.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3092388655}) 2024-08-18T21:13:03.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2859766842}) 2024-08-18T21:13:03.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1192595865}) 2024-08-18T21:13:03.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2859766842}) 2024-08-18T21:13:03.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1003010308}) 2024-08-18T21:13:03.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2859766842}) 2024-08-18T21:13:03.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2308500928}) 2024-08-18T21:13:03.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2859766842}) 2024-08-18T21:13:03.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2986677995}) 2024-08-18T21:13:03.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2859766842}) 2024-08-18T21:13:03.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=474983028}) 2024-08-18T21:13:03.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3847787090}) 2024-08-18T21:13:03.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2605448533}) 2024-08-18T21:13:03.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3847787090}) 2024-08-18T21:13:03.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3193959205}) 2024-08-18T21:13:03.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3847787090}) 2024-08-18T21:13:03.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=920933411}) 2024-08-18T21:13:03.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3847787090}) 2024-08-18T21:13:03.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2178685583}) 2024-08-18T21:13:03.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3847787090}) 2024-08-18T21:13:03.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2630071988}) 2024-08-18T21:13:03.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3847787090}) 2024-08-18T21:13:03.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4133189330}) 2024-08-18T21:13:03.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3847787090}) 2024-08-18T21:13:03.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2624870324}) 2024-08-18T21:13:03.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3847787090}) 2024-08-18T21:13:03.745 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1684482686}) 2024-08-18T21:13:03.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=12199830}) 2024-08-18T21:13:03.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3459283699}) 2024-08-18T21:13:03.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=12199830}) 2024-08-18T21:13:03.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1750625457}) 2024-08-18T21:13:03.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=12199830}) 2024-08-18T21:13:03.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2210296672}) 2024-08-18T21:13:03.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=12199830}) 2024-08-18T21:13:03.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=201593057}) 2024-08-18T21:13:03.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=12199830}) 2024-08-18T21:13:03.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4182850969}) 2024-08-18T21:13:03.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=12199830}) 2024-08-18T21:13:03.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3788366905}) 2024-08-18T21:13:03.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=12199830}) 2024-08-18T21:13:03.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=536573878}) 2024-08-18T21:13:03.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:03.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=12199830}) 2024-08-18T21:13:03.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:03.775+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1793865733}) 2024-08-18T21:13:03.955 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:03.955 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31722]: starting. 2024-08-18T21:13:03.955 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31722]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31687 2024-08-18T21:13:03.955 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31722]: created object 0... 2024-08-18T21:13:03.955 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31722]: created object 25... 2024-08-18T21:13:03.955 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31722]: created object 49... 2024-08-18T21:13:03.955 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31722]: finishing. 2024-08-18T21:13:03.955 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31722]: shutting down. 2024-08-18T21:13:04.000 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:13:04.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:13:04.029 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:04.029 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31724]: starting. 2024-08-18T21:13:04.029 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31724]: listing objects. 2024-08-18T21:13:04.029 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31724]: listed object 0... 2024-08-18T21:13:04.029 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31724]: listed object 25... 2024-08-18T21:13:04.029 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31724]: saw 50 objects 2024-08-18T21:13:04.029 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31724]: shutting down. 2024-08-18T21:13:04.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2043355325}) 2024-08-18T21:13:04.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4200068188}) 2024-08-18T21:13:04.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2043355325}) 2024-08-18T21:13:04.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1185416817}) 2024-08-18T21:13:04.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2043355325}) 2024-08-18T21:13:04.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3193023567}) 2024-08-18T21:13:04.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2043355325}) 2024-08-18T21:13:04.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=845589173}) 2024-08-18T21:13:04.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2043355325}) 2024-08-18T21:13:04.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=785504590}) 2024-08-18T21:13:04.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2043355325}) 2024-08-18T21:13:04.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2766996373}) 2024-08-18T21:13:04.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2043355325}) 2024-08-18T21:13:04.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1770493302}) 2024-08-18T21:13:04.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.045 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2043355325}) 2024-08-18T21:13:04.045 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3614639666}) 2024-08-18T21:13:04.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4110052634}) 2024-08-18T21:13:04.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2075576514}) 2024-08-18T21:13:04.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4110052634}) 2024-08-18T21:13:04.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1864933307}) 2024-08-18T21:13:04.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4110052634}) 2024-08-18T21:13:04.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=7940517}) 2024-08-18T21:13:04.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4110052634}) 2024-08-18T21:13:04.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3801048419}) 2024-08-18T21:13:04.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4110052634}) 2024-08-18T21:13:04.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1783939809}) 2024-08-18T21:13:04.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4110052634}) 2024-08-18T21:13:04.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1737483994}) 2024-08-18T21:13:04.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4110052634}) 2024-08-18T21:13:04.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2383312864}) 2024-08-18T21:13:04.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.057 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4110052634}) 2024-08-18T21:13:04.057 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1898954432}) 2024-08-18T21:13:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.159+0000 7f4d04e84640 10 monclient: get_monmap_and_config 2024-08-18T21:13:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.159+0000 7f4d04e84640 10 monclient: build_initial_monmap 2024-08-18T21:13:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.159+0000 7f4d04e84640 10 monclient: monmap: 2024-08-18T21:13:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:04.162959+0000 2024-08-18T21:13:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:04.162959+0000 2024-08-18T21:13:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:04.161 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.159+0000 7f4d04e84640 1 Processor -- start 2024-08-18T21:13:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.159+0000 7f4d04e84640 1 -- start start 2024-08-18T21:13:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.159+0000 7f4d04e84640 10 monclient: init 2024-08-18T21:13:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.159+0000 7f4d04e84640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4d04e84640 10 monclient: _add_conns ranks=[1,10,3,6,7,8,2,0,4,5,9] 2024-08-18T21:13:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4d04e84640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f4d000a6bd0 addr v1:172.21.15.157:6789/0 2024-08-18T21:13:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4d04e84640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4d0009f080 0x7f4d0013ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4d04e84640 10 monclient(hunting): picked mon.noname-f con 0x7f4d0009f080 addr v2:172.21.15.157:3300/0 2024-08-18T21:13:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4d04e84640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d000a76c0 0x7f4d00141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4d04e84640 10 monclient(hunting): picked mon.noname-g con 0x7f4d000a76c0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4d04e84640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d000a7fb0 con 0x7f4d000a6bd0 2024-08-18T21:13:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4d04e84640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4d04e84640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4d0009e4c0 con 0x7f4d0009f080 2024-08-18T21:13:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4d04e84640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4d04e84640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0006f930 con 0x7f4d000a76c0 2024-08-18T21:13:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4d04e84640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4d04e84640 10 monclient(hunting): authenticate will time out at 1551.176112s 2024-08-18T21:13:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfdd9b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4d0009f080 0x7f4d0013ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d000a76c0 0x7f4d00141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d000a76c0 0x7f4d00141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:42002/0 (socket says 172.21.15.5:42002) 2024-08-18T21:13:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 1 -- 172.21.15.5:0/644622260 learned_addr learned my addr 172.21.15.5:0/644622260 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 10 monclient(hunting): get_auth_request con 0x7f4d000a76c0 auth_method 0 2024-08-18T21:13:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfdd9b640 10 monclient(hunting): get_auth_request con 0x7f4d0009f080 auth_method 0 2024-08-18T21:13:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfdd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfdd9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfdd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfdd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfdd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 10 monclient(hunting): handle_auth_done global_id 124149 payload 274 2024-08-18T21:13:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 1 -- 172.21.15.5:0/644622260 >> v2:172.21.15.157:3300/0 conn(0x7f4d0009f080 msgr2=0x7f4d0013ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 1 --2- 172.21.15.5:0/644622260 >> v2:172.21.15.157:3300/0 conn(0x7f4d0009f080 0x7f4d0013ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 1 -- 172.21.15.5:0/644622260 >> v1:172.21.15.157:6789/0 conn(0x7f4d000a6bd0 legacy=0x7f4d000a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 10 monclient: _finish_hunting 0 2024-08-18T21:13:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 1 monclient: found mon.noname-g 2024-08-18T21:13:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:13:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfed9d640 1 -- 172.21.15.5:0/644622260 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0009de70 con 0x7f4d000a76c0 2024-08-18T21:13:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.163+0000 7f4cfdd9b640 1 --2- 172.21.15.5:0/644622260 >> v2:172.21.15.157:3300/0 conn(0x7f4d0009f080 0x7f4d0013ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4cfed9d640 1 -- 172.21.15.5:0/644622260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d000a76c0 msgr2=0x7f4d00141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4cfed9d640 1 --2- 172.21.15.5:0/644622260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d000a76c0 0x7f4d00141330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009e50 tx=0x7f4cf801c890 comp rx=0 tx=0).ready entity=mon.3 client_cookie=cf769b24a9afeb58 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4cfd59a640 1 -- 172.21.15.5:0/644622260 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4cf80090d0 con 0x7f4d000a76c0 2024-08-18T21:13:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4cfd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4cfd59a640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:13:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4cfd59a640 10 monclient: dump: 2024-08-18T21:13:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:04.169 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4cfd59a640 10 monclient: _finish_auth 0 2024-08-18T21:13:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4cfd59a640 10 monclient: _check_auth_tickets 2024-08-18T21:13:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4cfd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4cfd59a640 1 -- 172.21.15.5:0/644622260 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf80a5a10 con 0x7f4d000a76c0 2024-08-18T21:13:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 5 monclient: authenticate success, global_id 124149 2024-08-18T21:13:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:13:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4cfd59a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4cfd59a640 1 -- 172.21.15.5:0/644622260 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4cf80a5c00 con 0x7f4d000a76c0 2024-08-18T21:13:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4cfd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 4 set_mon_vals no callback set 2024-08-18T21:13:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4cfd59a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:13:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4cfd59a640 10 monclient: dump: 2024-08-18T21:13:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:04.171 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 10 monclient: shutdown 2024-08-18T21:13:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 1 -- 172.21.15.5:0/644622260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d000a76c0 msgr2=0x7f4d00141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 1 --2- 172.21.15.5:0/644622260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d000a76c0 0x7f4d00141330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009e50 tx=0x7f4cf801c890 comp rx=0 tx=0).stop 2024-08-18T21:13:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 1 -- 172.21.15.5:0/644622260 shutdown_connections 2024-08-18T21:13:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 1 --2- 172.21.15.5:0/644622260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d000a76c0 0x7f4d00141330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 1 --2- 172.21.15.5:0/644622260 >> v2:172.21.15.157:3300/0 conn(0x7f4d0009f080 0x7f4d0013ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 1 -- 172.21.15.5:0/644622260 >> 172.21.15.5:0/644622260 conn(0x7f4d00068700 msgr2=0x7f4d00068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 1 -- 172.21.15.5:0/644622260 shutdown_connections 2024-08-18T21:13:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 1 -- 172.21.15.5:0/644622260 wait complete. 2024-08-18T21:13:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 10 monclient: build_initial_monmap 2024-08-18T21:13:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 10 monclient: monmap: 2024-08-18T21:13:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:04.173 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 1 Processor -- start 2024-08-18T21:13:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 1 -- start start 2024-08-18T21:13:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 10 monclient: init 2024-08-18T21:13:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 10 monclient: _add_conns ranks=[0,8,5,2,6,1,3,7,4] 2024-08-18T21:13:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0009f080 0x7f4d00128e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 10 monclient(hunting): picked mon.noname-a con 0x7f4d0009f080 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:13:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4d000a6bd0 0x7f4d001d1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 10 monclient(hunting): picked mon.noname-e con 0x7f4d000a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d000a76c0 0x7f4d00126870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 10 monclient(hunting): picked mon.noname-h con 0x7f4d000a76c0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4d00144210 con 0x7f4d0009f080 2024-08-18T21:13:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f4d00144090 con 0x7f4d000a76c0 2024-08-18T21:13:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f4d00144390 con 0x7f4d000a6bd0 2024-08-18T21:13:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.167+0000 7f4d04e84640 10 monclient(hunting): authenticate will time out at 1551.183966s 2024-08-18T21:13:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4d000a6bd0 0x7f4d001d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0009f080 0x7f4d00128e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4d000a6bd0 0x7f4d001d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:39586/0 (socket says 172.21.15.5:39586) 2024-08-18T21:13:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 1 -- 172.21.15.5:0/1896047607 learned_addr learned my addr 172.21.15.5:0/1896047607 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 10 monclient(hunting): get_auth_request con 0x7f4d000a6bd0 auth_method 0 2024-08-18T21:13:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfe59c640 10 monclient(hunting): get_auth_request con 0x7f4d0009f080 auth_method 0 2024-08-18T21:13:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfe59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfe59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfe59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfe59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfe59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfe59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfed9d640 1 --2- 172.21.15.5:0/1896047607 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d000a76c0 0x7f4d00126870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfed9d640 10 monclient(hunting): get_auth_request con 0x7f4d000a76c0 auth_method 0 2024-08-18T21:13:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfed9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 10 monclient(hunting): handle_auth_done global_id 114677 payload 824 2024-08-18T21:13:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 1 -- 172.21.15.5:0/1896047607 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d000a76c0 msgr2=0x7f4d00126870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 1 --2- 172.21.15.5:0/1896047607 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d000a76c0 0x7f4d00126870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 1 -- 172.21.15.5:0/1896047607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0009f080 msgr2=0x7f4d00128e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 1 --2- 172.21.15.5:0/1896047607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0009f080 0x7f4d00128e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 10 monclient: _finish_hunting 0 2024-08-18T21:13:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 1 monclient: found mon.noname-e 2024-08-18T21:13:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:13:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 1 -- 172.21.15.5:0/1896047607 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d001297c0 con 0x7f4d000a6bd0 2024-08-18T21:13:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfe59c640 1 --2- 172.21.15.5:0/1896047607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0009f080 0x7f4d00128e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 1 -- 172.21.15.5:0/1896047607 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4d000a6bd0 msgr2=0x7f4d001d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfdd9b640 1 --2- 172.21.15.5:0/1896047607 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4d000a6bd0 0x7f4d001d1970 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000ebe0 tx=0x7f4cf000c520 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cf6ffd640 1 -- 172.21.15.5:0/1896047607 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4cf0017070 con 0x7f4d000a6bd0 2024-08-18T21:13:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cf6ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:13:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cf6ffd640 10 monclient: dump: 2024-08-18T21:13:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:04.183 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cf6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:13:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cf6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:13:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cf6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cf6ffd640 1 -- 172.21.15.5:0/1896047607 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf000ce40 con 0x7f4d000a6bd0 2024-08-18T21:13:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4d04e84640 5 monclient: authenticate success, global_id 114677 2024-08-18T21:13:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4d04e84640 10 monclient: _renew_subs 2024-08-18T21:13:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4d04e84640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4d04e84640 1 -- 172.21.15.5:0/1896047607 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d000abaa0 con 0x7f4d000a6bd0 2024-08-18T21:13:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cf6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cf6ffd640 1 -- 172.21.15.5:0/1896047607 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4cf0013d50 con 0x7f4d000a6bd0 2024-08-18T21:13:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cf6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cf6ffd640 10 monclient: dump: 2024-08-18T21:13:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:04.185 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4cfcd99640 4 set_mon_vals no callback set 2024-08-18T21:13:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4d04e84640 10 monclient: _renew_subs 2024-08-18T21:13:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4d04e84640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4d04e84640 1 -- 172.21.15.5:0/1896047607 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d001282d0 con 0x7f4d000a6bd0 2024-08-18T21:13:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4d04e84640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4d04e84640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4d04e84640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.171+0000 7f4d04e84640 1 -- 172.21.15.5:0/1896047607 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d000a6fb0 con 0x7f4d000a6bd0 2024-08-18T21:13:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.175+0000 7f4cf6ffd640 1 -- 172.21.15.5:0/1896047607 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f4cf001a070 con 0x7f4d000a6bd0 2024-08-18T21:13:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.175+0000 7f4cf6ffd640 1 --2- 172.21.15.5:0/1896047607 >> v2:172.21.15.157:6812/631023601 conn(0x7f4ce003bdc0 0x7f4ce003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.175+0000 7f4cf6ffd640 1 -- 172.21.15.5:0/1896047607 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(264..264 src has 22..264) ==== 3898+0+0 (secure 0 0 0) 0x7f4cf000f040 con 0x7f4d000a6bd0 2024-08-18T21:13:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.175+0000 7f4cfe59c640 1 --2- 172.21.15.5:0/1896047607 >> v2:172.21.15.157:6812/631023601 conn(0x7f4ce003bdc0 0x7f4ce003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.175+0000 7f4cfe59c640 10 monclient: get_auth_request con 0x7f4ce003bdc0 auth_method 0 2024-08-18T21:13:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.175+0000 7f4cfe59c640 1 --2- 172.21.15.5:0/1896047607 >> v2:172.21.15.157:6812/631023601 conn(0x7f4ce003bdc0 0x7f4ce003e280 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8007fd0 tx=0x7f4ce8007e40 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.179+0000 7f4cf6ffd640 1 -- 172.21.15.5:0/1896047607 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f4cf0021070 con 0x7f4d000a6bd0 2024-08-18T21:13:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.179+0000 7f4cf6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.179+0000 7f4cf6ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:04.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1742996921}) 2024-08-18T21:13:04.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1286217083}) 2024-08-18T21:13:04.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1742996921}) 2024-08-18T21:13:04.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2300809642}) 2024-08-18T21:13:04.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1742996921}) 2024-08-18T21:13:04.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3471814059}) 2024-08-18T21:13:04.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1742996921}) 2024-08-18T21:13:04.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2512291551}) 2024-08-18T21:13:04.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1742996921}) 2024-08-18T21:13:04.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1210292243}) 2024-08-18T21:13:04.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1742996921}) 2024-08-18T21:13:04.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2159205132}) 2024-08-18T21:13:04.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1742996921}) 2024-08-18T21:13:04.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2467634605}) 2024-08-18T21:13:04.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1742996921}) 2024-08-18T21:13:04.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1236980073}) 2024-08-18T21:13:04.367 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.367 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2284732650}) 2024-08-18T21:13:04.367 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2512548388}) 2024-08-18T21:13:04.367 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.367 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2284732650}) 2024-08-18T21:13:04.367 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2465514347}) 2024-08-18T21:13:04.367 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.368 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2284732650}) 2024-08-18T21:13:04.368 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2980331205}) 2024-08-18T21:13:04.368 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.368 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2284732650}) 2024-08-18T21:13:04.368 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4184197986}) 2024-08-18T21:13:04.368 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.368 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2284732650}) 2024-08-18T21:13:04.368 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1317091467}) 2024-08-18T21:13:04.368 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.368 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2284732650}) 2024-08-18T21:13:04.368 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1126115791}) 2024-08-18T21:13:04.368 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.368 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2284732650}) 2024-08-18T21:13:04.369 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=607246256}) 2024-08-18T21:13:04.369 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.369 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2284732650}) 2024-08-18T21:13:04.369 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.367+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=816473767}) 2024-08-18T21:13:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:13:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:13:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 1 -- 172.21.15.5:0/1896047607 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4d000746d0 con 0x7f4d000a6bd0 2024-08-18T21:13:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4cf6ffd640 1 -- 172.21.15.5:0/1896047607 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7f4cf0011350 con 0x7f4d000a6bd0 2024-08-18T21:13:04.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4cf6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:13:04.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4cf6ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:04.418 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":206,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:13:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 1 -- 172.21.15.5:0/1896047607 >> v2:172.21.15.157:6812/631023601 conn(0x7f4ce003bdc0 msgr2=0x7f4ce003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 1 --2- 172.21.15.5:0/1896047607 >> v2:172.21.15.157:6812/631023601 conn(0x7f4ce003bdc0 0x7f4ce003e280 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8007fd0 tx=0x7f4ce8007e40 comp rx=0 tx=0).stop 2024-08-18T21:13:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 10 monclient: shutdown 2024-08-18T21:13:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 1 -- 172.21.15.5:0/1896047607 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4d000a6bd0 msgr2=0x7f4d001d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 1 --2- 172.21.15.5:0/1896047607 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4d000a6bd0 0x7f4d001d1970 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000ebe0 tx=0x7f4cf000c520 comp rx=0 tx=0).stop 2024-08-18T21:13:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 1 -- 172.21.15.5:0/1896047607 shutdown_connections 2024-08-18T21:13:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 1 --2- 172.21.15.5:0/1896047607 >> v2:172.21.15.157:6812/631023601 conn(0x7f4ce003bdc0 0x7f4ce003e280 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 1 --2- 172.21.15.5:0/1896047607 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4d000a76c0 0x7f4d00126870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 1 --2- 172.21.15.5:0/1896047607 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f4d000a6bd0 0x7f4d001d1970 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 1 --2- 172.21.15.5:0/1896047607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0009f080 0x7f4d00128e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 1 -- 172.21.15.5:0/1896047607 >> 172.21.15.5:0/1896047607 conn(0x7f4d00068700 msgr2=0x7f4d000aa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 1 -- 172.21.15.5:0/1896047607 shutdown_connections 2024-08-18T21:13:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.419+0000 7f4d04e84640 1 -- 172.21.15.5:0/1896047607 wait complete. 2024-08-18T21:13:04.437 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:13:04.437 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-18T21:13:04.437 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:13:04.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:13:04.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1639001586}) 2024-08-18T21:13:04.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1220691645}) 2024-08-18T21:13:04.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1639001586}) 2024-08-18T21:13:04.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2684434153}) 2024-08-18T21:13:04.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1639001586}) 2024-08-18T21:13:04.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2887609207}) 2024-08-18T21:13:04.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1639001586}) 2024-08-18T21:13:04.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2015259412}) 2024-08-18T21:13:04.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1639001586}) 2024-08-18T21:13:04.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=239515443}) 2024-08-18T21:13:04.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1639001586}) 2024-08-18T21:13:04.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3694179415}) 2024-08-18T21:13:04.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1639001586}) 2024-08-18T21:13:04.481 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=94108931}) 2024-08-18T21:13:04.481 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.481 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1639001586}) 2024-08-18T21:13:04.481 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.479+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=566095140}) 2024-08-18T21:13:04.483 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.483 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1603612184}) 2024-08-18T21:13:04.483 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3554672400}) 2024-08-18T21:13:04.483 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.483 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1603612184}) 2024-08-18T21:13:04.483 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1842199361}) 2024-08-18T21:13:04.483 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.483 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1603612184}) 2024-08-18T21:13:04.483 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011171096}) 2024-08-18T21:13:04.483 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.484 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1603612184}) 2024-08-18T21:13:04.484 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3087613339}) 2024-08-18T21:13:04.484 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.484 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1603612184}) 2024-08-18T21:13:04.484 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=893291384}) 2024-08-18T21:13:04.484 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.484 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1603612184}) 2024-08-18T21:13:04.484 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2009604856}) 2024-08-18T21:13:04.484 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.484 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1603612184}) 2024-08-18T21:13:04.484 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4086722223}) 2024-08-18T21:13:04.484 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.484 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1603612184}) 2024-08-18T21:13:04.485 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.483+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1466692782}) 2024-08-18T21:13:04.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2528188564}) 2024-08-18T21:13:04.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=263512526}) 2024-08-18T21:13:04.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2528188564}) 2024-08-18T21:13:04.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3283227362}) 2024-08-18T21:13:04.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2528188564}) 2024-08-18T21:13:04.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3396457531}) 2024-08-18T21:13:04.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.487 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2528188564}) 2024-08-18T21:13:04.488 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2373617981}) 2024-08-18T21:13:04.488 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.488 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2528188564}) 2024-08-18T21:13:04.488 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=881818739}) 2024-08-18T21:13:04.488 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.488 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2528188564}) 2024-08-18T21:13:04.488 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1762413390}) 2024-08-18T21:13:04.488 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.488 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2528188564}) 2024-08-18T21:13:04.488 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=971368590}) 2024-08-18T21:13:04.488 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.488 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2528188564}) 2024-08-18T21:13:04.488 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.487+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=47000198}) 2024-08-18T21:13:04.491 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.491 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3914048460}) 2024-08-18T21:13:04.491 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4016518768}) 2024-08-18T21:13:04.491 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.491 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3914048460}) 2024-08-18T21:13:04.491 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=419275404}) 2024-08-18T21:13:04.491 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.491 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3914048460}) 2024-08-18T21:13:04.491 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3740790570}) 2024-08-18T21:13:04.491 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.492 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3914048460}) 2024-08-18T21:13:04.492 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1337381535}) 2024-08-18T21:13:04.492 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.492 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3914048460}) 2024-08-18T21:13:04.492 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3853161099}) 2024-08-18T21:13:04.492 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.492 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3914048460}) 2024-08-18T21:13:04.492 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1663814930}) 2024-08-18T21:13:04.492 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.492 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3914048460}) 2024-08-18T21:13:04.492 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2055579265}) 2024-08-18T21:13:04.492 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.492 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3914048460}) 2024-08-18T21:13:04.492 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.491+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1083053052}) 2024-08-18T21:13:04.495 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.495 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277594713}) 2024-08-18T21:13:04.495 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1859332505}) 2024-08-18T21:13:04.495 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.495 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277594713}) 2024-08-18T21:13:04.495 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1987131459}) 2024-08-18T21:13:04.495 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.495 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277594713}) 2024-08-18T21:13:04.496 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1307886465}) 2024-08-18T21:13:04.496 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.496 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277594713}) 2024-08-18T21:13:04.496 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=916859357}) 2024-08-18T21:13:04.496 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.496 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277594713}) 2024-08-18T21:13:04.496 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3838368496}) 2024-08-18T21:13:04.496 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.496 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277594713}) 2024-08-18T21:13:04.496 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2021231061}) 2024-08-18T21:13:04.496 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.496 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277594713}) 2024-08-18T21:13:04.496 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1827693811}) 2024-08-18T21:13:04.496 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.497 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277594713}) 2024-08-18T21:13:04.497 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.495+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1091644876}) 2024-08-18T21:13:04.498 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.498 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419464810}) 2024-08-18T21:13:04.499 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3641581913}) 2024-08-18T21:13:04.499 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.499 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419464810}) 2024-08-18T21:13:04.499 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1706398952}) 2024-08-18T21:13:04.499 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.499 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419464810}) 2024-08-18T21:13:04.499 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1708336109}) 2024-08-18T21:13:04.499 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.499 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419464810}) 2024-08-18T21:13:04.499 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3144959209}) 2024-08-18T21:13:04.499 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.499 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419464810}) 2024-08-18T21:13:04.499 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3975496205}) 2024-08-18T21:13:04.500 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.500 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419464810}) 2024-08-18T21:13:04.500 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4112513210}) 2024-08-18T21:13:04.500 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.500 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419464810}) 2024-08-18T21:13:04.500 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4073052361}) 2024-08-18T21:13:04.500 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.500 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419464810}) 2024-08-18T21:13:04.500 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3701513487}) 2024-08-18T21:13:04.502 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.502 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1152867408}) 2024-08-18T21:13:04.503 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2298456426}) 2024-08-18T21:13:04.503 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.503 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1152867408}) 2024-08-18T21:13:04.503 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3436566855}) 2024-08-18T21:13:04.503 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.503 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1152867408}) 2024-08-18T21:13:04.503 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=258016072}) 2024-08-18T21:13:04.503 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.503 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1152867408}) 2024-08-18T21:13:04.503 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=16529649}) 2024-08-18T21:13:04.503 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.503 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1152867408}) 2024-08-18T21:13:04.503 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2083674871}) 2024-08-18T21:13:04.504 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.504 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1152867408}) 2024-08-18T21:13:04.504 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2367282740}) 2024-08-18T21:13:04.504 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.504 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1152867408}) 2024-08-18T21:13:04.504 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1096102875}) 2024-08-18T21:13:04.504 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.504 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1152867408}) 2024-08-18T21:13:04.504 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.499+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3308779611}) 2024-08-18T21:13:04.508 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2321869815}) 2024-08-18T21:13:04.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3430533133}) 2024-08-18T21:13:04.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2321869815}) 2024-08-18T21:13:04.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=597921809}) 2024-08-18T21:13:04.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2321869815}) 2024-08-18T21:13:04.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3794037898}) 2024-08-18T21:13:04.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2321869815}) 2024-08-18T21:13:04.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2273337104}) 2024-08-18T21:13:04.509 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2321869815}) 2024-08-18T21:13:04.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2585370583}) 2024-08-18T21:13:04.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2321869815}) 2024-08-18T21:13:04.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1954247396}) 2024-08-18T21:13:04.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2321869815}) 2024-08-18T21:13:04.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2605496368}) 2024-08-18T21:13:04.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2321869815}) 2024-08-18T21:13:04.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.503+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=747709534}) 2024-08-18T21:13:04.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.510 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=516983583}) 2024-08-18T21:13:04.511 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2081478667}) 2024-08-18T21:13:04.511 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.511 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=516983583}) 2024-08-18T21:13:04.511 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=295954705}) 2024-08-18T21:13:04.511 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.511 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=516983583}) 2024-08-18T21:13:04.511 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2188568686}) 2024-08-18T21:13:04.511 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.511 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=516983583}) 2024-08-18T21:13:04.511 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2125304999}) 2024-08-18T21:13:04.511 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.511 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=516983583}) 2024-08-18T21:13:04.511 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=387472197}) 2024-08-18T21:13:04.511 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.512 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=516983583}) 2024-08-18T21:13:04.512 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1090207767}) 2024-08-18T21:13:04.512 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.512 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=516983583}) 2024-08-18T21:13:04.512 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1123045685}) 2024-08-18T21:13:04.512 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.512 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=516983583}) 2024-08-18T21:13:04.512 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.507+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2125691452}) 2024-08-18T21:13:04.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3515820240}) 2024-08-18T21:13:04.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1159338339}) 2024-08-18T21:13:04.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3515820240}) 2024-08-18T21:13:04.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2759508004}) 2024-08-18T21:13:04.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3515820240}) 2024-08-18T21:13:04.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2958208413}) 2024-08-18T21:13:04.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.518 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3515820240}) 2024-08-18T21:13:04.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=844484293}) 2024-08-18T21:13:04.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3515820240}) 2024-08-18T21:13:04.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1498241057}) 2024-08-18T21:13:04.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3515820240}) 2024-08-18T21:13:04.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2856750893}) 2024-08-18T21:13:04.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3515820240}) 2024-08-18T21:13:04.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=301147633}) 2024-08-18T21:13:04.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3515820240}) 2024-08-18T21:13:04.519 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.511+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=994735213}) 2024-08-18T21:13:04.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2980288865}) 2024-08-18T21:13:04.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2045493972}) 2024-08-18T21:13:04.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2980288865}) 2024-08-18T21:13:04.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2115300498}) 2024-08-18T21:13:04.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2980288865}) 2024-08-18T21:13:04.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=393862002}) 2024-08-18T21:13:04.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2980288865}) 2024-08-18T21:13:04.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2872367035}) 2024-08-18T21:13:04.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.520 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2980288865}) 2024-08-18T21:13:04.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1693978667}) 2024-08-18T21:13:04.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2980288865}) 2024-08-18T21:13:04.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=289417495}) 2024-08-18T21:13:04.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2980288865}) 2024-08-18T21:13:04.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2195794717}) 2024-08-18T21:13:04.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2980288865}) 2024-08-18T21:13:04.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2671641788}) 2024-08-18T21:13:04.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=172235212}) 2024-08-18T21:13:04.521 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=274235741}) 2024-08-18T21:13:04.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=172235212}) 2024-08-18T21:13:04.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2486006400}) 2024-08-18T21:13:04.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=172235212}) 2024-08-18T21:13:04.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2462041513}) 2024-08-18T21:13:04.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=172235212}) 2024-08-18T21:13:04.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4119761534}) 2024-08-18T21:13:04.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=172235212}) 2024-08-18T21:13:04.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2925047342}) 2024-08-18T21:13:04.522 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.523 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=172235212}) 2024-08-18T21:13:04.523 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1661010480}) 2024-08-18T21:13:04.523 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.523 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=172235212}) 2024-08-18T21:13:04.523 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=577918910}) 2024-08-18T21:13:04.523 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.523 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=172235212}) 2024-08-18T21:13:04.523 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2628184249}) 2024-08-18T21:13:04.528 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.528 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3594147522}) 2024-08-18T21:13:04.528 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1262595848}) 2024-08-18T21:13:04.528 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.528 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3594147522}) 2024-08-18T21:13:04.528 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2827750744}) 2024-08-18T21:13:04.528 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.528 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3594147522}) 2024-08-18T21:13:04.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2774789977}) 2024-08-18T21:13:04.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3594147522}) 2024-08-18T21:13:04.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3798181491}) 2024-08-18T21:13:04.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3594147522}) 2024-08-18T21:13:04.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4051543255}) 2024-08-18T21:13:04.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3594147522}) 2024-08-18T21:13:04.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2737064877}) 2024-08-18T21:13:04.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3594147522}) 2024-08-18T21:13:04.529 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=125085376}) 2024-08-18T21:13:04.530 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.530 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3594147522}) 2024-08-18T21:13:04.530 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.519+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1431539109}) 2024-08-18T21:13:04.530 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.530 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1558989390}) 2024-08-18T21:13:04.530 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2900792265}) 2024-08-18T21:13:04.530 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.530 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1558989390}) 2024-08-18T21:13:04.530 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1543457769}) 2024-08-18T21:13:04.530 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.530 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1558989390}) 2024-08-18T21:13:04.530 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=216729520}) 2024-08-18T21:13:04.530 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.531 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1558989390}) 2024-08-18T21:13:04.531 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=52833585}) 2024-08-18T21:13:04.531 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.531 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1558989390}) 2024-08-18T21:13:04.531 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2616717167}) 2024-08-18T21:13:04.531 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.531 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1558989390}) 2024-08-18T21:13:04.531 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=194801877}) 2024-08-18T21:13:04.531 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.531 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1558989390}) 2024-08-18T21:13:04.531 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1863092226}) 2024-08-18T21:13:04.531 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.531 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1558989390}) 2024-08-18T21:13:04.531 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.523+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=670726233}) 2024-08-18T21:13:04.532 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.532 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068612669}) 2024-08-18T21:13:04.532 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=657624983}) 2024-08-18T21:13:04.532 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.532 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068612669}) 2024-08-18T21:13:04.532 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1886465456}) 2024-08-18T21:13:04.532 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.532 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068612669}) 2024-08-18T21:13:04.532 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=330662101}) 2024-08-18T21:13:04.532 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.532 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068612669}) 2024-08-18T21:13:04.532 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=784104583}) 2024-08-18T21:13:04.532 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.533 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068612669}) 2024-08-18T21:13:04.533 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2060870817}) 2024-08-18T21:13:04.533 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.533 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068612669}) 2024-08-18T21:13:04.533 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2510165800}) 2024-08-18T21:13:04.533 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.533 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068612669}) 2024-08-18T21:13:04.533 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1817362732}) 2024-08-18T21:13:04.533 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.533 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1068612669}) 2024-08-18T21:13:04.533 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.527+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2319195462}) 2024-08-18T21:13:04.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=826543229}) 2024-08-18T21:13:04.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1757861744}) 2024-08-18T21:13:04.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=826543229}) 2024-08-18T21:13:04.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2364890206}) 2024-08-18T21:13:04.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=826543229}) 2024-08-18T21:13:04.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1378927719}) 2024-08-18T21:13:04.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.540 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=826543229}) 2024-08-18T21:13:04.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3885163358}) 2024-08-18T21:13:04.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=826543229}) 2024-08-18T21:13:04.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=71259226}) 2024-08-18T21:13:04.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=826543229}) 2024-08-18T21:13:04.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=821805977}) 2024-08-18T21:13:04.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=826543229}) 2024-08-18T21:13:04.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1064716907}) 2024-08-18T21:13:04.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=826543229}) 2024-08-18T21:13:04.541 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.531+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2807619435}) 2024-08-18T21:13:04.542 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.542 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2713163425}) 2024-08-18T21:13:04.542 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3372569024}) 2024-08-18T21:13:04.542 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.542 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2713163425}) 2024-08-18T21:13:04.542 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1300310441}) 2024-08-18T21:13:04.542 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.542 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2713163425}) 2024-08-18T21:13:04.542 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2446746248}) 2024-08-18T21:13:04.542 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.542 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2713163425}) 2024-08-18T21:13:04.542 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2413279346}) 2024-08-18T21:13:04.542 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.543 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2713163425}) 2024-08-18T21:13:04.543 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1181729716}) 2024-08-18T21:13:04.543 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.543 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2713163425}) 2024-08-18T21:13:04.543 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1012508852}) 2024-08-18T21:13:04.543 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.543 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2713163425}) 2024-08-18T21:13:04.543 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3378001289}) 2024-08-18T21:13:04.543 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.543 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2713163425}) 2024-08-18T21:13:04.543 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=247833549}) 2024-08-18T21:13:04.543 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.543 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606759006}) 2024-08-18T21:13:04.543 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2270593644}) 2024-08-18T21:13:04.544 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.544 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.535+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606759006}) 2024-08-18T21:13:04.544 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2958118847}) 2024-08-18T21:13:04.544 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.544 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606759006}) 2024-08-18T21:13:04.544 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4138368742}) 2024-08-18T21:13:04.544 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.544 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606759006}) 2024-08-18T21:13:04.544 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1533945154}) 2024-08-18T21:13:04.544 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.544 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606759006}) 2024-08-18T21:13:04.544 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2462514240}) 2024-08-18T21:13:04.544 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.544 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606759006}) 2024-08-18T21:13:04.545 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2358804945}) 2024-08-18T21:13:04.545 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.545 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606759006}) 2024-08-18T21:13:04.545 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2307409291}) 2024-08-18T21:13:04.545 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.545 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606759006}) 2024-08-18T21:13:04.545 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.539+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4246262704}) 2024-08-18T21:13:04.548 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.549 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2380310791}) 2024-08-18T21:13:04.549 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1481930234}) 2024-08-18T21:13:04.549 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.549 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2380310791}) 2024-08-18T21:13:04.549 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1432554784}) 2024-08-18T21:13:04.549 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.549 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2380310791}) 2024-08-18T21:13:04.549 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1246381951}) 2024-08-18T21:13:04.549 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.549 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2380310791}) 2024-08-18T21:13:04.549 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=206441244}) 2024-08-18T21:13:04.549 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.549 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2380310791}) 2024-08-18T21:13:04.550 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2085692453}) 2024-08-18T21:13:04.550 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.550 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2380310791}) 2024-08-18T21:13:04.550 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2740946705}) 2024-08-18T21:13:04.550 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.550 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2380310791}) 2024-08-18T21:13:04.550 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=141044686}) 2024-08-18T21:13:04.550 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.550 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2380310791}) 2024-08-18T21:13:04.550 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.547+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1046447501}) 2024-08-18T21:13:04.552 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.552 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338747118}) 2024-08-18T21:13:04.552 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3685123880}) 2024-08-18T21:13:04.552 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.552 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338747118}) 2024-08-18T21:13:04.552 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3794907279}) 2024-08-18T21:13:04.552 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.552 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338747118}) 2024-08-18T21:13:04.552 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1143337810}) 2024-08-18T21:13:04.552 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338747118}) 2024-08-18T21:13:04.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2497506050}) 2024-08-18T21:13:04.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338747118}) 2024-08-18T21:13:04.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3311585159}) 2024-08-18T21:13:04.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338747118}) 2024-08-18T21:13:04.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=317182139}) 2024-08-18T21:13:04.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338747118}) 2024-08-18T21:13:04.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1940512370}) 2024-08-18T21:13:04.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338747118}) 2024-08-18T21:13:04.553 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.551+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4024214639}) 2024-08-18T21:13:04.556 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.556 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=339556229}) 2024-08-18T21:13:04.556 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4168632981}) 2024-08-18T21:13:04.556 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.556 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=339556229}) 2024-08-18T21:13:04.556 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=985508135}) 2024-08-18T21:13:04.556 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.556 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=339556229}) 2024-08-18T21:13:04.557 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1648359964}) 2024-08-18T21:13:04.557 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.557 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=339556229}) 2024-08-18T21:13:04.557 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3513733080}) 2024-08-18T21:13:04.557 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.557 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=339556229}) 2024-08-18T21:13:04.557 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1273148290}) 2024-08-18T21:13:04.557 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.557 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=339556229}) 2024-08-18T21:13:04.557 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2714171569}) 2024-08-18T21:13:04.557 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.557 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=339556229}) 2024-08-18T21:13:04.558 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=6833174}) 2024-08-18T21:13:04.558 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.558 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=339556229}) 2024-08-18T21:13:04.558 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.555+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2557115718}) 2024-08-18T21:13:04.559 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.560 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4266329295}) 2024-08-18T21:13:04.560 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2769238682}) 2024-08-18T21:13:04.560 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.560 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4266329295}) 2024-08-18T21:13:04.560 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1737566428}) 2024-08-18T21:13:04.560 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.560 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4266329295}) 2024-08-18T21:13:04.560 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=860301481}) 2024-08-18T21:13:04.560 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.560 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4266329295}) 2024-08-18T21:13:04.560 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=885969820}) 2024-08-18T21:13:04.560 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.561 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4266329295}) 2024-08-18T21:13:04.561 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=524394308}) 2024-08-18T21:13:04.561 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.561 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4266329295}) 2024-08-18T21:13:04.561 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3601296093}) 2024-08-18T21:13:04.561 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.561 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4266329295}) 2024-08-18T21:13:04.561 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1653061648}) 2024-08-18T21:13:04.561 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.561 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4266329295}) 2024-08-18T21:13:04.561 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.559+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=465128204}) 2024-08-18T21:13:04.568 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.568 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251006017}) 2024-08-18T21:13:04.568 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4207785980}) 2024-08-18T21:13:04.568 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.568 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251006017}) 2024-08-18T21:13:04.568 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2589790485}) 2024-08-18T21:13:04.569 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.569 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251006017}) 2024-08-18T21:13:04.569 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3316842615}) 2024-08-18T21:13:04.569 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.569 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251006017}) 2024-08-18T21:13:04.569 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1390961919}) 2024-08-18T21:13:04.569 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.569 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251006017}) 2024-08-18T21:13:04.569 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2317113115}) 2024-08-18T21:13:04.569 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.569 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251006017}) 2024-08-18T21:13:04.569 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=574086833}) 2024-08-18T21:13:04.569 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.570 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251006017}) 2024-08-18T21:13:04.570 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=776321518}) 2024-08-18T21:13:04.570 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.570 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251006017}) 2024-08-18T21:13:04.570 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.567+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2597351205}) 2024-08-18T21:13:04.574 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.574 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3810263979}) 2024-08-18T21:13:04.574 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2186946257}) 2024-08-18T21:13:04.574 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.574 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3810263979}) 2024-08-18T21:13:04.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1023133812}) 2024-08-18T21:13:04.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3810263979}) 2024-08-18T21:13:04.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2726178477}) 2024-08-18T21:13:04.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3810263979}) 2024-08-18T21:13:04.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1302534778}) 2024-08-18T21:13:04.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3810263979}) 2024-08-18T21:13:04.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3269524799}) 2024-08-18T21:13:04.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3810263979}) 2024-08-18T21:13:04.575 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=639394401}) 2024-08-18T21:13:04.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3810263979}) 2024-08-18T21:13:04.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2950280918}) 2024-08-18T21:13:04.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3810263979}) 2024-08-18T21:13:04.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.571+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2748128658}) 2024-08-18T21:13:04.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1943076690}) 2024-08-18T21:13:04.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=420482108}) 2024-08-18T21:13:04.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1943076690}) 2024-08-18T21:13:04.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4184524819}) 2024-08-18T21:13:04.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.576 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1943076690}) 2024-08-18T21:13:04.577 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2740801950}) 2024-08-18T21:13:04.577 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.577 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1943076690}) 2024-08-18T21:13:04.577 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3425600569}) 2024-08-18T21:13:04.577 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.577 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1943076690}) 2024-08-18T21:13:04.577 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=130279689}) 2024-08-18T21:13:04.577 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.577 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1943076690}) 2024-08-18T21:13:04.577 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3940234145}) 2024-08-18T21:13:04.577 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.577 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1943076690}) 2024-08-18T21:13:04.577 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3994905493}) 2024-08-18T21:13:04.578 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.578 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1943076690}) 2024-08-18T21:13:04.578 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2888559114}) 2024-08-18T21:13:04.583 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.583 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2370966290}) 2024-08-18T21:13:04.583 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1438407680}) 2024-08-18T21:13:04.584 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.584 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2370966290}) 2024-08-18T21:13:04.584 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3201082013}) 2024-08-18T21:13:04.584 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.584 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2370966290}) 2024-08-18T21:13:04.584 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1473146406}) 2024-08-18T21:13:04.584 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.584 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2370966290}) 2024-08-18T21:13:04.584 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=691519037}) 2024-08-18T21:13:04.584 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.584 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2370966290}) 2024-08-18T21:13:04.584 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=430957992}) 2024-08-18T21:13:04.584 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2370966290}) 2024-08-18T21:13:04.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2479810741}) 2024-08-18T21:13:04.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2370966290}) 2024-08-18T21:13:04.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2654969743}) 2024-08-18T21:13:04.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2370966290}) 2024-08-18T21:13:04.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.575+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=9413989}) 2024-08-18T21:13:04.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1610516989}) 2024-08-18T21:13:04.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1583888691}) 2024-08-18T21:13:04.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1610516989}) 2024-08-18T21:13:04.585 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3147068143}) 2024-08-18T21:13:04.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1610516989}) 2024-08-18T21:13:04.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2054328326}) 2024-08-18T21:13:04.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1610516989}) 2024-08-18T21:13:04.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3285213257}) 2024-08-18T21:13:04.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1610516989}) 2024-08-18T21:13:04.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=773632257}) 2024-08-18T21:13:04.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1610516989}) 2024-08-18T21:13:04.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2248189561}) 2024-08-18T21:13:04.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1610516989}) 2024-08-18T21:13:04.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1858551984}) 2024-08-18T21:13:04.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1610516989}) 2024-08-18T21:13:04.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.579+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2438428478}) 2024-08-18T21:13:04.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4182020243}) 2024-08-18T21:13:04.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2416791398}) 2024-08-18T21:13:04.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4182020243}) 2024-08-18T21:13:04.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1422841101}) 2024-08-18T21:13:04.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4182020243}) 2024-08-18T21:13:04.587 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1471968145}) 2024-08-18T21:13:04.588 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.588 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4182020243}) 2024-08-18T21:13:04.588 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2352783926}) 2024-08-18T21:13:04.588 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.588 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4182020243}) 2024-08-18T21:13:04.588 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=204600735}) 2024-08-18T21:13:04.588 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.588 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4182020243}) 2024-08-18T21:13:04.588 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1530428493}) 2024-08-18T21:13:04.588 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.588 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4182020243}) 2024-08-18T21:13:04.588 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4006262905}) 2024-08-18T21:13:04.588 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.589 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4182020243}) 2024-08-18T21:13:04.589 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.583+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1361275547}) 2024-08-18T21:13:04.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896818389}) 2024-08-18T21:13:04.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4028570238}) 2024-08-18T21:13:04.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896818389}) 2024-08-18T21:13:04.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2742879438}) 2024-08-18T21:13:04.595 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896818389}) 2024-08-18T21:13:04.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2158484421}) 2024-08-18T21:13:04.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896818389}) 2024-08-18T21:13:04.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2285915204}) 2024-08-18T21:13:04.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896818389}) 2024-08-18T21:13:04.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=524642598}) 2024-08-18T21:13:04.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896818389}) 2024-08-18T21:13:04.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3707295841}) 2024-08-18T21:13:04.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896818389}) 2024-08-18T21:13:04.596 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3696281982}) 2024-08-18T21:13:04.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896818389}) 2024-08-18T21:13:04.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=798363377}) 2024-08-18T21:13:04.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1211003224}) 2024-08-18T21:13:04.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=735317143}) 2024-08-18T21:13:04.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.587+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1211003224}) 2024-08-18T21:13:04.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3458933809}) 2024-08-18T21:13:04.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1211003224}) 2024-08-18T21:13:04.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2077677541}) 2024-08-18T21:13:04.597 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1211003224}) 2024-08-18T21:13:04.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1967843541}) 2024-08-18T21:13:04.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1211003224}) 2024-08-18T21:13:04.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3417890593}) 2024-08-18T21:13:04.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1211003224}) 2024-08-18T21:13:04.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2183347234}) 2024-08-18T21:13:04.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1211003224}) 2024-08-18T21:13:04.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1274628340}) 2024-08-18T21:13:04.598 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1211003224}) 2024-08-18T21:13:04.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2592701401}) 2024-08-18T21:13:04.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=931680564}) 2024-08-18T21:13:04.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=159217443}) 2024-08-18T21:13:04.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=931680564}) 2024-08-18T21:13:04.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3228422821}) 2024-08-18T21:13:04.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=931680564}) 2024-08-18T21:13:04.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=700306668}) 2024-08-18T21:13:04.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.599 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=931680564}) 2024-08-18T21:13:04.600 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4047149093}) 2024-08-18T21:13:04.600 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.600 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=931680564}) 2024-08-18T21:13:04.600 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2374576565}) 2024-08-18T21:13:04.600 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.600 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=931680564}) 2024-08-18T21:13:04.600 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4163259993}) 2024-08-18T21:13:04.600 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.600 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=931680564}) 2024-08-18T21:13:04.600 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=460780091}) 2024-08-18T21:13:04.600 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.600 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=931680564}) 2024-08-18T21:13:04.600 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.591+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3294037648}) 2024-08-18T21:13:04.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1511820729}) 2024-08-18T21:13:04.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1181742118}) 2024-08-18T21:13:04.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1511820729}) 2024-08-18T21:13:04.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3322254292}) 2024-08-18T21:13:04.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1511820729}) 2024-08-18T21:13:04.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=728950772}) 2024-08-18T21:13:04.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1511820729}) 2024-08-18T21:13:04.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2880839186}) 2024-08-18T21:13:04.601 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1511820729}) 2024-08-18T21:13:04.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=975180504}) 2024-08-18T21:13:04.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1511820729}) 2024-08-18T21:13:04.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=277930386}) 2024-08-18T21:13:04.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1511820729}) 2024-08-18T21:13:04.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2645775174}) 2024-08-18T21:13:04.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1511820729}) 2024-08-18T21:13:04.602 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.595+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3765293885}) 2024-08-18T21:13:04.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1216008368}) 2024-08-18T21:13:04.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=465694783}) 2024-08-18T21:13:04.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1216008368}) 2024-08-18T21:13:04.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1088653187}) 2024-08-18T21:13:04.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1216008368}) 2024-08-18T21:13:04.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2210247664}) 2024-08-18T21:13:04.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1216008368}) 2024-08-18T21:13:04.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3978927934}) 2024-08-18T21:13:04.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1216008368}) 2024-08-18T21:13:04.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2309623354}) 2024-08-18T21:13:04.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1216008368}) 2024-08-18T21:13:04.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4136411664}) 2024-08-18T21:13:04.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.610 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1216008368}) 2024-08-18T21:13:04.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2567625365}) 2024-08-18T21:13:04.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1216008368}) 2024-08-18T21:13:04.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=288549515}) 2024-08-18T21:13:04.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=255311193}) 2024-08-18T21:13:04.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1875185620}) 2024-08-18T21:13:04.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=255311193}) 2024-08-18T21:13:04.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3662970335}) 2024-08-18T21:13:04.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=255311193}) 2024-08-18T21:13:04.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4269842132}) 2024-08-18T21:13:04.611 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.599+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.612 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=255311193}) 2024-08-18T21:13:04.612 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1114573787}) 2024-08-18T21:13:04.612 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.612 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=255311193}) 2024-08-18T21:13:04.612 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3443393306}) 2024-08-18T21:13:04.612 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.612 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=255311193}) 2024-08-18T21:13:04.612 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=750603231}) 2024-08-18T21:13:04.612 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.612 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=255311193}) 2024-08-18T21:13:04.612 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=822927764}) 2024-08-18T21:13:04.612 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.612 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=255311193}) 2024-08-18T21:13:04.612 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3842894022}) 2024-08-18T21:13:04.613 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.613 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2601058551}) 2024-08-18T21:13:04.613 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2970736152}) 2024-08-18T21:13:04.613 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.613 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2601058551}) 2024-08-18T21:13:04.613 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1993919187}) 2024-08-18T21:13:04.613 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.613 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2601058551}) 2024-08-18T21:13:04.613 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3699898575}) 2024-08-18T21:13:04.613 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.613 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2601058551}) 2024-08-18T21:13:04.613 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2605619428}) 2024-08-18T21:13:04.613 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.613 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2601058551}) 2024-08-18T21:13:04.614 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1460518679}) 2024-08-18T21:13:04.614 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.614 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2601058551}) 2024-08-18T21:13:04.614 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3034995139}) 2024-08-18T21:13:04.614 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.614 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2601058551}) 2024-08-18T21:13:04.614 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=606027227}) 2024-08-18T21:13:04.614 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.614 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2601058551}) 2024-08-18T21:13:04.614 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.603+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1458088917}) 2024-08-18T21:13:04.614 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.614 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2481253860}) 2024-08-18T21:13:04.615 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1839736045}) 2024-08-18T21:13:04.615 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.615 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2481253860}) 2024-08-18T21:13:04.615 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3342563182}) 2024-08-18T21:13:04.615 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.615 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2481253860}) 2024-08-18T21:13:04.615 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=724322701}) 2024-08-18T21:13:04.615 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.615 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2481253860}) 2024-08-18T21:13:04.615 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4084579376}) 2024-08-18T21:13:04.615 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.615 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2481253860}) 2024-08-18T21:13:04.615 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1843736070}) 2024-08-18T21:13:04.616 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.616 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2481253860}) 2024-08-18T21:13:04.616 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1512940739}) 2024-08-18T21:13:04.616 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.616 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2481253860}) 2024-08-18T21:13:04.616 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1510166611}) 2024-08-18T21:13:04.616 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.616 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2481253860}) 2024-08-18T21:13:04.616 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4165017641}) 2024-08-18T21:13:04.616 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.616 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=139658169}) 2024-08-18T21:13:04.616 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1014599543}) 2024-08-18T21:13:04.616 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.617 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=139658169}) 2024-08-18T21:13:04.617 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2313839245}) 2024-08-18T21:13:04.617 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.617 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=139658169}) 2024-08-18T21:13:04.617 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1927106574}) 2024-08-18T21:13:04.617 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.617 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=139658169}) 2024-08-18T21:13:04.617 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3829714754}) 2024-08-18T21:13:04.617 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.617 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=139658169}) 2024-08-18T21:13:04.617 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=33120925}) 2024-08-18T21:13:04.617 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.617 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=139658169}) 2024-08-18T21:13:04.617 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1257090067}) 2024-08-18T21:13:04.618 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.618 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=139658169}) 2024-08-18T21:13:04.618 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2499993338}) 2024-08-18T21:13:04.618 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.618 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=139658169}) 2024-08-18T21:13:04.618 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.607+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2484859528}) 2024-08-18T21:13:04.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3331201191}) 2024-08-18T21:13:04.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=638530828}) 2024-08-18T21:13:04.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3331201191}) 2024-08-18T21:13:04.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2593577350}) 2024-08-18T21:13:04.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3331201191}) 2024-08-18T21:13:04.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1243610041}) 2024-08-18T21:13:04.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3331201191}) 2024-08-18T21:13:04.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=585629147}) 2024-08-18T21:13:04.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3331201191}) 2024-08-18T21:13:04.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2196344642}) 2024-08-18T21:13:04.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.629 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3331201191}) 2024-08-18T21:13:04.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1965124368}) 2024-08-18T21:13:04.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3331201191}) 2024-08-18T21:13:04.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3058329612}) 2024-08-18T21:13:04.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3331201191}) 2024-08-18T21:13:04.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.611+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2079349724}) 2024-08-18T21:13:04.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364379677}) 2024-08-18T21:13:04.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4239197114}) 2024-08-18T21:13:04.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364379677}) 2024-08-18T21:13:04.630 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1273212445}) 2024-08-18T21:13:04.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364379677}) 2024-08-18T21:13:04.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=220281503}) 2024-08-18T21:13:04.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364379677}) 2024-08-18T21:13:04.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1301213369}) 2024-08-18T21:13:04.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364379677}) 2024-08-18T21:13:04.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1749504644}) 2024-08-18T21:13:04.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364379677}) 2024-08-18T21:13:04.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=892293403}) 2024-08-18T21:13:04.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.631 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364379677}) 2024-08-18T21:13:04.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1283294152}) 2024-08-18T21:13:04.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364379677}) 2024-08-18T21:13:04.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3765645388}) 2024-08-18T21:13:04.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3324052330}) 2024-08-18T21:13:04.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1556326411}) 2024-08-18T21:13:04.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3324052330}) 2024-08-18T21:13:04.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2421079684}) 2024-08-18T21:13:04.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3324052330}) 2024-08-18T21:13:04.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2645119822}) 2024-08-18T21:13:04.632 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3324052330}) 2024-08-18T21:13:04.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=770303463}) 2024-08-18T21:13:04.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.615+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3324052330}) 2024-08-18T21:13:04.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2140633574}) 2024-08-18T21:13:04.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3324052330}) 2024-08-18T21:13:04.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2619352124}) 2024-08-18T21:13:04.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3324052330}) 2024-08-18T21:13:04.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3900422734}) 2024-08-18T21:13:04.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.633 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3324052330}) 2024-08-18T21:13:04.634 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1195957794}) 2024-08-18T21:13:04.634 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.634 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2915572849}) 2024-08-18T21:13:04.634 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3361973473}) 2024-08-18T21:13:04.634 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.634 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2915572849}) 2024-08-18T21:13:04.634 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=796116430}) 2024-08-18T21:13:04.634 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.634 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2915572849}) 2024-08-18T21:13:04.634 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=523700894}) 2024-08-18T21:13:04.634 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.634 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2915572849}) 2024-08-18T21:13:04.634 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3033625867}) 2024-08-18T21:13:04.635 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.635 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2915572849}) 2024-08-18T21:13:04.635 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2097955387}) 2024-08-18T21:13:04.635 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.635 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2915572849}) 2024-08-18T21:13:04.635 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=270536646}) 2024-08-18T21:13:04.635 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.635 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2915572849}) 2024-08-18T21:13:04.635 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=951380446}) 2024-08-18T21:13:04.635 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.635 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2915572849}) 2024-08-18T21:13:04.635 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.619+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3109763933}) 2024-08-18T21:13:04.635 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.635 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2649582294}) 2024-08-18T21:13:04.636 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1484420665}) 2024-08-18T21:13:04.636 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.636 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2649582294}) 2024-08-18T21:13:04.636 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1987639332}) 2024-08-18T21:13:04.636 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.636 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2649582294}) 2024-08-18T21:13:04.636 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=438478259}) 2024-08-18T21:13:04.636 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.636 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2649582294}) 2024-08-18T21:13:04.636 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2638442445}) 2024-08-18T21:13:04.636 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.636 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2649582294}) 2024-08-18T21:13:04.636 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=971988537}) 2024-08-18T21:13:04.637 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.637 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2649582294}) 2024-08-18T21:13:04.637 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=422262845}) 2024-08-18T21:13:04.637 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.637 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2649582294}) 2024-08-18T21:13:04.637 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=719925597}) 2024-08-18T21:13:04.637 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.637 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2649582294}) 2024-08-18T21:13:04.637 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1641705372}) 2024-08-18T21:13:04.637 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.637 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1486872851}) 2024-08-18T21:13:04.637 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1736762120}) 2024-08-18T21:13:04.637 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.637 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1486872851}) 2024-08-18T21:13:04.638 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=135874202}) 2024-08-18T21:13:04.638 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.638 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1486872851}) 2024-08-18T21:13:04.638 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3953914240}) 2024-08-18T21:13:04.638 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.638 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1486872851}) 2024-08-18T21:13:04.638 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4005093757}) 2024-08-18T21:13:04.638 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.623+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.638 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1486872851}) 2024-08-18T21:13:04.638 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2618174118}) 2024-08-18T21:13:04.638 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.638 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1486872851}) 2024-08-18T21:13:04.638 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1300431351}) 2024-08-18T21:13:04.639 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.639 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1486872851}) 2024-08-18T21:13:04.639 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4149267052}) 2024-08-18T21:13:04.639 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.639 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1486872851}) 2024-08-18T21:13:04.639 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4265531878}) 2024-08-18T21:13:04.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 10 monclient: get_monmap_and_config 2024-08-18T21:13:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 10 monclient: build_initial_monmap 2024-08-18T21:13:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 10 monclient: monmap: 2024-08-18T21:13:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:04.630136+0000 2024-08-18T21:13:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:04.630136+0000 2024-08-18T21:13:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:04.641 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:04.641 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:04.641 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:04.641 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:04.641 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:04.641 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:04.641 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.642 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.642 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=175075260}) 2024-08-18T21:13:04.642 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2732473670}) 2024-08-18T21:13:04.642 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.642 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=175075260}) 2024-08-18T21:13:04.642 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4009527899}) 2024-08-18T21:13:04.642 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.643 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=175075260}) 2024-08-18T21:13:04.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 1 Processor -- start 2024-08-18T21:13:04.643 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1098430031}) 2024-08-18T21:13:04.644 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.644 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=175075260}) 2024-08-18T21:13:04.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 1 -- start start 2024-08-18T21:13:04.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 10 monclient: init 2024-08-18T21:13:04.645 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=873854483}) 2024-08-18T21:13:04.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=175075260}) 2024-08-18T21:13:04.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1949935601}) 2024-08-18T21:13:04.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=175075260}) 2024-08-18T21:13:04.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1034670051}) 2024-08-18T21:13:04.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=175075260}) 2024-08-18T21:13:04.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=291758077}) 2024-08-18T21:13:04.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=175075260}) 2024-08-18T21:13:04.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.627+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1109656214}) 2024-08-18T21:13:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 10 monclient: _add_conns ranks=[0,3,2,9,5,10,8,4,1,7,6] 2024-08-18T21:13:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8d140a5ac0 addr v1:172.21.15.5:6789/0 2024-08-18T21:13:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d140a65b0 0x7f8d1413cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 10 monclient(hunting): picked mon.noname-g con 0x7f8d140a65b0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8d1413d0d0 0x7f8d1413f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 10 monclient(hunting): picked mon.noname-b con 0x7f8d1413d0d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d140a2050 con 0x7f8d140a5ac0 2024-08-18T21:13:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f8d140a3990 con 0x7f8d1413d0d0 2024-08-18T21:13:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8d140a30f0 con 0x7f8d140a65b0 2024-08-18T21:13:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d1b732640 10 monclient(hunting): authenticate will time out at 1551.643193s 2024-08-18T21:13:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8d1413d0d0 0x7f8d1413f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8d1413d0d0 0x7f8d1413f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:45480/0 (socket says 172.21.15.5:45480) 2024-08-18T21:13:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 1 -- 172.21.15.5:0/526312632 learned_addr learned my addr 172.21.15.5:0/526312632 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 10 monclient(hunting): get_auth_request con 0x7f8d1413d0d0 auth_method 0 2024-08-18T21:13:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d18ccd640 1 --2- 172.21.15.5:0/526312632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d140a65b0 0x7f8d1413cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d18ccd640 10 monclient(hunting): get_auth_request con 0x7f8d140a65b0 auth_method 0 2024-08-18T21:13:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d18ccd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d18ccd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d18ccd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 10 monclient(hunting): handle_auth_done global_id 114491 payload 274 2024-08-18T21:13:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 1 -- 172.21.15.5:0/526312632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d140a65b0 msgr2=0x7f8d1413cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 1 --2- 172.21.15.5:0/526312632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d140a65b0 0x7f8d1413cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 1 -- 172.21.15.5:0/526312632 >> v1:172.21.15.5:6789/0 conn(0x7f8d140a5ac0 legacy=0x7f8d140a5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 10 monclient: _finish_hunting 0 2024-08-18T21:13:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 1 monclient: found mon.noname-b 2024-08-18T21:13:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:13:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.627+0000 7f8d19ccf640 1 -- 172.21.15.5:0/526312632 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d140a7660 con 0x7f8d1413d0d0 2024-08-18T21:13:04.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=190563502}) 2024-08-18T21:13:04.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=598112900}) 2024-08-18T21:13:04.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=190563502}) 2024-08-18T21:13:04.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2128297942}) 2024-08-18T21:13:04.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=190563502}) 2024-08-18T21:13:04.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2947381123}) 2024-08-18T21:13:04.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=190563502}) 2024-08-18T21:13:04.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2909448146}) 2024-08-18T21:13:04.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=190563502}) 2024-08-18T21:13:04.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1165578828}) 2024-08-18T21:13:04.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=190563502}) 2024-08-18T21:13:04.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1651734591}) 2024-08-18T21:13:04.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=190563502}) 2024-08-18T21:13:04.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=467168965}) 2024-08-18T21:13:04.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=190563502}) 2024-08-18T21:13:04.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.631+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3398298375}) 2024-08-18T21:13:04.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=934812973}) 2024-08-18T21:13:04.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3248926094}) 2024-08-18T21:13:04.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=934812973}) 2024-08-18T21:13:04.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1341854909}) 2024-08-18T21:13:04.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=934812973}) 2024-08-18T21:13:04.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3147132002}) 2024-08-18T21:13:04.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=934812973}) 2024-08-18T21:13:04.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2682010922}) 2024-08-18T21:13:04.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=934812973}) 2024-08-18T21:13:04.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2600576104}) 2024-08-18T21:13:04.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=934812973}) 2024-08-18T21:13:04.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2487099684}) 2024-08-18T21:13:04.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=934812973}) 2024-08-18T21:13:04.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4144990459}) 2024-08-18T21:13:04.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=934812973}) 2024-08-18T21:13:04.657 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1003140841}) 2024-08-18T21:13:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d19ccf640 1 -- 172.21.15.5:0/526312632 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8d1413d0d0 msgr2=0x7f8d1413f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d19ccf640 1 --2- 172.21.15.5:0/526312632 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8d1413d0d0 0x7f8d1413f4c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009e80 tx=0x7f8d0c01c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a92c1ec4fa826eaa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d0bfff640 1 -- 172.21.15.5:0/526312632 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8d0c0090d0 con 0x7f8d1413d0d0 2024-08-18T21:13:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d0bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d0bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:13:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d0bfff640 10 monclient: dump: 2024-08-18T21:13:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:04.660 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d0bfff640 10 monclient: _finish_auth 0 2024-08-18T21:13:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d0bfff640 10 monclient: _check_auth_tickets 2024-08-18T21:13:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d0bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d0bfff640 1 -- 172.21.15.5:0/526312632 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0c0a5a70 con 0x7f8d1413d0d0 2024-08-18T21:13:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d1b732640 5 monclient: authenticate success, global_id 114491 2024-08-18T21:13:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d1b732640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:13:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d0bfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d0bfff640 1 -- 172.21.15.5:0/526312632 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8d0c0a5c20 con 0x7f8d1413d0d0 2024-08-18T21:13:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d0bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d0bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d0bfff640 10 monclient: dump: 2024-08-18T21:13:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:04.662 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d1b732640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d1b732640 4 set_mon_vals no callback set 2024-08-18T21:13:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d1b732640 10 monclient: shutdown 2024-08-18T21:13:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d1b732640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d1b732640 1 -- 172.21.15.5:0/526312632 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8d1413d0d0 msgr2=0x7f8d1413f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d1b732640 1 --2- 172.21.15.5:0/526312632 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8d1413d0d0 0x7f8d1413f4c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009e80 tx=0x7f8d0c01c910 comp rx=0 tx=0).stop 2024-08-18T21:13:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d1b732640 1 -- 172.21.15.5:0/526312632 shutdown_connections 2024-08-18T21:13:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d1b732640 1 --2- 172.21.15.5:0/526312632 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8d1413d0d0 0x7f8d1413f4c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d1b732640 1 --2- 172.21.15.5:0/526312632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d140a65b0 0x7f8d1413cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d1b732640 1 -- 172.21.15.5:0/526312632 >> 172.21.15.5:0/526312632 conn(0x7f8d140aa770 msgr2=0x7f8d140a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d1b732640 1 -- 172.21.15.5:0/526312632 shutdown_connections 2024-08-18T21:13:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d1b732640 1 -- 172.21.15.5:0/526312632 wait complete. 2024-08-18T21:13:04.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3356345749}) 2024-08-18T21:13:04.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=725566557}) 2024-08-18T21:13:04.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3356345749}) 2024-08-18T21:13:04.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2283192789}) 2024-08-18T21:13:04.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3356345749}) 2024-08-18T21:13:04.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3547233340}) 2024-08-18T21:13:04.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3356345749}) 2024-08-18T21:13:04.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4004289762}) 2024-08-18T21:13:04.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3356345749}) 2024-08-18T21:13:04.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3648456681}) 2024-08-18T21:13:04.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3356345749}) 2024-08-18T21:13:04.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=459712981}) 2024-08-18T21:13:04.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3356345749}) 2024-08-18T21:13:04.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3823907322}) 2024-08-18T21:13:04.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3356345749}) 2024-08-18T21:13:04.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.635+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=140044155}) 2024-08-18T21:13:04.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d1b732640 10 monclient: build_initial_monmap 2024-08-18T21:13:04.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.635+0000 7f8d1b732640 10 monclient: monmap: 2024-08-18T21:13:04.669 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:04.669 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:04.669 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:04.669 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:04.669 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:04.669 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.669 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:04.669 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:04.669 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:04.670 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:04.670 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:04.670 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:04.670 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:04.670 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:04.670 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:04.670 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 1 Processor -- start 2024-08-18T21:13:04.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 1 -- start start 2024-08-18T21:13:04.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 10 monclient: init 2024-08-18T21:13:04.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:04.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 10 monclient: _add_conns ranks=[8,3,7,2,1,6,0,5,4] 2024-08-18T21:13:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8d140a5ac0 0x7f8d14120ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 10 monclient(hunting): picked mon.noname-e con 0x7f8d140a5ac0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d140a65b0 0x7f8d14122ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 10 monclient(hunting): picked mon.noname-g con 0x7f8d140a65b0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8d1413d0d0 0x7f8d1413bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 10 monclient(hunting): picked mon.noname-i con 0x7f8d1413d0d0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8d1406da60 con 0x7f8d140a65b0 2024-08-18T21:13:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f8d140a1e50 con 0x7f8d1413d0d0 2024-08-18T21:13:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f8d1406dbe0 con 0x7f8d140a5ac0 2024-08-18T21:13:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d1b732640 10 monclient(hunting): authenticate will time out at 1551.652885s 2024-08-18T21:13:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8d140a5ac0 0x7f8d14120ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8d140a5ac0 0x7f8d14120ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:39588/0 (socket says 172.21.15.5:39588) 2024-08-18T21:13:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 1 -- 172.21.15.5:0/1088830750 learned_addr learned my addr 172.21.15.5:0/1088830750 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 10 monclient(hunting): get_auth_request con 0x7f8d140a5ac0 auth_method 0 2024-08-18T21:13:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d19ccf640 1 --2- 172.21.15.5:0/1088830750 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8d1413d0d0 0x7f8d1413bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d19ccf640 10 monclient(hunting): get_auth_request con 0x7f8d1413d0d0 auth_method 0 2024-08-18T21:13:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d19ccf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d19ccf640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d19ccf640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d18ccd640 1 --2- 172.21.15.5:0/1088830750 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d140a65b0 0x7f8d14122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d18ccd640 10 monclient(hunting): get_auth_request con 0x7f8d140a65b0 auth_method 0 2024-08-18T21:13:04.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d18ccd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d18ccd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d18ccd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d18ccd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d18ccd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d18ccd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d19ccf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d19ccf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d19ccf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 10 monclient(hunting): handle_auth_done global_id 114686 payload 824 2024-08-18T21:13:04.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 1 -- 172.21.15.5:0/1088830750 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8d1413d0d0 msgr2=0x7f8d1413bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 1 --2- 172.21.15.5:0/1088830750 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8d1413d0d0 0x7f8d1413bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 1 -- 172.21.15.5:0/1088830750 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d140a65b0 msgr2=0x7f8d14122ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 1 --2- 172.21.15.5:0/1088830750 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d140a65b0 0x7f8d14122ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 10 monclient: _finish_hunting 0 2024-08-18T21:13:04.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 1 monclient: found mon.noname-e 2024-08-18T21:13:04.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:04.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:13:04.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 1 -- 172.21.15.5:0/1088830750 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d14123850 con 0x7f8d140a5ac0 2024-08-18T21:13:04.677 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.677 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3660412114}) 2024-08-18T21:13:04.677 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1024202221}) 2024-08-18T21:13:04.677 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.677 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3660412114}) 2024-08-18T21:13:04.677 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1419403957}) 2024-08-18T21:13:04.677 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.677 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3660412114}) 2024-08-18T21:13:04.677 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2814769977}) 2024-08-18T21:13:04.677 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.677 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3660412114}) 2024-08-18T21:13:04.678 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2009600927}) 2024-08-18T21:13:04.678 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.678 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3660412114}) 2024-08-18T21:13:04.678 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1901271723}) 2024-08-18T21:13:04.678 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.678 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3660412114}) 2024-08-18T21:13:04.678 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2590188970}) 2024-08-18T21:13:04.678 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.678 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3660412114}) 2024-08-18T21:13:04.678 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3912602099}) 2024-08-18T21:13:04.678 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.678 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3660412114}) 2024-08-18T21:13:04.678 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.639+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1872180562}) 2024-08-18T21:13:04.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 1 -- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8d140a5ac0 msgr2=0x7f8d14120ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.639+0000 7f8d194ce640 1 --2- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8d140a5ac0 0x7f8d14120ef0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000c480 tx=0x7f8d1000c940 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d09ffb640 1 -- 172.21.15.5:0/1088830750 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8d10012cb0 con 0x7f8d140a5ac0 2024-08-18T21:13:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d09ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d09ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:13:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d09ffb640 10 monclient: dump: 2024-08-18T21:13:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:04.681 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d09ffb640 10 monclient: _finish_auth 0 2024-08-18T21:13:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d09ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:13:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d09ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d09ffb640 1 -- 172.21.15.5:0/1088830750 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d10017070 con 0x7f8d140a5ac0 2024-08-18T21:13:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d1b732640 5 monclient: authenticate success, global_id 114686 2024-08-18T21:13:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d1b732640 10 monclient: _renew_subs 2024-08-18T21:13:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d1b732640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d1b732640 1 -- 172.21.15.5:0/1088830750 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d14121e70 con 0x7f8d140a5ac0 2024-08-18T21:13:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d09ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d09ffb640 1 -- 172.21.15.5:0/1088830750 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8d100117f0 con 0x7f8d140a5ac0 2024-08-18T21:13:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d09ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d09ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d0b7fe640 4 set_mon_vals no callback set 2024-08-18T21:13:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d09ffb640 10 monclient: dump: 2024-08-18T21:13:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:04.683 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d1b732640 10 monclient: _renew_subs 2024-08-18T21:13:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d1b732640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d1b732640 1 -- 172.21.15.5:0/1088830750 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d141246c0 con 0x7f8d140a5ac0 2024-08-18T21:13:04.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2611932293}) 2024-08-18T21:13:04.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2085903481}) 2024-08-18T21:13:04.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2611932293}) 2024-08-18T21:13:04.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1104928469}) 2024-08-18T21:13:04.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2611932293}) 2024-08-18T21:13:04.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=490477080}) 2024-08-18T21:13:04.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2611932293}) 2024-08-18T21:13:04.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1299166284}) 2024-08-18T21:13:04.687 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.687 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2611932293}) 2024-08-18T21:13:04.687 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=891467908}) 2024-08-18T21:13:04.687 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.687 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2611932293}) 2024-08-18T21:13:04.687 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4084186610}) 2024-08-18T21:13:04.687 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.687 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2611932293}) 2024-08-18T21:13:04.687 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=155430117}) 2024-08-18T21:13:04.687 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.687 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2611932293}) 2024-08-18T21:13:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d1b732640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:04.688 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3210425681}) 2024-08-18T21:13:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d1b732640 1 --2- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d141cd170 0x7f8d141cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d1b732640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d1b732640 1 -- 172.21.15.5:0/1088830750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8d14051140 con 0x7f8d141cd170 2024-08-18T21:13:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d18ccd640 1 --2- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d141cd170 0x7f8d141cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d18ccd640 10 monclient: get_auth_request con 0x7f8d141cd170 auth_method 0 2024-08-18T21:13:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d18ccd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d18ccd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d18ccd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d09ffb640 1 -- 172.21.15.5:0/1088830750 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f8d10011380 con 0x7f8d140a5ac0 2024-08-18T21:13:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d09ffb640 1 --2- 172.21.15.5:0/1088830750 >> v2:172.21.15.157:6812/631023601 conn(0x7f8cf803be20 0x7f8cf803e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d09ffb640 1 -- 172.21.15.5:0/1088830750 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(264..264 src has 22..264) ==== 3898+0+0 (secure 0 0 0) 0x7f8d1004e4b0 con 0x7f8d140a5ac0 2024-08-18T21:13:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d19ccf640 1 --2- 172.21.15.5:0/1088830750 >> v2:172.21.15.157:6812/631023601 conn(0x7f8cf803be20 0x7f8cf803e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d19ccf640 10 monclient: get_auth_request con 0x7f8cf803be20 auth_method 0 2024-08-18T21:13:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d18ccd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d18ccd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d18ccd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d18ccd640 10 monclient(hunting): handle_auth_done global_id 124236 payload 824 2024-08-18T21:13:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.643+0000 7f8d18ccd640 1 -- 172.21.15.5:0/1088830750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d1413ce90 con 0x7f8d141cd170 2024-08-18T21:13:04.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231877820}) 2024-08-18T21:13:04.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3974356668}) 2024-08-18T21:13:04.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231877820}) 2024-08-18T21:13:04.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=783660838}) 2024-08-18T21:13:04.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231877820}) 2024-08-18T21:13:04.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1981800113}) 2024-08-18T21:13:04.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231877820}) 2024-08-18T21:13:04.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3850663819}) 2024-08-18T21:13:04.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231877820}) 2024-08-18T21:13:04.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1090912582}) 2024-08-18T21:13:04.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231877820}) 2024-08-18T21:13:04.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3011527713}) 2024-08-18T21:13:04.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231877820}) 2024-08-18T21:13:04.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1585017274}) 2024-08-18T21:13:04.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.695 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.643+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231877820}) 2024-08-18T21:13:04.695 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1711997938}) 2024-08-18T21:13:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.647+0000 7f8d18ccd640 1 -- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d141cd170 msgr2=0x7f8d141cd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.647+0000 7f8d18ccd640 1 --2- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d141cd170 0x7f8d141cd550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8d140a6b80 tx=0x7f8d04010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.647+0000 7f8d19ccf640 1 --2- 172.21.15.5:0/1088830750 >> v2:172.21.15.157:6812/631023601 conn(0x7f8cf803be20 0x7f8cf803e2e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8d14071160 tx=0x7f8d0c0a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.647+0000 7f8d09ffb640 1 -- 172.21.15.5:0/1088830750 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8d0401a020 con 0x7f8d141cd170 2024-08-18T21:13:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.647+0000 7f8d09ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.647+0000 7f8d09ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:13:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.647+0000 7f8d09ffb640 10 monclient: dump: 2024-08-18T21:13:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:04.697 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.647+0000 7f8d09ffb640 1 -- 172.21.15.5:0/1088830750 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8d0400ebc0 con 0x7f8d141cd170 2024-08-18T21:13:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.647+0000 7f8d09ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.647+0000 7f8d09ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.647+0000 7f8d09ffb640 1 -- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d141cd170 msgr2=0x7f8d141cd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.647+0000 7f8d09ffb640 1 --2- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d141cd170 0x7f8d141cd550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8d140a6b80 tx=0x7f8d04010c80 comp rx=0 tx=0).stop 2024-08-18T21:13:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.647+0000 7f8d09ffb640 1 -- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d141cd170 msgr2=0x7f8d141cd550 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.647+0000 7f8d09ffb640 1 --2- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d141cd170 0x7f8d141cd550 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8d140a6b80 tx=0x7f8d04010c80 comp rx=0 tx=0).stop 2024-08-18T21:13:04.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1219008559}) 2024-08-18T21:13:04.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3767412953}) 2024-08-18T21:13:04.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1219008559}) 2024-08-18T21:13:04.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1378928857}) 2024-08-18T21:13:04.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1219008559}) 2024-08-18T21:13:04.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3731036739}) 2024-08-18T21:13:04.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1219008559}) 2024-08-18T21:13:04.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3432136055}) 2024-08-18T21:13:04.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1219008559}) 2024-08-18T21:13:04.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3860666689}) 2024-08-18T21:13:04.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1219008559}) 2024-08-18T21:13:04.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1156320666}) 2024-08-18T21:13:04.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1219008559}) 2024-08-18T21:13:04.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=605253891}) 2024-08-18T21:13:04.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1219008559}) 2024-08-18T21:13:04.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.647+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3665319985}) 2024-08-18T21:13:04.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4113309039}) 2024-08-18T21:13:04.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1879393038}) 2024-08-18T21:13:04.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4113309039}) 2024-08-18T21:13:04.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1567302601}) 2024-08-18T21:13:04.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4113309039}) 2024-08-18T21:13:04.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2046286668}) 2024-08-18T21:13:04.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4113309039}) 2024-08-18T21:13:04.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=437741997}) 2024-08-18T21:13:04.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4113309039}) 2024-08-18T21:13:04.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3615916282}) 2024-08-18T21:13:04.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.707 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4113309039}) 2024-08-18T21:13:04.707 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1225282850}) 2024-08-18T21:13:04.707 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.707 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4113309039}) 2024-08-18T21:13:04.707 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=636327150}) 2024-08-18T21:13:04.707 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.707 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4113309039}) 2024-08-18T21:13:04.707 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.651+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=85596034}) 2024-08-18T21:13:04.707 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.707 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2941775480}) 2024-08-18T21:13:04.707 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=101662439}) 2024-08-18T21:13:04.707 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.707 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2941775480}) 2024-08-18T21:13:04.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2470503122}) 2024-08-18T21:13:04.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2941775480}) 2024-08-18T21:13:04.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=952425858}) 2024-08-18T21:13:04.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2941775480}) 2024-08-18T21:13:04.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3238944845}) 2024-08-18T21:13:04.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2941775480}) 2024-08-18T21:13:04.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3312815207}) 2024-08-18T21:13:04.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2941775480}) 2024-08-18T21:13:04.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2951862472}) 2024-08-18T21:13:04.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.709 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2941775480}) 2024-08-18T21:13:04.709 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3611773907}) 2024-08-18T21:13:04.709 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.709 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2941775480}) 2024-08-18T21:13:04.709 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2657748614}) 2024-08-18T21:13:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.655+0000 7f8d1b732640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.655+0000 7f8d1b732640 1 --2- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d141cda90 0x7f8d140a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.655+0000 7f8d1b732640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.655+0000 7f8d1b732640 1 -- 172.21.15.5:0/1088830750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1406b7e0 con 0x7f8d141cda90 2024-08-18T21:13:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.655+0000 7f8d18ccd640 1 --2- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d141cda90 0x7f8d140a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.655+0000 7f8d18ccd640 10 monclient: get_auth_request con 0x7f8d141cda90 auth_method 0 2024-08-18T21:13:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.655+0000 7f8d18ccd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.655+0000 7f8d18ccd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.655+0000 7f8d18ccd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.655+0000 7f8d18ccd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.655+0000 7f8d18ccd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.655+0000 7f8d18ccd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.655+0000 7f8d18ccd640 10 monclient(hunting): handle_auth_done global_id 124245 payload 824 2024-08-18T21:13:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.655+0000 7f8d18ccd640 1 -- 172.21.15.5:0/1088830750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8d14124290 con 0x7f8d141cda90 2024-08-18T21:13:04.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3128796399}) 2024-08-18T21:13:04.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=788422738}) 2024-08-18T21:13:04.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3128796399}) 2024-08-18T21:13:04.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=101858281}) 2024-08-18T21:13:04.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3128796399}) 2024-08-18T21:13:04.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3109194688}) 2024-08-18T21:13:04.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3128796399}) 2024-08-18T21:13:04.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2073397684}) 2024-08-18T21:13:04.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3128796399}) 2024-08-18T21:13:04.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=982410917}) 2024-08-18T21:13:04.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3128796399}) 2024-08-18T21:13:04.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1076707647}) 2024-08-18T21:13:04.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3128796399}) 2024-08-18T21:13:04.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2191963973}) 2024-08-18T21:13:04.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3128796399}) 2024-08-18T21:13:04.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.655+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3449227002}) 2024-08-18T21:13:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d18ccd640 1 -- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d141cda90 msgr2=0x7f8d140a7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d18ccd640 1 --2- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d141cda90 0x7f8d140a7fb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d14123f40 tx=0x7f8d040046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d09ffb640 1 -- 172.21.15.5:0/1088830750 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8d0401a040 con 0x7f8d141cda90 2024-08-18T21:13:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d09ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d09ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:13:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d09ffb640 10 monclient: dump: 2024-08-18T21:13:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:04.717 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d09ffb640 1 -- 172.21.15.5:0/1088830750 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9249 (secure 0 0 0) 0x7f8d040212c0 con 0x7f8d141cda90 2024-08-18T21:13:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d09ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d09ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d09ffb640 1 -- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d141cda90 msgr2=0x7f8d140a7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d09ffb640 1 --2- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d141cda90 0x7f8d140a7fb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d14123f40 tx=0x7f8d040046d0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d09ffb640 1 -- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d141cda90 msgr2=0x7f8d140a7fb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d09ffb640 1 --2- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d141cda90 0x7f8d140a7fb0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d14123f40 tx=0x7f8d040046d0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.718 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:04.718 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:04.718 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:04.718 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:13:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 31639, 2024-08-18T21:13:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:04.719 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:13:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:04.721 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:04.722 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:04.725 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.727 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.741 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.741 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:04.741 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d1b732640 1 -- 172.21.15.5:0/1088830750 >> v2:172.21.15.157:6812/631023601 conn(0x7f8cf803be20 msgr2=0x7f8cf803e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d1b732640 1 --2- 172.21.15.5:0/1088830750 >> v2:172.21.15.157:6812/631023601 conn(0x7f8cf803be20 0x7f8cf803e2e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8d14071160 tx=0x7f8d0c0a7070 comp rx=0 tx=0).stop 2024-08-18T21:13:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d1b732640 10 monclient: shutdown 2024-08-18T21:13:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d1b732640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d1b732640 1 -- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8d140a5ac0 msgr2=0x7f8d14120ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d1b732640 1 --2- 172.21.15.5:0/1088830750 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f8d140a5ac0 0x7f8d14120ef0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000c480 tx=0x7f8d1000c940 comp rx=0 tx=0).stop 2024-08-18T21:13:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d19ccf640 1 -- 172.21.15.5:0/1088830750 reap_dead start 2024-08-18T21:13:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d19ccf640 1 -- 172.21.15.5:0/1088830750 reap_dead start 2024-08-18T21:13:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d1b732640 1 -- 172.21.15.5:0/1088830750 shutdown_connections 2024-08-18T21:13:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d1b732640 1 -- 172.21.15.5:0/1088830750 >> 172.21.15.5:0/1088830750 conn(0x7f8d140aa770 msgr2=0x7f8d140731a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d1b732640 1 -- 172.21.15.5:0/1088830750 shutdown_connections 2024-08-18T21:13:04.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198363326}) 2024-08-18T21:13:04.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=941767853}) 2024-08-18T21:13:04.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.659+0000 7f8d1b732640 1 -- 172.21.15.5:0/1088830750 wait complete. 2024-08-18T21:13:04.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198363326}) 2024-08-18T21:13:04.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2372100485}) 2024-08-18T21:13:04.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198363326}) 2024-08-18T21:13:04.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3730880707}) 2024-08-18T21:13:04.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198363326}) 2024-08-18T21:13:04.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3080448955}) 2024-08-18T21:13:04.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198363326}) 2024-08-18T21:13:04.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=791663485}) 2024-08-18T21:13:04.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198363326}) 2024-08-18T21:13:04.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4068909272}) 2024-08-18T21:13:04.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198363326}) 2024-08-18T21:13:04.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1041091762}) 2024-08-18T21:13:04.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198363326}) 2024-08-18T21:13:04.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.659+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1518265867}) 2024-08-18T21:13:04.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033250237}) 2024-08-18T21:13:04.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3809791291}) 2024-08-18T21:13:04.748 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.748 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033250237}) 2024-08-18T21:13:04.748 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2691035628}) 2024-08-18T21:13:04.748 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.748 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033250237}) 2024-08-18T21:13:04.748 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3859820369}) 2024-08-18T21:13:04.748 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.748 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033250237}) 2024-08-18T21:13:04.748 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2948525903}) 2024-08-18T21:13:04.748 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.748 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033250237}) 2024-08-18T21:13:04.748 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4057835380}) 2024-08-18T21:13:04.748 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.748 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033250237}) 2024-08-18T21:13:04.749 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4128991500}) 2024-08-18T21:13:04.749 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.749 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033250237}) 2024-08-18T21:13:04.749 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=680631764}) 2024-08-18T21:13:04.749 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.749 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033250237}) 2024-08-18T21:13:04.749 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.663+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=600902304}) 2024-08-18T21:13:04.750 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:04.750 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:13:04.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:13:04.756 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.719+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.756 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.719+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=49,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=12} crc {logm=2345803079,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3097968391,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3105920945,osd_snap=2941457380,osdmap=242084626}) 2024-08-18T21:13:04.756 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.719+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=46,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=8,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=16} crc {logm=4092862471,mdsmap=4274512535,mgr=1059420282,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1489439178,mon_config_key=2147202552,monmap=3438368439,osd_metadata=1131583894,osd_pg_creating=3105920945,osd_snap=723727393,osdmap=2020785727}) 2024-08-18T21:13:04.756 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.719+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.756 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.719+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=49,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=12} crc {logm=2345803079,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3097968391,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3105920945,osd_snap=2941457380,osdmap=242084626}) 2024-08-18T21:13:04.756 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.719+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=49,mdsmap=3,mgr=7,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=12} crc {logm=1494548556,mdsmap=4274512535,mgr=1059420282,mgrstat=527382200,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3105920945,osd_snap=723727393,osdmap=4269096309}) 2024-08-18T21:13:04.756 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.719+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.719+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=49,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=12} crc {logm=2345803079,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3097968391,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3105920945,osd_snap=2941457380,osdmap=242084626}) 2024-08-18T21:13:04.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.719+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=46,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=7,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=14} crc {logm=560727968,mdsmap=214691689,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=1111796497,mon_config_key=4097785744,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3105920945,osd_snap=723727393,osdmap=4292503896}) 2024-08-18T21:13:04.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.719+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.719+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=49,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=12} crc {logm=2345803079,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3097968391,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3105920945,osd_snap=2941457380,osdmap=242084626}) 2024-08-18T21:13:04.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.719+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=48,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=6,osd_snap=2,osdmap=12} crc {logm=3936639599,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgrstat=527382200,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_snap=723727393,osdmap=2477426001}) 2024-08-18T21:13:04.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.719+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.719+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=49,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=12} crc {logm=2345803079,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3097968391,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3105920945,osd_snap=2941457380,osdmap=242084626}) 2024-08-18T21:13:04.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.719+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=49,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=6,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=14} crc {logm=1820809016,mdsmap=4274512535,mgr=3549253758,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3377599716,mon_config_key=1801287425,monmap=3438368439,osd_metadata=1462106993,osd_pg_creating=3105920945,osd_snap=723727393,osdmap=4292503896}) 2024-08-18T21:13:04.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=49,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=12} crc {logm=2345803079,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3097968391,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3105920945,osd_snap=2941457380,osdmap=242084626}) 2024-08-18T21:13:04.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=48,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=11} crc {logm=3409450764,mdsmap=485591938,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=527382200,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3105920945,osd_snap=723727393,osdmap=4250717883}) 2024-08-18T21:13:04.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=49,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=12} crc {logm=2345803079,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3097968391,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3105920945,osd_snap=2941457380,osdmap=242084626}) 2024-08-18T21:13:04.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=49,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=7,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=10} crc {logm=1890107947,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=527382200,mon_config_key=4097785744,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3105920945,osd_snap=723727393,osdmap=2863799730}) 2024-08-18T21:13:04.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=49,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=12} crc {logm=2345803079,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3097968391,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3105920945,osd_snap=2941457380,osdmap=242084626}) 2024-08-18T21:13:04.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.723+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=50,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=10} crc {logm=3032071814,mdsmap=3140514009,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=391488473,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=3105920945,osd_snap=723727393,osdmap=701093961}) 2024-08-18T21:13:04.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2520858494}) 2024-08-18T21:13:04.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3700870502}) 2024-08-18T21:13:04.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2520858494}) 2024-08-18T21:13:04.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=861496273}) 2024-08-18T21:13:04.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2520858494}) 2024-08-18T21:13:04.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3066125343}) 2024-08-18T21:13:04.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2520858494}) 2024-08-18T21:13:04.780 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=1530199329}) 2024-08-18T21:13:04.780 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.780 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2520858494}) 2024-08-18T21:13:04.780 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=86988500}) 2024-08-18T21:13:04.780 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.780 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2520858494}) 2024-08-18T21:13:04.780 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=3082907123}) 2024-08-18T21:13:04.780 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.780 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2520858494}) 2024-08-18T21:13:04.780 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3706495385}) 2024-08-18T21:13:04.780 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.780 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2520858494}) 2024-08-18T21:13:04.780 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.779+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=3224588690}) 2024-08-18T21:13:04.812 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.812 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2650993107}) 2024-08-18T21:13:04.812 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2665024803}) 2024-08-18T21:13:04.812 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.812 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2650993107}) 2024-08-18T21:13:04.812 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1921917255}) 2024-08-18T21:13:04.812 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.812 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2650993107}) 2024-08-18T21:13:04.812 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3060548075}) 2024-08-18T21:13:04.812 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.812 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2650993107}) 2024-08-18T21:13:04.812 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=4104225257}) 2024-08-18T21:13:04.813 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.813 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2650993107}) 2024-08-18T21:13:04.813 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=1121407028}) 2024-08-18T21:13:04.813 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.813 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2650993107}) 2024-08-18T21:13:04.813 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=1142738304}) 2024-08-18T21:13:04.813 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.813 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2650993107}) 2024-08-18T21:13:04.813 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2445496630}) 2024-08-18T21:13:04.813 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:04.813 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2650993107}) 2024-08-18T21:13:04.813 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:04.811+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=2241779806}) 2024-08-18T21:13:04.826 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:04.827 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31723]: starting. 2024-08-18T21:13:04.827 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31723]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31687 2024-08-18T21:13:04.827 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31723]: shutting down. 2024-08-18T21:13:04.829 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:04.829 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:04.829 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:13:04.831 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:13:04.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 10 monclient: get_monmap_and_config 2024-08-18T21:13:04.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 10 monclient: build_initial_monmap 2024-08-18T21:13:04.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 10 monclient: monmap: 2024-08-18T21:13:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:04.905397+0000 2024-08-18T21:13:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:04.905397+0000 2024-08-18T21:13:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:04.903 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 1 Processor -- start 2024-08-18T21:13:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 1 -- start start 2024-08-18T21:13:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 10 monclient: init 2024-08-18T21:13:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 10 monclient: _add_conns ranks=[0,7,4,10,1,3,6,5,8,2,9] 2024-08-18T21:13:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f06fc0a59e0 addr v1:172.21.15.5:6789/0 2024-08-18T21:13:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f06fc0a64d0 0x7f06fc13cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 10 monclient(hunting): picked mon.noname-i con 0x7f06fc0a64d0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:04.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f06fc13cff0 0x7f06fc13f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 10 monclient(hunting): picked mon.noname-c con 0x7f06fc13cff0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:13:04.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06fc0a38b0 con 0x7f06fc0a59e0 2024-08-18T21:13:04.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f06fc0a0f40 con 0x7f06fc13cff0 2024-08-18T21:13:04.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f06fc0a3010 con 0x7f06fc0a64d0 2024-08-18T21:13:04.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:04.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f0701e12640 10 monclient(hunting): authenticate will time out at 1551.918405s 2024-08-18T21:13:04.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f06fc13cff0 0x7f06fc13f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f06fc0a59e0 0x7f06fc0a5dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44124/0 (socket says 172.21.15.5:44124) 2024-08-18T21:13:04.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fb7fe640 1 -- 172.21.15.5:0/3228470753 learned_addr learned my addr 172.21.15.5:0/3228470753 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:13:04.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 10 monclient(hunting): get_auth_request con 0x7f06fc13cff0 auth_method 0 2024-08-18T21:13:04.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06faffd640 1 --2- 172.21.15.5:0/3228470753 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f06fc0a64d0 0x7f06fc13cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06faffd640 10 monclient(hunting): get_auth_request con 0x7f06fc0a64d0 auth_method 0 2024-08-18T21:13:04.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06faffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06faffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 10 monclient(hunting): handle_auth_done global_id 114475 payload 274 2024-08-18T21:13:04.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 1 -- 172.21.15.5:0/3228470753 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f06fc0a64d0 msgr2=0x7f06fc13cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:04.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 1 --2- 172.21.15.5:0/3228470753 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f06fc0a64d0 0x7f06fc13cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 1 -- 172.21.15.5:0/3228470753 >> v1:172.21.15.5:6789/0 conn(0x7f06fc0a59e0 legacy=0x7f06fc0a5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:04.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 10 monclient: _finish_hunting 0 2024-08-18T21:13:04.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 1 monclient: found mon.noname-c 2024-08-18T21:13:04.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:04.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:13:04.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.903+0000 7f06fbfff640 1 -- 172.21.15.5:0/3228470753 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06fc0a35d0 con 0x7f06fc13cff0 2024-08-18T21:13:04.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f06fbfff640 1 -- 172.21.15.5:0/3228470753 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f06fc13cff0 msgr2=0x7f06fc13f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:04.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f06fbfff640 1 --2- 172.21.15.5:0/3228470753 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f06fc13cff0 0x7f06fc13f3e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009dc0 tx=0x7f06f401c7b0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=c4b51f798b799fe2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:04.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f06fa7fc640 1 -- 172.21.15.5:0/3228470753 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f06f40b2070 con 0x7f06fc13cff0 2024-08-18T21:13:04.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f06fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:04.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f06fa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:13:04.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f06fa7fc640 10 monclient: dump: 2024-08-18T21:13:04.914 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:04.914 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.914 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.914 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.914 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:04.914 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.914 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:04.914 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:04.914 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:04.915 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:04.915 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:04.915 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:04.915 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:04.915 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:04.915 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:04.915 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f06fa7fc640 10 monclient: _finish_auth 0 2024-08-18T21:13:04.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f06fa7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:13:04.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f06fa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:04.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f06fa7fc640 1 -- 172.21.15.5:0/3228470753 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f40a5ac0 con 0x7f06fc13cff0 2024-08-18T21:13:04.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f0701e12640 5 monclient: authenticate success, global_id 114475 2024-08-18T21:13:04.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f0701e12640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:13:04.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f06fa7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:04.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f0701e12640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:04.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f06fa7fc640 1 -- 172.21.15.5:0/3228470753 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f06f40a5c70 con 0x7f06fc13cff0 2024-08-18T21:13:04.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f06fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:04.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f0701e12640 4 set_mon_vals no callback set 2024-08-18T21:13:04.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f06fa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:13:04.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f06fa7fc640 10 monclient: dump: 2024-08-18T21:13:04.916 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:04.916 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.916 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.916 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.916 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:04.916 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.916 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:04.916 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:04.917 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:04.917 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:04.917 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:04.917 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:04.917 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:04.917 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:04.917 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:04.917 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f0701e12640 10 monclient: shutdown 2024-08-18T21:13:04.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f0701e12640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:04.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f0701e12640 1 -- 172.21.15.5:0/3228470753 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f06fc13cff0 msgr2=0x7f06fc13f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f0701e12640 1 --2- 172.21.15.5:0/3228470753 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f06fc13cff0 0x7f06fc13f3e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009dc0 tx=0x7f06f401c7b0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f0701e12640 1 -- 172.21.15.5:0/3228470753 shutdown_connections 2024-08-18T21:13:04.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f0701e12640 1 --2- 172.21.15.5:0/3228470753 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f06fc0a64d0 0x7f06fc13cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f0701e12640 1 --2- 172.21.15.5:0/3228470753 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f06fc13cff0 0x7f06fc13f3e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.907+0000 7f0701e12640 1 -- 172.21.15.5:0/3228470753 >> 172.21.15.5:0/3228470753 conn(0x7f06fc0aa5d0 msgr2=0x7f06fc0a6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:04.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 1 -- 172.21.15.5:0/3228470753 shutdown_connections 2024-08-18T21:13:04.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 1 -- 172.21.15.5:0/3228470753 wait complete. 2024-08-18T21:13:04.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 10 monclient: build_initial_monmap 2024-08-18T21:13:04.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 10 monclient: monmap: 2024-08-18T21:13:04.918 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:04.918 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:04.918 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:04.918 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:04.918 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:04.918 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.918 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:04.919 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:04.919 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:04.919 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:04.919 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:04.919 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:04.919 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:04.919 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:04.919 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:04.919 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 1 Processor -- start 2024-08-18T21:13:04.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 1 -- start start 2024-08-18T21:13:04.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 10 monclient: init 2024-08-18T21:13:04.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:04.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 10 monclient: _add_conns ranks=[8,6,5,3,7,1,2,0,4] 2024-08-18T21:13:04.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f06fc0a59e0 0x7f06fc073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 10 monclient(hunting): picked mon.noname-e con 0x7f06fc0a59e0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:04.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f06fc0a64d0 0x7f06fc136700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 10 monclient(hunting): picked mon.noname-d con 0x7f06fc0a64d0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:04.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f06fc13cff0 0x7f06fc136c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 10 monclient(hunting): picked mon.noname-h con 0x7f06fc13cff0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:04.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f06fc0a1d50 con 0x7f06fc13cff0 2024-08-18T21:13:04.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f06fc0a1bd0 con 0x7f06fc0a64d0 2024-08-18T21:13:04.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f06fc142140 con 0x7f06fc0a59e0 2024-08-18T21:13:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f0701e12640 10 monclient(hunting): authenticate will time out at 1551.925480s 2024-08-18T21:13:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fb7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f06fc0a59e0 0x7f06fc073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f06fc0a64d0 0x7f06fc136700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fb7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f06fc0a59e0 0x7f06fc073220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:39590/0 (socket says 172.21.15.5:39590) 2024-08-18T21:13:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fb7fe640 1 -- 172.21.15.5:0/490848793 learned_addr learned my addr 172.21.15.5:0/490848793 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fb7fe640 10 monclient(hunting): get_auth_request con 0x7f06fc0a59e0 auth_method 0 2024-08-18T21:13:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 10 monclient(hunting): get_auth_request con 0x7f06fc0a64d0 auth_method 0 2024-08-18T21:13:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fbfff640 1 --2- 172.21.15.5:0/490848793 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f06fc13cff0 0x7f06fc136c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fbfff640 10 monclient(hunting): get_auth_request con 0x7f06fc13cff0 auth_method 0 2024-08-18T21:13:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fbfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 10 monclient(hunting): handle_auth_done global_id 85686 payload 824 2024-08-18T21:13:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 1 -- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f06fc0a59e0 msgr2=0x7f06fc073220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 1 --2- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f06fc0a59e0 0x7f06fc073220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 1 -- 172.21.15.5:0/490848793 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f06fc13cff0 msgr2=0x7f06fc136c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 1 --2- 172.21.15.5:0/490848793 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f06fc13cff0 0x7f06fc136c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 10 monclient: _finish_hunting 0 2024-08-18T21:13:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 1 monclient: found mon.noname-d 2024-08-18T21:13:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:13:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06faffd640 1 -- 172.21.15.5:0/490848793 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06fc1230b0 con 0x7f06fc0a64d0 2024-08-18T21:13:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.911+0000 7f06fb7fe640 1 --2- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f06fc0a59e0 0x7f06fc073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:04.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06faffd640 1 -- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f06fc0a64d0 msgr2=0x7f06fc136700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:04.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06faffd640 1 --2- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f06fc0a64d0 0x7f06fc136700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f06f000e7f0 tx=0x7f06f000ecb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:04.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06e3fff640 1 -- 172.21.15.5:0/490848793 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f06f0017070 con 0x7f06fc0a64d0 2024-08-18T21:13:04.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:04.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06e3fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:13:04.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06e3fff640 10 monclient: dump: 2024-08-18T21:13:04.924 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:04.924 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.924 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.924 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.924 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:04.924 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.924 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:04.924 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:04.925 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06e3fff640 10 monclient: _finish_auth 0 2024-08-18T21:13:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06e3fff640 10 monclient: _check_auth_tickets 2024-08-18T21:13:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f0701e12640 5 monclient: authenticate success, global_id 85686 2024-08-18T21:13:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06e3fff640 1 -- 172.21.15.5:0/490848793 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f0013470 con 0x7f06fc0a64d0 2024-08-18T21:13:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06e3fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06e3fff640 1 -- 172.21.15.5:0/490848793 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f06f0013a90 con 0x7f06fc0a64d0 2024-08-18T21:13:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06e3fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:13:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06f9ffb640 4 set_mon_vals no callback set 2024-08-18T21:13:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06e3fff640 10 monclient: dump: 2024-08-18T21:13:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:04.927 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f0701e12640 10 monclient: _renew_subs 2024-08-18T21:13:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f0701e12640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:13:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f0701e12640 1 -- 172.21.15.5:0/490848793 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06fc13f480 con 0x7f06fc0a64d0 2024-08-18T21:13:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f0701e12640 10 monclient: _renew_subs 2024-08-18T21:13:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f0701e12640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:13:04.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f0701e12640 1 -- 172.21.15.5:0/490848793 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f06fc073be0 con 0x7f06fc0a64d0 2024-08-18T21:13:04.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f0701e12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:04.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f0701e12640 1 --2- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f06fc122810 0x7f06fc120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f0701e12640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f0701e12640 1 -- 172.21.15.5:0/490848793 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f06fc051140 con 0x7f06fc122810 2024-08-18T21:13:04.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06fb7fe640 1 --2- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f06fc122810 0x7f06fc120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06fb7fe640 10 monclient: get_auth_request con 0x7f06fc122810 auth_method 0 2024-08-18T21:13:04.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06fb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06e3fff640 1 -- 172.21.15.5:0/490848793 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f06f001a070 con 0x7f06fc0a64d0 2024-08-18T21:13:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06fb7fe640 10 monclient(hunting): handle_auth_done global_id 114509 payload 824 2024-08-18T21:13:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06e3fff640 1 --2- 172.21.15.5:0/490848793 >> v2:172.21.15.157:6812/631023601 conn(0x7f06e803bdf0 0x7f06e803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06fb7fe640 1 -- 172.21.15.5:0/490848793 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06fc0a5dc0 con 0x7f06fc122810 2024-08-18T21:13:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06e3fff640 1 -- 172.21.15.5:0/490848793 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(265..265 src has 22..265) ==== 3506+0+0 (secure 0 0 0) 0x7f06f000f040 con 0x7f06fc0a64d0 2024-08-18T21:13:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06fbfff640 1 --2- 172.21.15.5:0/490848793 >> v2:172.21.15.157:6812/631023601 conn(0x7f06e803bdf0 0x7f06e803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.915+0000 7f06fbfff640 10 monclient: get_auth_request con 0x7f06e803bdf0 auth_method 0 2024-08-18T21:13:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.919+0000 7f06fb7fe640 1 -- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f06fc122810 msgr2=0x7f06fc120620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.919+0000 7f06fb7fe640 1 --2- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f06fc122810 0x7f06fc120620 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0072a0 tx=0x7f06ec007760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.919+0000 7f06e3fff640 1 -- 172.21.15.5:0/490848793 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f06ec00fde0 con 0x7f06fc122810 2024-08-18T21:13:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.919+0000 7f06e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.919+0000 7f06e3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.919+0000 7f06e3fff640 10 monclient: dump: 2024-08-18T21:13:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:04.934 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.919+0000 7f06e3fff640 1 -- 172.21.15.5:0/490848793 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f06ec00fde0 con 0x7f06fc122810 2024-08-18T21:13:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.919+0000 7f06e3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.919+0000 7f06e3fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.919+0000 7f06e3fff640 1 -- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f06fc122810 msgr2=0x7f06fc120620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.919+0000 7f06e3fff640 1 --2- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f06fc122810 0x7f06fc120620 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0072a0 tx=0x7f06ec007760 comp rx=0 tx=0).stop 2024-08-18T21:13:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.919+0000 7f06e3fff640 1 -- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f06fc122810 msgr2=0x7f06fc120620 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.919+0000 7f06e3fff640 1 --2- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f06fc122810 0x7f06fc120620 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0072a0 tx=0x7f06ec007760 comp rx=0 tx=0).stop 2024-08-18T21:13:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.919+0000 7f06fbfff640 1 --2- 172.21.15.5:0/490848793 >> v2:172.21.15.157:6812/631023601 conn(0x7f06e803bdf0 0x7f06e803e2b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f06f40ac000 tx=0x7f06f40a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.923+0000 7f0701e12640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.923+0000 7f0701e12640 1 --2- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f06fc1218b0 0x7f06fc120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.923+0000 7f0701e12640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.923+0000 7f0701e12640 1 -- 172.21.15.5:0/490848793 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f06fc06d0f0 con 0x7f06fc1218b0 2024-08-18T21:13:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.923+0000 7f06fb7fe640 1 --2- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f06fc1218b0 0x7f06fc120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.923+0000 7f06fb7fe640 10 monclient: get_auth_request con 0x7f06fc1218b0 auth_method 0 2024-08-18T21:13:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.923+0000 7f06fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.923+0000 7f06fb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.923+0000 7f06fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.923+0000 7f06fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.923+0000 7f06fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.923+0000 7f06fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:04.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.923+0000 7f06fb7fe640 10 monclient(hunting): handle_auth_done global_id 114518 payload 824 2024-08-18T21:13:04.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.923+0000 7f06fb7fe640 1 -- 172.21.15.5:0/490848793 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f06fc1dc3c0 con 0x7f06fc1218b0 2024-08-18T21:13:04.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f06fb7fe640 1 -- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f06fc1218b0 msgr2=0x7f06fc120b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:04.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f06fb7fe640 1 --2- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f06fc1218b0 0x7f06fc120b60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0072a0 tx=0x7f06ec004950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:04.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f06e3fff640 1 -- 172.21.15.5:0/490848793 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f06ec0066b0 con 0x7f06fc1218b0 2024-08-18T21:13:04.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f06e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:04.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f06e3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:04.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f06e3fff640 10 monclient: dump: 2024-08-18T21:13:04.936 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:04.936 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:04.936 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.936 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:04.936 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:04.936 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:04.937 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:04.937 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:04.937 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:04.937 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:04.937 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:04.937 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:04.937 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:04.937 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:04.937 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:04.937 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:04.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f06e3fff640 1 -- 172.21.15.5:0/490848793 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f06ec006240 con 0x7f06fc1218b0 2024-08-18T21:13:04.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f06e3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:04.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f06e3fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:04.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f06e3fff640 1 -- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f06fc1218b0 msgr2=0x7f06fc120b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f06e3fff640 1 --2- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f06fc1218b0 0x7f06fc120b60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0072a0 tx=0x7f06ec004950 comp rx=0 tx=0).stop 2024-08-18T21:13:04.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f06e3fff640 1 -- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f06fc1218b0 msgr2=0x7f06fc120b60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:04.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f06e3fff640 1 --2- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f06fc1218b0 0x7f06fc120b60 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0072a0 tx=0x7f06ec004950 comp rx=0 tx=0).stop 2024-08-18T21:13:04.938 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:04.938 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:04.938 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:04.938 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:04.938 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:04.939 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 90083, 2024-08-18T21:13:04.939 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:04.939 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:04.939 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:04.939 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:04.939 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:04.939 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:04.939 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:04.939 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:04.939 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:04.939 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:04.939 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:04.939 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:13:04.940 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:04.940 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:04.940 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:04.940 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:04.940 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:04.940 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:04.940 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:04.940 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:04.940 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:04.940 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:04.940 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:04.940 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:04.940 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:04.941 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:04.941 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:04.941 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:04.941 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:04.941 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:04.941 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:04.941 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:04.941 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:04.941 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:04.941 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:04.941 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:04.941 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:04.941 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:04.941 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:04.942 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:04.942 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.942 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:04.942 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:04.942 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:04.942 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:04.942 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:04.942 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:04.942 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:04.942 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:04.942 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:04.942 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:04.943 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:04.943 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:04.943 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:04.943 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:04.943 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:04.943 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:04.943 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:04.943 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:04.943 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:04.943 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:04.943 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:04.943 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:04.943 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:04.944 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:04.944 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:04.944 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:04.944 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:04.944 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:04.944 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:04.944 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:04.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.944 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:04.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.944 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:04.944 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:04.944 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.944 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.945 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:04.945 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.945 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:04.945 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.945 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.945 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.945 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:04.945 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:04.946 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.946 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.946 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.946 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:04.946 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:04.946 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.946 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.946 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:04.946 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.947 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.947 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:04.947 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.947 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.947 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.947 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:04.947 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:04.947 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.947 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.947 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.948 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:04.948 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:04.948 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.948 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.948 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.948 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:04.948 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.948 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.948 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:04.948 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.949 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.949 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.949 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:04.949 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:04.949 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.949 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.949 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.949 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:04.949 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:04.949 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.949 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.950 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.950 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.950 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:04.950 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.950 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.950 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.950 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:04.950 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.950 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.950 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.950 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:04.951 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:04.951 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.951 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.951 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.951 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:04.951 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:04.951 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.951 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.951 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.951 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:04.951 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.952 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.952 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.952 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:04.952 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.952 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.952 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.952 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:04.952 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:04.952 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.952 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.952 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.953 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.953 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:04.953 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:04.953 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.953 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.953 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.953 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.953 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:04.953 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.953 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.953 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.953 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:04.953 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.954 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.954 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.954 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:04.954 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:04.954 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.954 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.954 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.954 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.958 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:04.958 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:04.958 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.958 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.958 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.958 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:04.958 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.959 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.959 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.959 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:04.959 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.959 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.959 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.959 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:04.959 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:04.959 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.959 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.959 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.959 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.960 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:04.960 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:04.960 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.960 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.960 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.960 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:04.960 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.960 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.960 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.960 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:04.960 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.961 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.961 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.961 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:04.961 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:04.961 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.961 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.961 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.961 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.961 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:04.961 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:04.961 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:04.961 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:04.962 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.962 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:04.962 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:04.962 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.962 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.962 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.962 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:04.962 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:04.962 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:04.962 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.962 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.962 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.962 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:04.963 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:04.963 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:04.963 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:04.963 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:04.963 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.963 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.963 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:04.963 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:04.963 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.963 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:04.963 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:04.963 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:04.963 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.963 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:04.964 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:13:04.964 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.964 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:04.964 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:04.964 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:13:04.964 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.964 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:04.964 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:04.964 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:04.964 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:04.964 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:04.964 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:13:04.964 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:04.964 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:04.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:04.965 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:04.965 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:04.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f0701e12640 1 -- 172.21.15.5:0/490848793 >> v2:172.21.15.157:6812/631023601 conn(0x7f06e803bdf0 msgr2=0x7f06e803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f0701e12640 1 --2- 172.21.15.5:0/490848793 >> v2:172.21.15.157:6812/631023601 conn(0x7f06e803bdf0 0x7f06e803e2b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f06f40ac000 tx=0x7f06f40a7070 comp rx=0 tx=0).stop 2024-08-18T21:13:04.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f0701e12640 10 monclient: shutdown 2024-08-18T21:13:04.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f0701e12640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:04.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f0701e12640 1 -- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f06fc0a64d0 msgr2=0x7f06fc136700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:04.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f0701e12640 1 --2- 172.21.15.5:0/490848793 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f06fc0a64d0 0x7f06fc136700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f06f000e7f0 tx=0x7f06f000ecb0 comp rx=0 tx=0).stop 2024-08-18T21:13:04.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f06fbfff640 1 -- 172.21.15.5:0/490848793 reap_dead start 2024-08-18T21:13:04.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f06fbfff640 1 -- 172.21.15.5:0/490848793 reap_dead start 2024-08-18T21:13:04.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f0701e12640 1 -- 172.21.15.5:0/490848793 shutdown_connections 2024-08-18T21:13:04.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f0701e12640 1 -- 172.21.15.5:0/490848793 >> 172.21.15.5:0/490848793 conn(0x7f06fc0aa5d0 msgr2=0x7f06fc06f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:04.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f0701e12640 1 -- 172.21.15.5:0/490848793 shutdown_connections 2024-08-18T21:13:04.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:04.927+0000 7f0701e12640 1 -- 172.21.15.5:0/490848793 wait complete. 2024-08-18T21:13:04.967 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:04.967 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:13:04.968 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:13:05.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 10 monclient: get_monmap_and_config 2024-08-18T21:13:05.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 10 monclient: build_initial_monmap 2024-08-18T21:13:05.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 10 monclient: monmap: 2024-08-18T21:13:05.138 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:05.138 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.138 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:05.141662+0000 2024-08-18T21:13:05.138 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:05.141662+0000 2024-08-18T21:13:05.138 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:05.138 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:05.139 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 1 Processor -- start 2024-08-18T21:13:05.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 1 -- start start 2024-08-18T21:13:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 10 monclient: init 2024-08-18T21:13:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 10 monclient: _add_conns ranks=[2,7,6,8,0,5,9,10,4,3,1] 2024-08-18T21:13:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f00a6ce0 0x7fc5f00a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 10 monclient(hunting): picked mon.noname-b con 0x7fc5f00a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc5f00a7600 0x7fc5f0139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 10 monclient(hunting): picked mon.noname-i con 0x7fc5f00a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc5f0139fe0 0x7fc5f013a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 10 monclient(hunting): picked mon.noname-d con 0x7fc5f0139fe0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f00a5000 con 0x7fc5f00a6ce0 2024-08-18T21:13:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fc5f00a4360 con 0x7fc5f0139fe0 2024-08-18T21:13:05.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fc5f00a45d0 con 0x7fc5f00a7600 2024-08-18T21:13:05.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:05.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5f5f71640 10 monclient(hunting): authenticate will time out at 1552.154878s 2024-08-18T21:13:05.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5ef7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f00a6ce0 0x7fc5f00a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5ef7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f00a6ce0 0x7fc5f00a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:45498/0 (socket says 172.21.15.5:45498) 2024-08-18T21:13:05.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5ef7fe640 1 -- 172.21.15.5:0/2882224682 learned_addr learned my addr 172.21.15.5:0/2882224682 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:05.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5ef7fe640 10 monclient(hunting): get_auth_request con 0x7fc5f00a6ce0 auth_method 0 2024-08-18T21:13:05.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5ef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 1 --2- 172.21.15.5:0/2882224682 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc5f0139fe0 0x7fc5f013a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 10 monclient(hunting): get_auth_request con 0x7fc5f0139fe0 auth_method 0 2024-08-18T21:13:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5eeffd640 1 --2- 172.21.15.5:0/2882224682 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc5f00a7600 0x7fc5f0139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5eeffd640 10 monclient(hunting): get_auth_request con 0x7fc5f00a7600 auth_method 0 2024-08-18T21:13:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5eeffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 10 monclient(hunting): handle_auth_done global_id 85695 payload 274 2024-08-18T21:13:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 1 -- 172.21.15.5:0/2882224682 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc5f00a7600 msgr2=0x7fc5f0139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 1 --2- 172.21.15.5:0/2882224682 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc5f00a7600 0x7fc5f0139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 1 -- 172.21.15.5:0/2882224682 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f00a6ce0 msgr2=0x7fc5f00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 1 --2- 172.21.15.5:0/2882224682 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f00a6ce0 0x7fc5f00a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 10 monclient: _finish_hunting 0 2024-08-18T21:13:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 1 monclient: found mon.noname-d 2024-08-18T21:13:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:13:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5effff640 1 -- 172.21.15.5:0/2882224682 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f00a32d0 con 0x7fc5f0139fe0 2024-08-18T21:13:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.139+0000 7fc5ef7fe640 1 --2- 172.21.15.5:0/2882224682 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f00a6ce0 0x7fc5f00a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:05.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.143+0000 7fc5effff640 1 -- 172.21.15.5:0/2882224682 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc5f0139fe0 msgr2=0x7fc5f013a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.143+0000 7fc5effff640 1 --2- 172.21.15.5:0/2882224682 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc5f0139fe0 0x7fc5f013a440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8009dc0 tx=0x7fc5e801c850 comp rx=0 tx=0).ready entity=mon.6 client_cookie=8e85d1782ce1526c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.143+0000 7fc5ee7fc640 1 -- 172.21.15.5:0/2882224682 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc5e80b2070 con 0x7fc5f0139fe0 2024-08-18T21:13:05.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.143+0000 7fc5ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.143+0000 7fc5ee7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:13:05.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.143+0000 7fc5ee7fc640 10 monclient: dump: 2024-08-18T21:13:05.149 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.149 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.149 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.149 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.149 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.150 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.143+0000 7fc5ee7fc640 10 monclient: _finish_auth 0 2024-08-18T21:13:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.143+0000 7fc5ee7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:13:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.143+0000 7fc5ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.143+0000 7fc5ee7fc640 1 -- 172.21.15.5:0/2882224682 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e80a5990 con 0x7fc5f0139fe0 2024-08-18T21:13:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.143+0000 7fc5ee7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.143+0000 7fc5ee7fc640 1 -- 172.21.15.5:0/2882224682 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc5e80ab340 con 0x7fc5f0139fe0 2024-08-18T21:13:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.143+0000 7fc5f5f71640 5 monclient: authenticate success, global_id 85695 2024-08-18T21:13:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 4 set_mon_vals no callback set 2024-08-18T21:13:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5ee7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:13:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5ee7fc640 10 monclient: dump: 2024-08-18T21:13:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.153 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 10 monclient: shutdown 2024-08-18T21:13:05.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:05.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 -- 172.21.15.5:0/2882224682 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc5f0139fe0 msgr2=0x7fc5f013a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 --2- 172.21.15.5:0/2882224682 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc5f0139fe0 0x7fc5f013a440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8009dc0 tx=0x7fc5e801c850 comp rx=0 tx=0).stop 2024-08-18T21:13:05.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 -- 172.21.15.5:0/2882224682 shutdown_connections 2024-08-18T21:13:05.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 --2- 172.21.15.5:0/2882224682 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc5f0139fe0 0x7fc5f013a440 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 --2- 172.21.15.5:0/2882224682 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc5f00a7600 0x7fc5f0139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 --2- 172.21.15.5:0/2882224682 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f00a6ce0 0x7fc5f00a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 -- 172.21.15.5:0/2882224682 >> 172.21.15.5:0/2882224682 conn(0x7fc5f00acbc0 msgr2=0x7fc5f00a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:05.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 -- 172.21.15.5:0/2882224682 shutdown_connections 2024-08-18T21:13:05.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 -- 172.21.15.5:0/2882224682 wait complete. 2024-08-18T21:13:05.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 10 monclient: build_initial_monmap 2024-08-18T21:13:05.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 10 monclient: monmap: 2024-08-18T21:13:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:05.155 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:05.155 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:05.155 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 Processor -- start 2024-08-18T21:13:05.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 -- start start 2024-08-18T21:13:05.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 10 monclient: init 2024-08-18T21:13:05.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:05.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 10 monclient: _add_conns ranks=[5,2,1,0,7,6,8,4,3] 2024-08-18T21:13:05.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc5f00a6ce0 0x7fc5f0132fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 10 monclient(hunting): picked mon.noname-h con 0x7fc5f00a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:05.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f00a7600 0x7fc5f00a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 10 monclient(hunting): picked mon.noname-b con 0x7fc5f00a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:05.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5f0139fe0 0x7fc5f00a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 10 monclient(hunting): picked mon.noname-f con 0x7fc5f0139fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:13:05.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f00a79e0 con 0x7fc5f0139fe0 2024-08-18T21:13:05.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f00a8220 con 0x7fc5f00a7600 2024-08-18T21:13:05.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fc5f013ada0 con 0x7fc5f00a6ce0 2024-08-18T21:13:05.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:05.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5f5f71640 10 monclient(hunting): authenticate will time out at 1552.162196s 2024-08-18T21:13:05.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f00a7600 0x7fc5f00a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f00a7600 0x7fc5f00a0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:45508/0 (socket says 172.21.15.5:45508) 2024-08-18T21:13:05.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 1 -- 172.21.15.5:0/984977519 learned_addr learned my addr 172.21.15.5:0/984977519 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:05.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 10 monclient(hunting): get_auth_request con 0x7fc5f00a7600 auth_method 0 2024-08-18T21:13:05.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5ef7fe640 1 --2- 172.21.15.5:0/984977519 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc5f00a6ce0 0x7fc5f0132fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5ef7fe640 10 monclient(hunting): get_auth_request con 0x7fc5f00a6ce0 auth_method 0 2024-08-18T21:13:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5ef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5effff640 1 --2- 172.21.15.5:0/984977519 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5f0139fe0 0x7fc5f00a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5effff640 10 monclient(hunting): get_auth_request con 0x7fc5f0139fe0 auth_method 0 2024-08-18T21:13:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5effff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5effff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 10 monclient(hunting): handle_auth_done global_id 114536 payload 824 2024-08-18T21:13:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 1 -- 172.21.15.5:0/984977519 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc5f00a6ce0 msgr2=0x7fc5f0132fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 1 --2- 172.21.15.5:0/984977519 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc5f00a6ce0 0x7fc5f0132fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 1 -- 172.21.15.5:0/984977519 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5f0139fe0 msgr2=0x7fc5f00a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 1 --2- 172.21.15.5:0/984977519 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5f0139fe0 0x7fc5f00a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 10 monclient: _finish_hunting 0 2024-08-18T21:13:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 1 monclient: found mon.noname-b 2024-08-18T21:13:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:13:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.147+0000 7fc5eeffd640 1 -- 172.21.15.5:0/984977519 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f013c5a0 con 0x7fc5f00a7600 2024-08-18T21:13:05.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5eeffd640 1 -- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f00a7600 msgr2=0x7fc5f00a0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5eeffd640 1 --2- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f00a7600 0x7fc5f00a0810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000d830 tx=0x7fc5e000dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5d7fff640 1 -- 172.21.15.5:0/984977519 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc5e000bd40 con 0x7fc5f00a7600 2024-08-18T21:13:05.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5d7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:13:05.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5d7fff640 10 monclient: dump: 2024-08-18T21:13:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.164 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5d7fff640 10 monclient: _finish_auth 0 2024-08-18T21:13:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5d7fff640 10 monclient: _check_auth_tickets 2024-08-18T21:13:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5d7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5d7fff640 1 -- 172.21.15.5:0/984977519 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e0019070 con 0x7fc5f00a7600 2024-08-18T21:13:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5d7fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5d7fff640 1 -- 172.21.15.5:0/984977519 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc5e00148a0 con 0x7fc5f00a7600 2024-08-18T21:13:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5f5f71640 5 monclient: authenticate success, global_id 114536 2024-08-18T21:13:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5f5f71640 10 monclient: _renew_subs 2024-08-18T21:13:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5f5f71640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5f5f71640 1 -- 172.21.15.5:0/984977519 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f00aa270 con 0x7fc5f00a7600 2024-08-18T21:13:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5ed7fa640 4 set_mon_vals no callback set 2024-08-18T21:13:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5d7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5d7fff640 10 monclient: dump: 2024-08-18T21:13:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.166 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5f5f71640 10 monclient: _renew_subs 2024-08-18T21:13:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5f5f71640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5f5f71640 1 -- 172.21.15.5:0/984977519 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f0135a60 con 0x7fc5f00a7600 2024-08-18T21:13:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5f5f71640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5f5f71640 1 --2- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc5f0133520 0x7fc5f013bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5f5f71640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5f5f71640 1 -- 172.21.15.5:0/984977519 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fc5f00a7b60 con 0x7fc5f0133520 2024-08-18T21:13:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5ef7fe640 1 --2- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc5f0133520 0x7fc5f013bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5ef7fe640 10 monclient: get_auth_request con 0x7fc5f0133520 auth_method 0 2024-08-18T21:13:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5ef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5d7fff640 1 -- 172.21.15.5:0/984977519 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fc5e0014430 con 0x7fc5f00a7600 2024-08-18T21:13:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5ef7fe640 10 monclient(hunting): handle_auth_done global_id 114484 payload 824 2024-08-18T21:13:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5ef7fe640 1 -- 172.21.15.5:0/984977519 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5f0139aa0 con 0x7fc5f0133520 2024-08-18T21:13:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5d7fff640 1 --2- 172.21.15.5:0/984977519 >> v2:172.21.15.157:6812/631023601 conn(0x7fc5dc03bdf0 0x7fc5dc03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5d7fff640 1 -- 172.21.15.5:0/984977519 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(265..265 src has 22..265) ==== 3506+0+0 (secure 0 0 0) 0x7fc5e000f040 con 0x7fc5f00a7600 2024-08-18T21:13:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5effff640 1 --2- 172.21.15.5:0/984977519 >> v2:172.21.15.157:6812/631023601 conn(0x7fc5dc03bdf0 0x7fc5dc03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.151+0000 7fc5effff640 10 monclient: get_auth_request con 0x7fc5dc03bdf0 auth_method 0 2024-08-18T21:13:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.155+0000 7fc5ef7fe640 1 -- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc5f0133520 msgr2=0x7fc5f013bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.155+0000 7fc5ef7fe640 1 --2- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc5f0133520 0x7fc5f013bf40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4011600 tx=0x7fc5e4011ac0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.155+0000 7fc5d7fff640 1 -- 172.21.15.5:0/984977519 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc5e400fe90 con 0x7fc5f0133520 2024-08-18T21:13:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.155+0000 7fc5d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.155+0000 7fc5d7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:13:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.155+0000 7fc5d7fff640 10 monclient: dump: 2024-08-18T21:13:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.169 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.155+0000 7fc5d7fff640 1 -- 172.21.15.5:0/984977519 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc5e400fa20 con 0x7fc5f0133520 2024-08-18T21:13:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.155+0000 7fc5d7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.155+0000 7fc5d7fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.155+0000 7fc5d7fff640 1 -- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc5f0133520 msgr2=0x7fc5f013bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.155+0000 7fc5d7fff640 1 --2- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc5f0133520 0x7fc5f013bf40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4011600 tx=0x7fc5e4011ac0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.155+0000 7fc5d7fff640 1 -- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc5f0133520 msgr2=0x7fc5f013bf40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.155+0000 7fc5d7fff640 1 --2- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc5f0133520 0x7fc5f013bf40 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4011600 tx=0x7fc5e4011ac0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.155+0000 7fc5effff640 1 --2- 172.21.15.5:0/984977519 >> v2:172.21.15.157:6812/631023601 conn(0x7fc5dc03bdf0 0x7fc5dc03e2b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00a81b0 tx=0x7fc5e80a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.159+0000 7fc5f5f71640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.159+0000 7fc5f5f71640 1 --2- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc5f00a1290 0x7fc5f00a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.159+0000 7fc5f5f71640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.159+0000 7fc5f5f71640 1 -- 172.21.15.5:0/984977519 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fc5f0051140 con 0x7fc5f00a1290 2024-08-18T21:13:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.159+0000 7fc5ef7fe640 1 --2- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc5f00a1290 0x7fc5f00a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.159+0000 7fc5ef7fe640 10 monclient: get_auth_request con 0x7fc5f00a1290 auth_method 0 2024-08-18T21:13:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.159+0000 7fc5ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.159+0000 7fc5ef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.159+0000 7fc5ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.159+0000 7fc5ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.159+0000 7fc5ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.159+0000 7fc5ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5ef7fe640 10 monclient(hunting): handle_auth_done global_id 114493 payload 824 2024-08-18T21:13:05.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5ef7fe640 1 -- 172.21.15.5:0/984977519 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc5f00a1be0 con 0x7fc5f00a1290 2024-08-18T21:13:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5ef7fe640 1 -- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc5f00a1290 msgr2=0x7fc5f00a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5ef7fe640 1 --2- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc5f00a1290 0x7fc5f00a16a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4011600 tx=0x7fc5e40046d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5d7fff640 1 -- 172.21.15.5:0/984977519 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc5e40066c0 con 0x7fc5f00a1290 2024-08-18T21:13:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5d7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:13:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5d7fff640 10 monclient: dump: 2024-08-18T21:13:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.174 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.174 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.174 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5d7fff640 1 -- 172.21.15.5:0/984977519 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7fc5e4006250 con 0x7fc5f00a1290 2024-08-18T21:13:05.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5d7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:05.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5d7fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:05.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5d7fff640 1 -- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc5f00a1290 msgr2=0x7fc5f00a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5d7fff640 1 --2- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc5f00a1290 0x7fc5f00a16a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4011600 tx=0x7fc5e40046d0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5d7fff640 1 -- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc5f00a1290 msgr2=0x7fc5f00a16a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:05.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5d7fff640 1 --2- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc5f00a1290 0x7fc5f00a16a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.175 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:05.175 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:05.175 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:05.175 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:05.175 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:05.175 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 90323, 2024-08-18T21:13:05.175 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:05.175 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:05.175 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:05.175 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:05.175 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:05.175 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:05.176 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:05.176 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:05.176 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:05.176 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:05.176 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.176 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:13:05.176 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:05.176 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:05.176 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:05.176 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:05.176 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:05.176 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:05.176 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:05.176 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:05.177 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:05.177 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:05.177 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:05.177 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:05.177 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:05.177 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:05.177 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.177 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:05.177 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:05.177 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:05.177 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:05.177 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:05.178 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:05.178 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:05.178 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:05.178 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:05.178 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:05.178 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:05.178 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:05.178 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:05.178 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.178 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:05.178 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:05.178 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:05.179 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:05.179 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:05.179 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:05.179 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:05.179 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:05.179 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:05.179 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:05.179 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:05.179 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:05.179 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:05.179 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:05.179 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:05.179 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:05.186 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.186 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.186 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.186 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:05.186 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:05.186 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.186 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.186 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:05.186 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.187 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.187 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:05.187 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.187 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.187 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.187 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:05.187 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:05.187 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.187 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.187 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.188 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:05.188 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:05.188 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.188 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.188 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:05.188 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.188 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:05.188 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.189 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.189 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.189 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:05.189 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:05.189 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.189 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.189 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.189 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:05.189 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:05.189 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.189 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:05.190 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:05.190 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.190 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.190 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.190 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:05.190 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:05.191 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.191 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.191 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.191 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:05.191 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:05.191 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.191 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:05.191 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:05.192 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.192 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.192 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.192 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:05.192 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:05.192 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.192 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.192 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.193 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:05.193 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:05.193 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:05.193 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.193 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:05.193 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.193 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.194 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:05.194 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:05.194 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.194 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.194 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.194 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:05.194 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:05.194 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.194 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:05.195 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:05.195 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.195 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.195 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.195 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:05.195 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:05.196 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.196 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.196 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.196 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.196 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.196 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:05.196 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:05.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.196 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:05.196 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:05.196 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:05.196 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.196 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.197 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:13:05.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.197 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:05.197 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:05.197 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:05.197 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.197 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.197 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:05.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.197 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:05.197 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:05.197 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:13:05.197 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.197 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.198 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:05.198 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5f5f71640 1 -- 172.21.15.5:0/984977519 >> v2:172.21.15.157:6812/631023601 conn(0x7fc5dc03bdf0 msgr2=0x7fc5dc03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5f5f71640 1 --2- 172.21.15.5:0/984977519 >> v2:172.21.15.157:6812/631023601 conn(0x7fc5dc03bdf0 0x7fc5dc03e2b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00a81b0 tx=0x7fc5e80a7070 comp rx=0 tx=0).stop 2024-08-18T21:13:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5f5f71640 10 monclient: shutdown 2024-08-18T21:13:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5f5f71640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5f5f71640 1 -- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f00a7600 msgr2=0x7fc5f00a0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5f5f71640 1 --2- 172.21.15.5:0/984977519 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f00a7600 0x7fc5f00a0810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000d830 tx=0x7fc5e000dcf0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5effff640 1 -- 172.21.15.5:0/984977519 reap_dead start 2024-08-18T21:13:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5effff640 1 -- 172.21.15.5:0/984977519 reap_dead start 2024-08-18T21:13:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5f5f71640 1 -- 172.21.15.5:0/984977519 shutdown_connections 2024-08-18T21:13:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5f5f71640 1 -- 172.21.15.5:0/984977519 >> 172.21.15.5:0/984977519 conn(0x7fc5f00acbc0 msgr2=0x7fc5f0135c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5f5f71640 1 -- 172.21.15.5:0/984977519 shutdown_connections 2024-08-18T21:13:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.163+0000 7fc5f5f71640 1 -- 172.21.15.5:0/984977519 wait complete. 2024-08-18T21:13:05.200 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:05.200 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:13:05.200 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:13:05.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 10 monclient: get_monmap_and_config 2024-08-18T21:13:05.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 10 monclient: build_initial_monmap 2024-08-18T21:13:05.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 10 monclient: monmap: 2024-08-18T21:13:05.330 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:05.334149+0000 2024-08-18T21:13:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:05.334149+0000 2024-08-18T21:13:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:05.332 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:05.332 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:05.332 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:05.332 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 1 Processor -- start 2024-08-18T21:13:05.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 1 -- start start 2024-08-18T21:13:05.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 10 monclient: init 2024-08-18T21:13:05.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:05.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 10 monclient: _add_conns ranks=[0,7,6,10,8,3,2,9,4,5,1] 2024-08-18T21:13:05.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f49fc0a6ce0 addr v1:172.21.15.5:6789/0 2024-08-18T21:13:05.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f49fc0a77d0 0x7f49fc13ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 10 monclient(hunting): picked mon.noname-i con 0x7f49fc0a77d0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:05.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc13f220 0x7f49fc141610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 10 monclient(hunting): picked mon.noname-d con 0x7f49fc13f220 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49fc0a45d0 con 0x7f49fc0a6ce0 2024-08-18T21:13:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f49fc0a5000 con 0x7f49fc13f220 2024-08-18T21:13:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f49fc0a4360 con 0x7f49fc0a77d0 2024-08-18T21:13:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a02f6c640 10 monclient(hunting): authenticate will time out at 1552.347276s 2024-08-18T21:13:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a00d08640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f49fc0a6ce0 0x7f49fc0a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44138/0 (socket says 172.21.15.5:44138) 2024-08-18T21:13:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a00d08640 1 -- 172.21.15.5:0/1652865420 learned_addr learned my addr 172.21.15.5:0/1652865420 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:13:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 1 --2- 172.21.15.5:0/1652865420 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc13f220 0x7f49fc141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 10 monclient(hunting): get_auth_request con 0x7f49fc13f220 auth_method 0 2024-08-18T21:13:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 10 monclient(hunting): handle_auth_done global_id 85704 payload 274 2024-08-18T21:13:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 1 -- 172.21.15.5:0/1652865420 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f49fc0a77d0 msgr2=0x7f49fc13ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f49fbfff640 1 --2- 172.21.15.5:0/1652865420 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f49fc0a77d0 0x7f49fc13ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 1 --2- 172.21.15.5:0/1652865420 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f49fc0a77d0 0x7f49fc13ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 1 -- 172.21.15.5:0/1652865420 >> v1:172.21.15.5:6789/0 conn(0x7f49fc0a6ce0 legacy=0x7f49fc0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 10 monclient: _finish_hunting 0 2024-08-18T21:13:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 1 monclient: found mon.noname-d 2024-08-18T21:13:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:05.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:13:05.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.331+0000 7f4a01509640 1 -- 172.21.15.5:0/1652865420 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49fc0a32d0 con 0x7f49fc13f220 2024-08-18T21:13:05.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 1 -- 172.21.15.5:0/1652865420 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc13f220 msgr2=0x7f49fc141610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 1 --2- 172.21.15.5:0/1652865420 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc13f220 0x7f49fc141610 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009df0 tx=0x7f49f401c850 comp rx=0 tx=0).ready entity=mon.6 client_cookie=1bc59bda25e03acd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fb7fe640 1 -- 172.21.15.5:0/1652865420 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f49f40b2070 con 0x7f49fc13f220 2024-08-18T21:13:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fb7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:13:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fb7fe640 10 monclient: dump: 2024-08-18T21:13:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.340 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fb7fe640 10 monclient: _finish_auth 0 2024-08-18T21:13:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fb7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:13:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fb7fe640 1 -- 172.21.15.5:0/1652865420 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f40a5a70 con 0x7f49fc13f220 2024-08-18T21:13:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 5 monclient: authenticate success, global_id 85704 2024-08-18T21:13:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:13:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fb7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fb7fe640 1 -- 172.21.15.5:0/1652865420 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f49f40a5c60 con 0x7f49fc13f220 2024-08-18T21:13:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 4 set_mon_vals no callback set 2024-08-18T21:13:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fb7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:13:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fb7fe640 10 monclient: dump: 2024-08-18T21:13:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.342 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 10 monclient: shutdown 2024-08-18T21:13:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 1 -- 172.21.15.5:0/1652865420 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc13f220 msgr2=0x7f49fc141610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 1 --2- 172.21.15.5:0/1652865420 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc13f220 0x7f49fc141610 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009df0 tx=0x7f49f401c850 comp rx=0 tx=0).stop 2024-08-18T21:13:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 1 -- 172.21.15.5:0/1652865420 shutdown_connections 2024-08-18T21:13:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 1 --2- 172.21.15.5:0/1652865420 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc13f220 0x7f49fc141610 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 1 --2- 172.21.15.5:0/1652865420 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f49fc0a77d0 0x7f49fc13ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 1 -- 172.21.15.5:0/1652865420 >> 172.21.15.5:0/1652865420 conn(0x7f49fc0acbc0 msgr2=0x7f49fc0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 1 -- 172.21.15.5:0/1652865420 shutdown_connections 2024-08-18T21:13:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 1 -- 172.21.15.5:0/1652865420 wait complete. 2024-08-18T21:13:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 10 monclient: build_initial_monmap 2024-08-18T21:13:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 10 monclient: monmap: 2024-08-18T21:13:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:05.344 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 1 Processor -- start 2024-08-18T21:13:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 1 -- start start 2024-08-18T21:13:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 10 monclient: init 2024-08-18T21:13:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 10 monclient: _add_conns ranks=[3,7,0,6,2,8,5,4,1] 2024-08-18T21:13:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f49fc0a6ce0 0x7f49fc137890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 10 monclient(hunting): picked mon.noname-g con 0x7f49fc0a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f49fc0a77d0 0x7f49fc137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 10 monclient(hunting): picked mon.noname-i con 0x7f49fc0a77d0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49fc13f220 0x7f49fc09eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 10 monclient(hunting): picked mon.noname-a con 0x7f49fc13f220 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:13:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc0a83a0 con 0x7f49fc13f220 2024-08-18T21:13:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f49fc0a8220 con 0x7f49fc0a6ce0 2024-08-18T21:13:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f49fc144370 con 0x7f49fc0a77d0 2024-08-18T21:13:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a02f6c640 10 monclient(hunting): authenticate will time out at 1552.355049s 2024-08-18T21:13:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49fc13f220 0x7f49fc09eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49fc13f220 0x7f49fc09eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49944/0 (socket says 172.21.15.5:49944) 2024-08-18T21:13:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 1 -- 172.21.15.5:0/4203297568 learned_addr learned my addr 172.21.15.5:0/4203297568 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 10 monclient(hunting): get_auth_request con 0x7f49fc13f220 auth_method 0 2024-08-18T21:13:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a00d08640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f49fc0a6ce0 0x7f49fc137890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fbfff640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f49fc0a77d0 0x7f49fc137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a00d08640 10 monclient(hunting): get_auth_request con 0x7f49fc0a6ce0 auth_method 0 2024-08-18T21:13:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a00d08640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a00d08640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a00d08640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fbfff640 10 monclient(hunting): get_auth_request con 0x7f49fc0a77d0 auth_method 0 2024-08-18T21:13:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fbfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a00d08640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a00d08640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a00d08640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 10 monclient(hunting): handle_auth_done global_id 124272 payload 824 2024-08-18T21:13:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 1 -- 172.21.15.5:0/4203297568 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f49fc0a77d0 msgr2=0x7f49fc137dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f49fc0a77d0 0x7f49fc137dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 1 -- 172.21.15.5:0/4203297568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f49fc0a6ce0 msgr2=0x7f49fc137890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f49fc0a6ce0 0x7f49fc137890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 10 monclient: _finish_hunting 0 2024-08-18T21:13:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 1 monclient: found mon.noname-a 2024-08-18T21:13:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:13:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f4a01509640 1 -- 172.21.15.5:0/4203297568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49fc140e70 con 0x7f49fc13f220 2024-08-18T21:13:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.339+0000 7f49fbfff640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f49fc0a77d0 0x7f49fc137dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:13:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a01509640 1 -- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49fc13f220 msgr2=0x7f49fc09eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a01509640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49fc13f220 0x7f49fc09eb80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f49f40b0040 tx=0x7f49f40195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49f97fa640 1 -- 172.21.15.5:0/4203297568 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f49f40b2050 con 0x7f49fc13f220 2024-08-18T21:13:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49f97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:13:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49f97fa640 10 monclient: dump: 2024-08-18T21:13:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.355 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49f97fa640 10 monclient: _finish_auth 0 2024-08-18T21:13:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49f97fa640 10 monclient: _check_auth_tickets 2024-08-18T21:13:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49f97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49f97fa640 1 -- 172.21.15.5:0/4203297568 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f40be070 con 0x7f49fc13f220 2024-08-18T21:13:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49f97fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49f97fa640 1 -- 172.21.15.5:0/4203297568 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f49f40b9450 con 0x7f49fc13f220 2024-08-18T21:13:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a02f6c640 5 monclient: authenticate success, global_id 124272 2024-08-18T21:13:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a02f6c640 10 monclient: _renew_subs 2024-08-18T21:13:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a02f6c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:13:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49fa7fc640 4 set_mon_vals no callback set 2024-08-18T21:13:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a02f6c640 1 -- 172.21.15.5:0/4203297568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49fc0aaf60 con 0x7f49fc13f220 2024-08-18T21:13:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49f97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:13:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49f97fa640 10 monclient: dump: 2024-08-18T21:13:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.358 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a02f6c640 10 monclient: _renew_subs 2024-08-18T21:13:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a02f6c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:13:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a02f6c640 1 -- 172.21.15.5:0/4203297568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49fc0a2320 con 0x7f49fc13f220 2024-08-18T21:13:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a02f6c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a02f6c640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc0a2560 0x7f49fc09f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a02f6c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a02f6c640 1 -- 172.21.15.5:0/4203297568 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f49fc051140 con 0x7f49fc0a2560 2024-08-18T21:13:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a00d08640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc0a2560 0x7f49fc09f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a00d08640 10 monclient: get_auth_request con 0x7f49fc0a2560 auth_method 0 2024-08-18T21:13:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a00d08640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a00d08640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a00d08640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a00d08640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a00d08640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a00d08640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49f97fa640 1 -- 172.21.15.5:0/4203297568 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f49f40b9690 con 0x7f49fc13f220 2024-08-18T21:13:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a00d08640 10 monclient(hunting): handle_auth_done global_id 85713 payload 824 2024-08-18T21:13:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f4a00d08640 1 -- 172.21.15.5:0/4203297568 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49fc1413a0 con 0x7f49fc0a2560 2024-08-18T21:13:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49f97fa640 1 --2- 172.21.15.5:0/4203297568 >> v2:172.21.15.157:6812/631023601 conn(0x7f49e003bdc0 0x7f49e003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.343+0000 7f49f97fa640 1 -- 172.21.15.5:0/4203297568 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(265..265 src has 22..265) ==== 3506+0+0 (secure 0 0 0) 0x7f49f40e97e0 con 0x7f49fc13f220 2024-08-18T21:13:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.347+0000 7f49fbfff640 1 --2- 172.21.15.5:0/4203297568 >> v2:172.21.15.157:6812/631023601 conn(0x7f49e003bdc0 0x7f49e003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.347+0000 7f49fbfff640 10 monclient: get_auth_request con 0x7f49e003bdc0 auth_method 0 2024-08-18T21:13:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.347+0000 7f4a00d08640 1 -- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc0a2560 msgr2=0x7f49fc09f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.347+0000 7f4a00d08640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc0a2560 0x7f49fc09f0c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f49f000eaa0 tx=0x7f49f000eb90 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.347+0000 7f49f97fa640 1 -- 172.21.15.5:0/4203297568 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f49f000ee60 con 0x7f49fc0a2560 2024-08-18T21:13:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.347+0000 7f49f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.347+0000 7f49f97fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:13:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.347+0000 7f49f97fa640 10 monclient: dump: 2024-08-18T21:13:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.361 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.347+0000 7f49f97fa640 1 -- 172.21.15.5:0/4203297568 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f49f0019070 con 0x7f49fc0a2560 2024-08-18T21:13:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.347+0000 7f49f97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.347+0000 7f49f97fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.347+0000 7f49f97fa640 1 -- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc0a2560 msgr2=0x7f49fc09f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.347+0000 7f49f97fa640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc0a2560 0x7f49fc09f0c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f49f000eaa0 tx=0x7f49f000eb90 comp rx=0 tx=0).stop 2024-08-18T21:13:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.347+0000 7f49f97fa640 1 -- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc0a2560 msgr2=0x7f49fc09f0c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:05.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.347+0000 7f49f97fa640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc0a2560 0x7f49fc09f0c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.347+0000 7f49fbfff640 1 --2- 172.21.15.5:0/4203297568 >> v2:172.21.15.157:6812/631023601 conn(0x7f49e003bdc0 0x7f49e003e280 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0a01f0 tx=0x7f49e8008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f4a02f6c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f4a02f6c640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc09f600 0x7f49fc09f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f4a02f6c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f4a02f6c640 1 -- 172.21.15.5:0/4203297568 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f49fc069fa0 con 0x7f49fc09f600 2024-08-18T21:13:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f4a00d08640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc09f600 0x7f49fc09f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f4a00d08640 10 monclient: get_auth_request con 0x7f49fc09f600 auth_method 0 2024-08-18T21:13:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f4a00d08640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f4a00d08640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f4a00d08640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f4a00d08640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f4a00d08640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f4a00d08640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f4a00d08640 10 monclient(hunting): handle_auth_done global_id 85722 payload 824 2024-08-18T21:13:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f4a00d08640 1 -- 172.21.15.5:0/4203297568 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f49fc0a7480 con 0x7f49fc09f600 2024-08-18T21:13:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f4a00d08640 1 -- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc09f600 msgr2=0x7f49fc09f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f4a00d08640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc09f600 0x7f49fc09f9e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f49f0007930 tx=0x7f49f0004950 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f49f97fa640 1 -- 172.21.15.5:0/4203297568 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f49f0024070 con 0x7f49fc09f600 2024-08-18T21:13:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f49f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f49f97fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:13:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f49f97fa640 10 monclient: dump: 2024-08-18T21:13:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.368 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f49f97fa640 1 -- 172.21.15.5:0/4203297568 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7f49f0014480 con 0x7f49fc09f600 2024-08-18T21:13:05.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f49f97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:05.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f49f97fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:05.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f49f97fa640 1 -- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc09f600 msgr2=0x7f49fc09f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f49f97fa640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc09f600 0x7f49fc09f9e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f49f0007930 tx=0x7f49f0004950 comp rx=0 tx=0).stop 2024-08-18T21:13:05.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.355+0000 7f49f97fa640 1 -- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc09f600 msgr2=0x7f49fc09f9e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:05.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.359+0000 7f49f97fa640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f49fc09f600 0x7f49fc09f9e0 secure :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f49f0007930 tx=0x7f49f0004950 comp rx=0 tx=0).stop 2024-08-18T21:13:05.369 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:05.369 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:05.369 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:05.370 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:05.370 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:05.370 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 282185, 2024-08-18T21:13:05.370 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:05.370 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:05.370 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:05.370 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:05.370 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:05.370 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:05.370 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 6, 2024-08-18T21:13:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:05.372 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:05.372 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:05.372 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:05.372 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:05.372 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:05.372 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.372 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:05.372 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:05.372 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:05.372 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:05.372 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:05.372 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:05.372 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:05.373 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:05.373 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:05.373 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:05.373 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:05.373 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:05.373 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:05.373 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.373 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:05.373 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:05.373 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:05.373 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:05.373 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:05.374 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:05.374 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:05.374 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:05.374 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:05.374 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:05.374 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:05.374 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:05.374 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:05.374 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:05.374 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:05.374 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:05.374 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:05.374 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:05.375 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:05.375 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:05.375 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:05.375 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:05.375 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:05.375 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:05.375 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:05.375 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:05.375 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:05.375 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:05.375 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.375 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:05.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.376 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:05.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.376 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:05.376 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:05.376 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.376 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.376 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.376 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:05.376 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.376 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.377 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:05.377 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.377 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.377 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.377 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:05.377 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:05.377 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.377 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.377 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.377 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:05.377 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:05.378 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.378 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.378 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.378 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:05.378 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.378 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.378 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:05.378 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.378 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.378 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.379 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:05.379 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:05.379 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.379 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.379 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.379 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:05.379 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:05.379 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.379 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.380 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.380 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:05.380 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.380 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.380 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.380 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:05.380 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.380 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.380 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.380 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:05.381 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:05.381 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.381 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.381 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.381 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:05.381 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:05.381 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.381 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.382 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:05.382 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.382 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.382 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:05.382 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.382 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.382 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.382 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:05.382 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:05.383 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.383 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.383 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.383 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:05.383 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:05.383 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.384 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:05.384 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.384 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:05.384 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.384 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.384 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:05.385 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:05.385 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.385 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.385 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.385 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.385 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:05.385 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:05.385 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.385 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.385 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.385 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.385 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:05.385 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.386 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.386 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:05.386 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.386 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.386 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.386 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:05.386 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:05.386 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.386 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.386 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.387 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.387 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:05.387 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:05.387 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.387 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.387 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:05.387 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.387 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.387 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:05.388 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.388 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.388 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:05.388 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:05.388 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.388 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.388 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.388 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:05.388 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:05.388 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.389 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:05.389 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.389 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:05.389 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.389 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.389 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:05.390 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:05.390 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.390 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.390 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.390 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:05.390 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:05.390 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.390 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.390 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:05.391 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:05.391 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.391 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.391 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:05.391 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:05.391 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.392 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.392 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.392 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.392 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.392 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:05.392 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:05.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.392 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:05.392 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:05.392 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:05.392 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.392 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.392 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:05.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.393 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:05.393 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:05.393 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:05.393 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.393 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.393 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:05.393 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:05.395 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:05.395 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2475562713}) 2024-08-18T21:13:05.395 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=349045421}) 2024-08-18T21:13:05.395 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:05.395 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2475562713}) 2024-08-18T21:13:05.395 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1525902574}) 2024-08-18T21:13:05.395 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:05.395 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2475562713}) 2024-08-18T21:13:05.396 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2557536214}) 2024-08-18T21:13:05.396 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:05.396 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2475562713}) 2024-08-18T21:13:05.396 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=1338515236}) 2024-08-18T21:13:05.396 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:05.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.359+0000 7f4a02f6c640 1 -- 172.21.15.5:0/4203297568 >> v2:172.21.15.157:6812/631023601 conn(0x7f49e003bdc0 msgr2=0x7f49e003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.359+0000 7f4a02f6c640 1 --2- 172.21.15.5:0/4203297568 >> v2:172.21.15.157:6812/631023601 conn(0x7f49e003bdc0 0x7f49e003e280 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0a01f0 tx=0x7f49e8008040 comp rx=0 tx=0).stop 2024-08-18T21:13:05.396 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2475562713}) 2024-08-18T21:13:05.397 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=2316339051}) 2024-08-18T21:13:05.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.359+0000 7f4a02f6c640 10 monclient: shutdown 2024-08-18T21:13:05.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.359+0000 7f4a02f6c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:05.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.359+0000 7f4a02f6c640 1 -- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49fc13f220 msgr2=0x7f49fc09eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.359+0000 7f4a02f6c640 1 --2- 172.21.15.5:0/4203297568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49fc13f220 0x7f49fc09eb80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f49f40b0040 tx=0x7f49f40195f0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.359+0000 7f4a01509640 1 -- 172.21.15.5:0/4203297568 reap_dead start 2024-08-18T21:13:05.398 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:05.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.359+0000 7f4a01509640 1 -- 172.21.15.5:0/4203297568 reap_dead start 2024-08-18T21:13:05.398 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2475562713}) 2024-08-18T21:13:05.398 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=3976348685}) 2024-08-18T21:13:05.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.359+0000 7f4a02f6c640 1 -- 172.21.15.5:0/4203297568 shutdown_connections 2024-08-18T21:13:05.399 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:05.399 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2475562713}) 2024-08-18T21:13:05.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.359+0000 7f4a02f6c640 1 -- 172.21.15.5:0/4203297568 >> 172.21.15.5:0/4203297568 conn(0x7f49fc0acbc0 msgr2=0x7f49fc0a59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:05.400 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3687849451}) 2024-08-18T21:13:05.400 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:05.400 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2475562713}) 2024-08-18T21:13:05.400 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.359+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=2463256289}) 2024-08-18T21:13:05.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.359+0000 7f4a02f6c640 1 -- 172.21.15.5:0/4203297568 shutdown_connections 2024-08-18T21:13:05.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.359+0000 7f4a02f6c640 1 -- 172.21.15.5:0/4203297568 wait complete. 2024-08-18T21:13:05.401 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:05.402 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:13:05.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:13:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 10 monclient: get_monmap_and_config 2024-08-18T21:13:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 10 monclient: build_initial_monmap 2024-08-18T21:13:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 10 monclient: monmap: 2024-08-18T21:13:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:05.529816+0000 2024-08-18T21:13:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:05.529816+0000 2024-08-18T21:13:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:05.527 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 1 Processor -- start 2024-08-18T21:13:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 1 -- start start 2024-08-18T21:13:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 10 monclient: init 2024-08-18T21:13:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 10 monclient: _add_conns ranks=[6,5,1,8,9,7,2,0,10,4,3] 2024-08-18T21:13:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f15f4073670 0x7f15f4073a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 10 monclient(hunting): picked mon.noname-d con 0x7f15f4073670 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f15f40a2da0 0x7f15f40a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 10 monclient(hunting): picked mon.noname-h con 0x7f15f40a2da0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f15f40a1a10 addr v1:172.21.15.157:6789/0 2024-08-18T21:13:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f40a3f90 con 0x7f15f40a1a10 2024-08-18T21:13:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f15f40a64d0 con 0x7f15f40a2da0 2024-08-18T21:13:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f15f4071200 con 0x7f15f4073670 2024-08-18T21:13:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15fba5d640 10 monclient(hunting): authenticate will time out at 1552.543203s 2024-08-18T21:13:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f15f4073670 0x7f15f4073a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f15f4073670 0x7f15f4073a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:38126/0 (socket says 172.21.15.5:38126) 2024-08-18T21:13:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 1 -- 172.21.15.5:0/2993347087 learned_addr learned my addr 172.21.15.5:0/2993347087 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 10 monclient(hunting): get_auth_request con 0x7f15f4073670 auth_method 0 2024-08-18T21:13:05.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f8ff8640 1 --2- 172.21.15.5:0/2993347087 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f15f40a2da0 0x7f15f40a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f8ff8640 10 monclient(hunting): get_auth_request con 0x7f15f40a2da0 auth_method 0 2024-08-18T21:13:05.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f8ff8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f8ff8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f8ff8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 10 monclient(hunting): handle_auth_done global_id 85731 payload 274 2024-08-18T21:13:05.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 1 -- 172.21.15.5:0/2993347087 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f15f40a2da0 msgr2=0x7f15f40a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:05.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 1 --2- 172.21.15.5:0/2993347087 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f15f40a2da0 0x7f15f40a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 1 -- 172.21.15.5:0/2993347087 >> v1:172.21.15.157:6789/0 conn(0x7f15f40a1a10 legacy=0x7f15f413e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:05.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 10 monclient: _finish_hunting 0 2024-08-18T21:13:05.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 1 monclient: found mon.noname-d 2024-08-18T21:13:05.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:05.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:13:05.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.527+0000 7f15f97f9640 1 -- 172.21.15.5:0/2993347087 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f40a36f0 con 0x7f15f4073670 2024-08-18T21:13:05.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f97f9640 1 -- 172.21.15.5:0/2993347087 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f15f4073670 msgr2=0x7f15f4073a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f97f9640 1 --2- 172.21.15.5:0/2993347087 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f15f4073670 0x7f15f4073a50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f15f00098a0 tx=0x7f15f001c4d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=5cbc27561686083a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15ebfff640 1 -- 172.21.15.5:0/2993347087 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f15f00ab860 con 0x7f15f4073670 2024-08-18T21:13:05.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15ebfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:13:05.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15ebfff640 10 monclient: dump: 2024-08-18T21:13:05.535 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.535 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.535 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.535 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.535 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.535 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.535 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.536 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.536 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.536 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.536 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.536 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.536 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.536 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.536 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.536 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15ebfff640 10 monclient: _finish_auth 0 2024-08-18T21:13:05.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15ebfff640 10 monclient: _check_auth_tickets 2024-08-18T21:13:05.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:05.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15ebfff640 1 -- 172.21.15.5:0/2993347087 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f00b0070 con 0x7f15f4073670 2024-08-18T21:13:05.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15ebfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:05.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15ebfff640 1 -- 172.21.15.5:0/2993347087 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f15f00aa350 con 0x7f15f4073670 2024-08-18T21:13:05.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15ebfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:13:05.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15ebfff640 10 monclient: dump: 2024-08-18T21:13:05.537 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.537 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.537 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.537 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.537 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.537 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.537 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.537 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.537 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.538 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.538 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.538 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.538 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.538 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.538 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.538 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 5 monclient: authenticate success, global_id 85731 2024-08-18T21:13:05.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:05.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 4 set_mon_vals no callback set 2024-08-18T21:13:05.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 10 monclient: shutdown 2024-08-18T21:13:05.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:05.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 1 -- 172.21.15.5:0/2993347087 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f15f4073670 msgr2=0x7f15f4073a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 1 --2- 172.21.15.5:0/2993347087 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f15f4073670 0x7f15f4073a50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f15f00098a0 tx=0x7f15f001c4d0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 1 -- 172.21.15.5:0/2993347087 shutdown_connections 2024-08-18T21:13:05.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 1 --2- 172.21.15.5:0/2993347087 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f15f40a2da0 0x7f15f40a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 1 --2- 172.21.15.5:0/2993347087 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f15f4073670 0x7f15f4073a50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 1 -- 172.21.15.5:0/2993347087 >> 172.21.15.5:0/2993347087 conn(0x7f15f4068700 msgr2=0x7f15f4068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:05.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 1 -- 172.21.15.5:0/2993347087 shutdown_connections 2024-08-18T21:13:05.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 1 -- 172.21.15.5:0/2993347087 wait complete. 2024-08-18T21:13:05.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 10 monclient: build_initial_monmap 2024-08-18T21:13:05.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 10 monclient: monmap: 2024-08-18T21:13:05.539 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:05.539 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:05.539 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:05.539 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:05.540 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:05.540 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.540 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:05.540 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:05.540 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:05.540 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:05.540 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:05.540 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:05.540 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:05.540 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:05.540 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:05.540 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 1 Processor -- start 2024-08-18T21:13:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 1 -- start start 2024-08-18T21:13:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 10 monclient: init 2024-08-18T21:13:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 10 monclient: _add_conns ranks=[5,3,1,0,6,4,2,7,8] 2024-08-18T21:13:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f15f4073670 0x7f15f4138350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 10 monclient(hunting): picked mon.noname-h con 0x7f15f4073670 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15f40a1a10 0x7f15f4138890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 10 monclient(hunting): picked mon.noname-g con 0x7f15f40a1a10 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15f4120620 0x7f15f4120a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 10 monclient(hunting): picked mon.noname-f con 0x7f15f4120620 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:13:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f15f40a43b0 con 0x7f15f4120620 2024-08-18T21:13:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f15f4073f90 con 0x7f15f40a1a10 2024-08-18T21:13:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f15f4121920 con 0x7f15f4073670 2024-08-18T21:13:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15fba5d640 10 monclient(hunting): authenticate will time out at 1552.551377s 2024-08-18T21:13:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f97f9640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f15f4073670 0x7f15f4138350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f8ff8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15f40a1a10 0x7f15f4138890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f9ffa640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15f4120620 0x7f15f4120a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f97f9640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f15f4073670 0x7f15f4138350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:49046/0 (socket says 172.21.15.5:49046) 2024-08-18T21:13:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f8ff8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15f40a1a10 0x7f15f4138890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:42020/0 (socket says 172.21.15.5:42020) 2024-08-18T21:13:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f97f9640 1 -- 172.21.15.5:0/3822777140 learned_addr learned my addr 172.21.15.5:0/3822777140 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f97f9640 10 monclient(hunting): get_auth_request con 0x7f15f4073670 auth_method 0 2024-08-18T21:13:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f97f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f97f9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f97f9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f8ff8640 10 monclient(hunting): get_auth_request con 0x7f15f40a1a10 auth_method 0 2024-08-18T21:13:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f8ff8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f8ff8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f8ff8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f9ffa640 10 monclient(hunting): get_auth_request con 0x7f15f4120620 auth_method 0 2024-08-18T21:13:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f9ffa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f9ffa640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.535+0000 7f15f9ffa640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f97f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f97f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f97f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f9ffa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f9ffa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f9ffa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f8ff8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f8ff8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f8ff8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f97f9640 10 monclient(hunting): handle_auth_done global_id 95189 payload 824 2024-08-18T21:13:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f97f9640 1 -- 172.21.15.5:0/3822777140 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15f40a1a10 msgr2=0x7f15f4138890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f97f9640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15f40a1a10 0x7f15f4138890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f97f9640 1 -- 172.21.15.5:0/3822777140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15f4120620 msgr2=0x7f15f4120a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f97f9640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15f4120620 0x7f15f4120a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f97f9640 10 monclient: _finish_hunting 0 2024-08-18T21:13:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f97f9640 1 monclient: found mon.noname-h 2024-08-18T21:13:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f97f9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f97f9640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:13:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f97f9640 1 -- 172.21.15.5:0/3822777140 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f4122e40 con 0x7f15f4073670 2024-08-18T21:13:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f8ff8640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15f40a1a10 0x7f15f4138890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f9ffa640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15f4120620 0x7f15f4120a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f97f9640 1 -- 172.21.15.5:0/3822777140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f15f4073670 msgr2=0x7f15f4138350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15f97f9640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f15f4073670 0x7f15f4138350 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009870 tx=0x7f15f0019270 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15e9ffb640 1 -- 172.21.15.5:0/3822777140 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f15f00bd400 con 0x7f15f4073670 2024-08-18T21:13:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15e9ffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:13:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15e9ffb640 10 monclient: dump: 2024-08-18T21:13:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.552 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15e9ffb640 10 monclient: _finish_auth 0 2024-08-18T21:13:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15e9ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:13:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15fba5d640 5 monclient: authenticate success, global_id 95189 2024-08-18T21:13:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15fba5d640 10 monclient: _renew_subs 2024-08-18T21:13:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15fba5d640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:13:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15fba5d640 1 -- 172.21.15.5:0/3822777140 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f4123120 con 0x7f15f4073670 2024-08-18T21:13:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15e9ffb640 1 -- 172.21.15.5:0/3822777140 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f0003b80 con 0x7f15f4073670 2024-08-18T21:13:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15e9ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15eb7fe640 4 set_mon_vals no callback set 2024-08-18T21:13:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15fba5d640 10 monclient: _renew_subs 2024-08-18T21:13:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15fba5d640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.157:3302/0 2024-08-18T21:13:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15fba5d640 1 -- 172.21.15.5:0/3822777140 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f40a9800 con 0x7f15f4073670 2024-08-18T21:13:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15e9ffb640 1 -- 172.21.15.5:0/3822777140 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f15f00c2020 con 0x7f15f4073670 2024-08-18T21:13:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15e9ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:13:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.539+0000 7f15e9ffb640 10 monclient: dump: 2024-08-18T21:13:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.554 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15fba5d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15fba5d640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f15f40a2da0 0x7f15f4120fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15fba5d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15fba5d640 1 -- 172.21.15.5:0/3822777140 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f15f40a4530 con 0x7f15f40a2da0 2024-08-18T21:13:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15f8ff8640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f15f40a2da0 0x7f15f4120fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15f8ff8640 10 monclient: get_auth_request con 0x7f15f40a2da0 auth_method 0 2024-08-18T21:13:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15f8ff8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15f8ff8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15f8ff8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15f8ff8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15f8ff8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15f8ff8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15f8ff8640 10 monclient(hunting): handle_auth_done global_id 114722 payload 824 2024-08-18T21:13:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15f8ff8640 1 -- 172.21.15.5:0/3822777140 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f15f40a92f0 con 0x7f15f40a2da0 2024-08-18T21:13:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15e9ffb640 1 -- 172.21.15.5:0/3822777140 <== mon.5 v2:172.21.15.157:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f15f0003d30 con 0x7f15f4073670 2024-08-18T21:13:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15e9ffb640 1 --2- 172.21.15.5:0/3822777140 >> v2:172.21.15.157:6812/631023601 conn(0x7f15d803bdc0 0x7f15d803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15e9ffb640 1 -- 172.21.15.5:0/3822777140 <== mon.5 v2:172.21.15.157:3302/0 5 ==== osd_map(265..265 src has 22..265) ==== 3506+0+0 (secure 0 0 0) 0x7f15f00e8a20 con 0x7f15f4073670 2024-08-18T21:13:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15f9ffa640 1 --2- 172.21.15.5:0/3822777140 >> v2:172.21.15.157:6812/631023601 conn(0x7f15d803bdc0 0x7f15d803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15f9ffa640 10 monclient: get_auth_request con 0x7f15d803bdc0 auth_method 0 2024-08-18T21:13:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15f8ff8640 1 -- 172.21.15.5:0/3822777140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f15f40a2da0 msgr2=0x7f15f4120fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15f8ff8640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f15f40a2da0 0x7f15f4120fa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f15f4069790 tx=0x7f15e4010f40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15e9ffb640 1 -- 172.21.15.5:0/3822777140 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f15e4018020 con 0x7f15f40a2da0 2024-08-18T21:13:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15e9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15e9ffb640 10 monclient: dump: 2024-08-18T21:13:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.557 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15e9ffb640 1 -- 172.21.15.5:0/3822777140 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f15e400e980 con 0x7f15f40a2da0 2024-08-18T21:13:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15e9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15e9ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15e9ffb640 1 -- 172.21.15.5:0/3822777140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f15f40a2da0 msgr2=0x7f15f4120fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15e9ffb640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f15f40a2da0 0x7f15f4120fa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f15f4069790 tx=0x7f15e4010f40 comp rx=0 tx=0).stop 2024-08-18T21:13:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15e9ffb640 1 -- 172.21.15.5:0/3822777140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f15f40a2da0 msgr2=0x7f15f4120fa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.543+0000 7f15e9ffb640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f15f40a2da0 0x7f15f4120fa0 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f15f4069790 tx=0x7f15e4010f40 comp rx=0 tx=0).stop 2024-08-18T21:13:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.547+0000 7f15f9ffa640 1 --2- 172.21.15.5:0/3822777140 >> v2:172.21.15.157:6812/631023601 conn(0x7f15d803bdc0 0x7f15d803e280 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f15f41226e0 tx=0x7f15ec003d50 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.551+0000 7f15fba5d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.551+0000 7f15fba5d640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f15f409dd50 0x7f15f409e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.551+0000 7f15fba5d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.551+0000 7f15fba5d640 1 -- 172.21.15.5:0/3822777140 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f15f4051140 con 0x7f15f409dd50 2024-08-18T21:13:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.551+0000 7f15f8ff8640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f15f409dd50 0x7f15f409e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.551+0000 7f15f8ff8640 10 monclient: get_auth_request con 0x7f15f409dd50 auth_method 0 2024-08-18T21:13:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.551+0000 7f15f8ff8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.551+0000 7f15f8ff8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.551+0000 7f15f8ff8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.551+0000 7f15f8ff8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.551+0000 7f15f8ff8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.551+0000 7f15f8ff8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.551+0000 7f15f8ff8640 10 monclient(hunting): handle_auth_done global_id 114731 payload 824 2024-08-18T21:13:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.551+0000 7f15f8ff8640 1 -- 172.21.15.5:0/3822777140 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f15f40a2670 con 0x7f15f409dd50 2024-08-18T21:13:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15f8ff8640 1 -- 172.21.15.5:0/3822777140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f15f409dd50 msgr2=0x7f15f409e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15f8ff8640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f15f409dd50 0x7f15f409e160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15e4019000 tx=0x7f15e40046d0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15e9ffb640 1 -- 172.21.15.5:0/3822777140 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f15e4018040 con 0x7f15f409dd50 2024-08-18T21:13:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15e9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15e9ffb640 10 monclient: dump: 2024-08-18T21:13:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.562 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15e9ffb640 1 -- 172.21.15.5:0/3822777140 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f15e4003830 con 0x7f15f409dd50 2024-08-18T21:13:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15e9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15e9ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15e9ffb640 1 -- 172.21.15.5:0/3822777140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f15f409dd50 msgr2=0x7f15f409e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15e9ffb640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f15f409dd50 0x7f15f409e160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15e4019000 tx=0x7f15e40046d0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15e9ffb640 1 -- 172.21.15.5:0/3822777140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f15f409dd50 msgr2=0x7f15f409e160 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15e9ffb640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f15f409dd50 0x7f15f409e160 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15e4019000 tx=0x7f15e40046d0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.563 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:05.563 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:05.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 90723, 2024-08-18T21:13:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:05.565 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.565 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:13:05.565 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:05.565 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:05.565 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:05.565 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:05.565 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:05.565 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:05.565 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:05.565 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:05.565 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:05.565 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:05.565 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:05.566 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:05.566 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:05.566 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:05.566 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.566 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:05.566 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:05.566 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:05.566 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:05.566 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:05.566 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:05.566 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:05.566 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:05.566 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:05.567 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:05.567 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:05.567 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:05.567 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:05.567 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.567 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:05.567 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:05.567 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:05.567 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:05.567 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:05.567 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:05.567 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:05.567 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:05.569 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:05.569 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:05.570 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:05.570 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:05.570 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:05.570 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:05.570 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:05.570 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:05.570 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:05.570 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:05.570 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:05.570 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:05.570 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:05.570 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:05.570 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:05.570 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:05.571 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:05.571 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:05.571 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:05.571 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:05.571 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.571 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:05.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.571 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:05.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.571 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:05.571 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:05.571 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.571 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.572 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.572 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:05.572 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.572 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.572 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:05.572 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.572 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.572 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.572 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:05.573 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:05.573 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.573 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.573 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.573 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:05.573 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:05.573 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.573 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.573 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.573 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:05.573 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.574 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:05.574 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.574 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.574 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:05.574 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:05.574 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.574 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.575 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.575 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:05.575 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:05.575 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.575 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.575 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:05.575 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:05.576 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.576 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.576 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:05.576 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:05.576 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.576 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.576 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.576 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:05.576 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:05.577 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:05.577 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:05.577 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.577 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.577 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.578 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:05.578 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:05.578 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.578 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.578 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.578 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:05.578 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:05.578 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.578 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.578 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.579 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:05.579 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.579 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.579 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:05.579 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.579 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.579 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.579 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:05.579 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:05.580 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.580 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.580 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.580 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:05.580 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:05.580 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.580 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.580 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.580 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:05.580 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.581 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:05.581 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.581 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.581 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:05.581 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:05.581 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.581 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.581 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.582 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:05.582 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:05.582 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:05.582 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:05.583 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.583 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.583 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:05.583 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:05.583 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.583 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.583 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.583 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:05.583 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:05.584 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.584 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:05.584 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.584 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:05.584 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.584 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.585 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:05.585 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:05.585 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.585 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.585 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.585 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:05.585 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:05.585 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.585 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.586 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.586 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:05.586 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.586 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.586 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:05.586 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.586 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.586 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.586 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:05.586 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:05.586 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.587 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.587 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.587 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.587 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.587 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:05.587 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:05.587 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.587 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:05.587 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:05.587 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:05.587 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.588 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.588 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:13:05.588 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.588 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:05.588 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:05.588 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:05.588 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.588 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.588 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:05.588 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.588 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:05.588 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:05.588 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:05.589 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.589 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.589 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:05.589 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:05.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15fba5d640 1 -- 172.21.15.5:0/3822777140 >> v2:172.21.15.157:6812/631023601 conn(0x7f15d803bdc0 msgr2=0x7f15d803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15fba5d640 1 --2- 172.21.15.5:0/3822777140 >> v2:172.21.15.157:6812/631023601 conn(0x7f15d803bdc0 0x7f15d803e280 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f15f41226e0 tx=0x7f15ec003d50 comp rx=0 tx=0).stop 2024-08-18T21:13:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15fba5d640 10 monclient: shutdown 2024-08-18T21:13:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15fba5d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15fba5d640 1 -- 172.21.15.5:0/3822777140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f15f4073670 msgr2=0x7f15f4138350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15fba5d640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f15f4073670 0x7f15f4138350 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009870 tx=0x7f15f0019270 comp rx=0 tx=0).stop 2024-08-18T21:13:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15f9ffa640 1 -- 172.21.15.5:0/3822777140 reap_dead start 2024-08-18T21:13:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15fba5d640 1 -- 172.21.15.5:0/3822777140 shutdown_connections 2024-08-18T21:13:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15fba5d640 1 --2- 172.21.15.5:0/3822777140 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f15f4073670 0x7f15f4138350 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15fba5d640 1 -- 172.21.15.5:0/3822777140 >> 172.21.15.5:0/3822777140 conn(0x7f15f4068700 msgr2=0x7f15f4072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15fba5d640 1 -- 172.21.15.5:0/3822777140 shutdown_connections 2024-08-18T21:13:05.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.555+0000 7f15fba5d640 1 -- 172.21.15.5:0/3822777140 wait complete. 2024-08-18T21:13:05.592 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:05.592 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:13:05.592 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:13:05.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 10 monclient: get_monmap_and_config 2024-08-18T21:13:05.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 10 monclient: build_initial_monmap 2024-08-18T21:13:05.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 10 monclient: monmap: 2024-08-18T21:13:05.705 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:05.705 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.705 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:05.708611+0000 2024-08-18T21:13:05.705 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:05.708611+0000 2024-08-18T21:13:05.705 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:05.705 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.705 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:05.705 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:05.706 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:05.706 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:05.706 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:05.706 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:05.706 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:05.706 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:05.706 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:05.706 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:05.706 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:05.706 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 1 Processor -- start 2024-08-18T21:13:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 1 -- start start 2024-08-18T21:13:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 10 monclient: init 2024-08-18T21:13:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 10 monclient: _add_conns ranks=[9,4,2,8,0,1,7,10,5,3,6] 2024-08-18T21:13:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a50139d00 0x7f9a5013a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 10 monclient(hunting): picked mon.noname-a con 0x7f9a50139d00 addr v2:172.21.15.5:3300/0 2024-08-18T21:13:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9a500a4b40 0x7f9a5006c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 10 monclient(hunting): picked mon.noname-c con 0x7f9a500a4b40 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:13:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9a500a4f80 0x7f9a5006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 10 monclient(hunting): picked mon.noname-b con 0x7f9a500a4f80 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9a5009e7f0 con 0x7f9a50139d00 2024-08-18T21:13:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5009e230 con 0x7f9a500a4f80 2024-08-18T21:13:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f9a5009e510 con 0x7f9a500a4b40 2024-08-18T21:13:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a57e58640 10 monclient(hunting): authenticate will time out at 1552.721968s 2024-08-18T21:13:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a50139d00 0x7f9a5013a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a563f5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9a500a4f80 0x7f9a5006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a50139d00 0x7f9a5013a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49954/0 (socket says 172.21.15.5:49954) 2024-08-18T21:13:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 1 -- 172.21.15.5:0/1623347883 learned_addr learned my addr 172.21.15.5:0/1623347883 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 10 monclient(hunting): get_auth_request con 0x7f9a50139d00 auth_method 0 2024-08-18T21:13:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a553f3640 1 --2- 172.21.15.5:0/1623347883 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9a500a4b40 0x7f9a5006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a563f5640 10 monclient(hunting): get_auth_request con 0x7f9a500a4f80 auth_method 0 2024-08-18T21:13:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a563f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a563f5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a563f5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a563f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a563f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a563f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 10 monclient(hunting): handle_auth_done global_id 124281 payload 274 2024-08-18T21:13:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 1 -- 172.21.15.5:0/1623347883 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9a500a4b40 msgr2=0x7f9a5006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 1 --2- 172.21.15.5:0/1623347883 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9a500a4b40 0x7f9a5006c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 1 -- 172.21.15.5:0/1623347883 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9a500a4f80 msgr2=0x7f9a5006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 1 --2- 172.21.15.5:0/1623347883 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9a500a4f80 0x7f9a5006ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 10 monclient: _finish_hunting 0 2024-08-18T21:13:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 1 monclient: found mon.noname-a 2024-08-18T21:13:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:13:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a55bf4640 1 -- 172.21.15.5:0/1623347883 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5009f000 con 0x7f9a50139d00 2024-08-18T21:13:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.707+0000 7f9a563f5640 1 --2- 172.21.15.5:0/1623347883 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9a500a4f80 0x7f9a5006ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a55bf4640 1 -- 172.21.15.5:0/1623347883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a50139d00 msgr2=0x7f9a5013a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a55bf4640 1 --2- 172.21.15.5:0/1623347883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a50139d00 0x7f9a5013a0e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009870 tx=0x7f9a4c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd7524a035a5bc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a54bf2640 1 -- 172.21.15.5:0/1623347883 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9a4c0b0070 con 0x7f9a50139d00 2024-08-18T21:13:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a54bf2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a54bf2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:13:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a54bf2640 10 monclient: dump: 2024-08-18T21:13:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.716 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a54bf2640 10 monclient: _finish_auth 0 2024-08-18T21:13:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a54bf2640 10 monclient: _check_auth_tickets 2024-08-18T21:13:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a54bf2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a54bf2640 1 -- 172.21.15.5:0/1623347883 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a4c0aa810 con 0x7f9a50139d00 2024-08-18T21:13:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a57e58640 5 monclient: authenticate success, global_id 124281 2024-08-18T21:13:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a57e58640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:13:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a54bf2640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a57e58640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a54bf2640 1 -- 172.21.15.5:0/1623347883 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9a4c0a9300 con 0x7f9a50139d00 2024-08-18T21:13:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a54bf2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a57e58640 4 set_mon_vals no callback set 2024-08-18T21:13:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a54bf2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:13:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a54bf2640 10 monclient: dump: 2024-08-18T21:13:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.719 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a57e58640 10 monclient: shutdown 2024-08-18T21:13:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a57e58640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a57e58640 1 -- 172.21.15.5:0/1623347883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a50139d00 msgr2=0x7f9a5013a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a57e58640 1 --2- 172.21.15.5:0/1623347883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a50139d00 0x7f9a5013a0e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009870 tx=0x7f9a4c01c420 comp rx=0 tx=0).stop 2024-08-18T21:13:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a57e58640 1 -- 172.21.15.5:0/1623347883 shutdown_connections 2024-08-18T21:13:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a57e58640 1 --2- 172.21.15.5:0/1623347883 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9a500a4f80 0x7f9a5006ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a57e58640 1 --2- 172.21.15.5:0/1623347883 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f9a500a4b40 0x7f9a5006c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a57e58640 1 --2- 172.21.15.5:0/1623347883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a50139d00 0x7f9a5013a0e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a57e58640 1 -- 172.21.15.5:0/1623347883 >> 172.21.15.5:0/1623347883 conn(0x7f9a500688d0 msgr2=0x7f9a50068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a57e58640 1 -- 172.21.15.5:0/1623347883 shutdown_connections 2024-08-18T21:13:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.711+0000 7f9a57e58640 1 -- 172.21.15.5:0/1623347883 wait complete. 2024-08-18T21:13:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 10 monclient: build_initial_monmap 2024-08-18T21:13:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 10 monclient: monmap: 2024-08-18T21:13:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:05.721 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 1 Processor -- start 2024-08-18T21:13:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 1 -- start start 2024-08-18T21:13:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 10 monclient: init 2024-08-18T21:13:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 10 monclient: _add_conns ranks=[1,2,7,5,6,3,4,0,8] 2024-08-18T21:13:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a500a4b40 0x7f9a50132840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 10 monclient(hunting): picked mon.noname-f con 0x7f9a500a4b40 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:13:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9a500a4f80 0x7f9a50132d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 10 monclient(hunting): picked mon.noname-b con 0x7f9a500a4f80 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9a50139d00 0x7f9a501332c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 10 monclient(hunting): picked mon.noname-i con 0x7f9a50139d00 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9a50143580 con 0x7f9a500a4b40 2024-08-18T21:13:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5006d7e0 con 0x7f9a500a4f80 2024-08-18T21:13:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f9a50143700 con 0x7f9a50139d00 2024-08-18T21:13:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a57e58640 10 monclient(hunting): authenticate will time out at 1552.729290s 2024-08-18T21:13:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9a500a4f80 0x7f9a50132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9a500a4f80 0x7f9a50132d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:45522/0 (socket says 172.21.15.5:45522) 2024-08-18T21:13:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 1 -- 172.21.15.5:0/3988267033 learned_addr learned my addr 172.21.15.5:0/3988267033 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 10 monclient(hunting): get_auth_request con 0x7f9a500a4f80 auth_method 0 2024-08-18T21:13:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a55bf4640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a500a4b40 0x7f9a50132840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 10 monclient(hunting): handle_auth_done global_id 114554 payload 824 2024-08-18T21:13:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a563f5640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9a50139d00 0x7f9a501332c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 1 -- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9a50139d00 msgr2=0x7f9a501332c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9a50139d00 0x7f9a501332c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 1 -- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a500a4b40 msgr2=0x7f9a50132840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a500a4b40 0x7f9a50132840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 10 monclient: _finish_hunting 0 2024-08-18T21:13:05.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 1 monclient: found mon.noname-b 2024-08-18T21:13:05.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:05.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:13:05.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a553f3640 1 -- 172.21.15.5:0/3988267033 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a50138910 con 0x7f9a500a4f80 2024-08-18T21:13:05.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a55bf4640 10 monclient: get_auth_request con 0x7f9a500a4b40 auth_method 0 2024-08-18T21:13:05.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.715+0000 7f9a55bf4640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a500a4b40 0x7f9a50132840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:13:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a553f3640 1 -- 172.21.15.5:0/3988267033 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9a500a4f80 msgr2=0x7f9a50132d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a553f3640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9a500a4f80 0x7f9a50132d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000c7f0 tx=0x7f9a4000ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a467fc640 1 -- 172.21.15.5:0/3988267033 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9a400044a0 con 0x7f9a500a4f80 2024-08-18T21:13:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a467fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:13:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a467fc640 10 monclient: dump: 2024-08-18T21:13:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.728 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a467fc640 10 monclient: _finish_auth 0 2024-08-18T21:13:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a467fc640 10 monclient: _check_auth_tickets 2024-08-18T21:13:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a467fc640 1 -- 172.21.15.5:0/3988267033 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a40007830 con 0x7f9a500a4f80 2024-08-18T21:13:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a467fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a467fc640 1 -- 172.21.15.5:0/3988267033 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9a40007e50 con 0x7f9a500a4f80 2024-08-18T21:13:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a467fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a467fc640 10 monclient: dump: 2024-08-18T21:13:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a47fff640 4 set_mon_vals no callback set 2024-08-18T21:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a57e58640 5 monclient: authenticate success, global_id 114554 2024-08-18T21:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a57e58640 10 monclient: _renew_subs 2024-08-18T21:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a57e58640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a57e58640 1 -- 172.21.15.5:0/3988267033 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a5013cee0 con 0x7f9a500a4f80 2024-08-18T21:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a57e58640 10 monclient: _renew_subs 2024-08-18T21:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a57e58640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a57e58640 1 -- 172.21.15.5:0/3988267033 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a5013ec80 con 0x7f9a500a4f80 2024-08-18T21:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a57e58640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a57e58640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a5013f9f0 0x7f9a5013b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a57e58640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a57e58640 1 -- 172.21.15.5:0/3988267033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9a50051140 con 0x7f9a5013f9f0 2024-08-18T21:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a467fc640 1 -- 172.21.15.5:0/3988267033 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f9a400079e0 con 0x7f9a500a4f80 2024-08-18T21:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a55bf4640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a5013f9f0 0x7f9a5013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a55bf4640 10 monclient: get_auth_request con 0x7f9a5013f9f0 auth_method 0 2024-08-18T21:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a55bf4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a55bf4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a55bf4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a467fc640 1 --2- 172.21.15.5:0/3988267033 >> v2:172.21.15.157:6812/631023601 conn(0x7f9a3403bf60 0x7f9a3403e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a467fc640 1 -- 172.21.15.5:0/3988267033 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(265..265 src has 22..265) ==== 3506+0+0 (secure 0 0 0) 0x7f9a4004e5a0 con 0x7f9a500a4f80 2024-08-18T21:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a55bf4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a55bf4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a55bf4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a563f5640 1 --2- 172.21.15.5:0/3988267033 >> v2:172.21.15.157:6812/631023601 conn(0x7f9a3403bf60 0x7f9a3403e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a563f5640 10 monclient: get_auth_request con 0x7f9a3403bf60 auth_method 0 2024-08-18T21:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a55bf4640 10 monclient(hunting): handle_auth_done global_id 124237 payload 824 2024-08-18T21:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.719+0000 7f9a55bf4640 1 -- 172.21.15.5:0/3988267033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a5013ee80 con 0x7f9a5013f9f0 2024-08-18T21:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.723+0000 7f9a55bf4640 1 -- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a5013f9f0 msgr2=0x7f9a5013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.723+0000 7f9a55bf4640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a5013f9f0 0x7f9a5013b550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0ad000 tx=0x7f9a4c0191c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.723+0000 7f9a563f5640 1 --2- 172.21.15.5:0/3988267033 >> v2:172.21.15.157:6812/631023601 conn(0x7f9a3403bf60 0x7f9a3403e420 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9a500a53f0 tx=0x7f9a4800b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.723+0000 7f9a467fc640 1 -- 172.21.15.5:0/3988267033 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9a4c0b0070 con 0x7f9a5013f9f0 2024-08-18T21:13:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.723+0000 7f9a467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.723+0000 7f9a467fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:13:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.723+0000 7f9a467fc640 10 monclient: dump: 2024-08-18T21:13:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.734 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.723+0000 7f9a467fc640 1 -- 172.21.15.5:0/3988267033 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9a4c0b1040 con 0x7f9a5013f9f0 2024-08-18T21:13:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.723+0000 7f9a467fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.723+0000 7f9a467fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.723+0000 7f9a467fc640 1 -- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a5013f9f0 msgr2=0x7f9a5013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.723+0000 7f9a467fc640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a5013f9f0 0x7f9a5013b550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0ad000 tx=0x7f9a4c0191c0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.723+0000 7f9a467fc640 1 -- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a5013f9f0 msgr2=0x7f9a5013b550 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.723+0000 7f9a467fc640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a5013f9f0 0x7f9a5013b550 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0ad000 tx=0x7f9a4c0191c0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.731+0000 7f9a57e58640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.731+0000 7f9a57e58640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a5013ba90 0x7f9a5013bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.731+0000 7f9a57e58640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.731+0000 7f9a57e58640 1 -- 172.21.15.5:0/3988267033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5013c3e0 con 0x7f9a5013ba90 2024-08-18T21:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.731+0000 7f9a55bf4640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a5013ba90 0x7f9a5013bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.731+0000 7f9a55bf4640 10 monclient: get_auth_request con 0x7f9a5013ba90 auth_method 0 2024-08-18T21:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.731+0000 7f9a55bf4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.731+0000 7f9a55bf4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.731+0000 7f9a55bf4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.731+0000 7f9a55bf4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.731+0000 7f9a55bf4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.731+0000 7f9a55bf4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.731+0000 7f9a55bf4640 10 monclient(hunting): handle_auth_done global_id 124246 payload 824 2024-08-18T21:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.731+0000 7f9a55bf4640 1 -- 172.21.15.5:0/3988267033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9a5013a0e0 con 0x7f9a5013ba90 2024-08-18T21:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a55bf4640 1 -- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a5013ba90 msgr2=0x7f9a5013bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a55bf4640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a5013ba90 0x7f9a5013bea0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009870 tx=0x7f9a4c0a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a467fc640 1 -- 172.21.15.5:0/3988267033 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9a4c0b5870 con 0x7f9a5013ba90 2024-08-18T21:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a467fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a467fc640 10 monclient: dump: 2024-08-18T21:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.739 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a467fc640 1 -- 172.21.15.5:0/3988267033 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f9a4c0b5400 con 0x7f9a5013ba90 2024-08-18T21:13:05.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a467fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:05.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a467fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:05.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a467fc640 1 -- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a5013ba90 msgr2=0x7f9a5013bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a467fc640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a5013ba90 0x7f9a5013bea0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009870 tx=0x7f9a4c0a8000 comp rx=0 tx=0).stop 2024-08-18T21:13:05.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a467fc640 1 -- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a5013ba90 msgr2=0x7f9a5013bea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:05.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a467fc640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a5013ba90 0x7f9a5013bea0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009870 tx=0x7f9a4c0a8000 comp rx=0 tx=0).stop 2024-08-18T21:13:05.739 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:05.739 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:05.740 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:05.740 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:05.740 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:05.740 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 32719, 2024-08-18T21:13:05.740 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:05.740 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:05.740 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:05.740 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:05.740 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:05.740 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:05.740 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:05.740 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:05.740 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:05.741 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:05.741 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.741 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:13:05.741 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:05.741 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:05.741 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:05.741 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:05.741 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:05.741 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:05.741 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:05.741 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:05.741 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:05.741 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:05.741 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:05.742 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:05.742 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:05.742 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:05.742 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.742 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:05.742 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:05.742 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:05.742 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:05.742 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:05.742 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:05.742 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:05.742 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:05.742 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:05.742 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:05.743 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:05.743 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:05.743 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:05.743 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.743 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:05.743 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:05.743 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:05.743 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:05.743 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:05.743 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:05.743 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:05.743 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:05.743 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:05.744 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:05.744 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:05.744 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:05.744 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:05.744 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:05.744 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:05.744 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:05.744 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:05.744 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:05.744 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:05.744 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:05.744 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:05.744 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:05.744 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:05.745 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:05.745 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:05.745 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:05.745 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:05.745 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:05.745 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.745 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:05.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.745 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:05.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.745 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:05.745 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:05.745 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.746 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.746 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:05.746 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.746 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.746 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:05.746 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.746 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.746 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.746 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:05.746 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:05.747 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.747 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.747 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.747 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:05.747 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:05.747 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:05.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:05.748 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.748 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.748 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:05.748 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:05.748 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.748 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.748 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.749 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:05.749 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:05.749 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.749 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:05.749 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.749 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:05.749 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.750 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:05.750 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:05.750 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.750 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.750 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.750 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:05.750 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:05.750 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.751 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.751 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:05.751 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.751 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.751 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:05.751 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.751 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.751 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.751 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:05.751 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:05.752 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.752 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.752 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.752 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:05.752 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:05.752 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:05.752 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:05.753 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.753 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.753 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:05.753 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:05.753 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.753 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.753 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.754 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:05.754 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:05.754 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.754 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:05.754 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.754 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:05.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.755 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.755 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:05.755 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:05.755 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.755 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.755 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.755 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:05.755 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:05.756 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.756 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:05.756 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.756 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:05.756 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.756 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.756 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:05.757 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:05.757 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.757 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.757 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.757 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:05.757 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:05.757 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:05.758 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:05.758 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.758 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.758 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:05.758 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:05.758 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.759 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.759 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.759 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:05.759 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:05.759 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.759 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:05.759 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:05.760 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.760 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:05.760 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:05.760 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.760 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.760 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.760 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.761 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:05.761 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:05.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.761 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:05.761 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:05.761 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:05.761 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.761 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.761 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:05.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.761 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:05.761 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:05.761 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:13:05.762 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.762 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.762 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:05.762 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:05.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a57e58640 1 -- 172.21.15.5:0/3988267033 >> v2:172.21.15.157:6812/631023601 conn(0x7f9a3403bf60 msgr2=0x7f9a3403e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a57e58640 1 --2- 172.21.15.5:0/3988267033 >> v2:172.21.15.157:6812/631023601 conn(0x7f9a3403bf60 0x7f9a3403e420 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9a500a53f0 tx=0x7f9a4800b040 comp rx=0 tx=0).stop 2024-08-18T21:13:05.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a57e58640 10 monclient: shutdown 2024-08-18T21:13:05.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a57e58640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:05.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a57e58640 1 -- 172.21.15.5:0/3988267033 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9a500a4f80 msgr2=0x7f9a50132d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a57e58640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9a500a4f80 0x7f9a50132d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000c7f0 tx=0x7f9a4000ccb0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a563f5640 1 -- 172.21.15.5:0/3988267033 reap_dead start 2024-08-18T21:13:05.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a57e58640 1 -- 172.21.15.5:0/3988267033 shutdown_connections 2024-08-18T21:13:05.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a57e58640 1 --2- 172.21.15.5:0/3988267033 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9a500a4f80 0x7f9a50132d80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a57e58640 1 -- 172.21.15.5:0/3988267033 >> 172.21.15.5:0/3988267033 conn(0x7f9a500688d0 msgr2=0x7f9a500a03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:05.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a57e58640 1 -- 172.21.15.5:0/3988267033 shutdown_connections 2024-08-18T21:13:05.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.735+0000 7f9a57e58640 1 -- 172.21.15.5:0/3988267033 wait complete. 2024-08-18T21:13:05.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:05.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=55} crc {osdmap=1358656004}) 2024-08-18T21:13:05.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=56} crc {osdmap=3075359696}) 2024-08-18T21:13:05.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:05.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=55} crc {osdmap=1358656004}) 2024-08-18T21:13:05.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=57} crc {osdmap=587261792}) 2024-08-18T21:13:05.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:05.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=55} crc {osdmap=1358656004}) 2024-08-18T21:13:05.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=54} crc {osdmap=2677115877}) 2024-08-18T21:13:05.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:05.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=55} crc {osdmap=1358656004}) 2024-08-18T21:13:05.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=52} crc {osdmap=2289912297}) 2024-08-18T21:13:05.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:05.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=55} crc {osdmap=1358656004}) 2024-08-18T21:13:05.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=53} crc {osdmap=581736860}) 2024-08-18T21:13:05.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:05.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=55} crc {osdmap=1358656004}) 2024-08-18T21:13:05.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=56} crc {osdmap=3503137035}) 2024-08-18T21:13:05.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:05.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=55} crc {osdmap=1358656004}) 2024-08-18T21:13:05.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=54} crc {osdmap=870721727}) 2024-08-18T21:13:05.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:13:05.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=55} crc {osdmap=1358656004}) 2024-08-18T21:13:05.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:13:05.743+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=55} crc {osdmap=2156972994}) 2024-08-18T21:13:05.767 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:05.768 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:13:05.768 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:13:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.895+0000 7fbd5fdcb640 10 monclient: get_monmap_and_config 2024-08-18T21:13:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.895+0000 7fbd5fdcb640 10 monclient: build_initial_monmap 2024-08-18T21:13:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.895+0000 7fbd5fdcb640 10 monclient: monmap: 2024-08-18T21:13:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:05.900352+0000 2024-08-18T21:13:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:05.900352+0000 2024-08-18T21:13:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:05.898 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 1 Processor -- start 2024-08-18T21:13:05.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 1 -- start start 2024-08-18T21:13:05.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 10 monclient: init 2024-08-18T21:13:05.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:05.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 10 monclient: _add_conns ranks=[7,3,2,4,0,9,5,1,6,10,8] 2024-08-18T21:13:05.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbd58068700 0x7fbd58073530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 10 monclient(hunting): picked mon.noname-i con 0x7fbd58068700 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:05.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58068ae0 0x7fbd58068f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 10 monclient(hunting): picked mon.noname-g con 0x7fbd58068ae0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbd58139820 0x7fbd58139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 10 monclient(hunting): picked mon.noname-b con 0x7fbd58139820 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fbd580a1af0 con 0x7fbd58139820 2024-08-18T21:13:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbd5809efb0 con 0x7fbd58068ae0 2024-08-18T21:13:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fbd5809de70 con 0x7fbd58068700 2024-08-18T21:13:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5fdcb640 10 monclient(hunting): authenticate will time out at 1552.913417s 2024-08-18T21:13:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbd58139820 0x7fbd58139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbd58139820 0x7fbd58139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:45526/0 (socket says 172.21.15.5:45526) 2024-08-18T21:13:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 1 -- 172.21.15.5:0/2846191857 learned_addr learned my addr 172.21.15.5:0/2846191857 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 10 monclient(hunting): get_auth_request con 0x7fbd58139820 auth_method 0 2024-08-18T21:13:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5d366640 1 --2- 172.21.15.5:0/2846191857 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58068ae0 0x7fbd58068f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 10 monclient(hunting): handle_auth_done global_id 114563 payload 274 2024-08-18T21:13:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5db67640 1 --2- 172.21.15.5:0/2846191857 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbd58068700 0x7fbd58073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 1 -- 172.21.15.5:0/2846191857 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbd58068700 msgr2=0x7fbd58073530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 1 --2- 172.21.15.5:0/2846191857 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbd58068700 0x7fbd58073530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 1 -- 172.21.15.5:0/2846191857 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58068ae0 msgr2=0x7fbd58068f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 1 --2- 172.21.15.5:0/2846191857 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58068ae0 0x7fbd58068f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 10 monclient: _finish_hunting 0 2024-08-18T21:13:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 1 monclient: found mon.noname-b 2024-08-18T21:13:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:13:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5e368640 1 -- 172.21.15.5:0/2846191857 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5809e150 con 0x7fbd58139820 2024-08-18T21:13:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5d366640 10 monclient: get_auth_request con 0x7fbd58068ae0 auth_method 0 2024-08-18T21:13:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.899+0000 7fbd5d366640 1 --2- 172.21.15.5:0/2846191857 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58068ae0 0x7fbd58068f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:13:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5e368640 1 -- 172.21.15.5:0/2846191857 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbd58139820 msgr2=0x7fbd58139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5e368640 1 --2- 172.21.15.5:0/2846191857 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbd58139820 0x7fbd58139ca0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009e80 tx=0x7fbd5001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47c83f5fb8518055 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5cb65640 1 -- 172.21.15.5:0/2846191857 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd500091b0 con 0x7fbd58139820 2024-08-18T21:13:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5cb65640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5cb65640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:13:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5cb65640 10 monclient: dump: 2024-08-18T21:13:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.909 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5cb65640 10 monclient: _finish_auth 0 2024-08-18T21:13:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5cb65640 10 monclient: _check_auth_tickets 2024-08-18T21:13:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5cb65640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5cb65640 1 -- 172.21.15.5:0/2846191857 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd500a5b30 con 0x7fbd58139820 2024-08-18T21:13:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5cb65640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5fdcb640 5 monclient: authenticate success, global_id 114563 2024-08-18T21:13:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5cb65640 1 -- 172.21.15.5:0/2846191857 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd500a5ce0 con 0x7fbd58139820 2024-08-18T21:13:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5fdcb640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5fdcb640 4 set_mon_vals no callback set 2024-08-18T21:13:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5cb65640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5cb65640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5cb65640 10 monclient: dump: 2024-08-18T21:13:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.910 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.911 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5fdcb640 10 monclient: shutdown 2024-08-18T21:13:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5fdcb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5fdcb640 1 -- 172.21.15.5:0/2846191857 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbd58139820 msgr2=0x7fbd58139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5fdcb640 1 --2- 172.21.15.5:0/2846191857 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbd58139820 0x7fbd58139ca0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009e80 tx=0x7fbd5001c8e0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5fdcb640 1 -- 172.21.15.5:0/2846191857 shutdown_connections 2024-08-18T21:13:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5fdcb640 1 --2- 172.21.15.5:0/2846191857 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbd58139820 0x7fbd58139ca0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5fdcb640 1 --2- 172.21.15.5:0/2846191857 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58068ae0 0x7fbd58068f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5fdcb640 1 --2- 172.21.15.5:0/2846191857 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbd58068700 0x7fbd58073530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5fdcb640 1 -- 172.21.15.5:0/2846191857 >> 172.21.15.5:0/2846191857 conn(0x7fbd580a8020 msgr2=0x7fbd580a8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:05.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5fdcb640 1 -- 172.21.15.5:0/2846191857 shutdown_connections 2024-08-18T21:13:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5fdcb640 1 -- 172.21.15.5:0/2846191857 wait complete. 2024-08-18T21:13:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5fdcb640 10 monclient: build_initial_monmap 2024-08-18T21:13:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.903+0000 7fbd5fdcb640 10 monclient: monmap: 2024-08-18T21:13:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:05.913 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 1 Processor -- start 2024-08-18T21:13:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 1 -- start start 2024-08-18T21:13:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 10 monclient: init 2024-08-18T21:13:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 10 monclient: _add_conns ranks=[2,8,7,5,3,4,0,1,6] 2024-08-18T21:13:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbd58068700 0x7fbd58122b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 10 monclient(hunting): picked mon.noname-b con 0x7fbd58068700 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:05.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbd58068ae0 0x7fbd58120a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 10 monclient(hunting): picked mon.noname-e con 0x7fbd58068ae0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:05.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbd58139820 0x7fbd581389d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 10 monclient(hunting): picked mon.noname-i con 0x7fbd58139820 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:05.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fbd580695e0 con 0x7fbd58068700 2024-08-18T21:13:05.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fbd58069460 con 0x7fbd58139820 2024-08-18T21:13:05.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fbd58143530 con 0x7fbd58068ae0 2024-08-18T21:13:05.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:05.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 10 monclient(hunting): authenticate will time out at 1552.920739s 2024-08-18T21:13:05.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5db67640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbd58068700 0x7fbd58122b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbd58068ae0 0x7fbd58120a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5db67640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbd58068700 0x7fbd58122b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:45538/0 (socket says 172.21.15.5:45538) 2024-08-18T21:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5db67640 1 -- 172.21.15.5:0/1821340332 learned_addr learned my addr 172.21.15.5:0/1821340332 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5db67640 10 monclient(hunting): get_auth_request con 0x7fbd58068700 auth_method 0 2024-08-18T21:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5db67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5db67640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5db67640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 10 monclient(hunting): get_auth_request con 0x7fbd58068ae0 auth_method 0 2024-08-18T21:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5db67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5db67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5db67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5e368640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbd58139820 0x7fbd581389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5e368640 10 monclient(hunting): get_auth_request con 0x7fbd58139820 auth_method 0 2024-08-18T21:13:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5e368640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5e368640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5e368640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 10 monclient(hunting): handle_auth_done global_id 114740 payload 824 2024-08-18T21:13:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 1 -- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbd58139820 msgr2=0x7fbd581389d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbd58139820 0x7fbd581389d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 1 -- 172.21.15.5:0/1821340332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbd58068700 msgr2=0x7fbd58122b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbd58068700 0x7fbd58122b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 10 monclient: _finish_hunting 0 2024-08-18T21:13:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 1 monclient: found mon.noname-e 2024-08-18T21:13:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:13:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 1 -- 172.21.15.5:0/1821340332 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd580a8400 con 0x7fbd58068ae0 2024-08-18T21:13:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5db67640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbd58068700 0x7fbd58122b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:05.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5e368640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fbd58139820 0x7fbd581389d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:13:05.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 1 -- 172.21.15.5:0/1821340332 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbd58068ae0 msgr2=0x7fbd58120a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5d366640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbd58068ae0 0x7fbd58120a60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbd580a8930 tx=0x7fbd5400cc50 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd4e7fc640 1 -- 172.21.15.5:0/1821340332 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd540044a0 con 0x7fbd58068ae0 2024-08-18T21:13:05.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd4e7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:13:05.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd4e7fc640 10 monclient: dump: 2024-08-18T21:13:05.921 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.921 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.921 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.921 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.922 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd4e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:13:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd4e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:13:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd4e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd4e7fc640 1 -- 172.21.15.5:0/1821340332 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd54007830 con 0x7fbd58068ae0 2024-08-18T21:13:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd4e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd4e7fc640 1 -- 172.21.15.5:0/1821340332 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd54007e50 con 0x7fbd58068ae0 2024-08-18T21:13:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd4e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd4e7fc640 10 monclient: dump: 2024-08-18T21:13:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd4ffff640 4 set_mon_vals no callback set 2024-08-18T21:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 5 monclient: authenticate success, global_id 114740 2024-08-18T21:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 10 monclient: _renew_subs 2024-08-18T21:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 1 -- 172.21.15.5:0/1821340332 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd58124370 con 0x7fbd58068ae0 2024-08-18T21:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 10 monclient: _renew_subs 2024-08-18T21:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.907+0000 7fbd5fdcb640 1 -- 172.21.15.5:0/1821340332 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd58123ad0 con 0x7fbd58068ae0 2024-08-18T21:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd5fdcb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd5fdcb640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58123d10 0x7fbd581d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd5fdcb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd5fdcb640 1 -- 172.21.15.5:0/1821340332 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbd58051140 con 0x7fbd58123d10 2024-08-18T21:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd5db67640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58123d10 0x7fbd581d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd5db67640 10 monclient: get_auth_request con 0x7fbd58123d10 auth_method 0 2024-08-18T21:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd5db67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd5db67640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd5db67640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd5db67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd5db67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd5db67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd4e7fc640 1 -- 172.21.15.5:0/1821340332 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fbd540079e0 con 0x7fbd58068ae0 2024-08-18T21:13:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd4e7fc640 1 --2- 172.21.15.5:0/1821340332 >> v2:172.21.15.157:6812/631023601 conn(0x7fbd3c03bf60 0x7fbd3c03e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd4e7fc640 1 -- 172.21.15.5:0/1821340332 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(266..266 src has 22..266) ==== 3898+0+0 (secure 0 0 0) 0x7fbd5404e610 con 0x7fbd58068ae0 2024-08-18T21:13:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd5db67640 10 monclient(hunting): handle_auth_done global_id 124194 payload 824 2024-08-18T21:13:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd5db67640 1 -- 172.21.15.5:0/1821340332 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd58068f20 con 0x7fbd58123d10 2024-08-18T21:13:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd5e368640 1 --2- 172.21.15.5:0/1821340332 >> v2:172.21.15.157:6812/631023601 conn(0x7fbd3c03bf60 0x7fbd3c03e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.911+0000 7fbd5e368640 10 monclient: get_auth_request con 0x7fbd3c03bf60 auth_method 0 2024-08-18T21:13:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.915+0000 7fbd5db67640 1 -- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58123d10 msgr2=0x7fbd581d1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.915+0000 7fbd5db67640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58123d10 0x7fbd581d1df0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800fcc0 tx=0x7fbd4800d590 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.915+0000 7fbd4e7fc640 1 -- 172.21.15.5:0/1821340332 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd48013ac0 con 0x7fbd58123d10 2024-08-18T21:13:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.915+0000 7fbd4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.915+0000 7fbd4e7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:13:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.915+0000 7fbd4e7fc640 10 monclient: dump: 2024-08-18T21:13:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.928 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.915+0000 7fbd5e368640 1 --2- 172.21.15.5:0/1821340332 >> v2:172.21.15.157:6812/631023601 conn(0x7fbd3c03bf60 0x7fbd3c03e420 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fbd500ab000 tx=0x7fbd500a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.915+0000 7fbd4e7fc640 1 -- 172.21.15.5:0/1821340332 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbd48013650 con 0x7fbd58123d10 2024-08-18T21:13:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.915+0000 7fbd4e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.915+0000 7fbd4e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.915+0000 7fbd4e7fc640 1 -- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58123d10 msgr2=0x7fbd581d1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.915+0000 7fbd4e7fc640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58123d10 0x7fbd581d1df0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800fcc0 tx=0x7fbd4800d590 comp rx=0 tx=0).stop 2024-08-18T21:13:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.915+0000 7fbd4e7fc640 1 -- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58123d10 msgr2=0x7fbd581d1df0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.915+0000 7fbd4e7fc640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58123d10 0x7fbd581d1df0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800fcc0 tx=0x7fbd4800d590 comp rx=0 tx=0).stop 2024-08-18T21:13:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.919+0000 7fbd5fdcb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.919+0000 7fbd5fdcb640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58138f10 0x7fbd5802d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.919+0000 7fbd5fdcb640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.919+0000 7fbd5fdcb640 1 -- 172.21.15.5:0/1821340332 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbd5813e180 con 0x7fbd58138f10 2024-08-18T21:13:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.919+0000 7fbd5db67640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58138f10 0x7fbd5802d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.923+0000 7fbd5db67640 10 monclient: get_auth_request con 0x7fbd58138f10 auth_method 0 2024-08-18T21:13:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.923+0000 7fbd5db67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.923+0000 7fbd5db67640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.923+0000 7fbd5db67640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.923+0000 7fbd5db67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.923+0000 7fbd5db67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.923+0000 7fbd5db67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.923+0000 7fbd5db67640 10 monclient(hunting): handle_auth_done global_id 124203 payload 824 2024-08-18T21:13:05.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.923+0000 7fbd5db67640 1 -- 172.21.15.5:0/1821340332 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbd5806d150 con 0x7fbd58138f10 2024-08-18T21:13:05.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.923+0000 7fbd5db67640 1 -- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58138f10 msgr2=0x7fbd5802d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:05.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.923+0000 7fbd5db67640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58138f10 0x7fbd5802d1d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800fcc0 tx=0x7fbd48004740 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.923+0000 7fbd4e7fc640 1 -- 172.21.15.5:0/1821340332 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd48004470 con 0x7fbd58138f10 2024-08-18T21:13:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.923+0000 7fbd4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.923+0000 7fbd4e7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:13:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.923+0000 7fbd4e7fc640 10 monclient: dump: 2024-08-18T21:13:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:05.932 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd4e7fc640 1 -- 172.21.15.5:0/1821340332 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7fbd48004470 con 0x7fbd58138f10 2024-08-18T21:13:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd4e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd4e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd4e7fc640 1 -- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58138f10 msgr2=0x7fbd5802d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd4e7fc640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58138f10 0x7fbd5802d1d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800fcc0 tx=0x7fbd48004740 comp rx=0 tx=0).stop 2024-08-18T21:13:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd4e7fc640 1 -- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58138f10 msgr2=0x7fbd5802d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd4e7fc640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58138f10 0x7fbd5802d1d0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800fcc0 tx=0x7fbd48004740 comp rx=0 tx=0).stop 2024-08-18T21:13:05.933 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:05.933 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:05.933 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:05.933 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:05.933 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:05.933 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 32907, 2024-08-18T21:13:05.933 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:05.933 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:05.933 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:05.933 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:05.934 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:05.934 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:05.934 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:05.934 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:05.934 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:05.934 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:05.934 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.934 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:13:05.934 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:05.934 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:05.934 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:05.934 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:05.934 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:05.935 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:05.935 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:05.935 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:05.935 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:05.935 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:05.935 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:05.935 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:05.935 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:05.935 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:05.935 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.935 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:05.935 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:05.935 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:05.936 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:05.936 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:05.936 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:05.936 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:05.936 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:05.936 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:05.936 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:05.936 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:05.936 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:05.936 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:05.936 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.936 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:05.937 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:05.937 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:05.937 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:05.937 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:05.937 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:05.937 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:05.937 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:05.937 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:05.937 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:05.937 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:05.937 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:05.937 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:05.937 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:05.937 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:05.938 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:05.938 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:05.938 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:05.938 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:05.938 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:05.938 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:05.938 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:05.938 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:05.938 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:05.938 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:05.938 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:05.938 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:05.938 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:05.939 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.939 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:05.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.939 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:05.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.939 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:05.939 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:05.939 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.939 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.939 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.939 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:05.939 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.940 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.940 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:05.940 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.940 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.940 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.940 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:05.940 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:05.940 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.940 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.940 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.941 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:05.941 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:05.941 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.941 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.941 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.941 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:05.941 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.941 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.941 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:05.942 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.942 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.942 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.942 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:05.942 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:05.942 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.942 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.942 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.942 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:05.942 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:05.942 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:05.943 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:05.943 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.943 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.943 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.943 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:05.944 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:05.944 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.944 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.944 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.944 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:05.944 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:05.944 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.944 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.944 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.944 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:05.945 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.945 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:05.945 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.945 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.945 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.945 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:05.945 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:05.945 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.945 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.945 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.946 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:05.946 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:05.946 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.946 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.946 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:05.946 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.947 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:05.947 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.947 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.947 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.947 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:05.947 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:05.947 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.947 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.947 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.947 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:05.947 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:05.948 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.948 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.948 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.948 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:05.948 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.948 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.948 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:05.948 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.948 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.948 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.949 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:05.949 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:05.949 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.949 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.949 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.949 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:05.949 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:05.949 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.949 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.949 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.949 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:05.950 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.950 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.950 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.950 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:05.950 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.950 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.950 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.950 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:05.950 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:05.950 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.950 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.950 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.951 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:05.951 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:05.951 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.951 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.951 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.951 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:05.951 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.951 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.952 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:05.952 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.952 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.952 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.952 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:05.952 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:05.952 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.952 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.952 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.952 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.952 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:05.952 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:05.953 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:05.953 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:05.953 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.953 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:05.953 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:05.953 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.953 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.953 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:05.953 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:05.953 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:05.953 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.953 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.954 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:05.954 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:05.954 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:05.954 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:05.954 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:05.954 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.954 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.954 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:05.954 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:05.954 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.954 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:05.954 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:05.955 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:05.955 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.955 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.955 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:13:05.955 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.955 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:05.955 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:05.955 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:05.955 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.955 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:05.955 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:05.955 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:05.955 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:05.955 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:05.956 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:05.956 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:05.956 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:05.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:05.956 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:05.956 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:05.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd5fdcb640 1 -- 172.21.15.5:0/1821340332 >> v2:172.21.15.157:6812/631023601 conn(0x7fbd3c03bf60 msgr2=0x7fbd3c03e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd5fdcb640 1 --2- 172.21.15.5:0/1821340332 >> v2:172.21.15.157:6812/631023601 conn(0x7fbd3c03bf60 0x7fbd3c03e420 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fbd500ab000 tx=0x7fbd500a7070 comp rx=0 tx=0).stop 2024-08-18T21:13:05.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd5fdcb640 10 monclient: shutdown 2024-08-18T21:13:05.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd5fdcb640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:05.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd5fdcb640 1 -- 172.21.15.5:0/1821340332 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbd58068ae0 msgr2=0x7fbd58120a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:05.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd5fdcb640 1 --2- 172.21.15.5:0/1821340332 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbd58068ae0 0x7fbd58120a60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbd580a8930 tx=0x7fbd5400cc50 comp rx=0 tx=0).stop 2024-08-18T21:13:05.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd5e368640 1 -- 172.21.15.5:0/1821340332 reap_dead start 2024-08-18T21:13:05.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd5e368640 1 -- 172.21.15.5:0/1821340332 reap_dead start 2024-08-18T21:13:05.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd5fdcb640 1 -- 172.21.15.5:0/1821340332 shutdown_connections 2024-08-18T21:13:05.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd5fdcb640 1 -- 172.21.15.5:0/1821340332 >> 172.21.15.5:0/1821340332 conn(0x7fbd580a8020 msgr2=0x7fbd5809fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:05.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd5fdcb640 1 -- 172.21.15.5:0/1821340332 shutdown_connections 2024-08-18T21:13:05.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:05.927+0000 7fbd5fdcb640 1 -- 172.21.15.5:0/1821340332 wait complete. 2024-08-18T21:13:05.958 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:05.959 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:13:05.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:13:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 10 monclient: get_monmap_and_config 2024-08-18T21:13:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 10 monclient: build_initial_monmap 2024-08-18T21:13:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 10 monclient: monmap: 2024-08-18T21:13:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:06.080939+0000 2024-08-18T21:13:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:06.080939+0000 2024-08-18T21:13:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:06.079 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 1 Processor -- start 2024-08-18T21:13:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 1 -- start start 2024-08-18T21:13:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 10 monclient: init 2024-08-18T21:13:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 10 monclient: _add_conns ranks=[5,3,4,2,8,9,10,1,0,7,6] 2024-08-18T21:13:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d80a4240 0x7fc9d81333a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 10 monclient(hunting): picked mon.noname-h con 0x7fc9d80a4240 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9d80a4620 0x7fc9d8070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 10 monclient(hunting): picked mon.noname-g con 0x7fc9d80a4620 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc9d80a4a40 0x7fc9d8071380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 10 monclient(hunting): picked mon.noname-c con 0x7fc9d80a4a40 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:13:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d8072a70 con 0x7fc9d80a4620 2024-08-18T21:13:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fc9d8073b10 con 0x7fc9d80a4a40 2024-08-18T21:13:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fc9d8073df0 con 0x7fc9d80a4240 2024-08-18T21:13:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dfbaf640 10 monclient(hunting): authenticate will time out at 1553.094114s 2024-08-18T21:13:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc9d80a4a40 0x7fc9d8071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc9d80a4a40 0x7fc9d8071380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:38996/0 (socket says 172.21.15.5:38996) 2024-08-18T21:13:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 1 -- 172.21.15.5:0/4054424740 learned_addr learned my addr 172.21.15.5:0/4054424740 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 10 monclient(hunting): get_auth_request con 0x7fc9d80a4a40 auth_method 0 2024-08-18T21:13:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dd14a640 1 --2- 172.21.15.5:0/4054424740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9d80a4620 0x7fc9d8070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dd94b640 1 --2- 172.21.15.5:0/4054424740 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d80a4240 0x7fc9d81333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dd14a640 10 monclient(hunting): get_auth_request con 0x7fc9d80a4620 auth_method 0 2024-08-18T21:13:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dd14a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dd14a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dd14a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dd94b640 10 monclient(hunting): get_auth_request con 0x7fc9d80a4240 auth_method 0 2024-08-18T21:13:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dd94b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dd94b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dd94b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 10 monclient(hunting): handle_auth_done global_id 114502 payload 274 2024-08-18T21:13:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 1 -- 172.21.15.5:0/4054424740 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d80a4240 msgr2=0x7fc9d81333a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 1 --2- 172.21.15.5:0/4054424740 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d80a4240 0x7fc9d81333a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 1 -- 172.21.15.5:0/4054424740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9d80a4620 msgr2=0x7fc9d8070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 1 --2- 172.21.15.5:0/4054424740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9d80a4620 0x7fc9d8070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 10 monclient: _finish_hunting 0 2024-08-18T21:13:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 1 monclient: found mon.noname-c 2024-08-18T21:13:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:13:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9de14c640 1 -- 172.21.15.5:0/4054424740 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d8072cb0 con 0x7fc9d80a4a40 2024-08-18T21:13:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.079+0000 7fc9dd14a640 1 --2- 172.21.15.5:0/4054424740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9d80a4620 0x7fc9d8070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:13:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9de14c640 1 -- 172.21.15.5:0/4054424740 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc9d80a4a40 msgr2=0x7fc9d8071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9de14c640 1 --2- 172.21.15.5:0/4054424740 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc9d80a4a40 0x7fc9d8071380 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0009e80 tx=0x7fc9d001c910 comp rx=0 tx=0).ready entity=mon.4 client_cookie=92a2405669d53e75 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dc949640 1 -- 172.21.15.5:0/4054424740 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9d00090d0 con 0x7fc9d80a4a40 2024-08-18T21:13:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dc949640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dc949640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:13:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dc949640 10 monclient: dump: 2024-08-18T21:13:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:06.091 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:06.091 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:06.091 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:06.091 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:06.091 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:06.091 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:06.091 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:06.091 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:06.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dc949640 10 monclient: _finish_auth 0 2024-08-18T21:13:06.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dc949640 10 monclient: _check_auth_tickets 2024-08-18T21:13:06.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dc949640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:06.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dc949640 1 -- 172.21.15.5:0/4054424740 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d00a5a70 con 0x7fc9d80a4a40 2024-08-18T21:13:06.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dc949640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dc949640 1 -- 172.21.15.5:0/4054424740 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9d00a5c20 con 0x7fc9d80a4a40 2024-08-18T21:13:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dfbaf640 5 monclient: authenticate success, global_id 114502 2024-08-18T21:13:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dfbaf640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dfbaf640 4 set_mon_vals no callback set 2024-08-18T21:13:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dc949640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dc949640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:13:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dc949640 10 monclient: dump: 2024-08-18T21:13:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:06.093 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dfbaf640 10 monclient: shutdown 2024-08-18T21:13:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dfbaf640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dfbaf640 1 -- 172.21.15.5:0/4054424740 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc9d80a4a40 msgr2=0x7fc9d8071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dfbaf640 1 --2- 172.21.15.5:0/4054424740 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc9d80a4a40 0x7fc9d8071380 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0009e80 tx=0x7fc9d001c910 comp rx=0 tx=0).stop 2024-08-18T21:13:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dfbaf640 1 -- 172.21.15.5:0/4054424740 shutdown_connections 2024-08-18T21:13:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dfbaf640 1 --2- 172.21.15.5:0/4054424740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9d80a4620 0x7fc9d8070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dfbaf640 1 --2- 172.21.15.5:0/4054424740 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fc9d80a4a40 0x7fc9d8071380 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dfbaf640 1 --2- 172.21.15.5:0/4054424740 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d80a4240 0x7fc9d81333a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dfbaf640 1 -- 172.21.15.5:0/4054424740 >> 172.21.15.5:0/4054424740 conn(0x7fc9d80a8a90 msgr2=0x7fc9d80a8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dfbaf640 1 -- 172.21.15.5:0/4054424740 shutdown_connections 2024-08-18T21:13:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.083+0000 7fc9dfbaf640 1 -- 172.21.15.5:0/4054424740 wait complete. 2024-08-18T21:13:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 10 monclient: build_initial_monmap 2024-08-18T21:13:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 10 monclient: monmap: 2024-08-18T21:13:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:06.095 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:06.095 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:06.095 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:06.095 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:06.095 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:06.095 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:06.095 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:06.095 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:06.095 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:06.095 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:06.095 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:06.095 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:06.095 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 1 Processor -- start 2024-08-18T21:13:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 1 -- start start 2024-08-18T21:13:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 10 monclient: init 2024-08-18T21:13:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 10 monclient: _add_conns ranks=[7,8,3,0,4,2,1,5,6] 2024-08-18T21:13:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc9d80a4240 0x7fc9d81cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 10 monclient(hunting): picked mon.noname-i con 0x7fc9d80a4240 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc9d80a4620 0x7fc9d81320f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 10 monclient(hunting): picked mon.noname-e con 0x7fc9d80a4620 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9d80a4a40 0x7fc9d8132630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 10 monclient(hunting): picked mon.noname-g con 0x7fc9d80a4a40 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d81402b0 con 0x7fc9d80a4a40 2024-08-18T21:13:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fc9d8140130 con 0x7fc9d80a4240 2024-08-18T21:13:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fc9d8140430 con 0x7fc9d80a4620 2024-08-18T21:13:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dfbaf640 10 monclient(hunting): authenticate will time out at 1553.101634s 2024-08-18T21:13:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc9d80a4620 0x7fc9d81320f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc9d80a4620 0x7fc9d81320f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:39622/0 (socket says 172.21.15.5:39622) 2024-08-18T21:13:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 1 -- 172.21.15.5:0/4210769907 learned_addr learned my addr 172.21.15.5:0/4210769907 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 10 monclient(hunting): get_auth_request con 0x7fc9d80a4620 auth_method 0 2024-08-18T21:13:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9de14c640 1 --2- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9d80a4a40 0x7fc9d8132630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd94b640 1 --2- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc9d80a4240 0x7fc9d81cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9de14c640 10 monclient(hunting): get_auth_request con 0x7fc9d80a4a40 auth_method 0 2024-08-18T21:13:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9de14c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9de14c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9de14c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd94b640 10 monclient(hunting): get_auth_request con 0x7fc9d80a4240 auth_method 0 2024-08-18T21:13:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd94b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd94b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd94b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 10 monclient(hunting): handle_auth_done global_id 114749 payload 824 2024-08-18T21:13:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 1 -- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc9d80a4240 msgr2=0x7fc9d81cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 1 --2- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc9d80a4240 0x7fc9d81cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 1 -- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9d80a4a40 msgr2=0x7fc9d8132630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 1 --2- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9d80a4a40 0x7fc9d8132630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 10 monclient: _finish_hunting 0 2024-08-18T21:13:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 1 monclient: found mon.noname-e 2024-08-18T21:13:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:13:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.087+0000 7fc9dd14a640 1 -- 172.21.15.5:0/4210769907 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d80a6490 con 0x7fc9d80a4620 2024-08-18T21:13:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dd14a640 1 -- 172.21.15.5:0/4210769907 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc9d80a4620 msgr2=0x7fc9d81320f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dd14a640 1 --2- 172.21.15.5:0/4210769907 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc9d80a4620 0x7fc9d81320f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00e730 tx=0x7fc9cc00ebf0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d67fc640 1 -- 172.21.15.5:0/4210769907 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9cc017070 con 0x7fc9d80a4620 2024-08-18T21:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d67fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d67fc640 10 monclient: dump: 2024-08-18T21:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:06.101 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:06.101 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:06.101 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:06.101 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:06.101 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:06.101 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:06.101 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:06.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d67fc640 10 monclient: _finish_auth 0 2024-08-18T21:13:06.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d67fc640 10 monclient: _check_auth_tickets 2024-08-18T21:13:06.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:06.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d67fc640 1 -- 172.21.15.5:0/4210769907 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9cc00ee40 con 0x7fc9d80a4620 2024-08-18T21:13:06.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dfbaf640 5 monclient: authenticate success, global_id 114749 2024-08-18T21:13:06.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dfbaf640 10 monclient: _renew_subs 2024-08-18T21:13:06.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dfbaf640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:06.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dfbaf640 1 -- 172.21.15.5:0/4210769907 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d813ac70 con 0x7fc9d80a4620 2024-08-18T21:13:06.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d67fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:06.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d67fc640 1 -- 172.21.15.5:0/4210769907 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9cc00f040 con 0x7fc9d80a4620 2024-08-18T21:13:06.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:06.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:06.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d67fc640 10 monclient: dump: 2024-08-18T21:13:06.102 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:06.102 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:06.102 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.102 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.102 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:06.102 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d7fff640 4 set_mon_vals no callback set 2024-08-18T21:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dfbaf640 10 monclient: _renew_subs 2024-08-18T21:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dfbaf640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:06.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dfbaf640 1 -- 172.21.15.5:0/4210769907 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d813b7d0 con 0x7fc9d80a4620 2024-08-18T21:13:06.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dfbaf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:06.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dfbaf640 1 --2- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d81391d0 0x7fc9d81395b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dfbaf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:06.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dfbaf640 1 -- 172.21.15.5:0/4210769907 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fc9d8051140 con 0x7fc9d81391d0 2024-08-18T21:13:06.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d67fc640 1 -- 172.21.15.5:0/4210769907 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fc9cc01a070 con 0x7fc9d80a4620 2024-08-18T21:13:06.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d67fc640 1 --2- 172.21.15.5:0/4210769907 >> v2:172.21.15.157:6812/631023601 conn(0x7fc9c403bdf0 0x7fc9c403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dd94b640 1 --2- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d81391d0 0x7fc9d81395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9d67fc640 1 -- 172.21.15.5:0/4210769907 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(266..266 src has 22..266) ==== 3898+0+0 (secure 0 0 0) 0x7fc9cc04e1c0 con 0x7fc9d80a4620 2024-08-18T21:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dd94b640 10 monclient: get_auth_request con 0x7fc9d81391d0 auth_method 0 2024-08-18T21:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dd94b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dd94b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dd94b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dd94b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dd94b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dd94b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9de14c640 1 --2- 172.21.15.5:0/4210769907 >> v2:172.21.15.157:6812/631023601 conn(0x7fc9c403bdf0 0x7fc9c403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9de14c640 10 monclient: get_auth_request con 0x7fc9c403bdf0 auth_method 0 2024-08-18T21:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dd94b640 10 monclient(hunting): handle_auth_done global_id 95207 payload 824 2024-08-18T21:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.091+0000 7fc9dd94b640 1 -- 172.21.15.5:0/4210769907 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9d80a6980 con 0x7fc9d81391d0 2024-08-18T21:13:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.095+0000 7fc9dd94b640 1 -- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d81391d0 msgr2=0x7fc9d81395b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.095+0000 7fc9dd94b640 1 --2- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d81391d0 0x7fc9d81395b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800f510 tx=0x7fc9c800f9d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.095+0000 7fc9de14c640 1 --2- 172.21.15.5:0/4210769907 >> v2:172.21.15.157:6812/631023601 conn(0x7fc9c403bdf0 0x7fc9c403e2b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00ab000 tx=0x7fc9d00a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.095+0000 7fc9d67fc640 1 -- 172.21.15.5:0/4210769907 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9c8019030 con 0x7fc9d81391d0 2024-08-18T21:13:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.095+0000 7fc9d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.095+0000 7fc9d67fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:13:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.095+0000 7fc9d67fc640 10 monclient: dump: 2024-08-18T21:13:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.095+0000 7fc9d67fc640 1 -- 172.21.15.5:0/4210769907 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc9c8014880 con 0x7fc9d81391d0 2024-08-18T21:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.095+0000 7fc9d67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.095+0000 7fc9d67fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.095+0000 7fc9d67fc640 1 -- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d81391d0 msgr2=0x7fc9d81395b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.095+0000 7fc9d67fc640 1 --2- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d81391d0 0x7fc9d81395b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800f510 tx=0x7fc9c800f9d0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.095+0000 7fc9d67fc640 1 -- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d81391d0 msgr2=0x7fc9d81395b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.095+0000 7fc9d67fc640 1 --2- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d81391d0 0x7fc9d81395b0 secure :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800f510 tx=0x7fc9c800f9d0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.099+0000 7fc9dfbaf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.099+0000 7fc9dfbaf640 1 --2- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d8139af0 0x7fc9d8133f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.099+0000 7fc9dfbaf640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.099+0000 7fc9dfbaf640 1 -- 172.21.15.5:0/4210769907 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fc9d8133650 con 0x7fc9d8139af0 2024-08-18T21:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.103+0000 7fc9dd94b640 1 --2- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d8139af0 0x7fc9d8133f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.103+0000 7fc9dd94b640 10 monclient: get_auth_request con 0x7fc9d8139af0 auth_method 0 2024-08-18T21:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.103+0000 7fc9dd94b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.103+0000 7fc9dd94b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.103+0000 7fc9dd94b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.103+0000 7fc9dd94b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.103+0000 7fc9dd94b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.103+0000 7fc9dd94b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.103+0000 7fc9dd94b640 10 monclient(hunting): handle_auth_done global_id 95216 payload 824 2024-08-18T21:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.103+0000 7fc9dd94b640 1 -- 172.21.15.5:0/4210769907 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc9d81333a0 con 0x7fc9d8139af0 2024-08-18T21:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.103+0000 7fc9dd94b640 1 -- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d8139af0 msgr2=0x7fc9d8133f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.103+0000 7fc9dd94b640 1 --2- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d8139af0 0x7fc9d8133f80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8008010 tx=0x7fc9c80046d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.103+0000 7fc9d67fc640 1 -- 172.21.15.5:0/4210769907 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9c8003dd0 con 0x7fc9d8139af0 2024-08-18T21:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.103+0000 7fc9d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.103+0000 7fc9d67fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.103+0000 7fc9d67fc640 10 monclient: dump: 2024-08-18T21:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:06.114 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9d67fc640 1 -- 172.21.15.5:0/4210769907 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7fc9c8003dd0 con 0x7fc9d8139af0 2024-08-18T21:13:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9d67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9d67fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9d67fc640 1 -- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d8139af0 msgr2=0x7fc9d8133f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9d67fc640 1 --2- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d8139af0 0x7fc9d8133f80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8008010 tx=0x7fc9c80046d0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9d67fc640 1 -- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d8139af0 msgr2=0x7fc9d8133f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9d67fc640 1 --2- 172.21.15.5:0/4210769907 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc9d8139af0 0x7fc9d8133f80 secure :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8008010 tx=0x7fc9c80046d0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.114 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:06.115 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:06.115 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:06.115 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:06.115 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:06.115 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 214140, 2024-08-18T21:13:06.115 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:06.115 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:06.115 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:06.115 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:06.115 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:06.115 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:06.115 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:06.115 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:06.116 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:06.116 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:06.116 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:06.116 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:13:06.116 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:06.116 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:06.116 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:06.116 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:06.116 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:06.116 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:06.116 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:06.116 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:06.116 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:06.116 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:06.117 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:06.117 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:06.117 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:06.117 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:06.117 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:06.117 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:06.117 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:06.117 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:06.117 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:06.117 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:06.117 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:06.117 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:06.117 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:06.117 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:06.118 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:06.118 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:06.118 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:06.118 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:06.118 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.118 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:06.118 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:06.118 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:06.118 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:06.118 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:06.118 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:06.118 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:06.119 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:06.119 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:06.119 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:06.119 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:06.119 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:06.119 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:06.119 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:06.119 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:06.119 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:06.119 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:06.119 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:06.119 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:06.119 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:06.119 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:06.120 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:06.120 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:06.120 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:06.120 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:06.120 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:06.120 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:06.120 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:06.120 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:06.120 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:06.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.120 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:06.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.120 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:06.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:06.121 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.121 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.121 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.121 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:06.121 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.121 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.121 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:06.121 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.121 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.121 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.122 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:06.122 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:06.122 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.122 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.122 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.122 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:06.122 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:06.122 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.122 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.123 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:06.123 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.123 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.123 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:06.123 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.123 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.123 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.123 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:06.123 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:06.123 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.123 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.124 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.124 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:06.124 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:06.124 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.124 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.124 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.124 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:06.124 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.125 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:06.125 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.125 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.125 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.125 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:06.125 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:06.125 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.125 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.125 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.125 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:06.126 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:06.126 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.126 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.126 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.126 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:06.126 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.126 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.126 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:06.126 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.126 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.126 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.127 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:06.127 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:06.127 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.127 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.127 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.127 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:06.127 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:06.127 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.127 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.128 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.128 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:06.128 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.128 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.128 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:06.128 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.128 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.128 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.128 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:06.128 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:06.128 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.129 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.129 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.129 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:06.129 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:06.129 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.129 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.129 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.129 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:06.129 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.130 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.130 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:06.130 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.130 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.130 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.130 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:06.130 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:06.130 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.130 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.130 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.130 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:06.131 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:06.131 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.131 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.131 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.131 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:06.131 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.131 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.131 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:06.131 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.131 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.131 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.132 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:06.132 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:06.132 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.132 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.132 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.132 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:06.132 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:06.132 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.132 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.132 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.133 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:06.133 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.133 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.133 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:06.133 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.133 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.133 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.133 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:06.133 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:06.133 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.133 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.134 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.134 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:06.134 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:06.134 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.134 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.134 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.134 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:06.134 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.135 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.135 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:06.135 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.135 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.135 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.135 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:06.135 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:06.135 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.135 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.135 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.135 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.135 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.136 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:06.136 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:06.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.136 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:06.136 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:06.136 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:06.136 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.136 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:06.136 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:06.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.136 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:06.136 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:06.136 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:06.136 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.137 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.137 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:06.137 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9dfbaf640 1 -- 172.21.15.5:0/4210769907 >> v2:172.21.15.157:6812/631023601 conn(0x7fc9c403bdf0 msgr2=0x7fc9c403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9dfbaf640 1 --2- 172.21.15.5:0/4210769907 >> v2:172.21.15.157:6812/631023601 conn(0x7fc9c403bdf0 0x7fc9c403e2b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00ab000 tx=0x7fc9d00a7070 comp rx=0 tx=0).stop 2024-08-18T21:13:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9dfbaf640 10 monclient: shutdown 2024-08-18T21:13:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9dfbaf640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9dfbaf640 1 -- 172.21.15.5:0/4210769907 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc9d80a4620 msgr2=0x7fc9d81320f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9dfbaf640 1 --2- 172.21.15.5:0/4210769907 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc9d80a4620 0x7fc9d81320f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00e730 tx=0x7fc9cc00ebf0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9de14c640 1 -- 172.21.15.5:0/4210769907 reap_dead start 2024-08-18T21:13:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9de14c640 1 -- 172.21.15.5:0/4210769907 reap_dead start 2024-08-18T21:13:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9dfbaf640 1 -- 172.21.15.5:0/4210769907 shutdown_connections 2024-08-18T21:13:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9dfbaf640 1 -- 172.21.15.5:0/4210769907 >> 172.21.15.5:0/4210769907 conn(0x7fc9d80a8a90 msgr2=0x7fc9d80a3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9dfbaf640 1 -- 172.21.15.5:0/4210769907 shutdown_connections 2024-08-18T21:13:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.107+0000 7fc9dfbaf640 1 -- 172.21.15.5:0/4210769907 wait complete. 2024-08-18T21:13:06.139 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:06.139 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:13:06.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:13:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 10 monclient: get_monmap_and_config 2024-08-18T21:13:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 10 monclient: build_initial_monmap 2024-08-18T21:13:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 10 monclient: monmap: 2024-08-18T21:13:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:06.261465+0000 2024-08-18T21:13:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:06.261465+0000 2024-08-18T21:13:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:06.259 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:06.259 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:06.259 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:06.259 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:06.259 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:06.259 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:06.259 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:06.259 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:06.259 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:06.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 1 Processor -- start 2024-08-18T21:13:06.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 1 -- start start 2024-08-18T21:13:06.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 10 monclient: init 2024-08-18T21:13:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 10 monclient: _add_conns ranks=[3,5,8,4,7,0,6,10,2,1,9] 2024-08-18T21:13:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b5409b700 0x7f9b5409bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 10 monclient(hunting): picked mon.noname-g con 0x7f9b5409b700 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9b5409c3a0 0x7f9b5409c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 10 monclient(hunting): picked mon.noname-h con 0x7f9b5409c3a0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b5409ccc0 0x7f9b54140a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 10 monclient(hunting): picked mon.noname-e con 0x7f9b5409ccc0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9b540a81f0 con 0x7f9b5409b700 2024-08-18T21:13:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f9b5406ef20 con 0x7f9b5409c3a0 2024-08-18T21:13:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f9b540741c0 con 0x7f9b5409ccc0 2024-08-18T21:13:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b59281640 10 monclient(hunting): authenticate will time out at 1553.274587s 2024-08-18T21:13:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b5409ccc0 0x7f9b54140a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b5409ccc0 0x7f9b54140a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:39636/0 (socket says 172.21.15.5:39636) 2024-08-18T21:13:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 1 -- 172.21.15.5:0/2342726497 learned_addr learned my addr 172.21.15.5:0/2342726497 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 10 monclient(hunting): get_auth_request con 0x7f9b5409ccc0 auth_method 0 2024-08-18T21:13:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b52ffd640 1 --2- 172.21.15.5:0/2342726497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b5409b700 0x7f9b5409bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b4a7fc640 1 --2- 172.21.15.5:0/2342726497 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9b5409c3a0 0x7f9b5409c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 10 monclient(hunting): handle_auth_done global_id 114758 payload 274 2024-08-18T21:13:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 1 -- 172.21.15.5:0/2342726497 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9b5409c3a0 msgr2=0x7f9b5409c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 1 --2- 172.21.15.5:0/2342726497 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9b5409c3a0 0x7f9b5409c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 1 -- 172.21.15.5:0/2342726497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b5409b700 msgr2=0x7f9b5409bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 1 --2- 172.21.15.5:0/2342726497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b5409b700 0x7f9b5409bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 10 monclient: _finish_hunting 0 2024-08-18T21:13:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 1 monclient: found mon.noname-e 2024-08-18T21:13:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:06.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:13:06.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b537fe640 1 -- 172.21.15.5:0/2342726497 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b540a91f0 con 0x7f9b5409ccc0 2024-08-18T21:13:06.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b4a7fc640 10 monclient: get_auth_request con 0x7f9b5409c3a0 auth_method 0 2024-08-18T21:13:06.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b52ffd640 10 monclient: get_auth_request con 0x7f9b5409b700 auth_method 0 2024-08-18T21:13:06.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b4a7fc640 1 --2- 172.21.15.5:0/2342726497 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9b5409c3a0 0x7f9b5409c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:13:06.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.259+0000 7f9b52ffd640 1 --2- 172.21.15.5:0/2342726497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b5409b700 0x7f9b5409bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:13:06.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b537fe640 1 -- 172.21.15.5:0/2342726497 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b5409ccc0 msgr2=0x7f9b54140a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b537fe640 1 --2- 172.21.15.5:0/2342726497 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b5409ccc0 0x7f9b54140a60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009e80 tx=0x7f9b4c01c910 comp rx=0 tx=0).ready entity=mon.8 client_cookie=bf5c1ec17460b9e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b527fc640 1 -- 172.21.15.5:0/2342726497 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9b4c0091b0 con 0x7f9b5409ccc0 2024-08-18T21:13:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b527fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:13:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b527fc640 10 monclient: dump: 2024-08-18T21:13:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:06.271 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b527fc640 10 monclient: _finish_auth 0 2024-08-18T21:13:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b527fc640 10 monclient: _check_auth_tickets 2024-08-18T21:13:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b527fc640 1 -- 172.21.15.5:0/2342726497 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b4c0a6970 con 0x7f9b5409ccc0 2024-08-18T21:13:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b59281640 5 monclient: authenticate success, global_id 114758 2024-08-18T21:13:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b59281640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:13:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b527fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b59281640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b527fc640 1 -- 172.21.15.5:0/2342726497 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9b4c0af480 con 0x7f9b5409ccc0 2024-08-18T21:13:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b59281640 4 set_mon_vals no callback set 2024-08-18T21:13:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b527fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.263+0000 7f9b527fc640 10 monclient: dump: 2024-08-18T21:13:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.273 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:06.273 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:06.273 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:06.273 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:06.273 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:06.273 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:06.273 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:06.273 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:06.273 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:06.273 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:06.273 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:06.273 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:06.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 10 monclient: shutdown 2024-08-18T21:13:06.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:06.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 -- 172.21.15.5:0/2342726497 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b5409ccc0 msgr2=0x7f9b54140a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:06.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 --2- 172.21.15.5:0/2342726497 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b5409ccc0 0x7f9b54140a60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009e80 tx=0x7f9b4c01c910 comp rx=0 tx=0).stop 2024-08-18T21:13:06.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 -- 172.21.15.5:0/2342726497 shutdown_connections 2024-08-18T21:13:06.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 --2- 172.21.15.5:0/2342726497 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b5409ccc0 0x7f9b54140a60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 --2- 172.21.15.5:0/2342726497 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9b5409c3a0 0x7f9b5409c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 --2- 172.21.15.5:0/2342726497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b5409b700 0x7f9b5409bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 -- 172.21.15.5:0/2342726497 >> 172.21.15.5:0/2342726497 conn(0x7f9b540a4ea0 msgr2=0x7f9b540a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:06.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 -- 172.21.15.5:0/2342726497 shutdown_connections 2024-08-18T21:13:06.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 -- 172.21.15.5:0/2342726497 wait complete. 2024-08-18T21:13:06.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 10 monclient: build_initial_monmap 2024-08-18T21:13:06.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 10 monclient: monmap: 2024-08-18T21:13:06.275 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:06.275 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:06.275 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:06.275 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:06.275 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:06.275 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:06.275 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:06.275 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:06.275 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:06.275 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:06.275 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:06.275 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:06.275 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:06.276 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 Processor -- start 2024-08-18T21:13:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 -- start start 2024-08-18T21:13:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 10 monclient: init 2024-08-18T21:13:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 10 monclient: _add_conns ranks=[3,8,2,6,0,4,7,5,1] 2024-08-18T21:13:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b5409b700 0x7f9b5413ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 10 monclient(hunting): picked mon.noname-g con 0x7f9b5409b700 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b5409c3a0 0x7f9b5413f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 10 monclient(hunting): picked mon.noname-e con 0x7f9b5409c3a0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9b5409ccc0 0x7f9b5413fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 10 monclient(hunting): picked mon.noname-b con 0x7f9b5409ccc0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f9b5409d9e0 con 0x7f9b5409ccc0 2024-08-18T21:13:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9b540a5cb0 con 0x7f9b5409b700 2024-08-18T21:13:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f9b540990f0 con 0x7f9b5409c3a0 2024-08-18T21:13:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b59281640 10 monclient(hunting): authenticate will time out at 1553.281836s 2024-08-18T21:13:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9b5409ccc0 0x7f9b5413fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9b5409ccc0 0x7f9b5413fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:45548/0 (socket says 172.21.15.5:45548) 2024-08-18T21:13:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 1 -- 172.21.15.5:0/2676723930 learned_addr learned my addr 172.21.15.5:0/2676723930 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 10 monclient(hunting): get_auth_request con 0x7f9b5409ccc0 auth_method 0 2024-08-18T21:13:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b4a7fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b5409c3a0 0x7f9b5413f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b4a7fc640 10 monclient(hunting): get_auth_request con 0x7f9b5409c3a0 auth_method 0 2024-08-18T21:13:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b4a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b4a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b4a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b52ffd640 1 --2- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b5409b700 0x7f9b5413ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b52ffd640 10 monclient(hunting): get_auth_request con 0x7f9b5409b700 auth_method 0 2024-08-18T21:13:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b52ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b52ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b52ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b4a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b4a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b4a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b52ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b52ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b52ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 10 monclient(hunting): handle_auth_done global_id 114581 payload 824 2024-08-18T21:13:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 1 -- 172.21.15.5:0/2676723930 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b5409c3a0 msgr2=0x7f9b5413f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 1 --2- 172.21.15.5:0/2676723930 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9b5409c3a0 0x7f9b5413f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 1 -- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b5409b700 msgr2=0x7f9b5413ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 1 --2- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b5409b700 0x7f9b5413ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 10 monclient: _finish_hunting 0 2024-08-18T21:13:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 1 monclient: found mon.noname-b 2024-08-18T21:13:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:13:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.267+0000 7f9b537fe640 1 -- 172.21.15.5:0/2676723930 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b54090d20 con 0x7f9b5409ccc0 2024-08-18T21:13:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b537fe640 1 -- 172.21.15.5:0/2676723930 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9b5409ccc0 msgr2=0x7f9b5413fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b537fe640 1 --2- 172.21.15.5:0/2676723930 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9b5409ccc0 0x7f9b5413fa00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009e80 tx=0x7f9b4c0196b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4bfff640 1 -- 172.21.15.5:0/2676723930 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9b4c0be070 con 0x7f9b5409ccc0 2024-08-18T21:13:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:13:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4bfff640 10 monclient: dump: 2024-08-18T21:13:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:06.282 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4bfff640 10 monclient: _finish_auth 0 2024-08-18T21:13:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4bfff640 10 monclient: _check_auth_tickets 2024-08-18T21:13:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4bfff640 1 -- 172.21.15.5:0/2676723930 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b4c003e10 con 0x7f9b5409ccc0 2024-08-18T21:13:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4bfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4bfff640 1 -- 172.21.15.5:0/2676723930 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9b4c0a6d30 con 0x7f9b5409ccc0 2024-08-18T21:13:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b59281640 5 monclient: authenticate success, global_id 114581 2024-08-18T21:13:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b59281640 10 monclient: _renew_subs 2024-08-18T21:13:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b59281640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b59281640 1 -- 172.21.15.5:0/2676723930 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b5408fae0 con 0x7f9b5409ccc0 2024-08-18T21:13:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b51ffb640 4 set_mon_vals no callback set 2024-08-18T21:13:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4bfff640 10 monclient: dump: 2024-08-18T21:13:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:06.284 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b59281640 10 monclient: _renew_subs 2024-08-18T21:13:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b59281640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b59281640 1 -- 172.21.15.5:0/2676723930 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b54091000 con 0x7f9b5409ccc0 2024-08-18T21:13:06.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b59281640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:06.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b59281640 1 --2- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9b541d18e0 0x7f9b541d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b59281640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:06.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b59281640 1 -- 172.21.15.5:0/2676723930 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f9b5409db60 con 0x7f9b541d18e0 2024-08-18T21:13:06.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4bfff640 1 -- 172.21.15.5:0/2676723930 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f9b4c0039a0 con 0x7f9b5409ccc0 2024-08-18T21:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4bfff640 1 --2- 172.21.15.5:0/2676723930 >> v2:172.21.15.157:6812/631023601 conn(0x7f9b3403bdc0 0x7f9b3403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b52ffd640 1 --2- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9b541d18e0 0x7f9b541d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4bfff640 1 -- 172.21.15.5:0/2676723930 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(266..266 src has 22..266) ==== 3898+0+0 (secure 0 0 0) 0x7f9b4c0b5030 con 0x7f9b5409ccc0 2024-08-18T21:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b52ffd640 10 monclient: get_auth_request con 0x7f9b541d18e0 auth_method 0 2024-08-18T21:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b52ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b52ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b52ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b52ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b52ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b52ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4a7fc640 1 --2- 172.21.15.5:0/2676723930 >> v2:172.21.15.157:6812/631023601 conn(0x7f9b3403bdc0 0x7f9b3403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b4a7fc640 10 monclient: get_auth_request con 0x7f9b3403bdc0 auth_method 0 2024-08-18T21:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b52ffd640 10 monclient(hunting): handle_auth_done global_id 124279 payload 824 2024-08-18T21:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.271+0000 7f9b52ffd640 1 -- 172.21.15.5:0/2676723930 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b5409bae0 con 0x7f9b541d18e0 2024-08-18T21:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.275+0000 7f9b52ffd640 1 -- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9b541d18e0 msgr2=0x7f9b541d1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.275+0000 7f9b52ffd640 1 --2- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9b541d18e0 0x7f9b541d1cc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400f880 tx=0x7f9b4400fd40 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.275+0000 7f9b4a7fc640 1 --2- 172.21.15.5:0/2676723930 >> v2:172.21.15.157:6812/631023601 conn(0x7f9b3403bdc0 0x7f9b3403e280 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9b54140630 tx=0x7f9b3c008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.275+0000 7f9b4bfff640 1 -- 172.21.15.5:0/2676723930 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9b4400dc30 con 0x7f9b541d18e0 2024-08-18T21:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.275+0000 7f9b4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.275+0000 7f9b4bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.275+0000 7f9b4bfff640 10 monclient: dump: 2024-08-18T21:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:06.291 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:06.291 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:06.291 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:06.291 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:06.291 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:06.291 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:06.291 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:06.291 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:06.291 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:06.291 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:06.291 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:06.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.275+0000 7f9b4bfff640 1 -- 172.21.15.5:0/2676723930 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9b4400dc30 con 0x7f9b541d18e0 2024-08-18T21:13:06.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.275+0000 7f9b4bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:06.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.275+0000 7f9b4bfff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:06.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.275+0000 7f9b4bfff640 1 -- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9b541d18e0 msgr2=0x7f9b541d1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:06.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.275+0000 7f9b4bfff640 1 --2- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9b541d18e0 0x7f9b541d1cc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400f880 tx=0x7f9b4400fd40 comp rx=0 tx=0).stop 2024-08-18T21:13:06.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.275+0000 7f9b4bfff640 1 -- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9b541d18e0 msgr2=0x7f9b541d1cc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:06.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.275+0000 7f9b4bfff640 1 --2- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9b541d18e0 0x7f9b541d1cc0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400f880 tx=0x7f9b4400fd40 comp rx=0 tx=0).stop 2024-08-18T21:13:06.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.283+0000 7f9b59281640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:06.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.283+0000 7f9b59281640 1 --2- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9b541d2200 0x7f9b5413a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:06.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.283+0000 7f9b59281640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:06.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.283+0000 7f9b59281640 1 -- 172.21.15.5:0/2676723930 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f9b54051140 con 0x7f9b541d2200 2024-08-18T21:13:06.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.283+0000 7f9b52ffd640 1 --2- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9b541d2200 0x7f9b5413a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:06.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.283+0000 7f9b52ffd640 10 monclient: get_auth_request con 0x7f9b541d2200 auth_method 0 2024-08-18T21:13:06.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.283+0000 7f9b52ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:06.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.283+0000 7f9b52ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:06.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.283+0000 7f9b52ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:06.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.283+0000 7f9b52ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:06.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.283+0000 7f9b52ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:06.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.283+0000 7f9b52ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:06.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.283+0000 7f9b52ffd640 10 monclient(hunting): handle_auth_done global_id 124288 payload 824 2024-08-18T21:13:06.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.283+0000 7f9b52ffd640 1 -- 172.21.15.5:0/2676723930 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9b54091240 con 0x7f9b541d2200 2024-08-18T21:13:06.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b52ffd640 1 -- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9b541d2200 msgr2=0x7f9b5413a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:06.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b52ffd640 1 --2- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9b541d2200 0x7f9b5413a7d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400f880 tx=0x7f9b440046d0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:06.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b4bfff640 1 -- 172.21.15.5:0/2676723930 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9b440067c0 con 0x7f9b541d2200 2024-08-18T21:13:06.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:06.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b4bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:13:06.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b4bfff640 10 monclient: dump: 2024-08-18T21:13:06.293 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:06.294 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:06.294 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.294 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:06.294 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:06.294 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:06.294 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:06.294 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:06.294 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:06.294 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:06.294 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:06.294 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:06.294 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:06.294 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:06.295 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:06.295 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:06.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b4bfff640 1 -- 172.21.15.5:0/2676723930 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9581 (secure 0 0 0) 0x7f9b440067c0 con 0x7f9b541d2200 2024-08-18T21:13:06.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b4bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:06.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b4bfff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:06.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b4bfff640 1 -- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9b541d2200 msgr2=0x7f9b5413a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:06.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b4bfff640 1 --2- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9b541d2200 0x7f9b5413a7d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400f880 tx=0x7f9b440046d0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b4bfff640 1 -- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9b541d2200 msgr2=0x7f9b5413a7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:06.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b4bfff640 1 --2- 172.21.15.5:0/2676723930 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f9b541d2200 0x7f9b5413a7d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.295 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:06.296 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:06.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:06.296 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:06.296 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 206, 2024-08-18T21:13:06.296 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 33271, 2024-08-18T21:13:06.296 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:06.296 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:06.296 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:13:06.296 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:06.296 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:13:06.296 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:06.296 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:06.297 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:13:06.297 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:13:06.297 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:06.297 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:06.297 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 7, 2024-08-18T21:13:06.297 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:06.297 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:06.297 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:06.297 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:06.297 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:06.297 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:06.297 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:06.297 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:06.298 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:06.298 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:06.298 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:06.298 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:06.298 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:06.298 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:06.298 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:06.298 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:06.298 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:06.298 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:06.298 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:06.298 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:06.298 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:06.299 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:06.299 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:06.299 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:06.299 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:06.299 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:06.299 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:06.299 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:06.299 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.299 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:06.299 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:06.299 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:06.299 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:06.300 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:06.300 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:06.300 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:06.300 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:06.300 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:06.300 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:06.300 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:06.300 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:06.300 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:06.300 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:06.300 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:06.300 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:06.300 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:06.301 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:06.301 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:06.301 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:06.301 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:06.301 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:06.301 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:06.301 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:06.301 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:06.301 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:06.301 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:06.301 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:06.301 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:06.301 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:06.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.302 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:06.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.302 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:06.302 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:06.302 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.302 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.302 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.302 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:06.302 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.303 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.303 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:06.303 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.303 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.303 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.303 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:06.303 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:06.303 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.303 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.303 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.304 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:06.304 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:06.304 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:06.304 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:06.304 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.305 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.305 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:06.305 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:06.305 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.305 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.305 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.305 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:06.305 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:06.305 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:06.306 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:06.306 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.306 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.306 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:06.307 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:06.307 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.307 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.307 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.307 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:06.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:06.307 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:06.308 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.308 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:06.308 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.308 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.308 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:06.308 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:06.308 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.308 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.309 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.309 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:06.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:06.309 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:06.309 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:06.310 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.310 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.310 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:06.310 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:06.310 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.310 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.310 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.310 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:06.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:06.311 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:06.311 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:06.311 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.311 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.312 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:06.312 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:06.312 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.312 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.312 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.312 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:06.312 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:06.312 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:06.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:06.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.313 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:06.313 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:06.313 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.314 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.314 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.314 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:06.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:06.314 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.314 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:06.314 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:06.315 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.315 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.315 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:06.315 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:06.315 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.315 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.315 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.316 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:06.316 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:06.316 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:06.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:06.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:06.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:06.316 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:06.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:06.317 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:06.317 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.317 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.317 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:06.317 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:06.317 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:06.317 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:06.317 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:06.317 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.317 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.317 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:06.317 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:06.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.318 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:06.318 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:06.318 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:06.318 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.318 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:06.318 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:13:06.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.318 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:06.318 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:06.318 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:06.318 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.318 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:06.319 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:06.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.319 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:06.319 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:06.319 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:13:06.319 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.319 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:06.319 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:13:06.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:06.319 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:06.319 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:06.319 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:06.319 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:06.319 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:06.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:06.320 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:06.320 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b59281640 1 -- 172.21.15.5:0/2676723930 >> v2:172.21.15.157:6812/631023601 conn(0x7f9b3403bdc0 msgr2=0x7f9b3403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b59281640 1 --2- 172.21.15.5:0/2676723930 >> v2:172.21.15.157:6812/631023601 conn(0x7f9b3403bdc0 0x7f9b3403e280 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9b54140630 tx=0x7f9b3c008040 comp rx=0 tx=0).stop 2024-08-18T21:13:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b59281640 10 monclient: shutdown 2024-08-18T21:13:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b59281640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b59281640 1 -- 172.21.15.5:0/2676723930 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9b5409ccc0 msgr2=0x7f9b5413fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b59281640 1 --2- 172.21.15.5:0/2676723930 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9b5409ccc0 0x7f9b5413fa00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009e80 tx=0x7f9b4c0196b0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b537fe640 1 -- 172.21.15.5:0/2676723930 reap_dead start 2024-08-18T21:13:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b59281640 1 -- 172.21.15.5:0/2676723930 shutdown_connections 2024-08-18T21:13:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b59281640 1 --2- 172.21.15.5:0/2676723930 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9b5409ccc0 0x7f9b5413fa00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b59281640 1 -- 172.21.15.5:0/2676723930 >> 172.21.15.5:0/2676723930 conn(0x7f9b540a4ea0 msgr2=0x7f9b540a17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b59281640 1 -- 172.21.15.5:0/2676723930 shutdown_connections 2024-08-18T21:13:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:06.287+0000 7f9b59281640 1 -- 172.21.15.5:0/2676723930 wait complete. 2024-08-18T21:13:06.322 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:13:06.322 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['f', 'd', 'g', 'i'] 2024-08-18T21:13:06.323 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2024-08-18T21:13:06.323 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.f 2024-08-18T21:13:06.323 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2024-08-18T21:13:06.323 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-08-18T21:13:06.323 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:13:06.340 INFO:tasks.ceph.mon.f:Stopped 2024-08-18T21:13:06.340 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d 2024-08-18T21:13:06.340 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2024-08-18T21:13:06.340 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-08-18T21:13:06.340 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:13:06.353 INFO:tasks.ceph.mon.d:Stopped 2024-08-18T21:13:06.353 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.g 2024-08-18T21:13:06.354 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2024-08-18T21:13:06.354 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-08-18T21:13:06.354 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:13:06.399 INFO:tasks.ceph.mon.g:Stopped 2024-08-18T21:13:06.399 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i 2024-08-18T21:13:06.399 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2024-08-18T21:13:06.399 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2024-08-18T21:13:06.399 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:13:06.469 INFO:tasks.ceph.mon.i:Stopped 2024-08-18T21:13:06.469 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-08-18T21:13:06.470 INFO:tasks.ceph.mon.c:Sent signal 19 2024-08-18T21:13:06.470 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs to unfreeze mons 2024-08-18T21:13:26.470 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-08-18T21:13:26.471 INFO:tasks.ceph.mon.c:Sent signal 18 2024-08-18T21:13:26.471 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 5 2024-08-18T21:13:26.471 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:13:26.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 10 monclient: get_monmap_and_config 2024-08-18T21:13:26.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 10 monclient: build_initial_monmap 2024-08-18T21:13:26.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 10 monclient: monmap: 2024-08-18T21:13:26.606 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:26.606 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:26.606 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:26.610175+0000 2024-08-18T21:13:26.606 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:26.610175+0000 2024-08-18T21:13:26.606 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:26.607 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:26.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 1 Processor -- start 2024-08-18T21:13:26.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 1 -- start start 2024-08-18T21:13:26.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 10 monclient: init 2024-08-18T21:13:26.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:26.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 10 monclient: _add_conns ranks=[3,8,1,2,10,9,4,0,6,5,7] 2024-08-18T21:13:26.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd80a49d0 0x7fdfd809e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:26.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 10 monclient(hunting): picked mon.noname-g con 0x7fdfd80a49d0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:26.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 0x7fdfd80a5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:26.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 10 monclient(hunting): picked mon.noname-e con 0x7fdfd80a4db0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:26.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fdfd81397b0 addr v1:172.21.15.157:6789/0 2024-08-18T21:13:26.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfd8069a60 con 0x7fdfd81397b0 2024-08-18T21:13:26.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:26.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdfd809eb80 con 0x7fdfd80a49d0 2024-08-18T21:13:26.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:26.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fdfd809dc60 con 0x7fdfd80a4db0 2024-08-18T21:13:26.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:26.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdfd3d640 10 monclient(hunting): authenticate will time out at 1573.623344s 2024-08-18T21:13:26.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfde2da640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7fdfd81397b0 legacy=0x7fdfd8139bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:13:26.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfddad9640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd80a49d0 msgr2=0x7fdfd809e640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:13:26.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdd2d8640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 0x7fdfd80a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:26.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdd2d8640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 0x7fdfd80a5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:43190/0 (socket says 172.21.15.5:43190) 2024-08-18T21:13:26.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 learned_addr learned my addr 172.21.15.5:0/441071967 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:26.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request con 0x7fdfd80a4db0 auth_method 0 2024-08-18T21:13:26.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd80a49d0 0x7fdfd809e640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:26.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:26.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:26.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:26.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 msgr2=0x7fdfd80a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:13:26.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 msgr2=0x7fdfd80a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:13:26.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 0x7fdfd80a5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:13:26.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.607+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 0x7fdfd80a5190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:26.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.811+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 0x7fdfd80a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:26.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.811+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request con 0x7fdfd80a4db0 auth_method 0 2024-08-18T21:13:26.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.811+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:26.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.811+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:26.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.811+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:13:26.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.811+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 msgr2=0x7fdfd80a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:13:26.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.811+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 msgr2=0x7fdfd80a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:13:26.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.811+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 0x7fdfd80a5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:13:26.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.811+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 0x7fdfd80a5190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:13:26.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.811+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 >> v1:172.21.15.157:6789/0 conn(0x7fdfd81397b0 legacy=0x7fdfd8139bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:13:26.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.811+0000 7fdfddad9640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd80a49d0 msgr2=0x7fdfd809e640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:13:26.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:26.811+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd80a49d0 0x7fdfd809e640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:13:27.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:27.215+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 0x7fdfd80a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:27.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:27.215+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request con 0x7fdfd80a4db0 auth_method 0 2024-08-18T21:13:27.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:27.215+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:27.215+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:27.215+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:13:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:27.215+0000 7fdfddad9640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd80a49d0 msgr2=0x7fdfd809e640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:13:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:27.215+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 >> v1:172.21.15.157:6789/0 conn(0x7fdfd81397b0 legacy=0x7fdfd8139bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:13:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:27.215+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 msgr2=0x7fdfd80a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:13:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:27.215+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 msgr2=0x7fdfd80a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:13:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:27.215+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd80a49d0 0x7fdfd809e640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:13:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:27.215+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 0x7fdfd80a5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:13:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:27.215+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 0x7fdfd80a5190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:13:28.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:28.019+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 >> v1:172.21.15.157:6789/0 conn(0x7fdfd81397b0 legacy=0x7fdfd8139bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:13:28.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:28.019+0000 7fdfddad9640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd80a49d0 msgr2=0x7fdfd809e640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:13:28.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:28.019+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd80a49d0 0x7fdfd809e640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:13:28.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:28.019+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 0x7fdfd80a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:28.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:28.019+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request con 0x7fdfd80a4db0 auth_method 0 2024-08-18T21:13:28.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:28.019+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:28.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:28.019+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:28.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:28.019+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:13:28.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:28.019+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 msgr2=0x7fdfd80a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:13:28.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:28.019+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 msgr2=0x7fdfd80a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:13:28.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:28.019+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 0x7fdfd80a5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:13:28.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:28.019+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 0x7fdfd80a5190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:13:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 10 monclient(hunting): tick 2024-08-18T21:13:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:13:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 1 monclient(hunting): continuing hunt 2024-08-18T21:13:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:13:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 msgr2=0x7fdfd80a5190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdfd80a4db0 0x7fdfd80a5190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd80a49d0 msgr2=0x7fdfd809e640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd80a49d0 0x7fdfd809e640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 >> v1:172.21.15.157:6789/0 conn(0x7fdfd81397b0 legacy=0x7fdfd8139bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 10 monclient: _add_conns ranks=[0,9,5,7,6,4,10,2] 2024-08-18T21:13:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdfbc003810 addr v1:172.21.15.5:6789/0 2024-08-18T21:13:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 0x7fdfbc009930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 10 monclient(hunting): picked mon.noname-a con 0x7fdfbc007470 addr v2:172.21.15.5:3300/0 2024-08-18T21:13:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 0x7fdfbc00c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 10 monclient(hunting): picked mon.noname-h con 0x7fdfbc009fc0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfd809df40 con 0x7fdfbc003810 2024-08-18T21:13:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdfd809dc60 con 0x7fdfbc007470 2024-08-18T21:13:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdfbc00db50 con 0x7fdfbc009fc0 2024-08-18T21:13:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.607+0000 7fdfcf7fe640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 0x7fdfbc009930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request con 0x7fdfbc007470 auth_method 0 2024-08-18T21:13:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfde2da640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 0x7fdfbc00c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfde2da640 10 monclient(hunting): get_auth_request con 0x7fdfbc009fc0 auth_method 0 2024-08-18T21:13:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfde2da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfde2da640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfde2da640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 msgr2=0x7fdfbc009930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:13:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 msgr2=0x7fdfbc009930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:13:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 0x7fdfbc009930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:13:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 msgr2=0x7fdfbc00c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:13:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 msgr2=0x7fdfbc00c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:13:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 0x7fdfbc009930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfde2da640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 0x7fdfbc00c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:13:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfde2da640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 0x7fdfbc00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.611+0000 7fdfddad9640 1 -- 172.21.15.5:0/441071967 >> v1:172.21.15.5:6789/0 conn(0x7fdfbc003810 legacy=0x7fdfbc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 0x7fdfbc009930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request con 0x7fdfbc007470 auth_method 0 2024-08-18T21:13:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:13:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfde2da640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 0x7fdfbc00c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfde2da640 10 monclient(hunting): get_auth_request con 0x7fdfbc009fc0 auth_method 0 2024-08-18T21:13:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfde2da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 msgr2=0x7fdfbc009930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:13:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfde2da640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfde2da640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:13:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 msgr2=0x7fdfbc009930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:13:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 0x7fdfbc009930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:13:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 0x7fdfbc009930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:13:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 msgr2=0x7fdfbc00c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:13:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 msgr2=0x7fdfbc00c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:13:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfde2da640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 0x7fdfbc00c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:13:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:29.815+0000 7fdfde2da640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 0x7fdfbc00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:13:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfde2da640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 0x7fdfbc00c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfde2da640 10 monclient(hunting): get_auth_request con 0x7fdfbc009fc0 auth_method 0 2024-08-18T21:13:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfde2da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfde2da640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfde2da640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:13:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 msgr2=0x7fdfbc00c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:13:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 msgr2=0x7fdfbc00c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:13:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfde2da640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 0x7fdfbc00c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:13:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfde2da640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 0x7fdfbc00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:13:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 0x7fdfbc009930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request con 0x7fdfbc007470 auth_method 0 2024-08-18T21:13:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:13:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 msgr2=0x7fdfbc009930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:13:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 msgr2=0x7fdfbc009930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:13:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 0x7fdfbc009930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:13:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:30.219+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 0x7fdfbc009930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:13:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfde2da640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 0x7fdfbc00c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfde2da640 10 monclient(hunting): get_auth_request con 0x7fdfbc009fc0 auth_method 0 2024-08-18T21:13:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfde2da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfde2da640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfde2da640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:13:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 msgr2=0x7fdfbc00c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:13:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 msgr2=0x7fdfbc00c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:13:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfde2da640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 0x7fdfbc00c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:13:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfde2da640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 0x7fdfbc00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:13:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 0x7fdfbc009930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request con 0x7fdfbc007470 auth_method 0 2024-08-18T21:13:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:13:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 msgr2=0x7fdfbc009930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:13:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 msgr2=0x7fdfbc009930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:13:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 0x7fdfbc009930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:13:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:31.023+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 0x7fdfbc009930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:13:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.607+0000 7fdfcf7fe640 10 monclient(hunting): tick 2024-08-18T21:13:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:13:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 1 monclient(hunting): continuing hunt 2024-08-18T21:13:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:13:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 msgr2=0x7fdfbc00c480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdfbc009fc0 0x7fdfbc00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 msgr2=0x7fdfbc009930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.5:3300/0 conn(0x7fdfbc007470 0x7fdfbc009930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 >> v1:172.21.15.5:6789/0 conn(0x7fdfbc003810 legacy=0x7fdfbc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 reap_dead start 2024-08-18T21:13:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 10 monclient: _add_conns ranks=[10,7,6,2,4] 2024-08-18T21:13:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.157:3300/0 conn(0x7fdfbc00ce10 0x7fdfbc00c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 10 monclient(hunting): picked mon.noname-f con 0x7fdfbc00ce10 addr v2:172.21.15.157:3300/0 2024-08-18T21:13:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdfbc00d2b0 0x7fdfbc0098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 10 monclient(hunting): picked mon.noname-i con 0x7fdfbc00d2b0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfbc00df10 0x7fdfbc010300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 10 monclient(hunting): picked mon.noname-d con 0x7fdfbc00df10 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fdfd809dc60 con 0x7fdfbc00ce10 2024-08-18T21:13:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fdfbc00db50 con 0x7fdfbc00df10 2024-08-18T21:13:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:32.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fdfbc00d9a0 con 0x7fdfbc00d2b0 2024-08-18T21:13:32.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfcf7fe640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:32.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfbc00df10 msgr2=0x7fdfbc010300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:13:32.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfde2da640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfbc00df10 0x7fdfbc010300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:32.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdfbc00d2b0 msgr2=0x7fdfbc0098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:13:32.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfddad9640 1 -- 172.21.15.5:0/441071967 >> v2:172.21.15.157:3300/0 conn(0x7fdfbc00ce10 msgr2=0x7fdfbc00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:13:32.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdfbc00d2b0 0x7fdfbc0098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:32.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.611+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.157:3300/0 conn(0x7fdfbc00ce10 0x7fdfbc00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.815+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfbc00df10 msgr2=0x7fdfbc010300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:13:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.815+0000 7fdfde2da640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfbc00df10 0x7fdfbc010300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:13:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.815+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdfbc00d2b0 msgr2=0x7fdfbc0098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:13:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.815+0000 7fdfddad9640 1 -- 172.21.15.5:0/441071967 >> v2:172.21.15.157:3300/0 conn(0x7fdfbc00ce10 msgr2=0x7fdfbc00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:13:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.815+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdfbc00d2b0 0x7fdfbc0098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:13:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:32.815+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.157:3300/0 conn(0x7fdfbc00ce10 0x7fdfbc00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:13:33.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:33.219+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfbc00df10 msgr2=0x7fdfbc010300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:13:33.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:33.219+0000 7fdfde2da640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfbc00df10 0x7fdfbc010300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:13:33.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:33.219+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdfbc00d2b0 msgr2=0x7fdfbc0098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:13:33.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:33.219+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdfbc00d2b0 0x7fdfbc0098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:13:33.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:33.219+0000 7fdfddad9640 1 -- 172.21.15.5:0/441071967 >> v2:172.21.15.157:3300/0 conn(0x7fdfbc00ce10 msgr2=0x7fdfbc00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:13:33.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:33.219+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.157:3300/0 conn(0x7fdfbc00ce10 0x7fdfbc00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:13:34.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:34.023+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfbc00df10 msgr2=0x7fdfbc010300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:13:34.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:34.023+0000 7fdfde2da640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfbc00df10 0x7fdfbc010300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:13:34.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:34.023+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdfbc00d2b0 msgr2=0x7fdfbc0098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:13:34.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:34.023+0000 7fdfddad9640 1 -- 172.21.15.5:0/441071967 >> v2:172.21.15.157:3300/0 conn(0x7fdfbc00ce10 msgr2=0x7fdfbc00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:13:34.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:34.023+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdfbc00d2b0 0x7fdfbc0098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:13:34.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:34.023+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.157:3300/0 conn(0x7fdfbc00ce10 0x7fdfbc00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:13:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 10 monclient(hunting): tick 2024-08-18T21:13:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:13:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 1 monclient(hunting): continuing hunt 2024-08-18T21:13:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:13:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdfbc00d2b0 msgr2=0x7fdfbc0098b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdfbc00d2b0 0x7fdfbc0098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfbc00df10 msgr2=0x7fdfbc010300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfbc00df10 0x7fdfbc010300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 >> v2:172.21.15.157:3300/0 conn(0x7fdfbc00ce10 msgr2=0x7fdfbc00c480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 1 --2- 172.21.15.5:0/441071967 >> v2:172.21.15.157:3300/0 conn(0x7fdfbc00ce10 0x7fdfbc00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 10 monclient: _add_conns ranks=[2,4] 2024-08-18T21:13:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdfbc0065b0 0x7fdfbc005c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 10 monclient(hunting): picked mon.noname-b con 0x7fdfbc0065b0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdfbc006990 0x7fdfbc006da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 10 monclient(hunting): picked mon.noname-c con 0x7fdfbc006990 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:13:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fdfd809dc60 con 0x7fdfbc0065b0 2024-08-18T21:13:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 1 -- 172.21.15.5:0/441071967 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fdfbc00db50 con 0x7fdfbc006990 2024-08-18T21:13:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfcf7fe640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdfbc0065b0 0x7fdfbc005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdfbc006990 0x7fdfbc006da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request con 0x7fdfbc006990 auth_method 0 2024-08-18T21:13:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfddad9640 10 monclient(hunting): get_auth_request con 0x7fdfbc0065b0 auth_method 0 2024-08-18T21:13:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfddad9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfddad9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfddad9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdfbc006990 msgr2=0x7fdfbc006da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:13:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdfbc006990 msgr2=0x7fdfbc006da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:13:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfddad9640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdfbc0065b0 msgr2=0x7fdfbc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:13:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfddad9640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdfbc0065b0 msgr2=0x7fdfbc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:13:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdfbc006990 0x7fdfbc006da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:13:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdfbc0065b0 0x7fdfbc005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:13:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdfbc006990 0x7fdfbc006da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.611+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdfbc0065b0 0x7fdfbc005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:35.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdfbc0065b0 0x7fdfbc005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:35.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdfbc006990 0x7fdfbc006da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:35.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request con 0x7fdfbc006990 auth_method 0 2024-08-18T21:13:35.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:35.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:35.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:13:35.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfddad9640 10 monclient(hunting): get_auth_request con 0x7fdfbc0065b0 auth_method 0 2024-08-18T21:13:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfddad9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfddad9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfddad9640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:13:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdfbc006990 msgr2=0x7fdfbc006da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:13:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdfbc006990 msgr2=0x7fdfbc006da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:13:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdfbc006990 0x7fdfbc006da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:13:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfddad9640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdfbc0065b0 msgr2=0x7fdfbc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:13:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfddad9640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdfbc0065b0 msgr2=0x7fdfbc005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:13:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdfbc0065b0 0x7fdfbc005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:13:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdfbc006990 0x7fdfbc006da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:13:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:35.815+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdfbc0065b0 0x7fdfbc005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:13:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdfbc006990 0x7fdfbc006da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdfbc0065b0 0x7fdfbc005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request con 0x7fdfbc006990 auth_method 0 2024-08-18T21:13:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:13:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfddad9640 10 monclient(hunting): get_auth_request con 0x7fdfbc0065b0 auth_method 0 2024-08-18T21:13:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfddad9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfddad9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfddad9640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:13:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfddad9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfddad9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfddad9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfdd2d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfdd2d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfdd2d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfddad9640 10 monclient(hunting): handle_auth_done global_id 114590 payload 274 2024-08-18T21:13:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfddad9640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdfbc006990 msgr2=0x7fdfbc006da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdfbc006990 0x7fdfbc006da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfddad9640 10 monclient: _finish_hunting 0 2024-08-18T21:13:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfddad9640 1 monclient: found mon.noname-b 2024-08-18T21:13:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfddad9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfddad9640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:13:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfddad9640 1 -- 172.21.15.5:0/441071967 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd8069a60 con 0x7fdfbc0065b0 2024-08-18T21:13:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.219+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdfbc006990 0x7fdfbc006da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:36.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfddad9640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdfbc0065b0 msgr2=0x7fdfbc005c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:36.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfddad9640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdfbc0065b0 0x7fdfbc005c60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0036f0 tx=0x7fdfd401d1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24c9f6defbb6227f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:36.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdcad7640 1 -- 172.21.15.5:0/441071967 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdfd40b2070 con 0x7fdfbc0065b0 2024-08-18T21:13:36.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdcad7640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdcad7640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:13:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdcad7640 10 monclient: dump: 2024-08-18T21:13:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:36.228 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdcad7640 10 monclient: _finish_auth 0 2024-08-18T21:13:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdcad7640 10 monclient: _check_auth_tickets 2024-08-18T21:13:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdcad7640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdcad7640 1 -- 172.21.15.5:0/441071967 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd40a5cf0 con 0x7fdfbc0065b0 2024-08-18T21:13:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdcad7640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdcad7640 1 -- 172.21.15.5:0/441071967 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdfd40abc20 con 0x7fdfbc0065b0 2024-08-18T21:13:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdfd3d640 5 monclient: authenticate success, global_id 114590 2024-08-18T21:13:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdfd3d640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdcad7640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdfd3d640 4 set_mon_vals no callback set 2024-08-18T21:13:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdcad7640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdcad7640 10 monclient: dump: 2024-08-18T21:13:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:36.230 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:36.230 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:36.230 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:36.230 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:36.230 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:36.230 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdfd3d640 10 monclient: shutdown 2024-08-18T21:13:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdfd3d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdfd3d640 1 -- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdfbc0065b0 msgr2=0x7fdfbc005c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdfd3d640 1 --2- 172.21.15.5:0/441071967 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdfbc0065b0 0x7fdfbc005c60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0036f0 tx=0x7fdfd401d1f0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfde2da640 1 -- 172.21.15.5:0/441071967 reap_dead start 2024-08-18T21:13:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdfd3d640 1 -- 172.21.15.5:0/441071967 shutdown_connections 2024-08-18T21:13:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdfd3d640 1 -- 172.21.15.5:0/441071967 >> 172.21.15.5:0/441071967 conn(0x7fdfd80a64e0 msgr2=0x7fdfd8068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdfd3d640 1 -- 172.21.15.5:0/441071967 shutdown_connections 2024-08-18T21:13:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.227+0000 7fdfdfd3d640 1 -- 172.21.15.5:0/441071967 wait complete. 2024-08-18T21:13:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 10 monclient: build_initial_monmap 2024-08-18T21:13:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 10 monclient: monmap: 2024-08-18T21:13:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:36.235 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 1 Processor -- start 2024-08-18T21:13:36.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 1 -- start start 2024-08-18T21:13:36.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 10 monclient: init 2024-08-18T21:13:36.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:36.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 10 monclient: _add_conns ranks=[6,0,3,8,7,4,2,5,1] 2024-08-18T21:13:36.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfd81388f0 0x7fdfd8138cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 10 monclient(hunting): picked mon.noname-d con 0x7fdfd81388f0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:36.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd8122560 0x7fdfd81229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 10 monclient(hunting): picked mon.noname-a con 0x7fdfd8122560 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:13:36.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd8122f00 0x7fdfd81d86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 10 monclient(hunting): picked mon.noname-g con 0x7fdfd8122f00 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:36.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd8139f20 con 0x7fdfd8122560 2024-08-18T21:13:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdfd8139da0 con 0x7fdfd8122f00 2024-08-18T21:13:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fdfd813a0a0 con 0x7fdfd81388f0 2024-08-18T21:13:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdfd3d640 10 monclient(hunting): authenticate will time out at 1583.246590s 2024-08-18T21:13:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfddad9640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfd81388f0 msgr2=0x7fdfd8138cd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:13:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfddad9640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfd81388f0 0x7fdfd8138cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd8122560 0x7fdfd81229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfde2da640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd8122f00 msgr2=0x7fdfd81d86f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:13:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfde2da640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd8122f00 0x7fdfd81d86f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd8122560 0x7fdfd81229c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35016/0 (socket says 172.21.15.5:35016) 2024-08-18T21:13:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/4108915500 learned_addr learned my addr 172.21.15.5:0/4108915500 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request con 0x7fdfd8122560 auth_method 0 2024-08-18T21:13:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 10 monclient(hunting): handle_auth_done global_id 124290 payload 824 2024-08-18T21:13:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/4108915500 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfd81388f0 msgr2=0x7fdfd8138cd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:13:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/4108915500 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfd81388f0 0x7fdfd8138cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/4108915500 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd8122f00 msgr2=0x7fdfd81d86f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:13:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/4108915500 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd8122f00 0x7fdfd81d86f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 10 monclient: _finish_hunting 0 2024-08-18T21:13:36.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 1 monclient: found mon.noname-a 2024-08-18T21:13:36.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:36.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:13:36.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.231+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/4108915500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd81263b0 con 0x7fdfd8122560 2024-08-18T21:13:36.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfdd2d8640 1 -- 172.21.15.5:0/4108915500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd8122560 msgr2=0x7fdfd81229c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:36.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfdd2d8640 1 --2- 172.21.15.5:0/4108915500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd8122560 0x7fdfd81229c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8018b70 tx=0x7fdfc8018f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:36.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfce7fc640 1 -- 172.21.15.5:0/4108915500 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdfc8029030 con 0x7fdfd8122560 2024-08-18T21:13:36.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:36.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfce7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:13:36.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfce7fc640 10 monclient: dump: 2024-08-18T21:13:36.240 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:36.240 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.240 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:36.241 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfce7fc640 10 monclient: _finish_auth 0 2024-08-18T21:13:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfce7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:13:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfce7fc640 1 -- 172.21.15.5:0/4108915500 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc80258d0 con 0x7fdfd8122560 2024-08-18T21:13:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfce7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfce7fc640 1 -- 172.21.15.5:0/4108915500 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdfc800f040 con 0x7fdfd8122560 2024-08-18T21:13:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfdfd3d640 5 monclient: authenticate success, global_id 124290 2024-08-18T21:13:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfdfd3d640 10 monclient: _renew_subs 2024-08-18T21:13:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfdfd3d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:13:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfdfd3d640 1 -- 172.21.15.5:0/4108915500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfd8125060 con 0x7fdfd8122560 2024-08-18T21:13:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfcffff640 4 set_mon_vals no callback set 2024-08-18T21:13:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfce7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:13:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfce7fc640 10 monclient: dump: 2024-08-18T21:13:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:36.244 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfdfd3d640 10 monclient: _renew_subs 2024-08-18T21:13:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfdfd3d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:13:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfdfd3d640 1 -- 172.21.15.5:0/4108915500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfd8123300 con 0x7fdfd8122560 2024-08-18T21:13:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfce7fc640 1 -- 172.21.15.5:0/4108915500 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fdfc802c070 con 0x7fdfd8122560 2024-08-18T21:13:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfdfd3d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfdfd3d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfdfd3d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:13:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfdfd3d640 1 -- 172.21.15.5:0/4108915500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfd8125cc0 con 0x7fdfd8122560 2024-08-18T21:13:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfce7fc640 1 --2- 172.21.15.5:0/4108915500 >> v2:172.21.15.157:6812/631023601 conn(0x7fdfbc03de30 0x7fdfbc0402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.235+0000 7fdfce7fc640 1 -- 172.21.15.5:0/4108915500 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(266..266 src has 22..266) ==== 3898+0+0 (secure 0 0 0) 0x7fdfc802a070 con 0x7fdfd8122560 2024-08-18T21:13:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.239+0000 7fdfddad9640 1 --2- 172.21.15.5:0/4108915500 >> v2:172.21.15.157:6812/631023601 conn(0x7fdfbc03de30 0x7fdfbc0402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.239+0000 7fdfddad9640 10 monclient: get_auth_request con 0x7fdfbc03de30 auth_method 0 2024-08-18T21:13:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.239+0000 7fdfddad9640 1 --2- 172.21.15.5:0/4108915500 >> v2:172.21.15.157:6812/631023601 conn(0x7fdfbc03de30 0x7fdfbc0402f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40ac000 tx=0x7fdfd40a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.243+0000 7fdfce7fc640 1 -- 172.21.15.5:0/4108915500 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fdfd8125cc0 con 0x7fdfd8122560 2024-08-18T21:13:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.243+0000 7fdfce7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.243+0000 7fdfce7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:36.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.495+0000 7fdfdfd3d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:13:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.495+0000 7fdfdfd3d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:13:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.495+0000 7fdfdfd3d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:13:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.495+0000 7fdfdfd3d640 1 -- 172.21.15.5:0/4108915500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdfd813a3d0 con 0x7fdfd8122560 2024-08-18T21:13:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.495+0000 7fdfce7fc640 1 -- 172.21.15.5:0/4108915500 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3149 (secure 0 0 0) 0x7fdfc8033020 con 0x7fdfd8122560 2024-08-18T21:13:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.495+0000 7fdfce7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:13:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.495+0000 7fdfce7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:36.495 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":216,"quorum":[0,2,4,5,8],"quorum_names":["a","b","c","h","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:13:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.499+0000 7fdfdfd3d640 1 -- 172.21.15.5:0/4108915500 >> v2:172.21.15.157:6812/631023601 conn(0x7fdfbc03de30 msgr2=0x7fdfbc0402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.499+0000 7fdfdfd3d640 1 --2- 172.21.15.5:0/4108915500 >> v2:172.21.15.157:6812/631023601 conn(0x7fdfbc03de30 0x7fdfbc0402f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40ac000 tx=0x7fdfd40a7070 comp rx=0 tx=0).stop 2024-08-18T21:13:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.499+0000 7fdfdfd3d640 10 monclient: shutdown 2024-08-18T21:13:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.499+0000 7fdfdfd3d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.499+0000 7fdfdfd3d640 1 -- 172.21.15.5:0/4108915500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd8122560 msgr2=0x7fdfd81229c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.499+0000 7fdfdfd3d640 1 --2- 172.21.15.5:0/4108915500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd8122560 0x7fdfd81229c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8018b70 tx=0x7fdfc8018f70 comp rx=0 tx=0).stop 2024-08-18T21:13:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.499+0000 7fdfdfd3d640 1 -- 172.21.15.5:0/4108915500 shutdown_connections 2024-08-18T21:13:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.499+0000 7fdfdfd3d640 1 --2- 172.21.15.5:0/4108915500 >> v2:172.21.15.157:6812/631023601 conn(0x7fdfbc03de30 0x7fdfbc0402f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.499+0000 7fdfdfd3d640 1 --2- 172.21.15.5:0/4108915500 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfd8122f00 0x7fdfd81d86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.499+0000 7fdfdfd3d640 1 --2- 172.21.15.5:0/4108915500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd8122560 0x7fdfd81229c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.499+0000 7fdfdfd3d640 1 --2- 172.21.15.5:0/4108915500 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdfd81388f0 0x7fdfd8138cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.499+0000 7fdfdfd3d640 1 -- 172.21.15.5:0/4108915500 >> 172.21.15.5:0/4108915500 conn(0x7fdfd80a64e0 msgr2=0x7fdfd81c1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.499+0000 7fdfdfd3d640 1 -- 172.21.15.5:0/4108915500 shutdown_connections 2024-08-18T21:13:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.499+0000 7fdfdfd3d640 1 -- 172.21.15.5:0/4108915500 wait complete. 2024-08-18T21:13:36.517 INFO:tasks.mon_thrash.ceph_manager:quorum is size 5 2024-08-18T21:13:36.517 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon a 2024-08-18T21:13:36.517 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:13:36.606 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-18T21:13:36.607+0000 7f9d2bae0640 -1 osd.1 266 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.124210.0:2 81.1a 81.db6ee63a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e266) 2024-08-18T21:13:36.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 10 monclient: get_monmap_and_config 2024-08-18T21:13:36.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 10 monclient: build_initial_monmap 2024-08-18T21:13:36.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 10 monclient: monmap: 2024-08-18T21:13:36.644 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:36.648684+0000 2024-08-18T21:13:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:36.648684+0000 2024-08-18T21:13:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:36.646 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:36.646 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:36.646 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 1 Processor -- start 2024-08-18T21:13:36.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 1 -- start start 2024-08-18T21:13:36.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 10 monclient: init 2024-08-18T21:13:36.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:36.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 10 monclient: _add_conns ranks=[10,3,5,8,4,6,9,7,2,0,1] 2024-08-18T21:13:36.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6e1c0a5ac0 0x7f6e1c0a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 10 monclient(hunting): picked mon.noname-f con 0x7f6e1c0a5ac0 addr v2:172.21.15.157:3300/0 2024-08-18T21:13:36.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e1c0a63e0 0x7f6e1c1378e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 10 monclient(hunting): picked mon.noname-g con 0x7f6e1c0a63e0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:36.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6e1c137e20 0x7f6e1c1382d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 10 monclient(hunting): picked mon.noname-h con 0x7f6e1c137e20 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:36.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f6e1c0a2050 con 0x7f6e1c0a5ac0 2024-08-18T21:13:36.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6e1c0a3990 con 0x7f6e1c0a63e0 2024-08-18T21:13:36.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f6e1c0a30f0 con 0x7f6e1c137e20 2024-08-18T21:13:36.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:36.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e2245b640 10 monclient(hunting): authenticate will time out at 1583.661880s 2024-08-18T21:13:36.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e1b7fe640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e1c0a63e0 msgr2=0x7f6e1c1378e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:13:36.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e1bfff640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7f6e1c0a5ac0 msgr2=0x7f6e1c0a5ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:13:36.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e1b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e1c0a63e0 0x7f6e1c1378e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:36.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e1bfff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6e1c0a5ac0 0x7f6e1c0a5ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:36.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6e1c137e20 0x7f6e1c1382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6e1c137e20 0x7f6e1c1382d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3302/0 says I am v2:172.21.15.5:41918/0 (socket says 172.21.15.5:41918) 2024-08-18T21:13:36.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 1 -- 172.21.15.5:0/766182797 learned_addr learned my addr 172.21.15.5:0/766182797 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:36.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 10 monclient(hunting): get_auth_request con 0x7f6e1c137e20 auth_method 0 2024-08-18T21:13:36.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:36.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:36.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:36.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 10 monclient(hunting): handle_auth_done global_id 95225 payload 274 2024-08-18T21:13:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 1 -- 172.21.15.5:0/766182797 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e1c0a63e0 msgr2=0x7f6e1c1378e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 1 --2- 172.21.15.5:0/766182797 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e1c0a63e0 0x7f6e1c1378e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 1 -- 172.21.15.5:0/766182797 >> v2:172.21.15.157:3300/0 conn(0x7f6e1c0a5ac0 msgr2=0x7f6e1c0a5ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 1 --2- 172.21.15.5:0/766182797 >> v2:172.21.15.157:3300/0 conn(0x7f6e1c0a5ac0 0x7f6e1c0a5ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 10 monclient: _finish_hunting 0 2024-08-18T21:13:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 1 monclient: found mon.noname-h 2024-08-18T21:13:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:13:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.647+0000 7f6e209f8640 1 -- 172.21.15.5:0/766182797 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1c0a7660 con 0x7f6e1c137e20 2024-08-18T21:13:36.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e209f8640 1 -- 172.21.15.5:0/766182797 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6e1c137e20 msgr2=0x7f6e1c1382d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:36.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e209f8640 1 --2- 172.21.15.5:0/766182797 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6e1c137e20 0x7f6e1c1382d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009e50 tx=0x7f6e1401c930 comp rx=0 tx=0).ready entity=mon.5 client_cookie=67a97b26b103ff34 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:36.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e1affd640 1 -- 172.21.15.5:0/766182797 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6e140090d0 con 0x7f6e1c137e20 2024-08-18T21:13:36.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e1affd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:13:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e1affd640 10 monclient: dump: 2024-08-18T21:13:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e1affd640 10 monclient: _finish_auth 0 2024-08-18T21:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e1affd640 10 monclient: _check_auth_tickets 2024-08-18T21:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e1affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e1affd640 1 -- 172.21.15.5:0/766182797 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e140a5af0 con 0x7f6e1c137e20 2024-08-18T21:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e1affd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e2245b640 5 monclient: authenticate success, global_id 95225 2024-08-18T21:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e2245b640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e2245b640 4 set_mon_vals no callback set 2024-08-18T21:13:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e1affd640 1 -- 172.21.15.5:0/766182797 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6e140a5ce0 con 0x7f6e1c137e20 2024-08-18T21:13:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e1affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:13:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.651+0000 7f6e1affd640 10 monclient: dump: 2024-08-18T21:13:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 10 monclient: shutdown 2024-08-18T21:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 -- 172.21.15.5:0/766182797 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6e1c137e20 msgr2=0x7f6e1c1382d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 --2- 172.21.15.5:0/766182797 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6e1c137e20 0x7f6e1c1382d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009e50 tx=0x7f6e1401c930 comp rx=0 tx=0).stop 2024-08-18T21:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 -- 172.21.15.5:0/766182797 shutdown_connections 2024-08-18T21:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 --2- 172.21.15.5:0/766182797 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6e1c137e20 0x7f6e1c1382d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 --2- 172.21.15.5:0/766182797 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e1c0a63e0 0x7f6e1c1378e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 --2- 172.21.15.5:0/766182797 >> v2:172.21.15.157:3300/0 conn(0x7f6e1c0a5ac0 0x7f6e1c0a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 -- 172.21.15.5:0/766182797 >> 172.21.15.5:0/766182797 conn(0x7f6e1c0aa770 msgr2=0x7f6e1c0a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 -- 172.21.15.5:0/766182797 shutdown_connections 2024-08-18T21:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 -- 172.21.15.5:0/766182797 wait complete. 2024-08-18T21:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 10 monclient: build_initial_monmap 2024-08-18T21:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 10 monclient: monmap: 2024-08-18T21:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 Processor -- start 2024-08-18T21:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 -- start start 2024-08-18T21:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 10 monclient: init 2024-08-18T21:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 10 monclient: _add_conns ranks=[2,6,8,3,1,4,5,0,7] 2024-08-18T21:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6e1c0a5ac0 0x7f6e1c1cf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 10 monclient(hunting): picked mon.noname-b con 0x7f6e1c0a5ac0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6e1c0a63e0 0x7f6e1c1cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 10 monclient(hunting): picked mon.noname-d con 0x7f6e1c0a63e0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6e1c137e20 0x7f6e1c1d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 10 monclient(hunting): picked mon.noname-e con 0x7f6e1c137e20 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f6e1c0a1dc0 con 0x7f6e1c0a5ac0 2024-08-18T21:13:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f6e1c0a1c40 con 0x7f6e1c0a63e0 2024-08-18T21:13:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f6e1c1417d0 con 0x7f6e1c137e20 2024-08-18T21:13:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e2245b640 10 monclient(hunting): authenticate will time out at 1583.670163s 2024-08-18T21:13:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e1b7fe640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6e1c0a63e0 msgr2=0x7f6e1c1cfca0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:13:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e1b7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6e1c0a63e0 0x7f6e1c1cfca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e1bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6e1c0a5ac0 0x7f6e1c1cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6e1c137e20 0x7f6e1c1d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e1bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6e1c0a5ac0 0x7f6e1c1cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:35138/0 (socket says 172.21.15.5:35138) 2024-08-18T21:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e1bfff640 1 -- 172.21.15.5:0/3247246853 learned_addr learned my addr 172.21.15.5:0/3247246853 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e1bfff640 10 monclient(hunting): get_auth_request con 0x7f6e1c0a5ac0 auth_method 0 2024-08-18T21:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e1bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 10 monclient(hunting): get_auth_request con 0x7f6e1c137e20 auth_method 0 2024-08-18T21:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 10 monclient(hunting): handle_auth_done global_id 114776 payload 824 2024-08-18T21:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 1 -- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6e1c0a63e0 msgr2=0x7f6e1c1cfca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 1 --2- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6e1c0a63e0 0x7f6e1c1cfca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 1 -- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6e1c0a5ac0 msgr2=0x7f6e1c1cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 1 --2- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6e1c0a5ac0 0x7f6e1c1cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 10 monclient: _finish_hunting 0 2024-08-18T21:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 1 monclient: found mon.noname-e 2024-08-18T21:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e209f8640 1 -- 172.21.15.5:0/3247246853 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1c13d690 con 0x7f6e1c137e20 2024-08-18T21:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.655+0000 7f6e1bfff640 1 --2- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6e1c0a5ac0 0x7f6e1c1cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e209f8640 1 -- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6e1c137e20 msgr2=0x7f6e1c1d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e209f8640 1 --2- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6e1c137e20 0x7f6e1c1d01e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6e140ab000 tx=0x7f6e140196d0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e209f8640 1 --2- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6e1c137e20 0x7f6e1c1d01e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6e140ab000 tx=0x7f6e140196d0 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7f6e140bc030 mon_map magic: 0 2024-08-18T21:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e18ff9640 1 -- 172.21.15.5:0/3247246853 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6e140bc030 con 0x7f6e1c137e20 2024-08-18T21:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e18ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e18ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e18ff9640 10 monclient: dump: 2024-08-18T21:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e18ff9640 10 monclient: _finish_auth 0 2024-08-18T21:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e18ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e18ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e2245b640 5 monclient: authenticate success, global_id 114776 2024-08-18T21:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e2245b640 10 monclient: _renew_subs 2024-08-18T21:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e2245b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e18ff9640 1 -- 172.21.15.5:0/3247246853 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e14003dc0 con 0x7f6e1c137e20 2024-08-18T21:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e2245b640 1 -- 172.21.15.5:0/3247246853 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1c138230 con 0x7f6e1c137e20 2024-08-18T21:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e18ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e2245b640 10 monclient: _renew_subs 2024-08-18T21:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e2245b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e1a7fc640 4 set_mon_vals no callback set 2024-08-18T21:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e2245b640 1 -- 172.21.15.5:0/3247246853 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e1c122430 con 0x7f6e1c137e20 2024-08-18T21:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e2245b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e2245b640 1 --2- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1c13bc80 0x7f6e1c13c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e2245b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e2245b640 1 -- 172.21.15.5:0/3247246853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c1220b0 con 0x7f6e1c13bc80 2024-08-18T21:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e1bfff640 1 --2- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1c13bc80 0x7f6e1c13c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e1bfff640 10 monclient: get_auth_request con 0x7f6e1c13bc80 auth_method 0 2024-08-18T21:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e1bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e18ff9640 1 -- 172.21.15.5:0/3247246853 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6e140b7450 con 0x7f6e1c137e20 2024-08-18T21:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e18ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e18ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e18ff9640 10 monclient: dump: 2024-08-18T21:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e18ff9640 1 -- 172.21.15.5:0/3247246853 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f6e140bf070 con 0x7f6e1c137e20 2024-08-18T21:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e1bfff640 10 monclient(hunting): handle_auth_done global_id 124299 payload 824 2024-08-18T21:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e1bfff640 1 -- 172.21.15.5:0/3247246853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e1c0a5ea0 con 0x7f6e1c13bc80 2024-08-18T21:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e18ff9640 1 --2- 172.21.15.5:0/3247246853 >> v2:172.21.15.157:6812/631023601 conn(0x7f6e0803be40 0x7f6e0803e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e1b7fe640 1 --2- 172.21.15.5:0/3247246853 >> v2:172.21.15.157:6812/631023601 conn(0x7f6e0803be40 0x7f6e0803e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.659+0000 7f6e1b7fe640 10 monclient: get_auth_request con 0x7f6e0803be40 auth_method 0 2024-08-18T21:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.663+0000 7f6e1bfff640 1 -- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1c13bc80 msgr2=0x7f6e1c13c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.663+0000 7f6e1bfff640 1 --2- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1c13bc80 0x7f6e1c13c060 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c005320 tx=0x7f6e0c0057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.663+0000 7f6e18ff9640 1 -- 172.21.15.5:0/3247246853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6e0c016070 con 0x7f6e1c13bc80 2024-08-18T21:13:36.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.663+0000 7f6e18ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:36.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.663+0000 7f6e18ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:13:36.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.663+0000 7f6e18ff9640 10 monclient: dump: 2024-08-18T21:13:36.675 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:36.675 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.675 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.675 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.675 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:36.675 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.675 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:36.675 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:36.675 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:36.675 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.663+0000 7f6e18ff9640 1 -- 172.21.15.5:0/3247246853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6e0c00ed90 con 0x7f6e1c13bc80 2024-08-18T21:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.663+0000 7f6e18ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.663+0000 7f6e18ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.663+0000 7f6e18ff9640 1 -- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1c13bc80 msgr2=0x7f6e1c13c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.663+0000 7f6e18ff9640 1 --2- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1c13bc80 0x7f6e1c13c060 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c005320 tx=0x7f6e0c0057e0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.663+0000 7f6e18ff9640 1 -- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1c13bc80 msgr2=0x7f6e1c13c060 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.663+0000 7f6e18ff9640 1 --2- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1c13bc80 0x7f6e1c13c060 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c005320 tx=0x7f6e0c0057e0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.663+0000 7f6e1b7fe640 1 --2- 172.21.15.5:0/3247246853 >> v2:172.21.15.157:6812/631023601 conn(0x7f6e0803be40 0x7f6e0803e300 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0a6ea0 tx=0x7f6e10006d10 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:36.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.667+0000 7f6e2245b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.667+0000 7f6e2245b640 1 --2- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1c13c5a0 0x7f6e1c09e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.667+0000 7f6e2245b640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.667+0000 7f6e2245b640 1 -- 172.21.15.5:0/3247246853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c051140 con 0x7f6e1c13c5a0 2024-08-18T21:13:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.667+0000 7f6e1bfff640 1 --2- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1c13c5a0 0x7f6e1c09e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.667+0000 7f6e1bfff640 10 monclient: get_auth_request con 0x7f6e1c13c5a0 auth_method 0 2024-08-18T21:13:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.667+0000 7f6e1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.667+0000 7f6e1bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.667+0000 7f6e1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.667+0000 7f6e1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.667+0000 7f6e1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.667+0000 7f6e1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.667+0000 7f6e1bfff640 10 monclient(hunting): handle_auth_done global_id 124308 payload 824 2024-08-18T21:13:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.667+0000 7f6e1bfff640 1 -- 172.21.15.5:0/3247246853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6e1c06d010 con 0x7f6e1c13c5a0 2024-08-18T21:13:36.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e1bfff640 1 -- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1c13c5a0 msgr2=0x7f6e1c09e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e1bfff640 1 --2- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1c13c5a0 0x7f6e1c09e960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c005320 tx=0x7f6e0c005980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e18ff9640 1 -- 172.21.15.5:0/3247246853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6e0c016040 con 0x7f6e1c13c5a0 2024-08-18T21:13:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e18ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e18ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:13:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e18ff9640 10 monclient: dump: 2024-08-18T21:13:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:36.681 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e18ff9640 1 -- 172.21.15.5:0/3247246853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9205 (secure 0 0 0) 0x7f6e0c005c00 con 0x7f6e1c13c5a0 2024-08-18T21:13:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e18ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e18ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e18ff9640 1 -- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1c13c5a0 msgr2=0x7f6e1c09e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e18ff9640 1 --2- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1c13c5a0 0x7f6e1c09e960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c005320 tx=0x7f6e0c005980 comp rx=0 tx=0).stop 2024-08-18T21:13:36.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e18ff9640 1 -- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1c13c5a0 msgr2=0x7f6e1c09e960 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:36.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e18ff9640 1 --2- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1c13c5a0 0x7f6e1c09e960 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c005320 tx=0x7f6e0c005980 comp rx=0 tx=0).stop 2024-08-18T21:13:36.682 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:36.682 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:36.682 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:36.683 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:13:36.683 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 216, 2024-08-18T21:13:36.683 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 63651, 2024-08-18T21:13:36.683 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:36.683 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:36.683 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:36.683 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:36.683 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:36.683 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:36.683 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:36.683 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:13:36.683 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:36.683 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:36.684 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:36.684 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:36.684 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:36.684 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:36.684 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:36.684 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:36.684 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:36.684 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:36.684 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:36.684 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:36.684 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:36.684 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:36.684 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:36.684 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:36.685 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:36.685 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:36.685 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:36.685 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:36.685 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:36.685 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:36.685 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:36.685 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:36.685 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:36.685 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:36.685 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:36.685 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:36.685 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.686 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:36.686 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:36.686 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:36.686 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:36.686 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:36.686 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:36.686 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:36.686 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:36.686 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:36.686 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:36.686 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:36.687 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:36.687 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:36.687 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:36.687 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:36.687 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:36.687 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:36.687 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:36.687 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:36.687 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:36.687 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:36.687 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:36.687 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:36.687 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:36.687 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:36.688 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:36.688 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:36.688 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:36.688 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:36.688 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:36.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.688 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:36.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.688 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:36.688 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:36.688 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:36.689 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:36.689 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.689 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:36.689 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:36.690 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.690 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.690 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.690 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:36.690 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:36.690 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.690 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:36.690 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:36.691 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.691 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.691 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:36.691 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:36.691 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.691 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.691 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.692 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:36.692 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:36.692 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:36.692 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:36.692 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.693 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.693 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:36.693 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:36.693 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.693 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.693 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.693 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:36.693 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:36.693 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:36.694 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:36.694 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.694 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.694 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:36.695 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:36.695 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.695 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.695 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.695 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:36.695 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:36.695 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:36.695 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.696 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.696 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:36.696 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.696 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.696 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.696 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:36.696 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:36.696 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.696 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.696 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.697 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:36.697 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:36.697 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.697 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:36.697 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.697 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:36.698 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.698 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.698 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:36.698 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:36.698 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.698 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.698 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.698 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:36.698 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:36.699 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.699 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:36.699 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.699 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:36.699 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.699 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.699 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:36.700 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:36.700 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.700 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.700 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.700 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:36.700 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:36.700 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.700 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.700 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.700 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:36.701 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.701 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.701 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:36.701 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.701 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.701 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.701 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:36.701 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:36.701 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.701 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.702 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.702 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:36.702 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:36.702 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.702 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.702 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.702 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:36.702 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.703 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.703 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:36.703 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.703 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.703 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.703 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:36.703 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:36.703 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.703 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.703 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.703 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.703 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.704 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:36.704 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:36.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.704 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:36.704 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:36.704 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:36.704 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.704 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:36.704 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:36.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.705 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:36.705 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:36.705 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:36.705 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.705 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.705 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:36.705 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:36.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e2245b640 1 -- 172.21.15.5:0/3247246853 >> v2:172.21.15.157:6812/631023601 conn(0x7f6e0803be40 msgr2=0x7f6e0803e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e2245b640 1 --2- 172.21.15.5:0/3247246853 >> v2:172.21.15.157:6812/631023601 conn(0x7f6e0803be40 0x7f6e0803e300 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0a6ea0 tx=0x7f6e10006d10 comp rx=0 tx=0).stop 2024-08-18T21:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e2245b640 10 monclient: shutdown 2024-08-18T21:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e2245b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e2245b640 1 -- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6e1c137e20 msgr2=0x7f6e1c1d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e2245b640 1 --2- 172.21.15.5:0/3247246853 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6e1c137e20 0x7f6e1c1d01e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6e140ab000 tx=0x7f6e140196d0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e209f8640 1 -- 172.21.15.5:0/3247246853 reap_dead start 2024-08-18T21:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e209f8640 1 -- 172.21.15.5:0/3247246853 reap_dead start 2024-08-18T21:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e18ff9640 1 -- 172.21.15.5:0/3247246853 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(266..266 src has 22..266) ==== 3898+0+0 (unknown 0 0 0) 0x7f6e140bd070 con 0x7f6e1c137e20 2024-08-18T21:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e2245b640 1 -- 172.21.15.5:0/3247246853 shutdown_connections 2024-08-18T21:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e2245b640 1 -- 172.21.15.5:0/3247246853 >> 172.21.15.5:0/3247246853 conn(0x7f6e1c0aa770 msgr2=0x7f6e1c09dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e2245b640 1 -- 172.21.15.5:0/3247246853 shutdown_connections 2024-08-18T21:13:36.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.671+0000 7f6e2245b640 1 -- 172.21.15.5:0/3247246853 wait complete. 2024-08-18T21:13:36.708 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:13:36.708 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon b 2024-08-18T21:13:36.708 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:13:36.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 10 monclient: get_monmap_and_config 2024-08-18T21:13:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 10 monclient: build_initial_monmap 2024-08-18T21:13:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 10 monclient: monmap: 2024-08-18T21:13:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:36.828902+0000 2024-08-18T21:13:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:36.828902+0000 2024-08-18T21:13:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:36.826 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 1 Processor -- start 2024-08-18T21:13:36.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 1 -- start start 2024-08-18T21:13:36.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 10 monclient: init 2024-08-18T21:13:36.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:36.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 10 monclient: _add_conns ranks=[8,2,10,7,0,3,1,5,4,9,6] 2024-08-18T21:13:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0bc40a59e0 0x7f0bc40a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 10 monclient(hunting): picked mon.noname-e con 0x7f0bc40a59e0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc40a6300 0x7f0bc4137800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 10 monclient(hunting): picked mon.noname-b con 0x7f0bc40a6300 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0bc4137d40 0x7f0bc4138190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 10 monclient(hunting): picked mon.noname-f con 0x7f0bc4137d40 addr v2:172.21.15.157:3300/0 2024-08-18T21:13:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f0bc40a0f40 con 0x7f0bc4137d40 2024-08-18T21:13:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f0bc40a3010 con 0x7f0bc40a6300 2024-08-18T21:13:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f0bc40a38b0 con 0x7f0bc40a59e0 2024-08-18T21:13:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc8f8d640 10 monclient(hunting): authenticate will time out at 1583.841895s 2024-08-18T21:13:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc259c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0bc40a59e0 0x7f0bc40a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc2d9d640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7f0bc4137d40 msgr2=0x7f0bc4138190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:13:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc2d9d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0bc4137d40 0x7f0bc4138190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc259c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0bc40a59e0 0x7f0bc40a5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:39664/0 (socket says 172.21.15.5:39664) 2024-08-18T21:13:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc259c640 1 -- 172.21.15.5:0/956289207 learned_addr learned my addr 172.21.15.5:0/956289207 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc40a6300 0x7f0bc4137800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc259c640 10 monclient(hunting): get_auth_request con 0x7f0bc40a59e0 auth_method 0 2024-08-18T21:13:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 10 monclient(hunting): get_auth_request con 0x7f0bc40a6300 auth_method 0 2024-08-18T21:13:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 10 monclient(hunting): handle_auth_done global_id 114608 payload 274 2024-08-18T21:13:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 1 -- 172.21.15.5:0/956289207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0bc40a59e0 msgr2=0x7f0bc40a5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 1 --2- 172.21.15.5:0/956289207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0bc40a59e0 0x7f0bc40a5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 1 -- 172.21.15.5:0/956289207 >> v2:172.21.15.157:3300/0 conn(0x7f0bc4137d40 msgr2=0x7f0bc4138190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 1 --2- 172.21.15.5:0/956289207 >> v2:172.21.15.157:3300/0 conn(0x7f0bc4137d40 0x7f0bc4138190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:13:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 1 monclient: found mon.noname-b 2024-08-18T21:13:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:13:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc1d9b640 1 -- 172.21.15.5:0/956289207 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc40a35d0 con 0x7f0bc40a6300 2024-08-18T21:13:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.827+0000 7f0bc259c640 1 --2- 172.21.15.5:0/956289207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0bc40a59e0 0x7f0bc40a5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:36.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc1d9b640 1 -- 172.21.15.5:0/956289207 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc40a6300 msgr2=0x7f0bc4137800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:36.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc1d9b640 1 --2- 172.21.15.5:0/956289207 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc40a6300 0x7f0bc4137800 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0bb80097f0 tx=0x7f0bb801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44e731bbb9489ff9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:36.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc159a640 1 -- 172.21.15.5:0/956289207 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0bb80b0070 con 0x7f0bc40a6300 2024-08-18T21:13:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc159a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:13:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc159a640 10 monclient: dump: 2024-08-18T21:13:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:36.837 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc159a640 10 monclient: _finish_auth 0 2024-08-18T21:13:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc159a640 10 monclient: _check_auth_tickets 2024-08-18T21:13:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc159a640 1 -- 172.21.15.5:0/956289207 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb80aa810 con 0x7f0bc40a6300 2024-08-18T21:13:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc159a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc159a640 1 -- 172.21.15.5:0/956289207 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0bb80a9300 con 0x7f0bc40a6300 2024-08-18T21:13:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc8f8d640 5 monclient: authenticate success, global_id 114608 2024-08-18T21:13:36.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:36.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc159a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:36.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc159a640 10 monclient: dump: 2024-08-18T21:13:36.838 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:36.838 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.838 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.838 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.838 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:36.838 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.838 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:36.838 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:36.838 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:36.838 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:36.838 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:36.839 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:36.839 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:36.839 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:36.839 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:36.839 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc8f8d640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:36.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc8f8d640 4 set_mon_vals no callback set 2024-08-18T21:13:36.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc8f8d640 10 monclient: shutdown 2024-08-18T21:13:36.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc8f8d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:36.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc8f8d640 1 -- 172.21.15.5:0/956289207 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc40a6300 msgr2=0x7f0bc4137800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:36.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc8f8d640 1 --2- 172.21.15.5:0/956289207 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc40a6300 0x7f0bc4137800 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0bb80097f0 tx=0x7f0bb801c380 comp rx=0 tx=0).stop 2024-08-18T21:13:36.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc8f8d640 1 -- 172.21.15.5:0/956289207 shutdown_connections 2024-08-18T21:13:36.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc8f8d640 1 --2- 172.21.15.5:0/956289207 >> v2:172.21.15.157:3300/0 conn(0x7f0bc4137d40 0x7f0bc4138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc8f8d640 1 --2- 172.21.15.5:0/956289207 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc40a6300 0x7f0bc4137800 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc8f8d640 1 --2- 172.21.15.5:0/956289207 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0bc40a59e0 0x7f0bc40a5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc8f8d640 1 -- 172.21.15.5:0/956289207 >> 172.21.15.5:0/956289207 conn(0x7f0bc40aa5d0 msgr2=0x7f0bc40a6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc8f8d640 1 -- 172.21.15.5:0/956289207 shutdown_connections 2024-08-18T21:13:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.831+0000 7f0bc8f8d640 1 -- 172.21.15.5:0/956289207 wait complete. 2024-08-18T21:13:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 10 monclient: build_initial_monmap 2024-08-18T21:13:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 10 monclient: monmap: 2024-08-18T21:13:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:36.841 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:36.841 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:36.841 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:36.841 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:36.841 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:36.841 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:36.841 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:36.841 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:36.841 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 1 Processor -- start 2024-08-18T21:13:36.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 1 -- start start 2024-08-18T21:13:36.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 10 monclient: init 2024-08-18T21:13:36.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:36.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 10 monclient: _add_conns ranks=[0,2,8,5,3,7,1,4,6] 2024-08-18T21:13:36.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bc40a59e0 0x7f0bc41347f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 10 monclient(hunting): picked mon.noname-a con 0x7f0bc40a59e0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:13:36.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc40a6300 0x7f0bc4139b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 10 monclient(hunting): picked mon.noname-b con 0x7f0bc40a6300 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:36.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0bc4137d40 0x7f0bc413a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 10 monclient(hunting): picked mon.noname-e con 0x7f0bc4137d40 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:36.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc40a66e0 con 0x7f0bc40a59e0 2024-08-18T21:13:36.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f0bc40a1bd0 con 0x7f0bc40a6300 2024-08-18T21:13:36.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f0bc413d1a0 con 0x7f0bc4137d40 2024-08-18T21:13:36.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:36.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc8f8d640 10 monclient(hunting): authenticate will time out at 1583.849168s 2024-08-18T21:13:36.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0bc4137d40 0x7f0bc413a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc1d9b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc40a6300 0x7f0bc4139b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0bc4137d40 0x7f0bc413a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:39678/0 (socket says 172.21.15.5:39678) 2024-08-18T21:13:36.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 1 -- 172.21.15.5:0/1964796280 learned_addr learned my addr 172.21.15.5:0/1964796280 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:36.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc1d9b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc40a6300 0x7f0bc4139b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:35170/0 (socket says 172.21.15.5:35170) 2024-08-18T21:13:36.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 10 monclient(hunting): get_auth_request con 0x7f0bc4137d40 auth_method 0 2024-08-18T21:13:36.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:36.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:36.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:36.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc259c640 1 --2- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bc40a59e0 0x7f0bc41347f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc1d9b640 10 monclient(hunting): get_auth_request con 0x7f0bc40a6300 auth_method 0 2024-08-18T21:13:36.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:36.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc1d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:36.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:36.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc259c640 10 monclient(hunting): get_auth_request con 0x7f0bc40a59e0 auth_method 0 2024-08-18T21:13:36.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:36.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:36.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:36.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:36.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:36.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:36.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 10 monclient(hunting): handle_auth_done global_id 114794 payload 824 2024-08-18T21:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 1 -- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc40a6300 msgr2=0x7f0bc4139b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 1 --2- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc40a6300 0x7f0bc4139b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 1 -- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bc40a59e0 msgr2=0x7f0bc41347f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 1 --2- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bc40a59e0 0x7f0bc41347f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 10 monclient: _finish_hunting 0 2024-08-18T21:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 1 monclient: found mon.noname-e 2024-08-18T21:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:13:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc2d9d640 1 -- 172.21.15.5:0/1964796280 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc413bf60 con 0x7f0bc4137d40 2024-08-18T21:13:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.835+0000 7f0bc1d9b640 1 --2- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc40a6300 0x7f0bc4139b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc2d9d640 1 -- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0bc4137d40 msgr2=0x7f0bc413a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc2d9d640 1 --2- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0bc4137d40 0x7f0bc413a0d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00b440 tx=0x7f0bbc009f90 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 1 -- 172.21.15.5:0/1964796280 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0bbc017070 con 0x7f0bc4137d40 2024-08-18T21:13:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:13:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 10 monclient: dump: 2024-08-18T21:13:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:36.853 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 10 monclient: _finish_auth 0 2024-08-18T21:13:36.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:13:36.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:36.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 1 -- 172.21.15.5:0/1964796280 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bbc003d90 con 0x7f0bc4137d40 2024-08-18T21:13:36.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc8f8d640 5 monclient: authenticate success, global_id 114794 2024-08-18T21:13:36.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc8f8d640 10 monclient: _renew_subs 2024-08-18T21:13:36.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc8f8d640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:36.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc8f8d640 1 -- 172.21.15.5:0/1964796280 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc413d480 con 0x7f0bc4137d40 2024-08-18T21:13:36.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:36.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 1 -- 172.21.15.5:0/1964796280 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0bbc006540 con 0x7f0bc4137d40 2024-08-18T21:13:36.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:36.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:36.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 10 monclient: dump: 2024-08-18T21:13:36.854 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:36.854 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.854 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.854 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.854 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:36.854 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.854 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:36.854 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:36.854 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:36.854 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:36.854 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:36.854 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:36.855 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc0d99640 4 set_mon_vals no callback set 2024-08-18T21:13:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc8f8d640 10 monclient: _renew_subs 2024-08-18T21:13:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc8f8d640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:13:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc8f8d640 1 -- 172.21.15.5:0/1964796280 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc413cec0 con 0x7f0bc4137d40 2024-08-18T21:13:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc8f8d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc8f8d640 1 --2- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc413bae0 0x7f0bc413a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc8f8d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc8f8d640 1 -- 172.21.15.5:0/1964796280 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f0bc40a6860 con 0x7f0bc413bae0 2024-08-18T21:13:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc259c640 1 --2- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc413bae0 0x7f0bc413a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc259c640 10 monclient: get_auth_request con 0x7f0bc413bae0 auth_method 0 2024-08-18T21:13:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 1 -- 172.21.15.5:0/1964796280 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f0bbc0060d0 con 0x7f0bc4137d40 2024-08-18T21:13:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc259c640 10 monclient(hunting): handle_auth_done global_id 114626 payload 824 2024-08-18T21:13:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc259c640 1 -- 172.21.15.5:0/1964796280 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0bc4137800 con 0x7f0bc413bae0 2024-08-18T21:13:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 1 --2- 172.21.15.5:0/1964796280 >> v2:172.21.15.157:6812/631023601 conn(0x7f0ba403bdc0 0x7f0ba403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 1 -- 172.21.15.5:0/1964796280 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(266..266 src has 22..266) ==== 3898+0+0 (secure 0 0 0) 0x7f0bbc04d7f0 con 0x7f0bc4137d40 2024-08-18T21:13:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc1d9b640 1 --2- 172.21.15.5:0/1964796280 >> v2:172.21.15.157:6812/631023601 conn(0x7f0ba403bdc0 0x7f0ba403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc1d9b640 10 monclient: get_auth_request con 0x7f0ba403bdc0 auth_method 0 2024-08-18T21:13:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc259c640 1 -- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc413bae0 msgr2=0x7f0bc413a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bc259c640 1 --2- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc413bae0 0x7f0bc413a610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009e60 tx=0x7f0bb400f580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 1 -- 172.21.15.5:0/1964796280 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0bb4019070 con 0x7f0bc413bae0 2024-08-18T21:13:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.839+0000 7f0bb2ffd640 10 monclient: dump: 2024-08-18T21:13:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:36.858 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.843+0000 7f0bb2ffd640 1 -- 172.21.15.5:0/1964796280 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0bb401e450 con 0x7f0bc413bae0 2024-08-18T21:13:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.843+0000 7f0bb2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.843+0000 7f0bb2ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.843+0000 7f0bb2ffd640 1 -- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc413bae0 msgr2=0x7f0bc413a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.843+0000 7f0bb2ffd640 1 --2- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc413bae0 0x7f0bc413a610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009e60 tx=0x7f0bb400f580 comp rx=0 tx=0).stop 2024-08-18T21:13:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.843+0000 7f0bb2ffd640 1 -- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc413bae0 msgr2=0x7f0bc413a610 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.843+0000 7f0bb2ffd640 1 --2- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc413bae0 0x7f0bc413a610 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009e60 tx=0x7f0bb400f580 comp rx=0 tx=0).stop 2024-08-18T21:13:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.843+0000 7f0bc1d9b640 1 --2- 172.21.15.5:0/1964796280 >> v2:172.21.15.157:6812/631023601 conn(0x7f0ba403bdc0 0x7f0ba403e280 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40a7a00 tx=0x7f0bb80a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.847+0000 7f0bc8f8d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.847+0000 7f0bc8f8d640 1 --2- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc4134d30 0x7f0bc413ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.847+0000 7f0bc8f8d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.847+0000 7f0bc8f8d640 1 -- 172.21.15.5:0/1964796280 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f0bc4051140 con 0x7f0bc4134d30 2024-08-18T21:13:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.847+0000 7f0bc259c640 1 --2- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc4134d30 0x7f0bc413ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.847+0000 7f0bc259c640 10 monclient: get_auth_request con 0x7f0bc4134d30 auth_method 0 2024-08-18T21:13:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.847+0000 7f0bc259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.847+0000 7f0bc259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.847+0000 7f0bc259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.847+0000 7f0bc259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.847+0000 7f0bc259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.847+0000 7f0bc259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.847+0000 7f0bc259c640 10 monclient(hunting): handle_auth_done global_id 114635 payload 824 2024-08-18T21:13:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.847+0000 7f0bc259c640 1 -- 172.21.15.5:0/1964796280 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0bc406d0f0 con 0x7f0bc4134d30 2024-08-18T21:13:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bc259c640 1 -- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc4134d30 msgr2=0x7f0bc413ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bc259c640 1 --2- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc4134d30 0x7f0bc413ab50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0bb401b000 tx=0x7f0bb4004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bb2ffd640 1 -- 172.21.15.5:0/1964796280 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0bb40039a0 con 0x7f0bc4134d30 2024-08-18T21:13:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bb2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bb2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bb2ffd640 10 monclient: dump: 2024-08-18T21:13:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:36.861 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bb2ffd640 1 -- 172.21.15.5:0/1964796280 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9204 (secure 0 0 0) 0x7f0bb4015a80 con 0x7f0bc4134d30 2024-08-18T21:13:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bb2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bb2ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:36.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bb2ffd640 1 -- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc4134d30 msgr2=0x7f0bc413ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:36.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bb2ffd640 1 --2- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc4134d30 0x7f0bc413ab50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0bb401b000 tx=0x7f0bb4004a50 comp rx=0 tx=0).stop 2024-08-18T21:13:36.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bb2ffd640 1 -- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc4134d30 msgr2=0x7f0bc413ab50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:36.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bb2ffd640 1 --2- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0bc4134d30 0x7f0bc413ab50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:36.862 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:36.862 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:36.862 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:36.862 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:36.862 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 216, 2024-08-18T21:13:36.863 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 122006, 2024-08-18T21:13:36.863 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:36.863 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:36.863 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:36.863 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:36.863 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:36.863 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:36.863 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:36.863 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:13:36.863 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:36.863 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:36.863 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:36.863 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:36.863 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:36.864 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:36.864 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:36.864 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:36.864 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:36.864 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:36.864 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:36.864 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:36.864 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:36.864 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:36.864 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:36.864 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:36.864 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:36.864 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:36.864 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:36.865 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:36.865 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:36.865 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:36.865 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:36.865 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:36.865 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:36.865 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:36.865 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:36.865 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:36.865 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.865 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:36.865 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:36.866 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:36.866 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:36.866 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:36.866 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:36.866 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:36.866 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:36.866 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:36.866 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:36.866 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:36.866 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:36.866 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:36.866 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:36.866 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.870 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:36.870 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:36.870 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.870 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.870 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.870 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:36.870 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.870 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.870 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:36.871 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.871 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.871 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:36.871 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:36.871 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.871 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.871 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.871 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:36.871 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:36.871 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:36.872 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:36.872 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.872 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.872 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:36.873 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:36.873 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.873 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.873 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.873 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:36.873 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:36.873 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.873 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.873 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.873 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:36.873 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.874 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:36.874 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.874 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.874 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.874 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:36.874 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:36.874 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.874 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.874 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.875 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:36.875 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:36.875 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.875 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:36.875 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.875 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:36.875 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.876 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.876 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.876 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:36.876 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:36.876 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.876 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.876 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.876 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:36.876 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:36.876 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.877 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:36.877 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.877 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:36.877 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.877 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.877 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:36.878 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:36.878 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.878 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.878 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.878 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:36.878 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:36.878 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:36.884 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bc8f8d640 1 -- 172.21.15.5:0/1964796280 >> v2:172.21.15.157:6812/631023601 conn(0x7f0ba403bdc0 msgr2=0x7f0ba403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bc8f8d640 1 --2- 172.21.15.5:0/1964796280 >> v2:172.21.15.157:6812/631023601 conn(0x7f0ba403bdc0 0x7f0ba403e280 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40a7a00 tx=0x7f0bb80a6000 comp rx=0 tx=0).stop 2024-08-18T21:13:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bc8f8d640 10 monclient: shutdown 2024-08-18T21:13:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bc8f8d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bc8f8d640 1 -- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0bc4137d40 msgr2=0x7f0bc413a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bc8f8d640 1 --2- 172.21.15.5:0/1964796280 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0bc4137d40 0x7f0bc413a0d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00b440 tx=0x7f0bbc009f90 comp rx=0 tx=0).stop 2024-08-18T21:13:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bc2d9d640 1 -- 172.21.15.5:0/1964796280 reap_dead start 2024-08-18T21:13:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bc2d9d640 1 -- 172.21.15.5:0/1964796280 reap_dead start 2024-08-18T21:13:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bc8f8d640 1 -- 172.21.15.5:0/1964796280 shutdown_connections 2024-08-18T21:13:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bc8f8d640 1 -- 172.21.15.5:0/1964796280 >> 172.21.15.5:0/1964796280 conn(0x7f0bc40aa5d0 msgr2=0x7f0bc40a8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bc8f8d640 1 -- 172.21.15.5:0/1964796280 shutdown_connections 2024-08-18T21:13:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:36.851+0000 7f0bc8f8d640 1 -- 172.21.15.5:0/1964796280 wait complete. 2024-08-18T21:13:36.887 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:13:36.887 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon c 2024-08-18T21:13:36.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:13:37.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 10 monclient: get_monmap_and_config 2024-08-18T21:13:37.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 10 monclient: build_initial_monmap 2024-08-18T21:13:37.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 10 monclient: monmap: 2024-08-18T21:13:37.005 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:37.006 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:37.006 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:37.009542+0000 2024-08-18T21:13:37.006 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:37.009542+0000 2024-08-18T21:13:37.006 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:37.006 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:37.006 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:37.006 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:37.006 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:37.006 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:37.006 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:37.007 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:37.007 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:37.007 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:37.007 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:37.007 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:37.007 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:37.007 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 1 Processor -- start 2024-08-18T21:13:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 1 -- start start 2024-08-18T21:13:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 10 monclient: init 2024-08-18T21:13:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 10 monclient: _add_conns ranks=[2,10,5,6,7,9,0,3,1,4,8] 2024-08-18T21:13:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f224c06ef90 0x7f224c0a6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 10 monclient(hunting): picked mon.noname-b con 0x7f224c06ef90 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f224c0a71b0 0x7f224c0a7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 10 monclient(hunting): picked mon.noname-f con 0x7f224c0a71b0 addr v2:172.21.15.157:3300/0 2024-08-18T21:13:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f224c139a30 0x7f224c139e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 10 monclient(hunting): picked mon.noname-h con 0x7f224c139a30 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f224c0a7ad0 con 0x7f224c0a71b0 2024-08-18T21:13:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f224c06f370 con 0x7f224c06ef90 2024-08-18T21:13:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f224c0a8250 con 0x7f224c139a30 2024-08-18T21:13:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f2251589640 10 monclient(hunting): authenticate will time out at 1584.022707s 2024-08-18T21:13:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f224c06ef90 0x7f224c0a6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f224c06ef90 0x7f224c0a6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:35182/0 (socket says 172.21.15.5:35182) 2024-08-18T21:13:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 1 -- 172.21.15.5:0/3441743748 learned_addr learned my addr 172.21.15.5:0/3441743748 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 10 monclient(hunting): get_auth_request con 0x7f224c06ef90 auth_method 0 2024-08-18T21:13:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224a7fc640 1 -- 172.21.15.5:0/3441743748 >> v2:172.21.15.157:3300/0 conn(0x7f224c0a71b0 msgr2=0x7f224c0a7590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:13:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224a7fc640 1 --2- 172.21.15.5:0/3441743748 >> v2:172.21.15.157:3300/0 conn(0x7f224c0a71b0 0x7f224c0a7590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224b7fe640 1 --2- 172.21.15.5:0/3441743748 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f224c139a30 0x7f224c139e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224b7fe640 10 monclient(hunting): get_auth_request con 0x7f224c139a30 auth_method 0 2024-08-18T21:13:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:37.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:37.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:37.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 10 monclient(hunting): handle_auth_done global_id 114644 payload 274 2024-08-18T21:13:37.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 1 -- 172.21.15.5:0/3441743748 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f224c139a30 msgr2=0x7f224c139e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:37.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 1 --2- 172.21.15.5:0/3441743748 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f224c139a30 0x7f224c139e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:37.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 1 -- 172.21.15.5:0/3441743748 >> v2:172.21.15.157:3300/0 conn(0x7f224c0a71b0 msgr2=0x7f224c0a7590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:37.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 1 --2- 172.21.15.5:0/3441743748 >> v2:172.21.15.157:3300/0 conn(0x7f224c0a71b0 0x7f224c0a7590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:37.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 10 monclient: _finish_hunting 0 2024-08-18T21:13:37.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 1 monclient: found mon.noname-b 2024-08-18T21:13:37.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:37.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:13:37.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.007+0000 7f224affd640 1 -- 172.21.15.5:0/3441743748 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f224c06f5e0 con 0x7f224c06ef90 2024-08-18T21:13:37.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f224affd640 1 -- 172.21.15.5:0/3441743748 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f224c06ef90 msgr2=0x7f224c0a6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:37.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f224affd640 1 --2- 172.21.15.5:0/3441743748 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f224c06ef90 0x7f224c0a6c70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f224c0a8400 tx=0x7f223c01c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25cf605e8c42e0e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:37.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2249ffb640 1 -- 172.21.15.5:0/3441743748 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f223c0b0070 con 0x7f224c06ef90 2024-08-18T21:13:37.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2249ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:37.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2249ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:13:37.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2249ffb640 10 monclient: dump: 2024-08-18T21:13:37.019 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:37.019 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:37.019 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:37.019 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:37.019 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:37.019 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:37.020 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2249ffb640 10 monclient: _finish_auth 0 2024-08-18T21:13:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2249ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:13:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2249ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2251589640 5 monclient: authenticate success, global_id 114644 2024-08-18T21:13:37.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2251589640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:13:37.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2249ffb640 1 -- 172.21.15.5:0/3441743748 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f223c0aa810 con 0x7f224c06ef90 2024-08-18T21:13:37.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2249ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:37.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2251589640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:37.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2251589640 4 set_mon_vals no callback set 2024-08-18T21:13:37.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2249ffb640 1 -- 172.21.15.5:0/3441743748 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f223c0aae30 con 0x7f224c06ef90 2024-08-18T21:13:37.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2249ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:37.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2249ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:37.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.011+0000 7f2249ffb640 10 monclient: dump: 2024-08-18T21:13:37.021 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:37.021 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:37.021 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:37.021 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:37.022 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 10 monclient: shutdown 2024-08-18T21:13:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 -- 172.21.15.5:0/3441743748 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f224c06ef90 msgr2=0x7f224c0a6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 --2- 172.21.15.5:0/3441743748 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f224c06ef90 0x7f224c0a6c70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f224c0a8400 tx=0x7f223c01c420 comp rx=0 tx=0).stop 2024-08-18T21:13:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 -- 172.21.15.5:0/3441743748 shutdown_connections 2024-08-18T21:13:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 --2- 172.21.15.5:0/3441743748 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f224c139a30 0x7f224c139e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 --2- 172.21.15.5:0/3441743748 >> v2:172.21.15.157:3300/0 conn(0x7f224c0a71b0 0x7f224c0a7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 --2- 172.21.15.5:0/3441743748 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f224c06ef90 0x7f224c0a6c70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 -- 172.21.15.5:0/3441743748 >> 172.21.15.5:0/3441743748 conn(0x7f224c0accf0 msgr2=0x7f224c0a8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 -- 172.21.15.5:0/3441743748 shutdown_connections 2024-08-18T21:13:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 -- 172.21.15.5:0/3441743748 wait complete. 2024-08-18T21:13:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 10 monclient: build_initial_monmap 2024-08-18T21:13:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 10 monclient: monmap: 2024-08-18T21:13:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:37.024 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 Processor -- start 2024-08-18T21:13:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 -- start start 2024-08-18T21:13:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 10 monclient: init 2024-08-18T21:13:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 10 monclient: _add_conns ranks=[6,5,2,3,0,1,7,4,8] 2024-08-18T21:13:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f224c06ef90 0x7f224c1382b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 10 monclient(hunting): picked mon.noname-d con 0x7f224c06ef90 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f224c0a71b0 0x7f224c1387f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 10 monclient(hunting): picked mon.noname-h con 0x7f224c0a71b0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:13:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f224c139a30 0x7f224c13da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 10 monclient(hunting): picked mon.noname-b con 0x7f224c139a30 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f224c1436b0 con 0x7f224c139a30 2024-08-18T21:13:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f224c13a7b0 con 0x7f224c0a71b0 2024-08-18T21:13:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f224c143830 con 0x7f224c06ef90 2024-08-18T21:13:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f2251589640 10 monclient(hunting): authenticate will time out at 1584.029905s 2024-08-18T21:13:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224affd640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f224c06ef90 msgr2=0x7f224c1382b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:13:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224affd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f224c06ef90 0x7f224c1382b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f224c139a30 0x7f224c13da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f224c139a30 0x7f224c13da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:35192/0 (socket says 172.21.15.5:35192) 2024-08-18T21:13:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 1 -- 172.21.15.5:0/1097485591 learned_addr learned my addr 172.21.15.5:0/1097485591 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 10 monclient(hunting): get_auth_request con 0x7f224c139a30 auth_method 0 2024-08-18T21:13:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224a7fc640 1 --2- 172.21.15.5:0/1097485591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f224c0a71b0 0x7f224c1387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 10 monclient(hunting): handle_auth_done global_id 114653 payload 824 2024-08-18T21:13:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 1 -- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f224c06ef90 msgr2=0x7f224c1382b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:13:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 1 --2- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f224c06ef90 0x7f224c1382b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 1 -- 172.21.15.5:0/1097485591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f224c0a71b0 msgr2=0x7f224c1387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 1 --2- 172.21.15.5:0/1097485591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f224c0a71b0 0x7f224c1387f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:13:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 1 monclient: found mon.noname-b 2024-08-18T21:13:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:13:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224b7fe640 1 -- 172.21.15.5:0/1097485591 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f224c123c20 con 0x7f224c139a30 2024-08-18T21:13:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224a7fc640 10 monclient: get_auth_request con 0x7f224c0a71b0 auth_method 0 2024-08-18T21:13:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.015+0000 7f224a7fc640 1 --2- 172.21.15.5:0/1097485591 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f224c0a71b0 0x7f224c1387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:13:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f224b7fe640 1 -- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f224c139a30 msgr2=0x7f224c13da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f224b7fe640 1 --2- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f224c139a30 0x7f224c13da50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2244007e40 tx=0x7f224400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f22337fe640 1 -- 172.21.15.5:0/1097485591 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2244013a00 con 0x7f224c139a30 2024-08-18T21:13:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f22337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f22337fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:13:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f22337fe640 10 monclient: dump: 2024-08-18T21:13:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:37.029 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f22337fe640 10 monclient: _finish_auth 0 2024-08-18T21:13:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f22337fe640 10 monclient: _check_auth_tickets 2024-08-18T21:13:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f22337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f22337fe640 1 -- 172.21.15.5:0/1097485591 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2244019070 con 0x7f224c139a30 2024-08-18T21:13:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f2251589640 5 monclient: authenticate success, global_id 114653 2024-08-18T21:13:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f2251589640 10 monclient: _renew_subs 2024-08-18T21:13:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f2251589640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f2251589640 1 -- 172.21.15.5:0/1097485591 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f224c123f00 con 0x7f224c139a30 2024-08-18T21:13:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f22337fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f22337fe640 1 -- 172.21.15.5:0/1097485591 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2244013c00 con 0x7f224c139a30 2024-08-18T21:13:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f22337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f22337fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f22337fe640 10 monclient: dump: 2024-08-18T21:13:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:37.031 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:37.031 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:37.031 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:37.031 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:37.031 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:37.031 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:37.031 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:37.031 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:37.031 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:37.031 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:37.031 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:37.031 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:37.031 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:37.032 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f2248ff9640 4 set_mon_vals no callback set 2024-08-18T21:13:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f2251589640 10 monclient: _renew_subs 2024-08-18T21:13:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f2251589640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f2251589640 1 -- 172.21.15.5:0/1097485591 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f224c0abbf0 con 0x7f224c139a30 2024-08-18T21:13:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f2251589640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f2251589640 1 --2- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f224c13df90 0x7f224c13e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f2251589640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f2251589640 1 -- 172.21.15.5:0/1097485591 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f224c069fb0 con 0x7f224c13df90 2024-08-18T21:13:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f224affd640 1 --2- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f224c13df90 0x7f224c13e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f22337fe640 1 -- 172.21.15.5:0/1097485591 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f2244013590 con 0x7f224c139a30 2024-08-18T21:13:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f224affd640 10 monclient: get_auth_request con 0x7f224c13df90 auth_method 0 2024-08-18T21:13:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f224affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f224affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f224affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f224affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f224affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f224affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f22337fe640 1 --2- 172.21.15.5:0/1097485591 >> v2:172.21.15.157:6812/631023601 conn(0x7f223803bdf0 0x7f223803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f22337fe640 1 -- 172.21.15.5:0/1097485591 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(266..266 src has 22..266) ==== 3898+0+0 (secure 0 0 0) 0x7f224404f0a0 con 0x7f224c139a30 2024-08-18T21:13:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f224affd640 10 monclient(hunting): handle_auth_done global_id 114520 payload 824 2024-08-18T21:13:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f224affd640 1 -- 172.21.15.5:0/1097485591 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f224c124240 con 0x7f224c13df90 2024-08-18T21:13:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f224a7fc640 1 --2- 172.21.15.5:0/1097485591 >> v2:172.21.15.157:6812/631023601 conn(0x7f223803bdf0 0x7f223803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.019+0000 7f224a7fc640 10 monclient: get_auth_request con 0x7f223803bdf0 auth_method 0 2024-08-18T21:13:37.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.023+0000 7f224affd640 1 -- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f224c13df90 msgr2=0x7f224c13e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:37.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.023+0000 7f224affd640 1 --2- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f224c13df90 0x7f224c13e370 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f224c0746d0 tx=0x7f223c01ac60 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:37.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.023+0000 7f22337fe640 1 -- 172.21.15.5:0/1097485591 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f223c0b0040 con 0x7f224c13df90 2024-08-18T21:13:37.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.023+0000 7f22337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:37.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.023+0000 7f22337fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:13:37.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.023+0000 7f22337fe640 10 monclient: dump: 2024-08-18T21:13:37.036 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:37.036 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:37.036 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:37.036 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:37.037 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.023+0000 7f22337fe640 1 -- 172.21.15.5:0/1097485591 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f223c0bb070 con 0x7f224c13df90 2024-08-18T21:13:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.023+0000 7f22337fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:37.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.023+0000 7f22337fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:37.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.023+0000 7f22337fe640 1 -- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f224c13df90 msgr2=0x7f224c13e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:37.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.023+0000 7f22337fe640 1 --2- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f224c13df90 0x7f224c13e370 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f224c0746d0 tx=0x7f223c01ac60 comp rx=0 tx=0).stop 2024-08-18T21:13:37.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.023+0000 7f22337fe640 1 -- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f224c13df90 msgr2=0x7f224c13e370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:37.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.023+0000 7f22337fe640 1 --2- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f224c13df90 0x7f224c13e370 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:37.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.023+0000 7f224a7fc640 1 --2- 172.21.15.5:0/1097485591 >> v2:172.21.15.157:6812/631023601 conn(0x7f223803bdf0 0x7f223803e2b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2240006fd0 tx=0x7f2240008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:37.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.027+0000 7f2251589640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:37.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.027+0000 7f2251589640 1 --2- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f224c13e8b0 0x7f224c0a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:37.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.027+0000 7f2251589640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:37.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.027+0000 7f2251589640 1 -- 172.21.15.5:0/1097485591 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f224c051140 con 0x7f224c13e8b0 2024-08-18T21:13:37.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.027+0000 7f224affd640 1 --2- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f224c13e8b0 0x7f224c0a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:37.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.027+0000 7f224affd640 10 monclient: get_auth_request con 0x7f224c13e8b0 auth_method 0 2024-08-18T21:13:37.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.027+0000 7f224affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.027+0000 7f224affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.027+0000 7f224affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.027+0000 7f224affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.027+0000 7f224affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.027+0000 7f224affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.027+0000 7f224affd640 10 monclient(hunting): handle_auth_done global_id 114529 payload 824 2024-08-18T21:13:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.027+0000 7f224affd640 1 -- 172.21.15.5:0/1097485591 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f224c0a7590 con 0x7f224c13e8b0 2024-08-18T21:13:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f224affd640 1 -- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f224c13e8b0 msgr2=0x7f224c0a0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f224affd640 1 --2- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f224c13e8b0 0x7f224c0a0a50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f223c0ae040 tx=0x7f223c0191c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f22337fe640 1 -- 172.21.15.5:0/1097485591 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f223c0b0040 con 0x7f224c13e8b0 2024-08-18T21:13:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f22337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f22337fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:13:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f22337fe640 10 monclient: dump: 2024-08-18T21:13:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:37.041 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:37.041 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:37.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f22337fe640 1 -- 172.21.15.5:0/1097485591 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9371 (secure 0 0 0) 0x7f223c0c07c0 con 0x7f224c13e8b0 2024-08-18T21:13:37.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f22337fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:37.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f22337fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:37.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f22337fe640 1 -- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f224c13e8b0 msgr2=0x7f224c0a0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:37.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f22337fe640 1 --2- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f224c13e8b0 0x7f224c0a0a50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f223c0ae040 tx=0x7f223c0191c0 comp rx=0 tx=0).stop 2024-08-18T21:13:37.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f22337fe640 1 -- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f224c13e8b0 msgr2=0x7f224c0a0a50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:37.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f22337fe640 1 --2- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f224c13e8b0 0x7f224c0a0a50 secure :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f223c0ae040 tx=0x7f223c0191c0 comp rx=0 tx=0).stop 2024-08-18T21:13:37.041 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:37.042 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:37.042 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:37.042 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:37.042 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 216, 2024-08-18T21:13:37.042 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 122190, 2024-08-18T21:13:37.042 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:37.042 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:37.042 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:37.042 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:37.042 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:37.042 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:37.042 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:37.042 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:13:37.043 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:37.043 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:37.043 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:37.043 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:37.043 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:37.043 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:37.043 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:37.043 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:37.043 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:37.043 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:37.043 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:37.043 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:37.043 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:37.044 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:37.044 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:37.044 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:37.044 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:37.044 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:37.044 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:37.044 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:37.044 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:37.044 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:37.044 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:37.044 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:37.044 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:37.044 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:37.044 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:37.045 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:37.045 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:37.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.045 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:37.045 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:37.045 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:37.045 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:37.045 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:37.045 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:37.045 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:37.045 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:37.045 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:37.045 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:37.045 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:37.046 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:37.046 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:37.046 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:37.046 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:37.046 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:37.046 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:37.046 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:37.046 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:37.046 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:37.046 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:37.046 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:37.046 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:37.046 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:37.047 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:37.047 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:37.047 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:37.047 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:37.047 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:37.047 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:37.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.047 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:37.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.047 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:37.047 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:37.047 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:37.047 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:37.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.047 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:37.048 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:37.048 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.049 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.049 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:37.049 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:37.049 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.049 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:37.050 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:37.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.050 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:37.050 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:37.050 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:37.050 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:37.050 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:37.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.050 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:37.050 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:37.050 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:37.050 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:37.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.051 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:37.051 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:37.051 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.051 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:37.051 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:37.051 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.051 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:37.051 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:37.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.051 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:37.052 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:37.052 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:37.052 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:37.052 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:37.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.052 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:37.052 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:37.052 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:37.052 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:37.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.052 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:37.052 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:37.052 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.053 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:37.053 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:37.053 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.053 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:37.053 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:37.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.053 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:37.053 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:37.053 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:37.053 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:37.053 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:37.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.054 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:37.054 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:37.054 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:37.054 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:37.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.054 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:37.054 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:37.054 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.054 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:37.055 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:37.055 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.055 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:37.055 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:37.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.055 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:37.055 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:37.055 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:37.055 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:37.055 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:37.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.055 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.057 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:37.057 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:37.057 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:37.057 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:37.057 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:37.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.057 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:37.057 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:37.057 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:37.057 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:37.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.057 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:37.057 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:37.058 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.058 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:37.058 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:37.058 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.058 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:37.058 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:37.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.058 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:37.058 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:37.058 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:37.058 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:37.058 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:13:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 5 2024-08-18T21:13:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 6 2024-08-18T21:13:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:37.065 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:37.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f2251589640 1 -- 172.21.15.5:0/1097485591 >> v2:172.21.15.157:6812/631023601 conn(0x7f223803bdf0 msgr2=0x7f223803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:37.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f2251589640 1 --2- 172.21.15.5:0/1097485591 >> v2:172.21.15.157:6812/631023601 conn(0x7f223803bdf0 0x7f223803e2b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2240006fd0 tx=0x7f2240008040 comp rx=0 tx=0).stop 2024-08-18T21:13:37.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f2251589640 10 monclient: shutdown 2024-08-18T21:13:37.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f2251589640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:37.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f2251589640 1 -- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f224c139a30 msgr2=0x7f224c13da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:37.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f2251589640 1 --2- 172.21.15.5:0/1097485591 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f224c139a30 0x7f224c13da50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2244007e40 tx=0x7f224400e4b0 comp rx=0 tx=0).stop 2024-08-18T21:13:37.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f224b7fe640 1 -- 172.21.15.5:0/1097485591 reap_dead start 2024-08-18T21:13:37.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f224b7fe640 1 -- 172.21.15.5:0/1097485591 reap_dead start 2024-08-18T21:13:37.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f2251589640 1 -- 172.21.15.5:0/1097485591 shutdown_connections 2024-08-18T21:13:37.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f2251589640 1 -- 172.21.15.5:0/1097485591 >> 172.21.15.5:0/1097485591 conn(0x7f224c0accf0 msgr2=0x7f224c06de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:37.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f2251589640 1 -- 172.21.15.5:0/1097485591 shutdown_connections 2024-08-18T21:13:37.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.031+0000 7f2251589640 1 -- 172.21.15.5:0/1097485591 wait complete. 2024-08-18T21:13:37.068 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:13:37.068 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon e 2024-08-18T21:13:37.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:13:37.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 10 monclient: get_monmap_and_config 2024-08-18T21:13:37.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 10 monclient: build_initial_monmap 2024-08-18T21:13:37.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 10 monclient: monmap: 2024-08-18T21:13:37.185 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:37.185 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:37.185 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:37.188848+0000 2024-08-18T21:13:37.185 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:37.188848+0000 2024-08-18T21:13:37.185 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:37.185 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:37.185 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:37.185 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:37.185 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:37.186 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:37.186 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:37.186 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:37.186 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:37.186 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:37.186 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:37.186 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:37.186 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:37.186 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:37.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 1 Processor -- start 2024-08-18T21:13:37.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 1 -- start start 2024-08-18T21:13:37.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 10 monclient: init 2024-08-18T21:13:37.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:37.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 10 monclient: _add_conns ranks=[1,0,7,9,8,4,2,3,5,6,10] 2024-08-18T21:13:37.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7ff1880a6ce0 addr v1:172.21.15.157:6789/0 2024-08-18T21:13:37.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff1880a77d0 addr v1:172.21.15.5:6789/0 2024-08-18T21:13:37.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff188140400 0x7ff1881427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:37.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 10 monclient(hunting): picked mon.noname-i con 0x7ff188140400 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:37.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1880a45d0 con 0x7ff1880a77d0 2024-08-18T21:13:37.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1880a32d0 con 0x7ff1880a6ce0 2024-08-18T21:13:37.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:37.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7ff1880a5000 con 0x7ff188140400 2024-08-18T21:13:37.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:37.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18e89c640 10 monclient(hunting): authenticate will time out at 1584.202073s 2024-08-18T21:13:37.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18ce39640 1 -- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff188140400 msgr2=0x7ff1881427f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:13:37.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff187fff640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7ff1880a6ce0 legacy=0x7ff1880a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:13:37.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff17f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff1880a77d0 0x7ff18813ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56156/0 (socket says 172.21.15.5:56156) 2024-08-18T21:13:37.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff18ce39640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff188140400 0x7ff1881427f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:37.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.187+0000 7ff17f7fe640 1 -- 172.21.15.5:0/2124170600 learned_addr learned my addr 172.21.15.5:0/2124170600 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:13:37.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff17f7fe640 1 -- 172.21.15.5:0/2124170600 >> v1:172.21.15.5:6789/0 conn(0x7ff1880a77d0 legacy=0x7ff18813ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:37.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 -- 172.21.15.5:0/2124170600 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1239421717 0 0) 0x7ff1880a45d0 con 0x7ff1880a77d0 2024-08-18T21:13:37.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient(hunting): _negotiate 2024-08-18T21:13:37.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:37.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:37.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient(hunting): my global_id is 124326 2024-08-18T21:13:37.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 -- 172.21.15.5:0/2124170600 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff174003530 con 0x7ff1880a77d0 2024-08-18T21:13:37.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 -- 172.21.15.5:0/2124170600 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 447531969 0 0) 0x7ff174003530 con 0x7ff1880a77d0 2024-08-18T21:13:37.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff188140400 msgr2=0x7ff1881427f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:37.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff188140400 0x7ff1881427f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:37.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 -- 172.21.15.5:0/2124170600 >> v1:172.21.15.157:6789/0 conn(0x7ff1880a6ce0 legacy=0x7ff1880a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:37.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient: _finish_hunting 0 2024-08-18T21:13:37.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 monclient: found mon.noname-a-legacy 2024-08-18T21:13:37.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:37.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.5:6789/0 2024-08-18T21:13:37.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 -- 172.21.15.5:0/2124170600 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1880a8900 con 0x7ff1880a77d0 2024-08-18T21:13:37.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient: _finish_auth 0 2024-08-18T21:13:37.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient: _check_auth_tickets 2024-08-18T21:13:37.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:37.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 -- 172.21.15.5:0/2124170600 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 4141550541 0 0) 0x7ff170001c20 con 0x7ff1880a77d0 2024-08-18T21:13:37.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:37.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-08-18T21:13:37.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient: dump: 2024-08-18T21:13:37.193 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:37.193 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:37.193 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:37.193 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:37.193 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:37.193 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:37.193 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:37.193 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:37.193 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:37.193 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:37.193 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:37.193 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:37.193 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:37.193 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:37.194 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] but i'm connected to v1:172.21.15.5:6789/0, reconnecting 2024-08-18T21:13:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 -- 172.21.15.5:0/2124170600 >> v1:172.21.15.5:6789/0 conn(0x7ff1880a77d0 legacy=0x7ff18813ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient: _add_conns ranks=[3,6,1,4,0,7,5,2,8] 2024-08-18T21:13:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff174004240 0x7ff174004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient(hunting): picked mon.g con 0x7ff174004240 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff174004f50 0x7ff1740099c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient(hunting): picked mon.d con 0x7ff174004f50 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff174009f00 0x7ff17400c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient(hunting): picked mon.f con 0x7ff174009f00 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:13:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:37.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 -- 172.21.15.5:0/2124170600 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff17400cb30 con 0x7ff174009f00 2024-08-18T21:13:37.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:37.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 -- 172.21.15.5:0/2124170600 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff17400cce0 con 0x7ff174004240 2024-08-18T21:13:37.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:37.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 1 -- 172.21.15.5:0/2124170600 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7ff17400ce90 con 0x7ff174004f50 2024-08-18T21:13:37.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:37.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff1877fe640 10 monclient(hunting): _finish_auth 0 2024-08-18T21:13:37.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff17f7fe640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff174004f50 msgr2=0x7ff1740099c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:13:37.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff17f7fe640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff174004f50 0x7ff1740099c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:37.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff187fff640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff174004240 msgr2=0x7ff174004810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:13:37.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff18ce39640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff174009f00 msgr2=0x7ff17400c2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:13:37.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff187fff640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff174004240 0x7ff174004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:37.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.191+0000 7ff18ce39640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff174009f00 0x7ff17400c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.395+0000 7ff17f7fe640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff174004f50 msgr2=0x7ff1740099c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:13:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.395+0000 7ff17f7fe640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff174004f50 0x7ff1740099c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:13:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.395+0000 7ff18ce39640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff174009f00 msgr2=0x7ff17400c2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:13:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.395+0000 7ff187fff640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff174004240 msgr2=0x7ff174004810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:13:37.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.395+0000 7ff18ce39640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff174009f00 0x7ff17400c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:13:37.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.395+0000 7ff187fff640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff174004240 0x7ff174004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:13:37.730 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31775]: starting. 2024-08-18T21:13:37.730 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31775]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31774 2024-08-18T21:13:37.730 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31775]: created object 0... 2024-08-18T21:13:37.730 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31775]: created object 25... 2024-08-18T21:13:37.730 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31775]: created object 49... 2024-08-18T21:13:37.730 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31775]: finishing. 2024-08-18T21:13:37.730 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31775]: shutting down. 2024-08-18T21:13:37.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.799+0000 7ff17f7fe640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff174004f50 msgr2=0x7ff1740099c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:13:37.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.799+0000 7ff17f7fe640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff174004f50 0x7ff1740099c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:13:37.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.799+0000 7ff187fff640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff174004240 msgr2=0x7ff174004810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:13:37.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.799+0000 7ff18ce39640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff174009f00 msgr2=0x7ff17400c2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:13:37.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.799+0000 7ff187fff640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff174004240 0x7ff174004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:13:37.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:37.799+0000 7ff18ce39640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff174009f00 0x7ff17400c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:13:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:38.603+0000 7ff17f7fe640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff174004f50 msgr2=0x7ff1740099c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:13:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:38.603+0000 7ff17f7fe640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff174004f50 0x7ff1740099c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:13:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:38.603+0000 7ff187fff640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff174004240 msgr2=0x7ff174004810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:13:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:38.603+0000 7ff18ce39640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff174009f00 msgr2=0x7ff17400c2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:13:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:38.603+0000 7ff18ce39640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff174009f00 0x7ff17400c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:13:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:38.603+0000 7ff187fff640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff174004240 0x7ff174004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:13:38.877 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31776]: starting. 2024-08-18T21:13:38.877 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31776]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31774 2024-08-18T21:13:38.878 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31776]: shutting down. 2024-08-18T21:13:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 10 monclient(hunting): tick 2024-08-18T21:13:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:13:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 1 monclient(hunting): continuing hunt 2024-08-18T21:13:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:13:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff174004f50 msgr2=0x7ff1740099c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7ff174004f50 0x7ff1740099c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff174004240 msgr2=0x7ff174004810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff174004240 0x7ff174004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff174009f00 msgr2=0x7ff17400c2f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff174009f00 0x7ff17400c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff18ce39640 1 -- 172.21.15.5:0/2124170600 reap_dead start 2024-08-18T21:13:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 10 monclient: _add_conns ranks=[7,4,2,5,0,8] 2024-08-18T21:13:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff18ce39640 1 -- 172.21.15.5:0/2124170600 reap_dead start 2024-08-18T21:13:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff168003770 0x7ff168005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 10 monclient(hunting): picked mon.i con 0x7ff168003770 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:13:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff1680061e0 0x7ff168008670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 10 monclient(hunting): picked mon.c con 0x7ff1680061e0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:13:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff168008d30 0x7ff16800b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 10 monclient(hunting): picked mon.b con 0x7ff168008d30 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 1 -- 172.21.15.5:0/2124170600 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7ff17400cb30 con 0x7ff168008d30 2024-08-18T21:13:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:40.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 1 -- 172.21.15.5:0/2124170600 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff17400cce0 con 0x7ff1680061e0 2024-08-18T21:13:40.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:40.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 1 -- 172.21.15.5:0/2124170600 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7ff17400ce90 con 0x7ff168003770 2024-08-18T21:13:40.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff1867fc640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:40.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff187fff640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff168003770 msgr2=0x7ff168005bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:13:40.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff187fff640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff168003770 0x7ff168005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:40.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff1680061e0 0x7ff168008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:40.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff18ce39640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff168008d30 0x7ff16800b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:40.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 10 monclient(hunting): get_auth_request con 0x7ff1680061e0 auth_method 0 2024-08-18T21:13:40.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:40.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:40.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:13:40.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff18ce39640 10 monclient(hunting): get_auth_request con 0x7ff168008d30 auth_method 0 2024-08-18T21:13:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff18ce39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff18ce39640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff18ce39640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:13:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:13:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff18ce39640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff18ce39640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff18ce39640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-18T21:13:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 10 monclient(hunting): handle_auth_done global_id 124326 payload 293 2024-08-18T21:13:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff168003770 msgr2=0x7ff168005bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff168003770 0x7ff168005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff168008d30 msgr2=0x7ff16800b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:13:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff168008d30 0x7ff16800b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:13:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 1 monclient: found mon.c 2024-08-18T21:13:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1.5 2024-08-18T21:13:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:13:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 1 -- 172.21.15.5:0/2124170600 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=2+}) -- 0x7ff174003530 con 0x7ff1680061e0 2024-08-18T21:13:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 10 monclient: _finish_auth 0 2024-08-18T21:13:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:13:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff17f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff18ce39640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff168008d30 0x7ff16800b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:13:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff18e89c640 5 monclient: authenticate success, global_id 124326 2024-08-18T21:13:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.187+0000 7ff18e89c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:13:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.195+0000 7ff17f7fe640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff1680061e0 msgr2=0x7ff168008670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.195+0000 7ff17f7fe640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff1680061e0 0x7ff168008670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff170000eb0 tx=0x7ff17001cbc0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=68ae970a19c37a83 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff1877fe640 1 -- 172.21.15.5:0/2124170600 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff170008d50 con 0x7ff1680061e0 2024-08-18T21:13:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff1877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff1877fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:13:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff1877fe640 10 monclient: dump: 2024-08-18T21:13:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff1877fe640 1 -- 172.21.15.5:0/2124170600 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff170005d50 con 0x7ff1680061e0 2024-08-18T21:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff18e89c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff1877fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff18e89c640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:40.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff18e89c640 4 set_mon_vals no callback set 2024-08-18T21:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff18e89c640 10 monclient: shutdown 2024-08-18T21:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff18e89c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff18e89c640 1 -- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff1680061e0 msgr2=0x7ff168008670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff18e89c640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff1680061e0 0x7ff168008670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff170000eb0 tx=0x7ff17001cbc0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff18e89c640 1 -- 172.21.15.5:0/2124170600 shutdown_connections 2024-08-18T21:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff18e89c640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff168008d30 0x7ff16800b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff18e89c640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff1680061e0 0x7ff168008670 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff18e89c640 1 --2- 172.21.15.5:0/2124170600 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff168003770 0x7ff168005bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff18e89c640 1 -- 172.21.15.5:0/2124170600 >> 172.21.15.5:0/2124170600 conn(0x7ff1880acbc0 msgr2=0x7ff1880a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff18e89c640 1 -- 172.21.15.5:0/2124170600 shutdown_connections 2024-08-18T21:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff18e89c640 1 -- 172.21.15.5:0/2124170600 wait complete. 2024-08-18T21:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff18e89c640 10 monclient: build_initial_monmap 2024-08-18T21:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.199+0000 7ff18e89c640 10 monclient: monmap: 2024-08-18T21:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:40.201 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:40.201 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:40.201 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:40.201 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:40.201 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 1 Processor -- start 2024-08-18T21:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 1 -- start start 2024-08-18T21:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 10 monclient: init 2024-08-18T21:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 10 monclient: _add_conns ranks=[2,1,8,6,4,3,7,5,0] 2024-08-18T21:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff168003770 0x7ff1881d1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 10 monclient(hunting): picked mon.noname-b con 0x7ff168003770 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1680061e0 0x7ff1881d1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 10 monclient(hunting): picked mon.noname-f con 0x7ff1680061e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff168008d30 0x7ff188123440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 10 monclient(hunting): picked mon.noname-e con 0x7ff168008d30 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff1880a7650 con 0x7ff1680061e0 2024-08-18T21:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7ff1880a74d0 con 0x7ff168003770 2024-08-18T21:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff1880a8220 con 0x7ff168008d30 2024-08-18T21:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff168003770 0x7ff1881d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18e89c640 10 monclient(hunting): authenticate will time out at 1587.217821s 2024-08-18T21:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff168003770 0x7ff1881d1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:35220/0 (socket says 172.21.15.5:35220) 2024-08-18T21:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 1 -- 172.21.15.5:0/2204343794 learned_addr learned my addr 172.21.15.5:0/2204343794 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 10 monclient(hunting): get_auth_request con 0x7ff168003770 auth_method 0 2024-08-18T21:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff17f7fe640 1 -- 172.21.15.5:0/2204343794 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1680061e0 msgr2=0x7ff1881d1d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18ce39640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff168008d30 0x7ff188123440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff17f7fe640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1680061e0 0x7ff1881d1d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18ce39640 10 monclient(hunting): get_auth_request con 0x7ff168008d30 auth_method 0 2024-08-18T21:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18ce39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18ce39640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18ce39640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 10 monclient(hunting): handle_auth_done global_id 114671 payload 824 2024-08-18T21:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 1 -- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff168008d30 msgr2=0x7ff188123440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff168008d30 0x7ff188123440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 1 -- 172.21.15.5:0/2204343794 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1680061e0 msgr2=0x7ff1881d1d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1680061e0 0x7ff1881d1d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 10 monclient: _finish_hunting 0 2024-08-18T21:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 1 monclient: found mon.noname-b 2024-08-18T21:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff187fff640 1 -- 172.21.15.5:0/2204343794 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1880aa2b0 con 0x7ff168003770 2024-08-18T21:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.203+0000 7ff18ce39640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff168008d30 0x7ff188123440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:13:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff187fff640 1 -- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff168003770 msgr2=0x7ff1881d1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff187fff640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff168003770 0x7ff1881d1810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff17800b560 tx=0x7ff17800ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff1857fa640 1 -- 172.21.15.5:0/2204343794 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff178013020 con 0x7ff168003770 2024-08-18T21:13:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff1857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff1857fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:13:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff1857fa640 10 monclient: dump: 2024-08-18T21:13:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff1857fa640 10 monclient: _finish_auth 0 2024-08-18T21:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff1857fa640 10 monclient: _check_auth_tickets 2024-08-18T21:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff1857fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff1857fa640 1 -- 172.21.15.5:0/2204343794 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff178003de0 con 0x7ff168003770 2024-08-18T21:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff1857fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff1857fa640 1 -- 172.21.15.5:0/2204343794 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff17800f460 con 0x7ff168003770 2024-08-18T21:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff18e89c640 5 monclient: authenticate success, global_id 114671 2024-08-18T21:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff18e89c640 10 monclient: _renew_subs 2024-08-18T21:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff18e89c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff186ffd640 4 set_mon_vals no callback set 2024-08-18T21:13:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff18e89c640 1 -- 172.21.15.5:0/2204343794 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18813ff70 con 0x7ff168003770 2024-08-18T21:13:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff1857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff1857fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff1857fa640 10 monclient: dump: 2024-08-18T21:13:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:40.215 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff18e89c640 10 monclient: _renew_subs 2024-08-18T21:13:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff18e89c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff18e89c640 1 -- 172.21.15.5:0/2204343794 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1881270d0 con 0x7ff168003770 2024-08-18T21:13:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff18e89c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff18e89c640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff188123980 0x7ff188123d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff18e89c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff18e89c640 1 -- 172.21.15.5:0/2204343794 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff188051140 con 0x7ff188123980 2024-08-18T21:13:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff17f7fe640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff188123980 0x7ff188123d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff17f7fe640 10 monclient: get_auth_request con 0x7ff188123980 auth_method 0 2024-08-18T21:13:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff17f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff17f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff17f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff17f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff17f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff17f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff17f7fe640 10 monclient(hunting): handle_auth_done global_id 114848 payload 824 2024-08-18T21:13:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff17f7fe640 1 -- 172.21.15.5:0/2204343794 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff188126950 con 0x7ff188123980 2024-08-18T21:13:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff1857fa640 1 -- 172.21.15.5:0/2204343794 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7ff178016020 con 0x7ff168003770 2024-08-18T21:13:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.207+0000 7ff1857fa640 1 --2- 172.21.15.5:0/2204343794 >> v2:172.21.15.157:6812/631023601 conn(0x7ff16803cce0 0x7ff16803f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff1857fa640 1 -- 172.21.15.5:0/2204343794 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(269..269 src has 22..269) ==== 3898+0+0 (secure 0 0 0) 0x7ff17804e110 con 0x7ff168003770 2024-08-18T21:13:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff18ce39640 1 --2- 172.21.15.5:0/2204343794 >> v2:172.21.15.157:6812/631023601 conn(0x7ff16803cce0 0x7ff16803f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff18ce39640 10 monclient: get_auth_request con 0x7ff16803cce0 auth_method 0 2024-08-18T21:13:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff17f7fe640 1 -- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff188123980 msgr2=0x7ff188123d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff17f7fe640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff188123980 0x7ff188123d60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff170001bf0 tx=0x7ff174005840 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff1857fa640 1 -- 172.21.15.5:0/2204343794 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff170001c20 con 0x7ff188123980 2024-08-18T21:13:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff1857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff1857fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff1857fa640 10 monclient: dump: 2024-08-18T21:13:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:40.218 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:40.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff1857fa640 1 -- 172.21.15.5:0/2204343794 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff1700b4070 con 0x7ff188123980 2024-08-18T21:13:40.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff1857fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:40.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff1857fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:40.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff1857fa640 1 -- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff188123980 msgr2=0x7ff188123d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:40.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff1857fa640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff188123980 0x7ff188123d60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff170001bf0 tx=0x7ff174005840 comp rx=0 tx=0).stop 2024-08-18T21:13:40.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff1857fa640 1 -- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff188123980 msgr2=0x7ff188123d60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:40.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff1857fa640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff188123980 0x7ff188123d60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.211+0000 7ff18ce39640 1 --2- 172.21.15.5:0/2204343794 >> v2:172.21.15.157:6812/631023601 conn(0x7ff16803cce0 0x7ff16803f1a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff1880a4fd0 tx=0x7ff1800094a0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:40.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.219+0000 7ff18e89c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:40.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.219+0000 7ff18e89c640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff1881242a0 0x7ff18809fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.219+0000 7ff18e89c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.219+0000 7ff18e89c640 1 -- 172.21.15.5:0/2204343794 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff188069fa0 con 0x7ff1881242a0 2024-08-18T21:13:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.219+0000 7ff17f7fe640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff1881242a0 0x7ff18809fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.219+0000 7ff17f7fe640 10 monclient: get_auth_request con 0x7ff1881242a0 auth_method 0 2024-08-18T21:13:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.219+0000 7ff17f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.219+0000 7ff17f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.219+0000 7ff17f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.219+0000 7ff17f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.219+0000 7ff17f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.219+0000 7ff17f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.219+0000 7ff17f7fe640 10 monclient(hunting): handle_auth_done global_id 114857 payload 824 2024-08-18T21:13:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.219+0000 7ff17f7fe640 1 -- 172.21.15.5:0/2204343794 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff18813a2b0 con 0x7ff1881242a0 2024-08-18T21:13:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff17f7fe640 1 -- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff1881242a0 msgr2=0x7ff18809fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff17f7fe640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff1881242a0 0x7ff18809fa40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff17001c9f0 tx=0x7ff170008910 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff1857fa640 1 -- 172.21.15.5:0/2204343794 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff1700c2070 con 0x7ff1881242a0 2024-08-18T21:13:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff1857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff1857fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff1857fa640 10 monclient: dump: 2024-08-18T21:13:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:40.224 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff1857fa640 1 -- 172.21.15.5:0/2204343794 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9371 (secure 0 0 0) 0x7ff170008d30 con 0x7ff1881242a0 2024-08-18T21:13:40.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff1857fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:40.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff1857fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:40.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff1857fa640 1 -- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff1881242a0 msgr2=0x7ff18809fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:40.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff1857fa640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff1881242a0 0x7ff18809fa40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff17001c9f0 tx=0x7ff170008910 comp rx=0 tx=0).stop 2024-08-18T21:13:40.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff1857fa640 1 -- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff1881242a0 msgr2=0x7ff18809fa40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:40.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff1857fa640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff1881242a0 0x7ff18809fa40 secure :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff17001c9f0 tx=0x7ff170008910 comp rx=0 tx=0).stop 2024-08-18T21:13:40.225 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:40.225 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:40.225 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:40.225 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 216, 2024-08-18T21:13:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 125390, 2024-08-18T21:13:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:13:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:13:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:13:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:40.249 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff18e89c640 1 -- 172.21.15.5:0/2204343794 >> v2:172.21.15.157:6812/631023601 conn(0x7ff16803cce0 msgr2=0x7ff16803f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff18e89c640 1 --2- 172.21.15.5:0/2204343794 >> v2:172.21.15.157:6812/631023601 conn(0x7ff16803cce0 0x7ff16803f1a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff1880a4fd0 tx=0x7ff1800094a0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff18e89c640 10 monclient: shutdown 2024-08-18T21:13:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff18e89c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff18e89c640 1 -- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff168003770 msgr2=0x7ff1881d1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff18e89c640 1 --2- 172.21.15.5:0/2204343794 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff168003770 0x7ff1881d1810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff17800b560 tx=0x7ff17800ba20 comp rx=0 tx=0).stop 2024-08-18T21:13:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff18ce39640 1 -- 172.21.15.5:0/2204343794 reap_dead start 2024-08-18T21:13:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff18ce39640 1 -- 172.21.15.5:0/2204343794 reap_dead start 2024-08-18T21:13:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff18e89c640 1 -- 172.21.15.5:0/2204343794 shutdown_connections 2024-08-18T21:13:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff18e89c640 1 -- 172.21.15.5:0/2204343794 >> 172.21.15.5:0/2204343794 conn(0x7ff1880acbc0 msgr2=0x7ff1880a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff18e89c640 1 -- 172.21.15.5:0/2204343794 shutdown_connections 2024-08-18T21:13:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.223+0000 7ff18e89c640 1 -- 172.21.15.5:0/2204343794 wait complete. 2024-08-18T21:13:40.252 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:13:40.252 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon h 2024-08-18T21:13:40.252 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:13:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 10 monclient: get_monmap_and_config 2024-08-18T21:13:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 10 monclient: build_initial_monmap 2024-08-18T21:13:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 10 monclient: monmap: 2024-08-18T21:13:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:13:40.381170+0000 2024-08-18T21:13:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:13:40.381170+0000 2024-08-18T21:13:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:13:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:13:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:13:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:13:40.379 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 1 Processor -- start 2024-08-18T21:13:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 1 -- start start 2024-08-18T21:13:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 10 monclient: init 2024-08-18T21:13:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 10 monclient: _add_conns ranks=[10,8,3,5,2,7,4,6,0,9,1] 2024-08-18T21:13:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdf880a5f00 0x7fdf88073750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 10 monclient(hunting): picked mon.noname-f con 0x7fdf880a5f00 addr v2:172.21.15.157:3300/0 2024-08-18T21:13:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdf88073c90 0x7fdf880a4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 10 monclient(hunting): picked mon.noname-e con 0x7fdf88073c90 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:13:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf880a4860 0x7fdf880a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 10 monclient(hunting): picked mon.noname-g con 0x7fdf880a4860 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:13:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:40.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fdf880a2e60 con 0x7fdf880a5f00 2024-08-18T21:13:40.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:40.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdf88068d40 con 0x7fdf880a4860 2024-08-18T21:13:40.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:40.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fdf880a62e0 con 0x7fdf88073c90 2024-08-18T21:13:40.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:40.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8f5f1640 10 monclient(hunting): authenticate will time out at 1587.394410s 2024-08-18T21:13:40.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdf88073c90 0x7fdf880a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:40.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdf88073c90 0x7fdf880a4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:39718/0 (socket says 172.21.15.5:39718) 2024-08-18T21:13:40.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 1 -- 172.21.15.5:0/749592 learned_addr learned my addr 172.21.15.5:0/749592 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:40.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 10 monclient(hunting): get_auth_request con 0x7fdf88073c90 auth_method 0 2024-08-18T21:13:40.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:40.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:40.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:40.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8d38d640 1 -- 172.21.15.5:0/749592 >> v2:172.21.15.157:3300/0 conn(0x7fdf880a5f00 msgr2=0x7fdf88073750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:13:40.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8db8e640 1 -- 172.21.15.5:0/749592 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf880a4860 msgr2=0x7fdf880a4ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-08-18T21:13:40.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8d38d640 1 --2- 172.21.15.5:0/749592 >> v2:172.21.15.157:3300/0 conn(0x7fdf880a5f00 0x7fdf88073750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:40.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8db8e640 1 --2- 172.21.15.5:0/749592 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf880a4860 0x7fdf880a4ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:40.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf87fff640 1 -- 172.21.15.5:0/749592 DispatchQueue::entry inject delay of 0.002000 2024-08-18T21:13:40.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:40.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:40.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:40.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 10 monclient(hunting): handle_auth_done global_id 114866 payload 274 2024-08-18T21:13:40.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 1 -- 172.21.15.5:0/749592 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf880a4860 msgr2=0x7fdf880a4ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:40.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 1 --2- 172.21.15.5:0/749592 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf880a4860 0x7fdf880a4ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 1 -- 172.21.15.5:0/749592 >> v2:172.21.15.157:3300/0 conn(0x7fdf880a5f00 msgr2=0x7fdf88073750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:13:40.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 1 --2- 172.21.15.5:0/749592 >> v2:172.21.15.157:3300/0 conn(0x7fdf880a5f00 0x7fdf88073750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 10 monclient: _finish_hunting 0 2024-08-18T21:13:40.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 1 monclient: found mon.noname-e 2024-08-18T21:13:40.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:40.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:13:40.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.379+0000 7fdf8cb8c640 1 -- 172.21.15.5:0/749592 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf88074360 con 0x7fdf88073c90 2024-08-18T21:13:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf8cb8c640 1 -- 172.21.15.5:0/749592 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdf88073c90 msgr2=0x7fdf880a4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf8cb8c640 1 --2- 172.21.15.5:0/749592 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdf88073c90 0x7fdf880a4320 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0098a0 tx=0x7fdf7c01c440 comp rx=0 tx=0).ready entity=mon.8 client_cookie=2d6301a9c878e959 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf87fff640 1 -- 172.21.15.5:0/749592 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdf7c0b0070 con 0x7fdf88073c90 2024-08-18T21:13:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf87fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:13:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf87fff640 10 monclient: dump: 2024-08-18T21:13:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:40.389 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf87fff640 10 monclient: _finish_auth 0 2024-08-18T21:13:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf87fff640 10 monclient: _check_auth_tickets 2024-08-18T21:13:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf87fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf87fff640 1 -- 172.21.15.5:0/749592 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7c0a4e50 con 0x7fdf88073c90 2024-08-18T21:13:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf87fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf87fff640 1 -- 172.21.15.5:0/749592 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdf7c0aac80 con 0x7fdf88073c90 2024-08-18T21:13:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf8f5f1640 5 monclient: authenticate success, global_id 114866 2024-08-18T21:13:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf8f5f1640 10 monclient: get_monmap_and_config success 2024-08-18T21:13:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf8f5f1640 4 set_mon_vals no callback set 2024-08-18T21:13:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf87fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:13:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.383+0000 7fdf87fff640 10 monclient: dump: 2024-08-18T21:13:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:40.392 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 10 monclient: shutdown 2024-08-18T21:13:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 -- 172.21.15.5:0/749592 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdf88073c90 msgr2=0x7fdf880a4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 --2- 172.21.15.5:0/749592 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdf88073c90 0x7fdf880a4320 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0098a0 tx=0x7fdf7c01c440 comp rx=0 tx=0).stop 2024-08-18T21:13:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 -- 172.21.15.5:0/749592 shutdown_connections 2024-08-18T21:13:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 --2- 172.21.15.5:0/749592 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdf88073c90 0x7fdf880a4320 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 --2- 172.21.15.5:0/749592 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf880a4860 0x7fdf880a4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 --2- 172.21.15.5:0/749592 >> v2:172.21.15.157:3300/0 conn(0x7fdf880a5f00 0x7fdf88073750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 -- 172.21.15.5:0/749592 >> 172.21.15.5:0/749592 conn(0x7fdf880a5410 msgr2=0x7fdf880a57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 -- 172.21.15.5:0/749592 shutdown_connections 2024-08-18T21:13:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 -- 172.21.15.5:0/749592 wait complete. 2024-08-18T21:13:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 10 monclient: build_initial_monmap 2024-08-18T21:13:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 10 monclient: monmap: 2024-08-18T21:13:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:13:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:13:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:13:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:13:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:13:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:13:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:13:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:13:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:13:40.393 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:13:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:13:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:13:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:13:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:13:40.394 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 Processor -- start 2024-08-18T21:13:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 -- start start 2024-08-18T21:13:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 10 monclient: init 2024-08-18T21:13:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 10 monclient: _reopen_session rank -1 2024-08-18T21:13:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 10 monclient: _add_conns ranks=[2,6,0,7,1,4,5,8,3] 2024-08-18T21:13:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdf88073c90 0x7fdf881d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 10 monclient(hunting): picked mon.noname-b con 0x7fdf88073c90 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:13:40.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdf880a4860 0x7fdf881342b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 10 monclient(hunting): picked mon.noname-d con 0x7fdf880a4860 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:13:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf880a5f00 0x7fdf8813d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 10 monclient(hunting): picked mon.noname-a con 0x7fdf880a5f00 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:13:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdf881435c0 con 0x7fdf880a5f00 2024-08-18T21:13:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fdf88074090 con 0x7fdf88073c90 2024-08-18T21:13:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fdf88143740 con 0x7fdf880a4860 2024-08-18T21:13:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 10 monclient(hunting): _renew_subs 2024-08-18T21:13:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8f5f1640 10 monclient(hunting): authenticate will time out at 1587.401871s 2024-08-18T21:13:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8cb8c640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdf880a4860 msgr2=0x7fdf881342b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:13:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8cb8c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdf880a4860 0x7fdf881342b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:13:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdf88073c90 0x7fdf881d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdf88073c90 0x7fdf881d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:35232/0 (socket says 172.21.15.5:35232) 2024-08-18T21:13:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 1 -- 172.21.15.5:0/3999522601 learned_addr learned my addr 172.21.15.5:0/3999522601 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:13:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 10 monclient(hunting): get_auth_request con 0x7fdf88073c90 auth_method 0 2024-08-18T21:13:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8db8e640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf880a5f00 0x7fdf8813d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8db8e640 10 monclient(hunting): get_auth_request con 0x7fdf880a5f00 auth_method 0 2024-08-18T21:13:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8db8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8db8e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8db8e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8db8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8db8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8db8e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 10 monclient(hunting): handle_auth_done global_id 114680 payload 824 2024-08-18T21:13:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 1 -- 172.21.15.5:0/3999522601 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdf880a4860 msgr2=0x7fdf881342b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:13:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdf880a4860 0x7fdf881342b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 1 -- 172.21.15.5:0/3999522601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf880a5f00 msgr2=0x7fdf8813d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf880a5f00 0x7fdf8813d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 10 monclient: _finish_hunting 0 2024-08-18T21:13:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 1 monclient: found mon.noname-b 2024-08-18T21:13:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:13:40.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:13:40.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.387+0000 7fdf8d38d640 1 -- 172.21.15.5:0/3999522601 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf881d27f0 con 0x7fdf88073c90 2024-08-18T21:13:40.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8d38d640 1 -- 172.21.15.5:0/3999522601 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdf88073c90 msgr2=0x7fdf881d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:40.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8d38d640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdf88073c90 0x7fdf881d18e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000b9e0 tx=0x7fdf8000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:40.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf85ffb640 1 -- 172.21.15.5:0/3999522601 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdf8000cbb0 con 0x7fdf88073c90 2024-08-18T21:13:40.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf85ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:40.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8d38d640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdf88073c90 0x7fdf881d18e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000b9e0 tx=0x7fdf8000bea0 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7fdf80010070 config(0 keys) 2024-08-18T21:13:40.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf85ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:13:40.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf85ffb640 10 monclient: dump: 2024-08-18T21:13:40.402 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:40.402 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:40.402 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.402 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.402 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:40.402 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:40.402 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:40.403 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf85ffb640 10 monclient: _finish_auth 0 2024-08-18T21:13:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf85ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:13:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf85ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:13:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8f5f1640 5 monclient: authenticate success, global_id 114680 2024-08-18T21:13:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8f5f1640 10 monclient: _renew_subs 2024-08-18T21:13:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf85ffb640 1 -- 172.21.15.5:0/3999522601 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf80010070 con 0x7fdf88073c90 2024-08-18T21:13:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8f5f1640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8f5f1640 1 -- 172.21.15.5:0/3999522601 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf880a3d60 con 0x7fdf88073c90 2024-08-18T21:13:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf85ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:13:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8f5f1640 10 monclient: _renew_subs 2024-08-18T21:13:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8f5f1640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:13:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8f5f1640 1 -- 172.21.15.5:0/3999522601 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf8813f220 con 0x7fdf88073c90 2024-08-18T21:13:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf86ffd640 4 set_mon_vals no callback set 2024-08-18T21:13:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8f5f1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8f5f1640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdf881347f0 0x7fdf8802d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8f5f1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8f5f1640 1 -- 172.21.15.5:0/3999522601 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdf88051140 con 0x7fdf881347f0 2024-08-18T21:13:40.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf85ffb640 1 -- 172.21.15.5:0/3999522601 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdf8000cd90 con 0x7fdf88073c90 2024-08-18T21:13:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf85ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf85ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:13:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf85ffb640 10 monclient: dump: 2024-08-18T21:13:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:40.406 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf85ffb640 1 -- 172.21.15.5:0/3999522601 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fdf80015470 con 0x7fdf88073c90 2024-08-18T21:13:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8cb8c640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdf881347f0 0x7fdf8802d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8cb8c640 10 monclient: get_auth_request con 0x7fdf881347f0 auth_method 0 2024-08-18T21:13:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8cb8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8cb8c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8cb8c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf85ffb640 1 --2- 172.21.15.5:0/3999522601 >> v2:172.21.15.157:6812/631023601 conn(0x7fdf7403be10 0x7fdf7403e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8cb8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:40.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8cb8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:40.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8cb8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:40.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8db8e640 1 --2- 172.21.15.5:0/3999522601 >> v2:172.21.15.157:6812/631023601 conn(0x7fdf7403be10 0x7fdf7403e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:40.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8db8e640 10 monclient: get_auth_request con 0x7fdf7403be10 auth_method 0 2024-08-18T21:13:40.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8cb8c640 10 monclient(hunting): handle_auth_done global_id 95252 payload 824 2024-08-18T21:13:40.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.391+0000 7fdf8cb8c640 1 -- 172.21.15.5:0/3999522601 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf8811f410 con 0x7fdf881347f0 2024-08-18T21:13:40.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.395+0000 7fdf8cb8c640 1 -- 172.21.15.5:0/3999522601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdf881347f0 msgr2=0x7fdf8802d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:40.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.395+0000 7fdf8cb8c640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdf881347f0 0x7fdf8802d1d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdf880a99d0 tx=0x7fdf7c0191e0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:40.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.395+0000 7fdf8db8e640 1 --2- 172.21.15.5:0/3999522601 >> v2:172.21.15.157:6812/631023601 conn(0x7fdf7403be10 0x7fdf7403e2d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fdf78003870 tx=0x7fdf78009060 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:40.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.395+0000 7fdf85ffb640 1 -- 172.21.15.5:0/3999522601 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdf7c0b0070 con 0x7fdf881347f0 2024-08-18T21:13:40.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.395+0000 7fdf85ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:40.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.395+0000 7fdf85ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:13:40.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.395+0000 7fdf85ffb640 10 monclient: dump: 2024-08-18T21:13:40.408 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:40.408 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:40.408 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.408 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.408 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:40.408 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:40.408 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:40.408 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:40.408 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:40.408 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:40.408 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:40.408 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:40.408 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:40.409 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:40.409 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:40.409 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:40.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.395+0000 7fdf85ffb640 1 -- 172.21.15.5:0/3999522601 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdf7c0b1040 con 0x7fdf881347f0 2024-08-18T21:13:40.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.395+0000 7fdf85ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:13:40.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.395+0000 7fdf85ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:13:40.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.395+0000 7fdf85ffb640 1 -- 172.21.15.5:0/3999522601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdf881347f0 msgr2=0x7fdf8802d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:40.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.395+0000 7fdf85ffb640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdf881347f0 0x7fdf8802d1d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdf880a99d0 tx=0x7fdf7c0191e0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.395+0000 7fdf85ffb640 1 -- 172.21.15.5:0/3999522601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdf881347f0 msgr2=0x7fdf8802d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:40.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.395+0000 7fdf85ffb640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdf881347f0 0x7fdf8802d1d0 secure :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdf880a99d0 tx=0x7fdf7c0191e0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.403+0000 7fdf8f5f1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:13:40.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.403+0000 7fdf8f5f1640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdf8802d710 0x7fdf8802daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:13:40.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.403+0000 7fdf8f5f1640 10 monclient(hunting): start opening mon connection 2024-08-18T21:13:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.403+0000 7fdf8f5f1640 1 -- 172.21.15.5:0/3999522601 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdf880a4ce0 con 0x7fdf8802d710 2024-08-18T21:13:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.403+0000 7fdf8cb8c640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdf8802d710 0x7fdf8802daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:13:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.403+0000 7fdf8cb8c640 10 monclient: get_auth_request con 0x7fdf8802d710 auth_method 0 2024-08-18T21:13:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.403+0000 7fdf8cb8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:13:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.403+0000 7fdf8cb8c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:13:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.403+0000 7fdf8cb8c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:13:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.403+0000 7fdf8cb8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:13:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.403+0000 7fdf8cb8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:13:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.403+0000 7fdf8cb8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:13:40.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.403+0000 7fdf8cb8c640 10 monclient(hunting): handle_auth_done global_id 95261 payload 824 2024-08-18T21:13:40.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.403+0000 7fdf8cb8c640 1 -- 172.21.15.5:0/3999522601 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdf881369e0 con 0x7fdf8802d710 2024-08-18T21:13:40.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf8cb8c640 1 -- 172.21.15.5:0/3999522601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdf8802d710 msgr2=0x7fdf8802daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:13:40.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf8cb8c640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdf8802d710 0x7fdf8802daf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c01cce0 tx=0x7fdf7c009240 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:13:40.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf85ffb640 1 -- 172.21.15.5:0/3999522601 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdf7c0bd720 con 0x7fdf8802d710 2024-08-18T21:13:40.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf85ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:13:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf85ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:13:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf85ffb640 10 monclient: dump: 2024-08-18T21:13:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:13:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:13:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:13:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:13:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:13:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:13:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:13:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:13:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:13:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:13:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:13:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:13:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:13:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:13:40.413 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:13:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf85ffb640 1 -- 172.21.15.5:0/3999522601 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9371 (secure 0 0 0) 0x7fdf7c0aa9f0 con 0x7fdf8802d710 2024-08-18T21:13:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf85ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:13:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf85ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:13:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf85ffb640 1 -- 172.21.15.5:0/3999522601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdf8802d710 msgr2=0x7fdf8802daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf85ffb640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdf8802d710 0x7fdf8802daf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c01cce0 tx=0x7fdf7c009240 comp rx=0 tx=0).stop 2024-08-18T21:13:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf85ffb640 1 -- 172.21.15.5:0/3999522601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdf8802d710 msgr2=0x7fdf8802daf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:13:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf85ffb640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdf8802d710 0x7fdf8802daf0 secure :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c01cce0 tx=0x7fdf7c009240 comp rx=0 tx=0).stop 2024-08-18T21:13:40.414 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:13:40.414 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:40.414 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:40.414 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:13:40.414 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 216, 2024-08-18T21:13:40.414 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 248440, 2024-08-18T21:13:40.414 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:13:40.414 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:13:40.415 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:13:40.415 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:13:40.415 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:13:40.415 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:13:40.415 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:40.415 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:13:40.415 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:40.415 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:13:40.415 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:13:40.415 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:40.415 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:40.415 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:40.415 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:40.416 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:40.416 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:40.416 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:40.416 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:40.416 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:40.416 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:40.416 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:40.416 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:40.416 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:13:40.416 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:13:40.416 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:40.416 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:40.416 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:40.417 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:40.417 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:40.417 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:40.417 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:40.417 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:40.417 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:40.417 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:40.417 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:40.417 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.417 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.417 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:13:40.417 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:13:40.417 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:13:40.417 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:13:40.418 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:13:40.418 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:13:40.418 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:40.418 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:13:40.418 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:13:40.418 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:13:40.418 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:13:40.418 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:13:40.418 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:13:40.418 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:13:40.418 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:13:40.418 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:13:40.419 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:13:40.419 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:13:40.419 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:13:40.419 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:13:40.419 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:13:40.419 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:13:40.419 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:13:40.419 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:13:40.419 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:13:40.419 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:13:40.419 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:13:40.419 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:13:40.419 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:40.419 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:13:40.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.420 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:13:40.420 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.420 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:13:40.420 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:13:40.420 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.420 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.420 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.420 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.420 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:13:40.420 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.420 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.421 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.421 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:13:40.421 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.421 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.421 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.421 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.421 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:13:40.421 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:13:40.421 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.421 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.421 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.421 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.421 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.421 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:13:40.422 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:13:40.422 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.422 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.422 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.422 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.422 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:13:40.422 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.422 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.422 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.422 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.422 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:13:40.422 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.422 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:13:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:13:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:13:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:13:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.424 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.424 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.424 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:13:40.424 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.424 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.424 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.424 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.424 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:13:40.424 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.424 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.424 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.424 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.424 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:13:40.425 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:13:40.425 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.425 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.425 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.425 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.425 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:13:40.425 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:13:40.425 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.425 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.425 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.425 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.426 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:13:40.426 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.426 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.426 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.426 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.426 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:13:40.426 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.426 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.426 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.426 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.426 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:13:40.426 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:13:40.426 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.427 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.427 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.427 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.427 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:13:40.427 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:13:40.427 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.427 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.427 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.427 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.427 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:13:40.427 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.427 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.428 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.428 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:13:40.428 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.428 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.428 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.428 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:13:40.428 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:13:40.428 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.428 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.428 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.428 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.428 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:13:40.429 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:13:40.429 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.429 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.429 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.429 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:13:40.429 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.429 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.429 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:13:40.429 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.429 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.430 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.430 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:13:40.430 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:13:40.430 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.430 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.430 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.430 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.430 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:13:40.430 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:13:40.430 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.430 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.431 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.431 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:13:40.431 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.431 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.431 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:13:40.431 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.431 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.431 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.431 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:13:40.432 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:13:40.432 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.432 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.432 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.432 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:13:40.432 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:13:40.432 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.432 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.432 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.432 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:13:40.432 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.433 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.433 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:13:40.433 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.433 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.433 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.433 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:13:40.433 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:13:40.433 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.433 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.433 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.434 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:13:40.434 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:13:40.434 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:13:40.434 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:13:40.434 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.434 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:13:40.434 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:13:40.434 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.434 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.434 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:13:40.434 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:13:40.434 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:13:40.435 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.435 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.435 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:13:40.435 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:13:40.435 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:13:40.435 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:13:40.435 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:13:40.435 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.435 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.435 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:13:40.435 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:13:40.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:13:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:13:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:13:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:13:40.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:13:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:13:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:13:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:13:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:13:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:13:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:13:40.437 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:13:40.437 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:13:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf8f5f1640 1 -- 172.21.15.5:0/3999522601 >> v2:172.21.15.157:6812/631023601 conn(0x7fdf7403be10 msgr2=0x7fdf7403e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf8f5f1640 1 --2- 172.21.15.5:0/3999522601 >> v2:172.21.15.157:6812/631023601 conn(0x7fdf7403be10 0x7fdf7403e2d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fdf78003870 tx=0x7fdf78009060 comp rx=0 tx=0).stop 2024-08-18T21:13:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf8f5f1640 10 monclient: shutdown 2024-08-18T21:13:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf8f5f1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:13:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf8f5f1640 1 -- 172.21.15.5:0/3999522601 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdf88073c90 msgr2=0x7fdf881d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:13:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf8f5f1640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdf88073c90 0x7fdf881d18e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000b9e0 tx=0x7fdf8000bea0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf8db8e640 1 -- 172.21.15.5:0/3999522601 reap_dead start 2024-08-18T21:13:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf85ffb640 1 -- 172.21.15.5:0/3999522601 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(269..269 src has 22..269) ==== 3898+0+0 (unknown 0 0 0) 0x7fdf8004ed00 con 0x7fdf88073c90 2024-08-18T21:13:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf8f5f1640 1 -- 172.21.15.5:0/3999522601 shutdown_connections 2024-08-18T21:13:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf8f5f1640 1 --2- 172.21.15.5:0/3999522601 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdf88073c90 0x7fdf881d18e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:13:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf8f5f1640 1 -- 172.21.15.5:0/3999522601 >> 172.21.15.5:0/3999522601 conn(0x7fdf880a5410 msgr2=0x7fdf88072500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:13:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf8f5f1640 1 -- 172.21.15.5:0/3999522601 shutdown_connections 2024-08-18T21:13:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:13:40.407+0000 7fdf8f5f1640 1 -- 172.21.15.5:0/3999522601 wait complete. 2024-08-18T21:13:40.440 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-08-18T21:13:40.440 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-18T21:13:41.243 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:41.243 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31810]: starting. 2024-08-18T21:13:41.243 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31810]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31774 2024-08-18T21:13:41.243 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31810]: created object 0... 2024-08-18T21:13:41.243 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31810]: created object 25... 2024-08-18T21:13:41.243 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31810]: created object 49... 2024-08-18T21:13:41.244 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31810]: finishing. 2024-08-18T21:13:41.244 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31810]: shutting down. 2024-08-18T21:13:41.309 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:41.310 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31812]: starting. 2024-08-18T21:13:41.310 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31812]: listing objects. 2024-08-18T21:13:41.310 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31812]: listed object 0... 2024-08-18T21:13:41.310 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31812]: listed object 25... 2024-08-18T21:13:41.310 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31812]: saw 50 objects 2024-08-18T21:13:41.310 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31812]: shutting down. 2024-08-18T21:13:41.911 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:41.911 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31811]: starting. 2024-08-18T21:13:41.911 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31811]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31774 2024-08-18T21:13:41.911 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31811]: shutting down. 2024-08-18T21:13:41.914 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:41.914 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:41.914 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:13:41.918 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:13:46.504 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31863]: starting. 2024-08-18T21:13:46.504 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31863]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31862 2024-08-18T21:13:46.504 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31863]: created object 0... 2024-08-18T21:13:46.504 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31863]: created object 25... 2024-08-18T21:13:46.504 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31863]: created object 49... 2024-08-18T21:13:46.504 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31863]: finishing. 2024-08-18T21:13:46.504 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31863]: shutting down. 2024-08-18T21:13:47.283 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31864]: starting. 2024-08-18T21:13:47.284 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31864]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31862 2024-08-18T21:13:47.284 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31864]: shutting down. 2024-08-18T21:13:52.558 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:52.558 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31898]: starting. 2024-08-18T21:13:52.558 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31898]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31862 2024-08-18T21:13:52.558 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31898]: created object 0... 2024-08-18T21:13:52.558 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31898]: created object 25... 2024-08-18T21:13:52.559 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31898]: created object 49... 2024-08-18T21:13:52.559 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31898]: finishing. 2024-08-18T21:13:52.559 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31898]: shutting down. 2024-08-18T21:13:52.614 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:52.615 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31900]: starting. 2024-08-18T21:13:52.615 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31900]: listing objects. 2024-08-18T21:13:52.615 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31900]: listed object 0... 2024-08-18T21:13:52.615 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31900]: listed object 25... 2024-08-18T21:13:52.615 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31900]: saw 50 objects 2024-08-18T21:13:52.615 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31900]: shutting down. 2024-08-18T21:13:54.351 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:54.351 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31899]: starting. 2024-08-18T21:13:54.351 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31899]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31862 2024-08-18T21:13:54.351 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31899]: shutting down. 2024-08-18T21:13:54.356 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:54.356 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:54.356 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:13:54.358 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:13:56.825 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31951]: starting. 2024-08-18T21:13:56.826 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31951]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31950 2024-08-18T21:13:56.826 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31951]: created object 0... 2024-08-18T21:13:56.826 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31951]: created object 25... 2024-08-18T21:13:56.826 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31951]: created object 49... 2024-08-18T21:13:56.827 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31951]: finishing. 2024-08-18T21:13:56.827 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[31951]: shutting down. 2024-08-18T21:13:57.386 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31952]: starting. 2024-08-18T21:13:57.387 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31952]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31950 2024-08-18T21:13:57.387 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[31952]: shutting down. 2024-08-18T21:13:59.465 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:59.465 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31985]: starting. 2024-08-18T21:13:59.465 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31985]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-31950 2024-08-18T21:13:59.465 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31985]: created object 0... 2024-08-18T21:13:59.465 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31985]: created object 25... 2024-08-18T21:13:59.466 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31985]: created object 49... 2024-08-18T21:13:59.466 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31985]: finishing. 2024-08-18T21:13:59.466 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[31985]: shutting down. 2024-08-18T21:13:59.525 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:13:59.525 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31987]: starting. 2024-08-18T21:13:59.525 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31987]: listing objects. 2024-08-18T21:13:59.525 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31987]: listed object 0... 2024-08-18T21:13:59.526 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31987]: listed object 25... 2024-08-18T21:13:59.526 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31987]: saw 50 objects 2024-08-18T21:13:59.526 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[31987]: shutting down. 2024-08-18T21:14:00.070 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:14:00.071 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31986]: starting. 2024-08-18T21:14:00.071 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31986]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-31950 2024-08-18T21:14:00.071 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[31986]: shutting down. 2024-08-18T21:14:00.073 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:14:00.073 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:14:00.073 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:14:00.076 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:14:00.441 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.f 2024-08-18T21:14:00.441 INFO:tasks.ceph.mon.f:Restarting daemon 2024-08-18T21:14:00.441 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-08-18T21:14:00.444 INFO:tasks.ceph.mon.f:Started 2024-08-18T21:14:00.444 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2024-08-18T21:14:00.444 INFO:tasks.ceph.mon.d:Restarting daemon 2024-08-18T21:14:00.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-08-18T21:14:00.446 INFO:tasks.ceph.mon.d:Started 2024-08-18T21:14:00.447 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.g 2024-08-18T21:14:00.447 INFO:tasks.ceph.mon.g:Restarting daemon 2024-08-18T21:14:00.447 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-08-18T21:14:00.449 INFO:tasks.ceph.mon.g:Started 2024-08-18T21:14:00.449 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.i 2024-08-18T21:14:00.449 INFO:tasks.ceph.mon.i:Restarting daemon 2024-08-18T21:14:00.449 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2024-08-18T21:14:00.452 INFO:tasks.ceph.mon.i:Started 2024-08-18T21:14:00.452 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-08-18T21:14:00.452 INFO:tasks.ceph.mon.c:Sent signal 19 2024-08-18T21:14:00.452 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs to unfreeze mons 2024-08-18T21:14:13.241 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32038]: starting. 2024-08-18T21:14:13.242 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32038]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-32037 2024-08-18T21:14:13.242 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32038]: created object 0... 2024-08-18T21:14:13.242 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32038]: created object 25... 2024-08-18T21:14:13.242 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32038]: created object 49... 2024-08-18T21:14:13.242 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32038]: finishing. 2024-08-18T21:14:13.242 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32038]: shutting down. 2024-08-18T21:14:14.117 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32039]: starting. 2024-08-18T21:14:14.117 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32039]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-32037 2024-08-18T21:14:14.117 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32039]: shutting down. 2024-08-18T21:14:16.379 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:14:16.380 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32201]: starting. 2024-08-18T21:14:16.380 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32201]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-32037 2024-08-18T21:14:16.380 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32201]: created object 0... 2024-08-18T21:14:16.380 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32201]: created object 25... 2024-08-18T21:14:16.380 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32201]: created object 49... 2024-08-18T21:14:16.380 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32201]: finishing. 2024-08-18T21:14:16.380 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32201]: shutting down. 2024-08-18T21:14:16.643 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:14:16.643 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32203]: starting. 2024-08-18T21:14:16.643 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32203]: listing objects. 2024-08-18T21:14:16.643 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32203]: listed object 0... 2024-08-18T21:14:16.643 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32203]: listed object 25... 2024-08-18T21:14:16.643 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32203]: saw 50 objects 2024-08-18T21:14:16.643 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32203]: shutting down. 2024-08-18T21:14:18.208 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:14:18.208 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32202]: starting. 2024-08-18T21:14:18.208 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32202]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-32037 2024-08-18T21:14:18.209 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32202]: shutting down. 2024-08-18T21:14:18.213 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:14:18.213 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:14:18.213 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:14:18.218 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:14:20.453 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-08-18T21:14:20.454 INFO:tasks.ceph.mon.c:Sent signal 18 2024-08-18T21:14:20.454 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:14:20.454 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:14:20.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 10 monclient: get_monmap_and_config 2024-08-18T21:14:20.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 10 monclient: build_initial_monmap 2024-08-18T21:14:20.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 10 monclient: monmap: 2024-08-18T21:14:20.606 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:20.606 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:20.606 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:20.610126+0000 2024-08-18T21:14:20.606 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:20.610126+0000 2024-08-18T21:14:20.606 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:20.607 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:20.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 1 Processor -- start 2024-08-18T21:14:20.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 1 -- start start 2024-08-18T21:14:20.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 10 monclient: init 2024-08-18T21:14:20.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:20.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 10 monclient: _add_conns ranks=[8,9,4,5,2,7,6,10,3,0,1] 2024-08-18T21:14:20.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25e80a6bd0 0x7f25e80a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:20.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 10 monclient(hunting): picked mon.noname-e con 0x7f25e80a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:14:20.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25e809f080 0x7f25e80a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:20.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 10 monclient(hunting): picked mon.noname-a con 0x7f25e809f080 addr v2:172.21.15.5:3300/0 2024-08-18T21:14:20.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f25e8139990 0x7f25e8139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 10 monclient(hunting): picked mon.noname-c con 0x7f25e8139990 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f25e809e4c0 con 0x7f25e809f080 2024-08-18T21:14:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f25e806f930 con 0x7f25e8139990 2024-08-18T21:14:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f25e80a7a30 con 0x7f25e80a6bd0 2024-08-18T21:14:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25eead2640 10 monclient(hunting): authenticate will time out at 1627.623475s 2024-08-18T21:14:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25ed06f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f25e8139990 0x7f25e8139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:20.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25ed06f640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f25e8139990 0x7f25e8139e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:58528/0 (socket says 172.21.15.5:58528) 2024-08-18T21:14:20.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25ed06f640 1 -- 172.21.15.5:0/3590660098 learned_addr learned my addr 172.21.15.5:0/3590660098 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:20.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25ed06f640 10 monclient(hunting): get_auth_request con 0x7f25e8139990 auth_method 0 2024-08-18T21:14:20.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25ed06f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:20.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25ed06f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:20.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25ed06f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:20.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25dffff640 1 --2- 172.21.15.5:0/3590660098 >> v2:172.21.15.5:3300/0 conn(0x7f25e809f080 0x7f25e80a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:20.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25dffff640 10 monclient(hunting): get_auth_request con 0x7f25e809f080 auth_method 0 2024-08-18T21:14:20.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:20.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25dffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:20.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25dffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:20.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25ed06f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:20.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25ed06f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:20.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25ed06f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:20.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25ec86e640 1 --2- 172.21.15.5:0/3590660098 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25e80a6bd0 0x7f25e80a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:20.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25ec86e640 10 monclient(hunting): get_auth_request con 0x7f25e80a6bd0 auth_method 0 2024-08-18T21:14:20.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25ec86e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:20.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25ec86e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:20.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.607+0000 7f25ec86e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:20.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.611+0000 7f25dffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:20.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.611+0000 7f25dffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:20.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.611+0000 7f25dffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:20.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.611+0000 7f25ec86e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.611+0000 7f25ec86e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.611+0000 7f25ec86e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.611+0000 7f25ed06f640 10 monclient(hunting): handle_auth_done global_id 114628 payload 274 2024-08-18T21:14:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.611+0000 7f25ed06f640 1 -- 172.21.15.5:0/3590660098 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25e80a6bd0 msgr2=0x7f25e80a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.611+0000 7f25ed06f640 1 --2- 172.21.15.5:0/3590660098 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25e80a6bd0 0x7f25e80a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.611+0000 7f25ed06f640 1 -- 172.21.15.5:0/3590660098 >> v2:172.21.15.5:3300/0 conn(0x7f25e809f080 msgr2=0x7f25e80a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.611+0000 7f25ed06f640 1 --2- 172.21.15.5:0/3590660098 >> v2:172.21.15.5:3300/0 conn(0x7f25e809f080 0x7f25e80a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.611+0000 7f25ed06f640 10 monclient: _finish_hunting 0 2024-08-18T21:14:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.611+0000 7f25ed06f640 1 monclient: found mon.noname-c 2024-08-18T21:14:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.611+0000 7f25ed06f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.611+0000 7f25ed06f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:14:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.611+0000 7f25ed06f640 1 -- 172.21.15.5:0/3590660098 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e80a7fb0 con 0x7f25e8139990 2024-08-18T21:14:20.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25ed06f640 1 -- 172.21.15.5:0/3590660098 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f25e8139990 msgr2=0x7f25e8139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:20.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25ed06f640 1 --2- 172.21.15.5:0/3590660098 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f25e8139990 0x7f25e8139e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f25e0009e50 tx=0x7f25e001c8f0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=a898cd75ed51803d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:20.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25df7fe640 1 -- 172.21.15.5:0/3590660098 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f25e00090d0 con 0x7f25e8139990 2024-08-18T21:14:20.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:20.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25df7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:14:20.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25df7fe640 10 monclient: dump: 2024-08-18T21:14:20.622 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:20.622 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:20.622 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:20.622 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:20.622 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:20.622 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:20.622 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:20.622 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:20.622 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:20.622 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:20.623 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:20.623 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:20.623 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:20.623 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:20.623 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:20.623 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:20.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25df7fe640 10 monclient: _finish_auth 0 2024-08-18T21:14:20.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25df7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:14:20.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25df7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:20.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25df7fe640 1 -- 172.21.15.5:0/3590660098 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25e00a5a90 con 0x7f25e8139990 2024-08-18T21:14:20.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25df7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:20.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25df7fe640 1 -- 172.21.15.5:0/3590660098 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f25e00a5c40 con 0x7f25e8139990 2024-08-18T21:14:20.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 5 monclient: authenticate success, global_id 114628 2024-08-18T21:14:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 4 set_mon_vals no callback set 2024-08-18T21:14:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25df7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25df7fe640 10 monclient: dump: 2024-08-18T21:14:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:20.625 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:20.625 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:20.625 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:20.625 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:20.625 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:20.625 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:20.625 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:20.625 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:20.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 10 monclient: shutdown 2024-08-18T21:14:20.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:20.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 -- 172.21.15.5:0/3590660098 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f25e8139990 msgr2=0x7f25e8139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:20.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 --2- 172.21.15.5:0/3590660098 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f25e8139990 0x7f25e8139e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f25e0009e50 tx=0x7f25e001c8f0 comp rx=0 tx=0).stop 2024-08-18T21:14:20.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 -- 172.21.15.5:0/3590660098 shutdown_connections 2024-08-18T21:14:20.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 --2- 172.21.15.5:0/3590660098 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f25e8139990 0x7f25e8139e10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:20.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 --2- 172.21.15.5:0/3590660098 >> v2:172.21.15.5:3300/0 conn(0x7f25e809f080 0x7f25e80a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:20.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 --2- 172.21.15.5:0/3590660098 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f25e80a6bd0 0x7f25e80a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:20.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 -- 172.21.15.5:0/3590660098 >> 172.21.15.5:0/3590660098 conn(0x7f25e8068700 msgr2=0x7f25e8068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:20.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 -- 172.21.15.5:0/3590660098 shutdown_connections 2024-08-18T21:14:20.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 -- 172.21.15.5:0/3590660098 wait complete. 2024-08-18T21:14:20.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 10 monclient: build_initial_monmap 2024-08-18T21:14:20.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 10 monclient: monmap: 2024-08-18T21:14:20.627 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:20.627 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:20.627 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:20.627 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:20.627 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:20.627 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:20.627 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:20.627 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:20.627 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:20.627 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:20.627 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:20.627 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:20.627 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:20.628 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:20.628 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:20.628 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:20.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 Processor -- start 2024-08-18T21:14:20.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 -- start start 2024-08-18T21:14:20.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 10 monclient: init 2024-08-18T21:14:20.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:20.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 10 monclient: _add_conns ranks=[7,0,5,1,6,2,8,3,4] 2024-08-18T21:14:20.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f25e809f080 0x7f25e81383f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:20.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 10 monclient(hunting): picked mon.noname-i con 0x7f25e809f080 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:20.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e80a6bd0 0x7f25e8138930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:20.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 10 monclient(hunting): picked mon.noname-a con 0x7f25e80a6bd0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:14:20.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f25e8139990 0x7f25e813da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:20.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 10 monclient(hunting): picked mon.noname-h con 0x7f25e8139990 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:20.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:20.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f25e80a89f0 con 0x7f25e80a6bd0 2024-08-18T21:14:20.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:20.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f25e80a7ce0 con 0x7f25e8139990 2024-08-18T21:14:20.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:20.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f25e8143610 con 0x7f25e809f080 2024-08-18T21:14:20.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:20.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25eead2640 10 monclient(hunting): authenticate will time out at 1627.630826s 2024-08-18T21:14:20.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e80a6bd0 0x7f25e8138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:20.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e80a6bd0 0x7f25e8138930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56390/0 (socket says 172.21.15.5:56390) 2024-08-18T21:14:20.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 1 -- 172.21.15.5:0/2094491522 learned_addr learned my addr 172.21.15.5:0/2094491522 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:20.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 10 monclient(hunting): get_auth_request con 0x7f25e80a6bd0 auth_method 0 2024-08-18T21:14:20.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:20.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:20.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:20.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:20.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:20.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:20.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 10 monclient(hunting): handle_auth_done global_id 124479 payload 824 2024-08-18T21:14:20.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 1 -- 172.21.15.5:0/2094491522 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f25e809f080 msgr2=0x7f25e81383f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:20.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25ec86e640 1 --2- 172.21.15.5:0/2094491522 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f25e809f080 0x7f25e81383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:20.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25ed06f640 1 --2- 172.21.15.5:0/2094491522 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f25e8139990 0x7f25e813da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:20.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 1 --2- 172.21.15.5:0/2094491522 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f25e809f080 0x7f25e81383f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:20.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 1 -- 172.21.15.5:0/2094491522 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f25e8139990 msgr2=0x7f25e813da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:20.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 1 --2- 172.21.15.5:0/2094491522 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f25e8139990 0x7f25e813da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:20.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 10 monclient: _finish_hunting 0 2024-08-18T21:14:20.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 1 monclient: found mon.noname-a 2024-08-18T21:14:20.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:20.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:14:20.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.615+0000 7f25dffff640 1 -- 172.21.15.5:0/2094491522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e8123e40 con 0x7f25e80a6bd0 2024-08-18T21:14:20.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dffff640 1 -- 172.21.15.5:0/2094491522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e80a6bd0 msgr2=0x7f25e8138930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:20.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dffff640 1 --2- 172.21.15.5:0/2094491522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e80a6bd0 0x7f25e8138930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f25d800e930 tx=0x7f25d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:20.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dd7fa640 1 -- 172.21.15.5:0/2094491522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f25d8017070 con 0x7f25e80a6bd0 2024-08-18T21:14:20.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:20.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:14:20.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dd7fa640 10 monclient: dump: 2024-08-18T21:14:20.632 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:20.633 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:20.633 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:20.633 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:20.633 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:20.633 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:20.633 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:20.633 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:20.633 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:20.633 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:20.633 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:20.633 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:20.633 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:20.633 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:20.633 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:20.634 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:20.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dd7fa640 10 monclient: _finish_auth 0 2024-08-18T21:14:20.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dd7fa640 10 monclient: _check_auth_tickets 2024-08-18T21:14:20.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:20.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dd7fa640 1 -- 172.21.15.5:0/2094491522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d800cc10 con 0x7f25e80a6bd0 2024-08-18T21:14:20.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dd7fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:20.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dd7fa640 1 -- 172.21.15.5:0/2094491522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f25d800cdc0 con 0x7f25e80a6bd0 2024-08-18T21:14:20.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:20.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:14:20.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dd7fa640 10 monclient: dump: 2024-08-18T21:14:20.635 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:20.635 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:20.635 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:20.635 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:20.635 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:20.635 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:20.635 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:20.635 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:20.635 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:20.635 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:20.635 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:20.636 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25deffd640 4 set_mon_vals no callback set 2024-08-18T21:14:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25eead2640 5 monclient: authenticate success, global_id 124479 2024-08-18T21:14:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25eead2640 10 monclient: _renew_subs 2024-08-18T21:14:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25eead2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25eead2640 1 -- 172.21.15.5:0/2094491522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e8124120 con 0x7f25e80a6bd0 2024-08-18T21:14:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25eead2640 10 monclient: _renew_subs 2024-08-18T21:14:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25eead2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25eead2640 1 -- 172.21.15.5:0/2094491522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e8123b60 con 0x7f25e80a6bd0 2024-08-18T21:14:20.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25eead2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:20.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25eead2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:20.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25eead2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:20.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25eead2640 1 -- 172.21.15.5:0/2094491522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e8139df0 con 0x7f25e80a6bd0 2024-08-18T21:14:20.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dd7fa640 1 -- 172.21.15.5:0/2094491522 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f25d801a070 con 0x7f25e80a6bd0 2024-08-18T21:14:20.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dd7fa640 1 --2- 172.21.15.5:0/2094491522 >> v2:172.21.15.157:6812/631023601 conn(0x7f25d403bdc0 0x7f25d403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:20.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.619+0000 7f25dd7fa640 1 -- 172.21.15.5:0/2094491522 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(293..293 src has 22..293) ==== 3898+0+0 (secure 0 0 0) 0x7f25d800f040 con 0x7f25e80a6bd0 2024-08-18T21:14:20.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.623+0000 7f25ec86e640 1 --2- 172.21.15.5:0/2094491522 >> v2:172.21.15.157:6812/631023601 conn(0x7f25d403bdc0 0x7f25d403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:20.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.623+0000 7f25ec86e640 10 monclient: get_auth_request con 0x7f25d403bdc0 auth_method 0 2024-08-18T21:14:20.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.623+0000 7f25ec86e640 1 --2- 172.21.15.5:0/2094491522 >> v2:172.21.15.157:6812/631023601 conn(0x7f25d403bdc0 0x7f25d403e280 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f25e40099b0 tx=0x7f25e4008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:20.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.627+0000 7f25dd7fa640 1 -- 172.21.15.5:0/2094491522 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f25d8021020 con 0x7f25e80a6bd0 2024-08-18T21:14:20.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.627+0000 7f25dd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:20.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.627+0000 7f25dd7fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:20.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:14:20.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:14:20.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:20.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 1 -- 172.21.15.5:0/2094491522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f25e813f810 con 0x7f25e80a6bd0 2024-08-18T21:14:20.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25dd7fa640 1 -- 172.21.15.5:0/2094491522 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7f25d801ac80 con 0x7f25e80a6bd0 2024-08-18T21:14:20.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25dd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:14:20.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25dd7fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:20.889 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":228,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:14:20.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 1 -- 172.21.15.5:0/2094491522 >> v2:172.21.15.157:6812/631023601 conn(0x7f25d403bdc0 msgr2=0x7f25d403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 1 --2- 172.21.15.5:0/2094491522 >> v2:172.21.15.157:6812/631023601 conn(0x7f25d403bdc0 0x7f25d403e280 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f25e40099b0 tx=0x7f25e4008040 comp rx=0 tx=0).stop 2024-08-18T21:14:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 10 monclient: shutdown 2024-08-18T21:14:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 1 -- 172.21.15.5:0/2094491522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e80a6bd0 msgr2=0x7f25e8138930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 1 --2- 172.21.15.5:0/2094491522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e80a6bd0 0x7f25e8138930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f25d800e930 tx=0x7f25d800edf0 comp rx=0 tx=0).stop 2024-08-18T21:14:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 1 -- 172.21.15.5:0/2094491522 shutdown_connections 2024-08-18T21:14:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 1 --2- 172.21.15.5:0/2094491522 >> v2:172.21.15.157:6812/631023601 conn(0x7f25d403bdc0 0x7f25d403e280 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 1 --2- 172.21.15.5:0/2094491522 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f25e8139990 0x7f25e813da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 1 --2- 172.21.15.5:0/2094491522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e80a6bd0 0x7f25e8138930 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 1 --2- 172.21.15.5:0/2094491522 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f25e809f080 0x7f25e81383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 1 -- 172.21.15.5:0/2094491522 >> 172.21.15.5:0/2094491522 conn(0x7f25e8068700 msgr2=0x7f25e80aa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.891+0000 7f25eead2640 1 -- 172.21.15.5:0/2094491522 shutdown_connections 2024-08-18T21:14:20.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:20.895+0000 7f25eead2640 1 -- 172.21.15.5:0/2094491522 wait complete. 2024-08-18T21:14:20.910 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:14:20.911 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:14:20.911 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:14:20.973 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32254]: starting. 2024-08-18T21:14:20.974 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32254]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-32253 2024-08-18T21:14:20.974 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32254]: created object 0... 2024-08-18T21:14:20.974 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32254]: created object 25... 2024-08-18T21:14:20.974 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32254]: created object 49... 2024-08-18T21:14:20.974 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32254]: finishing. 2024-08-18T21:14:20.975 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32254]: shutting down. 2024-08-18T21:14:21.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 10 monclient: get_monmap_and_config 2024-08-18T21:14:21.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 10 monclient: build_initial_monmap 2024-08-18T21:14:21.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 10 monclient: monmap: 2024-08-18T21:14:21.028 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:21.028 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.028 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:21.032840+0000 2024-08-18T21:14:21.028 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:21.032840+0000 2024-08-18T21:14:21.028 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:21.029 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.029 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:21.029 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:21.029 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:21.029 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:21.029 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:21.029 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:21.029 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:21.029 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:21.029 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:21.029 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:21.029 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:21.029 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 1 Processor -- start 2024-08-18T21:14:21.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 1 -- start start 2024-08-18T21:14:21.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 10 monclient: init 2024-08-18T21:14:21.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:21.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 10 monclient: _add_conns ranks=[4,3,7,2,10,9,6,1,5,8,0] 2024-08-18T21:14:21.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff8cc0a6bd0 0x7ff8cc0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 10 monclient(hunting): picked mon.noname-c con 0x7ff8cc0a6bd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:21.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8cc09f080 0x7ff8cc0a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 10 monclient(hunting): picked mon.noname-g con 0x7ff8cc09f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:21.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff8cc139990 0x7ff8cc139df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 10 monclient(hunting): picked mon.noname-i con 0x7ff8cc139990 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:21.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff8cc09e4c0 con 0x7ff8cc09f080 2024-08-18T21:14:21.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff8cc06f930 con 0x7ff8cc0a6bd0 2024-08-18T21:14:21.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7ff8cc0a7a30 con 0x7ff8cc139990 2024-08-18T21:14:21.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:21.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8d1f59640 10 monclient(hunting): authenticate will time out at 1628.045972s 2024-08-18T21:14:21.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff8cc0a6bd0 0x7ff8cc0a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff8cc0a6bd0 0x7ff8cc0a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:58544/0 (socket says 172.21.15.5:58544) 2024-08-18T21:14:21.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 1 -- 172.21.15.5:0/1111165952 learned_addr learned my addr 172.21.15.5:0/1111165952 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:21.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 10 monclient(hunting): get_auth_request con 0x7ff8cc0a6bd0 auth_method 0 2024-08-18T21:14:21.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cbfff640 1 --2- 172.21.15.5:0/1111165952 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff8cc139990 0x7ff8cc139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 10 monclient(hunting): handle_auth_done global_id 114637 payload 274 2024-08-18T21:14:21.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8caffd640 1 --2- 172.21.15.5:0/1111165952 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8cc09f080 0x7ff8cc0a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 1 -- 172.21.15.5:0/1111165952 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff8cc139990 msgr2=0x7ff8cc139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:21.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 1 --2- 172.21.15.5:0/1111165952 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff8cc139990 0x7ff8cc139df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 1 -- 172.21.15.5:0/1111165952 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8cc09f080 msgr2=0x7ff8cc0a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:21.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 1 --2- 172.21.15.5:0/1111165952 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8cc09f080 0x7ff8cc0a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:14:21.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 1 monclient: found mon.noname-c 2024-08-18T21:14:21.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:21.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:14:21.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8cb7fe640 1 -- 172.21.15.5:0/1111165952 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc0a7fb0 con 0x7ff8cc0a6bd0 2024-08-18T21:14:21.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8caffd640 10 monclient: get_auth_request con 0x7ff8cc09f080 auth_method 0 2024-08-18T21:14:21.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.031+0000 7ff8caffd640 1 --2- 172.21.15.5:0/1111165952 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8cc09f080 0x7ff8cc0a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:14:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8cb7fe640 1 -- 172.21.15.5:0/1111165952 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff8cc0a6bd0 msgr2=0x7ff8cc0a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8cb7fe640 1 --2- 172.21.15.5:0/1111165952 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff8cc0a6bd0 0x7ff8cc0a6fb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0098a0 tx=0x7ff8bc01c440 comp rx=0 tx=0).ready entity=mon.4 client_cookie=a55404d948c72880 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8ca7fc640 1 -- 172.21.15.5:0/1111165952 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff8bc0b0070 con 0x7ff8cc0a6bd0 2024-08-18T21:14:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8ca7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:14:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8ca7fc640 10 monclient: dump: 2024-08-18T21:14:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.060 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8ca7fc640 10 monclient: _finish_auth 0 2024-08-18T21:14:21.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8ca7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:14:21.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8ca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:21.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8ca7fc640 1 -- 172.21.15.5:0/1111165952 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8bc0aa810 con 0x7ff8cc0a6bd0 2024-08-18T21:14:21.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8ca7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:21.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8ca7fc640 1 -- 172.21.15.5:0/1111165952 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff8bc0aae30 con 0x7ff8cc0a6bd0 2024-08-18T21:14:21.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8ca7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:21.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8ca7fc640 10 monclient: dump: 2024-08-18T21:14:21.061 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.061 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.061 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.062 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.062 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.062 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.062 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.062 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.062 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.062 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.062 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.063 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.063 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.063 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.063 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.063 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8d1f59640 5 monclient: authenticate success, global_id 114637 2024-08-18T21:14:21.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8d1f59640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:21.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8d1f59640 4 set_mon_vals no callback set 2024-08-18T21:14:21.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8d1f59640 10 monclient: shutdown 2024-08-18T21:14:21.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8d1f59640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:21.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8d1f59640 1 -- 172.21.15.5:0/1111165952 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff8cc0a6bd0 msgr2=0x7ff8cc0a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8d1f59640 1 --2- 172.21.15.5:0/1111165952 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff8cc0a6bd0 0x7ff8cc0a6fb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0098a0 tx=0x7ff8bc01c440 comp rx=0 tx=0).stop 2024-08-18T21:14:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8d1f59640 1 -- 172.21.15.5:0/1111165952 shutdown_connections 2024-08-18T21:14:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8d1f59640 1 --2- 172.21.15.5:0/1111165952 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff8cc139990 0x7ff8cc139df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8d1f59640 1 --2- 172.21.15.5:0/1111165952 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8cc09f080 0x7ff8cc0a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8d1f59640 1 --2- 172.21.15.5:0/1111165952 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff8cc0a6bd0 0x7ff8cc0a6fb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8d1f59640 1 -- 172.21.15.5:0/1111165952 >> 172.21.15.5:0/1111165952 conn(0x7ff8cc068700 msgr2=0x7ff8cc068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8d1f59640 1 -- 172.21.15.5:0/1111165952 shutdown_connections 2024-08-18T21:14:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.035+0000 7ff8d1f59640 1 -- 172.21.15.5:0/1111165952 wait complete. 2024-08-18T21:14:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient: build_initial_monmap 2024-08-18T21:14:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient: monmap: 2024-08-18T21:14:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:21.066 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 1 Processor -- start 2024-08-18T21:14:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 1 -- start start 2024-08-18T21:14:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient: init 2024-08-18T21:14:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient: _add_conns ranks=[8,0,2,4,6,1,3,7,5] 2024-08-18T21:14:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff8cc09f080 0x7ff8cc1384b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient(hunting): picked mon.noname-e con 0x7ff8cc09f080 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:14:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc0a6bd0 0x7ff8cc1389f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient(hunting): picked mon.noname-a con 0x7ff8cc0a6bd0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:14:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff8cc139990 0x7ff8cc13d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient(hunting): picked mon.noname-b con 0x7ff8cc139990 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc0a89f0 con 0x7ff8cc0a6bd0 2024-08-18T21:14:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7ff8cc0a7ce0 con 0x7ff8cc139990 2024-08-18T21:14:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff8cc143610 con 0x7ff8cc09f080 2024-08-18T21:14:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient(hunting): authenticate will time out at 1628.052873s 2024-08-18T21:14:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff8cc09f080 0x7ff8cc1384b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cbfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff8cc139990 0x7ff8cc13d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff8cc09f080 0x7ff8cc1384b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:33608/0 (socket says 172.21.15.5:33608) 2024-08-18T21:14:21.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 1 -- 172.21.15.5:0/1769810790 learned_addr learned my addr 172.21.15.5:0/1769810790 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:21.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 10 monclient(hunting): get_auth_request con 0x7ff8cc09f080 auth_method 0 2024-08-18T21:14:21.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cbfff640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff8cc139990 0x7ff8cc13d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:56864/0 (socket says 172.21.15.5:56864) 2024-08-18T21:14:21.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cbfff640 10 monclient(hunting): get_auth_request con 0x7ff8cc139990 auth_method 0 2024-08-18T21:14:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cbfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8caffd640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc0a6bd0 0x7ff8cc1389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8caffd640 10 monclient(hunting): get_auth_request con 0x7ff8cc0a6bd0 auth_method 0 2024-08-18T21:14:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8caffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8caffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 10 monclient(hunting): handle_auth_done global_id 115001 payload 824 2024-08-18T21:14:21.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 1 -- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff8cc139990 msgr2=0x7ff8cc13d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff8cc139990 0x7ff8cc13d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 1 -- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc0a6bd0 msgr2=0x7ff8cc1389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc0a6bd0 0x7ff8cc1389f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:14:21.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 1 monclient: found mon.noname-e 2024-08-18T21:14:21.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:21.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:14:21.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 1 -- 172.21.15.5:0/1769810790 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc124200 con 0x7ff8cc09f080 2024-08-18T21:14:21.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cbfff640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff8cc139990 0x7ff8cc13d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:14:21.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 1 -- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff8cc09f080 msgr2=0x7ff8cc1384b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8cb7fe640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff8cc09f080 0x7ff8cc1384b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0097c0 tx=0x7ff8bc0191e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8c3fff640 1 -- 172.21.15.5:0/1769810790 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff8bc0ba070 con 0x7ff8cc09f080 2024-08-18T21:14:21.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8c3fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:14:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8c3fff640 10 monclient: dump: 2024-08-18T21:14:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.073 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8c3fff640 10 monclient: _finish_auth 0 2024-08-18T21:14:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8c3fff640 10 monclient: _check_auth_tickets 2024-08-18T21:14:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8c3fff640 1 -- 172.21.15.5:0/1769810790 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8bc0b1040 con 0x7ff8cc09f080 2024-08-18T21:14:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8c3fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8c3fff640 1 -- 172.21.15.5:0/1769810790 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff8bc0b0070 con 0x7ff8cc09f080 2024-08-18T21:14:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 5 monclient: authenticate success, global_id 115001 2024-08-18T21:14:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient: _renew_subs 2024-08-18T21:14:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:14:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 1 -- 172.21.15.5:0/1769810790 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8cc0ab5a0 con 0x7ff8cc09f080 2024-08-18T21:14:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8c3fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:14:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8c97fa640 4 set_mon_vals no callback set 2024-08-18T21:14:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8c3fff640 10 monclient: dump: 2024-08-18T21:14:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.075 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient: _renew_subs 2024-08-18T21:14:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:14:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.039+0000 7ff8d1f59640 1 -- 172.21.15.5:0/1769810790 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8cc13f490 con 0x7ff8cc09f080 2024-08-18T21:14:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8d1f59640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8d1f59640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc13fb70 0x7ff8cc13dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8d1f59640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8d1f59640 1 -- 172.21.15.5:0/1769810790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc051140 con 0x7ff8cc13fb70 2024-08-18T21:14:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8caffd640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc13fb70 0x7ff8cc13dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8caffd640 10 monclient: get_auth_request con 0x7ff8cc13fb70 auth_method 0 2024-08-18T21:14:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8caffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8caffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8c3fff640 1 -- 172.21.15.5:0/1769810790 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7ff8bc004250 con 0x7ff8cc09f080 2024-08-18T21:14:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8caffd640 10 monclient(hunting): handle_auth_done global_id 124497 payload 824 2024-08-18T21:14:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8caffd640 1 -- 172.21.15.5:0/1769810790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8cc139df0 con 0x7ff8cc13fb70 2024-08-18T21:14:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8c3fff640 1 --2- 172.21.15.5:0/1769810790 >> v2:172.21.15.157:6812/631023601 conn(0x7ff8ac03bdc0 0x7ff8ac03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8c3fff640 1 -- 172.21.15.5:0/1769810790 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(294..294 src has 22..294) ==== 3898+0+0 (secure 0 0 0) 0x7ff8bc0e7be0 con 0x7ff8cc09f080 2024-08-18T21:14:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8cbfff640 1 --2- 172.21.15.5:0/1769810790 >> v2:172.21.15.157:6812/631023601 conn(0x7ff8ac03bdc0 0x7ff8ac03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8cbfff640 10 monclient: get_auth_request con 0x7ff8ac03bdc0 auth_method 0 2024-08-18T21:14:21.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8caffd640 1 -- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc13fb70 msgr2=0x7ff8cc13dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8caffd640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc13fb70 0x7ff8cc13dee0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc13fb00 tx=0x7ff8b400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8c3fff640 1 -- 172.21.15.5:0/1769810790 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff8b400dc30 con 0x7ff8cc13fb70 2024-08-18T21:14:21.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8c3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:14:21.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8c3fff640 10 monclient: dump: 2024-08-18T21:14:21.078 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.078 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.079 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.079 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.079 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.079 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.079 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.079 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.079 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.079 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.080 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8c3fff640 1 -- 172.21.15.5:0/1769810790 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff8b400dc30 con 0x7ff8cc13fb70 2024-08-18T21:14:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8c3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8c3fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8c3fff640 1 -- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc13fb70 msgr2=0x7ff8cc13dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8c3fff640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc13fb70 0x7ff8cc13dee0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc13fb00 tx=0x7ff8b400fce0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8c3fff640 1 -- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc13fb70 msgr2=0x7ff8cc13dee0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.043+0000 7ff8c3fff640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc13fb70 0x7ff8cc13dee0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.047+0000 7ff8cbfff640 1 --2- 172.21.15.5:0/1769810790 >> v2:172.21.15.157:6812/631023601 conn(0x7ff8ac03bdc0 0x7ff8ac03e280 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0a6890 tx=0x7ff8c4007670 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.051+0000 7ff8d1f59640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:21.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.051+0000 7ff8d1f59640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc13e420 0x7ff8cc13e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.051+0000 7ff8d1f59640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.051+0000 7ff8d1f59640 1 -- 172.21.15.5:0/1769810790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc13ed70 con 0x7ff8cc13e420 2024-08-18T21:14:21.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.051+0000 7ff8caffd640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc13e420 0x7ff8cc13e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.051+0000 7ff8caffd640 10 monclient: get_auth_request con 0x7ff8cc13e420 auth_method 0 2024-08-18T21:14:21.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.051+0000 7ff8caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.051+0000 7ff8caffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.051+0000 7ff8caffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.051+0000 7ff8caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.051+0000 7ff8caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.051+0000 7ff8caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.051+0000 7ff8caffd640 10 monclient(hunting): handle_auth_done global_id 124506 payload 824 2024-08-18T21:14:21.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.051+0000 7ff8caffd640 1 -- 172.21.15.5:0/1769810790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff8cc0746d0 con 0x7ff8cc13e420 2024-08-18T21:14:21.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8caffd640 1 -- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc13e420 msgr2=0x7ff8cc13e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8caffd640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc13e420 0x7ff8cc13e830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4019000 tx=0x7ff8b40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8c3fff640 1 -- 172.21.15.5:0/1769810790 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff8b4004490 con 0x7ff8cc13e420 2024-08-18T21:14:21.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8c3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:14:21.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8c3fff640 10 monclient: dump: 2024-08-18T21:14:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.086 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.086 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.086 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.086 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.086 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.086 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.086 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.087 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.087 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8c3fff640 1 -- 172.21.15.5:0/1769810790 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9417 (secure 0 0 0) 0x7ff8b4004020 con 0x7ff8cc13e420 2024-08-18T21:14:21.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8c3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:21.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8c3fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:21.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8c3fff640 1 -- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc13e420 msgr2=0x7ff8cc13e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8c3fff640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc13e420 0x7ff8cc13e830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4019000 tx=0x7ff8b40046d0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8c3fff640 1 -- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc13e420 msgr2=0x7ff8cc13e830 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:21.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8c3fff640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8cc13e420 0x7ff8cc13e830 secure :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4019000 tx=0x7ff8b40046d0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.088 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:14:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 108035, 2024-08-18T21:14:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:14:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:14:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:14:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:21.118 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8d1f59640 1 -- 172.21.15.5:0/1769810790 >> v2:172.21.15.157:6812/631023601 conn(0x7ff8ac03bdc0 msgr2=0x7ff8ac03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8d1f59640 1 --2- 172.21.15.5:0/1769810790 >> v2:172.21.15.157:6812/631023601 conn(0x7ff8ac03bdc0 0x7ff8ac03e280 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0a6890 tx=0x7ff8c4007670 comp rx=0 tx=0).stop 2024-08-18T21:14:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8d1f59640 10 monclient: shutdown 2024-08-18T21:14:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8d1f59640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8d1f59640 1 -- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff8cc09f080 msgr2=0x7ff8cc1384b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8d1f59640 1 --2- 172.21.15.5:0/1769810790 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff8cc09f080 0x7ff8cc1384b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0097c0 tx=0x7ff8bc0191e0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8cbfff640 1 -- 172.21.15.5:0/1769810790 reap_dead start 2024-08-18T21:14:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8cbfff640 1 -- 172.21.15.5:0/1769810790 reap_dead start 2024-08-18T21:14:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8d1f59640 1 -- 172.21.15.5:0/1769810790 shutdown_connections 2024-08-18T21:14:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8d1f59640 1 -- 172.21.15.5:0/1769810790 >> 172.21.15.5:0/1769810790 conn(0x7ff8cc068700 msgr2=0x7ff8cc0aa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8d1f59640 1 -- 172.21.15.5:0/1769810790 shutdown_connections 2024-08-18T21:14:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.055+0000 7ff8d1f59640 1 -- 172.21.15.5:0/1769810790 wait complete. 2024-08-18T21:14:21.120 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:21.121 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:14:21.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:14:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.243+0000 7f32ba778640 10 monclient: get_monmap_and_config 2024-08-18T21:14:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.243+0000 7f32ba778640 10 monclient: build_initial_monmap 2024-08-18T21:14:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.243+0000 7f32ba778640 10 monclient: monmap: 2024-08-18T21:14:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:21.248350+0000 2024-08-18T21:14:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:21.248350+0000 2024-08-18T21:14:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:21.245 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 1 Processor -- start 2024-08-18T21:14:21.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 1 -- start start 2024-08-18T21:14:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 10 monclient: init 2024-08-18T21:14:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 10 monclient: _add_conns ranks=[3,4,1,7,6,9,2,5,8,0,10] 2024-08-18T21:14:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32b406c950 0x7f32b406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 10 monclient(hunting): picked mon.noname-g con 0x7f32b406c950 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f32b40a4d90 0x7f32b406d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 10 monclient(hunting): picked mon.noname-c con 0x7f32b40a4d90 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f32b4137800 addr v1:172.21.15.157:6789/0 2024-08-18T21:14:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b409fe20 con 0x7f32b4137800 2024-08-18T21:14:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f32b40a5610 con 0x7f32b406c950 2024-08-18T21:14:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f32b406d7b0 con 0x7f32b40a4d90 2024-08-18T21:14:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32ba778640 10 monclient(hunting): authenticate will time out at 1628.261491s 2024-08-18T21:14:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f32b40a4d90 0x7f32b406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f32b40a4d90 0x7f32b406d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:58558/0 (socket says 172.21.15.5:58558) 2024-08-18T21:14:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 1 -- 172.21.15.5:0/2844664765 learned_addr learned my addr 172.21.15.5:0/2844664765 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 10 monclient(hunting): get_auth_request con 0x7f32b40a4d90 auth_method 0 2024-08-18T21:14:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b3fff640 1 --2- 172.21.15.5:0/2844664765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32b406c950 0x7f32b406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b3fff640 10 monclient(hunting): get_auth_request con 0x7f32b406c950 auth_method 0 2024-08-18T21:14:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 10 monclient(hunting): handle_auth_done global_id 114646 payload 274 2024-08-18T21:14:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 1 -- 172.21.15.5:0/2844664765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32b406c950 msgr2=0x7f32b406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 1 --2- 172.21.15.5:0/2844664765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32b406c950 0x7f32b406cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 1 -- 172.21.15.5:0/2844664765 >> v1:172.21.15.157:6789/0 conn(0x7f32b4137800 legacy=0x7f32b4137cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 10 monclient: _finish_hunting 0 2024-08-18T21:14:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 1 monclient: found mon.noname-c 2024-08-18T21:14:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:14:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.247+0000 7f32b37fe640 1 -- 172.21.15.5:0/2844664765 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b40a09e0 con 0x7f32b40a4d90 2024-08-18T21:14:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32b37fe640 1 -- 172.21.15.5:0/2844664765 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f32b40a4d90 msgr2=0x7f32b406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32b37fe640 1 --2- 172.21.15.5:0/2844664765 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f32b40a4d90 0x7f32b406d270 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f329c0098a0 tx=0x7f329c01c440 comp rx=0 tx=0).ready entity=mon.4 client_cookie=fdb4c03ed4a3a596 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32b2ffd640 1 -- 172.21.15.5:0/2844664765 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f329c0b0070 con 0x7f32b40a4d90 2024-08-18T21:14:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32b2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:14:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32b2ffd640 10 monclient: dump: 2024-08-18T21:14:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.259 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32b2ffd640 10 monclient: _finish_auth 0 2024-08-18T21:14:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32b2ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:14:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32b2ffd640 1 -- 172.21.15.5:0/2844664765 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c0aa810 con 0x7f32b40a4d90 2024-08-18T21:14:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 5 monclient: authenticate success, global_id 114646 2024-08-18T21:14:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:14:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32b2ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32b2ffd640 1 -- 172.21.15.5:0/2844664765 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f329c0aae30 con 0x7f32b40a4d90 2024-08-18T21:14:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 4 set_mon_vals no callback set 2024-08-18T21:14:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32b2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32b2ffd640 10 monclient: dump: 2024-08-18T21:14:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.262 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 10 monclient: shutdown 2024-08-18T21:14:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 1 -- 172.21.15.5:0/2844664765 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f32b40a4d90 msgr2=0x7f32b406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 1 --2- 172.21.15.5:0/2844664765 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f32b40a4d90 0x7f32b406d270 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f329c0098a0 tx=0x7f329c01c440 comp rx=0 tx=0).stop 2024-08-18T21:14:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 1 -- 172.21.15.5:0/2844664765 shutdown_connections 2024-08-18T21:14:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 1 --2- 172.21.15.5:0/2844664765 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f32b40a4d90 0x7f32b406d270 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 1 --2- 172.21.15.5:0/2844664765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32b406c950 0x7f32b406cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 1 -- 172.21.15.5:0/2844664765 >> 172.21.15.5:0/2844664765 conn(0x7f32b40688d0 msgr2=0x7f32b4068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 1 -- 172.21.15.5:0/2844664765 shutdown_connections 2024-08-18T21:14:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 1 -- 172.21.15.5:0/2844664765 wait complete. 2024-08-18T21:14:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 10 monclient: build_initial_monmap 2024-08-18T21:14:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 10 monclient: monmap: 2024-08-18T21:14:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:21.265 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:21.265 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 1 Processor -- start 2024-08-18T21:14:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 1 -- start start 2024-08-18T21:14:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.251+0000 7f32ba778640 10 monclient: init 2024-08-18T21:14:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 10 monclient: _add_conns ranks=[5,8,3,0,7,1,4,6,2] 2024-08-18T21:14:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f32b406c950 0x7f32b41d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 10 monclient(hunting): picked mon.noname-h con 0x7f32b406c950 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f32b40a4d90 0x7f32b4136890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 10 monclient(hunting): picked mon.noname-e con 0x7f32b40a4d90 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:14:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32b4137800 0x7f32b4136dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 10 monclient(hunting): picked mon.noname-g con 0x7f32b4137800 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f32b4142610 con 0x7f32b4137800 2024-08-18T21:14:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f32b4142490 con 0x7f32b406c950 2024-08-18T21:14:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f32b4142790 con 0x7f32b40a4d90 2024-08-18T21:14:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 10 monclient(hunting): authenticate will time out at 1628.268302s 2024-08-18T21:14:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f32b40a4d90 0x7f32b4136890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f32b40a4d90 0x7f32b4136890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:33620/0 (socket says 172.21.15.5:33620) 2024-08-18T21:14:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 1 -- 172.21.15.5:0/4258513635 learned_addr learned my addr 172.21.15.5:0/4258513635 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 10 monclient(hunting): get_auth_request con 0x7f32b40a4d90 auth_method 0 2024-08-18T21:14:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b3fff640 1 --2- 172.21.15.5:0/4258513635 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f32b406c950 0x7f32b41d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b3fff640 10 monclient(hunting): get_auth_request con 0x7f32b406c950 auth_method 0 2024-08-18T21:14:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b8d15640 1 --2- 172.21.15.5:0/4258513635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32b4137800 0x7f32b4136dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b8d15640 10 monclient(hunting): get_auth_request con 0x7f32b4137800 auth_method 0 2024-08-18T21:14:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b8d15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b8d15640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b8d15640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b8d15640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b8d15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b8d15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 10 monclient(hunting): handle_auth_done global_id 115010 payload 824 2024-08-18T21:14:21.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 1 -- 172.21.15.5:0/4258513635 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f32b406c950 msgr2=0x7f32b41d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 1 --2- 172.21.15.5:0/4258513635 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f32b406c950 0x7f32b41d17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 1 -- 172.21.15.5:0/4258513635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32b4137800 msgr2=0x7f32b4136dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 1 --2- 172.21.15.5:0/4258513635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f32b4137800 0x7f32b4136dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 10 monclient: _finish_hunting 0 2024-08-18T21:14:21.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 1 monclient: found mon.noname-e 2024-08-18T21:14:21.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:21.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:14:21.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 1 -- 172.21.15.5:0/4258513635 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b4120ee0 con 0x7f32b40a4d90 2024-08-18T21:14:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 1 -- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f32b40a4d90 msgr2=0x7f32b4136890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b37fe640 1 --2- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f32b40a4d90 0x7f32b4136890 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f329c0097c0 tx=0x7f329c0191e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b0ff9640 1 -- 172.21.15.5:0/4258513635 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f329c0b0070 con 0x7f32b40a4d90 2024-08-18T21:14:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b0ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:14:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b0ff9640 10 monclient: dump: 2024-08-18T21:14:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.273 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b0ff9640 10 monclient: _finish_auth 0 2024-08-18T21:14:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b0ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:14:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 5 monclient: authenticate success, global_id 115010 2024-08-18T21:14:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 10 monclient: _renew_subs 2024-08-18T21:14:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b0ff9640 1 -- 172.21.15.5:0/4258513635 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c0b1040 con 0x7f32b40a4d90 2024-08-18T21:14:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:14:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 1 -- 172.21.15.5:0/4258513635 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b41229a0 con 0x7f32b40a4d90 2024-08-18T21:14:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b0ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b0ff9640 1 -- 172.21.15.5:0/4258513635 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f329c0044a0 con 0x7f32b40a4d90 2024-08-18T21:14:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b0ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:14:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b27fc640 4 set_mon_vals no callback set 2024-08-18T21:14:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32b0ff9640 10 monclient: dump: 2024-08-18T21:14:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.277 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.277 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.277 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.277 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.277 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.277 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.278 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.278 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.278 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.278 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.278 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 10 monclient: _renew_subs 2024-08-18T21:14:21.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:14:21.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.255+0000 7f32ba778640 1 -- 172.21.15.5:0/4258513635 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b4120930 con 0x7f32b40a4d90 2024-08-18T21:14:21.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b0ff9640 1 -- 172.21.15.5:0/4258513635 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f329c0bc060 con 0x7f32b40a4d90 2024-08-18T21:14:21.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32ba778640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:21.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32ba778640 1 --2- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32b4070030 0x7f32b4070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32ba778640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32ba778640 1 -- 172.21.15.5:0/4258513635 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f32b4051140 con 0x7f32b4070030 2024-08-18T21:14:21.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b0ff9640 1 --2- 172.21.15.5:0/4258513635 >> v2:172.21.15.157:6812/631023601 conn(0x7f329403bde0 0x7f329403e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b3fff640 1 --2- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32b4070030 0x7f32b4070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b3fff640 10 monclient: get_auth_request con 0x7f32b4070030 auth_method 0 2024-08-18T21:14:21.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b0ff9640 1 -- 172.21.15.5:0/4258513635 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(294..294 src has 22..294) ==== 3898+0+0 (secure 0 0 0) 0x7f329c0e77e0 con 0x7f32b40a4d90 2024-08-18T21:14:21.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b3fff640 10 monclient(hunting): handle_auth_done global_id 114770 payload 824 2024-08-18T21:14:21.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b3fff640 1 -- 172.21.15.5:0/4258513635 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32b4137cb0 con 0x7f32b4070030 2024-08-18T21:14:21.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b8d15640 1 --2- 172.21.15.5:0/4258513635 >> v2:172.21.15.157:6812/631023601 conn(0x7f329403bde0 0x7f329403e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b8d15640 10 monclient: get_auth_request con 0x7f329403bde0 auth_method 0 2024-08-18T21:14:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b3fff640 1 -- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32b4070030 msgr2=0x7f32b4070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b3fff640 1 --2- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32b4070030 0x7f32b4070410 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f32ac004680 tx=0x7f32ac007700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b0ff9640 1 -- 172.21.15.5:0/4258513635 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f32ac004850 con 0x7f32b4070030 2024-08-18T21:14:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:14:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b0ff9640 10 monclient: dump: 2024-08-18T21:14:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.285 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b0ff9640 1 -- 172.21.15.5:0/4258513635 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f32ac01a070 con 0x7f32b4070030 2024-08-18T21:14:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b0ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b0ff9640 1 -- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32b4070030 msgr2=0x7f32b4070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b0ff9640 1 --2- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32b4070030 0x7f32b4070410 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f32ac004680 tx=0x7f32ac007700 comp rx=0 tx=0).stop 2024-08-18T21:14:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b0ff9640 1 -- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32b4070030 msgr2=0x7f32b4070410 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b0ff9640 1 --2- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32b4070030 0x7f32b4070410 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f32ac004680 tx=0x7f32ac007700 comp rx=0 tx=0).stop 2024-08-18T21:14:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.259+0000 7f32b8d15640 1 --2- 172.21.15.5:0/4258513635 >> v2:172.21.15.157:6812/631023601 conn(0x7f329403bde0 0x7f329403e2a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f32b40a8c10 tx=0x7f32a4006f60 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.267+0000 7f32ba778640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.267+0000 7f32ba778640 1 --2- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32b4070950 0x7f32b411f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.267+0000 7f32ba778640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.267+0000 7f32ba778640 1 -- 172.21.15.5:0/4258513635 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f32b406e1f0 con 0x7f32b4070950 2024-08-18T21:14:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.267+0000 7f32b3fff640 1 --2- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32b4070950 0x7f32b411f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.267+0000 7f32b3fff640 10 monclient: get_auth_request con 0x7f32b4070950 auth_method 0 2024-08-18T21:14:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.267+0000 7f32b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.267+0000 7f32b3fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.267+0000 7f32b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.267+0000 7f32b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.267+0000 7f32b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.267+0000 7f32b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.267+0000 7f32b3fff640 10 monclient(hunting): handle_auth_done global_id 114779 payload 824 2024-08-18T21:14:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.267+0000 7f32b3fff640 1 -- 172.21.15.5:0/4258513635 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f32b41d1ce0 con 0x7f32b4070950 2024-08-18T21:14:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32b3fff640 1 -- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32b4070950 msgr2=0x7f32b411f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32b3fff640 1 --2- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32b4070950 0x7f32b411f680 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00afd0 tx=0x7f32ac004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32b0ff9640 1 -- 172.21.15.5:0/4258513635 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f32ac014e20 con 0x7f32b4070950 2024-08-18T21:14:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32b0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32b0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:14:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32b0ff9640 10 monclient: dump: 2024-08-18T21:14:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32b0ff9640 1 -- 172.21.15.5:0/4258513635 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f32ac0149b0 con 0x7f32b4070950 2024-08-18T21:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32b0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32b0ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32b0ff9640 1 -- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32b4070950 msgr2=0x7f32b411f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32b0ff9640 1 --2- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32b4070950 0x7f32b411f680 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00afd0 tx=0x7f32ac004a50 comp rx=0 tx=0).stop 2024-08-18T21:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32b0ff9640 1 -- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32b4070950 msgr2=0x7f32b411f680 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32b0ff9640 1 --2- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f32b4070950 0x7f32b411f680 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00afd0 tx=0x7f32ac004a50 comp rx=0 tx=0).stop 2024-08-18T21:14:21.290 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 166426, 2024-08-18T21:14:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:14:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:14:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:21.318 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32ba778640 1 -- 172.21.15.5:0/4258513635 >> v2:172.21.15.157:6812/631023601 conn(0x7f329403bde0 msgr2=0x7f329403e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32ba778640 1 --2- 172.21.15.5:0/4258513635 >> v2:172.21.15.157:6812/631023601 conn(0x7f329403bde0 0x7f329403e2a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f32b40a8c10 tx=0x7f32a4006f60 comp rx=0 tx=0).stop 2024-08-18T21:14:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32ba778640 10 monclient: shutdown 2024-08-18T21:14:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32ba778640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32ba778640 1 -- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f32b40a4d90 msgr2=0x7f32b4136890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32ba778640 1 --2- 172.21.15.5:0/4258513635 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f32b40a4d90 0x7f32b4136890 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f329c0097c0 tx=0x7f329c0191e0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32b8d15640 1 -- 172.21.15.5:0/4258513635 reap_dead start 2024-08-18T21:14:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32b8d15640 1 -- 172.21.15.5:0/4258513635 reap_dead start 2024-08-18T21:14:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32ba778640 1 -- 172.21.15.5:0/4258513635 shutdown_connections 2024-08-18T21:14:21.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32ba778640 1 -- 172.21.15.5:0/4258513635 >> 172.21.15.5:0/4258513635 conn(0x7f32b40688d0 msgr2=0x7f32b40a1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:21.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32ba778640 1 -- 172.21.15.5:0/4258513635 shutdown_connections 2024-08-18T21:14:21.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.271+0000 7f32ba778640 1 -- 172.21.15.5:0/4258513635 wait complete. 2024-08-18T21:14:21.321 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:21.321 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:14:21.321 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:14:21.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 10 monclient: get_monmap_and_config 2024-08-18T21:14:21.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 10 monclient: build_initial_monmap 2024-08-18T21:14:21.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 10 monclient: monmap: 2024-08-18T21:14:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:21.441142+0000 2024-08-18T21:14:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:21.441142+0000 2024-08-18T21:14:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:21.438 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:21.438 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:21.438 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:21.438 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 1 Processor -- start 2024-08-18T21:14:21.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 1 -- start start 2024-08-18T21:14:21.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 10 monclient: init 2024-08-18T21:14:21.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:21.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 10 monclient: _add_conns ranks=[9,7,8,2,3,10,0,1,6,5,4] 2024-08-18T21:14:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4b00a6ce0 0x7ff4b00a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 10 monclient(hunting): picked mon.noname-a con 0x7ff4b00a6ce0 addr v2:172.21.15.5:3300/0 2024-08-18T21:14:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff4b00a7600 0x7ff4b0139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 10 monclient(hunting): picked mon.noname-i con 0x7ff4b00a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff4b0139fe0 0x7ff4b013a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 10 monclient(hunting): picked mon.noname-e con 0x7ff4b0139fe0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:14:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff4b00a5000 con 0x7ff4b00a6ce0 2024-08-18T21:14:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7ff4b00a4360 con 0x7ff4b00a7600 2024-08-18T21:14:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff4b00a45d0 con 0x7ff4b0139fe0 2024-08-18T21:14:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b8102640 10 monclient(hunting): authenticate will time out at 1628.454331s 2024-08-18T21:14:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff4b0139fe0 0x7ff4b013a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b5e9e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4b00a6ce0 0x7ff4b00a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff4b0139fe0 0x7ff4b013a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:33630/0 (socket says 172.21.15.5:33630) 2024-08-18T21:14:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b5e9e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4b00a6ce0 0x7ff4b00a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56424/0 (socket says 172.21.15.5:56424) 2024-08-18T21:14:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 1 -- 172.21.15.5:0/3319746620 learned_addr learned my addr 172.21.15.5:0/3319746620 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 10 monclient(hunting): get_auth_request con 0x7ff4b0139fe0 auth_method 0 2024-08-18T21:14:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b5e9e640 10 monclient(hunting): get_auth_request con 0x7ff4b00a6ce0 auth_method 0 2024-08-18T21:14:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b5e9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b5e9e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b5e9e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b5e9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b5e9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b5e9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b569d640 1 --2- 172.21.15.5:0/3319746620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff4b00a7600 0x7ff4b0139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b569d640 10 monclient(hunting): get_auth_request con 0x7ff4b00a7600 auth_method 0 2024-08-18T21:14:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b569d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b569d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b569d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 10 monclient(hunting): handle_auth_done global_id 115019 payload 274 2024-08-18T21:14:21.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 1 -- 172.21.15.5:0/3319746620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff4b00a7600 msgr2=0x7ff4b0139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:21.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 1 --2- 172.21.15.5:0/3319746620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff4b00a7600 0x7ff4b0139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 1 -- 172.21.15.5:0/3319746620 >> v2:172.21.15.5:3300/0 conn(0x7ff4b00a6ce0 msgr2=0x7ff4b00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:21.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 1 --2- 172.21.15.5:0/3319746620 >> v2:172.21.15.5:3300/0 conn(0x7ff4b00a6ce0 0x7ff4b00a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 10 monclient: _finish_hunting 0 2024-08-18T21:14:21.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 1 monclient: found mon.noname-e 2024-08-18T21:14:21.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:21.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:14:21.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b669f640 1 -- 172.21.15.5:0/3319746620 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b00a32d0 con 0x7ff4b0139fe0 2024-08-18T21:14:21.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.439+0000 7ff4b5e9e640 1 --2- 172.21.15.5:0/3319746620 >> v2:172.21.15.5:3300/0 conn(0x7ff4b00a6ce0 0x7ff4b00a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:14:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b669f640 1 -- 172.21.15.5:0/3319746620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff4b0139fe0 msgr2=0x7ff4b013a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b669f640 1 --2- 172.21.15.5:0/3319746620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff4b0139fe0 0x7ff4b013a440 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009e80 tx=0x7ff4a801c8d0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=b6fd73a297725d5d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b4e9c640 1 -- 172.21.15.5:0/3319746620 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4a80090d0 con 0x7ff4b0139fe0 2024-08-18T21:14:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b4e9c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b4e9c640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:14:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b4e9c640 10 monclient: dump: 2024-08-18T21:14:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.455 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.455 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.455 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.455 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b4e9c640 10 monclient: _finish_auth 0 2024-08-18T21:14:21.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b4e9c640 10 monclient: _check_auth_tickets 2024-08-18T21:14:21.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b4e9c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:21.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b4e9c640 1 -- 172.21.15.5:0/3319746620 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a80a5a70 con 0x7ff4b0139fe0 2024-08-18T21:14:21.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b4e9c640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:21.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b4e9c640 1 -- 172.21.15.5:0/3319746620 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4a80a5c20 con 0x7ff4b0139fe0 2024-08-18T21:14:21.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b4e9c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b4e9c640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:14:21.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b4e9c640 10 monclient: dump: 2024-08-18T21:14:21.456 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.456 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.456 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.456 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.456 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.456 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.456 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.456 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.456 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.456 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.456 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.457 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b8102640 5 monclient: authenticate success, global_id 115019 2024-08-18T21:14:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b8102640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b8102640 4 set_mon_vals no callback set 2024-08-18T21:14:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b8102640 10 monclient: shutdown 2024-08-18T21:14:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b8102640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b8102640 1 -- 172.21.15.5:0/3319746620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff4b0139fe0 msgr2=0x7ff4b013a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b8102640 1 --2- 172.21.15.5:0/3319746620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff4b0139fe0 0x7ff4b013a440 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009e80 tx=0x7ff4a801c8d0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b8102640 1 -- 172.21.15.5:0/3319746620 shutdown_connections 2024-08-18T21:14:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b8102640 1 --2- 172.21.15.5:0/3319746620 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff4b0139fe0 0x7ff4b013a440 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b8102640 1 --2- 172.21.15.5:0/3319746620 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7ff4b00a7600 0x7ff4b0139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b8102640 1 --2- 172.21.15.5:0/3319746620 >> v2:172.21.15.5:3300/0 conn(0x7ff4b00a6ce0 0x7ff4b00a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b8102640 1 -- 172.21.15.5:0/3319746620 >> 172.21.15.5:0/3319746620 conn(0x7ff4b00acbc0 msgr2=0x7ff4b00a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b8102640 1 -- 172.21.15.5:0/3319746620 shutdown_connections 2024-08-18T21:14:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.443+0000 7ff4b8102640 1 -- 172.21.15.5:0/3319746620 wait complete. 2024-08-18T21:14:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 10 monclient: build_initial_monmap 2024-08-18T21:14:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 10 monclient: monmap: 2024-08-18T21:14:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:21.459 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 1 Processor -- start 2024-08-18T21:14:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 1 -- start start 2024-08-18T21:14:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 10 monclient: init 2024-08-18T21:14:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 10 monclient: _add_conns ranks=[3,0,4,2,6,8,7,1,5] 2024-08-18T21:14:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4b00a6ce0 0x7ff4b0134e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 10 monclient(hunting): picked mon.noname-g con 0x7ff4b00a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b00a7600 0x7ff4b0135380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 10 monclient(hunting): picked mon.noname-a con 0x7ff4b00a7600 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:14:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b0139fe0 0x7ff4b013aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 10 monclient(hunting): picked mon.noname-c con 0x7ff4b0139fe0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b00a79e0 con 0x7ff4b00a7600 2024-08-18T21:14:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b00a8220 con 0x7ff4b00a6ce0 2024-08-18T21:14:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff4b00aa250 con 0x7ff4b0139fe0 2024-08-18T21:14:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b8102640 10 monclient(hunting): authenticate will time out at 1628.461307s 2024-08-18T21:14:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b00a7600 0x7ff4b0135380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b00a7600 0x7ff4b0135380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56430/0 (socket says 172.21.15.5:56430) 2024-08-18T21:14:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 1 -- 172.21.15.5:0/2249456061 learned_addr learned my addr 172.21.15.5:0/2249456061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 10 monclient(hunting): get_auth_request con 0x7ff4b00a7600 auth_method 0 2024-08-18T21:14:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b669f640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b0139fe0 0x7ff4b013aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b669f640 10 monclient(hunting): get_auth_request con 0x7ff4b0139fe0 auth_method 0 2024-08-18T21:14:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b669f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b669f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b669f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b669f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b669f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b669f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b5e9e640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4b00a6ce0 0x7ff4b0134e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b5e9e640 10 monclient(hunting): get_auth_request con 0x7ff4b00a6ce0 auth_method 0 2024-08-18T21:14:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b5e9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b5e9e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b5e9e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 10 monclient(hunting): handle_auth_done global_id 124524 payload 824 2024-08-18T21:14:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 1 -- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b0139fe0 msgr2=0x7ff4b013aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b0139fe0 0x7ff4b013aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 1 -- 172.21.15.5:0/2249456061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4b00a6ce0 msgr2=0x7ff4b0134e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4b00a6ce0 0x7ff4b0134e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 10 monclient: _finish_hunting 0 2024-08-18T21:14:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 1 monclient: found mon.noname-a 2024-08-18T21:14:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:14:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b569d640 1 -- 172.21.15.5:0/2249456061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b00abe90 con 0x7ff4b00a7600 2024-08-18T21:14:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.447+0000 7ff4b669f640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b0139fe0 0x7ff4b013aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:14:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b569d640 1 -- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b00a7600 msgr2=0x7ff4b0135380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b569d640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b00a7600 0x7ff4b0135380 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00d800 tx=0x7ff4ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a67fc640 1 -- 172.21.15.5:0/2249456061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4ac00bd40 con 0x7ff4b00a7600 2024-08-18T21:14:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:14:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a67fc640 10 monclient: dump: 2024-08-18T21:14:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.465 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a67fc640 10 monclient: _finish_auth 0 2024-08-18T21:14:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a67fc640 10 monclient: _check_auth_tickets 2024-08-18T21:14:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b8102640 5 monclient: authenticate success, global_id 124524 2024-08-18T21:14:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b8102640 10 monclient: _renew_subs 2024-08-18T21:14:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a67fc640 1 -- 172.21.15.5:0/2249456061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4ac019070 con 0x7ff4b00a7600 2024-08-18T21:14:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b8102640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b8102640 1 -- 172.21.15.5:0/2249456061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b013c0c0 con 0x7ff4b00a7600 2024-08-18T21:14:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a67fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a67fc640 1 -- 172.21.15.5:0/2249456061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4ac0148a0 con 0x7ff4b00a7600 2024-08-18T21:14:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:14:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a7fff640 4 set_mon_vals no callback set 2024-08-18T21:14:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a67fc640 10 monclient: dump: 2024-08-18T21:14:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.469 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b8102640 10 monclient: _renew_subs 2024-08-18T21:14:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b8102640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b8102640 1 -- 172.21.15.5:0/2249456061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b013cbb0 con 0x7ff4b00a7600 2024-08-18T21:14:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b8102640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b8102640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b013b740 0x7ff4b002d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b8102640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b8102640 1 -- 172.21.15.5:0/2249456061 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff4b00a7b60 con 0x7ff4b013b740 2024-08-18T21:14:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b5e9e640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b013b740 0x7ff4b002d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b5e9e640 10 monclient: get_auth_request con 0x7ff4b013b740 auth_method 0 2024-08-18T21:14:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b5e9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b5e9e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b5e9e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b5e9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b5e9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b5e9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a67fc640 1 -- 172.21.15.5:0/2249456061 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7ff4ac014430 con 0x7ff4b00a7600 2024-08-18T21:14:21.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b5e9e640 10 monclient(hunting): handle_auth_done global_id 114664 payload 824 2024-08-18T21:14:21.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b5e9e640 1 -- 172.21.15.5:0/2249456061 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4b009f140 con 0x7ff4b013b740 2024-08-18T21:14:21.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a67fc640 1 --2- 172.21.15.5:0/2249456061 >> v2:172.21.15.157:6812/631023601 conn(0x7ff49403bdc0 0x7ff49403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4a67fc640 1 -- 172.21.15.5:0/2249456061 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(294..294 src has 22..294) ==== 3898+0+0 (secure 0 0 0) 0x7ff4ac00f040 con 0x7ff4b00a7600 2024-08-18T21:14:21.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b669f640 1 --2- 172.21.15.5:0/2249456061 >> v2:172.21.15.157:6812/631023601 conn(0x7ff49403bdc0 0x7ff49403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b669f640 10 monclient: get_auth_request con 0x7ff49403bdc0 auth_method 0 2024-08-18T21:14:21.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b5e9e640 1 -- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b013b740 msgr2=0x7ff4b002d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.451+0000 7ff4b5e9e640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b013b740 0x7ff4b002d1d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0011600 tx=0x7ff4a0011ac0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.455+0000 7ff4a67fc640 1 -- 172.21.15.5:0/2249456061 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4a000fea0 con 0x7ff4b013b740 2024-08-18T21:14:21.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.455+0000 7ff4a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.455+0000 7ff4a67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:21.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.455+0000 7ff4a67fc640 10 monclient: dump: 2024-08-18T21:14:21.472 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.472 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.474 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.474 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.455+0000 7ff4a67fc640 1 -- 172.21.15.5:0/2249456061 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff4a000fa30 con 0x7ff4b013b740 2024-08-18T21:14:21.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.455+0000 7ff4a67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:21.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.455+0000 7ff4a67fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:21.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.455+0000 7ff4a67fc640 1 -- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b013b740 msgr2=0x7ff4b002d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.455+0000 7ff4a67fc640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b013b740 0x7ff4b002d1d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0011600 tx=0x7ff4a0011ac0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.455+0000 7ff4a67fc640 1 -- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b013b740 msgr2=0x7ff4b002d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:21.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.455+0000 7ff4a67fc640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b013b740 0x7ff4b002d1d0 secure :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0011600 tx=0x7ff4a0011ac0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.455+0000 7ff4b669f640 1 --2- 172.21.15.5:0/2249456061 >> v2:172.21.15.157:6812/631023601 conn(0x7ff49403bdc0 0x7ff49403e280 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff4b006df00 tx=0x7ff4a80a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.459+0000 7ff4b8102640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:21.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.459+0000 7ff4b8102640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b013bb20 0x7ff4b002d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.459+0000 7ff4b8102640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.459+0000 7ff4b8102640 1 -- 172.21.15.5:0/2249456061 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff4b0051140 con 0x7ff4b013bb20 2024-08-18T21:14:21.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.459+0000 7ff4b5e9e640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b013bb20 0x7ff4b002d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.459+0000 7ff4b5e9e640 10 monclient: get_auth_request con 0x7ff4b013bb20 auth_method 0 2024-08-18T21:14:21.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.459+0000 7ff4b5e9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.459+0000 7ff4b5e9e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.459+0000 7ff4b5e9e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.459+0000 7ff4b5e9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.459+0000 7ff4b5e9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.459+0000 7ff4b5e9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.459+0000 7ff4b5e9e640 10 monclient(hunting): handle_auth_done global_id 114673 payload 824 2024-08-18T21:14:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.459+0000 7ff4b5e9e640 1 -- 172.21.15.5:0/2249456061 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff4b013def0 con 0x7ff4b013bb20 2024-08-18T21:14:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4b5e9e640 1 -- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b013bb20 msgr2=0x7ff4b002d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4b5e9e640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b013bb20 0x7ff4b002d710 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0011600 tx=0x7ff4a00046d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4a67fc640 1 -- 172.21.15.5:0/2249456061 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4a00064b0 con 0x7ff4b013bb20 2024-08-18T21:14:21.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4a67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:21.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4a67fc640 10 monclient: dump: 2024-08-18T21:14:21.479 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.479 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.479 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.479 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.480 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.480 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.480 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.480 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.480 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.480 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.480 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.480 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.481 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.481 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.481 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.481 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4a67fc640 1 -- 172.21.15.5:0/2249456061 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7ff4a0022570 con 0x7ff4b013bb20 2024-08-18T21:14:21.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4a67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:21.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4a67fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:21.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4a67fc640 1 -- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b013bb20 msgr2=0x7ff4b002d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4a67fc640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b013bb20 0x7ff4b002d710 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0011600 tx=0x7ff4a00046d0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4a67fc640 1 -- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b013bb20 msgr2=0x7ff4b002d710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:21.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4a67fc640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff4b013bb20 0x7ff4b002d710 secure :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0011600 tx=0x7ff4a00046d0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.482 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:21.482 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:21.482 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 166622, 2024-08-18T21:14:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:14:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:14:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:21.508 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:21.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4b8102640 1 -- 172.21.15.5:0/2249456061 >> v2:172.21.15.157:6812/631023601 conn(0x7ff49403bdc0 msgr2=0x7ff49403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4b8102640 1 --2- 172.21.15.5:0/2249456061 >> v2:172.21.15.157:6812/631023601 conn(0x7ff49403bdc0 0x7ff49403e280 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff4b006df00 tx=0x7ff4a80a7070 comp rx=0 tx=0).stop 2024-08-18T21:14:21.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4b8102640 10 monclient: shutdown 2024-08-18T21:14:21.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4b8102640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:21.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4b8102640 1 -- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b00a7600 msgr2=0x7ff4b0135380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4b8102640 1 --2- 172.21.15.5:0/2249456061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b00a7600 0x7ff4b0135380 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00d800 tx=0x7ff4ac00dcc0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4b669f640 1 -- 172.21.15.5:0/2249456061 reap_dead start 2024-08-18T21:14:21.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4b669f640 1 -- 172.21.15.5:0/2249456061 reap_dead start 2024-08-18T21:14:21.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4b8102640 1 -- 172.21.15.5:0/2249456061 shutdown_connections 2024-08-18T21:14:21.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4b8102640 1 -- 172.21.15.5:0/2249456061 >> 172.21.15.5:0/2249456061 conn(0x7ff4b00acbc0 msgr2=0x7ff4b0138420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:21.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4b8102640 1 -- 172.21.15.5:0/2249456061 shutdown_connections 2024-08-18T21:14:21.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.463+0000 7ff4b8102640 1 -- 172.21.15.5:0/2249456061 wait complete. 2024-08-18T21:14:21.511 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:21.511 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:14:21.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:14:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 10 monclient: get_monmap_and_config 2024-08-18T21:14:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 10 monclient: build_initial_monmap 2024-08-18T21:14:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 10 monclient: monmap: 2024-08-18T21:14:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:21.632968+0000 2024-08-18T21:14:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:21.632968+0000 2024-08-18T21:14:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:21.630 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 1 Processor -- start 2024-08-18T21:14:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 1 -- start start 2024-08-18T21:14:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 10 monclient: init 2024-08-18T21:14:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 10 monclient: _add_conns ranks=[9,5,0,10,3,2,7,1,4,8,6] 2024-08-18T21:14:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ae00a6de0 0x7f3ae00a71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 10 monclient(hunting): picked mon.noname-a con 0x7f3ae00a6de0 addr v2:172.21.15.5:3300/0 2024-08-18T21:14:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3ae009eb30 0x7f3ae00a7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 10 monclient(hunting): picked mon.noname-h con 0x7f3ae009eb30 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3ae0139ba0 addr v1:172.21.15.5:6789/0 2024-08-18T21:14:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ae006f790 con 0x7f3ae0139ba0 2024-08-18T21:14:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3ae009e430 con 0x7f3ae00a6de0 2024-08-18T21:14:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f3ae00a7c40 con 0x7f3ae009eb30 2024-08-18T21:14:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae868e640 10 monclient(hunting): authenticate will time out at 1628.646305s 2024-08-18T21:14:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ae00a6de0 0x7f3ae00a71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae6c2b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3ae0139ba0 0x7f3ae013a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33226/0 (socket says 172.21.15.5:33226) 2024-08-18T21:14:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae6c2b640 1 -- 172.21.15.5:0/2696516370 learned_addr learned my addr 172.21.15.5:0/2696516370 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:14:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 10 monclient(hunting): get_auth_request con 0x7f3ae00a6de0 auth_method 0 2024-08-18T21:14:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae5c29640 1 --2- 172.21.15.5:0/2696516370 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3ae009eb30 0x7f3ae00a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae5c29640 10 monclient(hunting): get_auth_request con 0x7f3ae009eb30 auth_method 0 2024-08-18T21:14:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae5c29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae5c29640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae5c29640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 10 monclient(hunting): handle_auth_done global_id 124533 payload 274 2024-08-18T21:14:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 1 -- 172.21.15.5:0/2696516370 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3ae009eb30 msgr2=0x7f3ae00a7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 1 --2- 172.21.15.5:0/2696516370 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3ae009eb30 0x7f3ae00a7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 1 -- 172.21.15.5:0/2696516370 >> v1:172.21.15.5:6789/0 conn(0x7f3ae0139ba0 legacy=0x7f3ae013a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 10 monclient: _finish_hunting 0 2024-08-18T21:14:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 1 monclient: found mon.noname-a 2024-08-18T21:14:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:14:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.631+0000 7f3ae642a640 1 -- 172.21.15.5:0/2696516370 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae009de70 con 0x7f3ae00a6de0 2024-08-18T21:14:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae642a640 1 -- 172.21.15.5:0/2696516370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ae00a6de0 msgr2=0x7f3ae00a71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae642a640 1 --2- 172.21.15.5:0/2696516370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ae00a6de0 0x7f3ae00a71c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3adc0097c0 tx=0x7f3adc01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93891b03ceaddd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae5428640 1 -- 172.21.15.5:0/2696516370 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3adc0b0070 con 0x7f3ae00a6de0 2024-08-18T21:14:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae5428640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae5428640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:14:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae5428640 10 monclient: dump: 2024-08-18T21:14:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.645 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.645 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.645 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.645 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.645 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.645 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.645 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.645 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.645 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.645 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae5428640 10 monclient: _finish_auth 0 2024-08-18T21:14:21.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae5428640 10 monclient: _check_auth_tickets 2024-08-18T21:14:21.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae5428640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:21.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae868e640 5 monclient: authenticate success, global_id 124533 2024-08-18T21:14:21.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae868e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:14:21.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae5428640 1 -- 172.21.15.5:0/2696516370 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3adc0aa810 con 0x7f3ae00a6de0 2024-08-18T21:14:21.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae5428640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:21.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae868e640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:21.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae868e640 4 set_mon_vals no callback set 2024-08-18T21:14:21.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae5428640 1 -- 172.21.15.5:0/2696516370 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3adc0a9300 con 0x7f3ae00a6de0 2024-08-18T21:14:21.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae5428640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae5428640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:14:21.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae5428640 10 monclient: dump: 2024-08-18T21:14:21.647 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.647 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.647 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.647 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.647 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.647 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.647 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.648 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae868e640 10 monclient: shutdown 2024-08-18T21:14:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae868e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae868e640 1 -- 172.21.15.5:0/2696516370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ae00a6de0 msgr2=0x7f3ae00a71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae868e640 1 --2- 172.21.15.5:0/2696516370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ae00a6de0 0x7f3ae00a71c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3adc0097c0 tx=0x7f3adc01c360 comp rx=0 tx=0).stop 2024-08-18T21:14:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae868e640 1 -- 172.21.15.5:0/2696516370 shutdown_connections 2024-08-18T21:14:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae868e640 1 --2- 172.21.15.5:0/2696516370 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f3ae009eb30 0x7f3ae00a7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae868e640 1 --2- 172.21.15.5:0/2696516370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ae00a6de0 0x7f3ae00a71c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae868e640 1 -- 172.21.15.5:0/2696516370 >> 172.21.15.5:0/2696516370 conn(0x7f3ae00ace00 msgr2=0x7f3ae00a8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.635+0000 7f3ae868e640 1 -- 172.21.15.5:0/2696516370 shutdown_connections 2024-08-18T21:14:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 1 -- 172.21.15.5:0/2696516370 wait complete. 2024-08-18T21:14:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 10 monclient: build_initial_monmap 2024-08-18T21:14:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 10 monclient: monmap: 2024-08-18T21:14:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:21.652 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 1 Processor -- start 2024-08-18T21:14:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 1 -- start start 2024-08-18T21:14:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 10 monclient: init 2024-08-18T21:14:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 10 monclient: _add_conns ranks=[4,8,0,5,6,7,2,3,1] 2024-08-18T21:14:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3ae009eb30 0x7f3ae01d1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 10 monclient(hunting): picked mon.noname-c con 0x7f3ae009eb30 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3ae00a6de0 0x7f3ae0138ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 10 monclient(hunting): picked mon.noname-e con 0x7f3ae00a6de0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:14:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ae0139ba0 0x7f3ae013ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 10 monclient(hunting): picked mon.noname-a con 0x7f3ae0139ba0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:14:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0144620 con 0x7f3ae0139ba0 2024-08-18T21:14:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f3ae00a8680 con 0x7f3ae009eb30 2024-08-18T21:14:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f3ae01447a0 con 0x7f3ae00a6de0 2024-08-18T21:14:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae868e640 10 monclient(hunting): authenticate will time out at 1628.653481s 2024-08-18T21:14:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae642a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3ae009eb30 0x7f3ae01d1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3ae00a6de0 0x7f3ae0138ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae642a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3ae009eb30 0x7f3ae01d1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:58600/0 (socket says 172.21.15.5:58600) 2024-08-18T21:14:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae6c2b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ae0139ba0 0x7f3ae013ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae642a640 1 -- 172.21.15.5:0/2151731819 learned_addr learned my addr 172.21.15.5:0/2151731819 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae642a640 10 monclient(hunting): get_auth_request con 0x7f3ae009eb30 auth_method 0 2024-08-18T21:14:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae642a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae642a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae642a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 10 monclient(hunting): get_auth_request con 0x7f3ae00a6de0 auth_method 0 2024-08-18T21:14:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae6c2b640 10 monclient(hunting): get_auth_request con 0x7f3ae0139ba0 auth_method 0 2024-08-18T21:14:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae6c2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae6c2b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae6c2b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae642a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae642a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae642a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae6c2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae6c2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae6c2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 10 monclient(hunting): handle_auth_done global_id 115028 payload 824 2024-08-18T21:14:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 1 -- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3ae009eb30 msgr2=0x7f3ae01d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 1 --2- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3ae009eb30 0x7f3ae01d1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 1 -- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ae0139ba0 msgr2=0x7f3ae013ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 1 --2- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ae0139ba0 0x7f3ae013ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 10 monclient: _finish_hunting 0 2024-08-18T21:14:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 1 monclient: found mon.noname-e 2024-08-18T21:14:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:14:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae5c29640 1 -- 172.21.15.5:0/2151731819 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae0123670 con 0x7f3ae00a6de0 2024-08-18T21:14:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae642a640 1 --2- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f3ae009eb30 0x7f3ae01d1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:14:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.639+0000 7f3ae6c2b640 1 --2- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ae0139ba0 0x7f3ae013ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:14:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae5c29640 1 -- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3ae00a6de0 msgr2=0x7f3ae0138ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae5c29640 1 --2- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3ae00a6de0 0x7f3ae0138ce0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000d5a0 tx=0x7f3ad000da60 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ad6ffd640 1 -- 172.21.15.5:0/2151731819 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ad0019070 con 0x7f3ae00a6de0 2024-08-18T21:14:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ad6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ad6ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:14:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ad6ffd640 10 monclient: dump: 2024-08-18T21:14:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.658 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ad6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:14:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ad6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:14:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ad6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ad6ffd640 1 -- 172.21.15.5:0/2151731819 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad0004450 con 0x7f3ae00a6de0 2024-08-18T21:14:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae868e640 5 monclient: authenticate success, global_id 115028 2024-08-18T21:14:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae868e640 10 monclient: _renew_subs 2024-08-18T21:14:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae868e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:14:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae868e640 1 -- 172.21.15.5:0/2151731819 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae00abba0 con 0x7f3ae00a6de0 2024-08-18T21:14:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ad6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ad6ffd640 1 -- 172.21.15.5:0/2151731819 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ad0012420 con 0x7f3ae00a6de0 2024-08-18T21:14:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ad6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ad6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:14:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ad6ffd640 10 monclient: dump: 2024-08-18T21:14:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.661 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.661 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.661 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.661 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae4c27640 4 set_mon_vals no callback set 2024-08-18T21:14:21.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae868e640 10 monclient: _renew_subs 2024-08-18T21:14:21.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae868e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:14:21.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae868e640 1 -- 172.21.15.5:0/2151731819 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae01413d0 con 0x7f3ae00a6de0 2024-08-18T21:14:21.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae868e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:21.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae868e640 1 --2- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3ae0139220 0x7f3ae013f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae868e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae868e640 1 -- 172.21.15.5:0/2151731819 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f3ae0051140 con 0x7f3ae0139220 2024-08-18T21:14:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae642a640 1 --2- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3ae0139220 0x7f3ae013f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae642a640 10 monclient: get_auth_request con 0x7f3ae0139220 auth_method 0 2024-08-18T21:14:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae642a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae642a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae642a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae642a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae642a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae642a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ad6ffd640 1 -- 172.21.15.5:0/2151731819 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f3ad0012640 con 0x7f3ae00a6de0 2024-08-18T21:14:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae642a640 10 monclient(hunting): handle_auth_done global_id 134115 payload 824 2024-08-18T21:14:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae642a640 1 -- 172.21.15.5:0/2151731819 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ae00abdd0 con 0x7f3ae0139220 2024-08-18T21:14:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ad6ffd640 1 --2- 172.21.15.5:0/2151731819 >> v2:172.21.15.157:6812/631023601 conn(0x7f3ac403bdf0 0x7f3ac403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ad6ffd640 1 -- 172.21.15.5:0/2151731819 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(294..294 src has 22..294) ==== 3898+0+0 (secure 0 0 0) 0x7f3ad000f040 con 0x7f3ae00a6de0 2024-08-18T21:14:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae6c2b640 1 --2- 172.21.15.5:0/2151731819 >> v2:172.21.15.157:6812/631023601 conn(0x7f3ac403bdf0 0x7f3ac403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.643+0000 7f3ae6c2b640 10 monclient: get_auth_request con 0x7f3ac403bdf0 auth_method 0 2024-08-18T21:14:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.647+0000 7f3ae642a640 1 -- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3ae0139220 msgr2=0x7f3ae013f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.647+0000 7f3ae642a640 1 --2- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3ae0139220 0x7f3ae013f160 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3adc009710 tx=0x7f3adc019100 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.647+0000 7f3ad6ffd640 1 -- 172.21.15.5:0/2151731819 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3adc0b0040 con 0x7f3ae0139220 2024-08-18T21:14:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.647+0000 7f3ad6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.647+0000 7f3ad6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:14:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.647+0000 7f3ad6ffd640 10 monclient: dump: 2024-08-18T21:14:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.665 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.665 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.665 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.647+0000 7f3ad6ffd640 1 -- 172.21.15.5:0/2151731819 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3adc0aab00 con 0x7f3ae0139220 2024-08-18T21:14:21.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.647+0000 7f3ad6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:21.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.647+0000 7f3ad6ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:21.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.647+0000 7f3ad6ffd640 1 -- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3ae0139220 msgr2=0x7f3ae013f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.647+0000 7f3ad6ffd640 1 --2- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3ae0139220 0x7f3ae013f160 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3adc009710 tx=0x7f3adc019100 comp rx=0 tx=0).stop 2024-08-18T21:14:21.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.647+0000 7f3ad6ffd640 1 -- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3ae0139220 msgr2=0x7f3ae013f160 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:21.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.647+0000 7f3ad6ffd640 1 --2- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3ae0139220 0x7f3ae013f160 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3adc009710 tx=0x7f3adc019100 comp rx=0 tx=0).stop 2024-08-18T21:14:21.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.647+0000 7f3ae6c2b640 1 --2- 172.21.15.5:0/2151731819 >> v2:172.21.15.157:6812/631023601 conn(0x7f3ac403bdf0 0x7f3ac403e2b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009400 tx=0x7f3ad8009350 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.651+0000 7f3ae868e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.651+0000 7f3ae868e640 1 --2- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3ae013f6a0 0x7f3ae013abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.651+0000 7f3ae868e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.651+0000 7f3ae868e640 1 -- 172.21.15.5:0/2151731819 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f3ae013fab0 con 0x7f3ae013f6a0 2024-08-18T21:14:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.651+0000 7f3ae642a640 1 --2- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3ae013f6a0 0x7f3ae013abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.651+0000 7f3ae642a640 10 monclient: get_auth_request con 0x7f3ae013f6a0 auth_method 0 2024-08-18T21:14:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.651+0000 7f3ae642a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.651+0000 7f3ae642a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.651+0000 7f3ae642a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.651+0000 7f3ae642a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.651+0000 7f3ae642a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.651+0000 7f3ae642a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.651+0000 7f3ae642a640 10 monclient(hunting): handle_auth_done global_id 134124 payload 824 2024-08-18T21:14:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.651+0000 7f3ae642a640 1 -- 172.21.15.5:0/2151731819 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3ae01406e0 con 0x7f3ae013f6a0 2024-08-18T21:14:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ae642a640 1 -- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3ae013f6a0 msgr2=0x7f3ae013abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ae642a640 1 --2- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3ae013f6a0 0x7f3ae013abb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3adc01cc00 tx=0x7f3adc0a8000 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ad6ffd640 1 -- 172.21.15.5:0/2151731819 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3adc0b0030 con 0x7f3ae013f6a0 2024-08-18T21:14:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ad6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ad6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:14:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ad6ffd640 10 monclient: dump: 2024-08-18T21:14:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.670 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ad6ffd640 1 -- 172.21.15.5:0/2151731819 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f3adc0aacb0 con 0x7f3ae013f6a0 2024-08-18T21:14:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ad6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ad6ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ad6ffd640 1 -- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3ae013f6a0 msgr2=0x7f3ae013abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ad6ffd640 1 --2- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3ae013f6a0 0x7f3ae013abb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3adc01cc00 tx=0x7f3adc0a8000 comp rx=0 tx=0).stop 2024-08-18T21:14:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ad6ffd640 1 -- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3ae013f6a0 msgr2=0x7f3ae013abb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ad6ffd640 1 --2- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3ae013f6a0 0x7f3ae013abb0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3adc01cc00 tx=0x7f3adc0a8000 comp rx=0 tx=0).stop 2024-08-18T21:14:21.671 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:21.672 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:21.672 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:21.672 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:21.672 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:21.672 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 21111, 2024-08-18T21:14:21.672 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:21.672 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:21.672 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:21.672 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:21.672 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:21.672 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:21.672 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:21.672 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:21.673 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:21.673 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:21.673 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.673 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:14:21.673 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:21.673 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:21.673 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:21.673 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:21.673 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:21.673 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:21.673 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:21.673 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:21.673 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:21.674 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:21.674 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:21.674 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:21.674 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:21.674 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:21.674 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.674 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:21.674 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:21.674 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:21.675 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:21.675 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:21.675 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:21.675 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:21.675 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:21.675 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:21.675 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:21.675 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:21.675 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:21.675 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:21.675 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.675 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:21.676 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:21.676 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:21.676 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:21.676 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:21.676 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:21.676 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:21.676 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:21.677 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:21.677 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:21.677 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:21.677 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:21.677 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:21.677 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:21.678 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:21.678 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:21.678 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:21.678 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:21.678 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:21.678 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:21.679 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:21.679 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:21.679 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:21.679 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:21.679 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:21.679 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:21.679 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:21.679 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:21.679 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.679 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:21.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.680 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:21.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.680 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:21.680 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:21.680 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.680 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.680 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:21.680 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.681 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:21.681 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.681 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.681 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.681 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:21.681 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:21.681 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.681 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.681 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.681 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:21.681 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:21.682 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.682 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.682 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.682 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:21.682 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.682 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.682 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:21.682 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.682 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.682 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.683 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:21.683 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:21.683 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.683 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.683 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.683 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:21.683 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:21.683 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.683 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.683 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:21.684 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:21.684 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.684 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.684 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:21.684 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:21.684 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.684 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.685 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.685 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:21.685 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:21.685 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.685 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.685 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.685 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:21.685 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.685 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:21.686 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.686 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.686 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:21.686 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:21.686 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.686 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.686 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.686 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:21.687 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:21.687 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.687 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:21.687 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.687 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:21.687 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.687 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.688 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:21.688 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:21.688 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.688 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.688 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.688 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:21.688 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:21.688 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:21.689 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:21.689 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.689 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:21.689 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:21.689 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.690 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.690 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.690 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:21.690 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:21.690 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.690 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:21.690 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:21.691 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.691 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.691 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:21.691 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:21.691 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.691 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.691 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.692 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:21.692 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:21.692 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:21.692 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:21.692 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.693 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.693 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:21.693 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:21.693 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.693 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.693 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.693 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:21.693 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:21.693 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:21.694 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:21.694 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.694 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.694 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:21.695 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:21.695 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.695 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.695 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.695 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.695 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.695 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:21.695 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:21.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.695 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:21.695 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:21.695 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:21.695 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.696 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.696 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:21.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.696 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:21.696 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:21.696 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:21.696 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.696 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.696 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:21.696 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:21.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ae868e640 1 -- 172.21.15.5:0/2151731819 >> v2:172.21.15.157:6812/631023601 conn(0x7f3ac403bdf0 msgr2=0x7f3ac403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ae868e640 1 --2- 172.21.15.5:0/2151731819 >> v2:172.21.15.157:6812/631023601 conn(0x7f3ac403bdf0 0x7f3ac403e2b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009400 tx=0x7f3ad8009350 comp rx=0 tx=0).stop 2024-08-18T21:14:21.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ae868e640 10 monclient: shutdown 2024-08-18T21:14:21.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ae868e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:21.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ae868e640 1 -- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3ae00a6de0 msgr2=0x7f3ae0138ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ae868e640 1 --2- 172.21.15.5:0/2151731819 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3ae00a6de0 0x7f3ae0138ce0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000d5a0 tx=0x7f3ad000da60 comp rx=0 tx=0).stop 2024-08-18T21:14:21.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ae6c2b640 1 -- 172.21.15.5:0/2151731819 reap_dead start 2024-08-18T21:14:21.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ae6c2b640 1 -- 172.21.15.5:0/2151731819 reap_dead start 2024-08-18T21:14:21.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ae868e640 1 -- 172.21.15.5:0/2151731819 shutdown_connections 2024-08-18T21:14:21.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ae868e640 1 -- 172.21.15.5:0/2151731819 >> 172.21.15.5:0/2151731819 conn(0x7f3ae00ace00 msgr2=0x7f3ae00a49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:21.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ae868e640 1 -- 172.21.15.5:0/2151731819 shutdown_connections 2024-08-18T21:14:21.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.655+0000 7f3ae868e640 1 -- 172.21.15.5:0/2151731819 wait complete. 2024-08-18T21:14:21.699 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:21.699 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:14:21.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:14:21.812 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32255]: starting. 2024-08-18T21:14:21.812 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32255]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-32253 2024-08-18T21:14:21.812 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32255]: shutting down. 2024-08-18T21:14:21.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 10 monclient: get_monmap_and_config 2024-08-18T21:14:21.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 10 monclient: build_initial_monmap 2024-08-18T21:14:21.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 10 monclient: monmap: 2024-08-18T21:14:21.825 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:21.825 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.825 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:21.830288+0000 2024-08-18T21:14:21.826 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:21.830288+0000 2024-08-18T21:14:21.826 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:21.826 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.826 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:21.826 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:21.826 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:21.826 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:21.826 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:21.826 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:21.826 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:21.827 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:21.827 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:21.827 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:21.827 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:21.827 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 1 Processor -- start 2024-08-18T21:14:21.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 1 -- start start 2024-08-18T21:14:21.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 10 monclient: init 2024-08-18T21:14:21.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:21.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 10 monclient: _add_conns ranks=[1,5,7,3,0,6,10,4,9,2,8] 2024-08-18T21:14:21.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fdd600a4260 addr v1:172.21.15.157:6789/0 2024-08-18T21:14:21.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd60072b10 0x7fdd6013b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 10 monclient(hunting): picked mon.noname-h con 0x7fdd60072b10 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:21.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdd60136850 0x7fdd6013dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 10 monclient(hunting): picked mon.noname-i con 0x7fdd60136850 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:21.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd60073b20 con 0x7fdd600a4260 2024-08-18T21:14:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdd600a4d50 con 0x7fdd60072b10 2024-08-18T21:14:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fdd60073e00 con 0x7fdd60136850 2024-08-18T21:14:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd66511640 10 monclient(hunting): authenticate will time out at 1628.843807s 2024-08-18T21:14:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd5ffff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fdd600a4260 0x7fdd600a4640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:47390/0 (socket says 172.21.15.5:47390) 2024-08-18T21:14:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.827+0000 7fdd5ffff640 1 -- 172.21.15.5:0/4237820548 learned_addr learned my addr 172.21.15.5:0/4237820548 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:14:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 1 --2- 172.21.15.5:0/4237820548 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd60072b10 0x7fdd6013b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 10 monclient(hunting): get_auth_request con 0x7fdd60072b10 auth_method 0 2024-08-18T21:14:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd64aae640 1 --2- 172.21.15.5:0/4237820548 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdd60136850 0x7fdd6013dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd64aae640 10 monclient(hunting): get_auth_request con 0x7fdd60136850 auth_method 0 2024-08-18T21:14:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd64aae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd64aae640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd64aae640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd64aae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd64aae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd64aae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 10 monclient(hunting): handle_auth_done global_id 95378 payload 274 2024-08-18T21:14:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 1 -- 172.21.15.5:0/4237820548 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdd60136850 msgr2=0x7fdd6013dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 1 --2- 172.21.15.5:0/4237820548 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdd60136850 0x7fdd6013dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 1 -- 172.21.15.5:0/4237820548 >> v1:172.21.15.157:6789/0 conn(0x7fdd600a4260 legacy=0x7fdd600a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 10 monclient: _finish_hunting 0 2024-08-18T21:14:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 1 monclient: found mon.noname-h 2024-08-18T21:14:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:14:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.831+0000 7fdd577fe640 1 -- 172.21.15.5:0/4237820548 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6009dad0 con 0x7fdd60072b10 2024-08-18T21:14:21.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd577fe640 1 -- 172.21.15.5:0/4237820548 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd60072b10 msgr2=0x7fdd6013b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd577fe640 1 --2- 172.21.15.5:0/4237820548 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd60072b10 0x7fdd6013b6f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdd480097f0 tx=0x7fdd4801c180 comp rx=0 tx=0).ready entity=mon.5 client_cookie=af1aab47c35dd9f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5f7fe640 1 -- 172.21.15.5:0/4237820548 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd480b0070 con 0x7fdd60072b10 2024-08-18T21:14:21.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5f7fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:14:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5f7fe640 10 monclient: dump: 2024-08-18T21:14:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.842 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.842 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.842 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.842 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.842 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.842 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5f7fe640 10 monclient: _finish_auth 0 2024-08-18T21:14:21.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5f7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:14:21.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:21.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5f7fe640 1 -- 172.21.15.5:0/4237820548 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd480aa810 con 0x7fdd60072b10 2024-08-18T21:14:21.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5f7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:21.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5f7fe640 1 -- 172.21.15.5:0/4237820548 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd480aae30 con 0x7fdd60072b10 2024-08-18T21:14:21.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5f7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:14:21.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5f7fe640 10 monclient: dump: 2024-08-18T21:14:21.843 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.843 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.843 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.843 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.843 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.843 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.843 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.844 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 5 monclient: authenticate success, global_id 95378 2024-08-18T21:14:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 4 set_mon_vals no callback set 2024-08-18T21:14:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 10 monclient: shutdown 2024-08-18T21:14:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 1 -- 172.21.15.5:0/4237820548 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd60072b10 msgr2=0x7fdd6013b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 1 --2- 172.21.15.5:0/4237820548 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd60072b10 0x7fdd6013b6f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdd480097f0 tx=0x7fdd4801c180 comp rx=0 tx=0).stop 2024-08-18T21:14:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 1 -- 172.21.15.5:0/4237820548 shutdown_connections 2024-08-18T21:14:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 1 --2- 172.21.15.5:0/4237820548 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd60072b10 0x7fdd6013b6f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 1 --2- 172.21.15.5:0/4237820548 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdd60136850 0x7fdd6013dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 1 -- 172.21.15.5:0/4237820548 >> 172.21.15.5:0/4237820548 conn(0x7fdd600a8a90 msgr2=0x7fdd600a8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 1 -- 172.21.15.5:0/4237820548 shutdown_connections 2024-08-18T21:14:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 1 -- 172.21.15.5:0/4237820548 wait complete. 2024-08-18T21:14:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 10 monclient: build_initial_monmap 2024-08-18T21:14:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 10 monclient: monmap: 2024-08-18T21:14:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:21.846 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:21.846 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:21.846 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:21.846 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.846 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:21.846 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:21.846 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:21.846 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:21.846 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:21.846 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:21.846 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:21.846 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:21.846 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:21.846 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 1 Processor -- start 2024-08-18T21:14:21.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 1 -- start start 2024-08-18T21:14:21.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 10 monclient: init 2024-08-18T21:14:21.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:21.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 10 monclient: _add_conns ranks=[5,2,4,3,1,6,7,8,0] 2024-08-18T21:14:21.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd60072b10 0x7fdd601cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 10 monclient(hunting): picked mon.noname-h con 0x7fdd60072b10 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:21.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdd600a4260 0x7fdd601cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 10 monclient(hunting): picked mon.noname-b con 0x7fdd600a4260 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:21.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdd60136850 0x7fdd601cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 10 monclient(hunting): picked mon.noname-c con 0x7fdd60136850 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:21.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fdd60140d30 con 0x7fdd600a4260 2024-08-18T21:14:21.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fdd60140bb0 con 0x7fdd60136850 2024-08-18T21:14:21.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdd60140eb0 con 0x7fdd60072b10 2024-08-18T21:14:21.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:21.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd66511640 10 monclient(hunting): authenticate will time out at 1628.851576s 2024-08-18T21:14:21.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd577fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdd600a4260 0x7fdd601cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd64aae640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdd60136850 0x7fdd601cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd577fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdd600a4260 0x7fdd601cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:56894/0 (socket says 172.21.15.5:56894) 2024-08-18T21:14:21.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd64aae640 10 monclient(hunting): get_auth_request con 0x7fdd60136850 auth_method 0 2024-08-18T21:14:21.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd577fe640 1 -- 172.21.15.5:0/664552365 learned_addr learned my addr 172.21.15.5:0/664552365 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd64aae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd64aae640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd64aae640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd577fe640 10 monclient(hunting): get_auth_request con 0x7fdd600a4260 auth_method 0 2024-08-18T21:14:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd577fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd577fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd64aae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd64aae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5ffff640 1 --2- 172.21.15.5:0/664552365 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd60072b10 0x7fdd601cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd64aae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5ffff640 10 monclient(hunting): get_auth_request con 0x7fdd60072b10 auth_method 0 2024-08-18T21:14:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.835+0000 7fdd5ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd64aae640 10 monclient(hunting): handle_auth_done global_id 114691 payload 824 2024-08-18T21:14:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd64aae640 1 -- 172.21.15.5:0/664552365 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd60072b10 msgr2=0x7fdd601cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd64aae640 1 --2- 172.21.15.5:0/664552365 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdd60072b10 0x7fdd601cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd64aae640 1 -- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdd600a4260 msgr2=0x7fdd601cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd64aae640 1 --2- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdd600a4260 0x7fdd601cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd64aae640 10 monclient: _finish_hunting 0 2024-08-18T21:14:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd64aae640 1 monclient: found mon.noname-c 2024-08-18T21:14:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd64aae640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd64aae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:14:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd64aae640 1 -- 172.21.15.5:0/664552365 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd600a8070 con 0x7fdd60136850 2024-08-18T21:14:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd577fe640 1 --2- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdd600a4260 0x7fdd601cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:14:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd64aae640 1 -- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdd60136850 msgr2=0x7fdd601cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd64aae640 1 --2- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdd60136850 0x7fdd601cfa30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800eba0 tx=0x7fdd5800c490 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5d7fa640 1 -- 172.21.15.5:0/664552365 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd58018020 con 0x7fdd60136850 2024-08-18T21:14:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:14:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5d7fa640 10 monclient: dump: 2024-08-18T21:14:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.853 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5d7fa640 10 monclient: _finish_auth 0 2024-08-18T21:14:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5d7fa640 10 monclient: _check_auth_tickets 2024-08-18T21:14:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd66511640 5 monclient: authenticate success, global_id 114691 2024-08-18T21:14:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5d7fa640 1 -- 172.21.15.5:0/664552365 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5800cd30 con 0x7fdd60136850 2024-08-18T21:14:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd66511640 10 monclient: _renew_subs 2024-08-18T21:14:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd66511640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:14:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd66511640 1 -- 172.21.15.5:0/664552365 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd60139e50 con 0x7fdd60136850 2024-08-18T21:14:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5d7fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5d7fa640 1 -- 172.21.15.5:0/664552365 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd58014d60 con 0x7fdd60136850 2024-08-18T21:14:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5effd640 4 set_mon_vals no callback set 2024-08-18T21:14:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5d7fa640 10 monclient: dump: 2024-08-18T21:14:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.855 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd66511640 10 monclient: _renew_subs 2024-08-18T21:14:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd66511640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:14:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd66511640 1 -- 172.21.15.5:0/664552365 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd6013b910 con 0x7fdd60136850 2024-08-18T21:14:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd66511640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd66511640 1 --2- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd60063b30 0x7fdd60063f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd66511640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd66511640 1 -- 172.21.15.5:0/664552365 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fdd60051140 con 0x7fdd60063b30 2024-08-18T21:14:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5ffff640 1 --2- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd60063b30 0x7fdd60063f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5ffff640 10 monclient: get_auth_request con 0x7fdd60063b30 auth_method 0 2024-08-18T21:14:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5d7fa640 1 -- 172.21.15.5:0/664552365 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fdd5801b020 con 0x7fdd60136850 2024-08-18T21:14:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5ffff640 10 monclient(hunting): handle_auth_done global_id 115046 payload 824 2024-08-18T21:14:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.839+0000 7fdd5ffff640 1 -- 172.21.15.5:0/664552365 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd6013a9b0 con 0x7fdd60063b30 2024-08-18T21:14:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd5d7fa640 1 --2- 172.21.15.5:0/664552365 >> v2:172.21.15.157:6812/631023601 conn(0x7fdd4003bdf0 0x7fdd4003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd5d7fa640 1 -- 172.21.15.5:0/664552365 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(295..295 src has 22..295) ==== 3506+0+0 (secure 0 0 0) 0x7fdd5804f170 con 0x7fdd60136850 2024-08-18T21:14:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd577fe640 1 --2- 172.21.15.5:0/664552365 >> v2:172.21.15.157:6812/631023601 conn(0x7fdd4003bdf0 0x7fdd4003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd577fe640 10 monclient: get_auth_request con 0x7fdd4003bdf0 auth_method 0 2024-08-18T21:14:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd5ffff640 1 -- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd60063b30 msgr2=0x7fdd60063f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd5ffff640 1 --2- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd60063b30 0x7fdd60063f10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000eaa0 tx=0x7fdd5000eb90 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd5d7fa640 1 -- 172.21.15.5:0/664552365 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd5000ee60 con 0x7fdd60063b30 2024-08-18T21:14:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd5d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd5d7fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:14:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd5d7fa640 10 monclient: dump: 2024-08-18T21:14:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.860 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd5d7fa640 1 -- 172.21.15.5:0/664552365 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdd50019070 con 0x7fdd60063b30 2024-08-18T21:14:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd5d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd5d7fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd5d7fa640 1 -- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd60063b30 msgr2=0x7fdd60063f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd5d7fa640 1 --2- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd60063b30 0x7fdd60063f10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000eaa0 tx=0x7fdd5000eb90 comp rx=0 tx=0).stop 2024-08-18T21:14:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd5d7fa640 1 -- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd60063b30 msgr2=0x7fdd60063f10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd5d7fa640 1 --2- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd60063b30 0x7fdd60063f10 secure :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000eaa0 tx=0x7fdd5000eb90 comp rx=0 tx=0).stop 2024-08-18T21:14:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.843+0000 7fdd577fe640 1 --2- 172.21.15.5:0/664552365 >> v2:172.21.15.157:6812/631023601 conn(0x7fdd4003bdf0 0x7fdd4003e2b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fdd60139ac0 tx=0x7fdd480a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd66511640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd66511640 1 --2- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd6002d1d0 0x7fdd6002d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd66511640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd66511640 1 -- 172.21.15.5:0/664552365 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fdd6006b7e0 con 0x7fdd6002d1d0 2024-08-18T21:14:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5ffff640 1 --2- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd6002d1d0 0x7fdd6002d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5ffff640 10 monclient: get_auth_request con 0x7fdd6002d1d0 auth_method 0 2024-08-18T21:14:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5ffff640 10 monclient(hunting): handle_auth_done global_id 115055 payload 824 2024-08-18T21:14:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5ffff640 1 -- 172.21.15.5:0/664552365 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdd600a4640 con 0x7fdd6002d1d0 2024-08-18T21:14:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5ffff640 1 -- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd6002d1d0 msgr2=0x7fdd6002d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5ffff640 1 --2- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd6002d1d0 0x7fdd6002d5e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdd50007930 tx=0x7fdd50004950 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5d7fa640 1 -- 172.21.15.5:0/664552365 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd50024070 con 0x7fdd6002d1d0 2024-08-18T21:14:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5d7fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:14:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5d7fa640 10 monclient: dump: 2024-08-18T21:14:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:21.864 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:21.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.851+0000 7fdd5d7fa640 1 -- 172.21.15.5:0/664552365 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7fdd50014480 con 0x7fdd6002d1d0 2024-08-18T21:14:21.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd5d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:21.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd5d7fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:21.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd5d7fa640 1 -- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd6002d1d0 msgr2=0x7fdd6002d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd5d7fa640 1 --2- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd6002d1d0 0x7fdd6002d5e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdd50007930 tx=0x7fdd50004950 comp rx=0 tx=0).stop 2024-08-18T21:14:21.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd5d7fa640 1 -- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd6002d1d0 msgr2=0x7fdd6002d5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:21.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd5d7fa640 1 --2- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd6002d1d0 0x7fdd6002d5e0 secure :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdd50007930 tx=0x7fdd50004950 comp rx=0 tx=0).stop 2024-08-18T21:14:21.864 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:21.865 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:21.865 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:21.865 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:21.865 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:21.865 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 167018, 2024-08-18T21:14:21.865 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:21.865 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:21.865 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:21.865 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:21.865 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:21.865 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:21.865 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:21.865 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:21.865 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:21.866 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:21.866 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.866 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:14:21.866 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:21.866 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:21.866 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:21.866 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:21.866 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:21.866 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:21.866 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:21.866 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:21.866 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:21.866 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:21.867 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:21.867 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:21.867 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:21.867 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:21.867 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.867 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:21.867 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:21.867 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:21.867 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:21.867 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:21.867 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:21.867 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:21.867 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:21.868 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:21.868 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:21.868 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:21.868 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:21.868 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:21.868 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.868 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:21.868 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:21.868 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:21.868 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:21.868 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:21.868 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:21.869 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:21.869 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:21.869 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:21.869 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:21.869 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:21.869 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:21.869 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:21.869 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:21.869 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:21.869 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:21.869 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:21.869 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:21.870 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:21.870 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:21.870 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:21.870 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:21.870 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:21.870 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:21.870 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:21.870 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:21.870 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:21.871 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:21.871 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.871 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:21.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.871 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:21.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.871 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:21.871 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:21.871 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.871 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:21.872 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:21.872 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.873 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.873 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.873 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:21.873 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:21.873 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.873 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.873 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.873 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:21.873 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:21.873 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.873 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.874 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:21.874 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.874 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:21.874 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.874 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.875 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:21.875 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:21.875 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.875 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.875 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.875 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:21.875 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:21.875 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.876 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.876 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:21.876 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.876 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.876 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:21.876 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.876 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.876 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.876 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:21.877 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:21.877 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.877 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.877 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.877 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:21.877 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:21.877 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.877 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:21.878 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:21.878 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.878 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.878 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:21.878 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:21.878 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.879 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.879 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.879 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:21.879 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:21.879 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.879 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.879 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.879 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:21.879 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.879 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:21.880 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.880 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.880 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:21.880 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:21.880 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.880 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.880 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.881 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:21.881 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:21.881 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.881 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.882 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:21.882 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.882 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:21.882 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.882 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.882 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.882 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:21.883 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:21.883 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.883 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.883 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.883 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:21.883 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:21.883 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.883 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.884 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.884 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:21.884 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.884 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.884 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:21.884 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.884 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.884 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.884 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:21.884 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:21.884 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.885 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.885 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.885 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:21.885 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:21.885 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.885 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.885 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.885 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:21.885 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.886 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.886 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:21.886 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.886 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.886 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.886 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:21.886 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:21.886 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.886 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.886 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.886 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:21.887 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:21.887 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:21.887 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:21.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.887 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:21.887 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:21.887 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.887 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:21.887 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:21.887 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:21.887 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.887 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.888 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:21.888 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:21.888 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:21.888 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:21.888 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:21.888 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.888 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.888 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:21.888 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:21.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.888 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:21.889 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:21.889 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:21.889 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.889 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:21.889 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:21.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:21.889 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:21.889 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:21.889 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:14:21.889 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:21.889 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:21.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:21.889 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:21.889 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd66511640 1 -- 172.21.15.5:0/664552365 >> v2:172.21.15.157:6812/631023601 conn(0x7fdd4003bdf0 msgr2=0x7fdd4003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd66511640 1 --2- 172.21.15.5:0/664552365 >> v2:172.21.15.157:6812/631023601 conn(0x7fdd4003bdf0 0x7fdd4003e2b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fdd60139ac0 tx=0x7fdd480a6000 comp rx=0 tx=0).stop 2024-08-18T21:14:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd66511640 10 monclient: shutdown 2024-08-18T21:14:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd66511640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd66511640 1 -- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdd60136850 msgr2=0x7fdd601cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd66511640 1 --2- 172.21.15.5:0/664552365 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdd60136850 0x7fdd601cfa30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800eba0 tx=0x7fdd5800c490 comp rx=0 tx=0).stop 2024-08-18T21:14:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd64aae640 1 -- 172.21.15.5:0/664552365 reap_dead start 2024-08-18T21:14:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd64aae640 1 -- 172.21.15.5:0/664552365 reap_dead start 2024-08-18T21:14:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd66511640 1 -- 172.21.15.5:0/664552365 shutdown_connections 2024-08-18T21:14:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd66511640 1 -- 172.21.15.5:0/664552365 >> 172.21.15.5:0/664552365 conn(0x7fdd600a8a90 msgr2=0x7fdd6013d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd66511640 1 -- 172.21.15.5:0/664552365 shutdown_connections 2024-08-18T21:14:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:21.855+0000 7fdd66511640 1 -- 172.21.15.5:0/664552365 wait complete. 2024-08-18T21:14:21.892 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:21.892 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:14:21.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:14:22.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 10 monclient: get_monmap_and_config 2024-08-18T21:14:22.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 10 monclient: build_initial_monmap 2024-08-18T21:14:22.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 10 monclient: monmap: 2024-08-18T21:14:22.008 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:22.008 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.008 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:22.012533+0000 2024-08-18T21:14:22.008 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:22.012533+0000 2024-08-18T21:14:22.008 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:22.008 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.008 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:22.009 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 1 Processor -- start 2024-08-18T21:14:22.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 1 -- start start 2024-08-18T21:14:22.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 10 monclient: init 2024-08-18T21:14:22.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:22.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 10 monclient: _add_conns ranks=[4,10,3,0,5,1,7,6,2,8,9] 2024-08-18T21:14:22.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a2006c950 0x7f0a2009f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 10 monclient(hunting): picked mon.noname-c con 0x7f0a2006c950 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:22.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0a2006cd30 0x7f0a2006d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 10 monclient(hunting): picked mon.noname-f con 0x7f0a2006cd30 addr v2:172.21.15.157:3300/0 2024-08-18T21:14:22.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a20139820 0x7f0a20139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 10 monclient(hunting): picked mon.noname-g con 0x7f0a20139820 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:22.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f0a2009dfc0 con 0x7f0a2006cd30 2024-08-18T21:14:22.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0a2009e580 con 0x7f0a20139820 2024-08-18T21:14:22.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f0a2009e2a0 con 0x7f0a2006c950 2024-08-18T21:14:22.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:22.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a2833d640 10 monclient(hunting): authenticate will time out at 1629.025695s 2024-08-18T21:14:22.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a2006c950 0x7f0a2009f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a2006c950 0x7f0a2009f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:58606/0 (socket says 172.21.15.5:58606) 2024-08-18T21:14:22.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 1 -- 172.21.15.5:0/3536023954 learned_addr learned my addr 172.21.15.5:0/3536023954 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:22.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 10 monclient(hunting): get_auth_request con 0x7f0a2006c950 auth_method 0 2024-08-18T21:14:22.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a258d8640 1 --2- 172.21.15.5:0/3536023954 >> v2:172.21.15.157:3300/0 conn(0x7f0a2006cd30 0x7f0a2006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a258d8640 10 monclient(hunting): get_auth_request con 0x7f0a2006cd30 auth_method 0 2024-08-18T21:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a258d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a258d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a258d8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a268da640 1 --2- 172.21.15.5:0/3536023954 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a20139820 0x7f0a20139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 10 monclient(hunting): handle_auth_done global_id 114700 payload 274 2024-08-18T21:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 1 -- 172.21.15.5:0/3536023954 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a20139820 msgr2=0x7f0a20139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 1 --2- 172.21.15.5:0/3536023954 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a20139820 0x7f0a20139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 1 -- 172.21.15.5:0/3536023954 >> v2:172.21.15.157:3300/0 conn(0x7f0a2006cd30 msgr2=0x7f0a2006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 1 --2- 172.21.15.5:0/3536023954 >> v2:172.21.15.157:3300/0 conn(0x7f0a2006cd30 0x7f0a2006d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 10 monclient: _finish_hunting 0 2024-08-18T21:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 1 monclient: found mon.noname-c 2024-08-18T21:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a260d9640 1 -- 172.21.15.5:0/3536023954 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2009da30 con 0x7f0a2006c950 2024-08-18T21:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a268da640 10 monclient: get_auth_request con 0x7f0a20139820 auth_method 0 2024-08-18T21:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a268da640 1 --2- 172.21.15.5:0/3536023954 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a20139820 0x7f0a20139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.011+0000 7f0a258d8640 1 --2- 172.21.15.5:0/3536023954 >> v2:172.21.15.157:3300/0 conn(0x7f0a2006cd30 0x7f0a2006d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a260d9640 1 -- 172.21.15.5:0/3536023954 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a2006c950 msgr2=0x7f0a2009f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a260d9640 1 --2- 172.21.15.5:0/3536023954 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a2006c950 0x7f0a2009f0b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009870 tx=0x7f0a0801c420 comp rx=0 tx=0).ready entity=mon.4 client_cookie=82b2e5e2535b6aef server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a250d7640 1 -- 172.21.15.5:0/3536023954 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a080b0070 con 0x7f0a2006c950 2024-08-18T21:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a250d7640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a250d7640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a250d7640 10 monclient: dump: 2024-08-18T21:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a250d7640 10 monclient: _finish_auth 0 2024-08-18T21:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a250d7640 10 monclient: _check_auth_tickets 2024-08-18T21:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a250d7640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a2833d640 5 monclient: authenticate success, global_id 114700 2024-08-18T21:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a2833d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a250d7640 1 -- 172.21.15.5:0/3536023954 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a080aa810 con 0x7f0a2006c950 2024-08-18T21:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a250d7640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a2833d640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a2833d640 4 set_mon_vals no callback set 2024-08-18T21:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a250d7640 1 -- 172.21.15.5:0/3536023954 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a080a9300 con 0x7f0a2006c950 2024-08-18T21:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a250d7640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a250d7640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.015+0000 7f0a250d7640 10 monclient: dump: 2024-08-18T21:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 10 monclient: shutdown 2024-08-18T21:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 -- 172.21.15.5:0/3536023954 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a2006c950 msgr2=0x7f0a2009f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 --2- 172.21.15.5:0/3536023954 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a2006c950 0x7f0a2009f0b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009870 tx=0x7f0a0801c420 comp rx=0 tx=0).stop 2024-08-18T21:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 -- 172.21.15.5:0/3536023954 shutdown_connections 2024-08-18T21:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 --2- 172.21.15.5:0/3536023954 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a20139820 0x7f0a20139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 --2- 172.21.15.5:0/3536023954 >> v2:172.21.15.157:3300/0 conn(0x7f0a2006cd30 0x7f0a2006d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 --2- 172.21.15.5:0/3536023954 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0a2006c950 0x7f0a2009f0b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 -- 172.21.15.5:0/3536023954 >> 172.21.15.5:0/3536023954 conn(0x7f0a200688d0 msgr2=0x7f0a20068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 -- 172.21.15.5:0/3536023954 shutdown_connections 2024-08-18T21:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 -- 172.21.15.5:0/3536023954 wait complete. 2024-08-18T21:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 10 monclient: build_initial_monmap 2024-08-18T21:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 10 monclient: monmap: 2024-08-18T21:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 Processor -- start 2024-08-18T21:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 -- start start 2024-08-18T21:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 10 monclient: init 2024-08-18T21:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 10 monclient: _add_conns ranks=[0,8,7,2,1,6,5,3,4] 2024-08-18T21:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a2006c950 0x7f0a2013ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 10 monclient(hunting): picked mon.noname-a con 0x7f0a2006c950 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0a2006cd30 0x7f0a20136970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 10 monclient(hunting): picked mon.noname-e con 0x7f0a2006cd30 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0a20139820 0x7f0a201d1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 10 monclient(hunting): picked mon.noname-i con 0x7f0a20139820 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0a20143690 con 0x7f0a2006c950 2024-08-18T21:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f0a20143510 con 0x7f0a20139820 2024-08-18T21:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f0a20143810 con 0x7f0a2006cd30 2024-08-18T21:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a2833d640 10 monclient(hunting): authenticate will time out at 1629.034160s 2024-08-18T21:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a260d9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a2006c950 0x7f0a2013ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0a2006cd30 0x7f0a20136970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a260d9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a2006c950 0x7f0a2013ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56444/0 (socket says 172.21.15.5:56444) 2024-08-18T21:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0a2006cd30 0x7f0a20136970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:33670/0 (socket says 172.21.15.5:33670) 2024-08-18T21:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a260d9640 1 -- 172.21.15.5:0/1637001226 learned_addr learned my addr 172.21.15.5:0/1637001226 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a260d9640 10 monclient(hunting): get_auth_request con 0x7f0a2006c950 auth_method 0 2024-08-18T21:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a260d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a260d9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a260d9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 10 monclient(hunting): get_auth_request con 0x7f0a2006cd30 auth_method 0 2024-08-18T21:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a260d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a260d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a260d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a268da640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0a20139820 0x7f0a201d1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a268da640 10 monclient(hunting): get_auth_request con 0x7f0a20139820 auth_method 0 2024-08-18T21:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a268da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a268da640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a268da640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a268da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a268da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a268da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 10 monclient(hunting): handle_auth_done global_id 115064 payload 824 2024-08-18T21:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 1 -- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0a20139820 msgr2=0x7f0a201d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0a20139820 0x7f0a201d1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 1 -- 172.21.15.5:0/1637001226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a2006c950 msgr2=0x7f0a2013ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a2006c950 0x7f0a2013ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 10 monclient: _finish_hunting 0 2024-08-18T21:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 1 monclient: found mon.noname-e 2024-08-18T21:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a258d8640 1 -- 172.21.15.5:0/1637001226 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a20122310 con 0x7f0a2006cd30 2024-08-18T21:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.019+0000 7f0a260d9640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a2006c950 0x7f0a2013ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a258d8640 1 -- 172.21.15.5:0/1637001226 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0a2006cd30 msgr2=0x7f0a20136970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a258d8640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0a2006cd30 0x7f0a20136970 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0a10007ea0 tx=0x7f0a10007f90 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a1effd640 1 -- 172.21.15.5:0/1637001226 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a1001a070 con 0x7f0a2006cd30 2024-08-18T21:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a1effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a1effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a1effd640 10 monclient: dump: 2024-08-18T21:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a1effd640 10 monclient: _finish_auth 0 2024-08-18T21:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a1effd640 10 monclient: _check_auth_tickets 2024-08-18T21:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a1effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a1effd640 1 -- 172.21.15.5:0/1637001226 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a1000de70 con 0x7f0a2006cd30 2024-08-18T21:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a2833d640 5 monclient: authenticate success, global_id 115064 2024-08-18T21:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a2833d640 10 monclient: _renew_subs 2024-08-18T21:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a2833d640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a2833d640 1 -- 172.21.15.5:0/1637001226 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a20068dd0 con 0x7f0a2006cd30 2024-08-18T21:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a1effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a1effd640 1 -- 172.21.15.5:0/1637001226 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a10003e10 con 0x7f0a2006cd30 2024-08-18T21:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a1effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a1effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a248d6640 4 set_mon_vals no callback set 2024-08-18T21:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a1effd640 10 monclient: dump: 2024-08-18T21:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a2833d640 10 monclient: _renew_subs 2024-08-18T21:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a2833d640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a2833d640 1 -- 172.21.15.5:0/1637001226 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a20120ee0 con 0x7f0a2006cd30 2024-08-18T21:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a2833d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a1effd640 1 -- 172.21.15.5:0/1637001226 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f0a100039a0 con 0x7f0a2006cd30 2024-08-18T21:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a2833d640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a20136eb0 0x7f0a201d1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a2833d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a2833d640 1 -- 172.21.15.5:0/1637001226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0a20051140 con 0x7f0a20136eb0 2024-08-18T21:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a1effd640 1 --2- 172.21.15.5:0/1637001226 >> v2:172.21.15.157:6812/631023601 conn(0x7f0a0003bdc0 0x7f0a0003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a1effd640 1 -- 172.21.15.5:0/1637001226 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(295..295 src has 22..295) ==== 3506+0+0 (secure 0 0 0) 0x7f0a1004e6f0 con 0x7f0a2006cd30 2024-08-18T21:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a260d9640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a20136eb0 0x7f0a201d1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a260d9640 10 monclient: get_auth_request con 0x7f0a20136eb0 auth_method 0 2024-08-18T21:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a260d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a260d9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a260d9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a268da640 1 --2- 172.21.15.5:0/1637001226 >> v2:172.21.15.157:6812/631023601 conn(0x7f0a0003bdc0 0x7f0a0003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a260d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a260d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a260d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a268da640 10 monclient: get_auth_request con 0x7f0a0003bdc0 auth_method 0 2024-08-18T21:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a260d9640 10 monclient(hunting): handle_auth_done global_id 134164 payload 824 2024-08-18T21:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.023+0000 7f0a260d9640 1 -- 172.21.15.5:0/1637001226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a20120d00 con 0x7f0a20136eb0 2024-08-18T21:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.027+0000 7f0a268da640 1 --2- 172.21.15.5:0/1637001226 >> v2:172.21.15.157:6812/631023601 conn(0x7f0a0003bdc0 0x7f0a0003e280 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0a2011fbd0 tx=0x7f0a18008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.027+0000 7f0a260d9640 1 -- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a20136eb0 msgr2=0x7f0a201d1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.027+0000 7f0a260d9640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a20136eb0 0x7f0a201d1e50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0a080097c0 tx=0x7f0a080191c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.027+0000 7f0a1effd640 1 -- 172.21.15.5:0/1637001226 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a080b0040 con 0x7f0a20136eb0 2024-08-18T21:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.027+0000 7f0a1effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.027+0000 7f0a1effd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.027+0000 7f0a1effd640 10 monclient: dump: 2024-08-18T21:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.027+0000 7f0a1effd640 1 -- 172.21.15.5:0/1637001226 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0a080aa960 con 0x7f0a20136eb0 2024-08-18T21:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.027+0000 7f0a1effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.027+0000 7f0a1effd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.027+0000 7f0a1effd640 1 -- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a20136eb0 msgr2=0x7f0a201d1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.027+0000 7f0a1effd640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a20136eb0 0x7f0a201d1e50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0a080097c0 tx=0x7f0a080191c0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.027+0000 7f0a1effd640 1 -- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a20136eb0 msgr2=0x7f0a201d1e50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.027+0000 7f0a1effd640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a20136eb0 0x7f0a201d1e50 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0a080097c0 tx=0x7f0a080191c0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.035+0000 7f0a2833d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.035+0000 7f0a2833d640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a201d2390 0x7f0a20137a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.035+0000 7f0a2833d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.035+0000 7f0a2833d640 1 -- 172.21.15.5:0/1637001226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0a201d27a0 con 0x7f0a201d2390 2024-08-18T21:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.035+0000 7f0a260d9640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a201d2390 0x7f0a20137a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.035+0000 7f0a260d9640 10 monclient: get_auth_request con 0x7f0a201d2390 auth_method 0 2024-08-18T21:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.035+0000 7f0a260d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.035+0000 7f0a260d9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.035+0000 7f0a260d9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.035+0000 7f0a260d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.035+0000 7f0a260d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.035+0000 7f0a260d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.035+0000 7f0a260d9640 10 monclient(hunting): handle_auth_done global_id 134173 payload 824 2024-08-18T21:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.035+0000 7f0a260d9640 1 -- 172.21.15.5:0/1637001226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0a20121b90 con 0x7f0a201d2390 2024-08-18T21:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a260d9640 1 -- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a201d2390 msgr2=0x7f0a20137a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a260d9640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a201d2390 0x7f0a20137a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a0801c460 tx=0x7f0a080a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a260d9640 1 -- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a201d2390 msgr2=0x7f0a20137a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-18T21:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a260d9640 1 -- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a201d2390 msgr2=0x7f0a20137a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a260d9640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a201d2390 0x7f0a20137a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a0801c460 tx=0x7f0a080a8000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a260d9640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a201d2390 0x7f0a20137a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a0801c460 tx=0x7f0a080a8000 comp rx=0 tx=0).stop 2024-08-18T21:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a1effd640 1 -- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a201d2390 msgr2=0x7f0a20137a10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a1effd640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a201d2390 0x7f0a20137a10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a1effd640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a00041bd0 0x7f0a00043fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a1effd640 1 -- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a201d2390 msgr2=0x7f0a20137a10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a1effd640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a201d2390 0x7f0a20137a10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a1effd640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a1effd640 1 -- 172.21.15.5:0/1637001226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0a00041640 con 0x7f0a00041bd0 2024-08-18T21:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a260d9640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a00041bd0 0x7f0a00043fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a260d9640 10 monclient: get_auth_request con 0x7f0a00041bd0 auth_method 0 2024-08-18T21:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a260d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a260d9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a260d9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a260d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a260d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.039+0000 7f0a260d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.043+0000 7f0a260d9640 10 monclient(hunting): handle_auth_done global_id 134182 payload 824 2024-08-18T21:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.043+0000 7f0a260d9640 1 -- 172.21.15.5:0/1637001226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0a080aa960 con 0x7f0a00041bd0 2024-08-18T21:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.043+0000 7f0a260d9640 1 -- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a00041bd0 msgr2=0x7f0a00043fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.043+0000 7f0a260d9640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a00041bd0 0x7f0a00043fc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a08000c10 tx=0x7f0a080a6000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.043+0000 7f0a1effd640 1 -- 172.21.15.5:0/1637001226 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a080d7020 con 0x7f0a00041bd0 2024-08-18T21:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.043+0000 7f0a1effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.043+0000 7f0a1effd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.043+0000 7f0a1effd640 10 monclient: dump: 2024-08-18T21:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a1effd640 1 -- 172.21.15.5:0/1637001226 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f0a080b6c40 con 0x7f0a00041bd0 2024-08-18T21:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a1effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a1effd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a1effd640 1 -- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a00041bd0 msgr2=0x7f0a00043fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a1effd640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a00041bd0 0x7f0a00043fc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a08000c10 tx=0x7f0a080a6000 comp rx=0 tx=0).stop 2024-08-18T21:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a1effd640 1 -- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a00041bd0 msgr2=0x7f0a00043fc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a1effd640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a00041bd0 0x7f0a00043fc0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a08000c10 tx=0x7f0a080a6000 comp rx=0 tx=0).stop 2024-08-18T21:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a268da640 1 -- 172.21.15.5:0/1637001226 reap_dead start 2024-08-18T21:14:22.051 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:22.051 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:22.051 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:22.051 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:22.052 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:22.052 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 21507, 2024-08-18T21:14:22.052 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:22.052 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:22.052 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:22.052 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:22.052 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:22.052 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:22.052 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:22.052 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:22.052 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:22.052 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:22.052 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.053 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:14:22.053 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:22.053 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:22.053 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:22.053 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:22.053 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:22.053 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:22.053 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:22.053 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:22.053 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:22.053 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:22.053 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:22.053 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:22.054 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:22.054 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:22.054 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.054 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:22.054 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:22.054 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:22.054 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:22.054 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:22.054 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:22.054 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:22.054 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:22.054 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:22.055 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:22.055 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:22.055 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:22.055 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:22.055 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.055 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:22.055 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:22.055 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:22.055 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:22.055 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:22.055 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:22.055 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:22.055 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:22.056 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:22.056 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:22.056 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:22.056 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:22.056 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:22.056 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:22.056 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:22.056 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:22.056 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:22.056 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:22.056 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:22.056 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:22.056 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:22.057 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:22.057 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:22.057 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:22.057 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:22.057 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:22.057 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:22.057 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:22.057 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.057 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:22.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.058 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:22.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.058 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:22.058 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:22.058 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.058 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.058 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.058 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:22.058 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.059 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.059 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:22.059 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.059 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.059 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.059 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:22.059 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:22.060 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.060 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.060 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.060 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:22.060 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:22.060 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.060 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.060 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.060 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:22.060 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.061 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.061 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:22.061 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.061 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.061 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.061 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:22.061 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:22.061 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.061 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.061 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.062 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:22.062 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:22.063 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.063 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.063 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.063 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:22.064 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.064 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.064 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:22.064 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.064 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.064 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.064 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:22.065 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:22.065 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.065 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.065 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.065 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:22.065 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:22.065 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.065 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.065 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.065 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:22.066 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.066 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.066 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.066 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:22.066 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.066 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.066 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.066 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:22.066 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:22.066 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.066 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.066 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.067 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:22.067 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:22.067 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.067 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.067 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.067 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:22.067 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.067 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.068 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:22.068 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.068 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.068 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.068 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:22.068 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:22.068 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.068 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.068 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.068 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:22.069 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:22.069 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.069 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.069 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.069 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.069 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:22.069 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.069 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.069 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.069 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:22.069 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.069 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.069 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.070 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:22.070 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:22.070 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.070 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.070 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.070 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:22.070 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:22.070 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.070 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.071 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.071 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:22.071 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.071 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.071 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:22.071 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.071 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.071 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.071 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:22.071 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:22.072 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.072 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.072 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.072 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:22.072 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:22.072 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.072 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.072 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.072 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:22.072 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.073 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:22.073 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.073 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.073 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.073 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:22.073 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:22.073 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.073 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.073 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.074 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:22.074 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:22.074 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.074 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.074 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.074 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:22.074 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.074 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.074 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:22.074 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.075 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.075 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.075 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:22.075 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:22.075 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.075 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.075 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.075 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.075 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.075 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:22.075 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:22.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.076 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:22.076 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:22.076 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:22.076 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.076 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.076 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:22.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.076 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:22.076 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:22.076 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:14:22.076 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.076 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.077 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:22.077 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a2833d640 1 -- 172.21.15.5:0/1637001226 >> v2:172.21.15.157:6812/631023601 conn(0x7f0a0003bdc0 msgr2=0x7f0a0003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a2833d640 1 --2- 172.21.15.5:0/1637001226 >> v2:172.21.15.157:6812/631023601 conn(0x7f0a0003bdc0 0x7f0a0003e280 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0a2011fbd0 tx=0x7f0a18008040 comp rx=0 tx=0).stop 2024-08-18T21:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a2833d640 10 monclient: shutdown 2024-08-18T21:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a2833d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a2833d640 1 -- 172.21.15.5:0/1637001226 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0a2006cd30 msgr2=0x7f0a20136970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a2833d640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0a2006cd30 0x7f0a20136970 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0a10007ea0 tx=0x7f0a10007f90 comp rx=0 tx=0).stop 2024-08-18T21:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a2833d640 1 -- 172.21.15.5:0/1637001226 shutdown_connections 2024-08-18T21:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a2833d640 1 --2- 172.21.15.5:0/1637001226 >> v2:172.21.15.157:6812/631023601 conn(0x7f0a0003bdc0 0x7f0a0003e280 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a2833d640 1 --2- 172.21.15.5:0/1637001226 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f0a2006cd30 0x7f0a20136970 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a2833d640 1 -- 172.21.15.5:0/1637001226 >> 172.21.15.5:0/1637001226 conn(0x7f0a200688d0 msgr2=0x7f0a200a7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a2833d640 1 -- 172.21.15.5:0/1637001226 shutdown_connections 2024-08-18T21:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.047+0000 7f0a2833d640 1 -- 172.21.15.5:0/1637001226 wait complete. 2024-08-18T21:14:22.079 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:22.079 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:14:22.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 10 monclient: get_monmap_and_config 2024-08-18T21:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 10 monclient: build_initial_monmap 2024-08-18T21:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 10 monclient: monmap: 2024-08-18T21:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:22.208615+0000 2024-08-18T21:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:22.208615+0000 2024-08-18T21:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 1 Processor -- start 2024-08-18T21:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 1 -- start start 2024-08-18T21:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 10 monclient: init 2024-08-18T21:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 10 monclient: _add_conns ranks=[1,5,7,9,4,0,10,8,3,2,6] 2024-08-18T21:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7264073790 addr v1:172.21.15.157:6789/0 2024-08-18T21:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7264136620 0x7f726413ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 10 monclient(hunting): picked mon.noname-h con 0x7f7264136620 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f726413ef40 0x7f7264141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 10 monclient(hunting): picked mon.noname-i con 0x7f726413ef40 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72640a4df0 con 0x7f7264073790 2024-08-18T21:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f7264136a60 con 0x7f7264136620 2024-08-18T21:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f72640a3a70 con 0x7f726413ef40 2024-08-18T21:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f726a5fe640 10 monclient(hunting): authenticate will time out at 1629.221894s 2024-08-18T21:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f7263fff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f7264073790 0x7f7264073b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:47394/0 (socket says 172.21.15.5:47394) 2024-08-18T21:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f7263fff640 1 -- 172.21.15.5:0/58765269 learned_addr learned my addr 172.21.15.5:0/58765269 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f7268b9b640 1 --2- 172.21.15.5:0/58765269 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f726413ef40 0x7f7264141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 1 --2- 172.21.15.5:0/58765269 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7264136620 0x7f726413ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 10 monclient(hunting): get_auth_request con 0x7f7264136620 auth_method 0 2024-08-18T21:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f7268b9b640 10 monclient(hunting): get_auth_request con 0x7f726413ef40 auth_method 0 2024-08-18T21:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f7268b9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f7268b9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f7268b9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f7268b9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f7268b9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f7268b9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 10 monclient(hunting): handle_auth_done global_id 95405 payload 274 2024-08-18T21:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 1 -- 172.21.15.5:0/58765269 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f726413ef40 msgr2=0x7f7264141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 1 --2- 172.21.15.5:0/58765269 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f726413ef40 0x7f7264141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 1 -- 172.21.15.5:0/58765269 >> v1:172.21.15.157:6789/0 conn(0x7f7264073790 legacy=0x7f7264073b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 10 monclient: _finish_hunting 0 2024-08-18T21:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 1 monclient: found mon.noname-h 2024-08-18T21:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.207+0000 7f72637fe640 1 -- 172.21.15.5:0/58765269 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726406fd30 con 0x7f7264136620 2024-08-18T21:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f72637fe640 1 -- 172.21.15.5:0/58765269 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7264136620 msgr2=0x7f726413ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f72637fe640 1 --2- 172.21.15.5:0/58765269 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7264136620 0x7f726413ea00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f72540097f0 tx=0x7f725401c340 comp rx=0 tx=0).ready entity=mon.5 client_cookie=eae844fd42752b39 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7262ffd640 1 -- 172.21.15.5:0/58765269 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f72540b0070 con 0x7f7264136620 2024-08-18T21:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7262ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7262ffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7262ffd640 10 monclient: dump: 2024-08-18T21:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7262ffd640 10 monclient: _finish_auth 0 2024-08-18T21:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7262ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7262ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7262ffd640 1 -- 172.21.15.5:0/58765269 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72540aa810 con 0x7f7264136620 2024-08-18T21:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7262ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7262ffd640 1 -- 172.21.15.5:0/58765269 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f72540aae30 con 0x7f7264136620 2024-08-18T21:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 5 monclient: authenticate success, global_id 95405 2024-08-18T21:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 4 set_mon_vals no callback set 2024-08-18T21:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7262ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7262ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7262ffd640 10 monclient: dump: 2024-08-18T21:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.216 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 10 monclient: shutdown 2024-08-18T21:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 1 -- 172.21.15.5:0/58765269 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7264136620 msgr2=0x7f726413ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 1 --2- 172.21.15.5:0/58765269 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7264136620 0x7f726413ea00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f72540097f0 tx=0x7f725401c340 comp rx=0 tx=0).stop 2024-08-18T21:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 1 -- 172.21.15.5:0/58765269 shutdown_connections 2024-08-18T21:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 1 --2- 172.21.15.5:0/58765269 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7264136620 0x7f726413ea00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 1 --2- 172.21.15.5:0/58765269 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f726413ef40 0x7f7264141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 1 -- 172.21.15.5:0/58765269 >> 172.21.15.5:0/58765269 conn(0x7f72640a8a90 msgr2=0x7f72640a8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 1 -- 172.21.15.5:0/58765269 shutdown_connections 2024-08-18T21:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 1 -- 172.21.15.5:0/58765269 wait complete. 2024-08-18T21:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 10 monclient: build_initial_monmap 2024-08-18T21:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 10 monclient: monmap: 2024-08-18T21:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 1 Processor -- start 2024-08-18T21:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 1 -- start start 2024-08-18T21:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 10 monclient: init 2024-08-18T21:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 10 monclient: _add_conns ranks=[2,0,6,8,7,1,5,4,3] 2024-08-18T21:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7264073790 0x7f72641d1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 10 monclient(hunting): picked mon.noname-b con 0x7f7264073790 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7264136620 0x7f7264134010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 10 monclient(hunting): picked mon.noname-a con 0x7f7264136620 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f726413ef40 0x7f726413ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 10 monclient(hunting): picked mon.noname-d con 0x7f726413ef40 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7264144210 con 0x7f7264136620 2024-08-18T21:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f7264144090 con 0x7f7264073790 2024-08-18T21:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f7264144390 con 0x7f726413ef40 2024-08-18T21:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f726a5fe640 10 monclient(hunting): authenticate will time out at 1629.231229s 2024-08-18T21:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7263fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7264073790 0x7f72641d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f72637fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7264136620 0x7f7264134010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7263fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7264073790 0x7f72641d1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:56904/0 (socket says 172.21.15.5:56904) 2024-08-18T21:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f726413ef40 0x7f726413ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f72637fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7264136620 0x7f7264134010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56446/0 (socket says 172.21.15.5:56446) 2024-08-18T21:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7263fff640 1 -- 172.21.15.5:0/766816600 learned_addr learned my addr 172.21.15.5:0/766816600 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7263fff640 10 monclient(hunting): get_auth_request con 0x7f7264073790 auth_method 0 2024-08-18T21:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7263fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7263fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7263fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f72637fe640 10 monclient(hunting): get_auth_request con 0x7f7264136620 auth_method 0 2024-08-18T21:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f72637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f72637fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f72637fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 10 monclient(hunting): get_auth_request con 0x7f726413ef40 auth_method 0 2024-08-18T21:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7263fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7263fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7263fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f72637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f72637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f72637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 10 monclient(hunting): handle_auth_done global_id 134142 payload 824 2024-08-18T21:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 1 -- 172.21.15.5:0/766816600 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7264073790 msgr2=0x7f72641d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 1 --2- 172.21.15.5:0/766816600 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7264073790 0x7f72641d1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 1 -- 172.21.15.5:0/766816600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7264136620 msgr2=0x7f7264134010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 1 --2- 172.21.15.5:0/766816600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7264136620 0x7f7264134010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 10 monclient: _finish_hunting 0 2024-08-18T21:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 1 monclient: found mon.noname-d 2024-08-18T21:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f7268b9b640 1 -- 172.21.15.5:0/766816600 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726413e990 con 0x7f726413ef40 2024-08-18T21:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.215+0000 7f72637fe640 1 --2- 172.21.15.5:0/766816600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7264136620 0x7f7264134010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7268b9b640 1 -- 172.21.15.5:0/766816600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f726413ef40 msgr2=0x7f726413ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7268b9b640 1 --2- 172.21.15.5:0/766816600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f726413ef40 0x7f726413ae20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f725c00eba0 tx=0x7f725c00c490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7260ff9640 1 -- 172.21.15.5:0/766816600 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f725c018020 con 0x7f726413ef40 2024-08-18T21:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7260ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7260ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7260ff9640 10 monclient: dump: 2024-08-18T21:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7260ff9640 10 monclient: _finish_auth 0 2024-08-18T21:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7260ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7260ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7260ff9640 1 -- 172.21.15.5:0/766816600 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c00cd30 con 0x7f726413ef40 2024-08-18T21:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7260ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7260ff9640 1 -- 172.21.15.5:0/766816600 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f725c014d60 con 0x7f726413ef40 2024-08-18T21:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f726a5fe640 5 monclient: authenticate success, global_id 134142 2024-08-18T21:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f726a5fe640 10 monclient: _renew_subs 2024-08-18T21:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f726a5fe640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f726a5fe640 1 -- 172.21.15.5:0/766816600 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72641415b0 con 0x7f726413ef40 2024-08-18T21:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f72627fc640 4 set_mon_vals no callback set 2024-08-18T21:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7260ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7260ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7260ff9640 10 monclient: dump: 2024-08-18T21:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f726a5fe640 10 monclient: _renew_subs 2024-08-18T21:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f726a5fe640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f726a5fe640 1 -- 172.21.15.5:0/766816600 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f72641d21c0 con 0x7f726413ef40 2024-08-18T21:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f726a5fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f726a5fe640 1 --2- 172.21.15.5:0/766816600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7264134550 0x7f726413b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f726a5fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f726a5fe640 1 -- 172.21.15.5:0/766816600 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7264051140 con 0x7f7264134550 2024-08-18T21:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7260ff9640 1 -- 172.21.15.5:0/766816600 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f725c01b020 con 0x7f726413ef40 2024-08-18T21:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7260ff9640 1 --2- 172.21.15.5:0/766816600 >> v2:172.21.15.157:6812/631023601 conn(0x7f724803bdf0 0x7f724803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7263fff640 1 --2- 172.21.15.5:0/766816600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7264134550 0x7f726413b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7263fff640 10 monclient: get_auth_request con 0x7f7264134550 auth_method 0 2024-08-18T21:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7263fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7263fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7263fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.219+0000 7f7260ff9640 1 -- 172.21.15.5:0/766816600 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(295..295 src has 22..295) ==== 3506+0+0 (secure 0 0 0) 0x7f725c04f140 con 0x7f726413ef40 2024-08-18T21:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.223+0000 7f7263fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.223+0000 7f7263fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.223+0000 7f7263fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.223+0000 7f72637fe640 1 --2- 172.21.15.5:0/766816600 >> v2:172.21.15.157:6812/631023601 conn(0x7f724803bdf0 0x7f724803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.223+0000 7f72637fe640 10 monclient: get_auth_request con 0x7f724803bdf0 auth_method 0 2024-08-18T21:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.223+0000 7f7263fff640 10 monclient(hunting): handle_auth_done global_id 134148 payload 824 2024-08-18T21:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.223+0000 7f7263fff640 1 -- 172.21.15.5:0/766816600 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72640a82f0 con 0x7f7264134550 2024-08-18T21:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.223+0000 7f7263fff640 1 -- 172.21.15.5:0/766816600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7264134550 msgr2=0x7f726413b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.223+0000 7f7263fff640 1 --2- 172.21.15.5:0/766816600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7264134550 0x7f726413b360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f724c00eaa0 tx=0x7f724c00ef60 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.223+0000 7f72637fe640 1 --2- 172.21.15.5:0/766816600 >> v2:172.21.15.157:6812/631023601 conn(0x7f724803bdf0 0x7f724803e2b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f72640a3580 tx=0x7f72540a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.223+0000 7f7260ff9640 1 -- 172.21.15.5:0/766816600 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f724c00cc40 con 0x7f7264134550 2024-08-18T21:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.223+0000 7f7260ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.223+0000 7f7260ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.223+0000 7f7260ff9640 10 monclient: dump: 2024-08-18T21:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.227+0000 7f7260ff9640 1 -- 172.21.15.5:0/766816600 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f724c019070 con 0x7f7264134550 2024-08-18T21:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.227+0000 7f7260ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.227+0000 7f7260ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.227+0000 7f7260ff9640 1 -- 172.21.15.5:0/766816600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7264134550 msgr2=0x7f726413b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.227+0000 7f7260ff9640 1 --2- 172.21.15.5:0/766816600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7264134550 0x7f726413b360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f724c00eaa0 tx=0x7f724c00ef60 comp rx=0 tx=0).stop 2024-08-18T21:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.227+0000 7f7260ff9640 1 -- 172.21.15.5:0/766816600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7264134550 msgr2=0x7f726413b360 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.227+0000 7f7260ff9640 1 --2- 172.21.15.5:0/766816600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7264134550 0x7f726413b360 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.231+0000 7f726a5fe640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.231+0000 7f726a5fe640 1 --2- 172.21.15.5:0/766816600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f726413b8a0 0x7f7264072540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.231+0000 7f726a5fe640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.231+0000 7f726a5fe640 1 -- 172.21.15.5:0/766816600 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f726413bcb0 con 0x7f726413b8a0 2024-08-18T21:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.231+0000 7f7263fff640 1 --2- 172.21.15.5:0/766816600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f726413b8a0 0x7f7264072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.231+0000 7f7263fff640 10 monclient: get_auth_request con 0x7f726413b8a0 auth_method 0 2024-08-18T21:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.231+0000 7f7263fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.231+0000 7f7263fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.231+0000 7f7263fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.235+0000 7f7263fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.235+0000 7f7263fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.235+0000 7f7263fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.235+0000 7f7263fff640 10 monclient(hunting): handle_auth_done global_id 134157 payload 824 2024-08-18T21:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.235+0000 7f7263fff640 1 -- 172.21.15.5:0/766816600 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7264073b70 con 0x7f726413b8a0 2024-08-18T21:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.235+0000 7f7263fff640 1 -- 172.21.15.5:0/766816600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f726413b8a0 msgr2=0x7f7264072540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.235+0000 7f7263fff640 1 --2- 172.21.15.5:0/766816600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f726413b8a0 0x7f7264072540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f724c018000 tx=0x7f724c004950 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.235+0000 7f7260ff9640 1 -- 172.21.15.5:0/766816600 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f724c01e260 con 0x7f726413b8a0 2024-08-18T21:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.235+0000 7f7260ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.235+0000 7f7260ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.235+0000 7f7260ff9640 10 monclient: dump: 2024-08-18T21:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f7260ff9640 1 -- 172.21.15.5:0/766816600 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f724c01e260 con 0x7f726413b8a0 2024-08-18T21:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f7260ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f7260ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f7260ff9640 1 -- 172.21.15.5:0/766816600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f726413b8a0 msgr2=0x7f7264072540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f7260ff9640 1 --2- 172.21.15.5:0/766816600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f726413b8a0 0x7f7264072540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f724c018000 tx=0x7f724c004950 comp rx=0 tx=0).stop 2024-08-18T21:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f7260ff9640 1 -- 172.21.15.5:0/766816600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f726413b8a0 msgr2=0x7f7264072540 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f7260ff9640 1 --2- 172.21.15.5:0/766816600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f726413b8a0 0x7f7264072540 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f724c018000 tx=0x7f724c004950 comp rx=0 tx=0).stop 2024-08-18T21:14:22.241 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:22.241 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:22.241 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:22.241 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:22.241 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:22.241 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 21699, 2024-08-18T21:14:22.241 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:22.241 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:22.242 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:22.242 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:22.242 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:22.242 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:22.242 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:22.242 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:22.242 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:22.242 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:22.242 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.242 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:14:22.242 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:22.242 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:22.242 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:22.243 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:22.243 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:22.243 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:22.243 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:22.243 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:22.243 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:22.243 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:22.243 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:22.243 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:22.243 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:22.243 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:22.243 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.243 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:22.243 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:22.244 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:22.244 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:22.244 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:22.244 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:22.244 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:22.244 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:22.244 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:22.244 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:22.244 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:22.244 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:22.244 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:22.244 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.244 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:22.245 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:22.245 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:22.245 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:22.245 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:22.245 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:22.245 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:22.245 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:22.245 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:22.245 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:22.245 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:22.245 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:22.245 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:22.246 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:22.246 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:22.246 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:22.246 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:22.246 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:22.246 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:22.246 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:22.246 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:22.246 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:22.246 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:22.246 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:22.246 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:22.246 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:22.247 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:22.247 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:22.247 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.247 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:22.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.247 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:22.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.247 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:22.247 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:22.247 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.247 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.247 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.247 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:22.248 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.248 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.248 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:22.248 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.248 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.248 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.248 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:22.248 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:22.248 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.248 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.248 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.249 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:22.249 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:22.249 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.249 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.249 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.249 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:22.249 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.249 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.250 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:22.250 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.250 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.250 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.250 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:22.250 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:22.250 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.250 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.250 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.250 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:22.251 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:22.251 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.251 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.251 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.251 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:22.251 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.251 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.251 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:22.251 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.251 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.252 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.252 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:22.252 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:22.252 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.252 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.252 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.252 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:22.252 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:22.252 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.252 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.253 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.253 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:22.253 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.253 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.253 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.253 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:22.253 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.253 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.253 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.253 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:22.253 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:22.253 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.254 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.254 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.254 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:22.254 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:22.254 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.254 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.254 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:22.255 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.255 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.255 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:22.255 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.255 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.255 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.255 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:22.255 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:22.255 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.255 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.255 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:22.257 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.257 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.257 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.257 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:22.257 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:22.257 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.257 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.257 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.257 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:22.257 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:22.257 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.258 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.258 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:22.258 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.258 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:22.258 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.258 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.258 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.259 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:22.259 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:22.259 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.259 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.259 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.259 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:22.259 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:22.259 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.259 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.259 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.259 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:22.260 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.260 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:22.260 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.260 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.260 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.260 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:22.260 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:22.260 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.260 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.261 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.261 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:22.261 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:22.261 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.261 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.261 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.261 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:22.261 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.261 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.262 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:22.262 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.262 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.262 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.262 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:22.262 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:22.262 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.262 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.262 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.262 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.262 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.263 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:22.263 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:22.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.263 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:22.263 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:22.263 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:22.263 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.263 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.263 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:22.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.263 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:22.263 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:22.263 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:22.263 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.264 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.264 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:22.264 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f726a5fe640 1 -- 172.21.15.5:0/766816600 >> v2:172.21.15.157:6812/631023601 conn(0x7f724803bdf0 msgr2=0x7f724803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f726a5fe640 1 --2- 172.21.15.5:0/766816600 >> v2:172.21.15.157:6812/631023601 conn(0x7f724803bdf0 0x7f724803e2b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f72640a3580 tx=0x7f72540a6000 comp rx=0 tx=0).stop 2024-08-18T21:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f726a5fe640 10 monclient: shutdown 2024-08-18T21:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f726a5fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f726a5fe640 1 -- 172.21.15.5:0/766816600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f726413ef40 msgr2=0x7f726413ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f726a5fe640 1 --2- 172.21.15.5:0/766816600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f726413ef40 0x7f726413ae20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f725c00eba0 tx=0x7f725c00c490 comp rx=0 tx=0).stop 2024-08-18T21:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f7268b9b640 1 -- 172.21.15.5:0/766816600 reap_dead start 2024-08-18T21:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f7268b9b640 1 -- 172.21.15.5:0/766816600 reap_dead start 2024-08-18T21:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f726a5fe640 1 -- 172.21.15.5:0/766816600 shutdown_connections 2024-08-18T21:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f726a5fe640 1 -- 172.21.15.5:0/766816600 >> 172.21.15.5:0/766816600 conn(0x7f72640a8a90 msgr2=0x7f726413ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f726a5fe640 1 -- 172.21.15.5:0/766816600 shutdown_connections 2024-08-18T21:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.239+0000 7f726a5fe640 1 -- 172.21.15.5:0/766816600 wait complete. 2024-08-18T21:14:22.267 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:22.267 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:14:22.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:14:22.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 10 monclient: get_monmap_and_config 2024-08-18T21:14:22.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 10 monclient: build_initial_monmap 2024-08-18T21:14:22.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 10 monclient: monmap: 2024-08-18T21:14:22.384 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:22.384 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.384 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:22.388899+0000 2024-08-18T21:14:22.385 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:22.388899+0000 2024-08-18T21:14:22.385 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:22.385 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.385 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:22.385 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:22.385 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:22.385 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:22.385 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:22.385 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:22.385 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:22.385 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:22.385 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:22.385 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:22.385 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:22.386 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 1 Processor -- start 2024-08-18T21:14:22.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 1 -- start start 2024-08-18T21:14:22.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 10 monclient: init 2024-08-18T21:14:22.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:22.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 10 monclient: _add_conns ranks=[1,7,6,3,5,9,4,0,10,8,2] 2024-08-18T21:14:22.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f0cbc139dc0 addr v1:172.21.15.157:6789/0 2024-08-18T21:14:22.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0cbc09f110 0x7f0cbc13a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 10 monclient(hunting): picked mon.noname-i con 0x7f0cbc09f110 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:22.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0cbc06d060 0x7f0cbc141a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 10 monclient(hunting): picked mon.noname-d con 0x7f0cbc06d060 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:14:22.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cbc09deb0 con 0x7f0cbc139dc0 2024-08-18T21:14:22.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f0cbc0a4f90 con 0x7f0cbc06d060 2024-08-18T21:14:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f0cbc09daa0 con 0x7f0cbc09f110 2024-08-18T21:14:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cc09e3640 10 monclient(hunting): authenticate will time out at 1629.402439s 2024-08-18T21:14:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0cbc06d060 0x7f0cbc141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0cbc06d060 0x7f0cbc141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:52522/0 (socket says 172.21.15.5:52522) 2024-08-18T21:14:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 1 -- 172.21.15.5:0/1591761178 learned_addr learned my addr 172.21.15.5:0/1591761178 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 10 monclient(hunting): get_auth_request con 0x7f0cbc06d060 auth_method 0 2024-08-18T21:14:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cb9d9b640 1 --2- 172.21.15.5:0/1591761178 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0cbc09f110 0x7f0cbc13a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cb9d9b640 10 monclient(hunting): get_auth_request con 0x7f0cbc09f110 auth_method 0 2024-08-18T21:14:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cb9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cb9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cb9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 10 monclient(hunting): handle_auth_done global_id 134151 payload 274 2024-08-18T21:14:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 1 -- 172.21.15.5:0/1591761178 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0cbc09f110 msgr2=0x7f0cbc13a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 1 --2- 172.21.15.5:0/1591761178 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0cbc09f110 0x7f0cbc13a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 1 -- 172.21.15.5:0/1591761178 >> v1:172.21.15.157:6789/0 conn(0x7f0cbc139dc0 legacy=0x7f0cbc06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 10 monclient: _finish_hunting 0 2024-08-18T21:14:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 1 monclient: found mon.noname-d 2024-08-18T21:14:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:22.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:14:22.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.387+0000 7f0cbad9d640 1 -- 172.21.15.5:0/1591761178 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cbc09e190 con 0x7f0cbc06d060 2024-08-18T21:14:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cbad9d640 1 -- 172.21.15.5:0/1591761178 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0cbc06d060 msgr2=0x7f0cbc141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cbad9d640 1 --2- 172.21.15.5:0/1591761178 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0cbc06d060 0x7f0cbc141a50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40098d0 tx=0x7f0ca401c3b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=2b58b99e6ea27314 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cb959a640 1 -- 172.21.15.5:0/1591761178 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0ca40b0070 con 0x7f0cbc06d060 2024-08-18T21:14:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cb959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cb959a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:14:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cb959a640 10 monclient: dump: 2024-08-18T21:14:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cb959a640 10 monclient: _finish_auth 0 2024-08-18T21:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cb959a640 10 monclient: _check_auth_tickets 2024-08-18T21:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cb959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cb959a640 1 -- 172.21.15.5:0/1591761178 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca40aa810 con 0x7f0cbc06d060 2024-08-18T21:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cb959a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cb959a640 1 -- 172.21.15.5:0/1591761178 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0ca40aae30 con 0x7f0cbc06d060 2024-08-18T21:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cc09e3640 5 monclient: authenticate success, global_id 134151 2024-08-18T21:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cc09e3640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cc09e3640 4 set_mon_vals no callback set 2024-08-18T21:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cb959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cb959a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.391+0000 7f0cb959a640 10 monclient: dump: 2024-08-18T21:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.396 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 10 monclient: shutdown 2024-08-18T21:14:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 1 -- 172.21.15.5:0/1591761178 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0cbc06d060 msgr2=0x7f0cbc141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 1 --2- 172.21.15.5:0/1591761178 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0cbc06d060 0x7f0cbc141a50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40098d0 tx=0x7f0ca401c3b0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 1 -- 172.21.15.5:0/1591761178 shutdown_connections 2024-08-18T21:14:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 1 --2- 172.21.15.5:0/1591761178 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f0cbc06d060 0x7f0cbc141a50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 1 --2- 172.21.15.5:0/1591761178 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0cbc09f110 0x7f0cbc13a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 1 -- 172.21.15.5:0/1591761178 >> 172.21.15.5:0/1591761178 conn(0x7f0cbc0688d0 msgr2=0x7f0cbc068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 1 -- 172.21.15.5:0/1591761178 shutdown_connections 2024-08-18T21:14:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 1 -- 172.21.15.5:0/1591761178 wait complete. 2024-08-18T21:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 10 monclient: build_initial_monmap 2024-08-18T21:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 10 monclient: monmap: 2024-08-18T21:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 1 Processor -- start 2024-08-18T21:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 1 -- start start 2024-08-18T21:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 10 monclient: init 2024-08-18T21:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 10 monclient: _add_conns ranks=[7,0,1,3,4,2,6,5,8] 2024-08-18T21:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0cbc06d060 0x7f0cbc073780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 10 monclient(hunting): picked mon.noname-i con 0x7f0cbc06d060 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cbc09f110 0x7f0cbc13f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 10 monclient(hunting): picked mon.noname-a con 0x7f0cbc09f110 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:14:22.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cbc139dc0 0x7f0cbc13f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 10 monclient(hunting): picked mon.noname-f con 0x7f0cbc139dc0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:14:22.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc144930 con 0x7f0cbc09f110 2024-08-18T21:14:22.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc1447b0 con 0x7f0cbc139dc0 2024-08-18T21:14:22.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f0cbc144ab0 con 0x7f0cbc06d060 2024-08-18T21:14:22.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:22.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cc09e3640 10 monclient(hunting): authenticate will time out at 1629.410323s 2024-08-18T21:14:22.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cbc09f110 0x7f0cbc13f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cbc09f110 0x7f0cbc13f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56462/0 (socket says 172.21.15.5:56462) 2024-08-18T21:14:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 1 -- 172.21.15.5:0/2157427172 learned_addr learned my addr 172.21.15.5:0/2157427172 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 10 monclient(hunting): get_auth_request con 0x7f0cbc09f110 auth_method 0 2024-08-18T21:14:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cba59c640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0cbc06d060 0x7f0cbc073780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cbad9d640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cbc139dc0 0x7f0cbc13f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cba59c640 10 monclient(hunting): get_auth_request con 0x7f0cbc06d060 auth_method 0 2024-08-18T21:14:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cba59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cba59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cba59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cbad9d640 10 monclient(hunting): get_auth_request con 0x7f0cbc139dc0 auth_method 0 2024-08-18T21:14:22.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cbad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cbad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cbad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 10 monclient(hunting): handle_auth_done global_id 124578 payload 824 2024-08-18T21:14:22.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 1 -- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0cbc06d060 msgr2=0x7f0cbc073780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0cbc06d060 0x7f0cbc073780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 1 -- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cbc139dc0 msgr2=0x7f0cbc13f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cbc139dc0 0x7f0cbc13f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:14:22.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 1 monclient: found mon.noname-a 2024-08-18T21:14:22.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:14:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cb9d9b640 1 -- 172.21.15.5:0/2157427172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cbc073cc0 con 0x7f0cbc09f110 2024-08-18T21:14:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cbad9d640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cbc139dc0 0x7f0cbc13f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:14:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.395+0000 7f0cba59c640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0cbc06d060 0x7f0cbc073780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:14:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cb9d9b640 1 -- 172.21.15.5:0/2157427172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cbc09f110 msgr2=0x7f0cbc13f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cb9d9b640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cbc09f110 0x7f0cbc13f410 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4007ef0 tx=0x7f0cb400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cb2ffd640 1 -- 172.21.15.5:0/2157427172 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0cb401a070 con 0x7f0cbc09f110 2024-08-18T21:14:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cb2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cb2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:14:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cb2ffd640 10 monclient: dump: 2024-08-18T21:14:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.406 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.406 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.406 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.406 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.406 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.406 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.406 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.406 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.406 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.406 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.406 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.406 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cb2ffd640 10 monclient: _finish_auth 0 2024-08-18T21:14:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cb2ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:14:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cb2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cb2ffd640 1 -- 172.21.15.5:0/2157427172 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb4003bb0 con 0x7f0cbc09f110 2024-08-18T21:14:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cb2ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cb2ffd640 1 -- 172.21.15.5:0/2157427172 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0cb4003d60 con 0x7f0cbc09f110 2024-08-18T21:14:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cb2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cb2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:14:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cb2ffd640 10 monclient: dump: 2024-08-18T21:14:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.408 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.408 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.408 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.408 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.408 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.408 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.408 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.408 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.408 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.408 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.408 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cb8d99640 4 set_mon_vals no callback set 2024-08-18T21:14:22.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cc09e3640 5 monclient: authenticate success, global_id 124578 2024-08-18T21:14:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cc09e3640 10 monclient: _renew_subs 2024-08-18T21:14:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cc09e3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cc09e3640 1 -- 172.21.15.5:0/2157427172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cbc0a4400 con 0x7f0cbc09f110 2024-08-18T21:14:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cc09e3640 10 monclient: _renew_subs 2024-08-18T21:14:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cc09e3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.399+0000 7f0cc09e3640 1 -- 172.21.15.5:0/2157427172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cbc071460 con 0x7f0cbc09f110 2024-08-18T21:14:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cc09e3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cc09e3640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0cbc070c20 0x7f0cbc02e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cc09e3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cc09e3640 1 -- 172.21.15.5:0/2157427172 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f0cbc051140 con 0x7f0cbc070c20 2024-08-18T21:14:22.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cba59c640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0cbc070c20 0x7f0cbc02e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cba59c640 10 monclient: get_auth_request con 0x7f0cbc070c20 auth_method 0 2024-08-18T21:14:22.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cba59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cba59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cba59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cb2ffd640 1 -- 172.21.15.5:0/2157427172 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f0cb4004030 con 0x7f0cbc09f110 2024-08-18T21:14:22.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cba59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cba59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cba59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cb2ffd640 1 --2- 172.21.15.5:0/2157427172 >> v2:172.21.15.157:6812/631023601 conn(0x7f0ca003bdc0 0x7f0ca003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cb2ffd640 1 -- 172.21.15.5:0/2157427172 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(295..295 src has 22..295) ==== 3506+0+0 (secure 0 0 0) 0x7f0cb404e750 con 0x7f0cbc09f110 2024-08-18T21:14:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cba59c640 10 monclient(hunting): handle_auth_done global_id 95414 payload 824 2024-08-18T21:14:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cba59c640 1 -- 172.21.15.5:0/2157427172 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0cbc06dbf0 con 0x7f0cbc070c20 2024-08-18T21:14:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cbad9d640 1 --2- 172.21.15.5:0/2157427172 >> v2:172.21.15.157:6812/631023601 conn(0x7f0ca003bdc0 0x7f0ca003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.403+0000 7f0cbad9d640 10 monclient: get_auth_request con 0x7f0ca003bdc0 auth_method 0 2024-08-18T21:14:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.407+0000 7f0cba59c640 1 -- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0cbc070c20 msgr2=0x7f0cbc02e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.407+0000 7f0cba59c640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0cbc070c20 0x7f0cbc02e350 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0cac00d730 tx=0x7f0cac00dbf0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.407+0000 7f0cb2ffd640 1 -- 172.21.15.5:0/2157427172 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0cac018030 con 0x7f0cbc070c20 2024-08-18T21:14:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.407+0000 7f0cb2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.407+0000 7f0cbad9d640 1 --2- 172.21.15.5:0/2157427172 >> v2:172.21.15.157:6812/631023601 conn(0x7f0ca003bdc0 0x7f0ca003e280 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40098d0 tx=0x7f0ca40a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.407+0000 7f0cb2ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:14:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.407+0000 7f0cb2ffd640 10 monclient: dump: 2024-08-18T21:14:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.415 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.407+0000 7f0cb2ffd640 1 -- 172.21.15.5:0/2157427172 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0cac009920 con 0x7f0cbc070c20 2024-08-18T21:14:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.407+0000 7f0cb2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.407+0000 7f0cb2ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.407+0000 7f0cb2ffd640 1 -- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0cbc070c20 msgr2=0x7f0cbc02e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.407+0000 7f0cb2ffd640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0cbc070c20 0x7f0cbc02e350 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0cac00d730 tx=0x7f0cac00dbf0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.407+0000 7f0cb2ffd640 1 -- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0cbc070c20 msgr2=0x7f0cbc02e350 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.407+0000 7f0cb2ffd640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0cbc070c20 0x7f0cbc02e350 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.411+0000 7f0cc09e3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.411+0000 7f0cc09e3640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0cbc13fe90 0x7f0cbc063b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.411+0000 7f0cc09e3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.411+0000 7f0cc09e3640 1 -- 172.21.15.5:0/2157427172 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f0cbc1402a0 con 0x7f0cbc13fe90 2024-08-18T21:14:22.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.411+0000 7f0cba59c640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0cbc13fe90 0x7f0cbc063b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.415+0000 7f0cba59c640 10 monclient: get_auth_request con 0x7f0cbc13fe90 auth_method 0 2024-08-18T21:14:22.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.415+0000 7f0cba59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.415+0000 7f0cba59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.415+0000 7f0cba59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.415+0000 7f0cba59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.415+0000 7f0cba59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.415+0000 7f0cba59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.415+0000 7f0cba59c640 10 monclient(hunting): handle_auth_done global_id 95423 payload 824 2024-08-18T21:14:22.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.415+0000 7f0cba59c640 1 -- 172.21.15.5:0/2157427172 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0cbc0a8aa0 con 0x7f0cbc13fe90 2024-08-18T21:14:22.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.415+0000 7f0cba59c640 1 -- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0cbc13fe90 msgr2=0x7f0cbc063b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.415+0000 7f0cba59c640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0cbc13fe90 0x7f0cbc063b30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0cac018000 tx=0x7f0cac004700 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.415+0000 7f0cb2ffd640 1 -- 172.21.15.5:0/2157427172 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0cac003a70 con 0x7f0cbc13fe90 2024-08-18T21:14:22.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.415+0000 7f0cb2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.415+0000 7f0cb2ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:14:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.415+0000 7f0cb2ffd640 10 monclient: dump: 2024-08-18T21:14:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.419 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cb2ffd640 1 -- 172.21.15.5:0/2157427172 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9582 (secure 0 0 0) 0x7f0cac003600 con 0x7f0cbc13fe90 2024-08-18T21:14:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cb2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cb2ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cb2ffd640 1 -- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0cbc13fe90 msgr2=0x7f0cbc063b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cb2ffd640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0cbc13fe90 0x7f0cbc063b30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0cac018000 tx=0x7f0cac004700 comp rx=0 tx=0).stop 2024-08-18T21:14:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cb2ffd640 1 -- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0cbc13fe90 msgr2=0x7f0cbc063b30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cb2ffd640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f0cbc13fe90 0x7f0cbc063b30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.420 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:22.420 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:22.420 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:22.420 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:22.420 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:22.420 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 290451, 2024-08-18T21:14:22.420 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:22.420 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:22.420 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:22.420 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:22.420 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:22.420 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:22.421 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:22.421 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:22.421 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:22.421 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:22.421 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.421 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:14:22.421 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:22.421 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:22.421 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:22.421 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:22.421 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:22.421 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:22.421 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:22.422 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:22.422 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:22.422 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:22.422 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:22.422 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:22.422 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:22.422 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:22.422 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.422 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:22.422 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:22.422 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:22.422 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:22.422 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:22.423 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:22.423 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:22.423 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:22.423 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:22.423 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:22.423 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:22.423 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:22.423 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:22.423 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.423 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.423 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:22.423 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:22.423 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:22.423 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:22.424 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:22.424 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:22.424 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:22.424 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:22.424 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:22.424 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:22.424 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:22.424 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:22.424 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:22.424 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:22.424 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:22.424 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:22.424 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:22.424 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:22.425 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:22.425 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:22.425 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:22.425 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:22.425 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:22.425 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:22.425 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:22.425 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:22.425 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:22.425 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:22.425 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.425 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:22.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.426 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:22.426 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.426 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:22.426 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:22.426 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.426 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.426 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.426 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.426 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:22.426 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.426 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.426 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.426 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.426 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:22.427 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.427 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.427 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.427 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:22.427 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:22.427 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.427 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.427 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.427 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.427 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:22.427 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:22.428 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.428 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.428 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.428 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.428 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:22.428 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.428 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.428 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.428 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:22.428 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.428 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.428 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.429 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:22.429 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:22.429 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.429 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.429 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.429 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:22.429 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:22.429 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.429 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.429 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.429 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:22.430 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.430 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.430 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.430 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:22.430 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.430 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.430 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.430 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:22.430 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:22.430 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.431 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.431 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.431 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:22.431 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:22.431 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.431 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.431 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.431 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:22.431 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.432 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.432 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:22.432 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.432 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.432 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.432 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:22.432 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:22.432 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.432 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.432 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.433 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:22.433 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:22.433 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.433 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.433 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.433 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:22.433 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.433 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.433 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:22.433 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.434 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.434 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.434 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:22.434 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:22.434 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.434 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.434 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.434 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.434 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:22.434 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:22.434 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.435 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.435 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.435 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:22.435 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.435 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.435 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:22.435 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.435 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.435 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.435 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:22.436 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:22.436 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.436 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.436 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.436 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:22.436 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:22.436 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.436 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.436 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.436 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:22.436 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.437 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.437 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.437 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:22.437 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.437 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.437 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.437 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:22.437 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:22.437 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.437 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.437 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.437 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.438 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:22.438 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:22.438 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.438 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.438 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.438 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:22.438 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.438 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.438 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:22.438 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.438 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:14:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:14:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:14:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:22.443 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:22.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cc09e3640 1 -- 172.21.15.5:0/2157427172 >> v2:172.21.15.157:6812/631023601 conn(0x7f0ca003bdc0 msgr2=0x7f0ca003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cc09e3640 1 --2- 172.21.15.5:0/2157427172 >> v2:172.21.15.157:6812/631023601 conn(0x7f0ca003bdc0 0x7f0ca003e280 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40098d0 tx=0x7f0ca40a6000 comp rx=0 tx=0).stop 2024-08-18T21:14:22.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cc09e3640 10 monclient: shutdown 2024-08-18T21:14:22.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cc09e3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:22.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cc09e3640 1 -- 172.21.15.5:0/2157427172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cbc09f110 msgr2=0x7f0cbc13f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cc09e3640 1 --2- 172.21.15.5:0/2157427172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cbc09f110 0x7f0cbc13f410 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4007ef0 tx=0x7f0cb400e4b0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cbad9d640 1 -- 172.21.15.5:0/2157427172 reap_dead start 2024-08-18T21:14:22.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cbad9d640 1 -- 172.21.15.5:0/2157427172 reap_dead start 2024-08-18T21:14:22.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cc09e3640 1 -- 172.21.15.5:0/2157427172 shutdown_connections 2024-08-18T21:14:22.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cc09e3640 1 -- 172.21.15.5:0/2157427172 >> 172.21.15.5:0/2157427172 conn(0x7f0cbc0688d0 msgr2=0x7f0cbc0a2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:22.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cc09e3640 1 -- 172.21.15.5:0/2157427172 shutdown_connections 2024-08-18T21:14:22.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.419+0000 7f0cc09e3640 1 -- 172.21.15.5:0/2157427172 wait complete. 2024-08-18T21:14:22.446 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:22.446 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:14:22.446 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:14:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.575+0000 7f8624604640 10 monclient: get_monmap_and_config 2024-08-18T21:14:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.575+0000 7f8624604640 10 monclient: build_initial_monmap 2024-08-18T21:14:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.575+0000 7f8624604640 10 monclient: monmap: 2024-08-18T21:14:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:22.579544+0000 2024-08-18T21:14:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:22.579544+0000 2024-08-18T21:14:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:22.576 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 1 Processor -- start 2024-08-18T21:14:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 1 -- start start 2024-08-18T21:14:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 10 monclient: init 2024-08-18T21:14:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 10 monclient: _add_conns ranks=[2,5,4,3,6,10,9,7,8,1,0] 2024-08-18T21:14:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f861c0a6ce0 0x7f861c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 10 monclient(hunting): picked mon.noname-b con 0x7f861c0a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f861c0a7600 0x7f861c139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 10 monclient(hunting): picked mon.noname-h con 0x7f861c0a7600 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f861c139fe0 0x7f861c13a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 10 monclient(hunting): picked mon.noname-c con 0x7f861c139fe0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:22.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f861c0a5000 con 0x7f861c0a6ce0 2024-08-18T21:14:22.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f861c0a4360 con 0x7f861c139fe0 2024-08-18T21:14:22.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f861c0a45d0 con 0x7f861c0a7600 2024-08-18T21:14:22.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:22.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8624604640 10 monclient(hunting): authenticate will time out at 1629.592929s 2024-08-18T21:14:22.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f861c0a6ce0 0x7f861c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f861c0a6ce0 0x7f861c0a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:56910/0 (socket says 172.21.15.5:56910) 2024-08-18T21:14:22.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 1 -- 172.21.15.5:0/1951217721 learned_addr learned my addr 172.21.15.5:0/1951217721 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:22.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 10 monclient(hunting): get_auth_request con 0x7f861c0a6ce0 auth_method 0 2024-08-18T21:14:22.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8622ba1640 1 --2- 172.21.15.5:0/1951217721 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f861c139fe0 0x7f861c13a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8622ba1640 10 monclient(hunting): get_auth_request con 0x7f861c139fe0 auth_method 0 2024-08-18T21:14:22.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8622ba1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8622ba1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8622ba1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8622ba1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8622ba1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8622ba1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 10 monclient(hunting): handle_auth_done global_id 114815 payload 274 2024-08-18T21:14:22.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 1 -- 172.21.15.5:0/1951217721 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f861c0a7600 msgr2=0x7f861c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:22.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8621b9f640 1 --2- 172.21.15.5:0/1951217721 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f861c0a7600 0x7f861c139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 1 --2- 172.21.15.5:0/1951217721 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f861c0a7600 0x7f861c139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 1 -- 172.21.15.5:0/1951217721 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f861c139fe0 msgr2=0x7f861c13a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:22.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 1 --2- 172.21.15.5:0/1951217721 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f861c139fe0 0x7f861c13a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 10 monclient: _finish_hunting 0 2024-08-18T21:14:22.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 1 monclient: found mon.noname-b 2024-08-18T21:14:22.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:22.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:14:22.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f86223a0640 1 -- 172.21.15.5:0/1951217721 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861c0a32d0 con 0x7f861c0a6ce0 2024-08-18T21:14:22.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8621b9f640 10 monclient: get_auth_request con 0x7f861c0a7600 auth_method 0 2024-08-18T21:14:22.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.579+0000 7f8621b9f640 1 --2- 172.21.15.5:0/1951217721 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f861c0a7600 0x7f861c139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:14:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f86223a0640 1 -- 172.21.15.5:0/1951217721 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f861c0a6ce0 msgr2=0x7f861c0a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f86223a0640 1 --2- 172.21.15.5:0/1951217721 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f861c0a6ce0 0x7f861c0a70c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f86180098d0 tx=0x7f861801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac86248d837db78f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f862139e640 1 -- 172.21.15.5:0/1951217721 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86180b0070 con 0x7f861c0a6ce0 2024-08-18T21:14:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f862139e640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f862139e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:14:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f862139e640 10 monclient: dump: 2024-08-18T21:14:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.591 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f862139e640 10 monclient: _finish_auth 0 2024-08-18T21:14:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f862139e640 10 monclient: _check_auth_tickets 2024-08-18T21:14:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f862139e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f862139e640 1 -- 172.21.15.5:0/1951217721 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86180aa810 con 0x7f861c0a6ce0 2024-08-18T21:14:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 5 monclient: authenticate success, global_id 114815 2024-08-18T21:14:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:14:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f862139e640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 4 set_mon_vals no callback set 2024-08-18T21:14:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f862139e640 1 -- 172.21.15.5:0/1951217721 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86180aae30 con 0x7f861c0a6ce0 2024-08-18T21:14:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f862139e640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f862139e640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:14:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f862139e640 10 monclient: dump: 2024-08-18T21:14:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.593 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 10 monclient: shutdown 2024-08-18T21:14:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 1 -- 172.21.15.5:0/1951217721 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f861c0a6ce0 msgr2=0x7f861c0a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 1 --2- 172.21.15.5:0/1951217721 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f861c0a6ce0 0x7f861c0a70c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f86180098d0 tx=0x7f861801c440 comp rx=0 tx=0).stop 2024-08-18T21:14:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 1 -- 172.21.15.5:0/1951217721 shutdown_connections 2024-08-18T21:14:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 1 --2- 172.21.15.5:0/1951217721 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f861c139fe0 0x7f861c13a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 1 --2- 172.21.15.5:0/1951217721 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f861c0a7600 0x7f861c139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 1 --2- 172.21.15.5:0/1951217721 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f861c0a6ce0 0x7f861c0a70c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 1 -- 172.21.15.5:0/1951217721 >> 172.21.15.5:0/1951217721 conn(0x7f861c0acbc0 msgr2=0x7f861c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 1 -- 172.21.15.5:0/1951217721 shutdown_connections 2024-08-18T21:14:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 1 -- 172.21.15.5:0/1951217721 wait complete. 2024-08-18T21:14:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 10 monclient: build_initial_monmap 2024-08-18T21:14:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 10 monclient: monmap: 2024-08-18T21:14:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:22.595 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 1 Processor -- start 2024-08-18T21:14:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 1 -- start start 2024-08-18T21:14:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.583+0000 7f8624604640 10 monclient: init 2024-08-18T21:14:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 10 monclient: _add_conns ranks=[6,1,4,8,3,2,0,5,7] 2024-08-18T21:14:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f861c0a6ce0 0x7f861c134d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 10 monclient(hunting): picked mon.noname-d con 0x7f861c0a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:14:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f861c0a7600 0x7f861c135280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 10 monclient(hunting): picked mon.noname-f con 0x7f861c0a7600 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:14:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f861c139fe0 0x7f861c13aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 10 monclient(hunting): picked mon.noname-c con 0x7f861c139fe0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f861c0a79e0 con 0x7f861c0a7600 2024-08-18T21:14:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f861c0a8220 con 0x7f861c139fe0 2024-08-18T21:14:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f861c13de40 con 0x7f861c0a6ce0 2024-08-18T21:14:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 10 monclient(hunting): authenticate will time out at 1629.600231s 2024-08-18T21:14:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f861c0a6ce0 0x7f861c134d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f861c0a6ce0 0x7f861c134d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:52538/0 (socket says 172.21.15.5:52538) 2024-08-18T21:14:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 1 -- 172.21.15.5:0/3182672744 learned_addr learned my addr 172.21.15.5:0/3182672744 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 10 monclient(hunting): get_auth_request con 0x7f861c0a6ce0 auth_method 0 2024-08-18T21:14:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8622ba1640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f861c139fe0 0x7f861c13aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8622ba1640 10 monclient(hunting): get_auth_request con 0x7f861c139fe0 auth_method 0 2024-08-18T21:14:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8622ba1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8622ba1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8622ba1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8622ba1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8622ba1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8622ba1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8621b9f640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f861c0a7600 0x7f861c135280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 10 monclient(hunting): handle_auth_done global_id 134160 payload 824 2024-08-18T21:14:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 1 -- 172.21.15.5:0/3182672744 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f861c139fe0 msgr2=0x7f861c13aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f861c139fe0 0x7f861c13aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 1 -- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f861c0a7600 msgr2=0x7f861c135280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f861c0a7600 0x7f861c135280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 10 monclient: _finish_hunting 0 2024-08-18T21:14:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 1 monclient: found mon.noname-d 2024-08-18T21:14:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:14:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 1 -- 172.21.15.5:0/3182672744 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861c13e120 con 0x7f861c0a6ce0 2024-08-18T21:14:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8621b9f640 10 monclient: get_auth_request con 0x7f861c0a7600 auth_method 0 2024-08-18T21:14:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8621b9f640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f861c0a7600 0x7f861c135280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:14:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 1 -- 172.21.15.5:0/3182672744 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f861c0a6ce0 msgr2=0x7f861c134d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f86223a0640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f861c0a6ce0 0x7f861c134d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f86180097c0 tx=0x7f86180191e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8612ffd640 1 -- 172.21.15.5:0/3182672744 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86180ba070 con 0x7f861c0a6ce0 2024-08-18T21:14:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8612ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8612ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:14:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8612ffd640 10 monclient: dump: 2024-08-18T21:14:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.601 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8612ffd640 10 monclient: _finish_auth 0 2024-08-18T21:14:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8612ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:14:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8612ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 5 monclient: authenticate success, global_id 134160 2024-08-18T21:14:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8612ffd640 1 -- 172.21.15.5:0/3182672744 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86180b1040 con 0x7f861c0a6ce0 2024-08-18T21:14:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 10 monclient: _renew_subs 2024-08-18T21:14:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:14:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 1 -- 172.21.15.5:0/3182672744 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861c13e400 con 0x7f861c0a6ce0 2024-08-18T21:14:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 10 monclient: _renew_subs 2024-08-18T21:14:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:14:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8624604640 1 -- 172.21.15.5:0/3182672744 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f861c13cee0 con 0x7f861c0a6ce0 2024-08-18T21:14:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8612ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8612ffd640 1 -- 172.21.15.5:0/3182672744 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86180b0070 con 0x7f861c0a6ce0 2024-08-18T21:14:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8612ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8612ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:14:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8613fff640 4 set_mon_vals no callback set 2024-08-18T21:14:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.587+0000 7f8612ffd640 10 monclient: dump: 2024-08-18T21:14:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.603 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8624604640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8624604640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8604002890 0x7f8604004d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8624604640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8624604640 1 -- 172.21.15.5:0/3182672744 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f8604007cc0 con 0x7f8604002890 2024-08-18T21:14:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8612ffd640 1 -- 172.21.15.5:0/3182672744 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f8618003620 con 0x7f861c0a6ce0 2024-08-18T21:14:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8621b9f640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8604002890 0x7f8604004d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8612ffd640 1 --2- 172.21.15.5:0/3182672744 >> v2:172.21.15.157:6812/631023601 conn(0x7f860003bdf0 0x7f860003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8621b9f640 10 monclient: get_auth_request con 0x7f8604002890 auth_method 0 2024-08-18T21:14:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8621b9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8621b9f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8621b9f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8612ffd640 1 -- 172.21.15.5:0/3182672744 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(295..295 src has 22..295) ==== 3506+0+0 (secure 0 0 0) 0x7f86180e78f0 con 0x7f861c0a6ce0 2024-08-18T21:14:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8621b9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8621b9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8621b9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8622ba1640 1 --2- 172.21.15.5:0/3182672744 >> v2:172.21.15.157:6812/631023601 conn(0x7f860003bdf0 0x7f860003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8621b9f640 10 monclient(hunting): handle_auth_done global_id 134215 payload 824 2024-08-18T21:14:22.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8621b9f640 1 -- 172.21.15.5:0/3182672744 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8604007ec0 con 0x7f8604002890 2024-08-18T21:14:22.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8622ba1640 10 monclient: get_auth_request con 0x7f860003bdf0 auth_method 0 2024-08-18T21:14:22.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8621b9f640 1 -- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8604002890 msgr2=0x7f8604004d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8621b9f640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8604002890 0x7f8604004d30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f861c13c9f0 tx=0x7f860c00db30 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8612ffd640 1 -- 172.21.15.5:0/3182672744 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f860c016070 con 0x7f8604002890 2024-08-18T21:14:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8612ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8612ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:14:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8612ffd640 10 monclient: dump: 2024-08-18T21:14:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.607 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.608 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.591+0000 7f8622ba1640 1 --2- 172.21.15.5:0/3182672744 >> v2:172.21.15.157:6812/631023601 conn(0x7f860003bdf0 0x7f860003e2b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f861c0a2a10 tx=0x7f861400b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.595+0000 7f8612ffd640 1 -- 172.21.15.5:0/3182672744 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f860c00de60 con 0x7f8604002890 2024-08-18T21:14:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.595+0000 7f8612ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.595+0000 7f8612ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.595+0000 7f8612ffd640 1 -- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8604002890 msgr2=0x7f8604004d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.595+0000 7f8612ffd640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8604002890 0x7f8604004d30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f861c13c9f0 tx=0x7f860c00db30 comp rx=0 tx=0).stop 2024-08-18T21:14:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.595+0000 7f8612ffd640 1 -- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8604002890 msgr2=0x7f8604004d30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.595+0000 7f8612ffd640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8604002890 0x7f8604004d30 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f861c13c9f0 tx=0x7f860c00db30 comp rx=0 tx=0).stop 2024-08-18T21:14:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.599+0000 7f8624604640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.599+0000 7f8624604640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8604006ce0 0x7f8604007170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.599+0000 7f8624604640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.599+0000 7f8624604640 1 -- 172.21.15.5:0/3182672744 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f860400a1e0 con 0x7f8604006ce0 2024-08-18T21:14:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.599+0000 7f8621b9f640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8604006ce0 0x7f8604007170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.599+0000 7f8621b9f640 10 monclient: get_auth_request con 0x7f8604006ce0 auth_method 0 2024-08-18T21:14:22.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.599+0000 7f8621b9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.599+0000 7f8621b9f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.599+0000 7f8621b9f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.599+0000 7f8621b9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.599+0000 7f8621b9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.599+0000 7f8621b9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.599+0000 7f8621b9f640 10 monclient(hunting): handle_auth_done global_id 134224 payload 824 2024-08-18T21:14:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.599+0000 7f8621b9f640 1 -- 172.21.15.5:0/3182672744 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f86040076b0 con 0x7f8604006ce0 2024-08-18T21:14:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.603+0000 7f8621b9f640 1 -- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8604006ce0 msgr2=0x7f8604007170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.603+0000 7f8621b9f640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8604006ce0 0x7f8604007170 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f861c13c9f0 tx=0x7f860c0046d0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.603+0000 7f8612ffd640 1 -- 172.21.15.5:0/3182672744 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f860c01cd70 con 0x7f8604006ce0 2024-08-18T21:14:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.603+0000 7f8612ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.603+0000 7f8612ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:14:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.603+0000 7f8612ffd640 10 monclient: dump: 2024-08-18T21:14:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.612 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.612 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.612 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.612 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.603+0000 7f8612ffd640 1 -- 172.21.15.5:0/3182672744 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7f860c012460 con 0x7f8604006ce0 2024-08-18T21:14:22.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.603+0000 7f8612ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:22.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.603+0000 7f8612ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:22.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.603+0000 7f8612ffd640 1 -- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8604006ce0 msgr2=0x7f8604007170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.603+0000 7f8612ffd640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8604006ce0 0x7f8604007170 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f861c13c9f0 tx=0x7f860c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.603+0000 7f8612ffd640 1 -- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8604006ce0 msgr2=0x7f8604007170 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:22.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.603+0000 7f8612ffd640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8604006ce0 0x7f8604007170 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f861c13c9f0 tx=0x7f860c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.613 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:22.613 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:22.613 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:22.613 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:22.613 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:22.613 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 22067, 2024-08-18T21:14:22.613 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:22.613 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:22.613 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:22.613 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:22.613 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:22.613 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:22.614 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:22.614 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:22.614 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:22.614 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:22.614 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.614 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:14:22.614 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:22.614 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:22.614 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:22.614 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:22.614 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:22.614 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:22.614 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:22.615 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:22.615 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:22.615 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:22.615 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:22.615 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:22.615 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:22.615 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:22.615 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.615 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:22.615 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:22.615 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:22.615 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:22.615 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:22.616 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:22.616 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:22.616 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:22.616 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:22.616 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:22.616 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:22.616 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:22.616 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:22.616 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.616 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.616 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:22.616 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:22.616 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:22.617 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:22.617 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:22.617 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:22.617 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:22.617 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:22.617 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:22.617 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:22.617 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:22.617 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:22.617 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:22.617 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:22.617 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:22.617 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:22.618 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:22.618 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:22.618 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:22.618 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:22.618 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:22.618 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:22.618 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:22.618 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:22.618 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:22.618 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:22.618 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:22.618 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:22.618 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.619 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:22.619 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.619 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:22.619 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.619 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:22.619 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:22.619 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.619 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.619 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.619 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.619 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:22.619 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.619 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.619 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.620 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.620 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:22.620 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.620 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.620 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.620 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.620 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:22.620 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:22.620 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.620 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.620 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.620 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.620 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.620 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:22.621 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:22.621 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.621 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.621 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.621 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.621 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:22.621 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.621 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.621 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.621 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:22.621 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.621 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.622 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.622 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:22.622 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:22.622 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.622 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.622 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.622 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.622 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:22.622 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:22.622 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.622 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.623 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.623 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.623 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:22.623 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.623 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.623 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.623 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:22.623 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.623 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.623 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.623 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:22.623 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:22.624 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.624 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.624 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.624 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.624 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.624 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:22.624 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:22.624 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.624 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.624 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.624 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.624 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:22.624 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.625 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.625 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.625 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:22.625 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.625 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.625 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.625 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:22.625 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:22.625 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.625 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.625 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.626 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.626 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:22.626 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:22.626 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.626 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.626 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.626 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.626 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:22.626 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.626 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.626 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.626 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:22.627 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.627 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.627 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.627 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:22.627 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:22.627 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.627 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.627 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.627 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:22.627 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:22.628 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.628 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.628 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.628 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.628 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:22.628 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.628 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.628 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.628 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:22.628 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.628 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.628 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.629 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:22.629 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:22.629 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.629 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.629 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.629 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.629 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:22.629 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:22.629 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.629 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.629 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.630 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.630 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:22.630 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.630 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.630 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.630 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:22.630 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.630 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.630 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.630 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:22.630 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:22.630 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.631 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.631 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.631 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:22.631 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:22.631 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.631 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.631 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.631 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:22.631 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.632 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.632 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:22.632 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.632 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.632 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.632 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:22.632 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:22.632 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.632 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.632 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.633 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:22.633 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:22.633 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:22.633 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:22.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.633 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:22.633 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:22.633 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.633 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:22.633 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:22.633 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:22.634 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.634 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.634 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:22.634 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:22.634 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:22.634 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:22.634 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:22.634 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.634 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.634 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:22.634 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:22.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.635 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:22.635 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:22.635 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:22.635 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.635 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.635 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:14:22.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.635 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:22.635 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:22.635 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:14:22.635 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.635 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:22.636 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:22.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:22.636 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:22.636 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:22.636 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:22.636 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:22.636 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:22.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:22.636 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:22.636 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.603+0000 7f8624604640 1 -- 172.21.15.5:0/3182672744 >> v2:172.21.15.157:6812/631023601 conn(0x7f860003bdf0 msgr2=0x7f860003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.603+0000 7f8624604640 1 --2- 172.21.15.5:0/3182672744 >> v2:172.21.15.157:6812/631023601 conn(0x7f860003bdf0 0x7f860003e2b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f861c0a2a10 tx=0x7f861400b040 comp rx=0 tx=0).stop 2024-08-18T21:14:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.603+0000 7f8624604640 10 monclient: shutdown 2024-08-18T21:14:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.607+0000 7f8624604640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.607+0000 7f8624604640 1 -- 172.21.15.5:0/3182672744 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f861c0a6ce0 msgr2=0x7f861c134d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.607+0000 7f8624604640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f861c0a6ce0 0x7f861c134d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f86180097c0 tx=0x7f86180191e0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.607+0000 7f8622ba1640 1 -- 172.21.15.5:0/3182672744 reap_dead start 2024-08-18T21:14:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.607+0000 7f8624604640 1 -- 172.21.15.5:0/3182672744 shutdown_connections 2024-08-18T21:14:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.607+0000 7f8624604640 1 --2- 172.21.15.5:0/3182672744 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f861c0a6ce0 0x7f861c134d40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.607+0000 7f8624604640 1 -- 172.21.15.5:0/3182672744 >> 172.21.15.5:0/3182672744 conn(0x7f861c0acbc0 msgr2=0x7f861c135c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.607+0000 7f8624604640 1 -- 172.21.15.5:0/3182672744 shutdown_connections 2024-08-18T21:14:22.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.607+0000 7f8624604640 1 -- 172.21.15.5:0/3182672744 wait complete. 2024-08-18T21:14:22.639 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:22.639 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-18T21:14:22.639 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-18T21:14:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 10 monclient: get_monmap_and_config 2024-08-18T21:14:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 10 monclient: build_initial_monmap 2024-08-18T21:14:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 10 monclient: monmap: 2024-08-18T21:14:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:22.762468+0000 2024-08-18T21:14:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:22.762468+0000 2024-08-18T21:14:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:22.759 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:22.759 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:22.759 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:22.759 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:22.759 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:22.759 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:22.759 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:22.759 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 1 Processor -- start 2024-08-18T21:14:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 1 -- start start 2024-08-18T21:14:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 10 monclient: init 2024-08-18T21:14:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 10 monclient: _add_conns ranks=[10,9,3,5,1,7,2,4,0,6,8] 2024-08-18T21:14:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3640a1ff0 0x7fe364137430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 10 monclient(hunting): picked mon.noname-f con 0x7fe3640a1ff0 addr v2:172.21.15.157:3300/0 2024-08-18T21:14:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe364137970 0x7fe364137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 10 monclient(hunting): picked mon.noname-a con 0x7fe364137970 addr v2:172.21.15.5:3300/0 2024-08-18T21:14:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe364133eb0 0x7fe364134340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 10 monclient(hunting): picked mon.noname-g con 0x7fe364133eb0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe36409dd50 con 0x7fe364137970 2024-08-18T21:14:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe3640a23d0 con 0x7fe3640a1ff0 2024-08-18T21:14:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe36409e970 con 0x7fe364133eb0 2024-08-18T21:14:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36be31640 10 monclient(hunting): authenticate will time out at 1629.775541s 2024-08-18T21:14:22.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe3693cc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe364137970 0x7fe364137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe3693cc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe364137970 0x7fe364137dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56468/0 (socket says 172.21.15.5:56468) 2024-08-18T21:14:22.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe3693cc640 1 -- 172.21.15.5:0/677082634 learned_addr learned my addr 172.21.15.5:0/677082634 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:22.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe3693cc640 10 monclient(hunting): get_auth_request con 0x7fe364137970 auth_method 0 2024-08-18T21:14:22.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe3693cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe3693cc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe3693cc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe36a3ce640 1 --2- 172.21.15.5:0/677082634 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe364133eb0 0x7fe364134340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.759+0000 7fe369bcd640 1 --2- 172.21.15.5:0/677082634 >> v2:172.21.15.157:3300/0 conn(0x7fe3640a1ff0 0x7fe364137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe3693cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe3693cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe3693cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe36a3ce640 10 monclient(hunting): get_auth_request con 0x7fe364133eb0 auth_method 0 2024-08-18T21:14:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe36a3ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe36a3ce640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe36a3ce640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe369bcd640 10 monclient(hunting): get_auth_request con 0x7fe3640a1ff0 auth_method 0 2024-08-18T21:14:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe369bcd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe369bcd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe369bcd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe36a3ce640 1 -- 172.21.15.5:0/677082634 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe364133eb0 msgr2=0x7fe364134340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:14:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe36a3ce640 1 -- 172.21.15.5:0/677082634 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe364133eb0 msgr2=0x7fe364134340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe36a3ce640 1 --2- 172.21.15.5:0/677082634 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe364133eb0 0x7fe364134340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe36a3ce640 1 --2- 172.21.15.5:0/677082634 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe364133eb0 0x7fe364134340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:14:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe369bcd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe369bcd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe369bcd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe3693cc640 10 monclient(hunting): handle_auth_done global_id 124587 payload 274 2024-08-18T21:14:22.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe3693cc640 1 -- 172.21.15.5:0/677082634 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe364133eb0 msgr2=0x7fe364134340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:14:22.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe3693cc640 1 --2- 172.21.15.5:0/677082634 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe364133eb0 0x7fe364134340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe3693cc640 1 -- 172.21.15.5:0/677082634 >> v2:172.21.15.157:3300/0 conn(0x7fe3640a1ff0 msgr2=0x7fe364137430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:22.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe3693cc640 1 --2- 172.21.15.5:0/677082634 >> v2:172.21.15.157:3300/0 conn(0x7fe3640a1ff0 0x7fe364137430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe3693cc640 10 monclient: _finish_hunting 0 2024-08-18T21:14:22.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe3693cc640 1 monclient: found mon.noname-a 2024-08-18T21:14:22.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe3693cc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:22.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe3693cc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:14:22.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.763+0000 7fe3693cc640 1 -- 172.21.15.5:0/677082634 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe36409ec50 con 0x7fe364137970 2024-08-18T21:14:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe3693cc640 1 -- 172.21.15.5:0/677082634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe364137970 msgr2=0x7fe364137dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe3693cc640 1 --2- 172.21.15.5:0/677082634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe364137970 0x7fe364137dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe3640a5ef0 tx=0x7fe35401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a86811e1ef45b97 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe368bcb640 1 -- 172.21.15.5:0/677082634 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe3540b0070 con 0x7fe364137970 2024-08-18T21:14:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe368bcb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe368bcb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:14:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe368bcb640 10 monclient: dump: 2024-08-18T21:14:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.773 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe368bcb640 10 monclient: _finish_auth 0 2024-08-18T21:14:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe368bcb640 10 monclient: _check_auth_tickets 2024-08-18T21:14:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe368bcb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe368bcb640 1 -- 172.21.15.5:0/677082634 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3540aa810 con 0x7fe364137970 2024-08-18T21:14:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 5 monclient: authenticate success, global_id 124587 2024-08-18T21:14:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:14:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe368bcb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe368bcb640 1 -- 172.21.15.5:0/677082634 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe3540aae30 con 0x7fe364137970 2024-08-18T21:14:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 4 set_mon_vals no callback set 2024-08-18T21:14:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe368bcb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe368bcb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:14:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe368bcb640 10 monclient: dump: 2024-08-18T21:14:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.775 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 10 monclient: shutdown 2024-08-18T21:14:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 -- 172.21.15.5:0/677082634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe364137970 msgr2=0x7fe364137dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 --2- 172.21.15.5:0/677082634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe364137970 0x7fe364137dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe3640a5ef0 tx=0x7fe35401c3e0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 -- 172.21.15.5:0/677082634 shutdown_connections 2024-08-18T21:14:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 --2- 172.21.15.5:0/677082634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe364137970 0x7fe364137dd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 --2- 172.21.15.5:0/677082634 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe364133eb0 0x7fe364134340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 --2- 172.21.15.5:0/677082634 >> v2:172.21.15.157:3300/0 conn(0x7fe3640a1ff0 0x7fe364137430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 -- 172.21.15.5:0/677082634 >> 172.21.15.5:0/677082634 conn(0x7fe3640a8020 msgr2=0x7fe3640a8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 -- 172.21.15.5:0/677082634 shutdown_connections 2024-08-18T21:14:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 -- 172.21.15.5:0/677082634 wait complete. 2024-08-18T21:14:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 10 monclient: build_initial_monmap 2024-08-18T21:14:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 10 monclient: monmap: 2024-08-18T21:14:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:22.777 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 Processor -- start 2024-08-18T21:14:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 -- start start 2024-08-18T21:14:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 10 monclient: init 2024-08-18T21:14:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 10 monclient: _add_conns ranks=[3,1,2,4,0,7,6,8,5] 2024-08-18T21:14:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3640a1ff0 0x7fe36413d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 10 monclient(hunting): picked mon.noname-g con 0x7fe3640a1ff0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe364133eb0 0x7fe36413dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 10 monclient(hunting): picked mon.noname-f con 0x7fe364133eb0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:14:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe364137970 0x7fe3640721b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 10 monclient(hunting): picked mon.noname-b con 0x7fe364137970 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe3641411f0 con 0x7fe364133eb0 2024-08-18T21:14:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fe3640a1e00 con 0x7fe364137970 2024-08-18T21:14:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe364141370 con 0x7fe3640a1ff0 2024-08-18T21:14:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36be31640 10 monclient(hunting): authenticate will time out at 1629.783219s 2024-08-18T21:14:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe364137970 0x7fe3640721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe364137970 0x7fe3640721b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:56916/0 (socket says 172.21.15.5:56916) 2024-08-18T21:14:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 1 -- 172.21.15.5:0/82044933 learned_addr learned my addr 172.21.15.5:0/82044933 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 10 monclient(hunting): get_auth_request con 0x7fe364137970 auth_method 0 2024-08-18T21:14:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe369bcd640 1 --2- 172.21.15.5:0/82044933 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3640a1ff0 0x7fe36413d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe3693cc640 1 --2- 172.21.15.5:0/82044933 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe364133eb0 0x7fe36413dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe369bcd640 10 monclient(hunting): get_auth_request con 0x7fe3640a1ff0 auth_method 0 2024-08-18T21:14:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe369bcd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe369bcd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe369bcd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe3693cc640 10 monclient(hunting): get_auth_request con 0x7fe364133eb0 auth_method 0 2024-08-18T21:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe3693cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe3693cc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe3693cc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe369bcd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe369bcd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe369bcd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe3693cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe3693cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe3693cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 10 monclient(hunting): handle_auth_done global_id 114824 payload 824 2024-08-18T21:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 1 -- 172.21.15.5:0/82044933 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3640a1ff0 msgr2=0x7fe36413d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 1 --2- 172.21.15.5:0/82044933 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3640a1ff0 0x7fe36413d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 1 -- 172.21.15.5:0/82044933 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe364133eb0 msgr2=0x7fe36413dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 1 --2- 172.21.15.5:0/82044933 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe364133eb0 0x7fe36413dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 10 monclient: _finish_hunting 0 2024-08-18T21:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 1 monclient: found mon.noname-b 2024-08-18T21:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.767+0000 7fe36a3ce640 1 -- 172.21.15.5:0/82044933 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe364138a10 con 0x7fe364137970 2024-08-18T21:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe36a3ce640 1 -- 172.21.15.5:0/82044933 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe364137970 msgr2=0x7fe3640721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe36a3ce640 1 --2- 172.21.15.5:0/82044933 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe364137970 0x7fe3640721b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe35c007e30 tx=0x7fe35c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35a7fc640 1 -- 172.21.15.5:0/82044933 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe35c014890 con 0x7fe364137970 2024-08-18T21:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35a7fc640 10 monclient: dump: 2024-08-18T21:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35a7fc640 10 monclient: _finish_auth 0 2024-08-18T21:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35a7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35a7fc640 1 -- 172.21.15.5:0/82044933 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe35c019070 con 0x7fe364137970 2024-08-18T21:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe36be31640 5 monclient: authenticate success, global_id 114824 2024-08-18T21:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe36be31640 10 monclient: _renew_subs 2024-08-18T21:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe36be31640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe36be31640 1 -- 172.21.15.5:0/82044933 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3640a8860 con 0x7fe364137970 2024-08-18T21:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35a7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35a7fc640 1 -- 172.21.15.5:0/82044933 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe35c013380 con 0x7fe364137970 2024-08-18T21:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:22.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:14:22.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35a7fc640 10 monclient: dump: 2024-08-18T21:14:22.784 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:22.784 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:22.784 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.784 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:22.784 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:22.784 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:22.784 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:22.784 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:22.784 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:22.785 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:22.785 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:22.785 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:22.785 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:22.785 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:22.785 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:22.785 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:22.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe36be31640 10 monclient: _renew_subs 2024-08-18T21:14:22.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe36be31640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:14:22.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe36be31640 1 -- 172.21.15.5:0/82044933 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe364138ed0 con 0x7fe364137970 2024-08-18T21:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35bfff640 4 set_mon_vals no callback set 2024-08-18T21:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe36be31640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe36be31640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe36be31640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe36be31640 1 -- 172.21.15.5:0/82044933 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe364134340 con 0x7fe364137970 2024-08-18T21:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35a7fc640 1 -- 172.21.15.5:0/82044933 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe35c014420 con 0x7fe364137970 2024-08-18T21:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35a7fc640 1 --2- 172.21.15.5:0/82044933 >> v2:172.21.15.157:6812/631023601 conn(0x7fe34803bdc0 0x7fe34803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.771+0000 7fe35a7fc640 1 -- 172.21.15.5:0/82044933 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(295..295 src has 22..295) ==== 3506+0+0 (secure 0 0 0) 0x7fe35c04ebf0 con 0x7fe364137970 2024-08-18T21:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.775+0000 7fe369bcd640 1 --2- 172.21.15.5:0/82044933 >> v2:172.21.15.157:6812/631023601 conn(0x7fe34803bdc0 0x7fe34803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.775+0000 7fe369bcd640 10 monclient: get_auth_request con 0x7fe34803bdc0 auth_method 0 2024-08-18T21:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.775+0000 7fe369bcd640 1 --2- 172.21.15.5:0/82044933 >> v2:172.21.15.157:6812/631023601 conn(0x7fe34803bdc0 0x7fe34803e280 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe360009b60 tx=0x7fe360009190 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.779+0000 7fe35a7fc640 1 -- 172.21.15.5:0/82044933 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fe35c0135a0 con 0x7fe364137970 2024-08-18T21:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.779+0000 7fe35a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:22.779+0000 7fe35a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:23.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.027+0000 7fe36be31640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-18T21:14:23.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.027+0000 7fe36be31640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-18T21:14:23.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.031+0000 7fe36be31640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:14:23.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.031+0000 7fe36be31640 1 -- 172.21.15.5:0/82044933 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fe36413e1c0 con 0x7fe364137970 2024-08-18T21:14:23.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fe35a7fc640 1 -- 172.21.15.5:0/82044933 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fe35c014a50 con 0x7fe364137970 2024-08-18T21:14:23.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fe35a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-18T21:14:23.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=23,config=2,health=11,kv=9,logm=55} crc {auth=2188254704,config=1618278320,health=827448758,kv=672252078,logm=2335673841}) 2024-08-18T21:14:23.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fe35a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:23.035 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=23,config=2,health=12,kv=10,logm=53} crc {auth=2872910046,config=1618278320,health=563955227,kv=3664197221,logm=2509082096}) 2024-08-18T21:14:23.035 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.036 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=23,config=2,health=11,kv=9,logm=55} crc {auth=2188254704,config=1618278320,health=827448758,kv=672252078,logm=2335673841}) 2024-08-18T21:14:23.036 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=20,config=1,health=12,kv=9,logm=58} crc {auth=3811187995,config=1228700967,health=563955227,kv=2071443739,logm=180319122}) 2024-08-18T21:14:23.036 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.036 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=23,config=2,health=11,kv=9,logm=55} crc {auth=2188254704,config=1618278320,health=827448758,kv=672252078,logm=2335673841}) 2024-08-18T21:14:23.036 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=24,config=2,health=12,kv=10,logm=52} crc {auth=797069872,config=1618278320,health=563955227,kv=3664197221,logm=4198094884}) 2024-08-18T21:14:23.036 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.036 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=23,config=2,health=11,kv=9,logm=55} crc {auth=2188254704,config=1618278320,health=827448758,kv=672252078,logm=2335673841}) 2024-08-18T21:14:23.036 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=24,config=2,health=12,kv=10,logm=52} crc {auth=797069872,config=1618278320,health=563955227,kv=3664197221,logm=2834922404}) 2024-08-18T21:14:23.036 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.036 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=23,config=2,health=11,kv=9,logm=55} crc {auth=2188254704,config=1618278320,health=827448758,kv=672252078,logm=2335673841}) 2024-08-18T21:14:23.036 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=20,config=2,health=12,kv=10,logm=56} crc {auth=1797276065,config=1618278320,health=563955227,kv=9163099,logm=851076091}) 2024-08-18T21:14:23.036 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.036 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=23,config=2,health=11,kv=9,logm=55} crc {auth=2188254704,config=1618278320,health=827448758,kv=672252078,logm=2335673841}) 2024-08-18T21:14:23.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=24,config=2,health=11,kv=10,logm=53} crc {auth=797069872,config=1618278320,health=2457931571,kv=3664197221,logm=769145071}) 2024-08-18T21:14:23.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=23,config=2,health=11,kv=9,logm=55} crc {auth=2188254704,config=1618278320,health=827448758,kv=672252078,logm=2335673841}) 2024-08-18T21:14:23.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=1,health=12,kv=10,logm=54} crc {auth=3686846325,config=2457401934,health=563955227,kv=3664197221,logm=3809112029}) 2024-08-18T21:14:23.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=23,config=2,health=11,kv=9,logm=55} crc {auth=2188254704,config=1618278320,health=827448758,kv=672252078,logm=2335673841}) 2024-08-18T21:14:23.037 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.035+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=23,config=2,health=12,kv=10,logm=53} crc {auth=1372030246,config=1618278320,health=563955227,kv=9163099,logm=433868704}) 2024-08-18T21:14:23.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fe36be31640 1 -- 172.21.15.5:0/82044933 >> v2:172.21.15.157:6812/631023601 conn(0x7fe34803bdc0 msgr2=0x7fe34803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:23.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fe36be31640 1 --2- 172.21.15.5:0/82044933 >> v2:172.21.15.157:6812/631023601 conn(0x7fe34803bdc0 0x7fe34803e280 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe360009b60 tx=0x7fe360009190 comp rx=0 tx=0).stop 2024-08-18T21:14:23.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fe36be31640 10 monclient: shutdown 2024-08-18T21:14:23.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fe36be31640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:23.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fe36be31640 1 -- 172.21.15.5:0/82044933 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe364137970 msgr2=0x7fe3640721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:23.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fe36be31640 1 --2- 172.21.15.5:0/82044933 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe364137970 0x7fe3640721b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe35c007e30 tx=0x7fe35c00e4b0 comp rx=0 tx=0).stop 2024-08-18T21:14:23.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fe36be31640 1 -- 172.21.15.5:0/82044933 shutdown_connections 2024-08-18T21:14:23.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fe36be31640 1 --2- 172.21.15.5:0/82044933 >> v2:172.21.15.157:6812/631023601 conn(0x7fe34803bdc0 0x7fe34803e280 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:23.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fe36be31640 1 --2- 172.21.15.5:0/82044933 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fe364137970 0x7fe3640721b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:23.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fe36be31640 1 --2- 172.21.15.5:0/82044933 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe364133eb0 0x7fe36413dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:23.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fe36be31640 1 --2- 172.21.15.5:0/82044933 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3640a1ff0 0x7fe36413d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:23.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fe36be31640 1 -- 172.21.15.5:0/82044933 >> 172.21.15.5:0/82044933 conn(0x7fe3640a8020 msgr2=0x7fe364131e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:23.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fe36be31640 1 -- 172.21.15.5:0/82044933 shutdown_connections 2024-08-18T21:14:23.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fe36be31640 1 -- 172.21.15.5:0/82044933 wait complete. 2024-08-18T21:14:23.041 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.042 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365570644}) 2024-08-18T21:14:23.042 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1503135324}) 2024-08-18T21:14:23.042 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.042 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365570644}) 2024-08-18T21:14:23.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3185825618}) 2024-08-18T21:14:23.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365570644}) 2024-08-18T21:14:23.043 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2507185563}) 2024-08-18T21:14:23.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365570644}) 2024-08-18T21:14:23.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2613233321}) 2024-08-18T21:14:23.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365570644}) 2024-08-18T21:14:23.044 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=220367128}) 2024-08-18T21:14:23.045 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.045 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365570644}) 2024-08-18T21:14:23.045 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1795396302}) 2024-08-18T21:14:23.045 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.045 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365570644}) 2024-08-18T21:14:23.048 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3492211318}) 2024-08-18T21:14:23.048 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.048 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365570644}) 2024-08-18T21:14:23.048 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1802129204}) 2024-08-18T21:14:23.048 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2520448939}) 2024-08-18T21:14:23.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2019804350}) 2024-08-18T21:14:23.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2520448939}) 2024-08-18T21:14:23.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2655965597}) 2024-08-18T21:14:23.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2520448939}) 2024-08-18T21:14:23.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1694885715}) 2024-08-18T21:14:23.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2520448939}) 2024-08-18T21:14:23.049 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=163018734}) 2024-08-18T21:14:23.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2520448939}) 2024-08-18T21:14:23.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2466679177}) 2024-08-18T21:14:23.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2520448939}) 2024-08-18T21:14:23.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2114847011}) 2024-08-18T21:14:23.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2520448939}) 2024-08-18T21:14:23.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=397784045}) 2024-08-18T21:14:23.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.050 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2520448939}) 2024-08-18T21:14:23.051 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=817412280}) 2024-08-18T21:14:23.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=843074922}) 2024-08-18T21:14:23.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1662113924}) 2024-08-18T21:14:23.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.054 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=843074922}) 2024-08-18T21:14:23.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1224146768}) 2024-08-18T21:14:23.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=843074922}) 2024-08-18T21:14:23.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2835679177}) 2024-08-18T21:14:23.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=843074922}) 2024-08-18T21:14:23.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3307663370}) 2024-08-18T21:14:23.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=843074922}) 2024-08-18T21:14:23.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1792560716}) 2024-08-18T21:14:23.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=843074922}) 2024-08-18T21:14:23.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1450204004}) 2024-08-18T21:14:23.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=843074922}) 2024-08-18T21:14:23.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1921313083}) 2024-08-18T21:14:23.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=843074922}) 2024-08-18T21:14:23.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.055+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2253305627}) 2024-08-18T21:14:23.064 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-18T21:14:23.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1102248056}) 2024-08-18T21:14:23.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=442177362}) 2024-08-18T21:14:23.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.069 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1102248056}) 2024-08-18T21:14:23.069 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3615152770}) 2024-08-18T21:14:23.070 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.070 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1102248056}) 2024-08-18T21:14:23.071 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4260668745}) 2024-08-18T21:14:23.071 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.071 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1102248056}) 2024-08-18T21:14:23.071 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=359432381}) 2024-08-18T21:14:23.071 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.071 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1102248056}) 2024-08-18T21:14:23.071 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=424054588}) 2024-08-18T21:14:23.071 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.071 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1102248056}) 2024-08-18T21:14:23.071 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1981195284}) 2024-08-18T21:14:23.071 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.071 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1102248056}) 2024-08-18T21:14:23.071 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3466469109}) 2024-08-18T21:14:23.071 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.072 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1102248056}) 2024-08-18T21:14:23.072 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.071+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1389931156}) 2024-08-18T21:14:23.264 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:14:23.264 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32288]: starting. 2024-08-18T21:14:23.264 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32288]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-32253 2024-08-18T21:14:23.264 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32288]: created object 0... 2024-08-18T21:14:23.264 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32288]: created object 25... 2024-08-18T21:14:23.264 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32288]: created object 49... 2024-08-18T21:14:23.264 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32288]: finishing. 2024-08-18T21:14:23.265 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32288]: shutting down. 2024-08-18T21:14:23.332 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:14:23.332 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32290]: starting. 2024-08-18T21:14:23.332 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32290]: listing objects. 2024-08-18T21:14:23.332 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32290]: listed object 0... 2024-08-18T21:14:23.332 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32290]: listed object 25... 2024-08-18T21:14:23.332 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32290]: saw 50 objects 2024-08-18T21:14:23.332 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32290]: shutting down. 2024-08-18T21:14:23.404 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.404 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=552866019}) 2024-08-18T21:14:23.404 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1400201402}) 2024-08-18T21:14:23.404 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.404 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=552866019}) 2024-08-18T21:14:23.404 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1790492751}) 2024-08-18T21:14:23.404 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.404 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=552866019}) 2024-08-18T21:14:23.405 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3891330118}) 2024-08-18T21:14:23.405 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.405 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=552866019}) 2024-08-18T21:14:23.405 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2160613087}) 2024-08-18T21:14:23.405 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.405 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=552866019}) 2024-08-18T21:14:23.405 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3934569585}) 2024-08-18T21:14:23.405 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.405 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=552866019}) 2024-08-18T21:14:23.405 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=865741106}) 2024-08-18T21:14:23.405 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.405 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=552866019}) 2024-08-18T21:14:23.405 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2925488795}) 2024-08-18T21:14:23.406 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.406 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=552866019}) 2024-08-18T21:14:23.406 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.403+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=800093783}) 2024-08-18T21:14:23.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563598647}) 2024-08-18T21:14:23.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2646185787}) 2024-08-18T21:14:23.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563598647}) 2024-08-18T21:14:23.851 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=150965102}) 2024-08-18T21:14:23.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563598647}) 2024-08-18T21:14:23.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1269559135}) 2024-08-18T21:14:23.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563598647}) 2024-08-18T21:14:23.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2561347269}) 2024-08-18T21:14:23.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563598647}) 2024-08-18T21:14:23.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1301241790}) 2024-08-18T21:14:23.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563598647}) 2024-08-18T21:14:23.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4059133744}) 2024-08-18T21:14:23.852 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.853 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563598647}) 2024-08-18T21:14:23.853 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1836006999}) 2024-08-18T21:14:23.853 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.853 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563598647}) 2024-08-18T21:14:23.853 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.851+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1561202822}) 2024-08-18T21:14:23.855 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.855 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=584635429}) 2024-08-18T21:14:23.855 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2482561565}) 2024-08-18T21:14:23.855 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.855 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=584635429}) 2024-08-18T21:14:23.855 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2129215933}) 2024-08-18T21:14:23.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=584635429}) 2024-08-18T21:14:23.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=954209317}) 2024-08-18T21:14:23.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=584635429}) 2024-08-18T21:14:23.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2259310930}) 2024-08-18T21:14:23.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=584635429}) 2024-08-18T21:14:23.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=423382671}) 2024-08-18T21:14:23.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=584635429}) 2024-08-18T21:14:23.856 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3806570375}) 2024-08-18T21:14:23.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=584635429}) 2024-08-18T21:14:23.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3191838964}) 2024-08-18T21:14:23.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=584635429}) 2024-08-18T21:14:23.858 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.855+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2144290008}) 2024-08-18T21:14:23.860 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.860 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3137376420}) 2024-08-18T21:14:23.860 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1785422126}) 2024-08-18T21:14:23.860 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.860 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3137376420}) 2024-08-18T21:14:23.861 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2909949648}) 2024-08-18T21:14:23.861 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.861 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3137376420}) 2024-08-18T21:14:23.861 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=592639573}) 2024-08-18T21:14:23.861 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.861 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3137376420}) 2024-08-18T21:14:23.861 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1409625268}) 2024-08-18T21:14:23.861 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.861 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3137376420}) 2024-08-18T21:14:23.861 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=186398704}) 2024-08-18T21:14:23.861 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.862 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3137376420}) 2024-08-18T21:14:23.862 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1279138421}) 2024-08-18T21:14:23.862 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.862 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3137376420}) 2024-08-18T21:14:23.862 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1579369601}) 2024-08-18T21:14:23.862 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.862 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3137376420}) 2024-08-18T21:14:23.862 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.859+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=932742906}) 2024-08-18T21:14:23.865 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.865 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192766499}) 2024-08-18T21:14:23.865 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=158061363}) 2024-08-18T21:14:23.865 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.865 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192766499}) 2024-08-18T21:14:23.866 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=304259922}) 2024-08-18T21:14:23.866 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.866 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192766499}) 2024-08-18T21:14:23.866 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4165872066}) 2024-08-18T21:14:23.866 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.866 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192766499}) 2024-08-18T21:14:23.866 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3940341504}) 2024-08-18T21:14:23.866 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.867 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192766499}) 2024-08-18T21:14:23.867 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1851950447}) 2024-08-18T21:14:23.867 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.867 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192766499}) 2024-08-18T21:14:23.867 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1734833369}) 2024-08-18T21:14:23.867 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.867 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192766499}) 2024-08-18T21:14:23.867 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4124503135}) 2024-08-18T21:14:23.868 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.868 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192766499}) 2024-08-18T21:14:23.868 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.863+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=578095969}) 2024-08-18T21:14:23.870 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.870 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3824774326}) 2024-08-18T21:14:23.871 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1469363823}) 2024-08-18T21:14:23.871 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.871 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3824774326}) 2024-08-18T21:14:23.871 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2498525897}) 2024-08-18T21:14:23.871 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.871 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3824774326}) 2024-08-18T21:14:23.871 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2639519579}) 2024-08-18T21:14:23.871 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.872 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3824774326}) 2024-08-18T21:14:23.872 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3988043014}) 2024-08-18T21:14:23.872 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.872 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3824774326}) 2024-08-18T21:14:23.872 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=58605083}) 2024-08-18T21:14:23.872 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.872 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3824774326}) 2024-08-18T21:14:23.872 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2659008842}) 2024-08-18T21:14:23.872 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.872 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3824774326}) 2024-08-18T21:14:23.872 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3786516260}) 2024-08-18T21:14:23.872 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.872 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3824774326}) 2024-08-18T21:14:23.873 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.867+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4291574690}) 2024-08-18T21:14:23.889 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.887+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.889 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737704130}) 2024-08-18T21:14:23.889 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=944538830}) 2024-08-18T21:14:23.889 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.889 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737704130}) 2024-08-18T21:14:23.889 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=473798745}) 2024-08-18T21:14:23.889 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.889 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737704130}) 2024-08-18T21:14:23.890 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4208299744}) 2024-08-18T21:14:23.890 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.890 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737704130}) 2024-08-18T21:14:23.890 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1824213920}) 2024-08-18T21:14:23.890 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.890 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737704130}) 2024-08-18T21:14:23.890 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3785886130}) 2024-08-18T21:14:23.891 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.891 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737704130}) 2024-08-18T21:14:23.891 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3026088365}) 2024-08-18T21:14:23.891 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.892 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737704130}) 2024-08-18T21:14:23.892 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3646172650}) 2024-08-18T21:14:23.892 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.892 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3737704130}) 2024-08-18T21:14:23.892 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.891+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2426407313}) 2024-08-18T21:14:23.922 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471045576}) 2024-08-18T21:14:23.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2163037870}) 2024-08-18T21:14:23.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471045576}) 2024-08-18T21:14:23.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=378038518}) 2024-08-18T21:14:23.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471045576}) 2024-08-18T21:14:23.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=436529965}) 2024-08-18T21:14:23.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471045576}) 2024-08-18T21:14:23.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4224275114}) 2024-08-18T21:14:23.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471045576}) 2024-08-18T21:14:23.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1086623785}) 2024-08-18T21:14:23.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471045576}) 2024-08-18T21:14:23.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1476404121}) 2024-08-18T21:14:23.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471045576}) 2024-08-18T21:14:23.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1654615383}) 2024-08-18T21:14:23.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:23.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471045576}) 2024-08-18T21:14:23.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:23.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=154872216}) 2024-08-18T21:14:24.062 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.062 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1130631907}) 2024-08-18T21:14:24.062 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1364831081}) 2024-08-18T21:14:24.062 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.062 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1130631907}) 2024-08-18T21:14:24.062 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3606062360}) 2024-08-18T21:14:24.062 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.062 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1130631907}) 2024-08-18T21:14:24.062 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2738177674}) 2024-08-18T21:14:24.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1130631907}) 2024-08-18T21:14:24.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3078344151}) 2024-08-18T21:14:24.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1130631907}) 2024-08-18T21:14:24.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1865237190}) 2024-08-18T21:14:24.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1130631907}) 2024-08-18T21:14:24.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2637878764}) 2024-08-18T21:14:24.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1130631907}) 2024-08-18T21:14:24.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4059791456}) 2024-08-18T21:14:24.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.064 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1130631907}) 2024-08-18T21:14:24.064 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.063+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1639402805}) 2024-08-18T21:14:24.065 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:14:24.065 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:14:24.073 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2291767459}) 2024-08-18T21:14:24.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=882158874}) 2024-08-18T21:14:24.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2291767459}) 2024-08-18T21:14:24.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4273871604}) 2024-08-18T21:14:24.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2291767459}) 2024-08-18T21:14:24.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1424632932}) 2024-08-18T21:14:24.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2291767459}) 2024-08-18T21:14:24.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2244865057}) 2024-08-18T21:14:24.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2291767459}) 2024-08-18T21:14:24.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3978703386}) 2024-08-18T21:14:24.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2291767459}) 2024-08-18T21:14:24.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1919728713}) 2024-08-18T21:14:24.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2291767459}) 2024-08-18T21:14:24.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1143762672}) 2024-08-18T21:14:24.077 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.077 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2291767459}) 2024-08-18T21:14:24.077 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.075+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3130395010}) 2024-08-18T21:14:24.089 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:14:24.089 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32289]: starting. 2024-08-18T21:14:24.089 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32289]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-32253 2024-08-18T21:14:24.089 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32289]: shutting down. 2024-08-18T21:14:24.094 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:14:24.094 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:14:24.094 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:14:24.097 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:14:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 10 monclient: get_monmap_and_config 2024-08-18T21:14:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 10 monclient: build_initial_monmap 2024-08-18T21:14:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 10 monclient: monmap: 2024-08-18T21:14:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:24.205373+0000 2024-08-18T21:14:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:24.205373+0000 2024-08-18T21:14:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:24.202 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 1 Processor -- start 2024-08-18T21:14:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 1 -- start start 2024-08-18T21:14:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 10 monclient: init 2024-08-18T21:14:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 10 monclient: _add_conns ranks=[7,10,3,2,0,8,9,5,6,4,1] 2024-08-18T21:14:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc0200a6bd0 0x7fc0200a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 10 monclient(hunting): picked mon.noname-i con 0x7fc0200a6bd0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc02009f080 0x7fc0200a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 10 monclient(hunting): picked mon.noname-f con 0x7fc02009f080 addr v2:172.21.15.157:3300/0 2024-08-18T21:14:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc020139990 0x7fc020139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 10 monclient(hunting): picked mon.noname-g con 0x7fc020139990 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc02009e4c0 con 0x7fc02009f080 2024-08-18T21:14:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc02006f930 con 0x7fc020139990 2024-08-18T21:14:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fc0200a7a30 con 0x7fc0200a6bd0 2024-08-18T21:14:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc025db0640 10 monclient(hunting): authenticate will time out at 1631.219198s 2024-08-18T21:14:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc020139990 0x7fc020139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc016ffd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc02009f080 0x7fc0200a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01f7fe640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc0200a6bd0 0x7fc0200a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc020139990 0x7fc020139e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:37820/0 (socket says 172.21.15.5:37820) 2024-08-18T21:14:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc016ffd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc02009f080 0x7fc0200a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:33042/0 (socket says 172.21.15.5:33042) 2024-08-18T21:14:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01f7fe640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc0200a6bd0 0x7fc0200a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:37944/0 (socket says 172.21.15.5:37944) 2024-08-18T21:14:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 1 -- 172.21.15.5:0/2594599384 learned_addr learned my addr 172.21.15.5:0/2594599384 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 10 monclient(hunting): get_auth_request con 0x7fc020139990 auth_method 0 2024-08-18T21:14:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc016ffd640 10 monclient(hunting): get_auth_request con 0x7fc02009f080 auth_method 0 2024-08-18T21:14:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc016ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc016ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc016ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01f7fe640 10 monclient(hunting): get_auth_request con 0x7fc0200a6bd0 auth_method 0 2024-08-18T21:14:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc016ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc016ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc016ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 10 monclient(hunting): handle_auth_done global_id 134202 payload 274 2024-08-18T21:14:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 1 -- 172.21.15.5:0/2594599384 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc0200a6bd0 msgr2=0x7fc0200a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 1 --2- 172.21.15.5:0/2594599384 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc0200a6bd0 0x7fc0200a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 1 -- 172.21.15.5:0/2594599384 >> v2:172.21.15.157:3300/0 conn(0x7fc02009f080 msgr2=0x7fc0200a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 1 --2- 172.21.15.5:0/2594599384 >> v2:172.21.15.157:3300/0 conn(0x7fc02009f080 0x7fc0200a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 10 monclient: _finish_hunting 0 2024-08-18T21:14:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 1 monclient: found mon.noname-g 2024-08-18T21:14:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:14:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.203+0000 7fc01ffff640 1 -- 172.21.15.5:0/2594599384 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0200a7fb0 con 0x7fc020139990 2024-08-18T21:14:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01ffff640 1 -- 172.21.15.5:0/2594599384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc020139990 msgr2=0x7fc020139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01ffff640 1 --2- 172.21.15.5:0/2594599384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc020139990 0x7fc020139e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc018009e50 tx=0x7fc01801c8f0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=4bec676beb437db2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01effd640 1 -- 172.21.15.5:0/2594599384 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc0180090d0 con 0x7fc020139990 2024-08-18T21:14:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01effd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:14:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01effd640 10 monclient: dump: 2024-08-18T21:14:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:24.216 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01effd640 10 monclient: _finish_auth 0 2024-08-18T21:14:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01effd640 10 monclient: _check_auth_tickets 2024-08-18T21:14:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01effd640 1 -- 172.21.15.5:0/2594599384 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0180a5a90 con 0x7fc020139990 2024-08-18T21:14:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01effd640 1 -- 172.21.15.5:0/2594599384 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc0180a5c40 con 0x7fc020139990 2024-08-18T21:14:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 5 monclient: authenticate success, global_id 134202 2024-08-18T21:14:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 4 set_mon_vals no callback set 2024-08-18T21:14:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:14:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01effd640 10 monclient: dump: 2024-08-18T21:14:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:24.218 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 10 monclient: shutdown 2024-08-18T21:14:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 -- 172.21.15.5:0/2594599384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc020139990 msgr2=0x7fc020139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 --2- 172.21.15.5:0/2594599384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc020139990 0x7fc020139e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc018009e50 tx=0x7fc01801c8f0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 -- 172.21.15.5:0/2594599384 shutdown_connections 2024-08-18T21:14:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 --2- 172.21.15.5:0/2594599384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc020139990 0x7fc020139e10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 --2- 172.21.15.5:0/2594599384 >> v2:172.21.15.157:3300/0 conn(0x7fc02009f080 0x7fc0200a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 --2- 172.21.15.5:0/2594599384 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc0200a6bd0 0x7fc0200a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 -- 172.21.15.5:0/2594599384 >> 172.21.15.5:0/2594599384 conn(0x7fc020068700 msgr2=0x7fc020068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 -- 172.21.15.5:0/2594599384 shutdown_connections 2024-08-18T21:14:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 -- 172.21.15.5:0/2594599384 wait complete. 2024-08-18T21:14:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 10 monclient: build_initial_monmap 2024-08-18T21:14:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 10 monclient: monmap: 2024-08-18T21:14:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:24.220 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 Processor -- start 2024-08-18T21:14:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 -- start start 2024-08-18T21:14:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 10 monclient: init 2024-08-18T21:14:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 10 monclient: _add_conns ranks=[1,2,7,8,5,0,3,6,4] 2024-08-18T21:14:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc02009f080 0x7fc020138100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 10 monclient(hunting): picked mon.noname-f con 0x7fc02009f080 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:14:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc0200a6bd0 0x7fc020138640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 10 monclient(hunting): picked mon.noname-b con 0x7fc0200a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc020139990 0x7fc02013d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 10 monclient(hunting): picked mon.noname-i con 0x7fc020139990 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc0200a89f0 con 0x7fc02009f080 2024-08-18T21:14:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fc0200a7ce0 con 0x7fc0200a6bd0 2024-08-18T21:14:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fc020143610 con 0x7fc020139990 2024-08-18T21:14:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc025db0640 10 monclient(hunting): authenticate will time out at 1631.227365s 2024-08-18T21:14:24.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc016ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc0200a6bd0 0x7fc020138640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc016ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc0200a6bd0 0x7fc020138640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:48406/0 (socket says 172.21.15.5:48406) 2024-08-18T21:14:24.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc016ffd640 1 -- 172.21.15.5:0/4205420491 learned_addr learned my addr 172.21.15.5:0/4205420491 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:24.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc016ffd640 10 monclient(hunting): get_auth_request con 0x7fc0200a6bd0 auth_method 0 2024-08-18T21:14:24.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc016ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc016ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc016ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc016ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:24.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc016ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:24.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc016ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:24.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01ffff640 1 --2- 172.21.15.5:0/4205420491 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc020139990 0x7fc02013d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01f7fe640 1 --2- 172.21.15.5:0/4205420491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc02009f080 0x7fc020138100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01ffff640 10 monclient(hunting): get_auth_request con 0x7fc020139990 auth_method 0 2024-08-18T21:14:24.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01f7fe640 10 monclient(hunting): get_auth_request con 0x7fc02009f080 auth_method 0 2024-08-18T21:14:24.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:24.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.211+0000 7fc01ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:24.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc01ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:24.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc016ffd640 10 monclient(hunting): handle_auth_done global_id 114842 payload 824 2024-08-18T21:14:24.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc016ffd640 1 -- 172.21.15.5:0/4205420491 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc020139990 msgr2=0x7fc02013d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc016ffd640 1 --2- 172.21.15.5:0/4205420491 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc020139990 0x7fc02013d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc016ffd640 1 -- 172.21.15.5:0/4205420491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc02009f080 msgr2=0x7fc020138100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc016ffd640 1 --2- 172.21.15.5:0/4205420491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc02009f080 0x7fc020138100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc016ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:14:24.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc016ffd640 1 monclient: found mon.noname-b 2024-08-18T21:14:24.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc016ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:24.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc016ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:14:24.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc016ffd640 1 -- 172.21.15.5:0/4205420491 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02013fa30 con 0x7fc0200a6bd0 2024-08-18T21:14:24.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc016ffd640 1 -- 172.21.15.5:0/4205420491 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc0200a6bd0 msgr2=0x7fc020138640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:24.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc016ffd640 1 --2- 172.21.15.5:0/4205420491 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc0200a6bd0 0x7fc020138640 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc00800e960 tx=0x7fc00800ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:24.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc01cff9640 1 -- 172.21.15.5:0/4205420491 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc008017070 con 0x7fc0200a6bd0 2024-08-18T21:14:24.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc01cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:24.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc01cff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:14:24.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc01cff9640 10 monclient: dump: 2024-08-18T21:14:24.224 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:24.225 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.225 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.225 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.225 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:24.225 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.225 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:24.225 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:24.225 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:24.225 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:24.225 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:24.225 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:24.225 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:24.225 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:24.225 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:24.226 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc01cff9640 10 monclient: _finish_auth 0 2024-08-18T21:14:24.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc01cff9640 10 monclient: _check_auth_tickets 2024-08-18T21:14:24.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc01cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:24.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc01cff9640 1 -- 172.21.15.5:0/4205420491 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc008013470 con 0x7fc0200a6bd0 2024-08-18T21:14:24.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc025db0640 5 monclient: authenticate success, global_id 114842 2024-08-18T21:14:24.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc025db0640 10 monclient: _renew_subs 2024-08-18T21:14:24.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc025db0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:14:24.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc025db0640 1 -- 172.21.15.5:0/4205420491 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02013fe10 con 0x7fc0200a6bd0 2024-08-18T21:14:24.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc01cff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:24.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc01cff9640 1 -- 172.21.15.5:0/4205420491 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc008013a90 con 0x7fc0200a6bd0 2024-08-18T21:14:24.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc01cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:24.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc01cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:14:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc01cff9640 10 monclient: dump: 2024-08-18T21:14:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:24.228 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc01e7fc640 4 set_mon_vals no callback set 2024-08-18T21:14:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc025db0640 10 monclient: _renew_subs 2024-08-18T21:14:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc025db0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:14:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc025db0640 1 -- 172.21.15.5:0/4205420491 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0201240d0 con 0x7fc0200a6bd0 2024-08-18T21:14:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc025db0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc025db0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc025db0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:14:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc025db0640 1 -- 172.21.15.5:0/4205420491 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc020139e10 con 0x7fc0200a6bd0 2024-08-18T21:14:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.215+0000 7fc01cff9640 1 -- 172.21.15.5:0/4205420491 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fc00801a070 con 0x7fc0200a6bd0 2024-08-18T21:14:24.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.219+0000 7fc01cff9640 1 --2- 172.21.15.5:0/4205420491 >> v2:172.21.15.157:6812/631023601 conn(0x7fc00003bdf0 0x7fc00003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.219+0000 7fc01cff9640 1 -- 172.21.15.5:0/4205420491 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(298..298 src has 22..298) ==== 3506+0+0 (secure 0 0 0) 0x7fc00800f040 con 0x7fc0200a6bd0 2024-08-18T21:14:24.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.219+0000 7fc01f7fe640 1 --2- 172.21.15.5:0/4205420491 >> v2:172.21.15.157:6812/631023601 conn(0x7fc00003bdf0 0x7fc00003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.219+0000 7fc01f7fe640 10 monclient: get_auth_request con 0x7fc00003bdf0 auth_method 0 2024-08-18T21:14:24.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.219+0000 7fc01f7fe640 1 --2- 172.21.15.5:0/4205420491 >> v2:172.21.15.157:6812/631023601 conn(0x7fc00003bdf0 0x7fc00003e2b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc010009a70 tx=0x7fc010008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:24.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.223+0000 7fc01cff9640 1 -- 172.21.15.5:0/4205420491 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fc008021070 con 0x7fc0200a6bd0 2024-08-18T21:14:24.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.223+0000 7fc01cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:24.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.223+0000 7fc01cff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:24.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3175428396}) 2024-08-18T21:14:24.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3579218282}) 2024-08-18T21:14:24.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3175428396}) 2024-08-18T21:14:24.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3464002452}) 2024-08-18T21:14:24.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3175428396}) 2024-08-18T21:14:24.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=751662180}) 2024-08-18T21:14:24.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3175428396}) 2024-08-18T21:14:24.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=136103996}) 2024-08-18T21:14:24.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3175428396}) 2024-08-18T21:14:24.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3641495250}) 2024-08-18T21:14:24.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3175428396}) 2024-08-18T21:14:24.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=84550825}) 2024-08-18T21:14:24.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3175428396}) 2024-08-18T21:14:24.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4166254475}) 2024-08-18T21:14:24.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3175428396}) 2024-08-18T21:14:24.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.287+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1855262432}) 2024-08-18T21:14:24.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:14:24.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:14:24.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:14:24.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 1 -- 172.21.15.5:0/4205420491 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc0200ab700 con 0x7fc0200a6bd0 2024-08-18T21:14:24.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc01cff9640 1 -- 172.21.15.5:0/4205420491 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7fc02013fe10 con 0x7fc0200a6bd0 2024-08-18T21:14:24.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc01cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:14:24.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc01cff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:24.465 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":228,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:14:24.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 1 -- 172.21.15.5:0/4205420491 >> v2:172.21.15.157:6812/631023601 conn(0x7fc00003bdf0 msgr2=0x7fc00003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 1 --2- 172.21.15.5:0/4205420491 >> v2:172.21.15.157:6812/631023601 conn(0x7fc00003bdf0 0x7fc00003e2b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc010009a70 tx=0x7fc010008040 comp rx=0 tx=0).stop 2024-08-18T21:14:24.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 10 monclient: shutdown 2024-08-18T21:14:24.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:24.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 1 -- 172.21.15.5:0/4205420491 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc0200a6bd0 msgr2=0x7fc020138640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 1 --2- 172.21.15.5:0/4205420491 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc0200a6bd0 0x7fc020138640 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc00800e960 tx=0x7fc00800ee20 comp rx=0 tx=0).stop 2024-08-18T21:14:24.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 1 -- 172.21.15.5:0/4205420491 shutdown_connections 2024-08-18T21:14:24.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 1 --2- 172.21.15.5:0/4205420491 >> v2:172.21.15.157:6812/631023601 conn(0x7fc00003bdf0 0x7fc00003e2b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 1 --2- 172.21.15.5:0/4205420491 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc020139990 0x7fc02013d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 1 --2- 172.21.15.5:0/4205420491 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc0200a6bd0 0x7fc020138640 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 1 --2- 172.21.15.5:0/4205420491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc02009f080 0x7fc020138100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 1 -- 172.21.15.5:0/4205420491 >> 172.21.15.5:0/4205420491 conn(0x7fc020068700 msgr2=0x7fc0200a9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:24.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 1 -- 172.21.15.5:0/4205420491 shutdown_connections 2024-08-18T21:14:24.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.467+0000 7fc025db0640 1 -- 172.21.15.5:0/4205420491 wait complete. 2024-08-18T21:14:24.485 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:14:24.485 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-18T21:14:24.485 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:14:24.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:14:24.515 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.515 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669874450}) 2024-08-18T21:14:24.515 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4271994425}) 2024-08-18T21:14:24.515 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.515 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669874450}) 2024-08-18T21:14:24.515 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3229516291}) 2024-08-18T21:14:24.515 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.515 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669874450}) 2024-08-18T21:14:24.516 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3791082030}) 2024-08-18T21:14:24.516 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.516 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669874450}) 2024-08-18T21:14:24.516 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=166637650}) 2024-08-18T21:14:24.516 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.516 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669874450}) 2024-08-18T21:14:24.516 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3730371170}) 2024-08-18T21:14:24.516 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.516 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669874450}) 2024-08-18T21:14:24.516 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1568207464}) 2024-08-18T21:14:24.516 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.516 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669874450}) 2024-08-18T21:14:24.516 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3664787062}) 2024-08-18T21:14:24.517 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.517 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669874450}) 2024-08-18T21:14:24.517 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.515+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=640947847}) 2024-08-18T21:14:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.639+0000 7f802e09f640 10 monclient: get_monmap_and_config 2024-08-18T21:14:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.639+0000 7f802e09f640 10 monclient: build_initial_monmap 2024-08-18T21:14:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 10 monclient: monmap: 2024-08-18T21:14:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:24.644436+0000 2024-08-18T21:14:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:24.644436+0000 2024-08-18T21:14:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:24.641 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 1 Processor -- start 2024-08-18T21:14:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 1 -- start start 2024-08-18T21:14:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 10 monclient: init 2024-08-18T21:14:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 10 monclient: _add_conns ranks=[2,10,1,7,6,9,4,8,3,0,5] 2024-08-18T21:14:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f80280a6bd0 0x7f80280a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 10 monclient(hunting): picked mon.noname-b con 0x7f80280a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f802809f080 0x7f80280a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 10 monclient(hunting): picked mon.noname-f con 0x7f802809f080 addr v2:172.21.15.157:3300/0 2024-08-18T21:14:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f8028139990 addr v1:172.21.15.157:6789/0 2024-08-18T21:14:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80280a7fb0 con 0x7f8028139990 2024-08-18T21:14:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f802809e4c0 con 0x7f802809f080 2024-08-18T21:14:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f802806f930 con 0x7f80280a6bd0 2024-08-18T21:14:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f802e09f640 10 monclient(hunting): authenticate will time out at 1631.658005s 2024-08-18T21:14:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f80280a6bd0 0x7f80280a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f80280a6bd0 0x7f80280a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:48422/0 (socket says 172.21.15.5:48422) 2024-08-18T21:14:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 1 -- 172.21.15.5:0/2311242297 learned_addr learned my addr 172.21.15.5:0/2311242297 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 10 monclient(hunting): get_auth_request con 0x7f80280a6bd0 auth_method 0 2024-08-18T21:14:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f8026ffd640 1 --2- 172.21.15.5:0/2311242297 >> v2:172.21.15.157:3300/0 conn(0x7f802809f080 0x7f80280a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 10 monclient(hunting): handle_auth_done global_id 114851 payload 274 2024-08-18T21:14:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 1 -- 172.21.15.5:0/2311242297 >> v2:172.21.15.157:3300/0 conn(0x7f802809f080 msgr2=0x7f80280a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 1 --2- 172.21.15.5:0/2311242297 >> v2:172.21.15.157:3300/0 conn(0x7f802809f080 0x7f80280a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 1 -- 172.21.15.5:0/2311242297 >> v1:172.21.15.157:6789/0 conn(0x7f8028139990 legacy=0x7f8028139e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 10 monclient: _finish_hunting 0 2024-08-18T21:14:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 1 monclient: found mon.noname-b 2024-08-18T21:14:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:14:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f80277fe640 1 -- 172.21.15.5:0/2311242297 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802809de70 con 0x7f80280a6bd0 2024-08-18T21:14:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f8026ffd640 10 monclient: get_auth_request con 0x7f802809f080 auth_method 0 2024-08-18T21:14:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.643+0000 7f8026ffd640 1 --2- 172.21.15.5:0/2311242297 >> v2:172.21.15.157:3300/0 conn(0x7f802809f080 0x7f80280a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:14:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f80277fe640 1 -- 172.21.15.5:0/2311242297 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f80280a6bd0 msgr2=0x7f80280a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f80277fe640 1 --2- 172.21.15.5:0/2311242297 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f80280a6bd0 0x7f80280a6fb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8018009870 tx=0x7f801801c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fa42479241d19bb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f80267fc640 1 -- 172.21.15.5:0/2311242297 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f80180b0070 con 0x7f80280a6bd0 2024-08-18T21:14:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f80267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f80267fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:14:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f80267fc640 10 monclient: dump: 2024-08-18T21:14:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:24.652 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f80267fc640 10 monclient: _finish_auth 0 2024-08-18T21:14:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f80267fc640 10 monclient: _check_auth_tickets 2024-08-18T21:14:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f80267fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f80267fc640 1 -- 172.21.15.5:0/2311242297 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80180aa810 con 0x7f80280a6bd0 2024-08-18T21:14:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f80267fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f80267fc640 1 -- 172.21.15.5:0/2311242297 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f80180aae30 con 0x7f80280a6bd0 2024-08-18T21:14:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f80267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f80267fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:14:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f80267fc640 10 monclient: dump: 2024-08-18T21:14:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:24.654 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f802e09f640 5 monclient: authenticate success, global_id 114851 2024-08-18T21:14:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f802e09f640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f802e09f640 4 set_mon_vals no callback set 2024-08-18T21:14:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f802e09f640 10 monclient: shutdown 2024-08-18T21:14:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f802e09f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f802e09f640 1 -- 172.21.15.5:0/2311242297 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f80280a6bd0 msgr2=0x7f80280a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f802e09f640 1 --2- 172.21.15.5:0/2311242297 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f80280a6bd0 0x7f80280a6fb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8018009870 tx=0x7f801801c420 comp rx=0 tx=0).stop 2024-08-18T21:14:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f802e09f640 1 -- 172.21.15.5:0/2311242297 shutdown_connections 2024-08-18T21:14:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f802e09f640 1 --2- 172.21.15.5:0/2311242297 >> v2:172.21.15.157:3300/0 conn(0x7f802809f080 0x7f80280a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f802e09f640 1 --2- 172.21.15.5:0/2311242297 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f80280a6bd0 0x7f80280a6fb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f802e09f640 1 -- 172.21.15.5:0/2311242297 >> 172.21.15.5:0/2311242297 conn(0x7f8028068700 msgr2=0x7f8028068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f802e09f640 1 -- 172.21.15.5:0/2311242297 shutdown_connections 2024-08-18T21:14:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.647+0000 7f802e09f640 1 -- 172.21.15.5:0/2311242297 wait complete. 2024-08-18T21:14:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 10 monclient: build_initial_monmap 2024-08-18T21:14:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 10 monclient: monmap: 2024-08-18T21:14:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:24.656 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 1 Processor -- start 2024-08-18T21:14:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 1 -- start start 2024-08-18T21:14:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 10 monclient: init 2024-08-18T21:14:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 10 monclient: _add_conns ranks=[3,6,7,0,8,5,2,4,1] 2024-08-18T21:14:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f802809f080 0x7f80281385b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 10 monclient(hunting): picked mon.noname-g con 0x7f802809f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f80280a6bd0 0x7f802813d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 10 monclient(hunting): picked mon.noname-d con 0x7f80280a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:14:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8028139990 0x7f802813dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 10 monclient(hunting): picked mon.noname-i con 0x7f8028139990 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f80281447a0 con 0x7f802809f080 2024-08-18T21:14:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f8028144620 con 0x7f80280a6bd0 2024-08-18T21:14:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f8028144920 con 0x7f8028139990 2024-08-18T21:14:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f802e09f640 10 monclient(hunting): authenticate will time out at 1631.665285s 2024-08-18T21:14:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f80280a6bd0 0x7f802813d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f80280a6bd0 0x7f802813d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:33070/0 (socket says 172.21.15.5:33070) 2024-08-18T21:14:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 1 -- 172.21.15.5:0/1067969069 learned_addr learned my addr 172.21.15.5:0/1067969069 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 10 monclient(hunting): get_auth_request con 0x7f80280a6bd0 auth_method 0 2024-08-18T21:14:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:24.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:24.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:24.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f80277fe640 1 --2- 172.21.15.5:0/1067969069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f802809f080 0x7f80281385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f80277fe640 10 monclient(hunting): get_auth_request con 0x7f802809f080 auth_method 0 2024-08-18T21:14:24.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f80277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f80277fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f80277fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 10 monclient(hunting): handle_auth_done global_id 134178 payload 824 2024-08-18T21:14:24.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8027fff640 1 --2- 172.21.15.5:0/1067969069 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8028139990 0x7f802813dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 1 -- 172.21.15.5:0/1067969069 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8028139990 msgr2=0x7f802813dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 1 --2- 172.21.15.5:0/1067969069 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f8028139990 0x7f802813dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 1 -- 172.21.15.5:0/1067969069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f802809f080 msgr2=0x7f80281385b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 1 --2- 172.21.15.5:0/1067969069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f802809f080 0x7f80281385b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:14:24.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 1 monclient: found mon.noname-d 2024-08-18T21:14:24.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:24.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:14:24.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.651+0000 7f8026ffd640 1 -- 172.21.15.5:0/1067969069 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80281402d0 con 0x7f80280a6bd0 2024-08-18T21:14:24.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f8026ffd640 1 -- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f80280a6bd0 msgr2=0x7f802813d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f8026ffd640 1 --2- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f80280a6bd0 0x7f802813d840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c7c0 tx=0x7f801c00cc80 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f800ffff640 1 -- 172.21.15.5:0/1067969069 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f801c0113f0 con 0x7f80280a6bd0 2024-08-18T21:14:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f800ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f800ffff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:14:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f800ffff640 10 monclient: dump: 2024-08-18T21:14:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:24.665 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:24.665 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:24.665 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:24.665 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:24.665 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:24.665 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:24.665 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:24.665 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f800ffff640 10 monclient: _finish_auth 0 2024-08-18T21:14:24.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f800ffff640 10 monclient: _check_auth_tickets 2024-08-18T21:14:24.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f800ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:24.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f800ffff640 1 -- 172.21.15.5:0/1067969069 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801c0115d0 con 0x7f80280a6bd0 2024-08-18T21:14:24.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f802e09f640 5 monclient: authenticate success, global_id 134178 2024-08-18T21:14:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f802e09f640 10 monclient: _renew_subs 2024-08-18T21:14:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f802e09f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:14:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f802e09f640 1 -- 172.21.15.5:0/1067969069 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80281230c0 con 0x7f80280a6bd0 2024-08-18T21:14:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f800ffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f800ffff640 1 -- 172.21.15.5:0/1067969069 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f801c011bf0 con 0x7f80280a6bd0 2024-08-18T21:14:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f800ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f800ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:14:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f800ffff640 10 monclient: dump: 2024-08-18T21:14:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:24.667 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f802e09f640 10 monclient: _renew_subs 2024-08-18T21:14:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f8025ffb640 4 set_mon_vals no callback set 2024-08-18T21:14:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f802e09f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:14:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f802e09f640 1 -- 172.21.15.5:0/1067969069 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f8028122de0 con 0x7f80280a6bd0 2024-08-18T21:14:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f802e09f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f802e09f640 1 --2- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8028138af0 0x7f802813e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f802e09f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f802e09f640 1 -- 172.21.15.5:0/1067969069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8028051140 con 0x7f8028138af0 2024-08-18T21:14:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f80277fe640 1 --2- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8028138af0 0x7f802813e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f80277fe640 10 monclient: get_auth_request con 0x7f8028138af0 auth_method 0 2024-08-18T21:14:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f80277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f80277fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f80277fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f800ffff640 1 -- 172.21.15.5:0/1067969069 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f801c011780 con 0x7f80280a6bd0 2024-08-18T21:14:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f80277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f80277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f80277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f800ffff640 1 --2- 172.21.15.5:0/1067969069 >> v2:172.21.15.157:6812/631023601 conn(0x7f801403bdc0 0x7f801403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f80277fe640 10 monclient(hunting): handle_auth_done global_id 124596 payload 824 2024-08-18T21:14:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f800ffff640 1 -- 172.21.15.5:0/1067969069 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(298..298 src has 22..298) ==== 3506+0+0 (secure 0 0 0) 0x7f801c04e7a0 con 0x7f80280a6bd0 2024-08-18T21:14:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f80277fe640 1 -- 172.21.15.5:0/1067969069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80280a3190 con 0x7f8028138af0 2024-08-18T21:14:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f8027fff640 1 --2- 172.21.15.5:0/1067969069 >> v2:172.21.15.157:6812/631023601 conn(0x7f801403bdc0 0x7f801403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f8027fff640 10 monclient: get_auth_request con 0x7f801403bdc0 auth_method 0 2024-08-18T21:14:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f80277fe640 1 -- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8028138af0 msgr2=0x7f802813e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.655+0000 7f80277fe640 1 --2- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8028138af0 0x7f802813e2c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f80280749c0 tx=0x7f80180191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.659+0000 7f800ffff640 1 -- 172.21.15.5:0/1067969069 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f80180ba020 con 0x7f8028138af0 2024-08-18T21:14:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.659+0000 7f800ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.659+0000 7f800ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:14:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.659+0000 7f800ffff640 10 monclient: dump: 2024-08-18T21:14:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:24.671 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.659+0000 7f800ffff640 1 -- 172.21.15.5:0/1067969069 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f80180b1040 con 0x7f8028138af0 2024-08-18T21:14:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.659+0000 7f800ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.659+0000 7f800ffff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.659+0000 7f800ffff640 1 -- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8028138af0 msgr2=0x7f802813e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.659+0000 7f800ffff640 1 --2- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8028138af0 0x7f802813e2c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f80280749c0 tx=0x7f80180191c0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.659+0000 7f800ffff640 1 -- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8028138af0 msgr2=0x7f802813e2c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.659+0000 7f800ffff640 1 --2- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8028138af0 0x7f802813e2c0 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f80280749c0 tx=0x7f80180191c0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.659+0000 7f8027fff640 1 --2- 172.21.15.5:0/1067969069 >> v2:172.21.15.157:6812/631023601 conn(0x7f801403bdc0 0x7f801403e280 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8020007d40 tx=0x7f8020007270 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.663+0000 7f802e09f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.663+0000 7f802e09f640 1 --2- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f802813e800 0x7f80280a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.663+0000 7f802e09f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.663+0000 7f802e09f640 1 -- 172.21.15.5:0/1067969069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f80281228b0 con 0x7f802813e800 2024-08-18T21:14:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.663+0000 7f80277fe640 1 --2- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f802813e800 0x7f80280a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.663+0000 7f80277fe640 10 monclient: get_auth_request con 0x7f802813e800 auth_method 0 2024-08-18T21:14:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.663+0000 7f80277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.663+0000 7f80277fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.663+0000 7f80277fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.663+0000 7f80277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.663+0000 7f80277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.663+0000 7f80277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.663+0000 7f80277fe640 10 monclient(hunting): handle_auth_done global_id 124605 payload 824 2024-08-18T21:14:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.663+0000 7f80277fe640 1 -- 172.21.15.5:0/1067969069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8028139e40 con 0x7f802813e800 2024-08-18T21:14:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.667+0000 7f80277fe640 1 -- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f802813e800 msgr2=0x7f80280a0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.667+0000 7f80277fe640 1 --2- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f802813e800 0x7f80280a0bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f801801ccc0 tx=0x7f80180a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.667+0000 7f800ffff640 1 -- 172.21.15.5:0/1067969069 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f80180ba070 con 0x7f802813e800 2024-08-18T21:14:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.667+0000 7f800ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.667+0000 7f800ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:14:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.667+0000 7f800ffff640 10 monclient: dump: 2024-08-18T21:14:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:24.675 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.667+0000 7f800ffff640 1 -- 172.21.15.5:0/1067969069 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9417 (secure 0 0 0) 0x7f80180c8420 con 0x7f802813e800 2024-08-18T21:14:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.667+0000 7f800ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.667+0000 7f800ffff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.667+0000 7f800ffff640 1 -- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f802813e800 msgr2=0x7f80280a0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.671+0000 7f800ffff640 1 --2- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f802813e800 0x7f80280a0bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f801801ccc0 tx=0x7f80180a8000 comp rx=0 tx=0).stop 2024-08-18T21:14:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.671+0000 7f800ffff640 1 -- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f802813e800 msgr2=0x7f80280a0bf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.671+0000 7f800ffff640 1 --2- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f802813e800 0x7f80280a0bf0 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f801801ccc0 tx=0x7f80180a8000 comp rx=0 tx=0).stop 2024-08-18T21:14:24.676 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:24.676 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:24.676 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:24.676 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:14:24.676 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:24.676 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 111647, 2024-08-18T21:14:24.676 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:14:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:14:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:14:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.699 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:24.699 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:24.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.699 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:24.699 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:24.699 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:24.699 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.699 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.699 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:24.699 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.671+0000 7f802e09f640 1 -- 172.21.15.5:0/1067969069 >> v2:172.21.15.157:6812/631023601 conn(0x7f801403bdc0 msgr2=0x7f801403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.671+0000 7f802e09f640 1 --2- 172.21.15.5:0/1067969069 >> v2:172.21.15.157:6812/631023601 conn(0x7f801403bdc0 0x7f801403e280 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8020007d40 tx=0x7f8020007270 comp rx=0 tx=0).stop 2024-08-18T21:14:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.671+0000 7f802e09f640 10 monclient: shutdown 2024-08-18T21:14:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.671+0000 7f802e09f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.671+0000 7f802e09f640 1 -- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f80280a6bd0 msgr2=0x7f802813d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.671+0000 7f802e09f640 1 --2- 172.21.15.5:0/1067969069 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f80280a6bd0 0x7f802813d840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c7c0 tx=0x7f801c00cc80 comp rx=0 tx=0).stop 2024-08-18T21:14:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.671+0000 7f8027fff640 1 -- 172.21.15.5:0/1067969069 reap_dead start 2024-08-18T21:14:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.671+0000 7f8027fff640 1 -- 172.21.15.5:0/1067969069 reap_dead start 2024-08-18T21:14:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.671+0000 7f802e09f640 1 -- 172.21.15.5:0/1067969069 shutdown_connections 2024-08-18T21:14:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.671+0000 7f802e09f640 1 -- 172.21.15.5:0/1067969069 >> 172.21.15.5:0/1067969069 conn(0x7f8028068700 msgr2=0x7f80281416d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.671+0000 7f802e09f640 1 -- 172.21.15.5:0/1067969069 shutdown_connections 2024-08-18T21:14:24.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.671+0000 7f802e09f640 1 -- 172.21.15.5:0/1067969069 wait complete. 2024-08-18T21:14:24.702 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:24.702 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:14:24.702 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:14:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 10 monclient: get_monmap_and_config 2024-08-18T21:14:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 10 monclient: build_initial_monmap 2024-08-18T21:14:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 10 monclient: monmap: 2024-08-18T21:14:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:24.825813+0000 2024-08-18T21:14:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:24.825813+0000 2024-08-18T21:14:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:24.823 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:24.823 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:24.823 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:24.823 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:24.823 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:24.823 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:24.823 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 1 Processor -- start 2024-08-18T21:14:24.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 1 -- start start 2024-08-18T21:14:24.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 10 monclient: init 2024-08-18T21:14:24.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:24.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 10 monclient: _add_conns ranks=[4,3,5,1,0,6,9,7,2,8,10] 2024-08-18T21:14:24.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd93c0a6bd0 0x7fd93c0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 10 monclient(hunting): picked mon.noname-c con 0x7fd93c0a6bd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd93c09f080 0x7fd93c0a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 10 monclient(hunting): picked mon.noname-g con 0x7fd93c09f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd93c139990 0x7fd93c139df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 10 monclient(hunting): picked mon.noname-h con 0x7fd93c139990 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd93c09e4c0 con 0x7fd93c09f080 2024-08-18T21:14:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fd93c06f930 con 0x7fd93c0a6bd0 2024-08-18T21:14:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fd93c0a7a30 con 0x7fd93c139990 2024-08-18T21:14:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd94196e640 10 monclient(hunting): authenticate will time out at 1631.839857s 2024-08-18T21:14:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.823+0000 7fd93affd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd93c0a6bd0 0x7fd93c0a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd93c0a6bd0 0x7fd93c0a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:54054/0 (socket says 172.21.15.5:54054) 2024-08-18T21:14:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 1 -- 172.21.15.5:0/4060804950 learned_addr learned my addr 172.21.15.5:0/4060804950 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 10 monclient(hunting): get_auth_request con 0x7fd93c0a6bd0 auth_method 0 2024-08-18T21:14:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93a7fc640 1 --2- 172.21.15.5:0/4060804950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd93c09f080 0x7fd93c0a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93a7fc640 10 monclient(hunting): get_auth_request con 0x7fd93c09f080 auth_method 0 2024-08-18T21:14:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 10 monclient(hunting): handle_auth_done global_id 114745 payload 274 2024-08-18T21:14:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 1 -- 172.21.15.5:0/4060804950 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd93c139990 msgr2=0x7fd93c139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 1 --2- 172.21.15.5:0/4060804950 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd93c139990 0x7fd93c139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 1 -- 172.21.15.5:0/4060804950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd93c09f080 msgr2=0x7fd93c0a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 1 --2- 172.21.15.5:0/4060804950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd93c09f080 0x7fd93c0a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 10 monclient: _finish_hunting 0 2024-08-18T21:14:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 1 monclient: found mon.noname-c 2024-08-18T21:14:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:14:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.827+0000 7fd93affd640 1 -- 172.21.15.5:0/4060804950 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93c0a7fb0 con 0x7fd93c0a6bd0 2024-08-18T21:14:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd93affd640 1 -- 172.21.15.5:0/4060804950 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd93c0a6bd0 msgr2=0x7fd93c0a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd93affd640 1 --2- 172.21.15.5:0/4060804950 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd93c0a6bd0 0x7fd93c0a6fb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0098a0 tx=0x7fd92c01c440 comp rx=0 tx=0).ready entity=mon.4 client_cookie=177b4d7c624b753a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd939ffb640 1 -- 172.21.15.5:0/4060804950 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd92c0b0070 con 0x7fd93c0a6bd0 2024-08-18T21:14:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd939ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd939ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:14:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd939ffb640 10 monclient: dump: 2024-08-18T21:14:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:24.835 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd939ffb640 10 monclient: _finish_auth 0 2024-08-18T21:14:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd939ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:14:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd939ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd939ffb640 1 -- 172.21.15.5:0/4060804950 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c0aa810 con 0x7fd93c0a6bd0 2024-08-18T21:14:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd939ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd939ffb640 1 -- 172.21.15.5:0/4060804950 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd92c0a9300 con 0x7fd93c0a6bd0 2024-08-18T21:14:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd939ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd939ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd939ffb640 10 monclient: dump: 2024-08-18T21:14:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:24.837 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 5 monclient: authenticate success, global_id 114745 2024-08-18T21:14:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 4 set_mon_vals no callback set 2024-08-18T21:14:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 10 monclient: shutdown 2024-08-18T21:14:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 -- 172.21.15.5:0/4060804950 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd93c0a6bd0 msgr2=0x7fd93c0a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 --2- 172.21.15.5:0/4060804950 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd93c0a6bd0 0x7fd93c0a6fb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0098a0 tx=0x7fd92c01c440 comp rx=0 tx=0).stop 2024-08-18T21:14:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 -- 172.21.15.5:0/4060804950 shutdown_connections 2024-08-18T21:14:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 --2- 172.21.15.5:0/4060804950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd93c09f080 0x7fd93c0a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 --2- 172.21.15.5:0/4060804950 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd93c139990 0x7fd93c139df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 --2- 172.21.15.5:0/4060804950 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd93c0a6bd0 0x7fd93c0a6fb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 -- 172.21.15.5:0/4060804950 >> 172.21.15.5:0/4060804950 conn(0x7fd93c068700 msgr2=0x7fd93c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 -- 172.21.15.5:0/4060804950 shutdown_connections 2024-08-18T21:14:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 -- 172.21.15.5:0/4060804950 wait complete. 2024-08-18T21:14:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 10 monclient: build_initial_monmap 2024-08-18T21:14:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 10 monclient: monmap: 2024-08-18T21:14:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:24.839 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 Processor -- start 2024-08-18T21:14:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 -- start start 2024-08-18T21:14:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 10 monclient: init 2024-08-18T21:14:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 10 monclient: _add_conns ranks=[0,3,5,7,8,6,2,1,4] 2024-08-18T21:14:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd93c09f080 0x7fd93c1d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 10 monclient(hunting): picked mon.noname-a con 0x7fd93c09f080 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:14:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd93c0a6bd0 0x7fd93c138a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 10 monclient(hunting): picked mon.noname-g con 0x7fd93c0a6bd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd93c139990 0x7fd93c13db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 10 monclient(hunting): picked mon.noname-h con 0x7fd93c139990 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c0a89f0 con 0x7fd93c09f080 2024-08-18T21:14:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd93c0a7ce0 con 0x7fd93c0a6bd0 2024-08-18T21:14:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fd93c143610 con 0x7fd93c139990 2024-08-18T21:14:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd94196e640 10 monclient(hunting): authenticate will time out at 1631.847803s 2024-08-18T21:14:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd93affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd93c09f080 0x7fd93c1d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.831+0000 7fd93affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd93c09f080 0x7fd93c1d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59834/0 (socket says 172.21.15.5:59834) 2024-08-18T21:14:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 1 -- 172.21.15.5:0/140280528 learned_addr learned my addr 172.21.15.5:0/140280528 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 10 monclient(hunting): get_auth_request con 0x7fd93c09f080 auth_method 0 2024-08-18T21:14:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93a7fc640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd93c0a6bd0 0x7fd93c138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93b7fe640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd93c139990 0x7fd93c13db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93a7fc640 10 monclient(hunting): get_auth_request con 0x7fd93c0a6bd0 auth_method 0 2024-08-18T21:14:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93b7fe640 10 monclient(hunting): get_auth_request con 0x7fd93c139990 auth_method 0 2024-08-18T21:14:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 10 monclient(hunting): handle_auth_done global_id 124614 payload 824 2024-08-18T21:14:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 1 -- 172.21.15.5:0/140280528 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd93c139990 msgr2=0x7fd93c13db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd93c139990 0x7fd93c13db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 1 -- 172.21.15.5:0/140280528 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd93c0a6bd0 msgr2=0x7fd93c138a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd93c0a6bd0 0x7fd93c138a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 10 monclient: _finish_hunting 0 2024-08-18T21:14:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 1 monclient: found mon.noname-a 2024-08-18T21:14:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:14:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 1 -- 172.21.15.5:0/140280528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93c0ab0e0 con 0x7fd93c09f080 2024-08-18T21:14:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93a7fc640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd93c0a6bd0 0x7fd93c138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:14:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 1 -- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd93c09f080 msgr2=0x7fd93c1d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93affd640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd93c09f080 0x7fd93c1d15a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0ae040 tx=0x7fd92c0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd923fff640 1 -- 172.21.15.5:0/140280528 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd92c0b0040 con 0x7fd93c09f080 2024-08-18T21:14:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd923fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd923fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:14:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd923fff640 10 monclient: dump: 2024-08-18T21:14:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:24.850 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd923fff640 10 monclient: _finish_auth 0 2024-08-18T21:14:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd923fff640 10 monclient: _check_auth_tickets 2024-08-18T21:14:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd923fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd94196e640 5 monclient: authenticate success, global_id 124614 2024-08-18T21:14:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd923fff640 1 -- 172.21.15.5:0/140280528 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c0044b0 con 0x7fd93c09f080 2024-08-18T21:14:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd923fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd923fff640 1 -- 172.21.15.5:0/140280528 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd92c003a90 con 0x7fd93c09f080 2024-08-18T21:14:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd94196e640 10 monclient: _renew_subs 2024-08-18T21:14:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd94196e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd94196e640 1 -- 172.21.15.5:0/140280528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd93c13f640 con 0x7fd93c09f080 2024-08-18T21:14:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd9397fa640 4 set_mon_vals no callback set 2024-08-18T21:14:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd923fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd923fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:14:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd923fff640 10 monclient: dump: 2024-08-18T21:14:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:24.852 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd94196e640 10 monclient: _renew_subs 2024-08-18T21:14:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd94196e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd94196e640 1 -- 172.21.15.5:0/140280528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd93c122bb0 con 0x7fd93c09f080 2024-08-18T21:14:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd94196e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd94196e640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd93c138f50 0x7fd93c13e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd94196e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd94196e640 1 -- 172.21.15.5:0/140280528 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fd93c1d2550 con 0x7fd93c138f50 2024-08-18T21:14:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93a7fc640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd93c138f50 0x7fd93c13e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93a7fc640 10 monclient: get_auth_request con 0x7fd93c138f50 auth_method 0 2024-08-18T21:14:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.835+0000 7fd93a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd93a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd93a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd93a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:24.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd93a7fc640 10 monclient(hunting): handle_auth_done global_id 114860 payload 824 2024-08-18T21:14:24.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd93a7fc640 1 -- 172.21.15.5:0/140280528 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd93c139df0 con 0x7fd93c138f50 2024-08-18T21:14:24.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd923fff640 1 -- 172.21.15.5:0/140280528 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fd92c003c30 con 0x7fd93c09f080 2024-08-18T21:14:24.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd923fff640 1 --2- 172.21.15.5:0/140280528 >> v2:172.21.15.157:6812/631023601 conn(0x7fd92803bdf0 0x7fd92803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd923fff640 1 -- 172.21.15.5:0/140280528 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(298..298 src has 22..298) ==== 3506+0+0 (secure 0 0 0) 0x7fd92c0e7910 con 0x7fd93c09f080 2024-08-18T21:14:24.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd93b7fe640 1 --2- 172.21.15.5:0/140280528 >> v2:172.21.15.157:6812/631023601 conn(0x7fd92803bdf0 0x7fd92803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd93b7fe640 10 monclient: get_auth_request con 0x7fd92803bdf0 auth_method 0 2024-08-18T21:14:24.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd93a7fc640 1 -- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd93c138f50 msgr2=0x7fd93c13e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:24.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd93a7fc640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd93c138f50 0x7fd93c13e0d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd93c122b40 tx=0x7fd93000f9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:24.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd923fff640 1 -- 172.21.15.5:0/140280528 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd930019020 con 0x7fd93c138f50 2024-08-18T21:14:24.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd923fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:24.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd923fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:14:24.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd923fff640 10 monclient: dump: 2024-08-18T21:14:24.855 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:24.855 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.855 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.855 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.855 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:24.855 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.855 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:24.855 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:24.856 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd923fff640 1 -- 172.21.15.5:0/140280528 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd930014880 con 0x7fd93c138f50 2024-08-18T21:14:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd923fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd923fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd923fff640 1 -- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd93c138f50 msgr2=0x7fd93c13e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd923fff640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd93c138f50 0x7fd93c13e0d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd93c122b40 tx=0x7fd93000f9e0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd923fff640 1 -- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd93c138f50 msgr2=0x7fd93c13e0d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd923fff640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd93c138f50 0x7fd93c13e0d0 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd93c122b40 tx=0x7fd93000f9e0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.839+0000 7fd93b7fe640 1 --2- 172.21.15.5:0/140280528 >> v2:172.21.15.157:6812/631023601 conn(0x7fd92803bdf0 0x7fd92803e2b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd93c0a6890 tx=0x7fd934009410 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.847+0000 7fd94196e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.847+0000 7fd94196e640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd93c13e610 0x7fd93c0a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.847+0000 7fd94196e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.847+0000 7fd94196e640 1 -- 172.21.15.5:0/140280528 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fd93c051140 con 0x7fd93c13e610 2024-08-18T21:14:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.847+0000 7fd93a7fc640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd93c13e610 0x7fd93c0a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.847+0000 7fd93a7fc640 10 monclient: get_auth_request con 0x7fd93c13e610 auth_method 0 2024-08-18T21:14:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.847+0000 7fd93a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.847+0000 7fd93a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.847+0000 7fd93a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.847+0000 7fd93a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.847+0000 7fd93a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.847+0000 7fd93a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.847+0000 7fd93a7fc640 10 monclient(hunting): handle_auth_done global_id 114869 payload 824 2024-08-18T21:14:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.847+0000 7fd93a7fc640 1 -- 172.21.15.5:0/140280528 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd93c13e9f0 con 0x7fd93c13e610 2024-08-18T21:14:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd93a7fc640 1 -- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd93c13e610 msgr2=0x7fd93c0a4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd93a7fc640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd93c13e610 0x7fd93c0a4410 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd93001a000 tx=0x7fd9300046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd923fff640 1 -- 172.21.15.5:0/140280528 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd930019040 con 0x7fd93c13e610 2024-08-18T21:14:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd923fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd923fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:14:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd923fff640 10 monclient: dump: 2024-08-18T21:14:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:24.860 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:24.860 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:24.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd923fff640 1 -- 172.21.15.5:0/140280528 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7fd93001e630 con 0x7fd93c13e610 2024-08-18T21:14:24.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd923fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:24.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd923fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:24.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd923fff640 1 -- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd93c13e610 msgr2=0x7fd93c0a4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd923fff640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd93c13e610 0x7fd93c0a4410 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd93001a000 tx=0x7fd9300046d0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd923fff640 1 -- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd93c13e610 msgr2=0x7fd93c0a4410 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:24.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd923fff640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd93c13e610 0x7fd93c0a4410 secure :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd93001a000 tx=0x7fd9300046d0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.861 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 170006, 2024-08-18T21:14:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:14:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:14:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:14:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:24.889 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:24.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd94196e640 1 -- 172.21.15.5:0/140280528 >> v2:172.21.15.157:6812/631023601 conn(0x7fd92803bdf0 msgr2=0x7fd92803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd94196e640 1 --2- 172.21.15.5:0/140280528 >> v2:172.21.15.157:6812/631023601 conn(0x7fd92803bdf0 0x7fd92803e2b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd93c0a6890 tx=0x7fd934009410 comp rx=0 tx=0).stop 2024-08-18T21:14:24.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd94196e640 10 monclient: shutdown 2024-08-18T21:14:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd94196e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd94196e640 1 -- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd93c09f080 msgr2=0x7fd93c1d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd94196e640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd93c09f080 0x7fd93c1d15a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0ae040 tx=0x7fd92c0191e0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd93b7fe640 1 -- 172.21.15.5:0/140280528 reap_dead start 2024-08-18T21:14:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd94196e640 1 -- 172.21.15.5:0/140280528 shutdown_connections 2024-08-18T21:14:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd94196e640 1 --2- 172.21.15.5:0/140280528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd93c09f080 0x7fd93c1d15a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd94196e640 1 -- 172.21.15.5:0/140280528 >> 172.21.15.5:0/140280528 conn(0x7fd93c068700 msgr2=0x7fd93c0aa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd94196e640 1 -- 172.21.15.5:0/140280528 shutdown_connections 2024-08-18T21:14:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:24.851+0000 7fd94196e640 1 -- 172.21.15.5:0/140280528 wait complete. 2024-08-18T21:14:24.891 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:24.892 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:14:24.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:14:24.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1483009431}) 2024-08-18T21:14:24.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3496511663}) 2024-08-18T21:14:24.897 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1483009431}) 2024-08-18T21:14:24.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3239735208}) 2024-08-18T21:14:24.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1483009431}) 2024-08-18T21:14:24.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1074322552}) 2024-08-18T21:14:24.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1483009431}) 2024-08-18T21:14:24.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3932157018}) 2024-08-18T21:14:24.898 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1483009431}) 2024-08-18T21:14:24.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1236694600}) 2024-08-18T21:14:24.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1483009431}) 2024-08-18T21:14:24.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2563531242}) 2024-08-18T21:14:24.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1483009431}) 2024-08-18T21:14:24.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3779241132}) 2024-08-18T21:14:24.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1483009431}) 2024-08-18T21:14:24.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.899+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1598862147}) 2024-08-18T21:14:24.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.911+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.911+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359667576}) 2024-08-18T21:14:24.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.911+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1494970023}) 2024-08-18T21:14:24.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.911+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.911+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359667576}) 2024-08-18T21:14:24.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.911+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1433691006}) 2024-08-18T21:14:24.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.911+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.912 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.911+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359667576}) 2024-08-18T21:14:24.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.911+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2775566001}) 2024-08-18T21:14:24.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.915+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.915+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359667576}) 2024-08-18T21:14:24.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.915+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3581808318}) 2024-08-18T21:14:24.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.915+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.915+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359667576}) 2024-08-18T21:14:24.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.915+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2372014015}) 2024-08-18T21:14:24.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.915+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.915+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359667576}) 2024-08-18T21:14:24.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.915+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=221743210}) 2024-08-18T21:14:24.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.915+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.913 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.915+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359667576}) 2024-08-18T21:14:24.914 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.915+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=530309983}) 2024-08-18T21:14:24.914 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.915+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.914 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.915+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359667576}) 2024-08-18T21:14:24.914 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.915+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2959311395}) 2024-08-18T21:14:24.918 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.919 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2627079534}) 2024-08-18T21:14:24.919 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=484082156}) 2024-08-18T21:14:24.919 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.919 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2627079534}) 2024-08-18T21:14:24.919 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=820681062}) 2024-08-18T21:14:24.919 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.919 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2627079534}) 2024-08-18T21:14:24.919 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2472301741}) 2024-08-18T21:14:24.919 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.919 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2627079534}) 2024-08-18T21:14:24.919 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2669531177}) 2024-08-18T21:14:24.919 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.919 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2627079534}) 2024-08-18T21:14:24.920 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1853877491}) 2024-08-18T21:14:24.920 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.920 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2627079534}) 2024-08-18T21:14:24.920 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=599522972}) 2024-08-18T21:14:24.920 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.920 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2627079534}) 2024-08-18T21:14:24.920 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3444001273}) 2024-08-18T21:14:24.920 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.920 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2627079534}) 2024-08-18T21:14:24.920 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.919+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3805636129}) 2024-08-18T21:14:24.922 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.922 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578146771}) 2024-08-18T21:14:24.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=407219076}) 2024-08-18T21:14:24.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578146771}) 2024-08-18T21:14:24.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1622259295}) 2024-08-18T21:14:24.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578146771}) 2024-08-18T21:14:24.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2977228660}) 2024-08-18T21:14:24.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578146771}) 2024-08-18T21:14:24.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2414277910}) 2024-08-18T21:14:24.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578146771}) 2024-08-18T21:14:24.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=64016735}) 2024-08-18T21:14:24.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578146771}) 2024-08-18T21:14:24.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4046874368}) 2024-08-18T21:14:24.925 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.925 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578146771}) 2024-08-18T21:14:24.925 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1645002505}) 2024-08-18T21:14:24.925 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.925 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578146771}) 2024-08-18T21:14:24.925 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.923+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3895576124}) 2024-08-18T21:14:24.928 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.928 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3259296832}) 2024-08-18T21:14:24.928 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2519201052}) 2024-08-18T21:14:24.928 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.928 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3259296832}) 2024-08-18T21:14:24.928 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4171875977}) 2024-08-18T21:14:24.928 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.928 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3259296832}) 2024-08-18T21:14:24.928 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2654233183}) 2024-08-18T21:14:24.928 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3259296832}) 2024-08-18T21:14:24.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=953384029}) 2024-08-18T21:14:24.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3259296832}) 2024-08-18T21:14:24.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=539878350}) 2024-08-18T21:14:24.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3259296832}) 2024-08-18T21:14:24.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1202298992}) 2024-08-18T21:14:24.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3259296832}) 2024-08-18T21:14:24.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2209825866}) 2024-08-18T21:14:24.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3259296832}) 2024-08-18T21:14:24.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.927+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=651371236}) 2024-08-18T21:14:24.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2760259970}) 2024-08-18T21:14:24.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=73335620}) 2024-08-18T21:14:24.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2760259970}) 2024-08-18T21:14:24.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2068284177}) 2024-08-18T21:14:24.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2760259970}) 2024-08-18T21:14:24.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4260015937}) 2024-08-18T21:14:24.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2760259970}) 2024-08-18T21:14:24.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1782158281}) 2024-08-18T21:14:24.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2760259970}) 2024-08-18T21:14:24.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4157914800}) 2024-08-18T21:14:24.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2760259970}) 2024-08-18T21:14:24.939 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2145969021}) 2024-08-18T21:14:24.939 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.939 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2760259970}) 2024-08-18T21:14:24.939 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=166748901}) 2024-08-18T21:14:24.939 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:24.939 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2760259970}) 2024-08-18T21:14:24.939 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:24.935+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=477687235}) 2024-08-18T21:14:25.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.019+0000 7fdbf7d4a640 10 monclient: get_monmap_and_config 2024-08-18T21:14:25.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.019+0000 7fdbf7d4a640 10 monclient: build_initial_monmap 2024-08-18T21:14:25.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.019+0000 7fdbf7d4a640 10 monclient: monmap: 2024-08-18T21:14:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:25.023154+0000 2024-08-18T21:14:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:25.023154+0000 2024-08-18T21:14:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:25.020 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.019+0000 7fdbf7d4a640 1 Processor -- start 2024-08-18T21:14:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.019+0000 7fdbf7d4a640 1 -- start start 2024-08-18T21:14:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.019+0000 7fdbf7d4a640 10 monclient: init 2024-08-18T21:14:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf7d4a640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf7d4a640 10 monclient: _add_conns ranks=[2,4,1,3,5,8,9,10,0,6,7] 2024-08-18T21:14:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf7d4a640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdbf00a6ce0 0x7fdbf00a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf7d4a640 10 monclient(hunting): picked mon.noname-b con 0x7fdbf00a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf7d4a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf00a7600 0x7fdbf0139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf7d4a640 10 monclient(hunting): picked mon.noname-c con 0x7fdbf00a7600 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf7d4a640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fdbf0139fe0 addr v1:172.21.15.157:6789/0 2024-08-18T21:14:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf7d4a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbf00a45d0 con 0x7fdbf0139fe0 2024-08-18T21:14:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf7d4a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf7d4a640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fdbf00a5000 con 0x7fdbf00a6ce0 2024-08-18T21:14:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf7d4a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf7d4a640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fdbf00a32d0 con 0x7fdbf00a7600 2024-08-18T21:14:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf7d4a640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf7d4a640 10 monclient(hunting): authenticate will time out at 1632.036638s 2024-08-18T21:14:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf5ae6640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdbf00a6ce0 0x7fdbf00a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf00a7600 0x7fdbf0139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf00a7600 0x7fdbf0139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:54060/0 (socket says 172.21.15.5:54060) 2024-08-18T21:14:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf5ae6640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdbf00a6ce0 0x7fdbf00a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:48442/0 (socket says 172.21.15.5:48442) 2024-08-18T21:14:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 1 -- 172.21.15.5:0/4069472334 learned_addr learned my addr 172.21.15.5:0/4069472334 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 10 monclient(hunting): get_auth_request con 0x7fdbf00a7600 auth_method 0 2024-08-18T21:14:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf5ae6640 10 monclient(hunting): get_auth_request con 0x7fdbf00a6ce0 auth_method 0 2024-08-18T21:14:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf5ae6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf5ae6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf5ae6640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf5ae6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf5ae6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf5ae6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 10 monclient(hunting): handle_auth_done global_id 114754 payload 274 2024-08-18T21:14:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 1 -- 172.21.15.5:0/4069472334 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdbf00a6ce0 msgr2=0x7fdbf00a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 1 --2- 172.21.15.5:0/4069472334 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdbf00a6ce0 0x7fdbf00a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 1 -- 172.21.15.5:0/4069472334 >> v1:172.21.15.157:6789/0 conn(0x7fdbf0139fe0 legacy=0x7fdbf0140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 10 monclient: _finish_hunting 0 2024-08-18T21:14:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 1 monclient: found mon.noname-c 2024-08-18T21:14:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:14:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf52e5640 1 -- 172.21.15.5:0/4069472334 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf00a8900 con 0x7fdbf00a7600 2024-08-18T21:14:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.023+0000 7fdbf5ae6640 1 --2- 172.21.15.5:0/4069472334 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdbf00a6ce0 0x7fdbf00a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:14:25.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf52e5640 1 -- 172.21.15.5:0/4069472334 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf00a7600 msgr2=0x7fdbf0139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf52e5640 1 --2- 172.21.15.5:0/4069472334 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf00a7600 0x7fdbf0139aa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00098a0 tx=0x7fdbe001c440 comp rx=0 tx=0).ready entity=mon.4 client_cookie=5928d6c02bb3f733 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf4ae4640 1 -- 172.21.15.5:0/4069472334 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbe00b2070 con 0x7fdbf00a7600 2024-08-18T21:14:25.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf4ae4640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf4ae4640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:14:25.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf4ae4640 10 monclient: dump: 2024-08-18T21:14:25.030 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.030 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.030 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.030 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.030 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.030 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.030 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.030 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.030 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.031 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.031 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.031 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.031 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.031 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.031 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.031 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf4ae4640 10 monclient: _finish_auth 0 2024-08-18T21:14:25.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf4ae4640 10 monclient: _check_auth_tickets 2024-08-18T21:14:25.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf4ae4640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:25.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 5 monclient: authenticate success, global_id 114754 2024-08-18T21:14:25.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:14:25.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf4ae4640 1 -- 172.21.15.5:0/4069472334 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe00a9070 con 0x7fdbf00a7600 2024-08-18T21:14:25.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf4ae4640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:25.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf4ae4640 1 -- 172.21.15.5:0/4069472334 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbe00ab7d0 con 0x7fdbf00a7600 2024-08-18T21:14:25.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:25.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 4 set_mon_vals no callback set 2024-08-18T21:14:25.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf4ae4640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf4ae4640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:25.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf4ae4640 10 monclient: dump: 2024-08-18T21:14:25.032 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.032 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.032 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.032 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.032 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.032 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.033 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.033 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.033 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.033 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.033 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.033 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.033 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.033 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.033 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.033 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 10 monclient: shutdown 2024-08-18T21:14:25.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:25.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 1 -- 172.21.15.5:0/4069472334 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf00a7600 msgr2=0x7fdbf0139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 1 --2- 172.21.15.5:0/4069472334 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf00a7600 0x7fdbf0139aa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00098a0 tx=0x7fdbe001c440 comp rx=0 tx=0).stop 2024-08-18T21:14:25.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 1 -- 172.21.15.5:0/4069472334 shutdown_connections 2024-08-18T21:14:25.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 1 --2- 172.21.15.5:0/4069472334 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf00a7600 0x7fdbf0139aa0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 1 --2- 172.21.15.5:0/4069472334 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdbf00a6ce0 0x7fdbf00a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 1 -- 172.21.15.5:0/4069472334 >> 172.21.15.5:0/4069472334 conn(0x7fdbf00acbc0 msgr2=0x7fdbf00a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:25.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 1 -- 172.21.15.5:0/4069472334 shutdown_connections 2024-08-18T21:14:25.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 1 -- 172.21.15.5:0/4069472334 wait complete. 2024-08-18T21:14:25.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 10 monclient: build_initial_monmap 2024-08-18T21:14:25.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 10 monclient: monmap: 2024-08-18T21:14:25.034 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:25.034 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:25.034 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:25.035 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:25.035 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:25.035 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.035 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:25.035 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:25.035 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:25.035 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:25.035 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:25.035 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:25.035 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:25.035 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:25.035 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:25.035 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 1 Processor -- start 2024-08-18T21:14:25.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 1 -- start start 2024-08-18T21:14:25.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.027+0000 7fdbf7d4a640 10 monclient: init 2024-08-18T21:14:25.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:25.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 10 monclient: _add_conns ranks=[0,7,2,8,1,3,4,5,6] 2024-08-18T21:14:25.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf00a6ce0 0x7fdbf01d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 10 monclient(hunting): picked mon.noname-a con 0x7fdbf00a6ce0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:14:25.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbf00a7600 0x7fdbf01d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 10 monclient(hunting): picked mon.noname-i con 0x7fdbf00a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:25.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdbf0139fe0 0x7fdbf01d2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 10 monclient(hunting): picked mon.noname-b con 0x7fdbf0139fe0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:25.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf00a79e0 con 0x7fdbf00a6ce0 2024-08-18T21:14:25.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fdbf00a9810 con 0x7fdbf0139fe0 2024-08-18T21:14:25.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fdbf00a26b0 con 0x7fdbf00a7600 2024-08-18T21:14:25.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:25.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 10 monclient(hunting): authenticate will time out at 1632.044278s 2024-08-18T21:14:25.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf00a6ce0 0x7fdbf01d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf62e7640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdbf0139fe0 0x7fdbf01d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf00a6ce0 0x7fdbf01d19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59842/0 (socket says 172.21.15.5:59842) 2024-08-18T21:14:25.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 1 -- 172.21.15.5:0/3783359471 learned_addr learned my addr 172.21.15.5:0/3783359471 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:25.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 10 monclient(hunting): get_auth_request con 0x7fdbf00a6ce0 auth_method 0 2024-08-18T21:14:25.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf62e7640 10 monclient(hunting): get_auth_request con 0x7fdbf0139fe0 auth_method 0 2024-08-18T21:14:25.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf62e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf62e7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf62e7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf62e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf62e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf62e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf52e5640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbf00a7600 0x7fdbf01d1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 10 monclient(hunting): handle_auth_done global_id 124623 payload 824 2024-08-18T21:14:25.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 1 -- 172.21.15.5:0/3783359471 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbf00a7600 msgr2=0x7fdbf01d1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbf00a7600 0x7fdbf01d1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 1 -- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdbf0139fe0 msgr2=0x7fdbf01d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdbf0139fe0 0x7fdbf01d2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 10 monclient: _finish_hunting 0 2024-08-18T21:14:25.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 1 monclient: found mon.noname-a 2024-08-18T21:14:25.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:25.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:14:25.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 1 -- 172.21.15.5:0/3783359471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf013f7a0 con 0x7fdbf00a6ce0 2024-08-18T21:14:25.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf52e5640 10 monclient: get_auth_request con 0x7fdbf00a7600 auth_method 0 2024-08-18T21:14:25.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf52e5640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdbf00a7600 0x7fdbf01d1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:14:25.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf62e7640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdbf0139fe0 0x7fdbf01d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:14:25.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 1 -- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf00a6ce0 msgr2=0x7fdbf01d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf5ae6640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf00a6ce0 0x7fdbf01d19c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00ec10 tx=0x7fdbec00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbe67fc640 1 -- 172.21.15.5:0/3783359471 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbec017070 con 0x7fdbf00a6ce0 2024-08-18T21:14:25.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbe67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbe67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:14:25.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbe67fc640 10 monclient: dump: 2024-08-18T21:14:25.045 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.045 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.046 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.046 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.046 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.046 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.046 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.046 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.046 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.047 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbe67fc640 10 monclient: _finish_auth 0 2024-08-18T21:14:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbe67fc640 10 monclient: _check_auth_tickets 2024-08-18T21:14:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbe67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbe67fc640 1 -- 172.21.15.5:0/3783359471 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbec00ce40 con 0x7fdbf00a6ce0 2024-08-18T21:14:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 5 monclient: authenticate success, global_id 124623 2024-08-18T21:14:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbe67fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 10 monclient: _renew_subs 2024-08-18T21:14:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbe67fc640 1 -- 172.21.15.5:0/3783359471 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbec013d50 con 0x7fdbf00a6ce0 2024-08-18T21:14:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 1 -- 172.21.15.5:0/3783359471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf013f2f0 con 0x7fdbf00a6ce0 2024-08-18T21:14:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbe67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbe67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:14:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbe67fc640 10 monclient: dump: 2024-08-18T21:14:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.049 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbe7fff640 4 set_mon_vals no callback set 2024-08-18T21:14:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 10 monclient: _renew_subs 2024-08-18T21:14:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.031+0000 7fdbf7d4a640 1 -- 172.21.15.5:0/3783359471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf00a21a0 con 0x7fdbf00a6ce0 2024-08-18T21:14:25.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf7d4a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:25.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf7d4a640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013ec90 0x7fdbf013b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf7d4a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf7d4a640 1 -- 172.21.15.5:0/3783359471 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fdbf00a7b60 con 0x7fdbf013ec90 2024-08-18T21:14:25.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbe67fc640 1 -- 172.21.15.5:0/3783359471 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fdbec01a070 con 0x7fdbf00a6ce0 2024-08-18T21:14:25.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf52e5640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013ec90 0x7fdbf013b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf52e5640 10 monclient: get_auth_request con 0x7fdbf013ec90 auth_method 0 2024-08-18T21:14:25.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf52e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf52e5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf52e5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf52e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf52e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf52e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbe67fc640 1 --2- 172.21.15.5:0/3783359471 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbd403bdf0 0x7fdbd403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf52e5640 10 monclient(hunting): handle_auth_done global_id 114763 payload 824 2024-08-18T21:14:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf52e5640 1 -- 172.21.15.5:0/3783359471 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdbf00a8220 con 0x7fdbf013ec90 2024-08-18T21:14:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbe67fc640 1 -- 172.21.15.5:0/3783359471 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(298..298 src has 22..298) ==== 3506+0+0 (secure 0 0 0) 0x7fdbec00f040 con 0x7fdbf00a6ce0 2024-08-18T21:14:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf62e7640 1 --2- 172.21.15.5:0/3783359471 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbd403bdf0 0x7fdbd403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf62e7640 10 monclient: get_auth_request con 0x7fdbd403bdf0 auth_method 0 2024-08-18T21:14:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf52e5640 1 -- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013ec90 msgr2=0x7fdbf013b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbf52e5640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013ec90 0x7fdbf013b5f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00af000 tx=0x7fdbe00191e0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbe67fc640 1 -- 172.21.15.5:0/3783359471 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbe00b2070 con 0x7fdbf013ec90 2024-08-18T21:14:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbe67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbe67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbe67fc640 10 monclient: dump: 2024-08-18T21:14:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.053 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.053 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.053 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.053 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.053 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.053 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.053 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.053 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbe67fc640 1 -- 172.21.15.5:0/3783359471 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdbe00b3040 con 0x7fdbf013ec90 2024-08-18T21:14:25.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbe67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:25.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbe67fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:25.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbe67fc640 1 -- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013ec90 msgr2=0x7fdbf013b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbe67fc640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013ec90 0x7fdbf013b5f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00af000 tx=0x7fdbe00191e0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbe67fc640 1 -- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013ec90 msgr2=0x7fdbf013b5f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.035+0000 7fdbe67fc640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013ec90 0x7fdbf013b5f0 secure :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00af000 tx=0x7fdbe00191e0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.039+0000 7fdbf62e7640 1 --2- 172.21.15.5:0/3783359471 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbd403bdf0 0x7fdbd403e2b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800b7a0 tx=0x7fdbe800d040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.043+0000 7fdbf7d4a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.043+0000 7fdbf7d4a640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013bb30 0x7fdbf013bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.043+0000 7fdbf7d4a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.043+0000 7fdbf7d4a640 1 -- 172.21.15.5:0/3783359471 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fdbf0051140 con 0x7fdbf013bb30 2024-08-18T21:14:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.043+0000 7fdbf52e5640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013bb30 0x7fdbf013bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.043+0000 7fdbf52e5640 10 monclient: get_auth_request con 0x7fdbf013bb30 auth_method 0 2024-08-18T21:14:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.043+0000 7fdbf52e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.043+0000 7fdbf52e5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.043+0000 7fdbf52e5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.043+0000 7fdbf52e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.043+0000 7fdbf52e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.043+0000 7fdbf52e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.043+0000 7fdbf52e5640 10 monclient(hunting): handle_auth_done global_id 114772 payload 824 2024-08-18T21:14:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.043+0000 7fdbf52e5640 1 -- 172.21.15.5:0/3783359471 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdbf013c480 con 0x7fdbf013bb30 2024-08-18T21:14:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbf52e5640 1 -- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013bb30 msgr2=0x7fdbf013bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbf52e5640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013bb30 0x7fdbf013bf40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00097c0 tx=0x7fdbe00a9000 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbe67fc640 1 -- 172.21.15.5:0/3783359471 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdbe00adae0 con 0x7fdbf013bb30 2024-08-18T21:14:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbe67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbe67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbe67fc640 10 monclient: dump: 2024-08-18T21:14:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.057 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbe67fc640 1 -- 172.21.15.5:0/3783359471 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7fdbe00b7400 con 0x7fdbf013bb30 2024-08-18T21:14:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbe67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbe67fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbe67fc640 1 -- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013bb30 msgr2=0x7fdbf013bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbe67fc640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013bb30 0x7fdbf013bf40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00097c0 tx=0x7fdbe00a9000 comp rx=0 tx=0).stop 2024-08-18T21:14:25.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbe67fc640 1 -- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013bb30 msgr2=0x7fdbf013bf40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:25.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbe67fc640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdbf013bb30 0x7fdbf013bf40 secure :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00097c0 tx=0x7fdbe00a9000 comp rx=0 tx=0).stop 2024-08-18T21:14:25.058 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.058 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=865348959}) 2024-08-18T21:14:25.058 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1869170399}) 2024-08-18T21:14:25.059 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:25.059 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:25.059 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:25.059 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:25.059 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:25.059 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 170206, 2024-08-18T21:14:25.059 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:25.059 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:25.059 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:25.060 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:25.060 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:25.060 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:25.060 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:25.060 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:25.060 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:25.060 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:25.060 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.060 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:14:25.060 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:25.060 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:25.060 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:25.060 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:25.061 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:25.061 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:25.061 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:25.061 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:25.061 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:25.061 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:25.061 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:25.061 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:25.061 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:25.061 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:25.061 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.061 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:25.061 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:25.061 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:25.061 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:25.062 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:25.062 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:25.062 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:25.062 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:25.062 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:25.062 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:25.062 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:25.062 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:25.062 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:25.062 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.062 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:25.062 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:25.063 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:25.063 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:25.063 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:25.063 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:25.063 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:25.063 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:25.063 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:25.063 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:25.063 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:25.063 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:25.063 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:25.063 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:25.064 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:25.064 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:25.064 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:25.064 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:25.064 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:25.064 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:25.064 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:25.064 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:25.064 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:25.064 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:25.064 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:25.065 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:25.065 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:25.065 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:25.065 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.065 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:25.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.065 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:25.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.065 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:25.065 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:25.065 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.065 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.066 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.066 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:25.066 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.066 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.066 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.066 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:25.066 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.066 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.066 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.066 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:25.066 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:25.067 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.067 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.067 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.067 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:25.067 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:25.067 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.067 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.067 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.067 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:25.067 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.068 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.068 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:25.068 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.068 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.068 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.068 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:25.068 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:25.068 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.068 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.068 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.069 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.069 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:25.069 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:25.069 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.069 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.069 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.069 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.069 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:25.069 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.069 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.070 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.070 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:25.070 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.070 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.070 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.070 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:25.070 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:25.070 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.070 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.070 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.071 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:25.071 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:25.071 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.071 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.071 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.071 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:25.071 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.072 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.072 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:25.072 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.072 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.072 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.072 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:25.072 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:25.072 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.072 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.072 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.073 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:25.073 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:25.073 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.073 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.073 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:25.073 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.074 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:25.074 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.074 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.074 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.075 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:25.075 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:25.075 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.075 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.075 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.075 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:25.075 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:25.075 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.075 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.076 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.076 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:25.076 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.076 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.076 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:25.076 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.076 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.076 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.076 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:25.077 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:25.077 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.077 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.077 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.077 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:25.077 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:25.077 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.077 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.077 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.078 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:25.078 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.078 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.078 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:25.078 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.078 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.078 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.079 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:25.079 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:25.079 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.079 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.079 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.079 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:25.079 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:25.079 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.079 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.080 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.080 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:25.080 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.080 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.080 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:25.080 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.080 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.080 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.080 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:25.080 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:25.081 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.081 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.081 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.081 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:25.081 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:25.081 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.081 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.082 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:25.082 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.082 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:25.082 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.082 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.082 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.082 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:25.082 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:25.083 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.083 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.083 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.083 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.083 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.083 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:25.083 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:25.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.083 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:25.083 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:25.083 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:25.083 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.084 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.084 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:25.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.084 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:25.084 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:25.084 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4 2024-08-18T21:14:25.084 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.084 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.084 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:25.084 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:25.085 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.086 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=865348959}) 2024-08-18T21:14:25.086 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=173179596}) 2024-08-18T21:14:25.086 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.086 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=865348959}) 2024-08-18T21:14:25.086 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3871946596}) 2024-08-18T21:14:25.086 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.086 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=865348959}) 2024-08-18T21:14:25.086 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=780115371}) 2024-08-18T21:14:25.086 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.087 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=865348959}) 2024-08-18T21:14:25.087 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=523239554}) 2024-08-18T21:14:25.087 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.087 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=865348959}) 2024-08-18T21:14:25.087 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2547765302}) 2024-08-18T21:14:25.087 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.087 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=865348959}) 2024-08-18T21:14:25.087 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714997048}) 2024-08-18T21:14:25.087 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.087 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=865348959}) 2024-08-18T21:14:25.087 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4231389440}) 2024-08-18T21:14:25.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbf7d4a640 1 -- 172.21.15.5:0/3783359471 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbd403bdf0 msgr2=0x7fdbd403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbf7d4a640 1 --2- 172.21.15.5:0/3783359471 >> v2:172.21.15.157:6812/631023601 conn(0x7fdbd403bdf0 0x7fdbd403e2b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800b7a0 tx=0x7fdbe800d040 comp rx=0 tx=0).stop 2024-08-18T21:14:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbf7d4a640 10 monclient: shutdown 2024-08-18T21:14:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbf7d4a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbf7d4a640 1 -- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf00a6ce0 msgr2=0x7fdbf01d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbf7d4a640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf00a6ce0 0x7fdbf01d19c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00ec10 tx=0x7fdbec00c520 comp rx=0 tx=0).stop 2024-08-18T21:14:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbf62e7640 1 -- 172.21.15.5:0/3783359471 reap_dead start 2024-08-18T21:14:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbf7d4a640 1 -- 172.21.15.5:0/3783359471 shutdown_connections 2024-08-18T21:14:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbf7d4a640 1 --2- 172.21.15.5:0/3783359471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbf00a6ce0 0x7fdbf01d19c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbf7d4a640 1 -- 172.21.15.5:0/3783359471 >> 172.21.15.5:0/3783359471 conn(0x7fdbf00acbc0 msgr2=0x7fdbf00aa570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbf7d4a640 1 -- 172.21.15.5:0/3783359471 shutdown_connections 2024-08-18T21:14:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.047+0000 7fdbf7d4a640 1 -- 172.21.15.5:0/3783359471 wait complete. 2024-08-18T21:14:25.090 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:25.090 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:14:25.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:14:25.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 10 monclient: get_monmap_and_config 2024-08-18T21:14:25.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 10 monclient: build_initial_monmap 2024-08-18T21:14:25.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 10 monclient: monmap: 2024-08-18T21:14:25.261 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:25.261 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.261 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:25.265574+0000 2024-08-18T21:14:25.261 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:25.265574+0000 2024-08-18T21:14:25.261 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:25.261 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.261 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:25.261 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:25.262 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:25.262 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:25.262 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:25.262 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:25.262 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:25.262 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:25.262 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:25.262 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:25.262 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:25.262 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 1 Processor -- start 2024-08-18T21:14:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 1 -- start start 2024-08-18T21:14:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 10 monclient: init 2024-08-18T21:14:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 10 monclient: _add_conns ranks=[10,4,3,8,2,5,6,0,9,1,7] 2024-08-18T21:14:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f921c0a6ce0 0x7f921c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 10 monclient(hunting): picked mon.noname-f con 0x7f921c0a6ce0 addr v2:172.21.15.157:3300/0 2024-08-18T21:14:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f921c0a7600 0x7f921c139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 10 monclient(hunting): picked mon.noname-c con 0x7f921c0a7600 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921c139fe0 0x7f921c13a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 10 monclient(hunting): picked mon.noname-g con 0x7f921c139fe0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f921c0a5000 con 0x7f921c0a6ce0 2024-08-18T21:14:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f921c0a4360 con 0x7f921c139fe0 2024-08-18T21:14:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f921c0a45d0 con 0x7f921c0a7600 2024-08-18T21:14:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9223add640 10 monclient(hunting): authenticate will time out at 1632.279475s 2024-08-18T21:14:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9221078640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f921c0a7600 0x7f921c139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9221078640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f921c0a7600 0x7f921c139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:54096/0 (socket says 172.21.15.5:54096) 2024-08-18T21:14:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9221078640 1 -- 172.21.15.5:0/2530940838 learned_addr learned my addr 172.21.15.5:0/2530940838 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9221078640 10 monclient(hunting): get_auth_request con 0x7f921c0a7600 auth_method 0 2024-08-18T21:14:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9221078640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9221078640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9221078640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9221078640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9221078640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9221078640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f922207a640 1 --2- 172.21.15.5:0/2530940838 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921c139fe0 0x7f921c13a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9221879640 1 --2- 172.21.15.5:0/2530940838 >> v2:172.21.15.157:3300/0 conn(0x7f921c0a6ce0 0x7f921c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f922207a640 10 monclient(hunting): get_auth_request con 0x7f921c139fe0 auth_method 0 2024-08-18T21:14:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f922207a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f922207a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f922207a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9221879640 10 monclient(hunting): get_auth_request con 0x7f921c0a6ce0 auth_method 0 2024-08-18T21:14:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9221879640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9221879640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.263+0000 7f9221879640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.267+0000 7f9221078640 10 monclient(hunting): handle_auth_done global_id 114781 payload 274 2024-08-18T21:14:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.267+0000 7f9221078640 1 -- 172.21.15.5:0/2530940838 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921c139fe0 msgr2=0x7f921c13a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.267+0000 7f9221078640 1 --2- 172.21.15.5:0/2530940838 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921c139fe0 0x7f921c13a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.267+0000 7f9221078640 1 -- 172.21.15.5:0/2530940838 >> v2:172.21.15.157:3300/0 conn(0x7f921c0a6ce0 msgr2=0x7f921c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.267+0000 7f9221078640 1 --2- 172.21.15.5:0/2530940838 >> v2:172.21.15.157:3300/0 conn(0x7f921c0a6ce0 0x7f921c0a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.267+0000 7f9221078640 10 monclient: _finish_hunting 0 2024-08-18T21:14:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.267+0000 7f9221078640 1 monclient: found mon.noname-c 2024-08-18T21:14:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.267+0000 7f9221078640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.267+0000 7f9221078640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:14:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.267+0000 7f9221078640 1 -- 172.21.15.5:0/2530940838 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f921c0a32d0 con 0x7f921c0a7600 2024-08-18T21:14:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.267+0000 7f922207a640 1 --2- 172.21.15.5:0/2530940838 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921c139fe0 0x7f921c13a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:14:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.267+0000 7f9221879640 1 --2- 172.21.15.5:0/2530940838 >> v2:172.21.15.157:3300/0 conn(0x7f921c0a6ce0 0x7f921c0a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:14:25.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 1 -- 172.21.15.5:0/2530940838 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f921c0a7600 msgr2=0x7f921c139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 1 --2- 172.21.15.5:0/2530940838 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f921c0a7600 0x7f921c139aa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f920c0098a0 tx=0x7f920c01c400 comp rx=0 tx=0).ready entity=mon.4 client_cookie=935187c64e0e3589 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9220877640 1 -- 172.21.15.5:0/2530940838 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f920c0b0070 con 0x7f921c0a7600 2024-08-18T21:14:25.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9220877640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9220877640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:14:25.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9220877640 10 monclient: dump: 2024-08-18T21:14:25.273 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.273 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.273 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.273 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.273 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.273 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.273 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.274 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9220877640 10 monclient: _finish_auth 0 2024-08-18T21:14:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9220877640 10 monclient: _check_auth_tickets 2024-08-18T21:14:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9220877640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9220877640 1 -- 172.21.15.5:0/2530940838 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920c0aa810 con 0x7f921c0a7600 2024-08-18T21:14:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9220877640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9220877640 1 -- 172.21.15.5:0/2530940838 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f920c0aae30 con 0x7f921c0a7600 2024-08-18T21:14:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9220877640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9220877640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9220877640 10 monclient: dump: 2024-08-18T21:14:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.276 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.276 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.276 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.276 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.276 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.276 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.276 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 5 monclient: authenticate success, global_id 114781 2024-08-18T21:14:25.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:25.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 4 set_mon_vals no callback set 2024-08-18T21:14:25.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 10 monclient: shutdown 2024-08-18T21:14:25.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:25.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 -- 172.21.15.5:0/2530940838 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f921c0a7600 msgr2=0x7f921c139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 --2- 172.21.15.5:0/2530940838 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f921c0a7600 0x7f921c139aa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f920c0098a0 tx=0x7f920c01c400 comp rx=0 tx=0).stop 2024-08-18T21:14:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 -- 172.21.15.5:0/2530940838 shutdown_connections 2024-08-18T21:14:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 --2- 172.21.15.5:0/2530940838 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f921c0a7600 0x7f921c139aa0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 --2- 172.21.15.5:0/2530940838 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f921c139fe0 0x7f921c13a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 --2- 172.21.15.5:0/2530940838 >> v2:172.21.15.157:3300/0 conn(0x7f921c0a6ce0 0x7f921c0a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 -- 172.21.15.5:0/2530940838 >> 172.21.15.5:0/2530940838 conn(0x7f921c0acbc0 msgr2=0x7f921c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 -- 172.21.15.5:0/2530940838 shutdown_connections 2024-08-18T21:14:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 -- 172.21.15.5:0/2530940838 wait complete. 2024-08-18T21:14:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 10 monclient: build_initial_monmap 2024-08-18T21:14:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 10 monclient: monmap: 2024-08-18T21:14:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:25.278 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 Processor -- start 2024-08-18T21:14:25.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 -- start start 2024-08-18T21:14:25.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 10 monclient: init 2024-08-18T21:14:25.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:25.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 10 monclient: _add_conns ranks=[7,2,5,1,3,8,0,6,4] 2024-08-18T21:14:25.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f921c0a6ce0 0x7f921c1365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 10 monclient(hunting): picked mon.noname-i con 0x7f921c0a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:25.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f921c0a7600 0x7f921c136b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 10 monclient(hunting): picked mon.noname-b con 0x7f921c0a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:25.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f921c139fe0 0x7f921c13c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 10 monclient(hunting): picked mon.noname-h con 0x7f921c139fe0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:25.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f921c0a79e0 con 0x7f921c0a7600 2024-08-18T21:14:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f921c0a8220 con 0x7f921c139fe0 2024-08-18T21:14:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f921c0a1c00 con 0x7f921c0a6ce0 2024-08-18T21:14:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9223add640 10 monclient(hunting): authenticate will time out at 1632.287316s 2024-08-18T21:14:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f921c0a7600 0x7f921c136b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f921c0a7600 0x7f921c136b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:48462/0 (socket says 172.21.15.5:48462) 2024-08-18T21:14:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 1 -- 172.21.15.5:0/535509506 learned_addr learned my addr 172.21.15.5:0/535509506 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 10 monclient(hunting): get_auth_request con 0x7f921c0a7600 auth_method 0 2024-08-18T21:14:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f922207a640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f921c139fe0 0x7f921c13c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221879640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f921c0a6ce0 0x7f921c1365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f922207a640 10 monclient(hunting): get_auth_request con 0x7f921c139fe0 auth_method 0 2024-08-18T21:14:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f922207a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f922207a640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f922207a640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221879640 10 monclient(hunting): get_auth_request con 0x7f921c0a6ce0 auth_method 0 2024-08-18T21:14:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221879640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221879640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221879640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 10 monclient(hunting): handle_auth_done global_id 114896 payload 824 2024-08-18T21:14:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 1 -- 172.21.15.5:0/535509506 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f921c0a6ce0 msgr2=0x7f921c1365e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f921c0a6ce0 0x7f921c1365e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 1 -- 172.21.15.5:0/535509506 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f921c139fe0 msgr2=0x7f921c13c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f921c139fe0 0x7f921c13c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 10 monclient: _finish_hunting 0 2024-08-18T21:14:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 1 monclient: found mon.noname-b 2024-08-18T21:14:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:14:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f9221078640 1 -- 172.21.15.5:0/535509506 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f921c13fc50 con 0x7f921c0a7600 2024-08-18T21:14:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.271+0000 7f922207a640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f921c139fe0 0x7f921c13c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:14:25.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3504031063}) 2024-08-18T21:14:25.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3780839363}) 2024-08-18T21:14:25.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3504031063}) 2024-08-18T21:14:25.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3174280896}) 2024-08-18T21:14:25.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3504031063}) 2024-08-18T21:14:25.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3250018235}) 2024-08-18T21:14:25.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3504031063}) 2024-08-18T21:14:25.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=63978079}) 2024-08-18T21:14:25.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3504031063}) 2024-08-18T21:14:25.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3640320641}) 2024-08-18T21:14:25.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3504031063}) 2024-08-18T21:14:25.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1768555754}) 2024-08-18T21:14:25.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3504031063}) 2024-08-18T21:14:25.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=667261373}) 2024-08-18T21:14:25.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3504031063}) 2024-08-18T21:14:25.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3172106199}) 2024-08-18T21:14:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f9221078640 1 -- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f921c0a7600 msgr2=0x7f921c136b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f9221078640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f921c0a7600 0x7f921c136b20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f920c0097c0 tx=0x7f920c0191a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f92127fc640 1 -- 172.21.15.5:0/535509506 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f920c0b0070 con 0x7f921c0a7600 2024-08-18T21:14:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f92127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f92127fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:14:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f92127fc640 10 monclient: dump: 2024-08-18T21:14:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.289 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f92127fc640 10 monclient: _finish_auth 0 2024-08-18T21:14:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f92127fc640 10 monclient: _check_auth_tickets 2024-08-18T21:14:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f92127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f92127fc640 1 -- 172.21.15.5:0/535509506 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920c0b1040 con 0x7f921c0a7600 2024-08-18T21:14:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f92127fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f92127fc640 1 -- 172.21.15.5:0/535509506 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f920c004450 con 0x7f921c0a7600 2024-08-18T21:14:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f92127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f92127fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:14:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f92127fc640 10 monclient: dump: 2024-08-18T21:14:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.290 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f92137fe640 4 set_mon_vals no callback set 2024-08-18T21:14:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f9223add640 5 monclient: authenticate success, global_id 114896 2024-08-18T21:14:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f9223add640 10 monclient: _renew_subs 2024-08-18T21:14:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f9223add640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:14:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f9223add640 1 -- 172.21.15.5:0/535509506 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f921c13ff30 con 0x7f921c0a7600 2024-08-18T21:14:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f9223add640 10 monclient: _renew_subs 2024-08-18T21:14:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f9223add640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:14:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f9223add640 1 -- 172.21.15.5:0/535509506 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f921c0a20a0 con 0x7f921c0a7600 2024-08-18T21:14:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.275+0000 7f9223add640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f9223add640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f921c137060 0x7f921c13d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f9223add640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f9223add640 1 -- 172.21.15.5:0/535509506 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f921c0a7b60 con 0x7f921c137060 2024-08-18T21:14:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f9221879640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f921c137060 0x7f921c13d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f9221879640 10 monclient: get_auth_request con 0x7f921c137060 auth_method 0 2024-08-18T21:14:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f9221879640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f9221879640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f9221879640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f9221879640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f9221879640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f9221879640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f9221879640 10 monclient(hunting): handle_auth_done global_id 134187 payload 824 2024-08-18T21:14:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f9221879640 1 -- 172.21.15.5:0/535509506 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f921c13e190 con 0x7f921c137060 2024-08-18T21:14:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f92127fc640 1 -- 172.21.15.5:0/535509506 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f920c0bc060 con 0x7f921c0a7600 2024-08-18T21:14:25.292 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.292 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1936003935}) 2024-08-18T21:14:25.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=853950971}) 2024-08-18T21:14:25.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1936003935}) 2024-08-18T21:14:25.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=681118618}) 2024-08-18T21:14:25.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1936003935}) 2024-08-18T21:14:25.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3900629001}) 2024-08-18T21:14:25.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1936003935}) 2024-08-18T21:14:25.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1577511316}) 2024-08-18T21:14:25.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1936003935}) 2024-08-18T21:14:25.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=891466959}) 2024-08-18T21:14:25.293 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1936003935}) 2024-08-18T21:14:25.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2279342120}) 2024-08-18T21:14:25.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1936003935}) 2024-08-18T21:14:25.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=698450552}) 2024-08-18T21:14:25.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1936003935}) 2024-08-18T21:14:25.294 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3934017516}) 2024-08-18T21:14:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f92127fc640 1 --2- 172.21.15.5:0/535509506 >> v2:172.21.15.157:6812/631023601 conn(0x7f920003bdc0 0x7f920003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f92127fc640 1 -- 172.21.15.5:0/535509506 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(299..299 src has 22..299) ==== 3898+0+0 (secure 0 0 0) 0x7f920c0e7ba0 con 0x7f921c0a7600 2024-08-18T21:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f922207a640 1 --2- 172.21.15.5:0/535509506 >> v2:172.21.15.157:6812/631023601 conn(0x7f920003bdc0 0x7f920003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.279+0000 7f922207a640 10 monclient: get_auth_request con 0x7f920003bdc0 auth_method 0 2024-08-18T21:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.287+0000 7f9221879640 1 -- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f921c137060 msgr2=0x7f921c13d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.287+0000 7f9221879640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f921c137060 0x7f921c13d490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f92180107c0 tx=0x7f9218010c80 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.287+0000 7f92127fc640 1 -- 172.21.15.5:0/535509506 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f921801a020 con 0x7f921c137060 2024-08-18T21:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.287+0000 7f92127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.287+0000 7f92127fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.287+0000 7f92127fc640 10 monclient: dump: 2024-08-18T21:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.287+0000 7f92127fc640 1 -- 172.21.15.5:0/535509506 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9218010e70 con 0x7f921c137060 2024-08-18T21:14:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.287+0000 7f92127fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.287+0000 7f92127fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.287+0000 7f92127fc640 1 -- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f921c137060 msgr2=0x7f921c13d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.287+0000 7f92127fc640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f921c137060 0x7f921c13d490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f92180107c0 tx=0x7f9218010c80 comp rx=0 tx=0).stop 2024-08-18T21:14:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.287+0000 7f92127fc640 1 -- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f921c137060 msgr2=0x7f921c13d490 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.287+0000 7f92127fc640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f921c137060 0x7f921c13d490 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f92180107c0 tx=0x7f9218010c80 comp rx=0 tx=0).stop 2024-08-18T21:14:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.291+0000 7f922207a640 1 --2- 172.21.15.5:0/535509506 >> v2:172.21.15.157:6812/631023601 conn(0x7f920003bdc0 0x7f920003e280 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f921c13fb30 tx=0x7f92140039a0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.295+0000 7f9223add640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.295+0000 7f9223add640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f921c13d9d0 0x7f921c02d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.295+0000 7f9223add640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.295+0000 7f9223add640 1 -- 172.21.15.5:0/535509506 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f921c051140 con 0x7f921c13d9d0 2024-08-18T21:14:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.295+0000 7f9221879640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f921c13d9d0 0x7f921c02d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.295+0000 7f9221879640 10 monclient: get_auth_request con 0x7f921c13d9d0 auth_method 0 2024-08-18T21:14:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.295+0000 7f9221879640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.295+0000 7f9221879640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.295+0000 7f9221879640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.295+0000 7f9221879640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.295+0000 7f9221879640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.295+0000 7f9221879640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.295+0000 7f9221879640 10 monclient(hunting): handle_auth_done global_id 134196 payload 824 2024-08-18T21:14:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.295+0000 7f9221879640 1 -- 172.21.15.5:0/535509506 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f921c0a70c0 con 0x7f921c13d9d0 2024-08-18T21:14:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f9221879640 1 -- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f921c13d9d0 msgr2=0x7f921c02d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f9221879640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f921c13d9d0 0x7f921c02d1d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f921801b000 tx=0x7f92180046d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f92127fc640 1 -- 172.21.15.5:0/535509506 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f921800f040 con 0x7f921c13d9d0 2024-08-18T21:14:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f92127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f92127fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:14:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f92127fc640 10 monclient: dump: 2024-08-18T21:14:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.302 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f92127fc640 1 -- 172.21.15.5:0/535509506 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f9218021a70 con 0x7f921c13d9d0 2024-08-18T21:14:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f92127fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f92127fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f92127fc640 1 -- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f921c13d9d0 msgr2=0x7f921c02d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f92127fc640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f921c13d9d0 0x7f921c02d1d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f921801b000 tx=0x7f92180046d0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f92127fc640 1 -- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f921c13d9d0 msgr2=0x7f921c02d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f92127fc640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f921c13d9d0 0x7f921c02d1d0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f921801b000 tx=0x7f92180046d0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.303 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 24755, 2024-08-18T21:14:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:14:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:25.326 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:25.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f9223add640 1 -- 172.21.15.5:0/535509506 >> v2:172.21.15.157:6812/631023601 conn(0x7f920003bdc0 msgr2=0x7f920003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f9223add640 1 --2- 172.21.15.5:0/535509506 >> v2:172.21.15.157:6812/631023601 conn(0x7f920003bdc0 0x7f920003e280 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f921c13fb30 tx=0x7f92140039a0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f9223add640 10 monclient: shutdown 2024-08-18T21:14:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f9223add640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f9223add640 1 -- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f921c0a7600 msgr2=0x7f921c136b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f9223add640 1 --2- 172.21.15.5:0/535509506 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f921c0a7600 0x7f921c136b20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f920c0097c0 tx=0x7f920c0191a0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f922207a640 1 -- 172.21.15.5:0/535509506 reap_dead start 2024-08-18T21:14:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f922207a640 1 -- 172.21.15.5:0/535509506 reap_dead start 2024-08-18T21:14:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f9223add640 1 -- 172.21.15.5:0/535509506 shutdown_connections 2024-08-18T21:14:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f9223add640 1 -- 172.21.15.5:0/535509506 >> 172.21.15.5:0/535509506 conn(0x7f921c0acbc0 msgr2=0x7f921c0aae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f9223add640 1 -- 172.21.15.5:0/535509506 shutdown_connections 2024-08-18T21:14:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.299+0000 7f9223add640 1 -- 172.21.15.5:0/535509506 wait complete. 2024-08-18T21:14:25.329 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:25.329 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:14:25.329 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:14:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 10 monclient: get_monmap_and_config 2024-08-18T21:14:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 10 monclient: build_initial_monmap 2024-08-18T21:14:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 10 monclient: monmap: 2024-08-18T21:14:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:25.452704+0000 2024-08-18T21:14:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:25.452704+0000 2024-08-18T21:14:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:25.449 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 1 Processor -- start 2024-08-18T21:14:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 1 -- start start 2024-08-18T21:14:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 10 monclient: init 2024-08-18T21:14:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 10 monclient: _add_conns ranks=[6,1,5,10,9,7,2,0,3,8,4] 2024-08-18T21:14:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe14c0a6bd0 0x7fe14c0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 10 monclient(hunting): picked mon.noname-d con 0x7fe14c0a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:14:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fe14c09f080 addr v1:172.21.15.157:6789/0 2024-08-18T21:14:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe14c0a74f0 0x7fe14c13a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 10 monclient(hunting): picked mon.noname-h con 0x7fe14c0a74f0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe14c0a7fb0 con 0x7fe14c09f080 2024-08-18T21:14:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe14c09e4c0 con 0x7fe14c0a74f0 2024-08-18T21:14:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fe14c06f930 con 0x7fe14c0a6bd0 2024-08-18T21:14:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe1520ef640 10 monclient(hunting): authenticate will time out at 1632.465909s 2024-08-18T21:14:25.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe14c0a6bd0 0x7fe14c0a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe14c0a6bd0 0x7fe14c0a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:33106/0 (socket says 172.21.15.5:33106) 2024-08-18T21:14:25.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 1 -- 172.21.15.5:0/2873438084 learned_addr learned my addr 172.21.15.5:0/2873438084 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:25.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 10 monclient(hunting): get_auth_request con 0x7fe14c0a6bd0 auth_method 0 2024-08-18T21:14:25.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14bfff640 1 --2- 172.21.15.5:0/2873438084 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe14c0a74f0 0x7fe14c13a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14bfff640 10 monclient(hunting): get_auth_request con 0x7fe14c0a74f0 auth_method 0 2024-08-18T21:14:25.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 10 monclient(hunting): handle_auth_done global_id 134205 payload 274 2024-08-18T21:14:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 1 -- 172.21.15.5:0/2873438084 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe14c0a74f0 msgr2=0x7fe14c13a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 1 --2- 172.21.15.5:0/2873438084 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe14c0a74f0 0x7fe14c13a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 1 -- 172.21.15.5:0/2873438084 >> v1:172.21.15.157:6789/0 conn(0x7fe14c09f080 legacy=0x7fe14c139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:14:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 1 monclient: found mon.noname-d 2024-08-18T21:14:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:14:25.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.451+0000 7fe14b7fe640 1 -- 172.21.15.5:0/2873438084 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14c09de70 con 0x7fe14c0a6bd0 2024-08-18T21:14:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe14b7fe640 1 -- 172.21.15.5:0/2873438084 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe14c0a6bd0 msgr2=0x7fe14c0a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe14b7fe640 1 --2- 172.21.15.5:0/2873438084 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe14c0a6bd0 0x7fe14c0a6fb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe1340098d0 tx=0x7fe13401cea0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=43d7b448fd9cc44a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe14a7fc640 1 -- 172.21.15.5:0/2873438084 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe1340b0070 con 0x7fe14c0a6bd0 2024-08-18T21:14:25.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe14a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe14a7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:14:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe14a7fc640 10 monclient: dump: 2024-08-18T21:14:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.459 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe14a7fc640 10 monclient: _finish_auth 0 2024-08-18T21:14:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe14a7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:14:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe14a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe14a7fc640 1 -- 172.21.15.5:0/2873438084 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1340aa810 con 0x7fe14c0a6bd0 2024-08-18T21:14:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe14a7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe14a7fc640 1 -- 172.21.15.5:0/2873438084 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe1340a9300 con 0x7fe14c0a6bd0 2024-08-18T21:14:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe1520ef640 5 monclient: authenticate success, global_id 134205 2024-08-18T21:14:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe1520ef640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe1520ef640 4 set_mon_vals no callback set 2024-08-18T21:14:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe14a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe14a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:14:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe14a7fc640 10 monclient: dump: 2024-08-18T21:14:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.461 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.461 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.461 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.461 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.461 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.461 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe1520ef640 10 monclient: shutdown 2024-08-18T21:14:25.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe1520ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:25.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe1520ef640 1 -- 172.21.15.5:0/2873438084 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe14c0a6bd0 msgr2=0x7fe14c0a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe1520ef640 1 --2- 172.21.15.5:0/2873438084 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe14c0a6bd0 0x7fe14c0a6fb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe1340098d0 tx=0x7fe13401cea0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe1520ef640 1 -- 172.21.15.5:0/2873438084 shutdown_connections 2024-08-18T21:14:25.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe1520ef640 1 --2- 172.21.15.5:0/2873438084 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe14c0a74f0 0x7fe14c13a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe1520ef640 1 --2- 172.21.15.5:0/2873438084 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fe14c0a6bd0 0x7fe14c0a6fb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe1520ef640 1 -- 172.21.15.5:0/2873438084 >> 172.21.15.5:0/2873438084 conn(0x7fe14c068700 msgr2=0x7fe14c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:25.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe1520ef640 1 -- 172.21.15.5:0/2873438084 shutdown_connections 2024-08-18T21:14:25.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.455+0000 7fe1520ef640 1 -- 172.21.15.5:0/2873438084 wait complete. 2024-08-18T21:14:25.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 10 monclient: build_initial_monmap 2024-08-18T21:14:25.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 10 monclient: monmap: 2024-08-18T21:14:25.462 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:25.462 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:25.462 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:25.462 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:25.463 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:25.463 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.463 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:25.463 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:25.463 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:25.463 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:25.463 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:25.463 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:25.463 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:25.463 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:25.463 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:25.463 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 1 Processor -- start 2024-08-18T21:14:25.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 1 -- start start 2024-08-18T21:14:25.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 10 monclient: init 2024-08-18T21:14:25.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:25.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 10 monclient: _add_conns ranks=[7,0,5,6,4,8,1,3,2] 2024-08-18T21:14:25.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe14c09f080 0x7fe14c1d1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 10 monclient(hunting): picked mon.noname-i con 0x7fe14c09f080 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:25.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c0a6bd0 0x7fe14c1d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 10 monclient(hunting): picked mon.noname-a con 0x7fe14c0a6bd0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:14:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe14c0a74f0 0x7fe14c13e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 10 monclient(hunting): picked mon.noname-h con 0x7fe14c0a74f0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c13a5e0 con 0x7fe14c0a6bd0 2024-08-18T21:14:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe14c0a89f0 con 0x7fe14c0a74f0 2024-08-18T21:14:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fe14c13a760 con 0x7fe14c09f080 2024-08-18T21:14:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe1520ef640 10 monclient(hunting): authenticate will time out at 1632.473996s 2024-08-18T21:14:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c0a6bd0 0x7fe14c1d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c0a6bd0 0x7fe14c1d1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59850/0 (socket says 172.21.15.5:59850) 2024-08-18T21:14:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 1 -- 172.21.15.5:0/2531053854 learned_addr learned my addr 172.21.15.5:0/2531053854 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 10 monclient(hunting): get_auth_request con 0x7fe14c0a6bd0 auth_method 0 2024-08-18T21:14:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14b7fe640 1 --2- 172.21.15.5:0/2531053854 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe14c09f080 0x7fe14c1d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14bfff640 1 --2- 172.21.15.5:0/2531053854 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe14c0a74f0 0x7fe14c13e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14bfff640 10 monclient(hunting): get_auth_request con 0x7fe14c0a74f0 auth_method 0 2024-08-18T21:14:25.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14b7fe640 10 monclient(hunting): get_auth_request con 0x7fe14c09f080 auth_method 0 2024-08-18T21:14:25.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 10 monclient(hunting): handle_auth_done global_id 124632 payload 824 2024-08-18T21:14:25.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 1 -- 172.21.15.5:0/2531053854 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe14c09f080 msgr2=0x7fe14c1d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 1 --2- 172.21.15.5:0/2531053854 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fe14c09f080 0x7fe14c1d1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 1 -- 172.21.15.5:0/2531053854 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe14c0a74f0 msgr2=0x7fe14c13e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 1 --2- 172.21.15.5:0/2531053854 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe14c0a74f0 0x7fe14c13e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 10 monclient: _finish_hunting 0 2024-08-18T21:14:25.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 1 monclient: found mon.noname-a 2024-08-18T21:14:25.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:25.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:14:25.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fe14affd640 1 -- 172.21.15.5:0/2531053854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14c0abb90 con 0x7fe14c0a6bd0 2024-08-18T21:14:25.470 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.470 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337915988}) 2024-08-18T21:14:25.470 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3445019614}) 2024-08-18T21:14:25.470 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.470 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337915988}) 2024-08-18T21:14:25.470 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=875295688}) 2024-08-18T21:14:25.470 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.470 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337915988}) 2024-08-18T21:14:25.470 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=149503990}) 2024-08-18T21:14:25.470 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.470 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337915988}) 2024-08-18T21:14:25.470 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3800763032}) 2024-08-18T21:14:25.471 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.471 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337915988}) 2024-08-18T21:14:25.471 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=528948658}) 2024-08-18T21:14:25.471 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.471 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337915988}) 2024-08-18T21:14:25.471 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2933460845}) 2024-08-18T21:14:25.471 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.471 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337915988}) 2024-08-18T21:14:25.471 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3095078916}) 2024-08-18T21:14:25.471 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.471 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337915988}) 2024-08-18T21:14:25.471 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.459+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1350051033}) 2024-08-18T21:14:25.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe14affd640 1 -- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c0a6bd0 msgr2=0x7fe14c1d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe14affd640 1 --2- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c0a6bd0 0x7fe14c1d1bb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00c7f0 tx=0x7fe13c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe143fff640 1 -- 172.21.15.5:0/2531053854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe13c016020 con 0x7fe14c0a6bd0 2024-08-18T21:14:25.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe143fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe143fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:14:25.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe143fff640 10 monclient: dump: 2024-08-18T21:14:25.476 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.476 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.476 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.476 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.477 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe143fff640 10 monclient: _finish_auth 0 2024-08-18T21:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe143fff640 10 monclient: _check_auth_tickets 2024-08-18T21:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe143fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe143fff640 1 -- 172.21.15.5:0/2531053854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe13c012420 con 0x7fe14c0a6bd0 2024-08-18T21:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe143fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe143fff640 1 -- 172.21.15.5:0/2531053854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe13c012a40 con 0x7fe14c0a6bd0 2024-08-18T21:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe1520ef640 5 monclient: authenticate success, global_id 124632 2024-08-18T21:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe1520ef640 10 monclient: _renew_subs 2024-08-18T21:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe1520ef640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe1520ef640 1 -- 172.21.15.5:0/2531053854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14c1233f0 con 0x7fe14c0a6bd0 2024-08-18T21:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe149ffb640 4 set_mon_vals no callback set 2024-08-18T21:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe143fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe143fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe143fff640 10 monclient: dump: 2024-08-18T21:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.480 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe1520ef640 10 monclient: _renew_subs 2024-08-18T21:14:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe1520ef640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe1520ef640 1 -- 172.21.15.5:0/2531053854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe14c1d20f0 con 0x7fe14c0a6bd0 2024-08-18T21:14:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe1520ef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe1520ef640 1 --2- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe14c13ecb0 0x7fe14c13f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe1520ef640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe1520ef640 1 -- 172.21.15.5:0/2531053854 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fe14c051140 con 0x7fe14c13ecb0 2024-08-18T21:14:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe14b7fe640 1 --2- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe14c13ecb0 0x7fe14c13f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe143fff640 1 -- 172.21.15.5:0/2531053854 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe13c019020 con 0x7fe14c0a6bd0 2024-08-18T21:14:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe14b7fe640 10 monclient: get_auth_request con 0x7fe14c13ecb0 auth_method 0 2024-08-18T21:14:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe14b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe14b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe14b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe14b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe14b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe14b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe143fff640 1 --2- 172.21.15.5:0/2531053854 >> v2:172.21.15.157:6812/631023601 conn(0x7fe12c03bdc0 0x7fe12c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe143fff640 1 -- 172.21.15.5:0/2531053854 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(299..299 src has 22..299) ==== 3898+0+0 (secure 0 0 0) 0x7fe13c04e6c0 con 0x7fe14c0a6bd0 2024-08-18T21:14:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe14b7fe640 10 monclient(hunting): handle_auth_done global_id 115082 payload 824 2024-08-18T21:14:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe14b7fe640 1 -- 172.21.15.5:0/2531053854 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe14c123d70 con 0x7fe14c13ecb0 2024-08-18T21:14:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe14bfff640 1 --2- 172.21.15.5:0/2531053854 >> v2:172.21.15.157:6812/631023601 conn(0x7fe12c03bdc0 0x7fe12c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.463+0000 7fe14bfff640 10 monclient: get_auth_request con 0x7fe12c03bdc0 auth_method 0 2024-08-18T21:14:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.467+0000 7fe14b7fe640 1 -- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe14c13ecb0 msgr2=0x7fe14c13f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.467+0000 7fe14b7fe640 1 --2- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe14c13ecb0 0x7fe14c13f090 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe1340ad000 tx=0x7fe1340191e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.467+0000 7fe143fff640 1 -- 172.21.15.5:0/2531053854 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe1340b9020 con 0x7fe14c13ecb0 2024-08-18T21:14:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.467+0000 7fe143fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.467+0000 7fe143fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:14:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.467+0000 7fe143fff640 10 monclient: dump: 2024-08-18T21:14:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.483 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.467+0000 7fe143fff640 1 -- 172.21.15.5:0/2531053854 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe1340b1040 con 0x7fe14c13ecb0 2024-08-18T21:14:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.467+0000 7fe143fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.467+0000 7fe143fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.467+0000 7fe143fff640 1 -- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe14c13ecb0 msgr2=0x7fe14c13f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.467+0000 7fe143fff640 1 --2- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe14c13ecb0 0x7fe14c13f090 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe1340ad000 tx=0x7fe1340191e0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.467+0000 7fe143fff640 1 -- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe14c13ecb0 msgr2=0x7fe14c13f090 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.467+0000 7fe143fff640 1 --2- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe14c13ecb0 0x7fe14c13f090 secure :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe1340ad000 tx=0x7fe1340191e0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.467+0000 7fe14bfff640 1 --2- 172.21.15.5:0/2531053854 >> v2:172.21.15.157:6812/631023601 conn(0x7fe12c03bdc0 0x7fe12c03e280 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe144009a50 tx=0x7fe144008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.471+0000 7fe1520ef640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.471+0000 7fe1520ef640 1 --2- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe14c13f5d0 0x7fe14c13ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.471+0000 7fe1520ef640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.471+0000 7fe1520ef640 1 -- 172.21.15.5:0/2531053854 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fe14c0746d0 con 0x7fe14c13f5d0 2024-08-18T21:14:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.471+0000 7fe14b7fe640 1 --2- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe14c13f5d0 0x7fe14c13ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.471+0000 7fe14b7fe640 10 monclient: get_auth_request con 0x7fe14c13f5d0 auth_method 0 2024-08-18T21:14:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.471+0000 7fe14b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.471+0000 7fe14b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.471+0000 7fe14b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.471+0000 7fe14b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.471+0000 7fe14b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.471+0000 7fe14b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe14b7fe640 10 monclient(hunting): handle_auth_done global_id 115091 payload 824 2024-08-18T21:14:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe14b7fe640 1 -- 172.21.15.5:0/2531053854 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe14c0a6fb0 con 0x7fe14c13f5d0 2024-08-18T21:14:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe14b7fe640 1 -- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe14c13f5d0 msgr2=0x7fe14c13ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe14b7fe640 1 --2- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe14c13f5d0 0x7fe14c13ab60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe134000c10 tx=0x7fe1340a6000 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe143fff640 1 -- 172.21.15.5:0/2531053854 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe1340b9040 con 0x7fe14c13f5d0 2024-08-18T21:14:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe143fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe143fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:14:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe143fff640 10 monclient: dump: 2024-08-18T21:14:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.487 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe143fff640 1 -- 172.21.15.5:0/2531053854 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7fe1340c0d20 con 0x7fe14c13f5d0 2024-08-18T21:14:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe143fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe143fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe143fff640 1 -- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe14c13f5d0 msgr2=0x7fe14c13ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe143fff640 1 --2- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe14c13f5d0 0x7fe14c13ab60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe134000c10 tx=0x7fe1340a6000 comp rx=0 tx=0).stop 2024-08-18T21:14:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe143fff640 1 -- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe14c13f5d0 msgr2=0x7fe14c13ab60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe143fff640 1 --2- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fe14c13f5d0 0x7fe14c13ab60 secure :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe134000c10 tx=0x7fe1340a6000 comp rx=0 tx=0).stop 2024-08-18T21:14:25.488 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:25.488 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:25.488 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:25.488 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:25.488 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:25.489 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 170642, 2024-08-18T21:14:25.489 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:25.489 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:25.489 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:25.489 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:25.489 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:25.489 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:25.489 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:25.489 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:25.489 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:25.489 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:25.489 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.489 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 4, 2024-08-18T21:14:25.490 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:25.490 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:25.490 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:25.490 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:25.490 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:25.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:25.490 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:25.490 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:25.490 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:25.490 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:25.490 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:25.490 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:25.491 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:25.491 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:25.491 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.491 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:25.491 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:25.491 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:25.491 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:25.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:25.491 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:25.491 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:25.491 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:25.491 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:25.491 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:25.492 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:25.492 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:25.492 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:25.492 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.492 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:25.492 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:25.492 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:25.492 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:25.492 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:25.492 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:25.492 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:25.492 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:25.493 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:25.493 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:25.493 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:25.493 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:25.493 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:25.493 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:25.493 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:25.493 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:25.493 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:25.493 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:25.493 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:25.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:25.493 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:25.494 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:25.494 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:25.494 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:25.494 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:25.494 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:25.494 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:25.494 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:25.494 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.494 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:25.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.494 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:25.494 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.494 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:25.495 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:25.495 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.495 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.495 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.495 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:25.495 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.495 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.495 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:25.495 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.495 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.496 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.496 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:25.496 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:25.496 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.496 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.496 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.496 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.496 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:25.496 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:25.496 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.496 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:25.497 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:25.497 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.497 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.497 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.497 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:25.497 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:25.498 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.498 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.498 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.498 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:25.498 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:25.498 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.498 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.498 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.498 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:25.499 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.499 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.499 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:25.499 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.499 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.499 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.499 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:25.499 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:25.499 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.499 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.499 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.500 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:25.500 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:25.500 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:25.500 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.500 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:25.501 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.501 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.501 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.501 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:25.501 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:25.501 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.501 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.501 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.501 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.501 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:25.501 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.503 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:25.503 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:25.503 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.503 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.503 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.503 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:25.503 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:25.503 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.503 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.503 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:25.504 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:25.504 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.504 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.504 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.504 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:25.504 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:25.504 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.505 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.505 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.505 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:25.505 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:25.505 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.505 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.505 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.505 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:25.505 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.506 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.506 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:25.506 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.506 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.506 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.506 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:25.506 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:25.506 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.506 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.506 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.507 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:25.507 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:25.507 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.507 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.507 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.507 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:25.507 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.507 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.507 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:25.507 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.508 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.508 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.508 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:25.508 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:25.508 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.508 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.508 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.508 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.508 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:25.508 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:25.508 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.509 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.509 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.509 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:25.509 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.509 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.509 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:25.509 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.509 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.509 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.509 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:25.510 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:25.510 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.510 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.510 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.510 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.510 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.510 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:25.510 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:25.510 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.510 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:25.510 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:25.510 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:25.511 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.511 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.511 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:25.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.511 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:25.511 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:25.511 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:14:25.511 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.511 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.511 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:25.511 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe1520ef640 1 -- 172.21.15.5:0/2531053854 >> v2:172.21.15.157:6812/631023601 conn(0x7fe12c03bdc0 msgr2=0x7fe12c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe1520ef640 1 --2- 172.21.15.5:0/2531053854 >> v2:172.21.15.157:6812/631023601 conn(0x7fe12c03bdc0 0x7fe12c03e280 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe144009a50 tx=0x7fe144008040 comp rx=0 tx=0).stop 2024-08-18T21:14:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe1520ef640 10 monclient: shutdown 2024-08-18T21:14:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe1520ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe1520ef640 1 -- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c0a6bd0 msgr2=0x7fe14c1d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe1520ef640 1 --2- 172.21.15.5:0/2531053854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c0a6bd0 0x7fe14c1d1bb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00c7f0 tx=0x7fe13c00ccb0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe14bfff640 1 -- 172.21.15.5:0/2531053854 reap_dead start 2024-08-18T21:14:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe14bfff640 1 -- 172.21.15.5:0/2531053854 reap_dead start 2024-08-18T21:14:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe1520ef640 1 -- 172.21.15.5:0/2531053854 shutdown_connections 2024-08-18T21:14:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe1520ef640 1 -- 172.21.15.5:0/2531053854 >> 172.21.15.5:0/2531053854 conn(0x7fe14c068700 msgr2=0x7fe14c0aa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe1520ef640 1 -- 172.21.15.5:0/2531053854 shutdown_connections 2024-08-18T21:14:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.475+0000 7fe1520ef640 1 -- 172.21.15.5:0/2531053854 wait complete. 2024-08-18T21:14:25.514 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:25.514 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:14:25.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:14:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 10 monclient: get_monmap_and_config 2024-08-18T21:14:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 10 monclient: build_initial_monmap 2024-08-18T21:14:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 10 monclient: monmap: 2024-08-18T21:14:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:25.636584+0000 2024-08-18T21:14:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:25.636584+0000 2024-08-18T21:14:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:25.634 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 1 Processor -- start 2024-08-18T21:14:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 1 -- start start 2024-08-18T21:14:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 10 monclient: init 2024-08-18T21:14:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 10 monclient: _add_conns ranks=[4,6,3,8,2,5,10,1,9,0,7] 2024-08-18T21:14:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f694409da30 0x7f694409de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 10 monclient(hunting): picked mon.noname-c con 0x7f694409da30 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f69440a53c0 0x7f694409e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 10 monclient(hunting): picked mon.noname-d con 0x7f69440a53c0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:14:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69441366a0 0x7f6944136b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 10 monclient(hunting): picked mon.noname-g con 0x7f69441366a0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f694409ef00 con 0x7f69441366a0 2024-08-18T21:14:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f694409e890 con 0x7f694409da30 2024-08-18T21:14:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f694409fdd0 con 0x7f69440a53c0 2024-08-18T21:14:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694a37e640 10 monclient(hunting): authenticate will time out at 1632.649832s 2024-08-18T21:14:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f69437fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f69440a53c0 0x7f694409e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f694409da30 0x7f694409de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f69437fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f69440a53c0 0x7f694409e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:33108/0 (socket says 172.21.15.5:33108) 2024-08-18T21:14:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f694409da30 0x7f694409de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:54100/0 (socket says 172.21.15.5:54100) 2024-08-18T21:14:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f69437fe640 1 -- 172.21.15.5:0/2296695076 learned_addr learned my addr 172.21.15.5:0/2296695076 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f69437fe640 10 monclient(hunting): get_auth_request con 0x7f69440a53c0 auth_method 0 2024-08-18T21:14:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f69437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f69437fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f69437fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 10 monclient(hunting): get_auth_request con 0x7f694409da30 auth_method 0 2024-08-18T21:14:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f69437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f69437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f69437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694891b640 1 --2- 172.21.15.5:0/2296695076 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69441366a0 0x7f6944136b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694891b640 10 monclient(hunting): get_auth_request con 0x7f69441366a0 auth_method 0 2024-08-18T21:14:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694891b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694891b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f694891b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 10 monclient(hunting): handle_auth_done global_id 114790 payload 274 2024-08-18T21:14:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 1 -- 172.21.15.5:0/2296695076 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f69440a53c0 msgr2=0x7f694409e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 1 --2- 172.21.15.5:0/2296695076 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f69440a53c0 0x7f694409e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 1 -- 172.21.15.5:0/2296695076 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69441366a0 msgr2=0x7f6944136b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 1 --2- 172.21.15.5:0/2296695076 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69441366a0 0x7f6944136b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 10 monclient: _finish_hunting 0 2024-08-18T21:14:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 1 monclient: found mon.noname-c 2024-08-18T21:14:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:14:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f6943fff640 1 -- 172.21.15.5:0/2296695076 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69440a5140 con 0x7f694409da30 2024-08-18T21:14:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.635+0000 7f69437fe640 1 --2- 172.21.15.5:0/2296695076 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f69440a53c0 0x7f694409e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:14:25.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f6943fff640 1 -- 172.21.15.5:0/2296695076 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f694409da30 msgr2=0x7f694409de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f6943fff640 1 --2- 172.21.15.5:0/2296695076 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f694409da30 0x7f694409de10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f693c009df0 tx=0x7f693c01c850 comp rx=0 tx=0).ready entity=mon.4 client_cookie=460d3dd20677a328 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f6942ffd640 1 -- 172.21.15.5:0/2296695076 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f693c0ad070 con 0x7f694409da30 2024-08-18T21:14:25.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f6942ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f6942ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:14:25.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f6942ffd640 10 monclient: dump: 2024-08-18T21:14:25.648 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.648 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.649 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.649 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.649 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.649 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.649 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.649 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.649 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.649 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.649 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.649 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.649 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.649 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.649 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.649 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f6942ffd640 10 monclient: _finish_auth 0 2024-08-18T21:14:25.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f6942ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:14:25.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f6942ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:25.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f694a37e640 5 monclient: authenticate success, global_id 114790 2024-08-18T21:14:25.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f694a37e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:14:25.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f6942ffd640 1 -- 172.21.15.5:0/2296695076 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693c0a98b0 con 0x7f694409da30 2024-08-18T21:14:25.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f6942ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:25.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f6942ffd640 1 -- 172.21.15.5:0/2296695076 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f693c0a83a0 con 0x7f694409da30 2024-08-18T21:14:25.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f6942ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f6942ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:25.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f6942ffd640 10 monclient: dump: 2024-08-18T21:14:25.650 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.650 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.651 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.651 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.651 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.651 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.651 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.651 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.651 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.651 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.651 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.651 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.651 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.651 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.651 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.652 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f694a37e640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:25.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.639+0000 7f694a37e640 4 set_mon_vals no callback set 2024-08-18T21:14:25.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 10 monclient: shutdown 2024-08-18T21:14:25.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:25.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 -- 172.21.15.5:0/2296695076 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f694409da30 msgr2=0x7f694409de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 --2- 172.21.15.5:0/2296695076 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f694409da30 0x7f694409de10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f693c009df0 tx=0x7f693c01c850 comp rx=0 tx=0).stop 2024-08-18T21:14:25.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 -- 172.21.15.5:0/2296695076 shutdown_connections 2024-08-18T21:14:25.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 --2- 172.21.15.5:0/2296695076 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69441366a0 0x7f6944136b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 --2- 172.21.15.5:0/2296695076 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f69440a53c0 0x7f694409e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 --2- 172.21.15.5:0/2296695076 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f694409da30 0x7f694409de10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 -- 172.21.15.5:0/2296695076 >> 172.21.15.5:0/2296695076 conn(0x7f6944068700 msgr2=0x7f6944068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:25.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 -- 172.21.15.5:0/2296695076 shutdown_connections 2024-08-18T21:14:25.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 -- 172.21.15.5:0/2296695076 wait complete. 2024-08-18T21:14:25.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 10 monclient: build_initial_monmap 2024-08-18T21:14:25.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 10 monclient: monmap: 2024-08-18T21:14:25.653 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:25.653 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:25.653 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:25.653 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:25.653 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:25.653 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.653 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:25.653 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:25.653 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:25.653 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:25.653 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:25.654 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:25.654 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:25.654 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:25.654 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:25.654 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 Processor -- start 2024-08-18T21:14:25.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 -- start start 2024-08-18T21:14:25.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 10 monclient: init 2024-08-18T21:14:25.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:25.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 10 monclient: _add_conns ranks=[0,1,7,3,4,2,8,6,5] 2024-08-18T21:14:25.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694409da30 0x7f694413b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 10 monclient(hunting): picked mon.noname-a con 0x7f694409da30 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:14:25.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69440a53c0 0x7f694413bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 10 monclient(hunting): picked mon.noname-f con 0x7f69440a53c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:14:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69441366a0 0x7f694413c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 10 monclient(hunting): picked mon.noname-i con 0x7f69441366a0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f69440a33d0 con 0x7f694409da30 2024-08-18T21:14:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f69440a3250 con 0x7f69440a53c0 2024-08-18T21:14:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f694406d160 con 0x7f69441366a0 2024-08-18T21:14:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694a37e640 10 monclient(hunting): authenticate will time out at 1632.657942s 2024-08-18T21:14:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694409da30 0x7f694413b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694409da30 0x7f694413b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59856/0 (socket says 172.21.15.5:59856) 2024-08-18T21:14:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 1 -- 172.21.15.5:0/3329987999 learned_addr learned my addr 172.21.15.5:0/3329987999 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 10 monclient(hunting): get_auth_request con 0x7f694409da30 auth_method 0 2024-08-18T21:14:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f69437fe640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69440a53c0 0x7f694413bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694891b640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69441366a0 0x7f694413c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f69437fe640 10 monclient(hunting): get_auth_request con 0x7f69440a53c0 auth_method 0 2024-08-18T21:14:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f69437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f69437fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f69437fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 10 monclient(hunting): handle_auth_done global_id 124641 payload 824 2024-08-18T21:14:25.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 1 -- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69441366a0 msgr2=0x7f694413c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69441366a0 0x7f694413c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 1 -- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69440a53c0 msgr2=0x7f694413bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69440a53c0 0x7f694413bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 10 monclient: _finish_hunting 0 2024-08-18T21:14:25.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 1 monclient: found mon.noname-a 2024-08-18T21:14:25.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:25.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:14:25.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f6943fff640 1 -- 172.21.15.5:0/3329987999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69440a2220 con 0x7f694409da30 2024-08-18T21:14:25.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694891b640 10 monclient: get_auth_request con 0x7f69441366a0 auth_method 0 2024-08-18T21:14:25.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.643+0000 7f694891b640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f69441366a0 0x7f694413c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:14:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6943fff640 1 -- 172.21.15.5:0/3329987999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694409da30 msgr2=0x7f694413b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6943fff640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694409da30 0x7f694413b610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f693c009d60 tx=0x7f693c0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6940ff9640 1 -- 172.21.15.5:0/3329987999 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f693c0ad050 con 0x7f694409da30 2024-08-18T21:14:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6940ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6940ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:14:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6940ff9640 10 monclient: dump: 2024-08-18T21:14:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.660 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6940ff9640 10 monclient: _finish_auth 0 2024-08-18T21:14:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6940ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:14:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6940ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6940ff9640 1 -- 172.21.15.5:0/3329987999 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693c003bb0 con 0x7f694409da30 2024-08-18T21:14:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f694a37e640 5 monclient: authenticate success, global_id 124641 2024-08-18T21:14:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f694a37e640 10 monclient: _renew_subs 2024-08-18T21:14:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f694a37e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f694a37e640 1 -- 172.21.15.5:0/3329987999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6944120730 con 0x7f694409da30 2024-08-18T21:14:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6940ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6940ff9640 1 -- 172.21.15.5:0/3329987999 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f693c003d60 con 0x7f694409da30 2024-08-18T21:14:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6940ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6940ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:14:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6940ff9640 10 monclient: dump: 2024-08-18T21:14:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.662 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f694a37e640 10 monclient: _renew_subs 2024-08-18T21:14:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f694a37e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f694a37e640 1 -- 172.21.15.5:0/3329987999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69440a1cf0 con 0x7f694409da30 2024-08-18T21:14:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6941ffb640 4 set_mon_vals no callback set 2024-08-18T21:14:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f694a37e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f694a37e640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f694413c5d0 0x7f6944137930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f694a37e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f694a37e640 1 -- 172.21.15.5:0/3329987999 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6944136370 con 0x7f694413c5d0 2024-08-18T21:14:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6940ff9640 1 -- 172.21.15.5:0/3329987999 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f693c0c3020 con 0x7f694409da30 2024-08-18T21:14:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f69437fe640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f694413c5d0 0x7f6944137930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f69437fe640 10 monclient: get_auth_request con 0x7f694413c5d0 auth_method 0 2024-08-18T21:14:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f69437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f69437fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f69437fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6940ff9640 1 --2- 172.21.15.5:0/3329987999 >> v2:172.21.15.157:6812/631023601 conn(0x7f693003bdc0 0x7f693003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f69437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f69437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f69437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f6940ff9640 1 -- 172.21.15.5:0/3329987999 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(299..299 src has 22..299) ==== 3898+0+0 (secure 0 0 0) 0x7f693c0b8030 con 0x7f694409da30 2024-08-18T21:14:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f694891b640 1 --2- 172.21.15.5:0/3329987999 >> v2:172.21.15.157:6812/631023601 conn(0x7f693003bdc0 0x7f693003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f694891b640 10 monclient: get_auth_request con 0x7f693003bdc0 auth_method 0 2024-08-18T21:14:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f69437fe640 10 monclient(hunting): handle_auth_done global_id 134254 payload 824 2024-08-18T21:14:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.647+0000 7f69437fe640 1 -- 172.21.15.5:0/3329987999 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6944068d00 con 0x7f694413c5d0 2024-08-18T21:14:25.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.651+0000 7f69437fe640 1 -- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f694413c5d0 msgr2=0x7f6944137930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.651+0000 7f69437fe640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f694413c5d0 0x7f6944137930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f694406e500 tx=0x7f6938011a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.651+0000 7f694891b640 1 --2- 172.21.15.5:0/3329987999 >> v2:172.21.15.157:6812/631023601 conn(0x7f693003bdc0 0x7f693003e280 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f694413c9f0 tx=0x7f6934008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.651+0000 7f6940ff9640 1 -- 172.21.15.5:0/3329987999 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6938015dd0 con 0x7f694413c5d0 2024-08-18T21:14:25.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.651+0000 7f6940ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.651+0000 7f6940ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:14:25.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.651+0000 7f6940ff9640 10 monclient: dump: 2024-08-18T21:14:25.666 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.668 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.651+0000 7f6940ff9640 1 -- 172.21.15.5:0/3329987999 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6938015960 con 0x7f694413c5d0 2024-08-18T21:14:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.651+0000 7f6940ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.651+0000 7f6940ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.651+0000 7f6940ff9640 1 -- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f694413c5d0 msgr2=0x7f6944137930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.651+0000 7f6940ff9640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f694413c5d0 0x7f6944137930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f694406e500 tx=0x7f6938011a60 comp rx=0 tx=0).stop 2024-08-18T21:14:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.651+0000 7f6940ff9640 1 -- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f694413c5d0 msgr2=0x7f6944137930 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.651+0000 7f6940ff9640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f694413c5d0 0x7f6944137930 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f694406e500 tx=0x7f6938011a60 comp rx=0 tx=0).stop 2024-08-18T21:14:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.659+0000 7f694a37e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.659+0000 7f694a37e640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6944137e70 0x7f6944138280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.659+0000 7f694a37e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.659+0000 7f694a37e640 1 -- 172.21.15.5:0/3329987999 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6944051140 con 0x7f6944137e70 2024-08-18T21:14:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.659+0000 7f69437fe640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6944137e70 0x7f6944138280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.659+0000 7f69437fe640 10 monclient: get_auth_request con 0x7f6944137e70 auth_method 0 2024-08-18T21:14:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.659+0000 7f69437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.659+0000 7f69437fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.659+0000 7f69437fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.659+0000 7f69437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.659+0000 7f69437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.659+0000 7f69437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.659+0000 7f69437fe640 10 monclient(hunting): handle_auth_done global_id 134263 payload 824 2024-08-18T21:14:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.659+0000 7f69437fe640 1 -- 172.21.15.5:0/3329987999 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f694406d4f0 con 0x7f6944137e70 2024-08-18T21:14:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f69437fe640 1 -- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6944137e70 msgr2=0x7f6944138280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f69437fe640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6944137e70 0x7f6944138280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6938000c10 tx=0x7f69380046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f6940ff9640 1 -- 172.21.15.5:0/3329987999 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f69380066c0 con 0x7f6944137e70 2024-08-18T21:14:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f6940ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f6940ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:14:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f6940ff9640 10 monclient: dump: 2024-08-18T21:14:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.671 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f6940ff9640 1 -- 172.21.15.5:0/3329987999 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f6938026070 con 0x7f6944137e70 2024-08-18T21:14:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f6940ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f6940ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f6940ff9640 1 -- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6944137e70 msgr2=0x7f6944138280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f6940ff9640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6944137e70 0x7f6944138280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6938000c10 tx=0x7f69380046d0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f6940ff9640 1 -- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6944137e70 msgr2=0x7f6944138280 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f6940ff9640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6944137e70 0x7f6944138280 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6938000c10 tx=0x7f69380046d0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.672 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:25.672 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 25123, 2024-08-18T21:14:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:14:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:25.679 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:25.679 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.679 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.679 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.679 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:25.679 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:25.684 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:25.684 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.684 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.684 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.684 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:25.684 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:25.685 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.685 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.685 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.685 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:25.685 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.685 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.685 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:25.685 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:25.688 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:25.688 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.688 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.688 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.688 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:25.688 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:25.688 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:25.689 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:25.690 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.690 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.690 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:25.690 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:25.690 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.690 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.690 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:25.697 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:25.697 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.697 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.697 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:25.697 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f694a37e640 1 -- 172.21.15.5:0/3329987999 >> v2:172.21.15.157:6812/631023601 conn(0x7f693003bdc0 msgr2=0x7f693003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f694a37e640 1 --2- 172.21.15.5:0/3329987999 >> v2:172.21.15.157:6812/631023601 conn(0x7f693003bdc0 0x7f693003e280 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f694413c9f0 tx=0x7f6934008040 comp rx=0 tx=0).stop 2024-08-18T21:14:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f694a37e640 10 monclient: shutdown 2024-08-18T21:14:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f694a37e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f694a37e640 1 -- 172.21.15.5:0/3329987999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694409da30 msgr2=0x7f694413b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f694a37e640 1 --2- 172.21.15.5:0/3329987999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694409da30 0x7f694413b610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f693c009d60 tx=0x7f693c0195f0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f694891b640 1 -- 172.21.15.5:0/3329987999 reap_dead start 2024-08-18T21:14:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f694891b640 1 -- 172.21.15.5:0/3329987999 reap_dead start 2024-08-18T21:14:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f694a37e640 1 -- 172.21.15.5:0/3329987999 shutdown_connections 2024-08-18T21:14:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f694a37e640 1 -- 172.21.15.5:0/3329987999 >> 172.21.15.5:0/3329987999 conn(0x7f6944068700 msgr2=0x7f69440a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f694a37e640 1 -- 172.21.15.5:0/3329987999 shutdown_connections 2024-08-18T21:14:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.663+0000 7f694a37e640 1 -- 172.21.15.5:0/3329987999 wait complete. 2024-08-18T21:14:25.699 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:25.700 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:14:25.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:14:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 10 monclient: get_monmap_and_config 2024-08-18T21:14:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 10 monclient: build_initial_monmap 2024-08-18T21:14:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 10 monclient: monmap: 2024-08-18T21:14:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:25.821883+0000 2024-08-18T21:14:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:25.821883+0000 2024-08-18T21:14:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:25.819 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 1 Processor -- start 2024-08-18T21:14:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 1 -- start start 2024-08-18T21:14:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 10 monclient: init 2024-08-18T21:14:25.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:25.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 10 monclient: _add_conns ranks=[10,2,0,3,5,7,8,4,9,6,1] 2024-08-18T21:14:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f97280a6ce0 0x7f97280a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 10 monclient(hunting): picked mon.noname-f con 0x7f97280a6ce0 addr v2:172.21.15.157:3300/0 2024-08-18T21:14:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97280a7600 0x7f9728139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 10 monclient(hunting): picked mon.noname-b con 0x7f97280a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9728139fe0 addr v1:172.21.15.5:6789/0 2024-08-18T21:14:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97280a45d0 con 0x7f9728139fe0 2024-08-18T21:14:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f97280a5000 con 0x7f97280a6ce0 2024-08-18T21:14:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f97280a4360 con 0x7f97280a7600 2024-08-18T21:14:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f9730303640 10 monclient(hunting): authenticate will time out at 1632.834860s 2024-08-18T21:14:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97280a7600 0x7f9728139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97280a7600 0x7f9728139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:48464/0 (socket says 172.21.15.5:48464) 2024-08-18T21:14:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972e8a0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9728139fe0 0x7f9728140cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51592/0 (socket says 172.21.15.5:51592) 2024-08-18T21:14:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 1 -- 172.21.15.5:0/1437634157 learned_addr learned my addr 172.21.15.5:0/1437634157 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 10 monclient(hunting): get_auth_request con 0x7f97280a7600 auth_method 0 2024-08-18T21:14:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972e09f640 1 --2- 172.21.15.5:0/1437634157 >> v2:172.21.15.157:3300/0 conn(0x7f97280a6ce0 0x7f97280a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972e09f640 10 monclient(hunting): get_auth_request con 0x7f97280a6ce0 auth_method 0 2024-08-18T21:14:25.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972e09f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972e09f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972e09f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 10 monclient(hunting): handle_auth_done global_id 114905 payload 274 2024-08-18T21:14:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 1 -- 172.21.15.5:0/1437634157 >> v2:172.21.15.157:3300/0 conn(0x7f97280a6ce0 msgr2=0x7f97280a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 1 --2- 172.21.15.5:0/1437634157 >> v2:172.21.15.157:3300/0 conn(0x7f97280a6ce0 0x7f97280a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 1 -- 172.21.15.5:0/1437634157 >> v1:172.21.15.5:6789/0 conn(0x7f9728139fe0 legacy=0x7f9728140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 10 monclient: _finish_hunting 0 2024-08-18T21:14:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 1 monclient: found mon.noname-b 2024-08-18T21:14:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:14:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.819+0000 7f972d89e640 1 -- 172.21.15.5:0/1437634157 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97280a8900 con 0x7f97280a7600 2024-08-18T21:14:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f972d89e640 1 -- 172.21.15.5:0/1437634157 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97280a7600 msgr2=0x7f9728139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f972d89e640 1 --2- 172.21.15.5:0/1437634157 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97280a7600 0x7f9728139aa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9718009870 tx=0x7f971801c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8830775f2b1a75b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f972d09d640 1 -- 172.21.15.5:0/1437634157 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97180b1070 con 0x7f97280a7600 2024-08-18T21:14:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f972d09d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f972d09d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:14:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f972d09d640 10 monclient: dump: 2024-08-18T21:14:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.833 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f972d09d640 10 monclient: _finish_auth 0 2024-08-18T21:14:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f972d09d640 10 monclient: _check_auth_tickets 2024-08-18T21:14:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f972d09d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f972d09d640 1 -- 172.21.15.5:0/1437634157 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97180ab830 con 0x7f97280a7600 2024-08-18T21:14:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f972d09d640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f972d09d640 1 -- 172.21.15.5:0/1437634157 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97180abe50 con 0x7f97280a7600 2024-08-18T21:14:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f9730303640 5 monclient: authenticate success, global_id 114905 2024-08-18T21:14:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f9730303640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f9730303640 4 set_mon_vals no callback set 2024-08-18T21:14:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f972d09d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f972d09d640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:14:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.823+0000 7f972d09d640 10 monclient: dump: 2024-08-18T21:14:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.836 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 10 monclient: shutdown 2024-08-18T21:14:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 1 -- 172.21.15.5:0/1437634157 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97280a7600 msgr2=0x7f9728139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 1 --2- 172.21.15.5:0/1437634157 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97280a7600 0x7f9728139aa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9718009870 tx=0x7f971801c420 comp rx=0 tx=0).stop 2024-08-18T21:14:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 1 -- 172.21.15.5:0/1437634157 shutdown_connections 2024-08-18T21:14:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 1 --2- 172.21.15.5:0/1437634157 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97280a7600 0x7f9728139aa0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 1 --2- 172.21.15.5:0/1437634157 >> v2:172.21.15.157:3300/0 conn(0x7f97280a6ce0 0x7f97280a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 1 -- 172.21.15.5:0/1437634157 >> 172.21.15.5:0/1437634157 conn(0x7f97280acbc0 msgr2=0x7f97280a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 1 -- 172.21.15.5:0/1437634157 shutdown_connections 2024-08-18T21:14:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 1 -- 172.21.15.5:0/1437634157 wait complete. 2024-08-18T21:14:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 10 monclient: build_initial_monmap 2024-08-18T21:14:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 10 monclient: monmap: 2024-08-18T21:14:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:25.840 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 1 Processor -- start 2024-08-18T21:14:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 1 -- start start 2024-08-18T21:14:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 10 monclient: init 2024-08-18T21:14:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 10 monclient: _add_conns ranks=[2,7,1,6,5,8,3,0,4] 2024-08-18T21:14:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97280a6ce0 0x7f9728135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 10 monclient(hunting): picked mon.noname-b con 0x7f97280a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f97280a7600 0x7f9728136230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 10 monclient(hunting): picked mon.noname-i con 0x7f97280a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9728139fe0 0x7f972813b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 10 monclient(hunting): picked mon.noname-f con 0x7f9728139fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:14:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f97280a79e0 con 0x7f9728139fe0 2024-08-18T21:14:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f97280a9810 con 0x7f97280a6ce0 2024-08-18T21:14:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f97280aa840 con 0x7f97280a7600 2024-08-18T21:14:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f9730303640 10 monclient(hunting): authenticate will time out at 1632.842002s 2024-08-18T21:14:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97280a6ce0 0x7f9728135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97280a6ce0 0x7f9728135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:48468/0 (socket says 172.21.15.5:48468) 2024-08-18T21:14:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 1 -- 172.21.15.5:0/1857440328 learned_addr learned my addr 172.21.15.5:0/1857440328 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 10 monclient(hunting): get_auth_request con 0x7f97280a6ce0 auth_method 0 2024-08-18T21:14:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e8a0640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9728139fe0 0x7f972813b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972d89e640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f97280a7600 0x7f9728136230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 10 monclient(hunting): handle_auth_done global_id 114914 payload 824 2024-08-18T21:14:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 1 -- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f97280a7600 msgr2=0x7f9728136230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f97280a7600 0x7f9728136230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 1 -- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9728139fe0 msgr2=0x7f972813b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9728139fe0 0x7f972813b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 10 monclient: _finish_hunting 0 2024-08-18T21:14:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 1 monclient: found mon.noname-b 2024-08-18T21:14:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:14:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e09f640 1 -- 172.21.15.5:0/1857440328 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9728142140 con 0x7f97280a6ce0 2024-08-18T21:14:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e8a0640 10 monclient: get_auth_request con 0x7f9728139fe0 auth_method 0 2024-08-18T21:14:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.827+0000 7f972e8a0640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9728139fe0 0x7f972813b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:14:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f972e09f640 1 -- 172.21.15.5:0/1857440328 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97280a6ce0 msgr2=0x7f9728135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f972e09f640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97280a6ce0 0x7f9728135cf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f972400d830 tx=0x7f972400dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f971effd640 1 -- 172.21.15.5:0/1857440328 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f972400bd40 con 0x7f97280a6ce0 2024-08-18T21:14:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f971effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f971effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:14:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f971effd640 10 monclient: dump: 2024-08-18T21:14:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.846 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f971effd640 10 monclient: _finish_auth 0 2024-08-18T21:14:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f971effd640 10 monclient: _check_auth_tickets 2024-08-18T21:14:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f971effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f971effd640 1 -- 172.21.15.5:0/1857440328 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9724019070 con 0x7f97280a6ce0 2024-08-18T21:14:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f971effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f971effd640 1 -- 172.21.15.5:0/1857440328 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97240148a0 con 0x7f97280a6ce0 2024-08-18T21:14:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f9730303640 5 monclient: authenticate success, global_id 114914 2024-08-18T21:14:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f9730303640 10 monclient: _renew_subs 2024-08-18T21:14:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f9730303640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:14:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f9730303640 1 -- 172.21.15.5:0/1857440328 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f972813d140 con 0x7f97280a6ce0 2024-08-18T21:14:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f971effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f972c89c640 4 set_mon_vals no callback set 2024-08-18T21:14:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f971effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:14:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f971effd640 10 monclient: dump: 2024-08-18T21:14:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.848 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f9730303640 10 monclient: _renew_subs 2024-08-18T21:14:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f9730303640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:14:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f9730303640 1 -- 172.21.15.5:0/1857440328 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9728141990 con 0x7f97280a6ce0 2024-08-18T21:14:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f9730303640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f9730303640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f972813bd00 0x7f972813c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f9730303640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f9730303640 1 -- 172.21.15.5:0/1857440328 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f97280a7b60 con 0x7f972813bd00 2024-08-18T21:14:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f971effd640 1 -- 172.21.15.5:0/1857440328 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f9724014430 con 0x7f97280a6ce0 2024-08-18T21:14:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f972d89e640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f972813bd00 0x7f972813c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f972d89e640 10 monclient: get_auth_request con 0x7f972813bd00 auth_method 0 2024-08-18T21:14:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f972d89e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f972d89e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f972d89e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f971effd640 1 --2- 172.21.15.5:0/1857440328 >> v2:172.21.15.157:6812/631023601 conn(0x7f970c03bdf0 0x7f970c03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f972d89e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f972d89e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f971effd640 1 -- 172.21.15.5:0/1857440328 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(299..299 src has 22..299) ==== 3898+0+0 (secure 0 0 0) 0x7f972400f040 con 0x7f97280a6ce0 2024-08-18T21:14:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f972d89e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f972e8a0640 1 --2- 172.21.15.5:0/1857440328 >> v2:172.21.15.157:6812/631023601 conn(0x7f970c03bdf0 0x7f970c03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f972e8a0640 10 monclient: get_auth_request con 0x7f970c03bdf0 auth_method 0 2024-08-18T21:14:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f972d89e640 10 monclient(hunting): handle_auth_done global_id 134256 payload 824 2024-08-18T21:14:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.831+0000 7f972d89e640 1 -- 172.21.15.5:0/1857440328 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97280a8220 con 0x7f972813bd00 2024-08-18T21:14:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.835+0000 7f972d89e640 1 -- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f972813bd00 msgr2=0x7f972813c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.835+0000 7f972d89e640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f972813bd00 0x7f972813c0e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f97280a7ef0 tx=0x7f97180191c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.835+0000 7f972e8a0640 1 --2- 172.21.15.5:0/1857440328 >> v2:172.21.15.157:6812/631023601 conn(0x7f970c03bdf0 0x7f970c03e2b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f972813db80 tx=0x7f9720007300 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.835+0000 7f971effd640 1 -- 172.21.15.5:0/1857440328 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97180b1050 con 0x7f972813bd00 2024-08-18T21:14:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.835+0000 7f971effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.835+0000 7f971effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:14:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.835+0000 7f971effd640 10 monclient: dump: 2024-08-18T21:14:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.854 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.854 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.854 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.835+0000 7f971effd640 1 -- 172.21.15.5:0/1857440328 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f97180bb070 con 0x7f972813bd00 2024-08-18T21:14:25.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.835+0000 7f971effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:25.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.835+0000 7f971effd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:25.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.835+0000 7f971effd640 1 -- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f972813bd00 msgr2=0x7f972813c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.835+0000 7f971effd640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f972813bd00 0x7f972813c0e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f97280a7ef0 tx=0x7f97180191c0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.835+0000 7f971effd640 1 -- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f972813bd00 msgr2=0x7f972813c0e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:25.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.835+0000 7f971effd640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f972813bd00 0x7f972813c0e0 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f97280a7ef0 tx=0x7f97180191c0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.843+0000 7f9730303640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:25.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.843+0000 7f9730303640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f972813c620 0x7f972809ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:25.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.843+0000 7f9730303640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:25.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.843+0000 7f9730303640 1 -- 172.21.15.5:0/1857440328 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9728051140 con 0x7f972813c620 2024-08-18T21:14:25.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.843+0000 7f972d89e640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f972813c620 0x7f972809ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:25.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.843+0000 7f972d89e640 10 monclient: get_auth_request con 0x7f972813c620 auth_method 0 2024-08-18T21:14:25.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.843+0000 7f972d89e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:25.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.843+0000 7f972d89e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:25.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.843+0000 7f972d89e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:25.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.843+0000 7f972d89e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.843+0000 7f972d89e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.843+0000 7f972d89e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.843+0000 7f972d89e640 10 monclient(hunting): handle_auth_done global_id 134265 payload 824 2024-08-18T21:14:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.843+0000 7f972d89e640 1 -- 172.21.15.5:0/1857440328 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9728141c40 con 0x7f972813c620 2024-08-18T21:14:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f972d89e640 1 -- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f972813c620 msgr2=0x7f972809ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f972d89e640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f972813c620 0x7f972809ea80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f971801aad0 tx=0x7f97180a9000 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f971effd640 1 -- 172.21.15.5:0/1857440328 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97180c0cc0 con 0x7f972813c620 2024-08-18T21:14:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f971effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f971effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:14:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f971effd640 10 monclient: dump: 2024-08-18T21:14:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:25.857 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:25.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f971effd640 1 -- 172.21.15.5:0/1857440328 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f97180b2040 con 0x7f972813c620 2024-08-18T21:14:25.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f971effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:25.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f971effd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:25.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f971effd640 1 -- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f972813c620 msgr2=0x7f972809ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f971effd640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f972813c620 0x7f972809ea80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f971801aad0 tx=0x7f97180a9000 comp rx=0 tx=0).stop 2024-08-18T21:14:25.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f971effd640 1 -- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f972813c620 msgr2=0x7f972809ea80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:25.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f971effd640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f972813c620 0x7f972809ea80 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f971801aad0 tx=0x7f97180a9000 comp rx=0 tx=0).stop 2024-08-18T21:14:25.858 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:25.858 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 25307, 2024-08-18T21:14:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:14:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:14:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:25.882 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f9730303640 1 -- 172.21.15.5:0/1857440328 >> v2:172.21.15.157:6812/631023601 conn(0x7f970c03bdf0 msgr2=0x7f970c03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f9730303640 1 --2- 172.21.15.5:0/1857440328 >> v2:172.21.15.157:6812/631023601 conn(0x7f970c03bdf0 0x7f970c03e2b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f972813db80 tx=0x7f9720007300 comp rx=0 tx=0).stop 2024-08-18T21:14:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f9730303640 10 monclient: shutdown 2024-08-18T21:14:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f9730303640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f9730303640 1 -- 172.21.15.5:0/1857440328 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97280a6ce0 msgr2=0x7f9728135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f9730303640 1 --2- 172.21.15.5:0/1857440328 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f97280a6ce0 0x7f9728135cf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f972400d830 tx=0x7f972400dcf0 comp rx=0 tx=0).stop 2024-08-18T21:14:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f972e8a0640 1 -- 172.21.15.5:0/1857440328 reap_dead start 2024-08-18T21:14:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f972e8a0640 1 -- 172.21.15.5:0/1857440328 reap_dead start 2024-08-18T21:14:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f9730303640 1 -- 172.21.15.5:0/1857440328 shutdown_connections 2024-08-18T21:14:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f9730303640 1 -- 172.21.15.5:0/1857440328 >> 172.21.15.5:0/1857440328 conn(0x7f97280acbc0 msgr2=0x7f972809de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f9730303640 1 -- 172.21.15.5:0/1857440328 shutdown_connections 2024-08-18T21:14:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:25.847+0000 7f9730303640 1 -- 172.21.15.5:0/1857440328 wait complete. 2024-08-18T21:14:25.885 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:25.885 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:14:25.885 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:14:25.905 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.906 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3703020592}) 2024-08-18T21:14:25.906 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1208052464}) 2024-08-18T21:14:25.906 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.906 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3703020592}) 2024-08-18T21:14:25.906 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=306285923}) 2024-08-18T21:14:25.906 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.906 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3703020592}) 2024-08-18T21:14:25.907 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2762452868}) 2024-08-18T21:14:25.907 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.907 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3703020592}) 2024-08-18T21:14:25.907 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3327169534}) 2024-08-18T21:14:25.907 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.907 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3703020592}) 2024-08-18T21:14:25.908 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2246631169}) 2024-08-18T21:14:25.908 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.908 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3703020592}) 2024-08-18T21:14:25.908 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2103873561}) 2024-08-18T21:14:25.908 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3703020592}) 2024-08-18T21:14:25.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2464661573}) 2024-08-18T21:14:25.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3703020592}) 2024-08-18T21:14:25.909 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.903+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=492975265}) 2024-08-18T21:14:25.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2858480140}) 2024-08-18T21:14:25.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2705291591}) 2024-08-18T21:14:25.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2858480140}) 2024-08-18T21:14:25.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=999936055}) 2024-08-18T21:14:25.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2858480140}) 2024-08-18T21:14:25.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1738938138}) 2024-08-18T21:14:25.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2858480140}) 2024-08-18T21:14:25.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2104699811}) 2024-08-18T21:14:25.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2858480140}) 2024-08-18T21:14:25.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3591643422}) 2024-08-18T21:14:25.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2858480140}) 2024-08-18T21:14:25.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2455468041}) 2024-08-18T21:14:25.931 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.931 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2858480140}) 2024-08-18T21:14:25.931 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1551209003}) 2024-08-18T21:14:25.931 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:25.931 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2858480140}) 2024-08-18T21:14:25.931 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:25.931+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1677518035}) 2024-08-18T21:14:26.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 10 monclient: get_monmap_and_config 2024-08-18T21:14:26.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 10 monclient: build_initial_monmap 2024-08-18T21:14:26.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 10 monclient: monmap: 2024-08-18T21:14:26.009 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:26.009 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:26.009 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:26.013224+0000 2024-08-18T21:14:26.009 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:26.013224+0000 2024-08-18T21:14:26.009 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:26.009 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:26.009 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:26.009 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:26.009 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:26.009 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:26.009 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:26.010 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:26.010 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:26.010 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:26.010 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:26.010 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:26.010 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:26.010 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:26.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 1 Processor -- start 2024-08-18T21:14:26.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 1 -- start start 2024-08-18T21:14:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 10 monclient: init 2024-08-18T21:14:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 10 monclient: _add_conns ranks=[3,5,1,10,0,7,4,2,8,6,9] 2024-08-18T21:14:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1c80a4960 0x7fa1c80a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 10 monclient(hunting): picked mon.noname-g con 0x7fa1c80a4960 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c806c990 0x7fa1c80a5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 10 monclient(hunting): picked mon.noname-h con 0x7fa1c806c990 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fa1c8137720 addr v1:172.21.15.157:6789/0 2024-08-18T21:14:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1c80a11a0 con 0x7fa1c8137720 2024-08-18T21:14:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa1c80a57c0 con 0x7fa1c80a4960 2024-08-18T21:14:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fa1c8069a80 con 0x7fa1c806c990 2024-08-18T21:14:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1ce471640 10 monclient(hunting): authenticate will time out at 1633.027233s 2024-08-18T21:14:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1cca0e640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fa1c8137720 0x7fa1c8137bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:33990/0 (socket says 172.21.15.5:33990) 2024-08-18T21:14:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1cca0e640 1 -- 172.21.15.5:0/1784068432 learned_addr learned my addr 172.21.15.5:0/1784068432 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:14:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1c7fff640 1 --2- 172.21.15.5:0/1784068432 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1c80a4960 0x7fa1c80a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1c7fff640 10 monclient(hunting): get_auth_request con 0x7fa1c80a4960 auth_method 0 2024-08-18T21:14:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1c7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1c7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1c77fe640 1 --2- 172.21.15.5:0/1784068432 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c806c990 0x7fa1c80a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1c77fe640 10 monclient(hunting): get_auth_request con 0x7fa1c806c990 auth_method 0 2024-08-18T21:14:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1c7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1c7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1c7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.011+0000 7fa1c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.015+0000 7fa1c7fff640 10 monclient(hunting): handle_auth_done global_id 134274 payload 274 2024-08-18T21:14:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.015+0000 7fa1c7fff640 1 -- 172.21.15.5:0/1784068432 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c806c990 msgr2=0x7fa1c80a5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.015+0000 7fa1c7fff640 1 --2- 172.21.15.5:0/1784068432 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c806c990 0x7fa1c80a5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.015+0000 7fa1c7fff640 1 -- 172.21.15.5:0/1784068432 >> v1:172.21.15.157:6789/0 conn(0x7fa1c8137720 legacy=0x7fa1c8137bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.015+0000 7fa1c7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:14:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.015+0000 7fa1c7fff640 1 monclient: found mon.noname-g 2024-08-18T21:14:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.015+0000 7fa1c7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.015+0000 7fa1c7fff640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:14:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.015+0000 7fa1c7fff640 1 -- 172.21.15.5:0/1784068432 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c806ce10 con 0x7fa1c80a4960 2024-08-18T21:14:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 1 -- 172.21.15.5:0/1784068432 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1c80a4960 msgr2=0x7fa1c80a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 1 --2- 172.21.15.5:0/1784068432 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1c80a4960 0x7fa1c80a4d40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80097f0 tx=0x7fa1b801c3a0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=51acbd7400e279e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c6ffd640 1 -- 172.21.15.5:0/1784068432 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa1b80b0070 con 0x7fa1c80a4960 2024-08-18T21:14:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c6ffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:14:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c6ffd640 10 monclient: dump: 2024-08-18T21:14:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:26.020 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:14:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:14:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 5 monclient: authenticate success, global_id 134274 2024-08-18T21:14:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:14:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c6ffd640 1 -- 172.21.15.5:0/1784068432 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b80aa3a0 con 0x7fa1c80a4960 2024-08-18T21:14:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 4 set_mon_vals no callback set 2024-08-18T21:14:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c6ffd640 1 -- 172.21.15.5:0/1784068432 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa1b80a4e60 con 0x7fa1c80a4960 2024-08-18T21:14:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c6ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:14:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c6ffd640 10 monclient: dump: 2024-08-18T21:14:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:26.022 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:26.022 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.022 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.022 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:26.022 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:26.022 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:26.023 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 10 monclient: shutdown 2024-08-18T21:14:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 1 -- 172.21.15.5:0/1784068432 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1c80a4960 msgr2=0x7fa1c80a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 1 --2- 172.21.15.5:0/1784068432 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1c80a4960 0x7fa1c80a4d40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80097f0 tx=0x7fa1b801c3a0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 1 -- 172.21.15.5:0/1784068432 shutdown_connections 2024-08-18T21:14:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 1 --2- 172.21.15.5:0/1784068432 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c806c990 0x7fa1c80a5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 1 --2- 172.21.15.5:0/1784068432 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1c80a4960 0x7fa1c80a4d40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 1 -- 172.21.15.5:0/1784068432 >> 172.21.15.5:0/1784068432 conn(0x7fa1c80a6440 msgr2=0x7fa1c8068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 1 -- 172.21.15.5:0/1784068432 shutdown_connections 2024-08-18T21:14:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 1 -- 172.21.15.5:0/1784068432 wait complete. 2024-08-18T21:14:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 10 monclient: build_initial_monmap 2024-08-18T21:14:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 10 monclient: monmap: 2024-08-18T21:14:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:26.027 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:26.027 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:26.027 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:26.027 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:26.027 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:26.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 1 Processor -- start 2024-08-18T21:14:26.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 1 -- start start 2024-08-18T21:14:26.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 10 monclient: init 2024-08-18T21:14:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 10 monclient: _add_conns ranks=[4,7,3,1,8,5,2,6,0] 2024-08-18T21:14:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa1c806c990 0x7fa1c81367a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 10 monclient(hunting): picked mon.noname-c con 0x7fa1c806c990 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fa1c80a4960 0x7fa1c8136ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 10 monclient(hunting): picked mon.noname-i con 0x7fa1c80a4960 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1c8137720 0x7fa1c811f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 10 monclient(hunting): picked mon.noname-g con 0x7fa1c8137720 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa1c81423b0 con 0x7fa1c8137720 2024-08-18T21:14:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fa1c8142530 con 0x7fa1c806c990 2024-08-18T21:14:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fa1c81426b0 con 0x7fa1c80a4960 2024-08-18T21:14:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1ce471640 10 monclient(hunting): authenticate will time out at 1633.035358s 2024-08-18T21:14:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa1c806c990 0x7fa1c81367a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa1c806c990 0x7fa1c81367a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:54112/0 (socket says 172.21.15.5:54112) 2024-08-18T21:14:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 1 -- 172.21.15.5:0/193510779 learned_addr learned my addr 172.21.15.5:0/193510779 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 10 monclient(hunting): get_auth_request con 0x7fa1c806c990 auth_method 0 2024-08-18T21:14:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1cca0e640 1 --2- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1c8137720 0x7fa1c811f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1cca0e640 10 monclient(hunting): get_auth_request con 0x7fa1c8137720 auth_method 0 2024-08-18T21:14:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1cca0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1cca0e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1cca0e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c77fe640 1 --2- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fa1c80a4960 0x7fa1c8136ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 10 monclient(hunting): handle_auth_done global_id 114799 payload 824 2024-08-18T21:14:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 1 -- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fa1c80a4960 msgr2=0x7fa1c8136ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 1 --2- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fa1c80a4960 0x7fa1c8136ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 1 -- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1c8137720 msgr2=0x7fa1c811f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 1 --2- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1c8137720 0x7fa1c811f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:14:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 1 monclient: found mon.noname-c 2024-08-18T21:14:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:26.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:14:26.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.019+0000 7fa1c7fff640 1 -- 172.21.15.5:0/193510779 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c80a8ca0 con 0x7fa1c806c990 2024-08-18T21:14:26.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c7fff640 1 -- 172.21.15.5:0/193510779 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa1c806c990 msgr2=0x7fa1c81367a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:26.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c7fff640 1 --2- 172.21.15.5:0/193510779 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa1c806c990 0x7fa1c81367a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa1b801c1d0 tx=0x7fa1b8019140 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:26.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c4ff9640 1 -- 172.21.15.5:0/193510779 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa1b80b0040 con 0x7fa1c806c990 2024-08-18T21:14:26.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:26.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:14:26.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c4ff9640 10 monclient: dump: 2024-08-18T21:14:26.040 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:26.040 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:26.040 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.040 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.040 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:26.042 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c4ff9640 10 monclient: _finish_auth 0 2024-08-18T21:14:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c4ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:14:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c4ff9640 1 -- 172.21.15.5:0/193510779 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b80b9070 con 0x7fa1c806c990 2024-08-18T21:14:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c4ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c4ff9640 1 -- 172.21.15.5:0/193510779 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa1b8003ca0 con 0x7fa1c806c990 2024-08-18T21:14:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:26.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c4ff9640 10 monclient: dump: 2024-08-18T21:14:26.043 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:26.043 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:26.043 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.043 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.043 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:26.044 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:26.044 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:26.044 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:26.044 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:26.044 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:26.044 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:26.045 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:26.045 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:26.045 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:26.045 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:26.045 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:26.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c67fc640 4 set_mon_vals no callback set 2024-08-18T21:14:26.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1ce471640 5 monclient: authenticate success, global_id 114799 2024-08-18T21:14:26.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1ce471640 10 monclient: _renew_subs 2024-08-18T21:14:26.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1ce471640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:14:26.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1ce471640 1 -- 172.21.15.5:0/193510779 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c8123170 con 0x7fa1c806c990 2024-08-18T21:14:26.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1ce471640 10 monclient: _renew_subs 2024-08-18T21:14:26.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1ce471640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:14:26.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1ce471640 1 -- 172.21.15.5:0/193510779 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c8068850 con 0x7fa1c806c990 2024-08-18T21:14:26.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1ce471640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1ce471640 1 --2- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c81d18b0 0x7fa1c811fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1ce471640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1ce471640 1 -- 172.21.15.5:0/193510779 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fa1c80a3480 con 0x7fa1c81d18b0 2024-08-18T21:14:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c4ff9640 1 -- 172.21.15.5:0/193510779 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fa1b8003830 con 0x7fa1c806c990 2024-08-18T21:14:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c77fe640 1 --2- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c81d18b0 0x7fa1c811fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c77fe640 10 monclient: get_auth_request con 0x7fa1c81d18b0 auth_method 0 2024-08-18T21:14:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:26.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:26.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:26.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c4ff9640 1 --2- 172.21.15.5:0/193510779 >> v2:172.21.15.157:6812/631023601 conn(0x7fa1b403bdc0 0x7fa1b403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c4ff9640 1 -- 172.21.15.5:0/193510779 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(299..299 src has 22..299) ==== 3898+0+0 (secure 0 0 0) 0x7fa1b80e7a80 con 0x7fa1c806c990 2024-08-18T21:14:26.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:26.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:26.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.023+0000 7fa1c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:26.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1cca0e640 1 --2- 172.21.15.5:0/193510779 >> v2:172.21.15.157:6812/631023601 conn(0x7fa1b403bdc0 0x7fa1b403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1cca0e640 10 monclient: get_auth_request con 0x7fa1b403bdc0 auth_method 0 2024-08-18T21:14:26.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1c77fe640 10 monclient(hunting): handle_auth_done global_id 95486 payload 824 2024-08-18T21:14:26.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1c77fe640 1 -- 172.21.15.5:0/193510779 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1c8122a40 con 0x7fa1c81d18b0 2024-08-18T21:14:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1c77fe640 1 -- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c81d18b0 msgr2=0x7fa1c811fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1c77fe640 1 --2- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c81d18b0 0x7fa1c811fae0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa1c81376f0 tx=0x7fa1bc010c20 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1cca0e640 1 --2- 172.21.15.5:0/193510779 >> v2:172.21.15.157:6812/631023601 conn(0x7fa1b403bdc0 0x7fa1b403e280 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009e90 tx=0x7fa1c0009480 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1c4ff9640 1 -- 172.21.15.5:0/193510779 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa1bc00f040 con 0x7fa1c81d18b0 2024-08-18T21:14:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1c4ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:14:26.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1c4ff9640 10 monclient: dump: 2024-08-18T21:14:26.051 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:26.051 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:26.051 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.051 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.052 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:26.052 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:26.052 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:26.052 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:26.052 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:26.052 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:26.053 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:26.053 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:26.053 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:26.053 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:26.053 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:26.053 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:26.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1c4ff9640 1 -- 172.21.15.5:0/193510779 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa1bc010e70 con 0x7fa1c81d18b0 2024-08-18T21:14:26.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1c4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:26.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1c4ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:26.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1c4ff9640 1 -- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c81d18b0 msgr2=0x7fa1c811fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:26.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1c4ff9640 1 --2- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c81d18b0 0x7fa1c811fae0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa1c81376f0 tx=0x7fa1bc010c20 comp rx=0 tx=0).stop 2024-08-18T21:14:26.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1c4ff9640 1 -- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c81d18b0 msgr2=0x7fa1c811fae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:26.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.027+0000 7fa1c4ff9640 1 --2- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c81d18b0 0x7fa1c811fae0 secure :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa1c81376f0 tx=0x7fa1bc010c20 comp rx=0 tx=0).stop 2024-08-18T21:14:26.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.035+0000 7fa1ce471640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:26.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.035+0000 7fa1ce471640 1 --2- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c8120020 0x7fa1c8070110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.035+0000 7fa1ce471640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:26.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.035+0000 7fa1ce471640 1 -- 172.21.15.5:0/193510779 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fa1c8120430 con 0x7fa1c8120020 2024-08-18T21:14:26.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.035+0000 7fa1c77fe640 1 --2- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c8120020 0x7fa1c8070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.035+0000 7fa1c77fe640 10 monclient: get_auth_request con 0x7fa1c8120020 auth_method 0 2024-08-18T21:14:26.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.035+0000 7fa1c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:26.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.035+0000 7fa1c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:26.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.035+0000 7fa1c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:26.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.035+0000 7fa1c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:26.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.035+0000 7fa1c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:26.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.035+0000 7fa1c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:26.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.035+0000 7fa1c77fe640 10 monclient(hunting): handle_auth_done global_id 95495 payload 824 2024-08-18T21:14:26.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.035+0000 7fa1c77fe640 1 -- 172.21.15.5:0/193510779 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa1c8120e10 con 0x7fa1c8120020 2024-08-18T21:14:26.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1c77fe640 1 -- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c8120020 msgr2=0x7fa1c8070110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:26.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1c77fe640 1 --2- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c8120020 0x7fa1c8070110 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc018000 tx=0x7fa1bc0046d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:26.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1c4ff9640 1 -- 172.21.15.5:0/193510779 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa1bc021d00 con 0x7fa1c8120020 2024-08-18T21:14:26.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:26.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1c4ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:14:26.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1c4ff9640 10 monclient: dump: 2024-08-18T21:14:26.060 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:26.060 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:26.061 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.061 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.061 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:26.061 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:26.062 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:26.062 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:26.062 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:26.062 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:26.062 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:26.062 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:26.063 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:26.063 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:26.063 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:26.064 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:26.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1c4ff9640 1 -- 172.21.15.5:0/193510779 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9582 (secure 0 0 0) 0x7fa1bc021890 con 0x7fa1c8120020 2024-08-18T21:14:26.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1c4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:26.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1c4ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:26.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1c4ff9640 1 -- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c8120020 msgr2=0x7fa1c8070110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:26.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1c4ff9640 1 --2- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c8120020 0x7fa1c8070110 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc018000 tx=0x7fa1bc0046d0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1c4ff9640 1 -- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c8120020 msgr2=0x7fa1c8070110 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:26.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1c4ff9640 1 --2- 172.21.15.5:0/193510779 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa1c8120020 0x7fa1c8070110 secure :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc018000 tx=0x7fa1bc0046d0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.065 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:26.065 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:26.065 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:26.065 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:26.065 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:26.065 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 294075, 2024-08-18T21:14:26.065 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:26.065 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:26.065 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:14:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:14:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:14:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:26.089 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:26.089 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.089 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.089 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:26.089 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:26.090 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.090 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307261845}) 2024-08-18T21:14:26.090 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2868705348}) 2024-08-18T21:14:26.090 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.090 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307261845}) 2024-08-18T21:14:26.091 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3421611674}) 2024-08-18T21:14:26.091 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.091 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307261845}) 2024-08-18T21:14:26.091 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2417164867}) 2024-08-18T21:14:26.091 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.091 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307261845}) 2024-08-18T21:14:26.091 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=41144725}) 2024-08-18T21:14:26.091 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1ce471640 1 -- 172.21.15.5:0/193510779 >> v2:172.21.15.157:6812/631023601 conn(0x7fa1b403bdc0 msgr2=0x7fa1b403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1ce471640 1 --2- 172.21.15.5:0/193510779 >> v2:172.21.15.157:6812/631023601 conn(0x7fa1b403bdc0 0x7fa1b403e280 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009e90 tx=0x7fa1c0009480 comp rx=0 tx=0).stop 2024-08-18T21:14:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1ce471640 10 monclient: shutdown 2024-08-18T21:14:26.092 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307261845}) 2024-08-18T21:14:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1ce471640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1ce471640 1 -- 172.21.15.5:0/193510779 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa1c806c990 msgr2=0x7fa1c81367a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1ce471640 1 --2- 172.21.15.5:0/193510779 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa1c806c990 0x7fa1c81367a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa1b801c1d0 tx=0x7fa1b8019140 comp rx=0 tx=0).stop 2024-08-18T21:14:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1cca0e640 1 -- 172.21.15.5:0/193510779 reap_dead start 2024-08-18T21:14:26.093 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1187264039}) 2024-08-18T21:14:26.093 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.093 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307261845}) 2024-08-18T21:14:26.093 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=67204776}) 2024-08-18T21:14:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1cca0e640 1 -- 172.21.15.5:0/193510779 reap_dead start 2024-08-18T21:14:26.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1ce471640 1 -- 172.21.15.5:0/193510779 shutdown_connections 2024-08-18T21:14:26.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa1ce471640 1 -- 172.21.15.5:0/193510779 >> 172.21.15.5:0/193510779 conn(0x7fa1c80a6440 msgr2=0x7fa1c809da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:26.094 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.039+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.094 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307261845}) 2024-08-18T21:14:26.094 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3294734978}) 2024-08-18T21:14:26.094 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.095 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307261845}) 2024-08-18T21:14:26.095 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.043+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3123462861}) 2024-08-18T21:14:26.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.043+0000 7fa1ce471640 1 -- 172.21.15.5:0/193510779 shutdown_connections 2024-08-18T21:14:26.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.043+0000 7fa1ce471640 1 -- 172.21.15.5:0/193510779 wait complete. 2024-08-18T21:14:26.096 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:26.096 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:14:26.096 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:14:26.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2810597002}) 2024-08-18T21:14:26.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3051074731}) 2024-08-18T21:14:26.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2810597002}) 2024-08-18T21:14:26.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1196063935}) 2024-08-18T21:14:26.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2810597002}) 2024-08-18T21:14:26.113 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1876582620}) 2024-08-18T21:14:26.114 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.114 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2810597002}) 2024-08-18T21:14:26.114 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=10855009}) 2024-08-18T21:14:26.114 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.114 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2810597002}) 2024-08-18T21:14:26.114 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3756505835}) 2024-08-18T21:14:26.114 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.114 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2810597002}) 2024-08-18T21:14:26.114 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1712104570}) 2024-08-18T21:14:26.114 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.114 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2810597002}) 2024-08-18T21:14:26.114 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3473838513}) 2024-08-18T21:14:26.115 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.115 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2810597002}) 2024-08-18T21:14:26.115 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.115+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1947061364}) 2024-08-18T21:14:26.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=133889610}) 2024-08-18T21:14:26.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2583036590}) 2024-08-18T21:14:26.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.117 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=133889610}) 2024-08-18T21:14:26.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3087922567}) 2024-08-18T21:14:26.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=133889610}) 2024-08-18T21:14:26.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2604853630}) 2024-08-18T21:14:26.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=133889610}) 2024-08-18T21:14:26.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=358395993}) 2024-08-18T21:14:26.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=133889610}) 2024-08-18T21:14:26.118 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1023000375}) 2024-08-18T21:14:26.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=133889610}) 2024-08-18T21:14:26.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1635302827}) 2024-08-18T21:14:26.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=133889610}) 2024-08-18T21:14:26.119 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1232731263}) 2024-08-18T21:14:26.120 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.120 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=133889610}) 2024-08-18T21:14:26.120 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.119+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2648729862}) 2024-08-18T21:14:26.122 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.123 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848634856}) 2024-08-18T21:14:26.123 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2487922688}) 2024-08-18T21:14:26.123 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.123 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848634856}) 2024-08-18T21:14:26.123 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=647946995}) 2024-08-18T21:14:26.123 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.123 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848634856}) 2024-08-18T21:14:26.123 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=827460935}) 2024-08-18T21:14:26.123 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.124 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848634856}) 2024-08-18T21:14:26.124 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3775681724}) 2024-08-18T21:14:26.124 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.124 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848634856}) 2024-08-18T21:14:26.124 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=582060424}) 2024-08-18T21:14:26.124 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.124 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848634856}) 2024-08-18T21:14:26.124 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3321507273}) 2024-08-18T21:14:26.124 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.124 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848634856}) 2024-08-18T21:14:26.124 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3396584976}) 2024-08-18T21:14:26.124 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.124 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848634856}) 2024-08-18T21:14:26.125 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.123+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2914904309}) 2024-08-18T21:14:26.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3082015039}) 2024-08-18T21:14:26.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1917554248}) 2024-08-18T21:14:26.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3082015039}) 2024-08-18T21:14:26.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3597947621}) 2024-08-18T21:14:26.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3082015039}) 2024-08-18T21:14:26.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3075992064}) 2024-08-18T21:14:26.132 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3082015039}) 2024-08-18T21:14:26.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=429568185}) 2024-08-18T21:14:26.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3082015039}) 2024-08-18T21:14:26.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=691627358}) 2024-08-18T21:14:26.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3082015039}) 2024-08-18T21:14:26.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3417844601}) 2024-08-18T21:14:26.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3082015039}) 2024-08-18T21:14:26.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2587822990}) 2024-08-18T21:14:26.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3082015039}) 2024-08-18T21:14:26.133 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.127+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2176105428}) 2024-08-18T21:14:26.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=712516473}) 2024-08-18T21:14:26.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3734608057}) 2024-08-18T21:14:26.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=712516473}) 2024-08-18T21:14:26.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=665457919}) 2024-08-18T21:14:26.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=712516473}) 2024-08-18T21:14:26.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2724405243}) 2024-08-18T21:14:26.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=712516473}) 2024-08-18T21:14:26.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2824918558}) 2024-08-18T21:14:26.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.135 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=712516473}) 2024-08-18T21:14:26.135 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2779874277}) 2024-08-18T21:14:26.135 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.135 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=712516473}) 2024-08-18T21:14:26.135 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1651082299}) 2024-08-18T21:14:26.135 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.135 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=712516473}) 2024-08-18T21:14:26.135 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=612095537}) 2024-08-18T21:14:26.135 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.135 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=712516473}) 2024-08-18T21:14:26.135 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.131+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2655268693}) 2024-08-18T21:14:26.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 10 monclient: get_monmap_and_config 2024-08-18T21:14:26.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 10 monclient: build_initial_monmap 2024-08-18T21:14:26.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 10 monclient: monmap: 2024-08-18T21:14:26.248 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:26.248 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:26.248 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:26.252830+0000 2024-08-18T21:14:26.248 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:26.252830+0000 2024-08-18T21:14:26.248 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:26.249 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:26.249 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:26.249 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:26.249 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:26.249 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:26.249 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:26.249 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:26.249 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:26.249 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:26.249 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:26.249 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:26.249 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:26.249 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:26.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 1 Processor -- start 2024-08-18T21:14:26.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 1 -- start start 2024-08-18T21:14:26.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 10 monclient: init 2024-08-18T21:14:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 10 monclient: _add_conns ranks=[7,4,5,2,6,3,0,1,9,8,10] 2024-08-18T21:14:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c80a4bb0 0x7fd6c80a4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 10 monclient(hunting): picked mon.noname-i con 0x7fd6c80a4bb0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd6c80a6840 0x7fd6c80a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 10 monclient(hunting): picked mon.noname-c con 0x7fd6c80a6840 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd6c813dd80 0x7fd6c8140170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 10 monclient(hunting): picked mon.noname-h con 0x7fd6c813dd80 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fd6c80a6470 con 0x7fd6c80a6840 2024-08-18T21:14:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fd6c80a5a10 con 0x7fd6c813dd80 2024-08-18T21:14:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fd6c806efa0 con 0x7fd6c80a4bb0 2024-08-18T21:14:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ce94c640 10 monclient(hunting): authenticate will time out at 1633.265972s 2024-08-18T21:14:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd6c80a6840 0x7fd6c80a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd6c80a6840 0x7fd6c80a54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:54116/0 (socket says 172.21.15.5:54116) 2024-08-18T21:14:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 1 -- 172.21.15.5:0/1837218061 learned_addr learned my addr 172.21.15.5:0/1837218061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 10 monclient(hunting): get_auth_request con 0x7fd6c80a6840 auth_method 0 2024-08-18T21:14:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ccee9640 1 --2- 172.21.15.5:0/1837218061 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd6c813dd80 0x7fd6c8140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c7fff640 1 --2- 172.21.15.5:0/1837218061 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c80a4bb0 0x7fd6c80a4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ccee9640 10 monclient(hunting): get_auth_request con 0x7fd6c813dd80 auth_method 0 2024-08-18T21:14:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ccee9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ccee9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6ccee9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c7fff640 10 monclient(hunting): get_auth_request con 0x7fd6c80a4bb0 auth_method 0 2024-08-18T21:14:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 10 monclient(hunting): handle_auth_done global_id 114808 payload 274 2024-08-18T21:14:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 1 -- 172.21.15.5:0/1837218061 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c80a4bb0 msgr2=0x7fd6c80a4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 1 --2- 172.21.15.5:0/1837218061 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c80a4bb0 0x7fd6c80a4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 1 -- 172.21.15.5:0/1837218061 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd6c813dd80 msgr2=0x7fd6c8140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 1 --2- 172.21.15.5:0/1837218061 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd6c813dd80 0x7fd6c8140170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 10 monclient: _finish_hunting 0 2024-08-18T21:14:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 1 monclient: found mon.noname-c 2024-08-18T21:14:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:14:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.251+0000 7fd6c77fe640 1 -- 172.21.15.5:0/1837218061 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c806e700 con 0x7fd6c80a6840 2024-08-18T21:14:26.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6c77fe640 1 -- 172.21.15.5:0/1837218061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd6c80a6840 msgr2=0x7fd6c80a54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:26.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6c77fe640 1 --2- 172.21.15.5:0/1837218061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd6c80a6840 0x7fd6c80a54d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0098a0 tx=0x7fd6bc01c440 comp rx=0 tx=0).ready entity=mon.4 client_cookie=8f4871b07d208d09 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:26.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6c6ffd640 1 -- 172.21.15.5:0/1837218061 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd6bc0b0070 con 0x7fd6c80a6840 2024-08-18T21:14:26.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:26.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6c6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:14:26.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6c6ffd640 10 monclient: dump: 2024-08-18T21:14:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:26.260 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6c6ffd640 10 monclient: _finish_auth 0 2024-08-18T21:14:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6c6ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:14:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6c6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6c6ffd640 1 -- 172.21.15.5:0/1837218061 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6bc0aa810 con 0x7fd6c80a6840 2024-08-18T21:14:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6ce94c640 5 monclient: authenticate success, global_id 114808 2024-08-18T21:14:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6ce94c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:14:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6c6ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6ce94c640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6c6ffd640 1 -- 172.21.15.5:0/1837218061 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd6bc0a9300 con 0x7fd6c80a6840 2024-08-18T21:14:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6ce94c640 4 set_mon_vals no callback set 2024-08-18T21:14:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6c6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6c6ffd640 10 monclient: dump: 2024-08-18T21:14:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:26.262 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6ce94c640 10 monclient: shutdown 2024-08-18T21:14:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6ce94c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6ce94c640 1 -- 172.21.15.5:0/1837218061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd6c80a6840 msgr2=0x7fd6c80a54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6ce94c640 1 --2- 172.21.15.5:0/1837218061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd6c80a6840 0x7fd6c80a54d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0098a0 tx=0x7fd6bc01c440 comp rx=0 tx=0).stop 2024-08-18T21:14:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6ce94c640 1 -- 172.21.15.5:0/1837218061 shutdown_connections 2024-08-18T21:14:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6ce94c640 1 --2- 172.21.15.5:0/1837218061 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fd6c813dd80 0x7fd6c8140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6ce94c640 1 --2- 172.21.15.5:0/1837218061 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fd6c80a6840 0x7fd6c80a54d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6ce94c640 1 --2- 172.21.15.5:0/1837218061 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c80a4bb0 0x7fd6c80a4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6ce94c640 1 -- 172.21.15.5:0/1837218061 >> 172.21.15.5:0/1837218061 conn(0x7fd6c80aa1b0 msgr2=0x7fd6c80aa590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6ce94c640 1 -- 172.21.15.5:0/1837218061 shutdown_connections 2024-08-18T21:14:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.255+0000 7fd6ce94c640 1 -- 172.21.15.5:0/1837218061 wait complete. 2024-08-18T21:14:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 10 monclient: build_initial_monmap 2024-08-18T21:14:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 10 monclient: monmap: 2024-08-18T21:14:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:26.264 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:26.264 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:26.264 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:26.264 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:26.264 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:26.264 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:26.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 1 Processor -- start 2024-08-18T21:14:26.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 1 -- start start 2024-08-18T21:14:26.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 10 monclient: init 2024-08-18T21:14:26.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 10 monclient: _add_conns ranks=[0,8,1,2,7,6,4,5,3] 2024-08-18T21:14:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c80a4bb0 0x7fd6c8125100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 10 monclient(hunting): picked mon.noname-a con 0x7fd6c80a4bb0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:14:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd6c80a6840 0x7fd6c809f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 10 monclient(hunting): picked mon.noname-e con 0x7fd6c80a6840 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:14:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6c813dd80 0x7fd6c813af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 10 monclient(hunting): picked mon.noname-f con 0x7fd6c813dd80 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:14:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c8143050 con 0x7fd6c80a4bb0 2024-08-18T21:14:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c8142ed0 con 0x7fd6c813dd80 2024-08-18T21:14:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fd6c81431d0 con 0x7fd6c80a6840 2024-08-18T21:14:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ce94c640 10 monclient(hunting): authenticate will time out at 1633.273545s 2024-08-18T21:14:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c80a4bb0 0x7fd6c8125100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c77fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd6c80a6840 0x7fd6c809f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c80a4bb0 0x7fd6c8125100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59860/0 (socket says 172.21.15.5:59860) 2024-08-18T21:14:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 1 -- 172.21.15.5:0/742953547 learned_addr learned my addr 172.21.15.5:0/742953547 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 10 monclient(hunting): get_auth_request con 0x7fd6c80a4bb0 auth_method 0 2024-08-18T21:14:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c77fe640 10 monclient(hunting): get_auth_request con 0x7fd6c80a6840 auth_method 0 2024-08-18T21:14:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ccee9640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6c813dd80 0x7fd6c813af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ccee9640 10 monclient(hunting): get_auth_request con 0x7fd6c813dd80 auth_method 0 2024-08-18T21:14:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ccee9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ccee9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ccee9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 10 monclient(hunting): handle_auth_done global_id 124650 payload 824 2024-08-18T21:14:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 1 -- 172.21.15.5:0/742953547 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd6c80a6840 msgr2=0x7fd6c809f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd6c80a6840 0x7fd6c809f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 1 -- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6c813dd80 msgr2=0x7fd6c813af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6c813dd80 0x7fd6c813af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 10 monclient: _finish_hunting 0 2024-08-18T21:14:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 1 monclient: found mon.noname-a 2024-08-18T21:14:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:14:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c7fff640 1 -- 172.21.15.5:0/742953547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c8124c10 con 0x7fd6c80a4bb0 2024-08-18T21:14:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6c77fe640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fd6c80a6840 0x7fd6c809f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:14:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.259+0000 7fd6ccee9640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6c813dd80 0x7fd6c813af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:14:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c7fff640 1 -- 172.21.15.5:0/742953547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c80a4bb0 msgr2=0x7fd6c8125100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c7fff640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c80a4bb0 0x7fd6c8125100 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800d800 tx=0x7fd6b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c4ff9640 1 -- 172.21.15.5:0/742953547 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd6b800bd40 con 0x7fd6c80a4bb0 2024-08-18T21:14:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:14:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c4ff9640 10 monclient: dump: 2024-08-18T21:14:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:26.273 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c4ff9640 10 monclient: _finish_auth 0 2024-08-18T21:14:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c4ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:14:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c4ff9640 1 -- 172.21.15.5:0/742953547 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6b8019070 con 0x7fd6c80a4bb0 2024-08-18T21:14:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c4ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c4ff9640 1 -- 172.21.15.5:0/742953547 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd6b80148a0 con 0x7fd6c80a4bb0 2024-08-18T21:14:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:14:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c4ff9640 10 monclient: dump: 2024-08-18T21:14:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:26.274 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6ce94c640 5 monclient: authenticate success, global_id 124650 2024-08-18T21:14:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6ce94c640 10 monclient: _renew_subs 2024-08-18T21:14:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6ce94c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c67fc640 4 set_mon_vals no callback set 2024-08-18T21:14:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6ce94c640 1 -- 172.21.15.5:0/742953547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c8140350 con 0x7fd6c80a4bb0 2024-08-18T21:14:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6ce94c640 10 monclient: _renew_subs 2024-08-18T21:14:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6ce94c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:14:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6ce94c640 1 -- 172.21.15.5:0/742953547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c8126900 con 0x7fd6c80a4bb0 2024-08-18T21:14:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6ce94c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6ce94c640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c813b4a0 0x7fd6c81d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6ce94c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6ce94c640 1 -- 172.21.15.5:0/742953547 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fd6c8051140 con 0x7fd6c813b4a0 2024-08-18T21:14:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c4ff9640 1 -- 172.21.15.5:0/742953547 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fd6b8014430 con 0x7fd6c80a4bb0 2024-08-18T21:14:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c77fe640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c813b4a0 0x7fd6c81d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c77fe640 10 monclient: get_auth_request con 0x7fd6c813b4a0 auth_method 0 2024-08-18T21:14:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c4ff9640 1 --2- 172.21.15.5:0/742953547 >> v2:172.21.15.157:6812/631023601 conn(0x7fd6b403bdf0 0x7fd6b403e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c4ff9640 1 -- 172.21.15.5:0/742953547 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(299..299 src has 22..299) ==== 3898+0+0 (secure 0 0 0) 0x7fd6b800f040 con 0x7fd6c80a4bb0 2024-08-18T21:14:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6ccee9640 1 --2- 172.21.15.5:0/742953547 >> v2:172.21.15.157:6812/631023601 conn(0x7fd6b403bdf0 0x7fd6b403e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6ccee9640 10 monclient: get_auth_request con 0x7fd6b403bdf0 auth_method 0 2024-08-18T21:14:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c77fe640 10 monclient(hunting): handle_auth_done global_id 134296 payload 824 2024-08-18T21:14:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.263+0000 7fd6c77fe640 1 -- 172.21.15.5:0/742953547 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6c8072db0 con 0x7fd6c813b4a0 2024-08-18T21:14:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.267+0000 7fd6c77fe640 1 -- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c813b4a0 msgr2=0x7fd6c81d12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.267+0000 7fd6c77fe640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c813b4a0 0x7fd6c81d12d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0ad000 tx=0x7fd6bc0191e0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.267+0000 7fd6ccee9640 1 --2- 172.21.15.5:0/742953547 >> v2:172.21.15.157:6812/631023601 conn(0x7fd6b403bdf0 0x7fd6b403e2b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8124e90 tx=0x7fd6c000b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.267+0000 7fd6c4ff9640 1 -- 172.21.15.5:0/742953547 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd6bc0ba020 con 0x7fd6c813b4a0 2024-08-18T21:14:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.267+0000 7fd6c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.267+0000 7fd6c4ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:14:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.267+0000 7fd6c4ff9640 10 monclient: dump: 2024-08-18T21:14:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:26.278 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.267+0000 7fd6c4ff9640 1 -- 172.21.15.5:0/742953547 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd6bc0aaa40 con 0x7fd6c813b4a0 2024-08-18T21:14:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.267+0000 7fd6c4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.267+0000 7fd6c4ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.267+0000 7fd6c4ff9640 1 -- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c813b4a0 msgr2=0x7fd6c81d12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.267+0000 7fd6c4ff9640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c813b4a0 0x7fd6c81d12d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0ad000 tx=0x7fd6bc0191e0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.267+0000 7fd6c4ff9640 1 -- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c813b4a0 msgr2=0x7fd6c81d12d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.267+0000 7fd6c4ff9640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c813b4a0 0x7fd6c81d12d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fd6ce94c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fd6ce94c640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c81d1810 0x7fd6c81d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fd6ce94c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fd6ce94c640 1 -- 172.21.15.5:0/742953547 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fd6c81264d0 con 0x7fd6c81d1810 2024-08-18T21:14:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fd6c77fe640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c81d1810 0x7fd6c81d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fd6c77fe640 10 monclient: get_auth_request con 0x7fd6c81d1810 auth_method 0 2024-08-18T21:14:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fd6c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fd6c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fd6c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fd6c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fd6c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fd6c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:26.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fd6c77fe640 10 monclient(hunting): handle_auth_done global_id 134305 payload 824 2024-08-18T21:14:26.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fd6c77fe640 1 -- 172.21.15.5:0/742953547 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd6c80a4f90 con 0x7fd6c81d1810 2024-08-18T21:14:26.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2165566530}) 2024-08-18T21:14:26.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=993322072}) 2024-08-18T21:14:26.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2165566530}) 2024-08-18T21:14:26.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2472130034}) 2024-08-18T21:14:26.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2165566530}) 2024-08-18T21:14:26.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1635578748}) 2024-08-18T21:14:26.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2165566530}) 2024-08-18T21:14:26.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1410818191}) 2024-08-18T21:14:26.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2165566530}) 2024-08-18T21:14:26.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4232740876}) 2024-08-18T21:14:26.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2165566530}) 2024-08-18T21:14:26.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3426988687}) 2024-08-18T21:14:26.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2165566530}) 2024-08-18T21:14:26.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2985566789}) 2024-08-18T21:14:26.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2165566530}) 2024-08-18T21:14:26.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.275+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1150954769}) 2024-08-18T21:14:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.279+0000 7fd6c77fe640 1 -- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c81d1810 msgr2=0x7fd6c81d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.279+0000 7fd6c77fe640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c81d1810 0x7fd6c81d1c30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80a8b40 tx=0x7fd6bc0a8000 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:26.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3536346753}) 2024-08-18T21:14:26.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2205000765}) 2024-08-18T21:14:26.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.279+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3536346753}) 2024-08-18T21:14:26.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=338781659}) 2024-08-18T21:14:26.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3536346753}) 2024-08-18T21:14:26.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2471956402}) 2024-08-18T21:14:26.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3536346753}) 2024-08-18T21:14:26.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=467803503}) 2024-08-18T21:14:26.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3536346753}) 2024-08-18T21:14:26.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3511652625}) 2024-08-18T21:14:26.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3536346753}) 2024-08-18T21:14:26.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=535225714}) 2024-08-18T21:14:26.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3536346753}) 2024-08-18T21:14:26.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2842742880}) 2024-08-18T21:14:26.288 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.288 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3536346753}) 2024-08-18T21:14:26.288 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.283+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=817645813}) 2024-08-18T21:14:26.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.287+0000 7fd6c4ff9640 1 -- 172.21.15.5:0/742953547 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd6bc0c1e60 con 0x7fd6c81d1810 2024-08-18T21:14:26.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.287+0000 7fd6c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:26.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.287+0000 7fd6c4ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.287+0000 7fd6c4ff9640 10 monclient: dump: 2024-08-18T21:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:26.290 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.287+0000 7fd6c4ff9640 1 -- 172.21.15.5:0/742953547 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7fd6bc003830 con 0x7fd6c81d1810 2024-08-18T21:14:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.287+0000 7fd6c4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.287+0000 7fd6c4ff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.287+0000 7fd6c4ff9640 1 -- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c81d1810 msgr2=0x7fd6c81d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.287+0000 7fd6c4ff9640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c81d1810 0x7fd6c81d1c30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80a8b40 tx=0x7fd6bc0a8000 comp rx=0 tx=0).stop 2024-08-18T21:14:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.287+0000 7fd6c4ff9640 1 -- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c81d1810 msgr2=0x7fd6c81d1c30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:26.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.287+0000 7fd6c4ff9640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fd6c81d1810 0x7fd6c81d1c30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.291 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:26.291 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:26.291 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:26.291 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:26.291 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 228, 2024-08-18T21:14:26.291 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 25747, 2024-08-18T21:14:26.291 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:26.291 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:26.292 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:14:26.292 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:26.292 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:26.292 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:26.292 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:26.292 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:14:26.292 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:14:26.292 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:26.292 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:14:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:14:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:14:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:26.314 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:26.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:26.314 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:26.314 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:26.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fd6ce94c640 1 -- 172.21.15.5:0/742953547 >> v2:172.21.15.157:6812/631023601 conn(0x7fd6b403bdf0 msgr2=0x7fd6b403e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fd6ce94c640 1 --2- 172.21.15.5:0/742953547 >> v2:172.21.15.157:6812/631023601 conn(0x7fd6b403bdf0 0x7fd6b403e2b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8124e90 tx=0x7fd6c000b040 comp rx=0 tx=0).stop 2024-08-18T21:14:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fd6ce94c640 10 monclient: shutdown 2024-08-18T21:14:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fd6ce94c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fd6ce94c640 1 -- 172.21.15.5:0/742953547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c80a4bb0 msgr2=0x7fd6c8125100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fd6ce94c640 1 --2- 172.21.15.5:0/742953547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c80a4bb0 0x7fd6c8125100 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800d800 tx=0x7fd6b800dcc0 comp rx=0 tx=0).stop 2024-08-18T21:14:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fd6ccee9640 1 -- 172.21.15.5:0/742953547 reap_dead start 2024-08-18T21:14:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fd6ccee9640 1 -- 172.21.15.5:0/742953547 reap_dead start 2024-08-18T21:14:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fd6ce94c640 1 -- 172.21.15.5:0/742953547 shutdown_connections 2024-08-18T21:14:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fd6ce94c640 1 -- 172.21.15.5:0/742953547 >> 172.21.15.5:0/742953547 conn(0x7fd6c80aa1b0 msgr2=0x7fd6c8072310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fd6ce94c640 1 -- 172.21.15.5:0/742953547 shutdown_connections 2024-08-18T21:14:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fd6ce94c640 1 -- 172.21.15.5:0/742953547 wait complete. 2024-08-18T21:14:26.317 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.317 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=68838451}) 2024-08-18T21:14:26.317 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2588466494}) 2024-08-18T21:14:26.317 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.317 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=68838451}) 2024-08-18T21:14:26.317 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2095298618}) 2024-08-18T21:14:26.317 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.317 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=68838451}) 2024-08-18T21:14:26.317 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1699071035}) 2024-08-18T21:14:26.317 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.317 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=68838451}) 2024-08-18T21:14:26.317 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3952846059}) 2024-08-18T21:14:26.317 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.318 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=68838451}) 2024-08-18T21:14:26.318 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2207946336}) 2024-08-18T21:14:26.318 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.318 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=68838451}) 2024-08-18T21:14:26.318 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3869836446}) 2024-08-18T21:14:26.318 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.318 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=68838451}) 2024-08-18T21:14:26.318 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=85749765}) 2024-08-18T21:14:26.318 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.318 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=68838451}) 2024-08-18T21:14:26.318 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.291+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2533367432}) 2024-08-18T21:14:26.319 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:14:26.319 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['d', 'i', 'f'] 2024-08-18T21:14:26.319 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['e', 'h'] 2024-08-18T21:14:26.320 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d 2024-08-18T21:14:26.320 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2024-08-18T21:14:26.320 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-08-18T21:14:26.320 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:14:26.374 INFO:tasks.ceph.mon.d:Stopped 2024-08-18T21:14:26.374 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i 2024-08-18T21:14:26.374 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2024-08-18T21:14:26.374 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2024-08-18T21:14:26.374 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:14:26.390 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.390 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=278105861}) 2024-08-18T21:14:26.390 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3383849169}) 2024-08-18T21:14:26.390 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.390 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=278105861}) 2024-08-18T21:14:26.390 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1455355808}) 2024-08-18T21:14:26.390 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.390 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=278105861}) 2024-08-18T21:14:26.390 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=36366800}) 2024-08-18T21:14:26.390 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.390 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=278105861}) 2024-08-18T21:14:26.391 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3342865920}) 2024-08-18T21:14:26.391 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.391 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=278105861}) 2024-08-18T21:14:26.391 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=328150638}) 2024-08-18T21:14:26.391 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.391 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=278105861}) 2024-08-18T21:14:26.391 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=702456248}) 2024-08-18T21:14:26.391 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.391 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=278105861}) 2024-08-18T21:14:26.391 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1002696707}) 2024-08-18T21:14:26.391 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:14:26.391 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=278105861}) 2024-08-18T21:14:26.392 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:14:26.391+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2448476396}) 2024-08-18T21:14:26.401 INFO:tasks.ceph.mon.i:Stopped 2024-08-18T21:14:26.401 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.f 2024-08-18T21:14:26.401 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2024-08-18T21:14:26.401 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-08-18T21:14:26.401 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:14:26.462 INFO:tasks.ceph.mon.f:Stopped 2024-08-18T21:14:26.462 INFO:tasks.mon_thrash:Sending STOP to mon e 2024-08-18T21:14:26.462 INFO:tasks.ceph.mon.e:Sent signal 19 2024-08-18T21:14:26.463 INFO:tasks.mon_thrash:Sending STOP to mon h 2024-08-18T21:14:26.463 INFO:tasks.ceph.mon.h:Sent signal 19 2024-08-18T21:14:26.463 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs to unfreeze mons 2024-08-18T21:14:26.463 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32341]: starting. 2024-08-18T21:14:26.463 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32341]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-32340 2024-08-18T21:14:26.463 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32341]: created object 0... 2024-08-18T21:14:26.463 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32341]: created object 25... 2024-08-18T21:14:26.464 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32341]: created object 49... 2024-08-18T21:14:26.464 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32341]: finishing. 2024-08-18T21:14:26.464 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32341]: shutting down. 2024-08-18T21:14:46.463 INFO:tasks.mon_thrash:Sending CONT to mon e 2024-08-18T21:14:46.465 INFO:tasks.ceph.mon.e:Sent signal 18 2024-08-18T21:14:46.465 INFO:tasks.mon_thrash:Sending CONT to mon h 2024-08-18T21:14:46.465 INFO:tasks.ceph.mon.h:Sent signal 18 2024-08-18T21:14:46.465 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 6 2024-08-18T21:14:46.465 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:14:46.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 10 monclient: get_monmap_and_config 2024-08-18T21:14:46.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 10 monclient: build_initial_monmap 2024-08-18T21:14:46.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 10 monclient: monmap: 2024-08-18T21:14:46.601 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:46.601 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:46.601 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:46.606067+0000 2024-08-18T21:14:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:46.606067+0000 2024-08-18T21:14:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:46.603 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 1 Processor -- start 2024-08-18T21:14:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 1 -- start start 2024-08-18T21:14:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 10 monclient: init 2024-08-18T21:14:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 10 monclient: _add_conns ranks=[10,3,0,1,7,8,4,5,6,9,2] 2024-08-18T21:14:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdd040a6ce0 0x7fdd040a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 10 monclient(hunting): picked mon.noname-f con 0x7fdd040a6ce0 addr v2:172.21.15.157:3300/0 2024-08-18T21:14:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 0x7fdd04139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 10 monclient(hunting): picked mon.noname-g con 0x7fdd040a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdd04139fe0 addr v1:172.21.15.5:6789/0 2024-08-18T21:14:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd040a45d0 con 0x7fdd04139fe0 2024-08-18T21:14:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fdd040a5000 con 0x7fdd040a6ce0 2024-08-18T21:14:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdd040a4360 con 0x7fdd040a7600 2024-08-18T21:14:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0898c640 10 monclient(hunting): authenticate will time out at 1653.619288s 2024-08-18T21:14:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd02d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdd04139fe0 0x7fdd04140cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33044/0 (socket says 172.21.15.5:33044) 2024-08-18T21:14:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 learned_addr learned my addr 172.21.15.5:0/133256733 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:14:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> v2:172.21.15.157:3300/0 conn(0x7fdd040a6ce0 msgr2=0x7fdd040a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:14:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.157:3300/0 conn(0x7fdd040a6ce0 0x7fdd040a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:14:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 0x7fdd04139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request con 0x7fdd040a7600 auth_method 0 2024-08-18T21:14:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 msgr2=0x7fdd04139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:14:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 msgr2=0x7fdd04139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 0x7fdd04139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.603+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 0x7fdd04139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:14:46.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.607+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 >> v1:172.21.15.5:6789/0 conn(0x7fdd04139fe0 legacy=0x7fdd04140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:46.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.807+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 0x7fdd04139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:46.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.807+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request con 0x7fdd040a7600 auth_method 0 2024-08-18T21:14:46.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.807+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.807+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.807+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.807+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 msgr2=0x7fdd04139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:14:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.807+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 msgr2=0x7fdd04139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.807+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 0x7fdd04139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.807+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 0x7fdd04139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:14:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.807+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> v2:172.21.15.157:3300/0 conn(0x7fdd040a6ce0 msgr2=0x7fdd040a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:14:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:46.807+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.157:3300/0 conn(0x7fdd040a6ce0 0x7fdd040a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:14:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:47.211+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> v2:172.21.15.157:3300/0 conn(0x7fdd040a6ce0 msgr2=0x7fdd040a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:14:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:47.211+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.157:3300/0 conn(0x7fdd040a6ce0 0x7fdd040a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:14:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:47.211+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 0x7fdd04139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:47.211+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request con 0x7fdd040a7600 auth_method 0 2024-08-18T21:14:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:47.211+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:47.211+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:47.211+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:47.211+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 msgr2=0x7fdd04139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:14:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:47.211+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 msgr2=0x7fdd04139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:47.211+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 0x7fdd04139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:47.211+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 0x7fdd04139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:14:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:48.015+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> v2:172.21.15.157:3300/0 conn(0x7fdd040a6ce0 msgr2=0x7fdd040a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:14:48.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:48.015+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.157:3300/0 conn(0x7fdd040a6ce0 0x7fdd040a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:14:48.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:48.015+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 0x7fdd04139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:48.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:48.015+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request con 0x7fdd040a7600 auth_method 0 2024-08-18T21:14:48.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:48.015+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:48.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:48.015+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:48.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:48.015+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:48.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:48.015+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 msgr2=0x7fdd04139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:14:48.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:48.015+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 msgr2=0x7fdd04139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:48.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:48.015+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 0x7fdd04139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:48.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:48.015+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 0x7fdd04139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:14:48.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:48.055+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 >> v1:172.21.15.5:6789/0 conn(0x7fdd04139fe0 legacy=0x7fdd04140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-08-18T21:14:48.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:48.055+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 >> v1:172.21.15.5:6789/0 conn(0x7fdd04139fe0 legacy=0x7fdd04140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:14:48.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:48.055+0000 7fdd02d9d640 1 --1- 172.21.15.5:0/133256733 >> v1:172.21.15.5:6789/0 conn(0x7fdd04139fe0 0x7fdd04140cf0 :-1 s=OPENED pgs=204 cs=1 l=1).handle_message read tag failed 2024-08-18T21:14:48.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:48.055+0000 7fdd02d9d640 1 --1- 172.21.15.5:0/133256733 >> v1:172.21.15.5:6789/0 conn(0x7fdd04139fe0 0x7fdd04140cf0 :-1 s=OPENED pgs=204 cs=1 l=1).fault on lossy channel, failing 2024-08-18T21:14:48.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:48.055+0000 7fdd01d9b640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.5:6789/0 2024-08-18T21:14:49.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 10 monclient(hunting): tick 2024-08-18T21:14:49.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:14:49.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 1 monclient(hunting): continuing hunt 2024-08-18T21:14:49.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:14:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 msgr2=0x7fdd04139aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:14:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd040a7600 0x7fdd04139aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 >> v2:172.21.15.157:3300/0 conn(0x7fdd040a6ce0 msgr2=0x7fdd040a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:14:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.157:3300/0 conn(0x7fdd040a6ce0 0x7fdd040a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 >> v1:172.21.15.5:6789/0 conn(0x7fdd04139fe0 legacy=0x7fdd04140cf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 10 monclient: _add_conns ranks=[5,4,2,8,7,1,9,6] 2024-08-18T21:14:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 0x7fdce4005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 10 monclient(hunting): picked mon.noname-h con 0x7fdce4003750 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 0x7fdce40086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:49.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 10 monclient(hunting): picked mon.noname-c con 0x7fdce4006220 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:49.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 0x7fdce400b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:49.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 10 monclient(hunting): picked mon.noname-b con 0x7fdce4008da0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:49.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:49.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fdd040a4360 con 0x7fdce4008da0 2024-08-18T21:14:49.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:49.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fdce400b970 con 0x7fdce4006220 2024-08-18T21:14:49.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:49.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdce400bb70 con 0x7fdce4003750 2024-08-18T21:14:49.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdd00d99640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:49.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.603+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 0x7fdce40086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:49.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 0x7fdce400b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:49.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request con 0x7fdce4006220 auth_method 0 2024-08-18T21:14:49.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:49.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:49.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:49.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 0x7fdce4005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:49.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd0259c640 10 monclient(hunting): get_auth_request con 0x7fdce4003750 auth_method 0 2024-08-18T21:14:49.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd0259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:49.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd0259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:49.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd0259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:49.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd02d9d640 10 monclient(hunting): get_auth_request con 0x7fdce4008da0 auth_method 0 2024-08-18T21:14:49.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd02d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:49.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd02d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:49.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd02d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:49.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 msgr2=0x7fdce4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:14:49.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 msgr2=0x7fdce4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:49.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 msgr2=0x7fdce40086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:14:49.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 0x7fdce4005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:49.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 msgr2=0x7fdce40086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:49.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 0x7fdce40086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:49.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 0x7fdce4005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:14:49.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 0x7fdce40086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:14:49.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 msgr2=0x7fdce400b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:14:49.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 msgr2=0x7fdce400b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:49.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 0x7fdce400b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:49.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.607+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 0x7fdce400b230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:14:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 0x7fdce400b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 0x7fdce40086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd02d9d640 10 monclient(hunting): get_auth_request con 0x7fdce4008da0 auth_method 0 2024-08-18T21:14:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd02d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd02d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd02d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request con 0x7fdce4006220 auth_method 0 2024-08-18T21:14:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 0x7fdce4005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd0259c640 10 monclient(hunting): get_auth_request con 0x7fdce4003750 auth_method 0 2024-08-18T21:14:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd0259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd0259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd0259c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 msgr2=0x7fdce400b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:14:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 msgr2=0x7fdce400b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 0x7fdce400b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 msgr2=0x7fdce40086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:14:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 msgr2=0x7fdce40086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 0x7fdce40086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 0x7fdce400b230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:14:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 msgr2=0x7fdce4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:14:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 msgr2=0x7fdce4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 0x7fdce40086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:14:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 0x7fdce4005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:49.811+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 0x7fdce4005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:14:50.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 0x7fdce400b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:50.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 0x7fdce40086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:50.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd02d9d640 10 monclient(hunting): get_auth_request con 0x7fdce4008da0 auth_method 0 2024-08-18T21:14:50.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd02d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:50.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd02d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:50.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd02d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:50.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request con 0x7fdce4006220 auth_method 0 2024-08-18T21:14:50.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:50.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:50.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:50.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 0x7fdce4005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:50.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd0259c640 10 monclient(hunting): get_auth_request con 0x7fdce4003750 auth_method 0 2024-08-18T21:14:50.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd0259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:50.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd0259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:50.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd0259c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:50.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 msgr2=0x7fdce400b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:14:50.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 msgr2=0x7fdce400b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:50.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 0x7fdce400b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:50.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 msgr2=0x7fdce40086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:14:50.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 msgr2=0x7fdce40086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:50.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 0x7fdce40086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:50.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 msgr2=0x7fdce4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:14:50.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 msgr2=0x7fdce4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:50.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 0x7fdce400b230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:14:50.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 0x7fdce40086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:14:50.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 0x7fdce4005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:50.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:50.215+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 0x7fdce4005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:14:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 0x7fdce400b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd02d9d640 10 monclient(hunting): get_auth_request con 0x7fdce4008da0 auth_method 0 2024-08-18T21:14:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd02d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd02d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd02d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 0x7fdce40086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request con 0x7fdce4006220 auth_method 0 2024-08-18T21:14:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 0x7fdce4005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd0259c640 10 monclient(hunting): get_auth_request con 0x7fdce4003750 auth_method 0 2024-08-18T21:14:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 msgr2=0x7fdce400b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:14:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd0259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd0259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd0259c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 msgr2=0x7fdce400b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 0x7fdce400b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 0x7fdce400b230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:14:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 msgr2=0x7fdce40086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:14:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 msgr2=0x7fdce40086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 0x7fdce40086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 msgr2=0x7fdce4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:14:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 msgr2=0x7fdce4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 0x7fdce40086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:14:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 0x7fdce4005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:51.019+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 0x7fdce4005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:14:52.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.602+0000 7fdd00d99640 10 monclient(hunting): tick 2024-08-18T21:14:52.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.602+0000 7fdd00d99640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:14:52.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.602+0000 7fdd00d99640 1 monclient(hunting): continuing hunt 2024-08-18T21:14:52.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.602+0000 7fdd00d99640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:14:52.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.602+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 msgr2=0x7fdce4005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:14:52.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.602+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4003750 0x7fdce4005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:52.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.602+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 msgr2=0x7fdce40086b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:14:52.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.602+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4006220 0x7fdce40086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:52.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.602+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 msgr2=0x7fdce400b230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:14:52.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.602+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4008da0 0x7fdce400b230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:52.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.602+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 reap_dead start 2024-08-18T21:14:52.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.602+0000 7fdd00d99640 10 monclient: _add_conns ranks=[9,8,1,6,7] 2024-08-18T21:14:52.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 reap_dead start 2024-08-18T21:14:52.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 0x7fdce4009220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:52.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd00d99640 10 monclient(hunting): picked mon.noname-a con 0x7fdce4003b70 addr v2:172.21.15.5:3300/0 2024-08-18T21:14:52.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 0x7fdce4008630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:52.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd00d99640 10 monclient(hunting): picked mon.noname-e con 0x7fdce4009760 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:14:52.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd00d99640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fdce4009b40 addr v1:172.21.15.157:6789/0 2024-08-18T21:14:52.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd040a8900 con 0x7fdce4009b40 2024-08-18T21:14:52.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd00d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:52.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdd040a4360 con 0x7fdce4003b70 2024-08-18T21:14:52.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd00d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:52.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fdce400b970 con 0x7fdce4009760 2024-08-18T21:14:52.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd00d99640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:52.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 >> v1:172.21.15.157:6789/0 conn(0x7fdce4009b40 legacy=0x7fdce4009fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:14:52.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 0x7fdce4008630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:52.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 0x7fdce4009220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request con 0x7fdce4009760 auth_method 0 2024-08-18T21:14:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd0259c640 10 monclient(hunting): get_auth_request con 0x7fdce4003b70 auth_method 0 2024-08-18T21:14:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd0259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd0259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd0259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 msgr2=0x7fdce4008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:14:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 msgr2=0x7fdce4008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 msgr2=0x7fdce4009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:14:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 msgr2=0x7fdce4009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 0x7fdce4008630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:52.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 0x7fdce4009220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:52.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 0x7fdce4009220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:14:52.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.606+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 0x7fdce4008630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:14:52.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 >> v1:172.21.15.157:6789/0 conn(0x7fdce4009b40 legacy=0x7fdce4009fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:14:52.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 0x7fdce4008630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:52.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 0x7fdce4009220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:52.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdd0259c640 10 monclient(hunting): get_auth_request con 0x7fdce4003b70 auth_method 0 2024-08-18T21:14:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdd0259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdd0259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdd0259c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request con 0x7fdce4009760 auth_method 0 2024-08-18T21:14:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 msgr2=0x7fdce4009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:14:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 msgr2=0x7fdce4008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:14:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 msgr2=0x7fdce4008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 msgr2=0x7fdce4009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 0x7fdce4008630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 0x7fdce4009220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 0x7fdce4008630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:14:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:52.810+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 0x7fdce4009220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:14:53.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 >> v1:172.21.15.157:6789/0 conn(0x7fdce4009b40 legacy=0x7fdce4009fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:14:53.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 0x7fdce4008630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:53.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request con 0x7fdce4009760 auth_method 0 2024-08-18T21:14:53.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:53.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 0x7fdce4009220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:53.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:53.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:53.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdd0259c640 10 monclient(hunting): get_auth_request con 0x7fdce4003b70 auth_method 0 2024-08-18T21:14:53.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdd0259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:53.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdd0259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:53.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdd0259c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:53.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 msgr2=0x7fdce4008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:14:53.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 msgr2=0x7fdce4008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:53.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 0x7fdce4008630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:53.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 0x7fdce4008630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:14:53.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 msgr2=0x7fdce4009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:14:53.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 msgr2=0x7fdce4009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:53.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 0x7fdce4009220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:53.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:53.214+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 0x7fdce4009220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:14:54.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 >> v1:172.21.15.157:6789/0 conn(0x7fdce4009b40 legacy=0x7fdce4009fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:14:54.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 0x7fdce4009220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:54.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 0x7fdce4008630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:54.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request con 0x7fdce4009760 auth_method 0 2024-08-18T21:14:54.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:54.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:54.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:54.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdd0259c640 10 monclient(hunting): get_auth_request con 0x7fdce4003b70 auth_method 0 2024-08-18T21:14:54.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdd0259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:54.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdd0259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdd0259c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-18T21:14:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 msgr2=0x7fdce4008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T21:14:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 msgr2=0x7fdce4009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T21:14:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 msgr2=0x7fdce4008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 msgr2=0x7fdce4009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:14:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 0x7fdce4008630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 0x7fdce4009220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:14:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 0x7fdce4009220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:14:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:54.018+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 0x7fdce4008630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:14:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 10 monclient(hunting): tick 2024-08-18T21:14:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:14:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 1 monclient(hunting): continuing hunt 2024-08-18T21:14:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:14:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 msgr2=0x7fdce4008630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:14:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce4009760 0x7fdce4008630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 msgr2=0x7fdce4009220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:14:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> v2:172.21.15.5:3300/0 conn(0x7fdce4003b70 0x7fdce4009220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 >> v1:172.21.15.157:6789/0 conn(0x7fdce4009b40 legacy=0x7fdce4009fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:14:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 10 monclient: _add_conns ranks=[6,7] 2024-08-18T21:14:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdce400aaf0 0x7fdce400aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 10 monclient(hunting): picked mon.noname-d con 0x7fdce400aaf0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:14:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdce40111a0 0x7fdce4013590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 10 monclient(hunting): picked mon.noname-i con 0x7fdce40111a0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fdd040a4360 con 0x7fdce400aaf0 2024-08-18T21:14:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fdce400b970 con 0x7fdce40111a0 2024-08-18T21:14:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd00d99640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:55.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdce400aaf0 msgr2=0x7fdce400aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:14:55.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdce400aaf0 0x7fdce400aed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:14:55.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdce40111a0 msgr2=0x7fdce4013590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:14:55.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.606+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdce40111a0 0x7fdce4013590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:14:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.810+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdce400aaf0 msgr2=0x7fdce400aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:14:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.810+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdce400aaf0 0x7fdce400aed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:14:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.810+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdce40111a0 msgr2=0x7fdce4013590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:14:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:55.810+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdce40111a0 0x7fdce4013590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:14:56.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:56.214+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdce400aaf0 msgr2=0x7fdce400aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:14:56.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:56.214+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdce400aaf0 0x7fdce400aed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:14:56.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:56.214+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdce40111a0 msgr2=0x7fdce4013590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:14:56.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:56.214+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdce40111a0 0x7fdce4013590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:14:57.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:57.018+0000 7fdd0259c640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdce400aaf0 msgr2=0x7fdce400aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:14:57.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:57.018+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdce400aaf0 0x7fdce400aed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:14:57.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:57.018+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdce40111a0 msgr2=0x7fdce4013590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:14:57.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:57.018+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdce40111a0 0x7fdce4013590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:14:58.233 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32342]: starting. 2024-08-18T21:14:58.233 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32342]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-32340 2024-08-18T21:14:58.233 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32342]: shutting down. 2024-08-18T21:14:58.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 10 monclient(hunting): tick 2024-08-18T21:14:58.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:14:58.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 1 monclient(hunting): continuing hunt 2024-08-18T21:14:58.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:14:58.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdce40111a0 msgr2=0x7fdce4013590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:14:58.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fdce40111a0 0x7fdce4013590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:58.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdce400aaf0 msgr2=0x7fdce400aed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:14:58.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fdce400aaf0 0x7fdce400aed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:58.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd02d9d640 1 -- 172.21.15.5:0/133256733 reap_dead start 2024-08-18T21:14:58.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 10 monclient: _add_conns ranks=[5,8,2,1,3,6,10,0,9,4,7] 2024-08-18T21:14:58.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4009fd0 0x7fdce400aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:58.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 10 monclient(hunting): picked mon.noname-h con 0x7fdce4009fd0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:58.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce400b030 0x7fdce4008630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:58.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 10 monclient(hunting): picked mon.noname-e con 0x7fdce400b030 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:14:58.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4005b80 0x7fdce4013590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:58.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 10 monclient(hunting): picked mon.noname-b con 0x7fdce4005b80 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:58.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:58.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fdd040a4360 con 0x7fdce4005b80 2024-08-18T21:14:58.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:58.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fdce400b970 con 0x7fdce4009fd0 2024-08-18T21:14:58.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:58.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 1 -- 172.21.15.5:0/133256733 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fdce400bb70 con 0x7fdce400b030 2024-08-18T21:14:58.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd00d99640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:58.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce400b030 0x7fdce4008630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:58.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request con 0x7fdce400b030 auth_method 0 2024-08-18T21:14:58.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4005b80 0x7fdce4013590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd0259c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4009fd0 0x7fdce400aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd02d9d640 10 monclient(hunting): get_auth_request con 0x7fdce4005b80 auth_method 0 2024-08-18T21:14:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd02d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd02d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd02d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd0259c640 10 monclient(hunting): get_auth_request con 0x7fdce4009fd0 auth_method 0 2024-08-18T21:14:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd0259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd0259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd0259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd02d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd02d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd02d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd0259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd0259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd0259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 10 monclient(hunting): handle_auth_done global_id 115118 payload 274 2024-08-18T21:14:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4009fd0 msgr2=0x7fdce400aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4009fd0 0x7fdce400aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4005b80 msgr2=0x7fdce4013590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4005b80 0x7fdce4013590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:58.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:14:58.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 1 monclient: found mon.noname-e 2024-08-18T21:14:58.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:58.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:14:58.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce400a7a0 con 0x7fdce400b030 2024-08-18T21:14:58.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.606+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4005b80 0x7fdce4013590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:14:58.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdcf9d9b640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce400b030 msgr2=0x7fdce4008630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:58.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdcf9d9b640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce400b030 0x7fdce4008630 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdcec000ee0 tx=0x7fdcec0092b0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=7c69b2688cdad391 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:58.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd01d9b640 1 -- 172.21.15.5:0/133256733 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdcec0b2070 con 0x7fdce400b030 2024-08-18T21:14:58.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd01d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:58.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd01d9b640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:14:58.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd01d9b640 10 monclient: dump: 2024-08-18T21:14:58.614 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:58.614 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:58.614 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:58.614 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:58.614 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:58.614 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:58.615 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:58.615 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:58.615 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:58.615 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:58.615 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:58.615 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:58.615 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:58.615 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:58.615 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:58.615 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:58.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd01d9b640 10 monclient: _finish_auth 0 2024-08-18T21:14:58.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd01d9b640 10 monclient: _check_auth_tickets 2024-08-18T21:14:58.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd01d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:58.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd01d9b640 1 -- 172.21.15.5:0/133256733 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec01a0d0 con 0x7fdce400b030 2024-08-18T21:14:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd01d9b640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd01d9b640 1 -- 172.21.15.5:0/133256733 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdcec00f040 con 0x7fdce400b030 2024-08-18T21:14:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd01d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd01d9b640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:14:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd01d9b640 10 monclient: dump: 2024-08-18T21:14:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:58.617 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:58.617 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:58.617 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:58.617 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:58.617 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:58.617 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:58.617 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:58.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd0898c640 5 monclient: authenticate success, global_id 115118 2024-08-18T21:14:58.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd0898c640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:58.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd0898c640 4 set_mon_vals no callback set 2024-08-18T21:14:58.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd0898c640 10 monclient: shutdown 2024-08-18T21:14:58.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd0898c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:58.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd0898c640 1 -- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce400b030 msgr2=0x7fdce4008630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:58.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd0898c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce400b030 0x7fdce4008630 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdcec000ee0 tx=0x7fdcec0092b0 comp rx=0 tx=0).stop 2024-08-18T21:14:58.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd0898c640 1 -- 172.21.15.5:0/133256733 shutdown_connections 2024-08-18T21:14:58.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd0898c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fdce4005b80 0x7fdce4013590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:58.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd0898c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdce400b030 0x7fdce4008630 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:58.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd0898c640 1 --2- 172.21.15.5:0/133256733 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fdce4009fd0 0x7fdce400aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:58.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.614+0000 7fdd0898c640 1 -- 172.21.15.5:0/133256733 >> 172.21.15.5:0/133256733 conn(0x7fdd040acbc0 msgr2=0x7fdd040a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:58.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.618+0000 7fdd0898c640 1 -- 172.21.15.5:0/133256733 shutdown_connections 2024-08-18T21:14:58.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.618+0000 7fdd0898c640 1 -- 172.21.15.5:0/133256733 wait complete. 2024-08-18T21:14:58.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.618+0000 7fdd0898c640 10 monclient: build_initial_monmap 2024-08-18T21:14:58.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.618+0000 7fdd0898c640 10 monclient: monmap: 2024-08-18T21:14:58.619 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:58.619 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:58.619 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:58.620 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:58.620 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:58.620 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:58.620 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:58.620 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:58.620 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:58.620 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:58.620 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:58.620 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:58.620 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:58.620 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:58.621 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:58.621 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:58.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.618+0000 7fdd0898c640 1 Processor -- start 2024-08-18T21:14:58.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.618+0000 7fdd0898c640 1 -- start start 2024-08-18T21:14:58.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.618+0000 7fdd0898c640 10 monclient: init 2024-08-18T21:14:58.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0898c640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:58.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0898c640 10 monclient: _add_conns ranks=[3,4,8,1,7,5,0,6,2] 2024-08-18T21:14:58.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0898c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdce4005b80 0x7fdd04122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:58.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0898c640 10 monclient(hunting): picked mon.noname-g con 0x7fdce4005b80 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:58.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0898c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4009fd0 0x7fdd04122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:58.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0898c640 10 monclient(hunting): picked mon.noname-c con 0x7fdce4009fd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0898c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd041233b0 0x7fdd04137240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0898c640 10 monclient(hunting): picked mon.noname-e con 0x7fdd041233b0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:14:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0898c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0898c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdd040a79e0 con 0x7fdce4005b80 2024-08-18T21:14:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0898c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0898c640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fdd040a8220 con 0x7fdce4009fd0 2024-08-18T21:14:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0898c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0898c640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fdd04123c30 con 0x7fdd041233b0 2024-08-18T21:14:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0898c640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0898c640 10 monclient(hunting): authenticate will time out at 1665.636733s 2024-08-18T21:14:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd041233b0 0x7fdd04137240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd041233b0 0x7fdd04137240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:37322/0 (socket says 172.21.15.5:37322) 2024-08-18T21:14:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 1 -- 172.21.15.5:0/1970353174 learned_addr learned my addr 172.21.15.5:0/1970353174 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 10 monclient(hunting): get_auth_request con 0x7fdd041233b0 auth_method 0 2024-08-18T21:14:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdcf9d9b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4009fd0 0x7fdd04122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request con 0x7fdce4009fd0 auth_method 0 2024-08-18T21:14:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdcf9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdcf9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0259c640 1 --2- 172.21.15.5:0/1970353174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdce4005b80 0x7fdd04122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0259c640 10 monclient(hunting): get_auth_request con 0x7fdce4005b80 auth_method 0 2024-08-18T21:14:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdcf9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdcf9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdcf9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd0259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 10 monclient(hunting): handle_auth_done global_id 115127 payload 824 2024-08-18T21:14:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 1 -- 172.21.15.5:0/1970353174 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4009fd0 msgr2=0x7fdd04122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/1970353174 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4009fd0 0x7fdd04122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 1 -- 172.21.15.5:0/1970353174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdce4005b80 msgr2=0x7fdd04122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/1970353174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdce4005b80 0x7fdd04122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 10 monclient: _finish_hunting 0 2024-08-18T21:14:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 1 monclient: found mon.noname-e 2024-08-18T21:14:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:14:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 1 -- 172.21.15.5:0/1970353174 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd04125150 con 0x7fdd041233b0 2024-08-18T21:14:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.622+0000 7fdd02d9d640 1 -- 172.21.15.5:0/1970353174 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd041233b0 msgr2=0x7fdd04137240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdd02d9d640 1 --2- 172.21.15.5:0/1970353174 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd041233b0 0x7fdd04137240 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdd0406f720 tx=0x7fdcfc006ca0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdcfb7fe640 1 -- 172.21.15.5:0/1970353174 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdcfc0047f0 con 0x7fdd041233b0 2024-08-18T21:14:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdcfb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:58.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdcfb7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:14:58.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdcfb7fe640 10 monclient: dump: 2024-08-18T21:14:58.631 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:58.631 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:58.631 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:58.631 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:58.631 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:58.631 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:58.631 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:58.631 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:58.631 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:58.631 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:58.631 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:58.631 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:58.631 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:58.632 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdcfb7fe640 10 monclient: _finish_auth 0 2024-08-18T21:14:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdcfb7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:14:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdcfb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdcfb7fe640 1 -- 172.21.15.5:0/1970353174 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcfc0049d0 con 0x7fdd041233b0 2024-08-18T21:14:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdcfb7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdcfb7fe640 1 -- 172.21.15.5:0/1970353174 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdcfc017430 con 0x7fdd041233b0 2024-08-18T21:14:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdd0898c640 5 monclient: authenticate success, global_id 115127 2024-08-18T21:14:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdd0898c640 10 monclient: _renew_subs 2024-08-18T21:14:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdd0159a640 4 set_mon_vals no callback set 2024-08-18T21:14:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdd0898c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:14:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdd0898c640 1 -- 172.21.15.5:0/1970353174 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd04125430 con 0x7fdd041233b0 2024-08-18T21:14:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdcfb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdcfb7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:14:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdcfb7fe640 10 monclient: dump: 2024-08-18T21:14:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:58.634 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdd0898c640 10 monclient: _renew_subs 2024-08-18T21:14:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdd0898c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:14:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdd0898c640 1 -- 172.21.15.5:0/1970353174 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd04138e70 con 0x7fdd041233b0 2024-08-18T21:14:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdd0898c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdd0898c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdd0898c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:14:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdd0898c640 1 -- 172.21.15.5:0/1970353174 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd0413a3f0 con 0x7fdd041233b0 2024-08-18T21:14:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdcfb7fe640 1 -- 172.21.15.5:0/1970353174 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fdcfc004b80 con 0x7fdd041233b0 2024-08-18T21:14:58.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdcfb7fe640 1 --2- 172.21.15.5:0/1970353174 >> v2:172.21.15.157:6812/631023601 conn(0x7fdce403ebd0 0x7fdce4041090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:58.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdcfb7fe640 1 -- 172.21.15.5:0/1970353174 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(302..302 src has 22..302) ==== 3506+0+0 (secure 0 0 0) 0x7fdcfc010030 con 0x7fdd041233b0 2024-08-18T21:14:58.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdd0259c640 1 --2- 172.21.15.5:0/1970353174 >> v2:172.21.15.157:6812/631023601 conn(0x7fdce403ebd0 0x7fdce4041090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:58.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.626+0000 7fdd0259c640 10 monclient: get_auth_request con 0x7fdce403ebd0 auth_method 0 2024-08-18T21:14:58.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.630+0000 7fdd0259c640 1 --2- 172.21.15.5:0/1970353174 >> v2:172.21.15.157:6812/631023601 conn(0x7fdce403ebd0 0x7fdce4041090 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4003ff0 tx=0x7fdcf4007ab0 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:58.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.630+0000 7fdcfb7fe640 1 -- 172.21.15.5:0/1970353174 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fdcfc006610 con 0x7fdd041233b0 2024-08-18T21:14:58.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.630+0000 7fdcfb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:58.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.630+0000 7fdcfb7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.870+0000 7fdd0898c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:14:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.870+0000 7fdd0898c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:14:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.870+0000 7fdd0898c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:14:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.870+0000 7fdd0898c640 1 -- 172.21.15.5:0/1970353174 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdd04138370 con 0x7fdd041233b0 2024-08-18T21:14:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.870+0000 7fdcfb7fe640 1 -- 172.21.15.5:0/1970353174 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3155 (secure 0 0 0) 0x7fdcfc04db80 con 0x7fdd041233b0 2024-08-18T21:14:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.870+0000 7fdcfb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:14:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.870+0000 7fdcfb7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:58.870 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":238,"quorum":[0,2,3,4,5,8],"quorum_names":["a","b","g","c","h","e"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:14:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.874+0000 7fdd0898c640 1 -- 172.21.15.5:0/1970353174 >> v2:172.21.15.157:6812/631023601 conn(0x7fdce403ebd0 msgr2=0x7fdce4041090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.874+0000 7fdd0898c640 1 --2- 172.21.15.5:0/1970353174 >> v2:172.21.15.157:6812/631023601 conn(0x7fdce403ebd0 0x7fdce4041090 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4003ff0 tx=0x7fdcf4007ab0 comp rx=0 tx=0).stop 2024-08-18T21:14:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.874+0000 7fdd0898c640 10 monclient: shutdown 2024-08-18T21:14:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.874+0000 7fdd0898c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.874+0000 7fdd0898c640 1 -- 172.21.15.5:0/1970353174 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd041233b0 msgr2=0x7fdd04137240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.874+0000 7fdd0898c640 1 --2- 172.21.15.5:0/1970353174 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd041233b0 0x7fdd04137240 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdd0406f720 tx=0x7fdcfc006ca0 comp rx=0 tx=0).stop 2024-08-18T21:14:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.874+0000 7fdd0898c640 1 -- 172.21.15.5:0/1970353174 shutdown_connections 2024-08-18T21:14:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.874+0000 7fdd0898c640 1 --2- 172.21.15.5:0/1970353174 >> v2:172.21.15.157:6812/631023601 conn(0x7fdce403ebd0 0x7fdce4041090 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.874+0000 7fdd0898c640 1 --2- 172.21.15.5:0/1970353174 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fdd041233b0 0x7fdd04137240 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.874+0000 7fdd0898c640 1 --2- 172.21.15.5:0/1970353174 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fdce4009fd0 0x7fdd04122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.874+0000 7fdd0898c640 1 --2- 172.21.15.5:0/1970353174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdce4005b80 0x7fdd04122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.874+0000 7fdd0898c640 1 -- 172.21.15.5:0/1970353174 >> 172.21.15.5:0/1970353174 conn(0x7fdd040acbc0 msgr2=0x7fdd040ab700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.874+0000 7fdd0898c640 1 -- 172.21.15.5:0/1970353174 shutdown_connections 2024-08-18T21:14:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:58.874+0000 7fdd0898c640 1 -- 172.21.15.5:0/1970353174 wait complete. 2024-08-18T21:14:58.891 INFO:tasks.mon_thrash.ceph_manager:quorum is size 6 2024-08-18T21:14:58.891 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon a 2024-08-18T21:14:58.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:14:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.018+0000 7f1533baa640 10 monclient: get_monmap_and_config 2024-08-18T21:14:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.018+0000 7f1533baa640 10 monclient: build_initial_monmap 2024-08-18T21:14:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.018+0000 7f1533baa640 10 monclient: monmap: 2024-08-18T21:14:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:59.023743+0000 2024-08-18T21:14:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:59.023743+0000 2024-08-18T21:14:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:59.020 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:59.020 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:59.020 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:59.020 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:59.020 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:59.020 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:59.020 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:59.020 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 1 Processor -- start 2024-08-18T21:14:59.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 1 -- start start 2024-08-18T21:14:59.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 10 monclient: init 2024-08-18T21:14:59.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:59.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 10 monclient: _add_conns ranks=[2,5,0,10,4,1,8,7,9,6,3] 2024-08-18T21:14:59.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f152c138a10 0x7f152c09efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 10 monclient(hunting): picked mon.noname-b con 0x7f152c138a10 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:59.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f152c0a4db0 0x7f152c138df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 10 monclient(hunting): picked mon.noname-h con 0x7f152c0a4db0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:59.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f152c139330 addr v1:172.21.15.5:6789/0 2024-08-18T21:14:59.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f152c09dec0 con 0x7f152c139330 2024-08-18T21:14:59.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f152c09f660 con 0x7f152c138a10 2024-08-18T21:14:59.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f152c09e1a0 con 0x7f152c0a4db0 2024-08-18T21:14:59.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:59.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1533baa640 10 monclient(hunting): authenticate will time out at 1666.037529s 2024-08-18T21:14:59.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f152c138a10 0x7f152c09efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1532147640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f152c139330 0x7f152c06c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40340/0 (socket says 172.21.15.5:40340) 2024-08-18T21:14:59.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1532147640 1 -- 172.21.15.5:0/3966614254 learned_addr learned my addr 172.21.15.5:0/3966614254 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:14:59.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f152c138a10 0x7f152c09efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:43148/0 (socket says 172.21.15.5:43148) 2024-08-18T21:14:59.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 10 monclient(hunting): get_auth_request con 0x7f152c138a10 auth_method 0 2024-08-18T21:14:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531145640 1 --2- 172.21.15.5:0/3966614254 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f152c0a4db0 0x7f152c138df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 10 monclient(hunting): handle_auth_done global_id 114941 payload 274 2024-08-18T21:14:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 1 -- 172.21.15.5:0/3966614254 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f152c0a4db0 msgr2=0x7f152c138df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 1 --2- 172.21.15.5:0/3966614254 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f152c0a4db0 0x7f152c138df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 1 -- 172.21.15.5:0/3966614254 >> v1:172.21.15.5:6789/0 conn(0x7f152c139330 legacy=0x7f152c06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 10 monclient: _finish_hunting 0 2024-08-18T21:14:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 1 monclient: found mon.noname-b 2024-08-18T21:14:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:59.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:14:59.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.022+0000 7f1531946640 1 -- 172.21.15.5:0/3966614254 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152c06d060 con 0x7f152c138a10 2024-08-18T21:14:59.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1531946640 1 -- 172.21.15.5:0/3966614254 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f152c138a10 msgr2=0x7f152c09efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:59.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1531946640 1 --2- 172.21.15.5:0/3966614254 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f152c138a10 0x7f152c09efd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f15280097f0 tx=0x7f152801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ed8140d3cf3f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1530944640 1 -- 172.21.15.5:0/3966614254 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f15280b0070 con 0x7f152c138a10 2024-08-18T21:14:59.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1530944640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1530944640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:14:59.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1530944640 10 monclient: dump: 2024-08-18T21:14:59.027 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.027 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.027 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.027 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.028 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.028 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.028 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.028 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.028 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.028 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.028 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.028 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.028 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.029 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.029 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.029 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1530944640 10 monclient: _finish_auth 0 2024-08-18T21:14:59.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1530944640 10 monclient: _check_auth_tickets 2024-08-18T21:14:59.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1530944640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:59.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1533baa640 5 monclient: authenticate success, global_id 114941 2024-08-18T21:14:59.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1530944640 1 -- 172.21.15.5:0/3966614254 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15280a9a60 con 0x7f152c138a10 2024-08-18T21:14:59.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1533baa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:14:59.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1530944640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:59.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1533baa640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:59.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1533baa640 4 set_mon_vals no callback set 2024-08-18T21:14:59.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1530944640 1 -- 172.21.15.5:0/3966614254 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f15280a9c10 con 0x7f152c138a10 2024-08-18T21:14:59.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1530944640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1530944640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:14:59.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1530944640 10 monclient: dump: 2024-08-18T21:14:59.030 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.030 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.030 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.030 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.030 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.030 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.030 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.030 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.030 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.030 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.031 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.031 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.031 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.031 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.031 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.031 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1533baa640 10 monclient: shutdown 2024-08-18T21:14:59.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1533baa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:59.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1533baa640 1 -- 172.21.15.5:0/3966614254 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f152c138a10 msgr2=0x7f152c09efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1533baa640 1 --2- 172.21.15.5:0/3966614254 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f152c138a10 0x7f152c09efd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f15280097f0 tx=0x7f152801c3a0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1533baa640 1 -- 172.21.15.5:0/3966614254 shutdown_connections 2024-08-18T21:14:59.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1533baa640 1 --2- 172.21.15.5:0/3966614254 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f152c0a4db0 0x7f152c138df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1533baa640 1 --2- 172.21.15.5:0/3966614254 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f152c138a10 0x7f152c09efd0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1533baa640 1 -- 172.21.15.5:0/3966614254 >> 172.21.15.5:0/3966614254 conn(0x7f152c0688d0 msgr2=0x7f152c068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1533baa640 1 -- 172.21.15.5:0/3966614254 shutdown_connections 2024-08-18T21:14:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1533baa640 1 -- 172.21.15.5:0/3966614254 wait complete. 2024-08-18T21:14:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1533baa640 10 monclient: build_initial_monmap 2024-08-18T21:14:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.026+0000 7f1533baa640 10 monclient: monmap: 2024-08-18T21:14:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:59.033 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 1 Processor -- start 2024-08-18T21:14:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 1 -- start start 2024-08-18T21:14:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 10 monclient: init 2024-08-18T21:14:59.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:59.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 10 monclient: _add_conns ranks=[4,3,2,7,1,5,8,6,0] 2024-08-18T21:14:59.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f152c0a4db0 0x7f152c1d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 10 monclient(hunting): picked mon.noname-c con 0x7f152c0a4db0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:59.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f152c138a10 0x7f152c140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 10 monclient(hunting): picked mon.noname-g con 0x7f152c138a10 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:59.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f152c139330 0x7f152c140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 10 monclient(hunting): picked mon.noname-b con 0x7f152c139330 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:59.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f152c1446a0 con 0x7f152c139330 2024-08-18T21:14:59.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f152c144520 con 0x7f152c138a10 2024-08-18T21:14:59.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f152c144820 con 0x7f152c0a4db0 2024-08-18T21:14:59.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:59.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 10 monclient(hunting): authenticate will time out at 1666.044786s 2024-08-18T21:14:59.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1532147640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f152c139330 0x7f152c140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f152c0a4db0 0x7f152c1d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1532147640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f152c139330 0x7f152c140d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:43158/0 (socket says 172.21.15.5:43158) 2024-08-18T21:14:59.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1532147640 1 -- 172.21.15.5:0/703078025 learned_addr learned my addr 172.21.15.5:0/703078025 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1532147640 10 monclient(hunting): get_auth_request con 0x7f152c139330 auth_method 0 2024-08-18T21:14:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1532147640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f152c0a4db0 0x7f152c1d17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:37708/0 (socket says 172.21.15.5:37708) 2024-08-18T21:14:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1532147640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1532147640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 10 monclient(hunting): get_auth_request con 0x7f152c0a4db0 auth_method 0 2024-08-18T21:14:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1532147640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1532147640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1532147640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531145640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f152c138a10 0x7f152c140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531145640 10 monclient(hunting): get_auth_request con 0x7f152c138a10 auth_method 0 2024-08-18T21:14:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531145640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531145640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531145640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 10 monclient(hunting): handle_auth_done global_id 114844 payload 824 2024-08-18T21:14:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 1 -- 172.21.15.5:0/703078025 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f152c138a10 msgr2=0x7f152c140840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f152c138a10 0x7f152c140840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 1 -- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f152c139330 msgr2=0x7f152c140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f152c139330 0x7f152c140d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 10 monclient: _finish_hunting 0 2024-08-18T21:14:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 1 monclient: found mon.noname-c 2024-08-18T21:14:59.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:59.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:14:59.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 1 -- 172.21.15.5:0/703078025 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152c1d1ec0 con 0x7f152c0a4db0 2024-08-18T21:14:59.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 1 -- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f152c0a4db0 msgr2=0x7f152c1d17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:59.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1531946640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f152c0a4db0 0x7f152c1d17a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f15280ad000 tx=0x7f1528019140 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f151e7fc640 1 -- 172.21.15.5:0/703078025 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f15280b0040 con 0x7f152c0a4db0 2024-08-18T21:14:59.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f151e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f151e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:14:59.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f151e7fc640 10 monclient: dump: 2024-08-18T21:14:59.042 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.042 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.042 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.043 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f151e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:14:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f151e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:14:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f151e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f151e7fc640 1 -- 172.21.15.5:0/703078025 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15280b9070 con 0x7f152c0a4db0 2024-08-18T21:14:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f151e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f151e7fc640 1 -- 172.21.15.5:0/703078025 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1528004490 con 0x7f152c0a4db0 2024-08-18T21:14:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 5 monclient: authenticate success, global_id 114844 2024-08-18T21:14:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 10 monclient: _renew_subs 2024-08-18T21:14:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:14:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 1 -- 172.21.15.5:0/703078025 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f152c1412c0 con 0x7f152c0a4db0 2024-08-18T21:14:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f151e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f151e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f151e7fc640 10 monclient: dump: 2024-08-18T21:14:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.046 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f151ffff640 4 set_mon_vals no callback set 2024-08-18T21:14:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 10 monclient: _renew_subs 2024-08-18T21:14:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:14:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.030+0000 7f1533baa640 1 -- 172.21.15.5:0/703078025 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f152c13ed50 con 0x7f152c0a4db0 2024-08-18T21:14:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1533baa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1533baa640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152c13db10 0x7f152c13b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1533baa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1533baa640 1 -- 172.21.15.5:0/703078025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f152c051140 con 0x7f152c13db10 2024-08-18T21:14:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1531145640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152c13db10 0x7f152c13b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1531145640 10 monclient: get_auth_request con 0x7f152c13db10 auth_method 0 2024-08-18T21:14:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1531145640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1531145640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1531145640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1531946640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f152c0a4db0 0x7f152c1d17a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f15280ad000 tx=0x7f1528019140 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7f15280e8770 osd_map(302..302 src has 22..302) 2024-08-18T21:14:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f151e7fc640 1 -- 172.21.15.5:0/703078025 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f1528003620 con 0x7f152c0a4db0 2024-08-18T21:14:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1531145640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1531145640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1531145640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1531145640 10 monclient(hunting): handle_auth_done global_id 124668 payload 824 2024-08-18T21:14:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1531145640 1 -- 172.21.15.5:0/703078025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f152c06dbf0 con 0x7f152c13db10 2024-08-18T21:14:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f151e7fc640 1 --2- 172.21.15.5:0/703078025 >> v2:172.21.15.157:6812/631023601 conn(0x7f151003bdf0 0x7f151003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1532147640 1 --2- 172.21.15.5:0/703078025 >> v2:172.21.15.157:6812/631023601 conn(0x7f151003bdf0 0x7f151003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1532147640 10 monclient: get_auth_request con 0x7f151003bdf0 auth_method 0 2024-08-18T21:14:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1531145640 1 -- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152c13db10 msgr2=0x7f152c13b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:59.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f1531145640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152c13db10 0x7f152c13b510 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f152c13d620 tx=0x7f152000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f151e7fc640 1 -- 172.21.15.5:0/703078025 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1520019020 con 0x7f152c13db10 2024-08-18T21:14:59.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f151e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f151e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:14:59.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f151e7fc640 10 monclient: dump: 2024-08-18T21:14:59.048 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.048 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.048 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.048 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.048 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.048 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.048 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.048 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.049 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f151e7fc640 1 -- 172.21.15.5:0/703078025 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f152000ab70 con 0x7f152c13db10 2024-08-18T21:14:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f151e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f151e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f151e7fc640 1 -- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152c13db10 msgr2=0x7f152c13b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f151e7fc640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152c13db10 0x7f152c13b510 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f152c13d620 tx=0x7f152000ec00 comp rx=0 tx=0).stop 2024-08-18T21:14:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f151e7fc640 1 -- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152c13db10 msgr2=0x7f152c13b510 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:59.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.034+0000 7f151e7fc640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152c13db10 0x7f152c13b510 secure :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f152c13d620 tx=0x7f152000ec00 comp rx=0 tx=0).stop 2024-08-18T21:14:59.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.038+0000 7f1532147640 1 --2- 172.21.15.5:0/703078025 >> v2:172.21.15.157:6812/631023601 conn(0x7f151003bdf0 0x7f151003e2b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f152400a560 tx=0x7f152400d040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.042+0000 7f1533baa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.042+0000 7f1533baa640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152c13ba50 0x7f152c13be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.042+0000 7f1533baa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.042+0000 7f1533baa640 1 -- 172.21.15.5:0/703078025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f152c0a8220 con 0x7f152c13ba50 2024-08-18T21:14:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.042+0000 7f1531145640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152c13ba50 0x7f152c13be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.042+0000 7f1531145640 10 monclient: get_auth_request con 0x7f152c13ba50 auth_method 0 2024-08-18T21:14:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.042+0000 7f1531145640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.042+0000 7f1531145640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.042+0000 7f1531145640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.042+0000 7f1531145640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.042+0000 7f1531145640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.042+0000 7f1531145640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.042+0000 7f1531145640 10 monclient(hunting): handle_auth_done global_id 124677 payload 824 2024-08-18T21:14:59.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.042+0000 7f1531145640 1 -- 172.21.15.5:0/703078025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f152c13c370 con 0x7f152c13ba50 2024-08-18T21:14:59.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f1531145640 1 -- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152c13ba50 msgr2=0x7f152c13be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:59.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f1531145640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152c13ba50 0x7f152c13be30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f152c13d620 tx=0x7f15200046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f151e7fc640 1 -- 172.21.15.5:0/703078025 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1520019040 con 0x7f152c13ba50 2024-08-18T21:14:59.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f151e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f151e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:14:59.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f151e7fc640 10 monclient: dump: 2024-08-18T21:14:59.053 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.053 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.053 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.053 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.053 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.053 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.054 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f151e7fc640 1 -- 172.21.15.5:0/703078025 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9384 (secure 0 0 0) 0x7f1520020280 con 0x7f152c13ba50 2024-08-18T21:14:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f151e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:59.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f151e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:59.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f151e7fc640 1 -- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152c13ba50 msgr2=0x7f152c13be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f151e7fc640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152c13ba50 0x7f152c13be30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f152c13d620 tx=0x7f15200046d0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f151e7fc640 1 -- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152c13ba50 msgr2=0x7f152c13be30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:59.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f151e7fc640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152c13ba50 0x7f152c13be30 secure :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f152c13d620 tx=0x7f15200046d0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.055 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:59.055 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:59.055 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:59.055 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:14:59.055 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 238, 2024-08-18T21:14:59.056 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 146026, 2024-08-18T21:14:59.056 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:59.056 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:59.056 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:59.056 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:59.056 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:59.056 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:59.056 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:59.056 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.056 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:14:59.056 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:59.056 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:59.056 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:59.058 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:59.058 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:59.058 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:59.058 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:59.058 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:59.058 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:59.058 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:59.058 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:59.058 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:59.058 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:59.058 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:59.058 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.059 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:59.059 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:59.059 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:59.059 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:59.059 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:59.059 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:59.059 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:59.059 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:59.059 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:59.059 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:59.059 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:59.059 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:59.059 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:59.059 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:59.060 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:59.060 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:59.060 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:59.060 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:59.060 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:59.060 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:59.060 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:59.060 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:59.060 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:59.060 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:59.060 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:59.060 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:59.060 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:59.061 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:59.061 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.061 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:59.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.061 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:59.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.061 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:59.061 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:59.061 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.061 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.061 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.061 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:59.062 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.062 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.062 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:59.062 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.062 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.062 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.062 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:59.062 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:59.062 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.062 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.063 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.063 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:59.063 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:59.063 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.063 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.063 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.063 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:59.063 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.063 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.064 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:59.064 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.064 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.064 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.064 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:59.064 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:59.064 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.064 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.064 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.064 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:59.064 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:59.065 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.065 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.065 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.065 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:59.065 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.065 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.065 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:59.065 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.065 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.065 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.066 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:59.066 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:59.066 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.066 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.066 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.066 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.066 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:59.066 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:59.066 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.066 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.066 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.067 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.067 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:59.067 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.067 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.067 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:59.067 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.067 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.067 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.067 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:59.067 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:59.068 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.068 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.068 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.068 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:59.068 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:59.068 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.068 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.068 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.068 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:59.068 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.070 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:59.070 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:59.070 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.070 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.070 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.070 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:59.070 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.070 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.070 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:59.071 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.071 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.071 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.071 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:59.071 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:59.071 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.071 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.071 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.071 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:59.071 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:59.071 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.072 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.072 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.072 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:59.072 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.072 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.072 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:59.072 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.072 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.072 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.072 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:59.073 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:59.073 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.073 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.073 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.073 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:59.073 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:59.073 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.073 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.073 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:59.074 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.074 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.074 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:59.074 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.074 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.074 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.074 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:59.074 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:59.074 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.074 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.074 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.075 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:59.075 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:59.075 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.075 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.075 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.075 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:59.075 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.075 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.076 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:59.076 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.076 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.076 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.076 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:59.076 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:59.076 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.076 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.076 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.076 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.076 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.076 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:59.077 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:59.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.077 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:59.077 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:59.077 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:59.077 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.077 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.077 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:14:59.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.077 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:59.077 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:59.077 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:14:59.077 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.077 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.078 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:59.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.078 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:59.078 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:59.078 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:59.078 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.078 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.078 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:59.078 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f1533baa640 1 -- 172.21.15.5:0/703078025 >> v2:172.21.15.157:6812/631023601 conn(0x7f151003bdf0 msgr2=0x7f151003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f1533baa640 1 --2- 172.21.15.5:0/703078025 >> v2:172.21.15.157:6812/631023601 conn(0x7f151003bdf0 0x7f151003e2b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f152400a560 tx=0x7f152400d040 comp rx=0 tx=0).stop 2024-08-18T21:14:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f1533baa640 10 monclient: shutdown 2024-08-18T21:14:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f1533baa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f1533baa640 1 -- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f152c0a4db0 msgr2=0x7f152c1d17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f1533baa640 1 --2- 172.21.15.5:0/703078025 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f152c0a4db0 0x7f152c1d17a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f15280ad000 tx=0x7f1528019140 comp rx=0 tx=0).stop 2024-08-18T21:14:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f1532147640 1 -- 172.21.15.5:0/703078025 reap_dead start 2024-08-18T21:14:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f151e7fc640 1 -- 172.21.15.5:0/703078025 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(302..302 src has 22..302) ==== 3506+0+0 (unknown 0 0 0) 0x7f15280e8770 con 0x7f152c0a4db0 2024-08-18T21:14:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f1532147640 1 -- 172.21.15.5:0/703078025 reap_dead start 2024-08-18T21:14:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f1533baa640 1 -- 172.21.15.5:0/703078025 shutdown_connections 2024-08-18T21:14:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f1533baa640 1 -- 172.21.15.5:0/703078025 >> 172.21.15.5:0/703078025 conn(0x7f152c0688d0 msgr2=0x7f152c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:59.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f1533baa640 1 -- 172.21.15.5:0/703078025 shutdown_connections 2024-08-18T21:14:59.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.046+0000 7f1533baa640 1 -- 172.21.15.5:0/703078025 wait complete. 2024-08-18T21:14:59.081 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-18T21:14:59.081 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon b 2024-08-18T21:14:59.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:14:59.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.198+0000 7f5f2ec05640 10 monclient: get_monmap_and_config 2024-08-18T21:14:59.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.198+0000 7f5f2ec05640 10 monclient: build_initial_monmap 2024-08-18T21:14:59.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.198+0000 7f5f2ec05640 10 monclient: monmap: 2024-08-18T21:14:59.205 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:59.205 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.205 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:59.204198+0000 2024-08-18T21:14:59.205 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:59.204198+0000 2024-08-18T21:14:59.205 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:59.205 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.205 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:59.205 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:59.206 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 1 Processor -- start 2024-08-18T21:14:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 1 -- start start 2024-08-18T21:14:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 10 monclient: init 2024-08-18T21:14:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 10 monclient: _add_conns ranks=[4,0,5,7,6,2,10,1,9,3,8] 2024-08-18T21:14:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5f280a4880 0x7f5f2809ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 10 monclient(hunting): picked mon.noname-c con 0x7f5f280a4880 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5f280a4c60 addr v1:172.21.15.5:6789/0 2024-08-18T21:14:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f2813ed00 0x7f5f281410f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 10 monclient(hunting): picked mon.noname-h con 0x7f5f2813ed00 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f2806cae0 con 0x7f5f280a4c60 2024-08-18T21:14:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f5f2809e310 con 0x7f5f280a4880 2024-08-18T21:14:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f5f2809e030 con 0x7f5f2813ed00 2024-08-18T21:14:59.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:59.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2ec05640 10 monclient(hunting): authenticate will time out at 1666.217747s 2024-08-18T21:14:59.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5f280a4880 0x7f5f2809ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f27fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5f280a4c60 0x7f5f280a5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40348/0 (socket says 172.21.15.5:40348) 2024-08-18T21:14:59.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f27fff640 1 -- 172.21.15.5:0/3032740346 learned_addr learned my addr 172.21.15.5:0/3032740346 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:14:59.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 10 monclient(hunting): get_auth_request con 0x7f5f280a4880 auth_method 0 2024-08-18T21:14:59.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2d1a2640 1 --2- 172.21.15.5:0/3032740346 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f2813ed00 0x7f5f281410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2d1a2640 10 monclient(hunting): get_auth_request con 0x7f5f2813ed00 auth_method 0 2024-08-18T21:14:59.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2d1a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2d1a2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2d1a2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 10 monclient(hunting): handle_auth_done global_id 114853 payload 274 2024-08-18T21:14:59.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 1 -- 172.21.15.5:0/3032740346 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f2813ed00 msgr2=0x7f5f281410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:59.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 1 --2- 172.21.15.5:0/3032740346 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f2813ed00 0x7f5f281410f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 1 -- 172.21.15.5:0/3032740346 >> v1:172.21.15.5:6789/0 conn(0x7f5f280a4c60 legacy=0x7f5f280a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:59.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 10 monclient: _finish_hunting 0 2024-08-18T21:14:59.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 1 monclient: found mon.noname-c 2024-08-18T21:14:59.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:59.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:14:59.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2c9a1640 1 -- 172.21.15.5:0/3032740346 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f280696a0 con 0x7f5f280a4880 2024-08-18T21:14:59.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.202+0000 7f5f2d1a2640 1 --2- 172.21.15.5:0/3032740346 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f2813ed00 0x7f5f281410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:14:59.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2c9a1640 1 -- 172.21.15.5:0/3032740346 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5f280a4880 msgr2=0x7f5f2809ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:59.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2c9a1640 1 --2- 172.21.15.5:0/3032740346 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5f280a4880 0x7f5f2809ecf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5f100097c0 tx=0x7f5f1001c380 comp rx=0 tx=0).ready entity=mon.4 client_cookie=e7cbe24255baecfa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f277fe640 1 -- 172.21.15.5:0/3032740346 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f100b0070 con 0x7f5f280a4880 2024-08-18T21:14:59.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f277fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:14:59.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f277fe640 10 monclient: dump: 2024-08-18T21:14:59.214 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.214 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.214 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.214 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.214 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.214 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.214 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.214 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.215 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f277fe640 10 monclient: _finish_auth 0 2024-08-18T21:14:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f277fe640 10 monclient: _check_auth_tickets 2024-08-18T21:14:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 5 monclient: authenticate success, global_id 114853 2024-08-18T21:14:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f277fe640 1 -- 172.21.15.5:0/3032740346 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f100aa810 con 0x7f5f280a4880 2024-08-18T21:14:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:14:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f277fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 4 set_mon_vals no callback set 2024-08-18T21:14:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f277fe640 1 -- 172.21.15.5:0/3032740346 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f100a9300 con 0x7f5f280a4880 2024-08-18T21:14:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f277fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f277fe640 10 monclient: dump: 2024-08-18T21:14:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.217 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 10 monclient: shutdown 2024-08-18T21:14:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 1 -- 172.21.15.5:0/3032740346 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5f280a4880 msgr2=0x7f5f2809ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 1 --2- 172.21.15.5:0/3032740346 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5f280a4880 0x7f5f2809ecf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5f100097c0 tx=0x7f5f1001c380 comp rx=0 tx=0).stop 2024-08-18T21:14:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 1 -- 172.21.15.5:0/3032740346 shutdown_connections 2024-08-18T21:14:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 1 --2- 172.21.15.5:0/3032740346 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f2813ed00 0x7f5f281410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 1 --2- 172.21.15.5:0/3032740346 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f5f280a4880 0x7f5f2809ecf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 1 -- 172.21.15.5:0/3032740346 >> 172.21.15.5:0/3032740346 conn(0x7f5f280a6490 msgr2=0x7f5f28068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 1 -- 172.21.15.5:0/3032740346 shutdown_connections 2024-08-18T21:14:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 1 -- 172.21.15.5:0/3032740346 wait complete. 2024-08-18T21:14:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 10 monclient: build_initial_monmap 2024-08-18T21:14:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 10 monclient: monmap: 2024-08-18T21:14:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:59.219 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 1 Processor -- start 2024-08-18T21:14:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 1 -- start start 2024-08-18T21:14:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 10 monclient: init 2024-08-18T21:14:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 10 monclient: _add_conns ranks=[6,8,5,0,4,7,3,2,1] 2024-08-18T21:14:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5f280a4c60 0x7f5f28124de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 10 monclient(hunting): picked mon.noname-d con 0x7f5f280a4c60 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:14:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f2813ed00 0x7f5f2813d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 10 monclient(hunting): picked mon.noname-e con 0x7f5f2813ed00 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:14:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f2813d660 0x7f5f281d15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 10 monclient(hunting): picked mon.noname-h con 0x7f5f2813d660 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f5f281441e0 con 0x7f5f2813d660 2024-08-18T21:14:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f5f28144060 con 0x7f5f280a4c60 2024-08-18T21:14:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f5f28144360 con 0x7f5f2813ed00 2024-08-18T21:14:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2ec05640 10 monclient(hunting): authenticate will time out at 1666.227023s 2024-08-18T21:14:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2c9a1640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5f280a4c60 msgr2=0x7f5f28124de0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:14:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2c9a1640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5f280a4c60 0x7f5f28124de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:14:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f2813ed00 0x7f5f2813d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f2813ed00 0x7f5f2813d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:37330/0 (socket says 172.21.15.5:37330) 2024-08-18T21:14:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 1 -- 172.21.15.5:0/2541592853 learned_addr learned my addr 172.21.15.5:0/2541592853 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 10 monclient(hunting): get_auth_request con 0x7f5f2813ed00 auth_method 0 2024-08-18T21:14:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2d1a2640 1 --2- 172.21.15.5:0/2541592853 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f2813d660 0x7f5f281d15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2d1a2640 10 monclient(hunting): get_auth_request con 0x7f5f2813d660 auth_method 0 2024-08-18T21:14:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2d1a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2d1a2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f2d1a2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 10 monclient(hunting): handle_auth_done global_id 115136 payload 824 2024-08-18T21:14:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 1 -- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5f280a4c60 msgr2=0x7f5f28124de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:14:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 1 --2- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f5f280a4c60 0x7f5f28124de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 1 -- 172.21.15.5:0/2541592853 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f2813d660 msgr2=0x7f5f281d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 1 --2- 172.21.15.5:0/2541592853 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5f2813d660 0x7f5f281d15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 10 monclient: _finish_hunting 0 2024-08-18T21:14:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 1 monclient: found mon.noname-e 2024-08-18T21:14:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:14:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.210+0000 7f5f27fff640 1 -- 172.21.15.5:0/2541592853 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f28127ab0 con 0x7f5f2813ed00 2024-08-18T21:14:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.214+0000 7f5f257fa640 1 -- 172.21.15.5:0/2541592853 DispatchQueue::entry inject delay of 0.002000 2024-08-18T21:14:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.214+0000 7f5f27fff640 1 -- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f2813ed00 msgr2=0x7f5f2813d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.214+0000 7f5f27fff640 1 --2- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f2813ed00 0x7f5f2813d120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800c480 tx=0x7f5f1800c940 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f257fa640 1 -- 172.21.15.5:0/2541592853 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f18005d00 con 0x7f5f2813ed00 2024-08-18T21:14:59.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f257fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f257fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:14:59.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f257fa640 10 monclient: dump: 2024-08-18T21:14:59.225 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.225 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.225 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.226 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f257fa640 10 monclient: _finish_auth 0 2024-08-18T21:14:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f257fa640 10 monclient: _check_auth_tickets 2024-08-18T21:14:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f257fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f257fa640 1 -- 172.21.15.5:0/2541592853 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f180074e0 con 0x7f5f2813ed00 2024-08-18T21:14:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f257fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f257fa640 1 -- 172.21.15.5:0/2541592853 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f18007690 con 0x7f5f2813ed00 2024-08-18T21:14:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f257fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f257fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:14:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f257fa640 10 monclient: dump: 2024-08-18T21:14:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.228 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.228 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.228 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.228 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.228 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.228 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.228 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.228 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.228 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.228 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.228 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.228 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f267fc640 4 set_mon_vals no callback set 2024-08-18T21:14:59.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f2ec05640 5 monclient: authenticate success, global_id 115136 2024-08-18T21:14:59.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f2ec05640 10 monclient: _renew_subs 2024-08-18T21:14:59.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f2ec05640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:14:59.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f2ec05640 1 -- 172.21.15.5:0/2541592853 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f28125750 con 0x7f5f2813ed00 2024-08-18T21:14:59.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f2ec05640 10 monclient: _renew_subs 2024-08-18T21:14:59.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f2ec05640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:14:59.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f2ec05640 1 -- 172.21.15.5:0/2541592853 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f281265a0 con 0x7f5f2813ed00 2024-08-18T21:14:59.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f257fa640 1 -- 172.21.15.5:0/2541592853 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f5f18007070 con 0x7f5f2813ed00 2024-08-18T21:14:59.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f257fa640 1 --2- 172.21.15.5:0/2541592853 >> v2:172.21.15.157:6812/631023601 conn(0x7f5f0803bdc0 0x7f5f0803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f257fa640 1 -- 172.21.15.5:0/2541592853 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(303..303 src has 22..303) ==== 3898+0+0 (secure 0 0 0) 0x7f5f1804e3c0 con 0x7f5f2813ed00 2024-08-18T21:14:59.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f2c9a1640 1 --2- 172.21.15.5:0/2541592853 >> v2:172.21.15.157:6812/631023601 conn(0x7f5f0803bdc0 0x7f5f0803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.218+0000 7f5f2c9a1640 10 monclient: get_auth_request con 0x7f5f0803bdc0 auth_method 0 2024-08-18T21:14:59.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2ec05640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:59.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2ec05640 1 --2- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f28124280 0x7f5f281d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2ec05640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2ec05640 1 -- 172.21.15.5:0/2541592853 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f5f28051140 con 0x7f5f28124280 2024-08-18T21:14:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2d1a2640 1 --2- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f28124280 0x7f5f281d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2d1a2640 10 monclient: get_auth_request con 0x7f5f28124280 auth_method 0 2024-08-18T21:14:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2d1a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2d1a2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2d1a2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2d1a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2d1a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2d1a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2d1a2640 10 monclient(hunting): handle_auth_done global_id 114959 payload 824 2024-08-18T21:14:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2d1a2640 1 -- 172.21.15.5:0/2541592853 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f280a4130 con 0x7f5f28124280 2024-08-18T21:14:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2c9a1640 1 --2- 172.21.15.5:0/2541592853 >> v2:172.21.15.157:6812/631023601 conn(0x7f5f0803bdc0 0x7f5f0803e280 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5f28069610 tx=0x7f5f10008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2d1a2640 1 -- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f28124280 msgr2=0x7f5f281d1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.222+0000 7f5f2d1a2640 1 --2- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f28124280 0x7f5f281d1b30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5f2813da60 tx=0x7f5f20007700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.226+0000 7f5f257fa640 1 -- 172.21.15.5:0/2541592853 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f200139f0 con 0x7f5f28124280 2024-08-18T21:14:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.226+0000 7f5f257fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.226+0000 7f5f257fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:14:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.226+0000 7f5f257fa640 10 monclient: dump: 2024-08-18T21:14:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.232 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.226+0000 7f5f257fa640 1 -- 172.21.15.5:0/2541592853 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5f20019070 con 0x7f5f28124280 2024-08-18T21:14:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.226+0000 7f5f257fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.226+0000 7f5f257fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:59.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.226+0000 7f5f257fa640 1 -- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f28124280 msgr2=0x7f5f281d1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.226+0000 7f5f257fa640 1 --2- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f28124280 0x7f5f281d1b30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5f2813da60 tx=0x7f5f20007700 comp rx=0 tx=0).stop 2024-08-18T21:14:59.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.226+0000 7f5f257fa640 1 -- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f28124280 msgr2=0x7f5f281d1b30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:59.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.226+0000 7f5f257fa640 1 --2- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f28124280 0x7f5f281d1b30 secure :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5f2813da60 tx=0x7f5f20007700 comp rx=0 tx=0).stop 2024-08-18T21:14:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.234+0000 7f5f2ec05640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.234+0000 7f5f2ec05640 1 --2- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f281d2070 0x7f5f2811f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.234+0000 7f5f2ec05640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.234+0000 7f5f2ec05640 1 -- 172.21.15.5:0/2541592853 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f5f281d2480 con 0x7f5f281d2070 2024-08-18T21:14:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.234+0000 7f5f2d1a2640 1 --2- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f281d2070 0x7f5f2811f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.234+0000 7f5f2d1a2640 10 monclient: get_auth_request con 0x7f5f281d2070 auth_method 0 2024-08-18T21:14:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.234+0000 7f5f2d1a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.234+0000 7f5f2d1a2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.234+0000 7f5f2d1a2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.234+0000 7f5f2d1a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.234+0000 7f5f2d1a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.234+0000 7f5f2d1a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.234+0000 7f5f2d1a2640 10 monclient(hunting): handle_auth_done global_id 114968 payload 824 2024-08-18T21:14:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.234+0000 7f5f2d1a2640 1 -- 172.21.15.5:0/2541592853 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5f280a4680 con 0x7f5f281d2070 2024-08-18T21:14:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f2d1a2640 1 -- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f281d2070 msgr2=0x7f5f2811f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f2d1a2640 1 --2- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f281d2070 0x7f5f2811f4c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5f20003ad0 tx=0x7f5f20004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f257fa640 1 -- 172.21.15.5:0/2541592853 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f200048b0 con 0x7f5f281d2070 2024-08-18T21:14:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f257fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f257fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:14:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f257fa640 10 monclient: dump: 2024-08-18T21:14:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.238 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f257fa640 1 -- 172.21.15.5:0/2541592853 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9215 (secure 0 0 0) 0x7f5f20013ca0 con 0x7f5f281d2070 2024-08-18T21:14:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f257fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f257fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f257fa640 1 -- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f281d2070 msgr2=0x7f5f2811f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f257fa640 1 --2- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f281d2070 0x7f5f2811f4c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5f20003ad0 tx=0x7f5f20004a50 comp rx=0 tx=0).stop 2024-08-18T21:14:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f257fa640 1 -- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f281d2070 msgr2=0x7f5f2811f4c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f257fa640 1 --2- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5f281d2070 0x7f5f2811f4c0 secure :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5f20003ad0 tx=0x7f5f20004a50 comp rx=0 tx=0).stop 2024-08-18T21:14:59.238 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:59.239 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:59.239 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:59.239 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:59.239 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 238, 2024-08-18T21:14:59.239 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 204394, 2024-08-18T21:14:59.239 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:59.239 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:59.239 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:59.239 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:59.239 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:59.239 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:59.239 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:59.240 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.240 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:14:59.240 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:59.240 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:59.240 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:59.240 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:59.240 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:59.240 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:59.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:59.240 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:59.240 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:59.240 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:59.240 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:59.240 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:59.241 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:59.241 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:59.241 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.241 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:59.241 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:59.241 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:59.241 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:59.241 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:59.241 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:59.241 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:59.241 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:59.241 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:59.241 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:59.242 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:59.242 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:59.242 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:59.242 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.242 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:59.242 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:59.242 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:59.242 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:59.242 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:59.242 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:59.242 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:59.242 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:59.242 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:59.243 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:59.243 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:59.243 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:59.243 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:59.243 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:59.243 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:59.243 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:59.243 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:59.243 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:59.243 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:59.243 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:59.243 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:59.243 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:59.244 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:59.244 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:59.244 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:59.244 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:59.244 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:59.244 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:59.244 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.244 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:59.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.244 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:59.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.244 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:59.244 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:59.244 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.245 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.245 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.245 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.245 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:59.245 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.245 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.245 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.245 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:59.245 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.245 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.245 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.245 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:59.246 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:59.246 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.246 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.246 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.246 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:59.246 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:59.246 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.246 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.246 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.246 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:59.247 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.247 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.247 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:59.247 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.247 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.247 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.247 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:59.247 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:59.247 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.247 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.248 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.248 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:59.248 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:59.248 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.248 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.248 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.248 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:59.248 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:59.250 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:59.250 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.250 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.250 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.250 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:59.250 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.250 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.250 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:59.250 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.250 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.251 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.251 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:59.251 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:59.251 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.251 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.251 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.251 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:59.251 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:59.251 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.251 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.252 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.252 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:59.252 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.252 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.252 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:59.252 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.252 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.252 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.252 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:59.252 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:59.252 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.253 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.253 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.253 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.253 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:59.253 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:59.253 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.253 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.253 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.253 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.253 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:59.253 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.253 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.254 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:59.254 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.254 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.254 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.254 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:59.254 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:59.254 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.254 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.254 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.255 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:59.255 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:59.255 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.255 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.255 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.255 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:59.255 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.255 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.255 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:59.255 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.256 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.256 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.256 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:59.256 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:59.256 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.256 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.256 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.256 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:59.256 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:59.256 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.257 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.257 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:59.257 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.257 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:59.257 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.257 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.257 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.257 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:59.258 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:59.258 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.258 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.258 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.258 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:59.258 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:59.258 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.258 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.259 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:59.259 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.259 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.259 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:59.259 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.259 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.259 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.259 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:59.259 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:59.259 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.259 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.260 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.260 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.260 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.260 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:59.260 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:59.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.260 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:59.260 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:59.260 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:59.260 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.260 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.260 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:59.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.261 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:59.261 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:59.261 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:59.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.261 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.261 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:59.261 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f2ec05640 1 -- 172.21.15.5:0/2541592853 >> v2:172.21.15.157:6812/631023601 conn(0x7f5f0803bdc0 msgr2=0x7f5f0803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f2ec05640 1 --2- 172.21.15.5:0/2541592853 >> v2:172.21.15.157:6812/631023601 conn(0x7f5f0803bdc0 0x7f5f0803e280 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5f28069610 tx=0x7f5f10008040 comp rx=0 tx=0).stop 2024-08-18T21:14:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f2d1a2640 1 -- 172.21.15.5:0/2541592853 reap_dead start 2024-08-18T21:14:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f2ec05640 10 monclient: shutdown 2024-08-18T21:14:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f2ec05640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f2ec05640 1 -- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f2813ed00 msgr2=0x7f5f2813d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f2ec05640 1 --2- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f2813ed00 0x7f5f2813d120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800c480 tx=0x7f5f1800c940 comp rx=0 tx=0).stop 2024-08-18T21:14:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f2ec05640 1 -- 172.21.15.5:0/2541592853 shutdown_connections 2024-08-18T21:14:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f2ec05640 1 --2- 172.21.15.5:0/2541592853 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f5f2813ed00 0x7f5f2813d120 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f2ec05640 1 -- 172.21.15.5:0/2541592853 >> 172.21.15.5:0/2541592853 conn(0x7f5f280a6490 msgr2=0x7f5f2813f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f2ec05640 1 -- 172.21.15.5:0/2541592853 shutdown_connections 2024-08-18T21:14:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.238+0000 7f5f2ec05640 1 -- 172.21.15.5:0/2541592853 wait complete. 2024-08-18T21:14:59.264 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-18T21:14:59.264 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon c 2024-08-18T21:14:59.265 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:14:59.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 10 monclient: get_monmap_and_config 2024-08-18T21:14:59.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 10 monclient: build_initial_monmap 2024-08-18T21:14:59.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 10 monclient: monmap: 2024-08-18T21:14:59.384 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:59.384 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.384 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:59.389365+0000 2024-08-18T21:14:59.385 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:59.389365+0000 2024-08-18T21:14:59.385 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:59.385 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.385 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:59.385 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:59.385 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:59.385 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:59.385 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:59.385 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:59.385 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:59.385 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:59.386 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:59.386 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:59.386 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:59.386 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 1 Processor -- start 2024-08-18T21:14:59.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 1 -- start start 2024-08-18T21:14:59.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 10 monclient: init 2024-08-18T21:14:59.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:59.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 10 monclient: _add_conns ranks=[0,2,7,9,3,10,4,1,8,6,5] 2024-08-18T21:14:59.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0e500a6bd0 addr v1:172.21.15.5:6789/0 2024-08-18T21:14:59.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0e5009f080 0x7f0e5013ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 10 monclient(hunting): picked mon.noname-b con 0x7f0e5009f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:59.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0e500a76c0 0x7f0e50141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 10 monclient(hunting): picked mon.noname-i con 0x7f0e500a76c0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:59.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e500a7fb0 con 0x7f0e500a6bd0 2024-08-18T21:14:59.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f0e5009e4c0 con 0x7f0e5009f080 2024-08-18T21:14:59.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f0e5006f930 con 0x7f0e500a76c0 2024-08-18T21:14:59.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:59.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e57119640 10 monclient(hunting): authenticate will time out at 1666.403072s 2024-08-18T21:14:59.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0e5009f080 0x7f0e5013ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e556b6640 1 -- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0e500a76c0 msgr2=0x7f0e50141330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:14:59.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e54eb5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0e500a6bd0 0x7f0e500a6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40364/0 (socket says 172.21.15.5:40364) 2024-08-18T21:14:59.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e54eb5640 1 -- 172.21.15.5:0/3069720148 learned_addr learned my addr 172.21.15.5:0/3069720148 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:14:59.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 10 monclient(hunting): get_auth_request con 0x7f0e5009f080 auth_method 0 2024-08-18T21:14:59.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e556b6640 1 --2- 172.21.15.5:0/3069720148 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0e500a76c0 0x7f0e50141330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:14:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 10 monclient(hunting): handle_auth_done global_id 114977 payload 274 2024-08-18T21:14:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 1 -- 172.21.15.5:0/3069720148 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0e500a76c0 msgr2=0x7f0e50141330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:14:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 1 --2- 172.21.15.5:0/3069720148 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0e500a76c0 0x7f0e50141330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 1 -- 172.21.15.5:0/3069720148 >> v1:172.21.15.5:6789/0 conn(0x7f0e500a6bd0 legacy=0x7f0e500a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 10 monclient: _finish_hunting 0 2024-08-18T21:14:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 1 monclient: found mon.noname-b 2024-08-18T21:14:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:59.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:14:59.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.386+0000 7f0e4ffff640 1 -- 172.21.15.5:0/3069720148 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5009de70 con 0x7f0e5009f080 2024-08-18T21:14:59.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 1 -- 172.21.15.5:0/3069720148 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0e5009f080 msgr2=0x7f0e5013ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:59.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 1 --2- 172.21.15.5:0/3069720148 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0e5009f080 0x7f0e5013ede0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0e440097f0 tx=0x7f0e4401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9905fc1fcbc1a9c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4f7fe640 1 -- 172.21.15.5:0/3069720148 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0e440b0070 con 0x7f0e5009f080 2024-08-18T21:14:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:14:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4f7fe640 10 monclient: dump: 2024-08-18T21:14:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.397 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4f7fe640 10 monclient: _finish_auth 0 2024-08-18T21:14:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4f7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:14:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4f7fe640 1 -- 172.21.15.5:0/3069720148 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e440aa810 con 0x7f0e5009f080 2024-08-18T21:14:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 5 monclient: authenticate success, global_id 114977 2024-08-18T21:14:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:14:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4f7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 4 set_mon_vals no callback set 2024-08-18T21:14:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4f7fe640 1 -- 172.21.15.5:0/3069720148 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0e440aae30 con 0x7f0e5009f080 2024-08-18T21:14:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:14:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4f7fe640 10 monclient: dump: 2024-08-18T21:14:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.400 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 10 monclient: shutdown 2024-08-18T21:14:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 1 -- 172.21.15.5:0/3069720148 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0e5009f080 msgr2=0x7f0e5013ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 1 --2- 172.21.15.5:0/3069720148 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0e5009f080 0x7f0e5013ede0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0e440097f0 tx=0x7f0e4401c450 comp rx=0 tx=0).stop 2024-08-18T21:14:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 1 -- 172.21.15.5:0/3069720148 shutdown_connections 2024-08-18T21:14:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 1 --2- 172.21.15.5:0/3069720148 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f0e500a76c0 0x7f0e50141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 1 --2- 172.21.15.5:0/3069720148 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0e5009f080 0x7f0e5013ede0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 1 -- 172.21.15.5:0/3069720148 >> 172.21.15.5:0/3069720148 conn(0x7f0e50068700 msgr2=0x7f0e50068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 1 -- 172.21.15.5:0/3069720148 shutdown_connections 2024-08-18T21:14:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 1 -- 172.21.15.5:0/3069720148 wait complete. 2024-08-18T21:14:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 10 monclient: build_initial_monmap 2024-08-18T21:14:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 10 monclient: monmap: 2024-08-18T21:14:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:59.402 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 1 Processor -- start 2024-08-18T21:14:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 1 -- start start 2024-08-18T21:14:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 10 monclient: init 2024-08-18T21:14:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 10 monclient: _add_conns ranks=[4,2,1,3,0,5,8,7,6] 2024-08-18T21:14:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e5009f080 0x7f0e50129050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 10 monclient(hunting): picked mon.noname-c con 0x7f0e5009f080 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:14:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0e500a6bd0 0x7f0e5013fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 10 monclient(hunting): picked mon.noname-b con 0x7f0e500a6bd0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:14:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e500a76c0 0x7f0e501d1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 10 monclient(hunting): picked mon.noname-f con 0x7f0e500a76c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:14:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0e50144210 con 0x7f0e500a76c0 2024-08-18T21:14:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f0e50144090 con 0x7f0e500a6bd0 2024-08-18T21:14:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f0e50144390 con 0x7f0e5009f080 2024-08-18T21:14:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e57119640 10 monclient(hunting): authenticate will time out at 1666.411255s 2024-08-18T21:14:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e54eb5640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e5009f080 0x7f0e50129050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0e500a6bd0 0x7f0e5013fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e556b6640 1 -- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e500a76c0 msgr2=0x7f0e501d1380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:14:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e54eb5640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e5009f080 0x7f0e50129050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:37720/0 (socket says 172.21.15.5:37720) 2024-08-18T21:14:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e54eb5640 1 -- 172.21.15.5:0/1464222669 learned_addr learned my addr 172.21.15.5:0/1464222669 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e54eb5640 10 monclient(hunting): get_auth_request con 0x7f0e5009f080 auth_method 0 2024-08-18T21:14:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e54eb5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e54eb5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e54eb5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e556b6640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e500a76c0 0x7f0e501d1380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:14:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 10 monclient(hunting): get_auth_request con 0x7f0e500a6bd0 auth_method 0 2024-08-18T21:14:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e54eb5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e54eb5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e54eb5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 10 monclient(hunting): handle_auth_done global_id 114986 payload 824 2024-08-18T21:14:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 1 -- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e5009f080 msgr2=0x7f0e50129050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e5009f080 0x7f0e50129050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 1 -- 172.21.15.5:0/1464222669 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e500a76c0 msgr2=0x7f0e501d1380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:14:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e500a76c0 0x7f0e501d1380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 10 monclient: _finish_hunting 0 2024-08-18T21:14:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 1 monclient: found mon.noname-b 2024-08-18T21:14:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:14:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e4ffff640 1 -- 172.21.15.5:0/1464222669 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e501284f0 con 0x7f0e500a6bd0 2024-08-18T21:14:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.394+0000 7f0e54eb5640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e5009f080 0x7f0e50129050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:14:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e4ffff640 1 -- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0e500a6bd0 msgr2=0x7f0e5013fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e4ffff640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0e500a6bd0 0x7f0e5013fec0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0e440ad000 tx=0x7f0e440191f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e4d7fa640 1 -- 172.21.15.5:0/1464222669 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0e440b0040 con 0x7f0e500a6bd0 2024-08-18T21:14:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e4d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e4d7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:14:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e4d7fa640 10 monclient: dump: 2024-08-18T21:14:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.411 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e4d7fa640 10 monclient: _finish_auth 0 2024-08-18T21:14:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e4d7fa640 10 monclient: _check_auth_tickets 2024-08-18T21:14:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e4d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e57119640 5 monclient: authenticate success, global_id 114986 2024-08-18T21:14:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e4d7fa640 1 -- 172.21.15.5:0/1464222669 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e440044b0 con 0x7f0e500a6bd0 2024-08-18T21:14:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e57119640 10 monclient: _renew_subs 2024-08-18T21:14:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e57119640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:14:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e57119640 1 -- 172.21.15.5:0/1464222669 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e50129fb0 con 0x7f0e500a6bd0 2024-08-18T21:14:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e4d7fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e4d7fa640 1 -- 172.21.15.5:0/1464222669 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0e44003a90 con 0x7f0e500a6bd0 2024-08-18T21:14:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e4d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e4d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:14:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e4effd640 4 set_mon_vals no callback set 2024-08-18T21:14:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e4d7fa640 10 monclient: dump: 2024-08-18T21:14:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.414 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e57119640 10 monclient: _renew_subs 2024-08-18T21:14:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e57119640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:14:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e57119640 1 -- 172.21.15.5:0/1464222669 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e50127e70 con 0x7f0e500a6bd0 2024-08-18T21:14:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e57119640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e57119640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e50140400 0x7f0e501d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e57119640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e57119640 1 -- 172.21.15.5:0/1464222669 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f0e50051140 con 0x7f0e50140400 2024-08-18T21:14:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e54eb5640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e50140400 0x7f0e501d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e54eb5640 10 monclient: get_auth_request con 0x7f0e50140400 auth_method 0 2024-08-18T21:14:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e54eb5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e54eb5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e54eb5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e54eb5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e54eb5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e54eb5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e54eb5640 10 monclient(hunting): handle_auth_done global_id 114871 payload 824 2024-08-18T21:14:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.398+0000 7f0e54eb5640 1 -- 172.21.15.5:0/1464222669 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e500abbd0 con 0x7f0e50140400 2024-08-18T21:14:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e4d7fa640 1 -- 172.21.15.5:0/1464222669 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f0e440bb030 con 0x7f0e500a6bd0 2024-08-18T21:14:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e4d7fa640 1 --2- 172.21.15.5:0/1464222669 >> v2:172.21.15.157:6812/631023601 conn(0x7f0e3c03bdc0 0x7f0e3c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e4d7fa640 1 -- 172.21.15.5:0/1464222669 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(303..303 src has 22..303) ==== 3898+0+0 (secure 0 0 0) 0x7f0e440b9020 con 0x7f0e500a6bd0 2024-08-18T21:14:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e556b6640 1 --2- 172.21.15.5:0/1464222669 >> v2:172.21.15.157:6812/631023601 conn(0x7f0e3c03bdc0 0x7f0e3c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e556b6640 10 monclient: get_auth_request con 0x7f0e3c03bdc0 auth_method 0 2024-08-18T21:14:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e54eb5640 1 -- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e50140400 msgr2=0x7f0e501d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e54eb5640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e50140400 0x7f0e501d18c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000d3d0 tx=0x7f0e4000d890 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e4d7fa640 1 -- 172.21.15.5:0/1464222669 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0e40007a20 con 0x7f0e50140400 2024-08-18T21:14:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e4d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e4d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e4d7fa640 10 monclient: dump: 2024-08-18T21:14:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.417 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e4d7fa640 1 -- 172.21.15.5:0/1464222669 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0e40018070 con 0x7f0e50140400 2024-08-18T21:14:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e4d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e4d7fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e4d7fa640 1 -- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e50140400 msgr2=0x7f0e501d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e4d7fa640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e50140400 0x7f0e501d18c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000d3d0 tx=0x7f0e4000d890 comp rx=0 tx=0).stop 2024-08-18T21:14:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e4d7fa640 1 -- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e50140400 msgr2=0x7f0e501d18c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e4d7fa640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e50140400 0x7f0e501d18c0 secure :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000d3d0 tx=0x7f0e4000d890 comp rx=0 tx=0).stop 2024-08-18T21:14:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.402+0000 7f0e556b6640 1 --2- 172.21.15.5:0/1464222669 >> v2:172.21.15.157:6812/631023601 conn(0x7f0e3c03bdc0 0x7f0e3c03e280 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0e480038f0 tx=0x7f0e48006c00 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e57119640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e57119640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e50126f80 0x7f0e501d1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e57119640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e57119640 1 -- 172.21.15.5:0/1464222669 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f0e500a6fb0 con 0x7f0e50126f80 2024-08-18T21:14:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e54eb5640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e50126f80 0x7f0e501d1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e54eb5640 10 monclient: get_auth_request con 0x7f0e50126f80 auth_method 0 2024-08-18T21:14:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e54eb5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e54eb5640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e54eb5640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e54eb5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e54eb5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e54eb5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e54eb5640 10 monclient(hunting): handle_auth_done global_id 114880 payload 824 2024-08-18T21:14:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e54eb5640 1 -- 172.21.15.5:0/1464222669 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0e500746d0 con 0x7f0e50126f80 2024-08-18T21:14:59.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e54eb5640 1 -- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e50126f80 msgr2=0x7f0e501d1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:59.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e54eb5640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e50126f80 0x7f0e501d1e00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000d3d0 tx=0x7f0e40004cd0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e4d7fa640 1 -- 172.21.15.5:0/1464222669 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0e40013a70 con 0x7f0e50126f80 2024-08-18T21:14:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e4d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e4d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:14:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.410+0000 7f0e4d7fa640 10 monclient: dump: 2024-08-18T21:14:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.421 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e4d7fa640 1 -- 172.21.15.5:0/1464222669 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9215 (secure 0 0 0) 0x7f0e40013600 con 0x7f0e50126f80 2024-08-18T21:14:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e4d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e4d7fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e4d7fa640 1 -- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e50126f80 msgr2=0x7f0e501d1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e4d7fa640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e50126f80 0x7f0e501d1e00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000d3d0 tx=0x7f0e40004cd0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e4d7fa640 1 -- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e50126f80 msgr2=0x7f0e501d1e00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:59.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e4d7fa640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f0e50126f80 0x7f0e501d1e00 secure :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000d3d0 tx=0x7f0e40004cd0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.422 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:59.422 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:59.422 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:59.422 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:59.422 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 238, 2024-08-18T21:14:59.422 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 204570, 2024-08-18T21:14:59.422 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:59.422 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:59.423 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:59.423 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:59.423 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:59.423 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:59.423 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:59.423 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.423 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:14:59.423 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:59.423 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:59.423 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:59.423 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:59.423 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:59.423 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:59.424 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:59.424 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:59.424 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:59.424 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:59.424 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:59.424 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:59.424 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:59.424 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:59.424 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.424 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:59.424 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:59.424 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:59.424 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:59.425 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:59.425 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:59.425 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:59.425 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:59.425 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:59.425 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:59.425 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:59.425 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:59.425 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:59.425 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.425 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:59.426 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:59.426 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:59.426 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:59.426 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:59.426 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:59.426 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:59.426 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:59.426 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:59.426 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:59.426 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:59.426 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:59.426 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:59.426 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:59.427 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:59.427 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:59.427 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:59.427 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:59.427 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:59.427 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:59.427 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:59.427 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:59.427 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:59.427 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:59.427 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:59.427 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:59.427 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:59.428 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:59.428 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.428 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:59.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.428 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:59.428 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.428 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:59.428 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:59.428 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.428 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.428 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.428 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.428 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:59.429 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.429 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.429 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:59.429 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.429 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.429 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.429 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:59.429 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:59.429 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.429 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.429 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.430 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.430 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:59.430 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:59.430 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.430 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.430 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.430 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.430 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:59.430 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.430 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.430 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.431 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:59.431 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.431 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.431 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.431 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:59.431 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:59.431 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.431 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.431 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.431 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:59.431 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:59.432 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.432 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.432 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.432 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:59.432 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.432 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.432 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:59.432 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.432 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.432 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.433 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:59.433 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:59.433 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.433 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.433 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.433 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:59.433 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:59.433 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.433 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.433 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.435 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.435 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:59.435 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:59.435 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.435 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.435 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.435 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:59.435 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.436 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.436 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:59.436 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.436 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.436 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.436 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:59.436 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:59.436 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.436 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.436 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.436 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:59.437 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:59.437 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.437 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.437 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.437 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.437 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:59.437 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.437 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.437 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.437 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:59.437 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.437 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.437 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.438 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:59.438 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:59.438 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.438 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.438 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.438 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:59.438 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:59.438 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.438 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.439 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.439 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:59.439 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.439 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.439 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.439 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:59.439 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.439 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.439 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.439 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:59.439 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:59.439 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.440 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.440 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.440 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:59.440 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:59.440 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.440 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.441 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:59.441 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.441 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.441 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:59.441 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.441 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.441 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.441 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:59.442 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:59.442 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.442 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.442 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.442 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:59.442 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:59.442 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.442 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.442 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.443 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:59.443 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.443 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:59.443 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.443 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.443 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.443 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:59.443 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:59.443 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.444 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.444 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.444 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.444 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.444 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:59.444 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:59.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.444 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:59.444 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:59.444 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:59.444 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.444 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.444 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:59.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.445 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:59.445 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:59.445 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:59.445 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.445 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.445 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:59.445 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e57119640 1 -- 172.21.15.5:0/1464222669 >> v2:172.21.15.157:6812/631023601 conn(0x7f0e3c03bdc0 msgr2=0x7f0e3c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e57119640 1 --2- 172.21.15.5:0/1464222669 >> v2:172.21.15.157:6812/631023601 conn(0x7f0e3c03bdc0 0x7f0e3c03e280 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0e480038f0 tx=0x7f0e48006c00 comp rx=0 tx=0).stop 2024-08-18T21:14:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e57119640 10 monclient: shutdown 2024-08-18T21:14:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e57119640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e57119640 1 -- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0e500a6bd0 msgr2=0x7f0e5013fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e57119640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0e500a6bd0 0x7f0e5013fec0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0e440ad000 tx=0x7f0e440191f0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e556b6640 1 -- 172.21.15.5:0/1464222669 reap_dead start 2024-08-18T21:14:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e57119640 1 -- 172.21.15.5:0/1464222669 shutdown_connections 2024-08-18T21:14:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e57119640 1 --2- 172.21.15.5:0/1464222669 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f0e500a6bd0 0x7f0e5013fec0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e57119640 1 -- 172.21.15.5:0/1464222669 >> 172.21.15.5:0/1464222669 conn(0x7f0e50068700 msgr2=0x7f0e500a4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e57119640 1 -- 172.21.15.5:0/1464222669 shutdown_connections 2024-08-18T21:14:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.414+0000 7f0e57119640 1 -- 172.21.15.5:0/1464222669 wait complete. 2024-08-18T21:14:59.448 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-18T21:14:59.448 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon e 2024-08-18T21:14:59.448 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:14:59.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.570+0000 7f0072f17640 10 monclient: get_monmap_and_config 2024-08-18T21:14:59.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.570+0000 7f0072f17640 10 monclient: build_initial_monmap 2024-08-18T21:14:59.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.570+0000 7f0072f17640 10 monclient: monmap: 2024-08-18T21:14:59.571 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:59.571 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.571 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:59.575474+0000 2024-08-18T21:14:59.571 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:59.575474+0000 2024-08-18T21:14:59.571 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:59.571 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.571 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:59.571 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:59.571 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:59.571 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:59.572 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:59.572 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:59.572 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:59.572 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:59.572 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:59.572 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:59.572 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:59.572 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.570+0000 7f0072f17640 1 Processor -- start 2024-08-18T21:14:59.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.570+0000 7f0072f17640 1 -- start start 2024-08-18T21:14:59.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.570+0000 7f0072f17640 10 monclient: init 2024-08-18T21:14:59.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0072f17640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:59.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0072f17640 10 monclient: _add_conns ranks=[3,0,8,1,10,6,9,4,5,7,2] 2024-08-18T21:14:59.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0072f17640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f006c0a6ce0 0x7f006c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0072f17640 10 monclient(hunting): picked mon.noname-g con 0x7f006c0a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:14:59.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0072f17640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f006c0a7600 addr v1:172.21.15.5:6789/0 2024-08-18T21:14:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0072f17640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13a1b0 0x7f006c141d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0072f17640 10 monclient(hunting): picked mon.noname-e con 0x7f006c13a1b0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:14:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0072f17640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f006c0a45d0 con 0x7f006c0a7600 2024-08-18T21:14:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0072f17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0072f17640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f006c0a5000 con 0x7f006c0a6ce0 2024-08-18T21:14:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0072f17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0072f17640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f006c0a32d0 con 0x7f006c13a1b0 2024-08-18T21:14:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0072f17640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0072f17640 10 monclient(hunting): authenticate will time out at 1666.588690s 2024-08-18T21:14:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13a1b0 0x7f006c141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f006bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f006c0a7600 0x7f006c139aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40366/0 (socket says 172.21.15.5:40366) 2024-08-18T21:14:59.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f006bfff640 1 -- 172.21.15.5:0/2420467834 learned_addr learned my addr 172.21.15.5:0/2420467834 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:14:59.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 10 monclient(hunting): get_auth_request con 0x7f006c13a1b0 auth_method 0 2024-08-18T21:14:59.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0070cb3640 1 --2- 172.21.15.5:0/2420467834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f006c0a6ce0 0x7f006c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0070cb3640 10 monclient(hunting): get_auth_request con 0x7f006c0a6ce0 auth_method 0 2024-08-18T21:14:59.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0070cb3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0070cb3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f0070cb3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 10 monclient(hunting): handle_auth_done global_id 115145 payload 274 2024-08-18T21:14:59.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 1 -- 172.21.15.5:0/2420467834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f006c0a6ce0 msgr2=0x7f006c0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:59.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 1 --2- 172.21.15.5:0/2420467834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f006c0a6ce0 0x7f006c0a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 1 -- 172.21.15.5:0/2420467834 >> v1:172.21.15.5:6789/0 conn(0x7f006c0a7600 legacy=0x7f006c139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:14:59.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 10 monclient: _finish_hunting 0 2024-08-18T21:14:59.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 1 monclient: found mon.noname-e 2024-08-18T21:14:59.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:59.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:14:59.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.574+0000 7f00714b4640 1 -- 172.21.15.5:0/2420467834 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006c0a8900 con 0x7f006c13a1b0 2024-08-18T21:14:59.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f00714b4640 1 -- 172.21.15.5:0/2420467834 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13a1b0 msgr2=0x7f006c141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:59.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f00714b4640 1 --2- 172.21.15.5:0/2420467834 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13a1b0 0x7f006c141d00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f005c0097f0 tx=0x7f005c01c3a0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=546b016928a8808a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f006b7fe640 1 -- 172.21.15.5:0/2420467834 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f005c0b0070 con 0x7f006c13a1b0 2024-08-18T21:14:59.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f006b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f006b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:14:59.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f006b7fe640 10 monclient: dump: 2024-08-18T21:14:59.585 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.585 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.585 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.585 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.585 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.585 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.585 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.585 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.585 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.585 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.585 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.586 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.586 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.586 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.586 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.586 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f006b7fe640 10 monclient: _finish_auth 0 2024-08-18T21:14:59.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f006b7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:14:59.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f006b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:59.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f006b7fe640 1 -- 172.21.15.5:0/2420467834 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f005c0aa810 con 0x7f006c13a1b0 2024-08-18T21:14:59.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 5 monclient: authenticate success, global_id 115145 2024-08-18T21:14:59.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:14:59.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f006b7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:59.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 10 monclient: get_monmap_and_config success 2024-08-18T21:14:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 4 set_mon_vals no callback set 2024-08-18T21:14:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f006b7fe640 1 -- 172.21.15.5:0/2420467834 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f005c0aae30 con 0x7f006c13a1b0 2024-08-18T21:14:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f006b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f006b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:14:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f006b7fe640 10 monclient: dump: 2024-08-18T21:14:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.587 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.588 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.588 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.588 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.588 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.588 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.588 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.588 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.588 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 10 monclient: shutdown 2024-08-18T21:14:59.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:59.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 1 -- 172.21.15.5:0/2420467834 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13a1b0 msgr2=0x7f006c141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 1 --2- 172.21.15.5:0/2420467834 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13a1b0 0x7f006c141d00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f005c0097f0 tx=0x7f005c01c3a0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 1 -- 172.21.15.5:0/2420467834 shutdown_connections 2024-08-18T21:14:59.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 1 --2- 172.21.15.5:0/2420467834 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13a1b0 0x7f006c141d00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 1 --2- 172.21.15.5:0/2420467834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f006c0a6ce0 0x7f006c0a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 1 -- 172.21.15.5:0/2420467834 >> 172.21.15.5:0/2420467834 conn(0x7f006c0acbc0 msgr2=0x7f006c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:59.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 1 -- 172.21.15.5:0/2420467834 shutdown_connections 2024-08-18T21:14:59.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 1 -- 172.21.15.5:0/2420467834 wait complete. 2024-08-18T21:14:59.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 10 monclient: build_initial_monmap 2024-08-18T21:14:59.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 10 monclient: monmap: 2024-08-18T21:14:59.589 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:59.589 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:14:59.589 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:14:59.589 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:14:59.589 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:59.589 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.590 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:14:59.590 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:14:59.590 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:59.590 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:59.590 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:59.590 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:59.590 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:59.590 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:59.590 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:59.590 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 1 Processor -- start 2024-08-18T21:14:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 1 -- start start 2024-08-18T21:14:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 10 monclient: init 2024-08-18T21:14:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 10 monclient: _add_conns ranks=[5,8,6,4,0,2,3,7,1] 2024-08-18T21:14:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f006c0a6ce0 0x7f006c135cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 10 monclient(hunting): picked mon.noname-h con 0x7f006c0a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:14:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c0a7600 0x7f006c136200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 10 monclient(hunting): picked mon.noname-e con 0x7f006c0a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:14:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f006c13a1b0 0x7f006c13b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 10 monclient(hunting): picked mon.noname-d con 0x7f006c13a1b0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:14:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f006c0a79e0 con 0x7f006c0a6ce0 2024-08-18T21:14:59.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f006c0a8220 con 0x7f006c13a1b0 2024-08-18T21:14:59.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f006c0aa8e0 con 0x7f006c0a7600 2024-08-18T21:14:59.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:59.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f0072f17640 10 monclient(hunting): authenticate will time out at 1666.595877s 2024-08-18T21:14:59.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f00714b4640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f006c13a1b0 msgr2=0x7f006c13b830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:14:59.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.578+0000 7f00714b4640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f006c13a1b0 0x7f006c13b830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:14:59.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c0a7600 0x7f006c136200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c0a7600 0x7f006c136200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:37358/0 (socket says 172.21.15.5:37358) 2024-08-18T21:14:59.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 1 -- 172.21.15.5:0/2803471701 learned_addr learned my addr 172.21.15.5:0/2803471701 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:14:59.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 10 monclient(hunting): get_auth_request con 0x7f006c0a7600 auth_method 0 2024-08-18T21:14:59.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0070cb3640 1 --2- 172.21.15.5:0/2803471701 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f006c0a6ce0 0x7f006c135cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 10 monclient(hunting): handle_auth_done global_id 115154 payload 824 2024-08-18T21:14:59.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 1 -- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f006c13a1b0 msgr2=0x7f006c13b830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:14:59.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 1 --2- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f006c13a1b0 0x7f006c13b830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 1 -- 172.21.15.5:0/2803471701 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f006c0a6ce0 msgr2=0x7f006c135cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 1 --2- 172.21.15.5:0/2803471701 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f006c0a6ce0 0x7f006c135cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:14:59.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 1 monclient: found mon.noname-e 2024-08-18T21:14:59.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:14:59.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:14:59.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 1 -- 172.21.15.5:0/2803471701 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006c13f5e0 con 0x7f006c0a7600 2024-08-18T21:14:59.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0070cb3640 10 monclient: get_auth_request con 0x7f006c0a6ce0 auth_method 0 2024-08-18T21:14:59.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0070cb3640 1 --2- 172.21.15.5:0/2803471701 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f006c0a6ce0 0x7f006c135cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:14:59.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 1 -- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c0a7600 msgr2=0x7f006c136200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:59.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006bfff640 1 --2- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c0a7600 0x7f006c136200 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f006000c470 tx=0x7f006000c930 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f00697fa640 1 -- 172.21.15.5:0/2803471701 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0060005d00 con 0x7f006c0a7600 2024-08-18T21:14:59.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f00697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f00697fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:14:59.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f00697fa640 10 monclient: dump: 2024-08-18T21:14:59.595 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.595 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.595 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.595 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.595 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.595 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.595 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.595 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.595 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.595 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.595 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.595 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.595 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.595 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.596 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.596 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f00697fa640 10 monclient: _finish_auth 0 2024-08-18T21:14:59.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f00697fa640 10 monclient: _check_auth_tickets 2024-08-18T21:14:59.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f00697fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:14:59.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f00697fa640 1 -- 172.21.15.5:0/2803471701 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00600074e0 con 0x7f006c0a7600 2024-08-18T21:14:59.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f00697fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:14:59.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f00697fa640 1 -- 172.21.15.5:0/2803471701 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0060007690 con 0x7f006c0a7600 2024-08-18T21:14:59.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0072f17640 5 monclient: authenticate success, global_id 115154 2024-08-18T21:14:59.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0072f17640 10 monclient: _renew_subs 2024-08-18T21:14:59.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0072f17640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:14:59.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0072f17640 1 -- 172.21.15.5:0/2803471701 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006c0a2650 con 0x7f006c0a7600 2024-08-18T21:14:59.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f00697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f00697fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:14:59.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f00697fa640 10 monclient: dump: 2024-08-18T21:14:59.597 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.597 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.597 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.597 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.597 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.597 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.597 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.597 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.597 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.597 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.597 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.597 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.598 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f006affd640 4 set_mon_vals no callback set 2024-08-18T21:14:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0072f17640 10 monclient: _renew_subs 2024-08-18T21:14:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0072f17640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:14:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0072f17640 1 -- 172.21.15.5:0/2803471701 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f006c13f300 con 0x7f006c0a7600 2024-08-18T21:14:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0072f17640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0072f17640 1 --2- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13bd70 0x7f006c13c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0072f17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0072f17640 1 -- 172.21.15.5:0/2803471701 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f006c0a7b60 con 0x7f006c13bd70 2024-08-18T21:14:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0070cb3640 1 --2- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13bd70 0x7f006c13c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0070cb3640 10 monclient: get_auth_request con 0x7f006c13bd70 auth_method 0 2024-08-18T21:14:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0070cb3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0070cb3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0070cb3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0070cb3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0070cb3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0070cb3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0070cb3640 10 monclient(hunting): handle_auth_done global_id 115163 payload 824 2024-08-18T21:14:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f0070cb3640 1 -- 172.21.15.5:0/2803471701 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f006c0a70c0 con 0x7f006c13bd70 2024-08-18T21:14:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.582+0000 7f00697fa640 1 -- 172.21.15.5:0/2803471701 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f0060007070 con 0x7f006c0a7600 2024-08-18T21:14:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f00697fa640 1 --2- 172.21.15.5:0/2803471701 >> v2:172.21.15.157:6812/631023601 conn(0x7f005803bdf0 0x7f005803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f00697fa640 1 -- 172.21.15.5:0/2803471701 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(303..303 src has 22..303) ==== 3898+0+0 (secure 0 0 0) 0x7f006004e480 con 0x7f006c0a7600 2024-08-18T21:14:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f00714b4640 1 --2- 172.21.15.5:0/2803471701 >> v2:172.21.15.157:6812/631023601 conn(0x7f005803bdf0 0x7f005803e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f00714b4640 10 monclient: get_auth_request con 0x7f005803bdf0 auth_method 0 2024-08-18T21:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f0070cb3640 1 -- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13bd70 msgr2=0x7f006c13c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f0070cb3640 1 --2- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13bd70 0x7f006c13c150 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0064007db0 tx=0x7f006400f520 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f00697fa640 1 -- 172.21.15.5:0/2803471701 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0064003bb0 con 0x7f006c13bd70 2024-08-18T21:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f00697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f00697fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f00697fa640 10 monclient: dump: 2024-08-18T21:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f00697fa640 1 -- 172.21.15.5:0/2803471701 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0064019070 con 0x7f006c13bd70 2024-08-18T21:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f00697fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f00697fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f00697fa640 1 -- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13bd70 msgr2=0x7f006c13c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f00697fa640 1 --2- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13bd70 0x7f006c13c150 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0064007db0 tx=0x7f006400f520 comp rx=0 tx=0).stop 2024-08-18T21:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f00697fa640 1 -- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13bd70 msgr2=0x7f006c13c150 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f00697fa640 1 --2- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13bd70 0x7f006c13c150 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.586+0000 7f00714b4640 1 --2- 172.21.15.5:0/2803471701 >> v2:172.21.15.157:6812/631023601 conn(0x7f005803bdf0 0x7f005803e2b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f005c0ab000 tx=0x7f005c0a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f0072f17640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f0072f17640 1 --2- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13c690 0x7f006c09e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f0072f17640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f0072f17640 1 -- 172.21.15.5:0/2803471701 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f006c051140 con 0x7f006c13c690 2024-08-18T21:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f0070cb3640 1 --2- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13c690 0x7f006c09e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f0070cb3640 10 monclient: get_auth_request con 0x7f006c13c690 auth_method 0 2024-08-18T21:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f0070cb3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:14:59.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f0070cb3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:14:59.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f0070cb3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:14:59.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f0070cb3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:14:59.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f0070cb3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:14:59.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f0070cb3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:14:59.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f0070cb3640 10 monclient(hunting): handle_auth_done global_id 115172 payload 824 2024-08-18T21:14:59.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f0070cb3640 1 -- 172.21.15.5:0/2803471701 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f006c13dde0 con 0x7f006c13c690 2024-08-18T21:14:59.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f0070cb3640 1 -- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13c690 msgr2=0x7f006c09e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:14:59.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f0070cb3640 1 --2- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13c690 0x7f006c09e2a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0064018000 tx=0x7f0064004a50 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:14:59.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f00697fa640 1 -- 172.21.15.5:0/2803471701 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0064027410 con 0x7f006c13c690 2024-08-18T21:14:59.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f00697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:14:59.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f00697fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:14:59.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.594+0000 7f00697fa640 10 monclient: dump: 2024-08-18T21:14:59.606 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:14:59.606 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.606 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.606 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:14:59.606 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:14:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:14:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:14:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:14:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f00697fa640 1 -- 172.21.15.5:0/2803471701 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9382 (secure 0 0 0) 0x7f0064004530 con 0x7f006c13c690 2024-08-18T21:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f00697fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f00697fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f00697fa640 1 -- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13c690 msgr2=0x7f006c09e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f00697fa640 1 --2- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13c690 0x7f006c09e2a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0064018000 tx=0x7f0064004a50 comp rx=0 tx=0).stop 2024-08-18T21:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f00697fa640 1 -- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13c690 msgr2=0x7f006c09e2a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f00697fa640 1 --2- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c13c690 0x7f006c09e2a0 secure :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0064018000 tx=0x7f0064004a50 comp rx=0 tx=0).stop 2024-08-18T21:14:59.609 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:14:59.609 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:59.609 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:59.609 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:14:59.609 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 238, 2024-08-18T21:14:59.609 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 204762, 2024-08-18T21:14:59.609 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:14:59.609 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:14:59.610 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:14:59.610 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:14:59.610 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:14:59.610 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:14:59.610 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:14:59.610 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.610 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:14:59.610 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:59.610 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:14:59.610 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:14:59.610 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:59.610 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:59.610 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:59.611 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:59.611 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:59.611 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:59.611 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:59.611 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:59.611 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:59.611 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:59.612 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:59.612 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.612 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:14:59.612 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:14:59.612 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:59.612 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:59.612 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:59.612 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:59.612 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:59.612 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:59.612 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:59.612 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:59.612 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:59.613 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:59.613 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:59.613 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.613 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:14:59.613 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:14:59.613 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:14:59.613 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:14:59.613 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:14:59.613 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:14:59.613 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:59.613 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:14:59.613 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:14:59.614 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:14:59.614 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:14:59.614 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:14:59.614 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:14:59.614 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:14:59.614 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:14:59.614 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:14:59.614 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:14:59.614 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:14:59.615 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:14:59.615 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:14:59.615 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:14:59.615 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:14:59.615 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:14:59.615 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:14:59.615 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:14:59.615 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:14:59.615 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:14:59.615 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:14:59.615 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.616 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:14:59.616 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.616 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:14:59.616 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.616 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:14:59.616 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:14:59.616 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.616 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.616 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.616 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.616 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:14:59.616 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.617 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.617 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.617 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.617 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:14:59.617 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.617 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.617 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.617 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.617 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:14:59.617 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:14:59.617 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.617 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.617 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.618 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.618 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.618 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:14:59.618 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:14:59.618 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.618 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.618 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.618 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.619 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:14:59.619 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.619 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.619 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.619 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.619 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:14:59.619 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.619 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.619 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.619 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.619 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:14:59.619 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:14:59.620 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.620 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.620 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.620 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.620 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.620 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:14:59.620 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:14:59.620 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.620 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.620 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.620 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.620 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:14:59.621 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.621 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.621 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.621 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:14:59.621 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.621 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.621 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.621 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:14:59.621 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:14:59.621 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.621 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.622 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.622 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.622 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:14:59.622 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:14:59.622 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.622 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.622 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.622 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.622 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:14:59.622 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.622 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.623 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.623 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:14:59.623 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.623 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.623 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.623 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:14:59.623 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:14:59.623 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.623 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.623 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.623 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.624 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:14:59.624 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:14:59.624 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.624 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.624 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.624 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.624 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:14:59.624 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.624 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.624 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.624 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.624 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:14:59.624 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:14:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:14:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:14:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:14:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:14:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:14:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:14:59.627 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:14:59.627 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.627 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.627 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.627 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:14:59.627 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:14:59.627 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.627 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.627 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.627 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:14:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:14:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:14:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:14:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.629 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.629 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:14:59.629 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:14:59.629 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.629 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.629 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.629 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.629 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:14:59.629 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.629 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.629 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:14:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:14:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:14:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:14:59.631 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:14:59.631 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:14:59.631 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:14:59.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.631 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:14:59.631 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:14:59.631 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.631 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:14:59.631 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:14:59.632 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:14:59.632 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.632 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.632 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:14:59.632 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:14:59.632 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:14:59.632 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:14:59.632 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:14:59.632 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.632 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.632 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:14:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:14:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:14:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:14:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.634 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:14:59.634 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:14:59.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:14:59.634 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:14:59.634 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:14:59.634 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 5 2024-08-18T21:14:59.634 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:14:59.634 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:14:59.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:14:59.634 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:14:59.634 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:14:59.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f0072f17640 1 -- 172.21.15.5:0/2803471701 >> v2:172.21.15.157:6812/631023601 conn(0x7f005803bdf0 msgr2=0x7f005803e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f0072f17640 1 --2- 172.21.15.5:0/2803471701 >> v2:172.21.15.157:6812/631023601 conn(0x7f005803bdf0 0x7f005803e2b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f005c0ab000 tx=0x7f005c0a6000 comp rx=0 tx=0).stop 2024-08-18T21:14:59.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f0072f17640 10 monclient: shutdown 2024-08-18T21:14:59.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f0072f17640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:14:59.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f0072f17640 1 -- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c0a7600 msgr2=0x7f006c136200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:14:59.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f0072f17640 1 --2- 172.21.15.5:0/2803471701 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f006c0a7600 0x7f006c136200 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f006000c470 tx=0x7f006000c930 comp rx=0 tx=0).stop 2024-08-18T21:14:59.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f00714b4640 1 -- 172.21.15.5:0/2803471701 reap_dead start 2024-08-18T21:14:59.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f00714b4640 1 -- 172.21.15.5:0/2803471701 reap_dead start 2024-08-18T21:14:59.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f0072f17640 1 -- 172.21.15.5:0/2803471701 shutdown_connections 2024-08-18T21:14:59.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f0072f17640 1 -- 172.21.15.5:0/2803471701 >> 172.21.15.5:0/2803471701 conn(0x7f006c0acbc0 msgr2=0x7f006c0a5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:14:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f0072f17640 1 -- 172.21.15.5:0/2803471701 shutdown_connections 2024-08-18T21:14:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.598+0000 7f0072f17640 1 -- 172.21.15.5:0/2803471701 wait complete. 2024-08-18T21:14:59.637 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-18T21:14:59.637 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon g 2024-08-18T21:14:59.637 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:14:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 10 monclient: get_monmap_and_config 2024-08-18T21:14:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 10 monclient: build_initial_monmap 2024-08-18T21:14:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 10 monclient: monmap: 2024-08-18T21:14:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:14:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:14:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:14:59.757738+0000 2024-08-18T21:14:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:14:59.757738+0000 2024-08-18T21:14:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:14:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:14:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:14:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:14:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:14:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:14:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:14:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:14:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:14:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:14:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:14:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:14:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:14:59.754 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:14:59.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 1 Processor -- start 2024-08-18T21:14:59.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 1 -- start start 2024-08-18T21:14:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 10 monclient: init 2024-08-18T21:14:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 10 monclient: _reopen_session rank -1 2024-08-18T21:14:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 10 monclient: _add_conns ranks=[6,1,7,5,10,4,3,2,0,8,9] 2024-08-18T21:14:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7d040a6ce0 0x7f7d040a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 10 monclient(hunting): picked mon.noname-d con 0x7f7d040a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:14:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7d040a7600 addr v1:172.21.15.157:6789/0 2024-08-18T21:14:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7d0413a1b0 0x7f7d04141d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:14:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 10 monclient(hunting): picked mon.noname-i con 0x7f7d0413a1b0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:14:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d040a45d0 con 0x7f7d040a7600 2024-08-18T21:14:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f7d040a5000 con 0x7f7d040a6ce0 2024-08-18T21:14:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:14:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7d040a32d0 con 0x7f7d0413a1b0 2024-08-18T21:14:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 10 monclient(hunting): _renew_subs 2024-08-18T21:14:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d0929d640 10 monclient(hunting): authenticate will time out at 1666.771048s 2024-08-18T21:14:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d02ffd640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7d040a6ce0 msgr2=0x7f7d040a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:14:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d02ffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7d040a6ce0 0x7f7d040a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:14:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d027fc640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7f7d040a7600 legacy=0x7f7d04139aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:14:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d037fe640 1 -- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7d0413a1b0 msgr2=0x7f7d04141d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:14:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.754+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7d0413a1b0 0x7f7d04141d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:14:59.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.958+0000 7f7d02ffd640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7d040a6ce0 msgr2=0x7f7d040a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:14:59.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.958+0000 7f7d02ffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7d040a6ce0 0x7f7d040a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:14:59.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.958+0000 7f7d037fe640 1 -- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7d0413a1b0 msgr2=0x7f7d04141d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:14:59.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.958+0000 7f7d027fc640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7f7d040a7600 legacy=0x7f7d04139aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:14:59.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:14:59.958+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7d0413a1b0 0x7f7d04141d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:15:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:00.362+0000 7f7d02ffd640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7d040a6ce0 msgr2=0x7f7d040a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:15:00.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:00.362+0000 7f7d02ffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7d040a6ce0 0x7f7d040a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:15:00.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:00.362+0000 7f7d037fe640 1 -- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7d0413a1b0 msgr2=0x7f7d04141d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:15:00.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:00.362+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7d0413a1b0 0x7f7d04141d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:15:00.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:00.362+0000 7f7d027fc640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7f7d040a7600 legacy=0x7f7d04139aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:15:00.458 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:00.458 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32375]: starting. 2024-08-18T21:15:00.458 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32375]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-32340 2024-08-18T21:15:00.458 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32375]: created object 0... 2024-08-18T21:15:00.458 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32375]: created object 25... 2024-08-18T21:15:00.458 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32375]: created object 49... 2024-08-18T21:15:00.458 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32375]: finishing. 2024-08-18T21:15:00.459 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32375]: shutting down. 2024-08-18T21:15:00.541 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:00.541 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32377]: starting. 2024-08-18T21:15:00.541 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32377]: listing objects. 2024-08-18T21:15:00.541 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32377]: listed object 0... 2024-08-18T21:15:00.541 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32377]: listed object 25... 2024-08-18T21:15:00.541 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32377]: saw 50 objects 2024-08-18T21:15:00.541 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32377]: shutting down. 2024-08-18T21:15:01.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:01.166+0000 7f7d02ffd640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7d040a6ce0 msgr2=0x7f7d040a70c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3303/0 2024-08-18T21:15:01.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:01.166+0000 7f7d02ffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7d040a6ce0 0x7f7d040a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:15:01.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:01.166+0000 7f7d037fe640 1 -- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7d0413a1b0 msgr2=0x7f7d04141d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:15:01.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:01.166+0000 7f7d027fc640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7f7d040a7600 legacy=0x7f7d04139aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:15:01.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:01.166+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7d0413a1b0 0x7f7d04141d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:15:01.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:01.166+0000 7f7d01ffb640 1 -- DispatchQueue::entry inject delay of 0.002000 2024-08-18T21:15:02.251 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:02.251 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32376]: starting. 2024-08-18T21:15:02.251 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32376]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-32340 2024-08-18T21:15:02.251 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32376]: shutting down. 2024-08-18T21:15:02.253 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:02.253 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:02.253 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:15:02.256 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:15:02.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 10 monclient(hunting): tick 2024-08-18T21:15:02.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 10 monclient(hunting): _check_auth_tickets 2024-08-18T21:15:02.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 1 monclient(hunting): continuing hunt 2024-08-18T21:15:02.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 10 monclient(hunting): _reopen_session rank -1 2024-08-18T21:15:02.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 1 -- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7d0413a1b0 msgr2=0x7f7d04141d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:15:02.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7d0413a1b0 0x7f7d04141d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 1 -- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7d040a6ce0 msgr2=0x7f7d040a70c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:15:02.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f7d040a6ce0 0x7f7d040a70c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7f7d040a7600 legacy=0x7f7d04139aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:15:02.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 10 monclient: _add_conns ranks=[10,3,2,9,0,4,8,5] 2024-08-18T21:15:02.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7ce4003830 0x7f7ce4005c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:02.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 10 monclient(hunting): picked mon.noname-f con 0x7f7ce4003830 addr v2:172.21.15.157:3300/0 2024-08-18T21:15:02.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ce4006280 0x7f7ce4008710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:02.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 10 monclient(hunting): picked mon.noname-g con 0x7f7ce4006280 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:02.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7ce4008d70 0x7f7ce400b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:02.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 10 monclient(hunting): picked mon.noname-b con 0x7f7ce4008d70 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:02.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:02.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7d040a32d0 con 0x7f7ce4003830 2024-08-18T21:15:02.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:02.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f7ce400b920 con 0x7f7ce4008d70 2024-08-18T21:15:02.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:02.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7ce400bb20 con 0x7f7ce4006280 2024-08-18T21:15:02.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d00ff9640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:02.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d02ffd640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7f7ce4003830 msgr2=0x7f7ce4005c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:15:02.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d02ffd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7ce4003830 0x7f7ce4005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:15:02.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7ce4008d70 0x7f7ce400b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:02.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7ce4008d70 0x7f7ce400b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:43190/0 (socket says 172.21.15.5:43190) 2024-08-18T21:15:02.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d027fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ce4006280 0x7f7ce4008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:02.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d037fe640 1 -- 172.21.15.5:0/737014184 learned_addr learned my addr 172.21.15.5:0/737014184 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:02.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d037fe640 10 monclient(hunting): get_auth_request con 0x7f7ce4008d70 auth_method 0 2024-08-18T21:15:02.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d037fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d037fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d027fc640 10 monclient(hunting): get_auth_request con 0x7f7ce4006280 auth_method 0 2024-08-18T21:15:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d027fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d027fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.754+0000 7f7d027fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d027fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d027fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d027fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d037fe640 10 monclient(hunting): handle_auth_done global_id 115004 payload 274 2024-08-18T21:15:02.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d037fe640 1 -- 172.21.15.5:0/737014184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ce4006280 msgr2=0x7f7ce4008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:02.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d037fe640 1 --2- 172.21.15.5:0/737014184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ce4006280 0x7f7ce4008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d037fe640 1 -- 172.21.15.5:0/737014184 >> v2:172.21.15.157:3300/0 conn(0x7f7ce4003830 msgr2=0x7f7ce4005c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:15:02.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d037fe640 1 --2- 172.21.15.5:0/737014184 >> v2:172.21.15.157:3300/0 conn(0x7f7ce4003830 0x7f7ce4005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d037fe640 10 monclient: _finish_hunting 0 2024-08-18T21:15:02.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d037fe640 1 monclient: found mon.noname-b 2024-08-18T21:15:02.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:02.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d037fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:02.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d037fe640 1 -- 172.21.15.5:0/737014184 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d040a8900 con 0x7f7ce4008d70 2024-08-18T21:15:02.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.758+0000 7f7d027fc640 1 --2- 172.21.15.5:0/737014184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ce4006280 0x7f7ce4008710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:15:02.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.762+0000 7f7d037fe640 1 -- 172.21.15.5:0/737014184 reap_dead start 2024-08-18T21:15:02.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d037fe640 1 -- 172.21.15.5:0/737014184 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7ce4008d70 msgr2=0x7f7ce400b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:02.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d037fe640 1 --2- 172.21.15.5:0/737014184 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7ce4008d70 0x7f7ce400b230 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009dc0 tx=0x7f7cf401c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=981e8cd61ae89f70 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:02.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d01ffb640 1 -- 172.21.15.5:0/737014184 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7cf40a5b00 con 0x7f7ce4008d70 2024-08-18T21:15:02.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:02.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d01ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:02.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d01ffb640 10 monclient: dump: 2024-08-18T21:15:02.764 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:02.764 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:02.764 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.764 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:02.765 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d01ffb640 10 monclient: _finish_auth 0 2024-08-18T21:15:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d01ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:15:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d01ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d01ffb640 1 -- 172.21.15.5:0/737014184 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf40a9070 con 0x7f7ce4008d70 2024-08-18T21:15:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d01ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d01ffb640 1 -- 172.21.15.5:0/737014184 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7cf40a5cc0 con 0x7f7ce4008d70 2024-08-18T21:15:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d0929d640 5 monclient: authenticate success, global_id 115004 2024-08-18T21:15:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d0929d640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d0929d640 4 set_mon_vals no callback set 2024-08-18T21:15:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d01ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d01ffb640 10 monclient: dump: 2024-08-18T21:15:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:02.767 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.767 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.767 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:02.767 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:02.767 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:02.767 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:02.767 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:02.767 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:02.767 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:02.767 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:02.767 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:02.767 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:02.767 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:02.768 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:02.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d0929d640 10 monclient: shutdown 2024-08-18T21:15:02.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d0929d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:02.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d0929d640 1 -- 172.21.15.5:0/737014184 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7ce4008d70 msgr2=0x7f7ce400b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:02.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d0929d640 1 --2- 172.21.15.5:0/737014184 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7ce4008d70 0x7f7ce400b230 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009dc0 tx=0x7f7cf401c850 comp rx=0 tx=0).stop 2024-08-18T21:15:02.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d0929d640 1 -- 172.21.15.5:0/737014184 shutdown_connections 2024-08-18T21:15:02.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d0929d640 1 --2- 172.21.15.5:0/737014184 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7ce4008d70 0x7f7ce400b230 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d0929d640 1 -- 172.21.15.5:0/737014184 >> 172.21.15.5:0/737014184 conn(0x7f7d040acbc0 msgr2=0x7f7d040a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:02.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d0929d640 1 -- 172.21.15.5:0/737014184 shutdown_connections 2024-08-18T21:15:02.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.766+0000 7f7d0929d640 1 -- 172.21.15.5:0/737014184 wait complete. 2024-08-18T21:15:02.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 10 monclient: build_initial_monmap 2024-08-18T21:15:02.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 10 monclient: monmap: 2024-08-18T21:15:02.769 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:02.769 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:02.771 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:02.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 1 Processor -- start 2024-08-18T21:15:02.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 1 -- start start 2024-08-18T21:15:02.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 10 monclient: init 2024-08-18T21:15:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 10 monclient: _add_conns ranks=[8,5,7,6,4,2,3,0,1] 2024-08-18T21:15:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7ce4008d70 0x7f7d04135d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 10 monclient(hunting): picked mon.noname-e con 0x7f7ce4008d70 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7d04136290 0x7f7d0413b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 10 monclient(hunting): picked mon.noname-h con 0x7f7d04136290 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:02.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7d0413bc10 0x7f7d0413c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:02.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 10 monclient(hunting): picked mon.noname-i con 0x7f7d0413bc10 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:15:02.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:02.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f7d040a79e0 con 0x7f7d04136290 2024-08-18T21:15:02.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:02.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f7d040a8220 con 0x7f7d0413bc10 2024-08-18T21:15:02.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:02.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f7d0406e730 con 0x7f7ce4008d70 2024-08-18T21:15:02.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:02.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d0929d640 10 monclient(hunting): authenticate will time out at 1669.786400s 2024-08-18T21:15:02.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7ce4008d70 0x7f7d04135d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:02.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d037fe640 1 -- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7d0413bc10 msgr2=0x7f7d0413c050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3303/0 2024-08-18T21:15:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7d0413bc10 0x7f7d0413c050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:15:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7ce4008d70 0x7f7d04135d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:37396/0 (socket says 172.21.15.5:37396) 2024-08-18T21:15:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 1 -- 172.21.15.5:0/2971833998 learned_addr learned my addr 172.21.15.5:0/2971833998 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 10 monclient(hunting): get_auth_request con 0x7f7ce4008d70 auth_method 0 2024-08-18T21:15:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d027fc640 1 --2- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7d04136290 0x7f7d0413b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d027fc640 10 monclient(hunting): get_auth_request con 0x7f7d04136290 auth_method 0 2024-08-18T21:15:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d027fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d027fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d027fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 10 monclient(hunting): handle_auth_done global_id 115190 payload 824 2024-08-18T21:15:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 1 -- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7d0413bc10 msgr2=0x7f7d0413c050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:15:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 1 --2- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f7d0413bc10 0x7f7d0413c050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 1 -- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7d04136290 msgr2=0x7f7d0413b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 1 --2- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7d04136290 0x7f7d0413b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:15:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 1 monclient: found mon.noname-e 2024-08-18T21:15:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:15:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d02ffd640 1 -- 172.21.15.5:0/2971833998 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0413ec80 con 0x7f7ce4008d70 2024-08-18T21:15:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.770+0000 7f7d027fc640 1 --2- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7d04136290 0x7f7d0413b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:15:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d02ffd640 1 -- 172.21.15.5:0/2971833998 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7ce4008d70 msgr2=0x7f7d04135d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d02ffd640 1 --2- 172.21.15.5:0/2971833998 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7ce4008d70 0x7f7d04135d50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00c930 tx=0x7f7cfc00cdf0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7cfb7fe640 1 -- 172.21.15.5:0/2971833998 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7cfc018070 con 0x7f7ce4008d70 2024-08-18T21:15:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7cfb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7cfb7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:15:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7cfb7fe640 10 monclient: dump: 2024-08-18T21:15:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:02.779 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:02.779 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:02.779 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:02.779 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:02.779 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:02.779 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:02.781 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:02.781 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:02.781 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:02.781 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:02.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7cfb7fe640 10 monclient: _finish_auth 0 2024-08-18T21:15:02.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7cfb7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:15:02.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7cfb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:02.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7cfb7fe640 1 -- 172.21.15.5:0/2971833998 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cfc0113a0 con 0x7f7ce4008d70 2024-08-18T21:15:02.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7cfb7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:02.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7cfb7fe640 1 -- 172.21.15.5:0/2971833998 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7cfc0119c0 con 0x7f7ce4008d70 2024-08-18T21:15:02.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d0929d640 5 monclient: authenticate success, global_id 115190 2024-08-18T21:15:02.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d0929d640 10 monclient: _renew_subs 2024-08-18T21:15:02.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d0929d640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:02.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d0929d640 1 -- 172.21.15.5:0/2971833998 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d04141d20 con 0x7f7ce4008d70 2024-08-18T21:15:02.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7cfb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:02.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d017fa640 4 set_mon_vals no callback set 2024-08-18T21:15:02.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7cfb7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:15:02.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7cfb7fe640 10 monclient: dump: 2024-08-18T21:15:02.783 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:02.783 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:02.783 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.783 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.783 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:02.783 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:02.783 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:02.783 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:02.784 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:02.784 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:02.784 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:02.784 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:02.784 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:02.784 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:02.784 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:02.784 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:02.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d0929d640 10 monclient: _renew_subs 2024-08-18T21:15:02.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d0929d640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:02.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d0929d640 1 -- 172.21.15.5:0/2971833998 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d0413f520 con 0x7f7ce4008d70 2024-08-18T21:15:02.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d0929d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:02.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d0929d640 1 --2- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d04136670 0x7f7d0402e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:02.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d0929d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:02.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d0929d640 1 -- 172.21.15.5:0/2971833998 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7d040a7b60 con 0x7f7d04136670 2024-08-18T21:15:02.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7cfb7fe640 1 -- 172.21.15.5:0/2971833998 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f7cfc011be0 con 0x7f7ce4008d70 2024-08-18T21:15:02.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7cfb7fe640 1 --2- 172.21.15.5:0/2971833998 >> v2:172.21.15.157:6812/631023601 conn(0x7f7ce403d0a0 0x7f7ce403f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:02.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7cfb7fe640 1 -- 172.21.15.5:0/2971833998 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(306..306 src has 22..306) ==== 3506+0+0 (secure 0 0 0) 0x7f7cfc04de60 con 0x7f7ce4008d70 2024-08-18T21:15:02.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d027fc640 1 --2- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d04136670 0x7f7d0402e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:02.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d027fc640 10 monclient: get_auth_request con 0x7f7d04136670 auth_method 0 2024-08-18T21:15:02.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d027fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:02.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d027fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:02.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.774+0000 7f7d027fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:02.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.778+0000 7f7d027fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:02.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.778+0000 7f7d027fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:02.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.778+0000 7f7d037fe640 1 --2- 172.21.15.5:0/2971833998 >> v2:172.21.15.157:6812/631023601 conn(0x7f7ce403d0a0 0x7f7ce403f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:02.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.778+0000 7f7d027fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:02.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.778+0000 7f7d037fe640 10 monclient: get_auth_request con 0x7f7ce403d0a0 auth_method 0 2024-08-18T21:15:02.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.778+0000 7f7d027fc640 10 monclient(hunting): handle_auth_done global_id 134364 payload 824 2024-08-18T21:15:02.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.778+0000 7f7d027fc640 1 -- 172.21.15.5:0/2971833998 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d04068af0 con 0x7f7d04136670 2024-08-18T21:15:02.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.778+0000 7f7d027fc640 1 -- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d04136670 msgr2=0x7f7d0402e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:02.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.778+0000 7f7d027fc640 1 --2- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d04136670 0x7f7d0402e350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7cec000c10 tx=0x7f7cec00b7c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:02.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.778+0000 7f7d037fe640 1 --2- 172.21.15.5:0/2971833998 >> v2:172.21.15.157:6812/631023601 conn(0x7f7ce403d0a0 0x7f7ce403f560 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7d0406f540 tx=0x7f7cf40a7000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:02.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.778+0000 7f7cfb7fe640 1 -- 172.21.15.5:0/2971833998 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7cec015a40 con 0x7f7d04136670 2024-08-18T21:15:02.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.778+0000 7f7cfb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:02.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.778+0000 7f7cfb7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:15:02.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.778+0000 7f7cfb7fe640 10 monclient: dump: 2024-08-18T21:15:02.791 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:02.791 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:02.791 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.791 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.791 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:02.791 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:02.792 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:02.792 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:02.792 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:02.792 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:02.792 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:02.792 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:02.792 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:02.792 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:02.792 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:02.793 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:02.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.782+0000 7f7cfb7fe640 1 -- 172.21.15.5:0/2971833998 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7cec0155d0 con 0x7f7d04136670 2024-08-18T21:15:02.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.782+0000 7f7cfb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:02.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.782+0000 7f7cfb7fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:02.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.782+0000 7f7cfb7fe640 1 -- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d04136670 msgr2=0x7f7d0402e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:02.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.782+0000 7f7cfb7fe640 1 --2- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d04136670 0x7f7d0402e350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7cec000c10 tx=0x7f7cec00b7c0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.782+0000 7f7cfb7fe640 1 -- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d04136670 msgr2=0x7f7d0402e350 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:02.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.782+0000 7f7cfb7fe640 1 --2- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d04136670 0x7f7d0402e350 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.786+0000 7f7d0929d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:15:02.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.786+0000 7f7d0929d640 1 --2- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d0413c590 0x7f7d04063b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:02.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.786+0000 7f7d0929d640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:02.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.786+0000 7f7d0929d640 1 -- 172.21.15.5:0/2971833998 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7d04051140 con 0x7f7d0413c590 2024-08-18T21:15:02.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.786+0000 7f7d027fc640 1 --2- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d0413c590 0x7f7d04063b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:02.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.786+0000 7f7d027fc640 10 monclient: get_auth_request con 0x7f7d0413c590 auth_method 0 2024-08-18T21:15:02.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.786+0000 7f7d027fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:02.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.786+0000 7f7d027fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:02.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.786+0000 7f7d027fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:02.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.786+0000 7f7d027fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:02.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.786+0000 7f7d027fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:02.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.786+0000 7f7d027fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:02.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.786+0000 7f7d027fc640 10 monclient(hunting): handle_auth_done global_id 134373 payload 824 2024-08-18T21:15:02.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.786+0000 7f7d027fc640 1 -- 172.21.15.5:0/2971833998 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7d0406e960 con 0x7f7d0413c590 2024-08-18T21:15:02.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.790+0000 7f7d027fc640 1 -- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d0413c590 msgr2=0x7f7d04063b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:02.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.790+0000 7f7d027fc640 1 --2- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d0413c590 0x7f7d04063b30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009fd0 tx=0x7f7cec0096b0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:02.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.790+0000 7f7cfb7fe640 1 -- 172.21.15.5:0/2971833998 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7cec0168d0 con 0x7f7d0413c590 2024-08-18T21:15:02.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.790+0000 7f7cfb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:02.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.790+0000 7f7cfb7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:15:02.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.790+0000 7f7cfb7fe640 10 monclient: dump: 2024-08-18T21:15:02.796 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:02.796 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:02.796 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.796 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.797 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:02.797 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:02.797 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:02.797 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:02.797 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:02.797 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:02.797 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:02.797 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:02.797 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:02.797 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:02.797 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:02.798 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:02.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.790+0000 7f7cfb7fe640 1 -- 172.21.15.5:0/2971833998 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9214 (secure 0 0 0) 0x7f7cec016460 con 0x7f7d0413c590 2024-08-18T21:15:02.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.790+0000 7f7cfb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:15:02.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.790+0000 7f7cfb7fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:15:02.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.790+0000 7f7cfb7fe640 1 -- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d0413c590 msgr2=0x7f7d04063b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:02.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.790+0000 7f7cfb7fe640 1 --2- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d0413c590 0x7f7d04063b30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009fd0 tx=0x7f7cec0096b0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.790+0000 7f7cfb7fe640 1 -- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d0413c590 msgr2=0x7f7d04063b30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:02.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.790+0000 7f7cfb7fe640 1 --2- 172.21.15.5:0/2971833998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d0413c590 0x7f7d04063b30 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009fd0 tx=0x7f7cec0096b0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.799 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:02.799 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:15:02.799 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:15:02.799 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:15:02.799 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 238, 2024-08-18T21:15:02.799 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 62255, 2024-08-18T21:15:02.799 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:15:02.799 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:15:02.799 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:15:02.800 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:15:02.800 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:15:02.800 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:15:02.800 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:15:02.800 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:02.800 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:15:02.800 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:02.800 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:15:02.800 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:15:02.800 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:02.800 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:02.800 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:02.801 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:02.801 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:02.801 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:02.801 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:02.801 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:02.801 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:02.801 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:02.801 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:02.801 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:02.801 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:15:02.801 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:15:02.801 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:02.801 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:02.802 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:02.802 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:02.802 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:02.802 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:02.802 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:02.802 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:02.802 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:02.802 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:02.802 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:02.802 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:02.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.802 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:15:02.802 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:15:02.803 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:15:02.805 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:15:02.805 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:15:02.805 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:15:02.805 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:02.805 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:02.806 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:15:02.806 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:15:02.806 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:15:02.806 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:15:02.806 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:15:02.806 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:15:02.807 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:15:02.807 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:02.807 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:15:02.807 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:02.807 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:02.807 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:02.807 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:02.807 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:02.807 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:02.807 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:02.807 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:02.808 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:02.808 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:02.809 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:02.809 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:02.809 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:15:02.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.809 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:15:02.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.809 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:15:02.810 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:15:02.810 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:02.810 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:02.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.810 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:02.810 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:15:02.810 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.810 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:02.811 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:15:02.811 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.811 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:02.811 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:02.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.811 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:15:02.811 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:15:02.811 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:02.811 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:02.811 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:02.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.812 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:15:02.812 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:15:02.812 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:02.812 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:02.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.812 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:02.812 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:15:02.812 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.812 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:02.812 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:15:02.813 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.813 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:02.813 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:02.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.813 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:15:02.813 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:15:02.813 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:02.813 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:02.813 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:02.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.814 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.814 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:15:02.814 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:15:02.814 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:02.814 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:02.814 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.814 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:02.814 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:15:02.814 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.815 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:02.815 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:15:02.815 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.815 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:02.815 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:02.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.815 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:15:02.815 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:15:02.815 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:02.815 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:02.815 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:02.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.816 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.816 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:15:02.816 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:15:02.816 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:02.816 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:02.816 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.816 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:02.816 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:15:02.816 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.816 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.816 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:02.816 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:15:02.817 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.817 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:02.817 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:02.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.817 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:15:02.817 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:15:02.817 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:02.817 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:02.817 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:02.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.818 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:15:02.818 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:15:02.818 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:02.818 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:02.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.818 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:02.818 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:15:02.818 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.819 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:02.819 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:15:02.819 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.819 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:02.819 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:02.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.819 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:15:02.819 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:15:02.819 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:02.820 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:02.820 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:02.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.820 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:15:02.820 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:15:02.820 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:02.820 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:02.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.820 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:02.820 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:15:02.820 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.821 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:02.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:15:02.821 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.821 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:02.821 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:02.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:15:02.821 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:15:02.821 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:02.821 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:02.821 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:02.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.822 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:15:02.822 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:15:02.822 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:02.822 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:02.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.822 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:02.822 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:15:02.822 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.823 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:02.823 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:15:02.823 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.823 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:02.823 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:02.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.823 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:15:02.823 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:15:02.823 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:02.823 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:02.823 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:02.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.824 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:15:02.824 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:15:02.824 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:02.824 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:02.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.824 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:02.824 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:15:02.824 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.824 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:02.824 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:15:02.824 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.825 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:02.825 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:02.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.825 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:15:02.825 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:15:02.825 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:02.825 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:02.825 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:02.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.825 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:15:02.826 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:15:02.826 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:02.826 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:02.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.826 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:02.826 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:15:02.826 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.826 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:02.826 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:15:02.827 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:02.827 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:02.827 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:02.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.827 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:15:02.827 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:15:02.827 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:02.827 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:02.827 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:02.827 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:02.827 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:02.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.827 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:15:02.828 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:15:02.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.828 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:02.828 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:02.828 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:02.828 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:02.828 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:02.828 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:15:02.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:02.828 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:02.828 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:02.829 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:15:02.829 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:02.829 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:02.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:02.829 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:15:02.829 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:02.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.794+0000 7f7d0929d640 1 -- 172.21.15.5:0/2971833998 >> v2:172.21.15.157:6812/631023601 conn(0x7f7ce403d0a0 msgr2=0x7f7ce403f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.794+0000 7f7d0929d640 1 --2- 172.21.15.5:0/2971833998 >> v2:172.21.15.157:6812/631023601 conn(0x7f7ce403d0a0 0x7f7ce403f560 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7d0406f540 tx=0x7f7cf40a7000 comp rx=0 tx=0).stop 2024-08-18T21:15:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.794+0000 7f7d0929d640 10 monclient: shutdown 2024-08-18T21:15:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.794+0000 7f7d0929d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.794+0000 7f7d0929d640 1 -- 172.21.15.5:0/2971833998 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7ce4008d70 msgr2=0x7f7d04135d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.794+0000 7f7d0929d640 1 --2- 172.21.15.5:0/2971833998 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f7ce4008d70 0x7f7d04135d50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00c930 tx=0x7f7cfc00cdf0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.794+0000 7f7d037fe640 1 -- 172.21.15.5:0/2971833998 reap_dead start 2024-08-18T21:15:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.794+0000 7f7d037fe640 1 -- 172.21.15.5:0/2971833998 reap_dead start 2024-08-18T21:15:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.794+0000 7f7d0929d640 1 -- 172.21.15.5:0/2971833998 shutdown_connections 2024-08-18T21:15:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.794+0000 7f7d0929d640 1 -- 172.21.15.5:0/2971833998 >> 172.21.15.5:0/2971833998 conn(0x7f7d040acbc0 msgr2=0x7f7d040aa900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.794+0000 7f7d0929d640 1 -- 172.21.15.5:0/2971833998 shutdown_connections 2024-08-18T21:15:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.794+0000 7f7d0929d640 1 -- 172.21.15.5:0/2971833998 wait complete. 2024-08-18T21:15:02.832 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-18T21:15:02.832 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon h 2024-08-18T21:15:02.832 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:15:02.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 10 monclient: get_monmap_and_config 2024-08-18T21:15:02.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 10 monclient: build_initial_monmap 2024-08-18T21:15:02.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 10 monclient: monmap: 2024-08-18T21:15:02.965 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:02.965 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:02.965 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:02.969746+0000 2024-08-18T21:15:02.965 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:02.969746+0000 2024-08-18T21:15:02.965 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:02.965 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:02.965 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:02.965 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:02.965 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:02.965 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:02.965 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:02.965 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:02.966 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 1 Processor -- start 2024-08-18T21:15:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 1 -- start start 2024-08-18T21:15:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 10 monclient: init 2024-08-18T21:15:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 10 monclient: _add_conns ranks=[1,2,5,10,8,3,7,6,9,4,0] 2024-08-18T21:15:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f9560137a70 addr v1:172.21.15.157:6789/0 2024-08-18T21:15:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95600a4c10 0x7f95600a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 10 monclient(hunting): picked mon.noname-b con 0x7f95600a4c10 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f956013c8f0 0x7f956013ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 10 monclient(hunting): picked mon.noname-h con 0x7f956013c8f0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956009fe40 con 0x7f9560137a70 2024-08-18T21:15:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f95600a03e0 con 0x7f95600a4c10 2024-08-18T21:15:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f95600a08e0 con 0x7f956013c8f0 2024-08-18T21:15:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9567d73640 10 monclient(hunting): authenticate will time out at 1669.983513s 2024-08-18T21:15:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f956530e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95600a4c10 0x7f95600a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9565b0f640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7f9560137a70 legacy=0x7f9560137e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-08-18T21:15:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f956530e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95600a4c10 0x7f95600a1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:43196/0 (socket says 172.21.15.5:43196) 2024-08-18T21:15:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f956530e640 1 -- 172.21.15.5:0/1587259035 learned_addr learned my addr 172.21.15.5:0/1587259035 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f956530e640 10 monclient(hunting): get_auth_request con 0x7f95600a4c10 auth_method 0 2024-08-18T21:15:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f956530e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f956530e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f956530e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f956530e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f956530e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f956530e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.966+0000 7f9566310640 1 --2- 172.21.15.5:0/1587259035 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f956013c8f0 0x7f956013ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.970+0000 7f9566310640 10 monclient(hunting): get_auth_request con 0x7f956013c8f0 auth_method 0 2024-08-18T21:15:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.970+0000 7f9566310640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.970+0000 7f9566310640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.970+0000 7f9566310640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.970+0000 7f956530e640 10 monclient(hunting): handle_auth_done global_id 115013 payload 274 2024-08-18T21:15:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.970+0000 7f956530e640 1 -- 172.21.15.5:0/1587259035 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f956013c8f0 msgr2=0x7f956013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.970+0000 7f956530e640 1 --2- 172.21.15.5:0/1587259035 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f956013c8f0 0x7f956013ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.970+0000 7f956530e640 1 -- 172.21.15.5:0/1587259035 >> v1:172.21.15.157:6789/0 conn(0x7f9560137a70 legacy=0x7f9560137e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:15:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.970+0000 7f956530e640 10 monclient: _finish_hunting 0 2024-08-18T21:15:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.970+0000 7f956530e640 1 monclient: found mon.noname-b 2024-08-18T21:15:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.970+0000 7f956530e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.970+0000 7f956530e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.970+0000 7f956530e640 1 -- 172.21.15.5:0/1587259035 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95600a0bc0 con 0x7f95600a4c10 2024-08-18T21:15:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f956530e640 1 -- 172.21.15.5:0/1587259035 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95600a4c10 msgr2=0x7f95600a1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f956530e640 1 --2- 172.21.15.5:0/1587259035 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95600a4c10 0x7f95600a1b60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f955c0098a0 tx=0x7f955c01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa00abaf7c3668 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9564b0d640 1 -- 172.21.15.5:0/1587259035 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f955c0b0070 con 0x7f95600a4c10 2024-08-18T21:15:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9564b0d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9564b0d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9564b0d640 10 monclient: dump: 2024-08-18T21:15:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:02.974 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9564b0d640 10 monclient: _finish_auth 0 2024-08-18T21:15:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9564b0d640 10 monclient: _check_auth_tickets 2024-08-18T21:15:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9564b0d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9564b0d640 1 -- 172.21.15.5:0/1587259035 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f955c0aa810 con 0x7f95600a4c10 2024-08-18T21:15:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 5 monclient: authenticate success, global_id 115013 2024-08-18T21:15:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:15:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9564b0d640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9564b0d640 1 -- 172.21.15.5:0/1587259035 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f955c0a9300 con 0x7f95600a4c10 2024-08-18T21:15:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 4 set_mon_vals no callback set 2024-08-18T21:15:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9564b0d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9564b0d640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9564b0d640 10 monclient: dump: 2024-08-18T21:15:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:02.977 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 10 monclient: shutdown 2024-08-18T21:15:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 1 -- 172.21.15.5:0/1587259035 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95600a4c10 msgr2=0x7f95600a1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 1 --2- 172.21.15.5:0/1587259035 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95600a4c10 0x7f95600a1b60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f955c0098a0 tx=0x7f955c01c440 comp rx=0 tx=0).stop 2024-08-18T21:15:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 1 -- 172.21.15.5:0/1587259035 shutdown_connections 2024-08-18T21:15:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 1 --2- 172.21.15.5:0/1587259035 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f956013c8f0 0x7f956013ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 1 --2- 172.21.15.5:0/1587259035 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95600a4c10 0x7f95600a1b60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 1 -- 172.21.15.5:0/1587259035 >> 172.21.15.5:0/1587259035 conn(0x7f95600688d0 msgr2=0x7f9560068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:02.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 1 -- 172.21.15.5:0/1587259035 shutdown_connections 2024-08-18T21:15:02.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 1 -- 172.21.15.5:0/1587259035 wait complete. 2024-08-18T21:15:02.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 10 monclient: build_initial_monmap 2024-08-18T21:15:02.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 10 monclient: monmap: 2024-08-18T21:15:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:02.980 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 1 Processor -- start 2024-08-18T21:15:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 1 -- start start 2024-08-18T21:15:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 10 monclient: init 2024-08-18T21:15:02.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 10 monclient: _add_conns ranks=[2,3,1,6,8,5,7,0,4] 2024-08-18T21:15:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95600a4c10 0x7f95601cef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 10 monclient(hunting): picked mon.noname-b con 0x7f95600a4c10 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9560137a70 0x7f9560136770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 10 monclient(hunting): picked mon.noname-g con 0x7f9560137a70 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f956013c8f0 0x7f956013a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 10 monclient(hunting): picked mon.noname-f con 0x7f956013c8f0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:15:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9560141dd0 con 0x7f956013c8f0 2024-08-18T21:15:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f9560141c50 con 0x7f95600a4c10 2024-08-18T21:15:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9560141f50 con 0x7f9560137a70 2024-08-18T21:15:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9567d73640 10 monclient(hunting): authenticate will time out at 1669.990638s 2024-08-18T21:15:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95600a4c10 0x7f95601cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95600a4c10 0x7f95601cef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:43202/0 (socket says 172.21.15.5:43202) 2024-08-18T21:15:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 1 -- 172.21.15.5:0/2226815728 learned_addr learned my addr 172.21.15.5:0/2226815728 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9566310640 1 -- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f956013c8f0 msgr2=0x7f956013a6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-08-18T21:15:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 10 monclient(hunting): get_auth_request con 0x7f95600a4c10 auth_method 0 2024-08-18T21:15:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9566310640 1 --2- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f956013c8f0 0x7f956013a6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:15:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f956530e640 1 --2- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9560137a70 0x7f9560136770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f956530e640 10 monclient(hunting): get_auth_request con 0x7f9560137a70 auth_method 0 2024-08-18T21:15:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f956530e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f956530e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f956530e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 10 monclient(hunting): handle_auth_done global_id 115022 payload 824 2024-08-18T21:15:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 1 -- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9560137a70 msgr2=0x7f9560136770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 1 --2- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9560137a70 0x7f9560136770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 1 -- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f956013c8f0 msgr2=0x7f956013a6e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:15:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 1 --2- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f956013c8f0 0x7f956013a6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 10 monclient: _finish_hunting 0 2024-08-18T21:15:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 1 monclient: found mon.noname-b 2024-08-18T21:15:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.974+0000 7f9565b0f640 1 -- 172.21.15.5:0/2226815728 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9560121100 con 0x7f95600a4c10 2024-08-18T21:15:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f9565b0f640 1 -- 172.21.15.5:0/2226815728 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95600a4c10 msgr2=0x7f95601cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f9565b0f640 1 --2- 172.21.15.5:0/2226815728 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95600a4c10 0x7f95601cef40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f955000b4e0 tx=0x7f955000b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95567fc640 1 -- 172.21.15.5:0/2226815728 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f95500092f0 con 0x7f95600a4c10 2024-08-18T21:15:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95567fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95567fc640 10 monclient: dump: 2024-08-18T21:15:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:02.990 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95567fc640 10 monclient: _finish_auth 0 2024-08-18T21:15:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95567fc640 10 monclient: _check_auth_tickets 2024-08-18T21:15:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95567fc640 1 -- 172.21.15.5:0/2226815728 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9550015070 con 0x7f95600a4c10 2024-08-18T21:15:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f9567d73640 5 monclient: authenticate success, global_id 115022 2024-08-18T21:15:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f9567d73640 10 monclient: _renew_subs 2024-08-18T21:15:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f9567d73640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f9567d73640 1 -- 172.21.15.5:0/2226815728 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95600a8070 con 0x7f95600a4c10 2024-08-18T21:15:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95567fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95567fc640 1 -- 172.21.15.5:0/2226815728 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9550003d90 con 0x7f95600a4c10 2024-08-18T21:15:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95567fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95577fe640 4 set_mon_vals no callback set 2024-08-18T21:15:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95567fc640 10 monclient: dump: 2024-08-18T21:15:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:02.992 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f9567d73640 10 monclient: _renew_subs 2024-08-18T21:15:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f9567d73640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f9567d73640 1 -- 172.21.15.5:0/2226815728 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f956013ee30 con 0x7f95600a4c10 2024-08-18T21:15:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f9567d73640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f9567d73640 1 --2- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9560136cb0 0x7f956013ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f9567d73640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f9567d73640 1 -- 172.21.15.5:0/2226815728 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f9560051140 con 0x7f9560136cb0 2024-08-18T21:15:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95567fc640 1 -- 172.21.15.5:0/2226815728 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f9550005070 con 0x7f95600a4c10 2024-08-18T21:15:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95567fc640 1 --2- 172.21.15.5:0/2226815728 >> v2:172.21.15.157:6812/631023601 conn(0x7f954403bdc0 0x7f954403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:02.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f95567fc640 1 -- 172.21.15.5:0/2226815728 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(306..306 src has 22..306) ==== 3506+0+0 (secure 0 0 0) 0x7f955004e380 con 0x7f95600a4c10 2024-08-18T21:15:02.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f956530e640 1 --2- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9560136cb0 0x7f956013ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:02.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f956530e640 10 monclient: get_auth_request con 0x7f9560136cb0 auth_method 0 2024-08-18T21:15:02.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f956530e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:02.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f956530e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:02.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f956530e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:02.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f9566310640 1 --2- 172.21.15.5:0/2226815728 >> v2:172.21.15.157:6812/631023601 conn(0x7f954403bdc0 0x7f954403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:02.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f956530e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:02.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f956530e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:02.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f956530e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:02.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f9566310640 10 monclient: get_auth_request con 0x7f954403bdc0 auth_method 0 2024-08-18T21:15:02.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f956530e640 10 monclient(hunting): handle_auth_done global_id 95594 payload 824 2024-08-18T21:15:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.978+0000 7f956530e640 1 -- 172.21.15.5:0/2226815728 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f956006dbf0 con 0x7f9560136cb0 2024-08-18T21:15:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.982+0000 7f9566310640 1 --2- 172.21.15.5:0/2226815728 >> v2:172.21.15.157:6812/631023601 conn(0x7f954403bdc0 0x7f954403e280 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f95600a2130 tx=0x7f9558009790 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.982+0000 7f956530e640 1 -- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9560136cb0 msgr2=0x7f956013ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.982+0000 7f956530e640 1 --2- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9560136cb0 0x7f956013ac20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f955c0ad000 tx=0x7f955c0191e0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.982+0000 7f95567fc640 1 -- 172.21.15.5:0/2226815728 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f955c0b0050 con 0x7f9560136cb0 2024-08-18T21:15:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.982+0000 7f95567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.982+0000 7f95567fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:15:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.982+0000 7f95567fc640 10 monclient: dump: 2024-08-18T21:15:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:02.997 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.982+0000 7f95567fc640 1 -- 172.21.15.5:0/2226815728 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f955c0b1040 con 0x7f9560136cb0 2024-08-18T21:15:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.982+0000 7f95567fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.982+0000 7f95567fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.982+0000 7f95567fc640 1 -- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9560136cb0 msgr2=0x7f956013ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.982+0000 7f95567fc640 1 --2- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9560136cb0 0x7f956013ac20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f955c0ad000 tx=0x7f955c0191e0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.982+0000 7f95567fc640 1 -- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9560136cb0 msgr2=0x7f956013ac20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.982+0000 7f95567fc640 1 --2- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f9560136cb0 0x7f956013ac20 secure :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f955c0ad000 tx=0x7f955c0191e0 comp rx=0 tx=0).stop 2024-08-18T21:15:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.990+0000 7f9567d73640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:15:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.990+0000 7f9567d73640 1 --2- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f956013b160 0x7f9560071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.990+0000 7f9567d73640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.990+0000 7f9567d73640 1 -- 172.21.15.5:0/2226815728 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f956013b570 con 0x7f956013b160 2024-08-18T21:15:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.990+0000 7f956530e640 1 --2- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f956013b160 0x7f9560071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.990+0000 7f956530e640 10 monclient: get_auth_request con 0x7f956013b160 auth_method 0 2024-08-18T21:15:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.990+0000 7f956530e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.990+0000 7f956530e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.990+0000 7f956530e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.990+0000 7f956530e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.990+0000 7f956530e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.990+0000 7f956530e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.990+0000 7f956530e640 10 monclient(hunting): handle_auth_done global_id 95603 payload 824 2024-08-18T21:15:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.990+0000 7f956530e640 1 -- 172.21.15.5:0/2226815728 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f95600a1b60 con 0x7f956013b160 2024-08-18T21:15:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f956530e640 1 -- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f956013b160 msgr2=0x7f9560071f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f956530e640 1 --2- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f956013b160 0x7f9560071f70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f955c000c10 tx=0x7f955c0a8000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f95567fc640 1 -- 172.21.15.5:0/2226815728 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f955c0beda0 con 0x7f956013b160 2024-08-18T21:15:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f95567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f95567fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:15:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f95567fc640 10 monclient: dump: 2024-08-18T21:15:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:03.002 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f95567fc640 1 -- 172.21.15.5:0/2226815728 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9549 (secure 0 0 0) 0x7f955c0be930 con 0x7f956013b160 2024-08-18T21:15:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f95567fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:15:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f95567fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:15:03.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f95567fc640 1 -- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f956013b160 msgr2=0x7f9560071f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:03.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f95567fc640 1 --2- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f956013b160 0x7f9560071f70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f955c000c10 tx=0x7f955c0a8000 comp rx=0 tx=0).stop 2024-08-18T21:15:03.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f95567fc640 1 -- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f956013b160 msgr2=0x7f9560071f70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:03.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f95567fc640 1 --2- 172.21.15.5:0/2226815728 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f956013b160 0x7f9560071f70 secure :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f955c000c10 tx=0x7f955c0a8000 comp rx=0 tx=0).stop 2024-08-18T21:15:03.003 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:03.003 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:15:03.003 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:15:03.003 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:15:03.003 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 238, 2024-08-18T21:15:03.004 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 331031, 2024-08-18T21:15:03.004 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:15:03.004 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:15:03.004 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:15:03.004 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:15:03.004 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:15:03.004 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:15:03.004 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:15:03.004 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:03.004 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 5, 2024-08-18T21:15:03.004 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:03.004 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:15:03.004 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:15:03.005 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:03.005 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:03.005 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:03.005 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:03.005 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:03.005 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:03.005 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:03.005 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:03.005 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:03.005 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:03.005 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:03.005 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:03.005 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:15:03.006 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:15:03.006 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:03.006 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:03.006 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:03.006 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:03.006 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:03.006 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:03.006 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:03.006 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:03.006 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:03.006 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:03.006 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:03.006 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:03.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.007 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:15:03.007 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:15:03.007 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:15:03.007 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:15:03.007 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:15:03.007 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:15:03.007 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:03.007 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:03.007 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:15:03.007 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:15:03.007 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:15:03.007 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:15:03.008 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:15:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:15:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:15:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:15:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:15:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:15:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:15:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:15:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:15:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:15:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:15:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:15:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:15:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:15:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:15:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:15:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:15:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:15:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:15:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:15:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:15:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:15:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:15:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:15:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:15:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:15:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:15:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:15:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:15:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:15:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:15:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:15:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:15:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:15:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:15:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:15:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:15:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:15:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:15:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:15:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:15:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:15:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:15:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:15:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:15:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:15:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:15:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:15:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:03.023 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:03.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.023 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:15:03.023 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:15:03.023 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:03.023 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:03.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:03.023 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:15:03.024 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.024 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:03.024 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:15:03.024 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.024 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:03.024 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:03.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.024 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:15:03.024 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:15:03.024 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:03.024 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:03.024 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:03.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.025 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:15:03.025 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:15:03.025 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:03.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:03.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:03.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:15:03.025 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:03.026 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:15:03.026 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:03.026 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:03.026 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:03.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.026 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:15:03.026 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:15:03.026 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:03.026 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:03.026 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:03.026 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:03.026 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:03.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.027 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:15:03.027 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:15:03.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.027 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:03.027 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:03.027 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:03.027 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:03.027 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:03.027 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:15:03.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.027 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:03.027 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:03.027 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:15:03.027 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:03.028 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:03.028 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:15:03.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.028 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:03.028 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:03.028 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:15:03.028 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:03.028 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:03.028 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:15:03.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:03.028 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:03.028 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:03.028 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:03.028 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:03.029 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:03.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:03.029 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:15:03.029 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:03.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f9567d73640 1 -- 172.21.15.5:0/2226815728 >> v2:172.21.15.157:6812/631023601 conn(0x7f954403bdc0 msgr2=0x7f954403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:03.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f9567d73640 1 --2- 172.21.15.5:0/2226815728 >> v2:172.21.15.157:6812/631023601 conn(0x7f954403bdc0 0x7f954403e280 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f95600a2130 tx=0x7f9558009790 comp rx=0 tx=0).stop 2024-08-18T21:15:03.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f9567d73640 10 monclient: shutdown 2024-08-18T21:15:03.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f9567d73640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:03.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f9567d73640 1 -- 172.21.15.5:0/2226815728 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95600a4c10 msgr2=0x7f95601cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:03.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f9567d73640 1 --2- 172.21.15.5:0/2226815728 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95600a4c10 0x7f95601cef40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f955000b4e0 tx=0x7f955000b9a0 comp rx=0 tx=0).stop 2024-08-18T21:15:03.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f9566310640 1 -- 172.21.15.5:0/2226815728 reap_dead start 2024-08-18T21:15:03.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f9566310640 1 -- 172.21.15.5:0/2226815728 reap_dead start 2024-08-18T21:15:03.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f9567d73640 1 -- 172.21.15.5:0/2226815728 shutdown_connections 2024-08-18T21:15:03.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f9567d73640 1 -- 172.21.15.5:0/2226815728 >> 172.21.15.5:0/2226815728 conn(0x7f95600688d0 msgr2=0x7f956006c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:03.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f9567d73640 1 -- 172.21.15.5:0/2226815728 shutdown_connections 2024-08-18T21:15:03.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:02.994+0000 7f9567d73640 1 -- 172.21.15.5:0/2226815728 wait complete. 2024-08-18T21:15:03.031 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-18T21:15:03.032 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-18T21:15:04.291 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32431]: starting. 2024-08-18T21:15:04.292 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32431]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-32430 2024-08-18T21:15:04.292 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32431]: created object 0... 2024-08-18T21:15:04.292 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32431]: created object 25... 2024-08-18T21:15:04.292 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32431]: created object 49... 2024-08-18T21:15:04.292 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32431]: finishing. 2024-08-18T21:15:04.292 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32431]: shutting down. 2024-08-18T21:15:05.081 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32432]: starting. 2024-08-18T21:15:05.081 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32432]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-32430 2024-08-18T21:15:05.081 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32432]: shutting down. 2024-08-18T21:15:07.323 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:07.323 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32465]: starting. 2024-08-18T21:15:07.323 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32465]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-32430 2024-08-18T21:15:07.324 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32465]: created object 0... 2024-08-18T21:15:07.324 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32465]: created object 25... 2024-08-18T21:15:07.324 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32465]: created object 49... 2024-08-18T21:15:07.324 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32465]: finishing. 2024-08-18T21:15:07.324 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32465]: shutting down. 2024-08-18T21:15:07.385 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:07.385 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32467]: starting. 2024-08-18T21:15:07.385 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32467]: listing objects. 2024-08-18T21:15:07.385 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32467]: listed object 0... 2024-08-18T21:15:07.385 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32467]: listed object 25... 2024-08-18T21:15:07.385 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32467]: saw 50 objects 2024-08-18T21:15:07.385 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32467]: shutting down. 2024-08-18T21:15:08.133 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:08.133 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32466]: starting. 2024-08-18T21:15:08.133 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32466]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-32430 2024-08-18T21:15:08.133 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32466]: shutting down. 2024-08-18T21:15:08.136 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:08.136 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:08.136 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:15:08.140 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:15:10.501 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32518]: starting. 2024-08-18T21:15:10.502 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32518]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-32517 2024-08-18T21:15:10.502 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32518]: created object 0... 2024-08-18T21:15:10.502 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32518]: created object 25... 2024-08-18T21:15:10.502 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32518]: created object 49... 2024-08-18T21:15:10.502 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32518]: finishing. 2024-08-18T21:15:10.502 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32518]: shutting down. 2024-08-18T21:15:11.303 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32519]: starting. 2024-08-18T21:15:11.303 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32519]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-32517 2024-08-18T21:15:11.303 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32519]: shutting down. 2024-08-18T21:15:14.657 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:14.658 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32552]: starting. 2024-08-18T21:15:14.658 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32552]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-32517 2024-08-18T21:15:14.658 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32552]: created object 0... 2024-08-18T21:15:14.658 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32552]: created object 25... 2024-08-18T21:15:14.658 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32552]: created object 49... 2024-08-18T21:15:14.658 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32552]: finishing. 2024-08-18T21:15:14.658 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32552]: shutting down. 2024-08-18T21:15:14.716 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:14.716 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32554]: starting. 2024-08-18T21:15:14.716 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32554]: listing objects. 2024-08-18T21:15:14.717 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32554]: listed object 0... 2024-08-18T21:15:14.717 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32554]: listed object 25... 2024-08-18T21:15:14.717 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32554]: saw 50 objects 2024-08-18T21:15:14.717 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32554]: shutting down. 2024-08-18T21:15:15.112 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:15.112 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32553]: starting. 2024-08-18T21:15:15.112 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32553]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-32517 2024-08-18T21:15:15.112 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32553]: shutting down. 2024-08-18T21:15:15.114 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:15.114 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:15.114 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:15:15.117 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:15:17.707 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32605]: starting. 2024-08-18T21:15:17.707 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32605]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-32604 2024-08-18T21:15:17.707 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32605]: created object 0... 2024-08-18T21:15:17.707 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32605]: created object 25... 2024-08-18T21:15:17.707 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32605]: created object 49... 2024-08-18T21:15:17.707 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32605]: finishing. 2024-08-18T21:15:17.707 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32605]: shutting down. 2024-08-18T21:15:18.491 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32606]: starting. 2024-08-18T21:15:18.491 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32606]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-32604 2024-08-18T21:15:18.491 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32606]: shutting down. 2024-08-18T21:15:20.764 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:20.764 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32639]: starting. 2024-08-18T21:15:20.764 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32639]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-32604 2024-08-18T21:15:20.764 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32639]: created object 0... 2024-08-18T21:15:20.764 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32639]: created object 25... 2024-08-18T21:15:20.764 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32639]: created object 49... 2024-08-18T21:15:20.764 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32639]: finishing. 2024-08-18T21:15:20.765 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32639]: shutting down. 2024-08-18T21:15:20.825 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:20.825 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32641]: starting. 2024-08-18T21:15:20.825 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32641]: listing objects. 2024-08-18T21:15:20.825 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32641]: listed object 0... 2024-08-18T21:15:20.825 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32641]: listed object 25... 2024-08-18T21:15:20.825 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32641]: saw 50 objects 2024-08-18T21:15:20.826 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32641]: shutting down. 2024-08-18T21:15:21.549 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:21.549 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32640]: starting. 2024-08-18T21:15:21.550 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32640]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-32604 2024-08-18T21:15:21.550 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32640]: shutting down. 2024-08-18T21:15:21.553 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:21.554 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:21.554 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:15:21.558 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-18T21:15:23.033 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2024-08-18T21:15:23.033 INFO:tasks.ceph.mon.d:Restarting daemon 2024-08-18T21:15:23.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-08-18T21:15:23.036 INFO:tasks.ceph.mon.d:Started 2024-08-18T21:15:23.036 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.i 2024-08-18T21:15:23.036 INFO:tasks.ceph.mon.i:Restarting daemon 2024-08-18T21:15:23.036 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2024-08-18T21:15:23.042 INFO:tasks.ceph.mon.i:Started 2024-08-18T21:15:23.042 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.f 2024-08-18T21:15:23.042 INFO:tasks.ceph.mon.f:Restarting daemon 2024-08-18T21:15:23.042 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-08-18T21:15:23.044 INFO:tasks.ceph.mon.f:Started 2024-08-18T21:15:23.044 INFO:tasks.mon_thrash:Sending STOP to mon e 2024-08-18T21:15:23.045 INFO:tasks.ceph.mon.e:Sent signal 19 2024-08-18T21:15:23.045 INFO:tasks.mon_thrash:Sending STOP to mon h 2024-08-18T21:15:23.045 INFO:tasks.ceph.mon.h:Sent signal 19 2024-08-18T21:15:23.045 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs to unfreeze mons 2024-08-18T21:15:41.039 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32695]: starting. 2024-08-18T21:15:41.039 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32695]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-32694 2024-08-18T21:15:41.039 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32695]: created object 0... 2024-08-18T21:15:41.040 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32695]: created object 25... 2024-08-18T21:15:41.040 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32695]: created object 49... 2024-08-18T21:15:41.040 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32695]: finishing. 2024-08-18T21:15:41.040 INFO:teuthology.orchestra.run.smithi157.stdout:process_1_[32695]: shutting down. 2024-08-18T21:15:41.844 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32696]: starting. 2024-08-18T21:15:41.844 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32696]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-32694 2024-08-18T21:15:41.844 INFO:teuthology.orchestra.run.smithi157.stdout:process_2_[32696]: shutting down. 2024-08-18T21:15:43.046 INFO:tasks.mon_thrash:Sending CONT to mon e 2024-08-18T21:15:43.047 INFO:tasks.ceph.mon.e:Sent signal 18 2024-08-18T21:15:43.047 INFO:tasks.mon_thrash:Sending CONT to mon h 2024-08-18T21:15:43.048 INFO:tasks.ceph.mon.h:Sent signal 18 2024-08-18T21:15:43.048 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-18T21:15:43.048 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-18T21:15:43.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 10 monclient: get_monmap_and_config 2024-08-18T21:15:43.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 10 monclient: build_initial_monmap 2024-08-18T21:15:43.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 10 monclient: monmap: 2024-08-18T21:15:43.192 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:43.192 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:43.197632+0000 2024-08-18T21:15:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:43.197632+0000 2024-08-18T21:15:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:43.194 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:43.194 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:43.194 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 1 Processor -- start 2024-08-18T21:15:43.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 1 -- start start 2024-08-18T21:15:43.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 10 monclient: init 2024-08-18T21:15:43.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:43.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 10 monclient: _add_conns ranks=[9,2,8,4,3,7,6,0,1,5,10] 2024-08-18T21:15:43.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f37280a6ce0 0x7f37280a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 10 monclient(hunting): picked mon.noname-a con 0x7f37280a6ce0 addr v2:172.21.15.5:3300/0 2024-08-18T21:15:43.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f37280a7600 0x7f3728139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 10 monclient(hunting): picked mon.noname-b con 0x7f37280a7600 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:43.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3728139fe0 0x7f372813a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 10 monclient(hunting): picked mon.noname-e con 0x7f3728139fe0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:43.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f37280a5000 con 0x7f37280a6ce0 2024-08-18T21:15:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f37280a4360 con 0x7f37280a7600 2024-08-18T21:15:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f37280a45d0 con 0x7f3728139fe0 2024-08-18T21:15:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372f384640 10 monclient(hunting): authenticate will time out at 1710.210783s 2024-08-18T21:15:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3728139fe0 0x7f372813a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372c91f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f37280a7600 0x7f3728139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d120640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f37280a6ce0 0x7f37280a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3728139fe0 0x7f372813a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:35878/0 (socket says 172.21.15.5:35878) 2024-08-18T21:15:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 1 -- 172.21.15.5:0/3843129598 learned_addr learned my addr 172.21.15.5:0/3843129598 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 10 monclient(hunting): get_auth_request con 0x7f3728139fe0 auth_method 0 2024-08-18T21:15:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372c91f640 10 monclient(hunting): get_auth_request con 0x7f37280a7600 auth_method 0 2024-08-18T21:15:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372c91f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372c91f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372c91f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d120640 10 monclient(hunting): get_auth_request con 0x7f37280a6ce0 auth_method 0 2024-08-18T21:15:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d120640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d120640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d120640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372c91f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372c91f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372c91f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d120640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d120640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d120640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 10 monclient(hunting): handle_auth_done global_id 115289 payload 274 2024-08-18T21:15:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 1 -- 172.21.15.5:0/3843129598 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f37280a7600 msgr2=0x7f3728139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 1 --2- 172.21.15.5:0/3843129598 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f37280a7600 0x7f3728139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 1 -- 172.21.15.5:0/3843129598 >> v2:172.21.15.5:3300/0 conn(0x7f37280a6ce0 msgr2=0x7f37280a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 1 --2- 172.21.15.5:0/3843129598 >> v2:172.21.15.5:3300/0 conn(0x7f37280a6ce0 0x7f37280a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 10 monclient: _finish_hunting 0 2024-08-18T21:15:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 1 monclient: found mon.noname-e 2024-08-18T21:15:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:15:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.194+0000 7f372d921640 1 -- 172.21.15.5:0/3843129598 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37280a32d0 con 0x7f3728139fe0 2024-08-18T21:15:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f372d921640 1 -- 172.21.15.5:0/3843129598 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3728139fe0 msgr2=0x7f372813a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f372d921640 1 --2- 172.21.15.5:0/3843129598 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3728139fe0 0x7f372813a440 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f37200098a0 tx=0x7f372001c400 comp rx=0 tx=0).ready entity=mon.8 client_cookie=7da7dd7a38dd7e0c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f3727fff640 1 -- 172.21.15.5:0/3843129598 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f37200b0070 con 0x7f3728139fe0 2024-08-18T21:15:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f3727fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f3727fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:15:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f3727fff640 10 monclient: dump: 2024-08-18T21:15:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.208 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f3727fff640 10 monclient: _finish_auth 0 2024-08-18T21:15:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f3727fff640 10 monclient: _check_auth_tickets 2024-08-18T21:15:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f3727fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f3727fff640 1 -- 172.21.15.5:0/3843129598 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37200aa810 con 0x7f3728139fe0 2024-08-18T21:15:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f3727fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f3727fff640 1 -- 172.21.15.5:0/3843129598 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f37200aae30 con 0x7f3728139fe0 2024-08-18T21:15:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f3727fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f3727fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:15:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f3727fff640 10 monclient: dump: 2024-08-18T21:15:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.210 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.210 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.210 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.210 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f372f384640 5 monclient: authenticate success, global_id 115289 2024-08-18T21:15:43.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f372f384640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:43.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.198+0000 7f372f384640 4 set_mon_vals no callback set 2024-08-18T21:15:43.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 10 monclient: shutdown 2024-08-18T21:15:43.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:43.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 -- 172.21.15.5:0/3843129598 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3728139fe0 msgr2=0x7f372813a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 --2- 172.21.15.5:0/3843129598 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3728139fe0 0x7f372813a440 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f37200098a0 tx=0x7f372001c400 comp rx=0 tx=0).stop 2024-08-18T21:15:43.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 -- 172.21.15.5:0/3843129598 shutdown_connections 2024-08-18T21:15:43.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 --2- 172.21.15.5:0/3843129598 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f3728139fe0 0x7f372813a440 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 --2- 172.21.15.5:0/3843129598 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f37280a7600 0x7f3728139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 --2- 172.21.15.5:0/3843129598 >> v2:172.21.15.5:3300/0 conn(0x7f37280a6ce0 0x7f37280a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 -- 172.21.15.5:0/3843129598 >> 172.21.15.5:0/3843129598 conn(0x7f37280acbc0 msgr2=0x7f37280a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:43.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 -- 172.21.15.5:0/3843129598 shutdown_connections 2024-08-18T21:15:43.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 -- 172.21.15.5:0/3843129598 wait complete. 2024-08-18T21:15:43.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 10 monclient: build_initial_monmap 2024-08-18T21:15:43.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 10 monclient: monmap: 2024-08-18T21:15:43.211 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:43.211 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:43.211 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:43.212 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:43.212 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:43.212 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.212 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:43.212 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:43.212 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:43.212 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:43.212 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:43.212 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:43.212 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:43.212 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:43.212 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:43.212 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 Processor -- start 2024-08-18T21:15:43.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 -- start start 2024-08-18T21:15:43.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 10 monclient: init 2024-08-18T21:15:43.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:43.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 10 monclient: _add_conns ranks=[7,8,6,4,2,3,1,0,5] 2024-08-18T21:15:43.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f37280a6ce0 0x7f3728135000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 10 monclient(hunting): picked mon.noname-i con 0x7f37280a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:15:43.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f37280a7600 0x7f3728135540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 10 monclient(hunting): picked mon.noname-e con 0x7f37280a7600 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:43.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3728139fe0 0x7f372813aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 10 monclient(hunting): picked mon.noname-d con 0x7f3728139fe0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:15:43.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f37280a79e0 con 0x7f3728139fe0 2024-08-18T21:15:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f37280a8220 con 0x7f37280a6ce0 2024-08-18T21:15:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f3728135af0 con 0x7f37280a7600 2024-08-18T21:15:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372f384640 10 monclient(hunting): authenticate will time out at 1710.218334s 2024-08-18T21:15:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372d921640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3728139fe0 0x7f372813aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f37280a7600 0x7f3728135540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f37280a7600 0x7f3728135540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:35884/0 (socket says 172.21.15.5:35884) 2024-08-18T21:15:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 1 -- 172.21.15.5:0/1814239869 learned_addr learned my addr 172.21.15.5:0/1814239869 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372d921640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3728139fe0 0x7f372813aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:46620/0 (socket says 172.21.15.5:46620) 2024-08-18T21:15:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 10 monclient(hunting): get_auth_request con 0x7f37280a7600 auth_method 0 2024-08-18T21:15:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372d921640 10 monclient(hunting): get_auth_request con 0x7f3728139fe0 auth_method 0 2024-08-18T21:15:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372d921640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372d921640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372d921640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372d921640 1 -- 172.21.15.5:0/1814239869 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3728139fe0 msgr2=0x7f372813aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-18T21:15:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372d921640 1 -- 172.21.15.5:0/1814239869 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3728139fe0 msgr2=0x7f372813aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:15:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372d921640 1 --2- 172.21.15.5:0/1814239869 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3728139fe0 0x7f372813aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:15:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372d921640 1 --2- 172.21.15.5:0/1814239869 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3728139fe0 0x7f372813aa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:15:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372d120640 1 --2- 172.21.15.5:0/1814239869 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f37280a6ce0 0x7f3728135000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372d120640 10 monclient(hunting): get_auth_request con 0x7f37280a6ce0 auth_method 0 2024-08-18T21:15:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372d120640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372d120640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372d120640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 10 monclient(hunting): handle_auth_done global_id 115298 payload 824 2024-08-18T21:15:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 1 -- 172.21.15.5:0/1814239869 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f37280a6ce0 msgr2=0x7f3728135000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 1 --2- 172.21.15.5:0/1814239869 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f37280a6ce0 0x7f3728135000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 1 -- 172.21.15.5:0/1814239869 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3728139fe0 msgr2=0x7f372813aa40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:15:43.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 1 --2- 172.21.15.5:0/1814239869 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3728139fe0 0x7f372813aa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 10 monclient: _finish_hunting 0 2024-08-18T21:15:43.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 1 monclient: found mon.noname-e 2024-08-18T21:15:43.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:43.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:15:43.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.202+0000 7f372c91f640 1 -- 172.21.15.5:0/1814239869 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37280aa370 con 0x7f37280a7600 2024-08-18T21:15:43.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f372c91f640 1 -- 172.21.15.5:0/1814239869 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f37280a7600 msgr2=0x7f3728135540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:43.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f372c91f640 1 --2- 172.21.15.5:0/1814239869 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f37280a7600 0x7f3728135540 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f371800efc0 tx=0x7f371800c490 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:43.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3725ffb640 1 -- 172.21.15.5:0/1814239869 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3718018020 con 0x7f37280a7600 2024-08-18T21:15:43.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3725ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3725ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:15:43.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3725ffb640 10 monclient: dump: 2024-08-18T21:15:43.217 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.218 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.218 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.218 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.218 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.218 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.218 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.218 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.218 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.218 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.218 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.218 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.218 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.218 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.219 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3725ffb640 10 monclient: _finish_auth 0 2024-08-18T21:15:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3725ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:15:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3725ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3725ffb640 1 -- 172.21.15.5:0/1814239869 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37180148f0 con 0x7f37280a7600 2024-08-18T21:15:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3725ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3725ffb640 1 -- 172.21.15.5:0/1814239869 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f37180133e0 con 0x7f37280a7600 2024-08-18T21:15:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f372f384640 5 monclient: authenticate success, global_id 115298 2024-08-18T21:15:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f372f384640 10 monclient: _renew_subs 2024-08-18T21:15:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f372f384640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f372f384640 1 -- 172.21.15.5:0/1814239869 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37280ac000 con 0x7f37280a7600 2024-08-18T21:15:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3725ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3725ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:15:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3725ffb640 10 monclient: dump: 2024-08-18T21:15:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.221 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3726ffd640 4 set_mon_vals no callback set 2024-08-18T21:15:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f372f384640 10 monclient: _renew_subs 2024-08-18T21:15:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f372f384640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f372f384640 1 -- 172.21.15.5:0/1814239869 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f372813e460 con 0x7f37280a7600 2024-08-18T21:15:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f372f384640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f372f384640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f372f384640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f372f384640 1 -- 172.21.15.5:0/1814239869 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37281408e0 con 0x7f37280a7600 2024-08-18T21:15:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3725ffb640 1 -- 172.21.15.5:0/1814239869 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f371801b020 con 0x7f37280a7600 2024-08-18T21:15:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3725ffb640 1 --2- 172.21.15.5:0/1814239869 >> v2:172.21.15.157:6812/631023601 conn(0x7f371403bdc0 0x7f371403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f3725ffb640 1 -- 172.21.15.5:0/1814239869 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(329..329 src has 22..329) ==== 3898+0+0 (secure 0 0 0) 0x7f371804f010 con 0x7f37280a7600 2024-08-18T21:15:43.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f372d120640 1 --2- 172.21.15.5:0/1814239869 >> v2:172.21.15.157:6812/631023601 conn(0x7f371403bdc0 0x7f371403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.206+0000 7f372d120640 10 monclient: get_auth_request con 0x7f371403bdc0 auth_method 0 2024-08-18T21:15:43.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.210+0000 7f372d120640 1 --2- 172.21.15.5:0/1814239869 >> v2:172.21.15.157:6812/631023601 conn(0x7f371403bdc0 0x7f371403e280 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f371c009a70 tx=0x7f371c008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:43.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.210+0000 7f3725ffb640 1 -- 172.21.15.5:0/1814239869 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f3718022070 con 0x7f37280a7600 2024-08-18T21:15:43.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.210+0000 7f3725ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:43.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.210+0000 7f3725ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.454+0000 7f372f384640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-18T21:15:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.454+0000 7f372f384640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-18T21:15:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.454+0000 7f372f384640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.454+0000 7f372f384640 1 -- 172.21.15.5:0/1814239869 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3728139aa0 con 0x7f37280a7600 2024-08-18T21:15:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.454+0000 7f3725ffb640 1 -- 172.21.15.5:0/1814239869 <== mon.8 v2:172.21.15.5:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3173 (secure 0 0 0) 0x7f3718010040 con 0x7f37280a7600 2024-08-18T21:15:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.458+0000 7f3725ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-18T21:15:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.458+0000 7f3725ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:15:43.455 INFO:teuthology.orchestra.run.smithi005.stdout:{"election_epoch":254,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","modified":"2024-08-18T21:02:46.585177Z","created":"2024-08-18T21:02:46.585177Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3302","nonce":0},{"type":"v1","addr":"172.21.15.5:6791","nonce":0}]},"addr":"172.21.15.5:6791/0","public_addr":"172.21.15.5:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3302","nonce":0},{"type":"v1","addr":"172.21.15.157:6791","nonce":0}]},"addr":"172.21.15.157:6791/0","public_addr":"172.21.15.157:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3303","nonce":0},{"type":"v1","addr":"172.21.15.5:6792","nonce":0}]},"addr":"172.21.15.5:6792/0","public_addr":"172.21.15.5:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3303","nonce":0},{"type":"v1","addr":"172.21.15.157:6792","nonce":0}]},"addr":"172.21.15.157:6792/0","public_addr":"172.21.15.157:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3304","nonce":0},{"type":"v1","addr":"172.21.15.5:6793","nonce":0}]},"addr":"172.21.15.5:6793/0","public_addr":"172.21.15.5:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-18T21:15:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.458+0000 7f372f384640 1 -- 172.21.15.5:0/1814239869 >> v2:172.21.15.157:6812/631023601 conn(0x7f371403bdc0 msgr2=0x7f371403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.458+0000 7f372f384640 1 --2- 172.21.15.5:0/1814239869 >> v2:172.21.15.157:6812/631023601 conn(0x7f371403bdc0 0x7f371403e280 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f371c009a70 tx=0x7f371c008040 comp rx=0 tx=0).stop 2024-08-18T21:15:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.458+0000 7f372f384640 10 monclient: shutdown 2024-08-18T21:15:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.458+0000 7f372f384640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.458+0000 7f372f384640 1 -- 172.21.15.5:0/1814239869 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f37280a7600 msgr2=0x7f3728135540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.458+0000 7f372f384640 1 --2- 172.21.15.5:0/1814239869 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f37280a7600 0x7f3728135540 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f371800efc0 tx=0x7f371800c490 comp rx=0 tx=0).stop 2024-08-18T21:15:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.458+0000 7f372f384640 1 -- 172.21.15.5:0/1814239869 shutdown_connections 2024-08-18T21:15:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.458+0000 7f372f384640 1 --2- 172.21.15.5:0/1814239869 >> v2:172.21.15.157:6812/631023601 conn(0x7f371403bdc0 0x7f371403e280 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.458+0000 7f372f384640 1 --2- 172.21.15.5:0/1814239869 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f37280a7600 0x7f3728135540 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.458+0000 7f372f384640 1 --2- 172.21.15.5:0/1814239869 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f3728139fe0 0x7f372813aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.458+0000 7f372f384640 1 --2- 172.21.15.5:0/1814239869 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f37280a6ce0 0x7f3728135000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.458+0000 7f372f384640 1 -- 172.21.15.5:0/1814239869 >> 172.21.15.5:0/1814239869 conn(0x7f37280acbc0 msgr2=0x7f3728135d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.458+0000 7f372f384640 1 -- 172.21.15.5:0/1814239869 shutdown_connections 2024-08-18T21:15:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.458+0000 7f372f384640 1 -- 172.21.15.5:0/1814239869 wait complete. 2024-08-18T21:15:43.475 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-18T21:15:43.475 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-18T21:15:43.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-18T21:15:43.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 10 monclient: get_monmap_and_config 2024-08-18T21:15:43.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 10 monclient: build_initial_monmap 2024-08-18T21:15:43.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 10 monclient: monmap: 2024-08-18T21:15:43.592 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:43.592 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.592 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:43.597472+0000 2024-08-18T21:15:43.592 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:43.597472+0000 2024-08-18T21:15:43.592 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:43.593 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 1 Processor -- start 2024-08-18T21:15:43.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 1 -- start start 2024-08-18T21:15:43.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 10 monclient: init 2024-08-18T21:15:43.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:43.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 10 monclient: _add_conns ranks=[6,4,1,3,8,2,10,0,5,9,7] 2024-08-18T21:15:43.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa5600a6bd0 0x7fa5600a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 10 monclient(hunting): picked mon.noname-d con 0x7fa5600a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:15:43.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa56009f080 0x7fa5600a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 10 monclient(hunting): picked mon.noname-c con 0x7fa56009f080 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:15:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fa560139990 addr v1:172.21.15.157:6789/0 2024-08-18T21:15:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5600a7fb0 con 0x7fa560139990 2024-08-18T21:15:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fa56009e4c0 con 0x7fa56009f080 2024-08-18T21:15:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fa56006f930 con 0x7fa5600a6bd0 2024-08-18T21:15:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa56743c640 10 monclient(hunting): authenticate will time out at 1710.610674s 2024-08-18T21:15:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5651d8640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa5600a6bd0 0x7fa5600a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa56009f080 0x7fa5600a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5651d8640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa5600a6bd0 0x7fa5600a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:46626/0 (socket says 172.21.15.5:46626) 2024-08-18T21:15:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5651d8640 1 -- 172.21.15.5:0/475062860 learned_addr learned my addr 172.21.15.5:0/475062860 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:43.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 10 monclient(hunting): get_auth_request con 0x7fa56009f080 auth_method 0 2024-08-18T21:15:43.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5651d8640 10 monclient(hunting): get_auth_request con 0x7fa5600a6bd0 auth_method 0 2024-08-18T21:15:43.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5651d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5651d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5651d8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:43.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:43.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5651d8640 1 -- 172.21.15.5:0/475062860 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa5600a6bd0 msgr2=0x7fa5600a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T21:15:43.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5651d8640 1 -- 172.21.15.5:0/475062860 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa5600a6bd0 msgr2=0x7fa5600a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T21:15:43.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5651d8640 1 --2- 172.21.15.5:0/475062860 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa5600a6bd0 0x7fa5600a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:15:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5651d8640 1 --2- 172.21.15.5:0/475062860 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa5600a6bd0 0x7fa5600a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:15:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 10 monclient(hunting): handle_auth_done global_id 114988 payload 274 2024-08-18T21:15:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 1 -- 172.21.15.5:0/475062860 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa5600a6bd0 msgr2=0x7fa5600a6fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T21:15:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 1 --2- 172.21.15.5:0/475062860 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa5600a6bd0 0x7fa5600a6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 1 -- 172.21.15.5:0/475062860 >> v1:172.21.15.157:6789/0 conn(0x7fa560139990 legacy=0x7fa560139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 10 monclient: _finish_hunting 0 2024-08-18T21:15:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 1 monclient: found mon.noname-c 2024-08-18T21:15:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:15:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.594+0000 7fa5649d7640 1 -- 172.21.15.5:0/475062860 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56009de70 con 0x7fa56009f080 2024-08-18T21:15:43.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa5649d7640 1 -- 172.21.15.5:0/475062860 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa56009f080 msgr2=0x7fa5600a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:43.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa5649d7640 1 --2- 172.21.15.5:0/475062860 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa56009f080 0x7fa5600a74f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa5540097f0 tx=0x7fa55401c3a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=98d51d923bbeec29 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:43.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa553fff640 1 -- 172.21.15.5:0/475062860 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa5540b0070 con 0x7fa56009f080 2024-08-18T21:15:43.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa553fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa553fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:15:43.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa553fff640 10 monclient: dump: 2024-08-18T21:15:43.603 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.603 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.603 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.604 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa553fff640 10 monclient: _finish_auth 0 2024-08-18T21:15:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa553fff640 10 monclient: _check_auth_tickets 2024-08-18T21:15:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa553fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa553fff640 1 -- 172.21.15.5:0/475062860 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5540aa810 con 0x7fa56009f080 2024-08-18T21:15:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa56743c640 5 monclient: authenticate success, global_id 114988 2024-08-18T21:15:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa56743c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:15:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa553fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa56743c640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa553fff640 1 -- 172.21.15.5:0/475062860 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa5540aae30 con 0x7fa56009f080 2024-08-18T21:15:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa56743c640 4 set_mon_vals no callback set 2024-08-18T21:15:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa553fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa553fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:15:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.598+0000 7fa553fff640 10 monclient: dump: 2024-08-18T21:15:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.607 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 10 monclient: shutdown 2024-08-18T21:15:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 1 -- 172.21.15.5:0/475062860 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa56009f080 msgr2=0x7fa5600a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 1 --2- 172.21.15.5:0/475062860 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa56009f080 0x7fa5600a74f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa5540097f0 tx=0x7fa55401c3a0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 1 -- 172.21.15.5:0/475062860 shutdown_connections 2024-08-18T21:15:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 1 --2- 172.21.15.5:0/475062860 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fa56009f080 0x7fa5600a74f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 1 --2- 172.21.15.5:0/475062860 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa5600a6bd0 0x7fa5600a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 1 -- 172.21.15.5:0/475062860 >> 172.21.15.5:0/475062860 conn(0x7fa560068700 msgr2=0x7fa560068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 1 -- 172.21.15.5:0/475062860 shutdown_connections 2024-08-18T21:15:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 1 -- 172.21.15.5:0/475062860 wait complete. 2024-08-18T21:15:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 10 monclient: build_initial_monmap 2024-08-18T21:15:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 10 monclient: monmap: 2024-08-18T21:15:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:43.609 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:43.609 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:43.609 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:43.609 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 1 Processor -- start 2024-08-18T21:15:43.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 1 -- start start 2024-08-18T21:15:43.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 10 monclient: init 2024-08-18T21:15:43.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:43.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 10 monclient: _add_conns ranks=[6,8,5,3,0,2,7,4,1] 2024-08-18T21:15:43.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa56009f080 0x7fa5601384d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 10 monclient(hunting): picked mon.noname-d con 0x7fa56009f080 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:15:43.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa5600a6bd0 0x7fa560138a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 10 monclient(hunting): picked mon.noname-e con 0x7fa5600a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:43.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa560139990 0x7fa56013da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 10 monclient(hunting): picked mon.noname-h con 0x7fa560139990 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:43.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fa5601447a0 con 0x7fa560139990 2024-08-18T21:15:43.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fa560144620 con 0x7fa56009f080 2024-08-18T21:15:43.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fa560144920 con 0x7fa5600a6bd0 2024-08-18T21:15:43.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:43.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa56743c640 10 monclient(hunting): authenticate will time out at 1710.618169s 2024-08-18T21:15:43.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5651d8640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa56009f080 0x7fa5601384d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa5600a6bd0 0x7fa560138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5651d8640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa56009f080 0x7fa5601384d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:46642/0 (socket says 172.21.15.5:46642) 2024-08-18T21:15:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5651d8640 1 -- 172.21.15.5:0/4041528412 learned_addr learned my addr 172.21.15.5:0/4041528412 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5651d8640 10 monclient(hunting): get_auth_request con 0x7fa56009f080 auth_method 0 2024-08-18T21:15:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5651d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5651d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5651d8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 10 monclient(hunting): get_auth_request con 0x7fa5600a6bd0 auth_method 0 2024-08-18T21:15:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5651d8640 1 -- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa56009f080 msgr2=0x7fa5601384d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-18T21:15:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5651d8640 1 -- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa56009f080 msgr2=0x7fa5601384d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:15:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5651d8640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa56009f080 0x7fa5601384d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:15:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5651d8640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa56009f080 0x7fa5601384d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:15:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5659d9640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa560139990 0x7fa56013da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 10 monclient(hunting): handle_auth_done global_id 115307 payload 824 2024-08-18T21:15:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 1 -- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa56009f080 msgr2=0x7fa5601384d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:15:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fa56009f080 0x7fa5601384d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 1 -- 172.21.15.5:0/4041528412 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa560139990 msgr2=0x7fa56013da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa560139990 0x7fa56013da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 10 monclient: _finish_hunting 0 2024-08-18T21:15:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 1 monclient: found mon.noname-e 2024-08-18T21:15:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:15:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5649d7640 1 -- 172.21.15.5:0/4041528412 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5601402d0 con 0x7fa5600a6bd0 2024-08-18T21:15:43.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5659d9640 10 monclient: get_auth_request con 0x7fa560139990 auth_method 0 2024-08-18T21:15:43.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.602+0000 7fa5659d9640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fa560139990 0x7fa56013da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:15:43.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa5649d7640 1 -- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa5600a6bd0 msgr2=0x7fa560138a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:43.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa5649d7640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa5600a6bd0 0x7fa560138a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa5540ad000 tx=0x7fa554019140 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:43.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa551ffb640 1 -- 172.21.15.5:0/4041528412 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa5540b0040 con 0x7fa5600a6bd0 2024-08-18T21:15:43.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa551ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa551ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:15:43.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa551ffb640 10 monclient: dump: 2024-08-18T21:15:43.617 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.617 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.617 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.618 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.618 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.618 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.618 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.618 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.618 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.618 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.618 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.618 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.618 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.618 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.618 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.618 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa551ffb640 10 monclient: _finish_auth 0 2024-08-18T21:15:43.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa551ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:15:43.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa551ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:43.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa551ffb640 1 -- 172.21.15.5:0/4041528412 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5540b9070 con 0x7fa5600a6bd0 2024-08-18T21:15:43.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa551ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:43.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa551ffb640 1 -- 172.21.15.5:0/4041528412 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa5540044b0 con 0x7fa5600a6bd0 2024-08-18T21:15:43.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa551ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa551ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:15:43.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa551ffb640 10 monclient: dump: 2024-08-18T21:15:43.619 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.619 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.619 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.619 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.620 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.620 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.620 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.620 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.620 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.620 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.620 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.620 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.620 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.620 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.620 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.620 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa5537fe640 4 set_mon_vals no callback set 2024-08-18T21:15:43.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa56743c640 5 monclient: authenticate success, global_id 115307 2024-08-18T21:15:43.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa56743c640 10 monclient: _renew_subs 2024-08-18T21:15:43.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa56743c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:43.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa56743c640 1 -- 172.21.15.5:0/4041528412 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa560123030 con 0x7fa5600a6bd0 2024-08-18T21:15:43.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa56743c640 10 monclient: _renew_subs 2024-08-18T21:15:43.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa56743c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:43.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa56743c640 1 -- 172.21.15.5:0/4041528412 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fa560123310 con 0x7fa5600a6bd0 2024-08-18T21:15:43.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa56743c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:43.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa56743c640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa56013df70 0x7fa56013e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa56743c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa56743c640 1 -- 172.21.15.5:0/4041528412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa560051140 con 0x7fa56013df70 2024-08-18T21:15:43.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa5651d8640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa56013df70 0x7fa56013e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa5651d8640 10 monclient: get_auth_request con 0x7fa56013df70 auth_method 0 2024-08-18T21:15:43.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa5651d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa5651d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa5651d8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa551ffb640 1 -- 172.21.15.5:0/4041528412 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fa5540b3070 con 0x7fa5600a6bd0 2024-08-18T21:15:43.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa5651d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:43.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa5651d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:43.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa5651d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:43.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa551ffb640 1 --2- 172.21.15.5:0/4041528412 >> v2:172.21.15.157:6812/631023601 conn(0x7fa54403bdc0 0x7fa54403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa5651d8640 10 monclient(hunting): handle_auth_done global_id 124794 payload 824 2024-08-18T21:15:43.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa5651d8640 1 -- 172.21.15.5:0/4041528412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa560140e80 con 0x7fa56013df70 2024-08-18T21:15:43.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa551ffb640 1 -- 172.21.15.5:0/4041528412 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(329..329 src has 22..329) ==== 3898+0+0 (secure 0 0 0) 0x7fa5540e7b30 con 0x7fa5600a6bd0 2024-08-18T21:15:43.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa5659d9640 1 --2- 172.21.15.5:0/4041528412 >> v2:172.21.15.157:6812/631023601 conn(0x7fa54403bdc0 0x7fa54403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.606+0000 7fa5659d9640 10 monclient: get_auth_request con 0x7fa54403bdc0 auth_method 0 2024-08-18T21:15:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.610+0000 7fa5651d8640 1 -- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa56013df70 msgr2=0x7fa56013e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.610+0000 7fa5651d8640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa56013df70 0x7fa56013e350 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009fd0 tx=0x7fa55c010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.610+0000 7fa551ffb640 1 -- 172.21.15.5:0/4041528412 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa55c01a030 con 0x7fa56013df70 2024-08-18T21:15:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.610+0000 7fa551ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.610+0000 7fa551ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:15:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.610+0000 7fa551ffb640 10 monclient: dump: 2024-08-18T21:15:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.624 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.624 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.624 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.624 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.624 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.624 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.624 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.624 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.610+0000 7fa551ffb640 1 -- 172.21.15.5:0/4041528412 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa55c00ebe0 con 0x7fa56013df70 2024-08-18T21:15:43.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.610+0000 7fa551ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:43.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.610+0000 7fa551ffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:43.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.610+0000 7fa551ffb640 1 -- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa56013df70 msgr2=0x7fa56013e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.610+0000 7fa551ffb640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa56013df70 0x7fa56013e350 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009fd0 tx=0x7fa55c010c20 comp rx=0 tx=0).stop 2024-08-18T21:15:43.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.610+0000 7fa551ffb640 1 -- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa56013df70 msgr2=0x7fa56013e350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:43.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.610+0000 7fa551ffb640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa56013df70 0x7fa56013e350 secure :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009fd0 tx=0x7fa55c010c20 comp rx=0 tx=0).stop 2024-08-18T21:15:43.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.610+0000 7fa5659d9640 1 --2- 172.21.15.5:0/4041528412 >> v2:172.21.15.157:6812/631023601 conn(0x7fa54403bdc0 0x7fa54403e280 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa558007e10 tx=0x7fa558007320 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:43.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.614+0000 7fa56743c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:15:43.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.614+0000 7fa56743c640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa56013e890 0x7fa5600a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.614+0000 7fa56743c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.614+0000 7fa56743c640 1 -- 172.21.15.5:0/4041528412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa56013f610 con 0x7fa56013e890 2024-08-18T21:15:43.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa5651d8640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa56013e890 0x7fa5600a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa5651d8640 10 monclient: get_auth_request con 0x7fa56013e890 auth_method 0 2024-08-18T21:15:43.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa5651d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa5651d8640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa5651d8640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa5651d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:43.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa5651d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:43.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa5651d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:43.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa5651d8640 10 monclient(hunting): handle_auth_done global_id 124803 payload 824 2024-08-18T21:15:43.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa5651d8640 1 -- 172.21.15.5:0/4041528412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa5600ab200 con 0x7fa56013e890 2024-08-18T21:15:43.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa5651d8640 1 -- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa56013e890 msgr2=0x7fa5600a4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:43.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa5651d8640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa56013e890 0x7fa5600a4140 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa55c01a000 tx=0x7fa55c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:43.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa551ffb640 1 -- 172.21.15.5:0/4041528412 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa55c00f040 con 0x7fa56013e890 2024-08-18T21:15:43.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa551ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa551ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:15:43.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa551ffb640 10 monclient: dump: 2024-08-18T21:15:43.627 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.627 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.627 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.627 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.627 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.628 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.628 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.628 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.628 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.628 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.628 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.628 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.628 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.628 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.628 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.628 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa551ffb640 1 -- 172.21.15.5:0/4041528412 <== mon.0 v2:172.21.15.5:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9417 (secure 0 0 0) 0x7fa55c000e50 con 0x7fa56013e890 2024-08-18T21:15:43.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa551ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:15:43.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa551ffb640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:15:43.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa551ffb640 1 -- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa56013e890 msgr2=0x7fa5600a4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa551ffb640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa56013e890 0x7fa5600a4140 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa55c01a000 tx=0x7fa55c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa551ffb640 1 -- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa56013e890 msgr2=0x7fa5600a4140 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:43.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa551ffb640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa56013e890 0x7fa5600a4140 secure :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa55c01a000 tx=0x7fa55c0046d0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.629 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:43.629 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:15:43.629 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:15:43.629 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "leader", 2024-08-18T21:15:43.629 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 254, 2024-08-18T21:15:43.629 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 190598, 2024-08-18T21:15:43.630 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:15:43.630 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:15:43.630 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:15:43.630 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:15:43.630 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:15:43.630 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:15:43.630 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:15:43.630 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:15:43.630 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:15:43.630 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:15:43.630 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:43.630 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:15:43.630 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:43.631 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:15:43.631 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:15:43.631 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:43.631 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:43.631 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:43.631 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:43.631 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:43.631 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:43.631 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:43.631 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:43.631 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:43.631 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:43.631 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:43.631 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:43.632 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:15:43.632 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:15:43.632 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:43.632 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:43.632 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:43.632 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:43.632 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:43.632 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:43.632 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:43.632 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:43.633 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:43.633 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:43.633 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:43.633 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.633 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:15:43.633 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:15:43.633 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:15:43.633 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:15:43.633 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:15:43.633 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:15:43.633 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:43.633 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:43.633 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:15:43.634 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:15:43.634 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:15:43.634 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:15:43.634 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:15:43.634 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:15:43.634 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:15:43.634 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:43.634 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:15:43.634 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:43.634 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:43.634 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:43.634 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:43.634 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:43.635 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:43.635 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:43.635 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:43.635 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:43.635 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:43.635 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:43.635 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:43.635 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:15:43.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.635 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:15:43.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.635 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:15:43.635 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:15:43.635 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.636 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.636 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.636 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:15:43.636 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.636 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.636 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:15:43.636 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.636 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.636 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.637 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:15:43.637 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:15:43.637 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.637 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.637 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.637 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:15:43.637 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:15:43.637 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.637 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.637 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.637 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:15:43.638 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.638 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.638 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:15:43.638 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.638 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.638 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.638 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:15:43.638 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:15:43.638 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.638 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.639 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.639 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:15:43.639 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:15:43.639 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.639 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.639 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.639 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:15:43.639 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.639 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.640 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:15:43.640 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.640 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.640 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.640 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:15:43.640 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:15:43.640 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.640 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.640 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.640 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:15:43.640 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:15:43.641 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.641 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.641 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.641 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:15:43.641 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.641 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.641 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:15:43.641 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.641 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.642 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.642 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:15:43.642 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:15:43.642 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.642 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.642 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.642 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:15:43.642 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:15:43.642 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.642 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.643 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.643 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:15:43.643 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.643 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.643 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.643 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:15:43.643 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.643 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.643 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.643 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:15:43.643 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:15:43.644 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.644 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.644 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.644 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:15:43.644 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:15:43.644 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.644 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.644 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.644 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:15:43.644 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.645 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.645 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:15:43.645 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.645 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.645 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.645 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:15:43.645 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:15:43.645 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.645 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.645 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.645 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.646 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:15:43.646 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:15:43.646 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.646 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.646 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.646 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:15:43.646 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.646 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.646 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:15:43.646 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.647 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.647 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.647 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:15:43.647 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:15:43.647 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.647 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.647 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.647 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.647 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:15:43.647 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:15:43.647 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.647 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.648 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.648 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:15:43.648 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.648 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.648 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:15:43.648 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.648 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.648 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.648 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:15:43.648 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:15:43.649 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.649 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.649 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.649 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:15:43.649 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:15:43.649 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.649 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.649 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.649 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:15:43.649 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.650 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.650 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.650 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:15:43.650 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.650 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.650 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.650 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:15:43.650 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:15:43.650 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.650 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.650 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.651 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.651 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.651 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:15:43.651 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:15:43.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.651 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:43.651 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:43.651 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:43.651 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.651 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:43.651 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:15:43.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.651 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:43.652 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:43.652 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:15:43.652 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.652 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:43.652 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:15:43.652 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.652 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:43.652 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:43.652 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:43.652 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.652 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.652 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:15:43.652 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa56743c640 1 -- 172.21.15.5:0/4041528412 >> v2:172.21.15.157:6812/631023601 conn(0x7fa54403bdc0 msgr2=0x7fa54403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa56743c640 1 --2- 172.21.15.5:0/4041528412 >> v2:172.21.15.157:6812/631023601 conn(0x7fa54403bdc0 0x7fa54403e280 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa558007e10 tx=0x7fa558007320 comp rx=0 tx=0).stop 2024-08-18T21:15:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa56743c640 10 monclient: shutdown 2024-08-18T21:15:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa56743c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa56743c640 1 -- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa5600a6bd0 msgr2=0x7fa560138a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa56743c640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa5600a6bd0 0x7fa560138a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa5540ad000 tx=0x7fa554019140 comp rx=0 tx=0).stop 2024-08-18T21:15:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa5659d9640 1 -- 172.21.15.5:0/4041528412 reap_dead start 2024-08-18T21:15:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa56743c640 1 -- 172.21.15.5:0/4041528412 shutdown_connections 2024-08-18T21:15:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa56743c640 1 --2- 172.21.15.5:0/4041528412 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa5600a6bd0 0x7fa560138a10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa56743c640 1 -- 172.21.15.5:0/4041528412 >> 172.21.15.5:0/4041528412 conn(0x7fa560068700 msgr2=0x7fa5600a9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa56743c640 1 -- 172.21.15.5:0/4041528412 shutdown_connections 2024-08-18T21:15:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.618+0000 7fa56743c640 1 -- 172.21.15.5:0/4041528412 wait complete. 2024-08-18T21:15:43.655 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:15:43.655 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-18T21:15:43.655 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-18T21:15:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.778+0000 7fb078618640 10 monclient: get_monmap_and_config 2024-08-18T21:15:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.778+0000 7fb078618640 10 monclient: build_initial_monmap 2024-08-18T21:15:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.778+0000 7fb078618640 10 monclient: monmap: 2024-08-18T21:15:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:43.784251+0000 2024-08-18T21:15:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:43.784251+0000 2024-08-18T21:15:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:43.780 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 1 Processor -- start 2024-08-18T21:15:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 1 -- start start 2024-08-18T21:15:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 10 monclient: init 2024-08-18T21:15:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 10 monclient: _add_conns ranks=[9,5,3,1,7,2,4,8,10,6,0] 2024-08-18T21:15:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb0700a6ce0 0x7fb0700a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 10 monclient(hunting): picked mon.noname-a con 0x7fb0700a6ce0 addr v2:172.21.15.5:3300/0 2024-08-18T21:15:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb0700a7600 0x7fb070139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 10 monclient(hunting): picked mon.noname-h con 0x7fb0700a7600 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb070139fe0 0x7fb07013a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 10 monclient(hunting): picked mon.noname-g con 0x7fb070139fe0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb0700a5000 con 0x7fb0700a6ce0 2024-08-18T21:15:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb0700a4360 con 0x7fb070139fe0 2024-08-18T21:15:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fb0700a45d0 con 0x7fb0700a7600 2024-08-18T21:15:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb078618640 10 monclient(hunting): authenticate will time out at 1710.797382s 2024-08-18T21:15:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb0700a6ce0 0x7fb0700a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb0700a6ce0 0x7fb0700a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53462/0 (socket says 172.21.15.5:53462) 2024-08-18T21:15:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 1 -- 172.21.15.5:0/3735214606 learned_addr learned my addr 172.21.15.5:0/3735214606 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 10 monclient(hunting): get_auth_request con 0x7fb0700a6ce0 auth_method 0 2024-08-18T21:15:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb075bb3640 1 --2- 172.21.15.5:0/3735214606 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb0700a7600 0x7fb070139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb076bb5640 1 --2- 172.21.15.5:0/3735214606 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb070139fe0 0x7fb07013a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb075bb3640 10 monclient(hunting): get_auth_request con 0x7fb0700a7600 auth_method 0 2024-08-18T21:15:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb075bb3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb075bb3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb075bb3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 10 monclient(hunting): handle_auth_done global_id 124812 payload 274 2024-08-18T21:15:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 1 -- 172.21.15.5:0/3735214606 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb0700a7600 msgr2=0x7fb070139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 1 --2- 172.21.15.5:0/3735214606 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb0700a7600 0x7fb070139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 1 -- 172.21.15.5:0/3735214606 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb070139fe0 msgr2=0x7fb07013a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 1 --2- 172.21.15.5:0/3735214606 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb070139fe0 0x7fb07013a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 10 monclient: _finish_hunting 0 2024-08-18T21:15:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 1 monclient: found mon.noname-a 2024-08-18T21:15:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:15:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb0763b4640 1 -- 172.21.15.5:0/3735214606 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0700a32d0 con 0x7fb0700a6ce0 2024-08-18T21:15:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb076bb5640 10 monclient: get_auth_request con 0x7fb070139fe0 auth_method 0 2024-08-18T21:15:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.782+0000 7fb076bb5640 1 --2- 172.21.15.5:0/3735214606 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb070139fe0 0x7fb07013a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:15:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb0763b4640 1 -- 172.21.15.5:0/3735214606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0700a6ce0 msgr2=0x7fb0700a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb0763b4640 1 --2- 172.21.15.5:0/3735214606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0700a6ce0 0x7fb0700a70c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009870 tx=0x7fb06c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93dd3744f16da71 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb0753b2640 1 -- 172.21.15.5:0/3735214606 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb06c0b0070 con 0x7fb0700a6ce0 2024-08-18T21:15:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb0753b2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb0753b2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:15:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb0753b2640 10 monclient: dump: 2024-08-18T21:15:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.790 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb0753b2640 10 monclient: _finish_auth 0 2024-08-18T21:15:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb0753b2640 10 monclient: _check_auth_tickets 2024-08-18T21:15:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb0753b2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb0753b2640 1 -- 172.21.15.5:0/3735214606 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb06c0aa810 con 0x7fb0700a6ce0 2024-08-18T21:15:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb0753b2640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb0753b2640 1 -- 172.21.15.5:0/3735214606 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb06c0aae30 con 0x7fb0700a6ce0 2024-08-18T21:15:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb078618640 5 monclient: authenticate success, global_id 124812 2024-08-18T21:15:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb078618640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb078618640 4 set_mon_vals no callback set 2024-08-18T21:15:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb0753b2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb0753b2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:15:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb0753b2640 10 monclient: dump: 2024-08-18T21:15:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.792 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb078618640 10 monclient: shutdown 2024-08-18T21:15:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb078618640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb078618640 1 -- 172.21.15.5:0/3735214606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0700a6ce0 msgr2=0x7fb0700a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb078618640 1 --2- 172.21.15.5:0/3735214606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0700a6ce0 0x7fb0700a70c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009870 tx=0x7fb06c01c420 comp rx=0 tx=0).stop 2024-08-18T21:15:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb078618640 1 -- 172.21.15.5:0/3735214606 shutdown_connections 2024-08-18T21:15:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb078618640 1 --2- 172.21.15.5:0/3735214606 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb070139fe0 0x7fb07013a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb078618640 1 --2- 172.21.15.5:0/3735214606 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb0700a7600 0x7fb070139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb078618640 1 --2- 172.21.15.5:0/3735214606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0700a6ce0 0x7fb0700a70c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb078618640 1 -- 172.21.15.5:0/3735214606 >> 172.21.15.5:0/3735214606 conn(0x7fb0700acbc0 msgr2=0x7fb0700a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb078618640 1 -- 172.21.15.5:0/3735214606 shutdown_connections 2024-08-18T21:15:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.786+0000 7fb078618640 1 -- 172.21.15.5:0/3735214606 wait complete. 2024-08-18T21:15:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 10 monclient: build_initial_monmap 2024-08-18T21:15:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 10 monclient: monmap: 2024-08-18T21:15:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:43.795 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 1 Processor -- start 2024-08-18T21:15:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 1 -- start start 2024-08-18T21:15:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 10 monclient: init 2024-08-18T21:15:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 10 monclient: _add_conns ranks=[6,5,1,2,3,4,8,7,0] 2024-08-18T21:15:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb0700a6ce0 0x7fb070136590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 10 monclient(hunting): picked mon.noname-d con 0x7fb0700a6ce0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:15:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb0700a7600 0x7fb070136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 10 monclient(hunting): picked mon.noname-h con 0x7fb0700a7600 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb070139fe0 0x7fb07013c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 10 monclient(hunting): picked mon.noname-f con 0x7fb070139fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:15:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb0700a79e0 con 0x7fb070139fe0 2024-08-18T21:15:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fb0700a8220 con 0x7fb0700a7600 2024-08-18T21:15:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fb07013ede0 con 0x7fb0700a6ce0 2024-08-18T21:15:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb078618640 10 monclient(hunting): authenticate will time out at 1710.805213s 2024-08-18T21:15:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb0700a6ce0 0x7fb070136590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb0700a6ce0 0x7fb070136590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:46658/0 (socket says 172.21.15.5:46658) 2024-08-18T21:15:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 1 -- 172.21.15.5:0/3269684616 learned_addr learned my addr 172.21.15.5:0/3269684616 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 10 monclient(hunting): get_auth_request con 0x7fb0700a6ce0 auth_method 0 2024-08-18T21:15:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb076bb5640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb070139fe0 0x7fb07013c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb075bb3640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb0700a7600 0x7fb070136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 10 monclient(hunting): handle_auth_done global_id 174111 payload 824 2024-08-18T21:15:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 1 -- 172.21.15.5:0/3269684616 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb0700a7600 msgr2=0x7fb070136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb0700a7600 0x7fb070136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 1 -- 172.21.15.5:0/3269684616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb070139fe0 msgr2=0x7fb07013c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb070139fe0 0x7fb07013c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 10 monclient: _finish_hunting 0 2024-08-18T21:15:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 1 monclient: found mon.noname-d 2024-08-18T21:15:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:15:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 1 -- 172.21.15.5:0/3269684616 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0700aa720 con 0x7fb0700a6ce0 2024-08-18T21:15:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb076bb5640 10 monclient: get_auth_request con 0x7fb070139fe0 auth_method 0 2024-08-18T21:15:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb075bb3640 10 monclient: get_auth_request con 0x7fb0700a7600 auth_method 0 2024-08-18T21:15:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb076bb5640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb070139fe0 0x7fb07013c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:15:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb075bb3640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fb0700a7600 0x7fb070136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:15:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 1 -- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb0700a6ce0 msgr2=0x7fb070136590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.790+0000 7fb0763b4640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb0700a6ce0 0x7fb070136590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb06c0097c0 tx=0x7fb06c0191c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb066ffd640 1 -- 172.21.15.5:0/3269684616 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb06c0b0070 con 0x7fb0700a6ce0 2024-08-18T21:15:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb066ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb066ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:15:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb066ffd640 10 monclient: dump: 2024-08-18T21:15:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.803 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb066ffd640 10 monclient: _finish_auth 0 2024-08-18T21:15:43.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb066ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:15:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb066ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb078618640 5 monclient: authenticate success, global_id 174111 2024-08-18T21:15:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb066ffd640 1 -- 172.21.15.5:0/3269684616 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb06c0b1040 con 0x7fb0700a6ce0 2024-08-18T21:15:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb066ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb066ffd640 1 -- 172.21.15.5:0/3269684616 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb06c004450 con 0x7fb0700a6ce0 2024-08-18T21:15:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb078618640 10 monclient: _renew_subs 2024-08-18T21:15:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb078618640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:15:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb078618640 1 -- 172.21.15.5:0/3269684616 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb070140300 con 0x7fb0700a6ce0 2024-08-18T21:15:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb074bb1640 4 set_mon_vals no callback set 2024-08-18T21:15:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb066ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb066ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:15:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb066ffd640 10 monclient: dump: 2024-08-18T21:15:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.805 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb078618640 10 monclient: _renew_subs 2024-08-18T21:15:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb078618640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:15:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb078618640 1 -- 172.21.15.5:0/3269684616 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0700a1b50 con 0x7fb0700a6ce0 2024-08-18T21:15:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb078618640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb078618640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb07013fe60 0x7fb07013d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb078618640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb078618640 1 -- 172.21.15.5:0/3269684616 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fb070051140 con 0x7fb07013fe60 2024-08-18T21:15:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb066ffd640 1 -- 172.21.15.5:0/3269684616 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fb06c0bc060 con 0x7fb0700a6ce0 2024-08-18T21:15:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb075bb3640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb07013fe60 0x7fb07013d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb075bb3640 10 monclient: get_auth_request con 0x7fb07013fe60 auth_method 0 2024-08-18T21:15:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb075bb3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb075bb3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb075bb3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb075bb3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb075bb3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb075bb3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb066ffd640 1 --2- 172.21.15.5:0/3269684616 >> v2:172.21.15.157:6812/631023601 conn(0x7fb05403bdc0 0x7fb05403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb066ffd640 1 -- 172.21.15.5:0/3269684616 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(329..329 src has 22..329) ==== 3898+0+0 (secure 0 0 0) 0x7fb06c0e7c20 con 0x7fb0700a6ce0 2024-08-18T21:15:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb075bb3640 10 monclient(hunting): handle_auth_done global_id 115103 payload 824 2024-08-18T21:15:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb075bb3640 1 -- 172.21.15.5:0/3269684616 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb0700a70c0 con 0x7fb07013fe60 2024-08-18T21:15:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb076bb5640 1 --2- 172.21.15.5:0/3269684616 >> v2:172.21.15.157:6812/631023601 conn(0x7fb05403bdc0 0x7fb05403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb076bb5640 1 -- 172.21.15.5:0/3269684616 >> v2:172.21.15.157:6812/631023601 conn(0x7fb05403bdc0 msgr2=0x7fb05403e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-18T21:15:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb076bb5640 1 -- 172.21.15.5:0/3269684616 >> v2:172.21.15.157:6812/631023601 conn(0x7fb05403bdc0 msgr2=0x7fb05403e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:15:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb076bb5640 1 --2- 172.21.15.5:0/3269684616 >> v2:172.21.15.157:6812/631023601 conn(0x7fb05403bdc0 0x7fb05403e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:15:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb076bb5640 1 --2- 172.21.15.5:0/3269684616 >> v2:172.21.15.157:6812/631023601 conn(0x7fb05403bdc0 0x7fb05403e280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:15:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb075bb3640 1 -- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb07013fe60 msgr2=0x7fb07013d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:43.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.794+0000 7fb075bb3640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb07013fe60 0x7fb07013d4c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb06000e710 tx=0x7fb06000ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.798+0000 7fb066ffd640 1 -- 172.21.15.5:0/3269684616 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb060017070 con 0x7fb07013fe60 2024-08-18T21:15:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.798+0000 7fb066ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.798+0000 7fb066ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.798+0000 7fb066ffd640 10 monclient: dump: 2024-08-18T21:15:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.808 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.809 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.798+0000 7fb066ffd640 1 -- 172.21.15.5:0/3269684616 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb06000c740 con 0x7fb07013fe60 2024-08-18T21:15:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.798+0000 7fb066ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.798+0000 7fb066ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.798+0000 7fb066ffd640 1 -- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb07013fe60 msgr2=0x7fb07013d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.798+0000 7fb066ffd640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb07013fe60 0x7fb07013d4c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb06000e710 tx=0x7fb06000ebd0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.798+0000 7fb066ffd640 1 -- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb07013fe60 msgr2=0x7fb07013d4c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.798+0000 7fb066ffd640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb07013fe60 0x7fb07013d4c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.802+0000 7fb078618640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:15:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.802+0000 7fb078618640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb07002d1d0 0x7fb07002d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.802+0000 7fb078618640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.802+0000 7fb078618640 1 -- 172.21.15.5:0/3269684616 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fb070069fa0 con 0x7fb07002d1d0 2024-08-18T21:15:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.802+0000 7fb075bb3640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb07002d1d0 0x7fb07002d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.802+0000 7fb075bb3640 10 monclient: get_auth_request con 0x7fb07002d1d0 auth_method 0 2024-08-18T21:15:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.802+0000 7fb075bb3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.802+0000 7fb075bb3640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.802+0000 7fb075bb3640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.802+0000 7fb075bb3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.802+0000 7fb075bb3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.802+0000 7fb075bb3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.802+0000 7fb075bb3640 10 monclient(hunting): handle_auth_done global_id 115112 payload 824 2024-08-18T21:15:43.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.802+0000 7fb075bb3640 1 -- 172.21.15.5:0/3269684616 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb0700a7b60 con 0x7fb07002d1d0 2024-08-18T21:15:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb075bb3640 1 -- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb07002d1d0 msgr2=0x7fb07002d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb075bb3640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb07002d1d0 0x7fb07002d5e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb06000e710 tx=0x7fb0600046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb066ffd640 1 -- 172.21.15.5:0/3269684616 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb06000f040 con 0x7fb07002d1d0 2024-08-18T21:15:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb066ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb066ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb066ffd640 10 monclient: dump: 2024-08-18T21:15:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.813 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb066ffd640 1 -- 172.21.15.5:0/3269684616 <== mon.2 v2:172.21.15.5:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7fb060003be0 con 0x7fb07002d1d0 2024-08-18T21:15:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb066ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:15:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb066ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:15:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb066ffd640 1 -- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb07002d1d0 msgr2=0x7fb07002d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb066ffd640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb07002d1d0 0x7fb07002d5e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb06000e710 tx=0x7fb0600046d0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb066ffd640 1 -- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb07002d1d0 msgr2=0x7fb07002d5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb066ffd640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb07002d1d0 0x7fb07002d5e0 secure :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb06000e710 tx=0x7fb0600046d0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.814 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:43.814 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:15:43.814 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:15:43.814 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:15:43.814 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 254, 2024-08-18T21:15:43.814 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 248961, 2024-08-18T21:15:43.814 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:15:43.814 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:15:43.814 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:15:43.814 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:15:43.814 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:15:43.815 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:15:43.815 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:15:43.815 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:15:43.815 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:15:43.815 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:15:43.815 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:43.815 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:15:43.815 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:43.815 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:15:43.815 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:15:43.815 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:43.815 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:43.815 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:43.816 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:43.816 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:43.816 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:43.816 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:43.816 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:43.816 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:43.816 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:43.816 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:43.816 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:43.816 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:15:43.816 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:15:43.816 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:43.816 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:43.816 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:43.817 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:43.817 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:43.817 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:43.817 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:43.817 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:43.817 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:43.817 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:43.817 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:43.817 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.817 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:15:43.817 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:15:43.817 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:15:43.818 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:15:43.818 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:15:43.818 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:15:43.818 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:43.818 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:43.818 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:15:43.818 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:15:43.818 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:15:43.818 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:15:43.818 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:15:43.818 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:15:43.818 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:15:43.818 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:43.819 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:15:43.819 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:43.819 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:43.819 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:43.819 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:43.819 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:43.819 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:43.819 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:43.819 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:43.819 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:43.819 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:43.819 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:43.819 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:43.819 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:15:43.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.820 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:15:43.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.820 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:15:43.820 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:15:43.820 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.820 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.820 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.820 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:15:43.820 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.820 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:15:43.821 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.821 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.821 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.821 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:15:43.821 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:15:43.821 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.821 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.821 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.821 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:15:43.821 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:15:43.822 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.822 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.822 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.822 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:15:43.822 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.822 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.822 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:15:43.822 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.822 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.822 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.823 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:15:43.823 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:15:43.823 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.823 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.823 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.823 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:15:43.823 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:15:43.823 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.823 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.823 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.824 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:15:43.824 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.824 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.824 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:15:43.824 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.824 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.824 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.824 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:15:43.824 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:15:43.824 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.824 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.825 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.825 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:15:43.825 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:15:43.825 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.825 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.825 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.825 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:15:43.825 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.825 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.826 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:15:43.826 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.826 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.826 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.826 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:15:43.826 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:15:43.826 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.826 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.826 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.826 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:15:43.827 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:15:43.827 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.827 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.827 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.827 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:15:43.827 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.827 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.827 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:15:43.827 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.827 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.828 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.828 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:15:43.828 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:15:43.828 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.828 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.828 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.828 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:15:43.828 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:15:43.828 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.828 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.829 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.829 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:15:43.829 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.829 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.829 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:15:43.829 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.829 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.829 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.829 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:15:43.829 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:15:43.829 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.830 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.830 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.830 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.830 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:15:43.830 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:15:43.830 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.830 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.830 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.830 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.830 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:15:43.830 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.831 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.831 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:15:43.831 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.831 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.831 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.831 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:15:43.831 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:15:43.831 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.831 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.831 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.832 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:15:43.832 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:15:43.832 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.832 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.832 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.832 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.832 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:15:43.832 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.833 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.833 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:15:43.833 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.833 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.833 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.833 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:15:43.833 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:15:43.833 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.833 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.833 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.834 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:15:43.834 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:15:43.834 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:43.834 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:43.834 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.834 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:43.834 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:15:43.834 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.834 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.834 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:43.834 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:15:43.835 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:43.835 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.835 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.835 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:15:43.835 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:15:43.835 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:43.835 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:43.835 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:43.835 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.835 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.835 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:15:43.835 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:15:43.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.836 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:43.836 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:43.836 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:43.836 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.836 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:43.836 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:15:43.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.836 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:43.836 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:43.836 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:43.836 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.836 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:43.836 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:15:43.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:43.837 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:43.837 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:43.837 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:15:43.837 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:43.837 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:43.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:43.837 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:15:43.837 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb078618640 1 -- 172.21.15.5:0/3269684616 >> v2:172.21.15.157:6812/631023601 conn(0x7fb05403bdc0 msgr2=0x7fb05403e280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:15:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb078618640 1 --2- 172.21.15.5:0/3269684616 >> v2:172.21.15.157:6812/631023601 conn(0x7fb05403bdc0 0x7fb05403e280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb078618640 10 monclient: shutdown 2024-08-18T21:15:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb078618640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb078618640 1 -- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb0700a6ce0 msgr2=0x7fb070136590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb078618640 1 --2- 172.21.15.5:0/3269684616 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fb0700a6ce0 0x7fb070136590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb06c0097c0 tx=0x7fb06c0191c0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb076bb5640 1 -- 172.21.15.5:0/3269684616 reap_dead start 2024-08-18T21:15:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb076bb5640 1 -- 172.21.15.5:0/3269684616 reap_dead start 2024-08-18T21:15:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb078618640 1 -- 172.21.15.5:0/3269684616 shutdown_connections 2024-08-18T21:15:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb078618640 1 -- 172.21.15.5:0/3269684616 >> 172.21.15.5:0/3269684616 conn(0x7fb0700acbc0 msgr2=0x7fb0700abb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb078618640 1 -- 172.21.15.5:0/3269684616 shutdown_connections 2024-08-18T21:15:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.806+0000 7fb078618640 1 -- 172.21.15.5:0/3269684616 wait complete. 2024-08-18T21:15:43.840 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:15:43.840 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-18T21:15:43.840 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-18T21:15:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 10 monclient: get_monmap_and_config 2024-08-18T21:15:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 10 monclient: build_initial_monmap 2024-08-18T21:15:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 10 monclient: monmap: 2024-08-18T21:15:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:43.978118+0000 2024-08-18T21:15:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:43.978118+0000 2024-08-18T21:15:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:43.974 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 1 Processor -- start 2024-08-18T21:15:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 1 -- start start 2024-08-18T21:15:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 10 monclient: init 2024-08-18T21:15:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 10 monclient: _add_conns ranks=[3,9,4,0,8,7,6,1,5,2,10] 2024-08-18T21:15:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31e00a4000 0x7f31e00a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 10 monclient(hunting): picked mon.noname-g con 0x7f31e00a4000 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f31e00a4920 0x7f31e009b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 10 monclient(hunting): picked mon.noname-a con 0x7f31e00a4920 addr v2:172.21.15.5:3300/0 2024-08-18T21:15:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e009b5c0 0x7f31e009b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 10 monclient(hunting): picked mon.noname-c con 0x7f31e009b5c0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:15:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f31e00a1f90 con 0x7f31e00a4920 2024-08-18T21:15:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f31e0068c10 con 0x7f31e00a4000 2024-08-18T21:15:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f31e009faf0 con 0x7f31e009b5c0 2024-08-18T21:15:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31e566a640 10 monclient(hunting): authenticate will time out at 1710.991387s 2024-08-18T21:15:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e009b5c0 0x7f31e009b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e009b5c0 0x7f31e009b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:48860/0 (socket says 172.21.15.5:48860) 2024-08-18T21:15:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 1 -- 172.21.15.5:0/857303318 learned_addr learned my addr 172.21.15.5:0/857303318 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 10 monclient(hunting): get_auth_request con 0x7f31e009b5c0 auth_method 0 2024-08-18T21:15:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31de7fc640 1 --2- 172.21.15.5:0/857303318 >> v2:172.21.15.5:3300/0 conn(0x7f31e00a4920 0x7f31e009b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31deffd640 1 --2- 172.21.15.5:0/857303318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31e00a4000 0x7f31e00a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31de7fc640 10 monclient(hunting): get_auth_request con 0x7f31e00a4920 auth_method 0 2024-08-18T21:15:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31de7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31de7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31de7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31deffd640 10 monclient(hunting): get_auth_request con 0x7f31e00a4000 auth_method 0 2024-08-18T21:15:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31deffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31deffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31deffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 10 monclient(hunting): handle_auth_done global_id 114997 payload 274 2024-08-18T21:15:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 1 -- 172.21.15.5:0/857303318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31e00a4000 msgr2=0x7f31e00a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 1 --2- 172.21.15.5:0/857303318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31e00a4000 0x7f31e00a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 1 -- 172.21.15.5:0/857303318 >> v2:172.21.15.5:3300/0 conn(0x7f31e00a4920 msgr2=0x7f31e009b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 1 --2- 172.21.15.5:0/857303318 >> v2:172.21.15.5:3300/0 conn(0x7f31e00a4920 0x7f31e009b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:15:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 1 monclient: found mon.noname-c 2024-08-18T21:15:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:15:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.974+0000 7f31df7fe640 1 -- 172.21.15.5:0/857303318 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e00a5f60 con 0x7f31e009b5c0 2024-08-18T21:15:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.978+0000 7f31de7fc640 1 --2- 172.21.15.5:0/857303318 >> v2:172.21.15.5:3300/0 conn(0x7f31e00a4920 0x7f31e009b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:15:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31df7fe640 1 -- 172.21.15.5:0/857303318 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e009b5c0 msgr2=0x7f31e009b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31df7fe640 1 --2- 172.21.15.5:0/857303318 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e009b5c0 0x7f31e009b9e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f31d80098d0 tx=0x7f31d801c400 comp rx=0 tx=0).ready entity=mon.4 client_cookie=f12602f7288509e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31ddffb640 1 -- 172.21.15.5:0/857303318 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f31d80b0070 con 0x7f31e009b5c0 2024-08-18T21:15:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31ddffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:15:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31ddffb640 10 monclient: dump: 2024-08-18T21:15:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.986 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31ddffb640 10 monclient: _finish_auth 0 2024-08-18T21:15:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31ddffb640 10 monclient: _check_auth_tickets 2024-08-18T21:15:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31ddffb640 1 -- 172.21.15.5:0/857303318 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d80aa810 con 0x7f31e009b5c0 2024-08-18T21:15:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 5 monclient: authenticate success, global_id 114997 2024-08-18T21:15:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:15:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31ddffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31ddffb640 1 -- 172.21.15.5:0/857303318 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f31d80a9300 con 0x7f31e009b5c0 2024-08-18T21:15:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 4 set_mon_vals no callback set 2024-08-18T21:15:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31ddffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:15:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31ddffb640 10 monclient: dump: 2024-08-18T21:15:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.989 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 10 monclient: shutdown 2024-08-18T21:15:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 -- 172.21.15.5:0/857303318 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e009b5c0 msgr2=0x7f31e009b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 --2- 172.21.15.5:0/857303318 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e009b5c0 0x7f31e009b9e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f31d80098d0 tx=0x7f31d801c400 comp rx=0 tx=0).stop 2024-08-18T21:15:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 -- 172.21.15.5:0/857303318 shutdown_connections 2024-08-18T21:15:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 --2- 172.21.15.5:0/857303318 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e009b5c0 0x7f31e009b9e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 --2- 172.21.15.5:0/857303318 >> v2:172.21.15.5:3300/0 conn(0x7f31e00a4920 0x7f31e009b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 --2- 172.21.15.5:0/857303318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31e00a4000 0x7f31e00a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 -- 172.21.15.5:0/857303318 >> 172.21.15.5:0/857303318 conn(0x7f31e00a50f0 msgr2=0x7f31e00a54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 -- 172.21.15.5:0/857303318 shutdown_connections 2024-08-18T21:15:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 -- 172.21.15.5:0/857303318 wait complete. 2024-08-18T21:15:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 10 monclient: build_initial_monmap 2024-08-18T21:15:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 10 monclient: monmap: 2024-08-18T21:15:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:43.991 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 Processor -- start 2024-08-18T21:15:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 -- start start 2024-08-18T21:15:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 10 monclient: init 2024-08-18T21:15:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 10 monclient: _add_conns ranks=[4,0,3,8,2,7,1,6,5] 2024-08-18T21:15:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e009b5c0 0x7f31e013b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 10 monclient(hunting): picked mon.noname-c con 0x7f31e009b5c0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:15:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31e00a4000 0x7f31e013b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 10 monclient(hunting): picked mon.noname-a con 0x7f31e00a4000 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:15:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31e00a4920 0x7f31e013be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 10 monclient(hunting): picked mon.noname-g con 0x7f31e00a4920 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f31e00a4d00 con 0x7f31e00a4000 2024-08-18T21:15:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f31e009ecc0 con 0x7f31e00a4920 2024-08-18T21:15:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f31e0074d00 con 0x7f31e009b5c0 2024-08-18T21:15:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31e566a640 10 monclient(hunting): authenticate will time out at 1710.998900s 2024-08-18T21:15:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e009b5c0 0x7f31e013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31de7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31e00a4000 0x7f31e013b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e009b5c0 0x7f31e013b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:48874/0 (socket says 172.21.15.5:48874) 2024-08-18T21:15:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 1 -- 172.21.15.5:0/2802574374 learned_addr learned my addr 172.21.15.5:0/2802574374 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31de7fc640 10 monclient(hunting): get_auth_request con 0x7f31e00a4000 auth_method 0 2024-08-18T21:15:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31de7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31de7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31de7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 10 monclient(hunting): get_auth_request con 0x7f31e009b5c0 auth_method 0 2024-08-18T21:15:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31de7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31de7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31de7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31df7fe640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31e00a4920 0x7f31e013be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31df7fe640 10 monclient(hunting): get_auth_request con 0x7f31e00a4920 auth_method 0 2024-08-18T21:15:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31df7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31df7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 10 monclient(hunting): handle_auth_done global_id 115006 payload 824 2024-08-18T21:15:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 1 -- 172.21.15.5:0/2802574374 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31e00a4920 msgr2=0x7f31e013be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31e00a4920 0x7f31e013be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 1 -- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31e00a4000 msgr2=0x7f31e013b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31e00a4000 0x7f31e013b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 10 monclient: _finish_hunting 0 2024-08-18T21:15:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 1 monclient: found mon.noname-c 2024-08-18T21:15:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:15:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31deffd640 1 -- 172.21.15.5:0/2802574374 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e009cc30 con 0x7f31e009b5c0 2024-08-18T21:15:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.982+0000 7f31de7fc640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31e00a4000 0x7f31e013b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:15:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31deffd640 1 -- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e009b5c0 msgr2=0x7f31e013b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31deffd640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e009b5c0 0x7f31e013b410 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f31d0007ef0 tx=0x7f31d000e4b0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31d77fe640 1 -- 172.21.15.5:0/2802574374 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f31d0013a00 con 0x7f31e009b5c0 2024-08-18T21:15:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31d77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31d77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:15:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31d77fe640 10 monclient: dump: 2024-08-18T21:15:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.997 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31d77fe640 10 monclient: _finish_auth 0 2024-08-18T21:15:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31d77fe640 10 monclient: _check_auth_tickets 2024-08-18T21:15:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31d77fe640 1 -- 172.21.15.5:0/2802574374 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d0019070 con 0x7f31e009b5c0 2024-08-18T21:15:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31e566a640 5 monclient: authenticate success, global_id 115006 2024-08-18T21:15:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31e566a640 10 monclient: _renew_subs 2024-08-18T21:15:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31e566a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:15:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31e566a640 1 -- 172.21.15.5:0/2802574374 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e009cf10 con 0x7f31e009b5c0 2024-08-18T21:15:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31d77fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31d77fe640 1 -- 172.21.15.5:0/2802574374 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f31d0013be0 con 0x7f31e009b5c0 2024-08-18T21:15:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31d77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31d77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:15:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31d77fe640 10 monclient: dump: 2024-08-18T21:15:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:43.999 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31dd7fa640 4 set_mon_vals no callback set 2024-08-18T21:15:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31e566a640 10 monclient: _renew_subs 2024-08-18T21:15:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31e566a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:15:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31e566a640 1 -- 172.21.15.5:0/2802574374 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e013cc20 con 0x7f31e009b5c0 2024-08-18T21:15:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31e566a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31e566a640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e0137750 0x7f31e0137b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31e566a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31e566a640 1 -- 172.21.15.5:0/2802574374 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f31e0051140 con 0x7f31e0137750 2024-08-18T21:15:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31de7fc640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e0137750 0x7f31e0137b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31de7fc640 10 monclient: get_auth_request con 0x7f31e0137750 auth_method 0 2024-08-18T21:15:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31de7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31de7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31de7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31deffd640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e009b5c0 0x7f31e013b410 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f31d0007ef0 tx=0x7f31d000e4b0 comp rx=0 tx=0).queue_received will delay after 1.72402e+09 on 0x7f31d0013590 mgrmap(e 5) 2024-08-18T21:15:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31d77fe640 1 -- 172.21.15.5:0/2802574374 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f31d0013590 con 0x7f31e009b5c0 2024-08-18T21:15:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31de7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31de7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31de7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31d77fe640 1 --2- 172.21.15.5:0/2802574374 >> v2:172.21.15.157:6812/631023601 conn(0x7f31c003bdc0 0x7f31c003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31de7fc640 10 monclient(hunting): handle_auth_done global_id 115015 payload 824 2024-08-18T21:15:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31de7fc640 1 -- 172.21.15.5:0/2802574374 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31e009d250 con 0x7f31e0137750 2024-08-18T21:15:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31df7fe640 1 --2- 172.21.15.5:0/2802574374 >> v2:172.21.15.157:6812/631023601 conn(0x7f31c003bdc0 0x7f31c003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.986+0000 7f31df7fe640 10 monclient: get_auth_request con 0x7f31c003bdc0 auth_method 0 2024-08-18T21:15:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.990+0000 7f31de7fc640 1 -- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e0137750 msgr2=0x7f31e0137b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.990+0000 7f31de7fc640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e0137750 0x7f31e0137b30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f31e013c730 tx=0x7f31c8007f20 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.990+0000 7f31d77fe640 1 -- 172.21.15.5:0/2802574374 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f31c8018070 con 0x7f31e0137750 2024-08-18T21:15:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.990+0000 7f31d77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.990+0000 7f31d77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:15:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.990+0000 7f31d77fe640 10 monclient: dump: 2024-08-18T21:15:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.006 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.990+0000 7f31d77fe640 1 -- 172.21.15.5:0/2802574374 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f31c800ed90 con 0x7f31e0137750 2024-08-18T21:15:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.990+0000 7f31d77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.990+0000 7f31d77fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.990+0000 7f31d77fe640 1 -- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e0137750 msgr2=0x7f31e0137b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.990+0000 7f31d77fe640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e0137750 0x7f31e0137b30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f31e013c730 tx=0x7f31c8007f20 comp rx=0 tx=0).stop 2024-08-18T21:15:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.990+0000 7f31d77fe640 1 -- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e0137750 msgr2=0x7f31e0137b30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.990+0000 7f31d77fe640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e0137750 0x7f31e0137b30 secure :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f31e013c730 tx=0x7f31c8007f20 comp rx=0 tx=0).stop 2024-08-18T21:15:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.990+0000 7f31df7fe640 1 --2- 172.21.15.5:0/2802574374 >> v2:172.21.15.157:6812/631023601 conn(0x7f31c003bdc0 0x7f31c003e280 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f31e00a5ed0 tx=0x7f31d80a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.998+0000 7f31e566a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:15:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.998+0000 7f31e566a640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e0138070 0x7f31e0099500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.998+0000 7f31e566a640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.998+0000 7f31e566a640 1 -- 172.21.15.5:0/2802574374 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f31e00a4e80 con 0x7f31e0138070 2024-08-18T21:15:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.998+0000 7f31de7fc640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e0138070 0x7f31e0099500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.998+0000 7f31de7fc640 10 monclient: get_auth_request con 0x7f31e0138070 auth_method 0 2024-08-18T21:15:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.998+0000 7f31de7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.998+0000 7f31de7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.998+0000 7f31de7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.998+0000 7f31de7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.998+0000 7f31de7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.998+0000 7f31de7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.998+0000 7f31de7fc640 10 monclient(hunting): handle_auth_done global_id 115024 payload 824 2024-08-18T21:15:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:43.998+0000 7f31de7fc640 1 -- 172.21.15.5:0/2802574374 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f31e00a0800 con 0x7f31e0138070 2024-08-18T21:15:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31de7fc640 1 -- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e0138070 msgr2=0x7f31e0099500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31de7fc640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e0138070 0x7f31e0099500 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f31e013c730 tx=0x7f31c80046d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31d77fe640 1 -- 172.21.15.5:0/2802574374 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f31c802b020 con 0x7f31e0138070 2024-08-18T21:15:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31d77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31d77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:15:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31d77fe640 10 monclient: dump: 2024-08-18T21:15:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.009 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31d77fe640 1 -- 172.21.15.5:0/2802574374 <== mon.4 v2:172.21.15.5:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9415 (secure 0 0 0) 0x7f31c8014dc0 con 0x7f31e0138070 2024-08-18T21:15:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31d77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:15:44.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31d77fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:15:44.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31d77fe640 1 -- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e0138070 msgr2=0x7f31e0099500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31d77fe640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e0138070 0x7f31e0099500 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f31e013c730 tx=0x7f31c80046d0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31d77fe640 1 -- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e0138070 msgr2=0x7f31e0099500 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:44.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31d77fe640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e0138070 0x7f31e0099500 secure :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f31e013c730 tx=0x7f31c80046d0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.010 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:44.010 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:15:44.010 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:15:44.010 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:15:44.011 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 254, 2024-08-18T21:15:44.011 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 249161, 2024-08-18T21:15:44.011 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:15:44.011 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:15:44.011 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:15:44.011 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:15:44.011 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:15:44.011 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:15:44.011 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:15:44.011 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:15:44.011 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:15:44.011 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:15:44.011 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.011 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 0, 2024-08-18T21:15:44.012 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:44.012 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:15:44.012 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:15:44.012 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:44.012 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:44.012 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:44.012 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:44.012 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:44.012 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:44.012 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:44.012 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:44.012 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:44.012 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:44.012 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:44.013 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.013 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:15:44.013 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:15:44.013 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:44.013 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:44.013 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:44.013 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:44.013 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:44.013 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:44.013 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:44.013 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:44.013 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:44.013 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:44.014 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:44.014 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.014 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:15:44.014 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:15:44.014 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:15:44.014 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:15:44.014 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:15:44.014 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:15:44.014 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:44.014 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:44.014 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:15:44.014 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:15:44.014 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:15:44.015 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:15:44.015 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:15:44.015 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:15:44.015 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:15:44.015 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:44.015 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:15:44.015 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:44.015 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:44.015 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:44.015 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:44.015 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:44.015 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:44.015 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:44.016 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:44.016 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:44.016 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:44.016 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:44.016 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.016 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:15:44.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.016 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:15:44.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.016 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:15:44.016 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:15:44.016 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.016 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.017 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.017 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:15:44.017 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.017 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.017 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:15:44.017 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.017 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.017 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.017 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:15:44.017 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:15:44.018 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.018 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.018 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.018 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:15:44.018 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:15:44.018 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.018 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.018 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.018 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:15:44.019 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.019 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.019 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.019 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:15:44.019 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.019 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.019 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.019 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:15:44.019 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:15:44.019 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.020 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.020 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.020 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:15:44.020 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:15:44.020 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.020 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.020 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:15:44.020 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.021 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.021 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:15:44.021 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.021 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.021 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.021 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:15:44.021 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:15:44.021 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.021 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.021 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.021 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:15:44.022 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:15:44.022 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.022 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.022 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.022 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:15:44.022 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.022 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.022 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:15:44.022 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.022 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.023 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.023 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:15:44.023 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:15:44.023 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.023 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.023 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.023 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:15:44.023 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:15:44.023 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.023 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.024 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.024 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:15:44.024 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.024 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.024 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:15:44.024 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.024 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.024 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.024 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:15:44.024 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:15:44.024 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.025 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.025 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.025 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:15:44.025 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:15:44.025 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.025 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:15:44.025 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.026 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.026 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:15:44.026 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.026 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.026 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.026 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:15:44.026 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:15:44.026 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.026 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.026 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.027 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:15:44.027 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:15:44.027 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:15:44.027 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.027 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:15:44.027 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.027 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.028 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.028 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:15:44.028 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:15:44.028 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.028 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.028 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.028 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:15:44.028 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:15:44.028 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.028 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.029 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.029 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:15:44.029 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.029 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.029 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:15:44.029 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.029 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.029 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.029 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:15:44.029 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:15:44.029 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.030 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.030 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.030 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:15:44.030 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:15:44.030 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.030 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.030 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:15:44.030 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:15:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:15:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:15:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:15:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:15:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:15:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:15:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 2 2024-08-18T21:15:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:15:44.033 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31e566a640 1 -- 172.21.15.5:0/2802574374 >> v2:172.21.15.157:6812/631023601 conn(0x7f31c003bdc0 msgr2=0x7f31c003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31e566a640 1 --2- 172.21.15.5:0/2802574374 >> v2:172.21.15.157:6812/631023601 conn(0x7f31c003bdc0 0x7f31c003e280 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f31e00a5ed0 tx=0x7f31d80a6000 comp rx=0 tx=0).stop 2024-08-18T21:15:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31e566a640 10 monclient: shutdown 2024-08-18T21:15:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31e566a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31e566a640 1 -- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e009b5c0 msgr2=0x7f31e013b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31e566a640 1 --2- 172.21.15.5:0/2802574374 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f31e009b5c0 0x7f31e013b410 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f31d0007ef0 tx=0x7f31d000e4b0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31df7fe640 1 -- 172.21.15.5:0/2802574374 reap_dead start 2024-08-18T21:15:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31df7fe640 1 -- 172.21.15.5:0/2802574374 reap_dead start 2024-08-18T21:15:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31d77fe640 1 -- 172.21.15.5:0/2802574374 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(330..330 src has 22..330) ==== 3898+0+0 (unknown 0 0 0) 0x7f31d004ef80 con 0x7f31e009b5c0 2024-08-18T21:15:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31e566a640 1 -- 172.21.15.5:0/2802574374 shutdown_connections 2024-08-18T21:15:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31e566a640 1 -- 172.21.15.5:0/2802574374 >> 172.21.15.5:0/2802574374 conn(0x7f31e00a50f0 msgr2=0x7f31e00a64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31e566a640 1 -- 172.21.15.5:0/2802574374 shutdown_connections 2024-08-18T21:15:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.002+0000 7f31e566a640 1 -- 172.21.15.5:0/2802574374 wait complete. 2024-08-18T21:15:44.036 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:15:44.036 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-18T21:15:44.036 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-18T21:15:44.037 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:44.037 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32815]: starting. 2024-08-18T21:15:44.037 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32815]: creating pool ceph_test_rados_delete_pools_parallel.smithi157-32694 2024-08-18T21:15:44.037 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32815]: created object 0... 2024-08-18T21:15:44.037 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32815]: created object 25... 2024-08-18T21:15:44.037 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32815]: created object 49... 2024-08-18T21:15:44.037 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32815]: finishing. 2024-08-18T21:15:44.037 INFO:teuthology.orchestra.run.smithi157.stdout:process_3_[32815]: shutting down. 2024-08-18T21:15:44.065 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:44.065 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32817]: starting. 2024-08-18T21:15:44.065 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32817]: listing objects. 2024-08-18T21:15:44.065 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32817]: listed object 0... 2024-08-18T21:15:44.065 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32817]: listed object 25... 2024-08-18T21:15:44.066 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32817]: saw 50 objects 2024-08-18T21:15:44.066 INFO:teuthology.orchestra.run.smithi157.stdout:process_5_[32817]: shutting down. 2024-08-18T21:15:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 10 monclient: get_monmap_and_config 2024-08-18T21:15:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 10 monclient: build_initial_monmap 2024-08-18T21:15:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 10 monclient: monmap: 2024-08-18T21:15:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:44.160532+0000 2024-08-18T21:15:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:44.160532+0000 2024-08-18T21:15:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:44.156 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 1 Processor -- start 2024-08-18T21:15:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 1 -- start start 2024-08-18T21:15:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 10 monclient: init 2024-08-18T21:15:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 10 monclient: _add_conns ranks=[2,10,1,3,4,7,0,5,6,9,8] 2024-08-18T21:15:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbe100a4a40 0x7fbe100a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 10 monclient(hunting): picked mon.noname-b con 0x7fbe100a4a40 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbe100a4e20 0x7fbe100a5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 10 monclient(hunting): picked mon.noname-f con 0x7fbe100a4e20 addr v2:172.21.15.157:3300/0 2024-08-18T21:15:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fbe10137800 addr v1:172.21.15.157:6789/0 2024-08-18T21:15:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe1006cef0 con 0x7fbe10137800 2024-08-18T21:15:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fbe100745f0 con 0x7fbe100a4e20 2024-08-18T21:15:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fbe1006ca70 con 0x7fbe100a4a40 2024-08-18T21:15:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe17bc3640 10 monclient(hunting): authenticate will time out at 1711.173751s 2024-08-18T21:15:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbe100a4a40 0x7fbe100a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbe100a4a40 0x7fbe100a1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33732/0 (socket says 172.21.15.5:33732) 2024-08-18T21:15:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 1 -- 172.21.15.5:0/280478905 learned_addr learned my addr 172.21.15.5:0/280478905 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 10 monclient(hunting): get_auth_request con 0x7fbe100a4a40 auth_method 0 2024-08-18T21:15:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1515e640 1 --2- 172.21.15.5:0/280478905 >> v2:172.21.15.157:3300/0 conn(0x7fbe100a4e20 0x7fbe100a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1515e640 10 monclient(hunting): get_auth_request con 0x7fbe100a4e20 auth_method 0 2024-08-18T21:15:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1515e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1515e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1515e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 10 monclient(hunting): handle_auth_done global_id 115121 payload 274 2024-08-18T21:15:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 1 -- 172.21.15.5:0/280478905 >> v2:172.21.15.157:3300/0 conn(0x7fbe100a4e20 msgr2=0x7fbe100a5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 1 --2- 172.21.15.5:0/280478905 >> v2:172.21.15.157:3300/0 conn(0x7fbe100a4e20 0x7fbe100a5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 1 -- 172.21.15.5:0/280478905 >> v1:172.21.15.157:6789/0 conn(0x7fbe10137800 legacy=0x7fbe10137cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 10 monclient: _finish_hunting 0 2024-08-18T21:15:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 1 monclient: found mon.noname-b 2024-08-18T21:15:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.158+0000 7fbe1595f640 1 -- 172.21.15.5:0/280478905 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe100a0970 con 0x7fbe100a4a40 2024-08-18T21:15:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe1595f640 1 -- 172.21.15.5:0/280478905 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbe100a4a40 msgr2=0x7fbe100a1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe1595f640 1 --2- 172.21.15.5:0/280478905 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbe100a4a40 0x7fbe100a1c20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009870 tx=0x7fbe0801c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f72e98f64bc22a70 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe1495d640 1 -- 172.21.15.5:0/280478905 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbe080b0070 con 0x7fbe100a4a40 2024-08-18T21:15:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe1495d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe1495d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe1495d640 10 monclient: dump: 2024-08-18T21:15:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.164 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe1495d640 10 monclient: _finish_auth 0 2024-08-18T21:15:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe1495d640 10 monclient: _check_auth_tickets 2024-08-18T21:15:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe1495d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe1495d640 1 -- 172.21.15.5:0/280478905 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe080aa810 con 0x7fbe100a4a40 2024-08-18T21:15:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe1495d640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe1495d640 1 -- 172.21.15.5:0/280478905 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbe080aae30 con 0x7fbe100a4a40 2024-08-18T21:15:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe17bc3640 5 monclient: authenticate success, global_id 115121 2024-08-18T21:15:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe17bc3640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe17bc3640 4 set_mon_vals no callback set 2024-08-18T21:15:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe1495d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe1495d640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe1495d640 10 monclient: dump: 2024-08-18T21:15:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.166 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe17bc3640 10 monclient: shutdown 2024-08-18T21:15:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe17bc3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe17bc3640 1 -- 172.21.15.5:0/280478905 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbe100a4a40 msgr2=0x7fbe100a1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.162+0000 7fbe17bc3640 1 --2- 172.21.15.5:0/280478905 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbe100a4a40 0x7fbe100a1c20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009870 tx=0x7fbe0801c420 comp rx=0 tx=0).stop 2024-08-18T21:15:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 1 -- 172.21.15.5:0/280478905 shutdown_connections 2024-08-18T21:15:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 1 --2- 172.21.15.5:0/280478905 >> v2:172.21.15.157:3300/0 conn(0x7fbe100a4e20 0x7fbe100a5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 1 --2- 172.21.15.5:0/280478905 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbe100a4a40 0x7fbe100a1c20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 1 -- 172.21.15.5:0/280478905 >> 172.21.15.5:0/280478905 conn(0x7fbe10068700 msgr2=0x7fbe10068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 1 -- 172.21.15.5:0/280478905 shutdown_connections 2024-08-18T21:15:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 1 -- 172.21.15.5:0/280478905 wait complete. 2024-08-18T21:15:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 10 monclient: build_initial_monmap 2024-08-18T21:15:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 10 monclient: monmap: 2024-08-18T21:15:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:44.174 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 1 Processor -- start 2024-08-18T21:15:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 1 -- start start 2024-08-18T21:15:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 10 monclient: init 2024-08-18T21:15:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 10 monclient: _add_conns ranks=[5,4,0,6,1,8,7,2,3] 2024-08-18T21:15:44.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbe100a4a40 0x7fbe10131cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 10 monclient(hunting): picked mon.noname-h con 0x7fbe100a4a40 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:44.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbe100a4e20 0x7fbe10132230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 10 monclient(hunting): picked mon.noname-c con 0x7fbe100a4e20 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:15:44.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe10137800 0x7fbe101d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 10 monclient(hunting): picked mon.noname-a con 0x7fbe10137800 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:15:44.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbe10142610 con 0x7fbe10137800 2024-08-18T21:15:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fbe10142490 con 0x7fbe100a4e20 2024-08-18T21:15:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fbe10142790 con 0x7fbe100a4a40 2024-08-18T21:15:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe17bc3640 10 monclient(hunting): authenticate will time out at 1711.182059s 2024-08-18T21:15:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1515e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbe100a4e20 0x7fbe10132230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe10137800 0x7fbe101d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1515e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbe100a4e20 0x7fbe10132230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:38510/0 (socket says 172.21.15.5:38510) 2024-08-18T21:15:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1515e640 1 -- 172.21.15.5:0/3919977778 learned_addr learned my addr 172.21.15.5:0/3919977778 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 10 monclient(hunting): get_auth_request con 0x7fbe10137800 auth_method 0 2024-08-18T21:15:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1515e640 10 monclient(hunting): get_auth_request con 0x7fbe100a4e20 auth_method 0 2024-08-18T21:15:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1515e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1515e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1515e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1515e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1515e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1595f640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbe100a4a40 0x7fbe10131cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1515e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1595f640 10 monclient(hunting): get_auth_request con 0x7fbe100a4a40 auth_method 0 2024-08-18T21:15:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1595f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1595f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1595f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 10 monclient(hunting): handle_auth_done global_id 124839 payload 824 2024-08-18T21:15:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 1 -- 172.21.15.5:0/3919977778 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbe100a4a40 msgr2=0x7fbe10131cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbe100a4a40 0x7fbe10131cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 1 -- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbe100a4e20 msgr2=0x7fbe10132230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbe100a4e20 0x7fbe10132230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 10 monclient: _finish_hunting 0 2024-08-18T21:15:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 1 monclient: found mon.noname-a 2024-08-18T21:15:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:15:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe16160640 1 -- 172.21.15.5:0/3919977778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe100a7150 con 0x7fbe10137800 2024-08-18T21:15:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1515e640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbe100a4e20 0x7fbe10132230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:15:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.166+0000 7fbe1595f640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fbe100a4a40 0x7fbe10131cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:15:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe16160640 1 -- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe10137800 msgr2=0x7fbe101d1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe16160640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe10137800 0x7fbe101d1a40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbe1013e5a0 tx=0x7fbe000098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0e7fc640 1 -- 172.21.15.5:0/3919977778 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbe00010c30 con 0x7fbe10137800 2024-08-18T21:15:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:15:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0e7fc640 10 monclient: dump: 2024-08-18T21:15:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.180 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:15:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:15:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe17bc3640 5 monclient: authenticate success, global_id 124839 2024-08-18T21:15:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0e7fc640 1 -- 172.21.15.5:0/3919977778 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe00010df0 con 0x7fbe10137800 2024-08-18T21:15:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe17bc3640 10 monclient: _renew_subs 2024-08-18T21:15:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe17bc3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:15:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe17bc3640 1 -- 172.21.15.5:0/3919977778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe10068f70 con 0x7fbe10137800 2024-08-18T21:15:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0e7fc640 1 -- 172.21.15.5:0/3919977778 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbe000118b0 con 0x7fbe10137800 2024-08-18T21:15:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:15:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0e7fc640 10 monclient: dump: 2024-08-18T21:15:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.182 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0ffff640 4 set_mon_vals no callback set 2024-08-18T21:15:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe17bc3640 10 monclient: _renew_subs 2024-08-18T21:15:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe17bc3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:15:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe17bc3640 1 -- 172.21.15.5:0/3919977778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe1013e6a0 con 0x7fbe10137800 2024-08-18T21:15:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe17bc3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe17bc3640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbe101d1f80 0x7fbe101d2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe17bc3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe17bc3640 1 -- 172.21.15.5:0/3919977778 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fbe10051140 con 0x7fbe101d1f80 2024-08-18T21:15:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe1595f640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbe101d1f80 0x7fbe101d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe1595f640 10 monclient: get_auth_request con 0x7fbe101d1f80 auth_method 0 2024-08-18T21:15:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe1595f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe1595f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe1595f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe1595f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe1595f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe1595f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe1595f640 10 monclient(hunting): handle_auth_done global_id 174120 payload 824 2024-08-18T21:15:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe1595f640 1 -- 172.21.15.5:0/3919977778 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe100a7380 con 0x7fbe101d1f80 2024-08-18T21:15:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0e7fc640 1 -- 172.21.15.5:0/3919977778 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fbe00018030 con 0x7fbe10137800 2024-08-18T21:15:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0e7fc640 1 --2- 172.21.15.5:0/3919977778 >> v2:172.21.15.157:6812/631023601 conn(0x7fbdfc03bdf0 0x7fbdfc03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe0e7fc640 1 -- 172.21.15.5:0/3919977778 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(330..330 src has 22..330) ==== 3898+0+0 (secure 0 0 0) 0x7fbe00016020 con 0x7fbe10137800 2024-08-18T21:15:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe1515e640 1 --2- 172.21.15.5:0/3919977778 >> v2:172.21.15.157:6812/631023601 conn(0x7fbdfc03bdf0 0x7fbdfc03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.170+0000 7fbe1515e640 10 monclient: get_auth_request con 0x7fbdfc03bdf0 auth_method 0 2024-08-18T21:15:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.174+0000 7fbe1595f640 1 -- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbe101d1f80 msgr2=0x7fbe101d2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.174+0000 7fbe1595f640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbe101d1f80 0x7fbe101d2380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe100a16c0 tx=0x7fbe080191c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.174+0000 7fbe0e7fc640 1 -- 172.21.15.5:0/3919977778 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbe080b0070 con 0x7fbe101d1f80 2024-08-18T21:15:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.174+0000 7fbe0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.174+0000 7fbe0e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:15:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.174+0000 7fbe0e7fc640 10 monclient: dump: 2024-08-18T21:15:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.186 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.174+0000 7fbe0e7fc640 1 -- 172.21.15.5:0/3919977778 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbe080b1040 con 0x7fbe101d1f80 2024-08-18T21:15:44.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.174+0000 7fbe0e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:44.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.174+0000 7fbe0e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:44.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.174+0000 7fbe0e7fc640 1 -- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbe101d1f80 msgr2=0x7fbe101d2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.174+0000 7fbe0e7fc640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbe101d1f80 0x7fbe101d2380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe100a16c0 tx=0x7fbe080191c0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.174+0000 7fbe0e7fc640 1 -- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbe101d1f80 msgr2=0x7fbe101d2380 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:44.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.174+0000 7fbe0e7fc640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbe101d1f80 0x7fbe101d2380 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe100a16c0 tx=0x7fbe080191c0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.174+0000 7fbe1515e640 1 --2- 172.21.15.5:0/3919977778 >> v2:172.21.15.157:6812/631023601 conn(0x7fbdfc03bdf0 0x7fbdfc03e2b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbe1013c050 tx=0x7fbe04009970 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.178+0000 7fbe17bc3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:15:44.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.178+0000 7fbe17bc3640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbe10072070 0x7fbe10072480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.178+0000 7fbe17bc3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.178+0000 7fbe17bc3640 1 -- 172.21.15.5:0/3919977778 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fbe10069fa0 con 0x7fbe10072070 2024-08-18T21:15:44.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.178+0000 7fbe1595f640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbe10072070 0x7fbe10072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.178+0000 7fbe1595f640 10 monclient: get_auth_request con 0x7fbe10072070 auth_method 0 2024-08-18T21:15:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.178+0000 7fbe1595f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.178+0000 7fbe1595f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.178+0000 7fbe1595f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.178+0000 7fbe1595f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.178+0000 7fbe1595f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.178+0000 7fbe1595f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe1595f640 10 monclient(hunting): handle_auth_done global_id 174129 payload 824 2024-08-18T21:15:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe1595f640 1 -- 172.21.15.5:0/3919977778 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbe100a1c20 con 0x7fbe10072070 2024-08-18T21:15:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe1595f640 1 -- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbe10072070 msgr2=0x7fbe10072480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe1595f640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbe10072070 0x7fbe10072480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbe0801ccc0 tx=0x7fbe080a8000 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe0e7fc640 1 -- 172.21.15.5:0/3919977778 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbe080b6890 con 0x7fbe10072070 2024-08-18T21:15:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe0e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:15:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe0e7fc640 10 monclient: dump: 2024-08-18T21:15:44.190 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.190 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.190 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.190 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.190 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.190 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.190 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.190 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.190 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.190 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.190 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.190 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.190 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.191 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.191 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.191 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe0e7fc640 1 -- 172.21.15.5:0/3919977778 <== mon.6 v2:172.21.15.5:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9414 (secure 0 0 0) 0x7fbe080c8410 con 0x7fbe10072070 2024-08-18T21:15:44.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe0e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:15:44.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe0e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:15:44.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe0e7fc640 1 -- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbe10072070 msgr2=0x7fbe10072480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe0e7fc640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbe10072070 0x7fbe10072480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbe0801ccc0 tx=0x7fbe080a8000 comp rx=0 tx=0).stop 2024-08-18T21:15:44.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe0e7fc640 1 -- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbe10072070 msgr2=0x7fbe10072480 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:44.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe0e7fc640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fbe10072070 0x7fbe10072480 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.191 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:44.192 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:15:44.192 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:15:44.192 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:15:44.192 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 254, 2024-08-18T21:15:44.192 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 21055, 2024-08-18T21:15:44.192 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:15:44.192 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:15:44.192 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:15:44.192 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:15:44.192 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:15:44.192 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:15:44.192 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:15:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:15:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:15:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:15:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:15:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:15:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:15:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:15:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:15:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:15:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:15:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:15:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:15:44.196 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:15:44.196 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:15:44.196 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:44.196 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:44.196 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:15:44.196 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:15:44.196 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:15:44.196 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:15:44.196 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:15:44.196 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:15:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:15:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:15:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:15:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:15:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:15:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:15:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:15:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:15:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:15:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:15:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:15:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:15:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:15:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:15:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:15:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:15:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:15:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:15:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:15:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:15:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:15:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:15:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:15:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:15:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:15:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:15:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:15:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:15:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:15:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:15:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:15:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:15:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:15:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:15:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:15:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:15:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:15:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:15:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:15:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:15:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:15:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:15:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:15:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:15:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:15:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:15:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:15:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:15:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:15:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:15:44.211 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.211 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.211 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.211 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:15:44.211 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:15:44.211 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.211 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.211 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.211 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.211 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:15:44.211 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:15:44.211 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.211 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.212 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.212 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:15:44.212 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.212 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.212 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:15:44.212 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.212 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.212 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.212 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:15:44.213 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:15:44.213 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.213 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.213 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.213 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.213 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.213 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:15:44.213 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:15:44.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.213 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:44.213 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:44.213 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:44.213 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.213 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.214 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:15:44.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.214 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:44.214 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:44.214 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:44.214 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.214 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.214 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:15:44.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.214 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:44.214 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:44.214 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:44.214 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.215 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.215 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:15:44.215 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:44.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe17bc3640 1 -- 172.21.15.5:0/3919977778 >> v2:172.21.15.157:6812/631023601 conn(0x7fbdfc03bdf0 msgr2=0x7fbdfc03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe17bc3640 1 --2- 172.21.15.5:0/3919977778 >> v2:172.21.15.157:6812/631023601 conn(0x7fbdfc03bdf0 0x7fbdfc03e2b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbe1013c050 tx=0x7fbe04009970 comp rx=0 tx=0).stop 2024-08-18T21:15:44.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe17bc3640 10 monclient: shutdown 2024-08-18T21:15:44.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe17bc3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:44.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe17bc3640 1 -- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe10137800 msgr2=0x7fbe101d1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe17bc3640 1 --2- 172.21.15.5:0/3919977778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe10137800 0x7fbe101d1a40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbe1013e5a0 tx=0x7fbe000098b0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe16160640 1 -- 172.21.15.5:0/3919977778 reap_dead start 2024-08-18T21:15:44.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe16160640 1 -- 172.21.15.5:0/3919977778 reap_dead start 2024-08-18T21:15:44.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe17bc3640 1 -- 172.21.15.5:0/3919977778 shutdown_connections 2024-08-18T21:15:44.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe17bc3640 1 -- 172.21.15.5:0/3919977778 >> 172.21.15.5:0/3919977778 conn(0x7fbe10068700 msgr2=0x7fbe10136dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:44.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe17bc3640 1 -- 172.21.15.5:0/3919977778 shutdown_connections 2024-08-18T21:15:44.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.182+0000 7fbe17bc3640 1 -- 172.21.15.5:0/3919977778 wait complete. 2024-08-18T21:15:44.217 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:15:44.217 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-18T21:15:44.217 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-18T21:15:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 10 monclient: get_monmap_and_config 2024-08-18T21:15:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 10 monclient: build_initial_monmap 2024-08-18T21:15:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 10 monclient: monmap: 2024-08-18T21:15:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:44.341045+0000 2024-08-18T21:15:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:44.341045+0000 2024-08-18T21:15:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:44.337 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 1 Processor -- start 2024-08-18T21:15:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 1 -- start start 2024-08-18T21:15:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 10 monclient: init 2024-08-18T21:15:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 10 monclient: _add_conns ranks=[0,2,5,10,9,3,6,7,1,4,8] 2024-08-18T21:15:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f00ec0a6ce0 addr v1:172.21.15.5:6789/0 2024-08-18T21:15:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f00ec0a77d0 0x7f00ec13ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 10 monclient(hunting): picked mon.noname-b con 0x7f00ec0a77d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f00ec13f220 0x7f00ec141610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 10 monclient(hunting): picked mon.noname-h con 0x7f00ec13f220 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00ec0a45d0 con 0x7f00ec0a6ce0 2024-08-18T21:15:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f00ec0a5000 con 0x7f00ec0a77d0 2024-08-18T21:15:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f00ec0a4360 con 0x7f00ec13f220 2024-08-18T21:15:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00f2017640 10 monclient(hunting): authenticate will time out at 1711.354330s 2024-08-18T21:15:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f00ec0a6ce0 0x7f00ec0a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36108/0 (socket says 172.21.15.5:36108) 2024-08-18T21:15:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eb7fe640 1 -- 172.21.15.5:0/1152433887 learned_addr learned my addr 172.21.15.5:0/1152433887 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:15:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 1 --2- 172.21.15.5:0/1152433887 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f00ec0a77d0 0x7f00ec13ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 10 monclient(hunting): get_auth_request con 0x7f00ec0a77d0 auth_method 0 2024-08-18T21:15:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 10 monclient(hunting): handle_auth_done global_id 115130 payload 274 2024-08-18T21:15:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00ebfff640 1 --2- 172.21.15.5:0/1152433887 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f00ec13f220 0x7f00ec141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 1 -- 172.21.15.5:0/1152433887 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f00ec13f220 msgr2=0x7f00ec141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 1 --2- 172.21.15.5:0/1152433887 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f00ec13f220 0x7f00ec141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 1 -- 172.21.15.5:0/1152433887 >> v1:172.21.15.5:6789/0 conn(0x7f00ec0a6ce0 legacy=0x7f00ec0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 10 monclient: _finish_hunting 0 2024-08-18T21:15:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 1 monclient: found mon.noname-b 2024-08-18T21:15:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00eaffd640 1 -- 172.21.15.5:0/1152433887 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ec0a32d0 con 0x7f00ec0a77d0 2024-08-18T21:15:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00ebfff640 10 monclient: get_auth_request con 0x7f00ec13f220 auth_method 0 2024-08-18T21:15:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.338+0000 7f00ebfff640 1 --2- 172.21.15.5:0/1152433887 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f00ec13f220 0x7f00ec141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:15:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00eaffd640 1 -- 172.21.15.5:0/1152433887 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f00ec0a77d0 msgr2=0x7f00ec13ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00eaffd640 1 --2- 172.21.15.5:0/1152433887 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f00ec0a77d0 0x7f00ec13ece0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009820 tx=0x7f00dc01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37568481c4d18fa4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00ea7fc640 1 -- 172.21.15.5:0/1152433887 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f00dc0b0070 con 0x7f00ec0a77d0 2024-08-18T21:15:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00ea7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00ea7fc640 10 monclient: dump: 2024-08-18T21:15:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.347 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00ea7fc640 10 monclient: _finish_auth 0 2024-08-18T21:15:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00ea7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:15:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00f2017640 5 monclient: authenticate success, global_id 115130 2024-08-18T21:15:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00f2017640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:15:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00ea7fc640 1 -- 172.21.15.5:0/1152433887 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00dc0aa810 con 0x7f00ec0a77d0 2024-08-18T21:15:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00ea7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00ea7fc640 1 -- 172.21.15.5:0/1152433887 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f00dc0a93e0 con 0x7f00ec0a77d0 2024-08-18T21:15:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00f2017640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00f2017640 4 set_mon_vals no callback set 2024-08-18T21:15:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00ea7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00ea7fc640 10 monclient: dump: 2024-08-18T21:15:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.349 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00f2017640 10 monclient: shutdown 2024-08-18T21:15:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00f2017640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00f2017640 1 -- 172.21.15.5:0/1152433887 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f00ec0a77d0 msgr2=0x7f00ec13ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.342+0000 7f00f2017640 1 --2- 172.21.15.5:0/1152433887 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f00ec0a77d0 0x7f00ec13ece0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009820 tx=0x7f00dc01c380 comp rx=0 tx=0).stop 2024-08-18T21:15:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 1 -- 172.21.15.5:0/1152433887 shutdown_connections 2024-08-18T21:15:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 1 --2- 172.21.15.5:0/1152433887 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f00ec0a77d0 0x7f00ec13ece0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 1 --2- 172.21.15.5:0/1152433887 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f00ec13f220 0x7f00ec141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 1 -- 172.21.15.5:0/1152433887 >> 172.21.15.5:0/1152433887 conn(0x7f00ec0acbc0 msgr2=0x7f00ec0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 1 -- 172.21.15.5:0/1152433887 shutdown_connections 2024-08-18T21:15:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 1 -- 172.21.15.5:0/1152433887 wait complete. 2024-08-18T21:15:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 10 monclient: build_initial_monmap 2024-08-18T21:15:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 10 monclient: monmap: 2024-08-18T21:15:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:44.351 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 1 Processor -- start 2024-08-18T21:15:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 1 -- start start 2024-08-18T21:15:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 10 monclient: init 2024-08-18T21:15:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 10 monclient: _add_conns ranks=[2,3,4,1,0,8,6,5,7] 2024-08-18T21:15:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f00ec0a6ce0 0x7f00ec0a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 10 monclient(hunting): picked mon.noname-b con 0x7f00ec0a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00ec0a77d0 0x7f00ec09f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 10 monclient(hunting): picked mon.noname-g con 0x7f00ec0a77d0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f00ec13f220 0x7f00ec138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 10 monclient(hunting): picked mon.noname-c con 0x7f00ec13f220 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:15:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f00ec0a83a0 con 0x7f00ec0a6ce0 2024-08-18T21:15:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f00ec0a8220 con 0x7f00ec0a77d0 2024-08-18T21:15:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f00ec144370 con 0x7f00ec13f220 2024-08-18T21:15:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00f2017640 10 monclient(hunting): authenticate will time out at 1711.361566s 2024-08-18T21:15:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00eb7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f00ec0a6ce0 0x7f00ec0a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f00ec13f220 0x7f00ec138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00eb7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f00ec0a6ce0 0x7f00ec0a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33750/0 (socket says 172.21.15.5:33750) 2024-08-18T21:15:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00eb7fe640 1 -- 172.21.15.5:0/2064757393 learned_addr learned my addr 172.21.15.5:0/2064757393 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 10 monclient(hunting): get_auth_request con 0x7f00ec13f220 auth_method 0 2024-08-18T21:15:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00eb7fe640 10 monclient(hunting): get_auth_request con 0x7f00ec0a6ce0 auth_method 0 2024-08-18T21:15:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00eb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00eb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00eaffd640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00ec0a77d0 0x7f00ec09f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00eaffd640 10 monclient(hunting): get_auth_request con 0x7f00ec0a77d0 auth_method 0 2024-08-18T21:15:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00eaffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 10 monclient(hunting): handle_auth_done global_id 115042 payload 824 2024-08-18T21:15:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 1 -- 172.21.15.5:0/2064757393 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00ec0a77d0 msgr2=0x7f00ec09f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00ec0a77d0 0x7f00ec09f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 1 -- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f00ec0a6ce0 msgr2=0x7f00ec0a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f00ec0a6ce0 0x7f00ec0a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 10 monclient: _finish_hunting 0 2024-08-18T21:15:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 1 monclient: found mon.noname-c 2024-08-18T21:15:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:15:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00ebfff640 1 -- 172.21.15.5:0/2064757393 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ec0a07b0 con 0x7f00ec13f220 2024-08-18T21:15:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.346+0000 7f00eb7fe640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f00ec0a6ce0 0x7f00ec0a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:15:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00ebfff640 1 -- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f00ec13f220 msgr2=0x7f00ec138040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00ebfff640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f00ec13f220 0x7f00ec138040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f00e400ccc0 tx=0x7f00e400a650 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00d3fff640 1 -- 172.21.15.5:0/2064757393 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f00e400fb00 con 0x7f00ec13f220 2024-08-18T21:15:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00d3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:15:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00d3fff640 10 monclient: dump: 2024-08-18T21:15:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.360 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00d3fff640 10 monclient: _finish_auth 0 2024-08-18T21:15:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00d3fff640 10 monclient: _check_auth_tickets 2024-08-18T21:15:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00d3fff640 1 -- 172.21.15.5:0/2064757393 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e400fce0 con 0x7f00ec13f220 2024-08-18T21:15:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00f2017640 5 monclient: authenticate success, global_id 115042 2024-08-18T21:15:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00f2017640 10 monclient: _renew_subs 2024-08-18T21:15:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00f2017640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:15:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00f2017640 1 -- 172.21.15.5:0/2064757393 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ec0a2930 con 0x7f00ec13f220 2024-08-18T21:15:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00d3fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00d3fff640 1 -- 172.21.15.5:0/2064757393 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f00e4018870 con 0x7f00ec13f220 2024-08-18T21:15:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00d3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:15:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00d3fff640 10 monclient: dump: 2024-08-18T21:15:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.363 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.363 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00e9ffb640 4 set_mon_vals no callback set 2024-08-18T21:15:44.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00f2017640 10 monclient: _renew_subs 2024-08-18T21:15:44.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00f2017640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:15:44.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00f2017640 1 -- 172.21.15.5:0/2064757393 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ec0a2550 con 0x7f00ec13f220 2024-08-18T21:15:44.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00d3fff640 1 -- 172.21.15.5:0/2064757393 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f00e4018400 con 0x7f00ec13f220 2024-08-18T21:15:44.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00f2017640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:44.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00f2017640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f00ec138580 0x7f00ec1d1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00f2017640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00f2017640 1 -- 172.21.15.5:0/2064757393 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f00ec0a2720 con 0x7f00ec138580 2024-08-18T21:15:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00eb7fe640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f00ec138580 0x7f00ec1d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00d3fff640 1 --2- 172.21.15.5:0/2064757393 >> v2:172.21.15.157:6812/631023601 conn(0x7f00d803be20 0x7f00d803e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00eb7fe640 10 monclient: get_auth_request con 0x7f00ec138580 auth_method 0 2024-08-18T21:15:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00eb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00eb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00d3fff640 1 -- 172.21.15.5:0/2064757393 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(330..330 src has 22..330) ==== 3898+0+0 (secure 0 0 0) 0x7f00e404f260 con 0x7f00ec13f220 2024-08-18T21:15:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00eb7fe640 10 monclient(hunting): handle_auth_done global_id 115316 payload 824 2024-08-18T21:15:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00eb7fe640 1 -- 172.21.15.5:0/2064757393 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00ec0aaf80 con 0x7f00ec138580 2024-08-18T21:15:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00eaffd640 1 --2- 172.21.15.5:0/2064757393 >> v2:172.21.15.157:6812/631023601 conn(0x7f00d803be20 0x7f00d803e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.350+0000 7f00eaffd640 10 monclient: get_auth_request con 0x7f00d803be20 auth_method 0 2024-08-18T21:15:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.354+0000 7f00eb7fe640 1 -- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f00ec138580 msgr2=0x7f00ec1d1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.354+0000 7f00eb7fe640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f00ec138580 0x7f00ec1d1670 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f00e00072a0 tx=0x7f00e0007760 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.354+0000 7f00d3fff640 1 -- 172.21.15.5:0/2064757393 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f00e000fde0 con 0x7f00ec138580 2024-08-18T21:15:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.354+0000 7f00d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.354+0000 7f00d3fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:15:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.354+0000 7f00d3fff640 10 monclient: dump: 2024-08-18T21:15:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.366 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.354+0000 7f00d3fff640 1 -- 172.21.15.5:0/2064757393 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f00e000fde0 con 0x7f00ec138580 2024-08-18T21:15:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.354+0000 7f00d3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.354+0000 7f00d3fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.354+0000 7f00d3fff640 1 -- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f00ec138580 msgr2=0x7f00ec1d1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.354+0000 7f00d3fff640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f00ec138580 0x7f00ec1d1670 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f00e00072a0 tx=0x7f00e0007760 comp rx=0 tx=0).stop 2024-08-18T21:15:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.354+0000 7f00d3fff640 1 -- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f00ec138580 msgr2=0x7f00ec1d1670 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.354+0000 7f00d3fff640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f00ec138580 0x7f00ec1d1670 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f00e00072a0 tx=0x7f00e0007760 comp rx=0 tx=0).stop 2024-08-18T21:15:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.354+0000 7f00eaffd640 1 --2- 172.21.15.5:0/2064757393 >> v2:172.21.15.157:6812/631023601 conn(0x7f00d803be20 0x7f00d803e2e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f00ec06df00 tx=0x7f00dc0a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.358+0000 7f00f2017640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:15:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.358+0000 7f00f2017640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f00ec1d1bb0 0x7f00ec1d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.358+0000 7f00f2017640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.358+0000 7f00f2017640 1 -- 172.21.15.5:0/2064757393 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f00ec1d2500 con 0x7f00ec1d1bb0 2024-08-18T21:15:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.358+0000 7f00eb7fe640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f00ec1d1bb0 0x7f00ec1d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.358+0000 7f00eb7fe640 10 monclient: get_auth_request con 0x7f00ec1d1bb0 auth_method 0 2024-08-18T21:15:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.358+0000 7f00eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.358+0000 7f00eb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.358+0000 7f00eb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.358+0000 7f00eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.358+0000 7f00eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.358+0000 7f00eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.358+0000 7f00eb7fe640 10 monclient(hunting): handle_auth_done global_id 115325 payload 824 2024-08-18T21:15:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.358+0000 7f00eb7fe640 1 -- 172.21.15.5:0/2064757393 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f00ec0a0380 con 0x7f00ec1d1bb0 2024-08-18T21:15:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00eb7fe640 1 -- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f00ec1d1bb0 msgr2=0x7f00ec1d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00eb7fe640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f00ec1d1bb0 0x7f00ec1d1fc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f00e00072a0 tx=0x7f00e0004950 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00d3fff640 1 -- 172.21.15.5:0/2064757393 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f00e00066b0 con 0x7f00ec1d1bb0 2024-08-18T21:15:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00d3fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:15:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00d3fff640 10 monclient: dump: 2024-08-18T21:15:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.370 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00d3fff640 1 -- 172.21.15.5:0/2064757393 <== mon.8 v2:172.21.15.5:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7f00e0006240 con 0x7f00ec1d1bb0 2024-08-18T21:15:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00d3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:15:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00d3fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:15:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00d3fff640 1 -- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f00ec1d1bb0 msgr2=0x7f00ec1d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00d3fff640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f00ec1d1bb0 0x7f00ec1d1fc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f00e00072a0 tx=0x7f00e0004950 comp rx=0 tx=0).stop 2024-08-18T21:15:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00d3fff640 1 -- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f00ec1d1bb0 msgr2=0x7f00ec1d1fc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00d3fff640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f00ec1d1bb0 0x7f00ec1d1fc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.371 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:44.371 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:15:44.371 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:15:44.371 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:15:44.371 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 254, 2024-08-18T21:15:44.372 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 249529, 2024-08-18T21:15:44.372 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:15:44.372 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:15:44.372 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:15:44.372 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:15:44.372 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:15:44.372 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:15:44.372 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:15:44.372 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:15:44.372 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:15:44.372 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:15:44.372 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.372 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:15:44.373 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:44.373 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:15:44.373 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:15:44.373 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:44.373 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:44.373 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:44.373 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:44.373 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:44.373 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:44.373 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:44.373 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:44.373 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:44.373 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:44.373 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:44.374 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.374 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:15:44.374 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:15:44.374 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:44.374 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:44.374 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:44.374 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:44.374 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:44.374 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:44.374 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:44.374 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:44.374 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:44.374 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:44.375 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:44.375 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.375 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:15:44.375 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:15:44.375 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:15:44.375 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:15:44.375 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:15:44.375 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:15:44.375 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:44.375 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:44.375 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:15:44.375 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:15:44.375 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:15:44.376 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:15:44.376 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:15:44.376 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:15:44.376 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:15:44.376 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:44.376 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:15:44.376 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:44.376 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:44.376 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:44.376 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:44.376 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:44.376 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:44.376 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:44.376 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:44.377 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:44.377 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:44.377 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:44.377 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.377 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:15:44.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.377 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:15:44.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.377 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:15:44.377 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:15:44.377 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.377 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.378 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.378 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:15:44.378 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.378 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.378 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:15:44.378 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.378 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.378 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.378 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:15:44.378 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:15:44.378 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.379 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.379 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.379 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:15:44.379 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:15:44.379 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.379 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.379 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.379 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:15:44.379 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.380 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.380 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:15:44.380 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.380 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.380 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.380 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:15:44.380 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:15:44.380 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.380 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.380 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.380 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.381 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:15:44.381 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:15:44.381 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.381 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.381 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:15:44.381 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.381 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:15:44.381 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.381 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.382 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.382 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:15:44.382 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:15:44.382 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.382 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.382 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.382 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:15:44.382 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:15:44.382 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.382 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.383 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.383 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:15:44.383 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.383 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.383 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:15:44.383 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.383 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.383 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.383 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:15:44.383 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:15:44.384 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.384 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.384 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.384 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:15:44.384 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:15:44.384 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.384 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:15:44.384 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.385 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.385 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.385 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:15:44.385 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.385 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.385 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.385 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:15:44.385 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:15:44.385 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.385 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.385 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.386 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:15:44.386 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:15:44.386 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.386 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.386 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.386 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:15:44.386 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.386 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.386 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:15:44.386 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.387 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.387 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:15:44.387 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:15:44.387 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.387 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.387 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.387 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.387 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:15:44.387 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:15:44.387 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:15:44.388 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:15:44.388 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.388 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.388 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:15:44.388 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:15:44.389 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.389 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.389 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.389 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:15:44.389 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:15:44.389 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.389 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:15:44.389 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.390 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.390 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:15:44.390 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.390 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.390 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.390 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:15:44.390 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:15:44.390 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.390 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.390 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.391 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:15:44.391 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:15:44.391 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:15:44.391 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.391 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:15:44.391 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.391 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:15:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:15:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:15:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:15:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:44.393 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:44.393 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:44.393 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.393 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.393 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:15:44.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.393 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:44.393 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:44.393 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:15:44.393 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.393 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.393 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:15:44.393 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00f2017640 1 -- 172.21.15.5:0/2064757393 >> v2:172.21.15.157:6812/631023601 conn(0x7f00d803be20 msgr2=0x7f00d803e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00f2017640 1 --2- 172.21.15.5:0/2064757393 >> v2:172.21.15.157:6812/631023601 conn(0x7f00d803be20 0x7f00d803e2e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f00ec06df00 tx=0x7f00dc0a6000 comp rx=0 tx=0).stop 2024-08-18T21:15:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00f2017640 10 monclient: shutdown 2024-08-18T21:15:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00f2017640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00f2017640 1 -- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f00ec13f220 msgr2=0x7f00ec138040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00ebfff640 1 -- 172.21.15.5:0/2064757393 reap_dead start 2024-08-18T21:15:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00f2017640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f00ec13f220 0x7f00ec138040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f00e400ccc0 tx=0x7f00e400a650 comp rx=0 tx=0).stop 2024-08-18T21:15:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00f2017640 1 -- 172.21.15.5:0/2064757393 shutdown_connections 2024-08-18T21:15:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00f2017640 1 --2- 172.21.15.5:0/2064757393 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f00ec13f220 0x7f00ec138040 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00f2017640 1 -- 172.21.15.5:0/2064757393 >> 172.21.15.5:0/2064757393 conn(0x7f00ec0acbc0 msgr2=0x7f00ec0ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00f2017640 1 -- 172.21.15.5:0/2064757393 shutdown_connections 2024-08-18T21:15:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.362+0000 7f00f2017640 1 -- 172.21.15.5:0/2064757393 wait complete. 2024-08-18T21:15:44.396 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:15:44.396 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-18T21:15:44.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-18T21:15:44.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.526+0000 7fc426603640 10 monclient: get_monmap_and_config 2024-08-18T21:15:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.526+0000 7fc426603640 10 monclient: build_initial_monmap 2024-08-18T21:15:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.526+0000 7fc426603640 10 monclient: monmap: 2024-08-18T21:15:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:44.532268+0000 2024-08-18T21:15:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:44.532268+0000 2024-08-18T21:15:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:44.528 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 1 Processor -- start 2024-08-18T21:15:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 1 -- start start 2024-08-18T21:15:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 10 monclient: init 2024-08-18T21:15:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 10 monclient: _add_conns ranks=[3,7,2,10,5,6,4,0,9,8,1] 2024-08-18T21:15:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4200a6ce0 0x7fc4200a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 10 monclient(hunting): picked mon.noname-g con 0x7fc4200a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc4200a7600 0x7fc420139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 10 monclient(hunting): picked mon.noname-i con 0x7fc4200a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:15:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc420139fe0 0x7fc42013a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 10 monclient(hunting): picked mon.noname-b con 0x7fc420139fe0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fc4200a5000 con 0x7fc420139fe0 2024-08-18T21:15:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc4200a4360 con 0x7fc4200a6ce0 2024-08-18T21:15:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fc4200a45d0 con 0x7fc4200a7600 2024-08-18T21:15:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc426603640 10 monclient(hunting): authenticate will time out at 1711.545430s 2024-08-18T21:15:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc420139fe0 0x7fc42013a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc420139fe0 0x7fc42013a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33752/0 (socket says 172.21.15.5:33752) 2024-08-18T21:15:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 1 -- 172.21.15.5:0/2908567303 learned_addr learned my addr 172.21.15.5:0/2908567303 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 10 monclient(hunting): get_auth_request con 0x7fc420139fe0 auth_method 0 2024-08-18T21:15:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc41f7fe640 1 --2- 172.21.15.5:0/2908567303 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc4200a7600 0x7fc420139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc41ffff640 1 --2- 172.21.15.5:0/2908567303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4200a6ce0 0x7fc4200a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc41f7fe640 10 monclient(hunting): get_auth_request con 0x7fc4200a7600 auth_method 0 2024-08-18T21:15:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc41f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc41f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc41f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc41ffff640 10 monclient(hunting): get_auth_request con 0x7fc4200a6ce0 auth_method 0 2024-08-18T21:15:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc41ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc41ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc41ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 10 monclient(hunting): handle_auth_done global_id 115148 payload 274 2024-08-18T21:15:44.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 1 -- 172.21.15.5:0/2908567303 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc4200a7600 msgr2=0x7fc420139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:44.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 1 --2- 172.21.15.5:0/2908567303 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc4200a7600 0x7fc420139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 1 -- 172.21.15.5:0/2908567303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4200a6ce0 msgr2=0x7fc4200a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:44.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 1 --2- 172.21.15.5:0/2908567303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4200a6ce0 0x7fc4200a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 10 monclient: _finish_hunting 0 2024-08-18T21:15:44.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 1 monclient: found mon.noname-b 2024-08-18T21:15:44.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:44.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:44.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.530+0000 7fc424ba0640 1 -- 172.21.15.5:0/2908567303 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4200a32d0 con 0x7fc420139fe0 2024-08-18T21:15:44.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc424ba0640 1 -- 172.21.15.5:0/2908567303 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc420139fe0 msgr2=0x7fc42013a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc424ba0640 1 --2- 172.21.15.5:0/2908567303 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc420139fe0 0x7fc42013a440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc418009eb0 tx=0x7fc41801c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb57f6cd4abb9f53 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc41effd640 1 -- 172.21.15.5:0/2908567303 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc4180090d0 con 0x7fc420139fe0 2024-08-18T21:15:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc41effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc41effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc41effd640 10 monclient: dump: 2024-08-18T21:15:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.543 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.543 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.543 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.543 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.543 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.543 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.543 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.543 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.543 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.543 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.543 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc41effd640 10 monclient: _finish_auth 0 2024-08-18T21:15:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc41effd640 10 monclient: _check_auth_tickets 2024-08-18T21:15:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc41effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc426603640 5 monclient: authenticate success, global_id 115148 2024-08-18T21:15:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc41effd640 1 -- 172.21.15.5:0/2908567303 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4180a5a30 con 0x7fc420139fe0 2024-08-18T21:15:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc41effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc426603640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc426603640 4 set_mon_vals no callback set 2024-08-18T21:15:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc41effd640 1 -- 172.21.15.5:0/2908567303 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc4180a5be0 con 0x7fc420139fe0 2024-08-18T21:15:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc41effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc41effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc41effd640 10 monclient: dump: 2024-08-18T21:15:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.546 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc426603640 10 monclient: shutdown 2024-08-18T21:15:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc426603640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc426603640 1 -- 172.21.15.5:0/2908567303 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc420139fe0 msgr2=0x7fc42013a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc426603640 1 --2- 172.21.15.5:0/2908567303 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc420139fe0 0x7fc42013a440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc418009eb0 tx=0x7fc41801c8f0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc426603640 1 -- 172.21.15.5:0/2908567303 shutdown_connections 2024-08-18T21:15:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc426603640 1 --2- 172.21.15.5:0/2908567303 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc420139fe0 0x7fc42013a440 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc426603640 1 --2- 172.21.15.5:0/2908567303 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fc4200a7600 0x7fc420139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc426603640 1 --2- 172.21.15.5:0/2908567303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4200a6ce0 0x7fc4200a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc426603640 1 -- 172.21.15.5:0/2908567303 >> 172.21.15.5:0/2908567303 conn(0x7fc4200acbc0 msgr2=0x7fc4200a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc426603640 1 -- 172.21.15.5:0/2908567303 shutdown_connections 2024-08-18T21:15:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc426603640 1 -- 172.21.15.5:0/2908567303 wait complete. 2024-08-18T21:15:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc426603640 10 monclient: build_initial_monmap 2024-08-18T21:15:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.534+0000 7fc426603640 10 monclient: monmap: 2024-08-18T21:15:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:44.548 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 1 Processor -- start 2024-08-18T21:15:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 1 -- start start 2024-08-18T21:15:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 10 monclient: init 2024-08-18T21:15:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 10 monclient: _add_conns ranks=[3,6,0,2,7,8,1,4,5] 2024-08-18T21:15:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4200a6ce0 0x7fc420134da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 10 monclient(hunting): picked mon.noname-g con 0x7fc4200a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc4200a7600 0x7fc4201352e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 10 monclient(hunting): picked mon.noname-d con 0x7fc4200a7600 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:15:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc420139fe0 0x7fc42013aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 10 monclient(hunting): picked mon.noname-a con 0x7fc420139fe0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:15:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc4200a79e0 con 0x7fc420139fe0 2024-08-18T21:15:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc4200a8220 con 0x7fc4200a6ce0 2024-08-18T21:15:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fc42013df30 con 0x7fc4200a7600 2024-08-18T21:15:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 10 monclient(hunting): authenticate will time out at 1711.552712s 2024-08-18T21:15:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41f7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc4200a7600 0x7fc4201352e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41f7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc4200a7600 0x7fc4201352e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:38368/0 (socket says 172.21.15.5:38368) 2024-08-18T21:15:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc420139fe0 0x7fc42013aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41f7fe640 1 -- 172.21.15.5:0/2333955132 learned_addr learned my addr 172.21.15.5:0/2333955132 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41f7fe640 10 monclient(hunting): get_auth_request con 0x7fc4200a7600 auth_method 0 2024-08-18T21:15:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 10 monclient(hunting): get_auth_request con 0x7fc420139fe0 auth_method 0 2024-08-18T21:15:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41ffff640 1 --2- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4200a6ce0 0x7fc420134da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41ffff640 10 monclient(hunting): get_auth_request con 0x7fc4200a6ce0 auth_method 0 2024-08-18T21:15:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 10 monclient(hunting): handle_auth_done global_id 124848 payload 824 2024-08-18T21:15:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 1 -- 172.21.15.5:0/2333955132 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc4200a7600 msgr2=0x7fc4201352e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 1 --2- 172.21.15.5:0/2333955132 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc4200a7600 0x7fc4201352e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 1 -- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4200a6ce0 msgr2=0x7fc420134da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 1 --2- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4200a6ce0 0x7fc420134da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 10 monclient: _finish_hunting 0 2024-08-18T21:15:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 1 monclient: found mon.noname-a 2024-08-18T21:15:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:15:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 1 -- 172.21.15.5:0/2333955132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42013a430 con 0x7fc420139fe0 2024-08-18T21:15:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41f7fe640 1 --2- 172.21.15.5:0/2333955132 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc4200a7600 0x7fc4201352e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:15:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 1 -- 172.21.15.5:0/2333955132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc420139fe0 msgr2=0x7fc42013aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc424ba0640 1 --2- 172.21.15.5:0/2333955132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc420139fe0 0x7fc42013aab0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc4180ab000 tx=0x7fc418019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41cff9640 1 -- 172.21.15.5:0/2333955132 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc4180bc030 con 0x7fc420139fe0 2024-08-18T21:15:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:15:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41cff9640 10 monclient: dump: 2024-08-18T21:15:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.554 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41cff9640 10 monclient: _finish_auth 0 2024-08-18T21:15:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41cff9640 10 monclient: _check_auth_tickets 2024-08-18T21:15:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41cff9640 1 -- 172.21.15.5:0/2333955132 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4180a5870 con 0x7fc420139fe0 2024-08-18T21:15:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 5 monclient: authenticate success, global_id 124848 2024-08-18T21:15:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 10 monclient: _renew_subs 2024-08-18T21:15:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:15:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 1 -- 172.21.15.5:0/2333955132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc42013dc50 con 0x7fc420139fe0 2024-08-18T21:15:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41cff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41cff9640 1 -- 172.21.15.5:0/2333955132 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc418003dc0 con 0x7fc420139fe0 2024-08-18T21:15:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:15:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41cff9640 10 monclient: dump: 2024-08-18T21:15:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.557 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 10 monclient: _renew_subs 2024-08-18T21:15:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc41e7fc640 4 set_mon_vals no callback set 2024-08-18T21:15:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:15:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.538+0000 7fc426603640 1 -- 172.21.15.5:0/2333955132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc42013e210 con 0x7fc420139fe0 2024-08-18T21:15:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc426603640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc426603640 1 --2- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc42013b7b0 0x7fc42002d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc426603640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc426603640 1 -- 172.21.15.5:0/2333955132 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc4200a7b60 con 0x7fc42013b7b0 2024-08-18T21:15:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc41cff9640 1 -- 172.21.15.5:0/2333955132 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fc418004040 con 0x7fc420139fe0 2024-08-18T21:15:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc41ffff640 1 --2- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc42013b7b0 0x7fc42002d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc41ffff640 10 monclient: get_auth_request con 0x7fc42013b7b0 auth_method 0 2024-08-18T21:15:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc41ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc41ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc41ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc41cff9640 1 --2- 172.21.15.5:0/2333955132 >> v2:172.21.15.157:6812/631023601 conn(0x7fc40c03bdf0 0x7fc40c03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc41cff9640 1 -- 172.21.15.5:0/2333955132 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(330..330 src has 22..330) ==== 3898+0+0 (secure 0 0 0) 0x7fc4180bd070 con 0x7fc420139fe0 2024-08-18T21:15:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc41ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc41ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc41ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc41f7fe640 1 --2- 172.21.15.5:0/2333955132 >> v2:172.21.15.157:6812/631023601 conn(0x7fc40c03bdf0 0x7fc40c03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc41f7fe640 10 monclient: get_auth_request con 0x7fc40c03bdf0 auth_method 0 2024-08-18T21:15:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc41ffff640 10 monclient(hunting): handle_auth_done global_id 174115 payload 824 2024-08-18T21:15:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.542+0000 7fc41ffff640 1 -- 172.21.15.5:0/2333955132 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc420139aa0 con 0x7fc42013b7b0 2024-08-18T21:15:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.546+0000 7fc41ffff640 1 -- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc42013b7b0 msgr2=0x7fc42002d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.546+0000 7fc41ffff640 1 --2- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc42013b7b0 0x7fc42002d1d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc41000f4b0 tx=0x7fc41000f970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.546+0000 7fc41f7fe640 1 --2- 172.21.15.5:0/2333955132 >> v2:172.21.15.157:6812/631023601 conn(0x7fc40c03bdf0 0x7fc40c03e2b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc4200a27f0 tx=0x7fc414008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.546+0000 7fc41cff9640 1 -- 172.21.15.5:0/2333955132 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc410019020 con 0x7fc42013b7b0 2024-08-18T21:15:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.546+0000 7fc41cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.546+0000 7fc41cff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:15:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.546+0000 7fc41cff9640 10 monclient: dump: 2024-08-18T21:15:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.563 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.546+0000 7fc41cff9640 1 -- 172.21.15.5:0/2333955132 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc410014880 con 0x7fc42013b7b0 2024-08-18T21:15:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.546+0000 7fc41cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.546+0000 7fc41cff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.546+0000 7fc41cff9640 1 -- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc42013b7b0 msgr2=0x7fc42002d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.546+0000 7fc41cff9640 1 --2- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc42013b7b0 0x7fc42002d1d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc41000f4b0 tx=0x7fc41000f970 comp rx=0 tx=0).stop 2024-08-18T21:15:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.546+0000 7fc41cff9640 1 -- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc42013b7b0 msgr2=0x7fc42002d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.546+0000 7fc41cff9640 1 --2- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc42013b7b0 0x7fc42002d1d0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc41000f4b0 tx=0x7fc41000f970 comp rx=0 tx=0).stop 2024-08-18T21:15:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.550+0000 7fc426603640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:15:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.550+0000 7fc426603640 1 --2- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc42013bb90 0x7fc42002d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.550+0000 7fc426603640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.550+0000 7fc426603640 1 -- 172.21.15.5:0/2333955132 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc420051140 con 0x7fc42013bb90 2024-08-18T21:15:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.550+0000 7fc41ffff640 1 --2- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc42013bb90 0x7fc42002d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.554+0000 7fc41ffff640 10 monclient: get_auth_request con 0x7fc42013bb90 auth_method 0 2024-08-18T21:15:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.554+0000 7fc41ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.554+0000 7fc41ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.554+0000 7fc41ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.554+0000 7fc41ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.554+0000 7fc41ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.554+0000 7fc41ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.554+0000 7fc41ffff640 10 monclient(hunting): handle_auth_done global_id 174124 payload 824 2024-08-18T21:15:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.554+0000 7fc41ffff640 1 -- 172.21.15.5:0/2333955132 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc420140a00 con 0x7fc42013bb90 2024-08-18T21:15:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.554+0000 7fc41ffff640 1 -- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc42013bb90 msgr2=0x7fc42002d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.554+0000 7fc41ffff640 1 --2- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc42013bb90 0x7fc42002d710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc41001a000 tx=0x7fc4100046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.554+0000 7fc41cff9640 1 -- 172.21.15.5:0/2333955132 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc410019040 con 0x7fc42013bb90 2024-08-18T21:15:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.554+0000 7fc41cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.554+0000 7fc41cff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:15:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.554+0000 7fc41cff9640 10 monclient: dump: 2024-08-18T21:15:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.566 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc41cff9640 1 -- 172.21.15.5:0/2333955132 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7fc41001e630 con 0x7fc42013bb90 2024-08-18T21:15:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc41cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:15:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc41cff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:15:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc41cff9640 1 -- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc42013bb90 msgr2=0x7fc42002d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc41cff9640 1 --2- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc42013bb90 0x7fc42002d710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc41001a000 tx=0x7fc4100046d0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc41cff9640 1 -- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc42013bb90 msgr2=0x7fc42002d710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc41cff9640 1 --2- 172.21.15.5:0/2333955132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc42013bb90 0x7fc42002d710 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc41001a000 tx=0x7fc4100046d0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.567 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:44.567 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:15:44.567 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:15:44.567 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:15:44.568 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 254, 2024-08-18T21:15:44.568 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 21431, 2024-08-18T21:15:44.568 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:15:44.568 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:15:44.568 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:15:44.568 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:15:44.568 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:15:44.568 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:15:44.568 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:15:44.568 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:15:44.568 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:15:44.568 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:15:44.569 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.569 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:15:44.569 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:44.569 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:15:44.569 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:15:44.569 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:44.569 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:44.569 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:44.569 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:44.569 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:44.569 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:44.569 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:44.569 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:44.570 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:44.570 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:44.570 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:44.570 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.570 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:15:44.570 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:15:44.570 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:44.570 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:44.570 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:44.570 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:44.570 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:44.570 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:44.571 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:44.571 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:44.571 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:44.571 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:44.571 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:44.571 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.571 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:15:44.571 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:15:44.571 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:15:44.571 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:15:44.571 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:15:44.572 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:15:44.572 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:44.572 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:44.572 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:15:44.572 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:15:44.572 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:15:44.572 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:15:44.572 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:15:44.572 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:15:44.572 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:15:44.572 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:44.572 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:15:44.573 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:44.573 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:44.573 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:44.573 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:44.573 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:44.573 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:44.573 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:44.573 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:44.573 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:44.573 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:44.573 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:44.573 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.574 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:15:44.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.574 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:15:44.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.574 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:15:44.574 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:15:44.574 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.574 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.574 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:15:44.574 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.575 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:15:44.575 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.575 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.575 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.575 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:15:44.575 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:15:44.575 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.575 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.575 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.576 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:15:44.576 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:15:44.576 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.576 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.576 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:15:44.576 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:15:44.577 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.577 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.577 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.577 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:15:44.577 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:15:44.577 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.577 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.577 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.577 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:15:44.578 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:15:44.578 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.578 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.578 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.578 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:15:44.578 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.578 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.578 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:15:44.578 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.579 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.579 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.579 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:15:44.579 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:15:44.579 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.579 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.579 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.579 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:15:44.579 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:15:44.580 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.580 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.580 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.580 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:15:44.580 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.580 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.580 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:15:44.580 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.580 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.581 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:15:44.581 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:15:44.581 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.581 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.581 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.581 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:15:44.581 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:15:44.581 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:15:44.582 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:15:44.582 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.583 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.583 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:15:44.583 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:15:44.583 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.583 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.583 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.584 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:15:44.584 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:15:44.584 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.584 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:15:44.584 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.584 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:15:44.585 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.585 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.585 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.585 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:15:44.585 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:15:44.585 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.585 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.585 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.585 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:15:44.585 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:15:44.585 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.586 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.586 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.586 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:15:44.586 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.586 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.586 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:15:44.586 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.586 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.586 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.587 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:15:44.587 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:15:44.587 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.587 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.587 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.587 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.587 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:15:44.587 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:15:44.587 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.587 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.587 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.587 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.588 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:15:44.588 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.588 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.588 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.588 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:15:44.588 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.588 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.588 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.588 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:15:44.588 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:15:44.588 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.588 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.589 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.589 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.589 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:15:44.589 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:15:44.589 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.589 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.589 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.589 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.589 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:15:44.589 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.590 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.590 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.590 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:15:44.590 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.590 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.590 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.590 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:15:44.590 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:15:44.590 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.590 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.590 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.590 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.591 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.591 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:15:44.591 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:15:44.591 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.591 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:44.591 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:44.591 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:44.591 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.591 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.591 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:15:44.591 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.591 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:44.591 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:44.592 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:44.592 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.592 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.592 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:15:44.592 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc426603640 1 -- 172.21.15.5:0/2333955132 >> v2:172.21.15.157:6812/631023601 conn(0x7fc40c03bdf0 msgr2=0x7fc40c03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc426603640 1 --2- 172.21.15.5:0/2333955132 >> v2:172.21.15.157:6812/631023601 conn(0x7fc40c03bdf0 0x7fc40c03e2b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc4200a27f0 tx=0x7fc414008040 comp rx=0 tx=0).stop 2024-08-18T21:15:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc426603640 10 monclient: shutdown 2024-08-18T21:15:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc426603640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc426603640 1 -- 172.21.15.5:0/2333955132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc420139fe0 msgr2=0x7fc42013aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc426603640 1 --2- 172.21.15.5:0/2333955132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc420139fe0 0x7fc42013aab0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc4180ab000 tx=0x7fc418019690 comp rx=0 tx=0).stop 2024-08-18T21:15:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc424ba0640 1 -- 172.21.15.5:0/2333955132 reap_dead start 2024-08-18T21:15:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc424ba0640 1 -- 172.21.15.5:0/2333955132 reap_dead start 2024-08-18T21:15:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc426603640 1 -- 172.21.15.5:0/2333955132 shutdown_connections 2024-08-18T21:15:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc426603640 1 -- 172.21.15.5:0/2333955132 >> 172.21.15.5:0/2333955132 conn(0x7fc4200acbc0 msgr2=0x7fc420138580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc426603640 1 -- 172.21.15.5:0/2333955132 shutdown_connections 2024-08-18T21:15:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.558+0000 7fc426603640 1 -- 172.21.15.5:0/2333955132 wait complete. 2024-08-18T21:15:44.595 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:15:44.595 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-18T21:15:44.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-18T21:15:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 10 monclient: get_monmap_and_config 2024-08-18T21:15:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 10 monclient: build_initial_monmap 2024-08-18T21:15:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 10 monclient: monmap: 2024-08-18T21:15:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:44.729489+0000 2024-08-18T21:15:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:44.729489+0000 2024-08-18T21:15:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:44.725 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 1 Processor -- start 2024-08-18T21:15:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 1 -- start start 2024-08-18T21:15:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 10 monclient: init 2024-08-18T21:15:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 10 monclient: _add_conns ranks=[3,0,5,1,2,4,7,9,8,10,6] 2024-08-18T21:15:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f683006c950 0x7f68300a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 10 monclient(hunting): picked mon.noname-g con 0x7f683006c950 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f68300a1b60 addr v1:172.21.15.5:6789/0 2024-08-18T21:15:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f683006d440 0x7f683013eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 10 monclient(hunting): picked mon.noname-h con 0x7f683006d440 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68300a03e0 con 0x7f68300a1b60 2024-08-18T21:15:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f68300a11a0 con 0x7f683006c950 2024-08-18T21:15:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f683009fdd0 con 0x7f683006d440 2024-08-18T21:15:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6835c00640 10 monclient(hunting): authenticate will time out at 1711.743341s 2024-08-18T21:15:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6827fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f68300a1b60 0x7f683006cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36122/0 (socket says 172.21.15.5:36122) 2024-08-18T21:15:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f6827fff640 1 -- 172.21.15.5:0/4168023115 learned_addr learned my addr 172.21.15.5:0/4168023115 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:15:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f682f7fe640 1 --2- 172.21.15.5:0/4168023115 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f683006c950 0x7f68300a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f682f7fe640 10 monclient(hunting): get_auth_request con 0x7f683006c950 auth_method 0 2024-08-18T21:15:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f682f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f682f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f682f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f682ffff640 1 --2- 172.21.15.5:0/4168023115 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f683006d440 0x7f683013eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f682ffff640 10 monclient(hunting): get_auth_request con 0x7f683006d440 auth_method 0 2024-08-18T21:15:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f682ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f682ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.726+0000 7f682ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.730+0000 7f682f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.730+0000 7f682f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.730+0000 7f682f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.730+0000 7f682ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.730+0000 7f682ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.730+0000 7f682ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.730+0000 7f682f7fe640 10 monclient(hunting): handle_auth_done global_id 134526 payload 274 2024-08-18T21:15:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.730+0000 7f682f7fe640 1 -- 172.21.15.5:0/4168023115 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f683006d440 msgr2=0x7f683013eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.730+0000 7f682f7fe640 1 --2- 172.21.15.5:0/4168023115 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f683006d440 0x7f683013eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.730+0000 7f682f7fe640 1 -- 172.21.15.5:0/4168023115 >> v1:172.21.15.5:6789/0 conn(0x7f68300a1b60 legacy=0x7f683006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.730+0000 7f682f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:15:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.730+0000 7f682f7fe640 1 monclient: found mon.noname-g 2024-08-18T21:15:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.730+0000 7f682f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.730+0000 7f682f7fe640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:15:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.730+0000 7f682f7fe640 1 -- 172.21.15.5:0/4168023115 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68300a0ec0 con 0x7f683006c950 2024-08-18T21:15:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682f7fe640 1 -- 172.21.15.5:0/4168023115 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f683006c950 msgr2=0x7f68300a4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682f7fe640 1 --2- 172.21.15.5:0/4168023115 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f683006c950 0x7f68300a4b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f68200097f0 tx=0x7f682001c370 comp rx=0 tx=0).ready entity=mon.3 client_cookie=835ef9d5934eca83 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682effd640 1 -- 172.21.15.5:0/4168023115 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68200b0070 con 0x7f683006c950 2024-08-18T21:15:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682effd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:15:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682effd640 10 monclient: dump: 2024-08-18T21:15:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.733 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682effd640 10 monclient: _finish_auth 0 2024-08-18T21:15:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682effd640 10 monclient: _check_auth_tickets 2024-08-18T21:15:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682effd640 1 -- 172.21.15.5:0/4168023115 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68200aa810 con 0x7f683006c950 2024-08-18T21:15:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682effd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682effd640 1 -- 172.21.15.5:0/4168023115 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68200aae30 con 0x7f683006c950 2024-08-18T21:15:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 5 monclient: authenticate success, global_id 134526 2024-08-18T21:15:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 4 set_mon_vals no callback set 2024-08-18T21:15:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:15:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682effd640 10 monclient: dump: 2024-08-18T21:15:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.735 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 10 monclient: shutdown 2024-08-18T21:15:44.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:44.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 1 -- 172.21.15.5:0/4168023115 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f683006c950 msgr2=0x7f68300a4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 1 --2- 172.21.15.5:0/4168023115 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f683006c950 0x7f68300a4b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f68200097f0 tx=0x7f682001c370 comp rx=0 tx=0).stop 2024-08-18T21:15:44.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 1 -- 172.21.15.5:0/4168023115 shutdown_connections 2024-08-18T21:15:44.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 1 --2- 172.21.15.5:0/4168023115 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f683006d440 0x7f683013eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 1 --2- 172.21.15.5:0/4168023115 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f683006c950 0x7f68300a4b80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 1 -- 172.21.15.5:0/4168023115 >> 172.21.15.5:0/4168023115 conn(0x7f68300688d0 msgr2=0x7f6830068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:44.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 1 -- 172.21.15.5:0/4168023115 shutdown_connections 2024-08-18T21:15:44.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 1 -- 172.21.15.5:0/4168023115 wait complete. 2024-08-18T21:15:44.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 10 monclient: build_initial_monmap 2024-08-18T21:15:44.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 10 monclient: monmap: 2024-08-18T21:15:44.742 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:44.742 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:44.742 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:44.742 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:44.742 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:44.742 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.742 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:44.742 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:44.742 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:44.742 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:44.742 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:44.743 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:44.743 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:44.743 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:44.743 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:44.743 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 1 Processor -- start 2024-08-18T21:15:44.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 1 -- start start 2024-08-18T21:15:44.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 10 monclient: init 2024-08-18T21:15:44.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:44.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 10 monclient: _add_conns ranks=[3,1,0,6,8,5,7,2,4] 2024-08-18T21:15:44.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f683006c950 0x7f683013d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 10 monclient(hunting): picked mon.noname-g con 0x7f683006c950 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:44.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f683006d440 0x7f683013b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 10 monclient(hunting): picked mon.noname-f con 0x7f683006d440 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:15:44.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68301346a0 0x7f68301ced00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 10 monclient(hunting): picked mon.noname-a con 0x7f68301346a0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:15:44.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6830141c00 con 0x7f68301346a0 2024-08-18T21:15:44.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6830141a80 con 0x7f683006d440 2024-08-18T21:15:44.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6830141d80 con 0x7f683006c950 2024-08-18T21:15:44.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:44.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f6835c00640 10 monclient(hunting): authenticate will time out at 1711.751692s 2024-08-18T21:15:44.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68301346a0 0x7f68301ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68301346a0 0x7f68301ced00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53768/0 (socket says 172.21.15.5:53768) 2024-08-18T21:15:44.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.734+0000 7f682ffff640 1 -- 172.21.15.5:0/841472575 learned_addr learned my addr 172.21.15.5:0/841472575 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:44.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 10 monclient(hunting): get_auth_request con 0x7f68301346a0 auth_method 0 2024-08-18T21:15:44.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682f7fe640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f683006c950 0x7f683013d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6827fff640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f683006d440 0x7f683013b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682f7fe640 10 monclient(hunting): get_auth_request con 0x7f683006c950 auth_method 0 2024-08-18T21:15:44.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6827fff640 10 monclient(hunting): get_auth_request con 0x7f683006d440 auth_method 0 2024-08-18T21:15:44.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6827fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6827fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6827fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 10 monclient(hunting): handle_auth_done global_id 124857 payload 824 2024-08-18T21:15:44.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 1 -- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f683006c950 msgr2=0x7f683013d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f683006c950 0x7f683013d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 1 -- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f683006d440 msgr2=0x7f683013b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f683006d440 0x7f683013b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 10 monclient: _finish_hunting 0 2024-08-18T21:15:44.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 1 monclient: found mon.noname-a 2024-08-18T21:15:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:15:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 1 -- 172.21.15.5:0/841472575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6830068f60 con 0x7f68301346a0 2024-08-18T21:15:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6827fff640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f683006d440 0x7f683013b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:15:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 1 -- 172.21.15.5:0/841472575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68301346a0 msgr2=0x7f68301ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682ffff640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68301346a0 0x7f68301ced00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f682800efc0 tx=0x7f682800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682cff9640 1 -- 172.21.15.5:0/841472575 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6828018020 con 0x7f68301346a0 2024-08-18T21:15:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:15:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682cff9640 10 monclient: dump: 2024-08-18T21:15:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.748 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682cff9640 10 monclient: _finish_auth 0 2024-08-18T21:15:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682cff9640 10 monclient: _check_auth_tickets 2024-08-18T21:15:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6835c00640 5 monclient: authenticate success, global_id 124857 2024-08-18T21:15:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682cff9640 1 -- 172.21.15.5:0/841472575 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68280148f0 con 0x7f68301346a0 2024-08-18T21:15:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682cff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682cff9640 1 -- 172.21.15.5:0/841472575 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68280133e0 con 0x7f68301346a0 2024-08-18T21:15:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6835c00640 10 monclient: _renew_subs 2024-08-18T21:15:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6835c00640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:15:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6835c00640 1 -- 172.21.15.5:0/841472575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683006d030 con 0x7f68301346a0 2024-08-18T21:15:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682dffb640 4 set_mon_vals no callback set 2024-08-18T21:15:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:15:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f682cff9640 10 monclient: dump: 2024-08-18T21:15:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.751 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6835c00640 10 monclient: _renew_subs 2024-08-18T21:15:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6835c00640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:15:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6835c00640 1 -- 172.21.15.5:0/841472575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f683013c5e0 con 0x7f68301346a0 2024-08-18T21:15:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6835c00640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6835c00640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68300a1b60 0x7f683002d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6835c00640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.738+0000 7f6835c00640 1 -- 172.21.15.5:0/841472575 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f683013e100 con 0x7f68300a1b60 2024-08-18T21:15:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682cff9640 1 -- 172.21.15.5:0/841472575 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f682801b020 con 0x7f68301346a0 2024-08-18T21:15:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682f7fe640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68300a1b60 0x7f683002d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682f7fe640 10 monclient: get_auth_request con 0x7f68300a1b60 auth_method 0 2024-08-18T21:15:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682cff9640 1 --2- 172.21.15.5:0/841472575 >> v2:172.21.15.157:6812/631023601 conn(0x7f681003bdf0 0x7f681003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682cff9640 1 -- 172.21.15.5:0/841472575 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(330..330 src has 22..330) ==== 3898+0+0 (secure 0 0 0) 0x7f682804f500 con 0x7f68301346a0 2024-08-18T21:15:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f6827fff640 1 --2- 172.21.15.5:0/841472575 >> v2:172.21.15.157:6812/631023601 conn(0x7f681003bdf0 0x7f681003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682f7fe640 10 monclient(hunting): handle_auth_done global_id 134544 payload 824 2024-08-18T21:15:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682f7fe640 1 -- 172.21.15.5:0/841472575 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f683006dbf0 con 0x7f68300a1b60 2024-08-18T21:15:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f6827fff640 10 monclient: get_auth_request con 0x7f681003bdf0 auth_method 0 2024-08-18T21:15:44.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682f7fe640 1 -- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68300a1b60 msgr2=0x7f683002d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682f7fe640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68300a1b60 0x7f683002d1d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f68300a4af0 tx=0x7f6820019110 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682cff9640 1 -- 172.21.15.5:0/841472575 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68200ba070 con 0x7f68300a1b60 2024-08-18T21:15:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682cff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:15:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f682cff9640 10 monclient: dump: 2024-08-18T21:15:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.756 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.742+0000 7f6827fff640 1 --2- 172.21.15.5:0/841472575 >> v2:172.21.15.157:6812/631023601 conn(0x7f681003bdf0 0x7f681003e2b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6818006fd0 tx=0x7f6818008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.746+0000 7f682cff9640 1 -- 172.21.15.5:0/841472575 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6820003be0 con 0x7f68300a1b60 2024-08-18T21:15:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.746+0000 7f682cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.746+0000 7f682cff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.746+0000 7f682cff9640 1 -- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68300a1b60 msgr2=0x7f683002d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.746+0000 7f682cff9640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68300a1b60 0x7f683002d1d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f68300a4af0 tx=0x7f6820019110 comp rx=0 tx=0).stop 2024-08-18T21:15:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.746+0000 7f682cff9640 1 -- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68300a1b60 msgr2=0x7f683002d1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.746+0000 7f682cff9640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68300a1b60 0x7f683002d1d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.750+0000 7f6835c00640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:15:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.750+0000 7f6835c00640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6830134b20 0x7f683002d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.750+0000 7f6835c00640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.750+0000 7f6835c00640 1 -- 172.21.15.5:0/841472575 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6830051140 con 0x7f6830134b20 2024-08-18T21:15:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.750+0000 7f682f7fe640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6830134b20 0x7f683002d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.750+0000 7f682f7fe640 10 monclient: get_auth_request con 0x7f6830134b20 auth_method 0 2024-08-18T21:15:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.750+0000 7f682f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.750+0000 7f682f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.750+0000 7f682f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.750+0000 7f682f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.750+0000 7f682f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.750+0000 7f682f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.750+0000 7f682f7fe640 10 monclient(hunting): handle_auth_done global_id 134553 payload 824 2024-08-18T21:15:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.750+0000 7f682f7fe640 1 -- 172.21.15.5:0/841472575 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f68300a4b80 con 0x7f6830134b20 2024-08-18T21:15:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f682f7fe640 1 -- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6830134b20 msgr2=0x7f683002d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f682f7fe640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6830134b20 0x7f683002d710 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f682001cc10 tx=0x7f68200a8000 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f682cff9640 1 -- 172.21.15.5:0/841472575 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68200b0040 con 0x7f6830134b20 2024-08-18T21:15:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f682cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f682cff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:15:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f682cff9640 10 monclient: dump: 2024-08-18T21:15:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:44.759 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:44.759 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:44.759 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:44.759 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:44.759 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:44.759 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:44.759 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:44.759 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:44.759 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:44.759 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:44.759 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:44.759 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:44.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f682cff9640 1 -- 172.21.15.5:0/841472575 <== mon.3 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9582 (secure 0 0 0) 0x7f68200b6660 con 0x7f6830134b20 2024-08-18T21:15:44.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f682cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:15:44.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f682cff9640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:15:44.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f682cff9640 1 -- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6830134b20 msgr2=0x7f683002d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f682cff9640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6830134b20 0x7f683002d710 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f682001cc10 tx=0x7f68200a8000 comp rx=0 tx=0).stop 2024-08-18T21:15:44.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f682cff9640 1 -- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6830134b20 msgr2=0x7f683002d710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:44.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f682cff9640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6830134b20 0x7f683002d710 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f682001cc10 tx=0x7f68200a8000 comp rx=0 tx=0).stop 2024-08-18T21:15:44.760 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:44.760 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:15:44.760 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:15:44.760 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:15:44.761 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 254, 2024-08-18T21:15:44.761 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 104218, 2024-08-18T21:15:44.761 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:15:44.761 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:15:44.761 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:15:44.761 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:15:44.761 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:15:44.761 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:15:44.761 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:15:44.761 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:15:44.761 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:15:44.761 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:15:44.761 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.762 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:15:44.762 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:44.762 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:15:44.762 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:15:44.762 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:44.762 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:44.762 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:44.762 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:44.762 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:44.762 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:44.762 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:44.762 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:44.762 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:44.763 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:44.763 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:44.763 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.763 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:15:44.763 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:15:44.763 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:44.763 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:44.763 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:44.763 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:44.763 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:44.763 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:44.763 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:44.763 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:44.763 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:44.764 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:44.764 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:44.764 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.764 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:15:44.764 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:15:44.764 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:15:44.764 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:15:44.764 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:15:44.764 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:15:44.764 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:44.764 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:44.764 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:15:44.764 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:15:44.765 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:15:44.765 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:15:44.765 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:15:44.765 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:15:44.765 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:15:44.765 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:44.765 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:15:44.765 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:44.765 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:44.765 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:44.765 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:44.765 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:44.765 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:44.766 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:44.766 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:44.766 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:44.766 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:44.766 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:44.766 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.766 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:15:44.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.766 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:15:44.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.766 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:15:44.766 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:15:44.766 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.767 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.767 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.767 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:15:44.767 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.767 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.767 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:15:44.767 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.767 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.767 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.767 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:15:44.768 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:15:44.768 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.768 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.768 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.768 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:15:44.768 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:15:44.768 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.768 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.768 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.768 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:15:44.769 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.769 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.769 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:15:44.769 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.769 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.769 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.769 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:15:44.769 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:15:44.769 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.769 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.769 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.770 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:15:44.770 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:15:44.770 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.770 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.770 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.770 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:15:44.770 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.770 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.771 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:15:44.771 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.771 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.771 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.771 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:15:44.771 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:15:44.771 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.771 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.771 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.771 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:15:44.771 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:15:44.772 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.772 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.772 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.772 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:15:44.772 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.772 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.772 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:15:44.772 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.772 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.772 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.773 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:15:44.773 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:15:44.773 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.773 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.773 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.773 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.773 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:15:44.773 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:15:44.773 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.773 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.773 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.773 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.773 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:15:44.774 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.774 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.774 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.774 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:15:44.774 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.774 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.774 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.774 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:15:44.774 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:15:44.774 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.774 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.775 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.775 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:15:44.775 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:15:44.775 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.775 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.775 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.775 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:15:44.775 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.775 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:15:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:15:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:15:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:15:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:15:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:15:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:15:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:15:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:15:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:15:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:15:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:15:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:15:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:15:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:15:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:15:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:15:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:15:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:15:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:15:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:15:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:15:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:15:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": [ 2024-08-18T21:15:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:15:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 3 2024-08-18T21:15:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": [ 2024-08-18T21:15:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:44.784 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:44.784 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:44.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:44.784 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:15:44.784 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:44.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f6835c00640 1 -- 172.21.15.5:0/841472575 >> v2:172.21.15.157:6812/631023601 conn(0x7f681003bdf0 msgr2=0x7f681003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f6835c00640 1 --2- 172.21.15.5:0/841472575 >> v2:172.21.15.157:6812/631023601 conn(0x7f681003bdf0 0x7f681003e2b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6818006fd0 tx=0x7f6818008040 comp rx=0 tx=0).stop 2024-08-18T21:15:44.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f6835c00640 10 monclient: shutdown 2024-08-18T21:15:44.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f6835c00640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f6835c00640 1 -- 172.21.15.5:0/841472575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68301346a0 msgr2=0x7f68301ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f6835c00640 1 --2- 172.21.15.5:0/841472575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68301346a0 0x7f68301ced00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f682800efc0 tx=0x7f682800c490 comp rx=0 tx=0).stop 2024-08-18T21:15:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f682ffff640 1 -- 172.21.15.5:0/841472575 reap_dead start 2024-08-18T21:15:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f682ffff640 1 -- 172.21.15.5:0/841472575 reap_dead start 2024-08-18T21:15:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f6835c00640 1 -- 172.21.15.5:0/841472575 shutdown_connections 2024-08-18T21:15:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f6835c00640 1 -- 172.21.15.5:0/841472575 >> 172.21.15.5:0/841472575 conn(0x7f68300688d0 msgr2=0x7f68300725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f6835c00640 1 -- 172.21.15.5:0/841472575 shutdown_connections 2024-08-18T21:15:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.754+0000 7f6835c00640 1 -- 172.21.15.5:0/841472575 wait complete. 2024-08-18T21:15:44.786 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:15:44.787 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-18T21:15:44.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-18T21:15:44.864 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:44.864 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32816]: starting. 2024-08-18T21:15:44.864 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32816]: deleting pool ceph_test_rados_delete_pools_parallel.smithi157-32694 2024-08-18T21:15:44.864 INFO:teuthology.orchestra.run.smithi157.stdout:process_4_[32816]: shutting down. 2024-08-18T21:15:44.867 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:44.867 INFO:teuthology.orchestra.run.smithi157.stdout:******************************* 2024-08-18T21:15:44.868 INFO:teuthology.orchestra.run.smithi157.stdout:******* SUCCESS ********** 2024-08-18T21:15:44.871 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-08-18T21:15:44.881 INFO:tasks.mon_thrash:joining mon_thrasher 2024-08-18T21:15:44.881 ERROR:teuthology.run_tasks:Manager failed: mon_thrash Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 466, in task thrash_proc.stop_and_join() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 178, in stop_and_join return self.join() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 170, in join self.stopping.set() AttributeError: 'bool' object has no attribute 'set' 2024-08-18T21:15:44.882 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-18T21:15:44.999 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T21:15:44.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T21:15:45.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.914+0000 7f1b1169e640 10 monclient: get_monmap_and_config 2024-08-18T21:15:45.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.914+0000 7f1b1169e640 10 monclient: build_initial_monmap 2024-08-18T21:15:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.914+0000 7f1b1169e640 10 monclient: monmap: 2024-08-18T21:15:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:44.919427+0000 2024-08-18T21:15:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:44.919427+0000 2024-08-18T21:15:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:45.010 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.914+0000 7f1b1169e640 1 Processor -- start 2024-08-18T21:15:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.914+0000 7f1b1169e640 1 -- start start 2024-08-18T21:15:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.914+0000 7f1b1169e640 10 monclient: init 2024-08-18T21:15:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b1169e640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b1169e640 10 monclient: _add_conns ranks=[3,2,10,6,4,8,7,1,9,5,0] 2024-08-18T21:15:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b1169e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b0c0a6bd0 0x7f1b0c0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b1169e640 10 monclient(hunting): picked mon.noname-g con 0x7f1b0c0a6bd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b1169e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b0c09f080 0x7f1b0c0a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b1169e640 10 monclient(hunting): picked mon.noname-b con 0x7f1b0c09f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b1169e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1b0c139990 0x7f1b0c139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b1169e640 10 monclient(hunting): picked mon.noname-f con 0x7f1b0c139990 addr v2:172.21.15.157:3300/0 2024-08-18T21:15:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b1169e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b1169e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1b0c09e4c0 con 0x7f1b0c139990 2024-08-18T21:15:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b1169e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b1169e640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0c06f930 con 0x7f1b0c09f080 2024-08-18T21:15:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b1169e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b1169e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0c0a7a30 con 0x7f1b0c0a6bd0 2024-08-18T21:15:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b1169e640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b1169e640 10 monclient(hunting): authenticate will time out at 1711.932653s 2024-08-18T21:15:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b0c09f080 0x7f1b0c0a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b0c09f080 0x7f1b0c0a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33768/0 (socket says 172.21.15.5:33768) 2024-08-18T21:15:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 1 -- 172.21.15.5:0/1926040998 learned_addr learned my addr 172.21.15.5:0/1926040998 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 10 monclient(hunting): get_auth_request con 0x7f1b0c09f080 auth_method 0 2024-08-18T21:15:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0affd640 1 --2- 172.21.15.5:0/1926040998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b0c0a6bd0 0x7f1b0c0a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0affd640 10 monclient(hunting): get_auth_request con 0x7f1b0c0a6bd0 auth_method 0 2024-08-18T21:15:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0b7fe640 1 --2- 172.21.15.5:0/1926040998 >> v2:172.21.15.157:3300/0 conn(0x7f1b0c139990 0x7f1b0c139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0b7fe640 10 monclient(hunting): get_auth_request con 0x7f1b0c139990 auth_method 0 2024-08-18T21:15:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 10 monclient(hunting): handle_auth_done global_id 115157 payload 274 2024-08-18T21:15:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 1 -- 172.21.15.5:0/1926040998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b0c0a6bd0 msgr2=0x7f1b0c0a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 1 --2- 172.21.15.5:0/1926040998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b0c0a6bd0 0x7f1b0c0a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 1 -- 172.21.15.5:0/1926040998 >> v2:172.21.15.157:3300/0 conn(0x7f1b0c139990 msgr2=0x7f1b0c139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 1 --2- 172.21.15.5:0/1926040998 >> v2:172.21.15.157:3300/0 conn(0x7f1b0c139990 0x7f1b0c139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:15:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 1 monclient: found mon.noname-b 2024-08-18T21:15:45.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:45.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:45.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.918+0000 7f1b0a7fc640 1 -- 172.21.15.5:0/1926040998 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c0a7fb0 con 0x7f1b0c09f080 2024-08-18T21:15:45.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b0a7fc640 1 -- 172.21.15.5:0/1926040998 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b0c09f080 msgr2=0x7f1b0c0a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:45.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b0a7fc640 1 --2- 172.21.15.5:0/1926040998 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b0c09f080 0x7f1b0c0a74f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009e80 tx=0x7f1b0001c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bc5ba1b7565a5a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b09ffb640 1 -- 172.21.15.5:0/1926040998 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1b000090d0 con 0x7f1b0c09f080 2024-08-18T21:15:45.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b09ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b09ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:45.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b09ffb640 10 monclient: dump: 2024-08-18T21:15:45.014 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.014 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.014 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.014 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.015 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b09ffb640 10 monclient: _finish_auth 0 2024-08-18T21:15:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b09ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:15:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b09ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b09ffb640 1 -- 172.21.15.5:0/1926040998 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b000a5a70 con 0x7f1b0c09f080 2024-08-18T21:15:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 5 monclient: authenticate success, global_id 115157 2024-08-18T21:15:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:15:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b09ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b09ffb640 1 -- 172.21.15.5:0/1926040998 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1b000a5c20 con 0x7f1b0c09f080 2024-08-18T21:15:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b09ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 4 set_mon_vals no callback set 2024-08-18T21:15:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b09ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b09ffb640 10 monclient: dump: 2024-08-18T21:15:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.018 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 10 monclient: shutdown 2024-08-18T21:15:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 1 -- 172.21.15.5:0/1926040998 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b0c09f080 msgr2=0x7f1b0c0a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 1 --2- 172.21.15.5:0/1926040998 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b0c09f080 0x7f1b0c0a74f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009e80 tx=0x7f1b0001c8d0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 1 -- 172.21.15.5:0/1926040998 shutdown_connections 2024-08-18T21:15:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 1 --2- 172.21.15.5:0/1926040998 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1b0c09f080 0x7f1b0c0a74f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 1 --2- 172.21.15.5:0/1926040998 >> v2:172.21.15.157:3300/0 conn(0x7f1b0c139990 0x7f1b0c139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 1 --2- 172.21.15.5:0/1926040998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b0c0a6bd0 0x7f1b0c0a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 1 -- 172.21.15.5:0/1926040998 >> 172.21.15.5:0/1926040998 conn(0x7f1b0c068700 msgr2=0x7f1b0c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 1 -- 172.21.15.5:0/1926040998 shutdown_connections 2024-08-18T21:15:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 1 -- 172.21.15.5:0/1926040998 wait complete. 2024-08-18T21:15:45.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 10 monclient: build_initial_monmap 2024-08-18T21:15:45.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 10 monclient: monmap: 2024-08-18T21:15:45.019 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:45.019 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:45.019 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:45.019 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:45.019 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:45.019 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.019 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:45.019 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:45.019 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:45.019 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:45.019 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:45.020 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:45.020 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:45.020 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:45.020 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:45.020 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 1 Processor -- start 2024-08-18T21:15:45.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 1 -- start start 2024-08-18T21:15:45.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.922+0000 7f1b1169e640 10 monclient: init 2024-08-18T21:15:45.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:45.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 10 monclient: _add_conns ranks=[4,5,6,8,1,0,7,3,2] 2024-08-18T21:15:45.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f1b0c09f080 0x7f1b0c1387a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 10 monclient(hunting): picked mon.noname-c con 0x7f1b0c09f080 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:15:45.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c0a6bd0 0x7f1b0c138ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 10 monclient(hunting): picked mon.noname-h con 0x7f1b0c0a6bd0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1b0c139990 0x7f1b0c13d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 10 monclient(hunting): picked mon.noname-d con 0x7f1b0c139990 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:15:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f1b0c0a89f0 con 0x7f1b0c09f080 2024-08-18T21:15:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f1b0c0a7ce0 con 0x7f1b0c0a6bd0 2024-08-18T21:15:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f1b0c143610 con 0x7f1b0c139990 2024-08-18T21:15:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 10 monclient(hunting): authenticate will time out at 1711.940345s 2024-08-18T21:15:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0affd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f1b0c09f080 0x7f1b0c1387a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1b0c139990 0x7f1b0c13d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0affd640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f1b0c09f080 0x7f1b0c1387a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:38528/0 (socket says 172.21.15.5:38528) 2024-08-18T21:15:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0affd640 1 -- 172.21.15.5:0/593046600 learned_addr learned my addr 172.21.15.5:0/593046600 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1b0c139990 0x7f1b0c13d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:38382/0 (socket says 172.21.15.5:38382) 2024-08-18T21:15:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0affd640 10 monclient(hunting): get_auth_request con 0x7f1b0c09f080 auth_method 0 2024-08-18T21:15:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 10 monclient(hunting): get_auth_request con 0x7f1b0c139990 auth_method 0 2024-08-18T21:15:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0a7fc640 1 --2- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c0a6bd0 0x7f1b0c138ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0a7fc640 10 monclient(hunting): get_auth_request con 0x7f1b0c0a6bd0 auth_method 0 2024-08-18T21:15:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 10 monclient(hunting): handle_auth_done global_id 174147 payload 824 2024-08-18T21:15:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 1 -- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c0a6bd0 msgr2=0x7f1b0c138ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 1 --2- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c0a6bd0 0x7f1b0c138ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 1 -- 172.21.15.5:0/593046600 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f1b0c09f080 msgr2=0x7f1b0c1387a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 1 --2- 172.21.15.5:0/593046600 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f1b0c09f080 0x7f1b0c1387a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:15:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 1 monclient: found mon.noname-d 2024-08-18T21:15:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:15:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 1 -- 172.21.15.5:0/593046600 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c124240 con 0x7f1b0c139990 2024-08-18T21:15:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 1 -- 172.21.15.5:0/593046600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1b0c139990 msgr2=0x7f1b0c13d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b0b7fe640 1 --2- 172.21.15.5:0/593046600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1b0c139990 0x7f1b0c13d9e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400d4b0 tx=0x7f1b0400d970 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1af37fe640 1 -- 172.21.15.5:0/593046600 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1b04012c70 con 0x7f1b0c139990 2024-08-18T21:15:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1af37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1af37fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:15:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1af37fe640 10 monclient: dump: 2024-08-18T21:15:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.027 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1af37fe640 10 monclient: _finish_auth 0 2024-08-18T21:15:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1af37fe640 10 monclient: _check_auth_tickets 2024-08-18T21:15:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1af37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1af37fe640 1 -- 172.21.15.5:0/593046600 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b04014430 con 0x7f1b0c139990 2024-08-18T21:15:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 5 monclient: authenticate success, global_id 174147 2024-08-18T21:15:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 10 monclient: _renew_subs 2024-08-18T21:15:45.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:15:45.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 1 -- 172.21.15.5:0/593046600 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0c0ab890 con 0x7f1b0c139990 2024-08-18T21:15:45.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1af37fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:45.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1af37fe640 1 -- 172.21.15.5:0/593046600 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1b04014a50 con 0x7f1b0c139990 2024-08-18T21:15:45.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1af37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1af37fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:15:45.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1af37fe640 10 monclient: dump: 2024-08-18T21:15:45.028 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.028 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.028 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.028 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.028 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.029 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 10 monclient: _renew_subs 2024-08-18T21:15:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b08ff9640 4 set_mon_vals no callback set 2024-08-18T21:15:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:15:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.926+0000 7f1b1169e640 1 -- 172.21.15.5:0/593046600 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b0c13fdb0 con 0x7f1b0c139990 2024-08-18T21:15:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b1169e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1af37fe640 1 -- 172.21.15.5:0/593046600 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f1b0401b030 con 0x7f1b0c139990 2024-08-18T21:15:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b1169e640 1 --2- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c13df20 0x7f1b0c13e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b1169e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b1169e640 1 -- 172.21.15.5:0/593046600 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f1b0c051140 con 0x7f1b0c13df20 2024-08-18T21:15:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1af37fe640 1 --2- 172.21.15.5:0/593046600 >> v2:172.21.15.157:6812/631023601 conn(0x7f1af803bdc0 0x7f1af803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1af37fe640 1 -- 172.21.15.5:0/593046600 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(331..331 src has 22..331) ==== 3506+0+0 (secure 0 0 0) 0x7f1b04019020 con 0x7f1b0c139990 2024-08-18T21:15:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b0affd640 1 --2- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c13df20 0x7f1b0c13e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b0affd640 10 monclient: get_auth_request con 0x7f1b0c13df20 auth_method 0 2024-08-18T21:15:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b0affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b0affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b0affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b0affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b0affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b0affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b0a7fc640 1 --2- 172.21.15.5:0/593046600 >> v2:172.21.15.157:6812/631023601 conn(0x7f1af803bdc0 0x7f1af803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b0a7fc640 10 monclient: get_auth_request con 0x7f1af803bdc0 auth_method 0 2024-08-18T21:15:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b0affd640 10 monclient(hunting): handle_auth_done global_id 95747 payload 824 2024-08-18T21:15:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b0affd640 1 -- 172.21.15.5:0/593046600 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b0c0008e0 con 0x7f1b0c13df20 2024-08-18T21:15:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b0affd640 1 -- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c13df20 msgr2=0x7f1b0c13e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b0affd640 1 --2- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c13df20 0x7f1b0c13e300 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1afc010890 tx=0x7f1afc010d50 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1af37fe640 1 -- 172.21.15.5:0/593046600 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1afc0044a0 con 0x7f1b0c13df20 2024-08-18T21:15:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1af37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1af37fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:15:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1af37fe640 10 monclient: dump: 2024-08-18T21:15:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.033 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.930+0000 7f1b0a7fc640 1 --2- 172.21.15.5:0/593046600 >> v2:172.21.15.157:6812/631023601 conn(0x7f1af803bdc0 0x7f1af803e280 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0a6890 tx=0x7f1b000a7070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.934+0000 7f1af37fe640 1 -- 172.21.15.5:0/593046600 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1afc00ecb0 con 0x7f1b0c13df20 2024-08-18T21:15:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.934+0000 7f1af37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.934+0000 7f1af37fe640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.934+0000 7f1af37fe640 1 -- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c13df20 msgr2=0x7f1b0c13e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.934+0000 7f1af37fe640 1 --2- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c13df20 0x7f1b0c13e300 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1afc010890 tx=0x7f1afc010d50 comp rx=0 tx=0).stop 2024-08-18T21:15:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.934+0000 7f1af37fe640 1 -- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c13df20 msgr2=0x7f1b0c13e300 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.934+0000 7f1af37fe640 1 --2- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c13df20 0x7f1b0c13e300 secure :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1afc010890 tx=0x7f1afc010d50 comp rx=0 tx=0).stop 2024-08-18T21:15:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.938+0000 7f1b1169e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:15:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.938+0000 7f1b1169e640 1 --2- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c13e840 0x7f1b0c0a4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.938+0000 7f1b1169e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.938+0000 7f1b1169e640 1 -- 172.21.15.5:0/593046600 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f1b0c139e10 con 0x7f1b0c13e840 2024-08-18T21:15:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.938+0000 7f1b0affd640 1 --2- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c13e840 0x7f1b0c0a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.938+0000 7f1b0affd640 10 monclient: get_auth_request con 0x7f1b0c13e840 auth_method 0 2024-08-18T21:15:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.938+0000 7f1b0affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.938+0000 7f1b0affd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.938+0000 7f1b0affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.938+0000 7f1b0affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.938+0000 7f1b0affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.938+0000 7f1b0affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.938+0000 7f1b0affd640 10 monclient(hunting): handle_auth_done global_id 95756 payload 824 2024-08-18T21:15:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.938+0000 7f1b0affd640 1 -- 172.21.15.5:0/593046600 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1b0c122a40 con 0x7f1b0c13e840 2024-08-18T21:15:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1b0affd640 1 -- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c13e840 msgr2=0x7f1b0c0a4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1b0affd640 1 --2- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c13e840 0x7f1b0c0a4940 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1afc010890 tx=0x7f1afc0046d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1af37fe640 1 -- 172.21.15.5:0/593046600 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1afc003d40 con 0x7f1b0c13e840 2024-08-18T21:15:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1af37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1af37fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:15:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1af37fe640 10 monclient: dump: 2024-08-18T21:15:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.036 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1af37fe640 1 -- 172.21.15.5:0/593046600 <== mon.5 v2:172.21.15.157:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9248 (secure 0 0 0) 0x7f1afc003d40 con 0x7f1b0c13e840 2024-08-18T21:15:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1af37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:15:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1af37fe640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:15:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1af37fe640 1 -- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c13e840 msgr2=0x7f1b0c0a4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1af37fe640 1 --2- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c13e840 0x7f1b0c0a4940 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1afc010890 tx=0x7f1afc0046d0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1af37fe640 1 -- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c13e840 msgr2=0x7f1b0c0a4940 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1af37fe640 1 --2- 172.21.15.5:0/593046600 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f1b0c13e840 0x7f1b0c0a4940 secure :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1afc010890 tx=0x7f1afc0046d0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.037 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:45.037 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:15:45.037 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:15:45.037 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:15:45.037 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 254, 2024-08-18T21:15:45.037 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 372978, 2024-08-18T21:15:45.037 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:15:45.037 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:15:45.037 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:15:45.038 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:15:45.038 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:15:45.038 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:15:45.038 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:15:45.038 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:15:45.038 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:15:45.038 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:15:45.038 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:45.038 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 1, 2024-08-18T21:15:45.038 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:45.038 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:15:45.038 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:15:45.039 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:45.039 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:45.039 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:45.039 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:45.039 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:45.039 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:45.039 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:45.039 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:45.039 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:45.039 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:45.039 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:45.039 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:45.039 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:15:45.039 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:15:45.040 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:45.040 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:45.040 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:45.040 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:45.040 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:45.040 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:45.040 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:45.040 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:45.040 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:45.040 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:45.040 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:45.040 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.041 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:15:45.041 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:15:45.041 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:15:45.041 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:15:45.041 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:15:45.041 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:15:45.041 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:45.041 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:45.041 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:15:45.041 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:15:45.041 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:15:45.041 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:15:45.041 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:15:45.041 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:15:45.042 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:15:45.042 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:45.042 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:15:45.042 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:45.042 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:45.042 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:45.042 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:45.042 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:45.042 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:45.042 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:45.042 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:45.042 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:45.042 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:45.043 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:45.043 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:45.043 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:15:45.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.043 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:15:45.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.043 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:15:45.043 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:15:45.043 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.043 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.043 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.043 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:15:45.043 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.044 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.044 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:15:45.044 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.044 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.044 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.044 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:15:45.044 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:15:45.044 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.044 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.044 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.045 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:15:45.045 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:15:45.045 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.045 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.045 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.045 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:15:45.045 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.045 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.045 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:15:45.046 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.046 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.046 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.046 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:15:45.046 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:15:45.046 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.046 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.046 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.046 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:15:45.046 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:15:45.047 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.047 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.047 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.047 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:15:45.047 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.047 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.047 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:15:45.047 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.047 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.047 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.048 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:15:45.048 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:15:45.048 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.048 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.048 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.048 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:15:45.048 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:15:45.048 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.048 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.048 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.049 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:15:45.049 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.049 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.049 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.049 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:15:45.049 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.049 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.049 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.049 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:15:45.049 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:15:45.049 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.049 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.050 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.050 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:15:45.050 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:15:45.050 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.050 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.050 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.050 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:15:45.050 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.050 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.051 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:15:45.051 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.051 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.051 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.051 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:15:45.051 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:15:45.051 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.051 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.051 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.052 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:15:45.052 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:15:45.052 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.052 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.052 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.052 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:15:45.052 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.052 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.052 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:15:45.052 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.053 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.053 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.053 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:15:45.053 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:15:45.053 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.053 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.053 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.053 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:15:45.053 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:15:45.053 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.054 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.054 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.054 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:15:45.054 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.054 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.054 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:15:45.054 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.054 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.054 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.055 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:15:45.055 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:15:45.055 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.055 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.055 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.055 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:15:45.055 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:15:45.055 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.055 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.055 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.056 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:15:45.056 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.056 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.056 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:15:45.056 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.056 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.056 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.056 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:15:45.056 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:15:45.056 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.056 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.057 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.057 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:15:45.057 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:15:45.057 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.057 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.057 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.057 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:15:45.057 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.058 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.058 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:15:45.058 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.058 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.058 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.058 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:15:45.058 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:15:45.058 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.058 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.058 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.058 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.058 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.059 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:15:45.059 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:15:45.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.059 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:45.059 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:45.059 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:45.059 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.059 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:45.059 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:15:45.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.059 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:45.059 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:45.060 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:45.060 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.060 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.060 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:15:45.060 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:45.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1b1169e640 1 -- 172.21.15.5:0/593046600 >> v2:172.21.15.157:6812/631023601 conn(0x7f1af803bdc0 msgr2=0x7f1af803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1b1169e640 1 --2- 172.21.15.5:0/593046600 >> v2:172.21.15.157:6812/631023601 conn(0x7f1af803bdc0 0x7f1af803e280 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0a6890 tx=0x7f1b000a7070 comp rx=0 tx=0).stop 2024-08-18T21:15:45.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1b1169e640 10 monclient: shutdown 2024-08-18T21:15:45.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1b1169e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:45.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1b1169e640 1 -- 172.21.15.5:0/593046600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1b0c139990 msgr2=0x7f1b0c13d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1b1169e640 1 --2- 172.21.15.5:0/593046600 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1b0c139990 0x7f1b0c13d9e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400d4b0 tx=0x7f1b0400d970 comp rx=0 tx=0).stop 2024-08-18T21:15:45.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1b0b7fe640 1 -- 172.21.15.5:0/593046600 reap_dead start 2024-08-18T21:15:45.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1b0b7fe640 1 -- 172.21.15.5:0/593046600 reap_dead start 2024-08-18T21:15:45.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1b1169e640 1 -- 172.21.15.5:0/593046600 shutdown_connections 2024-08-18T21:15:45.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1b1169e640 1 -- 172.21.15.5:0/593046600 >> 172.21.15.5:0/593046600 conn(0x7f1b0c068700 msgr2=0x7f1b0c0a3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:45.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1b1169e640 1 -- 172.21.15.5:0/593046600 shutdown_connections 2024-08-18T21:15:45.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:44.942+0000 7f1b1169e640 1 -- 172.21.15.5:0/593046600 wait complete. 2024-08-18T21:15:45.063 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:15:45.063 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-18T21:15:45.063 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-18T21:15:45.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 10 monclient: get_monmap_and_config 2024-08-18T21:15:45.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 10 monclient: build_initial_monmap 2024-08-18T21:15:45.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 10 monclient: monmap: 2024-08-18T21:15:45.232 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:45.232 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.232 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:45.237582+0000 2024-08-18T21:15:45.232 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:45.237582+0000 2024-08-18T21:15:45.232 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:45.233 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.233 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:45.233 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:45.233 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:45.233 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:45.233 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:45.233 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:45.233 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:45.233 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:45.233 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:45.233 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:45.233 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:45.233 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 1 Processor -- start 2024-08-18T21:15:45.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 1 -- start start 2024-08-18T21:15:45.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 10 monclient: init 2024-08-18T21:15:45.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:45.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 10 monclient: _add_conns ranks=[6,10,2,0,4,7,5,8,9,1,3] 2024-08-18T21:15:45.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f245c0a4960 0x7f245c0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 10 monclient(hunting): picked mon.noname-d con 0x7f245c0a4960 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:15:45.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f245c0a5280 0x7f245c138730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 10 monclient(hunting): picked mon.noname-f con 0x7f245c0a5280 addr v2:172.21.15.157:3300/0 2024-08-18T21:15:45.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f245c138c70 0x7f245c139120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 10 monclient(hunting): picked mon.noname-b con 0x7f245c138c70 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:45.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f245c06ccb0 con 0x7f245c0a5280 2024-08-18T21:15:45.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f245c06ce80 con 0x7f245c138c70 2024-08-18T21:15:45.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f245c09da30 con 0x7f245c0a4960 2024-08-18T21:15:45.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:45.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2463072640 10 monclient(hunting): authenticate will time out at 1712.250544s 2024-08-18T21:15:45.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f245c0a4960 0x7f245c0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f246160f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f245c138c70 0x7f245c139120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f245c0a4960 0x7f245c0a4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:38398/0 (socket says 172.21.15.5:38398) 2024-08-18T21:15:45.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 1 -- 172.21.15.5:0/78072038 learned_addr learned my addr 172.21.15.5:0/78072038 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:45.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 10 monclient(hunting): get_auth_request con 0x7f245c0a4960 auth_method 0 2024-08-18T21:15:45.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f246160f640 10 monclient(hunting): get_auth_request con 0x7f245c138c70 auth_method 0 2024-08-18T21:15:45.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f246160f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f246160f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f246160f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f246160f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f246160f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f246160f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f245bfff640 1 --2- 172.21.15.5:0/78072038 >> v2:172.21.15.157:3300/0 conn(0x7f245c0a5280 0x7f245c138730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f245bfff640 10 monclient(hunting): get_auth_request con 0x7f245c0a5280 auth_method 0 2024-08-18T21:15:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f245bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f245bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f245bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 10 monclient(hunting): handle_auth_done global_id 174156 payload 274 2024-08-18T21:15:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 1 -- 172.21.15.5:0/78072038 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f245c138c70 msgr2=0x7f245c139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 1 --2- 172.21.15.5:0/78072038 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f245c138c70 0x7f245c139120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 1 -- 172.21.15.5:0/78072038 >> v2:172.21.15.157:3300/0 conn(0x7f245c0a5280 msgr2=0x7f245c138730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 1 --2- 172.21.15.5:0/78072038 >> v2:172.21.15.157:3300/0 conn(0x7f245c0a5280 0x7f245c138730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 10 monclient: _finish_hunting 0 2024-08-18T21:15:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 1 monclient: found mon.noname-d 2024-08-18T21:15:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:15:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.234+0000 7f2460e0e640 1 -- 172.21.15.5:0/78072038 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c06d090 con 0x7f245c0a4960 2024-08-18T21:15:45.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 10 monclient: get_monmap_and_config 2024-08-18T21:15:45.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 10 monclient: build_initial_monmap 2024-08-18T21:15:45.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 10 monclient: monmap: 2024-08-18T21:15:45.240 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:45.241 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.241 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:45.242970+0000 2024-08-18T21:15:45.241 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:45.242970+0000 2024-08-18T21:15:45.241 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:45.241 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.241 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:45.241 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:45.241 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:45.241 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:45.241 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:45.241 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:45.241 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:45.241 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:45.241 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:45.242 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:45.242 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:45.242 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 1 Processor -- start 2024-08-18T21:15:45.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 1 -- start start 2024-08-18T21:15:45.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 10 monclient: init 2024-08-18T21:15:45.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f2460e0e640 1 -- 172.21.15.5:0/78072038 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f245c0a4960 msgr2=0x7f245c0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:45.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f2460e0e640 1 --2- 172.21.15.5:0/78072038 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f245c0a4960 0x7f245c0a4d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2444009870 tx=0x7f244401c420 comp rx=0 tx=0).ready entity=mon.6 client_cookie=6e346288a9920e3e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f245b7fe640 1 -- 172.21.15.5:0/78072038 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f24440b0070 con 0x7f245c0a4960 2024-08-18T21:15:45.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f245b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f245b7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:15:45.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f245b7fe640 10 monclient: dump: 2024-08-18T21:15:45.243 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.243 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.243 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.244 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.244 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.244 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.244 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.244 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.244 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.244 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.244 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.244 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.244 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.244 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.244 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.244 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f245b7fe640 10 monclient: _finish_auth 0 2024-08-18T21:15:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f245b7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:15:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f245b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f2463072640 5 monclient: authenticate success, global_id 174156 2024-08-18T21:15:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f245b7fe640 1 -- 172.21.15.5:0/78072038 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24440aa810 con 0x7f245c0a4960 2024-08-18T21:15:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f2463072640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:15:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f245b7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f2463072640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f2463072640 4 set_mon_vals no callback set 2024-08-18T21:15:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f245b7fe640 1 -- 172.21.15.5:0/78072038 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f24440a9300 con 0x7f245c0a4960 2024-08-18T21:15:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f245b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f245b7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:15:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f245b7fe640 10 monclient: dump: 2024-08-18T21:15:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.247 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:45.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 10 monclient: _add_conns ranks=[7,2,8,5,1,4,10,6,3,0,9] 2024-08-18T21:15:45.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13e80a5ac0 0x7f13e80a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 10 monclient(hunting): picked mon.noname-i con 0x7f13e80a5ac0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:15:45.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f13e80a63e0 0x7f13e81378e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 10 monclient(hunting): picked mon.noname-b con 0x7f13e80a63e0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:45.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13e8137e20 0x7f13e8138260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 10 monclient(hunting): picked mon.noname-e con 0x7f13e8137e20 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:45.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f13e80a2050 con 0x7f13e80a63e0 2024-08-18T21:15:45.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f13e80a3990 con 0x7f13e80a5ac0 2024-08-18T21:15:45.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f13e80a30f0 con 0x7f13e8137e20 2024-08-18T21:15:45.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:45.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13f0622640 10 monclient(hunting): authenticate will time out at 1712.255801s 2024-08-18T21:15:45.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13edbbd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f13e80a63e0 0x7f13e81378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13edbbd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f13e80a63e0 0x7f13e81378e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33784/0 (socket says 172.21.15.5:33784) 2024-08-18T21:15:45.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13edbbd640 1 -- 172.21.15.5:0/3310564007 learned_addr learned my addr 172.21.15.5:0/3310564007 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:45.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13edbbd640 10 monclient(hunting): get_auth_request con 0x7f13e80a63e0 auth_method 0 2024-08-18T21:15:45.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13edbbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13edbbd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.238+0000 7f13edbbd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13eebbf640 1 --2- 172.21.15.5:0/3310564007 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13e8137e20 0x7f13e8138260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13eebbf640 10 monclient(hunting): get_auth_request con 0x7f13e8137e20 auth_method 0 2024-08-18T21:15:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13eebbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13eebbf640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13eebbf640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13edbbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13edbbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13edbbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13eebbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13eebbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13eebbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13ee3be640 1 --2- 172.21.15.5:0/3310564007 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13e80a5ac0 0x7f13e80a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13ee3be640 10 monclient(hunting): get_auth_request con 0x7f13e80a5ac0 auth_method 0 2024-08-18T21:15:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13ee3be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13ee3be640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13ee3be640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13edbbd640 10 monclient(hunting): handle_auth_done global_id 115175 payload 274 2024-08-18T21:15:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13edbbd640 1 -- 172.21.15.5:0/3310564007 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13e8137e20 msgr2=0x7f13e8138260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13edbbd640 1 --2- 172.21.15.5:0/3310564007 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13e8137e20 0x7f13e8138260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13edbbd640 1 -- 172.21.15.5:0/3310564007 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13e80a5ac0 msgr2=0x7f13e80a5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13edbbd640 1 --2- 172.21.15.5:0/3310564007 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13e80a5ac0 0x7f13e80a5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13edbbd640 10 monclient: _finish_hunting 0 2024-08-18T21:15:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13edbbd640 1 monclient: found mon.noname-b 2024-08-18T21:15:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13edbbd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13edbbd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f13edbbd640 1 -- 172.21.15.5:0/3310564007 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e80a7660 con 0x7f13e80a63e0 2024-08-18T21:15:45.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 10 monclient: shutdown 2024-08-18T21:15:45.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:45.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 -- 172.21.15.5:0/78072038 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f245c0a4960 msgr2=0x7f245c0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 --2- 172.21.15.5:0/78072038 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f245c0a4960 0x7f245c0a4d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2444009870 tx=0x7f244401c420 comp rx=0 tx=0).stop 2024-08-18T21:15:45.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 -- 172.21.15.5:0/78072038 shutdown_connections 2024-08-18T21:15:45.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 --2- 172.21.15.5:0/78072038 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f245c138c70 0x7f245c139120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 --2- 172.21.15.5:0/78072038 >> v2:172.21.15.157:3300/0 conn(0x7f245c0a5280 0x7f245c138730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 --2- 172.21.15.5:0/78072038 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f245c0a4960 0x7f245c0a4d40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 -- 172.21.15.5:0/78072038 >> 172.21.15.5:0/78072038 conn(0x7f245c0a6440 msgr2=0x7f245c068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:45.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 -- 172.21.15.5:0/78072038 shutdown_connections 2024-08-18T21:15:45.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 -- 172.21.15.5:0/78072038 wait complete. 2024-08-18T21:15:45.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 10 monclient: build_initial_monmap 2024-08-18T21:15:45.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 10 monclient: monmap: 2024-08-18T21:15:45.256 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:45.256 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:45.256 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:45.256 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:45.256 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:45.256 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.256 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:45.256 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:45.256 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:45.257 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:45.257 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:45.257 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:45.257 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:45.257 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:45.257 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:45.257 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 Processor -- start 2024-08-18T21:15:45.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 -- start start 2024-08-18T21:15:45.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 10 monclient: init 2024-08-18T21:15:45.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:45.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 10 monclient: _add_conns ranks=[4,2,0,5,1,8,7,6,3] 2024-08-18T21:15:45.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f245c0a4960 0x7f245c11f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 10 monclient(hunting): picked mon.noname-c con 0x7f245c0a4960 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:15:45.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f245c0a5280 0x7f245c1d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 10 monclient(hunting): picked mon.noname-b con 0x7f245c0a5280 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:45.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f245c138c70 0x7f245c13d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 10 monclient(hunting): picked mon.noname-a con 0x7f245c138c70 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:15:45.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f245c09f290 con 0x7f245c138c70 2024-08-18T21:15:45.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f245c09f110 con 0x7f245c0a5280 2024-08-18T21:15:45.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f245c143580 con 0x7f245c0a4960 2024-08-18T21:15:45.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:45.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2463072640 10 monclient(hunting): authenticate will time out at 1712.258046s 2024-08-18T21:15:45.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2460e0e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f245c0a4960 0x7f245c11f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2460e0e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f245c0a4960 0x7f245c11f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:38538/0 (socket says 172.21.15.5:38538) 2024-08-18T21:15:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f246160f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f245c138c70 0x7f245c13d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2460e0e640 1 -- 172.21.15.5:0/3445731344 learned_addr learned my addr 172.21.15.5:0/3445731344 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2460e0e640 10 monclient(hunting): get_auth_request con 0x7f245c0a4960 auth_method 0 2024-08-18T21:15:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2460e0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2460e0e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2460e0e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 1 --2- 172.21.15.5:0/3445731344 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f245c0a5280 0x7f245c1d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f246160f640 10 monclient(hunting): get_auth_request con 0x7f245c138c70 auth_method 0 2024-08-18T21:15:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f246160f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f246160f640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f246160f640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 10 monclient(hunting): get_auth_request con 0x7f245c0a5280 auth_method 0 2024-08-18T21:15:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f246160f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f246160f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f246160f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2460e0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2460e0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f2460e0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 10 monclient(hunting): handle_auth_done global_id 115184 payload 824 2024-08-18T21:15:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 1 -- 172.21.15.5:0/3445731344 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f245c0a4960 msgr2=0x7f245c11f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 1 --2- 172.21.15.5:0/3445731344 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f245c0a4960 0x7f245c11f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 1 -- 172.21.15.5:0/3445731344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f245c138c70 msgr2=0x7f245c13d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 1 --2- 172.21.15.5:0/3445731344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f245c138c70 0x7f245c13d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 10 monclient: _finish_hunting 0 2024-08-18T21:15:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 1 monclient: found mon.noname-b 2024-08-18T21:15:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.242+0000 7f245bfff640 1 -- 172.21.15.5:0/3445731344 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c11ff50 con 0x7f245c0a5280 2024-08-18T21:15:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13edbbd640 1 -- 172.21.15.5:0/3310564007 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f13e80a63e0 msgr2=0x7f13e81378e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13edbbd640 1 --2- 172.21.15.5:0/3310564007 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f13e80a63e0 0x7f13e81378e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f13d80098a0 tx=0x7f13d801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e22ab9b93d8ed5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f245bfff640 1 -- 172.21.15.5:0/3445731344 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f245c0a5280 msgr2=0x7f245c1d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:45.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f245bfff640 1 --2- 172.21.15.5:0/3445731344 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f245c0a5280 0x7f245c1d1a80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f244c00d5d0 tx=0x7f244c00da90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13ed3bc640 1 -- 172.21.15.5:0/3310564007 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13d80b0070 con 0x7f13e80a63e0 2024-08-18T21:15:45.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13ed3bc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13ed3bc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:45.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13ed3bc640 10 monclient: dump: 2024-08-18T21:15:45.263 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.263 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.263 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.263 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.263 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.263 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.263 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.263 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.264 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.264 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.264 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.264 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.264 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.264 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.264 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.264 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13ed3bc640 10 monclient: _finish_auth 0 2024-08-18T21:15:45.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13ed3bc640 10 monclient: _check_auth_tickets 2024-08-18T21:15:45.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13ed3bc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:45.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 5 monclient: authenticate success, global_id 115175 2024-08-18T21:15:45.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13ed3bc640 1 -- 172.21.15.5:0/3310564007 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d80aa810 con 0x7f13e80a63e0 2024-08-18T21:15:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13ed3bc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13ed3bc640 1 -- 172.21.15.5:0/3310564007 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13d80a9300 con 0x7f13e80a63e0 2024-08-18T21:15:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 4 set_mon_vals no callback set 2024-08-18T21:15:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13ed3bc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13ed3bc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13ed3bc640 10 monclient: dump: 2024-08-18T21:15:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.266 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f24597fa640 1 -- 172.21.15.5:0/3445731344 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f244c004450 con 0x7f245c0a5280 2024-08-18T21:15:45.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f24597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f24597fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f24597fa640 10 monclient: dump: 2024-08-18T21:15:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.269 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f24597fa640 10 monclient: _finish_auth 0 2024-08-18T21:15:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f24597fa640 10 monclient: _check_auth_tickets 2024-08-18T21:15:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f24597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f24597fa640 1 -- 172.21.15.5:0/3445731344 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f244c003a90 con 0x7f245c0a5280 2024-08-18T21:15:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2463072640 5 monclient: authenticate success, global_id 115184 2024-08-18T21:15:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2463072640 10 monclient: _renew_subs 2024-08-18T21:15:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2463072640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2463072640 1 -- 172.21.15.5:0/3445731344 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245c120dc0 con 0x7f245c0a5280 2024-08-18T21:15:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f24597fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:45.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f24597fa640 1 -- 172.21.15.5:0/3445731344 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f244c003c40 con 0x7f245c0a5280 2024-08-18T21:15:45.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f24597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f24597fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:45.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f245affd640 4 set_mon_vals no callback set 2024-08-18T21:15:45.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f24597fa640 10 monclient: dump: 2024-08-18T21:15:45.270 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.270 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.270 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.270 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.270 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.270 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.270 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.270 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.270 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.271 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.271 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.271 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.271 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.271 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.271 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.271 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2463072640 10 monclient: _renew_subs 2024-08-18T21:15:45.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2463072640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:45.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2463072640 1 -- 172.21.15.5:0/3445731344 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f245c13fd50 con 0x7f245c0a5280 2024-08-18T21:15:45.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 10 monclient: shutdown 2024-08-18T21:15:45.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:45.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 -- 172.21.15.5:0/3310564007 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f13e80a63e0 msgr2=0x7f13e81378e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 --2- 172.21.15.5:0/3310564007 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f13e80a63e0 0x7f13e81378e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f13d80098a0 tx=0x7f13d801c440 comp rx=0 tx=0).stop 2024-08-18T21:15:45.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 -- 172.21.15.5:0/3310564007 shutdown_connections 2024-08-18T21:15:45.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 --2- 172.21.15.5:0/3310564007 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13e8137e20 0x7f13e8138260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 --2- 172.21.15.5:0/3310564007 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f13e80a63e0 0x7f13e81378e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 --2- 172.21.15.5:0/3310564007 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f13e80a5ac0 0x7f13e80a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 -- 172.21.15.5:0/3310564007 >> 172.21.15.5:0/3310564007 conn(0x7f13e80aa770 msgr2=0x7f13e80a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 -- 172.21.15.5:0/3310564007 shutdown_connections 2024-08-18T21:15:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 -- 172.21.15.5:0/3310564007 wait complete. 2024-08-18T21:15:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2463072640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2463072640 1 --2- 172.21.15.5:0/3445731344 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f245c1d1fc0 0x7f245c13dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2463072640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2463072640 1 -- 172.21.15.5:0/3445731344 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f245c051140 con 0x7f245c1d1fc0 2024-08-18T21:15:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f24597fa640 1 -- 172.21.15.5:0/3445731344 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f244c003620 con 0x7f245c0a5280 2024-08-18T21:15:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f24597fa640 1 --2- 172.21.15.5:0/3445731344 >> v2:172.21.15.157:6812/631023601 conn(0x7f243c03bdc0 0x7f243c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f24597fa640 1 -- 172.21.15.5:0/3445731344 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(331..331 src has 22..331) ==== 3506+0+0 (secure 0 0 0) 0x7f244c00f040 con 0x7f245c0a5280 2024-08-18T21:15:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2460e0e640 1 --2- 172.21.15.5:0/3445731344 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f245c1d1fc0 0x7f245c13dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2460e0e640 10 monclient: get_auth_request con 0x7f245c1d1fc0 auth_method 0 2024-08-18T21:15:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2460e0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2460e0e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2460e0e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 10 monclient: build_initial_monmap 2024-08-18T21:15:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 10 monclient: monmap: 2024-08-18T21:15:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:45.276 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2460e0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2460e0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2460e0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f246160f640 1 --2- 172.21.15.5:0/3445731344 >> v2:172.21.15.157:6812/631023601 conn(0x7f243c03bdc0 0x7f243c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f246160f640 10 monclient: get_auth_request con 0x7f243c03bdc0 auth_method 0 2024-08-18T21:15:45.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2460e0e640 10 monclient(hunting): handle_auth_done global_id 174130 payload 824 2024-08-18T21:15:45.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f2460e0e640 1 -- 172.21.15.5:0/3445731344 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f245c139fb0 con 0x7f245c1d1fc0 2024-08-18T21:15:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 Processor -- start 2024-08-18T21:15:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 -- start start 2024-08-18T21:15:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 10 monclient: init 2024-08-18T21:15:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 10 monclient: _add_conns ranks=[1,8,5,2,6,7,0,3,4] 2024-08-18T21:15:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13e80a5ac0 0x7f13e81cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 10 monclient(hunting): picked mon.noname-f con 0x7f13e80a5ac0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:15:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13e80a63e0 0x7f13e81cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 10 monclient(hunting): picked mon.noname-e con 0x7f13e80a63e0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f13e8137e20 0x7f13e813b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 10 monclient(hunting): picked mon.noname-h con 0x7f13e8137e20 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f13e80a1dc0 con 0x7f13e80a5ac0 2024-08-18T21:15:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f13e80a1c40 con 0x7f13e8137e20 2024-08-18T21:15:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f13e81417d0 con 0x7f13e80a63e0 2024-08-18T21:15:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13f0622640 10 monclient(hunting): authenticate will time out at 1712.263851s 2024-08-18T21:15:45.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13edbbd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13e80a63e0 0x7f13e81cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13edbbd640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13e80a63e0 0x7f13e81cfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:53896/0 (socket says 172.21.15.5:53896) 2024-08-18T21:15:45.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13edbbd640 1 -- 172.21.15.5:0/2339149515 learned_addr learned my addr 172.21.15.5:0/2339149515 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:45.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13edbbd640 10 monclient(hunting): get_auth_request con 0x7f13e80a63e0 auth_method 0 2024-08-18T21:15:45.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.246+0000 7f13edbbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13ee3be640 1 --2- 172.21.15.5:0/2339149515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13e80a5ac0 0x7f13e81cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13eebbf640 1 --2- 172.21.15.5:0/2339149515 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f13e8137e20 0x7f13e813b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13eebbf640 10 monclient(hunting): get_auth_request con 0x7f13e8137e20 auth_method 0 2024-08-18T21:15:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13eebbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13eebbf640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13eebbf640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 10 monclient(hunting): handle_auth_done global_id 115343 payload 824 2024-08-18T21:15:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 1 -- 172.21.15.5:0/2339149515 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f13e8137e20 msgr2=0x7f13e813b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 1 --2- 172.21.15.5:0/2339149515 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f13e8137e20 0x7f13e813b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 1 -- 172.21.15.5:0/2339149515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13e80a5ac0 msgr2=0x7f13e81cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 1 --2- 172.21.15.5:0/2339149515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13e80a5ac0 0x7f13e81cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 10 monclient: _finish_hunting 0 2024-08-18T21:15:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 1 monclient: found mon.noname-e 2024-08-18T21:15:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:15:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 1 -- 172.21.15.5:0/2339149515 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e813d0c0 con 0x7f13e80a63e0 2024-08-18T21:15:45.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f2460e0e640 1 -- 172.21.15.5:0/3445731344 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f245c1d1fc0 msgr2=0x7f245c13dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:45.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f2460e0e640 1 --2- 172.21.15.5:0/3445731344 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f245c1d1fc0 0x7f245c13dc90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f244401c250 tx=0x7f24440191c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f246160f640 1 --2- 172.21.15.5:0/3445731344 >> v2:172.21.15.157:6812/631023601 conn(0x7f243c03bdc0 0x7f243c03e280 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2454011340 tx=0x7f245400b040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f24597fa640 1 -- 172.21.15.5:0/3445731344 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f24440b0040 con 0x7f245c1d1fc0 2024-08-18T21:15:45.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f24597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f24597fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:15:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f24597fa640 10 monclient: dump: 2024-08-18T21:15:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.285 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.285 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.285 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.285 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 1 -- 172.21.15.5:0/2339149515 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13e80a63e0 msgr2=0x7f13e81cfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13edbbd640 1 --2- 172.21.15.5:0/2339149515 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13e80a63e0 0x7f13e81cfef0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f13d80ae040 tx=0x7f13d80191e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13deffd640 1 -- 172.21.15.5:0/2339149515 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13d80b9070 con 0x7f13e80a63e0 2024-08-18T21:15:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13deffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:15:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13deffd640 10 monclient: dump: 2024-08-18T21:15:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.287 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13deffd640 10 monclient: _finish_auth 0 2024-08-18T21:15:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13deffd640 10 monclient: _check_auth_tickets 2024-08-18T21:15:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:45.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f24597fa640 1 -- 172.21.15.5:0/3445731344 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2444003830 con 0x7f245c1d1fc0 2024-08-18T21:15:45.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f24597fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:45.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f24597fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:45.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f24597fa640 1 -- 172.21.15.5:0/3445731344 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f245c1d1fc0 msgr2=0x7f245c13dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f24597fa640 1 --2- 172.21.15.5:0/3445731344 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f245c1d1fc0 0x7f245c13dc90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f244401c250 tx=0x7f24440191c0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13deffd640 1 -- 172.21.15.5:0/2339149515 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d80044b0 con 0x7f13e80a63e0 2024-08-18T21:15:45.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13f0622640 5 monclient: authenticate success, global_id 115343 2024-08-18T21:15:45.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13f0622640 10 monclient: _renew_subs 2024-08-18T21:15:45.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13f0622640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:45.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13f0622640 1 -- 172.21.15.5:0/2339149515 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e8121fb0 con 0x7f13e80a63e0 2024-08-18T21:15:45.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f24597fa640 1 -- 172.21.15.5:0/3445731344 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f245c1d1fc0 msgr2=0x7f245c13dc90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:45.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f24597fa640 1 --2- 172.21.15.5:0/3445731344 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f245c1d1fc0 0x7f245c13dc90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13deffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:45.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13deffd640 1 -- 172.21.15.5:0/2339149515 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13d80b0040 con 0x7f13e80a63e0 2024-08-18T21:15:45.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13deffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:15:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13deffd640 10 monclient: dump: 2024-08-18T21:15:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.292 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13ecbbb640 4 set_mon_vals no callback set 2024-08-18T21:15:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13f0622640 10 monclient: _renew_subs 2024-08-18T21:15:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13f0622640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13f0622640 1 -- 172.21.15.5:0/2339149515 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e81207b0 con 0x7f13e80a63e0 2024-08-18T21:15:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13f0622640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13deffd640 1 -- 172.21.15.5:0/2339149515 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f13d80aac70 con 0x7f13e80a63e0 2024-08-18T21:15:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13f0622640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13f0622640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.250+0000 7f13f0622640 1 -- 172.21.15.5:0/2339149515 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e81378e0 con 0x7f13e80a63e0 2024-08-18T21:15:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.254+0000 7f13deffd640 1 --2- 172.21.15.5:0/2339149515 >> v2:172.21.15.157:6812/631023601 conn(0x7f13cc03bdb0 0x7f13cc03e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.254+0000 7f13deffd640 1 -- 172.21.15.5:0/2339149515 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(331..331 src has 22..331) ==== 3506+0+0 (secure 0 0 0) 0x7f13d80e7420 con 0x7f13e80a63e0 2024-08-18T21:15:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.254+0000 7f13ee3be640 1 --2- 172.21.15.5:0/2339149515 >> v2:172.21.15.157:6812/631023601 conn(0x7f13cc03bdb0 0x7f13cc03e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.254+0000 7f13ee3be640 10 monclient: get_auth_request con 0x7f13cc03bdb0 auth_method 0 2024-08-18T21:15:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.254+0000 7f13ee3be640 1 --2- 172.21.15.5:0/2339149515 >> v2:172.21.15.157:6812/631023601 conn(0x7f13cc03bdb0 0x7f13cc03e270 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009790 tx=0x7f13e4008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f13deffd640 1 -- 172.21.15.5:0/2339149515 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f13d8016150 con 0x7f13e80a63e0 2024-08-18T21:15:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f13deffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f13deffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f2463072640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-18T21:15:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f2463072640 1 --2- 172.21.15.5:0/3445731344 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f245c13e1d0 0x7f245c0a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f2463072640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f2463072640 1 -- 172.21.15.5:0/3445731344 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f245c13e5e0 con 0x7f245c13e1d0 2024-08-18T21:15:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f2460e0e640 1 --2- 172.21.15.5:0/3445731344 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f245c13e1d0 0x7f245c0a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f2460e0e640 10 monclient: get_auth_request con 0x7f245c13e1d0 auth_method 0 2024-08-18T21:15:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f2460e0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f2460e0e640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f2460e0e640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f2460e0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f2460e0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f2460e0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f2460e0e640 10 monclient(hunting): handle_auth_done global_id 174139 payload 824 2024-08-18T21:15:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.258+0000 7f2460e0e640 1 -- 172.21.15.5:0/3445731344 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f245c0a4d40 con 0x7f245c13e1d0 2024-08-18T21:15:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f2460e0e640 1 -- 172.21.15.5:0/3445731344 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f245c13e1d0 msgr2=0x7f245c0a1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f2460e0e640 1 --2- 172.21.15.5:0/3445731344 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f245c13e1d0 0x7f245c0a1360 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f244401c460 tx=0x7f24440a8000 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f24597fa640 1 -- 172.21.15.5:0/3445731344 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f24440b0070 con 0x7f245c13e1d0 2024-08-18T21:15:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f24597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f24597fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:15:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f24597fa640 10 monclient: dump: 2024-08-18T21:15:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.297 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f24597fa640 1 -- 172.21.15.5:0/3445731344 <== mon.7 v2:172.21.15.157:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9247 (secure 0 0 0) 0x7f24440c4030 con 0x7f245c13e1d0 2024-08-18T21:15:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f24597fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-18T21:15:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f24597fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:15:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f24597fa640 1 -- 172.21.15.5:0/3445731344 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f245c13e1d0 msgr2=0x7f245c0a1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f24597fa640 1 --2- 172.21.15.5:0/3445731344 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f245c13e1d0 0x7f245c0a1360 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f244401c460 tx=0x7f24440a8000 comp rx=0 tx=0).stop 2024-08-18T21:15:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f24597fa640 1 -- 172.21.15.5:0/3445731344 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f245c13e1d0 msgr2=0x7f245c0a1360 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-18T21:15:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f24597fa640 1 --2- 172.21.15.5:0/3445731344 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f245c13e1d0 0x7f245c0a1360 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f244401c460 tx=0x7f24440a8000 comp rx=0 tx=0).stop 2024-08-18T21:15:45.298 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:45.298 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:15:45.298 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:15:45.298 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "peon", 2024-08-18T21:15:45.298 INFO:teuthology.orchestra.run.smithi005.stdout: "election_epoch": 254, 2024-08-18T21:15:45.298 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 22139, 2024-08-18T21:15:45.298 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum": [ 2024-08-18T21:15:45.298 INFO:teuthology.orchestra.run.smithi005.stdout: 0, 2024-08-18T21:15:45.298 INFO:teuthology.orchestra.run.smithi005.stdout: 1, 2024-08-18T21:15:45.299 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-08-18T21:15:45.299 INFO:teuthology.orchestra.run.smithi005.stdout: 3, 2024-08-18T21:15:45.299 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-08-18T21:15:45.299 INFO:teuthology.orchestra.run.smithi005.stdout: 5, 2024-08-18T21:15:45.299 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-08-18T21:15:45.299 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-08-18T21:15:45.299 INFO:teuthology.orchestra.run.smithi005.stdout: 8 2024-08-18T21:15:45.299 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:45.299 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_age": 2, 2024-08-18T21:15:45.299 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:45.299 INFO:teuthology.orchestra.run.smithi005.stdout: "required_con": "2450521708007866372", 2024-08-18T21:15:45.299 INFO:teuthology.orchestra.run.smithi005.stdout: "required_mon": [ 2024-08-18T21:15:45.299 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:45.300 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:45.300 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:45.300 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:45.300 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:45.300 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:45.300 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:45.300 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:45.300 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:45.300 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:45.300 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:45.300 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:45.300 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_con": "4540701547738038271", 2024-08-18T21:15:45.300 INFO:teuthology.orchestra.run.smithi005.stdout: "quorum_mon": [ 2024-08-18T21:15:45.301 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:45.301 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:45.301 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:45.301 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:45.301 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:45.301 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:45.301 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:45.301 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:45.301 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:45.301 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:45.301 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:45.301 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.302 INFO:teuthology.orchestra.run.smithi005.stdout: "outside_quorum": [], 2024-08-18T21:15:45.302 INFO:teuthology.orchestra.run.smithi005.stdout: "extra_probe_peers": [], 2024-08-18T21:15:45.302 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_provider": [], 2024-08-18T21:15:45.302 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": { 2024-08-18T21:15:45.302 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-08-18T21:15:45.302 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "8465e564-1097-423a-818a-e3a141bbf945", 2024-08-18T21:15:45.302 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:45.302 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-08-18T21:02:46.585177Z", 2024-08-18T21:15:45.302 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release": 19, 2024-08-18T21:15:45.302 INFO:teuthology.orchestra.run.smithi005.stdout: "min_mon_release_name": "squid", 2024-08-18T21:15:45.302 INFO:teuthology.orchestra.run.smithi005.stdout: "election_strategy": 1, 2024-08-18T21:15:45.302 INFO:teuthology.orchestra.run.smithi005.stdout: "disallowed_leaders: ": "", 2024-08-18T21:15:45.302 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false, 2024-08-18T21:15:45.302 INFO:teuthology.orchestra.run.smithi005.stdout: "tiebreaker_mon": "", 2024-08-18T21:15:45.303 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_ranks: ": "", 2024-08-18T21:15:45.303 INFO:teuthology.orchestra.run.smithi005.stdout: "features": { 2024-08-18T21:15:45.303 INFO:teuthology.orchestra.run.smithi005.stdout: "persistent": [ 2024-08-18T21:15:45.303 INFO:teuthology.orchestra.run.smithi005.stdout: "kraken", 2024-08-18T21:15:45.303 INFO:teuthology.orchestra.run.smithi005.stdout: "luminous", 2024-08-18T21:15:45.303 INFO:teuthology.orchestra.run.smithi005.stdout: "mimic", 2024-08-18T21:15:45.303 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap-prune", 2024-08-18T21:15:45.303 INFO:teuthology.orchestra.run.smithi005.stdout: "nautilus", 2024-08-18T21:15:45.303 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus", 2024-08-18T21:15:45.303 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific", 2024-08-18T21:15:45.303 INFO:teuthology.orchestra.run.smithi005.stdout: "elector-pinging", 2024-08-18T21:15:45.303 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy", 2024-08-18T21:15:45.303 INFO:teuthology.orchestra.run.smithi005.stdout: "reef", 2024-08-18T21:15:45.304 INFO:teuthology.orchestra.run.smithi005.stdout: "squid" 2024-08-18T21:15:45.304 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:45.304 INFO:teuthology.orchestra.run.smithi005.stdout: "optional": [] 2024-08-18T21:15:45.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.304 INFO:teuthology.orchestra.run.smithi005.stdout: "mons": [ 2024-08-18T21:15:45.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.304 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 0, 2024-08-18T21:15:45.304 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "a", 2024-08-18T21:15:45.304 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.304 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3300", 2024-08-18T21:15:45.304 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789", 2024-08-18T21:15:45.305 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.305 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.305 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.305 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6789/0", 2024-08-18T21:15:45.305 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6789/0", 2024-08-18T21:15:45.305 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.305 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.305 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.306 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 1, 2024-08-18T21:15:45.306 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "f", 2024-08-18T21:15:45.306 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.306 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3300", 2024-08-18T21:15:45.306 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789", 2024-08-18T21:15:45.307 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.307 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.307 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.307 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6789/0", 2024-08-18T21:15:45.307 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6789/0", 2024-08-18T21:15:45.307 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.307 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.307 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.307 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 2, 2024-08-18T21:15:45.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "b", 2024-08-18T21:15:45.308 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.308 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3301", 2024-08-18T21:15:45.308 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.308 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.308 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790", 2024-08-18T21:15:45.308 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.308 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.308 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6790/0", 2024-08-18T21:15:45.309 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6790/0", 2024-08-18T21:15:45.309 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.309 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.309 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.309 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 3, 2024-08-18T21:15:45.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "g", 2024-08-18T21:15:45.309 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.309 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3301", 2024-08-18T21:15:45.310 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790", 2024-08-18T21:15:45.310 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.310 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.310 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.310 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6790/0", 2024-08-18T21:15:45.310 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6790/0", 2024-08-18T21:15:45.310 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.311 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.311 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.311 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 4, 2024-08-18T21:15:45.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "c", 2024-08-18T21:15:45.311 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.311 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3302", 2024-08-18T21:15:45.311 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.312 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791", 2024-08-18T21:15:45.312 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.312 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.312 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.312 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6791/0", 2024-08-18T21:15:45.312 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6791/0", 2024-08-18T21:15:45.312 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.312 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.312 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.313 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 5, 2024-08-18T21:15:45.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "h", 2024-08-18T21:15:45.313 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3302", 2024-08-18T21:15:45.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.313 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791", 2024-08-18T21:15:45.313 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.314 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.314 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6791/0", 2024-08-18T21:15:45.314 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6791/0", 2024-08-18T21:15:45.314 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.314 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.314 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.314 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 6, 2024-08-18T21:15:45.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "d", 2024-08-18T21:15:45.314 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.314 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3303", 2024-08-18T21:15:45.315 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792", 2024-08-18T21:15:45.315 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.315 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.315 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.315 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6792/0", 2024-08-18T21:15:45.316 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6792/0", 2024-08-18T21:15:45.316 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.316 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.316 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.316 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 7, 2024-08-18T21:15:45.316 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "i", 2024-08-18T21:15:45.316 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.316 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:3303", 2024-08-18T21:15:45.316 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.317 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.317 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792", 2024-08-18T21:15:45.317 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.317 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.317 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.317 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.157:6792/0", 2024-08-18T21:15:45.317 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.157:6792/0", 2024-08-18T21:15:45.317 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.317 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.317 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: "rank": 8, 2024-08-18T21:15:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "e", 2024-08-18T21:15:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-08-18T21:15:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-18T21:15:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-18T21:15:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:3304", 2024-08-18T21:15:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.319 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T21:15:45.319 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793", 2024-08-18T21:15:45.319 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 0 2024-08-18T21:15:45.319 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.319 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.319 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6793/0", 2024-08-18T21:15:45.319 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6793/0", 2024-08-18T21:15:45.319 INFO:teuthology.orchestra.run.smithi005.stdout: "priority": 0, 2024-08-18T21:15:45.319 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-08-18T21:15:45.319 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "{}" 2024-08-18T21:15:45.319 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.319 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.320 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_map": { 2024-08-18T21:15:45.320 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": [ 2024-08-18T21:15:45.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.320 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:45.320 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:45.320 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:45.320 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.320 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-18T21:15:45.320 INFO:teuthology.orchestra.run.smithi005.stdout: "client": [ 2024-08-18T21:15:45.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T21:15:45.320 INFO:teuthology.orchestra.run.smithi005.stdout: "features": "0x3f03cffffffdffff", 2024-08-18T21:15:45.320 INFO:teuthology.orchestra.run.smithi005.stdout: "release": "squid", 2024-08-18T21:15:45.320 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 1 2024-08-18T21:15:45.320 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T21:15:45.321 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T21:15:45.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T21:15:45.321 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": false 2024-08-18T21:15:45.321 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f2463072640 1 -- 172.21.15.5:0/3445731344 >> v2:172.21.15.157:6812/631023601 conn(0x7f243c03bdc0 msgr2=0x7f243c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f2463072640 1 --2- 172.21.15.5:0/3445731344 >> v2:172.21.15.157:6812/631023601 conn(0x7f243c03bdc0 0x7f243c03e280 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2454011340 tx=0x7f245400b040 comp rx=0 tx=0).stop 2024-08-18T21:15:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f2463072640 10 monclient: shutdown 2024-08-18T21:15:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f2463072640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f2463072640 1 -- 172.21.15.5:0/3445731344 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f245c0a5280 msgr2=0x7f245c1d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f2463072640 1 --2- 172.21.15.5:0/3445731344 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f245c0a5280 0x7f245c1d1a80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f244c00d5d0 tx=0x7f244c00da90 comp rx=0 tx=0).stop 2024-08-18T21:15:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f246160f640 1 -- 172.21.15.5:0/3445731344 reap_dead start 2024-08-18T21:15:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f246160f640 1 -- 172.21.15.5:0/3445731344 reap_dead start 2024-08-18T21:15:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f2463072640 1 -- 172.21.15.5:0/3445731344 shutdown_connections 2024-08-18T21:15:45.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f2463072640 1 -- 172.21.15.5:0/3445731344 >> 172.21.15.5:0/3445731344 conn(0x7f245c0a6440 msgr2=0x7f245c0a6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f2463072640 1 -- 172.21.15.5:0/3445731344 shutdown_connections 2024-08-18T21:15:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.262+0000 7f2463072640 1 -- 172.21.15.5:0/3445731344 wait complete. 2024-08-18T21:15:45.324 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-18T21:15:45.324 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-18T21:15:45.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-18T21:15:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.426+0000 7f13f0622640 1 -- 172.21.15.5:0/2339149515 --> v2:172.21.15.157:6812/631023601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f13e80a2830 con 0x7f13cc03bdb0 2024-08-18T21:15:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.430+0000 7f13deffd640 1 -- 172.21.15.5:0/2339149515 <== mgr.4130 v2:172.21.15.157:6812/631023601 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34068 (secure 0 0 0) 0x7f13e80a2830 con 0x7f13cc03bdb0 2024-08-18T21:15:45.429 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:15:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T21:15:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.434+0000 7f13f0622640 1 -- 172.21.15.5:0/2339149515 >> v2:172.21.15.157:6812/631023601 conn(0x7f13cc03bdb0 msgr2=0x7f13cc03e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.434+0000 7f13f0622640 1 --2- 172.21.15.5:0/2339149515 >> v2:172.21.15.157:6812/631023601 conn(0x7f13cc03bdb0 0x7f13cc03e270 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009790 tx=0x7f13e4008040 comp rx=0 tx=0).stop 2024-08-18T21:15:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.434+0000 7f13f0622640 10 monclient: shutdown 2024-08-18T21:15:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.434+0000 7f13f0622640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.434+0000 7f13f0622640 1 -- 172.21.15.5:0/2339149515 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13e80a63e0 msgr2=0x7f13e81cfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.434+0000 7f13f0622640 1 --2- 172.21.15.5:0/2339149515 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13e80a63e0 0x7f13e81cfef0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f13d80ae040 tx=0x7f13d80191e0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.434+0000 7f13f0622640 1 -- 172.21.15.5:0/2339149515 shutdown_connections 2024-08-18T21:15:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.434+0000 7f13f0622640 1 --2- 172.21.15.5:0/2339149515 >> v2:172.21.15.157:6812/631023601 conn(0x7f13cc03bdb0 0x7f13cc03e270 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.434+0000 7f13f0622640 1 --2- 172.21.15.5:0/2339149515 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f13e8137e20 0x7f13e813b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.434+0000 7f13f0622640 1 --2- 172.21.15.5:0/2339149515 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f13e80a63e0 0x7f13e81cfef0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.434+0000 7f13f0622640 1 --2- 172.21.15.5:0/2339149515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13e80a5ac0 0x7f13e81cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.434+0000 7f13f0622640 1 -- 172.21.15.5:0/2339149515 >> 172.21.15.5:0/2339149515 conn(0x7f13e80aa770 msgr2=0x7f13e80a7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.434+0000 7f13f0622640 1 -- 172.21.15.5:0/2339149515 shutdown_connections 2024-08-18T21:15:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.434+0000 7f13f0622640 1 -- 172.21.15.5:0/2339149515 wait complete. 2024-08-18T21:15:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.446+0000 7f79988ca640 10 monclient: get_monmap_and_config 2024-08-18T21:15:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.446+0000 7f79988ca640 10 monclient: build_initial_monmap 2024-08-18T21:15:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.446+0000 7f79988ca640 10 monclient: monmap: 2024-08-18T21:15:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.445 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:45.450872+0000 2024-08-18T21:15:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:45.450872+0000 2024-08-18T21:15:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:45.446 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:45.447 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.446+0000 7f79988ca640 1 Processor -- start 2024-08-18T21:15:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.446+0000 7f79988ca640 1 -- start start 2024-08-18T21:15:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.446+0000 7f79988ca640 10 monclient: init 2024-08-18T21:15:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f79988ca640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f79988ca640 10 monclient: _add_conns ranks=[9,4,3,10,5,8,0,7,6,1,2] 2024-08-18T21:15:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f79988ca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f799409da30 0x7f799409de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f79988ca640 10 monclient(hunting): picked mon.noname-a con 0x7f799409da30 addr v2:172.21.15.5:3300/0 2024-08-18T21:15:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f79988ca640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79940a03e0 0x7f799409e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f79988ca640 10 monclient(hunting): picked mon.noname-c con 0x7f79940a03e0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:15:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f79988ca640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79940a3110 0x7f79941366a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f79988ca640 10 monclient(hunting): picked mon.noname-g con 0x7f79940a3110 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f79988ca640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f79988ca640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f799409e890 con 0x7f799409da30 2024-08-18T21:15:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f79988ca640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f79988ca640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f799409f7c0 con 0x7f79940a3110 2024-08-18T21:15:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f79988ca640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f79988ca640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f799409f4e0 con 0x7f79940a03e0 2024-08-18T21:15:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f79988ca640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f79988ca640 10 monclient(hunting): authenticate will time out at 1712.464261s 2024-08-18T21:15:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f799259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f799409da30 0x7f799409de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79940a03e0 0x7f799409e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f799259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f799409da30 0x7f799409de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53794/0 (socket says 172.21.15.5:53794) 2024-08-18T21:15:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f799259c640 1 -- 172.21.15.5:0/1211857020 learned_addr learned my addr 172.21.15.5:0/1211857020 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:45.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f799259c640 10 monclient(hunting): get_auth_request con 0x7f799409da30 auth_method 0 2024-08-18T21:15:45.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f799259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f799259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f799259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 10 monclient(hunting): get_auth_request con 0x7f79940a03e0 auth_method 0 2024-08-18T21:15:45.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f799259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f799259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f799259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 10 monclient(hunting): handle_auth_done global_id 115069 payload 274 2024-08-18T21:15:45.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7992d9d640 1 --2- 172.21.15.5:0/1211857020 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79940a3110 0x7f79941366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 1 -- 172.21.15.5:0/1211857020 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79940a3110 msgr2=0x7f79941366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:45.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 1 --2- 172.21.15.5:0/1211857020 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79940a3110 0x7f79941366a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 1 -- 172.21.15.5:0/1211857020 >> v2:172.21.15.5:3300/0 conn(0x7f799409da30 msgr2=0x7f799409de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:45.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 1 --2- 172.21.15.5:0/1211857020 >> v2:172.21.15.5:3300/0 conn(0x7f799409da30 0x7f799409de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:15:45.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 1 monclient: found mon.noname-c 2024-08-18T21:15:45.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:45.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:15:45.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.450+0000 7f7991d9b640 1 -- 172.21.15.5:0/1211857020 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799409faa0 con 0x7f79940a03e0 2024-08-18T21:15:45.453 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":689,"stamp":"2024-08-18T21:15:44.858456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":204744,"kb_used_data":17604,"kb_used_omap":9,"kb_used_meta":186998,"kb_avail":566026296,"statfs":{"total":579820584960,"available":579610927104,"internally_reserved":0,"allocated":18026496,"data_stored":8938825,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9572,"internal_metadata":191486620},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.302097"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":726,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.853071+0000","last_change":"2024-08-18T21:03:33.600622+0000","last_active":"2024-08-18T21:15:43.853071+0000","last_peered":"2024-08-18T21:15:43.853071+0000","last_clean":"2024-08-18T21:15:43.853071+0000","last_became_active":"2024-08-18T21:03:33.598635+0000","last_became_peered":"2024-08-18T21:03:33.598635+0000","last_unstale":"2024-08-18T21:15:43.853071+0000","last_undegraded":"2024-08-18T21:15:43.853071+0000","last_fullsized":"2024-08-18T21:15:43.853071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:31.584484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:31.584484+0000","last_clean_scrub_stamp":"2024-08-18T21:03:31.584484+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:05.519532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":635,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.852644+0000","last_change":"2024-08-18T21:03:42.420443+0000","last_active":"2024-08-18T21:15:43.852644+0000","last_peered":"2024-08-18T21:15:43.852644+0000","last_clean":"2024-08-18T21:15:43.852644+0000","last_became_active":"2024-08-18T21:03:39.196022+0000","last_became_peered":"2024-08-18T21:03:39.196022+0000","last_unstale":"2024-08-18T21:15:43.852644+0000","last_undegraded":"2024-08-18T21:15:43.852644+0000","last_fullsized":"2024-08-18T21:15:43.852644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:31.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010002489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":635,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.854766+0000","last_change":"2024-08-18T21:03:42.185411+0000","last_active":"2024-08-18T21:15:43.854766+0000","last_peered":"2024-08-18T21:15:43.854766+0000","last_clean":"2024-08-18T21:15:43.854766+0000","last_became_active":"2024-08-18T21:03:39.201697+0000","last_became_peered":"2024-08-18T21:03:39.201697+0000","last_unstale":"2024-08-18T21:15:43.854766+0000","last_undegraded":"2024-08-18T21:15:43.854766+0000","last_fullsized":"2024-08-18T21:15:43.854766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:03:54.524520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001317337,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":644,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.855054+0000","last_change":"2024-08-18T21:03:42.184643+0000","last_active":"2024-08-18T21:15:43.855054+0000","last_peered":"2024-08-18T21:15:43.855054+0000","last_clean":"2024-08-18T21:15:43.855054+0000","last_became_active":"2024-08-18T21:03:39.201549+0000","last_became_peered":"2024-08-18T21:03:39.201549+0000","last_unstale":"2024-08-18T21:15:43.855054+0000","last_undegraded":"2024-08-18T21:15:43.855054+0000","last_fullsized":"2024-08-18T21:15:43.855054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:01:33.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010119630000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":639,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.854510+0000","last_change":"2024-08-18T21:03:42.420020+0000","last_active":"2024-08-18T21:15:43.854510+0000","last_peered":"2024-08-18T21:15:43.854510+0000","last_clean":"2024-08-18T21:15:43.854510+0000","last_became_active":"2024-08-18T21:03:39.203685+0000","last_became_peered":"2024-08-18T21:03:39.203685+0000","last_unstale":"2024-08-18T21:15:43.854510+0000","last_undegraded":"2024-08-18T21:15:43.854510+0000","last_fullsized":"2024-08-18T21:15:43.854510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:36.890241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099204900000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":634,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.852774+0000","last_change":"2024-08-18T21:03:42.420253+0000","last_active":"2024-08-18T21:15:43.852774+0000","last_peered":"2024-08-18T21:15:43.852774+0000","last_clean":"2024-08-18T21:15:43.852774+0000","last_became_active":"2024-08-18T21:03:39.192148+0000","last_became_peered":"2024-08-18T21:03:39.192148+0000","last_unstale":"2024-08-18T21:15:43.852774+0000","last_undegraded":"2024-08-18T21:15:43.852774+0000","last_fullsized":"2024-08-18T21:15:43.852774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:00:27.022175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082257800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":639,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.861806+0000","last_change":"2024-08-18T21:03:42.184578+0000","last_active":"2024-08-18T21:15:43.861806+0000","last_peered":"2024-08-18T21:15:43.861806+0000","last_clean":"2024-08-18T21:15:43.861806+0000","last_became_active":"2024-08-18T21:03:39.194596+0000","last_became_peered":"2024-08-18T21:03:39.194596+0000","last_unstale":"2024-08-18T21:15:43.861806+0000","last_undegraded":"2024-08-18T21:15:43.861806+0000","last_fullsized":"2024-08-18T21:15:43.861806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:22.467656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001127341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":634,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.852875+0000","last_change":"2024-08-18T21:03:42.420853+0000","last_active":"2024-08-18T21:15:43.852875+0000","last_peered":"2024-08-18T21:15:43.852875+0000","last_clean":"2024-08-18T21:15:43.852875+0000","last_became_active":"2024-08-18T21:03:39.195166+0000","last_became_peered":"2024-08-18T21:03:39.195166+0000","last_unstale":"2024-08-18T21:15:43.852875+0000","last_undegraded":"2024-08-18T21:15:43.852875+0000","last_fullsized":"2024-08-18T21:15:43.852875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:11:34.985385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001377777,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":633,"reported_epoch":327,"state":"active+clean","last_fresh":"2024-08-18T21:15:40.848621+0000","last_change":"2024-08-18T21:03:42.186027+0000","last_active":"2024-08-18T21:15:40.848621+0000","last_peered":"2024-08-18T21:15:40.848621+0000","last_clean":"2024-08-18T21:15:40.848621+0000","last_became_active":"2024-08-18T21:03:39.192275+0000","last_became_peered":"2024-08-18T21:03:39.192275+0000","last_unstale":"2024-08-18T21:15:40.848621+0000","last_undegraded":"2024-08-18T21:15:40.848621+0000","last_fullsized":"2024-08-18T21:15:40.848621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:55:49.809092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001842333,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":12,"seq":51539607701,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29860,"kb_used_data":2836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341980,"statfs":{"total":96636764160,"available":96606187520,"internally_reserved":0,"allocated":2904064,"data_stored":1297607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640405,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34152,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337688,"statfs":{"total":96636764160,"available":96601792512,"internally_reserved":0,"allocated":3035136,"data_stored":1844922,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640405,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34140,"kb_used_data":2944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337700,"statfs":{"total":96636764160,"available":96601804800,"internally_reserved":0,"allocated":3014656,"data_stored":1316730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640406,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34112,"kb_used_data":2916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337728,"statfs":{"total":96636764160,"available":96601833472,"internally_reserved":0,"allocated":2985984,"data_stored":1316547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640407,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38292,"kb_used_data":2944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333548,"statfs":{"total":96636764160,"available":96597553152,"internally_reserved":0,"allocated":3014656,"data_stored":1317085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640405,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34188,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337652,"statfs":{"total":96636764160,"available":96601755648,"internally_reserved":0,"allocated":3072000,"data_stored":1845934,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T21:15:45.454 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T21:15:45.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f7991d9b640 1 -- 172.21.15.5:0/1211857020 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79940a03e0 msgr2=0x7f799409e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:45.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f7991d9b640 1 --2- 172.21.15.5:0/1211857020 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79940a03e0 0x7f799409e350 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f79880097c0 tx=0x7f798801cad0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=64543450971dffed server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f799159a640 1 -- 172.21.15.5:0/1211857020 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f79880b0070 con 0x7f79940a03e0 2024-08-18T21:15:45.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f799159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f799159a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:15:45.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f799159a640 10 monclient: dump: 2024-08-18T21:15:45.459 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.459 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.459 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.459 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.460 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.460 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.460 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.460 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.460 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.460 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.460 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.460 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.460 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.460 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.460 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.460 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f799159a640 10 monclient: _finish_auth 0 2024-08-18T21:15:45.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f799159a640 10 monclient: _check_auth_tickets 2024-08-18T21:15:45.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f799159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:45.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f799159a640 1 -- 172.21.15.5:0/1211857020 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79880aa810 con 0x7f79940a03e0 2024-08-18T21:15:45.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f799159a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:45.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f799159a640 1 -- 172.21.15.5:0/1211857020 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f79880a9300 con 0x7f79940a03e0 2024-08-18T21:15:45.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 5 monclient: authenticate success, global_id 115069 2024-08-18T21:15:45.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:45.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 4 set_mon_vals no callback set 2024-08-18T21:15:45.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f799159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f799159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:15:45.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f799159a640 10 monclient: dump: 2024-08-18T21:15:45.461 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.462 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.462 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.462 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.462 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.462 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.462 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.462 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.462 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.462 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.462 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.462 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.462 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.462 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.463 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.463 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 10 monclient: shutdown 2024-08-18T21:15:45.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:45.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 -- 172.21.15.5:0/1211857020 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79940a03e0 msgr2=0x7f799409e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 --2- 172.21.15.5:0/1211857020 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79940a03e0 0x7f799409e350 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f79880097c0 tx=0x7f798801cad0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 -- 172.21.15.5:0/1211857020 shutdown_connections 2024-08-18T21:15:45.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 --2- 172.21.15.5:0/1211857020 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79940a3110 0x7f79941366a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 --2- 172.21.15.5:0/1211857020 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f79940a03e0 0x7f799409e350 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 --2- 172.21.15.5:0/1211857020 >> v2:172.21.15.5:3300/0 conn(0x7f799409da30 0x7f799409de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 -- 172.21.15.5:0/1211857020 >> 172.21.15.5:0/1211857020 conn(0x7f79940688d0 msgr2=0x7f7994068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:45.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 -- 172.21.15.5:0/1211857020 shutdown_connections 2024-08-18T21:15:45.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 -- 172.21.15.5:0/1211857020 wait complete. 2024-08-18T21:15:45.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 10 monclient: build_initial_monmap 2024-08-18T21:15:45.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 10 monclient: monmap: 2024-08-18T21:15:45.464 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:45.464 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:45.464 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:45.464 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:45.464 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:45.464 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.464 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:45.464 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:45.464 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:45.464 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:45.464 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:45.464 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:45.465 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:45.465 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:45.465 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:45.465 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 Processor -- start 2024-08-18T21:15:45.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 -- start start 2024-08-18T21:15:45.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 10 monclient: init 2024-08-18T21:15:45.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:45.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 10 monclient: _add_conns ranks=[2,6,5,0,3,1,7,8,4] 2024-08-18T21:15:45.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f799409da30 0x7f79941356c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 10 monclient(hunting): picked mon.noname-b con 0x7f799409da30 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:45.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79940a3110 0x7f79941210e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 10 monclient(hunting): picked mon.noname-d con 0x7f79940a3110 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:15:45.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7994135c00 0x7f7994121620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 10 monclient(hunting): picked mon.noname-h con 0x7f7994135c00 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:45.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f799406cce0 con 0x7f799409da30 2024-08-18T21:15:45.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f799406cb60 con 0x7f7994135c00 2024-08-18T21:15:45.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f799406ce60 con 0x7f79940a3110 2024-08-18T21:15:45.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:45.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.454+0000 7f79988ca640 10 monclient(hunting): authenticate will time out at 1712.471891s 2024-08-18T21:15:45.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f799409da30 0x7f79941356c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7991d9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79940a3110 0x7f79941210e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f799409da30 0x7f79941356c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33798/0 (socket says 172.21.15.5:33798) 2024-08-18T21:15:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7991d9b640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79940a3110 0x7f79941210e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:38402/0 (socket says 172.21.15.5:38402) 2024-08-18T21:15:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 1 -- 172.21.15.5:0/3784243231 learned_addr learned my addr 172.21.15.5:0/3784243231 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 10 monclient(hunting): get_auth_request con 0x7f799409da30 auth_method 0 2024-08-18T21:15:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7991d9b640 10 monclient(hunting): get_auth_request con 0x7f79940a3110 auth_method 0 2024-08-18T21:15:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7991d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7991d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7991d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7991d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7991d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7991d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7992d9d640 1 --2- 172.21.15.5:0/3784243231 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7994135c00 0x7f7994121620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7992d9d640 10 monclient(hunting): get_auth_request con 0x7f7994135c00 auth_method 0 2024-08-18T21:15:45.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7992d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7992d9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7992d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 10 monclient(hunting): handle_auth_done global_id 115193 payload 824 2024-08-18T21:15:45.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 1 -- 172.21.15.5:0/3784243231 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79940a3110 msgr2=0x7f79941210e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 1 --2- 172.21.15.5:0/3784243231 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79940a3110 0x7f79941210e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 1 -- 172.21.15.5:0/3784243231 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7994135c00 msgr2=0x7f7994121620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 1 --2- 172.21.15.5:0/3784243231 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7994135c00 0x7f7994121620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 10 monclient: _finish_hunting 0 2024-08-18T21:15:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 1 monclient: found mon.noname-b 2024-08-18T21:15:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 1 -- 172.21.15.5:0/3784243231 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7994122ae0 con 0x7f799409da30 2024-08-18T21:15:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7992d9d640 1 --2- 172.21.15.5:0/3784243231 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7994135c00 0x7f7994121620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:15:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 1 -- 172.21.15.5:0/3784243231 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f799409da30 msgr2=0x7f79941356c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f799259c640 1 --2- 172.21.15.5:0/3784243231 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f799409da30 0x7f79941356c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f798400b240 tx=0x7f798400d350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7982ffd640 1 -- 172.21.15.5:0/3784243231 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f79840108b0 con 0x7f799409da30 2024-08-18T21:15:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7982ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7982ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7982ffd640 10 monclient: dump: 2024-08-18T21:15:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.471 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7982ffd640 10 monclient: _finish_auth 0 2024-08-18T21:15:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7982ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:15:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7982ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f79988ca640 5 monclient: authenticate success, global_id 115193 2024-08-18T21:15:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7982ffd640 1 -- 172.21.15.5:0/3784243231 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7984010a90 con 0x7f799409da30 2024-08-18T21:15:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f79988ca640 10 monclient: _renew_subs 2024-08-18T21:15:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f79988ca640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f79988ca640 1 -- 172.21.15.5:0/3784243231 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f799413c0d0 con 0x7f799409da30 2024-08-18T21:15:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7982ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7982ffd640 1 -- 172.21.15.5:0/3784243231 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7984010c40 con 0x7f799409da30 2024-08-18T21:15:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7982ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7982ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:45.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7990d99640 4 set_mon_vals no callback set 2024-08-18T21:15:45.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7982ffd640 10 monclient: dump: 2024-08-18T21:15:45.472 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.472 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.472 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.472 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.472 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.472 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.472 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.472 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.472 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.472 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.473 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.473 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.473 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.473 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.473 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.473 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f79988ca640 10 monclient: _renew_subs 2024-08-18T21:15:45.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f79988ca640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:45.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f79988ca640 1 -- 172.21.15.5:0/3784243231 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7994124e40 con 0x7f799409da30 2024-08-18T21:15:45.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f7982ffd640 1 -- 172.21.15.5:0/3784243231 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f7984010440 con 0x7f799409da30 2024-08-18T21:15:45.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f79988ca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:45.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f79988ca640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:45.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f79988ca640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:45.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.458+0000 7f79988ca640 1 -- 172.21.15.5:0/3784243231 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79940a2eb0 con 0x7f799409da30 2024-08-18T21:15:45.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.462+0000 7f7982ffd640 1 --2- 172.21.15.5:0/3784243231 >> v2:172.21.15.157:6812/631023601 conn(0x7f797403bcf0 0x7f797403e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.462+0000 7f7982ffd640 1 -- 172.21.15.5:0/3784243231 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(331..331 src has 22..331) ==== 3506+0+0 (secure 0 0 0) 0x7f798404edf0 con 0x7f799409da30 2024-08-18T21:15:45.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.462+0000 7f7991d9b640 1 --2- 172.21.15.5:0/3784243231 >> v2:172.21.15.157:6812/631023601 conn(0x7f797403bcf0 0x7f797403e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.462+0000 7f7991d9b640 10 monclient: get_auth_request con 0x7f797403bcf0 auth_method 0 2024-08-18T21:15:45.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.462+0000 7f7991d9b640 1 --2- 172.21.15.5:0/3784243231 >> v2:172.21.15.157:6812/631023601 conn(0x7f797403bcf0 0x7f797403e1b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7994070010 tx=0x7f7988004740 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.466+0000 7f7982ffd640 1 -- 172.21.15.5:0/3784243231 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f7984052030 con 0x7f799409da30 2024-08-18T21:15:45.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.466+0000 7f7982ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:45.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.466+0000 7f7982ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.570+0000 7f9ae1e01640 10 monclient: get_monmap_and_config 2024-08-18T21:15:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.570+0000 7f9ae1e01640 10 monclient: build_initial_monmap 2024-08-18T21:15:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.570+0000 7f9ae1e01640 10 monclient: monmap: 2024-08-18T21:15:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:45.575731+0000 2024-08-18T21:15:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:45.575731+0000 2024-08-18T21:15:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:45.572 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 1 Processor -- start 2024-08-18T21:15:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 1 -- start start 2024-08-18T21:15:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 10 monclient: init 2024-08-18T21:15:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 10 monclient: _add_conns ranks=[10,9,0,1,6,8,7,5,2,4,3] 2024-08-18T21:15:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9adc0a59e0 0x7f9adc0a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 10 monclient(hunting): picked mon.noname-f con 0x7f9adc0a59e0 addr v2:172.21.15.157:3300/0 2024-08-18T21:15:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9adc0a0cd0 0x7f9adc0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 10 monclient(hunting): picked mon.noname-a con 0x7f9adc0a0cd0 addr v2:172.21.15.5:3300/0 2024-08-18T21:15:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9adc139b80 addr v1:172.21.15.5:6789/0 2024-08-18T21:15:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9adc0a16b0 con 0x7f9adc139b80 2024-08-18T21:15:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9adc06de40 con 0x7f9adc0a0cd0 2024-08-18T21:15:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f9adc0a6840 con 0x7f9adc0a59e0 2024-08-18T21:15:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9ae1e01640 10 monclient(hunting): authenticate will time out at 1712.589439s 2024-08-18T21:15:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adaffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9adc0a0cd0 0x7f9adc0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adaffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9adc0a0cd0 0x7f9adc0a6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53800/0 (socket says 172.21.15.5:53800) 2024-08-18T21:15:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adaffd640 1 -- 172.21.15.5:0/1260929824 learned_addr learned my addr 172.21.15.5:0/1260929824 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adaffd640 10 monclient(hunting): get_auth_request con 0x7f9adc0a0cd0 auth_method 0 2024-08-18T21:15:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adaffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adaffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 1 --2- 172.21.15.5:0/1260929824 >> v2:172.21.15.157:3300/0 conn(0x7f9adc0a59e0 0x7f9adc0a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 10 monclient(hunting): get_auth_request con 0x7f9adc0a59e0 auth_method 0 2024-08-18T21:15:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 10 monclient(hunting): handle_auth_done global_id 174160 payload 274 2024-08-18T21:15:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 1 -- 172.21.15.5:0/1260929824 >> v2:172.21.15.5:3300/0 conn(0x7f9adc0a0cd0 msgr2=0x7f9adc0a6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 1 --2- 172.21.15.5:0/1260929824 >> v2:172.21.15.5:3300/0 conn(0x7f9adc0a0cd0 0x7f9adc0a6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 1 -- 172.21.15.5:0/1260929824 >> v1:172.21.15.5:6789/0 conn(0x7f9adc139b80 legacy=0x7f9adc139fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:15:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 1 monclient: found mon.noname-f 2024-08-18T21:15:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:15:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.574+0000 7f9adb7fe640 1 -- 172.21.15.5:0/1260929824 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9adc06f0f0 con 0x7f9adc0a59e0 2024-08-18T21:15:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9adb7fe640 1 -- 172.21.15.5:0/1260929824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9adc0a59e0 msgr2=0x7f9adc0a5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9adb7fe640 1 --2- 172.21.15.5:0/1260929824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9adc0a59e0 0x7f9adc0a5dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0a0c80 tx=0x7f9ad001c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19ca56defef19591 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ada7fc640 1 -- 172.21.15.5:0/1260929824 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ad00b0070 con 0x7f9adc0a59e0 2024-08-18T21:15:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ada7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ada7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:15:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ada7fc640 10 monclient: dump: 2024-08-18T21:15:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.580 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ada7fc640 10 monclient: _finish_auth 0 2024-08-18T21:15:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ada7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:15:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ada7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ada7fc640 1 -- 172.21.15.5:0/1260929824 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad00aa810 con 0x7f9adc0a59e0 2024-08-18T21:15:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ae1e01640 5 monclient: authenticate success, global_id 174160 2024-08-18T21:15:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ae1e01640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:15:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ada7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ada7fc640 1 -- 172.21.15.5:0/1260929824 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ad00a9300 con 0x7f9adc0a59e0 2024-08-18T21:15:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ae1e01640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ada7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ae1e01640 4 set_mon_vals no callback set 2024-08-18T21:15:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ada7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:15:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.578+0000 7f9ada7fc640 10 monclient: dump: 2024-08-18T21:15:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.583 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 10 monclient: shutdown 2024-08-18T21:15:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 1 -- 172.21.15.5:0/1260929824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9adc0a59e0 msgr2=0x7f9adc0a5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 1 --2- 172.21.15.5:0/1260929824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9adc0a59e0 0x7f9adc0a5dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0a0c80 tx=0x7f9ad001c3d0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 1 -- 172.21.15.5:0/1260929824 shutdown_connections 2024-08-18T21:15:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 1 --2- 172.21.15.5:0/1260929824 >> v2:172.21.15.5:3300/0 conn(0x7f9adc0a0cd0 0x7f9adc0a6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 1 --2- 172.21.15.5:0/1260929824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9adc0a59e0 0x7f9adc0a5dc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 1 -- 172.21.15.5:0/1260929824 >> 172.21.15.5:0/1260929824 conn(0x7f9adc0aa5d0 msgr2=0x7f9adc0a6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 1 -- 172.21.15.5:0/1260929824 shutdown_connections 2024-08-18T21:15:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 1 -- 172.21.15.5:0/1260929824 wait complete. 2024-08-18T21:15:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 10 monclient: build_initial_monmap 2024-08-18T21:15:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 10 monclient: monmap: 2024-08-18T21:15:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:45.588 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 1 Processor -- start 2024-08-18T21:15:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 1 -- start start 2024-08-18T21:15:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 10 monclient: init 2024-08-18T21:15:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 10 monclient: _add_conns ranks=[3,6,8,7,4,0,1,5,2] 2024-08-18T21:15:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9adc0a0cd0 0x7f9adc13ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 10 monclient(hunting): picked mon.noname-g con 0x7f9adc0a0cd0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9adc0a59e0 0x7f9adc138b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 10 monclient(hunting): picked mon.noname-d con 0x7f9adc0a59e0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:15:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9adc139b80 0x7f9adc1390b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 10 monclient(hunting): picked mon.noname-e con 0x7f9adc139b80 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9adc144600 con 0x7f9adc0a0cd0 2024-08-18T21:15:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f9adc06e290 con 0x7f9adc0a59e0 2024-08-18T21:15:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f9adc144780 con 0x7f9adc139b80 2024-08-18T21:15:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9ae1e01640 10 monclient(hunting): authenticate will time out at 1712.598546s 2024-08-18T21:15:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9adc0a59e0 0x7f9adc138b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adbfff640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9adc139b80 0x7f9adc1390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9adc0a59e0 0x7f9adc138b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:38418/0 (socket says 172.21.15.5:38418) 2024-08-18T21:15:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 1 -- 172.21.15.5:0/3424735429 learned_addr learned my addr 172.21.15.5:0/3424735429 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 10 monclient(hunting): get_auth_request con 0x7f9adc0a59e0 auth_method 0 2024-08-18T21:15:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adbfff640 10 monclient(hunting): get_auth_request con 0x7f9adc139b80 auth_method 0 2024-08-18T21:15:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adbfff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adb7fe640 1 --2- 172.21.15.5:0/3424735429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9adc0a0cd0 0x7f9adc13ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adb7fe640 10 monclient(hunting): get_auth_request con 0x7f9adc0a0cd0 auth_method 0 2024-08-18T21:15:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 10 monclient(hunting): handle_auth_done global_id 174174 payload 824 2024-08-18T21:15:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 1 -- 172.21.15.5:0/3424735429 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9adc139b80 msgr2=0x7f9adc1390b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 1 --2- 172.21.15.5:0/3424735429 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9adc139b80 0x7f9adc1390b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 1 -- 172.21.15.5:0/3424735429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9adc0a0cd0 msgr2=0x7f9adc13ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 1 --2- 172.21.15.5:0/3424735429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9adc0a0cd0 0x7f9adc13ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 10 monclient: _finish_hunting 0 2024-08-18T21:15:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 1 monclient: found mon.noname-d 2024-08-18T21:15:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:15:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adaffd640 1 -- 172.21.15.5:0/3424735429 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9adc077830 con 0x7f9adc0a59e0 2024-08-18T21:15:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.582+0000 7f9adbfff640 1 --2- 172.21.15.5:0/3424735429 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9adc139b80 0x7f9adc1390b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:15:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9adaffd640 1 -- 172.21.15.5:0/3424735429 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9adc0a59e0 msgr2=0x7f9adc138b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9adaffd640 1 --2- 172.21.15.5:0/3424735429 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9adc0a59e0 0x7f9adc138b70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00efc0 tx=0x7f9acc00c490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ac3fff640 1 -- 172.21.15.5:0/3424735429 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9acc00cdb0 con 0x7f9adc0a59e0 2024-08-18T21:15:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ac3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ac3fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:15:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ac3fff640 10 monclient: dump: 2024-08-18T21:15:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.594 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ac3fff640 10 monclient: _finish_auth 0 2024-08-18T21:15:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ac3fff640 10 monclient: _check_auth_tickets 2024-08-18T21:15:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ac3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ae1e01640 5 monclient: authenticate success, global_id 174174 2024-08-18T21:15:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ac3fff640 1 -- 172.21.15.5:0/3424735429 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9acc019070 con 0x7f9adc0a59e0 2024-08-18T21:15:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ac3fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ae1e01640 10 monclient: _renew_subs 2024-08-18T21:15:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ac3fff640 1 -- 172.21.15.5:0/3424735429 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9acc014d60 con 0x7f9adc0a59e0 2024-08-18T21:15:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ae1e01640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:15:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ae1e01640 1 -- 172.21.15.5:0/3424735429 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9adc13d440 con 0x7f9adc0a59e0 2024-08-18T21:15:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ac3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ac3fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:15:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ad9ffb640 4 set_mon_vals no callback set 2024-08-18T21:15:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ac3fff640 10 monclient: dump: 2024-08-18T21:15:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.596 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ae1e01640 10 monclient: _renew_subs 2024-08-18T21:15:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ae1e01640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:15:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ae1e01640 1 -- 172.21.15.5:0/3424735429 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f9adc13dfa0 con 0x7f9adc0a59e0 2024-08-18T21:15:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ae1e01640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ae1e01640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ae1e01640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:15:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ae1e01640 1 -- 172.21.15.5:0/3424735429 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9adc0a9a00 con 0x7f9adc0a59e0 2024-08-18T21:15:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ac3fff640 1 -- 172.21.15.5:0/3424735429 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f9acc012050 con 0x7f9adc0a59e0 2024-08-18T21:15:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ac3fff640 1 --2- 172.21.15.5:0/3424735429 >> v2:172.21.15.157:6812/631023601 conn(0x7f9ac803bdc0 0x7f9ac803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9ac3fff640 1 -- 172.21.15.5:0/3424735429 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(331..331 src has 22..331) ==== 3506+0+0 (secure 0 0 0) 0x7f9acc04e760 con 0x7f9adc0a59e0 2024-08-18T21:15:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9adb7fe640 1 --2- 172.21.15.5:0/3424735429 >> v2:172.21.15.157:6812/631023601 conn(0x7f9ac803bdc0 0x7f9ac803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.586+0000 7f9adb7fe640 10 monclient: get_auth_request con 0x7f9ac803bdc0 auth_method 0 2024-08-18T21:15:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.590+0000 7f9adb7fe640 1 --2- 172.21.15.5:0/3424735429 >> v2:172.21.15.157:6812/631023601 conn(0x7f9ac803bdc0 0x7f9ac803e280 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9adc076ee0 tx=0x7f9ad00a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.590+0000 7f9ac3fff640 1 -- 172.21.15.5:0/3424735429 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f9acc022060 con 0x7f9adc0a59e0 2024-08-18T21:15:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.590+0000 7f9ac3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:45.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.590+0000 7f9ac3fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:45.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.706+0000 7f79988ca640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-18T21:15:45.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.706+0000 7f79988ca640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-18T21:15:45.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.706+0000 7f79988ca640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:45.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.706+0000 7f79988ca640 1 -- 172.21.15.5:0/3784243231 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f799406e0d0 con 0x7f799409da30 2024-08-18T21:15:45.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.710+0000 7f7982ffd640 1 -- 172.21.15.5:0/3784243231 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f7984014030 con 0x7f799409da30 2024-08-18T21:15:45.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.710+0000 7f7982ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-18T21:15:45.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.710+0000 7f7982ffd640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:15:45.712 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.712 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=9,logm=52} crc {auth=1860687002,config=1618278320,health=1180819906,kv=3058383650,logm=1372485179}) 2024-08-18T21:15:45.712 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=28,config=2,health=12,kv=9,logm=49} crc {auth=2763518954,config=1618278320,health=3417833825,kv=64388820,logm=1930852793}) 2024-08-18T21:15:45.712 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.712 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=9,logm=52} crc {auth=1860687002,config=1618278320,health=1180819906,kv=3058383650,logm=1372485179}) 2024-08-18T21:15:45.712 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=25,config=2,health=12,kv=9,logm=52} crc {auth=2688729286,config=1618278320,health=3417833825,kv=64388820,logm=1585382761}) 2024-08-18T21:15:45.712 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=9,logm=52} crc {auth=1860687002,config=1618278320,health=1180819906,kv=3058383650,logm=1372485179}) 2024-08-18T21:15:45.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=28,config=2,health=11,kv=8,logm=51} crc {auth=218518982,config=1618278320,health=3357365337,kv=2782037072,logm=2138071318}) 2024-08-18T21:15:45.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=9,logm=52} crc {auth=1860687002,config=1618278320,health=1180819906,kv=3058383650,logm=1372485179}) 2024-08-18T21:15:45.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=27,config=2,health=12,kv=10,logm=49} crc {auth=1126036290,config=1618278320,health=3417833825,kv=3664197221,logm=1314762640}) 2024-08-18T21:15:45.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=9,logm=52} crc {auth=1860687002,config=1618278320,health=1180819906,kv=3058383650,logm=1372485179}) 2024-08-18T21:15:45.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=26,config=2,health=12,kv=10,logm=50} crc {auth=3863382067,config=1618278320,health=3417833825,kv=3664197221,logm=2723617437}) 2024-08-18T21:15:45.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=9,logm=52} crc {auth=1860687002,config=1618278320,health=1180819906,kv=3058383650,logm=1372485179}) 2024-08-18T21:15:45.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=26,config=2,health=12,kv=10,logm=50} crc {auth=2955764310,config=1618278320,health=3417833825,kv=3382662806,logm=2795630999}) 2024-08-18T21:15:45.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=9,logm=52} crc {auth=1860687002,config=1618278320,health=1180819906,kv=3058383650,logm=1372485179}) 2024-08-18T21:15:45.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=28,config=2,health=12,kv=10,logm=48} crc {auth=3911144578,config=1618278320,health=3417833825,kv=3664197221,logm=1334858156}) 2024-08-18T21:15:45.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=9,logm=52} crc {auth=1860687002,config=1618278320,health=1180819906,kv=3058383650,logm=1372485179}) 2024-08-18T21:15:45.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=29,config=2,health=12,kv=9,logm=48} crc {auth=903499110,config=1618278320,health=3417833825,kv=3322494909,logm=2634176068}) 2024-08-18T21:15:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.714+0000 7f79988ca640 1 -- 172.21.15.5:0/3784243231 >> v2:172.21.15.157:6812/631023601 conn(0x7f797403bcf0 msgr2=0x7f797403e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.714+0000 7f79988ca640 1 --2- 172.21.15.5:0/3784243231 >> v2:172.21.15.157:6812/631023601 conn(0x7f797403bcf0 0x7f797403e1b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7994070010 tx=0x7f7988004740 comp rx=0 tx=0).stop 2024-08-18T21:15:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.714+0000 7f79988ca640 10 monclient: shutdown 2024-08-18T21:15:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.714+0000 7f79988ca640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.714+0000 7f79988ca640 1 -- 172.21.15.5:0/3784243231 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f799409da30 msgr2=0x7f79941356c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.714+0000 7f79988ca640 1 --2- 172.21.15.5:0/3784243231 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f799409da30 0x7f79941356c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f798400b240 tx=0x7f798400d350 comp rx=0 tx=0).stop 2024-08-18T21:15:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.714+0000 7f79988ca640 1 -- 172.21.15.5:0/3784243231 shutdown_connections 2024-08-18T21:15:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.714+0000 7f79988ca640 1 --2- 172.21.15.5:0/3784243231 >> v2:172.21.15.157:6812/631023601 conn(0x7f797403bcf0 0x7f797403e1b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.714+0000 7f79988ca640 1 --2- 172.21.15.5:0/3784243231 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f7994135c00 0x7f7994121620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.714+0000 7f79988ca640 1 --2- 172.21.15.5:0/3784243231 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f79940a3110 0x7f79941210e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.714+0000 7f79988ca640 1 --2- 172.21.15.5:0/3784243231 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f799409da30 0x7f79941356c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.714+0000 7f79988ca640 1 -- 172.21.15.5:0/3784243231 >> 172.21.15.5:0/3784243231 conn(0x7f79940688d0 msgr2=0x7f79940a0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.714+0000 7f79988ca640 1 -- 172.21.15.5:0/3784243231 shutdown_connections 2024-08-18T21:15:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.714+0000 7f79988ca640 1 -- 172.21.15.5:0/3784243231 wait complete. 2024-08-18T21:15:45.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=869001303}) 2024-08-18T21:15:45.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1054088823}) 2024-08-18T21:15:45.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=869001303}) 2024-08-18T21:15:45.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1135786116}) 2024-08-18T21:15:45.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=869001303}) 2024-08-18T21:15:45.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2091937635}) 2024-08-18T21:15:45.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=869001303}) 2024-08-18T21:15:45.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2488388170}) 2024-08-18T21:15:45.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=869001303}) 2024-08-18T21:15:45.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2944451373}) 2024-08-18T21:15:45.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=869001303}) 2024-08-18T21:15:45.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3488625423}) 2024-08-18T21:15:45.720 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.720 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=869001303}) 2024-08-18T21:15:45.720 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3445950131}) 2024-08-18T21:15:45.720 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.720 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=869001303}) 2024-08-18T21:15:45.720 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3925593970}) 2024-08-18T21:15:45.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2878017114}) 2024-08-18T21:15:45.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2888283938}) 2024-08-18T21:15:45.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2878017114}) 2024-08-18T21:15:45.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4208060267}) 2024-08-18T21:15:45.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2878017114}) 2024-08-18T21:15:45.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1671090237}) 2024-08-18T21:15:45.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2878017114}) 2024-08-18T21:15:45.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2726220400}) 2024-08-18T21:15:45.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.727 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2878017114}) 2024-08-18T21:15:45.727 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3556401414}) 2024-08-18T21:15:45.727 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.727 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2878017114}) 2024-08-18T21:15:45.727 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=559196258}) 2024-08-18T21:15:45.727 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.727 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2878017114}) 2024-08-18T21:15:45.727 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=202495531}) 2024-08-18T21:15:45.727 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.727 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2878017114}) 2024-08-18T21:15:45.727 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3879355602}) 2024-08-18T21:15:45.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2075482833}) 2024-08-18T21:15:45.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2881907601}) 2024-08-18T21:15:45.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2075482833}) 2024-08-18T21:15:45.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=377654061}) 2024-08-18T21:15:45.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2075482833}) 2024-08-18T21:15:45.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2020575260}) 2024-08-18T21:15:45.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2075482833}) 2024-08-18T21:15:45.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4033185311}) 2024-08-18T21:15:45.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2075482833}) 2024-08-18T21:15:45.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2121001824}) 2024-08-18T21:15:45.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2075482833}) 2024-08-18T21:15:45.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=949764998}) 2024-08-18T21:15:45.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2075482833}) 2024-08-18T21:15:45.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3973894306}) 2024-08-18T21:15:45.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2075482833}) 2024-08-18T21:15:45.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3033365699}) 2024-08-18T21:15:45.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1556077080}) 2024-08-18T21:15:45.735 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-18T21:15:45.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1750433452}) 2024-08-18T21:15:45.736 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.736 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1556077080}) 2024-08-18T21:15:45.736 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=325241679}) 2024-08-18T21:15:45.736 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.736 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1556077080}) 2024-08-18T21:15:45.736 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=160446503}) 2024-08-18T21:15:45.736 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.736 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1556077080}) 2024-08-18T21:15:45.736 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=781670637}) 2024-08-18T21:15:45.736 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.736 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1556077080}) 2024-08-18T21:15:45.736 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2138452430}) 2024-08-18T21:15:45.736 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1556077080}) 2024-08-18T21:15:45.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=493883014}) 2024-08-18T21:15:45.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1556077080}) 2024-08-18T21:15:45.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3099414703}) 2024-08-18T21:15:45.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1556077080}) 2024-08-18T21:15:45.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2487134392}) 2024-08-18T21:15:45.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1641892059}) 2024-08-18T21:15:45.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1808262089}) 2024-08-18T21:15:45.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1641892059}) 2024-08-18T21:15:45.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1434309872}) 2024-08-18T21:15:45.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1641892059}) 2024-08-18T21:15:45.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=816077520}) 2024-08-18T21:15:45.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1641892059}) 2024-08-18T21:15:45.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=708932426}) 2024-08-18T21:15:45.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1641892059}) 2024-08-18T21:15:45.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1801593698}) 2024-08-18T21:15:45.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1641892059}) 2024-08-18T21:15:45.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=150538872}) 2024-08-18T21:15:45.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1641892059}) 2024-08-18T21:15:45.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1231363925}) 2024-08-18T21:15:45.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1641892059}) 2024-08-18T21:15:45.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=327906584}) 2024-08-18T21:15:45.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409747400}) 2024-08-18T21:15:45.745 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=692356087}) 2024-08-18T21:15:45.745 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.745 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409747400}) 2024-08-18T21:15:45.745 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3981142466}) 2024-08-18T21:15:45.745 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.745 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409747400}) 2024-08-18T21:15:45.745 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1209067598}) 2024-08-18T21:15:45.745 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.745 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409747400}) 2024-08-18T21:15:45.745 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=718511720}) 2024-08-18T21:15:45.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409747400}) 2024-08-18T21:15:45.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1445669767}) 2024-08-18T21:15:45.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409747400}) 2024-08-18T21:15:45.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1935475824}) 2024-08-18T21:15:45.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409747400}) 2024-08-18T21:15:45.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1639246049}) 2024-08-18T21:15:45.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409747400}) 2024-08-18T21:15:45.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1322990838}) 2024-08-18T21:15:45.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000953153}) 2024-08-18T21:15:45.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2738731305}) 2024-08-18T21:15:45.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000953153}) 2024-08-18T21:15:45.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3589384061}) 2024-08-18T21:15:45.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000953153}) 2024-08-18T21:15:45.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1690633079}) 2024-08-18T21:15:45.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000953153}) 2024-08-18T21:15:45.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=738605924}) 2024-08-18T21:15:45.753 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.753 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000953153}) 2024-08-18T21:15:45.753 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1736814661}) 2024-08-18T21:15:45.753 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.753 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000953153}) 2024-08-18T21:15:45.753 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4280932634}) 2024-08-18T21:15:45.753 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.753 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000953153}) 2024-08-18T21:15:45.753 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1493720888}) 2024-08-18T21:15:45.753 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.753 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000953153}) 2024-08-18T21:15:45.753 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.746+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1248684832}) 2024-08-18T21:15:45.753 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.754 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3846236539}) 2024-08-18T21:15:45.754 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4172066268}) 2024-08-18T21:15:45.754 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.754 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3846236539}) 2024-08-18T21:15:45.754 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1518524868}) 2024-08-18T21:15:45.754 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.754 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3846236539}) 2024-08-18T21:15:45.754 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3443640863}) 2024-08-18T21:15:45.754 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.754 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3846236539}) 2024-08-18T21:15:45.754 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=139877958}) 2024-08-18T21:15:45.754 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.754 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3846236539}) 2024-08-18T21:15:45.755 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4029242604}) 2024-08-18T21:15:45.755 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.755 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3846236539}) 2024-08-18T21:15:45.755 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=357598559}) 2024-08-18T21:15:45.755 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.755 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3846236539}) 2024-08-18T21:15:45.755 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1904043730}) 2024-08-18T21:15:45.755 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.755 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3846236539}) 2024-08-18T21:15:45.755 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=6385194}) 2024-08-18T21:15:45.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=784691764}) 2024-08-18T21:15:45.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=886935451}) 2024-08-18T21:15:45.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=784691764}) 2024-08-18T21:15:45.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=489119575}) 2024-08-18T21:15:45.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=784691764}) 2024-08-18T21:15:45.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3068902254}) 2024-08-18T21:15:45.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=784691764}) 2024-08-18T21:15:45.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2019895841}) 2024-08-18T21:15:45.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=784691764}) 2024-08-18T21:15:45.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3222849159}) 2024-08-18T21:15:45.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=784691764}) 2024-08-18T21:15:45.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2635092046}) 2024-08-18T21:15:45.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=784691764}) 2024-08-18T21:15:45.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=408069691}) 2024-08-18T21:15:45.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=784691764}) 2024-08-18T21:15:45.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3833692471}) 2024-08-18T21:15:45.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2725202971}) 2024-08-18T21:15:45.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1141029801}) 2024-08-18T21:15:45.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2725202971}) 2024-08-18T21:15:45.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2602368834}) 2024-08-18T21:15:45.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2725202971}) 2024-08-18T21:15:45.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=830373512}) 2024-08-18T21:15:45.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2725202971}) 2024-08-18T21:15:45.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3337269942}) 2024-08-18T21:15:45.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2725202971}) 2024-08-18T21:15:45.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3260780715}) 2024-08-18T21:15:45.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2725202971}) 2024-08-18T21:15:45.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2029671480}) 2024-08-18T21:15:45.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2725202971}) 2024-08-18T21:15:45.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4206554499}) 2024-08-18T21:15:45.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2725202971}) 2024-08-18T21:15:45.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2549600546}) 2024-08-18T21:15:45.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1540175053}) 2024-08-18T21:15:45.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1715560556}) 2024-08-18T21:15:45.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1540175053}) 2024-08-18T21:15:45.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=623928540}) 2024-08-18T21:15:45.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1540175053}) 2024-08-18T21:15:45.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2972307079}) 2024-08-18T21:15:45.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1540175053}) 2024-08-18T21:15:45.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1775739738}) 2024-08-18T21:15:45.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1540175053}) 2024-08-18T21:15:45.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1469594894}) 2024-08-18T21:15:45.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1540175053}) 2024-08-18T21:15:45.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=568562479}) 2024-08-18T21:15:45.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1540175053}) 2024-08-18T21:15:45.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1771451626}) 2024-08-18T21:15:45.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1540175053}) 2024-08-18T21:15:45.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=214496111}) 2024-08-18T21:15:45.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=419218586}) 2024-08-18T21:15:45.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2191715373}) 2024-08-18T21:15:45.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=419218586}) 2024-08-18T21:15:45.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=132325172}) 2024-08-18T21:15:45.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=419218586}) 2024-08-18T21:15:45.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1494504955}) 2024-08-18T21:15:45.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=419218586}) 2024-08-18T21:15:45.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1139366159}) 2024-08-18T21:15:45.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=419218586}) 2024-08-18T21:15:45.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=724351493}) 2024-08-18T21:15:45.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=419218586}) 2024-08-18T21:15:45.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1417211572}) 2024-08-18T21:15:45.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=419218586}) 2024-08-18T21:15:45.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=166884457}) 2024-08-18T21:15:45.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=419218586}) 2024-08-18T21:15:45.772 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3107005972}) 2024-08-18T21:15:45.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3455446277}) 2024-08-18T21:15:45.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1031534819}) 2024-08-18T21:15:45.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3455446277}) 2024-08-18T21:15:45.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=58836010}) 2024-08-18T21:15:45.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3455446277}) 2024-08-18T21:15:45.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2459294203}) 2024-08-18T21:15:45.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3455446277}) 2024-08-18T21:15:45.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3602163928}) 2024-08-18T21:15:45.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3455446277}) 2024-08-18T21:15:45.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4247849625}) 2024-08-18T21:15:45.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3455446277}) 2024-08-18T21:15:45.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2667925643}) 2024-08-18T21:15:45.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3455446277}) 2024-08-18T21:15:45.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1374230460}) 2024-08-18T21:15:45.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3455446277}) 2024-08-18T21:15:45.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2193506543}) 2024-08-18T21:15:45.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307816567}) 2024-08-18T21:15:45.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1059806632}) 2024-08-18T21:15:45.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307816567}) 2024-08-18T21:15:45.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1951706323}) 2024-08-18T21:15:45.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307816567}) 2024-08-18T21:15:45.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2605805595}) 2024-08-18T21:15:45.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307816567}) 2024-08-18T21:15:45.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1538722416}) 2024-08-18T21:15:45.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307816567}) 2024-08-18T21:15:45.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2763501684}) 2024-08-18T21:15:45.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307816567}) 2024-08-18T21:15:45.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1432922180}) 2024-08-18T21:15:45.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307816567}) 2024-08-18T21:15:45.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1105367170}) 2024-08-18T21:15:45.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307816567}) 2024-08-18T21:15:45.779 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2046277976}) 2024-08-18T21:15:45.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.774+0000 7f9ae1e01640 1 -- 172.21.15.5:0/3424735429 --> v2:172.21.15.157:6812/631023601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9adc140e00 con 0x7f9ac803bdc0 2024-08-18T21:15:45.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.778+0000 7f9ac3fff640 1 -- 172.21.15.5:0/3424735429 <== mgr.4130 v2:172.21.15.157:6812/631023601 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34068 (secure 0 0 0) 0x7f9adc140e00 con 0x7f9ac803bdc0 2024-08-18T21:15:45.781 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:15:45.781 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T21:15:45.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.782+0000 7f9ae1e01640 1 -- 172.21.15.5:0/3424735429 >> v2:172.21.15.157:6812/631023601 conn(0x7f9ac803bdc0 msgr2=0x7f9ac803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.782+0000 7f9ae1e01640 1 --2- 172.21.15.5:0/3424735429 >> v2:172.21.15.157:6812/631023601 conn(0x7f9ac803bdc0 0x7f9ac803e280 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9adc076ee0 tx=0x7f9ad00a6000 comp rx=0 tx=0).stop 2024-08-18T21:15:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.782+0000 7f9ae1e01640 10 monclient: shutdown 2024-08-18T21:15:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.782+0000 7f9ae1e01640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.782+0000 7f9ae1e01640 1 -- 172.21.15.5:0/3424735429 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9adc0a59e0 msgr2=0x7f9adc138b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.782+0000 7f9ae1e01640 1 --2- 172.21.15.5:0/3424735429 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9adc0a59e0 0x7f9adc138b70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00efc0 tx=0x7f9acc00c490 comp rx=0 tx=0).stop 2024-08-18T21:15:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.782+0000 7f9ae1e01640 1 -- 172.21.15.5:0/3424735429 shutdown_connections 2024-08-18T21:15:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.782+0000 7f9ae1e01640 1 --2- 172.21.15.5:0/3424735429 >> v2:172.21.15.157:6812/631023601 conn(0x7f9ac803bdc0 0x7f9ac803e280 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.782+0000 7f9ae1e01640 1 --2- 172.21.15.5:0/3424735429 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f9adc139b80 0x7f9adc1390b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.782+0000 7f9ae1e01640 1 --2- 172.21.15.5:0/3424735429 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f9adc0a59e0 0x7f9adc138b70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.782+0000 7f9ae1e01640 1 --2- 172.21.15.5:0/3424735429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9adc0a0cd0 0x7f9adc13ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.782+0000 7f9ae1e01640 1 -- 172.21.15.5:0/3424735429 >> 172.21.15.5:0/3424735429 conn(0x7f9adc0aa5d0 msgr2=0x7f9adc0a8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.782+0000 7f9ae1e01640 1 -- 172.21.15.5:0/3424735429 shutdown_connections 2024-08-18T21:15:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.782+0000 7f9ae1e01640 1 -- 172.21.15.5:0/3424735429 wait complete. 2024-08-18T21:15:45.795 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":690,"stamp":"2024-08-18T21:15:45.559153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":204744,"kb_used_data":17604,"kb_used_omap":9,"kb_used_meta":186998,"kb_avail":566026296,"statfs":{"total":579820584960,"available":579610927104,"internally_reserved":0,"allocated":18026496,"data_stored":8938825,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9572,"internal_metadata":191486620},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002156"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":726,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.853071+0000","last_change":"2024-08-18T21:03:33.600622+0000","last_active":"2024-08-18T21:15:43.853071+0000","last_peered":"2024-08-18T21:15:43.853071+0000","last_clean":"2024-08-18T21:15:43.853071+0000","last_became_active":"2024-08-18T21:03:33.598635+0000","last_became_peered":"2024-08-18T21:03:33.598635+0000","last_unstale":"2024-08-18T21:15:43.853071+0000","last_undegraded":"2024-08-18T21:15:43.853071+0000","last_fullsized":"2024-08-18T21:15:43.853071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:31.584484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:31.584484+0000","last_clean_scrub_stamp":"2024-08-18T21:03:31.584484+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:05.519532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":635,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.852644+0000","last_change":"2024-08-18T21:03:42.420443+0000","last_active":"2024-08-18T21:15:43.852644+0000","last_peered":"2024-08-18T21:15:43.852644+0000","last_clean":"2024-08-18T21:15:43.852644+0000","last_became_active":"2024-08-18T21:03:39.196022+0000","last_became_peered":"2024-08-18T21:03:39.196022+0000","last_unstale":"2024-08-18T21:15:43.852644+0000","last_undegraded":"2024-08-18T21:15:43.852644+0000","last_fullsized":"2024-08-18T21:15:43.852644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:31.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010002489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":635,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.854766+0000","last_change":"2024-08-18T21:03:42.185411+0000","last_active":"2024-08-18T21:15:43.854766+0000","last_peered":"2024-08-18T21:15:43.854766+0000","last_clean":"2024-08-18T21:15:43.854766+0000","last_became_active":"2024-08-18T21:03:39.201697+0000","last_became_peered":"2024-08-18T21:03:39.201697+0000","last_unstale":"2024-08-18T21:15:43.854766+0000","last_undegraded":"2024-08-18T21:15:43.854766+0000","last_fullsized":"2024-08-18T21:15:43.854766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:03:54.524520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001317337,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":644,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.855054+0000","last_change":"2024-08-18T21:03:42.184643+0000","last_active":"2024-08-18T21:15:43.855054+0000","last_peered":"2024-08-18T21:15:43.855054+0000","last_clean":"2024-08-18T21:15:43.855054+0000","last_became_active":"2024-08-18T21:03:39.201549+0000","last_became_peered":"2024-08-18T21:03:39.201549+0000","last_unstale":"2024-08-18T21:15:43.855054+0000","last_undegraded":"2024-08-18T21:15:43.855054+0000","last_fullsized":"2024-08-18T21:15:43.855054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:01:33.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010119630000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":639,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.854510+0000","last_change":"2024-08-18T21:03:42.420020+0000","last_active":"2024-08-18T21:15:43.854510+0000","last_peered":"2024-08-18T21:15:43.854510+0000","last_clean":"2024-08-18T21:15:43.854510+0000","last_became_active":"2024-08-18T21:03:39.203685+0000","last_became_peered":"2024-08-18T21:03:39.203685+0000","last_unstale":"2024-08-18T21:15:43.854510+0000","last_undegraded":"2024-08-18T21:15:43.854510+0000","last_fullsized":"2024-08-18T21:15:43.854510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:36.890241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099204900000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":634,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.852774+0000","last_change":"2024-08-18T21:03:42.420253+0000","last_active":"2024-08-18T21:15:43.852774+0000","last_peered":"2024-08-18T21:15:43.852774+0000","last_clean":"2024-08-18T21:15:43.852774+0000","last_became_active":"2024-08-18T21:03:39.192148+0000","last_became_peered":"2024-08-18T21:03:39.192148+0000","last_unstale":"2024-08-18T21:15:43.852774+0000","last_undegraded":"2024-08-18T21:15:43.852774+0000","last_fullsized":"2024-08-18T21:15:43.852774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:00:27.022175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082257800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":639,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.861806+0000","last_change":"2024-08-18T21:03:42.184578+0000","last_active":"2024-08-18T21:15:43.861806+0000","last_peered":"2024-08-18T21:15:43.861806+0000","last_clean":"2024-08-18T21:15:43.861806+0000","last_became_active":"2024-08-18T21:03:39.194596+0000","last_became_peered":"2024-08-18T21:03:39.194596+0000","last_unstale":"2024-08-18T21:15:43.861806+0000","last_undegraded":"2024-08-18T21:15:43.861806+0000","last_fullsized":"2024-08-18T21:15:43.861806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:22.467656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001127341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":634,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.852875+0000","last_change":"2024-08-18T21:03:42.420853+0000","last_active":"2024-08-18T21:15:43.852875+0000","last_peered":"2024-08-18T21:15:43.852875+0000","last_clean":"2024-08-18T21:15:43.852875+0000","last_became_active":"2024-08-18T21:03:39.195166+0000","last_became_peered":"2024-08-18T21:03:39.195166+0000","last_unstale":"2024-08-18T21:15:43.852875+0000","last_undegraded":"2024-08-18T21:15:43.852875+0000","last_fullsized":"2024-08-18T21:15:43.852875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:11:34.985385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001377777,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":633,"reported_epoch":327,"state":"active+clean","last_fresh":"2024-08-18T21:15:40.848621+0000","last_change":"2024-08-18T21:03:42.186027+0000","last_active":"2024-08-18T21:15:40.848621+0000","last_peered":"2024-08-18T21:15:40.848621+0000","last_clean":"2024-08-18T21:15:40.848621+0000","last_became_active":"2024-08-18T21:03:39.192275+0000","last_became_peered":"2024-08-18T21:03:39.192275+0000","last_unstale":"2024-08-18T21:15:40.848621+0000","last_undegraded":"2024-08-18T21:15:40.848621+0000","last_fullsized":"2024-08-18T21:15:40.848621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:55:49.809092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001842333,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":12,"seq":51539607701,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29860,"kb_used_data":2836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341980,"statfs":{"total":96636764160,"available":96606187520,"internally_reserved":0,"allocated":2904064,"data_stored":1297607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640405,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34152,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337688,"statfs":{"total":96636764160,"available":96601792512,"internally_reserved":0,"allocated":3035136,"data_stored":1844922,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640405,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34140,"kb_used_data":2944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337700,"statfs":{"total":96636764160,"available":96601804800,"internally_reserved":0,"allocated":3014656,"data_stored":1316730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640406,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34112,"kb_used_data":2916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337728,"statfs":{"total":96636764160,"available":96601833472,"internally_reserved":0,"allocated":2985984,"data_stored":1316547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640407,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38292,"kb_used_data":2944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333548,"statfs":{"total":96636764160,"available":96597553152,"internally_reserved":0,"allocated":3014656,"data_stored":1317085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640405,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34188,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337652,"statfs":{"total":96636764160,"available":96601755648,"internally_reserved":0,"allocated":3072000,"data_stored":1845934,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T21:15:45.796 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T21:15:45.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T21:15:45.876 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3181487870}) 2024-08-18T21:15:45.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1228208170}) 2024-08-18T21:15:45.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3181487870}) 2024-08-18T21:15:45.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1287265834}) 2024-08-18T21:15:45.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3181487870}) 2024-08-18T21:15:45.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1332451047}) 2024-08-18T21:15:45.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3181487870}) 2024-08-18T21:15:45.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2932519510}) 2024-08-18T21:15:45.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.877 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3181487870}) 2024-08-18T21:15:45.878 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=628774708}) 2024-08-18T21:15:45.878 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.878 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3181487870}) 2024-08-18T21:15:45.878 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1687853178}) 2024-08-18T21:15:45.878 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.878 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3181487870}) 2024-08-18T21:15:45.878 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1793353020}) 2024-08-18T21:15:45.878 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.878 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3181487870}) 2024-08-18T21:15:45.878 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.878+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1088110694}) 2024-08-18T21:15:45.901 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.901 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1175715431}) 2024-08-18T21:15:45.901 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2167257519}) 2024-08-18T21:15:45.901 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.901 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1175715431}) 2024-08-18T21:15:45.901 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2789863411}) 2024-08-18T21:15:45.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1175715431}) 2024-08-18T21:15:45.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3336255282}) 2024-08-18T21:15:45.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1175715431}) 2024-08-18T21:15:45.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1694955373}) 2024-08-18T21:15:45.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1175715431}) 2024-08-18T21:15:45.902 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=739543772}) 2024-08-18T21:15:45.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1175715431}) 2024-08-18T21:15:45.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3416159757}) 2024-08-18T21:15:45.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1175715431}) 2024-08-18T21:15:45.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=937974205}) 2024-08-18T21:15:45.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1175715431}) 2024-08-18T21:15:45.903 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.902+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4207980732}) 2024-08-18T21:15:45.915 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.915 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3368867805}) 2024-08-18T21:15:45.915 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4203485262}) 2024-08-18T21:15:45.915 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.915 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3368867805}) 2024-08-18T21:15:45.915 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=166279420}) 2024-08-18T21:15:45.915 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.915 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3368867805}) 2024-08-18T21:15:45.915 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3520284291}) 2024-08-18T21:15:45.915 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.915 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3368867805}) 2024-08-18T21:15:45.915 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2399164818}) 2024-08-18T21:15:45.916 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.916 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3368867805}) 2024-08-18T21:15:45.916 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4243721914}) 2024-08-18T21:15:45.916 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.916 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3368867805}) 2024-08-18T21:15:45.916 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2523831755}) 2024-08-18T21:15:45.916 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.916 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3368867805}) 2024-08-18T21:15:45.916 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=467795304}) 2024-08-18T21:15:45.916 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:45.916 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3368867805}) 2024-08-18T21:15:45.916 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:45.914+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4118702534}) 2024-08-18T21:15:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 10 monclient: get_monmap_and_config 2024-08-18T21:15:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 10 monclient: build_initial_monmap 2024-08-18T21:15:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 10 monclient: monmap: 2024-08-18T21:15:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:45.978515+0000 2024-08-18T21:15:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:45.978515+0000 2024-08-18T21:15:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:45.975 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:45.975 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:45.975 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:45.975 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:45.975 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 1 Processor -- start 2024-08-18T21:15:45.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 1 -- start start 2024-08-18T21:15:45.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 10 monclient: init 2024-08-18T21:15:45.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:45.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 10 monclient: _add_conns ranks=[3,8,7,0,4,10,6,2,1,9,5] 2024-08-18T21:15:45.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be009de40 0x7f1be009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 10 monclient(hunting): picked mon.noname-g con 0x7f1be009de40 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:45.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1be009e760 0x7f1be0135b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 10 monclient(hunting): picked mon.noname-e con 0x7f1be009e760 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:45.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1be009da30 0x7f1be01360a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 10 monclient(hunting): picked mon.noname-i con 0x7f1be009da30 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:15:45.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1be00a0540 con 0x7f1be009de40 2024-08-18T21:15:45.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f1be0069730 con 0x7f1be009da30 2024-08-18T21:15:45.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f1be009ff80 con 0x7f1be009e760 2024-08-18T21:15:45.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:45.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be7cfa640 10 monclient(hunting): authenticate will time out at 1712.991372s 2024-08-18T21:15:45.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1be009e760 0x7f1be0135b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1be009e760 0x7f1be0135b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:53918/0 (socket says 172.21.15.5:53918) 2024-08-18T21:15:45.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 1 -- 172.21.15.5:0/1981946706 learned_addr learned my addr 172.21.15.5:0/1981946706 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:45.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 10 monclient(hunting): get_auth_request con 0x7f1be009e760 auth_method 0 2024-08-18T21:15:45.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 10 monclient(hunting): handle_auth_done global_id 115361 payload 274 2024-08-18T21:15:45.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be6297640 1 --2- 172.21.15.5:0/1981946706 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1be009da30 0x7f1be01360a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 1 -- 172.21.15.5:0/1981946706 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1be009da30 msgr2=0x7f1be01360a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:45.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5a96640 1 --2- 172.21.15.5:0/1981946706 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be009de40 0x7f1be009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 1 --2- 172.21.15.5:0/1981946706 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1be009da30 0x7f1be01360a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 1 -- 172.21.15.5:0/1981946706 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be009de40 msgr2=0x7f1be009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:45.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 1 --2- 172.21.15.5:0/1981946706 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be009de40 0x7f1be009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 10 monclient: _finish_hunting 0 2024-08-18T21:15:45.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 1 monclient: found mon.noname-e 2024-08-18T21:15:45.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:45.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:15:45.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.974+0000 7f1be5295640 1 -- 172.21.15.5:0/1981946706 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be00a0260 con 0x7f1be009e760 2024-08-18T21:15:45.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.978+0000 7f1be5295640 1 -- 172.21.15.5:0/1981946706 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1be009e760 msgr2=0x7f1be0135b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:45.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.978+0000 7f1be5295640 1 --2- 172.21.15.5:0/1981946706 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1be009e760 0x7f1be0135b60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00098a0 tx=0x7f1bd001c440 comp rx=0 tx=0).ready entity=mon.8 client_cookie=7c518d842aff7d91 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be4a94640 1 -- 172.21.15.5:0/1981946706 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1bd00b0070 con 0x7f1be009e760 2024-08-18T21:15:45.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be4a94640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be4a94640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:15:45.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be4a94640 10 monclient: dump: 2024-08-18T21:15:45.987 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.987 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.987 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.987 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.987 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.987 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.988 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be4a94640 10 monclient: _finish_auth 0 2024-08-18T21:15:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be4a94640 10 monclient: _check_auth_tickets 2024-08-18T21:15:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be4a94640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be4a94640 1 -- 172.21.15.5:0/1981946706 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd00aa810 con 0x7f1be009e760 2024-08-18T21:15:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be4a94640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be4a94640 1 -- 172.21.15.5:0/1981946706 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1bd00a93e0 con 0x7f1be009e760 2024-08-18T21:15:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 5 monclient: authenticate success, global_id 115361 2024-08-18T21:15:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 4 set_mon_vals no callback set 2024-08-18T21:15:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be4a94640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be4a94640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:15:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be4a94640 10 monclient: dump: 2024-08-18T21:15:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.991 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 10 monclient: shutdown 2024-08-18T21:15:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 -- 172.21.15.5:0/1981946706 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1be009e760 msgr2=0x7f1be0135b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 --2- 172.21.15.5:0/1981946706 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1be009e760 0x7f1be0135b60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00098a0 tx=0x7f1bd001c440 comp rx=0 tx=0).stop 2024-08-18T21:15:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 -- 172.21.15.5:0/1981946706 shutdown_connections 2024-08-18T21:15:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 --2- 172.21.15.5:0/1981946706 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f1be009da30 0x7f1be01360a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 --2- 172.21.15.5:0/1981946706 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f1be009e760 0x7f1be0135b60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 --2- 172.21.15.5:0/1981946706 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be009de40 0x7f1be009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 -- 172.21.15.5:0/1981946706 >> 172.21.15.5:0/1981946706 conn(0x7f1be00a8020 msgr2=0x7f1be00a8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 -- 172.21.15.5:0/1981946706 shutdown_connections 2024-08-18T21:15:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 -- 172.21.15.5:0/1981946706 wait complete. 2024-08-18T21:15:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 10 monclient: build_initial_monmap 2024-08-18T21:15:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 10 monclient: monmap: 2024-08-18T21:15:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:45.992 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:45.993 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:45.993 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 Processor -- start 2024-08-18T21:15:45.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 -- start start 2024-08-18T21:15:45.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 10 monclient: init 2024-08-18T21:15:45.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:45.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 10 monclient: _add_conns ranks=[6,3,0,4,2,7,5,8,1] 2024-08-18T21:15:45.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1be009da30 0x7f1be013dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 10 monclient(hunting): picked mon.noname-d con 0x7f1be009da30 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:15:45.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be009de40 0x7f1be013e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 10 monclient(hunting): picked mon.noname-g con 0x7f1be009de40 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:45.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be009e760 0x7f1be013ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:45.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 10 monclient(hunting): picked mon.noname-a con 0x7f1be009e760 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:15:45.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1be013d220 con 0x7f1be009e760 2024-08-18T21:15:45.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1be013d0a0 con 0x7f1be009de40 2024-08-18T21:15:45.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:45.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f1be013d3a0 con 0x7f1be009da30 2024-08-18T21:15:45.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:45.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be7cfa640 10 monclient(hunting): authenticate will time out at 1712.998279s 2024-08-18T21:15:45.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1be009da30 0x7f1be013dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be6297640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be009e760 0x7f1be013ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1be009da30 0x7f1be013dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:38428/0 (socket says 172.21.15.5:38428) 2024-08-18T21:15:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be6297640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be009e760 0x7f1be013ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53802/0 (socket says 172.21.15.5:53802) 2024-08-18T21:15:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 1 -- 172.21.15.5:0/201216702 learned_addr learned my addr 172.21.15.5:0/201216702 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 10 monclient(hunting): get_auth_request con 0x7f1be009da30 auth_method 0 2024-08-18T21:15:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be6297640 10 monclient(hunting): get_auth_request con 0x7f1be009e760 auth_method 0 2024-08-18T21:15:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be6297640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be6297640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be6297640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be6297640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:45.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be6297640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:45.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be6297640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:45.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5295640 1 --2- 172.21.15.5:0/201216702 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be009de40 0x7f1be013e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:45.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5295640 10 monclient(hunting): get_auth_request con 0x7f1be009de40 auth_method 0 2024-08-18T21:15:45.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5295640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:45.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5295640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:45.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5295640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:45.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 10 monclient(hunting): handle_auth_done global_id 174183 payload 824 2024-08-18T21:15:45.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 1 -- 172.21.15.5:0/201216702 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be009de40 msgr2=0x7f1be013e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 1 --2- 172.21.15.5:0/201216702 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be009de40 0x7f1be013e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 1 -- 172.21.15.5:0/201216702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be009e760 msgr2=0x7f1be013ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:45.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 1 --2- 172.21.15.5:0/201216702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be009e760 0x7f1be013ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:45.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 10 monclient: _finish_hunting 0 2024-08-18T21:15:45.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 1 monclient: found mon.noname-d 2024-08-18T21:15:45.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:45.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:15:45.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5a96640 1 -- 172.21.15.5:0/201216702 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be013b370 con 0x7f1be009da30 2024-08-18T21:15:45.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be6297640 1 --2- 172.21.15.5:0/201216702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be009e760 0x7f1be013ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:15:45.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.982+0000 7f1be5295640 1 --2- 172.21.15.5:0/201216702 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be009de40 0x7f1be013e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:15:45.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1be5a96640 1 -- 172.21.15.5:0/201216702 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1be009da30 msgr2=0x7f1be013dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:45.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1be5a96640 1 --2- 172.21.15.5:0/201216702 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1be009da30 0x7f1be013dfa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00c7f0 tx=0x7f1bdc00ccb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:45.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd67fc640 1 -- 172.21.15.5:0/201216702 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1bdc015070 con 0x7f1be009da30 2024-08-18T21:15:45.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:45.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd67fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:15:45.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd67fc640 10 monclient: dump: 2024-08-18T21:15:45.998 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:45.998 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:45.998 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.998 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:45.998 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:45.998 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:45.998 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:45.998 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:45.998 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:45.998 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:45.998 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:45.999 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd67fc640 10 monclient: _finish_auth 0 2024-08-18T21:15:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd67fc640 10 monclient: _check_auth_tickets 2024-08-18T21:15:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd67fc640 1 -- 172.21.15.5:0/201216702 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bdc007ca0 con 0x7f1be009da30 2024-08-18T21:15:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd67fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd67fc640 1 -- 172.21.15.5:0/201216702 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1bdc007e50 con 0x7f1be009da30 2024-08-18T21:15:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1be7cfa640 5 monclient: authenticate success, global_id 174183 2024-08-18T21:15:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd67fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:15:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd7fff640 4 set_mon_vals no callback set 2024-08-18T21:15:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd67fc640 10 monclient: dump: 2024-08-18T21:15:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:46.001 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:46.001 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:46.001 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:46.001 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:46.001 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:46.001 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:46.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1be7cfa640 10 monclient: _renew_subs 2024-08-18T21:15:46.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1be7cfa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:15:46.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1be7cfa640 1 -- 172.21.15.5:0/201216702 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be0135010 con 0x7f1be009da30 2024-08-18T21:15:46.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1be7cfa640 10 monclient: _renew_subs 2024-08-18T21:15:46.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1be7cfa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:15:46.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1be7cfa640 1 -- 172.21.15.5:0/201216702 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be013fa40 con 0x7f1be009da30 2024-08-18T21:15:46.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1be7cfa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:46.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1be7cfa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:46.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1be7cfa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:15:46.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1be7cfa640 1 -- 172.21.15.5:0/201216702 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be009e220 con 0x7f1be009da30 2024-08-18T21:15:46.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd67fc640 1 -- 172.21.15.5:0/201216702 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f1bdc007830 con 0x7f1be009da30 2024-08-18T21:15:46.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd67fc640 1 --2- 172.21.15.5:0/201216702 >> v2:172.21.15.157:6812/631023601 conn(0x7f1bc403bf90 0x7f1bc403e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:46.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1bd67fc640 1 -- 172.21.15.5:0/201216702 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(331..331 src has 22..331) ==== 3506+0+0 (secure 0 0 0) 0x7f1bdc04dfc0 con 0x7f1be009da30 2024-08-18T21:15:46.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1be5295640 1 --2- 172.21.15.5:0/201216702 >> v2:172.21.15.157:6812/631023601 conn(0x7f1bc403bf90 0x7f1bc403e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:46.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.986+0000 7f1be5295640 10 monclient: get_auth_request con 0x7f1bc403bf90 auth_method 0 2024-08-18T21:15:46.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.990+0000 7f1be5295640 1 --2- 172.21.15.5:0/201216702 >> v2:172.21.15.157:6812/631023601 conn(0x7f1bc403bf90 0x7f1bc403e450 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009870 tx=0x7f1bd00a4f90 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:46.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.990+0000 7f1bd67fc640 1 -- 172.21.15.5:0/201216702 <== mon.6 v2:172.21.15.5:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f1bdc01e070 con 0x7f1be009da30 2024-08-18T21:15:46.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.990+0000 7f1bd67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:46.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:45.990+0000 7f1bd67fc640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:46.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.154+0000 7f1be7cfa640 1 -- 172.21.15.5:0/201216702 --> v2:172.21.15.157:6812/631023601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1be006d150 con 0x7f1bc403bf90 2024-08-18T21:15:46.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.158+0000 7f1bd67fc640 1 -- 172.21.15.5:0/201216702 <== mgr.4130 v2:172.21.15.157:6812/631023601 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34068 (secure 0 0 0) 0x7f1be006d150 con 0x7f1bc403bf90 2024-08-18T21:15:46.155 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:15:46.156 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T21:15:46.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.158+0000 7f1be7cfa640 1 -- 172.21.15.5:0/201216702 >> v2:172.21.15.157:6812/631023601 conn(0x7f1bc403bf90 msgr2=0x7f1bc403e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:46.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.158+0000 7f1be7cfa640 1 --2- 172.21.15.5:0/201216702 >> v2:172.21.15.157:6812/631023601 conn(0x7f1bc403bf90 0x7f1bc403e450 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009870 tx=0x7f1bd00a4f90 comp rx=0 tx=0).stop 2024-08-18T21:15:46.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.158+0000 7f1be7cfa640 10 monclient: shutdown 2024-08-18T21:15:46.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.158+0000 7f1be7cfa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:46.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.158+0000 7f1be7cfa640 1 -- 172.21.15.5:0/201216702 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1be009da30 msgr2=0x7f1be013dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:46.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.158+0000 7f1be7cfa640 1 --2- 172.21.15.5:0/201216702 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1be009da30 0x7f1be013dfa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00c7f0 tx=0x7f1bdc00ccb0 comp rx=0 tx=0).stop 2024-08-18T21:15:46.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.158+0000 7f1be7cfa640 1 -- 172.21.15.5:0/201216702 shutdown_connections 2024-08-18T21:15:46.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.158+0000 7f1be7cfa640 1 --2- 172.21.15.5:0/201216702 >> v2:172.21.15.157:6812/631023601 conn(0x7f1bc403bf90 0x7f1bc403e450 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:46.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.158+0000 7f1be7cfa640 1 --2- 172.21.15.5:0/201216702 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be009de40 0x7f1be013e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:46.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.158+0000 7f1be7cfa640 1 --2- 172.21.15.5:0/201216702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be009e760 0x7f1be013ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:46.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.158+0000 7f1be7cfa640 1 --2- 172.21.15.5:0/201216702 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f1be009da30 0x7f1be013dfa0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:46.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.158+0000 7f1be7cfa640 1 -- 172.21.15.5:0/201216702 >> 172.21.15.5:0/201216702 conn(0x7f1be00a8020 msgr2=0x7f1be00a4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:46.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.158+0000 7f1be7cfa640 1 -- 172.21.15.5:0/201216702 shutdown_connections 2024-08-18T21:15:46.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.158+0000 7f1be7cfa640 1 -- 172.21.15.5:0/201216702 wait complete. 2024-08-18T21:15:46.172 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":690,"stamp":"2024-08-18T21:15:45.559153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":204744,"kb_used_data":17604,"kb_used_omap":9,"kb_used_meta":186998,"kb_avail":566026296,"statfs":{"total":579820584960,"available":579610927104,"internally_reserved":0,"allocated":18026496,"data_stored":8938825,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9572,"internal_metadata":191486620},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002156"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":726,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.853071+0000","last_change":"2024-08-18T21:03:33.600622+0000","last_active":"2024-08-18T21:15:43.853071+0000","last_peered":"2024-08-18T21:15:43.853071+0000","last_clean":"2024-08-18T21:15:43.853071+0000","last_became_active":"2024-08-18T21:03:33.598635+0000","last_became_peered":"2024-08-18T21:03:33.598635+0000","last_unstale":"2024-08-18T21:15:43.853071+0000","last_undegraded":"2024-08-18T21:15:43.853071+0000","last_fullsized":"2024-08-18T21:15:43.853071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:31.584484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:31.584484+0000","last_clean_scrub_stamp":"2024-08-18T21:03:31.584484+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:05.519532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":635,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.852644+0000","last_change":"2024-08-18T21:03:42.420443+0000","last_active":"2024-08-18T21:15:43.852644+0000","last_peered":"2024-08-18T21:15:43.852644+0000","last_clean":"2024-08-18T21:15:43.852644+0000","last_became_active":"2024-08-18T21:03:39.196022+0000","last_became_peered":"2024-08-18T21:03:39.196022+0000","last_unstale":"2024-08-18T21:15:43.852644+0000","last_undegraded":"2024-08-18T21:15:43.852644+0000","last_fullsized":"2024-08-18T21:15:43.852644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:31.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010002489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":635,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.854766+0000","last_change":"2024-08-18T21:03:42.185411+0000","last_active":"2024-08-18T21:15:43.854766+0000","last_peered":"2024-08-18T21:15:43.854766+0000","last_clean":"2024-08-18T21:15:43.854766+0000","last_became_active":"2024-08-18T21:03:39.201697+0000","last_became_peered":"2024-08-18T21:03:39.201697+0000","last_unstale":"2024-08-18T21:15:43.854766+0000","last_undegraded":"2024-08-18T21:15:43.854766+0000","last_fullsized":"2024-08-18T21:15:43.854766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:03:54.524520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001317337,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":644,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.855054+0000","last_change":"2024-08-18T21:03:42.184643+0000","last_active":"2024-08-18T21:15:43.855054+0000","last_peered":"2024-08-18T21:15:43.855054+0000","last_clean":"2024-08-18T21:15:43.855054+0000","last_became_active":"2024-08-18T21:03:39.201549+0000","last_became_peered":"2024-08-18T21:03:39.201549+0000","last_unstale":"2024-08-18T21:15:43.855054+0000","last_undegraded":"2024-08-18T21:15:43.855054+0000","last_fullsized":"2024-08-18T21:15:43.855054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:01:33.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010119630000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":639,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.854510+0000","last_change":"2024-08-18T21:03:42.420020+0000","last_active":"2024-08-18T21:15:43.854510+0000","last_peered":"2024-08-18T21:15:43.854510+0000","last_clean":"2024-08-18T21:15:43.854510+0000","last_became_active":"2024-08-18T21:03:39.203685+0000","last_became_peered":"2024-08-18T21:03:39.203685+0000","last_unstale":"2024-08-18T21:15:43.854510+0000","last_undegraded":"2024-08-18T21:15:43.854510+0000","last_fullsized":"2024-08-18T21:15:43.854510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:36.890241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099204900000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":634,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.852774+0000","last_change":"2024-08-18T21:03:42.420253+0000","last_active":"2024-08-18T21:15:43.852774+0000","last_peered":"2024-08-18T21:15:43.852774+0000","last_clean":"2024-08-18T21:15:43.852774+0000","last_became_active":"2024-08-18T21:03:39.192148+0000","last_became_peered":"2024-08-18T21:03:39.192148+0000","last_unstale":"2024-08-18T21:15:43.852774+0000","last_undegraded":"2024-08-18T21:15:43.852774+0000","last_fullsized":"2024-08-18T21:15:43.852774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:00:27.022175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082257800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":639,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.861806+0000","last_change":"2024-08-18T21:03:42.184578+0000","last_active":"2024-08-18T21:15:43.861806+0000","last_peered":"2024-08-18T21:15:43.861806+0000","last_clean":"2024-08-18T21:15:43.861806+0000","last_became_active":"2024-08-18T21:03:39.194596+0000","last_became_peered":"2024-08-18T21:03:39.194596+0000","last_unstale":"2024-08-18T21:15:43.861806+0000","last_undegraded":"2024-08-18T21:15:43.861806+0000","last_fullsized":"2024-08-18T21:15:43.861806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:22.467656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001127341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":634,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.852875+0000","last_change":"2024-08-18T21:03:42.420853+0000","last_active":"2024-08-18T21:15:43.852875+0000","last_peered":"2024-08-18T21:15:43.852875+0000","last_clean":"2024-08-18T21:15:43.852875+0000","last_became_active":"2024-08-18T21:03:39.195166+0000","last_became_peered":"2024-08-18T21:03:39.195166+0000","last_unstale":"2024-08-18T21:15:43.852875+0000","last_undegraded":"2024-08-18T21:15:43.852875+0000","last_fullsized":"2024-08-18T21:15:43.852875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:11:34.985385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001377777,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":633,"reported_epoch":327,"state":"active+clean","last_fresh":"2024-08-18T21:15:40.848621+0000","last_change":"2024-08-18T21:03:42.186027+0000","last_active":"2024-08-18T21:15:40.848621+0000","last_peered":"2024-08-18T21:15:40.848621+0000","last_clean":"2024-08-18T21:15:40.848621+0000","last_became_active":"2024-08-18T21:03:39.192275+0000","last_became_peered":"2024-08-18T21:03:39.192275+0000","last_unstale":"2024-08-18T21:15:40.848621+0000","last_undegraded":"2024-08-18T21:15:40.848621+0000","last_fullsized":"2024-08-18T21:15:40.848621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:55:49.809092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001842333,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":12,"seq":51539607701,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29860,"kb_used_data":2836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341980,"statfs":{"total":96636764160,"available":96606187520,"internally_reserved":0,"allocated":2904064,"data_stored":1297607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640405,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34152,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337688,"statfs":{"total":96636764160,"available":96601792512,"internally_reserved":0,"allocated":3035136,"data_stored":1844922,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640405,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34140,"kb_used_data":2944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337700,"statfs":{"total":96636764160,"available":96601804800,"internally_reserved":0,"allocated":3014656,"data_stored":1316730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640406,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34112,"kb_used_data":2916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337728,"statfs":{"total":96636764160,"available":96601833472,"internally_reserved":0,"allocated":2985984,"data_stored":1316547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640407,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38292,"kb_used_data":2944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333548,"statfs":{"total":96636764160,"available":96597553152,"internally_reserved":0,"allocated":3014656,"data_stored":1317085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640405,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34188,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337652,"statfs":{"total":96636764160,"available":96601755648,"internally_reserved":0,"allocated":3072000,"data_stored":1845934,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T21:15:46.173 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T21:15:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.338+0000 7f4e959f3640 10 monclient: get_monmap_and_config 2024-08-18T21:15:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.338+0000 7f4e959f3640 10 monclient: build_initial_monmap 2024-08-18T21:15:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.338+0000 7f4e959f3640 10 monclient: monmap: 2024-08-18T21:15:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:46.343469+0000 2024-08-18T21:15:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:46.343469+0000 2024-08-18T21:15:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:46.339 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:46.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.338+0000 7f4e959f3640 1 Processor -- start 2024-08-18T21:15:46.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.338+0000 7f4e959f3640 1 -- start start 2024-08-18T21:15:46.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.338+0000 7f4e959f3640 10 monclient: init 2024-08-18T21:15:46.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e959f3640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:46.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e959f3640 10 monclient: _add_conns ranks=[0,4,2,6,3,1,10,7,5,9,8] 2024-08-18T21:15:46.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e959f3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4e90073570 addr v1:172.21.15.5:6789/0 2024-08-18T21:15:46.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e959f3640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e90139b90 0x7f4e9013ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:46.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e959f3640 10 monclient(hunting): picked mon.noname-c con 0x7f4e90139b90 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:15:46.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e959f3640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4e9013ef50 0x7f4e90141340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e959f3640 10 monclient(hunting): picked mon.noname-b con 0x7f4e9013ef50 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e959f3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e9006fd70 con 0x7f4e90073570 2024-08-18T21:15:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e959f3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e959f3640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f4e900a4aa0 con 0x7f4e9013ef50 2024-08-18T21:15:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e959f3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e959f3640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f4e900a4d80 con 0x7f4e90139b90 2024-08-18T21:15:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e959f3640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e959f3640 10 monclient(hunting): authenticate will time out at 1713.356620s 2024-08-18T21:15:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4e9013ef50 0x7f4e90141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8e7fc640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e90139b90 0x7f4e9013ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4e9013ef50 0x7f4e90141340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33812/0 (socket says 172.21.15.5:33812) 2024-08-18T21:15:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 1 -- 172.21.15.5:0/459169217 learned_addr learned my addr 172.21.15.5:0/459169217 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 10 monclient(hunting): get_auth_request con 0x7f4e9013ef50 auth_method 0 2024-08-18T21:15:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8e7fc640 10 monclient(hunting): get_auth_request con 0x7f4e90139b90 auth_method 0 2024-08-18T21:15:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 10 monclient(hunting): handle_auth_done global_id 115202 payload 274 2024-08-18T21:15:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 1 -- 172.21.15.5:0/459169217 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e90139b90 msgr2=0x7f4e9013ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 1 --2- 172.21.15.5:0/459169217 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e90139b90 0x7f4e9013ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 1 -- 172.21.15.5:0/459169217 >> v1:172.21.15.5:6789/0 conn(0x7f4e90073570 legacy=0x7f4e90073950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:15:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 1 monclient: found mon.noname-b 2024-08-18T21:15:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.342+0000 7f4e8f7fe640 1 -- 172.21.15.5:0/459169217 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e90070020 con 0x7f4e9013ef50 2024-08-18T21:15:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e8f7fe640 1 -- 172.21.15.5:0/459169217 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4e9013ef50 msgr2=0x7f4e90141340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e8f7fe640 1 --2- 172.21.15.5:0/459169217 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4e9013ef50 0x7f4e90141340 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4e880098a0 tx=0x7f4e8801c260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c1076082928e6cf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e8dffb640 1 -- 172.21.15.5:0/459169217 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e880b0070 con 0x7f4e9013ef50 2024-08-18T21:15:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e8dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e8dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e8dffb640 10 monclient: dump: 2024-08-18T21:15:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:46.350 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e8dffb640 10 monclient: _finish_auth 0 2024-08-18T21:15:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e8dffb640 10 monclient: _check_auth_tickets 2024-08-18T21:15:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e8dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e8dffb640 1 -- 172.21.15.5:0/459169217 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e880aa810 con 0x7f4e9013ef50 2024-08-18T21:15:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e8dffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e8dffb640 1 -- 172.21.15.5:0/459169217 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e880a9300 con 0x7f4e9013ef50 2024-08-18T21:15:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 5 monclient: authenticate success, global_id 115202 2024-08-18T21:15:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 4 set_mon_vals no callback set 2024-08-18T21:15:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e8dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e8dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e8dffb640 10 monclient: dump: 2024-08-18T21:15:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:46.352 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 10 monclient: shutdown 2024-08-18T21:15:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 1 -- 172.21.15.5:0/459169217 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4e9013ef50 msgr2=0x7f4e90141340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 1 --2- 172.21.15.5:0/459169217 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4e9013ef50 0x7f4e90141340 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4e880098a0 tx=0x7f4e8801c260 comp rx=0 tx=0).stop 2024-08-18T21:15:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 1 -- 172.21.15.5:0/459169217 shutdown_connections 2024-08-18T21:15:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 1 --2- 172.21.15.5:0/459169217 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4e9013ef50 0x7f4e90141340 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 1 --2- 172.21.15.5:0/459169217 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f4e90139b90 0x7f4e9013ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 1 -- 172.21.15.5:0/459169217 >> 172.21.15.5:0/459169217 conn(0x7f4e900a8a90 msgr2=0x7f4e900a8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 1 -- 172.21.15.5:0/459169217 shutdown_connections 2024-08-18T21:15:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 1 -- 172.21.15.5:0/459169217 wait complete. 2024-08-18T21:15:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 10 monclient: build_initial_monmap 2024-08-18T21:15:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 10 monclient: monmap: 2024-08-18T21:15:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:46.354 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 1 Processor -- start 2024-08-18T21:15:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 1 -- start start 2024-08-18T21:15:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.346+0000 7f4e959f3640 10 monclient: init 2024-08-18T21:15:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 10 monclient: _add_conns ranks=[3,2,1,5,7,6,0,8,4] 2024-08-18T21:15:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e90073570 0x7f4e9013ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 10 monclient(hunting): picked mon.noname-g con 0x7f4e90073570 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4e90139b90 0x7f4e9013b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 10 monclient(hunting): picked mon.noname-b con 0x7f4e90139b90 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e9013ef50 0x7f4e901d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 10 monclient(hunting): picked mon.noname-f con 0x7f4e9013ef50 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:15:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4e901440a0 con 0x7f4e9013ef50 2024-08-18T21:15:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f4e900a3fe0 con 0x7f4e90139b90 2024-08-18T21:15:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4e90144220 con 0x7f4e90073570 2024-08-18T21:15:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 10 monclient(hunting): authenticate will time out at 1713.364242s 2024-08-18T21:15:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4e90139b90 0x7f4e9013b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4e90139b90 0x7f4e9013b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33820/0 (socket says 172.21.15.5:33820) 2024-08-18T21:15:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 1 -- 172.21.15.5:0/3430117450 learned_addr learned my addr 172.21.15.5:0/3430117450 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 10 monclient(hunting): get_auth_request con 0x7f4e90139b90 auth_method 0 2024-08-18T21:15:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 10 monclient(hunting): handle_auth_done global_id 115211 payload 824 2024-08-18T21:15:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 1 -- 172.21.15.5:0/3430117450 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e90073570 msgr2=0x7f4e9013ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 1 --2- 172.21.15.5:0/3430117450 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e90073570 0x7f4e9013ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 1 -- 172.21.15.5:0/3430117450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e9013ef50 msgr2=0x7f4e901d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 1 --2- 172.21.15.5:0/3430117450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e9013ef50 0x7f4e901d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 10 monclient: _finish_hunting 0 2024-08-18T21:15:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 1 monclient: found mon.noname-b 2024-08-18T21:15:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 1 -- 172.21.15.5:0/3430117450 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9013d550 con 0x7f4e90139b90 2024-08-18T21:15:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 1 -- 172.21.15.5:0/3430117450 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4e90139b90 msgr2=0x7f4e9013b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8e7fc640 1 --2- 172.21.15.5:0/3430117450 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4e90139b90 0x7f4e9013b380 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400e8d0 tx=0x7f4e8400ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e77fff640 1 -- 172.21.15.5:0/3430117450 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e84017070 con 0x7f4e90139b90 2024-08-18T21:15:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e77fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e77fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e77fff640 10 monclient: dump: 2024-08-18T21:15:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:46.361 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e77fff640 10 monclient: _finish_auth 0 2024-08-18T21:15:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e77fff640 10 monclient: _check_auth_tickets 2024-08-18T21:15:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e77fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e77fff640 1 -- 172.21.15.5:0/3430117450 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e84013470 con 0x7f4e90139b90 2024-08-18T21:15:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 5 monclient: authenticate success, global_id 115211 2024-08-18T21:15:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 10 monclient: _renew_subs 2024-08-18T21:15:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 1 -- 172.21.15.5:0/3430117450 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e90139030 con 0x7f4e90139b90 2024-08-18T21:15:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e77fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e77fff640 1 -- 172.21.15.5:0/3430117450 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e84013a90 con 0x7f4e90139b90 2024-08-18T21:15:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e77fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e77fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e77fff640 10 monclient: dump: 2024-08-18T21:15:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:46.363 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 10 monclient: _renew_subs 2024-08-18T21:15:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e959f3640 1 -- 172.21.15.5:0/3430117450 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e9013c530 con 0x7f4e90139b90 2024-08-18T21:15:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.350+0000 7f4e8cff9640 4 set_mon_vals no callback set 2024-08-18T21:15:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.354+0000 7f4e959f3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.354+0000 7f4e959f3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.354+0000 7f4e959f3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.354+0000 7f4e959f3640 1 -- 172.21.15.5:0/3430117450 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e90139200 con 0x7f4e90139b90 2024-08-18T21:15:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.354+0000 7f4e77fff640 1 -- 172.21.15.5:0/3430117450 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f4e8401a070 con 0x7f4e90139b90 2024-08-18T21:15:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.354+0000 7f4e77fff640 1 --2- 172.21.15.5:0/3430117450 >> v2:172.21.15.157:6812/631023601 conn(0x7f4e7c03bdf0 0x7f4e7c03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.354+0000 7f4e77fff640 1 -- 172.21.15.5:0/3430117450 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(331..331 src has 22..331) ==== 3506+0+0 (secure 0 0 0) 0x7f4e8400f040 con 0x7f4e90139b90 2024-08-18T21:15:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.354+0000 7f4e8effd640 1 --2- 172.21.15.5:0/3430117450 >> v2:172.21.15.157:6812/631023601 conn(0x7f4e7c03bdf0 0x7f4e7c03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.354+0000 7f4e8effd640 10 monclient: get_auth_request con 0x7f4e7c03bdf0 auth_method 0 2024-08-18T21:15:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.354+0000 7f4e8effd640 1 --2- 172.21.15.5:0/3430117450 >> v2:172.21.15.157:6812/631023601 conn(0x7f4e7c03bdf0 0x7f4e7c03e2b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f4e80007fd0 tx=0x7f4e80007d40 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.358+0000 7f4e77fff640 1 -- 172.21.15.5:0/3430117450 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f4e84013620 con 0x7f4e90139b90 2024-08-18T21:15:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.358+0000 7f4e77fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.358+0000 7f4e77fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:46.382 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.382 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206910498}) 2024-08-18T21:15:46.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3451137302}) 2024-08-18T21:15:46.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206910498}) 2024-08-18T21:15:46.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4259534322}) 2024-08-18T21:15:46.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206910498}) 2024-08-18T21:15:46.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2993198898}) 2024-08-18T21:15:46.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206910498}) 2024-08-18T21:15:46.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1727223189}) 2024-08-18T21:15:46.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206910498}) 2024-08-18T21:15:46.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1752772681}) 2024-08-18T21:15:46.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206910498}) 2024-08-18T21:15:46.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2585542380}) 2024-08-18T21:15:46.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206910498}) 2024-08-18T21:15:46.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4040257730}) 2024-08-18T21:15:46.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206910498}) 2024-08-18T21:15:46.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4186362253}) 2024-08-18T21:15:46.409 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.409 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=195262688}) 2024-08-18T21:15:46.409 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=277616062}) 2024-08-18T21:15:46.409 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.410 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=195262688}) 2024-08-18T21:15:46.410 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1410530047}) 2024-08-18T21:15:46.410 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.410 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=195262688}) 2024-08-18T21:15:46.410 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4010767194}) 2024-08-18T21:15:46.410 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.410 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=195262688}) 2024-08-18T21:15:46.410 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=489884519}) 2024-08-18T21:15:46.410 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.410 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=195262688}) 2024-08-18T21:15:46.410 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3898842385}) 2024-08-18T21:15:46.410 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.410 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=195262688}) 2024-08-18T21:15:46.411 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2453810785}) 2024-08-18T21:15:46.411 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.411 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=195262688}) 2024-08-18T21:15:46.411 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2106442820}) 2024-08-18T21:15:46.411 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.411 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=195262688}) 2024-08-18T21:15:46.411 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.410+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4124261664}) 2024-08-18T21:15:46.420 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.420 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=208141646}) 2024-08-18T21:15:46.420 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2843216947}) 2024-08-18T21:15:46.420 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.420 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=208141646}) 2024-08-18T21:15:46.420 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3088585709}) 2024-08-18T21:15:46.420 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.420 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=208141646}) 2024-08-18T21:15:46.421 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=641321965}) 2024-08-18T21:15:46.421 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.421 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=208141646}) 2024-08-18T21:15:46.421 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1971971342}) 2024-08-18T21:15:46.421 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.421 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=208141646}) 2024-08-18T21:15:46.421 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=605897345}) 2024-08-18T21:15:46.421 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.421 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=208141646}) 2024-08-18T21:15:46.421 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1893904370}) 2024-08-18T21:15:46.421 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.421 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=208141646}) 2024-08-18T21:15:46.421 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=807168153}) 2024-08-18T21:15:46.421 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.422 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=208141646}) 2024-08-18T21:15:46.422 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1814895417}) 2024-08-18T21:15:46.425 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.425 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=585271307}) 2024-08-18T21:15:46.425 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=67491054}) 2024-08-18T21:15:46.425 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.425 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=585271307}) 2024-08-18T21:15:46.425 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3607033748}) 2024-08-18T21:15:46.425 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.426 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=585271307}) 2024-08-18T21:15:46.426 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2157012976}) 2024-08-18T21:15:46.426 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.426 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=585271307}) 2024-08-18T21:15:46.426 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2073546472}) 2024-08-18T21:15:46.426 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.426 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=585271307}) 2024-08-18T21:15:46.426 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3273384048}) 2024-08-18T21:15:46.426 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.426 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=585271307}) 2024-08-18T21:15:46.426 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1309790236}) 2024-08-18T21:15:46.426 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.426 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=585271307}) 2024-08-18T21:15:46.427 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2549955498}) 2024-08-18T21:15:46.427 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.427 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=585271307}) 2024-08-18T21:15:46.427 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.426+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2478871074}) 2024-08-18T21:15:46.429 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.430 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4129532785}) 2024-08-18T21:15:46.430 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3778102984}) 2024-08-18T21:15:46.430 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.430 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4129532785}) 2024-08-18T21:15:46.430 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1773250189}) 2024-08-18T21:15:46.430 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.430 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4129532785}) 2024-08-18T21:15:46.430 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=121787292}) 2024-08-18T21:15:46.430 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.430 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4129532785}) 2024-08-18T21:15:46.430 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4057392121}) 2024-08-18T21:15:46.430 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.431 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4129532785}) 2024-08-18T21:15:46.431 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4260351135}) 2024-08-18T21:15:46.431 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.431 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4129532785}) 2024-08-18T21:15:46.431 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=784747960}) 2024-08-18T21:15:46.431 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.431 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4129532785}) 2024-08-18T21:15:46.431 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2062033345}) 2024-08-18T21:15:46.431 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.431 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4129532785}) 2024-08-18T21:15:46.431 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.430+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2554744785}) 2024-08-18T21:15:46.434 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.434 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2662615414}) 2024-08-18T21:15:46.434 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2275058032}) 2024-08-18T21:15:46.434 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.434 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2662615414}) 2024-08-18T21:15:46.434 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1292564873}) 2024-08-18T21:15:46.434 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.434 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2662615414}) 2024-08-18T21:15:46.434 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1801556270}) 2024-08-18T21:15:46.434 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.434 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2662615414}) 2024-08-18T21:15:46.434 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1188960378}) 2024-08-18T21:15:46.435 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.435 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2662615414}) 2024-08-18T21:15:46.435 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3335643263}) 2024-08-18T21:15:46.435 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.435 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2662615414}) 2024-08-18T21:15:46.435 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2790551312}) 2024-08-18T21:15:46.435 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.435 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2662615414}) 2024-08-18T21:15:46.435 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=151404859}) 2024-08-18T21:15:46.435 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.435 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2662615414}) 2024-08-18T21:15:46.435 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.434+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=100983620}) 2024-08-18T21:15:46.438 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.439 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1926405021}) 2024-08-18T21:15:46.439 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3133855915}) 2024-08-18T21:15:46.439 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.439 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1926405021}) 2024-08-18T21:15:46.439 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=452995043}) 2024-08-18T21:15:46.439 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.439 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1926405021}) 2024-08-18T21:15:46.439 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3249168775}) 2024-08-18T21:15:46.439 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.439 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1926405021}) 2024-08-18T21:15:46.439 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2549054375}) 2024-08-18T21:15:46.439 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.440 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1926405021}) 2024-08-18T21:15:46.440 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2700835565}) 2024-08-18T21:15:46.440 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.440 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1926405021}) 2024-08-18T21:15:46.440 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1749934522}) 2024-08-18T21:15:46.440 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.440 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1926405021}) 2024-08-18T21:15:46.440 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1402088789}) 2024-08-18T21:15:46.440 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.441 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1926405021}) 2024-08-18T21:15:46.441 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.438+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=712498808}) 2024-08-18T21:15:46.443 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.443 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635878300}) 2024-08-18T21:15:46.443 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3628779063}) 2024-08-18T21:15:46.443 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.443 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635878300}) 2024-08-18T21:15:46.443 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2596349949}) 2024-08-18T21:15:46.443 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.443 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635878300}) 2024-08-18T21:15:46.443 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3068168726}) 2024-08-18T21:15:46.443 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.443 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635878300}) 2024-08-18T21:15:46.444 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=807436345}) 2024-08-18T21:15:46.444 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.444 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635878300}) 2024-08-18T21:15:46.444 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=574140772}) 2024-08-18T21:15:46.444 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.444 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635878300}) 2024-08-18T21:15:46.444 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1373964222}) 2024-08-18T21:15:46.444 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.445 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635878300}) 2024-08-18T21:15:46.445 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3863418781}) 2024-08-18T21:15:46.445 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.445 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635878300}) 2024-08-18T21:15:46.445 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.442+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3544675009}) 2024-08-18T21:15:46.447 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.447 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4155632077}) 2024-08-18T21:15:46.447 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2178936061}) 2024-08-18T21:15:46.447 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.447 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4155632077}) 2024-08-18T21:15:46.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3725531723}) 2024-08-18T21:15:46.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4155632077}) 2024-08-18T21:15:46.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1593185767}) 2024-08-18T21:15:46.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4155632077}) 2024-08-18T21:15:46.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3442312301}) 2024-08-18T21:15:46.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4155632077}) 2024-08-18T21:15:46.449 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3746361026}) 2024-08-18T21:15:46.449 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.450+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.449 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.450+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4155632077}) 2024-08-18T21:15:46.449 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.450+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3428060788}) 2024-08-18T21:15:46.449 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.450+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.449 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.450+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4155632077}) 2024-08-18T21:15:46.449 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.450+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=983690779}) 2024-08-18T21:15:46.449 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.450+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.449 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.450+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4155632077}) 2024-08-18T21:15:46.449 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.450+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=636178589}) 2024-08-18T21:15:46.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.538+0000 7f4e959f3640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:15:46.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.538+0000 7f4e959f3640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:15:46.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.538+0000 7f4e959f3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:46.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.538+0000 7f4e959f3640 1 -- 172.21.15.5:0/3430117450 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e90073950 con 0x7f4e90139b90 2024-08-18T21:15:46.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e77fff640 1 -- 172.21.15.5:0/3430117450 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v331) ==== 74+0+10846 (secure 0 0 0) 0x7f4e8401b3b0 con 0x7f4e90139b90 2024-08-18T21:15:46.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e77fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-18T21:15:46.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e77fff640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:15:46.540 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:15:46.540 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":331,"fsid":"8465e564-1097-423a-818a-e3a141bbf945","created":"2024-08-18T21:03:17.118714+0000","modified":"2024-08-18T21:15:44.848274+0000","last_up_change":"2024-08-18T21:03:30.570125+0000","last_in_change":"2024-08-18T21:03:21.231242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":100,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T21:03:31.386335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-18T21:03:37.578348+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f6d162e-ed99-408f-87c5-4880e57b4f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":329,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":150392090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":150392090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":150392090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":150392090}]},"public_addr":"172.21.15.5:6808/150392090","cluster_addr":"172.21.15.5:6809/150392090","heartbeat_back_addr":"172.21.15.5:6811/150392090","heartbeat_front_addr":"172.21.15.5:6810/150392090","state":["exists","up"]},{"osd":1,"uuid":"99984157-5771-44d0-b5fa-c3e5b2537e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":329,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1057536297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6805","nonce":1057536297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":1057536297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1057536297}]},"public_addr":"172.21.15.5:6804/1057536297","cluster_addr":"172.21.15.5:6805/1057536297","heartbeat_back_addr":"172.21.15.5:6807/1057536297","heartbeat_front_addr":"172.21.15.5:6806/1057536297","state":["exists","up"]},{"osd":2,"uuid":"00fd1d05-f5a1-4d89-8e2c-47a61392f500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":329,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3354229361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":3354229361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":3354229361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3354229361}]},"public_addr":"172.21.15.5:6800/3354229361","cluster_addr":"172.21.15.5:6801/3354229361","heartbeat_back_addr":"172.21.15.5:6803/3354229361","heartbeat_front_addr":"172.21.15.5:6802/3354229361","state":["exists","up"]},{"osd":3,"uuid":"8bb1ba33-9e75-43ee-bbfc-7ab22350e4a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":329,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1750098759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6805","nonce":1750098759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":1750098759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1750098759}]},"public_addr":"172.21.15.157:6804/1750098759","cluster_addr":"172.21.15.157:6805/1750098759","heartbeat_back_addr":"172.21.15.157:6807/1750098759","heartbeat_front_addr":"172.21.15.157:6806/1750098759","state":["exists","up"]},{"osd":4,"uuid":"f7043f2f-d6d1-4c40-bf70-80a10071a795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":329,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":269684279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":269684279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":269684279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":269684279}]},"public_addr":"172.21.15.157:6808/269684279","cluster_addr":"172.21.15.157:6809/269684279","heartbeat_back_addr":"172.21.15.157:6811/269684279","heartbeat_front_addr":"172.21.15.157:6810/269684279","state":["exists","up"]},{"osd":5,"uuid":"6d9d2c91-ec42-46cf-9b18-8c488f1f489c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":329,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2335500119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6801","nonce":2335500119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":2335500119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2335500119}]},"public_addr":"172.21.15.157:6800/2335500119","cluster_addr":"172.21.15.157:6801/2335500119","heartbeat_back_addr":"172.21.15.157:6803/2335500119","heartbeat_front_addr":"172.21.15.157:6802/2335500119","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:28.290592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.700001+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.705490+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.882949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:28.204174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T21:03:27.630992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T21:15:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e959f3640 1 -- 172.21.15.5:0/3430117450 >> v2:172.21.15.157:6812/631023601 conn(0x7f4e7c03bdf0 msgr2=0x7f4e7c03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e959f3640 1 --2- 172.21.15.5:0/3430117450 >> v2:172.21.15.157:6812/631023601 conn(0x7f4e7c03bdf0 0x7f4e7c03e2b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f4e80007fd0 tx=0x7f4e80007d40 comp rx=0 tx=0).stop 2024-08-18T21:15:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e959f3640 10 monclient: shutdown 2024-08-18T21:15:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e959f3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e959f3640 1 -- 172.21.15.5:0/3430117450 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4e90139b90 msgr2=0x7f4e9013b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e959f3640 1 --2- 172.21.15.5:0/3430117450 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4e90139b90 0x7f4e9013b380 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400e8d0 tx=0x7f4e8400ed90 comp rx=0 tx=0).stop 2024-08-18T21:15:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e959f3640 1 -- 172.21.15.5:0/3430117450 shutdown_connections 2024-08-18T21:15:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e959f3640 1 --2- 172.21.15.5:0/3430117450 >> v2:172.21.15.157:6812/631023601 conn(0x7f4e7c03bdf0 0x7f4e7c03e2b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e959f3640 1 --2- 172.21.15.5:0/3430117450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e9013ef50 0x7f4e901d13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e959f3640 1 --2- 172.21.15.5:0/3430117450 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4e90139b90 0x7f4e9013b380 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e959f3640 1 --2- 172.21.15.5:0/3430117450 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e90073570 0x7f4e9013ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e959f3640 1 -- 172.21.15.5:0/3430117450 >> 172.21.15.5:0/3430117450 conn(0x7f4e900a8a90 msgr2=0x7f4e90140590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e959f3640 1 -- 172.21.15.5:0/3430117450 shutdown_connections 2024-08-18T21:15:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:46.542+0000 7f4e959f3640 1 -- 172.21.15.5:0/3430117450 wait complete. 2024-08-18T21:15:46.736 ERROR:tasks.mon_thrash.mon_thrasher:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 272, in do_thrash self._do_thrash() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 321, in _do_thrash while not self.stopping.is_set(): AttributeError: 'bool' object has no attribute 'is_set' 2024-08-18T21:15:46.886 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.886 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3657610010}) 2024-08-18T21:15:46.886 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1962882729}) 2024-08-18T21:15:46.886 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.886 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3657610010}) 2024-08-18T21:15:46.886 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4272750964}) 2024-08-18T21:15:46.887 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.888 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3657610010}) 2024-08-18T21:15:46.888 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3362202154}) 2024-08-18T21:15:46.888 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.888 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3657610010}) 2024-08-18T21:15:46.888 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1947547020}) 2024-08-18T21:15:46.888 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.888 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3657610010}) 2024-08-18T21:15:46.888 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=428087377}) 2024-08-18T21:15:46.888 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.888 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.886+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3657610010}) 2024-08-18T21:15:46.888 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.890+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2279915440}) 2024-08-18T21:15:46.888 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.890+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.889 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.890+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3657610010}) 2024-08-18T21:15:46.889 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.890+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2941763417}) 2024-08-18T21:15:46.889 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.890+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.889 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.890+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3657610010}) 2024-08-18T21:15:46.889 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.890+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1922660032}) 2024-08-18T21:15:46.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3065642581}) 2024-08-18T21:15:46.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=421112737}) 2024-08-18T21:15:46.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3065642581}) 2024-08-18T21:15:46.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1090816951}) 2024-08-18T21:15:46.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3065642581}) 2024-08-18T21:15:46.923 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3643143611}) 2024-08-18T21:15:46.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3065642581}) 2024-08-18T21:15:46.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1003368148}) 2024-08-18T21:15:46.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3065642581}) 2024-08-18T21:15:46.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2207738506}) 2024-08-18T21:15:46.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3065642581}) 2024-08-18T21:15:46.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2513172252}) 2024-08-18T21:15:46.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3065642581}) 2024-08-18T21:15:46.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3962023177}) 2024-08-18T21:15:46.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.924 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3065642581}) 2024-08-18T21:15:46.925 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.922+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=216210681}) 2024-08-18T21:15:46.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2719558527}) 2024-08-18T21:15:46.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=70085562}) 2024-08-18T21:15:46.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2719558527}) 2024-08-18T21:15:46.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3213415400}) 2024-08-18T21:15:46.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2719558527}) 2024-08-18T21:15:46.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3390079030}) 2024-08-18T21:15:46.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2719558527}) 2024-08-18T21:15:46.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1803391753}) 2024-08-18T21:15:46.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2719558527}) 2024-08-18T21:15:46.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2544716489}) 2024-08-18T21:15:46.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2719558527}) 2024-08-18T21:15:46.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=283276579}) 2024-08-18T21:15:46.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2719558527}) 2024-08-18T21:15:46.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2382847721}) 2024-08-18T21:15:46.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2719558527}) 2024-08-18T21:15:46.930 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.930+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2033345887}) 2024-08-18T21:15:46.932 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.932 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1287072975}) 2024-08-18T21:15:46.932 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3883739355}) 2024-08-18T21:15:46.933 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.933 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1287072975}) 2024-08-18T21:15:46.933 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2175278933}) 2024-08-18T21:15:46.933 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.933 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1287072975}) 2024-08-18T21:15:46.933 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1244213909}) 2024-08-18T21:15:46.933 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.933 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1287072975}) 2024-08-18T21:15:46.933 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3392175166}) 2024-08-18T21:15:46.933 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.933 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1287072975}) 2024-08-18T21:15:46.933 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=97458796}) 2024-08-18T21:15:46.933 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.933 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1287072975}) 2024-08-18T21:15:46.934 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3448312711}) 2024-08-18T21:15:46.934 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.934 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1287072975}) 2024-08-18T21:15:46.934 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=790181129}) 2024-08-18T21:15:46.934 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.934 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1287072975}) 2024-08-18T21:15:46.934 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.934+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2931667421}) 2024-08-18T21:15:46.936 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.936 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=94083843}) 2024-08-18T21:15:46.936 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2257974177}) 2024-08-18T21:15:46.936 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.936 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=94083843}) 2024-08-18T21:15:46.936 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=767573802}) 2024-08-18T21:15:46.936 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.936 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=94083843}) 2024-08-18T21:15:46.936 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1288460436}) 2024-08-18T21:15:46.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=94083843}) 2024-08-18T21:15:46.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3284346265}) 2024-08-18T21:15:46.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=94083843}) 2024-08-18T21:15:46.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=166592040}) 2024-08-18T21:15:46.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=94083843}) 2024-08-18T21:15:46.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=261779628}) 2024-08-18T21:15:46.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=94083843}) 2024-08-18T21:15:46.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=312387320}) 2024-08-18T21:15:46.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:46.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=94083843}) 2024-08-18T21:15:46.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:46.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3459089684}) 2024-08-18T21:15:47.055 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=653353905}) 2024-08-18T21:15:47.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3770462200}) 2024-08-18T21:15:47.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=653353905}) 2024-08-18T21:15:47.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4249956670}) 2024-08-18T21:15:47.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=653353905}) 2024-08-18T21:15:47.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2441138951}) 2024-08-18T21:15:47.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=653353905}) 2024-08-18T21:15:47.056 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=328813894}) 2024-08-18T21:15:47.057 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.057 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=653353905}) 2024-08-18T21:15:47.057 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1485624617}) 2024-08-18T21:15:47.057 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.057 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=653353905}) 2024-08-18T21:15:47.057 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=223771469}) 2024-08-18T21:15:47.057 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.057 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=653353905}) 2024-08-18T21:15:47.057 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2413538817}) 2024-08-18T21:15:47.057 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.057 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=653353905}) 2024-08-18T21:15:47.057 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3785287776}) 2024-08-18T21:15:47.561 INFO:tasks.ceph:Scrubbing osd.0 2024-08-18T21:15:47.561 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-18T21:15:47.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=389343715}) 2024-08-18T21:15:47.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2579561795}) 2024-08-18T21:15:47.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=389343715}) 2024-08-18T21:15:47.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3550386326}) 2024-08-18T21:15:47.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=389343715}) 2024-08-18T21:15:47.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3375490716}) 2024-08-18T21:15:47.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=389343715}) 2024-08-18T21:15:47.647 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3614862446}) 2024-08-18T21:15:47.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=389343715}) 2024-08-18T21:15:47.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2000844327}) 2024-08-18T21:15:47.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=389343715}) 2024-08-18T21:15:47.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1446027437}) 2024-08-18T21:15:47.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=389343715}) 2024-08-18T21:15:47.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=436237316}) 2024-08-18T21:15:47.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=389343715}) 2024-08-18T21:15:47.648 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.646+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3341606845}) 2024-08-18T21:15:47.651 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.651 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2075312893}) 2024-08-18T21:15:47.651 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2579816498}) 2024-08-18T21:15:47.651 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.651 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2075312893}) 2024-08-18T21:15:47.651 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2848804293}) 2024-08-18T21:15:47.651 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.652 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2075312893}) 2024-08-18T21:15:47.652 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=999957160}) 2024-08-18T21:15:47.652 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.652 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2075312893}) 2024-08-18T21:15:47.652 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=808359930}) 2024-08-18T21:15:47.652 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.652 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2075312893}) 2024-08-18T21:15:47.652 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=774558559}) 2024-08-18T21:15:47.652 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.652 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2075312893}) 2024-08-18T21:15:47.652 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=854702573}) 2024-08-18T21:15:47.652 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.652 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2075312893}) 2024-08-18T21:15:47.652 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=683866099}) 2024-08-18T21:15:47.653 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.653 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2075312893}) 2024-08-18T21:15:47.653 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.650+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2385089661}) 2024-08-18T21:15:47.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.654 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=635058793}) 2024-08-18T21:15:47.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1826938384}) 2024-08-18T21:15:47.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=635058793}) 2024-08-18T21:15:47.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2903932401}) 2024-08-18T21:15:47.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=635058793}) 2024-08-18T21:15:47.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2262287264}) 2024-08-18T21:15:47.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=635058793}) 2024-08-18T21:15:47.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2625356618}) 2024-08-18T21:15:47.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=635058793}) 2024-08-18T21:15:47.655 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3545147803}) 2024-08-18T21:15:47.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=635058793}) 2024-08-18T21:15:47.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=771167355}) 2024-08-18T21:15:47.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=635058793}) 2024-08-18T21:15:47.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1081972065}) 2024-08-18T21:15:47.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=635058793}) 2024-08-18T21:15:47.656 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.654+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3518820001}) 2024-08-18T21:15:47.658 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.658 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1133171954}) 2024-08-18T21:15:47.659 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2013735956}) 2024-08-18T21:15:47.659 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.659 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1133171954}) 2024-08-18T21:15:47.659 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2212378860}) 2024-08-18T21:15:47.659 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.659 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1133171954}) 2024-08-18T21:15:47.659 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2441416559}) 2024-08-18T21:15:47.659 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.659 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1133171954}) 2024-08-18T21:15:47.659 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1367309337}) 2024-08-18T21:15:47.659 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.659 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1133171954}) 2024-08-18T21:15:47.659 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2462292710}) 2024-08-18T21:15:47.660 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.660 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1133171954}) 2024-08-18T21:15:47.660 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4217589184}) 2024-08-18T21:15:47.660 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.660 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1133171954}) 2024-08-18T21:15:47.660 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2542729456}) 2024-08-18T21:15:47.660 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.660 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1133171954}) 2024-08-18T21:15:47.660 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.658+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3493152157}) 2024-08-18T21:15:47.664 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.662+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.664 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.662+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3739784009}) 2024-08-18T21:15:47.664 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.662+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=381657469}) 2024-08-18T21:15:47.664 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.662+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.664 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.662+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3739784009}) 2024-08-18T21:15:47.664 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.662+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1249428888}) 2024-08-18T21:15:47.664 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.662+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.664 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.662+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3739784009}) 2024-08-18T21:15:47.664 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.662+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1749669500}) 2024-08-18T21:15:47.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.662+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.666+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3739784009}) 2024-08-18T21:15:47.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.666+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1102187399}) 2024-08-18T21:15:47.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.666+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.666+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3739784009}) 2024-08-18T21:15:47.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.666+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=592820118}) 2024-08-18T21:15:47.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.666+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.666+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3739784009}) 2024-08-18T21:15:47.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.666+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4218767307}) 2024-08-18T21:15:47.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.666+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.666+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3739784009}) 2024-08-18T21:15:47.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.666+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4135316532}) 2024-08-18T21:15:47.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.666+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.665 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.666+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3739784009}) 2024-08-18T21:15:47.666 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.666+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=320736261}) 2024-08-18T21:15:47.671 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.671 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2553351058}) 2024-08-18T21:15:47.671 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3733603431}) 2024-08-18T21:15:47.671 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.671 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2553351058}) 2024-08-18T21:15:47.671 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1535231987}) 2024-08-18T21:15:47.671 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.671 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2553351058}) 2024-08-18T21:15:47.671 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2318177897}) 2024-08-18T21:15:47.672 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.672 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2553351058}) 2024-08-18T21:15:47.672 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1837521980}) 2024-08-18T21:15:47.672 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.672 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2553351058}) 2024-08-18T21:15:47.672 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2979391920}) 2024-08-18T21:15:47.672 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.672 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2553351058}) 2024-08-18T21:15:47.672 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=808995883}) 2024-08-18T21:15:47.672 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.672 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2553351058}) 2024-08-18T21:15:47.672 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3169636636}) 2024-08-18T21:15:47.672 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.672 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2553351058}) 2024-08-18T21:15:47.673 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.670+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2031960442}) 2024-08-18T21:15:47.680 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.680 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2084408100}) 2024-08-18T21:15:47.680 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1761104040}) 2024-08-18T21:15:47.680 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.680 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2084408100}) 2024-08-18T21:15:47.681 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2986939760}) 2024-08-18T21:15:47.681 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.681 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2084408100}) 2024-08-18T21:15:47.681 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=882605992}) 2024-08-18T21:15:47.681 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.681 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2084408100}) 2024-08-18T21:15:47.681 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1507006880}) 2024-08-18T21:15:47.681 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.681 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2084408100}) 2024-08-18T21:15:47.681 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=347430004}) 2024-08-18T21:15:47.681 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.681 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2084408100}) 2024-08-18T21:15:47.681 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1145684521}) 2024-08-18T21:15:47.682 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.682 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2084408100}) 2024-08-18T21:15:47.682 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1411065058}) 2024-08-18T21:15:47.682 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.682 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.678+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2084408100}) 2024-08-18T21:15:47.682 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3987922515}) 2024-08-18T21:15:47.685 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.685 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402831585}) 2024-08-18T21:15:47.685 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1633518809}) 2024-08-18T21:15:47.685 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.685 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402831585}) 2024-08-18T21:15:47.685 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1481593154}) 2024-08-18T21:15:47.685 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.685 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402831585}) 2024-08-18T21:15:47.685 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1828212571}) 2024-08-18T21:15:47.685 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.685 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402831585}) 2024-08-18T21:15:47.685 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2603351635}) 2024-08-18T21:15:47.685 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402831585}) 2024-08-18T21:15:47.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3603626626}) 2024-08-18T21:15:47.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402831585}) 2024-08-18T21:15:47.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3490079442}) 2024-08-18T21:15:47.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.682+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.686 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.686+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402831585}) 2024-08-18T21:15:47.687 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.686+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1225356770}) 2024-08-18T21:15:47.687 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.686+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.687 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.686+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402831585}) 2024-08-18T21:15:47.687 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.686+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3311143811}) 2024-08-18T21:15:47.689 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.686+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.689 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.686+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2151693885}) 2024-08-18T21:15:47.689 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.686+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=471971356}) 2024-08-18T21:15:47.689 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.686+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.689 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.686+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2151693885}) 2024-08-18T21:15:47.690 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.686+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4179261804}) 2024-08-18T21:15:47.690 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.686+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.690 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.686+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2151693885}) 2024-08-18T21:15:47.690 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.686+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1609921068}) 2024-08-18T21:15:47.690 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.686+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.690 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.690+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2151693885}) 2024-08-18T21:15:47.690 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.690+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4194007289}) 2024-08-18T21:15:47.690 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.690+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.690 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.690+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2151693885}) 2024-08-18T21:15:47.690 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.690+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=696336517}) 2024-08-18T21:15:47.690 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.690+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.690 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.690+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2151693885}) 2024-08-18T21:15:47.690 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.690+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2731863382}) 2024-08-18T21:15:47.691 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.690+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.691 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.690+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2151693885}) 2024-08-18T21:15:47.691 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.690+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2815627515}) 2024-08-18T21:15:47.691 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.690+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.691 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.690+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2151693885}) 2024-08-18T21:15:47.691 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.690+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2913685756}) 2024-08-18T21:15:47.692 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.692 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2477989295}) 2024-08-18T21:15:47.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=140864669}) 2024-08-18T21:15:47.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2477989295}) 2024-08-18T21:15:47.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3951883299}) 2024-08-18T21:15:47.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2477989295}) 2024-08-18T21:15:47.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=373655244}) 2024-08-18T21:15:47.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2477989295}) 2024-08-18T21:15:47.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2887634392}) 2024-08-18T21:15:47.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2477989295}) 2024-08-18T21:15:47.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=345562057}) 2024-08-18T21:15:47.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2477989295}) 2024-08-18T21:15:47.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3457349426}) 2024-08-18T21:15:47.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2477989295}) 2024-08-18T21:15:47.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1374824701}) 2024-08-18T21:15:47.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2477989295}) 2024-08-18T21:15:47.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=895856944}) 2024-08-18T21:15:47.696 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.696 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1565149261}) 2024-08-18T21:15:47.696 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=521457482}) 2024-08-18T21:15:47.696 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.696 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1565149261}) 2024-08-18T21:15:47.697 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2826558080}) 2024-08-18T21:15:47.697 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.697 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1565149261}) 2024-08-18T21:15:47.697 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4143716440}) 2024-08-18T21:15:47.697 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.697 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1565149261}) 2024-08-18T21:15:47.697 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3487365494}) 2024-08-18T21:15:47.697 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.697 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1565149261}) 2024-08-18T21:15:47.697 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=507197373}) 2024-08-18T21:15:47.697 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.697 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1565149261}) 2024-08-18T21:15:47.697 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=244231976}) 2024-08-18T21:15:47.698 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.698 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1565149261}) 2024-08-18T21:15:47.698 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=57338915}) 2024-08-18T21:15:47.698 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.698 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1565149261}) 2024-08-18T21:15:47.698 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1432204821}) 2024-08-18T21:15:47.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1411383511}) 2024-08-18T21:15:47.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3096908750}) 2024-08-18T21:15:47.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1411383511}) 2024-08-18T21:15:47.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1549117718}) 2024-08-18T21:15:47.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1411383511}) 2024-08-18T21:15:47.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=766746169}) 2024-08-18T21:15:47.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1411383511}) 2024-08-18T21:15:47.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=403345172}) 2024-08-18T21:15:47.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1411383511}) 2024-08-18T21:15:47.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3426151505}) 2024-08-18T21:15:47.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1411383511}) 2024-08-18T21:15:47.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=849239351}) 2024-08-18T21:15:47.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1411383511}) 2024-08-18T21:15:47.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4098134058}) 2024-08-18T21:15:47.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1411383511}) 2024-08-18T21:15:47.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=137301170}) 2024-08-18T21:15:47.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.706+0000 7fc8c0825640 10 monclient: get_monmap_and_config 2024-08-18T21:15:47.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.706+0000 7fc8c0825640 10 monclient: build_initial_monmap 2024-08-18T21:15:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.706+0000 7fc8c0825640 10 monclient: monmap: 2024-08-18T21:15:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:47.710452+0000 2024-08-18T21:15:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:47.710452+0000 2024-08-18T21:15:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:47.706 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:47.706 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:47.706 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:47.706 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:47.706 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:47.706 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:47.706 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:47.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.706+0000 7fc8c0825640 1 Processor -- start 2024-08-18T21:15:47.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.706+0000 7fc8c0825640 1 -- start start 2024-08-18T21:15:47.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.706+0000 7fc8c0825640 10 monclient: init 2024-08-18T21:15:47.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325829856}) 2024-08-18T21:15:47.708 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3342498949}) 2024-08-18T21:15:47.709 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.709 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325829856}) 2024-08-18T21:15:47.709 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2152946270}) 2024-08-18T21:15:47.709 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.709 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325829856}) 2024-08-18T21:15:47.709 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1182817289}) 2024-08-18T21:15:47.709 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.709 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325829856}) 2024-08-18T21:15:47.709 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=492949946}) 2024-08-18T21:15:47.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8c0825640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:47.710 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8c0825640 10 monclient: _add_conns ranks=[0,2,5,3,9,6,1,10,8,4,7] 2024-08-18T21:15:47.711 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325829856}) 2024-08-18T21:15:47.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8c0825640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc8bc0a1460 addr v1:172.21.15.5:6789/0 2024-08-18T21:15:47.711 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2320905641}) 2024-08-18T21:15:47.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8c0825640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc8bc0a1f50 0x7fc8bc13cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:47.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8c0825640 10 monclient(hunting): picked mon.noname-b con 0x7fc8bc0a1f50 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:47.712 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.712 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325829856}) 2024-08-18T21:15:47.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8c0825640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc8bc13d0b0 0x7fc8bc13f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:47.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8c0825640 10 monclient(hunting): picked mon.noname-h con 0x7fc8bc13d0b0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:47.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1906657954}) 2024-08-18T21:15:47.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8c0825640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8bc0a6320 con 0x7fc8bc0a1460 2024-08-18T21:15:47.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8c0825640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:47.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8c0825640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fc8bc0a2520 con 0x7fc8bc0a1f50 2024-08-18T21:15:47.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8c0825640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:47.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325829856}) 2024-08-18T21:15:47.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8c0825640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fc8bc0a0fb0 con 0x7fc8bc13d0b0 2024-08-18T21:15:47.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8c0825640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:47.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8c0825640 10 monclient(hunting): authenticate will time out at 1714.724337s 2024-08-18T21:15:47.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1430952792}) 2024-08-18T21:15:47.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325829856}) 2024-08-18T21:15:47.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1679415586}) 2024-08-18T21:15:47.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc8bc0a1f50 0x7fc8bc13cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:47.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc8bc0a1f50 0x7fc8bc13cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33836/0 (socket says 172.21.15.5:33836) 2024-08-18T21:15:47.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 1 -- 172.21.15.5:0/913550326 learned_addr learned my addr 172.21.15.5:0/913550326 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:47.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 10 monclient(hunting): get_auth_request con 0x7fc8bc0a1f50 auth_method 0 2024-08-18T21:15:47.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:47.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:47.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:47.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:47.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:47.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:47.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8bad9d640 1 --2- 172.21.15.5:0/913550326 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc8bc13d0b0 0x7fc8bc13f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:47.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8bad9d640 10 monclient(hunting): get_auth_request con 0x7fc8bc13d0b0 auth_method 0 2024-08-18T21:15:47.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8bad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:47.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8bad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:47.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8bad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:47.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 10 monclient(hunting): handle_auth_done global_id 115220 payload 274 2024-08-18T21:15:47.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 1 -- 172.21.15.5:0/913550326 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc8bc13d0b0 msgr2=0x7fc8bc13f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:47.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 1 --2- 172.21.15.5:0/913550326 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc8bc13d0b0 0x7fc8bc13f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:47.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 1 -- 172.21.15.5:0/913550326 >> v1:172.21.15.5:6789/0 conn(0x7fc8bc0a1460 legacy=0x7fc8bc0a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:47.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:15:47.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 1 monclient: found mon.noname-b 2024-08-18T21:15:47.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:47.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:47.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fc8b9d9b640 1 -- 172.21.15.5:0/913550326 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8bc0a35c0 con 0x7fc8bc0a1f50 2024-08-18T21:15:47.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2339334112}) 2024-08-18T21:15:47.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=352842807}) 2024-08-18T21:15:47.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2339334112}) 2024-08-18T21:15:47.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=548887515}) 2024-08-18T21:15:47.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2339334112}) 2024-08-18T21:15:47.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2133079648}) 2024-08-18T21:15:47.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2339334112}) 2024-08-18T21:15:47.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1799338604}) 2024-08-18T21:15:47.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2339334112}) 2024-08-18T21:15:47.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3399388715}) 2024-08-18T21:15:47.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2339334112}) 2024-08-18T21:15:47.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=907221095}) 2024-08-18T21:15:47.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2339334112}) 2024-08-18T21:15:47.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1562133664}) 2024-08-18T21:15:47.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2339334112}) 2024-08-18T21:15:47.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3827380959}) 2024-08-18T21:15:47.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2698251673}) 2024-08-18T21:15:47.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3125598865}) 2024-08-18T21:15:47.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2698251673}) 2024-08-18T21:15:47.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3219304309}) 2024-08-18T21:15:47.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2698251673}) 2024-08-18T21:15:47.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1361178991}) 2024-08-18T21:15:47.724 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2698251673}) 2024-08-18T21:15:47.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=584035941}) 2024-08-18T21:15:47.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2698251673}) 2024-08-18T21:15:47.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=138956665}) 2024-08-18T21:15:47.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2698251673}) 2024-08-18T21:15:47.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2833458520}) 2024-08-18T21:15:47.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2698251673}) 2024-08-18T21:15:47.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1765926996}) 2024-08-18T21:15:47.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2698251673}) 2024-08-18T21:15:47.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1935056601}) 2024-08-18T21:15:47.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8b9d9b640 1 -- 172.21.15.5:0/913550326 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc8bc0a1f50 msgr2=0x7fc8bc13cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:47.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8b9d9b640 1 --2- 172.21.15.5:0/913550326 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc8bc0a1f50 0x7fc8bc13cb70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00098a0 tx=0x7fc8b001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b930cd8f814ea521 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:47.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8b959a640 1 -- 172.21.15.5:0/913550326 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc8b00b0070 con 0x7fc8bc0a1f50 2024-08-18T21:15:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8b959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8b959a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8b959a640 10 monclient: dump: 2024-08-18T21:15:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:47.729 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8b959a640 10 monclient: _finish_auth 0 2024-08-18T21:15:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8b959a640 10 monclient: _check_auth_tickets 2024-08-18T21:15:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8b959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8b959a640 1 -- 172.21.15.5:0/913550326 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b00aa810 con 0x7fc8bc0a1f50 2024-08-18T21:15:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8b959a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8b959a640 1 -- 172.21.15.5:0/913550326 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc8b00aae30 con 0x7fc8bc0a1f50 2024-08-18T21:15:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8b959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8b959a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8b959a640 10 monclient: dump: 2024-08-18T21:15:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:47.731 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8c0825640 5 monclient: authenticate success, global_id 115220 2024-08-18T21:15:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8c0825640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.714+0000 7fc8c0825640 4 set_mon_vals no callback set 2024-08-18T21:15:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 10 monclient: shutdown 2024-08-18T21:15:47.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:47.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 1 -- 172.21.15.5:0/913550326 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc8bc0a1f50 msgr2=0x7fc8bc13cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:47.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 1 --2- 172.21.15.5:0/913550326 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc8bc0a1f50 0x7fc8bc13cb70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00098a0 tx=0x7fc8b001c440 comp rx=0 tx=0).stop 2024-08-18T21:15:47.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 1 -- 172.21.15.5:0/913550326 shutdown_connections 2024-08-18T21:15:47.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 1 --2- 172.21.15.5:0/913550326 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc8bc0a1f50 0x7fc8bc13cb70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:47.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 1 --2- 172.21.15.5:0/913550326 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fc8bc13d0b0 0x7fc8bc13f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:47.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 1 -- 172.21.15.5:0/913550326 >> 172.21.15.5:0/913550326 conn(0x7fc8bc0688d0 msgr2=0x7fc8bc068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:47.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 1 -- 172.21.15.5:0/913550326 shutdown_connections 2024-08-18T21:15:47.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 1 -- 172.21.15.5:0/913550326 wait complete. 2024-08-18T21:15:47.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 10 monclient: build_initial_monmap 2024-08-18T21:15:47.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 10 monclient: monmap: 2024-08-18T21:15:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:47.734 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 1 Processor -- start 2024-08-18T21:15:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 1 -- start start 2024-08-18T21:15:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 10 monclient: init 2024-08-18T21:15:47.734 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796851790}) 2024-08-18T21:15:47.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2733844120}) 2024-08-18T21:15:47.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796851790}) 2024-08-18T21:15:47.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3574948149}) 2024-08-18T21:15:47.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796851790}) 2024-08-18T21:15:47.735 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2508595932}) 2024-08-18T21:15:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:47.736 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.736 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796851790}) 2024-08-18T21:15:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 10 monclient: _add_conns ranks=[8,3,6,0,4,5,7,2,1] 2024-08-18T21:15:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc8bc0a1460 0x7fc8bc132960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:47.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1463332025}) 2024-08-18T21:15:47.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.737 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796851790}) 2024-08-18T21:15:47.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 10 monclient(hunting): picked mon.noname-e con 0x7fc8bc0a1460 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:47.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8bc0a1f50 0x7fc8bc132ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:47.738 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2702972984}) 2024-08-18T21:15:47.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 10 monclient(hunting): picked mon.noname-g con 0x7fc8bc0a1f50 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:47.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc8bc13d0b0 0x7fc8bc135820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:47.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 10 monclient(hunting): picked mon.noname-d con 0x7fc8bc13d0b0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:15:47.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:47.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc8bc0a4400 con 0x7fc8bc0a1f50 2024-08-18T21:15:47.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796851790}) 2024-08-18T21:15:47.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:47.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7fc8bc0a4280 con 0x7fc8bc13d0b0 2024-08-18T21:15:47.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:47.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fc8bc142200 con 0x7fc8bc0a1460 2024-08-18T21:15:47.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:47.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8c0825640 10 monclient(hunting): authenticate will time out at 1714.734743s 2024-08-18T21:15:47.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2805265048}) 2024-08-18T21:15:47.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796851790}) 2024-08-18T21:15:47.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1516249176}) 2024-08-18T21:15:47.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796851790}) 2024-08-18T21:15:47.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc8bc0a1460 0x7fc8bc132960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:47.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1001899739}) 2024-08-18T21:15:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc8bc0a1460 0x7fc8bc132960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:53940/0 (socket says 172.21.15.5:53940) 2024-08-18T21:15:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 1 -- 172.21.15.5:0/1852321510 learned_addr learned my addr 172.21.15.5:0/1852321510 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 10 monclient(hunting): get_auth_request con 0x7fc8bc0a1460 auth_method 0 2024-08-18T21:15:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8b9d9b640 1 --2- 172.21.15.5:0/1852321510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8bc0a1f50 0x7fc8bc132ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8b9d9b640 10 monclient(hunting): get_auth_request con 0x7fc8bc0a1f50 auth_method 0 2024-08-18T21:15:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8b9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8b9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8b9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 10 monclient(hunting): handle_auth_done global_id 115370 payload 824 2024-08-18T21:15:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 1 -- 172.21.15.5:0/1852321510 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc8bc13d0b0 msgr2=0x7fc8bc135820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 1 --2- 172.21.15.5:0/1852321510 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7fc8bc13d0b0 0x7fc8bc135820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 1 -- 172.21.15.5:0/1852321510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8bc0a1f50 msgr2=0x7fc8bc132ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 1 --2- 172.21.15.5:0/1852321510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8bc0a1f50 0x7fc8bc132ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 10 monclient: _finish_hunting 0 2024-08-18T21:15:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 1 monclient: found mon.noname-e 2024-08-18T21:15:47.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:47.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:15:47.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8ba59c640 1 -- 172.21.15.5:0/1852321510 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8bc13ce20 con 0x7fc8bc0a1460 2024-08-18T21:15:47.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.718+0000 7fc8b9d9b640 1 --2- 172.21.15.5:0/1852321510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8bc0a1f50 0x7fc8bc132ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:15:47.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8ba59c640 1 -- 172.21.15.5:0/1852321510 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc8bc0a1460 msgr2=0x7fc8bc132960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:47.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8ba59c640 1 --2- 172.21.15.5:0/1852321510 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc8bc0a1460 0x7fc8bc132960 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00c450 tx=0x7fc8ac00c910 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:47.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 1 -- 172.21.15.5:0/1852321510 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc8ac01e070 con 0x7fc8bc0a1460 2024-08-18T21:15:47.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:47.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:15:47.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 10 monclient: dump: 2024-08-18T21:15:47.745 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:47.745 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:47.745 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:47.746 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:47.746 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:47.746 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:47.746 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:47.746 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:47.746 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:47.746 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:47.746 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:47.746 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:47.746 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:47.746 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:47.746 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:47.746 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 10 monclient: _finish_auth 0 2024-08-18T21:15:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 10 monclient: _check_auth_tickets 2024-08-18T21:15:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 1 -- 172.21.15.5:0/1852321510 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac017340 con 0x7fc8bc0a1460 2024-08-18T21:15:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 1 -- 172.21.15.5:0/1852321510 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc8ac017960 con 0x7fc8bc0a1460 2024-08-18T21:15:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:15:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 10 monclient: dump: 2024-08-18T21:15:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:47.748 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8c0825640 5 monclient: authenticate success, global_id 115370 2024-08-18T21:15:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8c0825640 10 monclient: _renew_subs 2024-08-18T21:15:47.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8b8d99640 4 set_mon_vals no callback set 2024-08-18T21:15:47.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8c0825640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:47.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8c0825640 1 -- 172.21.15.5:0/1852321510 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8bc1372c0 con 0x7fc8bc0a1460 2024-08-18T21:15:47.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8c0825640 10 monclient: _renew_subs 2024-08-18T21:15:47.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8c0825640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:47.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8c0825640 1 -- 172.21.15.5:0/1852321510 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8bc139620 con 0x7fc8bc0a1460 2024-08-18T21:15:47.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8c0825640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:47.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8c0825640 1 -- 172.21.15.5:0/1852321510 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc8bc0a53b0 con 0x7fc8bc0a1460 2024-08-18T21:15:47.750 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3530671670}) 2024-08-18T21:15:47.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=40624646}) 2024-08-18T21:15:47.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3530671670}) 2024-08-18T21:15:47.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2664332666}) 2024-08-18T21:15:47.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3530671670}) 2024-08-18T21:15:47.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3061487495}) 2024-08-18T21:15:47.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3530671670}) 2024-08-18T21:15:47.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4102741823}) 2024-08-18T21:15:47.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3530671670}) 2024-08-18T21:15:47.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1420920867}) 2024-08-18T21:15:47.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3530671670}) 2024-08-18T21:15:47.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1003053489}) 2024-08-18T21:15:47.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3530671670}) 2024-08-18T21:15:47.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2884566768}) 2024-08-18T21:15:47.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3530671670}) 2024-08-18T21:15:47.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=105482629}) 2024-08-18T21:15:47.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 1 -- 172.21.15.5:0/1852321510 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fc8ac017bc0 con 0x7fc8bc0a1460 2024-08-18T21:15:47.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 1 --2- 172.21.15.5:0/1852321510 >> v2:172.21.15.157:6812/631023601 conn(0x7fc89c03bdf0 0x7fc89c03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:47.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 1 -- 172.21.15.5:0/1852321510 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(331..331 src has 22..331) ==== 3506+0+0 (secure 0 0 0) 0x7fc8ac051e50 con 0x7fc8bc0a1460 2024-08-18T21:15:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 1 --2- 172.21.15.5:0/1852321510 >> v2:172.21.15.5:6808/150392090 conn(0x7fc89c041900 0x7fc89c043d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 1 -- 172.21.15.5:0/1852321510 --> v2:172.21.15.5:6808/150392090 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8ac009eb0 con 0x7fc89c041900 2024-08-18T21:15:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 1 -- 172.21.15.5:0/1852321510 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_get_version_reply(handle=1 version=331) ==== 24+0+0 (secure 0 0 0) 0x7fc8ac054420 con 0x7fc8bc0a1460 2024-08-18T21:15:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8aaffd640 10 monclient: handle_get_version_reply finishing 1 version 331 2024-08-18T21:15:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8b9d9b640 1 --2- 172.21.15.5:0/1852321510 >> v2:172.21.15.157:6812/631023601 conn(0x7fc89c03bdf0 0x7fc89c03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.722+0000 7fc8b9d9b640 10 monclient: get_auth_request con 0x7fc89c03bdf0 auth_method 0 2024-08-18T21:15:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fc8bad9d640 1 --2- 172.21.15.5:0/1852321510 >> v2:172.21.15.5:6808/150392090 conn(0x7fc89c041900 0x7fc89c043d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fc8bad9d640 10 monclient: get_auth_request con 0x7fc89c041900 auth_method 0 2024-08-18T21:15:47.756 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.756 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4182362408}) 2024-08-18T21:15:47.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1658310651}) 2024-08-18T21:15:47.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4182362408}) 2024-08-18T21:15:47.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3705631574}) 2024-08-18T21:15:47.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4182362408}) 2024-08-18T21:15:47.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3595187660}) 2024-08-18T21:15:47.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4182362408}) 2024-08-18T21:15:47.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1609768105}) 2024-08-18T21:15:47.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4182362408}) 2024-08-18T21:15:47.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=781832997}) 2024-08-18T21:15:47.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4182362408}) 2024-08-18T21:15:47.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2808048313}) 2024-08-18T21:15:47.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4182362408}) 2024-08-18T21:15:47.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3183983687}) 2024-08-18T21:15:47.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4182362408}) 2024-08-18T21:15:47.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=473779092}) 2024-08-18T21:15:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.726+0000 7fc8b9d9b640 1 --2- 172.21.15.5:0/1852321510 >> v2:172.21.15.157:6812/631023601 conn(0x7fc89c03bdf0 0x7fc89c03e2b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0a2730 tx=0x7fc8b00a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fc8bad9d640 1 --2- 172.21.15.5:0/1852321510 >> v2:172.21.15.5:6808/150392090 conn(0x7fc89c041900 0x7fc89c043d20 crc :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fc8aaffd640 1 -- 172.21.15.5:0/1852321510 <== osd.0 v2:172.21.15.5:6808/150392090 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc8ac009eb0 con 0x7fc89c041900 2024-08-18T21:15:47.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1111710462}) 2024-08-18T21:15:47.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1751000709}) 2024-08-18T21:15:47.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1111710462}) 2024-08-18T21:15:47.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4058458226}) 2024-08-18T21:15:47.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1111710462}) 2024-08-18T21:15:47.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1827680794}) 2024-08-18T21:15:47.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1111710462}) 2024-08-18T21:15:47.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2033137650}) 2024-08-18T21:15:47.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1111710462}) 2024-08-18T21:15:47.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2027537079}) 2024-08-18T21:15:47.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1111710462}) 2024-08-18T21:15:47.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4155179693}) 2024-08-18T21:15:47.768 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1111710462}) 2024-08-18T21:15:47.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3803243375}) 2024-08-18T21:15:47.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1111710462}) 2024-08-18T21:15:47.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=141859488}) 2024-08-18T21:15:47.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175685857}) 2024-08-18T21:15:47.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=790607221}) 2024-08-18T21:15:47.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175685857}) 2024-08-18T21:15:47.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1746011863}) 2024-08-18T21:15:47.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175685857}) 2024-08-18T21:15:47.769 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2701401361}) 2024-08-18T21:15:47.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175685857}) 2024-08-18T21:15:47.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3337442801}) 2024-08-18T21:15:47.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175685857}) 2024-08-18T21:15:47.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1053970100}) 2024-08-18T21:15:47.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175685857}) 2024-08-18T21:15:47.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2757493859}) 2024-08-18T21:15:47.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175685857}) 2024-08-18T21:15:47.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2478117504}) 2024-08-18T21:15:47.770 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175685857}) 2024-08-18T21:15:47.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4096663607}) 2024-08-18T21:15:47.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974179954}) 2024-08-18T21:15:47.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1659308132}) 2024-08-18T21:15:47.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974179954}) 2024-08-18T21:15:47.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3847928860}) 2024-08-18T21:15:47.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974179954}) 2024-08-18T21:15:47.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4021288136}) 2024-08-18T21:15:47.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.771 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974179954}) 2024-08-18T21:15:47.772 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4065152699}) 2024-08-18T21:15:47.772 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.772 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974179954}) 2024-08-18T21:15:47.772 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3982657442}) 2024-08-18T21:15:47.772 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.772 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974179954}) 2024-08-18T21:15:47.772 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3193631748}) 2024-08-18T21:15:47.772 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.772 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974179954}) 2024-08-18T21:15:47.772 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2764163981}) 2024-08-18T21:15:47.772 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.772 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974179954}) 2024-08-18T21:15:47.772 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1164221354}) 2024-08-18T21:15:47.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.746+0000 7fc8c0825640 1 -- 172.21.15.5:0/1852321510 --> v2:172.21.15.5:6808/150392090 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc8bc0a1840 con 0x7fc89c041900 2024-08-18T21:15:47.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.746+0000 7fc8aaffd640 1 -- 172.21.15.5:0/1852321510 <== osd.0 v2:172.21.15.5:6808/150392090 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc8bc0a1840 con 0x7fc89c041900 2024-08-18T21:15:47.773 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:47.773 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T21:15:47.773 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:47.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.746+0000 7fc8c0825640 1 -- 172.21.15.5:0/1852321510 >> v2:172.21.15.5:6808/150392090 conn(0x7fc89c041900 msgr2=0x7fc89c043d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:47.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.746+0000 7fc8c0825640 1 --2- 172.21.15.5:0/1852321510 >> v2:172.21.15.5:6808/150392090 conn(0x7fc89c041900 0x7fc89c043d20 crc :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:47.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.746+0000 7fc8c0825640 1 -- 172.21.15.5:0/1852321510 >> v2:172.21.15.157:6812/631023601 conn(0x7fc89c03bdf0 msgr2=0x7fc89c03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:47.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.746+0000 7fc8c0825640 1 --2- 172.21.15.5:0/1852321510 >> v2:172.21.15.157:6812/631023601 conn(0x7fc89c03bdf0 0x7fc89c03e2b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0a2730 tx=0x7fc8b00a6000 comp rx=0 tx=0).stop 2024-08-18T21:15:47.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.746+0000 7fc8c0825640 10 monclient: shutdown 2024-08-18T21:15:47.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.746+0000 7fc8c0825640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:47.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.746+0000 7fc8c0825640 1 -- 172.21.15.5:0/1852321510 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc8bc0a1460 msgr2=0x7fc8bc132960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:47.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.746+0000 7fc8c0825640 1 --2- 172.21.15.5:0/1852321510 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fc8bc0a1460 0x7fc8bc132960 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00c450 tx=0x7fc8ac00c910 comp rx=0 tx=0).stop 2024-08-18T21:15:47.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.746+0000 7fc8bad9d640 1 -- 172.21.15.5:0/1852321510 reap_dead start 2024-08-18T21:15:47.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.746+0000 7fc8c0825640 1 -- 172.21.15.5:0/1852321510 shutdown_connections 2024-08-18T21:15:47.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.746+0000 7fc8c0825640 1 -- 172.21.15.5:0/1852321510 >> 172.21.15.5:0/1852321510 conn(0x7fc8bc0688d0 msgr2=0x7fc8bc0a9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:47.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.746+0000 7fc8c0825640 1 -- 172.21.15.5:0/1852321510 shutdown_connections 2024-08-18T21:15:47.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.746+0000 7fc8c0825640 1 -- 172.21.15.5:0/1852321510 wait complete. 2024-08-18T21:15:47.776 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-18T21:15:47.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 10 monclient: get_monmap_and_config 2024-08-18T21:15:47.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 10 monclient: build_initial_monmap 2024-08-18T21:15:47.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 10 monclient: monmap: 2024-08-18T21:15:47.897 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:47.897 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:47.897 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:47.901834+0000 2024-08-18T21:15:47.897 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:47.901834+0000 2024-08-18T21:15:47.897 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:47.897 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:47.897 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:47.897 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:47.897 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:47.897 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:47.898 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:47.898 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:47.898 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:47.898 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:47.898 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:47.898 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:47.898 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:47.898 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:47.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1934689367}) 2024-08-18T21:15:47.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4252045783}) 2024-08-18T21:15:47.899 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1934689367}) 2024-08-18T21:15:47.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3410690997}) 2024-08-18T21:15:47.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1934689367}) 2024-08-18T21:15:47.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=253773791}) 2024-08-18T21:15:47.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1934689367}) 2024-08-18T21:15:47.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=501568775}) 2024-08-18T21:15:47.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1934689367}) 2024-08-18T21:15:47.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1353601677}) 2024-08-18T21:15:47.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1934689367}) 2024-08-18T21:15:47.900 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1560743214}) 2024-08-18T21:15:47.901 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.901 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1934689367}) 2024-08-18T21:15:47.901 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=99358191}) 2024-08-18T21:15:47.901 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.901 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1934689367}) 2024-08-18T21:15:47.901 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.898+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2964878599}) 2024-08-18T21:15:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 1 Processor -- start 2024-08-18T21:15:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 1 -- start start 2024-08-18T21:15:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 10 monclient: init 2024-08-18T21:15:47.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:47.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 10 monclient: _add_conns ranks=[5,7,2,8,9,0,6,1,10,3,4] 2024-08-18T21:15:47.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d740a6ce0 0x7f5d740a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:47.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 10 monclient(hunting): picked mon.noname-h con 0x7f5d740a6ce0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:47.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5d740a7600 0x7f5d74139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:47.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 10 monclient(hunting): picked mon.noname-i con 0x7f5d740a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:15:47.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d74139fe0 0x7f5d7413a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:47.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 10 monclient(hunting): picked mon.noname-b con 0x7f5d74139fe0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:47.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:47.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f5d740a5000 con 0x7f5d74139fe0 2024-08-18T21:15:47.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:47.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f5d740a4360 con 0x7f5d740a6ce0 2024-08-18T21:15:47.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f5d740a45d0 con 0x7f5d740a7600 2024-08-18T21:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d79df6640 10 monclient(hunting): authenticate will time out at 1714.915742s 2024-08-18T21:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d73fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d74139fe0 0x7f5d7413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d73fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d74139fe0 0x7f5d7413a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33850/0 (socket says 172.21.15.5:33850) 2024-08-18T21:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d73fff640 1 -- 172.21.15.5:0/3360517971 learned_addr learned my addr 172.21.15.5:0/3360517971 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d73fff640 10 monclient(hunting): get_auth_request con 0x7f5d74139fe0 auth_method 0 2024-08-18T21:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d73fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.898+0000 7f5d73fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 1 --2- 172.21.15.5:0/3360517971 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d740a6ce0 0x7f5d740a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d72ffd640 1 --2- 172.21.15.5:0/3360517971 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5d740a7600 0x7f5d74139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 10 monclient(hunting): get_auth_request con 0x7f5d740a6ce0 auth_method 0 2024-08-18T21:15:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d72ffd640 10 monclient(hunting): get_auth_request con 0x7f5d740a7600 auth_method 0 2024-08-18T21:15:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d72ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d72ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:47.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d72ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:47.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:47.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:47.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:47.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d72ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:47.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d72ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:47.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d72ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:47.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 10 monclient(hunting): handle_auth_done global_id 95792 payload 274 2024-08-18T21:15:47.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 1 -- 172.21.15.5:0/3360517971 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5d740a7600 msgr2=0x7f5d74139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:47.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 1 --2- 172.21.15.5:0/3360517971 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5d740a7600 0x7f5d74139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:47.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 1 -- 172.21.15.5:0/3360517971 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d74139fe0 msgr2=0x7f5d7413a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 1 --2- 172.21.15.5:0/3360517971 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d74139fe0 0x7f5d7413a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 10 monclient: _finish_hunting 0 2024-08-18T21:15:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 1 monclient: found mon.noname-h 2024-08-18T21:15:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.157:3302/0 2024-08-18T21:15:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.902+0000 7f5d737fe640 1 -- 172.21.15.5:0/3360517971 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d740a32d0 con 0x7f5d740a6ce0 2024-08-18T21:15:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d737fe640 1 -- 172.21.15.5:0/3360517971 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d740a6ce0 msgr2=0x7f5d740a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d737fe640 1 --2- 172.21.15.5:0/3360517971 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d740a6ce0 0x7f5d740a70c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5d640097f0 tx=0x7f5d6401c3c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=185c83c4e22c4096 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d727fc640 1 -- 172.21.15.5:0/3360517971 <== mon.5 v2:172.21.15.157:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5d640b0070 con 0x7f5d740a6ce0 2024-08-18T21:15:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d727fc640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-18T21:15:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d727fc640 10 monclient: dump: 2024-08-18T21:15:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:47.912 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d727fc640 10 monclient: _finish_auth 0 2024-08-18T21:15:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d727fc640 10 monclient: _check_auth_tickets 2024-08-18T21:15:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d727fc640 1 -- 172.21.15.5:0/3360517971 <== mon.5 v2:172.21.15.157:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d640aa810 con 0x7f5d740a6ce0 2024-08-18T21:15:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d727fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d727fc640 1 -- 172.21.15.5:0/3360517971 <== mon.5 v2:172.21.15.157:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5d640a4e60 con 0x7f5d740a6ce0 2024-08-18T21:15:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d727fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-18T21:15:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d727fc640 10 monclient: dump: 2024-08-18T21:15:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:47.914 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d79df6640 5 monclient: authenticate success, global_id 95792 2024-08-18T21:15:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d79df6640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.906+0000 7f5d79df6640 4 set_mon_vals no callback set 2024-08-18T21:15:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 10 monclient: shutdown 2024-08-18T21:15:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 -- 172.21.15.5:0/3360517971 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d740a6ce0 msgr2=0x7f5d740a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 --2- 172.21.15.5:0/3360517971 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d740a6ce0 0x7f5d740a70c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5d640097f0 tx=0x7f5d6401c3c0 comp rx=0 tx=0).stop 2024-08-18T21:15:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 -- 172.21.15.5:0/3360517971 shutdown_connections 2024-08-18T21:15:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 --2- 172.21.15.5:0/3360517971 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d74139fe0 0x7f5d7413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 --2- 172.21.15.5:0/3360517971 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f5d740a7600 0x7f5d74139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 --2- 172.21.15.5:0/3360517971 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d740a6ce0 0x7f5d740a70c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 -- 172.21.15.5:0/3360517971 >> 172.21.15.5:0/3360517971 conn(0x7f5d740acbc0 msgr2=0x7f5d740a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 -- 172.21.15.5:0/3360517971 shutdown_connections 2024-08-18T21:15:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 -- 172.21.15.5:0/3360517971 wait complete. 2024-08-18T21:15:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 10 monclient: build_initial_monmap 2024-08-18T21:15:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 10 monclient: monmap: 2024-08-18T21:15:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:47.917 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:47.917 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.917 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058054767}) 2024-08-18T21:15:47.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 Processor -- start 2024-08-18T21:15:47.918 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2105276834}) 2024-08-18T21:15:47.918 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.918 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058054767}) 2024-08-18T21:15:47.918 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=396478694}) 2024-08-18T21:15:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 -- start start 2024-08-18T21:15:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 10 monclient: init 2024-08-18T21:15:47.921 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.921 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058054767}) 2024-08-18T21:15:47.921 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2657720626}) 2024-08-18T21:15:47.921 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.921 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058054767}) 2024-08-18T21:15:47.921 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3142433219}) 2024-08-18T21:15:47.921 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.921 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058054767}) 2024-08-18T21:15:47.921 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4080291393}) 2024-08-18T21:15:47.921 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.921 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058054767}) 2024-08-18T21:15:47.921 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3010018366}) 2024-08-18T21:15:47.921 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.922 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058054767}) 2024-08-18T21:15:47.922 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4245475444}) 2024-08-18T21:15:47.922 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:47.922 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058054767}) 2024-08-18T21:15:47.922 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:47.910+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2683237623}) 2024-08-18T21:15:47.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 10 monclient: _add_conns ranks=[3,5,2,4,7,8,0,6,1] 2024-08-18T21:15:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d740a6ce0 0x7f5d74135200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 10 monclient(hunting): picked mon.noname-g con 0x7f5d740a6ce0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d740a7600 0x7f5d7413aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 10 monclient(hunting): picked mon.noname-h con 0x7f5d740a7600 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d74139fe0 0x7f5d7413aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 10 monclient(hunting): picked mon.noname-b con 0x7f5d74139fe0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f5d740a79e0 con 0x7f5d74139fe0 2024-08-18T21:15:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:47.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5d740a8220 con 0x7f5d740a6ce0 2024-08-18T21:15:47.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:47.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f5d740a73a0 con 0x7f5d740a7600 2024-08-18T21:15:47.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:47.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d79df6640 10 monclient(hunting): authenticate will time out at 1714.926772s 2024-08-18T21:15:47.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d74139fe0 0x7f5d7413aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:47.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d74139fe0 0x7f5d7413aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33852/0 (socket says 172.21.15.5:33852) 2024-08-18T21:15:47.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 1 -- 172.21.15.5:0/2571038374 learned_addr learned my addr 172.21.15.5:0/2571038374 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:47.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 10 monclient(hunting): get_auth_request con 0x7f5d74139fe0 auth_method 0 2024-08-18T21:15:47.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:47.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:47.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:47.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d737fe640 1 --2- 172.21.15.5:0/2571038374 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d740a6ce0 0x7f5d74135200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d737fe640 10 monclient(hunting): get_auth_request con 0x7f5d740a6ce0 auth_method 0 2024-08-18T21:15:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d737fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d737fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d72ffd640 1 --2- 172.21.15.5:0/2571038374 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d740a7600 0x7f5d7413aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d72ffd640 10 monclient(hunting): get_auth_request con 0x7f5d740a7600 auth_method 0 2024-08-18T21:15:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d72ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d72ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d72ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 10 monclient(hunting): handle_auth_done global_id 115238 payload 824 2024-08-18T21:15:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 1 -- 172.21.15.5:0/2571038374 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d740a7600 msgr2=0x7f5d7413aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 1 --2- 172.21.15.5:0/2571038374 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d740a7600 0x7f5d7413aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 1 -- 172.21.15.5:0/2571038374 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d740a6ce0 msgr2=0x7f5d74135200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 1 --2- 172.21.15.5:0/2571038374 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d740a6ce0 0x7f5d74135200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 10 monclient: _finish_hunting 0 2024-08-18T21:15:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 1 monclient: found mon.noname-b 2024-08-18T21:15:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d73fff640 1 -- 172.21.15.5:0/2571038374 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7413e170 con 0x7f5d74139fe0 2024-08-18T21:15:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.910+0000 7f5d737fe640 1 --2- 172.21.15.5:0/2571038374 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d740a6ce0 0x7f5d74135200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:15:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d73fff640 1 -- 172.21.15.5:0/2571038374 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d74139fe0 msgr2=0x7f5d7413aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d73fff640 1 --2- 172.21.15.5:0/2571038374 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d74139fe0 0x7f5d7413aff0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00efc0 tx=0x7f5d6c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d5bfff640 1 -- 172.21.15.5:0/2571038374 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5d6c009e60 con 0x7f5d74139fe0 2024-08-18T21:15:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d5bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d5bfff640 10 monclient: dump: 2024-08-18T21:15:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:47.931 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d5bfff640 10 monclient: _finish_auth 0 2024-08-18T21:15:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d5bfff640 10 monclient: _check_auth_tickets 2024-08-18T21:15:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d5bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d5bfff640 1 -- 172.21.15.5:0/2571038374 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d6c003e10 con 0x7f5d74139fe0 2024-08-18T21:15:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d79df6640 5 monclient: authenticate success, global_id 115238 2024-08-18T21:15:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d79df6640 10 monclient: _renew_subs 2024-08-18T21:15:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d79df6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d79df6640 1 -- 172.21.15.5:0/2571038374 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d7413c3d0 con 0x7f5d74139fe0 2024-08-18T21:15:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d5bfff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d5bfff640 1 -- 172.21.15.5:0/2571038374 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5d6c00cd30 con 0x7f5d74139fe0 2024-08-18T21:15:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d5bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d5bfff640 10 monclient: dump: 2024-08-18T21:15:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:47.933 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d71ffb640 4 set_mon_vals no callback set 2024-08-18T21:15:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d79df6640 10 monclient: _renew_subs 2024-08-18T21:15:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d79df6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d79df6640 1 -- 172.21.15.5:0/2571038374 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d7413cf30 con 0x7f5d74139fe0 2024-08-18T21:15:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d79df6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d79df6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d79df6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d79df6640 1 -- 172.21.15.5:0/2571038374 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d74139aa0 con 0x7f5d74139fe0 2024-08-18T21:15:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d5bfff640 1 -- 172.21.15.5:0/2571038374 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f5d6c012050 con 0x7f5d74139fe0 2024-08-18T21:15:47.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d5bfff640 1 --2- 172.21.15.5:0/2571038374 >> v2:172.21.15.157:6812/631023601 conn(0x7f5d6003bdf0 0x7f5d6003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:47.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d5bfff640 1 -- 172.21.15.5:0/2571038374 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(331..331 src has 22..331) ==== 3506+0+0 (secure 0 0 0) 0x7f5d6c04ea40 con 0x7f5d74139fe0 2024-08-18T21:15:47.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d737fe640 1 --2- 172.21.15.5:0/2571038374 >> v2:172.21.15.157:6812/631023601 conn(0x7f5d6003bdf0 0x7f5d6003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:47.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.914+0000 7f5d737fe640 10 monclient: get_auth_request con 0x7f5d6003bdf0 auth_method 0 2024-08-18T21:15:47.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.918+0000 7f5d737fe640 1 --2- 172.21.15.5:0/2571038374 >> v2:172.21.15.157:6812/631023601 conn(0x7f5d6003bdf0 0x7f5d6003e2b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5d640097f0 tx=0x7f5d640a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:47.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.922+0000 7f5d5bfff640 1 -- 172.21.15.5:0/2571038374 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f5d6c022020 con 0x7f5d74139fe0 2024-08-18T21:15:47.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.922+0000 7f5d5bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:47.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:47.922+0000 7f5d5bfff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:48.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.090+0000 7f5d79df6640 1 -- 172.21.15.5:0/2571038374 --> v2:172.21.15.157:6812/631023601 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f5d74069580 con 0x7f5d6003bdf0 2024-08-18T21:15:48.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.094+0000 7f5d5bfff640 1 -- 172.21.15.5:0/2571038374 <== mgr.4130 v2:172.21.15.157:6812/631023601 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5d74069580 con 0x7f5d6003bdf0 2024-08-18T21:15:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 0 to deep-scrub 2024-08-18T21:15:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.094+0000 7f5d79df6640 1 -- 172.21.15.5:0/2571038374 >> v2:172.21.15.157:6812/631023601 conn(0x7f5d6003bdf0 msgr2=0x7f5d6003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.094+0000 7f5d79df6640 1 --2- 172.21.15.5:0/2571038374 >> v2:172.21.15.157:6812/631023601 conn(0x7f5d6003bdf0 0x7f5d6003e2b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5d640097f0 tx=0x7f5d640a6000 comp rx=0 tx=0).stop 2024-08-18T21:15:48.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.094+0000 7f5d79df6640 10 monclient: shutdown 2024-08-18T21:15:48.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.094+0000 7f5d79df6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:48.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.094+0000 7f5d79df6640 1 -- 172.21.15.5:0/2571038374 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d74139fe0 msgr2=0x7f5d7413aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.094+0000 7f5d79df6640 1 --2- 172.21.15.5:0/2571038374 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d74139fe0 0x7f5d7413aff0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00efc0 tx=0x7f5d6c00c490 comp rx=0 tx=0).stop 2024-08-18T21:15:48.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.094+0000 7f5d79df6640 1 -- 172.21.15.5:0/2571038374 shutdown_connections 2024-08-18T21:15:48.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.094+0000 7f5d79df6640 1 --2- 172.21.15.5:0/2571038374 >> v2:172.21.15.157:6812/631023601 conn(0x7f5d6003bdf0 0x7f5d6003e2b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.094+0000 7f5d79df6640 1 --2- 172.21.15.5:0/2571038374 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d74139fe0 0x7f5d7413aff0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.094+0000 7f5d79df6640 1 --2- 172.21.15.5:0/2571038374 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f5d740a7600 0x7f5d7413aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.094+0000 7f5d79df6640 1 --2- 172.21.15.5:0/2571038374 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d740a6ce0 0x7f5d74135200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.094+0000 7f5d79df6640 1 -- 172.21.15.5:0/2571038374 >> 172.21.15.5:0/2571038374 conn(0x7f5d740acbc0 msgr2=0x7f5d74135c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:48.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.094+0000 7f5d79df6640 1 -- 172.21.15.5:0/2571038374 shutdown_connections 2024-08-18T21:15:48.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.094+0000 7f5d79df6640 1 -- 172.21.15.5:0/2571038374 wait complete. 2024-08-18T21:15:48.110 INFO:tasks.ceph:Scrubbing osd.1 2024-08-18T21:15:48.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-18T21:15:48.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 10 monclient: get_monmap_and_config 2024-08-18T21:15:48.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 10 monclient: build_initial_monmap 2024-08-18T21:15:48.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 10 monclient: monmap: 2024-08-18T21:15:48.240 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:48.240 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:48.240 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:48.245675+0000 2024-08-18T21:15:48.240 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:48.245675+0000 2024-08-18T21:15:48.241 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:48.241 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.241 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:48.241 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:48.241 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:48.241 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:48.241 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:48.241 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:48.241 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:48.241 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:48.242 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:48.242 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:48.242 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:48.242 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 1 Processor -- start 2024-08-18T21:15:48.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 1 -- start start 2024-08-18T21:15:48.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 10 monclient: init 2024-08-18T21:15:48.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:48.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 10 monclient: _add_conns ranks=[7,3,6,8,2,9,1,10,0,5,4] 2024-08-18T21:15:48.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7feb100a3290 0x7feb100a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 10 monclient(hunting): picked mon.noname-i con 0x7feb100a3290 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:15:48.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb100a3670 0x7feb100a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 10 monclient(hunting): picked mon.noname-g con 0x7feb100a3670 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:48.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7feb1009b180 0x7feb1009b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 10 monclient(hunting): picked mon.noname-d con 0x7feb1009b180 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:15:48.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb10074af0 con 0x7feb100a3670 2024-08-18T21:15:48.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7feb100748b0 con 0x7feb1009b180 2024-08-18T21:15:48.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7feb100a01c0 con 0x7feb100a3290 2024-08-18T21:15:48.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:48.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb17e12640 10 monclient(hunting): authenticate will time out at 1715.259624s 2024-08-18T21:15:48.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb163af640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7feb1009b180 0x7feb1009b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb163af640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7feb1009b180 0x7feb1009b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:38454/0 (socket says 172.21.15.5:38454) 2024-08-18T21:15:48.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb163af640 1 -- 172.21.15.5:0/3224726684 learned_addr learned my addr 172.21.15.5:0/3224726684 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:48.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb163af640 10 monclient(hunting): get_auth_request con 0x7feb1009b180 auth_method 0 2024-08-18T21:15:48.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb163af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:48.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb163af640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:48.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb163af640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:48.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb163af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:48.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb163af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:48.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.242+0000 7feb163af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:48.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb153ad640 1 --2- 172.21.15.5:0/3224726684 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb100a3670 0x7feb100a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb15bae640 1 --2- 172.21.15.5:0/3224726684 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7feb100a3290 0x7feb100a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb153ad640 10 monclient(hunting): get_auth_request con 0x7feb100a3670 auth_method 0 2024-08-18T21:15:48.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb153ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:48.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb153ad640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:48.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb153ad640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:48.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb15bae640 10 monclient(hunting): get_auth_request con 0x7feb100a3290 auth_method 0 2024-08-18T21:15:48.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb15bae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:48.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb15bae640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:48.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb15bae640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:48.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb163af640 10 monclient(hunting): handle_auth_done global_id 174192 payload 274 2024-08-18T21:15:48.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb163af640 1 -- 172.21.15.5:0/3224726684 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7feb100a3290 msgr2=0x7feb100a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:48.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb163af640 1 --2- 172.21.15.5:0/3224726684 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7feb100a3290 0x7feb100a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb163af640 1 -- 172.21.15.5:0/3224726684 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb100a3670 msgr2=0x7feb100a3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:48.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb163af640 1 --2- 172.21.15.5:0/3224726684 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb100a3670 0x7feb100a3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb163af640 10 monclient: _finish_hunting 0 2024-08-18T21:15:48.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb163af640 1 monclient: found mon.noname-d 2024-08-18T21:15:48.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb163af640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:48.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb163af640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:15:48.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.246+0000 7feb163af640 1 -- 172.21.15.5:0/3224726684 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb10074cf0 con 0x7feb1009b180 2024-08-18T21:15:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb163af640 1 -- 172.21.15.5:0/3224726684 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7feb1009b180 msgr2=0x7feb1009b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb163af640 1 --2- 172.21.15.5:0/3224726684 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7feb1009b180 0x7feb1009b600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feb08009eb0 tx=0x7feb0801c8f0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=e830f87aad524337 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb14bac640 1 -- 172.21.15.5:0/3224726684 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feb080090d0 con 0x7feb1009b180 2024-08-18T21:15:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb14bac640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb14bac640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:15:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb14bac640 10 monclient: dump: 2024-08-18T21:15:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:48.254 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:48.254 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:48.254 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:48.254 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb14bac640 10 monclient: _finish_auth 0 2024-08-18T21:15:48.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb14bac640 10 monclient: _check_auth_tickets 2024-08-18T21:15:48.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb14bac640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:48.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 5 monclient: authenticate success, global_id 174192 2024-08-18T21:15:48.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb14bac640 1 -- 172.21.15.5:0/3224726684 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb080a6950 con 0x7feb1009b180 2024-08-18T21:15:48.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb14bac640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:48.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:48.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb14bac640 1 -- 172.21.15.5:0/3224726684 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feb080af480 con 0x7feb1009b180 2024-08-18T21:15:48.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 4 set_mon_vals no callback set 2024-08-18T21:15:48.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb14bac640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:48.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb14bac640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:15:48.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb14bac640 10 monclient: dump: 2024-08-18T21:15:48.255 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:48.255 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:48.255 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.255 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.255 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:48.255 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.255 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:48.255 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:48.255 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:48.255 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:48.256 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 10 monclient: shutdown 2024-08-18T21:15:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 -- 172.21.15.5:0/3224726684 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7feb1009b180 msgr2=0x7feb1009b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 --2- 172.21.15.5:0/3224726684 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7feb1009b180 0x7feb1009b600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feb08009eb0 tx=0x7feb0801c8f0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 -- 172.21.15.5:0/3224726684 shutdown_connections 2024-08-18T21:15:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 --2- 172.21.15.5:0/3224726684 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb100a3670 0x7feb100a3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 --2- 172.21.15.5:0/3224726684 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7feb1009b180 0x7feb1009b600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 --2- 172.21.15.5:0/3224726684 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7feb100a3290 0x7feb100a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 -- 172.21.15.5:0/3224726684 >> 172.21.15.5:0/3224726684 conn(0x7feb100a8a60 msgr2=0x7feb100a8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 -- 172.21.15.5:0/3224726684 shutdown_connections 2024-08-18T21:15:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 -- 172.21.15.5:0/3224726684 wait complete. 2024-08-18T21:15:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 10 monclient: build_initial_monmap 2024-08-18T21:15:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 10 monclient: monmap: 2024-08-18T21:15:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:48.258 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 Processor -- start 2024-08-18T21:15:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 -- start start 2024-08-18T21:15:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 10 monclient: init 2024-08-18T21:15:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 10 monclient: _add_conns ranks=[0,6,3,2,7,4,8,5,1] 2024-08-18T21:15:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb1009b180 0x7feb101d1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 10 monclient(hunting): picked mon.noname-a con 0x7feb1009b180 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:15:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7feb100a3290 0x7feb10137820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 10 monclient(hunting): picked mon.noname-d con 0x7feb100a3290 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:15:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb100a3670 0x7feb10137d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 10 monclient(hunting): picked mon.noname-g con 0x7feb100a3670 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7feb10143650 con 0x7feb1009b180 2024-08-18T21:15:48.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb101434d0 con 0x7feb100a3670 2024-08-18T21:15:48.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7feb101437d0 con 0x7feb100a3290 2024-08-18T21:15:48.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:48.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb17e12640 10 monclient(hunting): authenticate will time out at 1715.266908s 2024-08-18T21:15:48.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7feb100a3290 0x7feb10137820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb15bae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb1009b180 0x7feb101d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7feb100a3290 0x7feb10137820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3303/0 says I am v2:172.21.15.5:38460/0 (socket says 172.21.15.5:38460) 2024-08-18T21:15:48.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 1 -- 172.21.15.5:0/3115522770 learned_addr learned my addr 172.21.15.5:0/3115522770 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb15bae640 10 monclient(hunting): get_auth_request con 0x7feb1009b180 auth_method 0 2024-08-18T21:15:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb15bae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb15bae640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb15bae640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 10 monclient(hunting): get_auth_request con 0x7feb100a3290 auth_method 0 2024-08-18T21:15:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb15bae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb15bae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb15bae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb163af640 1 --2- 172.21.15.5:0/3115522770 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb100a3670 0x7feb10137d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb163af640 10 monclient(hunting): get_auth_request con 0x7feb100a3670 auth_method 0 2024-08-18T21:15:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb163af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb163af640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb163af640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 10 monclient(hunting): handle_auth_done global_id 174201 payload 824 2024-08-18T21:15:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 1 -- 172.21.15.5:0/3115522770 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb100a3670 msgr2=0x7feb10137d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 1 --2- 172.21.15.5:0/3115522770 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb100a3670 0x7feb10137d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 1 -- 172.21.15.5:0/3115522770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb1009b180 msgr2=0x7feb101d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 1 --2- 172.21.15.5:0/3115522770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb1009b180 0x7feb101d1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 10 monclient: _finish_hunting 0 2024-08-18T21:15:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 1 monclient: found mon.noname-d 2024-08-18T21:15:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:48.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.5:3303/0 2024-08-18T21:15:48.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.250+0000 7feb153ad640 1 -- 172.21.15.5:0/3115522770 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb100a8e40 con 0x7feb100a3290 2024-08-18T21:15:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb153ad640 1 -- 172.21.15.5:0/3115522770 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7feb100a3290 msgr2=0x7feb10137820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb153ad640 1 --2- 172.21.15.5:0/3115522770 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7feb100a3290 0x7feb10137820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feb0400d600 tx=0x7feb0400dac0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 1 -- 172.21.15.5:0/3115522770 <== mon.6 v2:172.21.15.5:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feb04004450 con 0x7feb100a3290 2024-08-18T21:15:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-18T21:15:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 10 monclient: dump: 2024-08-18T21:15:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:48.267 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:48.267 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:48.267 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 10 monclient: _finish_auth 0 2024-08-18T21:15:48.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 10 monclient: _check_auth_tickets 2024-08-18T21:15:48.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:48.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 1 -- 172.21.15.5:0/3115522770 <== mon.6 v2:172.21.15.5:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb04003a90 con 0x7feb100a3290 2024-08-18T21:15:48.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb17e12640 5 monclient: authenticate success, global_id 174201 2024-08-18T21:15:48.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:48.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 1 -- 172.21.15.5:0/3115522770 <== mon.6 v2:172.21.15.5:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feb04003c40 con 0x7feb100a3290 2024-08-18T21:15:48.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-18T21:15:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb03fff640 4 set_mon_vals no callback set 2024-08-18T21:15:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 10 monclient: dump: 2024-08-18T21:15:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:48.269 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb17e12640 10 monclient: _renew_subs 2024-08-18T21:15:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb17e12640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:15:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb17e12640 1 -- 172.21.15.5:0/3115522770 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb100a9290 con 0x7feb100a3290 2024-08-18T21:15:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb17e12640 10 monclient: _renew_subs 2024-08-18T21:15:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb17e12640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:15:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb17e12640 1 -- 172.21.15.5:0/3115522770 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7feb1012e9e0 con 0x7feb100a3290 2024-08-18T21:15:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb17e12640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.5:3303/0 2024-08-18T21:15:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb17e12640 1 -- 172.21.15.5:0/3115522770 --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb100a0ed0 con 0x7feb100a3290 2024-08-18T21:15:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 1 -- 172.21.15.5:0/3115522770 <== mon.6 v2:172.21.15.5:3303/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7feb04003620 con 0x7feb100a3290 2024-08-18T21:15:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 1 --2- 172.21.15.5:0/3115522770 >> v2:172.21.15.157:6812/631023601 conn(0x7feaf403bdc0 0x7feaf403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 1 -- 172.21.15.5:0/3115522770 <== mon.6 v2:172.21.15.5:3303/0 5 ==== osd_map(331..331 src has 22..331) ==== 3506+0+0 (secure 0 0 0) 0x7feb0400f040 con 0x7feb100a3290 2024-08-18T21:15:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 1 --2- 172.21.15.5:0/3115522770 >> v2:172.21.15.5:6804/1057536297 conn(0x7feaf4041860 0x7feaf4043c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.254+0000 7feb027fc640 1 -- 172.21.15.5:0/3115522770 --> v2:172.21.15.5:6804/1057536297 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb04015e70 con 0x7feaf4041860 2024-08-18T21:15:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.258+0000 7feb163af640 1 --2- 172.21.15.5:0/3115522770 >> v2:172.21.15.5:6804/1057536297 conn(0x7feaf4041860 0x7feaf4043c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.258+0000 7feb163af640 10 monclient: get_auth_request con 0x7feaf4041860 auth_method 0 2024-08-18T21:15:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.258+0000 7feb15bae640 1 --2- 172.21.15.5:0/3115522770 >> v2:172.21.15.157:6812/631023601 conn(0x7feaf403bdc0 0x7feaf403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.258+0000 7feb15bae640 10 monclient: get_auth_request con 0x7feaf403bdc0 auth_method 0 2024-08-18T21:15:48.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.258+0000 7feb15bae640 1 --2- 172.21.15.5:0/3115522770 >> v2:172.21.15.157:6812/631023601 conn(0x7feaf403bdc0 0x7feaf403e280 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7feb0c007a60 tx=0x7feb0c008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:48.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.262+0000 7feb163af640 1 --2- 172.21.15.5:0/3115522770 >> v2:172.21.15.5:6804/1057536297 conn(0x7feaf4041860 0x7feaf4043c80 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:48.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.262+0000 7feb027fc640 1 -- 172.21.15.5:0/3115522770 <== osd.1 v2:172.21.15.5:6804/1057536297 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb04015e70 con 0x7feaf4041860 2024-08-18T21:15:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.274+0000 7feb17e12640 1 -- 172.21.15.5:0/3115522770 --> v2:172.21.15.5:6804/1057536297 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7feb1012da80 con 0x7feaf4041860 2024-08-18T21:15:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.274+0000 7feb027fc640 1 -- 172.21.15.5:0/3115522770 <== osd.1 v2:172.21.15.5:6804/1057536297 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7feb1012da80 con 0x7feaf4041860 2024-08-18T21:15:48.274 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:48.274 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T21:15:48.274 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:48.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.274+0000 7feb17e12640 1 -- 172.21.15.5:0/3115522770 >> v2:172.21.15.5:6804/1057536297 conn(0x7feaf4041860 msgr2=0x7feaf4043c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.274+0000 7feb17e12640 1 --2- 172.21.15.5:0/3115522770 >> v2:172.21.15.5:6804/1057536297 conn(0x7feaf4041860 0x7feaf4043c80 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.274+0000 7feb17e12640 1 -- 172.21.15.5:0/3115522770 >> v2:172.21.15.157:6812/631023601 conn(0x7feaf403bdc0 msgr2=0x7feaf403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.274+0000 7feb17e12640 1 --2- 172.21.15.5:0/3115522770 >> v2:172.21.15.157:6812/631023601 conn(0x7feaf403bdc0 0x7feaf403e280 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7feb0c007a60 tx=0x7feb0c008040 comp rx=0 tx=0).stop 2024-08-18T21:15:48.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.274+0000 7feb17e12640 10 monclient: shutdown 2024-08-18T21:15:48.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.274+0000 7feb17e12640 20 monclient: shutdown canceling and discarding version request 1 2024-08-18T21:15:48.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.274+0000 7feb17e12640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:48.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.274+0000 7feb17e12640 1 -- 172.21.15.5:0/3115522770 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7feb100a3290 msgr2=0x7feb10137820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.274+0000 7feb17e12640 1 --2- 172.21.15.5:0/3115522770 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7feb100a3290 0x7feb10137820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feb0400d600 tx=0x7feb0400dac0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.274+0000 7feb163af640 1 -- 172.21.15.5:0/3115522770 reap_dead start 2024-08-18T21:15:48.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.274+0000 7feb17e12640 1 -- 172.21.15.5:0/3115522770 shutdown_connections 2024-08-18T21:15:48.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.274+0000 7feb17e12640 1 -- 172.21.15.5:0/3115522770 >> 172.21.15.5:0/3115522770 conn(0x7feb100a8a60 msgr2=0x7feb100a6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:48.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.274+0000 7feb17e12640 1 -- 172.21.15.5:0/3115522770 shutdown_connections 2024-08-18T21:15:48.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.274+0000 7feb17e12640 1 -- 172.21.15.5:0/3115522770 wait complete. 2024-08-18T21:15:48.291 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-18T21:15:48.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1689182826}) 2024-08-18T21:15:48.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4288662958}) 2024-08-18T21:15:48.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1689182826}) 2024-08-18T21:15:48.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=789825465}) 2024-08-18T21:15:48.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1689182826}) 2024-08-18T21:15:48.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2824566672}) 2024-08-18T21:15:48.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1689182826}) 2024-08-18T21:15:48.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=630254322}) 2024-08-18T21:15:48.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.385 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1689182826}) 2024-08-18T21:15:48.385 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3783020474}) 2024-08-18T21:15:48.385 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.385 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1689182826}) 2024-08-18T21:15:48.385 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=976324813}) 2024-08-18T21:15:48.385 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.385 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1689182826}) 2024-08-18T21:15:48.385 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=617047202}) 2024-08-18T21:15:48.385 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.385 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1689182826}) 2024-08-18T21:15:48.385 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1188853797}) 2024-08-18T21:15:48.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.410+0000 7f21a0d2c640 10 monclient: get_monmap_and_config 2024-08-18T21:15:48.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.410+0000 7f21a0d2c640 10 monclient: build_initial_monmap 2024-08-18T21:15:48.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 10 monclient: monmap: 2024-08-18T21:15:48.411 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:48.411 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:48.411 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:48.416474+0000 2024-08-18T21:15:48.411 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:48.416474+0000 2024-08-18T21:15:48.411 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:48.411 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.411 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:48.412 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:48.412 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:48.412 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:48.412 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:48.412 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:48.412 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:48.412 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:48.412 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:48.412 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:48.412 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:48.412 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 1 Processor -- start 2024-08-18T21:15:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 1 -- start start 2024-08-18T21:15:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 10 monclient: init 2024-08-18T21:15:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 10 monclient: _add_conns ranks=[4,5,6,2,8,10,0,3,1,7,9] 2024-08-18T21:15:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f219c0a4a40 0x7f219c0a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 10 monclient(hunting): picked mon.noname-c con 0x7f219c0a4a40 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:15:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f219c0a0b40 0x7f219c0a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 10 monclient(hunting): picked mon.noname-h con 0x7f219c0a0b40 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f219c1367f0 0x7f219c136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 10 monclient(hunting): picked mon.noname-d con 0x7f219c1367f0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:15:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f219c0a58a0 con 0x7f219c0a4a40 2024-08-18T21:15:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f219c069960 con 0x7f219c0a0b40 2024-08-18T21:15:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f219c09e490 con 0x7f219c1367f0 2024-08-18T21:15:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f21a0d2c640 10 monclient(hunting): authenticate will time out at 1715.429789s 2024-08-18T21:15:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f219c0a4a40 0x7f219c0a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f219c0a4a40 0x7f219c0a4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:38574/0 (socket says 172.21.15.5:38574) 2024-08-18T21:15:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 1 -- 172.21.15.5:0/2017896554 learned_addr learned my addr 172.21.15.5:0/2017896554 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 10 monclient(hunting): get_auth_request con 0x7f219c0a4a40 auth_method 0 2024-08-18T21:15:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219ad9d640 1 --2- 172.21.15.5:0/2017896554 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f219c1367f0 0x7f219c136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219ad9d640 10 monclient(hunting): get_auth_request con 0x7f219c1367f0 auth_method 0 2024-08-18T21:15:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f2199d9b640 1 --2- 172.21.15.5:0/2017896554 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f219c0a0b40 0x7f219c0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 10 monclient(hunting): handle_auth_done global_id 115087 payload 274 2024-08-18T21:15:48.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 1 -- 172.21.15.5:0/2017896554 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f219c1367f0 msgr2=0x7f219c136c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:48.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 1 --2- 172.21.15.5:0/2017896554 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f219c1367f0 0x7f219c136c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 1 -- 172.21.15.5:0/2017896554 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f219c0a0b40 msgr2=0x7f219c0a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:48.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 1 --2- 172.21.15.5:0/2017896554 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f219c0a0b40 0x7f219c0a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 10 monclient: _finish_hunting 0 2024-08-18T21:15:48.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 1 monclient: found mon.noname-c 2024-08-18T21:15:48.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:48.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:15:48.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f219a59c640 1 -- 172.21.15.5:0/2017896554 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c09f530 con 0x7f219c0a4a40 2024-08-18T21:15:48.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f2199d9b640 10 monclient: get_auth_request con 0x7f219c0a0b40 auth_method 0 2024-08-18T21:15:48.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.414+0000 7f2199d9b640 1 --2- 172.21.15.5:0/2017896554 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f219c0a0b40 0x7f219c0a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:15:48.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f219a59c640 1 -- 172.21.15.5:0/2017896554 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f219c0a4a40 msgr2=0x7f219c0a4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:48.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f219a59c640 1 --2- 172.21.15.5:0/2017896554 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f219c0a4a40 0x7f219c0a4e20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f218c00bb70 tx=0x7f218c01eb10 comp rx=0 tx=0).ready entity=mon.4 client_cookie=6bbd758b97ec1395 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:48.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f219959a640 1 -- 172.21.15.5:0/2017896554 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f218c0b4070 con 0x7f219c0a4a40 2024-08-18T21:15:48.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f219959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:48.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f219959a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:15:48.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f219959a640 10 monclient: dump: 2024-08-18T21:15:48.422 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:48.422 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:48.422 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:48.423 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f219959a640 10 monclient: _finish_auth 0 2024-08-18T21:15:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f219959a640 10 monclient: _check_auth_tickets 2024-08-18T21:15:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f219959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f21a0d2c640 5 monclient: authenticate success, global_id 115087 2024-08-18T21:15:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f21a0d2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:15:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f219959a640 1 -- 172.21.15.5:0/2017896554 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f218c0a7a70 con 0x7f219c0a4a40 2024-08-18T21:15:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f219959a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f21a0d2c640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f219959a640 1 -- 172.21.15.5:0/2017896554 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f218c0a7c60 con 0x7f219c0a4a40 2024-08-18T21:15:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f219959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f21a0d2c640 4 set_mon_vals no callback set 2024-08-18T21:15:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f219959a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:15:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f219959a640 10 monclient: dump: 2024-08-18T21:15:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:48.426 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f21a0d2c640 10 monclient: shutdown 2024-08-18T21:15:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f21a0d2c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f21a0d2c640 1 -- 172.21.15.5:0/2017896554 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f219c0a4a40 msgr2=0x7f219c0a4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f21a0d2c640 1 --2- 172.21.15.5:0/2017896554 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f219c0a4a40 0x7f219c0a4e20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f218c00bb70 tx=0x7f218c01eb10 comp rx=0 tx=0).stop 2024-08-18T21:15:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f21a0d2c640 1 -- 172.21.15.5:0/2017896554 shutdown_connections 2024-08-18T21:15:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f21a0d2c640 1 --2- 172.21.15.5:0/2017896554 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f219c1367f0 0x7f219c136c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f21a0d2c640 1 --2- 172.21.15.5:0/2017896554 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f219c0a0b40 0x7f219c0a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f21a0d2c640 1 --2- 172.21.15.5:0/2017896554 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f219c0a4a40 0x7f219c0a4e20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f21a0d2c640 1 -- 172.21.15.5:0/2017896554 >> 172.21.15.5:0/2017896554 conn(0x7f219c068700 msgr2=0x7f219c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f21a0d2c640 1 -- 172.21.15.5:0/2017896554 shutdown_connections 2024-08-18T21:15:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.418+0000 7f21a0d2c640 1 -- 172.21.15.5:0/2017896554 wait complete. 2024-08-18T21:15:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 10 monclient: build_initial_monmap 2024-08-18T21:15:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 10 monclient: monmap: 2024-08-18T21:15:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:48.428 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:48.428 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:48.428 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:48.428 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:48.428 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:48.428 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:48.428 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 1 Processor -- start 2024-08-18T21:15:48.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 1 -- start start 2024-08-18T21:15:48.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 10 monclient: init 2024-08-18T21:15:48.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:48.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 10 monclient: _add_conns ranks=[3,0,2,1,8,5,6,7,4] 2024-08-18T21:15:48.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f219c0a0b40 0x7f219c135330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 10 monclient(hunting): picked mon.noname-g con 0x7f219c0a0b40 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f219c0a4a40 0x7f219c135870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 10 monclient(hunting): picked mon.noname-a con 0x7f219c0a4a40 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:15:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f219c1367f0 0x7f219c13b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 10 monclient(hunting): picked mon.noname-b con 0x7f219c1367f0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f219c06d160 con 0x7f219c0a4a40 2024-08-18T21:15:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f219c09e290 con 0x7f219c1367f0 2024-08-18T21:15:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f219c06d2e0 con 0x7f219c0a0b40 2024-08-18T21:15:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f21a0d2c640 10 monclient(hunting): authenticate will time out at 1715.437478s 2024-08-18T21:15:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f219c0a4a40 0x7f219c135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f219c0a4a40 0x7f219c135870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53820/0 (socket says 172.21.15.5:53820) 2024-08-18T21:15:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f219ad9d640 1 --2- 172.21.15.5:0/564665278 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f219c1367f0 0x7f219c13b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 1 -- 172.21.15.5:0/564665278 learned_addr learned my addr 172.21.15.5:0/564665278 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 10 monclient(hunting): get_auth_request con 0x7f219c0a4a40 auth_method 0 2024-08-18T21:15:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f219ad9d640 10 monclient(hunting): get_auth_request con 0x7f219c1367f0 auth_method 0 2024-08-18T21:15:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f219ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f219ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f219ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f219ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f219ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f219ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f219a59c640 1 --2- 172.21.15.5:0/564665278 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f219c0a0b40 0x7f219c135330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 10 monclient(hunting): handle_auth_done global_id 124911 payload 824 2024-08-18T21:15:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 1 -- 172.21.15.5:0/564665278 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f219c0a0b40 msgr2=0x7f219c135330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 1 --2- 172.21.15.5:0/564665278 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f219c0a0b40 0x7f219c135330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 1 -- 172.21.15.5:0/564665278 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f219c1367f0 msgr2=0x7f219c13b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 1 --2- 172.21.15.5:0/564665278 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f219c1367f0 0x7f219c13b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 10 monclient: _finish_hunting 0 2024-08-18T21:15:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 1 monclient: found mon.noname-a 2024-08-18T21:15:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:15:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f2199d9b640 1 -- 172.21.15.5:0/564665278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c124bb0 con 0x7f219c0a4a40 2024-08-18T21:15:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f219a59c640 10 monclient: get_auth_request con 0x7f219c0a0b40 auth_method 0 2024-08-18T21:15:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.422+0000 7f219a59c640 1 --2- 172.21.15.5:0/564665278 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f219c0a0b40 0x7f219c135330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:15:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.426+0000 7f2199d9b640 1 -- 172.21.15.5:0/564665278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f219c0a4a40 msgr2=0x7f219c135870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:48.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.426+0000 7f2199d9b640 1 --2- 172.21.15.5:0/564665278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f219c0a4a40 0x7f219c135870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f219000c7f0 tx=0x7f219000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218affd640 1 -- 172.21.15.5:0/564665278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2190015070 con 0x7f219c0a4a40 2024-08-18T21:15:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:15:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218affd640 10 monclient: dump: 2024-08-18T21:15:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:48.445 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218affd640 10 monclient: _finish_auth 0 2024-08-18T21:15:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218affd640 10 monclient: _check_auth_tickets 2024-08-18T21:15:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f21a0d2c640 5 monclient: authenticate success, global_id 124911 2024-08-18T21:15:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f21a0d2c640 10 monclient: _renew_subs 2024-08-18T21:15:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218affd640 1 -- 172.21.15.5:0/564665278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21900113f0 con 0x7f219c0a4a40 2024-08-18T21:15:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f21a0d2c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:15:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f21a0d2c640 1 -- 172.21.15.5:0/564665278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219c13d2d0 con 0x7f219c0a4a40 2024-08-18T21:15:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218affd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218affd640 1 -- 172.21.15.5:0/564665278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2190011a10 con 0x7f219c0a4a40 2024-08-18T21:15:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:15:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218affd640 10 monclient: dump: 2024-08-18T21:15:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:48.447 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218bfff640 4 set_mon_vals no callback set 2024-08-18T21:15:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f21a0d2c640 10 monclient: _renew_subs 2024-08-18T21:15:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f21a0d2c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:15:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f21a0d2c640 1 -- 172.21.15.5:0/564665278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f219c068ae0 con 0x7f219c0a4a40 2024-08-18T21:15:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f21a0d2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f21a0d2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f21a0d2c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:15:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f21a0d2c640 1 -- 172.21.15.5:0/564665278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f219c06d670 con 0x7f219c0a4a40 2024-08-18T21:15:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218affd640 1 -- 172.21.15.5:0/564665278 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f2190018070 con 0x7f219c0a4a40 2024-08-18T21:15:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218affd640 1 --2- 172.21.15.5:0/564665278 >> v2:172.21.15.157:6812/631023601 conn(0x7f217c03bdc0 0x7f217c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f218affd640 1 -- 172.21.15.5:0/564665278 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(331..331 src has 22..331) ==== 3506+0+0 (secure 0 0 0) 0x7f219004e140 con 0x7f219c0a4a40 2024-08-18T21:15:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f219a59c640 1 --2- 172.21.15.5:0/564665278 >> v2:172.21.15.157:6812/631023601 conn(0x7f217c03bdc0 0x7f217c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.446+0000 7f219a59c640 10 monclient: get_auth_request con 0x7f217c03bdc0 auth_method 0 2024-08-18T21:15:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.450+0000 7f219a59c640 1 --2- 172.21.15.5:0/564665278 >> v2:172.21.15.157:6812/631023601 conn(0x7f217c03bdc0 0x7f217c03e280 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f218c00bb40 tx=0x7f218c0a9070 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:48.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.450+0000 7f218affd640 1 -- 172.21.15.5:0/564665278 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f21900193b0 con 0x7f219c0a4a40 2024-08-18T21:15:48.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.450+0000 7f218affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:48.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.450+0000 7f218affd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:48.606 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.606 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3121147127}) 2024-08-18T21:15:48.607 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2709069599}) 2024-08-18T21:15:48.607 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.607 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3121147127}) 2024-08-18T21:15:48.607 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2273863300}) 2024-08-18T21:15:48.607 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.607 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3121147127}) 2024-08-18T21:15:48.607 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1832898683}) 2024-08-18T21:15:48.607 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.608 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3121147127}) 2024-08-18T21:15:48.608 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1163112376}) 2024-08-18T21:15:48.608 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.608 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3121147127}) 2024-08-18T21:15:48.608 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=551494918}) 2024-08-18T21:15:48.608 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.608 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3121147127}) 2024-08-18T21:15:48.608 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=296311484}) 2024-08-18T21:15:48.608 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.608 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3121147127}) 2024-08-18T21:15:48.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2653782264}) 2024-08-18T21:15:48.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3121147127}) 2024-08-18T21:15:48.609 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.602+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3488566968}) 2024-08-18T21:15:48.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.650+0000 7f21a0d2c640 1 -- 172.21.15.5:0/564665278 --> v2:172.21.15.157:6812/631023601 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f219c069010 con 0x7f217c03bdc0 2024-08-18T21:15:48.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.650+0000 7f218affd640 1 -- 172.21.15.5:0/564665278 <== mgr.4130 v2:172.21.15.157:6812/631023601 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f219c069010 con 0x7f217c03bdc0 2024-08-18T21:15:48.649 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 1 to deep-scrub 2024-08-18T21:15:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.654+0000 7f21a0d2c640 1 -- 172.21.15.5:0/564665278 >> v2:172.21.15.157:6812/631023601 conn(0x7f217c03bdc0 msgr2=0x7f217c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.654+0000 7f21a0d2c640 1 --2- 172.21.15.5:0/564665278 >> v2:172.21.15.157:6812/631023601 conn(0x7f217c03bdc0 0x7f217c03e280 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f218c00bb40 tx=0x7f218c0a9070 comp rx=0 tx=0).stop 2024-08-18T21:15:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.654+0000 7f21a0d2c640 10 monclient: shutdown 2024-08-18T21:15:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.654+0000 7f21a0d2c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.654+0000 7f21a0d2c640 1 -- 172.21.15.5:0/564665278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f219c0a4a40 msgr2=0x7f219c135870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.654+0000 7f21a0d2c640 1 --2- 172.21.15.5:0/564665278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f219c0a4a40 0x7f219c135870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f219000c7f0 tx=0x7f219000ccb0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.654+0000 7f21a0d2c640 1 -- 172.21.15.5:0/564665278 shutdown_connections 2024-08-18T21:15:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.654+0000 7f21a0d2c640 1 --2- 172.21.15.5:0/564665278 >> v2:172.21.15.157:6812/631023601 conn(0x7f217c03bdc0 0x7f217c03e280 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.654+0000 7f21a0d2c640 1 --2- 172.21.15.5:0/564665278 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f219c1367f0 0x7f219c13b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.654+0000 7f21a0d2c640 1 --2- 172.21.15.5:0/564665278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f219c0a4a40 0x7f219c135870 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.654+0000 7f21a0d2c640 1 --2- 172.21.15.5:0/564665278 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f219c0a0b40 0x7f219c135330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.654+0000 7f21a0d2c640 1 -- 172.21.15.5:0/564665278 >> 172.21.15.5:0/564665278 conn(0x7f219c068700 msgr2=0x7f219c0a2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.654+0000 7f21a0d2c640 1 -- 172.21.15.5:0/564665278 shutdown_connections 2024-08-18T21:15:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.654+0000 7f21a0d2c640 1 -- 172.21.15.5:0/564665278 wait complete. 2024-08-18T21:15:48.676 INFO:tasks.ceph:Scrubbing osd.2 2024-08-18T21:15:48.676 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-18T21:15:48.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2122336223}) 2024-08-18T21:15:48.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3944009783}) 2024-08-18T21:15:48.693 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2122336223}) 2024-08-18T21:15:48.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=140821679}) 2024-08-18T21:15:48.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2122336223}) 2024-08-18T21:15:48.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1170544481}) 2024-08-18T21:15:48.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2122336223}) 2024-08-18T21:15:48.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2273957205}) 2024-08-18T21:15:48.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2122336223}) 2024-08-18T21:15:48.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3749028016}) 2024-08-18T21:15:48.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.694 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2122336223}) 2024-08-18T21:15:48.695 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=801576104}) 2024-08-18T21:15:48.695 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.695 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2122336223}) 2024-08-18T21:15:48.695 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2313292935}) 2024-08-18T21:15:48.695 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.695 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2122336223}) 2024-08-18T21:15:48.695 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2513113439}) 2024-08-18T21:15:48.700 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.701 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=527872371}) 2024-08-18T21:15:48.701 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2874564502}) 2024-08-18T21:15:48.701 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.701 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=527872371}) 2024-08-18T21:15:48.701 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=885025909}) 2024-08-18T21:15:48.701 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.701 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=527872371}) 2024-08-18T21:15:48.701 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=615912150}) 2024-08-18T21:15:48.701 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.701 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=527872371}) 2024-08-18T21:15:48.701 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4057051254}) 2024-08-18T21:15:48.701 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.701 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=527872371}) 2024-08-18T21:15:48.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=432161797}) 2024-08-18T21:15:48.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=527872371}) 2024-08-18T21:15:48.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.694+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=99436514}) 2024-08-18T21:15:48.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=527872371}) 2024-08-18T21:15:48.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1539223865}) 2024-08-18T21:15:48.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=527872371}) 2024-08-18T21:15:48.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=877159517}) 2024-08-18T21:15:48.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114224417}) 2024-08-18T21:15:48.702 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1241497171}) 2024-08-18T21:15:48.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114224417}) 2024-08-18T21:15:48.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=598617417}) 2024-08-18T21:15:48.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114224417}) 2024-08-18T21:15:48.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1266271974}) 2024-08-18T21:15:48.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114224417}) 2024-08-18T21:15:48.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3952143014}) 2024-08-18T21:15:48.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114224417}) 2024-08-18T21:15:48.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1992613511}) 2024-08-18T21:15:48.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.703 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114224417}) 2024-08-18T21:15:48.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3082183564}) 2024-08-18T21:15:48.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114224417}) 2024-08-18T21:15:48.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=790794217}) 2024-08-18T21:15:48.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114224417}) 2024-08-18T21:15:48.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.698+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2844634719}) 2024-08-18T21:15:48.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3634722777}) 2024-08-18T21:15:48.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1404137902}) 2024-08-18T21:15:48.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3634722777}) 2024-08-18T21:15:48.704 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=367899846}) 2024-08-18T21:15:48.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3634722777}) 2024-08-18T21:15:48.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1280164396}) 2024-08-18T21:15:48.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3634722777}) 2024-08-18T21:15:48.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2766511649}) 2024-08-18T21:15:48.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3634722777}) 2024-08-18T21:15:48.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1936067421}) 2024-08-18T21:15:48.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3634722777}) 2024-08-18T21:15:48.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4082720219}) 2024-08-18T21:15:48.705 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3634722777}) 2024-08-18T21:15:48.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=666435743}) 2024-08-18T21:15:48.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3634722777}) 2024-08-18T21:15:48.706 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3580055919}) 2024-08-18T21:15:48.712 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.712 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573200490}) 2024-08-18T21:15:48.712 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=412562747}) 2024-08-18T21:15:48.712 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.712 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573200490}) 2024-08-18T21:15:48.712 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2639552494}) 2024-08-18T21:15:48.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573200490}) 2024-08-18T21:15:48.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=858002971}) 2024-08-18T21:15:48.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573200490}) 2024-08-18T21:15:48.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1833230294}) 2024-08-18T21:15:48.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573200490}) 2024-08-18T21:15:48.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1737254302}) 2024-08-18T21:15:48.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573200490}) 2024-08-18T21:15:48.713 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1994998262}) 2024-08-18T21:15:48.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573200490}) 2024-08-18T21:15:48.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1819380281}) 2024-08-18T21:15:48.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573200490}) 2024-08-18T21:15:48.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.702+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2598855724}) 2024-08-18T21:15:48.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2827568675}) 2024-08-18T21:15:48.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2531527176}) 2024-08-18T21:15:48.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2827568675}) 2024-08-18T21:15:48.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2467485922}) 2024-08-18T21:15:48.714 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2827568675}) 2024-08-18T21:15:48.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=350133677}) 2024-08-18T21:15:48.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2827568675}) 2024-08-18T21:15:48.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=315441068}) 2024-08-18T21:15:48.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2827568675}) 2024-08-18T21:15:48.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2588004376}) 2024-08-18T21:15:48.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2827568675}) 2024-08-18T21:15:48.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4230107114}) 2024-08-18T21:15:48.715 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.716 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2827568675}) 2024-08-18T21:15:48.716 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=340159088}) 2024-08-18T21:15:48.716 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.716 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2827568675}) 2024-08-18T21:15:48.716 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.706+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=613530987}) 2024-08-18T21:15:48.716 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.716 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4087128650}) 2024-08-18T21:15:48.716 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4185016647}) 2024-08-18T21:15:48.716 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.716 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4087128650}) 2024-08-18T21:15:48.716 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3159639495}) 2024-08-18T21:15:48.716 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.716 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4087128650}) 2024-08-18T21:15:48.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1476672178}) 2024-08-18T21:15:48.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4087128650}) 2024-08-18T21:15:48.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1459697003}) 2024-08-18T21:15:48.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4087128650}) 2024-08-18T21:15:48.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=770416830}) 2024-08-18T21:15:48.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4087128650}) 2024-08-18T21:15:48.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3366183422}) 2024-08-18T21:15:48.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4087128650}) 2024-08-18T21:15:48.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4223766810}) 2024-08-18T21:15:48.717 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4087128650}) 2024-08-18T21:15:48.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.710+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3436453083}) 2024-08-18T21:15:48.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1965336809}) 2024-08-18T21:15:48.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=201967117}) 2024-08-18T21:15:48.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1965336809}) 2024-08-18T21:15:48.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=159269759}) 2024-08-18T21:15:48.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1965336809}) 2024-08-18T21:15:48.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3129762472}) 2024-08-18T21:15:48.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.718 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1965336809}) 2024-08-18T21:15:48.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1805665194}) 2024-08-18T21:15:48.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1965336809}) 2024-08-18T21:15:48.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=445019834}) 2024-08-18T21:15:48.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1965336809}) 2024-08-18T21:15:48.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=327691558}) 2024-08-18T21:15:48.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1965336809}) 2024-08-18T21:15:48.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1606841520}) 2024-08-18T21:15:48.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1965336809}) 2024-08-18T21:15:48.719 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3761237073}) 2024-08-18T21:15:48.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3906671749}) 2024-08-18T21:15:48.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1563731403}) 2024-08-18T21:15:48.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3906671749}) 2024-08-18T21:15:48.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2389345347}) 2024-08-18T21:15:48.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3906671749}) 2024-08-18T21:15:48.721 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3010165146}) 2024-08-18T21:15:48.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3906671749}) 2024-08-18T21:15:48.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2859471717}) 2024-08-18T21:15:48.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3906671749}) 2024-08-18T21:15:48.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1183086787}) 2024-08-18T21:15:48.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3906671749}) 2024-08-18T21:15:48.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1906320878}) 2024-08-18T21:15:48.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3906671749}) 2024-08-18T21:15:48.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=482879946}) 2024-08-18T21:15:48.722 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3906671749}) 2024-08-18T21:15:48.723 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.714+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=64169091}) 2024-08-18T21:15:48.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1590895759}) 2024-08-18T21:15:48.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1115237522}) 2024-08-18T21:15:48.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1590895759}) 2024-08-18T21:15:48.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4030626246}) 2024-08-18T21:15:48.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1590895759}) 2024-08-18T21:15:48.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2410561085}) 2024-08-18T21:15:48.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1590895759}) 2024-08-18T21:15:48.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=191873272}) 2024-08-18T21:15:48.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1590895759}) 2024-08-18T21:15:48.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=622415114}) 2024-08-18T21:15:48.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1590895759}) 2024-08-18T21:15:48.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1391016450}) 2024-08-18T21:15:48.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1590895759}) 2024-08-18T21:15:48.726 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1820435578}) 2024-08-18T21:15:48.727 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.727 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1590895759}) 2024-08-18T21:15:48.727 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3902303730}) 2024-08-18T21:15:48.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689932857}) 2024-08-18T21:15:48.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3798377650}) 2024-08-18T21:15:48.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689932857}) 2024-08-18T21:15:48.730 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4055771069}) 2024-08-18T21:15:48.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689932857}) 2024-08-18T21:15:48.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2550301177}) 2024-08-18T21:15:48.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689932857}) 2024-08-18T21:15:48.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2564619922}) 2024-08-18T21:15:48.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689932857}) 2024-08-18T21:15:48.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4157275131}) 2024-08-18T21:15:48.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689932857}) 2024-08-18T21:15:48.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3532245748}) 2024-08-18T21:15:48.731 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689932857}) 2024-08-18T21:15:48.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1397050027}) 2024-08-18T21:15:48.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689932857}) 2024-08-18T21:15:48.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.726+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1968269895}) 2024-08-18T21:15:48.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2353284526}) 2024-08-18T21:15:48.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2355058898}) 2024-08-18T21:15:48.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2353284526}) 2024-08-18T21:15:48.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2672891668}) 2024-08-18T21:15:48.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2353284526}) 2024-08-18T21:15:48.732 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2759896209}) 2024-08-18T21:15:48.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2353284526}) 2024-08-18T21:15:48.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3880568800}) 2024-08-18T21:15:48.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2353284526}) 2024-08-18T21:15:48.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3824524219}) 2024-08-18T21:15:48.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2353284526}) 2024-08-18T21:15:48.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3014915380}) 2024-08-18T21:15:48.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2353284526}) 2024-08-18T21:15:48.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1739384324}) 2024-08-18T21:15:48.733 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.734 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2353284526}) 2024-08-18T21:15:48.734 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.730+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2602642691}) 2024-08-18T21:15:48.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1970405298}) 2024-08-18T21:15:48.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3362542242}) 2024-08-18T21:15:48.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1970405298}) 2024-08-18T21:15:48.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=536284866}) 2024-08-18T21:15:48.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1970405298}) 2024-08-18T21:15:48.739 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1239988458}) 2024-08-18T21:15:48.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1970405298}) 2024-08-18T21:15:48.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1300503833}) 2024-08-18T21:15:48.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1970405298}) 2024-08-18T21:15:48.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1653059266}) 2024-08-18T21:15:48.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1970405298}) 2024-08-18T21:15:48.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4060659750}) 2024-08-18T21:15:48.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1970405298}) 2024-08-18T21:15:48.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1666898846}) 2024-08-18T21:15:48.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1970405298}) 2024-08-18T21:15:48.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.734+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3794979209}) 2024-08-18T21:15:48.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2430867631}) 2024-08-18T21:15:48.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1217383052}) 2024-08-18T21:15:48.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2430867631}) 2024-08-18T21:15:48.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2649862762}) 2024-08-18T21:15:48.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2430867631}) 2024-08-18T21:15:48.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2971772424}) 2024-08-18T21:15:48.741 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2430867631}) 2024-08-18T21:15:48.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1893635684}) 2024-08-18T21:15:48.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2430867631}) 2024-08-18T21:15:48.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=509532133}) 2024-08-18T21:15:48.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2430867631}) 2024-08-18T21:15:48.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1548207538}) 2024-08-18T21:15:48.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2430867631}) 2024-08-18T21:15:48.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1993098065}) 2024-08-18T21:15:48.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.742 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2430867631}) 2024-08-18T21:15:48.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=586334307}) 2024-08-18T21:15:48.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=928002884}) 2024-08-18T21:15:48.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2407470435}) 2024-08-18T21:15:48.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=928002884}) 2024-08-18T21:15:48.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=287628242}) 2024-08-18T21:15:48.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=928002884}) 2024-08-18T21:15:48.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=571269636}) 2024-08-18T21:15:48.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=928002884}) 2024-08-18T21:15:48.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4095464927}) 2024-08-18T21:15:48.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.743 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=928002884}) 2024-08-18T21:15:48.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1897134775}) 2024-08-18T21:15:48.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=928002884}) 2024-08-18T21:15:48.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3347194839}) 2024-08-18T21:15:48.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=928002884}) 2024-08-18T21:15:48.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=40487448}) 2024-08-18T21:15:48.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=928002884}) 2024-08-18T21:15:48.744 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.738+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2309778848}) 2024-08-18T21:15:48.745 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.745 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471003012}) 2024-08-18T21:15:48.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2768630029}) 2024-08-18T21:15:48.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471003012}) 2024-08-18T21:15:48.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1370014760}) 2024-08-18T21:15:48.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471003012}) 2024-08-18T21:15:48.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3348665833}) 2024-08-18T21:15:48.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471003012}) 2024-08-18T21:15:48.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3146178743}) 2024-08-18T21:15:48.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471003012}) 2024-08-18T21:15:48.746 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=462880095}) 2024-08-18T21:15:48.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471003012}) 2024-08-18T21:15:48.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1830915564}) 2024-08-18T21:15:48.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471003012}) 2024-08-18T21:15:48.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3802722181}) 2024-08-18T21:15:48.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471003012}) 2024-08-18T21:15:48.747 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.742+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4078310330}) 2024-08-18T21:15:48.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=655048367}) 2024-08-18T21:15:48.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1942477102}) 2024-08-18T21:15:48.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=655048367}) 2024-08-18T21:15:48.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2613321481}) 2024-08-18T21:15:48.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=655048367}) 2024-08-18T21:15:48.751 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1975263111}) 2024-08-18T21:15:48.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=655048367}) 2024-08-18T21:15:48.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=701220243}) 2024-08-18T21:15:48.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=655048367}) 2024-08-18T21:15:48.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1055473718}) 2024-08-18T21:15:48.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=655048367}) 2024-08-18T21:15:48.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1787143008}) 2024-08-18T21:15:48.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=655048367}) 2024-08-18T21:15:48.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=302070771}) 2024-08-18T21:15:48.752 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.753 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=655048367}) 2024-08-18T21:15:48.753 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.750+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3575402481}) 2024-08-18T21:15:48.756 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=944362536}) 2024-08-18T21:15:48.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4141767469}) 2024-08-18T21:15:48.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=944362536}) 2024-08-18T21:15:48.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3670249127}) 2024-08-18T21:15:48.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=944362536}) 2024-08-18T21:15:48.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=883219531}) 2024-08-18T21:15:48.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=944362536}) 2024-08-18T21:15:48.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1052872752}) 2024-08-18T21:15:48.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.757 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=944362536}) 2024-08-18T21:15:48.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=914250169}) 2024-08-18T21:15:48.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=944362536}) 2024-08-18T21:15:48.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3206011865}) 2024-08-18T21:15:48.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=944362536}) 2024-08-18T21:15:48.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2635538288}) 2024-08-18T21:15:48.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=944362536}) 2024-08-18T21:15:48.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.754+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2526167110}) 2024-08-18T21:15:48.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4060804383}) 2024-08-18T21:15:48.758 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1278264436}) 2024-08-18T21:15:48.759 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.759 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4060804383}) 2024-08-18T21:15:48.759 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4139788384}) 2024-08-18T21:15:48.759 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.759 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4060804383}) 2024-08-18T21:15:48.759 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3213923624}) 2024-08-18T21:15:48.759 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.759 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4060804383}) 2024-08-18T21:15:48.759 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2341659418}) 2024-08-18T21:15:48.759 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.759 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4060804383}) 2024-08-18T21:15:48.759 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1574757483}) 2024-08-18T21:15:48.759 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.760 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4060804383}) 2024-08-18T21:15:48.760 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3810716086}) 2024-08-18T21:15:48.760 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.760 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4060804383}) 2024-08-18T21:15:48.760 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=845732082}) 2024-08-18T21:15:48.760 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.760 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4060804383}) 2024-08-18T21:15:48.760 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3346261223}) 2024-08-18T21:15:48.762 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.762 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3148559359}) 2024-08-18T21:15:48.762 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2337103517}) 2024-08-18T21:15:48.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3148559359}) 2024-08-18T21:15:48.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=959520409}) 2024-08-18T21:15:48.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3148559359}) 2024-08-18T21:15:48.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1702628746}) 2024-08-18T21:15:48.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3148559359}) 2024-08-18T21:15:48.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3457369852}) 2024-08-18T21:15:48.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3148559359}) 2024-08-18T21:15:48.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1000577726}) 2024-08-18T21:15:48.763 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3148559359}) 2024-08-18T21:15:48.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4032989120}) 2024-08-18T21:15:48.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3148559359}) 2024-08-18T21:15:48.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2853515046}) 2024-08-18T21:15:48.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3148559359}) 2024-08-18T21:15:48.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.758+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3328377990}) 2024-08-18T21:15:48.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4262000721}) 2024-08-18T21:15:48.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3989175817}) 2024-08-18T21:15:48.764 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4262000721}) 2024-08-18T21:15:48.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=702388918}) 2024-08-18T21:15:48.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4262000721}) 2024-08-18T21:15:48.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=800302026}) 2024-08-18T21:15:48.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4262000721}) 2024-08-18T21:15:48.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1420269182}) 2024-08-18T21:15:48.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4262000721}) 2024-08-18T21:15:48.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2449091448}) 2024-08-18T21:15:48.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4262000721}) 2024-08-18T21:15:48.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4162491964}) 2024-08-18T21:15:48.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4262000721}) 2024-08-18T21:15:48.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=808131594}) 2024-08-18T21:15:48.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4262000721}) 2024-08-18T21:15:48.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.762+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1280584085}) 2024-08-18T21:15:48.772 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.772 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2155286185}) 2024-08-18T21:15:48.773 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1978190264}) 2024-08-18T21:15:48.773 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.773 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2155286185}) 2024-08-18T21:15:48.773 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=685661460}) 2024-08-18T21:15:48.773 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.773 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2155286185}) 2024-08-18T21:15:48.773 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1761730220}) 2024-08-18T21:15:48.773 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.773 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2155286185}) 2024-08-18T21:15:48.773 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3779088950}) 2024-08-18T21:15:48.773 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.773 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2155286185}) 2024-08-18T21:15:48.773 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=945794617}) 2024-08-18T21:15:48.774 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.774 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2155286185}) 2024-08-18T21:15:48.774 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2590049961}) 2024-08-18T21:15:48.774 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.774 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2155286185}) 2024-08-18T21:15:48.774 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1790379594}) 2024-08-18T21:15:48.774 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.774 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2155286185}) 2024-08-18T21:15:48.774 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=153146978}) 2024-08-18T21:15:48.774 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.774 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2054306989}) 2024-08-18T21:15:48.774 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4123763418}) 2024-08-18T21:15:48.774 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.775 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2054306989}) 2024-08-18T21:15:48.775 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=201274641}) 2024-08-18T21:15:48.775 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.775 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2054306989}) 2024-08-18T21:15:48.775 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3721694397}) 2024-08-18T21:15:48.775 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.775 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2054306989}) 2024-08-18T21:15:48.775 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3633119680}) 2024-08-18T21:15:48.775 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.775 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2054306989}) 2024-08-18T21:15:48.775 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=563481862}) 2024-08-18T21:15:48.775 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.775 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2054306989}) 2024-08-18T21:15:48.775 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2618790300}) 2024-08-18T21:15:48.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2054306989}) 2024-08-18T21:15:48.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3174258575}) 2024-08-18T21:15:48.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2054306989}) 2024-08-18T21:15:48.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3042487058}) 2024-08-18T21:15:48.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000325627}) 2024-08-18T21:15:48.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=831718451}) 2024-08-18T21:15:48.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000325627}) 2024-08-18T21:15:48.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3219237855}) 2024-08-18T21:15:48.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.776 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000325627}) 2024-08-18T21:15:48.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1039867334}) 2024-08-18T21:15:48.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000325627}) 2024-08-18T21:15:48.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2451038202}) 2024-08-18T21:15:48.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000325627}) 2024-08-18T21:15:48.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2069209225}) 2024-08-18T21:15:48.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000325627}) 2024-08-18T21:15:48.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3307971038}) 2024-08-18T21:15:48.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000325627}) 2024-08-18T21:15:48.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1770916061}) 2024-08-18T21:15:48.777 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000325627}) 2024-08-18T21:15:48.778 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.770+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3371158502}) 2024-08-18T21:15:48.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1084715086}) 2024-08-18T21:15:48.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3840139334}) 2024-08-18T21:15:48.786 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1084715086}) 2024-08-18T21:15:48.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2138667373}) 2024-08-18T21:15:48.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1084715086}) 2024-08-18T21:15:48.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3428778547}) 2024-08-18T21:15:48.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1084715086}) 2024-08-18T21:15:48.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1375747284}) 2024-08-18T21:15:48.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1084715086}) 2024-08-18T21:15:48.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1034732949}) 2024-08-18T21:15:48.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.787 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1084715086}) 2024-08-18T21:15:48.788 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3918106530}) 2024-08-18T21:15:48.788 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.788 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1084715086}) 2024-08-18T21:15:48.788 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3089265826}) 2024-08-18T21:15:48.788 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.788 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1084715086}) 2024-08-18T21:15:48.788 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.774+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=132006859}) 2024-08-18T21:15:48.788 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.788 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1506033562}) 2024-08-18T21:15:48.788 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=54506509}) 2024-08-18T21:15:48.788 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.788 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1506033562}) 2024-08-18T21:15:48.788 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4052542807}) 2024-08-18T21:15:48.788 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1506033562}) 2024-08-18T21:15:48.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4282982616}) 2024-08-18T21:15:48.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1506033562}) 2024-08-18T21:15:48.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4180789526}) 2024-08-18T21:15:48.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1506033562}) 2024-08-18T21:15:48.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1307283775}) 2024-08-18T21:15:48.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1506033562}) 2024-08-18T21:15:48.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=493031026}) 2024-08-18T21:15:48.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1506033562}) 2024-08-18T21:15:48.789 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2408551434}) 2024-08-18T21:15:48.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1506033562}) 2024-08-18T21:15:48.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.778+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3121464640}) 2024-08-18T21:15:48.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2700038722}) 2024-08-18T21:15:48.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3466227934}) 2024-08-18T21:15:48.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2700038722}) 2024-08-18T21:15:48.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1724550524}) 2024-08-18T21:15:48.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2700038722}) 2024-08-18T21:15:48.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1654576948}) 2024-08-18T21:15:48.790 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2700038722}) 2024-08-18T21:15:48.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=41726411}) 2024-08-18T21:15:48.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2700038722}) 2024-08-18T21:15:48.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=931673272}) 2024-08-18T21:15:48.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2700038722}) 2024-08-18T21:15:48.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1436993745}) 2024-08-18T21:15:48.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2700038722}) 2024-08-18T21:15:48.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3612493954}) 2024-08-18T21:15:48.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2700038722}) 2024-08-18T21:15:48.791 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=58576297}) 2024-08-18T21:15:48.792 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.792 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2973705714}) 2024-08-18T21:15:48.792 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1491915178}) 2024-08-18T21:15:48.792 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.792 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2973705714}) 2024-08-18T21:15:48.792 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2376535565}) 2024-08-18T21:15:48.792 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.792 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2973705714}) 2024-08-18T21:15:48.792 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=598723881}) 2024-08-18T21:15:48.792 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.792 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2973705714}) 2024-08-18T21:15:48.792 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=741415594}) 2024-08-18T21:15:48.792 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.792 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2973705714}) 2024-08-18T21:15:48.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1295271173}) 2024-08-18T21:15:48.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2973705714}) 2024-08-18T21:15:48.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1936171063}) 2024-08-18T21:15:48.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2973705714}) 2024-08-18T21:15:48.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3309954892}) 2024-08-18T21:15:48.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2973705714}) 2024-08-18T21:15:48.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.782+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2803043674}) 2024-08-18T21:15:48.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248933394}) 2024-08-18T21:15:48.793 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2321933877}) 2024-08-18T21:15:48.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248933394}) 2024-08-18T21:15:48.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2836027198}) 2024-08-18T21:15:48.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248933394}) 2024-08-18T21:15:48.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3990642464}) 2024-08-18T21:15:48.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248933394}) 2024-08-18T21:15:48.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3357884361}) 2024-08-18T21:15:48.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248933394}) 2024-08-18T21:15:48.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4289753573}) 2024-08-18T21:15:48.794 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.795 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248933394}) 2024-08-18T21:15:48.795 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1275425227}) 2024-08-18T21:15:48.795 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.795 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248933394}) 2024-08-18T21:15:48.795 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=850930326}) 2024-08-18T21:15:48.795 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:48.795 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248933394}) 2024-08-18T21:15:48.795 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:48.786+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2478553010}) 2024-08-18T21:15:48.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.810+0000 7fbfc9395640 10 monclient: get_monmap_and_config 2024-08-18T21:15:48.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.810+0000 7fbfc9395640 10 monclient: build_initial_monmap 2024-08-18T21:15:48.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.810+0000 7fbfc9395640 10 monclient: monmap: 2024-08-18T21:15:48.810 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:48.810 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:48.810 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:48.815616+0000 2024-08-18T21:15:48.810 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:48.815616+0000 2024-08-18T21:15:48.810 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:48.810 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.810 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:48.811 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.810+0000 7fbfc9395640 1 Processor -- start 2024-08-18T21:15:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc9395640 1 -- start start 2024-08-18T21:15:48.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc9395640 10 monclient: init 2024-08-18T21:15:48.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc9395640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:48.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc9395640 10 monclient: _add_conns ranks=[1,3,9,10,6,8,7,5,4,0,2] 2024-08-18T21:15:48.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc9395640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fbfc40a6b60 addr v1:172.21.15.157:6789/0 2024-08-18T21:15:48.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc9395640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfc40a6f40 0x7fbfc40a7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc9395640 10 monclient(hunting): picked mon.noname-g con 0x7fbfc40a6f40 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:48.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc9395640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbfc413ede0 0x7fbfc41411d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc9395640 10 monclient(hunting): picked mon.noname-a con 0x7fbfc413ede0 addr v2:172.21.15.5:3300/0 2024-08-18T21:15:48.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc9395640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfc40a99e0 con 0x7fbfc40a6b60 2024-08-18T21:15:48.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc9395640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc9395640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbfc409e410 con 0x7fbfc413ede0 2024-08-18T21:15:48.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc9395640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc9395640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc40a7ed0 con 0x7fbfc40a6f40 2024-08-18T21:15:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc9395640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc9395640 10 monclient(hunting): authenticate will time out at 1715.828668s 2024-08-18T21:15:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbfc413ede0 0x7fbfc41411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbfc413ede0 0x7fbfc41411d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53848/0 (socket says 172.21.15.5:53848) 2024-08-18T21:15:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 1 -- 172.21.15.5:0/356128818 learned_addr learned my addr 172.21.15.5:0/356128818 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 10 monclient(hunting): get_auth_request con 0x7fbfc413ede0 auth_method 0 2024-08-18T21:15:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc27fc640 1 --2- 172.21.15.5:0/356128818 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfc40a6f40 0x7fbfc40a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 10 monclient(hunting): handle_auth_done global_id 124920 payload 274 2024-08-18T21:15:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 1 -- 172.21.15.5:0/356128818 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfc40a6f40 msgr2=0x7fbfc40a7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 1 --2- 172.21.15.5:0/356128818 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfc40a6f40 0x7fbfc40a7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 1 -- 172.21.15.5:0/356128818 >> v1:172.21.15.157:6789/0 conn(0x7fbfc40a6b60 legacy=0x7fbfc409eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 10 monclient: _finish_hunting 0 2024-08-18T21:15:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 1 monclient: found mon.noname-a 2024-08-18T21:15:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:15:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc37fe640 1 -- 172.21.15.5:0/356128818 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc40a7c50 con 0x7fbfc413ede0 2024-08-18T21:15:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc27fc640 10 monclient: get_auth_request con 0x7fbfc40a6f40 auth_method 0 2024-08-18T21:15:48.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.814+0000 7fbfc27fc640 1 --2- 172.21.15.5:0/356128818 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfc40a6f40 0x7fbfc40a7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:15:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc37fe640 1 -- 172.21.15.5:0/356128818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfc413ede0 msgr2=0x7fbfc41411d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc37fe640 1 --2- 172.21.15.5:0/356128818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfc413ede0 0x7fbfc41411d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbfc406f6f0 tx=0x7fbfbc01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0dfaa5834eebd5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc1ffb640 1 -- 172.21.15.5:0/356128818 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbfbc0091b0 con 0x7fbfc413ede0 2024-08-18T21:15:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:15:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc1ffb640 10 monclient: dump: 2024-08-18T21:15:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:48.822 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc1ffb640 10 monclient: _finish_auth 0 2024-08-18T21:15:48.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc1ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:15:48.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:48.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc1ffb640 1 -- 172.21.15.5:0/356128818 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfbc0a5aa0 con 0x7fbfc413ede0 2024-08-18T21:15:48.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 5 monclient: authenticate success, global_id 124920 2024-08-18T21:15:48.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:15:48.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc1ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:48.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:48.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc1ffb640 1 -- 172.21.15.5:0/356128818 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbfbc0a5c50 con 0x7fbfc413ede0 2024-08-18T21:15:48.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:48.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 4 set_mon_vals no callback set 2024-08-18T21:15:48.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:15:48.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc1ffb640 10 monclient: dump: 2024-08-18T21:15:48.823 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:48.823 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:48.823 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.823 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.823 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:48.823 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.823 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:48.823 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:48.823 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:48.823 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:48.823 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:48.824 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:48.824 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:48.824 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:48.824 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:48.824 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 10 monclient: shutdown 2024-08-18T21:15:48.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:48.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 1 -- 172.21.15.5:0/356128818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfc413ede0 msgr2=0x7fbfc41411d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 1 --2- 172.21.15.5:0/356128818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfc413ede0 0x7fbfc41411d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbfc406f6f0 tx=0x7fbfbc01c8d0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 1 -- 172.21.15.5:0/356128818 shutdown_connections 2024-08-18T21:15:48.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 1 --2- 172.21.15.5:0/356128818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfc413ede0 0x7fbfc41411d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 1 --2- 172.21.15.5:0/356128818 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfc40a6f40 0x7fbfc40a7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 1 -- 172.21.15.5:0/356128818 >> 172.21.15.5:0/356128818 conn(0x7fbfc40ac920 msgr2=0x7fbfc40a8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:48.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 1 -- 172.21.15.5:0/356128818 shutdown_connections 2024-08-18T21:15:48.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 1 -- 172.21.15.5:0/356128818 wait complete. 2024-08-18T21:15:48.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 10 monclient: build_initial_monmap 2024-08-18T21:15:48.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 10 monclient: monmap: 2024-08-18T21:15:48.825 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:48.825 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:48.825 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:48.825 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:48.825 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:48.825 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.825 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:48.825 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:48.825 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:48.826 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:48.826 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:48.826 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:48.826 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:48.826 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:48.826 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:48.826 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 1 Processor -- start 2024-08-18T21:15:48.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 1 -- start start 2024-08-18T21:15:48.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 10 monclient: init 2024-08-18T21:15:48.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:48.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 10 monclient: _add_conns ranks=[3,8,4,5,0,7,6,1,2] 2024-08-18T21:15:48.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfc40a6b60 0x7fbfc4127240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 10 monclient(hunting): picked mon.noname-g con 0x7fbfc40a6b60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:48.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbfc40a6f40 0x7fbfc4125270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 10 monclient(hunting): picked mon.noname-e con 0x7fbfc40a6f40 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:48.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbfc413ede0 0x7fbfc413e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 10 monclient(hunting): picked mon.noname-c con 0x7fbfc413ede0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:15:48.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc41442c0 con 0x7fbfc40a6b60 2024-08-18T21:15:48.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fbfc4144140 con 0x7fbfc413ede0 2024-08-18T21:15:48.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:48.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fbfc4144440 con 0x7fbfc40a6f40 2024-08-18T21:15:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.818+0000 7fbfc9395640 10 monclient(hunting): authenticate will time out at 1715.835848s 2024-08-18T21:15:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc27fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbfc40a6f40 0x7fbfc4125270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbfc413ede0 0x7fbfc413e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc27fc640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbfc40a6f40 0x7fbfc4125270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:53946/0 (socket says 172.21.15.5:53946) 2024-08-18T21:15:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc27fc640 1 -- 172.21.15.5:0/1099986291 learned_addr learned my addr 172.21.15.5:0/1099986291 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 10 monclient(hunting): get_auth_request con 0x7fbfc413ede0 auth_method 0 2024-08-18T21:15:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc27fc640 10 monclient(hunting): get_auth_request con 0x7fbfc40a6f40 auth_method 0 2024-08-18T21:15:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc27fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc27fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc2ffd640 1 --2- 172.21.15.5:0/1099986291 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfc40a6b60 0x7fbfc4127240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc2ffd640 10 monclient(hunting): get_auth_request con 0x7fbfc40a6b60 auth_method 0 2024-08-18T21:15:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:48.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 10 monclient(hunting): handle_auth_done global_id 115096 payload 824 2024-08-18T21:15:48.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 1 -- 172.21.15.5:0/1099986291 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbfc40a6f40 msgr2=0x7fbfc4125270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 1 --2- 172.21.15.5:0/1099986291 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbfc40a6f40 0x7fbfc4125270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 1 -- 172.21.15.5:0/1099986291 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfc40a6b60 msgr2=0x7fbfc4127240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 1 --2- 172.21.15.5:0/1099986291 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfc40a6b60 0x7fbfc4127240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 10 monclient: _finish_hunting 0 2024-08-18T21:15:48.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 1 monclient: found mon.noname-c 2024-08-18T21:15:48.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:48.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:15:48.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 1 -- 172.21.15.5:0/1099986291 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc40abcf0 con 0x7fbfc413ede0 2024-08-18T21:15:48.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc27fc640 1 --2- 172.21.15.5:0/1099986291 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fbfc40a6f40 0x7fbfc4125270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:15:48.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 1 -- 172.21.15.5:0/1099986291 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbfc413ede0 msgr2=0x7fbfc413e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc37fe640 1 --2- 172.21.15.5:0/1099986291 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbfc413ede0 0x7fbfc413e0b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0ab000 tx=0x7fbfbc019670 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfab7fe640 1 -- 172.21.15.5:0/1099986291 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbfbc0bb070 con 0x7fbfc413ede0 2024-08-18T21:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfab7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfab7fe640 10 monclient: dump: 2024-08-18T21:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:48.834 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.834 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:48.834 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:48.834 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:48.834 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:48.834 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:48.834 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:48.834 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:48.834 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:48.834 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:48.834 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfab7fe640 10 monclient: _finish_auth 0 2024-08-18T21:15:48.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfab7fe640 10 monclient: _check_auth_tickets 2024-08-18T21:15:48.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:48.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfab7fe640 1 -- 172.21.15.5:0/1099986291 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfbc003dc0 con 0x7fbfc413ede0 2024-08-18T21:15:48.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfab7fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:48.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfab7fe640 1 -- 172.21.15.5:0/1099986291 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbfbc0b6440 con 0x7fbfc413ede0 2024-08-18T21:15:48.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc9395640 5 monclient: authenticate success, global_id 115096 2024-08-18T21:15:48.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc9395640 10 monclient: _renew_subs 2024-08-18T21:15:48.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc9395640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:15:48.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc9395640 1 -- 172.21.15.5:0/1099986291 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc40ab780 con 0x7fbfc413ede0 2024-08-18T21:15:48.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc17fa640 4 set_mon_vals no callback set 2024-08-18T21:15:48.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:48.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:15:48.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfab7fe640 10 monclient: dump: 2024-08-18T21:15:48.835 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:48.835 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc9395640 10 monclient: _renew_subs 2024-08-18T21:15:48.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc9395640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:15:48.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc9395640 1 -- 172.21.15.5:0/1099986291 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc4128a40 con 0x7fbfc413ede0 2024-08-18T21:15:48.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc9395640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:15:48.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.822+0000 7fbfc9395640 1 -- 172.21.15.5:0/1099986291 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbfc40a7320 con 0x7fbfc413ede0 2024-08-18T21:15:48.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.826+0000 7fbfab7fe640 1 -- 172.21.15.5:0/1099986291 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fbfbc0b6700 con 0x7fbfc413ede0 2024-08-18T21:15:48.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.826+0000 7fbfab7fe640 1 --2- 172.21.15.5:0/1099986291 >> v2:172.21.15.157:6812/631023601 conn(0x7fbfb003bdf0 0x7fbfb003e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.826+0000 7fbfab7fe640 1 -- 172.21.15.5:0/1099986291 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(331..331 src has 300..331) ==== 3506+0+0 (secure 0 0 0) 0x7fbfbc0e8870 con 0x7fbfc413ede0 2024-08-18T21:15:48.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.826+0000 7fbfab7fe640 1 --2- 172.21.15.5:0/1099986291 >> v2:172.21.15.5:6800/3354229361 conn(0x7fbfb0041980 0x7fbfb0043da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:48.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.826+0000 7fbfab7fe640 1 -- 172.21.15.5:0/1099986291 --> v2:172.21.15.5:6800/3354229361 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbfbc0a5aa0 con 0x7fbfb0041980 2024-08-18T21:15:48.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.826+0000 7fbfab7fe640 1 -- 172.21.15.5:0/1099986291 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_get_version_reply(handle=1 version=331) ==== 24+0+0 (secure 0 0 0) 0x7fbfbc0ef050 con 0x7fbfc413ede0 2024-08-18T21:15:48.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.826+0000 7fbfab7fe640 10 monclient: handle_get_version_reply finishing 1 version 331 2024-08-18T21:15:48.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.826+0000 7fbfc27fc640 1 --2- 172.21.15.5:0/1099986291 >> v2:172.21.15.5:6800/3354229361 conn(0x7fbfb0041980 0x7fbfb0043da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.826+0000 7fbfc27fc640 10 monclient: get_auth_request con 0x7fbfb0041980 auth_method 0 2024-08-18T21:15:48.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.826+0000 7fbfc2ffd640 1 --2- 172.21.15.5:0/1099986291 >> v2:172.21.15.157:6812/631023601 conn(0x7fbfb003bdf0 0x7fbfb003e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:48.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.826+0000 7fbfc2ffd640 10 monclient: get_auth_request con 0x7fbfb003bdf0 auth_method 0 2024-08-18T21:15:48.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.826+0000 7fbfc2ffd640 1 --2- 172.21.15.5:0/1099986291 >> v2:172.21.15.157:6812/631023601 conn(0x7fbfb003bdf0 0x7fbfb003e2b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40016c0 tx=0x7fbfb4009040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:48.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.830+0000 7fbfc27fc640 1 --2- 172.21.15.5:0/1099986291 >> v2:172.21.15.5:6800/3354229361 conn(0x7fbfb0041980 0x7fbfb0043da0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:48.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.830+0000 7fbfab7fe640 1 -- 172.21.15.5:0/1099986291 <== osd.2 v2:172.21.15.5:6800/3354229361 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbfbc0a5aa0 con 0x7fbfb0041980 2024-08-18T21:15:48.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.842+0000 7fbfc9395640 1 -- 172.21.15.5:0/1099986291 --> v2:172.21.15.5:6800/3354229361 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbfc413e5f0 con 0x7fbfb0041980 2024-08-18T21:15:48.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.842+0000 7fbfab7fe640 1 -- 172.21.15.5:0/1099986291 <== osd.2 v2:172.21.15.5:6800/3354229361 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbfc413e5f0 con 0x7fbfb0041980 2024-08-18T21:15:48.843 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:48.843 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T21:15:48.843 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:48.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.846+0000 7fbfc9395640 1 -- 172.21.15.5:0/1099986291 >> v2:172.21.15.5:6800/3354229361 conn(0x7fbfb0041980 msgr2=0x7fbfb0043da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.846+0000 7fbfc9395640 1 --2- 172.21.15.5:0/1099986291 >> v2:172.21.15.5:6800/3354229361 conn(0x7fbfb0041980 0x7fbfb0043da0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.846+0000 7fbfc9395640 1 -- 172.21.15.5:0/1099986291 >> v2:172.21.15.157:6812/631023601 conn(0x7fbfb003bdf0 msgr2=0x7fbfb003e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.846+0000 7fbfc9395640 1 --2- 172.21.15.5:0/1099986291 >> v2:172.21.15.157:6812/631023601 conn(0x7fbfb003bdf0 0x7fbfb003e2b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40016c0 tx=0x7fbfb4009040 comp rx=0 tx=0).stop 2024-08-18T21:15:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.846+0000 7fbfc9395640 10 monclient: shutdown 2024-08-18T21:15:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.846+0000 7fbfc9395640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.846+0000 7fbfc9395640 1 -- 172.21.15.5:0/1099986291 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbfc413ede0 msgr2=0x7fbfc413e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.846+0000 7fbfc9395640 1 --2- 172.21.15.5:0/1099986291 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fbfc413ede0 0x7fbfc413e0b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0ab000 tx=0x7fbfbc019670 comp rx=0 tx=0).stop 2024-08-18T21:15:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.846+0000 7fbfc37fe640 1 -- 172.21.15.5:0/1099986291 reap_dead start 2024-08-18T21:15:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.846+0000 7fbfc9395640 1 -- 172.21.15.5:0/1099986291 shutdown_connections 2024-08-18T21:15:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.846+0000 7fbfc9395640 1 -- 172.21.15.5:0/1099986291 >> 172.21.15.5:0/1099986291 conn(0x7fbfc40ac920 msgr2=0x7fbfc40a20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.846+0000 7fbfc9395640 1 -- 172.21.15.5:0/1099986291 shutdown_connections 2024-08-18T21:15:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:48.846+0000 7fbfc9395640 1 -- 172.21.15.5:0/1099986291 wait complete. 2024-08-18T21:15:48.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-18T21:15:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 10 monclient: get_monmap_and_config 2024-08-18T21:15:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 10 monclient: build_initial_monmap 2024-08-18T21:15:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 10 monclient: monmap: 2024-08-18T21:15:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:49.033537+0000 2024-08-18T21:15:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:49.033537+0000 2024-08-18T21:15:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:49.029 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 1 Processor -- start 2024-08-18T21:15:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 1 -- start start 2024-08-18T21:15:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 10 monclient: init 2024-08-18T21:15:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 10 monclient: _add_conns ranks=[8,10,0,7,9,6,5,2,4,1,3] 2024-08-18T21:15:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6f700a6ce0 0x7f6f700a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 10 monclient(hunting): picked mon.noname-e con 0x7f6f700a6ce0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6f700a7600 0x7f6f70139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 10 monclient(hunting): picked mon.noname-f con 0x7f6f700a7600 addr v2:172.21.15.157:3300/0 2024-08-18T21:15:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6f70139fe0 addr v1:172.21.15.5:6789/0 2024-08-18T21:15:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f700a45d0 con 0x7f6f70139fe0 2024-08-18T21:15:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f6f700a5000 con 0x7f6f700a7600 2024-08-18T21:15:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f6f700a4360 con 0x7f6f700a6ce0 2024-08-18T21:15:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f75d0f640 10 monclient(hunting): authenticate will time out at 1716.046875s 2024-08-18T21:15:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6f700a6ce0 0x7f6f700a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6f700a6ce0 0x7f6f700a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:53954/0 (socket says 172.21.15.5:53954) 2024-08-18T21:15:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 1 -- 172.21.15.5:0/1076518616 learned_addr learned my addr 172.21.15.5:0/1076518616 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 10 monclient(hunting): get_auth_request con 0x7f6f700a6ce0 auth_method 0 2024-08-18T21:15:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6effd640 1 --2- 172.21.15.5:0/1076518616 >> v2:172.21.15.157:3300/0 conn(0x7f6f700a7600 0x7f6f70139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 10 monclient(hunting): handle_auth_done global_id 115388 payload 274 2024-08-18T21:15:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 1 -- 172.21.15.5:0/1076518616 >> v2:172.21.15.157:3300/0 conn(0x7f6f700a7600 msgr2=0x7f6f70139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 1 --2- 172.21.15.5:0/1076518616 >> v2:172.21.15.157:3300/0 conn(0x7f6f700a7600 0x7f6f70139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 1 -- 172.21.15.5:0/1076518616 >> v1:172.21.15.5:6789/0 conn(0x7f6f70139fe0 legacy=0x7f6f70140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:15:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 1 monclient: found mon.noname-e 2024-08-18T21:15:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:15:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6f7fe640 1 -- 172.21.15.5:0/1076518616 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f700a8900 con 0x7f6f700a6ce0 2024-08-18T21:15:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6effd640 10 monclient: get_auth_request con 0x7f6f700a7600 auth_method 0 2024-08-18T21:15:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.030+0000 7f6f6effd640 1 --2- 172.21.15.5:0/1076518616 >> v2:172.21.15.157:3300/0 conn(0x7f6f700a7600 0x7f6f70139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:15:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f6f7fe640 1 -- 172.21.15.5:0/1076518616 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6f700a6ce0 msgr2=0x7f6f700a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f6f7fe640 1 --2- 172.21.15.5:0/1076518616 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6f700a6ce0 0x7f6f700a70c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009870 tx=0x7f6f6401c420 comp rx=0 tx=0).ready entity=mon.8 client_cookie=a3b0c3e04556f3d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f6e7fc640 1 -- 172.21.15.5:0/1076518616 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6f640b1070 con 0x7f6f700a6ce0 2024-08-18T21:15:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f6e7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:15:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f6e7fc640 10 monclient: dump: 2024-08-18T21:15:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:49.041 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f6e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:15:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f6e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:15:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f6e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f6e7fc640 1 -- 172.21.15.5:0/1076518616 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f640ab830 con 0x7f6f700a6ce0 2024-08-18T21:15:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f75d0f640 5 monclient: authenticate success, global_id 115388 2024-08-18T21:15:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f75d0f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:15:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f6e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f75d0f640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f6e7fc640 1 -- 172.21.15.5:0/1076518616 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6f640aa400 con 0x7f6f700a6ce0 2024-08-18T21:15:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f75d0f640 4 set_mon_vals no callback set 2024-08-18T21:15:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f6e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:15:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.034+0000 7f6f6e7fc640 10 monclient: dump: 2024-08-18T21:15:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:49.043 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 10 monclient: shutdown 2024-08-18T21:15:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 1 -- 172.21.15.5:0/1076518616 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6f700a6ce0 msgr2=0x7f6f700a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 1 --2- 172.21.15.5:0/1076518616 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6f700a6ce0 0x7f6f700a70c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009870 tx=0x7f6f6401c420 comp rx=0 tx=0).stop 2024-08-18T21:15:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 1 -- 172.21.15.5:0/1076518616 shutdown_connections 2024-08-18T21:15:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 1 --2- 172.21.15.5:0/1076518616 >> v2:172.21.15.157:3300/0 conn(0x7f6f700a7600 0x7f6f70139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 1 --2- 172.21.15.5:0/1076518616 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6f700a6ce0 0x7f6f700a70c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 1 -- 172.21.15.5:0/1076518616 >> 172.21.15.5:0/1076518616 conn(0x7f6f700acbc0 msgr2=0x7f6f700a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 1 -- 172.21.15.5:0/1076518616 shutdown_connections 2024-08-18T21:15:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 1 -- 172.21.15.5:0/1076518616 wait complete. 2024-08-18T21:15:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 10 monclient: build_initial_monmap 2024-08-18T21:15:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 10 monclient: monmap: 2024-08-18T21:15:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:49.045 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:49.045 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:49.045 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:49.045 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:49.045 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:49.045 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:49.045 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:49.045 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:49.045 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 1 Processor -- start 2024-08-18T21:15:49.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 1 -- start start 2024-08-18T21:15:49.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 10 monclient: init 2024-08-18T21:15:49.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:49.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 10 monclient: _add_conns ranks=[2,7,8,3,1,5,0,4,6] 2024-08-18T21:15:49.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6f700a6ce0 0x7f6f7013b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 10 monclient(hunting): picked mon.noname-b con 0x7f6f700a6ce0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:49.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6f700a7600 0x7f6f7013baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 10 monclient(hunting): picked mon.noname-i con 0x7f6f700a7600 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:15:49.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6f70139fe0 0x7f6f7013bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 10 monclient(hunting): picked mon.noname-e con 0x7f6f70139fe0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:49.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f6f700a79e0 con 0x7f6f700a6ce0 2024-08-18T21:15:49.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f6f700a9810 con 0x7f6f700a7600 2024-08-18T21:15:49.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f6f70142130 con 0x7f6f70139fe0 2024-08-18T21:15:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f75d0f640 10 monclient(hunting): authenticate will time out at 1716.054265s 2024-08-18T21:15:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6f700a6ce0 0x7f6f7013b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6f700a6ce0 0x7f6f7013b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33878/0 (socket says 172.21.15.5:33878) 2024-08-18T21:15:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 1 -- 172.21.15.5:0/4157584035 learned_addr learned my addr 172.21.15.5:0/4157584035 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 10 monclient(hunting): get_auth_request con 0x7f6f700a6ce0 auth_method 0 2024-08-18T21:15:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6ffff640 1 --2- 172.21.15.5:0/4157584035 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6f70139fe0 0x7f6f7013bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6effd640 1 --2- 172.21.15.5:0/4157584035 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6f700a7600 0x7f6f7013baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6ffff640 10 monclient(hunting): get_auth_request con 0x7f6f70139fe0 auth_method 0 2024-08-18T21:15:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6effd640 10 monclient(hunting): get_auth_request con 0x7f6f700a7600 auth_method 0 2024-08-18T21:15:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 10 monclient(hunting): handle_auth_done global_id 115256 payload 824 2024-08-18T21:15:49.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 1 -- 172.21.15.5:0/4157584035 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6f70139fe0 msgr2=0x7f6f7013bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 1 --2- 172.21.15.5:0/4157584035 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6f70139fe0 0x7f6f7013bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 1 -- 172.21.15.5:0/4157584035 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6f700a7600 msgr2=0x7f6f7013baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 1 --2- 172.21.15.5:0/4157584035 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6f700a7600 0x7f6f7013baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:15:49.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 1 monclient: found mon.noname-b 2024-08-18T21:15:49.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:49.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:49.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6f7fe640 1 -- 172.21.15.5:0/4157584035 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7013f050 con 0x7f6f700a6ce0 2024-08-18T21:15:49.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.038+0000 7f6f6effd640 1 --2- 172.21.15.5:0/4157584035 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6f700a7600 0x7f6f7013baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:15:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f6f7fe640 1 -- 172.21.15.5:0/4157584035 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6f700a6ce0 msgr2=0x7f6f7013b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f6f7fe640 1 --2- 172.21.15.5:0/4157584035 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6f700a6ce0 0x7f6f7013b560 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6f640af040 tx=0x7f6f640191c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f57fff640 1 -- 172.21.15.5:0/4157584035 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6f640ba070 con 0x7f6f700a6ce0 2024-08-18T21:15:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f57fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f57fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f57fff640 10 monclient: dump: 2024-08-18T21:15:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:49.053 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f57fff640 10 monclient: _finish_auth 0 2024-08-18T21:15:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f57fff640 10 monclient: _check_auth_tickets 2024-08-18T21:15:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f57fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f57fff640 1 -- 172.21.15.5:0/4157584035 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f640044b0 con 0x7f6f700a6ce0 2024-08-18T21:15:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f75d0f640 5 monclient: authenticate success, global_id 115256 2024-08-18T21:15:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f75d0f640 10 monclient: _renew_subs 2024-08-18T21:15:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f75d0f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f75d0f640 1 -- 172.21.15.5:0/4157584035 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f7013f330 con 0x7f6f700a6ce0 2024-08-18T21:15:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f57fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f57fff640 1 -- 172.21.15.5:0/4157584035 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6f640b1040 con 0x7f6f700a6ce0 2024-08-18T21:15:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f57fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f57fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f6d7fa640 4 set_mon_vals no callback set 2024-08-18T21:15:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f57fff640 10 monclient: dump: 2024-08-18T21:15:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:49.055 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:49.055 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:49.055 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:49.055 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:49.055 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:49.055 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f75d0f640 10 monclient: _renew_subs 2024-08-18T21:15:49.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f75d0f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:49.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f75d0f640 1 -- 172.21.15.5:0/4157584035 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f700aae10 con 0x7f6f700a6ce0 2024-08-18T21:15:49.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f75d0f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:49.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f75d0f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:49.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f75d0f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:49.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f75d0f640 1 -- 172.21.15.5:0/4157584035 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f700aa8c0 con 0x7f6f700a6ce0 2024-08-18T21:15:49.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f57fff640 1 -- 172.21.15.5:0/4157584035 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f6f64004040 con 0x7f6f700a6ce0 2024-08-18T21:15:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f57fff640 1 --2- 172.21.15.5:0/4157584035 >> v2:172.21.15.157:6812/631023601 conn(0x7f6f5c03bde0 0x7f6f5c03e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f57fff640 1 -- 172.21.15.5:0/4157584035 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(331..331 src has 300..331) ==== 3506+0+0 (secure 0 0 0) 0x7f6f640e7880 con 0x7f6f700a6ce0 2024-08-18T21:15:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f6effd640 1 --2- 172.21.15.5:0/4157584035 >> v2:172.21.15.157:6812/631023601 conn(0x7f6f5c03bde0 0x7f6f5c03e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.042+0000 7f6f6effd640 10 monclient: get_auth_request con 0x7f6f5c03bde0 auth_method 0 2024-08-18T21:15:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.046+0000 7f6f6effd640 1 --2- 172.21.15.5:0/4157584035 >> v2:172.21.15.157:6812/631023601 conn(0x7f6f5c03bde0 0x7f6f5c03e2a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6f60006fd0 tx=0x7f6f60008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.046+0000 7f6f57fff640 1 -- 172.21.15.5:0/4157584035 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f6f64016130 con 0x7f6f700a6ce0 2024-08-18T21:15:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.046+0000 7f6f57fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.046+0000 7f6f57fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:49.062 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.062 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=880627120}) 2024-08-18T21:15:49.062 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=639046577}) 2024-08-18T21:15:49.062 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.062 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=880627120}) 2024-08-18T21:15:49.062 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=415920032}) 2024-08-18T21:15:49.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=880627120}) 2024-08-18T21:15:49.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3076816975}) 2024-08-18T21:15:49.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=880627120}) 2024-08-18T21:15:49.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1870099856}) 2024-08-18T21:15:49.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=880627120}) 2024-08-18T21:15:49.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4037807952}) 2024-08-18T21:15:49.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=880627120}) 2024-08-18T21:15:49.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=424508765}) 2024-08-18T21:15:49.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.063 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=880627120}) 2024-08-18T21:15:49.064 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2864509473}) 2024-08-18T21:15:49.064 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.064 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=880627120}) 2024-08-18T21:15:49.064 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.054+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1911953028}) 2024-08-18T21:15:49.064 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.064 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1861112904}) 2024-08-18T21:15:49.064 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=282170871}) 2024-08-18T21:15:49.064 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.064 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1861112904}) 2024-08-18T21:15:49.064 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1286714146}) 2024-08-18T21:15:49.064 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.064 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1861112904}) 2024-08-18T21:15:49.064 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4088840086}) 2024-08-18T21:15:49.065 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.065 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1861112904}) 2024-08-18T21:15:49.065 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3739825403}) 2024-08-18T21:15:49.065 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.065 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1861112904}) 2024-08-18T21:15:49.065 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3107923697}) 2024-08-18T21:15:49.065 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.065 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1861112904}) 2024-08-18T21:15:49.065 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=479777482}) 2024-08-18T21:15:49.065 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.065 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1861112904}) 2024-08-18T21:15:49.065 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=369654293}) 2024-08-18T21:15:49.065 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.065 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1861112904}) 2024-08-18T21:15:49.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1005315046}) 2024-08-18T21:15:49.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=517564150}) 2024-08-18T21:15:49.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3480398124}) 2024-08-18T21:15:49.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=517564150}) 2024-08-18T21:15:49.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3416826456}) 2024-08-18T21:15:49.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=517564150}) 2024-08-18T21:15:49.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1819295433}) 2024-08-18T21:15:49.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=517564150}) 2024-08-18T21:15:49.066 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=521679990}) 2024-08-18T21:15:49.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=517564150}) 2024-08-18T21:15:49.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2197768271}) 2024-08-18T21:15:49.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=517564150}) 2024-08-18T21:15:49.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=991134160}) 2024-08-18T21:15:49.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=517564150}) 2024-08-18T21:15:49.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2882027537}) 2024-08-18T21:15:49.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=517564150}) 2024-08-18T21:15:49.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.058+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1885128191}) 2024-08-18T21:15:49.067 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2129933624}) 2024-08-18T21:15:49.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=248731366}) 2024-08-18T21:15:49.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2129933624}) 2024-08-18T21:15:49.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=884135431}) 2024-08-18T21:15:49.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2129933624}) 2024-08-18T21:15:49.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2435897251}) 2024-08-18T21:15:49.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2129933624}) 2024-08-18T21:15:49.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3921801216}) 2024-08-18T21:15:49.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.068 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2129933624}) 2024-08-18T21:15:49.069 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2447225800}) 2024-08-18T21:15:49.069 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.069 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2129933624}) 2024-08-18T21:15:49.069 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1959601726}) 2024-08-18T21:15:49.069 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.069 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2129933624}) 2024-08-18T21:15:49.069 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3589543189}) 2024-08-18T21:15:49.069 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.069 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2129933624}) 2024-08-18T21:15:49.069 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.062+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1496975068}) 2024-08-18T21:15:49.073 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.073 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=247466715}) 2024-08-18T21:15:49.073 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=374759072}) 2024-08-18T21:15:49.073 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.073 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=247466715}) 2024-08-18T21:15:49.073 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2054929940}) 2024-08-18T21:15:49.074 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.074 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=247466715}) 2024-08-18T21:15:49.074 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2251017196}) 2024-08-18T21:15:49.074 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.074 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=247466715}) 2024-08-18T21:15:49.074 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1096315713}) 2024-08-18T21:15:49.074 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.074 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=247466715}) 2024-08-18T21:15:49.074 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=239150867}) 2024-08-18T21:15:49.074 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.074 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=247466715}) 2024-08-18T21:15:49.074 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2010213222}) 2024-08-18T21:15:49.074 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=247466715}) 2024-08-18T21:15:49.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=471434024}) 2024-08-18T21:15:49.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=247466715}) 2024-08-18T21:15:49.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.066+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1412614452}) 2024-08-18T21:15:49.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=805305509}) 2024-08-18T21:15:49.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3331948163}) 2024-08-18T21:15:49.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=805305509}) 2024-08-18T21:15:49.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3376441498}) 2024-08-18T21:15:49.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.075 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=805305509}) 2024-08-18T21:15:49.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=763271303}) 2024-08-18T21:15:49.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=805305509}) 2024-08-18T21:15:49.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3627223822}) 2024-08-18T21:15:49.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=805305509}) 2024-08-18T21:15:49.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2926505004}) 2024-08-18T21:15:49.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=805305509}) 2024-08-18T21:15:49.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3824095742}) 2024-08-18T21:15:49.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=805305509}) 2024-08-18T21:15:49.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=275031726}) 2024-08-18T21:15:49.076 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.077 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=805305509}) 2024-08-18T21:15:49.077 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.070+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=604259241}) 2024-08-18T21:15:49.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.226+0000 7f6f75d0f640 1 -- 172.21.15.5:0/4157584035 --> v2:172.21.15.157:6812/631023601 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f6f700a8220 con 0x7f6f5c03bde0 2024-08-18T21:15:49.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.226+0000 7f6f57fff640 1 -- 172.21.15.5:0/4157584035 <== mgr.4130 v2:172.21.15.157:6812/631023601 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6f700a8220 con 0x7f6f5c03bde0 2024-08-18T21:15:49.225 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 2 to deep-scrub 2024-08-18T21:15:49.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.230+0000 7f6f75d0f640 1 -- 172.21.15.5:0/4157584035 >> v2:172.21.15.157:6812/631023601 conn(0x7f6f5c03bde0 msgr2=0x7f6f5c03e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.230+0000 7f6f75d0f640 1 --2- 172.21.15.5:0/4157584035 >> v2:172.21.15.157:6812/631023601 conn(0x7f6f5c03bde0 0x7f6f5c03e2a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6f60006fd0 tx=0x7f6f60008040 comp rx=0 tx=0).stop 2024-08-18T21:15:49.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.230+0000 7f6f75d0f640 10 monclient: shutdown 2024-08-18T21:15:49.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.230+0000 7f6f75d0f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:49.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.230+0000 7f6f75d0f640 1 -- 172.21.15.5:0/4157584035 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6f700a6ce0 msgr2=0x7f6f7013b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.230+0000 7f6f75d0f640 1 --2- 172.21.15.5:0/4157584035 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6f700a6ce0 0x7f6f7013b560 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6f640af040 tx=0x7f6f640191c0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.230+0000 7f6f75d0f640 1 -- 172.21.15.5:0/4157584035 shutdown_connections 2024-08-18T21:15:49.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.230+0000 7f6f75d0f640 1 --2- 172.21.15.5:0/4157584035 >> v2:172.21.15.157:6812/631023601 conn(0x7f6f5c03bde0 0x7f6f5c03e2a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.230+0000 7f6f75d0f640 1 --2- 172.21.15.5:0/4157584035 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6f70139fe0 0x7f6f7013bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.230+0000 7f6f75d0f640 1 --2- 172.21.15.5:0/4157584035 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f6f700a7600 0x7f6f7013baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.230+0000 7f6f75d0f640 1 --2- 172.21.15.5:0/4157584035 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6f700a6ce0 0x7f6f7013b560 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.230+0000 7f6f75d0f640 1 -- 172.21.15.5:0/4157584035 >> 172.21.15.5:0/4157584035 conn(0x7f6f700acbc0 msgr2=0x7f6f7009de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:49.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.230+0000 7f6f75d0f640 1 -- 172.21.15.5:0/4157584035 shutdown_connections 2024-08-18T21:15:49.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.230+0000 7f6f75d0f640 1 -- 172.21.15.5:0/4157584035 wait complete. 2024-08-18T21:15:49.245 INFO:tasks.ceph:Scrubbing osd.3 2024-08-18T21:15:49.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-18T21:15:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.378+0000 7f223f45f640 10 monclient: get_monmap_and_config 2024-08-18T21:15:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.378+0000 7f223f45f640 10 monclient: build_initial_monmap 2024-08-18T21:15:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.378+0000 7f223f45f640 10 monclient: monmap: 2024-08-18T21:15:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:49.384259+0000 2024-08-18T21:15:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:49.384259+0000 2024-08-18T21:15:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:49.381 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 1 Processor -- start 2024-08-18T21:15:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 1 -- start start 2024-08-18T21:15:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 10 monclient: init 2024-08-18T21:15:49.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3609835643}) 2024-08-18T21:15:49.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2660170209}) 2024-08-18T21:15:49.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3609835643}) 2024-08-18T21:15:49.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=943063627}) 2024-08-18T21:15:49.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3609835643}) 2024-08-18T21:15:49.383 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3392301849}) 2024-08-18T21:15:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:49.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.384 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3609835643}) 2024-08-18T21:15:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 10 monclient: _add_conns ranks=[0,9,5,4,3,10,7,8,2,1,6] 2024-08-18T21:15:49.385 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=198551672}) 2024-08-18T21:15:49.385 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.385 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3609835643}) 2024-08-18T21:15:49.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f22380a6b60 addr v1:172.21.15.5:6789/0 2024-08-18T21:15:49.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22380a6f40 0x7f22380a7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.385 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1290840478}) 2024-08-18T21:15:49.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 10 monclient(hunting): picked mon.noname-a con 0x7f22380a6f40 addr v2:172.21.15.5:3300/0 2024-08-18T21:15:49.386 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.386 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3609835643}) 2024-08-18T21:15:49.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f223813ede0 0x7f22381411d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 10 monclient(hunting): picked mon.noname-h con 0x7f223813ede0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:49.387 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=977630017}) 2024-08-18T21:15:49.387 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.387 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3609835643}) 2024-08-18T21:15:49.387 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1766056604}) 2024-08-18T21:15:49.387 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.387 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3609835643}) 2024-08-18T21:15:49.387 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.382+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=272042291}) 2024-08-18T21:15:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223d1fb640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f22380a6b60 0x7f223809eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36174/0 (socket says 172.21.15.5:36174) 2024-08-18T21:15:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223d1fb640 1 -- 172.21.15.5:0/821668537 learned_addr learned my addr 172.21.15.5:0/821668537 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:15:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 1 -- 172.21.15.5:0/821668537 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22380a99e0 con 0x7f22380a6b60 2024-08-18T21:15:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 1 --2- 172.21.15.5:0/821668537 >> v2:172.21.15.5:3300/0 conn(0x7f22380a6f40 0x7f22380a7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 1 -- 172.21.15.5:0/821668537 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f223809e410 con 0x7f22380a6f40 2024-08-18T21:15:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 1 -- 172.21.15.5:0/821668537 --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f22380a7ed0 con 0x7f223813ede0 2024-08-18T21:15:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223f45f640 10 monclient(hunting): authenticate will time out at 1716.397952s 2024-08-18T21:15:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 10 monclient(hunting): get_auth_request con 0x7f22380a6f40 auth_method 0 2024-08-18T21:15:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223d9fc640 1 --2- 172.21.15.5:0/821668537 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f223813ede0 0x7f22381411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223d9fc640 10 monclient(hunting): get_auth_request con 0x7f223813ede0 auth_method 0 2024-08-18T21:15:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223d9fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223d9fc640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223d9fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223d9fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223d9fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223d9fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 10 monclient(hunting): handle_auth_done global_id 124929 payload 274 2024-08-18T21:15:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 1 -- 172.21.15.5:0/821668537 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f223813ede0 msgr2=0x7f22381411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 1 --2- 172.21.15.5:0/821668537 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f223813ede0 0x7f22381411d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 1 -- 172.21.15.5:0/821668537 >> v1:172.21.15.5:6789/0 conn(0x7f22380a6b60 legacy=0x7f223809eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 10 monclient: _finish_hunting 0 2024-08-18T21:15:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 1 monclient: found mon.noname-a 2024-08-18T21:15:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:15:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.382+0000 7f223c9fa640 1 -- 172.21.15.5:0/821668537 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22380a7c50 con 0x7f22380a6f40 2024-08-18T21:15:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.386+0000 7f223c9fa640 1 -- 172.21.15.5:0/821668537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22380a6f40 msgr2=0x7f22380a7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.386+0000 7f223c9fa640 1 --2- 172.21.15.5:0/821668537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22380a6f40 0x7f22380a7350 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f22280097f0 tx=0x7f222801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12c86b59fd1279a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f222ffff640 1 -- 172.21.15.5:0/821668537 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f22280b0070 con 0x7f22380a6f40 2024-08-18T21:15:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f222ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f222ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:15:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f222ffff640 10 monclient: dump: 2024-08-18T21:15:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:49.394 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f222ffff640 10 monclient: _finish_auth 0 2024-08-18T21:15:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f222ffff640 10 monclient: _check_auth_tickets 2024-08-18T21:15:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f222ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f222ffff640 1 -- 172.21.15.5:0/821668537 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22280aa810 con 0x7f22380a6f40 2024-08-18T21:15:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 5 monclient: authenticate success, global_id 124929 2024-08-18T21:15:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:15:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f222ffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 4 set_mon_vals no callback set 2024-08-18T21:15:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f222ffff640 1 -- 172.21.15.5:0/821668537 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f22280aae30 con 0x7f22380a6f40 2024-08-18T21:15:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f222ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f222ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:15:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f222ffff640 10 monclient: dump: 2024-08-18T21:15:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:49.396 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.397 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.397 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=458573821}) 2024-08-18T21:15:49.397 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3452705966}) 2024-08-18T21:15:49.397 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.397 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=458573821}) 2024-08-18T21:15:49.397 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3297775554}) 2024-08-18T21:15:49.398 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.398 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=458573821}) 2024-08-18T21:15:49.398 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=525514955}) 2024-08-18T21:15:49.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 10 monclient: shutdown 2024-08-18T21:15:49.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:49.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 1 -- 172.21.15.5:0/821668537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22380a6f40 msgr2=0x7f22380a7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.399 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 1 --2- 172.21.15.5:0/821668537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22380a6f40 0x7f22380a7350 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f22280097f0 tx=0x7f222801c360 comp rx=0 tx=0).stop 2024-08-18T21:15:49.400 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=458573821}) 2024-08-18T21:15:49.400 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3719866752}) 2024-08-18T21:15:49.400 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.400 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=458573821}) 2024-08-18T21:15:49.400 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2089888710}) 2024-08-18T21:15:49.400 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.400 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=458573821}) 2024-08-18T21:15:49.400 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2568847069}) 2024-08-18T21:15:49.401 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 1 -- 172.21.15.5:0/821668537 shutdown_connections 2024-08-18T21:15:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 1 --2- 172.21.15.5:0/821668537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22380a6f40 0x7f22380a7350 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 1 --2- 172.21.15.5:0/821668537 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f223813ede0 0x7f22381411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 1 -- 172.21.15.5:0/821668537 >> 172.21.15.5:0/821668537 conn(0x7f22380ac920 msgr2=0x7f22380a8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:49.402 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=458573821}) 2024-08-18T21:15:49.402 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1007358144}) 2024-08-18T21:15:49.402 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 1 -- 172.21.15.5:0/821668537 shutdown_connections 2024-08-18T21:15:49.402 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=458573821}) 2024-08-18T21:15:49.402 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.394+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4125852511}) 2024-08-18T21:15:49.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 1 -- 172.21.15.5:0/821668537 wait complete. 2024-08-18T21:15:49.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 10 monclient: build_initial_monmap 2024-08-18T21:15:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 10 monclient: monmap: 2024-08-18T21:15:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:49.409 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 1 Processor -- start 2024-08-18T21:15:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 1 -- start start 2024-08-18T21:15:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.394+0000 7f223f45f640 10 monclient: init 2024-08-18T21:15:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 10 monclient: _add_conns ranks=[2,7,3,6,8,1,4,5,0] 2024-08-18T21:15:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f22380a6b60 0x7f2238126ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 10 monclient(hunting): picked mon.noname-b con 0x7f22380a6b60 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f22380a6f40 0x7f223813dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 10 monclient(hunting): picked mon.noname-i con 0x7f22380a6f40 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:15:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f223813ede0 0x7f2238124960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 10 monclient(hunting): picked mon.noname-g con 0x7f223813ede0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f22381442c0 con 0x7f22380a6b60 2024-08-18T21:15:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2238144140 con 0x7f223813ede0 2024-08-18T21:15:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f2238144440 con 0x7f22380a6f40 2024-08-18T21:15:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 10 monclient(hunting): authenticate will time out at 1716.412297s 2024-08-18T21:15:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f22380a6b60 0x7f2238126ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f22380a6b60 0x7f2238126ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33890/0 (socket says 172.21.15.5:33890) 2024-08-18T21:15:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 1 -- 172.21.15.5:0/2291896408 learned_addr learned my addr 172.21.15.5:0/2291896408 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 10 monclient(hunting): get_auth_request con 0x7f22380a6b60 auth_method 0 2024-08-18T21:15:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d9fc640 1 --2- 172.21.15.5:0/2291896408 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f223813ede0 0x7f2238124960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 10 monclient(hunting): handle_auth_done global_id 115265 payload 824 2024-08-18T21:15:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 1 -- 172.21.15.5:0/2291896408 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f22380a6f40 msgr2=0x7f223813dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 1 --2- 172.21.15.5:0/2291896408 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f22380a6f40 0x7f223813dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 1 -- 172.21.15.5:0/2291896408 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f223813ede0 msgr2=0x7f2238124960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 1 --2- 172.21.15.5:0/2291896408 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f223813ede0 0x7f2238124960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 10 monclient: _finish_hunting 0 2024-08-18T21:15:49.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 1 monclient: found mon.noname-b 2024-08-18T21:15:49.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:49.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:49.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 1 -- 172.21.15.5:0/2291896408 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22381286e0 con 0x7f22380a6b60 2024-08-18T21:15:49.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d9fc640 10 monclient: get_auth_request con 0x7f223813ede0 auth_method 0 2024-08-18T21:15:49.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d9fc640 1 --2- 172.21.15.5:0/2291896408 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f223813ede0 0x7f2238124960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:15:49.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 1 -- 172.21.15.5:0/2291896408 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f22380a6b60 msgr2=0x7f2238126ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:49.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223d1fb640 1 --2- 172.21.15.5:0/2291896408 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f22380a6b60 0x7f2238126ee0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f223400c3f0 tx=0x7f223400c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:49.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f222dffb640 1 -- 172.21.15.5:0/2291896408 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2234017070 con 0x7f22380a6b60 2024-08-18T21:15:49.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f222dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:49.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f222dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:49.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f222dffb640 10 monclient: dump: 2024-08-18T21:15:49.413 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:49.413 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.413 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.413 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.413 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:49.413 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.413 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:49.413 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:49.413 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:49.413 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:49.414 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:49.414 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:49.414 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:49.414 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:49.414 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:49.414 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f222dffb640 10 monclient: _finish_auth 0 2024-08-18T21:15:49.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f222dffb640 10 monclient: _check_auth_tickets 2024-08-18T21:15:49.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f222dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:49.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f222dffb640 1 -- 172.21.15.5:0/2291896408 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2234005d00 con 0x7f22380a6b60 2024-08-18T21:15:49.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 5 monclient: authenticate success, global_id 115265 2024-08-18T21:15:49.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 10 monclient: _renew_subs 2024-08-18T21:15:49.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:49.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 1 -- 172.21.15.5:0/2291896408 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2238126380 con 0x7f22380a6b60 2024-08-18T21:15:49.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f222dffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:49.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f222dffb640 1 -- 172.21.15.5:0/2291896408 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2234007540 con 0x7f22380a6b60 2024-08-18T21:15:49.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f222dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:49.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f222dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:49.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f222dffb640 10 monclient: dump: 2024-08-18T21:15:49.415 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:49.415 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.415 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.415 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.415 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:49.415 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.415 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:49.416 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:49.416 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:49.416 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:49.416 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:49.416 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:49.416 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:49.416 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:49.416 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:49.416 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f222f7fe640 4 set_mon_vals no callback set 2024-08-18T21:15:49.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 10 monclient: _renew_subs 2024-08-18T21:15:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.398+0000 7f223f45f640 1 -- 172.21.15.5:0/2291896408 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f22380abd50 con 0x7f22380a6b60 2024-08-18T21:15:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.402+0000 7f223f45f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.402+0000 7f223f45f640 1 -- 172.21.15.5:0/2291896408 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f22380a7350 con 0x7f22380a6b60 2024-08-18T21:15:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.402+0000 7f222dffb640 1 -- 172.21.15.5:0/2291896408 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f2234007070 con 0x7f22380a6b60 2024-08-18T21:15:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.402+0000 7f222dffb640 1 --2- 172.21.15.5:0/2291896408 >> v2:172.21.15.157:6812/631023601 conn(0x7f221c03bdc0 0x7f221c03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.402+0000 7f222dffb640 1 -- 172.21.15.5:0/2291896408 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(331..331 src has 300..331) ==== 3506+0+0 (secure 0 0 0) 0x7f223404da70 con 0x7f22380a6b60 2024-08-18T21:15:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.402+0000 7f222dffb640 1 --2- 172.21.15.5:0/2291896408 >> v2:172.21.15.157:6804/1750098759 conn(0x7f221c041860 0x7f221c043c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.402+0000 7f222dffb640 1 -- 172.21.15.5:0/2291896408 --> v2:172.21.15.157:6804/1750098759 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f221c0442f0 con 0x7f221c041860 2024-08-18T21:15:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.402+0000 7f223c9fa640 1 --2- 172.21.15.5:0/2291896408 >> v2:172.21.15.157:6812/631023601 conn(0x7f221c03bdc0 0x7f221c03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.402+0000 7f223d9fc640 1 --2- 172.21.15.5:0/2291896408 >> v2:172.21.15.157:6804/1750098759 conn(0x7f221c041860 0x7f221c043c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.402+0000 7f223c9fa640 10 monclient: get_auth_request con 0x7f221c03bdc0 auth_method 0 2024-08-18T21:15:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.402+0000 7f223d9fc640 10 monclient: get_auth_request con 0x7f221c041860 auth_method 0 2024-08-18T21:15:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.406+0000 7f223c9fa640 1 --2- 172.21.15.5:0/2291896408 >> v2:172.21.15.157:6812/631023601 conn(0x7f221c03bdc0 0x7f221c03e280 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f22280ab000 tx=0x7f2228004740 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.406+0000 7f223d9fc640 1 --2- 172.21.15.5:0/2291896408 >> v2:172.21.15.157:6804/1750098759 conn(0x7f221c041860 0x7f221c043c80 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.410+0000 7f222dffb640 1 -- 172.21.15.5:0/2291896408 <== osd.3 v2:172.21.15.157:6804/1750098759 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f221c0442f0 con 0x7f221c041860 2024-08-18T21:15:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.430+0000 7f222dffb640 1 -- 172.21.15.5:0/2291896408 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_get_version_reply(handle=1 version=331) ==== 24+0+0 (secure 0 0 0) 0x7f223400e460 con 0x7f22380a6b60 2024-08-18T21:15:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.430+0000 7f222dffb640 10 monclient: handle_get_version_reply finishing 1 version 331 2024-08-18T21:15:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.434+0000 7f223f45f640 1 -- 172.21.15.5:0/2291896408 --> v2:172.21.15.157:6804/1750098759 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f223813e9f0 con 0x7f221c041860 2024-08-18T21:15:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.434+0000 7f222dffb640 1 -- 172.21.15.5:0/2291896408 <== osd.3 v2:172.21.15.157:6804/1750098759 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f223813e9f0 con 0x7f221c041860 2024-08-18T21:15:49.432 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:49.432 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T21:15:49.432 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.434+0000 7f223f45f640 1 -- 172.21.15.5:0/2291896408 >> v2:172.21.15.157:6804/1750098759 conn(0x7f221c041860 msgr2=0x7f221c043c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.434+0000 7f223f45f640 1 --2- 172.21.15.5:0/2291896408 >> v2:172.21.15.157:6804/1750098759 conn(0x7f221c041860 0x7f221c043c80 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.434+0000 7f223f45f640 1 -- 172.21.15.5:0/2291896408 >> v2:172.21.15.157:6812/631023601 conn(0x7f221c03bdc0 msgr2=0x7f221c03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.434+0000 7f223f45f640 1 --2- 172.21.15.5:0/2291896408 >> v2:172.21.15.157:6812/631023601 conn(0x7f221c03bdc0 0x7f221c03e280 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f22280ab000 tx=0x7f2228004740 comp rx=0 tx=0).stop 2024-08-18T21:15:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.434+0000 7f223f45f640 10 monclient: shutdown 2024-08-18T21:15:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.434+0000 7f223f45f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.434+0000 7f223f45f640 1 -- 172.21.15.5:0/2291896408 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f22380a6b60 msgr2=0x7f2238126ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.434+0000 7f223f45f640 1 --2- 172.21.15.5:0/2291896408 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f22380a6b60 0x7f2238126ee0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f223400c3f0 tx=0x7f223400c8b0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.434+0000 7f223d9fc640 1 -- 172.21.15.5:0/2291896408 reap_dead start 2024-08-18T21:15:49.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.434+0000 7f223f45f640 1 -- 172.21.15.5:0/2291896408 shutdown_connections 2024-08-18T21:15:49.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.434+0000 7f223f45f640 1 -- 172.21.15.5:0/2291896408 >> 172.21.15.5:0/2291896408 conn(0x7f22380ac920 msgr2=0x7f2238140b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:49.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.434+0000 7f223f45f640 1 -- 172.21.15.5:0/2291896408 shutdown_connections 2024-08-18T21:15:49.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.434+0000 7f223f45f640 1 -- 172.21.15.5:0/2291896408 wait complete. 2024-08-18T21:15:49.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-18T21:15:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 10 monclient: get_monmap_and_config 2024-08-18T21:15:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 10 monclient: build_initial_monmap 2024-08-18T21:15:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 10 monclient: monmap: 2024-08-18T21:15:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:49.568502+0000 2024-08-18T21:15:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:49.568502+0000 2024-08-18T21:15:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:49.564 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 1 Processor -- start 2024-08-18T21:15:49.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 1 -- start start 2024-08-18T21:15:49.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 10 monclient: init 2024-08-18T21:15:49.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:49.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 10 monclient: _add_conns ranks=[8,3,4,7,6,9,5,1,2,0,10] 2024-08-18T21:15:49.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6b100a6bd0 0x7f6b100a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 10 monclient(hunting): picked mon.noname-e con 0x7f6b100a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:49.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b1009f080 0x7f6b100a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 10 monclient(hunting): picked mon.noname-g con 0x7f6b1009f080 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:49.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6b10139990 0x7f6b10139df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 10 monclient(hunting): picked mon.noname-c con 0x7f6b10139990 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:15:49.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6b1009e4c0 con 0x7f6b1009f080 2024-08-18T21:15:49.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f6b1006f930 con 0x7f6b10139990 2024-08-18T21:15:49.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f6b100a7a30 con 0x7f6b100a6bd0 2024-08-18T21:15:49.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:49.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b16110640 10 monclient(hunting): authenticate will time out at 1716.581326s 2024-08-18T21:15:49.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6b100a6bd0 0x7f6b100a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0ffff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6b10139990 0x7f6b10139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6b100a6bd0 0x7f6b100a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:53978/0 (socket says 172.21.15.5:53978) 2024-08-18T21:15:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0ffff640 10 monclient(hunting): get_auth_request con 0x7f6b10139990 auth_method 0 2024-08-18T21:15:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 1 -- 172.21.15.5:0/191770887 learned_addr learned my addr 172.21.15.5:0/191770887 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0ffff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 10 monclient(hunting): get_auth_request con 0x7f6b100a6bd0 auth_method 0 2024-08-18T21:15:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0effd640 1 --2- 172.21.15.5:0/191770887 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b1009f080 0x7f6b100a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0effd640 10 monclient(hunting): get_auth_request con 0x7f6b1009f080 auth_method 0 2024-08-18T21:15:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 10 monclient(hunting): handle_auth_done global_id 115406 payload 274 2024-08-18T21:15:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 1 -- 172.21.15.5:0/191770887 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6b10139990 msgr2=0x7f6b10139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 1 --2- 172.21.15.5:0/191770887 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6b10139990 0x7f6b10139df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 1 -- 172.21.15.5:0/191770887 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b1009f080 msgr2=0x7f6b100a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 1 --2- 172.21.15.5:0/191770887 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b1009f080 0x7f6b100a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:15:49.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 1 monclient: found mon.noname-e 2024-08-18T21:15:49.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:49.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:15:49.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.566+0000 7f6b0f7fe640 1 -- 172.21.15.5:0/191770887 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b100a7fb0 con 0x7f6b100a6bd0 2024-08-18T21:15:49.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b0f7fe640 1 -- 172.21.15.5:0/191770887 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6b100a6bd0 msgr2=0x7f6b100a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:49.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b0f7fe640 1 --2- 172.21.15.5:0/191770887 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6b100a6bd0 0x7f6b100a6fb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009e80 tx=0x7f6b0001c910 comp rx=0 tx=0).ready entity=mon.8 client_cookie=616f677b2c2986be server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:49.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b0e7fc640 1 -- 172.21.15.5:0/191770887 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6b000090d0 con 0x7f6b100a6bd0 2024-08-18T21:15:49.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b0e7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:15:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b0e7fc640 10 monclient: dump: 2024-08-18T21:15:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:49.578 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b0e7fc640 10 monclient: _finish_auth 0 2024-08-18T21:15:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b0e7fc640 10 monclient: _check_auth_tickets 2024-08-18T21:15:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b0e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b0e7fc640 1 -- 172.21.15.5:0/191770887 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b000a5a70 con 0x7f6b100a6bd0 2024-08-18T21:15:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 5 monclient: authenticate success, global_id 115406 2024-08-18T21:15:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:15:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b0e7fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:49.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:49.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b0e7fc640 1 -- 172.21.15.5:0/191770887 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6b000a5c20 con 0x7f6b100a6bd0 2024-08-18T21:15:49.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:49.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 4 set_mon_vals no callback set 2024-08-18T21:15:49.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b0e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:15:49.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b0e7fc640 10 monclient: dump: 2024-08-18T21:15:49.579 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:49.579 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.579 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.579 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.579 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:49.579 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.580 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:49.580 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:49.580 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:49.580 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:49.580 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:49.580 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:49.580 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:49.580 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:49.580 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:49.580 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 10 monclient: shutdown 2024-08-18T21:15:49.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:49.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 1 -- 172.21.15.5:0/191770887 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6b100a6bd0 msgr2=0x7f6b100a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 1 --2- 172.21.15.5:0/191770887 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6b100a6bd0 0x7f6b100a6fb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009e80 tx=0x7f6b0001c910 comp rx=0 tx=0).stop 2024-08-18T21:15:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 1 -- 172.21.15.5:0/191770887 shutdown_connections 2024-08-18T21:15:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 1 --2- 172.21.15.5:0/191770887 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f6b10139990 0x7f6b10139df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 1 --2- 172.21.15.5:0/191770887 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b1009f080 0x7f6b100a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 1 --2- 172.21.15.5:0/191770887 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f6b100a6bd0 0x7f6b100a6fb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 1 -- 172.21.15.5:0/191770887 >> 172.21.15.5:0/191770887 conn(0x7f6b10068700 msgr2=0x7f6b10068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 1 -- 172.21.15.5:0/191770887 shutdown_connections 2024-08-18T21:15:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 1 -- 172.21.15.5:0/191770887 wait complete. 2024-08-18T21:15:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 10 monclient: build_initial_monmap 2024-08-18T21:15:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 10 monclient: monmap: 2024-08-18T21:15:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:49.582 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:49.582 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.582 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:49.582 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:49.582 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:49.582 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:49.582 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:49.582 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:49.582 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:49.582 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:49.582 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:49.582 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.570+0000 7f6b16110640 1 Processor -- start 2024-08-18T21:15:49.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 1 -- start start 2024-08-18T21:15:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 10 monclient: init 2024-08-18T21:15:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 10 monclient: _add_conns ranks=[2,6,5,1,7,8,0,4,3] 2024-08-18T21:15:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6b1009f080 0x7f6b10138470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 10 monclient(hunting): picked mon.noname-b con 0x7f6b1009f080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 1 --2- >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6b100a6bd0 0x7f6b101389b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 10 monclient(hunting): picked mon.noname-d con 0x7f6b100a6bd0 addr [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] 2024-08-18T21:15:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6b10139990 0x7f6b1013db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 10 monclient(hunting): picked mon.noname-h con 0x7f6b10139990 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f6b100a89f0 con 0x7f6b1009f080 2024-08-18T21:15:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f6b100a7ce0 con 0x7f6b10139990 2024-08-18T21:15:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 1 -- --> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] -- mon_getmap magic: 0 -- 0x7f6b10143610 con 0x7f6b100a6bd0 2024-08-18T21:15:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 10 monclient(hunting): authenticate will time out at 1716.588536s 2024-08-18T21:15:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6b1009f080 0x7f6b10138470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6b1009f080 0x7f6b10138470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33902/0 (socket says 172.21.15.5:33902) 2024-08-18T21:15:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 1 -- 172.21.15.5:0/222601690 learned_addr learned my addr 172.21.15.5:0/222601690 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0effd640 1 --2- 172.21.15.5:0/222601690 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6b100a6bd0 0x7f6b101389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 10 monclient(hunting): get_auth_request con 0x7f6b1009f080 auth_method 0 2024-08-18T21:15:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0effd640 10 monclient(hunting): get_auth_request con 0x7f6b100a6bd0 auth_method 0 2024-08-18T21:15:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0effd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0ffff640 1 --2- 172.21.15.5:0/222601690 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6b10139990 0x7f6b1013db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 10 monclient(hunting): handle_auth_done global_id 115274 payload 824 2024-08-18T21:15:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0ffff640 1 -- 172.21.15.5:0/222601690 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6b10139990 msgr2=0x7f6b1013db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-18T21:15:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0ffff640 1 -- 172.21.15.5:0/222601690 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6b10139990 msgr2=0x7f6b1013db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:15:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0ffff640 1 --2- 172.21.15.5:0/222601690 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6b10139990 0x7f6b1013db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:15:49.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 1 -- 172.21.15.5:0/222601690 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6b100a6bd0 msgr2=0x7f6b101389b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 1 --2- 172.21.15.5:0/222601690 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6b100a6bd0 0x7f6b101389b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0ffff640 1 --2- 172.21.15.5:0/222601690 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6b10139990 0x7f6b1013db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:15:49.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 1 -- 172.21.15.5:0/222601690 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6b10139990 msgr2=0x7f6b1013db00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:15:49.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 1 --2- 172.21.15.5:0/222601690 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6b10139990 0x7f6b1013db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 10 monclient: _finish_hunting 0 2024-08-18T21:15:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 1 monclient: found mon.noname-b 2024-08-18T21:15:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 1 -- 172.21.15.5:0/222601690 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b10139710 con 0x7f6b1009f080 2024-08-18T21:15:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 1 -- 172.21.15.5:0/222601690 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6b1009f080 msgr2=0x7f6b10138470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0f7fe640 1 --2- 172.21.15.5:0/222601690 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6b1009f080 0x7f6b10138470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009e20 tx=0x7f6b000196b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6af7fff640 1 -- 172.21.15.5:0/222601690 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6b000bc020 con 0x7f6b1009f080 2024-08-18T21:15:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6af7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6af7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6af7fff640 10 monclient: dump: 2024-08-18T21:15:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:49.589 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6af7fff640 10 monclient: _finish_auth 0 2024-08-18T21:15:49.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6af7fff640 10 monclient: _check_auth_tickets 2024-08-18T21:15:49.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6af7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:49.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b16110640 5 monclient: authenticate success, global_id 115274 2024-08-18T21:15:49.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6af7fff640 1 -- 172.21.15.5:0/222601690 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b00003e10 con 0x7f6b1009f080 2024-08-18T21:15:49.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6af7fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:49.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6af7fff640 1 -- 172.21.15.5:0/222601690 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6b000044b0 con 0x7f6b1009f080 2024-08-18T21:15:49.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6af7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:49.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6af7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:49.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6b0d7fa640 4 set_mon_vals no callback set 2024-08-18T21:15:49.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.574+0000 7f6af7fff640 10 monclient: dump: 2024-08-18T21:15:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:49.591 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:49.591 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.578+0000 7f6b16110640 10 monclient: _renew_subs 2024-08-18T21:15:49.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.578+0000 7f6b16110640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:49.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.578+0000 7f6b16110640 1 -- 172.21.15.5:0/222601690 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b101239e0 con 0x7f6b1009f080 2024-08-18T21:15:49.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.578+0000 7f6b16110640 10 monclient: _renew_subs 2024-08-18T21:15:49.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.578+0000 7f6b16110640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:49.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.578+0000 7f6b16110640 1 -- 172.21.15.5:0/222601690 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b1013fde0 con 0x7f6b1009f080 2024-08-18T21:15:49.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.578+0000 7f6b16110640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:49.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.578+0000 7f6b16110640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:49.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.578+0000 7f6b16110640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:49.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.578+0000 7f6b16110640 1 -- 172.21.15.5:0/222601690 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b10139df0 con 0x7f6b1009f080 2024-08-18T21:15:49.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.578+0000 7f6af7fff640 1 -- 172.21.15.5:0/222601690 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f6b000bf020 con 0x7f6b1009f080 2024-08-18T21:15:49.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.578+0000 7f6af7fff640 1 --2- 172.21.15.5:0/222601690 >> v2:172.21.15.157:6812/631023601 conn(0x7f6afc03bdc0 0x7f6afc03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.578+0000 7f6af7fff640 1 -- 172.21.15.5:0/222601690 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(331..331 src has 300..331) ==== 3506+0+0 (secure 0 0 0) 0x7f6b000e93e0 con 0x7f6b1009f080 2024-08-18T21:15:49.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.578+0000 7f6b0effd640 1 --2- 172.21.15.5:0/222601690 >> v2:172.21.15.157:6812/631023601 conn(0x7f6afc03bdc0 0x7f6afc03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.578+0000 7f6b0effd640 10 monclient: get_auth_request con 0x7f6afc03bdc0 auth_method 0 2024-08-18T21:15:49.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.582+0000 7f6b0effd640 1 --2- 172.21.15.5:0/222601690 >> v2:172.21.15.157:6812/631023601 conn(0x7f6afc03bdc0 0x7f6afc03e280 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6b1013f220 tx=0x7f6b08008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:49.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.582+0000 7f6af7fff640 1 -- 172.21.15.5:0/222601690 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f6b000c6070 con 0x7f6b1009f080 2024-08-18T21:15:49.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.582+0000 7f6af7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:49.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.582+0000 7f6af7fff640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.754+0000 7f6b16110640 1 -- 172.21.15.5:0/222601690 --> v2:172.21.15.157:6812/631023601 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f6b101243a0 con 0x7f6afc03bdc0 2024-08-18T21:15:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.754+0000 7f6af7fff640 1 -- 172.21.15.5:0/222601690 <== mgr.4130 v2:172.21.15.157:6812/631023601 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6b080076b0 con 0x7f6afc03bdc0 2024-08-18T21:15:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 3 to deep-scrub 2024-08-18T21:15:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.754+0000 7f6b16110640 1 -- 172.21.15.5:0/222601690 >> v2:172.21.15.157:6812/631023601 conn(0x7f6afc03bdc0 msgr2=0x7f6afc03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.754+0000 7f6b16110640 1 --2- 172.21.15.5:0/222601690 >> v2:172.21.15.157:6812/631023601 conn(0x7f6afc03bdc0 0x7f6afc03e280 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6b1013f220 tx=0x7f6b08008040 comp rx=0 tx=0).stop 2024-08-18T21:15:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.754+0000 7f6b16110640 10 monclient: shutdown 2024-08-18T21:15:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.754+0000 7f6b16110640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.754+0000 7f6b16110640 1 -- 172.21.15.5:0/222601690 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6b1009f080 msgr2=0x7f6b10138470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.754+0000 7f6b16110640 1 --2- 172.21.15.5:0/222601690 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6b1009f080 0x7f6b10138470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009e20 tx=0x7f6b000196b0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.758+0000 7f6b16110640 1 -- 172.21.15.5:0/222601690 shutdown_connections 2024-08-18T21:15:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.758+0000 7f6b16110640 1 --2- 172.21.15.5:0/222601690 >> v2:172.21.15.157:6812/631023601 conn(0x7f6afc03bdc0 0x7f6afc03e280 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.758+0000 7f6b16110640 1 --2- 172.21.15.5:0/222601690 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f6b10139990 0x7f6b1013db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.758+0000 7f6b16110640 1 --2- 172.21.15.5:0/222601690 >> [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] conn(0x7f6b100a6bd0 0x7f6b101389b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.758+0000 7f6b16110640 1 --2- 172.21.15.5:0/222601690 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6b1009f080 0x7f6b10138470 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.758+0000 7f6b16110640 1 -- 172.21.15.5:0/222601690 >> 172.21.15.5:0/222601690 conn(0x7f6b10068700 msgr2=0x7f6b100aa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.758+0000 7f6b16110640 1 -- 172.21.15.5:0/222601690 shutdown_connections 2024-08-18T21:15:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.758+0000 7f6b16110640 1 -- 172.21.15.5:0/222601690 wait complete. 2024-08-18T21:15:49.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1855668871}) 2024-08-18T21:15:49.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4064729743}) 2024-08-18T21:15:49.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.765 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1855668871}) 2024-08-18T21:15:49.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3778006566}) 2024-08-18T21:15:49.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1855668871}) 2024-08-18T21:15:49.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2921493212}) 2024-08-18T21:15:49.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1855668871}) 2024-08-18T21:15:49.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3931982674}) 2024-08-18T21:15:49.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1855668871}) 2024-08-18T21:15:49.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=197819583}) 2024-08-18T21:15:49.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1855668871}) 2024-08-18T21:15:49.766 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2242137700}) 2024-08-18T21:15:49.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1855668871}) 2024-08-18T21:15:49.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=93215832}) 2024-08-18T21:15:49.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1855668871}) 2024-08-18T21:15:49.767 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.766+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3492029122}) 2024-08-18T21:15:49.771 INFO:tasks.ceph:Scrubbing osd.4 2024-08-18T21:15:49.771 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-18T21:15:49.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3477461988}) 2024-08-18T21:15:49.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3064885855}) 2024-08-18T21:15:49.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3477461988}) 2024-08-18T21:15:49.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3128305529}) 2024-08-18T21:15:49.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3477461988}) 2024-08-18T21:15:49.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1886552043}) 2024-08-18T21:15:49.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.825 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3477461988}) 2024-08-18T21:15:49.826 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4061084468}) 2024-08-18T21:15:49.826 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.826 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3477461988}) 2024-08-18T21:15:49.826 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2290572339}) 2024-08-18T21:15:49.826 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.826 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3477461988}) 2024-08-18T21:15:49.826 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=942886908}) 2024-08-18T21:15:49.826 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.826 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3477461988}) 2024-08-18T21:15:49.826 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=261041054}) 2024-08-18T21:15:49.826 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.827 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3477461988}) 2024-08-18T21:15:49.827 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.826+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2029927134}) 2024-08-18T21:15:49.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 10 monclient: get_monmap_and_config 2024-08-18T21:15:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 10 monclient: build_initial_monmap 2024-08-18T21:15:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 10 monclient: monmap: 2024-08-18T21:15:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:49.905215+0000 2024-08-18T21:15:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:49.905215+0000 2024-08-18T21:15:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:49.901 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:49.901 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:49.901 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:49.901 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:49.901 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:49.901 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:49.901 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:49.901 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:49.901 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 1 Processor -- start 2024-08-18T21:15:49.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 1 -- start start 2024-08-18T21:15:49.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 10 monclient: init 2024-08-18T21:15:49.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:49.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 10 monclient: _add_conns ranks=[3,9,0,1,4,7,8,6,5,2,10] 2024-08-18T21:15:49.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67700a6af0 0x7f67700a6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 10 monclient(hunting): picked mon.noname-g con 0x7f67700a6af0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:49.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f67700a83d0 0x7f67700a7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 10 monclient(hunting): picked mon.noname-a con 0x7f67700a83d0 addr v2:172.21.15.5:3300/0 2024-08-18T21:15:49.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f677009ea80 addr v1:172.21.15.5:6789/0 2024-08-18T21:15:49.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f677009ddc0 con 0x7f677009ea80 2024-08-18T21:15:49.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f67700a7950 con 0x7f67700a83d0 2024-08-18T21:15:49.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f677009e0a0 con 0x7f67700a6af0 2024-08-18T21:15:49.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:49.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f677765e640 10 monclient(hunting): authenticate will time out at 1716.919165s 2024-08-18T21:15:49.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f6774bf9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f67700a83d0 0x7f67700a7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f6774bf9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f67700a83d0 0x7f67700a7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53896/0 (socket says 172.21.15.5:53896) 2024-08-18T21:15:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f6774bf9640 1 -- 172.21.15.5:0/1894278535 learned_addr learned my addr 172.21.15.5:0/1894278535 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f6774bf9640 10 monclient(hunting): get_auth_request con 0x7f67700a83d0 auth_method 0 2024-08-18T21:15:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f6774bf9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f6774bf9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f6774bf9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f6774bf9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f6774bf9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f6774bf9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f67753fa640 1 --2- 172.21.15.5:0/1894278535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67700a6af0 0x7f67700a6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f67753fa640 10 monclient(hunting): get_auth_request con 0x7f67700a6af0 auth_method 0 2024-08-18T21:15:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f67753fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f67753fa640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f67753fa640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f67753fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f67753fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.902+0000 7f67753fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.906+0000 7f67753fa640 10 monclient(hunting): handle_auth_done global_id 134643 payload 274 2024-08-18T21:15:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.906+0000 7f67753fa640 1 -- 172.21.15.5:0/1894278535 >> v2:172.21.15.5:3300/0 conn(0x7f67700a83d0 msgr2=0x7f67700a7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.906+0000 7f67753fa640 1 --2- 172.21.15.5:0/1894278535 >> v2:172.21.15.5:3300/0 conn(0x7f67700a83d0 0x7f67700a7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.906+0000 7f67753fa640 1 -- 172.21.15.5:0/1894278535 >> v1:172.21.15.5:6789/0 conn(0x7f677009ea80 legacy=0x7f67701398b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.906+0000 7f67753fa640 10 monclient: _finish_hunting 0 2024-08-18T21:15:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.906+0000 7f67753fa640 1 monclient: found mon.noname-g 2024-08-18T21:15:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.906+0000 7f67753fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.906+0000 7f67753fa640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.157:3301/0 2024-08-18T21:15:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.906+0000 7f67753fa640 1 -- 172.21.15.5:0/1894278535 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677009e380 con 0x7f67700a6af0 2024-08-18T21:15:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f67753fa640 1 -- 172.21.15.5:0/1894278535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67700a6af0 msgr2=0x7f67700a6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f67753fa640 1 --2- 172.21.15.5:0/1894278535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67700a6af0 0x7f67700a6ed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f676c0097c0 tx=0x7f676c01c3f0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=aa580e8dcce95952 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f6767fff640 1 -- 172.21.15.5:0/1894278535 <== mon.3 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f676c0b0070 con 0x7f67700a6af0 2024-08-18T21:15:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f6767fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f6767fff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-18T21:15:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f6767fff640 10 monclient: dump: 2024-08-18T21:15:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:49.911 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f6767fff640 10 monclient: _finish_auth 0 2024-08-18T21:15:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f6767fff640 10 monclient: _check_auth_tickets 2024-08-18T21:15:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f6767fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f6767fff640 1 -- 172.21.15.5:0/1894278535 <== mon.3 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f676c0aa810 con 0x7f67700a6af0 2024-08-18T21:15:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f6767fff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f6767fff640 1 -- 172.21.15.5:0/1894278535 <== mon.3 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f676c0aae30 con 0x7f67700a6af0 2024-08-18T21:15:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f6767fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f6767fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-18T21:15:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f6767fff640 10 monclient: dump: 2024-08-18T21:15:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:49.913 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 5 monclient: authenticate success, global_id 134643 2024-08-18T21:15:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 4 set_mon_vals no callback set 2024-08-18T21:15:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 10 monclient: shutdown 2024-08-18T21:15:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 1 -- 172.21.15.5:0/1894278535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67700a6af0 msgr2=0x7f67700a6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 1 --2- 172.21.15.5:0/1894278535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67700a6af0 0x7f67700a6ed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f676c0097c0 tx=0x7f676c01c3f0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 1 -- 172.21.15.5:0/1894278535 shutdown_connections 2024-08-18T21:15:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 1 --2- 172.21.15.5:0/1894278535 >> v2:172.21.15.5:3300/0 conn(0x7f67700a83d0 0x7f67700a7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 1 --2- 172.21.15.5:0/1894278535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67700a6af0 0x7f67700a6ed0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 1 -- 172.21.15.5:0/1894278535 >> 172.21.15.5:0/1894278535 conn(0x7f67700a8bf0 msgr2=0x7f67700a9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 1 -- 172.21.15.5:0/1894278535 shutdown_connections 2024-08-18T21:15:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 1 -- 172.21.15.5:0/1894278535 wait complete. 2024-08-18T21:15:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 10 monclient: build_initial_monmap 2024-08-18T21:15:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 10 monclient: monmap: 2024-08-18T21:15:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:49.920 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 1 Processor -- start 2024-08-18T21:15:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 1 -- start start 2024-08-18T21:15:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 10 monclient: init 2024-08-18T21:15:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 10 monclient: _add_conns ranks=[5,1,8,3,6,7,0,2,4] 2024-08-18T21:15:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f677009ea80 0x7f6770138380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 10 monclient(hunting): picked mon.noname-h con 0x7f677009ea80 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67700a6af0 0x7f67701388c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 10 monclient(hunting): picked mon.noname-f con 0x7f67700a6af0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:15:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f67700a83d0 0x7f677013dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.910+0000 7f677765e640 10 monclient(hunting): picked mon.noname-e con 0x7f67700a83d0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f677765e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f677765e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f67701449b0 con 0x7f67700a6af0 2024-08-18T21:15:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f677765e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f677765e640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f6770144830 con 0x7f677009ea80 2024-08-18T21:15:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f677765e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f677765e640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f6770144b30 con 0x7f67700a83d0 2024-08-18T21:15:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f677765e640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f677765e640 10 monclient(hunting): authenticate will time out at 1716.928044s 2024-08-18T21:15:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f67700a83d0 0x7f677013dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f67700a83d0 0x7f677013dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:53980/0 (socket says 172.21.15.5:53980) 2024-08-18T21:15:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 1 -- 172.21.15.5:0/2646083382 learned_addr learned my addr 172.21.15.5:0/2646083382 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 10 monclient(hunting): get_auth_request con 0x7f67700a83d0 auth_method 0 2024-08-18T21:15:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f67753fa640 1 --2- 172.21.15.5:0/2646083382 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f677009ea80 0x7f6770138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6774bf9640 1 --2- 172.21.15.5:0/2646083382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67700a6af0 0x7f67701388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f67753fa640 10 monclient(hunting): get_auth_request con 0x7f677009ea80 auth_method 0 2024-08-18T21:15:49.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f67753fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f67753fa640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f67753fa640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6774bf9640 10 monclient(hunting): get_auth_request con 0x7f67700a6af0 auth_method 0 2024-08-18T21:15:49.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6774bf9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:49.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6774bf9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:49.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6774bf9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:49.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 10 monclient(hunting): handle_auth_done global_id 115415 payload 824 2024-08-18T21:15:49.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 1 -- 172.21.15.5:0/2646083382 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f677009ea80 msgr2=0x7f6770138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 1 --2- 172.21.15.5:0/2646083382 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f677009ea80 0x7f6770138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 1 -- 172.21.15.5:0/2646083382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67700a6af0 msgr2=0x7f67701388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 1 --2- 172.21.15.5:0/2646083382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67700a6af0 0x7f67701388c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 10 monclient: _finish_hunting 0 2024-08-18T21:15:49.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 1 monclient: found mon.noname-e 2024-08-18T21:15:49.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:49.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:15:49.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 1 -- 172.21.15.5:0/2646083382 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6770140340 con 0x7f67700a83d0 2024-08-18T21:15:49.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 1 -- 172.21.15.5:0/2646083382 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f67700a83d0 msgr2=0x7f677013dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:49.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6775bfb640 1 --2- 172.21.15.5:0/2646083382 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f67700a83d0 0x7f677013dbf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f676800c7b0 tx=0x7f676800cc70 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:49.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6765ffb640 1 -- 172.21.15.5:0/2646083382 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6768004970 con 0x7f67700a83d0 2024-08-18T21:15:49.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6765ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:49.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6765ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:15:49.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6765ffb640 10 monclient: dump: 2024-08-18T21:15:49.925 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:49.925 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.925 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.925 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.925 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:49.925 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.925 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:49.925 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:49.925 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:49.926 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:49.926 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:49.926 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:49.926 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:49.926 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:49.926 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:49.926 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6765ffb640 10 monclient: _finish_auth 0 2024-08-18T21:15:49.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6765ffb640 10 monclient: _check_auth_tickets 2024-08-18T21:15:49.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6765ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:49.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f677765e640 5 monclient: authenticate success, global_id 115415 2024-08-18T21:15:49.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f677765e640 10 monclient: _renew_subs 2024-08-18T21:15:49.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6765ffb640 1 -- 172.21.15.5:0/2646083382 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6768004b30 con 0x7f67700a83d0 2024-08-18T21:15:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f677765e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f677765e640 1 -- 172.21.15.5:0/2646083382 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6770122ee0 con 0x7f67700a83d0 2024-08-18T21:15:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6765ffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6765ffb640 1 -- 172.21.15.5:0/2646083382 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6768004ce0 con 0x7f67700a83d0 2024-08-18T21:15:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6765ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6765ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:15:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f67677fe640 4 set_mon_vals no callback set 2024-08-18T21:15:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f6765ffb640 10 monclient: dump: 2024-08-18T21:15:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:49.928 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:49.928 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:49.928 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:49.928 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:49.928 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:49.928 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:49.928 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:49.928 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:49.928 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:49.928 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:49.928 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:49.928 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:49.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f677765e640 10 monclient: _renew_subs 2024-08-18T21:15:49.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f677765e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:49.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.914+0000 7f677765e640 1 -- 172.21.15.5:0/2646083382 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f6770122c00 con 0x7f67700a83d0 2024-08-18T21:15:49.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.918+0000 7f677765e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:49.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.918+0000 7f677765e640 1 -- 172.21.15.5:0/2646083382 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f67700ab330 con 0x7f67700a83d0 2024-08-18T21:15:49.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.918+0000 7f6765ffb640 1 -- 172.21.15.5:0/2646083382 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f676800aa60 con 0x7f67700a83d0 2024-08-18T21:15:49.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.918+0000 7f6765ffb640 1 --2- 172.21.15.5:0/2646083382 >> v2:172.21.15.157:6812/631023601 conn(0x7f675403bdc0 0x7f675403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.918+0000 7f6765ffb640 1 -- 172.21.15.5:0/2646083382 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(331..331 src has 300..331) ==== 3506+0+0 (secure 0 0 0) 0x7f676804e850 con 0x7f67700a83d0 2024-08-18T21:15:49.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.918+0000 7f6765ffb640 1 --2- 172.21.15.5:0/2646083382 >> v2:172.21.15.157:6808/269684279 conn(0x7f6754041950 0x7f6754043d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:49.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.918+0000 7f6765ffb640 1 -- 172.21.15.5:0/2646083382 --> v2:172.21.15.157:6808/269684279 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f67540443e0 con 0x7f6754041950 2024-08-18T21:15:49.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.918+0000 7f6765ffb640 1 -- 172.21.15.5:0/2646083382 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_get_version_reply(handle=1 version=331) ==== 24+0+0 (secure 0 0 0) 0x7f6768055050 con 0x7f67700a83d0 2024-08-18T21:15:49.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.918+0000 7f6765ffb640 10 monclient: handle_get_version_reply finishing 1 version 331 2024-08-18T21:15:49.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.918+0000 7f67753fa640 1 --2- 172.21.15.5:0/2646083382 >> v2:172.21.15.157:6812/631023601 conn(0x7f675403bdc0 0x7f675403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.918+0000 7f67753fa640 10 monclient: get_auth_request con 0x7f675403bdc0 auth_method 0 2024-08-18T21:15:49.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.918+0000 7f6774bf9640 1 --2- 172.21.15.5:0/2646083382 >> v2:172.21.15.157:6808/269684279 conn(0x7f6754041950 0x7f6754043d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:49.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.918+0000 7f6774bf9640 10 monclient: get_auth_request con 0x7f6754041950 auth_method 0 2024-08-18T21:15:49.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.918+0000 7f67753fa640 1 --2- 172.21.15.5:0/2646083382 >> v2:172.21.15.157:6812/631023601 conn(0x7f675403bdc0 0x7f675403e280 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f676c0ab000 tx=0x7f676c0a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:49.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.922+0000 7f6774bf9640 1 --2- 172.21.15.5:0/2646083382 >> v2:172.21.15.157:6808/269684279 conn(0x7f6754041950 0x7f6754043d70 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:49.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.922+0000 7f6765ffb640 1 -- 172.21.15.5:0/2646083382 <== osd.4 v2:172.21.15.157:6808/269684279 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f67540443e0 con 0x7f6754041950 2024-08-18T21:15:49.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.938+0000 7f677765e640 1 -- 172.21.15.5:0/2646083382 --> v2:172.21.15.157:6808/269684279 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f67700ab000 con 0x7f6754041950 2024-08-18T21:15:49.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.938+0000 7f6765ffb640 1 -- 172.21.15.5:0/2646083382 <== osd.4 v2:172.21.15.157:6808/269684279 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f67700ab000 con 0x7f6754041950 2024-08-18T21:15:49.937 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:49.937 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T21:15:49.937 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:49.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.938+0000 7f677765e640 1 -- 172.21.15.5:0/2646083382 >> v2:172.21.15.157:6808/269684279 conn(0x7f6754041950 msgr2=0x7f6754043d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.938+0000 7f677765e640 1 --2- 172.21.15.5:0/2646083382 >> v2:172.21.15.157:6808/269684279 conn(0x7f6754041950 0x7f6754043d70 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:49.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.938+0000 7f677765e640 1 -- 172.21.15.5:0/2646083382 >> v2:172.21.15.157:6812/631023601 conn(0x7f675403bdc0 msgr2=0x7f675403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.938+0000 7f677765e640 1 --2- 172.21.15.5:0/2646083382 >> v2:172.21.15.157:6812/631023601 conn(0x7f675403bdc0 0x7f675403e280 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f676c0ab000 tx=0x7f676c0a6000 comp rx=0 tx=0).stop 2024-08-18T21:15:49.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.938+0000 7f677765e640 10 monclient: shutdown 2024-08-18T21:15:49.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.938+0000 7f677765e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:49.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.938+0000 7f677765e640 1 -- 172.21.15.5:0/2646083382 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f67700a83d0 msgr2=0x7f677013dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:49.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.938+0000 7f677765e640 1 --2- 172.21.15.5:0/2646083382 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f67700a83d0 0x7f677013dbf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f676800c7b0 tx=0x7f676800cc70 comp rx=0 tx=0).stop 2024-08-18T21:15:49.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.938+0000 7f6775bfb640 1 -- 172.21.15.5:0/2646083382 reap_dead start 2024-08-18T21:15:49.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.938+0000 7f677765e640 1 -- 172.21.15.5:0/2646083382 shutdown_connections 2024-08-18T21:15:49.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.938+0000 7f677765e640 1 -- 172.21.15.5:0/2646083382 >> 172.21.15.5:0/2646083382 conn(0x7f67700a8bf0 msgr2=0x7f67700a9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:49.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.938+0000 7f677765e640 1 -- 172.21.15.5:0/2646083382 shutdown_connections 2024-08-18T21:15:49.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:49.938+0000 7f677765e640 1 -- 172.21.15.5:0/2646083382 wait complete. 2024-08-18T21:15:49.946 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.946 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2942068978}) 2024-08-18T21:15:49.947 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3751869874}) 2024-08-18T21:15:49.947 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.947 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2942068978}) 2024-08-18T21:15:49.947 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2195507463}) 2024-08-18T21:15:49.947 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.947 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2942068978}) 2024-08-18T21:15:49.947 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=238727188}) 2024-08-18T21:15:49.947 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.947 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2942068978}) 2024-08-18T21:15:49.947 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=123408352}) 2024-08-18T21:15:49.947 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.947 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2942068978}) 2024-08-18T21:15:49.948 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4118191512}) 2024-08-18T21:15:49.948 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.948 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2942068978}) 2024-08-18T21:15:49.948 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1807676928}) 2024-08-18T21:15:49.948 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.948 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2942068978}) 2024-08-18T21:15:49.948 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2510721491}) 2024-08-18T21:15:49.948 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.948 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2942068978}) 2024-08-18T21:15:49.948 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.946+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2996032021}) 2024-08-18T21:15:49.951 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.951 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319761577}) 2024-08-18T21:15:49.951 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1982073698}) 2024-08-18T21:15:49.951 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.951 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319761577}) 2024-08-18T21:15:49.951 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=908061343}) 2024-08-18T21:15:49.951 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.951 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319761577}) 2024-08-18T21:15:49.951 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3005475158}) 2024-08-18T21:15:49.952 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.952 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319761577}) 2024-08-18T21:15:49.952 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2195191299}) 2024-08-18T21:15:49.952 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.952 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319761577}) 2024-08-18T21:15:49.952 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2846991970}) 2024-08-18T21:15:49.952 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.952 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319761577}) 2024-08-18T21:15:49.952 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=790709295}) 2024-08-18T21:15:49.952 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.952 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319761577}) 2024-08-18T21:15:49.952 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=447819341}) 2024-08-18T21:15:49.952 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.953 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319761577}) 2024-08-18T21:15:49.953 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.950+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2007610525}) 2024-08-18T21:15:49.955 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.955 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1588335576}) 2024-08-18T21:15:49.955 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2368266519}) 2024-08-18T21:15:49.955 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.955 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1588335576}) 2024-08-18T21:15:49.956 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2233076105}) 2024-08-18T21:15:49.956 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.956 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1588335576}) 2024-08-18T21:15:49.956 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2978893145}) 2024-08-18T21:15:49.956 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.956 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1588335576}) 2024-08-18T21:15:49.956 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2717811800}) 2024-08-18T21:15:49.956 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.956 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1588335576}) 2024-08-18T21:15:49.956 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=583964126}) 2024-08-18T21:15:49.956 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.956 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1588335576}) 2024-08-18T21:15:49.957 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3957597209}) 2024-08-18T21:15:49.957 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.957 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1588335576}) 2024-08-18T21:15:49.957 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1820524112}) 2024-08-18T21:15:49.957 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.957 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1588335576}) 2024-08-18T21:15:49.957 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.954+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=377810635}) 2024-08-18T21:15:49.958 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-18T21:15:49.962 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.962 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192354879}) 2024-08-18T21:15:49.962 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=567325740}) 2024-08-18T21:15:49.963 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.963 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192354879}) 2024-08-18T21:15:49.963 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1837182835}) 2024-08-18T21:15:49.963 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.963 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192354879}) 2024-08-18T21:15:49.963 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3813374683}) 2024-08-18T21:15:49.963 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.963 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192354879}) 2024-08-18T21:15:49.963 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=470396263}) 2024-08-18T21:15:49.963 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.963 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192354879}) 2024-08-18T21:15:49.963 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3855889980}) 2024-08-18T21:15:49.963 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.963 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192354879}) 2024-08-18T21:15:49.964 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1974286301}) 2024-08-18T21:15:49.964 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.964 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192354879}) 2024-08-18T21:15:49.964 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4289244784}) 2024-08-18T21:15:49.964 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.964 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1192354879}) 2024-08-18T21:15:49.964 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.958+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2451325641}) 2024-08-18T21:15:49.964 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.964 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1305244147}) 2024-08-18T21:15:49.964 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1048393736}) 2024-08-18T21:15:49.964 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.964 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1305244147}) 2024-08-18T21:15:49.964 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=32910788}) 2024-08-18T21:15:49.965 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.965 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1305244147}) 2024-08-18T21:15:49.965 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1416747343}) 2024-08-18T21:15:49.965 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.965 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1305244147}) 2024-08-18T21:15:49.965 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3346932709}) 2024-08-18T21:15:49.965 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.965 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1305244147}) 2024-08-18T21:15:49.965 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3931443313}) 2024-08-18T21:15:49.965 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.965 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1305244147}) 2024-08-18T21:15:49.965 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=73080211}) 2024-08-18T21:15:49.965 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.966 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1305244147}) 2024-08-18T21:15:49.966 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1682799324}) 2024-08-18T21:15:49.966 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.966 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1305244147}) 2024-08-18T21:15:49.966 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.962+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=831547527}) 2024-08-18T21:15:49.972 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.973 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2645342753}) 2024-08-18T21:15:49.973 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=222275761}) 2024-08-18T21:15:49.973 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.973 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2645342753}) 2024-08-18T21:15:49.973 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3676207109}) 2024-08-18T21:15:49.973 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.973 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2645342753}) 2024-08-18T21:15:49.973 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2962419610}) 2024-08-18T21:15:49.973 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.973 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2645342753}) 2024-08-18T21:15:49.973 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1607544354}) 2024-08-18T21:15:49.973 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.974 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2645342753}) 2024-08-18T21:15:49.974 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3165901428}) 2024-08-18T21:15:49.974 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.974 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2645342753}) 2024-08-18T21:15:49.974 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=275691845}) 2024-08-18T21:15:49.974 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.974 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2645342753}) 2024-08-18T21:15:49.974 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2304241531}) 2024-08-18T21:15:49.974 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.974 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2645342753}) 2024-08-18T21:15:49.974 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.966+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3150786391}) 2024-08-18T21:15:49.974 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.975 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3372486733}) 2024-08-18T21:15:49.975 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3486499900}) 2024-08-18T21:15:49.975 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.975 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3372486733}) 2024-08-18T21:15:49.975 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=671635282}) 2024-08-18T21:15:49.975 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.975 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3372486733}) 2024-08-18T21:15:49.975 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1991438578}) 2024-08-18T21:15:49.975 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.975 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3372486733}) 2024-08-18T21:15:49.975 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3002565662}) 2024-08-18T21:15:49.975 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.976 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3372486733}) 2024-08-18T21:15:49.976 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2281852998}) 2024-08-18T21:15:49.976 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.976 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3372486733}) 2024-08-18T21:15:49.976 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3043124070}) 2024-08-18T21:15:49.976 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.976 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3372486733}) 2024-08-18T21:15:49.976 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=298066401}) 2024-08-18T21:15:49.976 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.976 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3372486733}) 2024-08-18T21:15:49.976 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.970+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2362962178}) 2024-08-18T21:15:49.976 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.976 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=909119130}) 2024-08-18T21:15:49.976 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=969656903}) 2024-08-18T21:15:49.977 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.977 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=909119130}) 2024-08-18T21:15:49.977 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2584781388}) 2024-08-18T21:15:49.977 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.977 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=909119130}) 2024-08-18T21:15:49.977 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1197980809}) 2024-08-18T21:15:49.977 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.977 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=909119130}) 2024-08-18T21:15:49.977 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1900222471}) 2024-08-18T21:15:49.977 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.977 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=909119130}) 2024-08-18T21:15:49.977 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2852436784}) 2024-08-18T21:15:49.977 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.978 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=909119130}) 2024-08-18T21:15:49.978 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2827173489}) 2024-08-18T21:15:49.978 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.978 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=909119130}) 2024-08-18T21:15:49.978 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1209773015}) 2024-08-18T21:15:49.978 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.978 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=909119130}) 2024-08-18T21:15:49.978 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2056874076}) 2024-08-18T21:15:49.980 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.980 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.974+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1913300075}) 2024-08-18T21:15:49.980 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3613870623}) 2024-08-18T21:15:49.981 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.981 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1913300075}) 2024-08-18T21:15:49.981 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3220926253}) 2024-08-18T21:15:49.981 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.981 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1913300075}) 2024-08-18T21:15:49.981 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1445032599}) 2024-08-18T21:15:49.981 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.981 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1913300075}) 2024-08-18T21:15:49.981 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3004667575}) 2024-08-18T21:15:49.981 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.981 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1913300075}) 2024-08-18T21:15:49.981 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=947877109}) 2024-08-18T21:15:49.981 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.982 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1913300075}) 2024-08-18T21:15:49.982 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=356399852}) 2024-08-18T21:15:49.982 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.982 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1913300075}) 2024-08-18T21:15:49.982 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=422185477}) 2024-08-18T21:15:49.982 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:49.982 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1913300075}) 2024-08-18T21:15:49.982 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:49.978+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1463224765}) 2024-08-18T21:15:50.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 10 monclient: get_monmap_and_config 2024-08-18T21:15:50.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 10 monclient: build_initial_monmap 2024-08-18T21:15:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 10 monclient: monmap: 2024-08-18T21:15:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:50.081001+0000 2024-08-18T21:15:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:50.081001+0000 2024-08-18T21:15:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:50.077 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:50.077 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:50.077 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:50.077 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:50.077 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:50.077 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 1 Processor -- start 2024-08-18T21:15:50.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 1 -- start start 2024-08-18T21:15:50.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 10 monclient: init 2024-08-18T21:15:50.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 10 monclient: _add_conns ranks=[3,9,7,6,10,4,0,8,2,5,1] 2024-08-18T21:15:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7b8134460 0x7fa7b8134840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 10 monclient(hunting): picked mon.noname-g con 0x7fa7b8134460 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa7b8133fa0 0x7fa7b806fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 10 monclient(hunting): picked mon.noname-a con 0x7fa7b8133fa0 addr v2:172.21.15.5:3300/0 2024-08-18T21:15:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fa7b8070270 0x7fa7b8070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 10 monclient(hunting): picked mon.noname-i con 0x7fa7b8070270 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:15:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b809e320 con 0x7fa7b8133fa0 2024-08-18T21:15:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b809e600 con 0x7fa7b8134460 2024-08-18T21:15:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7fa7b809e8e0 con 0x7fa7b8070270 2024-08-18T21:15:50.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:50.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bf6ba640 10 monclient(hunting): authenticate will time out at 1717.094304s 2024-08-18T21:15:50.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa7b8133fa0 0x7fa7b806fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa7b8133fa0 0x7fa7b806fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53900/0 (socket says 172.21.15.5:53900) 2024-08-18T21:15:50.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 1 -- 172.21.15.5:0/2897879517 learned_addr learned my addr 172.21.15.5:0/2897879517 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:50.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 10 monclient(hunting): get_auth_request con 0x7fa7b8133fa0 auth_method 0 2024-08-18T21:15:50.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bd456640 1 --2- 172.21.15.5:0/2897879517 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7b8134460 0x7fa7b8134840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bd456640 10 monclient(hunting): get_auth_request con 0x7fa7b8134460 auth_method 0 2024-08-18T21:15:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bd456640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bd456640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bd456640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bdc57640 1 --2- 172.21.15.5:0/2897879517 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fa7b8070270 0x7fa7b8070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bdc57640 10 monclient(hunting): get_auth_request con 0x7fa7b8070270 auth_method 0 2024-08-18T21:15:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bdc57640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bdc57640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bdc57640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bd456640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bd456640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bd456640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 10 monclient(hunting): handle_auth_done global_id 124947 payload 274 2024-08-18T21:15:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 1 -- 172.21.15.5:0/2897879517 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fa7b8070270 msgr2=0x7fa7b8070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 1 --2- 172.21.15.5:0/2897879517 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fa7b8070270 0x7fa7b8070720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 1 -- 172.21.15.5:0/2897879517 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7b8134460 msgr2=0x7fa7b8134840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 1 --2- 172.21.15.5:0/2897879517 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7b8134460 0x7fa7b8134840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 10 monclient: _finish_hunting 0 2024-08-18T21:15:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 1 monclient: found mon.noname-a 2024-08-18T21:15:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:15:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bcc55640 1 -- 172.21.15.5:0/2897879517 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b809ebc0 con 0x7fa7b8133fa0 2024-08-18T21:15:50.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.078+0000 7fa7bdc57640 1 --2- 172.21.15.5:0/2897879517 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fa7b8070270 0x7fa7b8070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:15:50.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7bcc55640 1 -- 172.21.15.5:0/2897879517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7b8133fa0 msgr2=0x7fa7b806fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:50.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7bcc55640 1 --2- 172.21.15.5:0/2897879517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7b8133fa0 0x7fa7b806fd30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009870 tx=0x7fa7a801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e5c5d79eaadb11 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7affff640 1 -- 172.21.15.5:0/2897879517 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa7a80b0070 con 0x7fa7b8133fa0 2024-08-18T21:15:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7affff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7affff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:15:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7affff640 10 monclient: dump: 2024-08-18T21:15:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:50.090 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7affff640 10 monclient: _finish_auth 0 2024-08-18T21:15:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7affff640 10 monclient: _check_auth_tickets 2024-08-18T21:15:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7affff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7affff640 1 -- 172.21.15.5:0/2897879517 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a80aa810 con 0x7fa7b8133fa0 2024-08-18T21:15:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7affff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7affff640 1 -- 172.21.15.5:0/2897879517 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa7a80aae30 con 0x7fa7b8133fa0 2024-08-18T21:15:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7bf6ba640 5 monclient: authenticate success, global_id 124947 2024-08-18T21:15:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7bf6ba640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7bf6ba640 4 set_mon_vals no callback set 2024-08-18T21:15:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7affff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7affff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:15:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7affff640 10 monclient: dump: 2024-08-18T21:15:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:50.092 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7bf6ba640 10 monclient: shutdown 2024-08-18T21:15:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7bf6ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7bf6ba640 1 -- 172.21.15.5:0/2897879517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7b8133fa0 msgr2=0x7fa7b806fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7bf6ba640 1 --2- 172.21.15.5:0/2897879517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7b8133fa0 0x7fa7b806fd30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009870 tx=0x7fa7a801c420 comp rx=0 tx=0).stop 2024-08-18T21:15:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7bf6ba640 1 -- 172.21.15.5:0/2897879517 shutdown_connections 2024-08-18T21:15:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7bf6ba640 1 --2- 172.21.15.5:0/2897879517 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7fa7b8070270 0x7fa7b8070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7bf6ba640 1 --2- 172.21.15.5:0/2897879517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7b8133fa0 0x7fa7b806fd30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7bf6ba640 1 --2- 172.21.15.5:0/2897879517 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7b8134460 0x7fa7b8134840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7bf6ba640 1 -- 172.21.15.5:0/2897879517 >> 172.21.15.5:0/2897879517 conn(0x7fa7b80a8a90 msgr2=0x7fa7b80a8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7bf6ba640 1 -- 172.21.15.5:0/2897879517 shutdown_connections 2024-08-18T21:15:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.082+0000 7fa7bf6ba640 1 -- 172.21.15.5:0/2897879517 wait complete. 2024-08-18T21:15:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 10 monclient: build_initial_monmap 2024-08-18T21:15:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 10 monclient: monmap: 2024-08-18T21:15:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:50.094 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 1 Processor -- start 2024-08-18T21:15:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 1 -- start start 2024-08-18T21:15:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 10 monclient: init 2024-08-18T21:15:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 10 monclient: _add_conns ranks=[1,2,8,6,5,4,0,7,3] 2024-08-18T21:15:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7b8070270 0x7fa7b81d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 10 monclient(hunting): picked mon.noname-f con 0x7fa7b8070270 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:15:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7b8133fa0 0x7fa7b8130f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 10 monclient(hunting): picked mon.noname-b con 0x7fa7b8133fa0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa7b8134460 0x7fa7b813c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 10 monclient(hunting): picked mon.noname-e con 0x7fa7b8134460 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b8141440 con 0x7fa7b8070270 2024-08-18T21:15:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b809dd40 con 0x7fa7b8133fa0 2024-08-18T21:15:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7fa7b81415c0 con 0x7fa7b8134460 2024-08-18T21:15:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bf6ba640 10 monclient(hunting): authenticate will time out at 1717.101516s 2024-08-18T21:15:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7b8133fa0 0x7fa7b8130f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bdc57640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa7b8134460 0x7fa7b813c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7b8133fa0 0x7fa7b8130f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33916/0 (socket says 172.21.15.5:33916) 2024-08-18T21:15:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 1 -- 172.21.15.5:0/2223691649 learned_addr learned my addr 172.21.15.5:0/2223691649 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 10 monclient(hunting): get_auth_request con 0x7fa7b8133fa0 auth_method 0 2024-08-18T21:15:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bdc57640 10 monclient(hunting): get_auth_request con 0x7fa7b8134460 auth_method 0 2024-08-18T21:15:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bdc57640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bdc57640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bdc57640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bdc57640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bdc57640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bdc57640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bd456640 1 --2- 172.21.15.5:0/2223691649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7b8070270 0x7fa7b81d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bd456640 10 monclient(hunting): get_auth_request con 0x7fa7b8070270 auth_method 0 2024-08-18T21:15:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bd456640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bd456640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bd456640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 10 monclient(hunting): handle_auth_done global_id 115283 payload 824 2024-08-18T21:15:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 1 -- 172.21.15.5:0/2223691649 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa7b8134460 msgr2=0x7fa7b813c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 1 --2- 172.21.15.5:0/2223691649 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa7b8134460 0x7fa7b813c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 1 -- 172.21.15.5:0/2223691649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7b8070270 msgr2=0x7fa7b81d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 1 --2- 172.21.15.5:0/2223691649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7b8070270 0x7fa7b81d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 10 monclient: _finish_hunting 0 2024-08-18T21:15:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 1 monclient: found mon.noname-b 2024-08-18T21:15:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.086+0000 7fa7bcc55640 1 -- 172.21.15.5:0/2223691649 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b813e5c0 con 0x7fa7b8133fa0 2024-08-18T21:15:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7bcc55640 1 -- 172.21.15.5:0/2223691649 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7b8133fa0 msgr2=0x7fa7b8130f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7bcc55640 1 --2- 172.21.15.5:0/2223691649 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7b8133fa0 0x7fa7b8130f00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80097c0 tx=0x7fa7a80191c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7adffb640 1 -- 172.21.15.5:0/2223691649 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa7a80ba070 con 0x7fa7b8133fa0 2024-08-18T21:15:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7adffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7adffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7adffb640 10 monclient: dump: 2024-08-18T21:15:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:50.100 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7adffb640 10 monclient: _finish_auth 0 2024-08-18T21:15:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7adffb640 10 monclient: _check_auth_tickets 2024-08-18T21:15:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7adffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7adffb640 1 -- 172.21.15.5:0/2223691649 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a80b1040 con 0x7fa7b8133fa0 2024-08-18T21:15:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7adffb640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7adffb640 1 -- 172.21.15.5:0/2223691649 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa7a80b0070 con 0x7fa7b8133fa0 2024-08-18T21:15:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7adffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7adffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7adffb640 10 monclient: dump: 2024-08-18T21:15:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:50.102 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7af7fe640 4 set_mon_vals no callback set 2024-08-18T21:15:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7bf6ba640 5 monclient: authenticate success, global_id 115283 2024-08-18T21:15:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7bf6ba640 10 monclient: _renew_subs 2024-08-18T21:15:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7bf6ba640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7bf6ba640 1 -- 172.21.15.5:0/2223691649 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b8072900 con 0x7fa7b8133fa0 2024-08-18T21:15:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7bf6ba640 10 monclient: _renew_subs 2024-08-18T21:15:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7bf6ba640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7bf6ba640 1 -- 172.21.15.5:0/2223691649 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b813dc60 con 0x7fa7b8133fa0 2024-08-18T21:15:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7adffb640 1 -- 172.21.15.5:0/2223691649 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fa7a8004040 con 0x7fa7b8133fa0 2024-08-18T21:15:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7bf6ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7bf6ba640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7bf6ba640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:15:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7bf6ba640 1 -- 172.21.15.5:0/2223691649 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b806fd30 con 0x7fa7b8133fa0 2024-08-18T21:15:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7adffb640 1 --2- 172.21.15.5:0/2223691649 >> v2:172.21.15.157:6812/631023601 conn(0x7fa79c03bde0 0x7fa79c03e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7adffb640 1 -- 172.21.15.5:0/2223691649 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(331..331 src has 300..331) ==== 3506+0+0 (secure 0 0 0) 0x7fa7a80e7710 con 0x7fa7b8133fa0 2024-08-18T21:15:50.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7bd456640 1 --2- 172.21.15.5:0/2223691649 >> v2:172.21.15.157:6812/631023601 conn(0x7fa79c03bde0 0x7fa79c03e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.090+0000 7fa7bd456640 10 monclient: get_auth_request con 0x7fa79c03bde0 auth_method 0 2024-08-18T21:15:50.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.094+0000 7fa7bd456640 1 --2- 172.21.15.5:0/2223691649 >> v2:172.21.15.157:6812/631023601 conn(0x7fa79c03bde0 0x7fa79c03e2a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40099d0 tx=0x7fa7b4008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:50.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.094+0000 7fa7adffb640 1 -- 172.21.15.5:0/2223691649 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fa7b813e5c0 con 0x7fa7b8133fa0 2024-08-18T21:15:50.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.094+0000 7fa7adffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:50.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.094+0000 7fa7adffb640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:50.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.262+0000 7fa7bf6ba640 1 -- 172.21.15.5:0/2223691649 --> v2:172.21.15.157:6812/631023601 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fa7b8131870 con 0x7fa79c03bde0 2024-08-18T21:15:50.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.262+0000 7fa7adffb640 1 -- 172.21.15.5:0/2223691649 <== mgr.4130 v2:172.21.15.157:6812/631023601 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa7b8131870 con 0x7fa79c03bde0 2024-08-18T21:15:50.262 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 4 to deep-scrub 2024-08-18T21:15:50.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.266+0000 7fa7bf6ba640 1 -- 172.21.15.5:0/2223691649 >> v2:172.21.15.157:6812/631023601 conn(0x7fa79c03bde0 msgr2=0x7fa79c03e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.266+0000 7fa7bf6ba640 1 --2- 172.21.15.5:0/2223691649 >> v2:172.21.15.157:6812/631023601 conn(0x7fa79c03bde0 0x7fa79c03e2a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40099d0 tx=0x7fa7b4008040 comp rx=0 tx=0).stop 2024-08-18T21:15:50.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.266+0000 7fa7bf6ba640 10 monclient: shutdown 2024-08-18T21:15:50.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.266+0000 7fa7bf6ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:50.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.266+0000 7fa7bf6ba640 1 -- 172.21.15.5:0/2223691649 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7b8133fa0 msgr2=0x7fa7b8130f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.266+0000 7fa7bf6ba640 1 --2- 172.21.15.5:0/2223691649 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7b8133fa0 0x7fa7b8130f00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80097c0 tx=0x7fa7a80191c0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.266+0000 7fa7bf6ba640 1 -- 172.21.15.5:0/2223691649 shutdown_connections 2024-08-18T21:15:50.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.266+0000 7fa7bf6ba640 1 --2- 172.21.15.5:0/2223691649 >> v2:172.21.15.157:6812/631023601 conn(0x7fa79c03bde0 0x7fa79c03e2a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.266+0000 7fa7bf6ba640 1 --2- 172.21.15.5:0/2223691649 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7fa7b8134460 0x7fa7b813c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.266+0000 7fa7bf6ba640 1 --2- 172.21.15.5:0/2223691649 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7b8133fa0 0x7fa7b8130f00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.266+0000 7fa7bf6ba640 1 --2- 172.21.15.5:0/2223691649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7b8070270 0x7fa7b81d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.266+0000 7fa7bf6ba640 1 -- 172.21.15.5:0/2223691649 >> 172.21.15.5:0/2223691649 conn(0x7fa7b80a8a90 msgr2=0x7fa7b8132da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:50.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.266+0000 7fa7bf6ba640 1 -- 172.21.15.5:0/2223691649 shutdown_connections 2024-08-18T21:15:50.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.266+0000 7fa7bf6ba640 1 -- 172.21.15.5:0/2223691649 wait complete. 2024-08-18T21:15:50.283 INFO:tasks.ceph:Scrubbing osd.5 2024-08-18T21:15:50.283 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-18T21:15:50.406 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.406 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382516908}) 2024-08-18T21:15:50.406 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=387624245}) 2024-08-18T21:15:50.406 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.406 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382516908}) 2024-08-18T21:15:50.406 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2153618846}) 2024-08-18T21:15:50.406 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.406 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382516908}) 2024-08-18T21:15:50.407 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2608869138}) 2024-08-18T21:15:50.407 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.407 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382516908}) 2024-08-18T21:15:50.407 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3935951069}) 2024-08-18T21:15:50.407 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.407 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382516908}) 2024-08-18T21:15:50.407 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1455359729}) 2024-08-18T21:15:50.407 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.407 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382516908}) 2024-08-18T21:15:50.407 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1375915491}) 2024-08-18T21:15:50.407 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.408 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382516908}) 2024-08-18T21:15:50.408 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3432408357}) 2024-08-18T21:15:50.408 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.408 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382516908}) 2024-08-18T21:15:50.408 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.406+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3002076338}) 2024-08-18T21:15:50.423 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.423 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1867254396}) 2024-08-18T21:15:50.423 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1810705435}) 2024-08-18T21:15:50.423 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.424 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1867254396}) 2024-08-18T21:15:50.424 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2104009186}) 2024-08-18T21:15:50.424 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.424 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1867254396}) 2024-08-18T21:15:50.424 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3555442696}) 2024-08-18T21:15:50.424 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.424 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1867254396}) 2024-08-18T21:15:50.424 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1132756399}) 2024-08-18T21:15:50.424 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.424 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1867254396}) 2024-08-18T21:15:50.424 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2390667181}) 2024-08-18T21:15:50.424 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.425 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1867254396}) 2024-08-18T21:15:50.425 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2967146522}) 2024-08-18T21:15:50.425 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.425 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1867254396}) 2024-08-18T21:15:50.425 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2065626431}) 2024-08-18T21:15:50.425 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.425 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1867254396}) 2024-08-18T21:15:50.425 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.422+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3798282193}) 2024-08-18T21:15:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 10 monclient: get_monmap_and_config 2024-08-18T21:15:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 10 monclient: build_initial_monmap 2024-08-18T21:15:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 10 monclient: monmap: 2024-08-18T21:15:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:50.472927+0000 2024-08-18T21:15:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:50.472927+0000 2024-08-18T21:15:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:50.469 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 1 Processor -- start 2024-08-18T21:15:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 1 -- start start 2024-08-18T21:15:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 10 monclient: init 2024-08-18T21:15:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 10 monclient: _add_conns ranks=[3,7,5,0,4,10,2,6,8,1,9] 2024-08-18T21:15:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85e80a6b60 0x7f85e809eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 10 monclient(hunting): picked mon.noname-g con 0x7f85e80a6b60 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f85e80a6f40 0x7f85e80a7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 10 monclient(hunting): picked mon.noname-i con 0x7f85e80a6f40 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:15:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f85e8139920 0x7f85e8139d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 10 monclient(hunting): picked mon.noname-h con 0x7f85e8139920 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f85e809e410 con 0x7f85e80a6b60 2024-08-18T21:15:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f85e80a99e0 con 0x7f85e8139920 2024-08-18T21:15:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f85e80a7ed0 con 0x7f85e80a6f40 2024-08-18T21:15:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85edf96640 10 monclient(hunting): authenticate will time out at 1717.486123s 2024-08-18T21:15:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e7fff640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f85e8139920 0x7f85e8139d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f85e80a6f40 0x7f85e80a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e77fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85e80a6b60 0x7f85e809eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f85e80a6f40 0x7f85e80a7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:37938/0 (socket says 172.21.15.5:37938) 2024-08-18T21:15:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 1 -- 172.21.15.5:0/3145620314 learned_addr learned my addr 172.21.15.5:0/3145620314 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 10 monclient(hunting): get_auth_request con 0x7f85e80a6f40 auth_method 0 2024-08-18T21:15:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e7fff640 10 monclient(hunting): get_auth_request con 0x7f85e8139920 auth_method 0 2024-08-18T21:15:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e7fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e77fe640 10 monclient(hunting): get_auth_request con 0x7f85e80a6b60 auth_method 0 2024-08-18T21:15:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 10 monclient(hunting): handle_auth_done global_id 174184 payload 274 2024-08-18T21:15:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 1 -- 172.21.15.5:0/3145620314 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f85e8139920 msgr2=0x7f85e8139d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 1 --2- 172.21.15.5:0/3145620314 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f85e8139920 0x7f85e8139d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 1 -- 172.21.15.5:0/3145620314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85e80a6b60 msgr2=0x7f85e809eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 1 --2- 172.21.15.5:0/3145620314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85e80a6b60 0x7f85e809eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 10 monclient: _finish_hunting 0 2024-08-18T21:15:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 1 monclient: found mon.noname-i 2024-08-18T21:15:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:15:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e6ffd640 1 -- 172.21.15.5:0/3145620314 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e80a7c50 con 0x7f85e80a6f40 2024-08-18T21:15:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.470+0000 7f85e77fe640 1 --2- 172.21.15.5:0/3145620314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85e80a6b60 0x7f85e809eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:15:50.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.474+0000 7f85e6ffd640 1 -- 172.21.15.5:0/3145620314 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f85e80a6f40 msgr2=0x7f85e80a7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:50.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.474+0000 7f85e6ffd640 1 --2- 172.21.15.5:0/3145620314 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f85e80a6f40 0x7f85e80a7320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0098a0 tx=0x7f85dc01c440 comp rx=0 tx=0).ready entity=mon.7 client_cookie=6ba1b6175cee5ff1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:50.478 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.478 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=114877837}) 2024-08-18T21:15:50.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2165242848}) 2024-08-18T21:15:50.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=114877837}) 2024-08-18T21:15:50.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1660411683}) 2024-08-18T21:15:50.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=114877837}) 2024-08-18T21:15:50.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3120475329}) 2024-08-18T21:15:50.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=114877837}) 2024-08-18T21:15:50.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1027361657}) 2024-08-18T21:15:50.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.479 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=114877837}) 2024-08-18T21:15:50.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=226814424}) 2024-08-18T21:15:50.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=114877837}) 2024-08-18T21:15:50.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1365129002}) 2024-08-18T21:15:50.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=114877837}) 2024-08-18T21:15:50.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=867020730}) 2024-08-18T21:15:50.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:50.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=114877837}) 2024-08-18T21:15:50.480 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:50.478+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3909931072}) 2024-08-18T21:15:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e67fc640 1 -- 172.21.15.5:0/3145620314 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f85dc0b2070 con 0x7f85e80a6f40 2024-08-18T21:15:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e67fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:15:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e67fc640 10 monclient: dump: 2024-08-18T21:15:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:50.487 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e67fc640 10 monclient: _finish_auth 0 2024-08-18T21:15:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e67fc640 10 monclient: _check_auth_tickets 2024-08-18T21:15:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e67fc640 1 -- 172.21.15.5:0/3145620314 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85dc0ab7f0 con 0x7f85e80a6f40 2024-08-18T21:15:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 5 monclient: authenticate success, global_id 174184 2024-08-18T21:15:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:15:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e67fc640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 4 set_mon_vals no callback set 2024-08-18T21:15:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e67fc640 1 -- 172.21.15.5:0/3145620314 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f85dc0abe10 con 0x7f85e80a6f40 2024-08-18T21:15:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e67fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:15:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e67fc640 10 monclient: dump: 2024-08-18T21:15:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:50.489 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 10 monclient: shutdown 2024-08-18T21:15:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 -- 172.21.15.5:0/3145620314 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f85e80a6f40 msgr2=0x7f85e80a7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 --2- 172.21.15.5:0/3145620314 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f85e80a6f40 0x7f85e80a7320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0098a0 tx=0x7f85dc01c440 comp rx=0 tx=0).stop 2024-08-18T21:15:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 -- 172.21.15.5:0/3145620314 shutdown_connections 2024-08-18T21:15:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 --2- 172.21.15.5:0/3145620314 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f85e8139920 0x7f85e8139d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 --2- 172.21.15.5:0/3145620314 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f85e80a6f40 0x7f85e80a7320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 --2- 172.21.15.5:0/3145620314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85e80a6b60 0x7f85e809eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 -- 172.21.15.5:0/3145620314 >> 172.21.15.5:0/3145620314 conn(0x7f85e80ac920 msgr2=0x7f85e80a8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 -- 172.21.15.5:0/3145620314 shutdown_connections 2024-08-18T21:15:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 -- 172.21.15.5:0/3145620314 wait complete. 2024-08-18T21:15:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 10 monclient: build_initial_monmap 2024-08-18T21:15:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 10 monclient: monmap: 2024-08-18T21:15:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:50.491 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 Processor -- start 2024-08-18T21:15:50.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 -- start start 2024-08-18T21:15:50.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 10 monclient: init 2024-08-18T21:15:50.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:50.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 10 monclient: _add_conns ranks=[0,2,3,5,1,8,7,4,6] 2024-08-18T21:15:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e80a6b60 0x7f85e81d1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 10 monclient(hunting): picked mon.noname-a con 0x7f85e80a6b60 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:15:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f85e80a6f40 0x7f85e81389e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 10 monclient(hunting): picked mon.noname-b con 0x7f85e80a6f40 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85e8139920 0x7f85e813dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 10 monclient(hunting): picked mon.noname-g con 0x7f85e8139920 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f85e80a7860 con 0x7f85e80a6b60 2024-08-18T21:15:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f85e8143610 con 0x7f85e80a6f40 2024-08-18T21:15:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f85e813f0a0 con 0x7f85e8139920 2024-08-18T21:15:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85edf96640 10 monclient(hunting): authenticate will time out at 1717.503184s 2024-08-18T21:15:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e80a6b60 0x7f85e81d1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e80a6b60 0x7f85e81d1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53906/0 (socket says 172.21.15.5:53906) 2024-08-18T21:15:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 1 -- 172.21.15.5:0/3283785447 learned_addr learned my addr 172.21.15.5:0/3283785447 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 10 monclient(hunting): get_auth_request con 0x7f85e80a6b60 auth_method 0 2024-08-18T21:15:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e6ffd640 1 --2- 172.21.15.5:0/3283785447 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f85e80a6f40 0x7f85e81389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e6ffd640 10 monclient(hunting): get_auth_request con 0x7f85e80a6f40 auth_method 0 2024-08-18T21:15:50.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:50.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:50.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:50.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:50.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:50.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:50.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e7fff640 1 --2- 172.21.15.5:0/3283785447 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85e8139920 0x7f85e813dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 10 monclient(hunting): handle_auth_done global_id 124956 payload 824 2024-08-18T21:15:50.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 1 -- 172.21.15.5:0/3283785447 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85e8139920 msgr2=0x7f85e813dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 1 --2- 172.21.15.5:0/3283785447 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85e8139920 0x7f85e813dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 1 -- 172.21.15.5:0/3283785447 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f85e80a6f40 msgr2=0x7f85e81389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 1 --2- 172.21.15.5:0/3283785447 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f85e80a6f40 0x7f85e81389e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 10 monclient: _finish_hunting 0 2024-08-18T21:15:50.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 1 monclient: found mon.noname-a 2024-08-18T21:15:50.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:50.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2024-08-18T21:15:50.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e77fe640 1 -- 172.21.15.5:0/3283785447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e8124380 con 0x7f85e80a6b60 2024-08-18T21:15:50.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e7fff640 10 monclient: get_auth_request con 0x7f85e8139920 auth_method 0 2024-08-18T21:15:50.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e6ffd640 1 --2- 172.21.15.5:0/3283785447 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f85e80a6f40 0x7f85e81389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:15:50.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.486+0000 7f85e7fff640 1 --2- 172.21.15.5:0/3283785447 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85e8139920 0x7f85e813dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:15:50.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85e77fe640 1 -- 172.21.15.5:0/3283785447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e80a6b60 msgr2=0x7f85e81d1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:50.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85e77fe640 1 --2- 172.21.15.5:0/3283785447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e80a6b60 0x7f85e81d1610 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f85d800ebe0 tx=0x7f85d800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 1 -- 172.21.15.5:0/3283785447 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f85d8017070 con 0x7f85e80a6b60 2024-08-18T21:15:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-18T21:15:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 10 monclient: dump: 2024-08-18T21:15:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:50.502 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 10 monclient: _finish_auth 0 2024-08-18T21:15:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 10 monclient: _check_auth_tickets 2024-08-18T21:15:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85edf96640 5 monclient: authenticate success, global_id 124956 2024-08-18T21:15:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 1 -- 172.21.15.5:0/3283785447 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d800ce40 con 0x7f85e80a6b60 2024-08-18T21:15:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85edf96640 10 monclient: _renew_subs 2024-08-18T21:15:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 1 -- 172.21.15.5:0/3283785447 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f85d8013d50 con 0x7f85e80a6b60 2024-08-18T21:15:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85edf96640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:15:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85edf96640 1 -- 172.21.15.5:0/3283785447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e813f6c0 con 0x7f85e80a6b60 2024-08-18T21:15:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-18T21:15:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85e5ffb640 4 set_mon_vals no callback set 2024-08-18T21:15:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 10 monclient: dump: 2024-08-18T21:15:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:50.504 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85edf96640 10 monclient: _renew_subs 2024-08-18T21:15:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85edf96640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:15:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85edf96640 1 -- 172.21.15.5:0/3283785447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e8123dc0 con 0x7f85e80a6b60 2024-08-18T21:15:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85edf96640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2024-08-18T21:15:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85edf96640 1 -- 172.21.15.5:0/3283785447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f85e80ab070 con 0x7f85e80a6b60 2024-08-18T21:15:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 1 -- 172.21.15.5:0/3283785447 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f85d801a070 con 0x7f85e80a6b60 2024-08-18T21:15:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 1 --2- 172.21.15.5:0/3283785447 >> v2:172.21.15.157:6812/631023601 conn(0x7f85d403bdc0 0x7f85d403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 1 -- 172.21.15.5:0/3283785447 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(331..331 src has 300..331) ==== 3506+0+0 (secure 0 0 0) 0x7f85d800f040 con 0x7f85e80a6b60 2024-08-18T21:15:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 1 --2- 172.21.15.5:0/3283785447 >> v2:172.21.15.157:6800/2335500119 conn(0x7f85d40418d0 0x7f85d4043cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 1 -- 172.21.15.5:0/3283785447 --> v2:172.21.15.157:6800/2335500119 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85d801ae50 con 0x7f85d40418d0 2024-08-18T21:15:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 1 -- 172.21.15.5:0/3283785447 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=331) ==== 24+0+0 (secure 0 0 0) 0x7f85d8055050 con 0x7f85e80a6b60 2024-08-18T21:15:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.490+0000 7f85cffff640 10 monclient: handle_get_version_reply finishing 1 version 331 2024-08-18T21:15:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.494+0000 7f85e6ffd640 1 --2- 172.21.15.5:0/3283785447 >> v2:172.21.15.157:6812/631023601 conn(0x7f85d403bdc0 0x7f85d403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.494+0000 7f85e6ffd640 10 monclient: get_auth_request con 0x7f85d403bdc0 auth_method 0 2024-08-18T21:15:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.494+0000 7f85e7fff640 1 --2- 172.21.15.5:0/3283785447 >> v2:172.21.15.157:6800/2335500119 conn(0x7f85d40418d0 0x7f85d4043cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.494+0000 7f85e7fff640 10 monclient: get_auth_request con 0x7f85d40418d0 auth_method 0 2024-08-18T21:15:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.494+0000 7f85e6ffd640 1 --2- 172.21.15.5:0/3283785447 >> v2:172.21.15.157:6812/631023601 conn(0x7f85d403bdc0 0x7f85d403e280 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0ac000 tx=0x7f85dc0a7000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.498+0000 7f85e7fff640 1 --2- 172.21.15.5:0/3283785447 >> v2:172.21.15.157:6800/2335500119 conn(0x7f85d40418d0 0x7f85d4043cf0 crc :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.498+0000 7f85cffff640 1 -- 172.21.15.5:0/3283785447 <== osd.5 v2:172.21.15.157:6800/2335500119 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85d801ae50 con 0x7f85d40418d0 2024-08-18T21:15:50.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.514+0000 7f85edf96640 1 -- 172.21.15.5:0/3283785447 --> v2:172.21.15.157:6800/2335500119 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f85e8139170 con 0x7f85d40418d0 2024-08-18T21:15:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.514+0000 7f85cffff640 1 -- 172.21.15.5:0/3283785447 <== osd.5 v2:172.21.15.157:6800/2335500119 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f85e8139170 con 0x7f85d40418d0 2024-08-18T21:15:50.512 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T21:15:50.512 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T21:15:50.512 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T21:15:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.514+0000 7f85edf96640 1 -- 172.21.15.5:0/3283785447 >> v2:172.21.15.157:6800/2335500119 conn(0x7f85d40418d0 msgr2=0x7f85d4043cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.514+0000 7f85edf96640 1 --2- 172.21.15.5:0/3283785447 >> v2:172.21.15.157:6800/2335500119 conn(0x7f85d40418d0 0x7f85d4043cf0 crc :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.514+0000 7f85edf96640 1 -- 172.21.15.5:0/3283785447 >> v2:172.21.15.157:6812/631023601 conn(0x7f85d403bdc0 msgr2=0x7f85d403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.514+0000 7f85edf96640 1 --2- 172.21.15.5:0/3283785447 >> v2:172.21.15.157:6812/631023601 conn(0x7f85d403bdc0 0x7f85d403e280 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0ac000 tx=0x7f85dc0a7000 comp rx=0 tx=0).stop 2024-08-18T21:15:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.514+0000 7f85edf96640 10 monclient: shutdown 2024-08-18T21:15:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.514+0000 7f85edf96640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.514+0000 7f85edf96640 1 -- 172.21.15.5:0/3283785447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e80a6b60 msgr2=0x7f85e81d1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.514+0000 7f85edf96640 1 --2- 172.21.15.5:0/3283785447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e80a6b60 0x7f85e81d1610 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f85d800ebe0 tx=0x7f85d800c520 comp rx=0 tx=0).stop 2024-08-18T21:15:50.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.514+0000 7f85e7fff640 1 -- 172.21.15.5:0/3283785447 reap_dead start 2024-08-18T21:15:50.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.514+0000 7f85edf96640 1 -- 172.21.15.5:0/3283785447 shutdown_connections 2024-08-18T21:15:50.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.514+0000 7f85edf96640 1 -- 172.21.15.5:0/3283785447 >> 172.21.15.5:0/3283785447 conn(0x7f85e80ac920 msgr2=0x7f85e80ab9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:50.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.514+0000 7f85edf96640 1 -- 172.21.15.5:0/3283785447 shutdown_connections 2024-08-18T21:15:50.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.514+0000 7f85edf96640 1 -- 172.21.15.5:0/3283785447 wait complete. 2024-08-18T21:15:50.529 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-18T21:15:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.646+0000 7f8930ea3640 10 monclient: get_monmap_and_config 2024-08-18T21:15:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.646+0000 7f8930ea3640 10 monclient: build_initial_monmap 2024-08-18T21:15:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.646+0000 7f8930ea3640 10 monclient: monmap: 2024-08-18T21:15:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:50.651234+0000 2024-08-18T21:15:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:50.651234+0000 2024-08-18T21:15:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:50.647 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.646+0000 7f8930ea3640 1 Processor -- start 2024-08-18T21:15:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.646+0000 7f8930ea3640 1 -- start start 2024-08-18T21:15:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.646+0000 7f8930ea3640 10 monclient: init 2024-08-18T21:15:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f8930ea3640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f8930ea3640 10 monclient: _add_conns ranks=[0,1,10,8,3,5,7,9,2,6,4] 2024-08-18T21:15:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f8930ea3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f892c0a59e0 addr v1:172.21.15.5:6789/0 2024-08-18T21:15:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f8930ea3640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f892c0a64d0 addr v1:172.21.15.157:6789/0 2024-08-18T21:15:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f8930ea3640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f892c13e1d0 0x7f892c1405c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f8930ea3640 10 monclient(hunting): picked mon.noname-f con 0x7f892c13e1d0 addr v2:172.21.15.157:3300/0 2024-08-18T21:15:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f8930ea3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f892c0a38b0 con 0x7f892c0a59e0 2024-08-18T21:15:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f8930ea3640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f892c0a35d0 con 0x7f892c0a64d0 2024-08-18T21:15:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f8930ea3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f8930ea3640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f892c0a0f40 con 0x7f892c13e1d0 2024-08-18T21:15:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f8930ea3640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f8930ea3640 10 monclient(hunting): authenticate will time out at 1717.664456s 2024-08-18T21:15:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892a59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f892c0a59e0 0x7f892c0a5dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36196/0 (socket says 172.21.15.5:36196) 2024-08-18T21:15:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892a59c640 1 -- 172.21.15.5:0/3256389754 learned_addr learned my addr 172.21.15.5:0/3256389754 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T21:15:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892ad9d640 1 --2- 172.21.15.5:0/3256389754 >> v2:172.21.15.157:3300/0 conn(0x7f892c13e1d0 0x7f892c1405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892ad9d640 10 monclient(hunting): get_auth_request con 0x7f892c13e1d0 auth_method 0 2024-08-18T21:15:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892ad9d640 10 monclient(hunting): handle_auth_done global_id 174187 payload 274 2024-08-18T21:15:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892ad9d640 1 -- 172.21.15.5:0/3256389754 >> v1:172.21.15.157:6789/0 conn(0x7f892c0a64d0 legacy=0x7f892c13cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892ad9d640 1 -- 172.21.15.5:0/3256389754 >> v1:172.21.15.5:6789/0 conn(0x7f892c0a59e0 legacy=0x7f892c0a5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892ad9d640 10 monclient: _finish_hunting 0 2024-08-18T21:15:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892ad9d640 1 monclient: found mon.noname-f 2024-08-18T21:15:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892ad9d640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.157:3300/0 2024-08-18T21:15:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.650+0000 7f892ad9d640 1 -- 172.21.15.5:0/3256389754 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892c0a7530 con 0x7f892c13e1d0 2024-08-18T21:15:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f892ad9d640 1 -- 172.21.15.5:0/3256389754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f892c13e1d0 msgr2=0x7f892c1405c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f892ad9d640 1 --2- 172.21.15.5:0/3256389754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f892c13e1d0 0x7f892c1405c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f89240097c0 tx=0x7f892401c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8329120bee1def4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f892959a640 1 -- 172.21.15.5:0/3256389754 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f89240b0070 con 0x7f892c13e1d0 2024-08-18T21:15:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f892959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f892959a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-18T21:15:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f892959a640 10 monclient: dump: 2024-08-18T21:15:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:50.656 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f892959a640 10 monclient: _finish_auth 0 2024-08-18T21:15:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f892959a640 10 monclient: _check_auth_tickets 2024-08-18T21:15:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f892959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f892959a640 1 -- 172.21.15.5:0/3256389754 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89240aa810 con 0x7f892c13e1d0 2024-08-18T21:15:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f892959a640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f892959a640 1 -- 172.21.15.5:0/3256389754 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f89240aae30 con 0x7f892c13e1d0 2024-08-18T21:15:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f8930ea3640 5 monclient: authenticate success, global_id 174187 2024-08-18T21:15:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f8930ea3640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f8930ea3640 4 set_mon_vals no callback set 2024-08-18T21:15:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f892959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f892959a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-18T21:15:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f892959a640 10 monclient: dump: 2024-08-18T21:15:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:50.658 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f8930ea3640 10 monclient: shutdown 2024-08-18T21:15:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f8930ea3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f8930ea3640 1 -- 172.21.15.5:0/3256389754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f892c13e1d0 msgr2=0x7f892c1405c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f8930ea3640 1 --2- 172.21.15.5:0/3256389754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f892c13e1d0 0x7f892c1405c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f89240097c0 tx=0x7f892401c360 comp rx=0 tx=0).stop 2024-08-18T21:15:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f8930ea3640 1 -- 172.21.15.5:0/3256389754 shutdown_connections 2024-08-18T21:15:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f8930ea3640 1 --2- 172.21.15.5:0/3256389754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f892c13e1d0 0x7f892c1405c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f8930ea3640 1 -- 172.21.15.5:0/3256389754 >> 172.21.15.5:0/3256389754 conn(0x7f892c0aa5d0 msgr2=0x7f892c0a6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:50.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f8930ea3640 1 -- 172.21.15.5:0/3256389754 shutdown_connections 2024-08-18T21:15:50.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.654+0000 7f8930ea3640 1 -- 172.21.15.5:0/3256389754 wait complete. 2024-08-18T21:15:50.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 10 monclient: build_initial_monmap 2024-08-18T21:15:50.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 10 monclient: monmap: 2024-08-18T21:15:50.663 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:50.663 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:50.663 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:50.663 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:50.663 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:50.663 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.663 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:50.663 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:50.663 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:50.663 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:50.663 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:50.663 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:50.664 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 1 Processor -- start 2024-08-18T21:15:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 1 -- start start 2024-08-18T21:15:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 10 monclient: init 2024-08-18T21:15:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 10 monclient: _add_conns ranks=[8,3,0,1,7,5,2,4,6] 2024-08-18T21:15:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f892c0a59e0 0x7f892c121a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 10 monclient(hunting): picked mon.noname-e con 0x7f892c0a59e0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f892c0a64d0 0x7f892c1d2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 10 monclient(hunting): picked mon.noname-g con 0x7f892c0a64d0 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f892c13e1d0 0x7f892c120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 10 monclient(hunting): picked mon.noname-a con 0x7f892c13e1d0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2024-08-18T21:15:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f892c1438b0 con 0x7f892c13e1d0 2024-08-18T21:15:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f892c143730 con 0x7f892c0a64d0 2024-08-18T21:15:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7f892c143a30 con 0x7f892c0a59e0 2024-08-18T21:15:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8930ea3640 10 monclient(hunting): authenticate will time out at 1717.673139s 2024-08-18T21:15:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f892c0a59e0 0x7f892c121a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f892c13e1d0 0x7f892c120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f892c0a59e0 0x7f892c121a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3304/0 says I am v2:172.21.15.5:54000/0 (socket says 172.21.15.5:54000) 2024-08-18T21:15:50.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 1 -- 172.21.15.5:0/1471671587 learned_addr learned my addr 172.21.15.5:0/1471671587 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:50.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 10 monclient(hunting): get_auth_request con 0x7f892c0a59e0 auth_method 0 2024-08-18T21:15:50.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892ad9d640 10 monclient(hunting): get_auth_request con 0x7f892c13e1d0 auth_method 0 2024-08-18T21:15:50.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:50.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:50.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:50.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 10 monclient(hunting): handle_auth_done global_id 115433 payload 824 2024-08-18T21:15:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8929d9b640 1 --2- 172.21.15.5:0/1471671587 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f892c0a64d0 0x7f892c1d2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 1 -- 172.21.15.5:0/1471671587 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f892c0a64d0 msgr2=0x7f892c1d2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 1 --2- 172.21.15.5:0/1471671587 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f892c0a64d0 0x7f892c1d2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 1 -- 172.21.15.5:0/1471671587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f892c13e1d0 msgr2=0x7f892c120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 1 --2- 172.21.15.5:0/1471671587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f892c13e1d0 0x7f892c120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 10 monclient: _finish_hunting 0 2024-08-18T21:15:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 1 monclient: found mon.noname-e 2024-08-18T21:15:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.5:3304/0 2024-08-18T21:15:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 1 -- 172.21.15.5:0/1471671587 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892c0a56a0 con 0x7f892c0a59e0 2024-08-18T21:15:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8929d9b640 10 monclient: get_auth_request con 0x7f892c0a64d0 auth_method 0 2024-08-18T21:15:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892ad9d640 1 --2- 172.21.15.5:0/1471671587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f892c13e1d0 0x7f892c120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:15:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f8929d9b640 1 --2- 172.21.15.5:0/1471671587 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f892c0a64d0 0x7f892c1d2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:15:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 1 -- 172.21.15.5:0/1471671587 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f892c0a59e0 msgr2=0x7f892c121a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.658+0000 7f892a59c640 1 --2- 172.21.15.5:0/1471671587 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f892c0a59e0 0x7f892c121a00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f891c00cc10 tx=0x7f891c00a430 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f891affd640 1 -- 172.21.15.5:0/1471671587 <== mon.8 v2:172.21.15.5:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f891c00ad50 con 0x7f892c0a59e0 2024-08-18T21:15:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f891affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f891affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-18T21:15:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f891affd640 10 monclient: dump: 2024-08-18T21:15:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:50.669 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f891affd640 10 monclient: _finish_auth 0 2024-08-18T21:15:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f891affd640 10 monclient: _check_auth_tickets 2024-08-18T21:15:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f891affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f891affd640 1 -- 172.21.15.5:0/1471671587 <== mon.8 v2:172.21.15.5:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891c012870 con 0x7f892c0a59e0 2024-08-18T21:15:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f891affd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f891affd640 1 -- 172.21.15.5:0/1471671587 <== mon.8 v2:172.21.15.5:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f891c007070 con 0x7f892c0a59e0 2024-08-18T21:15:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f891affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f891affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-18T21:15:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f891affd640 10 monclient: dump: 2024-08-18T21:15:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:50.671 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:50.671 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:50.671 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:50.671 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:50.671 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:50.671 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:50.671 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:50.671 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f8928d99640 4 set_mon_vals no callback set 2024-08-18T21:15:50.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f8930ea3640 5 monclient: authenticate success, global_id 115433 2024-08-18T21:15:50.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f8930ea3640 10 monclient: _renew_subs 2024-08-18T21:15:50.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f8930ea3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:50.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f8930ea3640 1 -- 172.21.15.5:0/1471671587 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892c140660 con 0x7f892c0a59e0 2024-08-18T21:15:50.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f8930ea3640 10 monclient: _renew_subs 2024-08-18T21:15:50.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f8930ea3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:50.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f8930ea3640 1 -- 172.21.15.5:0/1471671587 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f892c122f20 con 0x7f892c0a59e0 2024-08-18T21:15:50.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f891affd640 1 -- 172.21.15.5:0/1471671587 <== mon.8 v2:172.21.15.5:3304/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f891c012400 con 0x7f892c0a59e0 2024-08-18T21:15:50.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f8930ea3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:50.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f8930ea3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:50.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f8930ea3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.5:3304/0 2024-08-18T21:15:50.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f8930ea3640 1 -- 172.21.15.5:0/1471671587 --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f892c1c88c0 con 0x7f892c0a59e0 2024-08-18T21:15:50.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f891affd640 1 --2- 172.21.15.5:0/1471671587 >> v2:172.21.15.157:6812/631023601 conn(0x7f890c03bdf0 0x7f890c03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f891affd640 1 -- 172.21.15.5:0/1471671587 <== mon.8 v2:172.21.15.5:3304/0 5 ==== osd_map(331..331 src has 300..331) ==== 3506+0+0 (secure 0 0 0) 0x7f891c04ec40 con 0x7f892c0a59e0 2024-08-18T21:15:50.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f8929d9b640 1 --2- 172.21.15.5:0/1471671587 >> v2:172.21.15.157:6812/631023601 conn(0x7f890c03bdf0 0x7f890c03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.662+0000 7f8929d9b640 10 monclient: get_auth_request con 0x7f890c03bdf0 auth_method 0 2024-08-18T21:15:50.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.666+0000 7f8929d9b640 1 --2- 172.21.15.5:0/1471671587 >> v2:172.21.15.157:6812/631023601 conn(0x7f890c03bdf0 0x7f890c03e2b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f892c0a02f0 tx=0x7f8920009040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:50.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.666+0000 7f891affd640 1 -- 172.21.15.5:0/1471671587 <== mon.8 v2:172.21.15.5:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f892c140660 con 0x7f892c0a59e0 2024-08-18T21:15:50.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.666+0000 7f891affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:50.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.666+0000 7f891affd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.834+0000 7f8930ea3640 1 -- 172.21.15.5:0/1471671587 --> v2:172.21.15.157:6812/631023601 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f892c0a5dc0 con 0x7f890c03bdf0 2024-08-18T21:15:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.834+0000 7f891affd640 1 -- 172.21.15.5:0/1471671587 <== mgr.4130 v2:172.21.15.157:6812/631023601 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f892c0a5dc0 con 0x7f890c03bdf0 2024-08-18T21:15:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 5 to deep-scrub 2024-08-18T21:15:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.838+0000 7f8930ea3640 1 -- 172.21.15.5:0/1471671587 >> v2:172.21.15.157:6812/631023601 conn(0x7f890c03bdf0 msgr2=0x7f890c03e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.838+0000 7f8930ea3640 1 --2- 172.21.15.5:0/1471671587 >> v2:172.21.15.157:6812/631023601 conn(0x7f890c03bdf0 0x7f890c03e2b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f892c0a02f0 tx=0x7f8920009040 comp rx=0 tx=0).stop 2024-08-18T21:15:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.838+0000 7f8930ea3640 10 monclient: shutdown 2024-08-18T21:15:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.838+0000 7f8930ea3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.838+0000 7f8930ea3640 1 -- 172.21.15.5:0/1471671587 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f892c0a59e0 msgr2=0x7f892c121a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.838+0000 7f8930ea3640 1 --2- 172.21.15.5:0/1471671587 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f892c0a59e0 0x7f892c121a00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f891c00cc10 tx=0x7f891c00a430 comp rx=0 tx=0).stop 2024-08-18T21:15:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.838+0000 7f8930ea3640 1 -- 172.21.15.5:0/1471671587 shutdown_connections 2024-08-18T21:15:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.838+0000 7f8930ea3640 1 --2- 172.21.15.5:0/1471671587 >> v2:172.21.15.157:6812/631023601 conn(0x7f890c03bdf0 0x7f890c03e2b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.838+0000 7f8930ea3640 1 --2- 172.21.15.5:0/1471671587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f892c13e1d0 0x7f892c120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.838+0000 7f8930ea3640 1 --2- 172.21.15.5:0/1471671587 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f892c0a64d0 0x7f892c1d2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.838+0000 7f8930ea3640 1 --2- 172.21.15.5:0/1471671587 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7f892c0a59e0 0x7f892c121a00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.838+0000 7f8930ea3640 1 -- 172.21.15.5:0/1471671587 >> 172.21.15.5:0/1471671587 conn(0x7f892c0aa5d0 msgr2=0x7f892c13e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.838+0000 7f8930ea3640 1 -- 172.21.15.5:0/1471671587 shutdown_connections 2024-08-18T21:15:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.838+0000 7f8930ea3640 1 -- 172.21.15.5:0/1471671587 wait complete. 2024-08-18T21:15:50.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T21:15:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.962+0000 7ff92872e640 10 monclient: get_monmap_and_config 2024-08-18T21:15:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.962+0000 7ff92872e640 10 monclient: build_initial_monmap 2024-08-18T21:15:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.962+0000 7ff92872e640 10 monclient: monmap: 2024-08-18T21:15:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:15:50.967563+0000 2024-08-18T21:15:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:15:50.967563+0000 2024-08-18T21:15:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:15:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:15:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:15:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:15:50.963 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.962+0000 7ff92872e640 1 Processor -- start 2024-08-18T21:15:50.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 1 -- start start 2024-08-18T21:15:50.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 10 monclient: init 2024-08-18T21:15:50.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 10 monclient: _add_conns ranks=[8,9,2,3,5,10,7,4,6,0,1] 2024-08-18T21:15:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 1 --2- >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff9200a6bd0 0x7ff9200a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 10 monclient(hunting): picked mon.noname-e con 0x7ff9200a6bd0 addr [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] 2024-08-18T21:15:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff92009f080 0x7ff9200a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 10 monclient(hunting): picked mon.noname-a con 0x7ff92009f080 addr v2:172.21.15.5:3300/0 2024-08-18T21:15:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff920139990 0x7ff920139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 10 monclient(hunting): picked mon.noname-b con 0x7ff920139990 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:15:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff92009e4c0 con 0x7ff92009f080 2024-08-18T21:15:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7ff92006f930 con 0x7ff920139990 2024-08-18T21:15:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 1 -- --> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] -- mon_getmap magic: 0 -- 0x7ff9200a7a30 con 0x7ff9200a6bd0 2024-08-18T21:15:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff92872e640 10 monclient(hunting): authenticate will time out at 1717.980684s 2024-08-18T21:15:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff925cc9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff92009f080 0x7ff9200a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff920139990 0x7ff920139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff925cc9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff92009f080 0x7ff9200a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53914/0 (socket says 172.21.15.5:53914) 2024-08-18T21:15:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff920139990 0x7ff920139e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:33940/0 (socket says 172.21.15.5:33940) 2024-08-18T21:15:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff925cc9640 1 -- 172.21.15.5:0/4269864449 learned_addr learned my addr 172.21.15.5:0/4269864449 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff9264ca640 1 --2- 172.21.15.5:0/4269864449 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff9200a6bd0 0x7ff9200a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff925cc9640 10 monclient(hunting): get_auth_request con 0x7ff92009f080 auth_method 0 2024-08-18T21:15:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff925cc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff925cc9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff925cc9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 10 monclient(hunting): get_auth_request con 0x7ff920139990 auth_method 0 2024-08-18T21:15:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff9264ca640 10 monclient(hunting): get_auth_request con 0x7ff9200a6bd0 auth_method 0 2024-08-18T21:15:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff9264ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff9264ca640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff9264ca640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff925cc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff925cc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff925cc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff9264ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff9264ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:50.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff9264ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:50.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 10 monclient(hunting): handle_auth_done global_id 115301 payload 274 2024-08-18T21:15:50.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 1 -- 172.21.15.5:0/4269864449 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff9200a6bd0 msgr2=0x7ff9200a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:50.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 1 --2- 172.21.15.5:0/4269864449 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff9200a6bd0 0x7ff9200a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 1 -- 172.21.15.5:0/4269864449 >> v2:172.21.15.5:3300/0 conn(0x7ff92009f080 msgr2=0x7ff9200a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:15:50.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 1 --2- 172.21.15.5:0/4269864449 >> v2:172.21.15.5:3300/0 conn(0x7ff92009f080 0x7ff9200a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 10 monclient: _finish_hunting 0 2024-08-18T21:15:50.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 1 monclient: found mon.noname-b 2024-08-18T21:15:50.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:50.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:15:50.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff926ccb640 1 -- 172.21.15.5:0/4269864449 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9200a7fb0 con 0x7ff920139990 2024-08-18T21:15:50.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.966+0000 7ff925cc9640 1 --2- 172.21.15.5:0/4269864449 >> v2:172.21.15.5:3300/0 conn(0x7ff92009f080 0x7ff9200a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:15:50.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff926ccb640 1 -- 172.21.15.5:0/4269864449 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff920139990 msgr2=0x7ff920139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:50.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff926ccb640 1 --2- 172.21.15.5:0/4269864449 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff920139990 0x7ff920139e10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff918009d90 tx=0x7ff91801c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8651318d5fd5cf13 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:50.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff9254c8640 1 -- 172.21.15.5:0/4269864449 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff9180b2070 con 0x7ff920139990 2024-08-18T21:15:50.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff9254c8640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:50.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff9254c8640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:15:50.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff9254c8640 10 monclient: dump: 2024-08-18T21:15:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:50.978 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff9254c8640 10 monclient: _finish_auth 0 2024-08-18T21:15:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff9254c8640 10 monclient: _check_auth_tickets 2024-08-18T21:15:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff9254c8640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff9254c8640 1 -- 172.21.15.5:0/4269864449 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9180a59d0 con 0x7ff920139990 2024-08-18T21:15:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff9254c8640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff9254c8640 1 -- 172.21.15.5:0/4269864449 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff9180ab340 con 0x7ff920139990 2024-08-18T21:15:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 5 monclient: authenticate success, global_id 115301 2024-08-18T21:15:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 10 monclient: get_monmap_and_config success 2024-08-18T21:15:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 4 set_mon_vals no callback set 2024-08-18T21:15:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff9254c8640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff9254c8640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:15:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff9254c8640 10 monclient: dump: 2024-08-18T21:15:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:50.980 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 10 monclient: shutdown 2024-08-18T21:15:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 -- 172.21.15.5:0/4269864449 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff920139990 msgr2=0x7ff920139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 --2- 172.21.15.5:0/4269864449 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff920139990 0x7ff920139e10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff918009d90 tx=0x7ff91801c830 comp rx=0 tx=0).stop 2024-08-18T21:15:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 -- 172.21.15.5:0/4269864449 shutdown_connections 2024-08-18T21:15:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 --2- 172.21.15.5:0/4269864449 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff920139990 0x7ff920139e10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 --2- 172.21.15.5:0/4269864449 >> v2:172.21.15.5:3300/0 conn(0x7ff92009f080 0x7ff9200a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 --2- 172.21.15.5:0/4269864449 >> [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] conn(0x7ff9200a6bd0 0x7ff9200a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 -- 172.21.15.5:0/4269864449 >> 172.21.15.5:0/4269864449 conn(0x7ff920068700 msgr2=0x7ff920068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 -- 172.21.15.5:0/4269864449 shutdown_connections 2024-08-18T21:15:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 -- 172.21.15.5:0/4269864449 wait complete. 2024-08-18T21:15:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 10 monclient: build_initial_monmap 2024-08-18T21:15:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 10 monclient: monmap: 2024-08-18T21:15:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:15:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:15:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:15:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:15:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:15:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:15:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:15:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:15:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:15:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:15:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:15:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:15:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:15:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:15:50.982 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 Processor -- start 2024-08-18T21:15:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 -- start start 2024-08-18T21:15:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 10 monclient: init 2024-08-18T21:15:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 10 monclient: _reopen_session rank -1 2024-08-18T21:15:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 10 monclient: _add_conns ranks=[5,4,3,1,2,0,8,7,6] 2024-08-18T21:15:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff92009f080 0x7ff9201382f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 10 monclient(hunting): picked mon.noname-h con 0x7ff92009f080 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:15:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff9200a6bd0 0x7ff920138830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 10 monclient(hunting): picked mon.noname-c con 0x7ff9200a6bd0 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:15:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff920139990 0x7ff92013dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 10 monclient(hunting): picked mon.noname-g con 0x7ff920139990 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:15:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff9200a89f0 con 0x7ff920139990 2024-08-18T21:15:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7ff9200a7ce0 con 0x7ff9200a6bd0 2024-08-18T21:15:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 10 monclient(hunting): start opening mon connection 2024-08-18T21:15:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7ff920143610 con 0x7ff92009f080 2024-08-18T21:15:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 10 monclient(hunting): _renew_subs 2024-08-18T21:15:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff92872e640 10 monclient(hunting): authenticate will time out at 1717.987871s 2024-08-18T21:15:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.970+0000 7ff925cc9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff9200a6bd0 0x7ff920138830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff9200a6bd0 0x7ff920138830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:38602/0 (socket says 172.21.15.5:38602) 2024-08-18T21:15:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 1 -- 172.21.15.5:0/3540124984 learned_addr learned my addr 172.21.15.5:0/3540124984 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:15:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 10 monclient(hunting): get_auth_request con 0x7ff9200a6bd0 auth_method 0 2024-08-18T21:15:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:15:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:15:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:15:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:15:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:15:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:15:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff9264ca640 1 --2- 172.21.15.5:0/3540124984 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff92009f080 0x7ff9201382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 10 monclient(hunting): handle_auth_done global_id 115114 payload 824 2024-08-18T21:15:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff926ccb640 1 --2- 172.21.15.5:0/3540124984 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff920139990 0x7ff92013dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 1 -- 172.21.15.5:0/3540124984 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff92009f080 msgr2=0x7ff9201382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 1 --2- 172.21.15.5:0/3540124984 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff92009f080 0x7ff9201382f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 1 -- 172.21.15.5:0/3540124984 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff920139990 msgr2=0x7ff92013dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 1 --2- 172.21.15.5:0/3540124984 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff920139990 0x7ff92013dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 10 monclient: _finish_hunting 0 2024-08-18T21:15:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 1 monclient: found mon.noname-c 2024-08-18T21:15:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:15:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:15:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 1 -- 172.21.15.5:0/3540124984 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9200ab660 con 0x7ff9200a6bd0 2024-08-18T21:15:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 1 -- 172.21.15.5:0/3540124984 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff9200a6bd0 msgr2=0x7ff920138830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:15:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff925cc9640 1 --2- 172.21.15.5:0/3540124984 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff9200a6bd0 0x7ff920138830 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff91000e980 tx=0x7ff91000ee40 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff916ffd640 1 -- 172.21.15.5:0/3540124984 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff9100044a0 con 0x7ff9200a6bd0 2024-08-18T21:15:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff916ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff916ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:15:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff916ffd640 10 monclient: dump: 2024-08-18T21:15:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:50.987 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff916ffd640 10 monclient: _finish_auth 0 2024-08-18T21:15:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff916ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:15:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff916ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:15:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff92872e640 5 monclient: authenticate success, global_id 115114 2024-08-18T21:15:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff916ffd640 1 -- 172.21.15.5:0/3540124984 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff91000cc10 con 0x7ff9200a6bd0 2024-08-18T21:15:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff92872e640 10 monclient: _renew_subs 2024-08-18T21:15:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff92872e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:15:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff92872e640 1 -- 172.21.15.5:0/3540124984 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff920124220 con 0x7ff9200a6bd0 2024-08-18T21:15:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff916ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:15:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff916ffd640 1 -- 172.21.15.5:0/3540124984 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff91000cdc0 con 0x7ff9200a6bd0 2024-08-18T21:15:50.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff916ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:15:50.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff916ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:15:50.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff916ffd640 10 monclient: dump: 2024-08-18T21:15:50.988 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:15:50.988 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:15:50.988 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.988 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:15:50.988 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:15:50.988 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:15:50.988 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:15:50.988 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:15:50.988 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:15:50.988 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:15:50.988 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:15:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:15:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:15:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:15:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:15:50.989 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:15:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff917fff640 4 set_mon_vals no callback set 2024-08-18T21:15:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff92872e640 10 monclient: _renew_subs 2024-08-18T21:15:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff92872e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:15:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff92872e640 1 -- 172.21.15.5:0/3540124984 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7ff920123f40 con 0x7ff9200a6bd0 2024-08-18T21:15:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff92872e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff92872e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff92872e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:15:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff92872e640 1 -- 172.21.15.5:0/3540124984 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff920139e10 con 0x7ff9200a6bd0 2024-08-18T21:15:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff916ffd640 1 -- 172.21.15.5:0/3540124984 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7ff910004030 con 0x7ff9200a6bd0 2024-08-18T21:15:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff916ffd640 1 --2- 172.21.15.5:0/3540124984 >> v2:172.21.15.157:6812/631023601 conn(0x7ff90403bdc0 0x7ff90403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:15:50.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.974+0000 7ff916ffd640 1 -- 172.21.15.5:0/3540124984 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(331..331 src has 300..331) ==== 3506+0+0 (secure 0 0 0) 0x7ff91000f040 con 0x7ff9200a6bd0 2024-08-18T21:15:50.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.978+0000 7ff9264ca640 1 --2- 172.21.15.5:0/3540124984 >> v2:172.21.15.157:6812/631023601 conn(0x7ff90403bdc0 0x7ff90403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:15:50.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.978+0000 7ff9264ca640 10 monclient: get_auth_request con 0x7ff90403bdc0 auth_method 0 2024-08-18T21:15:50.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.978+0000 7ff9264ca640 1 --2- 172.21.15.5:0/3540124984 >> v2:172.21.15.157:6812/631023601 conn(0x7ff90403bdc0 0x7ff90403e280 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0099b0 tx=0x7ff91c008040 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:15:50.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.982+0000 7ff916ffd640 1 -- 172.21.15.5:0/3540124984 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7ff9200ab660 con 0x7ff9200a6bd0 2024-08-18T21:15:50.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.982+0000 7ff916ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:15:50.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:50.982+0000 7ff916ffd640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:15:51.142 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.142 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2118210641}) 2024-08-18T21:15:51.142 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1115604317}) 2024-08-18T21:15:51.142 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.142 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2118210641}) 2024-08-18T21:15:51.143 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2698865531}) 2024-08-18T21:15:51.143 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.143 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2118210641}) 2024-08-18T21:15:51.143 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2899647648}) 2024-08-18T21:15:51.143 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.143 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2118210641}) 2024-08-18T21:15:51.143 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=875163195}) 2024-08-18T21:15:51.143 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.143 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2118210641}) 2024-08-18T21:15:51.143 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1285997813}) 2024-08-18T21:15:51.143 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.143 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2118210641}) 2024-08-18T21:15:51.144 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1161565609}) 2024-08-18T21:15:51.144 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.144 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2118210641}) 2024-08-18T21:15:51.144 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3999110506}) 2024-08-18T21:15:51.144 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.144 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2118210641}) 2024-08-18T21:15:51.144 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.142+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1476616318}) 2024-08-18T21:15:51.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:51.142+0000 7ff92872e640 1 -- 172.21.15.5:0/3540124984 --> v2:172.21.15.157:6812/631023601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff92013fe10 con 0x7ff90403bdc0 2024-08-18T21:15:51.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:51.146+0000 7ff916ffd640 1 -- 172.21.15.5:0/3540124984 <== mgr.4130 v2:172.21.15.157:6812/631023601 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34068 (secure 0 0 0) 0x7ff91c010870 con 0x7ff90403bdc0 2024-08-18T21:15:51.145 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:15:51.145 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T21:15:51.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:51.150+0000 7ff92872e640 1 -- 172.21.15.5:0/3540124984 >> v2:172.21.15.157:6812/631023601 conn(0x7ff90403bdc0 msgr2=0x7ff90403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:51.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:51.150+0000 7ff92872e640 1 --2- 172.21.15.5:0/3540124984 >> v2:172.21.15.157:6812/631023601 conn(0x7ff90403bdc0 0x7ff90403e280 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0099b0 tx=0x7ff91c008040 comp rx=0 tx=0).stop 2024-08-18T21:15:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:51.150+0000 7ff92872e640 10 monclient: shutdown 2024-08-18T21:15:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:51.150+0000 7ff92872e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:15:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:51.150+0000 7ff92872e640 1 -- 172.21.15.5:0/3540124984 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff9200a6bd0 msgr2=0x7ff920138830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:15:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:51.150+0000 7ff92872e640 1 --2- 172.21.15.5:0/3540124984 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff9200a6bd0 0x7ff920138830 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff91000e980 tx=0x7ff91000ee40 comp rx=0 tx=0).stop 2024-08-18T21:15:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:51.150+0000 7ff92872e640 1 -- 172.21.15.5:0/3540124984 shutdown_connections 2024-08-18T21:15:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:51.150+0000 7ff92872e640 1 --2- 172.21.15.5:0/3540124984 >> v2:172.21.15.157:6812/631023601 conn(0x7ff90403bdc0 0x7ff90403e280 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:51.150+0000 7ff92872e640 1 --2- 172.21.15.5:0/3540124984 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff920139990 0x7ff92013dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:51.150+0000 7ff92872e640 1 --2- 172.21.15.5:0/3540124984 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7ff9200a6bd0 0x7ff920138830 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:51.150+0000 7ff92872e640 1 --2- 172.21.15.5:0/3540124984 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7ff92009f080 0x7ff9201382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:15:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:51.150+0000 7ff92872e640 1 -- 172.21.15.5:0/3540124984 >> 172.21.15.5:0/3540124984 conn(0x7ff920068700 msgr2=0x7ff9200a1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:15:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:51.150+0000 7ff92872e640 1 -- 172.21.15.5:0/3540124984 shutdown_connections 2024-08-18T21:15:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:15:51.150+0000 7ff92872e640 1 -- 172.21.15.5:0/3540124984 wait complete. 2024-08-18T21:15:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":692,"stamp":"2024-08-18T21:15:49.560198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":209024,"kb_used_data":17712,"kb_used_omap":9,"kb_used_meta":191158,"kb_avail":566022016,"statfs":{"total":579820584960,"available":579606544384,"internally_reserved":0,"allocated":18137088,"data_stored":8957700,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9572,"internal_metadata":195746460},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.469504"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":726,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.853071+0000","last_change":"2024-08-18T21:03:33.600622+0000","last_active":"2024-08-18T21:15:43.853071+0000","last_peered":"2024-08-18T21:15:43.853071+0000","last_clean":"2024-08-18T21:15:43.853071+0000","last_became_active":"2024-08-18T21:03:33.598635+0000","last_became_peered":"2024-08-18T21:03:33.598635+0000","last_unstale":"2024-08-18T21:15:43.853071+0000","last_undegraded":"2024-08-18T21:15:43.853071+0000","last_fullsized":"2024-08-18T21:15:43.853071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:31.584484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:31.584484+0000","last_clean_scrub_stamp":"2024-08-18T21:03:31.584484+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:05.519532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":635,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.852644+0000","last_change":"2024-08-18T21:03:42.420443+0000","last_active":"2024-08-18T21:15:43.852644+0000","last_peered":"2024-08-18T21:15:43.852644+0000","last_clean":"2024-08-18T21:15:43.852644+0000","last_became_active":"2024-08-18T21:03:39.196022+0000","last_became_peered":"2024-08-18T21:03:39.196022+0000","last_unstale":"2024-08-18T21:15:43.852644+0000","last_undegraded":"2024-08-18T21:15:43.852644+0000","last_fullsized":"2024-08-18T21:15:43.852644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:31.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010002489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":635,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.854766+0000","last_change":"2024-08-18T21:03:42.185411+0000","last_active":"2024-08-18T21:15:43.854766+0000","last_peered":"2024-08-18T21:15:43.854766+0000","last_clean":"2024-08-18T21:15:43.854766+0000","last_became_active":"2024-08-18T21:03:39.201697+0000","last_became_peered":"2024-08-18T21:03:39.201697+0000","last_unstale":"2024-08-18T21:15:43.854766+0000","last_undegraded":"2024-08-18T21:15:43.854766+0000","last_fullsized":"2024-08-18T21:15:43.854766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:03:54.524520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001317337,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":644,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.855054+0000","last_change":"2024-08-18T21:03:42.184643+0000","last_active":"2024-08-18T21:15:43.855054+0000","last_peered":"2024-08-18T21:15:43.855054+0000","last_clean":"2024-08-18T21:15:43.855054+0000","last_became_active":"2024-08-18T21:03:39.201549+0000","last_became_peered":"2024-08-18T21:03:39.201549+0000","last_unstale":"2024-08-18T21:15:43.855054+0000","last_undegraded":"2024-08-18T21:15:43.855054+0000","last_fullsized":"2024-08-18T21:15:43.855054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:01:33.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010119630000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":639,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.854510+0000","last_change":"2024-08-18T21:03:42.420020+0000","last_active":"2024-08-18T21:15:43.854510+0000","last_peered":"2024-08-18T21:15:43.854510+0000","last_clean":"2024-08-18T21:15:43.854510+0000","last_became_active":"2024-08-18T21:03:39.203685+0000","last_became_peered":"2024-08-18T21:03:39.203685+0000","last_unstale":"2024-08-18T21:15:43.854510+0000","last_undegraded":"2024-08-18T21:15:43.854510+0000","last_fullsized":"2024-08-18T21:15:43.854510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:36.890241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099204900000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":634,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.852774+0000","last_change":"2024-08-18T21:03:42.420253+0000","last_active":"2024-08-18T21:15:43.852774+0000","last_peered":"2024-08-18T21:15:43.852774+0000","last_clean":"2024-08-18T21:15:43.852774+0000","last_became_active":"2024-08-18T21:03:39.192148+0000","last_became_peered":"2024-08-18T21:03:39.192148+0000","last_unstale":"2024-08-18T21:15:43.852774+0000","last_undegraded":"2024-08-18T21:15:43.852774+0000","last_fullsized":"2024-08-18T21:15:43.852774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:00:27.022175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082257800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":639,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.861806+0000","last_change":"2024-08-18T21:03:42.184578+0000","last_active":"2024-08-18T21:15:43.861806+0000","last_peered":"2024-08-18T21:15:43.861806+0000","last_clean":"2024-08-18T21:15:43.861806+0000","last_became_active":"2024-08-18T21:03:39.194596+0000","last_became_peered":"2024-08-18T21:03:39.194596+0000","last_unstale":"2024-08-18T21:15:43.861806+0000","last_undegraded":"2024-08-18T21:15:43.861806+0000","last_fullsized":"2024-08-18T21:15:43.861806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:22.467656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001127341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":634,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.852875+0000","last_change":"2024-08-18T21:03:42.420853+0000","last_active":"2024-08-18T21:15:43.852875+0000","last_peered":"2024-08-18T21:15:43.852875+0000","last_clean":"2024-08-18T21:15:43.852875+0000","last_became_active":"2024-08-18T21:03:39.195166+0000","last_became_peered":"2024-08-18T21:03:39.195166+0000","last_unstale":"2024-08-18T21:15:43.852875+0000","last_undegraded":"2024-08-18T21:15:43.852875+0000","last_fullsized":"2024-08-18T21:15:43.852875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:11:34.985385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001377777,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":639,"reported_epoch":330,"state":"active+clean","last_fresh":"2024-08-18T21:15:43.853713+0000","last_change":"2024-08-18T21:03:42.186027+0000","last_active":"2024-08-18T21:15:43.853713+0000","last_peered":"2024-08-18T21:15:43.853713+0000","last_clean":"2024-08-18T21:15:43.853713+0000","last_became_active":"2024-08-18T21:03:39.192275+0000","last_became_peered":"2024-08-18T21:03:39.192275+0000","last_unstale":"2024-08-18T21:15:43.853713+0000","last_undegraded":"2024-08-18T21:15:43.853713+0000","last_fullsized":"2024-08-18T21:15:43.853713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:03:38.089891+0000","last_clean_scrub_stamp":"2024-08-18T21:03:38.089891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:55:49.809092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001842333,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":12,"seq":51539607702,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34140,"kb_used_data":2944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337700,"statfs":{"total":96636764160,"available":96601804800,"internally_reserved":0,"allocated":3014656,"data_stored":1316482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640405,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34152,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337688,"statfs":{"total":96636764160,"available":96601792512,"internally_reserved":0,"allocated":3035136,"data_stored":1844922,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640405,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34140,"kb_used_data":2944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337700,"statfs":{"total":96636764160,"available":96601804800,"internally_reserved":0,"allocated":3014656,"data_stored":1316730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640406,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34112,"kb_used_data":2916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337728,"statfs":{"total":96636764160,"available":96601833472,"internally_reserved":0,"allocated":2985984,"data_stored":1316547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640407,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38292,"kb_used_data":2944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333548,"statfs":{"total":96636764160,"available":96597553152,"internally_reserved":0,"allocated":3014656,"data_stored":1317085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640405,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34188,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337652,"statfs":{"total":96636764160,"available":96601755648,"internally_reserved":0,"allocated":3072000,"data_stored":1845934,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T21:15:51.167 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-18T21:03:31.584484+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=3, tm_sec=31, tm_wday=6, tm_yday=231, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=15, tm_sec=46, tm_wday=6, tm_yday=231, tm_isdst=0) 2024-08-18T21:15:51.167 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-08-18T21:03:38.089891+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=3, tm_sec=38, tm_wday=6, tm_yday=231, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=15, tm_sec=46, tm_wday=6, tm_yday=231, tm_isdst=0) 2024-08-18T21:15:51.167 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-08-18T21:03:38.089891+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=3, tm_sec=38, tm_wday=6, tm_yday=231, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=15, tm_sec=46, tm_wday=6, tm_yday=231, tm_isdst=0) 2024-08-18T21:15:51.167 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-08-18T21:03:38.089891+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=3, tm_sec=38, tm_wday=6, tm_yday=231, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=15, tm_sec=46, tm_wday=6, tm_yday=231, tm_isdst=0) 2024-08-18T21:15:51.167 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-08-18T21:03:38.089891+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=3, tm_sec=38, tm_wday=6, tm_yday=231, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=15, tm_sec=46, tm_wday=6, tm_yday=231, tm_isdst=0) 2024-08-18T21:15:51.167 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-08-18T21:03:38.089891+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=3, tm_sec=38, tm_wday=6, tm_yday=231, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=15, tm_sec=46, tm_wday=6, tm_yday=231, tm_isdst=0) 2024-08-18T21:15:51.168 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-08-18T21:03:38.089891+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=3, tm_sec=38, tm_wday=6, tm_yday=231, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=15, tm_sec=46, tm_wday=6, tm_yday=231, tm_isdst=0) 2024-08-18T21:15:51.168 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-08-18T21:03:38.089891+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=3, tm_sec=38, tm_wday=6, tm_yday=231, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=15, tm_sec=46, tm_wday=6, tm_yday=231, tm_isdst=0) 2024-08-18T21:15:51.168 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-08-18T21:03:38.089891+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=3, tm_sec=38, tm_wday=6, tm_yday=231, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=21, tm_min=15, tm_sec=46, tm_wday=6, tm_yday=231, tm_isdst=0) 2024-08-18T21:15:51.168 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-18T21:15:51.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3655797620}) 2024-08-18T21:15:51.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1505162458}) 2024-08-18T21:15:51.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3655797620}) 2024-08-18T21:15:51.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1795009658}) 2024-08-18T21:15:51.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3655797620}) 2024-08-18T21:15:51.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3354112747}) 2024-08-18T21:15:51.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.272 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3655797620}) 2024-08-18T21:15:51.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3981986048}) 2024-08-18T21:15:51.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3655797620}) 2024-08-18T21:15:51.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4195730225}) 2024-08-18T21:15:51.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3655797620}) 2024-08-18T21:15:51.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=311816455}) 2024-08-18T21:15:51.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3655797620}) 2024-08-18T21:15:51.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=595196312}) 2024-08-18T21:15:51.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3655797620}) 2024-08-18T21:15:51.273 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3983354848}) 2024-08-18T21:15:51.275 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.275 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252486647}) 2024-08-18T21:15:51.275 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1531788190}) 2024-08-18T21:15:51.275 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.275 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252486647}) 2024-08-18T21:15:51.275 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4207781793}) 2024-08-18T21:15:51.275 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.275 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252486647}) 2024-08-18T21:15:51.275 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2391941112}) 2024-08-18T21:15:51.276 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.276 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252486647}) 2024-08-18T21:15:51.276 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2456844416}) 2024-08-18T21:15:51.276 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.276 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252486647}) 2024-08-18T21:15:51.276 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=349443907}) 2024-08-18T21:15:51.276 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.276 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252486647}) 2024-08-18T21:15:51.276 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2101376199}) 2024-08-18T21:15:51.276 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.276 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252486647}) 2024-08-18T21:15:51.276 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3301386248}) 2024-08-18T21:15:51.276 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.276 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252486647}) 2024-08-18T21:15:51.276 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.274+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1753073536}) 2024-08-18T21:15:51.278 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=476943165}) 2024-08-18T21:15:51.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=599748191}) 2024-08-18T21:15:51.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=476943165}) 2024-08-18T21:15:51.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=49819549}) 2024-08-18T21:15:51.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=476943165}) 2024-08-18T21:15:51.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2645063686}) 2024-08-18T21:15:51.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=476943165}) 2024-08-18T21:15:51.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4241729278}) 2024-08-18T21:15:51.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.279 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=476943165}) 2024-08-18T21:15:51.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4027367308}) 2024-08-18T21:15:51.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=476943165}) 2024-08-18T21:15:51.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1865036908}) 2024-08-18T21:15:51.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=476943165}) 2024-08-18T21:15:51.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1342502769}) 2024-08-18T21:15:51.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=476943165}) 2024-08-18T21:15:51.280 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.278+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3181006900}) 2024-08-18T21:15:51.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1930824923}) 2024-08-18T21:15:51.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=658527924}) 2024-08-18T21:15:51.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.282 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1930824923}) 2024-08-18T21:15:51.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3433229107}) 2024-08-18T21:15:51.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1930824923}) 2024-08-18T21:15:51.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2936441921}) 2024-08-18T21:15:51.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1930824923}) 2024-08-18T21:15:51.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3414787116}) 2024-08-18T21:15:51.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1930824923}) 2024-08-18T21:15:51.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=326007064}) 2024-08-18T21:15:51.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1930824923}) 2024-08-18T21:15:51.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2479172045}) 2024-08-18T21:15:51.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.283 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1930824923}) 2024-08-18T21:15:51.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2867336561}) 2024-08-18T21:15:51.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1930824923}) 2024-08-18T21:15:51.284 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.282+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3808000243}) 2024-08-18T21:15:51.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2970792218}) 2024-08-18T21:15:51.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3601648655}) 2024-08-18T21:15:51.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2970792218}) 2024-08-18T21:15:51.285 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1939584059}) 2024-08-18T21:15:51.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2970792218}) 2024-08-18T21:15:51.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2450920387}) 2024-08-18T21:15:51.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2970792218}) 2024-08-18T21:15:51.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2871402550}) 2024-08-18T21:15:51.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2970792218}) 2024-08-18T21:15:51.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2269184733}) 2024-08-18T21:15:51.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.286 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2970792218}) 2024-08-18T21:15:51.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1663652449}) 2024-08-18T21:15:51.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2970792218}) 2024-08-18T21:15:51.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=899913525}) 2024-08-18T21:15:51.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2970792218}) 2024-08-18T21:15:51.287 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.286+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1453052958}) 2024-08-18T21:15:51.291 INFO:tasks.daemonwatchdog.daemon_watchdog:MonitorThrasher failed 2024-08-18T21:15:51.291 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/daemonwatchdog.py", line 42, in _run self.watch() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/daemonwatchdog.py", line 120, in watch thrasher.stop_and_join() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 178, in stop_and_join return self.join() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 170, in join self.stopping.set() AttributeError: 'bool' object has no attribute 'set' 2024-08-18T21:15:51.416 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.416 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2145023462}) 2024-08-18T21:15:51.416 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1353590104}) 2024-08-18T21:15:51.417 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.417 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2145023462}) 2024-08-18T21:15:51.417 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2621388547}) 2024-08-18T21:15:51.417 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.417 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2145023462}) 2024-08-18T21:15:51.417 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=879708572}) 2024-08-18T21:15:51.417 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.417 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2145023462}) 2024-08-18T21:15:51.417 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1430402402}) 2024-08-18T21:15:51.417 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.417 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2145023462}) 2024-08-18T21:15:51.418 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3587707541}) 2024-08-18T21:15:51.418 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.418 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2145023462}) 2024-08-18T21:15:51.418 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1219556999}) 2024-08-18T21:15:51.418 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.418 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2145023462}) 2024-08-18T21:15:51.418 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3301979445}) 2024-08-18T21:15:51.418 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.418 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2145023462}) 2024-08-18T21:15:51.418 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.418+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3287024070}) 2024-08-18T21:15:51.447 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.447 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2403498871}) 2024-08-18T21:15:51.447 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4070140987}) 2024-08-18T21:15:51.447 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.447 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2403498871}) 2024-08-18T21:15:51.447 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2042925100}) 2024-08-18T21:15:51.447 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.447 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2403498871}) 2024-08-18T21:15:51.447 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2464052379}) 2024-08-18T21:15:51.447 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.447 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2403498871}) 2024-08-18T21:15:51.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1033624657}) 2024-08-18T21:15:51.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2403498871}) 2024-08-18T21:15:51.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2688449719}) 2024-08-18T21:15:51.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2403498871}) 2024-08-18T21:15:51.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1005518686}) 2024-08-18T21:15:51.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2403498871}) 2024-08-18T21:15:51.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=442585224}) 2024-08-18T21:15:51.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2403498871}) 2024-08-18T21:15:51.448 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.446+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=531996657}) 2024-08-18T21:15:51.557 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.558 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546801632}) 2024-08-18T21:15:51.558 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2489863959}) 2024-08-18T21:15:51.558 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.558 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546801632}) 2024-08-18T21:15:51.558 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=62035785}) 2024-08-18T21:15:51.558 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.558 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546801632}) 2024-08-18T21:15:51.558 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3015125418}) 2024-08-18T21:15:51.558 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.558 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546801632}) 2024-08-18T21:15:51.558 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=786428078}) 2024-08-18T21:15:51.559 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.559 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546801632}) 2024-08-18T21:15:51.559 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2802254869}) 2024-08-18T21:15:51.559 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.559 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546801632}) 2024-08-18T21:15:51.559 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3540006479}) 2024-08-18T21:15:51.559 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.559 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546801632}) 2024-08-18T21:15:51.559 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3981111428}) 2024-08-18T21:15:51.559 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.559 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546801632}) 2024-08-18T21:15:51.559 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.558+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3706536107}) 2024-08-18T21:15:51.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4066781159}) 2024-08-18T21:15:51.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2558784329}) 2024-08-18T21:15:51.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4066781159}) 2024-08-18T21:15:51.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=728810478}) 2024-08-18T21:15:51.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4066781159}) 2024-08-18T21:15:51.937 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1642153198}) 2024-08-18T21:15:51.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4066781159}) 2024-08-18T21:15:51.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3531693813}) 2024-08-18T21:15:51.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4066781159}) 2024-08-18T21:15:51.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2356748860}) 2024-08-18T21:15:51.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4066781159}) 2024-08-18T21:15:51.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2122377064}) 2024-08-18T21:15:51.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4066781159}) 2024-08-18T21:15:51.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2450859382}) 2024-08-18T21:15:51.939 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.939 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4066781159}) 2024-08-18T21:15:51.939 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.938+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1231249161}) 2024-08-18T21:15:51.986 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.986 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=680014993}) 2024-08-18T21:15:51.986 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2546131939}) 2024-08-18T21:15:51.986 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.986 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=680014993}) 2024-08-18T21:15:51.986 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=405741334}) 2024-08-18T21:15:51.986 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.986 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=680014993}) 2024-08-18T21:15:51.986 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=82777106}) 2024-08-18T21:15:51.986 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.987 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=680014993}) 2024-08-18T21:15:51.987 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2266256041}) 2024-08-18T21:15:51.987 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.987 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=680014993}) 2024-08-18T21:15:51.987 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=595424021}) 2024-08-18T21:15:51.987 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.987 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=680014993}) 2024-08-18T21:15:51.987 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2601970393}) 2024-08-18T21:15:51.988 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.988 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=680014993}) 2024-08-18T21:15:51.988 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=477598289}) 2024-08-18T21:15:51.988 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.988 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=680014993}) 2024-08-18T21:15:51.988 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.986+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3969017109}) 2024-08-18T21:15:51.992 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.992 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2929873786}) 2024-08-18T21:15:51.992 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2835950686}) 2024-08-18T21:15:51.992 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.992 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2929873786}) 2024-08-18T21:15:51.992 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2060453835}) 2024-08-18T21:15:51.992 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.992 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2929873786}) 2024-08-18T21:15:51.992 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2751764788}) 2024-08-18T21:15:51.992 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.992 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2929873786}) 2024-08-18T21:15:51.993 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2103897540}) 2024-08-18T21:15:51.993 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.993 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2929873786}) 2024-08-18T21:15:51.993 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1879681727}) 2024-08-18T21:15:51.993 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.993 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2929873786}) 2024-08-18T21:15:51.993 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1850508993}) 2024-08-18T21:15:51.993 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.993 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2929873786}) 2024-08-18T21:15:51.993 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3337646878}) 2024-08-18T21:15:51.993 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.993 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2929873786}) 2024-08-18T21:15:51.994 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.990+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1852251609}) 2024-08-18T21:15:51.994 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.994 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=85835794}) 2024-08-18T21:15:51.994 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3867037693}) 2024-08-18T21:15:51.994 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.994 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=85835794}) 2024-08-18T21:15:51.994 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1673988813}) 2024-08-18T21:15:51.994 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.995 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=85835794}) 2024-08-18T21:15:51.995 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3806731262}) 2024-08-18T21:15:51.995 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.995 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=85835794}) 2024-08-18T21:15:51.995 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1423524153}) 2024-08-18T21:15:51.995 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.995 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=85835794}) 2024-08-18T21:15:51.995 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=48040221}) 2024-08-18T21:15:51.995 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.995 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=85835794}) 2024-08-18T21:15:51.995 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1869310997}) 2024-08-18T21:15:51.995 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.996 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=85835794}) 2024-08-18T21:15:51.996 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4084769401}) 2024-08-18T21:15:51.996 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:51.996 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=85835794}) 2024-08-18T21:15:51.996 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1870175785}) 2024-08-18T21:15:52.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2144066650}) 2024-08-18T21:15:52.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2769126178}) 2024-08-18T21:15:52.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2144066650}) 2024-08-18T21:15:52.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2050332512}) 2024-08-18T21:15:52.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2144066650}) 2024-08-18T21:15:52.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=415557367}) 2024-08-18T21:15:52.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.994+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2144066650}) 2024-08-18T21:15:52.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2414404526}) 2024-08-18T21:15:52.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2144066650}) 2024-08-18T21:15:52.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4228541741}) 2024-08-18T21:15:52.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2144066650}) 2024-08-18T21:15:52.002 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1508958059}) 2024-08-18T21:15:52.002 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.002 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2144066650}) 2024-08-18T21:15:52.002 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4185190436}) 2024-08-18T21:15:52.002 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.002 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2144066650}) 2024-08-18T21:15:52.002 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3010923399}) 2024-08-18T21:15:52.002 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.002 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3930572416}) 2024-08-18T21:15:52.003 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3622210187}) 2024-08-18T21:15:52.003 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.003 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3930572416}) 2024-08-18T21:15:52.003 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3202354484}) 2024-08-18T21:15:52.003 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.003 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3930572416}) 2024-08-18T21:15:52.003 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1515856160}) 2024-08-18T21:15:52.003 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.003 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3930572416}) 2024-08-18T21:15:52.003 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3000036733}) 2024-08-18T21:15:52.003 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.003 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:51.998+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3930572416}) 2024-08-18T21:15:52.004 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.002+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3982776425}) 2024-08-18T21:15:52.004 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.002+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.004 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.002+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3930572416}) 2024-08-18T21:15:52.004 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.002+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2180354883}) 2024-08-18T21:15:52.004 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.002+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.004 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.002+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3930572416}) 2024-08-18T21:15:52.004 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.002+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3356335380}) 2024-08-18T21:15:52.004 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.002+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.004 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.002+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3930572416}) 2024-08-18T21:15:52.004 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.002+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3399287153}) 2024-08-18T21:15:52.007 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.002+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.007 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.002+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669564422}) 2024-08-18T21:15:52.007 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.002+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=286242139}) 2024-08-18T21:15:52.007 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.002+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.007 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669564422}) 2024-08-18T21:15:52.007 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4269636116}) 2024-08-18T21:15:52.007 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.007 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669564422}) 2024-08-18T21:15:52.007 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1640398822}) 2024-08-18T21:15:52.007 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.007 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669564422}) 2024-08-18T21:15:52.007 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3718052481}) 2024-08-18T21:15:52.008 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.008 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669564422}) 2024-08-18T21:15:52.008 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4027788525}) 2024-08-18T21:15:52.008 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.008 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669564422}) 2024-08-18T21:15:52.008 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2998994248}) 2024-08-18T21:15:52.008 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.008 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669564422}) 2024-08-18T21:15:52.008 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3951679401}) 2024-08-18T21:15:52.008 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.008 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669564422}) 2024-08-18T21:15:52.009 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.006+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2525003949}) 2024-08-18T21:15:52.010 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.010 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=4074242900,mdsmap=485591938,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3184105807,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397923,osd_pg_creating=1608752382,osd_snap=723727393,osdmap=615766058}) 2024-08-18T21:15:52.010 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=17,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=1999873176,mdsmap=4274512535,mgr=695303193,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3989260994,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=1608752382,osd_snap=723727393,osdmap=2573160991}) 2024-08-18T21:15:52.010 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.010 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=4074242900,mdsmap=485591938,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3184105807,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397923,osd_pg_creating=1608752382,osd_snap=723727393,osdmap=615766058}) 2024-08-18T21:15:52.010 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=17,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=41} crc {logm=4281988515,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3184105807,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=1608752382,osd_snap=723727393,osdmap=1816533524}) 2024-08-18T21:15:52.010 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.011 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=4074242900,mdsmap=485591938,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3184105807,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397923,osd_pg_creating=1608752382,osd_snap=723727393,osdmap=615766058}) 2024-08-18T21:15:52.011 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=13,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=7,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=47} crc {logm=4032480525,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3791229793,mon_config_key=2309266927,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=1608752382,osd_snap=723727393,osdmap=1722039414}) 2024-08-18T21:15:52.011 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.011 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=4074242900,mdsmap=485591938,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3184105807,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397923,osd_pg_creating=1608752382,osd_snap=723727393,osdmap=615766058}) 2024-08-18T21:15:52.011 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=16,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=7,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=46} crc {logm=4190140645,mdsmap=4274512535,mgr=2581221129,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3184105807,mon_config_key=1282707525,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=1608752382,osd_snap=3823785925,osdmap=2737444501}) 2024-08-18T21:15:52.011 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.011 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=4074242900,mdsmap=485591938,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3184105807,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397923,osd_pg_creating=1608752382,osd_snap=723727393,osdmap=615766058}) 2024-08-18T21:15:52.011 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=16,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=7,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=45} crc {logm=667924194,mdsmap=4274512535,mgr=2868859441,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3184105807,mon_config_key=628873106,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=1608752382,osd_snap=723727393,osdmap=1103923777}) 2024-08-18T21:15:52.011 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.011 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=4074242900,mdsmap=485591938,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3184105807,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397923,osd_pg_creating=1608752382,osd_snap=723727393,osdmap=615766058}) 2024-08-18T21:15:52.011 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=15,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=4049651477,mdsmap=4274512535,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3184105807,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397922,osd_pg_creating=1608752382,osd_snap=1927752934,osdmap=551642737}) 2024-08-18T21:15:52.011 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.012 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=4074242900,mdsmap=485591938,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3184105807,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397923,osd_pg_creating=1608752382,osd_snap=723727393,osdmap=615766058}) 2024-08-18T21:15:52.012 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=16,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=8,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=44} crc {logm=2935160751,mdsmap=4274512535,mgr=4115300050,mgr_metadata=2208114464,mgrstat=2377644673,mon_config_key=2147202552,monmap=3438368439,osd_metadata=1031801891,osd_pg_creating=1608752382,osd_snap=723727393,osdmap=3363903201}) 2024-08-18T21:15:52.012 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.012 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=4074242900,mdsmap=485591938,mgr=4115300050,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=3184105807,mon_config_key=2147202552,monmap=3438368439,osd_metadata=2816397923,osd_pg_creating=1608752382,osd_snap=723727393,osdmap=615766058}) 2024-08-18T21:15:52.012 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.010+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=17,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=7,monmap=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=46} crc {logm=4281988515,mdsmap=4274512535,mgr=2693273374,mgr_command_descs=3328876062,mgr_metadata=2208114464,mgrstat=4226634099,mon_config_key=4097785744,monmap=3140514009,osd_metadata=3887816624,osd_pg_creating=1608752382,osd_snap=723727393,osdmap=3037594263}) 2024-08-18T21:15:52.032 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.032 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=21} crc {osdmap=2296750835}) 2024-08-18T21:15:52.032 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=20} crc {osdmap=1799990027}) 2024-08-18T21:15:52.032 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=21} crc {osdmap=2296750835}) 2024-08-18T21:15:52.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=21} crc {osdmap=3001678011}) 2024-08-18T21:15:52.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=21} crc {osdmap=2296750835}) 2024-08-18T21:15:52.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=22} crc {osdmap=1819632093}) 2024-08-18T21:15:52.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=21} crc {osdmap=2296750835}) 2024-08-18T21:15:52.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=20} crc {osdmap=1839397026}) 2024-08-18T21:15:52.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=21} crc {osdmap=2296750835}) 2024-08-18T21:15:52.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=20} crc {osdmap=977779960}) 2024-08-18T21:15:52.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.033 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=21} crc {osdmap=2296750835}) 2024-08-18T21:15:52.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=21} crc {osdmap=1154895876}) 2024-08-18T21:15:52.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=21} crc {osdmap=2296750835}) 2024-08-18T21:15:52.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=21} crc {osdmap=40563889}) 2024-08-18T21:15:52.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-18T21:15:52.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=21} crc {osdmap=2296750835}) 2024-08-18T21:15:52.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T21:15:52.034+0000 7fa79e75d640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=22} crc {osdmap=935016711}) 2024-08-18T21:16:11.169 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T21:16:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.305+0000 7f469e995640 10 monclient: get_monmap_and_config 2024-08-18T21:16:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.305+0000 7f469e995640 10 monclient: build_initial_monmap 2024-08-18T21:16:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.305+0000 7f469e995640 10 monclient: monmap: 2024-08-18T21:16:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:16:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:16:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:16:11.311068+0000 2024-08-18T21:16:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:16:11.311068+0000 2024-08-18T21:16:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:16:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:16:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:16:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:16:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:16:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:16:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:16:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:16:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:16:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:16:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:16:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:16:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:16:11.307 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:11.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.305+0000 7f469e995640 1 Processor -- start 2024-08-18T21:16:11.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.305+0000 7f469e995640 1 -- start start 2024-08-18T21:16:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.305+0000 7f469e995640 10 monclient: init 2024-08-18T21:16:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469e995640 10 monclient: _reopen_session rank -1 2024-08-18T21:16:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469e995640 10 monclient: _add_conns ranks=[7,3,5,10,9,6,8,4,1,2,0] 2024-08-18T21:16:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469e995640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46980a6ce0 0x7f46980a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:16:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469e995640 10 monclient(hunting): picked mon.noname-i con 0x7f46980a6ce0 addr [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] 2024-08-18T21:16:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469e995640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46980a7600 0x7f4698139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:16:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469e995640 10 monclient(hunting): picked mon.noname-g con 0x7f46980a7600 addr [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] 2024-08-18T21:16:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469e995640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4698139fe0 0x7f469813a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:16:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469e995640 10 monclient(hunting): picked mon.noname-h con 0x7f4698139fe0 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:16:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469e995640 10 monclient(hunting): start opening mon connection 2024-08-18T21:16:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469e995640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f46980a5000 con 0x7f46980a7600 2024-08-18T21:16:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469e995640 10 monclient(hunting): start opening mon connection 2024-08-18T21:16:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469e995640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7f46980a4360 con 0x7f4698139fe0 2024-08-18T21:16:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469e995640 10 monclient(hunting): start opening mon connection 2024-08-18T21:16:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469e995640 1 -- --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_getmap magic: 0 -- 0x7f46980a45d0 con 0x7f46980a6ce0 2024-08-18T21:16:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469e995640 10 monclient(hunting): _renew_subs 2024-08-18T21:16:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469e995640 10 monclient(hunting): authenticate will time out at 1738.324348s 2024-08-18T21:16:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f46977fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46980a7600 0x7f4698139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:16:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46980a6ce0 0x7f46980a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:16:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469cf32640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4698139fe0 0x7f469813a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:16:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 1 --2- >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46980a6ce0 0x7f46980a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3303/0 says I am v2:172.21.15.5:59934/0 (socket says 172.21.15.5:59934) 2024-08-18T21:16:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f46977fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46980a7600 0x7f4698139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:60912/0 (socket says 172.21.15.5:60912) 2024-08-18T21:16:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 1 -- 172.21.15.5:0/1933938589 learned_addr learned my addr 172.21.15.5:0/1933938589 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:16:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 10 monclient(hunting): get_auth_request con 0x7f46980a6ce0 auth_method 0 2024-08-18T21:16:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:16:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:16:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:16:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f46977fe640 10 monclient(hunting): get_auth_request con 0x7f46980a7600 auth_method 0 2024-08-18T21:16:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f46977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:16:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f46977fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:16:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f46977fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:16:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469cf32640 10 monclient(hunting): get_auth_request con 0x7f4698139fe0 auth_method 0 2024-08-18T21:16:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469cf32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:16:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469cf32640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:16:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469cf32640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:16:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:16:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:16:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:16:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f46977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:16:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f46977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:16:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f46977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:16:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469cf32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:16:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469cf32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:16:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f469cf32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:16:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 10 monclient(hunting): handle_auth_done global_id 174193 payload 274 2024-08-18T21:16:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 1 -- 172.21.15.5:0/1933938589 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4698139fe0 msgr2=0x7f469813a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:16:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 1 --2- 172.21.15.5:0/1933938589 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4698139fe0 0x7f469813a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 1 -- 172.21.15.5:0/1933938589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46980a7600 msgr2=0x7f4698139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:16:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 1 --2- 172.21.15.5:0/1933938589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46980a7600 0x7f4698139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 10 monclient: _finish_hunting 0 2024-08-18T21:16:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 1 monclient: found mon.noname-i 2024-08-18T21:16:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:16:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.157:3303/0 2024-08-18T21:16:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f4697fff640 1 -- 172.21.15.5:0/1933938589 --> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46980a32d0 con 0x7f46980a6ce0 2024-08-18T21:16:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.309+0000 7f46977fe640 1 --2- 172.21.15.5:0/1933938589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46980a7600 0x7f4698139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:16:11.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f4697fff640 1 -- 172.21.15.5:0/1933938589 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46980a6ce0 msgr2=0x7f46980a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:16:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f4697fff640 1 --2- 172.21.15.5:0/1933938589 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46980a6ce0 0x7f46980a70c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f468c0098d0 tx=0x7f468c01c440 comp rx=0 tx=0).ready entity=mon.7 client_cookie=d116361c4e1fa0b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:16:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f4696ffd640 1 -- 172.21.15.5:0/1933938589 <== mon.7 v2:172.21.15.157:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f468c0b0070 con 0x7f46980a6ce0 2024-08-18T21:16:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f4696ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:16:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f4696ffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-18T21:16:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f4696ffd640 10 monclient: dump: 2024-08-18T21:16:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:16:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:16:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:16:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:16:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:16:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:16:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:16:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:16:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:16:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:16:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:16:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:16:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:16:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:16:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:16:11.319 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f4696ffd640 10 monclient: _finish_auth 0 2024-08-18T21:16:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f4696ffd640 10 monclient: _check_auth_tickets 2024-08-18T21:16:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f4696ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:16:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f4696ffd640 1 -- 172.21.15.5:0/1933938589 <== mon.7 v2:172.21.15.157:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f468c0aa810 con 0x7f46980a6ce0 2024-08-18T21:16:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f4696ffd640 10 monclient: handle_config config(0 keys) 2024-08-18T21:16:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f4696ffd640 1 -- 172.21.15.5:0/1933938589 <== mon.7 v2:172.21.15.157:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f468c0a9300 con 0x7f46980a6ce0 2024-08-18T21:16:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f469e995640 5 monclient: authenticate success, global_id 174193 2024-08-18T21:16:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f469e995640 10 monclient: get_monmap_and_config success 2024-08-18T21:16:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f469e995640 4 set_mon_vals no callback set 2024-08-18T21:16:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f4696ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:16:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f4696ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-18T21:16:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f4696ffd640 10 monclient: dump: 2024-08-18T21:16:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:16:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:16:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:16:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:16:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:16:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:16:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:16:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:16:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:16:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:16:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:16:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:16:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:16:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:16:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:16:11.321 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f469e995640 10 monclient: shutdown 2024-08-18T21:16:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f469e995640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:16:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f469e995640 1 -- 172.21.15.5:0/1933938589 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46980a6ce0 msgr2=0x7f46980a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:16:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f469e995640 1 --2- 172.21.15.5:0/1933938589 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46980a6ce0 0x7f46980a70c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f468c0098d0 tx=0x7f468c01c440 comp rx=0 tx=0).stop 2024-08-18T21:16:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f469e995640 1 -- 172.21.15.5:0/1933938589 shutdown_connections 2024-08-18T21:16:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f469e995640 1 --2- 172.21.15.5:0/1933938589 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7f4698139fe0 0x7f469813a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f469e995640 1 --2- 172.21.15.5:0/1933938589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46980a7600 0x7f4698139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f469e995640 1 --2- 172.21.15.5:0/1933938589 >> [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] conn(0x7f46980a6ce0 0x7f46980a70c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f469e995640 1 -- 172.21.15.5:0/1933938589 >> 172.21.15.5:0/1933938589 conn(0x7f46980acbc0 msgr2=0x7f46980a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:16:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f469e995640 1 -- 172.21.15.5:0/1933938589 shutdown_connections 2024-08-18T21:16:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f469e995640 1 -- 172.21.15.5:0/1933938589 wait complete. 2024-08-18T21:16:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f469e995640 10 monclient: build_initial_monmap 2024-08-18T21:16:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.313+0000 7f469e995640 10 monclient: monmap: 2024-08-18T21:16:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:16:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:16:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:16:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:16:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:16:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:16:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:16:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:16:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:16:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:16:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:16:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:16:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:16:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:16:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:16:11.324 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 1 Processor -- start 2024-08-18T21:16:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 1 -- start start 2024-08-18T21:16:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 10 monclient: init 2024-08-18T21:16:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 10 monclient: _reopen_session rank -1 2024-08-18T21:16:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 10 monclient: _add_conns ranks=[1,4,2,6,0,8,5,7,3] 2024-08-18T21:16:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46980a6ce0 0x7f4698134eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:16:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 10 monclient(hunting): picked mon.noname-f con 0x7f46980a6ce0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:16:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46980a7600 0x7f46981353f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:16:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 10 monclient(hunting): picked mon.noname-c con 0x7f46980a7600 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:16:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4698139fe0 0x7f469813aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:16:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 10 monclient(hunting): picked mon.noname-b con 0x7f4698139fe0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-08-18T21:16:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 10 monclient(hunting): start opening mon connection 2024-08-18T21:16:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f46980a79e0 con 0x7f46980a6ce0 2024-08-18T21:16:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 10 monclient(hunting): start opening mon connection 2024-08-18T21:16:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 -- 0x7f46980a8220 con 0x7f4698139fe0 2024-08-18T21:16:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 10 monclient(hunting): start opening mon connection 2024-08-18T21:16:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7f469813e6f0 con 0x7f46980a7600 2024-08-18T21:16:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 10 monclient(hunting): _renew_subs 2024-08-18T21:16:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 10 monclient(hunting): authenticate will time out at 1738.332661s 2024-08-18T21:16:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4698139fe0 0x7f469813aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:16:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f46977fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46980a7600 0x7f46981353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:16:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f46977fe640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46980a7600 0x7f46981353f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:38426/0 (socket says 172.21.15.5:38426) 2024-08-18T21:16:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4698139fe0 0x7f469813aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:35470/0 (socket says 172.21.15.5:35470) 2024-08-18T21:16:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f46977fe640 1 -- 172.21.15.5:0/2818944044 learned_addr learned my addr 172.21.15.5:0/2818944044 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:16:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f46977fe640 10 monclient(hunting): get_auth_request con 0x7f46980a7600 auth_method 0 2024-08-18T21:16:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f46977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:16:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f46977fe640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:16:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f46977fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:16:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 10 monclient(hunting): get_auth_request con 0x7f4698139fe0 auth_method 0 2024-08-18T21:16:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:16:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:16:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:16:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:16:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:16:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:16:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f46977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:16:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f46977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:16:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f46977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:16:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4697fff640 1 --2- 172.21.15.5:0/2818944044 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46980a6ce0 0x7f4698134eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:16:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4697fff640 10 monclient(hunting): get_auth_request con 0x7f46980a6ce0 auth_method 0 2024-08-18T21:16:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4697fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:16:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4697fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:16:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4697fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:16:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 10 monclient(hunting): handle_auth_done global_id 115310 payload 824 2024-08-18T21:16:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 1 -- 172.21.15.5:0/2818944044 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46980a7600 msgr2=0x7f46981353f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:16:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 1 --2- 172.21.15.5:0/2818944044 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46980a7600 0x7f46981353f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 1 -- 172.21.15.5:0/2818944044 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46980a6ce0 msgr2=0x7f4698134eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:16:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 1 --2- 172.21.15.5:0/2818944044 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46980a6ce0 0x7f4698134eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 10 monclient: _finish_hunting 0 2024-08-18T21:16:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 1 monclient: found mon.noname-b 2024-08-18T21:16:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:16:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2024-08-18T21:16:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 1 -- 172.21.15.5:0/2818944044 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4698077670 con 0x7f4698139fe0 2024-08-18T21:16:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 1 -- 172.21.15.5:0/2818944044 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4698139fe0 msgr2=0x7f469813aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:16:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469cf32640 1 --2- 172.21.15.5:0/2818944044 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4698139fe0 0x7f469813aab0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f469000e7c0 tx=0x7f469000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:16:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4694ff9640 1 -- 172.21.15.5:0/2818944044 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4690017070 con 0x7f4698139fe0 2024-08-18T21:16:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4694ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:16:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4694ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-18T21:16:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4694ff9640 10 monclient: dump: 2024-08-18T21:16:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:16:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:16:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:16:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:16:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:16:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:16:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:16:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:16:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:16:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:16:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:16:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:16:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:16:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:16:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:16:11.332 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4694ff9640 10 monclient: _finish_auth 0 2024-08-18T21:16:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4694ff9640 10 monclient: _check_auth_tickets 2024-08-18T21:16:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4694ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:16:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 5 monclient: authenticate success, global_id 115310 2024-08-18T21:16:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4694ff9640 1 -- 172.21.15.5:0/2818944044 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f469000cdb0 con 0x7f4698139fe0 2024-08-18T21:16:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4694ff9640 10 monclient: handle_config config(0 keys) 2024-08-18T21:16:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 10 monclient: _renew_subs 2024-08-18T21:16:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4694ff9640 1 -- 172.21.15.5:0/2818944044 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f46900138e0 con 0x7f4698139fe0 2024-08-18T21:16:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:16:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 1 -- 172.21.15.5:0/2818944044 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469813c390 con 0x7f4698139fe0 2024-08-18T21:16:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f46967fc640 4 set_mon_vals no callback set 2024-08-18T21:16:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4694ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:16:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4694ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-18T21:16:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f4694ff9640 10 monclient: dump: 2024-08-18T21:16:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:16:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:16:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:16:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:16:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:16:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:16:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:16:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:16:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:16:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:16:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:16:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:16:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:16:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:16:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:16:11.334 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 10 monclient: _renew_subs 2024-08-18T21:16:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:16:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.317+0000 7f469e995640 1 -- 172.21.15.5:0/2818944044 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4698135930 con 0x7f4698139fe0 2024-08-18T21:16:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.321+0000 7f469e995640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:16:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.321+0000 7f469e995640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:16:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.321+0000 7f469e995640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.5:3301/0 2024-08-18T21:16:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.321+0000 7f469e995640 1 -- 172.21.15.5:0/2818944044 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f469813e310 con 0x7f4698139fe0 2024-08-18T21:16:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.321+0000 7f4694ff9640 1 -- 172.21.15.5:0/2818944044 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7f469001a070 con 0x7f4698139fe0 2024-08-18T21:16:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.321+0000 7f4694ff9640 1 --2- 172.21.15.5:0/2818944044 >> v2:172.21.15.157:6812/631023601 conn(0x7f468403bdc0 0x7f468403e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:16:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.321+0000 7f4694ff9640 1 -- 172.21.15.5:0/2818944044 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(331..331 src has 300..331) ==== 3506+0+0 (secure 0 0 0) 0x7f469000f040 con 0x7f4698139fe0 2024-08-18T21:16:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.321+0000 7f4697fff640 1 --2- 172.21.15.5:0/2818944044 >> v2:172.21.15.157:6812/631023601 conn(0x7f468403bdc0 0x7f468403e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:16:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.321+0000 7f4697fff640 10 monclient: get_auth_request con 0x7f468403bdc0 auth_method 0 2024-08-18T21:16:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.325+0000 7f4697fff640 1 --2- 172.21.15.5:0/2818944044 >> v2:172.21.15.157:6812/631023601 conn(0x7f468403bdc0 0x7f468403e280 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f468c0098a0 tx=0x7f468c0a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:16:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.325+0000 7f4694ff9640 1 -- 172.21.15.5:0/2818944044 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7f469004d020 con 0x7f4698139fe0 2024-08-18T21:16:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.325+0000 7f4694ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:16:11.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.325+0000 7f4694ff9640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:16:11.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.493+0000 7f469e995640 1 -- 172.21.15.5:0/2818944044 --> v2:172.21.15.157:6812/631023601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4698139aa0 con 0x7f468403bdc0 2024-08-18T21:16:11.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.493+0000 7f4694ff9640 1 -- 172.21.15.5:0/2818944044 <== mgr.4130 v2:172.21.15.157:6812/631023601 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33992 (secure 0 0 0) 0x7f4698139aa0 con 0x7f468403bdc0 2024-08-18T21:16:11.498 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T21:16:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T21:16:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.497+0000 7f469e995640 1 -- 172.21.15.5:0/2818944044 >> v2:172.21.15.157:6812/631023601 conn(0x7f468403bdc0 msgr2=0x7f468403e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:16:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.497+0000 7f469e995640 1 --2- 172.21.15.5:0/2818944044 >> v2:172.21.15.157:6812/631023601 conn(0x7f468403bdc0 0x7f468403e280 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f468c0098a0 tx=0x7f468c0a6000 comp rx=0 tx=0).stop 2024-08-18T21:16:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.497+0000 7f469e995640 10 monclient: shutdown 2024-08-18T21:16:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.497+0000 7f469e995640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:16:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.497+0000 7f469e995640 1 -- 172.21.15.5:0/2818944044 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4698139fe0 msgr2=0x7f469813aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:16:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.497+0000 7f469e995640 1 --2- 172.21.15.5:0/2818944044 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4698139fe0 0x7f469813aab0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f469000e7c0 tx=0x7f469000ec80 comp rx=0 tx=0).stop 2024-08-18T21:16:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.497+0000 7f469e995640 1 -- 172.21.15.5:0/2818944044 shutdown_connections 2024-08-18T21:16:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.497+0000 7f469e995640 1 --2- 172.21.15.5:0/2818944044 >> v2:172.21.15.157:6812/631023601 conn(0x7f468403bdc0 0x7f468403e280 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.497+0000 7f469e995640 1 --2- 172.21.15.5:0/2818944044 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4698139fe0 0x7f469813aab0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.497+0000 7f469e995640 1 --2- 172.21.15.5:0/2818944044 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7f46980a7600 0x7f46981353f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.497+0000 7f469e995640 1 --2- 172.21.15.5:0/2818944044 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46980a6ce0 0x7f4698134eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.497+0000 7f469e995640 1 -- 172.21.15.5:0/2818944044 >> 172.21.15.5:0/2818944044 conn(0x7f46980acbc0 msgr2=0x7f4698135d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:16:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.497+0000 7f469e995640 1 -- 172.21.15.5:0/2818944044 shutdown_connections 2024-08-18T21:16:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.497+0000 7f469e995640 1 -- 172.21.15.5:0/2818944044 wait complete. 2024-08-18T21:16:11.514 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":702,"stamp":"2024-08-18T21:16:09.565635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":208656,"kb_used_data":17392,"kb_used_omap":9,"kb_used_meta":191158,"kb_avail":566022384,"statfs":{"total":579820584960,"available":579606921216,"internally_reserved":0,"allocated":17809408,"data_stored":8969506,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9572,"internal_metadata":195746460},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003306"},"pg_stats":[{"pgid":"1.0","version":"331'74","reported_seq":739,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-08-18T21:15:49.086288+0000","last_change":"2024-08-18T21:15:49.086341+0000","last_active":"2024-08-18T21:15:49.086288+0000","last_peered":"2024-08-18T21:15:49.086288+0000","last_clean":"2024-08-18T21:15:49.086288+0000","last_became_active":"2024-08-18T21:03:33.598635+0000","last_became_peered":"2024-08-18T21:03:33.598635+0000","last_unstale":"2024-08-18T21:15:49.086288+0000","last_undegraded":"2024-08-18T21:15:49.086288+0000","last_fullsized":"2024-08-18T21:15:49.086288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"331'74","last_scrub_stamp":"2024-08-18T21:15:49.086162+0000","last_deep_scrub":"331'74","last_deep_scrub_stamp":"2024-08-18T21:15:49.086162+0000","last_clean_scrub_stamp":"2024-08-18T21:15:49.086162+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:07:31.782772+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"331'2","reported_seq":647,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-08-18T21:15:50.110669+0000","last_change":"2024-08-18T21:15:50.110727+0000","last_active":"2024-08-18T21:15:50.110669+0000","last_peered":"2024-08-18T21:15:50.110669+0000","last_clean":"2024-08-18T21:15:50.110669+0000","last_became_active":"2024-08-18T21:03:39.196022+0000","last_became_peered":"2024-08-18T21:03:39.196022+0000","last_unstale":"2024-08-18T21:15:50.110669+0000","last_undegraded":"2024-08-18T21:15:50.110669+0000","last_fullsized":"2024-08-18T21:15:50.110669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"331'2","last_scrub_stamp":"2024-08-18T21:15:50.110553+0000","last_deep_scrub":"331'2","last_deep_scrub_stamp":"2024-08-18T21:15:50.110553+0000","last_clean_scrub_stamp":"2024-08-18T21:15:50.110553+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:00:32.920741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010002489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":646,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-08-18T21:15:49.589519+0000","last_change":"2024-08-18T21:15:49.589542+0000","last_active":"2024-08-18T21:15:49.589519+0000","last_peered":"2024-08-18T21:15:49.589519+0000","last_clean":"2024-08-18T21:15:49.589519+0000","last_became_active":"2024-08-18T21:03:39.201697+0000","last_became_peered":"2024-08-18T21:03:39.201697+0000","last_unstale":"2024-08-18T21:15:49.589519+0000","last_undegraded":"2024-08-18T21:15:49.589519+0000","last_fullsized":"2024-08-18T21:15:49.589519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:15:49.589427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:15:49.589427+0000","last_clean_scrub_stamp":"2024-08-18T21:15:49.589427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:51.471988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001317337,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":655,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-08-18T21:15:49.953459+0000","last_change":"2024-08-18T21:15:49.953519+0000","last_active":"2024-08-18T21:15:49.953459+0000","last_peered":"2024-08-18T21:15:49.953459+0000","last_clean":"2024-08-18T21:15:49.953459+0000","last_became_active":"2024-08-18T21:03:39.201549+0000","last_became_peered":"2024-08-18T21:03:39.201549+0000","last_unstale":"2024-08-18T21:15:49.953459+0000","last_undegraded":"2024-08-18T21:15:49.953459+0000","last_fullsized":"2024-08-18T21:15:49.953459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:15:49.953272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:15:49.953272+0000","last_clean_scrub_stamp":"2024-08-18T21:15:49.953272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:05:19.474872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010119630000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":650,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-08-18T21:15:51.601395+0000","last_change":"2024-08-18T21:15:51.601452+0000","last_active":"2024-08-18T21:15:51.601395+0000","last_peered":"2024-08-18T21:15:51.601395+0000","last_clean":"2024-08-18T21:15:51.601395+0000","last_became_active":"2024-08-18T21:03:39.203685+0000","last_became_peered":"2024-08-18T21:03:39.203685+0000","last_unstale":"2024-08-18T21:15:51.601395+0000","last_undegraded":"2024-08-18T21:15:51.601395+0000","last_fullsized":"2024-08-18T21:15:51.601395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:15:51.601209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:15:51.601209+0000","last_clean_scrub_stamp":"2024-08-18T21:15:51.601209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:18.140718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099204900000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":645,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-08-18T21:15:52.122269+0000","last_change":"2024-08-18T21:15:52.122335+0000","last_active":"2024-08-18T21:15:52.122269+0000","last_peered":"2024-08-18T21:15:52.122269+0000","last_clean":"2024-08-18T21:15:52.122269+0000","last_became_active":"2024-08-18T21:03:39.192148+0000","last_became_peered":"2024-08-18T21:03:39.192148+0000","last_unstale":"2024-08-18T21:15:52.122269+0000","last_undegraded":"2024-08-18T21:15:52.122269+0000","last_fullsized":"2024-08-18T21:15:52.122269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:15:52.122082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:15:52.122082+0000","last_clean_scrub_stamp":"2024-08-18T21:15:52.122082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:37:46.015436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00082257800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":650,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-08-18T21:15:50.582164+0000","last_change":"2024-08-18T21:15:50.582270+0000","last_active":"2024-08-18T21:15:50.582164+0000","last_peered":"2024-08-18T21:15:50.582164+0000","last_clean":"2024-08-18T21:15:50.582164+0000","last_became_active":"2024-08-18T21:03:39.194596+0000","last_became_peered":"2024-08-18T21:03:39.194596+0000","last_unstale":"2024-08-18T21:15:50.582164+0000","last_undegraded":"2024-08-18T21:15:50.582164+0000","last_fullsized":"2024-08-18T21:15:50.582164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:15:50.581933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:15:50.581933+0000","last_clean_scrub_stamp":"2024-08-18T21:15:50.581933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:31:04.031657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001127341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":645,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-08-18T21:15:51.106171+0000","last_change":"2024-08-18T21:15:51.106233+0000","last_active":"2024-08-18T21:15:51.106171+0000","last_peered":"2024-08-18T21:15:51.106171+0000","last_clean":"2024-08-18T21:15:51.106171+0000","last_became_active":"2024-08-18T21:03:39.195166+0000","last_became_peered":"2024-08-18T21:03:39.195166+0000","last_unstale":"2024-08-18T21:15:51.106171+0000","last_undegraded":"2024-08-18T21:15:51.106171+0000","last_fullsized":"2024-08-18T21:15:51.106171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T21:15:51.105966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T21:15:51.105966+0000","last_clean_scrub_stamp":"2024-08-18T21:15:51.105966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:19.245660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001377777,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"331'3","reported_seq":651,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-08-18T21:15:48.965448+0000","last_change":"2024-08-18T21:15:48.965516+0000","last_active":"2024-08-18T21:15:48.965448+0000","last_peered":"2024-08-18T21:15:48.965448+0000","last_clean":"2024-08-18T21:15:48.965448+0000","last_became_active":"2024-08-18T21:03:39.192275+0000","last_became_peered":"2024-08-18T21:03:39.192275+0000","last_unstale":"2024-08-18T21:15:48.965448+0000","last_undegraded":"2024-08-18T21:15:48.965448+0000","last_fullsized":"2024-08-18T21:15:48.965448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"331'3","last_scrub_stamp":"2024-08-18T21:15:48.965331+0000","last_deep_scrub":"331'3","last_deep_scrub_stamp":"2024-08-18T21:15:48.965331+0000","last_clean_scrub_stamp":"2024-08-18T21:15:48.965331+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:53:17.009100+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001842333,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11116,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":12,"seq":51539607706,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34068,"kb_used_data":2884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337772,"statfs":{"total":96636764160,"available":96601878528,"internally_reserved":0,"allocated":2953216,"data_stored":1318621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640409,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34116,"kb_used_data":2932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337724,"statfs":{"total":96636764160,"available":96601829376,"internally_reserved":0,"allocated":3002368,"data_stored":1847530,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640409,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34068,"kb_used_data":2884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337772,"statfs":{"total":96636764160,"available":96601878528,"internally_reserved":0,"allocated":2953216,"data_stored":1318621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640410,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34064,"kb_used_data":2880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337776,"statfs":{"total":96636764160,"available":96601882624,"internally_reserved":0,"allocated":2949120,"data_stored":1318602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640411,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38224,"kb_used_data":2880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333616,"statfs":{"total":96636764160,"available":96597622784,"internally_reserved":0,"allocated":2949120,"data_stored":1318602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640409,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34116,"kb_used_data":2932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337724,"statfs":{"total":96636764160,"available":96601829376,"internally_reserved":0,"allocated":3002368,"data_stored":1847530,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5558,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T21:16:11.517 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-18T21:16:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.641+0000 7fe232b05640 10 monclient: get_monmap_and_config 2024-08-18T21:16:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.641+0000 7fe232b05640 10 monclient: build_initial_monmap 2024-08-18T21:16:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.641+0000 7fe232b05640 10 monclient: monmap: 2024-08-18T21:16:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:16:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:16:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:16:11.648212+0000 2024-08-18T21:16:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:16:11.648212+0000 2024-08-18T21:16:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:16:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:16:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2024-08-18T21:16:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.157:6789/0 mon.noname-f-legacy 2024-08-18T21:16:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:16:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:16:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:16:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:16:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:16:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:16:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:16:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:9: v2:172.21.15.5:3300/0 mon.noname-a 2024-08-18T21:16:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:10: v2:172.21.15.157:3300/0 mon.noname-f 2024-08-18T21:16:11.645 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 1 Processor -- start 2024-08-18T21:16:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 1 -- start start 2024-08-18T21:16:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 10 monclient: init 2024-08-18T21:16:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 10 monclient: _reopen_session rank -1 2024-08-18T21:16:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 10 monclient: _add_conns ranks=[9,4,5,1,8,3,6,10,7,2,0] 2024-08-18T21:16:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe22c0a6bd0 0x7fe22c0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:16:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 10 monclient(hunting): picked mon.noname-a con 0x7fe22c0a6bd0 addr v2:172.21.15.5:3300/0 2024-08-18T21:16:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe22c09f080 0x7fe22c0a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:16:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 10 monclient(hunting): picked mon.noname-c con 0x7fe22c09f080 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:16:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe22c139990 0x7fe22c139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:16:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 10 monclient(hunting): picked mon.noname-h con 0x7fe22c139990 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:16:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 10 monclient(hunting): start opening mon connection 2024-08-18T21:16:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe22c09e4c0 con 0x7fe22c0a6bd0 2024-08-18T21:16:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 10 monclient(hunting): start opening mon connection 2024-08-18T21:16:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fe22c06f930 con 0x7fe22c09f080 2024-08-18T21:16:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 10 monclient(hunting): start opening mon connection 2024-08-18T21:16:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe22c0a7a30 con 0x7fe22c139990 2024-08-18T21:16:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 10 monclient(hunting): _renew_subs 2024-08-18T21:16:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe232b05640 10 monclient(hunting): authenticate will time out at 1738.661795s 2024-08-18T21:16:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe22c09f080 0x7fe22c0a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:16:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe2308a1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe22c0a6bd0 0x7fe22c0a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:16:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe22c09f080 0x7fe22c0a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:38432/0 (socket says 172.21.15.5:38432) 2024-08-18T21:16:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 1 -- 172.21.15.5:0/3461157860 learned_addr learned my addr 172.21.15.5:0/3461157860 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:16:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 10 monclient(hunting): get_auth_request con 0x7fe22c09f080 auth_method 0 2024-08-18T21:16:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:16:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:16:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:16:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe2308a1640 10 monclient(hunting): get_auth_request con 0x7fe22c0a6bd0 auth_method 0 2024-08-18T21:16:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe2308a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe2308a1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe2308a1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe2308a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe2308a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe2308a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe2310a2640 1 --2- 172.21.15.5:0/3461157860 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe22c139990 0x7fe22c139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe2310a2640 10 monclient(hunting): get_auth_request con 0x7fe22c139990 auth_method 0 2024-08-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe2310a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe2310a2640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe2310a2640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 10 monclient(hunting): handle_auth_done global_id 115132 payload 274 2024-08-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 1 -- 172.21.15.5:0/3461157860 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe22c139990 msgr2=0x7fe22c139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 1 --2- 172.21.15.5:0/3461157860 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe22c139990 0x7fe22c139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 1 -- 172.21.15.5:0/3461157860 >> v2:172.21.15.5:3300/0 conn(0x7fe22c0a6bd0 msgr2=0x7fe22c0a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 1 --2- 172.21.15.5:0/3461157860 >> v2:172.21.15.5:3300/0 conn(0x7fe22c0a6bd0 0x7fe22c0a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 10 monclient: _finish_hunting 0 2024-08-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 1 monclient: found mon.noname-c 2024-08-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe223fff640 1 -- 172.21.15.5:0/3461157860 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22c0a7fb0 con 0x7fe22c09f080 2024-08-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.645+0000 7fe2308a1640 1 --2- 172.21.15.5:0/3461157860 >> v2:172.21.15.5:3300/0 conn(0x7fe22c0a6bd0 0x7fe22c0a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:16:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.649+0000 7fe223fff640 1 -- 172.21.15.5:0/3461157860 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe22c09f080 msgr2=0x7fe22c0a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:16:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.649+0000 7fe223fff640 1 --2- 172.21.15.5:0/3461157860 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe22c09f080 0x7fe22c0a74f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009870 tx=0x7fe21c01c420 comp rx=0 tx=0).ready entity=mon.4 client_cookie=82b3eca55a1d284e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:16:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2237fe640 1 -- 172.21.15.5:0/3461157860 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe21c0b0070 con 0x7fe22c09f080 2024-08-18T21:16:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:16:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2237fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:16:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2237fe640 10 monclient: dump: 2024-08-18T21:16:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:16:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:16:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:16:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:16:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:16:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:16:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:16:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:16:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:16:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:16:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:16:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:16:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:16:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:16:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:16:11.661 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2237fe640 10 monclient: _finish_auth 0 2024-08-18T21:16:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2237fe640 10 monclient: _check_auth_tickets 2024-08-18T21:16:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:16:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2237fe640 1 -- 172.21.15.5:0/3461157860 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe21c0aa810 con 0x7fe22c09f080 2024-08-18T21:16:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 5 monclient: authenticate success, global_id 115132 2024-08-18T21:16:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-18T21:16:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2237fe640 10 monclient: handle_config config(0 keys) 2024-08-18T21:16:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 10 monclient: get_monmap_and_config success 2024-08-18T21:16:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2237fe640 1 -- 172.21.15.5:0/3461157860 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe21c0aae30 con 0x7fe22c09f080 2024-08-18T21:16:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 4 set_mon_vals no callback set 2024-08-18T21:16:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:16:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2237fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:16:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2237fe640 10 monclient: dump: 2024-08-18T21:16:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:16:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:16:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:16:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:16:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:16:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:16:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:16:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:16:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:16:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:16:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:16:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:16:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:16:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:16:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:16:11.664 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 10 monclient: shutdown 2024-08-18T21:16:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:16:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 -- 172.21.15.5:0/3461157860 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe22c09f080 msgr2=0x7fe22c0a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:16:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 --2- 172.21.15.5:0/3461157860 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe22c09f080 0x7fe22c0a74f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009870 tx=0x7fe21c01c420 comp rx=0 tx=0).stop 2024-08-18T21:16:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 -- 172.21.15.5:0/3461157860 shutdown_connections 2024-08-18T21:16:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 --2- 172.21.15.5:0/3461157860 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe22c139990 0x7fe22c139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 --2- 172.21.15.5:0/3461157860 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe22c09f080 0x7fe22c0a74f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 --2- 172.21.15.5:0/3461157860 >> v2:172.21.15.5:3300/0 conn(0x7fe22c0a6bd0 0x7fe22c0a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 -- 172.21.15.5:0/3461157860 >> 172.21.15.5:0/3461157860 conn(0x7fe22c068700 msgr2=0x7fe22c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:16:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 -- 172.21.15.5:0/3461157860 shutdown_connections 2024-08-18T21:16:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 -- 172.21.15.5:0/3461157860 wait complete. 2024-08-18T21:16:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 10 monclient: build_initial_monmap 2024-08-18T21:16:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 10 monclient: monmap: 2024-08-18T21:16:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2024-08-18T21:16:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-18T21:16:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2024-08-18T21:16:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2024-08-18T21:16:11.666 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2024-08-18T21:16:11.666 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:16:11.666 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2024-08-18T21:16:11.666 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-f 2024-08-18T21:16:11.666 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2024-08-18T21:16:11.666 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.noname-g 2024-08-18T21:16:11.666 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.noname-c 2024-08-18T21:16:11.666 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.noname-h 2024-08-18T21:16:11.666 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.noname-d 2024-08-18T21:16:11.666 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.noname-i 2024-08-18T21:16:11.666 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.noname-e 2024-08-18T21:16:11.666 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 Processor -- start 2024-08-18T21:16:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 -- start start 2024-08-18T21:16:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 10 monclient: init 2024-08-18T21:16:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 10 monclient: _reopen_session rank -1 2024-08-18T21:16:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 10 monclient: _add_conns ranks=[4,1,5,0,6,7,8,2,3] 2024-08-18T21:16:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe22c09f080 0x7fe22c1d1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:16:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 10 monclient(hunting): picked mon.noname-c con 0x7fe22c09f080 addr [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] 2024-08-18T21:16:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe22c0a6bd0 0x7fe22c138a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:16:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 10 monclient(hunting): picked mon.noname-f con 0x7fe22c0a6bd0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-08-18T21:16:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 --2- >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe22c139990 0x7fe22c13dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:16:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 10 monclient(hunting): picked mon.noname-h con 0x7fe22c139990 addr [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] 2024-08-18T21:16:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 10 monclient(hunting): start opening mon connection 2024-08-18T21:16:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c0a89f0 con 0x7fe22c0a6bd0 2024-08-18T21:16:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 10 monclient(hunting): start opening mon connection 2024-08-18T21:16:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 -- --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_getmap magic: 0 -- 0x7fe22c0a7ce0 con 0x7fe22c09f080 2024-08-18T21:16:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 10 monclient(hunting): start opening mon connection 2024-08-18T21:16:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 1 -- --> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] -- mon_getmap magic: 0 -- 0x7fe22c143610 con 0x7fe22c139990 2024-08-18T21:16:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 10 monclient(hunting): _renew_subs 2024-08-18T21:16:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe232b05640 10 monclient(hunting): authenticate will time out at 1738.670574s 2024-08-18T21:16:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe22c09f080 0x7fe22c1d1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:16:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 1 --2- >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe22c09f080 0x7fe22c1d1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3302/0 says I am v2:172.21.15.5:38438/0 (socket says 172.21.15.5:38438) 2024-08-18T21:16:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 1 -- 172.21.15.5:0/3043238788 learned_addr learned my addr 172.21.15.5:0/3043238788 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T21:16:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 10 monclient(hunting): get_auth_request con 0x7fe22c09f080 auth_method 0 2024-08-18T21:16:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-18T21:16:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 10 monclient(hunting): _init_auth method 2 2024-08-18T21:16:11.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 10 monclient(hunting): _init_auth creating new auth 2024-08-18T21:16:11.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-18T21:16:11.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-18T21:16:11.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-18T21:16:11.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2310a2640 1 --2- 172.21.15.5:0/3043238788 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe22c139990 0x7fe22c13dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:16:11.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 10 monclient(hunting): handle_auth_done global_id 115141 payload 824 2024-08-18T21:16:11.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe223fff640 1 --2- 172.21.15.5:0/3043238788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe22c0a6bd0 0x7fe22c138a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:16:11.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 1 -- 172.21.15.5:0/3043238788 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe22c139990 msgr2=0x7fe22c13dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:16:11.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 1 --2- 172.21.15.5:0/3043238788 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe22c139990 0x7fe22c13dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 1 -- 172.21.15.5:0/3043238788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe22c0a6bd0 msgr2=0x7fe22c138a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:16:11.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 1 --2- 172.21.15.5:0/3043238788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe22c0a6bd0 0x7fe22c138a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:11.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 10 monclient: _finish_hunting 0 2024-08-18T21:16:11.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 1 monclient: found mon.noname-c 2024-08-18T21:16:11.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-18T21:16:11.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3302/0 2024-08-18T21:16:11.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.653+0000 7fe2308a1640 1 -- 172.21.15.5:0/3043238788 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22c0ab070 con 0x7fe22c09f080 2024-08-18T21:16:11.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2308a1640 1 -- 172.21.15.5:0/3043238788 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe22c09f080 msgr2=0x7fe22c1d1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-18T21:16:11.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2308a1640 1 --2- 172.21.15.5:0/3043238788 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe22c09f080 0x7fe22c1d1610 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe22800ebe0 tx=0x7fe22800c520 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:16:11.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2217fa640 1 -- 172.21.15.5:0/3043238788 <== mon.4 v2:172.21.15.5:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe228017070 con 0x7fe22c09f080 2024-08-18T21:16:11.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:16:11.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2217fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-18T21:16:11.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2217fa640 10 monclient: dump: 2024-08-18T21:16:11.670 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:16:11.670 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2217fa640 10 monclient: _finish_auth 0 2024-08-18T21:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2217fa640 10 monclient: _check_auth_tickets 2024-08-18T21:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-18T21:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2217fa640 1 -- 172.21.15.5:0/3043238788 <== mon.4 v2:172.21.15.5:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe22800ce40 con 0x7fe22c09f080 2024-08-18T21:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2217fa640 10 monclient: handle_config config(0 keys) 2024-08-18T21:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2217fa640 1 -- 172.21.15.5:0/3043238788 <== mon.4 v2:172.21.15.5:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe228013d50 con 0x7fe22c09f080 2024-08-18T21:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe232b05640 5 monclient: authenticate success, global_id 115141 2024-08-18T21:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe232b05640 10 monclient: _renew_subs 2024-08-18T21:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe232b05640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe232b05640 1 -- 172.21.15.5:0/3043238788 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe22c13f660 con 0x7fe22c09f080 2024-08-18T21:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2227fc640 4 set_mon_vals no callback set 2024-08-18T21:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-18T21:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2217fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-18T21:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2217fa640 10 monclient: dump: 2024-08-18T21:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2024-08-18T21:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 8465e564-1097-423a-818a-e3a141bbf945 2024-08-18T21:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2024-08-18T21:02:46.585177+0000 2024-08-18T21:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:created 2024-08-18T21:02:46.585177+0000 2024-08-18T21:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 19 (squid) 2024-08-18T21:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2024-08-18T21:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T21:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.f 2024-08-18T21:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-08-18T21:16:11.675 INFO:teuthology.orchestra.run.smithi005.stderr:3: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.g 2024-08-18T21:16:11.675 INFO:teuthology.orchestra.run.smithi005.stderr:4: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-08-18T21:16:11.675 INFO:teuthology.orchestra.run.smithi005.stderr:5: [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] mon.h 2024-08-18T21:16:11.675 INFO:teuthology.orchestra.run.smithi005.stderr:6: [v2:172.21.15.5:3303/0,v1:172.21.15.5:6792/0] mon.d 2024-08-18T21:16:11.675 INFO:teuthology.orchestra.run.smithi005.stderr:7: [v2:172.21.15.157:3303/0,v1:172.21.15.157:6792/0] mon.i 2024-08-18T21:16:11.675 INFO:teuthology.orchestra.run.smithi005.stderr:8: [v2:172.21.15.5:3304/0,v1:172.21.15.5:6793/0] mon.e 2024-08-18T21:16:11.676 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe232b05640 10 monclient: _renew_subs 2024-08-18T21:16:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe232b05640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:16:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe232b05640 1 -- 172.21.15.5:0/3043238788 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fe22c123b30 con 0x7fe22c09f080 2024-08-18T21:16:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe232b05640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-18T21:16:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe232b05640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:16:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe232b05640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:16:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe232b05640 1 -- 172.21.15.5:0/3043238788 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe22c139e10 con 0x7fe22c09f080 2024-08-18T21:16:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2217fa640 1 -- 172.21.15.5:0/3043238788 <== mon.4 v2:172.21.15.5:3302/0 4 ==== mgrmap(e 5) ==== 47758+0+0 (secure 0 0 0) 0x7fe22801a070 con 0x7fe22c09f080 2024-08-18T21:16:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2217fa640 1 --2- 172.21.15.5:0/3043238788 >> v2:172.21.15.157:6812/631023601 conn(0x7fe21803bdc0 0x7fe21803e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe2217fa640 1 -- 172.21.15.5:0/3043238788 <== mon.4 v2:172.21.15.5:3302/0 5 ==== osd_map(331..331 src has 300..331) ==== 3506+0+0 (secure 0 0 0) 0x7fe22800f040 con 0x7fe22c09f080 2024-08-18T21:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe223fff640 1 --2- 172.21.15.5:0/3043238788 >> v2:172.21.15.157:6812/631023601 conn(0x7fe21803bdc0 0x7fe21803e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.657+0000 7fe223fff640 10 monclient: get_auth_request con 0x7fe21803bdc0 auth_method 0 2024-08-18T21:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.661+0000 7fe223fff640 1 --2- 172.21.15.5:0/3043238788 >> v2:172.21.15.157:6812/631023601 conn(0x7fe21803bdc0 0x7fe21803e280 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0ab000 tx=0x7fe21c0a6000 comp rx=0 tx=0).ready entity=mgr.4130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.661+0000 7fe2217fa640 1 -- 172.21.15.5:0/3043238788 <== mon.4 v2:172.21.15.5:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186915 (secure 0 0 0) 0x7fe228021070 con 0x7fe22c09f080 2024-08-18T21:16:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.661+0000 7fe2217fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-18T21:16:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.661+0000 7fe2217fa640 10 monclient: _finish_command 1 = system:0 2024-08-18T21:16:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.837+0000 7fe232b05640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-08-18T21:16:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.837+0000 7fe232b05640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-08-18T21:16:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.837+0000 7fe232b05640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3302/0 2024-08-18T21:16:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:11.837+0000 7fe232b05640 1 -- 172.21.15.5:0/3043238788 --> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fe22c122bd0 con 0x7fe22c09f080 2024-08-18T21:16:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.065+0000 7fe2217fa640 1 -- 172.21.15.5:0/3043238788 <== mon.4 v2:172.21.15.5:3302/0 7 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe22801bc60 con 0x7fe22c09f080 2024-08-18T21:16:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.065+0000 7fe2217fa640 10 monclient: handle_config config(1 keys) 2024-08-18T21:16:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.065+0000 7fe2227fc640 4 set_mon_vals no callback set 2024-08-18T21:16:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.069+0000 7fe2227fc640 10 set_mon_vals mon_health_to_clog = false 2024-08-18T21:16:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.069+0000 7fe2217fa640 1 -- 172.21.15.5:0/3043238788 <== mon.4 v2:172.21.15.5:3302/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v3)=0 v3) ==== 123+0+0 (secure 0 0 0) 0x7fe228013520 con 0x7fe22c09f080 2024-08-18T21:16:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.069+0000 7fe2217fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-08-18T21:16:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.069+0000 7fe2217fa640 10 monclient: _finish_command 2 = system:0 2024-08-18T21:16:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.073+0000 7fe232b05640 1 -- 172.21.15.5:0/3043238788 >> v2:172.21.15.157:6812/631023601 conn(0x7fe21803bdc0 msgr2=0x7fe21803e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:16:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.073+0000 7fe232b05640 1 --2- 172.21.15.5:0/3043238788 >> v2:172.21.15.157:6812/631023601 conn(0x7fe21803bdc0 0x7fe21803e280 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0ab000 tx=0x7fe21c0a6000 comp rx=0 tx=0).stop 2024-08-18T21:16:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.073+0000 7fe232b05640 10 monclient: shutdown 2024-08-18T21:16:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.073+0000 7fe232b05640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-18T21:16:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.073+0000 7fe232b05640 1 -- 172.21.15.5:0/3043238788 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe22c09f080 msgr2=0x7fe22c1d1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:16:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.073+0000 7fe232b05640 1 --2- 172.21.15.5:0/3043238788 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe22c09f080 0x7fe22c1d1610 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe22800ebe0 tx=0x7fe22800c520 comp rx=0 tx=0).stop 2024-08-18T21:16:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.073+0000 7fe232b05640 1 -- 172.21.15.5:0/3043238788 shutdown_connections 2024-08-18T21:16:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.073+0000 7fe232b05640 1 --2- 172.21.15.5:0/3043238788 >> v2:172.21.15.157:6812/631023601 conn(0x7fe21803bdc0 0x7fe21803e280 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.073+0000 7fe232b05640 1 --2- 172.21.15.5:0/3043238788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe22c0a6bd0 0x7fe22c138a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.073+0000 7fe232b05640 1 --2- 172.21.15.5:0/3043238788 >> [v2:172.21.15.157:3302/0,v1:172.21.15.157:6791/0] conn(0x7fe22c139990 0x7fe22c13dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.073+0000 7fe232b05640 1 --2- 172.21.15.5:0/3043238788 >> [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] conn(0x7fe22c09f080 0x7fe22c1d1610 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:16:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.073+0000 7fe232b05640 1 -- 172.21.15.5:0/3043238788 >> 172.21.15.5:0/3043238788 conn(0x7fe22c068700 msgr2=0x7fe22c0a9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:16:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.073+0000 7fe232b05640 1 -- 172.21.15.5:0/3043238788 shutdown_connections 2024-08-18T21:16:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T21:16:13.073+0000 7fe232b05640 1 -- 172.21.15.5:0/3043238788 wait complete. 2024-08-18T21:16:13.096 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/ceph.py", line 1980, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 466, in task thrash_proc.stop_and_join() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 178, in stop_and_join return self.join() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 170, in join self.stopping.set() AttributeError: 'bool' object has no attribute 'set' 2024-08-18T21:16:13.097 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-18T21:16:13.098 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-18T21:16:13.098 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-18T21:16:13.098 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:16:13.187 INFO:tasks.ceph.osd.0:Stopped 2024-08-18T21:16:13.187 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-18T21:16:13.187 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:16:13.271 INFO:tasks.ceph.osd.1:Stopped 2024-08-18T21:16:13.271 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-18T21:16:13.271 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:16:13.353 INFO:tasks.ceph.osd.2:Stopped 2024-08-18T21:16:13.354 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-18T21:16:13.354 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:16:13.448 INFO:tasks.ceph.osd.3:Stopped 2024-08-18T21:16:13.448 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-18T21:16:13.449 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:16:13.533 INFO:tasks.ceph.osd.4:Stopped 2024-08-18T21:16:13.533 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-18T21:16:13.533 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:16:13.610 INFO:tasks.ceph.osd.5:Stopped 2024-08-18T21:16:13.611 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-18T21:16:13.611 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-18T21:16:13.611 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:16:13.647 INFO:tasks.ceph.mgr.x:Stopped 2024-08-18T21:16:13.647 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-18T21:16:13.647 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-18T21:16:13.647 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:16:13.669 INFO:tasks.ceph.mon.a:Stopped 2024-08-18T21:16:13.670 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-18T21:16:13.670 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:16:13.732 INFO:tasks.ceph.mon.b:Stopped 2024-08-18T21:16:13.733 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-18T21:16:13.733 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:16:13.801 INFO:tasks.ceph.mon.c:Stopped 2024-08-18T21:16:13.802 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-08-18T21:16:13.802 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:16:13.862 INFO:tasks.ceph.mon.d:Stopped 2024-08-18T21:16:13.863 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-08-18T21:16:13.863 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:16:13.932 INFO:tasks.ceph.mon.e:Stopped 2024-08-18T21:16:13.932 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-08-18T21:16:13.932 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:16:13.950 INFO:tasks.ceph.mon.f:Stopped 2024-08-18T21:16:13.950 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-08-18T21:16:13.951 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:16:14.020 INFO:tasks.ceph.mon.g:Stopped 2024-08-18T21:16:14.020 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2024-08-18T21:16:14.020 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:16:14.084 INFO:tasks.ceph.mon.h:Stopped 2024-08-18T21:16:14.085 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2024-08-18T21:16:14.085 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T21:16:14.146 INFO:tasks.ceph.mon.i:Stopped 2024-08-18T21:16:14.147 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-18T21:16:14.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v ScrubResult | egrep -v 'scrub mismatch' | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | head -n 1 2024-08-18T21:16:14.178 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T21:16:14.178 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-18T21:16:14.521 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T21:16:14.521 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-18T21:16:14.785 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T21:16:14.785 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-18T21:16:14.985 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi157.front.sepia.ceph.com 2024-08-18T21:16:14.985 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-18T21:16:15.207 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi157.front.sepia.ceph.com 2024-08-18T21:16:15.208 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-18T21:16:15.409 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi157.front.sepia.ceph.com 2024-08-18T21:16:15.409 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-18T21:16:15.570 INFO:tasks.ceph:Archiving mon data... 2024-08-18T21:16:15.570 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222/data/mon.a.tgz 2024-08-18T21:16:15.571 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-08-18T21:16:15.576 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.aWlJr43siN 2024-08-18T21:16:15.577 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.aWlJr43siN 2024-08-18T21:16:15.830 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.aWlJr43siN 2024-08-18T21:16:15.895 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.aWlJr43siN is 1MB 2024-08-18T21:16:15.966 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.aWlJr43siN 2024-08-18T21:16:15.972 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222/data/mon.b.tgz 2024-08-18T21:16:15.972 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-08-18T21:16:16.020 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.BaUx8oHmZ3 2024-08-18T21:16:16.021 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.BaUx8oHmZ3 2024-08-18T21:16:16.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.BaUx8oHmZ3 2024-08-18T21:16:16.336 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.BaUx8oHmZ3 is 1MB 2024-08-18T21:16:16.405 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.BaUx8oHmZ3 2024-08-18T21:16:16.411 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222/data/mon.c.tgz 2024-08-18T21:16:16.411 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-08-18T21:16:16.459 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.HRfUlvr3gg 2024-08-18T21:16:16.460 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.HRfUlvr3gg 2024-08-18T21:16:16.703 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.HRfUlvr3gg 2024-08-18T21:16:16.767 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.HRfUlvr3gg is 1MB 2024-08-18T21:16:16.837 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.HRfUlvr3gg 2024-08-18T21:16:16.843 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-d to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222/data/mon.d.tgz 2024-08-18T21:16:16.843 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-08-18T21:16:16.891 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.ugeACYdhFX 2024-08-18T21:16:16.891 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-d -- . > /tmp/tmp.ugeACYdhFX 2024-08-18T21:16:17.135 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.ugeACYdhFX 2024-08-18T21:16:17.199 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.ugeACYdhFX is 1MB 2024-08-18T21:16:17.269 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.ugeACYdhFX 2024-08-18T21:16:17.275 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-e to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222/data/mon.e.tgz 2024-08-18T21:16:17.275 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-08-18T21:16:17.323 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.KXeuzd7Wc7 2024-08-18T21:16:17.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-e -- . > /tmp/tmp.KXeuzd7Wc7 2024-08-18T21:16:17.560 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.KXeuzd7Wc7 2024-08-18T21:16:17.625 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.KXeuzd7Wc7 is 1MB 2024-08-18T21:16:17.693 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.KXeuzd7Wc7 2024-08-18T21:16:17.699 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-f to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222/data/mon.f.tgz 2024-08-18T21:16:17.699 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-08-18T21:16:17.705 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.drkB1bOfOT 2024-08-18T21:16:17.705 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-f -- . > /tmp/tmp.drkB1bOfOT 2024-08-18T21:16:17.949 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.drkB1bOfOT 2024-08-18T21:16:18.016 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.drkB1bOfOT is 1MB 2024-08-18T21:16:18.087 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.drkB1bOfOT 2024-08-18T21:16:18.093 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-g to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222/data/mon.g.tgz 2024-08-18T21:16:18.093 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-08-18T21:16:18.141 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.iSCjR9lUd5 2024-08-18T21:16:18.141 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-g -- . > /tmp/tmp.iSCjR9lUd5 2024-08-18T21:16:18.380 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.iSCjR9lUd5 2024-08-18T21:16:18.440 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.iSCjR9lUd5 is 1MB 2024-08-18T21:16:18.508 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.iSCjR9lUd5 2024-08-18T21:16:18.513 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-h to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222/data/mon.h.tgz 2024-08-18T21:16:18.514 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-08-18T21:16:18.561 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.iN3RiBH5W2 2024-08-18T21:16:18.657 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-h -- . > /tmp/tmp.iN3RiBH5W2 2024-08-18T21:16:18.859 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.iN3RiBH5W2 2024-08-18T21:16:18.925 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.iN3RiBH5W2 is 1MB 2024-08-18T21:16:18.995 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.iN3RiBH5W2 2024-08-18T21:16:19.001 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-i to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222/data/mon.i.tgz 2024-08-18T21:16:19.001 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-08-18T21:16:19.049 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.IoVDVd2As4 2024-08-18T21:16:19.049 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-i -- . > /tmp/tmp.IoVDVd2As4 2024-08-18T21:16:19.294 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.IoVDVd2As4 2024-08-18T21:16:19.357 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.IoVDVd2As4 is 1MB 2024-08-18T21:16:19.467 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.IoVDVd2As4 2024-08-18T21:16:19.475 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-18T21:16:19.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-18T21:16:19.477 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-18T21:16:19.537 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-18T21:16:19.577 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-18T21:16:19.577 INFO:tasks.ceph:Archiving crash dumps... 2024-08-18T21:16:19.579 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222/remote/smithi005/crash 2024-08-18T21:16:19.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-18T21:16:19.594 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222/remote/smithi157/crash 2024-08-18T21:16:19.595 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-18T21:16:19.633 INFO:tasks.ceph:Compressing logs... 2024-08-18T21:16:19.634 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-18T21:16:19.640 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-18T21:16:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36023.log 2024-08-18T21:16:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37743.log 2024-08-18T21:16:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33417.log 2024-08-18T21:16:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29753.log 2024-08-18T21:16:19.807 INFO:teuthology.orchestra.run.smithi005.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.36023.log.gz 2024-08-18T21:16:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33443.log 2024-08-18T21:16:19.808 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37743.log.gz 2024-08-18T21:16:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28419.log 2024-08-18T21:16:19.808 INFO:teuthology.orchestra.run.smithi005.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.33417.log.gz 2024-08-18T21:16:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30881.log 2024-08-18T21:16:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30567.log 2024-08-18T21:16:19.808 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.29753.log.gz 2024-08-18T21:16:19.808 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.33443.log.gz 2024-08-18T21:16:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30619.log 2024-08-18T21:16:19.808 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28419.log.gz 2024-08-18T21:16:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30567.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30881.log.gz 2024-08-18T21:16:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34323.log 2024-08-18T21:16:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.30619.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35839.log 2024-08-18T21:16:19.809 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.30567.log.gz 2024-08-18T21:16:19.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33311.log 2024-08-18T21:16:19.809 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.34323.log.gz 2024-08-18T21:16:19.809 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.30619.log.gz 2024-08-18T21:16:19.809 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34139.log 2024-08-18T21:16:19.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35839.log: /var/log/ceph/ceph-client.admin.33311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30431.log 2024-08-18T21:16:19.809 INFO:teuthology.orchestra.run.smithi005.stderr: 89.6%/var/log/ceph/ceph-client.admin.34139.log: -- replaced with /var/log/ceph/ceph-client.admin.35839.log.gz 2024-08-18T21:16:19.809 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31700.log 2024-08-18T21:16:19.809 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.33311.log.gz 2024-08-18T21:16:19.809 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32432.log 2024-08-18T21:16:19.809 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.34139.log.gz 2024-08-18T21:16:19.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30431.log: /var/log/ceph/ceph-client.admin.31700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36712.log 2024-08-18T21:16:19.810 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32775.log 2024-08-18T21:16:19.810 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.31700.log.gz 2024-08-18T21:16:19.810 INFO:teuthology.orchestra.run.smithi005.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.30431.log.gz 2024-08-18T21:16:19.810 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35943.log 2024-08-18T21:16:19.810 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.32432.log.gz 2024-08-18T21:16:19.810 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35810.log 2024-08-18T21:16:19.810 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.36712.log.gz 2024-08-18T21:16:19.810 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30067.log 2024-08-18T21:16:19.810 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.32775.log.gz 2024-08-18T21:16:19.810 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36153.log 2024-08-18T21:16:19.810 INFO:teuthology.orchestra.run.smithi005.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.35943.log.gz 2024-08-18T21:16:19.810 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36738.log 2024-08-18T21:16:19.810 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30487.log 2024-08-18T21:16:19.811 INFO:teuthology.orchestra.run.smithi005.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.35810.log.gz 2024-08-18T21:16:19.811 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36738.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.36153.log.gz 2024-08-18T21:16:19.811 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 92.2% -- replaced with /var/log/ceph/ceph-client.admin.30067.log.gz -5 2024-08-18T21:16:19.811 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32616.log 2024-08-18T21:16:19.811 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33103.log 2024-08-18T21:16:19.811 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30487.log: /var/log/ceph/ceph-client.admin.32616.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-18T21:16:19.811 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.36738.log.gz 2024-08-18T21:16:19.811 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34687.log 2024-08-18T21:16:19.811 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30487.log.gz 2024-08-18T21:16:19.811 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.0.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32616.log.gz 2024-08-18T21:16:19.812 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.33103.log.gz 2024-08-18T21:16:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36634.log 2024-08-18T21:16:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32959.log 2024-08-18T21:16:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37405.log 2024-08-18T21:16:19.812 INFO:teuthology.orchestra.run.smithi005.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34687.log.gz 2024-08-18T21:16:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31037.log 2024-08-18T21:16:19.812 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.36634.log.gz 2024-08-18T21:16:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32406.log 2024-08-18T21:16:19.812 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.32959.log.gz 2024-08-18T21:16:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32907.log 2024-08-18T21:16:19.812 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37405.log.gz 2024-08-18T21:16:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34243.log 2024-08-18T21:16:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27994.log 2024-08-18T21:16:19.812 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32406.log.gz 2024-08-18T21:16:19.813 INFO:teuthology.orchestra.run.smithi005.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.31037.log.gz 2024-08-18T21:16:19.813 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.32907.log.gz 2024-08-18T21:16:19.813 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31542.log 2024-08-18T21:16:19.813 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.27994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28087.log 2024-08-18T21:16:19.813 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34243.log.gz 2024-08-18T21:16:19.813 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.27994.log.gz 2024-08-18T21:16:19.813 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35543.log 2024-08-18T21:16:19.813 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29223.log 2024-08-18T21:16:19.813 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28087.log: /var/log/ceph/ceph-client.admin.35543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29275.log 2024-08-18T21:16:19.813 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.31542.log.gz 2024-08-18T21:16:19.813 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30645.log 2024-08-18T21:16:19.813 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.28087.log.gz 2024-08-18T21:16:19.813 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35543.log.gz 2024-08-18T21:16:19.813 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38081.log 2024-08-18T21:16:19.814 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.29223.log.gz 2024-08-18T21:16:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30645.log: 90.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.29275.log.gz 2024-08-18T21:16:19.814 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33981.log 2024-08-18T21:16:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35701.log 2024-08-18T21:16:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38081.log: /var/log/ceph/ceph-client.admin.33981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36521.log 2024-08-18T21:16:19.814 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.30645.log.gz 2024-08-18T21:16:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35701.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38081.log.gz 2024-08-18T21:16:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35333.log 2024-08-18T21:16:19.814 INFO:teuthology.orchestra.run.smithi005.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33981.log.gz 2024-08-18T21:16:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36337.log 2024-08-18T21:16:19.814 INFO:teuthology.orchestra.run.smithi005.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.35701.log.gz 2024-08-18T21:16:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29673.log 2024-08-18T21:16:19.814 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.36521.log.gz 2024-08-18T21:16:19.815 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29592.log 2024-08-18T21:16:19.815 INFO:teuthology.orchestra.run.smithi005.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.35333.log.gz 2024-08-18T21:16:19.815 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32590.log 2024-08-18T21:16:19.815 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.36337.log.gz 2024-08-18T21:16:19.815 INFO:teuthology.orchestra.run.smithi005.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.29673.log.gz 2024-08-18T21:16:19.815 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32248.log 2024-08-18T21:16:19.815 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28800.log 2024-08-18T21:16:19.815 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.29592.log.gz 2024-08-18T21:16:19.815 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34061.log 2024-08-18T21:16:19.815 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28800.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32590.log.gz 2024-08-18T21:16:19.815 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30907.log 2024-08-18T21:16:19.815 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35437.log 2024-08-18T21:16:19.815 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34061.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.32248.log.gz 2024-08-18T21:16:19.816 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28800.log.gz 2024-08-18T21:16:19.816 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32801.log 2024-08-18T21:16:19.816 INFO:teuthology.orchestra.run.smithi005.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.34061.log.gz 2024-08-18T21:16:19.816 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28081.log 2024-08-18T21:16:19.816 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30907.log.gz 2024-08-18T21:16:19.816 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35623.log 2024-08-18T21:16:19.816 INFO:teuthology.orchestra.run.smithi005.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.32801.log.gz 2024-08-18T21:16:19.816 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.35437.log.gz/var/log/ceph/ceph-client.admin.28081.log: 2024-08-18T21:16:19.816 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31726.log 2024-08-18T21:16:19.816 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28544.log 2024-08-18T21:16:19.816 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.28081.log.gz 2024-08-18T21:16:19.816 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37238.log 2024-08-18T21:16:19.816 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.35623.log.gz 2024-08-18T21:16:19.816 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31962.log 2024-08-18T21:16:19.817 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.31726.log.gz 2024-08-18T21:16:19.817 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37264.log 2024-08-18T21:16:19.817 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28544.log.gz 2024-08-18T21:16:19.817 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33549.log 2024-08-18T21:16:19.817 INFO:teuthology.orchestra.run.smithi005.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.37238.log.gz 2024-08-18T21:16:19.817 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37264.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.31962.log.gz 2024-08-18T21:16:19.817 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33653.log 2024-08-18T21:16:19.817 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34479.log 2024-08-18T21:16:19.817 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33549.log: /var/log/ceph/ceph-client.admin.33653.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.37264.log.gz 2024-08-18T21:16:19.817 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36950.log 2024-08-18T21:16:19.817 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8%/var/log/ceph/ceph-client.admin.34479.log: -- replaced with /var/log/ceph/ceph-client.admin.33653.log.gz 2024-08-18T21:16:19.817 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35463.log 2024-08-18T21:16:19.817 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.33549.log.gz 2024-08-18T21:16:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28878.log 2024-08-18T21:16:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36950.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.34479.log.gz 2024-08-18T21:16:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28235.log 2024-08-18T21:16:19.818 INFO:teuthology.orchestra.run.smithi005.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.36950.log.gz 2024-08-18T21:16:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32066.log 2024-08-18T21:16:19.818 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35463.log.gz 2024-08-18T21:16:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37028.log 2024-08-18T21:16:19.818 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28878.log.gz 2024-08-18T21:16:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37925.log 2024-08-18T21:16:19.818 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.28235.log.gz 2024-08-18T21:16:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37028.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-18T21:16:19.818 INFO:teuthology.orchestra.run.smithi005.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.32066.log.gz 2024-08-18T21:16:19.818 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.37028.log.gz 2024-08-18T21:16:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30749.log 2024-08-18T21:16:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31438.log 2024-08-18T21:16:19.819 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37925.log.gz 2024-08-18T21:16:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34113.log 2024-08-18T21:16:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29171.log 2024-08-18T21:16:19.819 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30749.log.gz 2024-08-18T21:16:19.819 INFO:teuthology.orchestra.run.smithi005.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.31438.log.gz 2024-08-18T21:16:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37457.log 2024-08-18T21:16:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36686.log/var/log/ceph/ceph-client.admin.29171.log: 2024-08-18T21:16:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37457.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.34113.log.gz 2024-08-18T21:16:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32642.log 2024-08-18T21:16:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35997.log 90.3% 2024-08-18T21:16:19.819 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37457.log.gz 2024-08-18T21:16:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32642.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.29171.log.gz 2024-08-18T21:16:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37715.log 2024-08-18T21:16:19.820 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.36686.log.gz 2024-08-18T21:16:19.820 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.32642.log.gz 2024-08-18T21:16:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28937.log 2024-08-18T21:16:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35227.log 2024-08-18T21:16:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37715.log: /var/log/ceph/ceph-client.admin.28937.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.35997.log.gz 2024-08-18T21:16:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28384.log 2024-08-18T21:16:19.820 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37715.log.gz 2024-08-18T21:16:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 90.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.28937.log.gz --verbose 2024-08-18T21:16:19.820 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.36896.log 2024-08-18T21:16:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35227.log: /var/log/ceph/ceph-client.admin.28384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29935.log 2024-08-18T21:16:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33953.log 2024-08-18T21:16:19.820 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35227.log.gz 2024-08-18T21:16:19.820 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28384.log.gz 2024-08-18T21:16:19.821 INFO:teuthology.orchestra.run.smithi005.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36896.log.gz 2024-08-18T21:16:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38055.log 2024-08-18T21:16:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29935.log: /var/log/ceph/ceph-client.admin.33953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32722.log 2024-08-18T21:16:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38055.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.29935.log.gz 2024-08-18T21:16:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37795.log 2024-08-18T21:16:19.821 INFO:teuthology.orchestra.run.smithi005.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.33953.log.gz 2024-08-18T21:16:19.821 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38055.log.gz 2024-08-18T21:16:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37321.log 2024-08-18T21:16:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32722.log: /var/log/ceph/ceph-client.admin.37795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33627.log 2024-08-18T21:16:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37321.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-18T21:16:19.821 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.32722.log.gz 2024-08-18T21:16:19.821 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37795.log.gz 2024-08-18T21:16:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27968.log 2024-08-18T21:16:19.821 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.37321.log.gz 2024-08-18T21:16:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36660.log 2024-08-18T21:16:19.822 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33627.log.gz 2024-08-18T21:16:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.27968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29514.log 2024-08-18T21:16:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34531.log 2024-08-18T21:16:19.822 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.27968.log.gz 2024-08-18T21:16:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29514.log: gzip -5 --verbose 90.2% -- -- replaced with /var/log/ceph/ceph-client.admin.36660.log.gz /var/log/ceph/ceph-client.admin.31674.log 2024-08-18T21:16:19.822 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28020.log/var/log/ceph/ceph-client.admin.34531.log: 2024-08-18T21:16:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31674.log: gzip 90.1% -5 --verbose -- /var/log/ceph/ceph-client.admin.33497.log 2024-08-18T21:16:19.822 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29514.log.gz 2024-08-18T21:16:19.822 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34531.log.gz/var/log/ceph/ceph-client.admin.28020.log: 2024-08-18T21:16:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30095.log 2024-08-18T21:16:19.822 INFO:teuthology.orchestra.run.smithi005.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.31674.log.gz 2024-08-18T21:16:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33497.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28020.log.gz 2024-08-18T21:16:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28241.log 2024-08-18T21:16:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32354.log 2024-08-18T21:16:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30095.log: /var/log/ceph/ceph-client.admin.28241.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.33497.log.gz 2024-08-18T21:16:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.e.log 2024-08-18T21:16:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32354.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.30095.log.gz 2024-08-18T21:16:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36924.log 2024-08-18T21:16:19.823 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28241.log.gz 2024-08-18T21:16:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33181.log 2024-08-18T21:16:19.823 INFO:teuthology.orchestra.run.smithi005.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.32354.log.gz 2024-08-18T21:16:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33129.log 2024-08-18T21:16:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31063.log 2024-08-18T21:16:19.823 INFO:teuthology.orchestra.run.smithi005.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.36924.log.gz 2024-08-18T21:16:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35045.log 2024-08-18T21:16:19.823 INFO:teuthology.orchestra.run.smithi005.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.33181.log.gz 2024-08-18T21:16:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30541.log 2024-08-18T21:16:19.824 INFO:teuthology.orchestra.run.smithi005.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.33129.log.gz/var/log/ceph/ceph-client.admin.31063.log: 2024-08-18T21:16:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33155.log 2024-08-18T21:16:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34297.log 2024-08-18T21:16:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33155.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.35045.log.gz 2024-08-18T21:16:19.824 INFO:teuthology.orchestra.run.smithi005.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.31063.log.gz 2024-08-18T21:16:19.824 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30541.log.gz 2024-08-18T21:16:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34557.log 2024-08-18T21:16:19.824 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.33155.log.gz 2024-08-18T21:16:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29805.log 2024-08-18T21:16:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36311.log 2024-08-18T21:16:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34557.log: /var/log/ceph/ceph-client.admin.29805.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.34297.log.gz 2024-08-18T21:16:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31115.log 2024-08-18T21:16:19.824 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33075.log 2024-08-18T21:16:19.825 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34557.log.gz 2024-08-18T21:16:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36311.log: /var/log/ceph/ceph-client.admin.31115.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.29805.log.gz 2024-08-18T21:16:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30251.log 2024-08-18T21:16:19.825 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.36311.log.gz 2024-08-18T21:16:19.825 INFO:teuthology.orchestra.run.smithi005.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.31115.log.gz 2024-08-18T21:16:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33075.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33075.log.gz 2024-08-18T21:16:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29647.log 2024-08-18T21:16:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35649.log 2024-08-18T21:16:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28091.log 2024-08-18T21:16:19.825 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0%/var/log/ceph/ceph-client.admin.35649.log: -- replaced with /var/log/ceph/ceph-client.admin.30251.log.gz 2024-08-18T21:16:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36766.log 2024-08-18T21:16:19.825 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.29647.log.gz 2024-08-18T21:16:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28091.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.35649.log.gz 2024-08-18T21:16:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34191.log 2024-08-18T21:16:19.826 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28091.log.gz 2024-08-18T21:16:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28089.log 2024-08-18T21:16:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29831.log 2024-08-18T21:16:19.826 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.36766.log.gz 2024-08-18T21:16:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37509.log 2024-08-18T21:16:19.826 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.34191.log.gz 2024-08-18T21:16:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34165.log 2024-08-18T21:16:19.826 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28089.log.gz 2024-08-18T21:16:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36818.log 2024-08-18T21:16:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37509.log: /var/log/ceph/ceph-client.admin.34165.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.29831.log.gz 2024-08-18T21:16:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35385.log 2024-08-18T21:16:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31988.log 2024-08-18T21:16:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35385.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.34165.log.gz 2024-08-18T21:16:19.827 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.37509.log.gz 2024-08-18T21:16:19.827 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.36818.log.gz 2024-08-18T21:16:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34609.log 2024-08-18T21:16:19.827 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.35385.log.gz 2024-08-18T21:16:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32102.log 2024-08-18T21:16:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28422.log 2024-08-18T21:16:19.827 INFO:teuthology.orchestra.run.smithi005.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.31988.log.gz 2024-08-18T21:16:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31568.log 2024-08-18T21:16:19.827 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.34609.log.gz 2024-08-18T21:16:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34217.log 2024-08-18T21:16:19.827 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5%/var/log/ceph/ceph-client.admin.28422.log: -- replaced with /var/log/ceph/ceph-client.admin.32102.log.gz/var/log/ceph/ceph-client.admin.31568.log: 2024-08-18T21:16:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35675.log 2024-08-18T21:16:19.827 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28422.log.gz 90.5% 2024-08-18T21:16:19.827 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31568.log.gz 2024-08-18T21:16:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34217.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.34217.log.gz 2024-08-18T21:16:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30403.log 2024-08-18T21:16:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29436.log 2024-08-18T21:16:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34713.log 2024-08-18T21:16:19.828 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4%/var/log/ceph/ceph-client.admin.29436.log: -- replaced with /var/log/ceph/ceph-client.admin.35675.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31622.log 2024-08-18T21:16:19.828 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34713.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.30403.log.gz 2024-08-18T21:16:19.828 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29436.log.gz 2024-08-18T21:16:19.828 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.34713.log.gz 2024-08-18T21:16:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32328.log 2024-08-18T21:16:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37951.log 2024-08-18T21:16:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30933.log 2024-08-18T21:16:19.828 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31622.log.gz 2024-08-18T21:16:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35865.log 2024-08-18T21:16:19.829 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32328.log.gz 2024-08-18T21:16:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34965.log 2024-08-18T21:16:19.829 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2%/var/log/ceph/ceph-client.admin.30933.log: /var/log/ceph/ceph-client.admin.35865.log: -- replaced with /var/log/ceph/ceph-client.admin.37951.log.gz 2024-08-18T21:16:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31490.log 2024-08-18T21:16:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34965.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35865.log.gz 2024-08-18T21:16:19.829 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.30933.log.gz 2024-08-18T21:16:19.829 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34965.log.gz 2024-08-18T21:16:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37080.log 2024-08-18T21:16:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28580.log 2024-08-18T21:16:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37483.log 2024-08-18T21:16:19.829 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.31490.log.gz 2024-08-18T21:16:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36207.log 2024-08-18T21:16:19.829 INFO:teuthology.orchestra.run.smithi005.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.37080.log.gz 2024-08-18T21:16:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37769.log 2024-08-18T21:16:19.830 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28580.log.gz 2024-08-18T21:16:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37483.log: /var/log/ceph/ceph-client.admin.36207.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.36207.log.gz 2024-08-18T21:16:19.830 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.37483.log.gz 2024-08-18T21:16:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37431.log 2024-08-18T21:16:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28242.log 2024-08-18T21:16:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37769.log: /var/log/ceph/ceph-client.admin.37431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30015.log 2024-08-18T21:16:19.830 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37769.log.gz 2024-08-18T21:16:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32668.log 2024-08-18T21:16:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28242.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.37431.log.gz 2024-08-18T21:16:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30015.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28242.log.gz 2024-08-18T21:16:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29197.log 2024-08-18T21:16:19.830 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30015.log.gz 2024-08-18T21:16:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28774.log 2024-08-18T21:16:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35019.log 2024-08-18T21:16:19.831 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.32668.log.gz 2024-08-18T21:16:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28551.log 2024-08-18T21:16:19.831 INFO:teuthology.orchestra.run.smithi005.stderr: 89.8%/var/log/ceph/ceph-client.admin.35019.log: -- replaced with /var/log/ceph/ceph-client.admin.29197.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33469.log 2024-08-18T21:16:19.831 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:19.831 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28774.log.gz 2024-08-18T21:16:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25264.log 2024-08-18T21:16:19.831 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.35019.log.gz 2024-08-18T21:16:19.831 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28551.log.gz 2024-08-18T21:16:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33469.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.33469.log.gz 2024-08-18T21:16:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29488.log 2024-08-18T21:16:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.25264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35891.log 2024-08-18T21:16:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37054.log 2024-08-18T21:16:19.831 INFO:teuthology.orchestra.run.smithi005.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.25264.log.gz 2024-08-18T21:16:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28852.log 2024-08-18T21:16:19.832 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.29488.log.gz 2024-08-18T21:16:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29779.log 2024-08-18T21:16:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37054.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35891.log.gz/var/log/ceph/ceph-client.admin.28852.log: 2024-08-18T21:16:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34937.log 2024-08-18T21:16:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33339.log 2024-08-18T21:16:19.832 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% 90.5%/var/log/ceph/ceph-client.admin.34937.log: -- replaced with /var/log/ceph/ceph-client.admin.37054.log.gz 2024-08-18T21:16:19.832 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28852.log.gz 2024-08-18T21:16:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 90.4% -- replaced with /var/log/ceph/ceph-client.admin.29779.log.gz -5 2024-08-18T21:16:19.832 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35123.log 2024-08-18T21:16:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35071.log 2024-08-18T21:16:19.832 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.34937.log.gz 2024-08-18T21:16:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29883.log 2024-08-18T21:16:19.832 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33339.log.gz/var/log/ceph/ceph-client.admin.35071.log: gzip 2024-08-18T21:16:19.833 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35149.log 2024-08-18T21:16:19.833 INFO:teuthology.orchestra.run.smithi005.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.35123.log.gz 2024-08-18T21:16:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29883.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35071.log.gz 2024-08-18T21:16:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31011.log 2024-08-18T21:16:19.833 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.29883.log.gz 2024-08-18T21:16:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30041.log 2024-08-18T21:16:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36363.log 2024-08-18T21:16:19.833 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4%/var/log/ceph/ceph-client.admin.30041.log: -- replaced with /var/log/ceph/ceph-client.admin.35149.log.gz 2024-08-18T21:16:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28226.log 2024-08-18T21:16:19.833 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34453.log 2024-08-18T21:16:19.833 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31011.log.gz 2024-08-18T21:16:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36363.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30041.log.gz 2024-08-18T21:16:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28226.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28226.log.gz 2024-08-18T21:16:19.833 INFO:teuthology.orchestra.run.smithi005.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.36363.log.gz 2024-08-18T21:16:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36870.log 2024-08-18T21:16:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35569.log 2024-08-18T21:16:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32985.log 2024-08-18T21:16:19.834 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4%/var/log/ceph/ceph-client.admin.35569.log: -- replaced with /var/log/ceph/ceph-client.admin.34453.log.gz 2024-08-18T21:16:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30697.log 2024-08-18T21:16:19.834 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36870.log.gz 2024-08-18T21:16:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33913.log 2024-08-18T21:16:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32985.log: /var/log/ceph/ceph-client.admin.30697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32694.log 2024-08-18T21:16:19.834 INFO:teuthology.orchestra.run.smithi005.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.35569.log.gz 2024-08-18T21:16:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33913.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.32985.log.gz 2024-08-18T21:16:19.835 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.30697.log.gz 2024-08-18T21:16:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31856.log 2024-08-18T21:16:19.835 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.33913.log.gz 2024-08-18T21:16:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-18T21:16:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32694.log: /var/log/ceph/ceph-client.admin.31856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37212.log 2024-08-18T21:16:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- 90.1% /var/log/ceph/ceph-client.admin.35175.log -- replaced with /var/log/ceph/ceph-client.admin.32694.log.gz 2024-08-18T21:16:19.835 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:19.835 INFO:teuthology.orchestra.run.smithi005.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.31856.log.gz 2024-08-18T21:16:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37212.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.37212.log.gz 2024-08-18T21:16:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35097.log 2024-08-18T21:16:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29566.log 2024-08-18T21:16:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34583.log 2024-08-18T21:16:19.836 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.35175.log.gz 2024-08-18T21:16:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29566.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.35097.log.gz 2024-08-18T21:16:19.836 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35281.log 2024-08-18T21:16:19.836 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29566.log.gz 2024-08-18T21:16:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31193.log 2024-08-18T21:16:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35359.log 2024-08-18T21:16:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35281.log: /var/log/ceph/ceph-client.admin.31193.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.35281.log.gz 2024-08-18T21:16:19.836 INFO:teuthology.orchestra.run.smithi005.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.34583.log.gz 2024-08-18T21:16:19.836 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.31193.log.gz 2024-08-18T21:16:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36608.log 2024-08-18T21:16:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29989.log 2024-08-18T21:16:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35359.log: /var/log/ceph/ceph-client.admin.36608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35255.log 2024-08-18T21:16:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29989.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36608.log.gz 2024-08-18T21:16:19.836 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.35359.log.gz 2024-08-18T21:16:19.837 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29989.log.gz 2024-08-18T21:16:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30723.log 2024-08-18T21:16:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32460.log 2024-08-18T21:16:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30723.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.d.log 2024-08-18T21:16:19.837 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35255.log.gz 2024-08-18T21:16:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32460.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.30723.log.gz 2024-08-18T21:16:19.837 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32460.log.gz 2024-08-18T21:16:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30959.log 2024-08-18T21:16:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31412.log 2024-08-18T21:16:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33233.log 2024-08-18T21:16:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31412.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.30959.log.gz 2024-08-18T21:16:19.837 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.31412.log.gz 2024-08-18T21:16:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36233.log 2024-08-18T21:16:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33011.log 2024-08-18T21:16:19.838 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33233.log: /var/log/ceph/ceph-client.admin.36233.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.33233.log.gz 2024-08-18T21:16:19.838 INFO:teuthology.orchestra.run.smithi005.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.36233.log.gz 2024-08-18T21:16:19.838 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34375.log 2024-08-18T21:16:19.838 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31778.log 2024-08-18T21:16:19.838 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33011.log: /var/log/ceph/ceph-client.admin.34375.log: 89.9% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.33011.log.gz 2024-08-18T21:16:19.838 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34375.log.gz 2024-08-18T21:16:19.838 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29618.log 2024-08-18T21:16:19.838 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25032.log 2024-08-18T21:16:19.838 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29618.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.31778.log.gz 2024-08-18T21:16:19.838 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36976.log 2024-08-18T21:16:19.838 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.29618.log.gz 2024-08-18T21:16:19.838 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.25032.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.25032.log.gz 2024-08-18T21:16:19.838 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34087.log 2024-08-18T21:16:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35597.log 2024-08-18T21:16:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36976.log: /var/log/ceph/ceph-client.admin.34087.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.36976.log.gz 2024-08-18T21:16:19.839 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.34087.log.gz 2024-08-18T21:16:19.839 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31219.log 2024-08-18T21:16:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35597.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.35597.log.gz 2024-08-18T21:16:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37821.log 2024-08-18T21:16:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31882.log 2024-08-18T21:16:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31219.log: /var/log/ceph/ceph-client.admin.37821.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.31219.log.gz 2024-08-18T21:16:19.839 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37821.log.gz 2024-08-18T21:16:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28826.log 2024-08-18T21:16:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30827.log 2024-08-18T21:16:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31882.log: /var/log/ceph/ceph-client.admin.28826.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.31882.log.gz 2024-08-18T21:16:19.839 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28826.log.gz 2024-08-18T21:16:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34661.log 2024-08-18T21:16:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30827.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.30827.log.gz 2024-08-18T21:16:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34269.log 2024-08-18T21:16:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36441.log 2024-08-18T21:16:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34661.log: /var/log/ceph/ceph-client.admin.34269.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34269.log.gz 2024-08-18T21:16:19.840 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.34661.log.gz 2024-08-18T21:16:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31386.log 2024-08-18T21:16:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37158.log 2024-08-18T21:16:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36441.log: /var/log/ceph/ceph-client.admin.31386.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.36441.log.gz 2024-08-18T21:16:19.840 INFO:teuthology.orchestra.run.smithi005.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.31386.log.gz 2024-08-18T21:16:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31360.log 2024-08-18T21:16:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34427.log 2024-08-18T21:16:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37158.log: /var/log/ceph/ceph-client.admin.31360.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.31360.log.gz 2024-08-18T21:16:19.840 INFO:teuthology.orchestra.run.smithi005.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.37158.log.gz 2024-08-18T21:16:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29857.log 2024-08-18T21:16:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28083.log 2024-08-18T21:16:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34427.log: /var/log/ceph/ceph-client.admin.29857.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.34427.log.gz 2024-08-18T21:16:19.841 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.29857.log.gz 2024-08-18T21:16:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36415.log 2024-08-18T21:16:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34349.log 2024-08-18T21:16:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28083.log: /var/log/ceph/ceph-client.admin.36415.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28083.log.gz 2024-08-18T21:16:19.841 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.36415.log.gzgzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-18T21:16:19.841 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34349.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.34349.log.gz 2024-08-18T21:16:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33259.log 2024-08-18T21:16:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28392.log 2024-08-18T21:16:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.33259.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.33259.log.gz 2024-08-18T21:16:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29727.log 2024-08-18T21:16:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28392.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28392.log.gz 2024-08-18T21:16:19.842 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37535.log 2024-08-18T21:16:19.842 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29727.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29727.log.gz 2024-08-18T21:16:19.842 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37002.log 2024-08-18T21:16:19.856 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31507.log 2024-08-18T21:16:19.856 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30089.log 2024-08-18T21:16:19.856 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29912.log 2024-08-18T21:16:19.856 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29474.log 2024-08-18T21:16:19.856 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31329.log 2024-08-18T21:16:19.857 INFO:teuthology.orchestra.run.smithi157.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30089.log.gz 2024-08-18T21:16:19.857 INFO:teuthology.orchestra.run.smithi157.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.31507.log.gz 2024-08-18T21:16:19.857 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28090.log 2024-08-18T21:16:19.857 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28123.log 2024-08-18T21:16:19.857 INFO:teuthology.orchestra.run.smithi157.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29912.log.gz 2024-08-18T21:16:19.857 INFO:teuthology.orchestra.run.smithi157.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29474.log.gz 2024-08-18T21:16:19.857 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25348.log 2024-08-18T21:16:19.857 INFO:teuthology.orchestra.run.smithi157.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31329.log.gz 2024-08-18T21:16:19.857 INFO:teuthology.orchestra.run.smithi157.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.28090.log.gz 2024-08-18T21:16:19.857 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30088.log 2024-08-18T21:16:19.857 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.25348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28124.log 2024-08-18T21:16:19.857 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31150.log 2024-08-18T21:16:19.857 INFO:teuthology.orchestra.run.smithi157.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28123.log.gz 2024-08-18T21:16:19.858 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28124.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.25348.log.gz 2024-08-18T21:16:19.858 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32432.log 2024-08-18T21:16:19.858 INFO:teuthology.orchestra.run.smithi157.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28124.log.gz 2024-08-18T21:16:19.858 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32290.log 2024-08-18T21:16:19.858 INFO:teuthology.orchestra.run.smithi157.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30088.log.gz 2024-08-18T21:16:19.858 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29418.log 2024-08-18T21:16:19.858 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32432.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31150.log.gz 2024-08-18T21:16:19.858 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32467.log 2024-08-18T21:16:19.858 INFO:teuthology.orchestra.run.smithi157.stderr:gzip/var/log/ceph/ceph-client.admin.29418.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28298.log 2024-08-18T21:16:19.858 INFO:teuthology.orchestra.run.smithi157.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32432.log.gz 2024-08-18T21:16:19.858 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32467.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.32290.log.gz 2024-08-18T21:16:19.858 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31328.log 2024-08-18T21:16:19.858 INFO:teuthology.orchestra.run.smithi157.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29418.log.gz 2024-08-18T21:16:19.858 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29567.log 2024-08-18T21:16:19.859 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28298.log: /var/log/ceph/ceph-client.admin.31328.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.32467.log.gz 2024-08-18T21:16:19.859 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30176.log 2024-08-18T21:16:19.859 INFO:teuthology.orchestra.run.smithi157.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28298.log.gz 2024-08-18T21:16:19.859 INFO:teuthology.orchestra.run.smithi157.stderr:gzip/var/log/ceph/ceph-client.admin.29567.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30487.log 2024-08-18T21:16:19.859 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30176.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.31328.log.gz 2024-08-18T21:16:19.859 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30364.log 2024-08-18T21:16:19.859 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.f.log 2024-08-18T21:16:19.859 INFO:teuthology.orchestra.run.smithi157.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30176.log.gz 2024-08-18T21:16:19.859 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30487.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.29567.log.gz 2024-08-18T21:16:19.859 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28396.log 2024-08-18T21:16:19.859 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.f.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30487.log.gz 2024-08-18T21:16:19.859 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25252.log 2024-08-18T21:16:19.859 INFO:teuthology.orchestra.run.smithi157.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30364.log.gz 2024-08-18T21:16:19.860 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31418.log 2024-08-18T21:16:19.860 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28396.log: /var/log/ceph/ceph-client.admin.25252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32288.log 2024-08-18T21:16:19.860 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28698.log 2024-08-18T21:16:19.860 INFO:teuthology.orchestra.run.smithi157.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.25252.log.gz 2024-08-18T21:16:19.860 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28519.log 2024-08-18T21:16:19.860 INFO:teuthology.orchestra.run.smithi157.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28396.log.gz 2024-08-18T21:16:19.860 INFO:teuthology.orchestra.run.smithi157.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.31418.log.gz 2024-08-18T21:16:19.860 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31330.log 2024-08-18T21:16:19.860 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29235.log 2024-08-18T21:16:19.860 INFO:teuthology.orchestra.run.smithi157.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.32288.log.gz 2024-08-18T21:16:19.860 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31330.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.28698.log.gz 2024-08-18T21:16:19.860 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31060.log 2024-08-18T21:16:19.860 INFO:teuthology.orchestra.run.smithi157.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28519.log.gz 2024-08-18T21:16:19.860 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31294.log 2024-08-18T21:16:19.861 INFO:teuthology.orchestra.run.smithi157.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.31330.log.gz 2024-08-18T21:16:19.861 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32641.log 2024-08-18T21:16:19.861 INFO:teuthology.orchestra.run.smithi157.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.29235.log.gz 2024-08-18T21:16:19.861 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29108.log 2024-08-18T21:16:19.861 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31294.log: /var/log/ceph/ceph-client.admin.32641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30399.log 2024-08-18T21:16:19.861 INFO:teuthology.orchestra.run.smithi157.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.31060.log.gz 2024-08-18T21:16:19.861 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32640.log 2024-08-18T21:16:19.861 INFO:teuthology.orchestra.run.smithi157.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.32641.log.gz 2024-08-18T21:16:19.861 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32815.log 2024-08-18T21:16:19.861 INFO:teuthology.orchestra.run.smithi157.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.31294.log.gz 2024-08-18T21:16:19.861 INFO:teuthology.orchestra.run.smithi157.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29108.log.gz 2024-08-18T21:16:19.861 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28299.log 2024-08-18T21:16:19.861 INFO:teuthology.orchestra.run.smithi157.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.30399.log.gz 2024-08-18T21:16:19.861 INFO:teuthology.orchestra.run.smithi157.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32640.log.gz 2024-08-18T21:16:19.862 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28962.log 2024-08-18T21:16:19.862 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29017.log 2024-08-18T21:16:19.862 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30272.log 2024-08-18T21:16:19.862 INFO:teuthology.orchestra.run.smithi157.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28962.log.gz 2024-08-18T21:16:19.862 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29017.log: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.32815.log.gz -5 2024-08-18T21:16:19.862 INFO:teuthology.orchestra.run.smithi157.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32039.log 2024-08-18T21:16:19.862 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30272.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.28299.log.gz 2024-08-18T21:16:19.862 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31149.log 2024-08-18T21:16:19.862 INFO:teuthology.orchestra.run.smithi157.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29017.log.gz 2024-08-18T21:16:19.862 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28210.log 2024-08-18T21:16:19.862 INFO:teuthology.orchestra.run.smithi157.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30272.log.gz 2024-08-18T21:16:19.862 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32605.log 2024-08-18T21:16:19.862 INFO:teuthology.orchestra.run.smithi157.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32039.log.gz 2024-08-18T21:16:19.862 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28750.log 2024-08-18T21:16:19.863 INFO:teuthology.orchestra.run.smithi157.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31149.log.gz 2024-08-18T21:16:19.863 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28002.log 2024-08-18T21:16:19.863 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32553.log 2024-08-18T21:16:19.863 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28750.log: /var/log/ceph/ceph-client.admin.28002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30310.log 2024-08-18T21:16:19.863 INFO:teuthology.orchestra.run.smithi157.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28210.log.gz 2024-08-18T21:16:19.863 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28609.log 2024-08-18T21:16:19.863 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30310.log: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29511.log 2024-08-18T21:16:19.863 INFO:teuthology.orchestra.run.smithi157.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32553.log.gz 2024-08-18T21:16:19.863 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32605.log.gz 2024-08-18T21:16:19.863 INFO:teuthology.orchestra.run.smithi157.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.28002.log.gz 2024-08-18T21:16:19.863 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30845.log 2024-08-18T21:16:19.863 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28839.log 2024-08-18T21:16:19.863 INFO:teuthology.orchestra.run.smithi157.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30310.log.gz 2024-08-18T21:16:19.863 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29511.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.28750.log.gz 2024-08-18T21:16:19.864 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30932.log 2024-08-18T21:16:19.864 INFO:teuthology.orchestra.run.smithi157.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.28609.log.gz 2024-08-18T21:16:19.864 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31900.log 2024-08-18T21:16:19.864 INFO:teuthology.orchestra.run.smithi157.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30845.log.gz 2024-08-18T21:16:19.864 INFO:teuthology.orchestra.run.smithi157.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.29511.log.gz 2024-08-18T21:16:19.864 INFO:teuthology.orchestra.run.smithi157.stderr:gzip/var/log/ceph/ceph-client.admin.30932.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29054.log 2024-08-18T21:16:19.864 INFO:teuthology.orchestra.run.smithi157.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.28839.log.gz 2024-08-18T21:16:19.864 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31812.log 2024-08-18T21:16:19.864 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29054.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30932.log.gz 2024-08-18T21:16:19.864 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29877.log 2024-08-18T21:16:19.864 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28520.log 2024-08-18T21:16:19.864 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31812.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.29054.log.gz 2024-08-18T21:16:19.864 INFO:teuthology.orchestra.run.smithi157.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.31900.log.gz 2024-08-18T21:16:19.865 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30003.log 2024-08-18T21:16:19.865 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29287.log 2024-08-18T21:16:19.865 INFO:teuthology.orchestra.run.smithi157.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.31812.log.gz 2024-08-18T21:16:19.865 INFO:teuthology.orchestra.run.smithi157.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29877.log.gz 2024-08-18T21:16:19.865 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28838.log 2024-08-18T21:16:19.865 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30540.log 2024-08-18T21:16:19.865 INFO:teuthology.orchestra.run.smithi157.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.28520.log.gz 2024-08-18T21:16:19.865 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28838.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30003.log.gz 2024-08-18T21:16:19.865 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28432.log 2024-08-18T21:16:19.865 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28089.log 2024-08-18T21:16:19.865 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30540.log: /var/log/ceph/ceph-client.admin.28432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32552.log 2024-08-18T21:16:19.865 INFO:teuthology.orchestra.run.smithi157.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.29287.log.gz 2024-08-18T21:16:19.865 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32038.log 2024-08-18T21:16:19.865 INFO:teuthology.orchestra.run.smithi157.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30540.log.gz 2024-08-18T21:16:19.866 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28089.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28838.log.gz 2024-08-18T21:16:19.866 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29825.log 2024-08-18T21:16:19.866 INFO:teuthology.orchestra.run.smithi157.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.28432.log.gz 2024-08-18T21:16:19.866 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29419.log 2024-08-18T21:16:19.866 INFO:teuthology.orchestra.run.smithi157.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32552.log.gz 2024-08-18T21:16:19.866 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28177.log 2024-08-18T21:16:19.866 INFO:teuthology.orchestra.run.smithi157.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28089.log.gz 2024-08-18T21:16:19.866 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28573.log 2024-08-18T21:16:19.866 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29419.log: /var/log/ceph/ceph-client.admin.28177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32518.log 2024-08-18T21:16:19.866 INFO:teuthology.orchestra.run.smithi157.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.29825.log.gz 2024-08-18T21:16:19.866 INFO:teuthology.orchestra.run.smithi157.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32038.log.gz 2024-08-18T21:16:19.866 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29328.log 2024-08-18T21:16:19.866 INFO:teuthology.orchestra.run.smithi157.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.28177.log.gz 2024-08-18T21:16:19.866 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32518.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28573.log.gz 2024-08-18T21:16:19.867 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30453.log 2024-08-18T21:16:19.867 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28125.log 2024-08-18T21:16:19.867 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29328.log: /var/log/ceph/ceph-client.admin.30453.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.29419.log.gz 2024-08-18T21:16:19.867 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28873.log 2024-08-18T21:16:19.867 INFO:teuthology.orchestra.run.smithi157.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30453.log.gz 2024-08-18T21:16:19.867 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31023.log 2024-08-18T21:16:19.867 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28125.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32518.log.gz 2024-08-18T21:16:19.867 INFO:teuthology.orchestra.run.smithi157.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.29328.log.gz 2024-08-18T21:16:19.867 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28484.log 2024-08-18T21:16:19.867 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30663.log 2024-08-18T21:16:19.867 INFO:teuthology.orchestra.run.smithi157.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.28125.log.gz 2024-08-18T21:16:19.867 INFO:teuthology.orchestra.run.smithi157.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.28873.log.gz 2024-08-18T21:16:19.867 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31689.log 2024-08-18T21:16:19.867 INFO:teuthology.orchestra.run.smithi157.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31023.log.gz 2024-08-18T21:16:19.868 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30663.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28484.log.gz 2024-08-18T21:16:19.868 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29736.log 2024-08-18T21:16:19.868 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31058.log 2024-08-18T21:16:19.868 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29736.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.30663.log.gz 2024-08-18T21:16:19.868 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32376.log 2024-08-18T21:16:19.868 INFO:teuthology.orchestra.run.smithi157.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31689.log.gz 2024-08-18T21:16:19.868 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25276.log 2024-08-18T21:16:19.868 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32376.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-18T21:16:19.868 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.25276.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29736.log.gz 2024-08-18T21:16:19.868 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29107.log 2024-08-18T21:16:19.868 INFO:teuthology.orchestra.run.smithi157.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31058.log.gz 2024-08-18T21:16:19.868 INFO:teuthology.orchestra.run.smithi157.stderr: 90.2%/var/log/ceph/ceph-osd.3.log: -- replaced with /var/log/ceph/ceph-client.admin.32376.log.gz 2024-08-18T21:16:19.868 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30142.log 2024-08-18T21:16:19.868 INFO:teuthology.orchestra.run.smithi157.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.25276.log.gz 2024-08-18T21:16:19.869 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5/var/log/ceph/ceph-client.admin.29107.log: --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-18T21:16:19.869 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29144.log 2024-08-18T21:16:19.869 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31864.log 2024-08-18T21:16:19.869 INFO:teuthology.orchestra.run.smithi157.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30142.log.gz 2024-08-18T21:16:19.869 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29198.log 2024-08-18T21:16:19.869 INFO:teuthology.orchestra.run.smithi157.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29107.log.gz 2024-08-18T21:16:19.869 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29604.log 2024-08-18T21:16:19.869 INFO:teuthology.orchestra.run.smithi157.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29144.log.gz 2024-08-18T21:16:19.869 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29789.log 2024-08-18T21:16:19.869 INFO:teuthology.orchestra.run.smithi157.stderr: 89.2%/var/log/ceph/ceph-client.admin.29604.log: -- replaced with /var/log/ceph/ceph-client.admin.31864.log.gz 2024-08-18T21:16:19.869 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30177.log 2024-08-18T21:16:19.869 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29789.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29198.log.gz 2024-08-18T21:16:19.869 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29737.log 2024-08-18T21:16:19.870 INFO:teuthology.orchestra.run.smithi157.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.29604.log.gz 2024-08-18T21:16:19.870 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29914.log 2024-08-18T21:16:19.870 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29737.log: gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29789.log.gz 2024-08-18T21:16:19.870 INFO:teuthology.orchestra.run.smithi157.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30628.log 2024-08-18T21:16:19.870 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29914.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29326.log 2024-08-18T21:16:19.870 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29737.log.gz 2024-08-18T21:16:19.870 INFO:teuthology.orchestra.run.smithi157.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.30177.log.gz 2024-08-18T21:16:19.870 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28608.log 2024-08-18T21:16:19.870 INFO:teuthology.orchestra.run.smithi157.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.29914.log.gz 2024-08-18T21:16:19.870 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29326.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30628.log.gz 2024-08-18T21:16:19.870 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29381.log 2024-08-18T21:16:19.870 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28518.log 2024-08-18T21:16:19.870 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28608.log: /var/log/ceph/ceph-client.admin.29381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30400.log 2024-08-18T21:16:19.870 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28431.log 2024-08-18T21:16:19.871 INFO:teuthology.orchestra.run.smithi157.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28608.log.gz 2024-08-18T21:16:19.871 INFO:teuthology.orchestra.run.smithi157.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29326.log.gz 2024-08-18T21:16:19.871 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30400.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29381.log.gz 2024-08-18T21:16:19.871 INFO:teuthology.orchestra.run.smithi157.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28518.log.gz 2024-08-18T21:16:19.871 INFO:teuthology.orchestra.run.smithi157.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.30400.log.gz 2024-08-18T21:16:19.871 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29236.log 2024-08-18T21:16:19.871 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31241.log 2024-08-18T21:16:19.871 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29236.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.28431.log.gz 2024-08-18T21:16:19.871 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29603.log 2024-08-18T21:16:19.871 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31208.log 2024-08-18T21:16:19.871 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31241.log: /var/log/ceph/ceph-client.admin.29603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31471.log 2024-08-18T21:16:19.871 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31208.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.29236.log.gz 2024-08-18T21:16:19.872 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31811.log 2024-08-18T21:16:19.872 INFO:teuthology.orchestra.run.smithi157.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.29603.log.gz 2024-08-18T21:16:19.872 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31863.log 2024-08-18T21:16:19.872 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31471.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31208.log.gz 2024-08-18T21:16:19.872 INFO:teuthology.orchestra.run.smithi157.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.31241.log.gz 2024-08-18T21:16:19.872 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29566.log 2024-08-18T21:16:19.872 INFO:teuthology.orchestra.run.smithi157.stderr: 89.1%/var/log/ceph/ceph-client.admin.31863.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31471.log.gz 2024-08-18T21:16:19.872 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31811.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28751.log 2024-08-18T21:16:19.872 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:16:19.872 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29790.log 2024-08-18T21:16:19.872 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31986.log 2024-08-18T21:16:19.872 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29657.log 2024-08-18T21:16:19.872 INFO:teuthology.orchestra.run.smithi157.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.31863.log.gz 2024-08-18T21:16:19.872 INFO:teuthology.orchestra.run.smithi157.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29566.log.gz 2024-08-18T21:16:19.873 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31986.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29790.log.gz 2024-08-18T21:16:19.873 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28036.log 2024-08-18T21:16:19.873 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29657.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31986.log.gz 2024-08-18T21:16:19.873 INFO:teuthology.orchestra.run.smithi157.stderr: 93.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31419.log 2024-08-18T21:16:19.873 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28751.log.gz 2024-08-18T21:16:19.873 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25300.log 2024-08-18T21:16:19.873 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31506.log 2024-08-18T21:16:19.873 INFO:teuthology.orchestra.run.smithi157.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.29657.log.gz/var/log/ceph/ceph-client.admin.25300.log: 2024-08-18T21:16:19.873 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30575.log 2024-08-18T21:16:19.873 INFO:teuthology.orchestra.run.smithi157.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31419.log.gz 2024-08-18T21:16:19.873 INFO:teuthology.orchestra.run.smithi157.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28036.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mon.i.log 2024-08-18T21:16:19.873 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:16:19.873 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31506.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.25300.log.gz 2024-08-18T21:16:19.874 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32465.log 2024-08-18T21:16:19.874 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30575.log: /var/log/ceph/ceph-mon.i.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32203.log 2024-08-18T21:16:19.874 INFO:teuthology.orchestra.run.smithi157.stderr: 91.1%/var/log/ceph/ceph-client.admin.32465.log: -- replaced with /var/log/ceph/ceph-client.admin.31506.log.gz 2024-08-18T21:16:19.874 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28212.log 2024-08-18T21:16:19.874 INFO:teuthology.orchestra.run.smithi157.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.30575.log.gz 2024-08-18T21:16:19.874 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32203.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32465.log.gz 2024-08-18T21:16:19.874 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.g.log 2024-08-18T21:16:19.874 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28212.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32519.log 2024-08-18T21:16:19.874 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32203.log.gz 2024-08-18T21:16:19.874 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.g.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29876.log 2024-08-18T21:16:19.874 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30968.log 2024-08-18T21:16:19.874 INFO:teuthology.orchestra.run.smithi157.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.28212.log.gz 2024-08-18T21:16:19.874 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32519.log: /var/log/ceph/ceph-client.admin.29876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28297.log 2024-08-18T21:16:19.874 INFO:teuthology.orchestra.run.smithi157.stderr: 89.2%/var/log/ceph/ceph-client.admin.30968.log: -- replaced with /var/log/ceph/ceph-client.admin.32519.log.gz 2024-08-18T21:16:19.875 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30452.log 2024-08-18T21:16:19.875 INFO:teuthology.orchestra.run.smithi157.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30968.log.gz 2024-08-18T21:16:19.875 INFO:teuthology.orchestra.run.smithi157.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29876.log.gz 2024-08-18T21:16:19.875 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28697.log 2024-08-18T21:16:19.875 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28003.log 2024-08-18T21:16:19.875 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28697.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28297.log.gz 2024-08-18T21:16:19.875 INFO:teuthology.orchestra.run.smithi157.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31722.log 2024-08-18T21:16:19.875 INFO:teuthology.orchestra.run.smithi157.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30452.log.gz 2024-08-18T21:16:19.875 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28697.log.gz 2024-08-18T21:16:19.875 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-18T21:16:19.875 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28003.log: /var/log/ceph/ceph-client.admin.31722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32342.log 2024-08-18T21:16:19.875 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mgr.x.log: 89.5% 91.4% -- replaced with /var/log/ceph/ceph-client.admin.28003.log.gz 2024-08-18T21:16:19.875 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31722.log.gz 2024-08-18T21:16:19.876 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31987.log 2024-08-18T21:16:19.876 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30790.log 2024-08-18T21:16:19.876 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31987.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.32342.log.gz 2024-08-18T21:16:19.876 INFO:teuthology.orchestra.run.smithi157.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.31987.log.gz 2024-08-18T21:16:19.876 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28607.log 2024-08-18T21:16:19.876 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29199.log 2024-08-18T21:16:19.876 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28607.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30790.log.gz 2024-08-18T21:16:19.876 INFO:teuthology.orchestra.run.smithi157.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28607.log.gz 2024-08-18T21:16:19.876 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30574.log 2024-08-18T21:16:19.876 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28430.log 2024-08-18T21:16:19.876 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30574.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29199.log.gz 2024-08-18T21:16:19.876 INFO:teuthology.orchestra.run.smithi157.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30574.log.gz 2024-08-18T21:16:19.876 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-18T21:16:19.876 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29382.log 2024-08-18T21:16:19.877 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.28430.log.gz 2024-08-18T21:16:19.877 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31113.log 2024-08-18T21:16:19.877 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29382.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29382.log.gz 2024-08-18T21:16:19.877 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30844.log 2024-08-18T21:16:19.877 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31113.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31113.log.gz 2024-08-18T21:16:19.877 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28211.log 2024-08-18T21:16:19.877 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30844.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.30844.log.gz 2024-08-18T21:16:19.877 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32201.log 2024-08-18T21:16:19.877 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28211.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28211.log.gz 2024-08-18T21:16:19.877 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32377.log 2024-08-18T21:16:19.877 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32201.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32201.log.gz 2024-08-18T21:16:19.877 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31723.log 2024-08-18T21:16:19.877 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32377.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32377.log.gz 2024-08-18T21:16:19.878 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32375.log 2024-08-18T21:16:19.878 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31723.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31723.log.gz 2024-08-18T21:16:19.878 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28483.log 2024-08-18T21:16:19.878 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32375.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32375.log.gz 2024-08-18T21:16:19.878 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28176.log 2024-08-18T21:16:19.878 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28483.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28483.log.gz 2024-08-18T21:16:19.878 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32639.log 2024-08-18T21:16:19.878 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28176.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28176.log.gz 2024-08-18T21:16:19.878 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31472.log 2024-08-18T21:16:19.878 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32639.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32639.log.gz 2024-08-18T21:16:19.878 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30539.log 2024-08-18T21:16:19.878 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31472.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31472.log.gz 2024-08-18T21:16:19.879 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29327.log 2024-08-18T21:16:19.879 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30539.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30539.log.gz 2024-08-18T21:16:19.879 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32431.log 2024-08-18T21:16:19.879 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29327.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29327.log.gz 2024-08-18T21:16:19.879 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28872.log 2024-08-18T21:16:19.879 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32431.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32431.log.gz 2024-08-18T21:16:19.879 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28961.log 2024-08-18T21:16:19.879 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28872.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.28872.log.gz 2024-08-18T21:16:19.879 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29602.log 2024-08-18T21:16:19.879 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28961.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28961.log.gz 2024-08-18T21:16:19.879 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30662.log 2024-08-18T21:16:19.879 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29602.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29602.log.gz 2024-08-18T21:16:19.879 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30054.log 2024-08-18T21:16:19.879 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30662.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30662.log.gz 2024-08-18T21:16:19.880 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30715.log 2024-08-18T21:16:19.880 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30054.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30054.log.gz 2024-08-18T21:16:19.880 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.h.log 2024-08-18T21:16:19.880 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30715.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30715.log.gz 2024-08-18T21:16:19.880 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32816.log 2024-08-18T21:16:19.880 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.h.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32696.log 2024-08-18T21:16:19.880 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32816.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32816.log.gz 2024-08-18T21:16:19.880 INFO:teuthology.orchestra.run.smithi157.stderr: 93.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-18T21:16:19.880 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32466.log 2024-08-18T21:16:19.880 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32696.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32696.log.gz 2024-08-18T21:16:19.880 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28397.log 2024-08-18T21:16:19.880 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32466.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32466.log.gz 2024-08-18T21:16:19.880 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30879.log 2024-08-18T21:16:19.880 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28397.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28397.log.gz 2024-08-18T21:16:19.881 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30791.log 2024-08-18T21:16:19.881 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30879.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.30879.log.gz 2024-08-18T21:16:19.881 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29143.log 2024-08-18T21:16:19.881 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30791.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30791.log.gz 2024-08-18T21:16:19.881 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25324.log 2024-08-18T21:16:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37535.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.37535.log.gz 2024-08-18T21:16:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37873.log 2024-08-18T21:16:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37002.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.37002.log.gz 2024-08-18T21:16:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31167.log 2024-08-18T21:16:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37873.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37873.log.gz 2024-08-18T21:16:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32538.log 2024-08-18T21:16:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31167.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.31167.log.gz 2024-08-18T21:16:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29699.log 2024-08-18T21:16:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32538.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32538.log.gz 2024-08-18T21:16:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32564.log 2024-08-18T21:16:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29699.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29699.log.gz 2024-08-18T21:16:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35411.log 2024-08-18T21:16:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32564.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32564.log.gz 2024-08-18T21:16:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27898.log 2024-08-18T21:16:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35411.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.35411.log.gz 2024-08-18T21:16:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29327.log 2024-08-18T21:16:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.27898.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.27898.log.gz 2024-08-18T21:16:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36075.log 2024-08-18T21:16:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29327.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.29327.log.gz 2024-08-18T21:16:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28989.log 2024-08-18T21:16:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36075.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.36075.log.gz 2024-08-18T21:16:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37186.log 2024-08-18T21:16:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28989.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.28989.log.gz 2024-08-18T21:16:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33731.log 2024-08-18T21:16:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37186.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.37186.log.gz 2024-08-18T21:16:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27824.log 2024-08-18T21:16:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33731.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.33731.log.gz 2024-08-18T21:16:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30775.log 2024-08-18T21:16:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.27824.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.27824.log.gz 2024-08-18T21:16:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28552.log 2024-08-18T21:16:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30775.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30775.log.gz 2024-08-18T21:16:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28748.log 2024-08-18T21:16:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28552.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28552.log.gz 2024-08-18T21:16:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33285.log 2024-08-18T21:16:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28748.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.28748.log.gz 2024-08-18T21:16:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34033.log 2024-08-18T21:16:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33285.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.33285.log.gz 2024-08-18T21:16:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28397.log 2024-08-18T21:16:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34033.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.34033.log.gz 2024-08-18T21:16:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31804.log 2024-08-18T21:16:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28397.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.28397.log.gz 2024-08-18T21:16:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33391.log 2024-08-18T21:16:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31804.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.31804.log.gz 2024-08-18T21:16:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29119.log 2024-08-18T21:16:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33391.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.33391.log.gz 2024-08-18T21:16:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37106.log 2024-08-18T21:16:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29119.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.29119.log.gz 2024-08-18T21:16:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30853.log 2024-08-18T21:16:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37106.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.37106.log.gz 2024-08-18T21:16:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-18T21:16:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30853.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30853.log.gz 2024-08-18T21:16:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30513.log 2024-08-18T21:16:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32276.log 2024-08-18T21:16:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30513.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30513.log.gz 2024-08-18T21:16:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29041.log 2024-08-18T21:16:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32276.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32276.log.gz 2024-08-18T21:16:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30147.log 2024-08-18T21:16:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29041.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.29041.log.gz 2024-08-18T21:16:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28963.log 2024-08-18T21:16:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30147.log: 93.0% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.30147.log.gz 2024-08-18T21:16:19.909 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-08-18T21:16:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37290.log 2024-08-18T21:16:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28963.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.28963.log.gz 2024-08-18T21:16:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38003.log 2024-08-18T21:16:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37290.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.37290.log.gz 2024-08-18T21:16:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21337.log 2024-08-18T21:16:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38003.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38003.log.gz 2024-08-18T21:16:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29249.log 2024-08-18T21:16:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.tmp-client.admin.21337.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21337.log.gz 2024-08-18T21:16:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33365.log 2024-08-18T21:16:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29249.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.29249.log.gz 2024-08-18T21:16:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37847.log 2024-08-18T21:16:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33365.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33365.log.gz 2024-08-18T21:16:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28236.log 2024-08-18T21:16:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37847.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37847.log.gz 2024-08-18T21:16:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34007.log 2024-08-18T21:16:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28236.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.28236.log.gz 2024-08-18T21:16:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36493.log 2024-08-18T21:16:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34007.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.34007.log.gz 2024-08-18T21:16:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30985.log 2024-08-18T21:16:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36493.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.36493.log.gz 2024-08-18T21:16:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31648.log 2024-08-18T21:16:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30985.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30985.log.gz 2024-08-18T21:16:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32933.log 2024-08-18T21:16:19.915 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29143.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29143.log.gz 2024-08-18T21:16:19.915 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30398.log 2024-08-18T21:16:19.915 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.25324.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.25324.log.gz 2024-08-18T21:16:19.915 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32254.log 2024-08-18T21:16:19.915 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30398.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.30398.log.gz 2024-08-18T21:16:19.915 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29913.log 2024-08-18T21:16:19.915 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32254.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32254.log.gz 2024-08-18T21:16:19.915 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30969.log 2024-08-18T21:16:19.915 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29913.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29913.log.gz 2024-08-18T21:16:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29509.log 2024-08-18T21:16:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30969.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30969.log.gz 2024-08-18T21:16:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31242.log 2024-08-18T21:16:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29509.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29509.log.gz 2024-08-18T21:16:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28963.log 2024-08-18T21:16:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31242.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31242.log.gz 2024-08-18T21:16:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31295.log 2024-08-18T21:16:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28963.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.28963.log.gz 2024-08-18T21:16:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30714.log 2024-08-18T21:16:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31295.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.31295.log.gz 2024-08-18T21:16:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31059.log 2024-08-18T21:16:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30714.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30714.log.gz 2024-08-18T21:16:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30311.log 2024-08-18T21:16:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31059.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.31059.log.gz 2024-08-18T21:16:19.917 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29510.log 2024-08-18T21:16:19.917 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30311.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30311.log.gz 2024-08-18T21:16:19.917 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32202.log 2024-08-18T21:16:19.917 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29510.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29510.log.gz 2024-08-18T21:16:19.917 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29823.log 2024-08-18T21:16:19.917 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32202.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.32202.log.gz 2024-08-18T21:16:19.917 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30271.log 2024-08-18T21:16:19.917 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29823.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.29823.log.gz 2024-08-18T21:16:19.917 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-18T21:16:19.917 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30271.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30271.log.gz 2024-08-18T21:16:19.917 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31151.log 2024-08-18T21:16:19.917 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.audit.log: 96.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31114.log 2024-08-18T21:16:19.917 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31151.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-18T21:16:19.918 INFO:teuthology.orchestra.run.smithi157.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.31151.log.gz 2024-08-18T21:16:19.918 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32255.log 2024-08-18T21:16:19.918 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31114.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31114.log.gz 2024-08-18T21:16:19.918 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29658.log 2024-08-18T21:16:19.918 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32255.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32255.log.gz 2024-08-18T21:16:19.918 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29145.log 2024-08-18T21:16:19.918 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29658.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29658.log.gz 2024-08-18T21:16:19.918 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30488.log 2024-08-18T21:16:19.918 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29145.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.29145.log.gz 2024-08-18T21:16:19.918 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30175.log 2024-08-18T21:16:19.918 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30488.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.30488.log.gz 2024-08-18T21:16:19.918 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29738.log 2024-08-18T21:16:19.918 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30175.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.30175.log.gz 2024-08-18T21:16:19.918 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31381.log 2024-08-18T21:16:19.919 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29738.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.29738.log.gz 2024-08-18T21:16:19.919 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28662.log 2024-08-18T21:16:19.919 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31381.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31381.log.gz 2024-08-18T21:16:19.919 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29016.log 2024-08-18T21:16:19.919 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28662.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28662.log.gz 2024-08-18T21:16:19.919 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30001.log 2024-08-18T21:16:19.919 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29016.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29016.log.gz 2024-08-18T21:16:19.919 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30141.log 2024-08-18T21:16:19.922 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30001.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30001.log.gz 2024-08-18T21:16:19.922 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31382.log 2024-08-18T21:16:19.922 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30141.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30141.log.gz 2024-08-18T21:16:19.923 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31505.log 2024-08-18T21:16:19.923 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31382.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31382.log.gz 2024-08-18T21:16:19.923 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31775.log 2024-08-18T21:16:19.924 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31648.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.31648.log.gz 2024-08-18T21:16:19.924 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33575.log 2024-08-18T21:16:19.924 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32933.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.32933.log.gz 2024-08-18T21:16:19.924 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31141.log 2024-08-18T21:16:19.925 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33575.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.33575.log.gz 2024-08-18T21:16:19.925 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35917.log 2024-08-18T21:16:19.925 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31141.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.31141.log.gz 2024-08-18T21:16:19.925 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34401.log 2024-08-18T21:16:19.925 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35917.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35917.log.gz 2024-08-18T21:16:19.925 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31908.log 2024-08-18T21:16:19.925 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34401.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.34401.log.gz 2024-08-18T21:16:19.925 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31594.log 2024-08-18T21:16:19.925 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31908.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31908.log.gz 2024-08-18T21:16:19.925 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29540.log 2024-08-18T21:16:19.925 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31594.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31594.log.gz 2024-08-18T21:16:19.925 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-18T21:16:19.925 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29540.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.29540.log.gz 2024-08-18T21:16:19.925 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37613.log 2024-08-18T21:16:19.927 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31505.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.31505.log.gz 2024-08-18T21:16:19.927 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28926.log 2024-08-18T21:16:19.927 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31775.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.31775.log.gz 2024-08-18T21:16:19.927 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29288.log 2024-08-18T21:16:19.927 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28926.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28926.log.gz 2024-08-18T21:16:19.927 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28784.log 2024-08-18T21:16:19.929 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29288.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29288.log.gz 2024-08-18T21:16:19.929 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28572.log 2024-08-18T21:16:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.audit.log: 96.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34505.log 2024-08-18T21:16:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37613.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.37613.log.gz 2024-08-18T21:16:19.930 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-18T21:16:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36179.log 2024-08-18T21:16:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34505.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.34505.log.gz 2024-08-18T21:16:19.931 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35489.log 2024-08-18T21:16:19.931 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28784.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28784.log.gz 2024-08-18T21:16:19.931 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28038.log 2024-08-18T21:16:19.932 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36179.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.36179.log.gz 2024-08-18T21:16:19.932 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29015.log 2024-08-18T21:16:19.933 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28572.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28572.log.gz 2024-08-18T21:16:19.933 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32695.log 2024-08-18T21:16:19.934 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35489.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.35489.log.gz 2024-08-18T21:16:19.934 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31752.log 2024-08-18T21:16:19.935 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28038.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.28038.log.gz 2024-08-18T21:16:19.935 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31810.log 2024-08-18T21:16:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29015.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.29015.log.gz 2024-08-18T21:16:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29145.log 2024-08-18T21:16:19.937 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32695.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32695.log.gz 2024-08-18T21:16:19.937 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32817.log 2024-08-18T21:16:19.937 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31752.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.31752.log.gz 2024-08-18T21:16:19.937 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32881.log 2024-08-18T21:16:19.939 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31810.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31810.log.gz 2024-08-18T21:16:19.939 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29967.log 2024-08-18T21:16:19.939 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29145.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.29145.log.gz 2024-08-18T21:16:19.939 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30173.log 2024-08-18T21:16:19.940 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32881.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.32881.log.gz 2024-08-18T21:16:19.940 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33037.log 2024-08-18T21:16:19.941 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32817.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32817.log.gz 2024-08-18T21:16:19.941 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31420.log 2024-08-18T21:16:19.941 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30173.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.30173.log.gz 2024-08-18T21:16:19.942 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37899.log 2024-08-18T21:16:19.943 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29967.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29967.log.gz 2024-08-18T21:16:19.943 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30661.log 2024-08-18T21:16:19.943 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33037.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.33037.log.gz 2024-08-18T21:16:19.944 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30593.log 2024-08-18T21:16:19.944 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31420.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.31420.log.gz 2024-08-18T21:16:19.944 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30486.log 2024-08-18T21:16:19.945 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37899.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37899.log.gz 2024-08-18T21:16:19.945 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37587.log 2024-08-18T21:16:19.946 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30661.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30661.log.gz 2024-08-18T21:16:19.946 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30967.log 2024-08-18T21:16:19.947 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30593.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.30593.log.gz 2024-08-18T21:16:19.947 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33809.log 2024-08-18T21:16:19.947 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30486.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30486.log.gz 2024-08-18T21:16:19.948 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31724.log 2024-08-18T21:16:19.949 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37587.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.37587.log.gz 2024-08-18T21:16:19.949 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31464.log 2024-08-18T21:16:19.949 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33809.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.33809.log.gz 2024-08-18T21:16:19.950 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33887.log 2024-08-18T21:16:19.950 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30967.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30967.log.gz 2024-08-18T21:16:19.951 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30878.log 2024-08-18T21:16:19.951 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31464.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.31464.log.gz 2024-08-18T21:16:19.951 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36467.log 2024-08-18T21:16:19.952 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31724.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.31724.log.gz 2024-08-18T21:16:19.952 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28874.log 2024-08-18T21:16:19.953 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33887.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.33887.log.gz 2024-08-18T21:16:19.953 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30121.log 2024-08-18T21:16:19.954 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30878.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30878.log.gz 2024-08-18T21:16:19.955 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28263.log 2024-08-18T21:16:19.955 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36467.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.36467.log.gz 2024-08-18T21:16:19.955 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35307.log 2024-08-18T21:16:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30121.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.30121.log.gz 2024-08-18T21:16:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32014.log 2024-08-18T21:16:19.957 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28874.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.28874.log.gz 2024-08-18T21:16:19.957 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31951.log 2024-08-18T21:16:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35307.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.35307.log.gz 2024-08-18T21:16:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28581.log 2024-08-18T21:16:19.959 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28263.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28263.log.gz 2024-08-18T21:16:19.959 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30055.log 2024-08-18T21:16:19.960 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32014.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.32014.log.gz 2024-08-18T21:16:19.960 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36049.log 2024-08-18T21:16:19.960 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31951.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31951.log.gz 2024-08-18T21:16:19.960 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32289.log 2024-08-18T21:16:19.961 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28581.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28581.log.gz 2024-08-18T21:16:19.962 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37643.log 2024-08-18T21:16:19.962 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30055.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30055.log.gz 2024-08-18T21:16:19.962 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31776.log 2024-08-18T21:16:19.963 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36049.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.36049.log.gz 2024-08-18T21:16:19.963 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29961.log 2024-08-18T21:16:19.964 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32289.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32289.log.gz 2024-08-18T21:16:19.964 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30792.log 2024-08-18T21:16:19.965 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37643.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.37643.log.gz 2024-08-18T21:16:19.965 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32302.log 2024-08-18T21:16:19.966 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31776.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.31776.log.gz 2024-08-18T21:16:19.966 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30627.log 2024-08-18T21:16:19.966 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29961.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.29961.log.gz 2024-08-18T21:16:19.967 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30225.log 2024-08-18T21:16:19.967 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30792.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.30792.log.gz 2024-08-18T21:16:19.967 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28925.log 2024-08-18T21:16:19.968 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32302.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.32302.log.gz 2024-08-18T21:16:19.968 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38107.log 2024-08-18T21:16:19.969 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30627.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.30627.log.gz 2024-08-18T21:16:19.969 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29473.log 2024-08-18T21:16:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30225.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30225.log.gz 2024-08-18T21:16:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28909.log 2024-08-18T21:16:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38107.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38107.log.gz 2024-08-18T21:16:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32040.log 2024-08-18T21:16:19.972 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28925.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.28925.log.gz 2024-08-18T21:16:19.972 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29968.log 2024-08-18T21:16:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28909.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28909.log.gz 2024-08-18T21:16:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34635.log 2024-08-18T21:16:19.973 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29473.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29473.log.gz 2024-08-18T21:16:19.974 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29053.log 2024-08-18T21:16:19.974 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32040.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.32040.log.gz 2024-08-18T21:16:19.974 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35969.log 2024-08-18T21:16:19.975 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33523.log 2024-08-18T21:16:19.976 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29968.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29968.log.gz 2024-08-18T21:16:19.976 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31243.log 2024-08-18T21:16:19.976 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29053.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29053.log.gz 2024-08-18T21:16:19.976 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28786.log 2024-08-18T21:16:19.977 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35969.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.34635.log.gz 2024-08-18T21:16:19.977 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35969.log.gz 2024-08-18T21:16:19.977 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29301.log 2024-08-18T21:16:19.978 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33523.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.33523.log.gz 2024-08-18T21:16:19.979 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37977.log 2024-08-18T21:16:19.979 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31243.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.31243.log.gz 2024-08-18T21:16:19.979 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28785.log 2024-08-18T21:16:19.979 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29301.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.29301.log.gz 2024-08-18T21:16:19.980 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30199.log 2024-08-18T21:16:19.980 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28786.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.28786.log.gz 2024-08-18T21:16:19.981 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29824.log 2024-08-18T21:16:19.982 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28785.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28785.log.gz 2024-08-18T21:16:19.982 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30573.log 2024-08-18T21:16:19.982 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37977.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37977.log.gz 2024-08-18T21:16:19.982 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29353.log 2024-08-18T21:16:19.983 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29824.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29824.log.gz 2024-08-18T21:16:19.984 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-18T21:16:19.984 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30199.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.30199.log.gz 2024-08-18T21:16:19.984 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35742.log 2024-08-18T21:16:19.984 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29353.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.29353.log.gz 2024-08-18T21:16:19.985 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30801.log 2024-08-18T21:16:19.985 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30573.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30573.log.gz 2024-08-18T21:16:19.986 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30880.log 2024-08-18T21:16:19.987 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35742.log: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.35742.log.gz 2024-08-18T21:16:19.987 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27923.log 2024-08-18T21:16:19.989 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30801.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.30801.log.gz 2024-08-18T21:16:19.989 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38029.log 2024-08-18T21:16:19.990 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.27923.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.27923.log.gz 2024-08-18T21:16:19.991 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29462.log 2024-08-18T21:16:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38029.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38029.log.gz 2024-08-18T21:16:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25339.log 2024-08-18T21:16:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29462.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.29462.log.gz 2024-08-18T21:16:19.994 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32512.log 2024-08-18T21:16:19.995 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28696.log 2024-08-18T21:16:19.999 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.25339.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.25339.log.gz 2024-08-18T21:16:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32486.log 2024-08-18T21:16:20.001 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30309.log 2024-08-18T21:16:20.001 INFO:teuthology.orchestra.run.smithi157.stderr: 91.2%/var/log/ceph/ceph-client.admin.28696.log: -- replaced with /var/log/ceph/ceph-client.admin.30880.log.gz 2024-08-18T21:16:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32512.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32512.log.gz 2024-08-18T21:16:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37132.log 2024-08-18T21:16:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32486.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.32486.log.gz 2024-08-18T21:16:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36101.log 2024-08-18T21:16:20.004 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37132.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.37132.log.gz 2024-08-18T21:16:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33705.log 2024-08-18T21:16:20.006 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36101.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36101.log.gz 2024-08-18T21:16:20.006 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-18T21:16:20.008 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33705.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.33705.log.gz 2024-08-18T21:16:20.008 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36285.log 2024-08-18T21:16:20.013 INFO:teuthology.orchestra.run.smithi157.stderr: 89.5% 91.7% -- replaced with /var/log/ceph/ceph-client.admin.28696.log.gz 2024-08-18T21:16:20.013 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30002.log 2024-08-18T21:16:20.013 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-18T21:16:20.014 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30309.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30309.log.gz 2024-08-18T21:16:20.020 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28661.log 2024-08-18T21:16:20.021 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30002.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30002.log.gz 2024-08-18T21:16:20.022 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31952.log 2024-08-18T21:16:20.022 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33835.log 2024-08-18T21:16:20.024 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28661.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28661.log.gz 2024-08-18T21:16:20.024 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25372.log 2024-08-18T21:16:20.025 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36285.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.36285.log.gz 2024-08-18T21:16:20.025 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31952.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31952.log.gz 2024-08-18T21:16:20.025 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31207.log 2024-08-18T21:16:20.027 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.25372.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.25372.log.gz 2024-08-18T21:16:20.027 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28037.log 2024-08-18T21:16:20.028 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31207.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31207.log.gz 2024-08-18T21:16:20.029 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29234.log 2024-08-18T21:16:20.030 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28037.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.28037.log.gz 2024-08-18T21:16:20.030 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32554.log 2024-08-18T21:16:20.032 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29234.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29234.log.gz 2024-08-18T21:16:20.032 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30931.log 2024-08-18T21:16:20.034 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32554.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32554.log.gz 2024-08-18T21:16:20.034 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32341.log 2024-08-18T21:16:20.036 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30931.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.30931.log.gz 2024-08-18T21:16:20.036 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31985.log 2024-08-18T21:16:20.038 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32341.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.32341.log.gz 2024-08-18T21:16:20.038 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31022.log 2024-08-18T21:16:20.040 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31985.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31985.log.gz 2024-08-18T21:16:20.040 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31898.log 2024-08-18T21:16:20.042 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31022.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.31022.log.gz 2024-08-18T21:16:20.042 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29052.log 2024-08-18T21:16:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32827.log 2024-08-18T21:16:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33835.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.33835.log.gz 2024-08-18T21:16:20.044 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31898.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.31898.log.gz 2024-08-18T21:16:20.044 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30090.log 2024-08-18T21:16:20.046 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29052.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29052.log.gz 2024-08-18T21:16:20.046 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31899.log 2024-08-18T21:16:20.048 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30090.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.30090.log.gz 2024-08-18T21:16:20.048 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29417.log 2024-08-18T21:16:20.049 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31899.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31899.log.gz 2024-08-18T21:16:20.049 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30365.log 2024-08-18T21:16:20.050 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30457.log 2024-08-18T21:16:20.051 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.29417.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29417.log.gz 2024-08-18T21:16:20.051 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31688.log 2024-08-18T21:16:20.052 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.30365.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30365.log.gz 2024-08-18T21:16:20.053 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32606.log 2024-08-18T21:16:20.054 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.31688.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31688.log.gz 2024-08-18T21:16:20.055 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28264.log 2024-08-18T21:16:20.056 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.32606.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32606.log.gz 2024-08-18T21:16:20.057 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28264.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28264.log.gz 2024-08-18T21:16:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32827.log: 91.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37561.log 2024-08-18T21:16:20.064 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30457.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30457.log.gz 2024-08-18T21:16:20.066 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32827.log.gz 2024-08-18T21:16:20.071 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31089.log 2024-08-18T21:16:20.072 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37561.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.37561.log.gz 2024-08-18T21:16:20.072 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32748.log 2024-08-18T21:16:20.074 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31089.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.31089.log.gz 2024-08-18T21:16:20.082 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28722.log 2024-08-18T21:16:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32748.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32748.log.gz 2024-08-18T21:16:20.094 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33207.log 2024-08-18T21:16:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28722.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28722.log.gz 2024-08-18T21:16:20.115 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36127.log 2024-08-18T21:16:20.116 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33207.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.33207.log.gz 2024-08-18T21:16:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37641.log 2024-08-18T21:16:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36127.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36127.log.gz 2024-08-18T21:16:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33601.log 2024-08-18T21:16:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37641.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37641.log.gz 2024-08-18T21:16:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32380.log 2024-08-18T21:16:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33601.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.33601.log.gz 2024-08-18T21:16:20.171 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31516.log 2024-08-18T21:16:20.172 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32380.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.32380.log.gz 2024-08-18T21:16:20.186 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36389.log 2024-08-18T21:16:20.188 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31516.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.31516.log.gz 2024-08-18T21:16:20.199 INFO:teuthology.orchestra.run.smithi005.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.d.log.gz 2024-08-18T21:16:20.203 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33757.log 2024-08-18T21:16:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36389.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.36389.log.gz 2024-08-18T21:16:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30671.log 2024-08-18T21:16:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33757.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.33757.log.gz 2024-08-18T21:16:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30295.log 2024-08-18T21:16:20.207 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30671.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.30671.log.gz 2024-08-18T21:16:20.208 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33861.log 2024-08-18T21:16:20.208 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30295.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30295.log.gz 2024-08-18T21:16:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33679.log 2024-08-18T21:16:20.210 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33861.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.33861.log.gz 2024-08-18T21:16:20.210 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37689.log 2024-08-18T21:16:20.212 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33679.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33679.log.gz 2024-08-18T21:16:20.212 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28696.log 2024-08-18T21:16:20.213 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37689.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37689.log.gz 2024-08-18T21:16:20.213 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35517.log 2024-08-18T21:16:20.214 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28696.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28696.log.gz 2024-08-18T21:16:20.214 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28046.log 2024-08-18T21:16:20.215 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35517.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35517.log.gz 2024-08-18T21:16:20.216 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32855.log 2024-08-18T21:16:20.216 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28046.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28046.log.gz 2024-08-18T21:16:20.217 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28391.log 2024-08-18T21:16:20.218 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32855.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.32855.log.gz 2024-08-18T21:16:20.218 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28092.log 2024-08-18T21:16:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28391.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28391.log.gz 2024-08-18T21:16:20.220 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28540.log 2024-08-18T21:16:20.220 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28092.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28092.log.gz 2024-08-18T21:16:20.221 INFO:teuthology.orchestra.run.smithi157.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.g.log.gz 2024-08-18T21:16:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31934.log 2024-08-18T21:16:20.222 INFO:teuthology.orchestra.run.smithi005.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.e.log.gz 2024-08-18T21:16:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28540.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28540.log.gz 2024-08-18T21:16:20.223 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29909.log 2024-08-18T21:16:20.223 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34751.log 2024-08-18T21:16:20.224 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29909.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.29909.log.gz 2024-08-18T21:16:20.224 INFO:teuthology.orchestra.run.smithi005.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.31934.log.gz 2024-08-18T21:16:20.224 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34993.log 2024-08-18T21:16:20.225 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34751.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.34751.log.gz 2024-08-18T21:16:20.226 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36844.log 2024-08-18T21:16:20.226 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38134.log 2024-08-18T21:16:20.227 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34993.log: /var/log/ceph/ceph-client.admin.36844.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.34993.log.gz 2024-08-18T21:16:20.227 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.36844.log.gz 2024-08-18T21:16:20.227 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29067.log 2024-08-18T21:16:20.228 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38134.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38134.log.gz 2024-08-18T21:16:20.228 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33783.log 2024-08-18T21:16:20.228 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31830.log 2024-08-18T21:16:20.229 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29067.log: /var/log/ceph/ceph-client.admin.33783.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.29067.log.gz 2024-08-18T21:16:20.229 INFO:teuthology.orchestra.run.smithi005.stderr: 89.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.33783.log.gz -5 2024-08-18T21:16:20.230 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36792.log 2024-08-18T21:16:20.231 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31830.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.31830.log.gz 2024-08-18T21:16:20.233 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28285.log 2024-08-18T21:16:20.233 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31332.log 2024-08-18T21:16:20.233 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36792.log: /var/log/ceph/ceph-client.admin.28285.log: 89.1% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.36792.log.gz 2024-08-18T21:16:20.233 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28285.log.gz 2024-08-18T21:16:20.233 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36259.log 2024-08-18T21:16:20.233 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38158.log 2024-08-18T21:16:20.234 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31332.log: /var/log/ceph/ceph-client.admin.36259.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.36259.log.gz 2024-08-18T21:16:20.234 INFO:teuthology.orchestra.run.smithi005.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.31332.log.gz 2024-08-18T21:16:20.235 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29093.log 2024-08-18T21:16:20.235 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27948.log 2024-08-18T21:16:20.235 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38158.log: /var/log/ceph/ceph-client.admin.29093.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38158.log.gz 2024-08-18T21:16:20.236 INFO:teuthology.orchestra.run.smithi005.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.29093.log.gz 2024-08-18T21:16:20.236 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35201.log 2024-08-18T21:16:20.237 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.27948.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27948.log.gz 2024-08-18T21:16:20.238 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35201.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.35201.log.gz 2024-08-18T21:16:20.270 INFO:teuthology.orchestra.run.smithi157.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.i.log.gz 2024-08-18T21:16:20.286 INFO:teuthology.orchestra.run.smithi157.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.f.log.gz 2024-08-18T21:16:20.316 INFO:teuthology.orchestra.run.smithi157.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.h.log.gz 2024-08-18T21:16:20.350 INFO:teuthology.orchestra.run.smithi005.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-18T21:16:20.456 INFO:teuthology.orchestra.run.smithi005.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-18T21:16:20.956 INFO:teuthology.orchestra.run.smithi005.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-18T21:16:22.129 INFO:teuthology.orchestra.run.smithi157.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-18T21:16:22.140 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-18T21:16:22.247 INFO:teuthology.orchestra.run.smithi005.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-18T21:16:22.262 INFO:teuthology.orchestra.run.smithi005.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-18T21:16:22.347 INFO:teuthology.orchestra.run.smithi157.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-18T21:16:22.349 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-18T21:16:22.349 INFO:teuthology.orchestra.run.smithi157.stderr:real 0m2.662s 2024-08-18T21:16:22.349 INFO:teuthology.orchestra.run.smithi157.stderr:user 0m9.503s 2024-08-18T21:16:22.349 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m0.467s 2024-08-18T21:16:22.586 INFO:teuthology.orchestra.run.smithi005.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-18T21:16:22.587 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T21:16:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m2.945s 2024-08-18T21:16:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:user 0m11.271s 2024-08-18T21:16:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m0.524s 2024-08-18T21:16:22.588 INFO:tasks.ceph:Archiving logs... 2024-08-18T21:16:22.589 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222/remote/smithi005/log 2024-08-18T21:16:22.590 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-18T21:16:24.244 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222/remote/smithi157/log 2024-08-18T21:16:24.245 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-18T21:16:25.648 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-18T21:16:25.657 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 466, in task thrash_proc.stop_and_join() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 178, in stop_and_join return self.join() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 170, in join self.stopping.set() AttributeError: 'bool' object has no attribute 'set' 2024-08-18T21:16:25.658 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-18T21:16:25.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-18T21:16:25.661 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-18T21:16:25.726 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-18T21:16:25.735 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-18T21:16:25.736 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T21:16:25.738 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T21:16:25.750 INFO:teuthology.orchestra.run.smithi005.stdout: remote refid st t when poll reach delay offset jitter 2024-08-18T21:16:25.750 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================== 2024-08-18T21:16:25.750 INFO:teuthology.orchestra.run.smithi005.stdout:+hv01.front.sepi 67.205.162.81 3 u 19 64 377 0.094 -1.341 2.802 2024-08-18T21:16:25.750 INFO:teuthology.orchestra.run.smithi005.stdout:*hv02.front.sepi 96.245.170.99 3 u 13 64 377 0.098 -2.357 1.848 2024-08-18T21:16:25.750 INFO:teuthology.orchestra.run.smithi005.stdout:+hv03.front.sepi 74.6.168.72 3 u 11 64 377 0.115 -5.861 3.069 2024-08-18T21:16:25.750 INFO:teuthology.orchestra.run.smithi005.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-08-18T21:16:25.752 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-08-18T21:16:25.752 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-08-18T21:16:25.752 INFO:teuthology.orchestra.run.smithi157.stdout:+hv01.front.sepi 67.205.162.81 3 u 18 64 377 0.071 -3.247 1.094 2024-08-18T21:16:25.752 INFO:teuthology.orchestra.run.smithi157.stdout:*hv02.front.sepi 96.245.170.99 3 u 15 64 377 0.080 -1.905 1.022 2024-08-18T21:16:25.752 INFO:teuthology.orchestra.run.smithi157.stdout:+hv03.front.sepi 74.6.168.72 3 u 16 64 377 0.089 -4.460 0.780 2024-08-18T21:16:25.752 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-08-18T21:16:25.752 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-18T21:16:25.766 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-18T21:16:25.766 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-18T21:16:25.800 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-18T21:16:25.897 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-18T21:16:25.934 INFO:teuthology.task.internal:Duration was 1399.421145 seconds 2024-08-18T21:16:25.935 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-18T21:16:25.971 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-18T21:16:25.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-18T21:16:25.974 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-18T21:16:26.015 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-18T21:16:26.015 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T21:16:26.015 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-18T21:16:26.068 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2024-08-18T21:16:26.069 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-18T21:16:26.079 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-18T21:16:26.079 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-18T21:16:26.112 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-18T21:16:26.151 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-18T21:16:26.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-18T21:16:26.184 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-18T21:16:26.250 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-18T21:16:26.260 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-18T21:16:26.260 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-18T21:16:26.272 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-18T21:16:26.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-18T21:16:26.361 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-18T21:16:26.364 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-18T21:16:26.374 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-08-18T21:16:26.377 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2024-08-18T21:16:26.408 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-18T21:16:26.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T21:16:26.447 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-18T21:16:26.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T21:16:26.456 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-18T21:16:26.466 INFO:teuthology.task.internal:Transferring archived files... 2024-08-18T21:16:26.467 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222/remote/smithi005 2024-08-18T21:16:26.467 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-18T21:16:26.512 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859222/remote/smithi157 2024-08-18T21:16:26.512 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-18T21:16:26.532 INFO:teuthology.task.internal:Removing archive directory... 2024-08-18T21:16:26.532 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-18T21:16:26.552 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-18T21:16:26.576 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-18T21:16:26.587 INFO:teuthology.task.internal:Not uploading archives. 2024-08-18T21:16:26.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-18T21:16:26.609 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-18T21:16:26.609 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-18T21:16:26.612 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-18T21:16:26.615 INFO:teuthology.orchestra.run.smithi005.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 18 21:16 /home/ubuntu/cephtest 2024-08-18T21:16:26.625 INFO:teuthology.orchestra.run.smithi157.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 18 21:16 /home/ubuntu/cephtest 2024-08-18T21:16:26.626 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-18T21:16:26.690 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-18T21:16:26.728 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: AttributeError: 'bool' object has no attribute 'set' 2024-08-18T21:16:26.731 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-zstd} rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/pool-create-delete} duration: 1399.4211449623108 failure_reason: '''bool'' object has no attribute ''set''' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-08-18T21:16:26.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-18T21:16:26.821 INFO:teuthology.run:FAIL